☰ Datalayer System
Datalayer System provides technical utilities and facilities needed by the other services.
📄️ Home
Kubernetes
📄️ Cert Manager
Check the availability of the Cert Manager Pods.
📄️ Ingress
Kubernetes
📄️ Observer
DEPRECATED - The Datalayer Observer is deprecated and will be removed in a future release. It is replaced by the Datalayer OTEL service that only deploys the OpenTelemetry Collector and relies on the services to be instrumented and to send their telemetry to it.
📄️ OTEL
The datalayer-otel service provides long-term observability storage and querying for the Datalayer Platform. It collects traces, metrics and logs via Apache Pulsar, stores them as Parquet files using Apache DataFusion, and exposes a REST + WebSocket API for querying.
📄️ Shared File System
Datalayer user data is stored on a Shared File System. The File System Storage can be implemented as a:
📄️ OpenFGA
Follow the OpenFGA installation guide.
📄️ Vault
HashiCorp Vault.
📄️ Kafka
Apache Kakfa is an open-source distributed event streaming platform used by thousands of companies for high-performance data pipelines, streaming analytics, data integration, and mission-critical applications.
📄️ Pulsar
Apache Pulsar is an open-source, distributed messaging and streaming platform built for the cloud.
📄️ Solr
Apache Solr Operator
📄️ GPU CUDA
Install CUDA Operator
📄️ Datashim
Datashim needs to be deployed in the cloud to benefit from the Jupyter Content features.
📄️ Falco
Contact us if you want to use Falco with the Datalayer Platform or if you want to contribute to the Datalayer Falco Helm Chart.
📄️ Mailer
Check the availability of the Mailer Pods.
📄️ JupyterHub
- https://zero-to-jupyterhub.readthedocs.io/en/latest/kubernetes/google/step-zero-gcp.html