Capability domains
The main capability areas covered by Data.
Data is a focused data and analytics layer. Each domain below names its main components; the reference architecture shows how they connect.
Business intelligence
This domain provides data exploration and dashboarding.
| Capability | Main components | Purpose |
|---|---|---|
| Dashboards and BI | Superset | Explore and visualize analytical data |
Data ingestion and ETL
This domain moves and transforms data between systems.
| Capability | Main components | Purpose |
|---|---|---|
| Ingestion and sync | Studio Data Ingestion, BSQAI API, Temporal and connector containers | Connect sources and destinations through managed ingestion, including customer-packaged Meltano/Singer connectors |
Data discovery
This domain shows users the governed tables they can see.
| Capability | Main components | Purpose |
|---|---|---|
| Data catalog | Studio Data Catalog, BSQAI API, Tuples, Lakekeeper | Search authorized tables and show their structure, owner and grants |
Event streaming
This domain supports event-driven data movement.
| Capability | Main components | Purpose |
|---|---|---|
| Streaming backbone | Kafka | Carry event streams between producers and consumers |
Lakehouse and distributed processing
This domain stores and processes analytical workloads at scale.
| Capability | Main components | Purpose |
|---|---|---|
| Iceberg catalog | Lakekeeper | Govern tenant projects, warehouses, and table metadata |
| Distributed processing | Studio Compute, BSQAI API, Spark Operator | Run Spark clusters and PySpark jobs in profile namespaces |
| ML pipelines and notebooks | Kubeflow, MLflow through the BSQAI API | Build, run, and track ML, DL, and GenAI workflows |
Tenant data services
| Capability | Main components | Purpose |
|---|---|---|
| Data authorization | Tuples | Authorize spaces, datasets and tables per tenant and publish optional Kafka audit events |
Why this matters
Data gives the platform a clear place for data-intensive services that should not be folded into the Foundation layer or the AI application layer.