Reference Architecture
A high-level view of how AI services fit together.
AI combines product-facing interfaces with tenant-aware application services, model serving, retrieval, tools, and observability.
Architecture view
AI domains
| Domain | Main role | Example components |
|---|---|---|
| User experience | Provide chat, files, Agents, MCP, models, and administration | AI Web Portal |
| API and orchestration | Expose tenant-aware application services and workflows | BSQAI API, Temporal |
| Tenant lifecycle | Reconcile tenant identity and optional platform resources | BSQAI Tenant Operator, PlatformTenant |
| Model lifecycle | Import, register, and observe models | Model Installer, MLflow |
| Model access and inference | Route and execute model requests | LiteLLM, KServe, vLLM |
| Tools and search | Connect approved MCP and web-search providers | MCP Gateway, MCP Lifecycle Operator |
| Retrieval and documents | Convert, embed, store, and retrieve content | Docling, Milvus |
| AI observability | Trace application and inference operations | OpenTelemetry, MLflow, Grafana Alloy |
Design intent
Applications integrate with the portal or BSQAI API. Internal model, storage, workflow, and tool components can evolve without changing those primary product interfaces. Tenant identity and authorization remain attached as requests move through each layer.