Open WebUI
Open WebUI is a managed AI chat interface deployed on a dedicated k0s cluster. It provides a user-friendly web interface for interacting with large language models (LLMs) via OpenAI-compatible inference endpoints.
Key Features
- Dedicated deployment — Each customer gets a fully isolated Open WebUI instance on a dedicated cluster
- Full customer control — Manage users, configure settings, and customize the experience
- External LLM connectivity — Connect to any OpenAI-compatible inference endpoint (e.g., Nebul Inference)
- RAG support — Upload documents and use Retrieval-Augmented Generation via integrated Qdrant vector database
- SSO integration — Keycloak OIDC for enterprise identity provider integration
- Custom domains — Use your own domain with automated TLS certificates via cert-manager
Architecture
| Component | Technology |
|---|---|
| Application | Open WebUI |
| Database | Managed PostgreSQL (Percona Operator) with PgBouncer |
| Vector Store | Qdrant |
| Cluster | k0s on OpenStack via k0smotron |
| Ingress | F5 NGINX Ingress Controller |
| Certificates | cert-manager with Let's Encrypt |
| Backup | Velero (cluster) + PGBackRest (PostgreSQL) |
Backup
- Cluster-level: Velero-based backups with configurable schedule and retention
- Database: Full and differential PostgreSQL backups via PGBackRest