LiteLLM OperatorKubernetes-native AI Gateway Management

Deploy and manage production-ready LiteLLM instances with declarative custom resources. Bidirectional config sync lets you use both GitOps and the Admin UI.

Get Started

View on GitHub

📦

Declarative CRDs

Manage LiteLLM instances, organizations, models, teams, users, customers, credentials, guardrails, and API keys as Kubernetes custom resources. Full GitOps compatibility.

🔄

Bidirectional Config Sync

Changes made via CRDs or the Admin UI are kept in sync. Three policies for unmanaged resources — preserve, prune, or adopt.

👥

SSO-Aware Team Management

Three member management modes — CRD authoritative, SSO authoritative, or mixed. Never accidentally destroy SSO-provisioned memberships.

🔑

Automatic Secret Management

Virtual keys are generated via the LiteLLM API and stored in Kubernetes Secrets with owner references for automatic garbage collection.

🚀

Production Ready

HPA, PDB, NetworkPolicy, health probes, security contexts, resource limits, and database migrations out of the box.

🌍

Multiple Install Methods

OLM bundles for OperatorHub and OpenShift, Helm chart for vanilla Kubernetes, or direct Makefile-based install.