Compare / Gateway

LiteLLM

Open-source, self-hosted LLM proxy with virtual keys, multi-level budgets and an experimental FOCUS export.

GatewayVendor: BerriAILast checked 2026-10-20Not vendor-verified
Hard budgets (team / key / user) (scored)yes
Budgets per virtual key, team, team member, internal user, customer and agent; multiple budget windows; optional fail-closed enforcement. Requires a Postgres database; per-model budgets need Enterprise
Rate & spend limits (scored)yes
RPM/TPM and max parallel requests per key, user, team, model and agent
Cost attribution / chargeback tags (scored)yes
Spend by key, user, team and org; tag-based spend tracking
FOCUS export (scored)yes version: 1.2
Experimental export conforming to FOCUS 1.2 (Parquet/CSV to S3, GCS, Vantage; also Ternary and Mavvrik connectors)
EU data residency option (scored)yes
Self-hosted: runs in any region you choose
Public pricing (scored)yes
Open sourceyes
MIT for the core; the enterprise/ directory is under a commercial license
HostingSelf-host
Self-hosted or air-gapped in your own infrastructure
Supported providers / models100+
"Call 100+ LLM APIs"
Cachingyes
Redis/Valkey exact cache and Redis semantic cache
Pricing modelOpen source + Enterprise license
Public price pointsOSS free; Enterprise: custom pricing (talk to sales), 30-day trial key

"unknown" means we could not confirm it in public sources. Vendors can send evidence to update a cell; see get verified. Verification never changes the scoring rules.