
LiteLLM
#1 in LLM InfrastructureA proxy and SDK to call 100+ LLM APIs in the OpenAI format.
Overview
The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]From the project's GitHub description
Our editorial assessment of LiteLLM is still in review. Facts below come from the repository and our catalogue.
Good for
Screenshots
Images published by the project in its repository.
Technical specifications
Each attribute is labelled with where it came from.
- Software type
- API / Backend serviceLibrary / SDK
- Interface
- Web UIAPISDK
- Runtime
- ServerContainer
- Interaction model
- API-driven
- Target audience
- StartupsEnterprisesDevelopers
- Pricing model
- Open-source / Free self-hostedEnterprise pricing
- License
- Not verified. GitHub could not identify this licence; check the repository before adopting.
Deployment
Detected from files in the repository. We only list what we found evidence for.
The repository ships a Docker Compose setup. Expect to set environment variables before it runs.
- Self-hosting
- Supported
- Docker
- Docker Compose file in the repository
- Kubernetes
- Helm chart or Kubernetes instructions available
- Local installation
- Possible
- Infrastructure
- PostgreSQL (Database)evidence
- API keys
- OpenAI API key (optional), Anthropic API key (optional)
- Setup complexity
- Low
- Install methods
- Docker Compose, Docker, Kubernetes / Helm, Package manager, Cloud/SaaS signup
Alternatives
Also in LLM Infrastructure
Same category, not necessarily equivalent.
Langfuse
Open-source LLM engineering platform for tracing, evals and prompt management.
azure-aigateway
Configure Azure API Management as an AI Gateway for AI models, MCP tools, and agents.
Reviews
Community ratings are kept separate from Beav Scout rankings.
No reviews yet. Community reviews and comments are opening soon; you'll be able to rate LiteLLM once signed in.


