LiteLLM
Open-source AI gateway and Python SDK that calls 100+ LLM providers in the OpenAI format, with cost tracking, guardrails, load balancing and logging.
Updated
✨ Try AgentScout's free AI image generator →Good for: building AI agents, building voice agents, building MCP servers, evaluating agents, monitoring agents in production, agent security and safety
Use cases
About LiteLLM
LiteLLM is listed in our agent infra category and is aimed at builders. Open-source AI gateway and Python SDK that calls 100+ LLM providers in the OpenAI format, with cost tracking, guardrails, load balancing and logging. Pricing, as the maker states it: Open source + cloud. Maturity: Mature. We last checked the official link on 2026-10-18.
What is LiteLLM?
LiteLLM is an open-source AI gateway that gives you one interface to call 100+ LLM providers, including OpenAI, Anthropic, Gemini, Bedrock and Azure, using the OpenAI format.
You can use it as a Python SDK inside your code or deploy the AI Gateway (proxy server) as a central service for a team, with virtual keys, spend tracking, guardrails, load balancing and an admin dashboard. A hosted proxy and an enterprise tier are also offered.
Sources: the official README and our directory listing, checked 2026-10-18. Official site: litellm.ai.
Who is LiteLLM for?
Developers and platform teams who call several LLM providers and want one OpenAI-compatible API, plus central keys, budgets and spend tracking.
LiteLLM at a glance
- Open source: Yes (MIT License)
- GitHub: BerriAI/litellm · 61,715 stars (as of Oct 21, 2026)
Key features
- One OpenAI-format API for 100+ LLM providers
- Python SDK and self-hosted AI Gateway (proxy server)
- Virtual keys, spend tracking and budgets
- Guardrails, load balancing and fallbacks
- Admin dashboard
- Endpoints for chat, responses, embeddings, images, audio, batches and rerank
LiteLLM FAQ
What is LiteLLM?
LiteLLM is an open-source AI gateway that gives you one interface to call 100+ LLM providers, including OpenAI, Anthropic, Gemini, Bedrock and Azure, using the OpenAI format.
Who is LiteLLM for?
Developers and platform teams who call several LLM providers and want one OpenAI-compatible API, plus central keys, budgets and spend tracking.
Is LiteLLM free?
LiteLLM's pricing, as the maker states it: Open source + cloud. Open-source tools are free to use, though you may still pay for model API usage or a hosted plan. Check the official site for current plans.
Is LiteLLM open source?
Yes. LiteLLM is released under the MIT License, according to its GitHub repository.
What are alternatives to LiteLLM?
Similar tools include Open Connector, opencodex, Portkey AI Gateway, Bifrost, Caspian and Kong Gateway.
LiteLLM ratings and reviews
Be the first to rate LiteLLM: tap 1 to 5 stars below. A written review is optional.
LiteLLM alternatives
Compare 10 LiteLLM alternatives side by side →
Other agent infra tools in our directory. See all agent infra tools →
Open Connector
Open-source auth gateway connecting SaaS apps to AI agents via SDK, CLI and MCP.
opencodex
A local provider proxy that lets OpenAI Codex (CLI, app and SDK) and Claude Code run on other model providers such as Claude, Gemini, Grok, DeepSeek or local Ollama models.
Portkey AI Gateway
Fast open-source AI gateway that routes requests to hundreds of LLMs through one API with fallbacks, load balancing and built-in guardrails.
Bifrost
High-performance AI gateway from Maxim that unifies 20+ LLM providers behind one OpenAI-compatible API and acts as an MCP and agent gateway.
Caspian
An open-source communication SDK that lets AI agents send and receive messages over email, WhatsApp, Slack, Discord and other channels.
Kong Gateway
Cloud-native API, LLM and MCP gateway that adds routing, auth, multi-LLM support, semantic security and MCP traffic analytics through plugins.
Popular searches with this tool
🏆 Ranked in: LiteLLM alternatives · Kong Gateway alternatives
🔁 Listed in: Kong Gateway alternatives
🧭 Task guides: Voice and phone agents for building AI agents · Guardrail and policy tools for agent security · Agent frameworks and SDKs for building MCP servers
💲 Estimate API cost: compare per-request and monthly costs for GPT, Claude, Gemini and Grok models.
Badge for makers
Built LiteLLM? Add this badge to your README or site. It links back to this page. About badges
