⬢github Python · 60.6K ★ +198 since we first saw it · pushed 12 min ago · NOASSERTION
BerriAI/litellm
The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]
LiteLLM is an open-source AI gateway that lets you call 100+ LLM providers (OpenAI, Anthropic, Bedrock, Azure, Vertex AI, vLLM, etc.) through a single unified OpenAI-format API. It works as a Python SDK or a self-hostable proxy server, with cost tracking, guardrails, load balancing, and logging built in, plus a fast Rust core.
Why now: It's a popular, actively maintained project (60k+ stars) positioning itself as 'the fastest, litest AI gateway' with a new Rust core, amid strong demand for unified LLM infrastructure.
Who it is for: Developers and teams building AI applications who need one API layer across multiple LLM providers.
ai-gatewayanthropicazure-openaibedrockgatewaylangchainlitellmllmllm-gatewayllmops
Stars over our 50 snapshots: 60.4K to 60.6K, since 12 h ago.
Where people talked about it
- ⬢github BerriAI/litellm 12 min ago
API: https://socialmediatrends-api.osmike.com/v1/repos/BerriAI/litellm