⬢github first seen 6 h ago, last 6 min ago, peak #7
LiteLLM AI gateway gains traction among developers
Original: BerriAI/litellm
BerriAI's LiteLLM is drawing attention as an open-source AI gateway built around a Rust core with a Python SDK. It lets developers call more than 100 large language model APIs, including Bedrock, Azure OpenAI, Anthropic, VertexAI, vLLM and Nvidia NIM, through a single OpenAI-compatible interface, with cost tracking, guardrails, load balancing and logging built in.
Why now: Developers are actively looking for unified tools to manage multiple LLM providers as AI adoption grows.
BerriAILiteLLMOpenAIAnthropicNvidia
Rank over time, top of the chart is #1. 27 snapshots from 6 h ago to 6 min ago.
Evidence
- BerriAI/litellm · BerriAI · 16
The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]
API: https://socialmediatrends-api.osmike.com/v1/trends/1601242