⬢github first seen 23 h ago, last 7 min ago, peak #7

LiteLLM AI gateway gains traction among developers

Original: BerriAI/litellm

BerriAI's LiteLLM, an open-source AI gateway written with a Rust core and Python SDK, is drawing attention on GitHub. The tool lets developers call more than 100 large language model APIs in OpenAI or native formats, with built-in cost tracking, guardrails, load balancing and logging across providers such as AWS Bedrock, Azure, Anthropic, Vertex AI, vLLM and Nvidia NIM.

Why now: Developers are actively looking for unified gateways to manage multiple LLM providers as AI adoption grows.

BerriAILiteLLMOpenAIAnthropicAWS Bedrock

Open on github →

Rank over time, top of the chart is #1. 24 snapshots from 5 h ago to 7 min ago.

Evidence

• BerriAI/litellm · BerriAI · 16

  The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]

API: https://socialmediatrends-api.osmike.com/v1/trends/1601242