⬢github first seen 3 h ago, last 8 min ago, peak #7

LiteLLM gateway gains traction among AI developers

Original: BerriAI/litellm

The open-source LiteLLM project from BerriAI is drawing attention as a lightweight AI gateway that lets developers call more than 100 large language model APIs through a single interface, in OpenAI or native formats. Built around a Rust core with a Python SDK, it offers cost tracking, guardrails, load balancing and logging across providers including Bedrock, Azure, Anthropic, Vertex AI, vLLM and Nvidia NIM. Developers are discussing it as a practical way to manage multiple model providers in one place.

Why now: Interest in tools that simplify routing and managing multiple LLM providers is high as AI adoption grows.

BerriAILiteLLMOpenAIAnthropicAWS Bedrock

Open on github →

Rank over time, top of the chart is #1. 14 snapshots from 3 h ago to 8 min ago.

Evidence

• BerriAI/litellm · BerriAI · 16

  The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]

API: https://socialmediatrends-api.osmike.com/v1/trends/1601242