search
AI gateways
Trends
- 1
BerriAI's LiteLLM is drawing attention as an open-source AI gateway built on a Rust core with a Python SDK. It lets developers call more than 100 large language model APIs — including Bedrock, Azure, OpenAI, Anthropic, Vertex AI, vLLM and Nvidia NIM — in OpenAI or native format, with built-in cost tracking, guardrails, load balancing and logging. The project is trending among developers building applications across multiple AI providers.
- 2AI gateways face challenges handling multimodal workloads●TL;DR Multimodal AI workloads passing images, audio, and video create payload-size variances and... # aigroups # llm # d
A roundup of the top five AI gateways for multimodal workloads in 2026 is drawing attention among developers. Multimodal AI workloads that pass images, audio, and video create significant payload-size variances, making gateway selection important for performance and cost. The discussion spans devops, open source, and software engineering communities weighing which platforms best handle mixed media traffic.
- 3Snowflake launches Cortex AI Gateway for AI infrastructure●Building the Modern AI Infrastructure Stack with Cortex AI Gateway
Snowflake has introduced Cortex AI Gateway, positioning it as a foundation for building a modern AI infrastructure stack. The gateway is designed to help enterprises manage and route access to large language models and AI services through Snowflake's data platform. The announcement is drawing attention from companies evaluating how to consolidate AI tooling within their existing data environments.
Repos
- Ebony-Vinyl/dsh-our-free-model 在 dsh 里装上这个插件即可，无需登录、注册或填 API Key，就能使用包括 DeepSeek V4.1 Flash、Kimi K3 在内的前沿模型——完全免费，不限量。 All you do is install this plugi
- zouyuxuan122/dsh-our-free-model 在 dsh 里装上这个插件即可，无需登录、注册或填 API Key，就能使用包括 DeepSeek V4.1 Flash、Kimi K3 在内的前沿模型——完全免费，不限量。 All you do is install this plugi
- yetone/magpie Every agent's model. One place. Codex on DeepSeek, Claude Code on Kimi, from the menu bar.
- BerriAI/litellm The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tra
- dzhng/jevgrep Find code by asking what it does. A CLI for coding agents that uses Jev to discover relevant files and source context.