⬢github first seen 1 d ago, last 8 min ago, peak #2
vLLM inference engine draws developer attention
Original: vllm-project/vllm
vLLM, an open-source Python project from the vllm-project organisation, provides a high-throughput, memory-efficient engine for running and serving large language models. The repository is currently among the most-engaged projects on GitHub, as developers working with LLMs continue to seek faster and cheaper ways to deploy models in production.
Why now: Interest in efficient open-source tools for serving large language models keeps growing as more teams deploy LLMs.
Rank over time, top of the chart is #1. 2 snapshots from 23 min ago to 8 min ago.
Evidence
- vllm-project/vllm · vllm-project · 16
A high-throughput and memory-efficient inference and serving engine for LLMs
API: https://socialmediatrends-api.osmike.com/v1/trends/2978185