search
vLLM
Trends
Nothing in this window yet.
Repos
- aryamandarda/tamserve Live, multi-camera object tracking with SAM3, SAM 2 and EdgeTAM, on one GPU or many. One model per GPU serves every came
- mit-han-lab/pear Training Reasoning Models in Simulation to Natively Use Real Robots
- huawei-csl/MACaQ SOTA model-agnostic quantization for GGUF, local inference and beyond. Quantize and run text, image, video and audio mod
- higurashi-ai/Haru Haru: a low-latency, multilingual, full-duplex spoken dialogue model
- OmniJev/Flide 🔥🔥 The extremely fast inference engine for decision model
- garritfra/llmtee Self-hosted LLM proxy
- flitai-io/gpuworks A ~45 MB MaaS platform: one cluster across public and private clouds, on any mix of accelerators.
- samir-sarwar/samir-vllm small LLM inference engine from scratch, w/ 6+ hours of youtube tutorials & 85+ pages of handwritten notes included
- NeuraCryption/SPECTRA Compress any LLM in seconds, load it for inference and in one click you have an AI that could have taken hours of vLLM c