search
llama.cpp
Trends
- 1Developer Breaks Down llama.cpp Configuration for Qwen 3.8B●Understanding My llama.cpp Qwen 3.8 Configuration I've been tuning llama.cpp for local AI development, and the command l
A developer has published a parameter-by-parameter walkthrough of their llama.cpp setup for running the Qwen 3 8B model locally, explaining what each command-line flag does and how the options are tuned for maximum performance on their hardware. The guide is aimed at people running AI models on their own machines, where cryptic command-line options often make local inference setups hard to understand and reproduce.
Repos
- Vibra-Ingenn/Janus Janus is a API router for AI models written in Go and has a Vulkan Model runner
- ollaya-dev/ollaya Run open decision models locally: pull and serve Laya, decider, NLI and GLiClass behind a TypeSafe-compatible API. Ollam
- kvmem/kvmem-llama.cpp
- magnitudedev/magnitude Open source inference engine for agents that optimizes itself for your exact hardware. Compiles and tunes its kernels on
- Rizzo-AI-Academy/rizzo-flow The open, local take on Jev: typed decisions from an LLM, without generating a single token
- IterateAI/lifeboat-releases Lifeboat — downloads for macOS, Windows and Linux, plus Docker and Kubernetes install instructions. Run language models