search
llama.cpp
Trends
- 1
The GGML machine learning tensor library, best known as the foundation of llama.cpp and local LLM inference, has released version 1.0.0, marking its first stable major release. Developers are discussing the milestone, as the library underpins much of the open-source effort to run large language models on consumer hardware.
Repos
- FrigadeHQ/yogurt Private AI meeting notes that stay on your computer. A free, open-source alternative to Granola for Mac, Windows and Lin
- hyperionaidev/smolmaxxing maxxing the ability to run different LLMs on the smallest devices possible
- huawei-csl/MACaQ SOTA model-agnostic quantization for GGUF, local inference and beyond. Quantize and run text, image, video and audio mod
- AmSach/maple MAPLE: Manifold-Activated Pruning of Latent Experts for Sub-2-BPW MoE LLMs
- ggml-org/llama.cpp LLM inference in C/C++
- ggml-org/ggml Tensor library for machine learning
- sdalberto/ia-da-sobrevivencia Assistente de sobrevivência 100% offline para Windows, Linux e macOS: guias com fontes (água, fogo, comida, primeiros so
- hardwiredagent/silicon-forge-arm-neon-study Arm NEON kernel for llama.cpp tiled K-quant matmul - benchmark study, patch and tools