search
llama.cpp
Trends
- 1
The GGML machine learning tensor library, best known as the foundation of llama.cpp and local LLM inference, has released version 1.0.0, marking its first stable major release. Developers are discussing the milestone, as the library underpins much of the open-source effort to run large language models on consumer hardware.
Repos
- FrigadeHQ/yogurt Private AI meeting notes that stay on your computer. A free, open-source alternative to Granola for Mac, Windows and Lin
- hyperionaidev/smolmaxxing maxxing the ability to run different LLMs on the smallest devices possible
- huawei-csl/MACaQ SOTA model-agnostic quantization for GGUF, local inference and beyond. Quantize and run text, image, video and audio mod
- ggml-org/ggml Tensor library for machine learning
- ggml-org/llama.cpp LLM inference in C/C++
- AmSach/maple MAPLE: Manifold-Activated Pruning of Latent Experts for Sub-2-BPW MoE LLMs
- hardwiredagent/silicon-forge-arm-neon-study Arm NEON kernel for llama.cpp tiled K-quant matmul - benchmark study, patch and tools