quantization

Samsung Labs has released LittleBit, a research method that compresses large language models below one bit per parameter using latent factorization. The work, published on GitHub, aims to shrink model memory footprints far beyond existing 1- and 2-bit quantization approaches, and it is drawing attention from developers discussing how far LLM compression can realistically go without losing accuracy.