LittleBit

Samsung Labs has published LittleBit, a new technique for compressing large language models to below one bit per parameter using latent factorization. The work, released openly on GitHub, promises to shrink model memory requirements far beyond existing quantization approaches, drawing attention from developers and researchers interested in running capable models on limited hardware.