LittleBit

Samsung Labs has released LittleBit, a method for compressing large language models to below one bit per parameter using latent factorization. The technique promises major memory savings for running LLMs on limited hardware. The release drew quick attention from developers and machine learning researchers discussing its practical implications and benchmarks.