LittleBit

Samsung's AI lab has released LittleBit, a technique that compresses large language models to less than one bit per weight using latent factorization. The approach aims to make big models far cheaper to store and run, and it is drawing attention among machine learning researchers debating how far quantization can go before accuracy collapses.