quantization

Samsung Labs has released LittleBit, a technique for compressing large language models below one bit per weight using latent factorization. The work aims to shrink model memory requirements far beyond standard quantization, potentially allowing large models to run on much smaller hardware. Developer communities are discussing the approach and its implications for efficient on-device AI.