Small Language Models

AWS Strands Labs has released Strands Decider 2B, a new open source model designed to make quick decisions between options. According to the announcement, the model picks among choices in roughly 115 milliseconds, making it suited to latency-sensitive applications where larger language models would be too slow. The release adds to the growing set of small, specialized open models aimed at specific tasks rather than general-purpose reasoning.

A quantized 27-billion-parameter language model is reported to match frontier AI models on a single task from a coding benchmark. The narrow, specific nature of the claim makes it more believable than sweeping benchmark-superiority claims, but it also means the result says little about overall performance. Readers are debating how much weight such partial benchmark results deserve in judging open and smaller models.