KV cache compression

A new paper describes DeepSeek-v4.1-Flash, a model variant focused on pushing the limits of KV cache compression, a technique that reduces memory use when running large language models. Discussion is centering on whether the compression gains could make inference cheaper and allow the model to run on more modest hardware.