Expected Attention: KV Cache Compression by Estimating Attention from Future Queries Distribution

Devoto, Alessio, Jeblick, Maximilian, Jégou, Simon · arXiv · 2025