LaCache: Ladder-Shaped KV Caching for Efficient Long-Context Modeling of Large Language Models

Shi, Dachuan, Fu, Yonggan, Yuan, Xiangchi · arXiv · 2025