RotateKV: Accurate and Robust 2-Bit KV Cache Quantization for LLMs via Outlier-Aware Adaptive Rotations

Su, Zunhai, Chen, Zhe, Shen, Wang · arXiv · 2025