ZipCache: Accurate and Efficient KV Cache Quantization with Salient Token Identification

He, Yefei, Zhang, Luoming, Wu, Weijia · arXiv · 2024