SemShareKV: Efficient KVCache Sharing for Semantically Similar Prompts via Token-Level LSH Matching

Zhao, Xinye, Mastorakis, Spyridon · arXiv · 2025