DualMap: Enabling Both Cache Affinity and Load Balancing for Distributed LLM Serving

Yuan, Ying, Zuo, Pengfei, Wang, Bo · arXiv · 2026