CacheBlend: Fast Large Language Model Serving for RAG with Cached Knowledge Fusion

Yao, Jiayi, Li, Hanchen, Liu, Yuhan · arXiv · 2024