Cheng, Yihua

CacheGen: KV Cache Compression and Streaming for Fast Large Language Model Serving

Liu, Y., Li, H., Cheng, Y., Ray, S., Huang, Y., Zhang, Q., Du, K., Yao, J., Lu, S., Ananthanarayanan, G., et al. (2024) · Proceedings of the ACM SIGCOMM 2024 Conference

Topic ModelingNatural Language Processing Techniques

Cited by 118

CacheBlend: Fast Large Language Model Serving for RAG with Cached Knowledge Fusion

Yao, J., Li, H., Liu, Y., Ray, S., Cheng, Y., Zhang, Q., Du, K., Lu, S., & Jiang, J. (2025) · Proceedings of the Twentieth European Conference on Computer Systems

Topic ModelingNatural Language Processing Techniques

Cited by 75

CacheBlend: Fast Large Language Model Serving for RAG with Cached Knowledge Fusion

Yao, J., Li, H., Liu, Y., Ray, S., Cheng, Y., Zhang, Q., Du, K., Lu, S., & Jiang, J. (2024) · arXiv

Topic ModelingNatural Language Processing Techniques

Cited by 3

LMCache: An Efficient KV Cache Layer for Enterprise-Scale LLM Inference

Liu, Y., Cheng, Y., Yao, J., An, Y., Chen, X., Feng, S., Huang, Y., Shen, S., Zhang, R., Du, K., et al. (2025) · arXiv

Parallel Computing and Optimization TechniquesNatural Language Processing Techniques

Cited by 2

CacheGen: KV Cache Compression and Streaming for Fast Large Language Model Serving

Liu, Y., Li, H., Cheng, Y., Ray, S., Huang, Y., Zhang, Q., Du, K., Yao, J., Lu, S., Ananthanarayanan, G., et al. (2023) · arXiv

Topic ModelingNatural Language Processing Techniques

Cited by 0