Zheng, Lianmin

Efficient Memory Management for Large Language Model Serving with PagedAttention

Kwon, W., Li, Z., Zhuang, S., Sheng, Y., Zheng, L., Yu, C. H., Gonzalez, J., Zhang, H., & Stoica, I. (2023) · Proceedings of the 29th Symposium on Operating Systems Principles

Natural Language Processing TechniquesTopic Modeling

Cited by 1,817

Efficient Memory Management for Large Language Model Serving with PagedAttention

Kwon, W., Li, Z., Zhuang, S., Sheng, Y., Zheng, L., Yu, C. H., Gonzalez, J. E., Zhang, H., & Stoica, I. (2023) · arXiv

Natural Language Processing TechniquesTopic Modeling

Cited by 1,802

BlendServe: Optimizing Offline Inference with Resource-Aware Batching

Zhao, Y., Yang, S., Zhu, K., Zheng, L., Kasikci, B., Qiao, Y., Zhou, Y., Xing, J., & Stoica, I. (2026) · Proceedings of the 31st ACM International Conference on Architectural Support for Programming Languages and Operating Systems, Volume 2

Cloud Computing and Resource ManagementParallel Computing and Optimization Techniques

Cited by 0