Sheng, Ying

Judging LLM-as-a-Judge with MT-Bench and Chatbot Arena

Zheng, L., Chiang, W.-L., Sheng, Y., Zhuang, S., Wu, Z., Zhuang, Y., Lin, Z., Li, Z., Li, D., Xing, E. P., et al. (2023) · arXiv

Artificial Intelligence in LawTopic Modeling

Cited by 1,888

Efficient Memory Management for Large Language Model Serving with PagedAttention

Kwon, W., Li, Z., Zhuang, S., Sheng, Y., Zheng, L., Yu, C. H., Gonzalez, J., Zhang, H., & Stoica, I. (2023) · Proceedings of the 29th Symposium on Operating Systems Principles

Natural Language Processing TechniquesTopic Modeling

Cited by 1,817

Efficient Memory Management for Large Language Model Serving with PagedAttention

Kwon, W., Li, Z., Zhuang, S., Sheng, Y., Zheng, L., Yu, C. H., Gonzalez, J. E., Zhang, H., & Stoica, I. (2023) · arXiv

Natural Language Processing TechniquesTopic Modeling

Cited by 1,802

SGLang: Efficient Execution of Structured Language Model Programs

Zheng, L., Yin, L., Xie, Z., Sun, C., Huang, J., Yu, C. H., Cao, S., Kozyrakis, C., Stoica, I., Gonzalez, J. E., et al. (2023) · arXiv

Natural Language Processing TechniquesParallel Computing and Optimization Techniques

Cited by 145

Chatbot Arena: An Open Platform for Evaluating LLMs by Human Preference

Chiang, W.-L., Zheng, L., Sheng, Y., Angelopoulos, A. N., Li, T., Li, D., Zhang, H., Zhu, B., Jordan, M., Gonzalez, J. E., et al. (2024) · arXiv

Constraint Satisfaction and OptimizationNatural Language Processing Techniques

Cited by 118

FlexGen: High-Throughput Generative Inference of Large Language Models with a Single GPU

Sheng, Y., Zheng, L., Yuan, B., Li, Z., Ryabinin, M., Fu, D. Y., Xie, Z., Chen, B., Barrett, C., Gonzalez, J. E., et al. (2023) · arXiv

Parallel Computing and Optimization TechniquesNatural Language Processing Techniques

Cited by 86

Clover: Closed-Loop Verifiable Code Generation

Sun, C., Sheng, Y., Padon, O., & Barrett, C. (2023) · arXiv

Logic, programming, and type systemsSoftware Engineering Research

Cited by 43

Clover: Closed-Loop Verifiable Code Generation

Sun, C., Sheng, Y., Padon, O., & Barrett, C. (2024) · Lecture Notes in Computer Science

Logic, programming, and type systemsSoftware Engineering Research

Cited by 43

LMSYS-Chat-1M: A Large-Scale Real-World LLM Conversation Dataset

Zheng, L., Chiang, W.-L., Sheng, Y., Li, T., Zhuang, S., Wu, Z., Zhuang, Y., Li, Z., Lin, Z., Xing, E. P., et al. (2023) · arXiv

Speech and dialogue systemsTopic Modeling

Cited by 27

DafnyBench: A Benchmark for Formal Software Verification

Loughridge, C., Sun, Q., Ahrenbach, S., Cassano, F., Sun, C., Sheng, Y., Mudide, A., Misu, M. R. H., Amin, N., & Tegmark, M. (2024) · arXiv

Logic, programming, and type systemsFormal Methods in Verification

Cited by 6

Towards Optimal Caching and Model Selection for Large Model Inference

Zhu, B., Sheng, Y., Zheng, L., Barrett, C., Jordan, M., & Jiao, J. (2023) · Advances in Neural Information Processing Systems 36

Parallel Computing and Optimization TechniquesAdvanced Neural Network Applications

Cited by 2

Locality-aware Fair Scheduling in LLM Serving

Cao, S., Wang, Y., Mao, Z., Hsu, P.-L., Yin, L., Xia, T., Li, D., Liu, S., Zhang, Y., Zhou, Y., et al. (2025) · arXiv

Cloud Computing and Resource ManagementDistributed and Parallel Computing Systems

Cited by 0