Li, Yuanzhi

LoRA: Low-Rank Adaptation of Large Language Models

Hu, E. J., Shen, Y., Wallis, P., Allen-Zhu, Z., Li, Y., Wang, S., Wang, L., & Chen, W. (2021) · arXiv

Domain Adaptation and Few-Shot LearningTopic Modeling

Cited by 13,453

Sparks of Artificial General Intelligence: Early experiments with GPT-4

Bubeck, S., Chandrasekaran, V., Eldan, R., Gehrke, J., Horvitz, E., Kamar, E., Lee, P., Lee, Y. T., Li, Y., Lundberg, S., et al. (2023) · arXiv

Topic ModelingArtificial Intelligence Applications

Cited by 1,526

A Theoretical Analysis of NDCG Type Ranking Measures

Wang, Y., Wang, L., Li, Y., He, D., Liu, T.-Y., & Chen, W. (2013) · arXiv

Information Retrieval and Search BehaviorRecommender Systems and Techniques

Cited by 351

A Latent Variable Model Approach to PMI-based Word Embeddings

Arora, S., Li, Y., Liang, Y., Ma, T., & Risteski, A. (2016) · Transactions of the Association for Computational Linguistics

Topic ModelingNatural Language Processing Techniques

Cited by 286

Linear Algebraic Structure of Word Senses, with Applications to Polysemy

Arora, S., Li, Y., Liang, Y., Ma, T., & Risteski, A. (2018) · Transactions of the Association for Computational Linguistics

Topic ModelingNatural Language Processing Techniques

Cited by 186

Can Generalist Foundation Models Outcompete Special-Purpose Tuning? Case Study in Medicine

Nori, H., Lee, Y. T., Zhang, S., Carignan, D., Edgar, R., Fusi, N., King, N., Larson, J., Li, Y., Liu, W., et al. (2023) · arXiv

Topic ModelingArtificial Intelligence in Healthcare and Education

Cited by 178

Towards Understanding Ensemble, Knowledge Distillation and Self-Distillation in Deep Learning

Allen-Zhu, Z., & Li, Y. (2020) · arXiv

Domain Adaptation and Few-Shot LearningMachine Learning and Algorithms

Cited by 178

Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone

Abdin, M., Aneja, J., Awadalla, H., Awadallah, A., Awan, A. A., Bach, N., Bahree, A., Bakhtiari, A., Bao, J., Behl, H., et al. (2024) · arXiv

Topic ModelingNatural Language Processing Techniques

Cited by 166

Textbooks Are All You Need

Gunasekar, S., Zhang, Y., Aneja, J., Mendes, C. C. T., Del Giorno, A., Gopi, S., Javaheripi, M., Kauffmann, P., de Rosa, G., Saarikivi, O., et al. (2023) · arXiv

Software Engineering ResearchTopic Modeling

Cited by 138

Length Generalization in Arithmetic Transformers

Jelassi, S., d'Ascoli, S., Domingo-Enrich, C., Wu, Y., Li, Y., & Charton, F. (2023) · arXiv

Topic ModelingAdvanced Neural Network Applications

Cited by 76

TinyStories: How Small Can Language Models Be and Still Speak Coherent English?

Eldan, R., & Li, Y. (2023) · arXiv

Topic ModelingNatural Language Processing Techniques

Cited by 52

Phi-4 Technical Report

Abdin, M., Aneja, J., Behl, H., Bubeck, S., Eldan, R., Gunasekar, S., Harrison, M., Hewett, R. J., Javaheripi, M., Kauffmann, P., et al. (2024) · arXiv

Topic ModelingNatural Language Processing Techniques

Cited by 31

OpenAI GPT-5 System Card

Singh, A., Fry, A., Perelman, A., Tart, A., Ganesh, A., El-Kishky, A., McLaughlin, A., Low, A., Ostrow, A., Ananthram, A., et al. (2026) · arXiv

Topic ModelingNatural Language Processing Techniques

Cited by 26

Physics of language models: Part 3.3, knowledge capacity scaling laws

Allen-Zhu, Z., & Li, Y. (2025) · SSRN Electronic Journal

Topic ModelingNatural Language Processing Techniques

Cited by 17

Physics of Language Models: Part 3.1, Knowledge Storage and Extraction

Allen-Zhu, Z., & Li, Y. (2023) · arXiv

Topic ModelingNatural Language Processing Techniques

Cited by 14

Physics of Language Models: Part 3.2, Knowledge Manipulation

Allen-Zhu, Z., & Li, Y. (2025) · SSRN Electronic Journal

Topic ModelingNatural Language Processing Techniques

Cited by 8

Physics of Language Models: Part 3.2, Knowledge Manipulation

Allen-Zhu, Z., & Li, Y. (2023) · arXiv

Topic ModelingNatural Language Processing Techniques

Cited by 8

Plan, Eliminate, and Track - Language Models are Good Teachers for Embodied Agents

Wu, Y., Min, S. Y., Bisk, Y., Salakhutdinov, R., Azaria, A., Li, Y., Mitchell, T., & Prabhumoye, S. (2023) · arXiv

AI-based Problem Solving and PlanningReinforcement Learning in Robotics

Cited by 7

SmartPlay: A Benchmark for LLMs as Intelligent Agents

Wu, Y., Tang, X., Mitchell, T. M., & Li, Y. (2023) · arXiv

Artificial Intelligence in GamesAI-based Problem Solving and Planning

Cited by 6

Efficient RLHF: Reducing the Memory Usage of PPO

Santacroce, M., Lu, Y., Yu, H., Li, Y., & Shen, Y. (2023) · arXiv

Reinforcement Learning in RoboticsNatural Language Processing Techniques

Cited by 4