Training Language Models to Follow Instructions with Human Feedback
The DOI matches its Crossref record; 2 of the 2 references it cites were found in a registry or an index.
Abstract
Making language models bigger does not inherently make them better at following a user's intent. For example, large language models can generate outputs that are untruthful, toxic, or simply not helpful to the user. In other words, these models are not aligned with their users. In this paper, we show an avenue for aligning language models with user intent on a wide range of tasks by fine-tuning with human feedback. Starting with a set of labeler-written prompts and prompts submitted through the OpenAI API, we collect a dataset of labeler demonstrations of the desired model behavior, which we use to fine-tune GPT-3 using supervised learning. We then collect a dataset of rankings of model outputs, which we use to further fine-tune this supervised model using reinforcement learning from human feedback. We call the resulting models InstructGPT. In human evaluations on our prompt distribution, outputs from the 1.3B parameter InstructGPT model are preferred to outputs from the 175B GPT-3, despite having 100x fewer parameters. Moreover, InstructGPT models show improvements in truthfulness and reductions in toxic output generation while having minimal performance regressions on public NLP datasets. Even though InstructGPT still makes simple mistakes, our results show that fine-tuning with human feedback is a promising direction for aligning language models with human intent.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Existing literature (Ouyang et al., 2022) does not fully describe the details of these models, such as the pretraining corpus, model sizes, and model biases.”
From Self-Refine: Iterative Refinement with Self-Feedback (2023) · cites this paper as Ouyang et al., 2022
Experimental — accuracy not yet measuredIn the citing paper
“Specifically, providers mitigate race and gender bias through reinforcement learning from human feedback (RLHF), adversarial stress-testing known as red teaming, and hard-coded refusals governed by the provider's own content policies [6, 43, 71].”
From All Public Voices Are Equal, But Are Some More Equal Than Others to LLMs? (2026) · cites this paper as [71]
In the citing paper
“Fine-tuning a model from human feedback at scale, using preference data from paid raters or drawn from a large and willing user base, is an especially potent technique.It has the potential not only to shape a model's responses to better reflect user norms (for better or worse), but also to filter out toxic language, improve factual accuracy, and mitigate the tendency to fabricate information.”
From Talking about Large Language Models (2024) · cites this paper as [26]
In the citing paper
“These include general competencies such as in-context learning (ICL) [13], chain-of-thought (CoT) [17] reasoning, and instruction following [25], as well as task-specialized skills like mathematical reasoning [30].”
From A Survey of Large Language Models (2026) · cites this paper as [25]
In the citing paper
“When external reward models or ground-truth answers are available, rejection sampling can also be applied to select higher-quality responses from multiple candidates [25].”
From A Survey of Large Language Models (2026) · cites this paper as [25]
41 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
The publisher hasn’t deposited this paper’s reference list.
Cited by
Items 201–300 of 4,340
Jiang, P., Sonne, C., Li, W., You, F., & You, S. (2024) · Engineering · doi:10.1016/j.eng.2024.04.002 · Cited by 164
Large Language Model Instruction Following: A Survey of Progresses and Challenges
Lou, R., Zhang, K., & Yin, W. (2024) · Computational Linguistics · doi:10.1162/coli_a_00523 · Cited by 197
InstructDiffusion: A Generalist Modeling Interface for Vision Tasks
Geng, Z., Yang, B., Hang, T., Li, C., Gu, S., Zhang, T., Bao, J., Zhang, Z., Li, H., Hu, H., et al. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01208 · Cited by 247
HIVE: Harnessing Human Feedback for Instructional Visual Editing
Zhang, S., Yang, X., Feng, Y., Qin, C., Chen, C.-C., Yu, N., Chen, Z., Wang, H., Savarese, S., Ermon, S., et al. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00862 · Cited by 219
Sharma, M., Tong, M., Korbak, T., Duperrouzel, D., Was, H., Korbak, J., Cheng, M., Askell, A., Bai, Y., Brain, C., et al. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2310.13548 · Cited by 1,313
“Finetuning language models with RLHF improves the quality of their outputs as rated by human evaluators (Ouyang et al., 2022; Bai et al., 2022a).”
Self-citationMulti-Modal Hallucination Control by Visual Information Grounding
Favero, A., Zancato, L., Trager, M., Choudhary, S., Perera, P., Achille, A., Swaminathan, A. D., & Soatto, S. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01356 · Cited by 371
Large Language Models Can Be Easily Distracted by Irrelevant Context
Shi, F., Chen, X., Misra, K., Scales, N., Dohan, D., Chi, E., Schärli, N., & Zhou, D. (2023) · arXiv · doi:10.48550/arxiv.2302.00093 · Cited by 134
“In addition to demonstrating how to handle irrelevant information via exemplars, we also investigate the usage of task-specific instructions (Wei et al., 2021; Sanh et al., 2021; Ouyang et al., 2022; Suzgun et al., 2022; Chung et al., 2022), where we prepend an instruction sentence “feel free to ignore irrelevant info…”
BackgroundMethodIs ChatGPT accurate and reliable in answering questions regarding head and neck cancer?
Kuşcu, O., Pamuk, A. E., Sütay Süslü, N., & Hosal, S. (2023) · Frontiers in Oncology · doi:10.3389/fonc.2023.1256459 · Cited by 117
MCQGen: A Large Language Model-Driven MCQ Generator for Personalized Learning
Hang, C. N., Tan, C. W., & Yu, P.-D. (2024) · IEEE Access · doi:10.1109/access.2024.3420709 · Cited by 151
Survey of Different Large Language Model Architectures: Trends, Benchmarks, and Challenges
Shao, M., Basit, A., Karri, R., & Shafique, M. (2024) · IEEE Access · doi:10.1109/access.2024.3482107 · Cited by 179
Red Teaming Language Models to Reduce Harms: Methods, Scaling Behaviors, and Lessons Learned
Ganguli, D., Lovitt, L., Kernion, J., Askell, A., Bai, Y., Kadavath, S., Mann, B., Perez, E., Schiefer, N., Ndousse, K., et al. (2022) · arXiv · doi:10.48550/arxiv.2209.07858 · Cited by 130
“These types of models are already deployed [41] and we believe our data can help shed further light on their strengths and weaknesses.”
BackgroundSelf-citationHarmful Fine-tuning Attacks and Defenses for Large Language Models: A Survey
Huang, T., Hu, S., İlhan, F., Tekin, S. F., & Liu, L. (2026) · ACM Computing Surveys · doi:10.1145/3817114 · Cited by 141
AI-Powered Educational Agents: Opportunities, Innovations, and Ethical Challenges
Esparza, D. M. C. (2025) · Information · doi:10.3390/info16060469 · Cited by 160
No Need to Lift a Finger Anymore? Assessing the Quality of Code Generation by ChatGPT
Liu, Z., Tang, Y., Luo, X., Zhou, Y., & Zhang, L. F. (2024) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2024.3392499 · Cited by 128
“ChatGPT [12], [31], implemented atop GPT-3.”
BackgroundMethodInfluentialLLM for SoC Security: A Paradigm Shift
Saha, D., Tarek, S., Yahyaei, K., Saha, S. K., Zhou, J., Tehranipoor, M., & Farahmandi, F. (2024) · IEEE Access · doi:10.1109/access.2024.3427369 · Cited by 93
LLM-Grounder: Open-Vocabulary 3D Visual Grounding with Large Language Model as an Agent
Yang, J., Chen, X., Qian, S., Madaan, N., Iyengar, M., Fouhey, D. F., & Chai, J. Y. (2024) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra57147.2024.10610443 · Cited by 212
Interleaved Vision-and-Language Generation via Generative Voken
Zheng, K., He, X., & Wang, X. E. (2026) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv61042.2026.00054 · Cited by 128
Zheng, S., Pan, K., Liu, J., & Chen, Y. (2024) · Reliability Engineering & System Safety · doi:10.1016/j.ress.2024.110382 · Cited by 127
Barman, D., Guo, Z., & Conlan, O. (2024) · Machine Learning with Applications · doi:10.1016/j.mlwa.2024.100545 · Cited by 92
Li, J., Liu, Y., Fan, W., Wei, X.-Y., Liu, H., Tang, J., & Li, Q. (2024) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2024.3393356 · Cited by 83
Deep learning for cross-domain data fusion in urban computing: Taxonomy, advances, and outlook
Zou, X., Yan, Y., Hao, X., Hu, Y., Wen, H., Liu, E., Zhang, J., Li, Y., Li, T., Zheng, Y., et al. (2024) · Information Fusion · doi:10.1016/j.inffus.2024.102606 · Cited by 177
GSVA: Generalized Segmentation via Multimodal Large Language Models
Xia, Z., Han, D., Han, Y., Pan, X., Song, S., & Huang, G. M. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00370 · Cited by 304
Usable XAI: 10 Strategies Towards Exploiting Explainability in the LLM Era
Wu, X., Zhao, H., Zhu, Y., Shi, Y., Yang, F., Hu, L., Liu, T., Zhaı, X., Yao, W., Li, J., et al. (2026) · ACM Transactions on Knowledge Discovery from Data · doi:10.1145/3816150 · Cited by 150
Evolution and Prospects of Foundation Models: From Large Language Models to Large Multimodal Models
Chen, Z., Xu, L., Zheng, H., Chen, L., Tolba, A. K. R., Zhao, L., Yu, K., & Feng, H. (2024) · Computers, materials & continua/Computers, materials & continua (Print) · doi:10.32604/cmc.2024.052618 · Cited by 176
Graph Retrieval-Augmented Generation for Large Language Models: A Survey
Procko, T. T., & Ochoa, O. (2024) · 2024 Conference on AI, Science, Engineering, and Technology (AIxSET) · doi:10.1109/aixset62544.2024.00030 · Cited by 125
An extensive benchmark study on biomedical text generation and mining with ChatGPT
Chen, Q., Sun, H., Liu, H., Jiang, Y., Ran, T., Jin, X., Xiao, X., Lin, Z., Chen, H., & Niu, Z. (2023) · Bioinformatics · doi:10.1093/bioinformatics/btad557 · Cited by 97
PromptMagician: Interactive Prompt Engineering for Text-to-Image Creation
Feng, Y., Wang, X., Wong, K. K., Wang, S., Lu, Y., Zhu, M., Wang, B., & Chen, W. (2023) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2023.3327168 · Cited by 124
Decision-guided chatbots and cognitive styles in interdisciplinary learning
Iku-Silan, A., Hwang, G., & Chen, C. (2023) · Computers & Education · doi:10.1016/j.compedu.2023.104812 · Cited by 134
VideoLLM-online: Online Video Large Language Model for Streaming Video
Chen, J., Lv, Z., Wu, S., Lin, K. Q., Song, C., Gao, D., Liu, J.-W., Gao, Z., Mao, D., & Shou, M. Z. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01742 · Cited by 368
Adaptive Attacks Break Defenses Against Indirect Prompt Injection Attacks on LLM Agents
Zhan, Q., Fang, R., Panchal, H. S., & Kang, D. (2025) · Findings of the Association for Computational Linguistics: NAACL 2025 · doi:10.18653/v1/2025.findings-naacl.395 · Cited by 124
Less-to-More Generalization: Unlocking More Controllability by In-Context Generation
Wu, S., Huang, M., Wu, W. Y., Cheng, Y., Ding, F., & He, Q. (2025) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.01736 · Cited by 168
Large Language Models Are State-of-the-Art Evaluators of Translation Quality
Kocmi, T., & Federmann, C. (2023) · arXiv · doi:10.48550/arxiv.2302.14520 · Cited by 122
DriveLLM: Charting the Path Toward Full Autonomous Driving With Large Language Models
Cui, Y., Huang, S.-C., Zhong, J.-M., Liu, Z., Wang, Y.-T., Sun, C., Li, B., Wang, X., & Khajepour, A. (2024) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2023.3327715 · Cited by 122
AIGC challenges and opportunities related to public safety: A case study of ChatGPT
Guo, D., Chen, H., Wu, R., & Wang, Y. (2023) · Journal of Safety Science and Resilience · doi:10.1016/j.jnlssr.2023.08.001 · Cited by 108
OmniHuman-1: Rethinking the Scaling-Up of One-Stage Conditioned Human Animation Models
Lin, G., Jiang, J., Yang, J., Zheng, Z., Liang, C., Zhang, Y., & Liu, J. (2025) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.01285 · Cited by 174
The limitations and ethical considerations of ChatGPT
Hua, S., Jin, S., & Jiang, S. (2024) · Data Intelligence · doi:10.1162/dint_a_00243 · Cited by 120
“The models can also be subjected to multiple probes, tests, and attacks to identify potential problems and solve them before they are released through Red Teaming [4].”
BackgroundLLM-Based Test-Driven Interactive Code Generation: User Study and Empirical Evaluation
Fakhoury, S., Naik, A., Sakkas, G., Chakraborty, S., & Lahiri, S. K. (2024) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2024.3428972 · Cited by 120
Radiology-GPT: A large language model for radiology
Liu, Z., Li, Y., Shu, P., Zhong, A., Jiang, H., Pan, Y., Yang, L., Ju, C., Wu, Z., Ma, C., et al. (2025) · Meta-Radiology · doi:10.1016/j.metrad.2025.100153 · Cited by 53
Fairness and Bias in Algorithmic Hiring: A Multidisciplinary Survey
Fabris, A., Baranowska, N., Dennis, M. J., Graus, D., Hacker, P., Saldivar, J., Zuiderveen Borgesius, F., & Biega, A. J. (2025) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3696457 · Cited by 117
Yu, T., Yao, Y., Zhang, H., He, T., Han, Y., Cui, G., Hu, J., Liu, Z., Zheng, H.-T., Sun, M., et al. (2023) · arXiv · doi:10.48550/arxiv.2312.00849 · Cited by 117
When brain-inspired AI meets AGI
Zhao, L., Zhang, L., Wu, Z., Chen, Y., Dai, H., Yu, X., Liu, Z., Zhang, T., Hu, X., Jiang, X., et al. (2023) · Meta-Radiology · doi:10.1016/j.metrad.2023.100005 · Cited by 89
Self-citationIntegrating LLMs With ITS: Recent Advances, Potentials, Challenges, and Future Directions
Mahmud, D., Hajmohamed, H., Almentheri, S., Alqaydi, S., Aldhaheri, L., Khalil, R. A., & Saeed, N. (2025) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2025.3528116 · Cited by 141
Transformers in speech processing: Overcoming challenges and paving the future
Latif, S., Zaidi, S. A. M., Cuayáhuitl, H., Shamshad, F., Shoukat, M., Usama, M., & Qadir, J. (2025) · Computer Science Review · doi:10.1016/j.cosrev.2025.100768 · Cited by 126
HuaTuo: Tuning LLaMA Model with Chinese Medical Knowledge
Wang, H., Liu, C., Xi, N., Qiang, Z., Zhao, S., Qin, B., & Liu, T. (2023) · arXiv · doi:10.48550/arxiv.2304.06975 · Cited by 115
“Instruct-tuning has proven to be effective to tune large language models (Wei et al., 2022; Ouyang et al., 2022), which helps the models perform satisfactorily under zero-shot scenarios with the cost of sufficient annotated instructions.”
BackgroundInformation Retrieval meets Large Language Models: A strategic report from Chinese IR community
Ai, Q., Bai, T., Cao, Z., Chang, Y., Chen, J., Chen, Z., Cheng, Z., Dong, S., Dou, Z., Feng, F., et al. (2023) · AI Open · doi:10.1016/j.aiopen.2023.08.001 · Cited by 84
Artificial intelligence: revolutionizing cardiology with large language models
Boonstra, M., Weissenbacher, D., Moore, J. H., Gonzalez‐Hernandez, G., & Asselbergs, F. W. (2024) · European Heart Journal · doi:10.1093/eurheartj/ehad838 · Cited by 132
Large Language Model–Based Responses to Patients’ In-Basket Messages
Small, W. R., Wiesenfeld, B., Brandfield-Harvey, B., Jonassen, Z., Mandal, S., Stevens, E. R., Major, V. J., Lostraglio, E., Szerencsy, A., Jones, S., et al. (2024) · JAMA Network Open · doi:10.1001/jamanetworkopen.2024.22399 · Cited by 106
Exploiting Programmatic Behavior of LLMs: Dual-Use Through Standard Security Attacks
Kang, D., Li, X., Stoica, I., Guestrin, C., Zaharia, M., & Hashimoto, T. (2024) · 2024 IEEE Security and Privacy Workshops (SPW) · doi:10.1109/spw63631.2024.00018 · Cited by 114
“Two major changes have occurred since their publication: (i) state-of-the-art LLMs have dramatically improved in their instruction-following ability (Ouyang et al., 2022; Wei et al., 2021; Sanh et al., 2021; Iyer et al., 2022); and (ii) Zellers et al., 2019; Markov et al., 2022; Pavlopoulos et al.,…”
BackgroundMethodInfluentialExploiting Programmatic Behavior of LLMs: Dual-Use Through Standard Security Attacks
Kang, D., Li, X., Stoica, I., Guestrin, C., Zaharia, M., & Hashimoto, T. (2023) · arXiv · doi:10.48550/arxiv.2302.05733 · Cited by 114
“Two major changes have occurred since their publication: (i) state-of-the-art LLMs have dramatically improved in their instruction-following ability (Ouyang et al., 2022; Wei et al., 2021; Sanh et al., 2021; Iyer et al., 2022); and (ii) Zellers et al., 2019; Markov et al., 2022; Pavlopoulos et al.,…”
BackgroundMethodInfluentialLarge Language Models for Software Engineering: A Systematic Literature Review
Hou, X., Zhao, Y., Liu, Y., Yang, Z., Wang, K., Li, L., Luo, X., Lo, D., Grundy, J., & Wang, H. (2023) · arXiv · doi:10.48550/arxiv.2308.10620 · Cited by 114
“More specialized versions like CodeGPT [173], InstructGPT [213], Codex [36], Copilot [74]3, and others have been fine-tuned for specific tasks in SE.”
MethodA Watermark for Large Language Models
Kirchenbauer, J., Geiping, J., Wen, Y., Katz, J., Miers, I., & Goldstein, T. (2023) · arXiv · doi:10.48550/arxiv.2301.10226 · Cited by 194
“Note that instruction finetuning is already common (for example in ChatGPT) for other categories of malicious prompts, using reinforcement learning protocols (RLHF) (Christiano et al., 2017; Ouyang et al., 2022; Bai et al., 2022).”
Large Language Models as Zero-Shot Human Models for Human-Robot Interaction
Zhang, B., & Soh, H. (2023) · 2023 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros55552.2023.10341488 · Cited by 82
When Search Engine Services Meet Large Language Models: Visions and Challenges
Xiong, H., Bian, J., Li, Y., Li, X., Du, M., Wang, S., Yin, D., & Helal, S. (2024) · IEEE Transactions on Services Computing · doi:10.1109/tsc.2024.3451185 · Cited by 183
El Agente: An autonomous agent for quantum chemistry
Zou, Y., Cheng, A., Aldossary, A., Bai, J., Leong, S. X., Campos-Gonzalez-Angulo, J. A., Choi, C., Ser, C. T., Tom, G., Wang, A., et al. (2025) · Matter · doi:10.1016/j.matt.2025.102263 · Cited by 189
Learning the natural history of human disease with generative transformers
Shmatko, A., Jung, A. W., Gaurav, K., Brunak, S., Mortensen, L. H., Birney, E., Fitzgerald, T., & Gerstung, M. (2025) · Nature · doi:10.1038/s41586-025-09529-3 · Cited by 110
LLM Multimodal Traffic Accident Forecasting
de Zarzà, I., de Curtò, J., Roig, G., & Calafate, C. T. (2023) · Sensors · doi:10.3390/s23229225 · Cited by 130
When Software Security Meets Large Language Models: A Survey
Zhu, X., Zhou, W., Han, Q., Ma, W., Wen, S., & Xiang, Y. (2025) · IEEE/CAA Journal of Automatica Sinica · doi:10.1109/jas.2024.124971 · Cited by 128
LC-LLM: Explainable lane-change intention and trajectory predictions with Large Language Models
Peng, M., Guo, X., Chen, X., Chen, K., Zhu, M., Chen, L., & Wang, F. (2025) · Communications in Transportation Research · doi:10.1016/j.commtr.2025.100170 · Cited by 136
Target Detection in Hyperspectral Remote Sensing Image: Current Status and Challenges
Chen, B., Liu, L., Zou, Z., & Shi, Z. (2023) · Remote Sensing · doi:10.3390/rs15133223 · Cited by 119
BB-GeoGPT: A framework for learning a large language model for geographic information science
Zhang, Y., Wang, Z., He, Z., Li, J., Mai, G., Lin, J., Cheng, W., & Yu, W. (2024) · Information Processing & Management · doi:10.1016/j.ipm.2024.103808 · Cited by 135
TelecomGPT: A Framework to Build Telecom-Specific Large Language Models
Zou, H., Zhao, Q., Tian, Y., Bariah, L., Bader, F., Lestable, T., & Debbah, M. A. (2025) · IEEE Transactions on Machine Learning in Communications and Networking · doi:10.1109/tmlcn.2025.3593184 · Cited by 144
Singh, S., Nan, Y., Wang, A., D'Souza, D., Kapoor, S., Üstün, A., Koyejo, S., Deng, Y., Longpre, S., Smith, N. A., et al. (2025) · arXiv · doi:10.48550/arxiv.2504.20879 · Cited by 108
Recent Advances in Large Language Models for Healthcare
Nassiri, K., & Akhloufi, M. A. (2024) · BioMedInformatics · doi:10.3390/biomedinformatics4020062 · Cited by 134
Hindi, M., Mohammed, L., Maaz, O., & Alwarafy, A. (2025) · IEEE Access · doi:10.1109/access.2025.3550145 · Cited by 142
Mustapha, K. B. (2024) · Advanced Engineering Informatics · doi:10.1016/j.aei.2024.103066 · Cited by 118
Secret Collusion among AI Agents: Multi-Agent Deception via Steganography
Motwani, S., Baranchuk, M., Strohmeier, M., Bolina, V., Torr, P., Hammond, L., & Witt, C. D. (2024) · Advances in Neural Information Processing Systems 37 · doi:10.52202/079017-2336 · Cited by 106
Language Model Behavior: A Comprehensive Survey
Chang, T. A., & Bergen, B. K. (2024) · Computational Linguistics · doi:10.1162/coli_a_00492 · Cited by 105
How to Bridge the Gap Between Modalities: Survey on Multimodal Large Language Model
Song, S., Li, X., Li, S., Zhao, S., Yu, J., Ma, J., Mao, X., Zhang, W., & Wang, M. (2025) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2025.3527978 · Cited by 145
Li, R., Kumar, A., & Chen, J. H. (2023) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2023.1835 · Cited by 104
Modular RAG: Transforming RAG Systems into LEGO-like Reconfigurable Frameworks
Gao, Y., Xiong, Y., Wang, M., & Wang, H. (2026) · ACM Transactions on Information Systems · doi:10.1145/3837856 · Cited by 125
Advancing Reasoning in Large Language Models: Promising Methods and Approaches
Patil, A., & Jadon, A. (2026) · Communications in computer and information science · doi:10.1007/978-981-95-7289-2_22 · Cited by 124
The future of self-driving laboratories: from human in the loop interactive AI to gamification
Hysmith, H., Foadian, E., Padhy, S. P., Kalinin, S. V., Moore, R. G., Ovchinnikova, O. S., & Ahmadi, M. (2024) · Digital Discovery · doi:10.1039/d4dd00040d · Cited by 103
McIntosh, T. R., Susnjak, T., Liu, T., Watters, P., Xu, D., Liu, D., & Halgamuge, M. N. (2025) · Technologies · doi:10.3390/technologies13020051 · Cited by 102
Tian, Y., Li, X., Zhang, H., Zhao, C., Li, B., Wang, X., Wang, X., & Wang, F. (2023) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2023.3307012 · Cited by 107
Investigating ChatGPT and cybersecurity: A perspective on topic modeling and sentiment analysis
Okey, O. D., Udo, E. U., Rosa, R. L., Rodríguez, D. Z., & Kleinschmidt, J. H. (2023) · Computers & Security · doi:10.1016/j.cose.2023.103476 · Cited by 122
Asai, A., Wu, Z., Wang, Y., Sil, A., & Hajishirzi, H. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2310.11511 · Cited by 101
“…strong publicly available pre-trained LLMs, Llama2 7 B , 13 B (Touvron et al., 2023), instruction-tuned models, Alpaca 7 B , 13 B (Dubois et al., 2023) (our replication based on Llama2); and models trained and reinforced using private data, Chat-GPT (Ouyang et al., 2022) and Llama2-chat 13 B .”
BackgroundMethodInfluentialEmotion detection for misinformation: A review
Liu, Z., Zhang, T., Yang, K., Thompson, P., Yu, Z., & Ananiadou, S. (2024) · Information Fusion · doi:10.1016/j.inffus.2024.102300 · Cited by 132
Editable Scene Simulation for Autonomous Driving via Collaborative LLM-Agents
Wei, Y., Wang, Z., Lu, Y., Xu, C., Liu, C., Zhao, H., Chen, S., & Wang, Y. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01428 · Cited by 189
Multitask-Based Evaluation of Open-Source LLM on Software Vulnerability
Yin, X., Ni, C., & Wang, S. (2024) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2024.3470333 · Cited by 135
Rahman, A., Mahir, S. H., Tashrif, M. T. A., Karim, M. A., Aishi, A. A., Kundu, D., Debnath, T., Moududi, M. A. A., Eidmum, M. Z. A., Miah, A. S. M., et al. (2025) · Systems and Soft Computing · doi:10.1016/j.sasc.2025.200396 · Cited by 126
DeepSeek LLM: Scaling Open-Source Language Models with Longtermism
DeepSeek-AI, :, Bi, X., Chen, D., Chen, G., Chen, S., Dai, D., Deng, C., Ding, H., Dong, K., et al. (2024) · arXiv · doi:10.48550/arxiv.2401.02954 · Cited by 99
“The value of SFT lies in the ability to learn to achieve comparable scores to the base model’s few-shot setting in the chat model’s zero-shot setting, which is aligned with real scenarios.”
MethodInfluentialChatGPT: perspectives from human–computer interaction and psychology
Liu, J. (2024) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2024.1418869 · Cited by 99
“But ChatGPT also went through another pioneering OpenAI process called Reinforcement Learning from Human Feedback (Ouyang et al., 2022).”
MethodLarge language models in food science: Innovations, applications, and future
Ma, P., Tsai, S., He, Y., Jia, X., Zhen, D., Yu, N., Wang, Q., Ahuja, J. K. C., & Wei, C. (2024) · Trends in Food Science & Technology · doi:10.1016/j.tifs.2024.104488 · Cited by 105
Jin, Y., Yang, R., Yi, Z., Shen, X., Peng, H., Liu, X., Qin, J., Li, J., Xie, J., Gao, P., et al. (2024) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros58592.2024.10802229 · Cited by 118
A world model: On the political logics of generative AI
Amoore, L., Campolo, A., Jacobsen, B. N., & Rella, L. (2024) · Political Geography · doi:10.1016/j.polgeo.2024.103134 · Cited by 113
Deep Reinforcement Learning: A Chronological Overview and Methods
Terven, J. R. (2025) · AI · doi:10.3390/ai6030046 · Cited by 122
Can ChatGPT Boost Artistic Creation: The Need of Imaginative Intelligence for Parallel Art
Guo, C., Lu, Y., Dou, Y., & Wang, F.-Y. (2023) · IEEE/CAA Journal of Automatica Sinica · doi:10.1109/jas.2023.123555 · Cited by 80
Refactoring Programs Using Large Language Models with Few-Shot Examples
Shirafuji, A., Oda, Y., Suzuki, J., Morishita, M., & Watanobe, Y. (2023) · 2023 30th Asia-Pacific Software Engineering Conference (APSEC) · doi:10.1109/apsec60848.2023.00025 · Cited by 67
Lan, Z., Liu, L. D., Fan, B. Y., Lv, Y., Ren, Y., & Cui, Z. (2024) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2024.3418522 · Cited by 138
Li, J., Li, B., Tu, Z., Liu, X., Guo, Q., Juefei-Xu, F., Xu, R., & Yu, H. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01440 · Cited by 134
Improving Factuality and Reasoning in Language Models through Multiagent Debate
Du, Y., Li, S., Torralba, A., Tenenbaum, J. B., & Mordatch, I. (2023) · arXiv · doi:10.48550/arxiv.2305.14325 · Cited by 1,202
“Overall, we observed that language model agents were relatively "agreeable", perhaps as a result of instruction tuning or reinforcement learning based on human feedback (Ouyang et al., 2022).”
Mastering Diverse Domains through World Models
Hafner, D., Pasukonis, J., Ba, J., & Lillicrap, T. (2023) · arXiv · doi:10.48550/arxiv.2301.04104 · Cited by 124
“It is also a key component for improving large language models beyond what is demonstrated in their pretraining data 3,4 .”
BackgroundChatGPT Empowered Long-Step Robot Control in Various Environments: A Case Application
Wake, N., Kanehira, A., Sasabuchi, K., Takamatsu, J., & Ikeuchi, K. (2023) · IEEE Access · doi:10.1109/access.2023.3310935 · Cited by 96
“Furthermore, the capacity to effectively accommodate user feedback could be partially attributed to learning methods that align model behavior with human intent, known as reinforcement learning from human feedback [56].”
BackgroundOn Transforming Reinforcement Learning With Transformers: The Development Trajectory
Hu, S., Shen, L., Zhang, Y., Chen, Y., & Tao, D. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3408271 · Cited by 131
Scalable Extraction of Training Data from (Production) Language Models
Nasr, M., Carlini, N., Hayase, J., Jagielski, M., Cooper, A. F., Ippolito, D., Choquette-Choo, C. A., Wallace, E., Tramèr, F., & Lee, K. (2023) · arXiv · doi:10.48550/arxiv.2311.17035 · Cited by 96
McCoy, R. T., Yao, S., Friedman, D., Hardy, M. D., & Griffiths, T. L. (2024) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2322420121 · Cited by 96
The Impact of AI Usage on University Students’ Willingness for Autonomous Learning
Wang, L., & Li, W. (2024) · Behavioral Sciences · doi:10.3390/bs14100956 · Cited by 94
“Ouyang et al. argued that the output of generative AI may not always align with individual intentions, and a forward-looking learning approach involves questioning and adjusting the content through human feedback [51].”
BackgroundA mathematical guide to operator learning
Boullé, N., & Townsend, A. (2024) · Handbook of numerical analysis · doi:10.1016/bs.hna.2024.05.003 · Cited by 172
Yuan, M., Bao, P., Yuan, J., Shen, Y., Chen, Z., Xie, Y., Zhao, J., Li, Q., Chen, Y., Zhang, L., et al. (2024) · Medicine Plus · doi:10.1016/j.medp.2024.100030 · Cited by 70
Herrera-Poyatos, D., Peláez-González, C., Zuheros, C., Herrera-Poyatos, A., Tejedor, V., Herrera, F., & Montes, R. (2025) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2025.1609097 · Cited by 105
Metadata
- Authors
- Ouyang, L., Wu, J., Jiang, X., Almeida, D., Wainwright, C., Mishkin, P., Zhang, C., Agarwal, S., Slama, K., Ray, A., Schulman, J., Hilton, J., Kelton, F., Miller, L., Simens, M., Askell, A., Welinder, P., Christiano, P., Leike, J., & Lowe, R.
- Venue
- Advances in Neural Information Processing Systems 35
- Published
- 2022
- Pages
- 27730-27744
- ISSN
- 1049-5258 (ISSN-L)
- OpenAlex
- W7133211372
- Cited by
- 3,117
- References
- 0
- Citations by year
- 2026: 1421 · 2025: 544 · 2024: 852 · 2023: 297 · 2022: 3
- FWCI
- 234.27
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- neural information processing systems (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Keywords
- instruction following, language models, human feedback, reinforcement learning from human feedback, large language models
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.