Training Language Models to Follow Instructions with Human Feedback
The DOI matches its Crossref record; 2 of the 2 references it cites were found in a registry or an index.
Abstract
Making language models bigger does not inherently make them better at following a user's intent. For example, large language models can generate outputs that are untruthful, toxic, or simply not helpful to the user. In other words, these models are not aligned with their users. In this paper, we show an avenue for aligning language models with user intent on a wide range of tasks by fine-tuning with human feedback. Starting with a set of labeler-written prompts and prompts submitted through the OpenAI API, we collect a dataset of labeler demonstrations of the desired model behavior, which we use to fine-tune GPT-3 using supervised learning. We then collect a dataset of rankings of model outputs, which we use to further fine-tune this supervised model using reinforcement learning from human feedback. We call the resulting models InstructGPT. In human evaluations on our prompt distribution, outputs from the 1.3B parameter InstructGPT model are preferred to outputs from the 175B GPT-3, despite having 100x fewer parameters. Moreover, InstructGPT models show improvements in truthfulness and reductions in toxic output generation while having minimal performance regressions on public NLP datasets. Even though InstructGPT still makes simple mistakes, our results show that fine-tuning with human feedback is a promising direction for aligning language models with human intent.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Existing literature (Ouyang et al., 2022) does not fully describe the details of these models, such as the pretraining corpus, model sizes, and model biases.”
From Self-Refine: Iterative Refinement with Self-Feedback (2023) · cites this paper as Ouyang et al., 2022
Experimental — accuracy not yet measuredIn the citing paper
“Specifically, providers mitigate race and gender bias through reinforcement learning from human feedback (RLHF), adversarial stress-testing known as red teaming, and hard-coded refusals governed by the provider's own content policies [6, 43, 71].”
From All Public Voices Are Equal, But Are Some More Equal Than Others to LLMs? (2026) · cites this paper as [71]
In the citing paper
“Fine-tuning a model from human feedback at scale, using preference data from paid raters or drawn from a large and willing user base, is an especially potent technique.It has the potential not only to shape a model's responses to better reflect user norms (for better or worse), but also to filter out toxic language, improve factual accuracy, and mitigate the tendency to fabricate information.”
From Talking about Large Language Models (2024) · cites this paper as [26]
In the citing paper
“These include general competencies such as in-context learning (ICL) [13], chain-of-thought (CoT) [17] reasoning, and instruction following [25], as well as task-specialized skills like mathematical reasoning [30].”
From A Survey of Large Language Models (2026) · cites this paper as [25]
In the citing paper
“When external reward models or ground-truth answers are available, rejection sampling can also be applied to select higher-quality responses from multiple candidates [25].”
From A Survey of Large Language Models (2026) · cites this paper as [25]
41 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
The publisher hasn’t deposited this paper’s reference list.
Cited by
Items 301–400 of 4,340
Zhang, Z., Jia, M., Lee, H.-P. (., Yao, B., Das, S., Lerner, A., Wang, D., & Li, T. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642385 · Cited by 95
ChatGPT as Your Vehicle Co-Pilot: An Initial Attempt
Wang, S., Zhu, Y., Li, Z., Wang, Y., Li, L., & He, Z. (2023) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2023.3325300 · Cited by 114
Šavelka, J., & Ashley, K. D. (2023) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2023.1279794 · Cited by 128
Qi, W., Pan, J., Lyu, H., & Luo, J. (2024) · Telematics and Informatics · doi:10.1016/j.tele.2024.102158 · Cited by 102
A Wide Evaluation of ChatGPT on Affective Computing Tasks
Amin, M. M., Mao, R., Cambria, E., & Schuller, B. W. (2024) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2024.3419593 · Cited by 117
Open Problems and Fundamental Limitations of Reinforcement Learning from Human Feedback
Casper, S., Davies, X., Shi, C., Gilbert, T. K., Scheurer, J., Rando, J., Freedman, R., Korbak, T., Lindner, D., Freire, P., et al. (2023) · arXiv · doi:10.48550/arxiv.2307.15217 · Cited by 101
“Additionally, the demographics for each platform appear different from the general population: OpenAI has reported working with roughly 50% Filipino and Bangladeshi nationals, and roughly 50% 25-34 year-olds [Ouyang et al., 2022] while Anthropic has reported hiring 68% white population from an initial evaluator popula…”
BackgroundMethodArtificial General Intelligence for Medical Imaging Analysis
Li, X., Zhao, L., Zhang, L., Wu, Z., Liu, Z., Jiang, H., Cao, C., Xu, S., Li, Y., Dai, H., et al. (2024) · IEEE Reviews in Biomedical Engineering · doi:10.1109/rbme.2024.3493775 · Cited by 116
Turpin, M., Michael, J., Perez, E., & Bowman, S. R. (2023) · arXiv · doi:10.48550/arxiv.2305.04388 · Cited by 262
Zhang, J. J., Wang, Y. W., Ruan, Q., & Yang, Y. (2024) · Tourism Management Perspectives · doi:10.1016/j.tmp.2024.101279 · Cited by 109
An advanced retrieval-augmented generation system for manufacturing quality control
Heredia, J. A., & Barreda, J. G. (2024) · Advanced Engineering Informatics · doi:10.1016/j.aei.2024.103007 · Cited by 110
CHEAT: A Large-Scale Dataset for Detecting CHatGPT-writtEn AbsTracts
Yu, P., Chen, J., Feng, X., & Xia, Z. (2025) · IEEE Transactions on Big Data · doi:10.1109/tbdata.2025.3536929 · Cited by 42
Recommender AI Agent: Integrating Large Language Models for Interactive Recommendations
Huang, X., Lian, J., Lei, Y., Yao, J., Lian, D., & Xie, X. (2025) · ACM Transactions on Information Systems · doi:10.1145/3731446 · Cited by 89
“…the capabilities of LLMs, including in-context learning (Brown et al. 2020; Liu et al. 2021; Rubin, Herzig, and Berant 2021), instruction following (Ouyang et al. 2022; Touvron et al. 2023a; OpenAI 2023), planning and reasoning (Wei et al. 2022; Wang et al. 2022a; Yao et al. 2022; Yang et al.…”
UFineBench: Towards Text-based Person Retrieval with Ultra-fine Granularity
Zuo, J., Zhou, H., Nie, Y., Zhang, F., Guo, T., Sang, N., Wang, Y., & Gao, C. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02078 · Cited by 89
A Survey of Robot Intelligence with Large Language Models
Jeong, H., Lee, H., Kim, C., & Shin, S. (2024) · Applied Sciences · doi:10.3390/app14198868 · Cited by 121
Huang, Z., Sheng, Z., Ma, C., & Chen, S. (2024) · Communications in Transportation Research · doi:10.1016/j.commtr.2024.100127 · Cited by 88
Denoising Diffusion Autoencoders are Unified Self-supervised Learners
Xiang, W., Hongyu, Y., Huang, D., & Wang, Y. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01448 · Cited by 192
Yang, J., Liu, C., Deng, W., Wu, D., Weng, C., Zhou, Y., & Wang, K. (2024) · Patterns · doi:10.1016/j.patter.2023.100887 · Cited by 68
Hajipour, H., Hassler, K., Holz, T., Schönherr, L., & Fritz, M. (2024) · 2024 IEEE Conference on Secure and Trustworthy Machine Learning (SaTML) · doi:10.1109/satml59370.2024.00040 · Cited by 40
VisEval: A Benchmark for Data Visualization in the Era of Large Language Models
Chen, N., Zhang, Y., Xu, J., Ren, K., & Yang, Y. (2024) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2024.3456320 · Cited by 154
The Revolution of Multimodal Large Language Models: A Survey
Caffagni, D., Cocchi, F., Barsellotti, L., Moratelli, N., Sarto, S., Baraldi, L., Baraldi, L., Cornia, M., & Cucchiara, R. (2024) · Findings of the Association for Computational Linguistics ACL 2024 · doi:10.18653/v1/2024.findings-acl.807 · Cited by 98
“This technique, called instruction-tuning (Chung et al., 2022; Wang et al., 2022b,a; Jiang et al., 2024), turns out to be critical for aligning the behavior of an LLM with that of humans and currently empowers the most advanced LLMs, eventually boosted via reinforcement learning from human feedback (RLHF) (Ouyang et a…”
Pan, L., Saxon, M., Xu, W., Nathani, D., Wang, X., & Wang, W. Y. (2024) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00660 · Cited by 86
SCD-SAM: Adapting Segment Anything Model for Semantic Change Detection in Remote Sensing Imagery
Mei, L., Ye, Z., Xu, C., Wang, H., Wang, Y., Lei, C., Yang, W., & Li, Y. (2024) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2024.3407884 · Cited by 86
Zada, Z., Goldstein, A., Michelmann, S., Simony, E., Price, A. R., Hasenfratz, L., Barham, E., Zadbood, A., Doyle, W., Friedman, D. J., et al. (2024) · Neuron · doi:10.1016/j.neuron.2024.06.025 · Cited by 100
Xiao, T., & Xu, P. (2024) · Energy and Buildings · doi:10.1016/j.enbuild.2024.114691 · Cited by 95
Prompt a Robot to Walk with Large Language Models
Wang, Y., Zhang, B., Chen, J., & Sreenath, K. (2024) · IEEE Conference on Decision and Control (CDC) · doi:10.1109/cdc56724.2024.10885862 · Cited by 106
Large Language Models Sensitivity to The Order of Options in Multiple-Choice Questions
Pezeshkpour, P., & Hruschka, E. (2024) · Findings of the Association for Computational Linguistics: NAACL 2024 · doi:10.18653/v1/2024.findings-naacl.130 · Cited by 85
Chen, X., & Wu, D. (2024) · IEEE Transactions on Learning Technologies · doi:10.1109/tlt.2024.3378279 · Cited by 101
Generalized Predictive Model for Autonomous Driving
Yang, J., Gao, S., Qiu, Y., Chen, L., Li, T., Dai, B., Chitta, K., Wu, P., Zeng, J., Luo, P., et al. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01389 · Cited by 226
Data Contamination Quiz: A Tool to Detect and Estimate Contamination in Large Language Models
Golchin, S., & Surdeanu, M. (2025) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl.a.20 · Cited by 115
Retracted: Chat With ChatGPT on Interactive Engines for Intelligent Driving
Gao, Y., Tong, W., Wu, E. Q., Chen, W., Zhu, G., & Wang, F.-Y. (2023) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2023.3252571 · Cited by 82
RetractedCWEval: Outcome-driven Evaluation on Functionality and Security of LLM Code Generation
Peng, J., Cui, L., Huang, K., Yang, J., & Ray, B. (2025) · International Workshop on Large Language Models for Code (LLM4Code) · doi:10.1109/llm4code66737.2025.00009 · Cited by 138
DataSentinel: A Game-Theoretic Detection of Prompt Injection Attacks
Liu, Y., Jia, Y., Jia, J., Song, D., & Gong, N. Z. (2025) · IEEE Symposium on Security and Privacy (S&P) · doi:10.1109/sp61157.2025.00250 · Cited by 199
Will we run out of data? Limits of LLM scaling based on human-generated data
Villalobos, P., Ho, A., Sevilla, J., Besiroglu, T., Heim, L., & Hobbhahn, M. (2022) · arXiv · doi:10.48550/arxiv.2211.04325 · Cited by 80
Trust in artificial intelligence: Literature review and main path analysis
Henrique, B. M., & Santos, E. (2024) · Computers in Human Behavior Artificial Humans · doi:10.1016/j.chbah.2024.100043 · Cited by 103
Shimizu, R., Yamamoto, R., Kawamura, M., Shirahata, Y., Doi, H., Komatsu, T., & Tachibana, K. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10448173 · Cited by 118
Automating construction contract review using knowledge graph-enhanced large language models
Zheng, C., Wong, S., Su, X., Tang, Y., Nawaz, A., & Kassem, M. (2025) · Automation in Construction · doi:10.1016/j.autcon.2025.106179 · Cited by 90
del Río, A., Jiménez, D., & Serrano, J. (2024) · IEEE Access · doi:10.1109/access.2024.3472473 · Cited by 95
Xiao, J., Li, Z., Xie, X., Getzen, E., Fang, C., Long, Q., & Su, W. J. (2025) · Journal of the American Statistical Association · doi:10.1080/01621459.2025.2555067 · Cited by 17
PeFoMed: Parameter efficient fine-tuning of multimodal large language models for medical CXR
Liu, G., Tang, X., He, J., Li, P., Chen, Z., & Zhong, S. (2026) · Scientific Reports · doi:10.1038/s41598-026-47871-2 · Cited by 85
Huang, G., Li, Y., Jameel, S., Long, Y., & Papanastasiou, G. (2024) · Computational and Structural Biotechnology Journal · doi:10.1016/j.csbj.2024.05.004 · Cited by 99
Large models for intelligent transportation systems and autonomous vehicles: A survey
Gan, L., Chu, W., Li, G., Tang, X., & Li, K. (2024) · Advanced Engineering Informatics · doi:10.1016/j.aei.2024.102786 · Cited by 90
Culturally Aware and Adapted NLP: A Taxonomy and a Survey of the State of the Art
Liu, C. C., Gurevych, I., & Korhonen, A. (2025) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00760 · Cited by 158
Generating meaning: active inference and the scope and limits of passive AI
Pezzulo, G., Parr, T., Cisek, P., Clark, A., & Friston, K. (2024) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2023.10.002 · Cited by 80
“State-of-the-art models often include subsequent fi ne-tuning in a (semi)supervised manner [88]; however, this still relies upon passive presentation of labeled data or self-generated outputs paired with rewards.”
InfluentialSemantic Communication: A Survey of Its Theoretical Development
Xin, G., Fan, P., & Letaief, K. B. (2024) · Entropy · doi:10.3390/e26020102 · Cited by 102
AppPoet: Large language model based android malware detection via multi-view prompt engineering
Zhao, W., Wu, J., & Meng, Z. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2024.125546 · Cited by 105
Self-citationKnowledge Graphs for Multi-modal Learning: Survey and Perspective
Chen, Z., Zhang, Y., Fang, Y., Geng, Y., Guo, L., Chen, J., Liu, X., Pan, J. Z., Zhang, N., Chen, H., et al. (2025) · Information Fusion · doi:10.1016/j.inffus.2025.103124 · Cited by 87
DAO to HANOI via DeSci: AI Paradigm Shifts from AlphaGo to ChatGPT
Miao, Q., Zheng, W., Lv, Y., Huang, M., Ding, W., & Wang, F.-Y. (2023) · IEEE/CAA Journal of Automatica Sinica · doi:10.1109/jas.2023.123561 · Cited by 78
“TheChatGPT is a sibling model of InstructGPT [3], which is released by OpenAI at the beginning of 2022.”
BackgroundDrugAssist: a large language model for molecule optimization
Ye, G., Cai, X., Lai, H., Wang, X., Huang, J., Wang, L., Liu, W., & Zeng, X. (2024) · Briefings in Bioinformatics · doi:10.1093/bib/bbae693 · Cited by 124
Teaching Large Language Models to Self-Debug
Chen, X., Lin, M., Schärli, N., & Zhou, D. (2023) · arXiv · doi:10.48550/arxiv.2304.05128 · Cited by 812
“One popular technique is reinforcement learning from human feedback (RLHF) (Ziegler et al., 2019; Ouyang et al., 2022), and RLHF-trained models have demonstrated the ability to avoid harmful outputs when instructed to do so in the prompt (Ganguli et al., 2023).”
MethodInfluentialAgentAI: A comprehensive survey on autonomous agents in distributed AI for industry 4.0
Piccialli, F., Chiaro, D., Sarwar, S., Cerciello, D., Qi, P., & Mele, V. (2025) · Expert Systems with Applications · doi:10.1016/j.eswa.2025.128404 · Cited by 77
A Credible and Fair Federated Learning Framework Based on Blockchain
Chen, L., Zhao, D., Tao, L., Wang, K., Qiao, S., Zeng, X., & Tan, C. W. (2024) · IEEE Transactions on Artificial Intelligence · doi:10.1109/tai.2024.3355362 · Cited by 89
Bewersdorff, A., Seßler, K., Baur, A., Kasneci, E., & Nerdel, C. (2023) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2023.100177 · Cited by 76
“We set this parameter to zero, which results in a greedy generation process, decreasing the flexibility and variety in the output to achieve a more stable inference performance (Reiss, 2023).”
BackgroundHumans or LLMs as the Judge? A Study on Judgement Bias
Chen, G. H., Chen, S., Liu, Z., Jiang, F., & Wang, B. (2024) · Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2024.emnlp-main.474 · Cited by 76
Phelps, S., & Russell, Y. I. (2025) · Journal of Physics: Complexity · doi:10.1088/2632-072x/ada711 · Cited by 8
From screens to scenes: A survey of embodied AI in healthcare
Liu, Y., Cao, X., Chen, T., Jiang, Y., You, J., Wu, M., Wang, X., Feng, M., Jin, Y., & Chen, J. (2025) · Information Fusion · doi:10.1016/j.inffus.2025.103033 · Cited by 91
Tseng, L.-P., Huang, L.-P., & Chen, W.-R. (2025) · Nurse Education Today · doi:10.1016/j.nedt.2025.106570 · Cited by 75
Agentic Large Language Models, a Survey
Plaat, A., Van Duijn, M., Van Stein, N., Preuss, M., Van der Putten, P., & Batenburg, K. J. (2025) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.18675 · Cited by 75
A Comprehensive Review of Generative AI in Finance
Lee, D. K. C., Guan, C., Yu, Y., & Ding, Q. (2024) · FinTech · doi:10.3390/fintech3030025 · Cited by 97
Instruct-ReID: A Multi-Purpose Person Re-Identification Task with Instructions
He, W., Deng, Y., Tang, S., Chen, Q., Xie, Q., Wang, Y., Bai, L., Zhu, F., Zhao, R., Ouyang, W., et al. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01659 · Cited by 110
Large Language Models Meet Next-Generation Networking Technologies: A Review
Hang, C.-N., Yu, P.-D., Morabito, R., & Tan, C.-W. (2024) · Future Internet · doi:10.3390/fi16100365 · Cited by 64
TDAG: A multi-agent framework based on dynamic Task Decomposition and Agent Generation
Wang, Y., Wu, Z., Yao, J., & Su, J. (2025) · Neural Networks · doi:10.1016/j.neunet.2025.107200 · Cited by 102
Evaluating Correctness and Faithfulness of Instruction-Following Models for Question Answering
Adlakha, V., BehnamGhader, P., Lu, X. H., Meade, N., & Reddy, S. (2024) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00667 · Cited by 74
ChatGPT and finetuned BERT: A comparative study for developing intelligent design support systems
Qiu, Y., & Jin, Y. (2023) · Intelligent Systems with Applications · doi:10.1016/j.iswa.2023.200308 · Cited by 104
HRS-Bench: Holistic, Reliable and Scalable Benchmark for Text-to-Image Models
Bakr, E. M., Sun, P., Shen, X., Khan, F. F., Li, L. E., & Elhoseiny, M. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01834 · Cited by 151
Yao, D., Zhang, J., Harris, I. G., & Carlsson, M. (2024) · ICASSP 2024 - 2024 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp48485.2024.10448041 · Cited by 43
RegionGPT: Towards Region Understanding Vision Language Model
Guo, Q., Mello, S. D., Yin, H., Byeon, W., Cheung, K. C., Yu, Y., Luo, P., & Liu, S. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01309 · Cited by 148
ChatPhishDetector: Detecting Phishing Sites Using Large Language Models
Koide, T., Nakano, H., & Chiba, D. (2024) · IEEE Access · doi:10.1109/access.2024.3483905 · Cited by 48
MLLM-Tool: A Multimodal Large Language Model for Tool Agent Learning
Wang, C., Luo, W., Dong, S., Xuan, X., Li, Z., Ma, L., & Gao, S. (2025) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv61041.2025.00650 · Cited by 109
Evaluating Correctness and Faithfulness of Instruction-Following Models for Question Answering
Adlakha, V., BehnamGhader, P., Lu, X. H., Meade, N., & Reddy, S. (2023) · arXiv · doi:10.48550/arxiv.2307.16877 · Cited by 74
FreshLLMs: Refreshing Large Language Models with Search Engine Augmentation
Vu, T., Iyyer, M., Wang, X., Constant, N., Wei, J., Wei, J., Tar, C., Sung, Y.-H., Zhou, D., Le, Q., et al. (2024) · Findings of the Association for Computational Linguistics ACL 2024 · doi:10.18653/v1/2024.findings-acl.813 · Cited by 73
A multifaceted vision of the human-AI collaboration: a comprehensive review
Puerta-Beldarrain, M., Gómez-Carmona, O., Sánchez-Corcuera, R., Casado-Mansilla, D., López-de-Ipiña, D., & Chen, L. (2025) · IEEE Access · doi:10.1109/access.2025.3536095 · Cited by 73
“…fundamental pillar in the evolution of GAI models was the integration of new techniques into them, such as the capability to learn from human feedback [171], [172], [173] to determine the most appropriate response for a given instruction, improving the model’s reliability and accuracy over time.”
Retrieval-Generation Synergy Augmented Large Language Models
Feng, Z., Feng, X., Zhao, D., Yang, M., & Qin, B. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10448015 · Cited by 117
Exploring the Effectiveness of LLMs in Automated Logging Statement Generation: An Empirical Study
Li, Y., Huo, Y., Jiang, Z., Zhong, R., He, P., Su, Y., Briand, L., & Lyu, M. R.-T. (2024) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2024.3475375 · Cited by 90
Cognitive Architectures for Language Agents
Sumers, T. R., Yao, S., Narasimhan, K., & Griffiths, T. L. (2023) · arXiv · doi:10.48550/arxiv.2309.02427 · Cited by 798
Orthogonal Subspace Learning for Language Model Continual Learning
Wang, X., Chen, T., Ge, Q., Xia, H., Bao, R., Zheng, R., Zhang, Q., Gui, T., & Huang, X. (2023) · Findings of the Association for Computational Linguistics: EMNLP 2023 · doi:10.18653/v1/2023.findings-emnlp.715 · Cited by 79
Benchmarking Cognitive Biases in Large Language Models as Evaluators
Koo, R., Lee, M., Raheja, V., Park, J. I., Kim, Z. M., & Kang, D. (2023) · arXiv · doi:10.48550/arxiv.2309.17012 · Cited by 72
“Large language models (LLMs) (Brown et al., 2020; Ouyang et al., 2022) adapted to follow various kinds of instructions have been popularly utilized for several natural language tasks.”
BackgroundInteractive repair and the foundations of language
Dingemanse, M., & Enfield, N. J. (2023) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2023.09.003 · Cited by 92
A Systematic Review of Chatbots: Classification, Development, and Their Impact on Tourism
Benaddi, L., Ouaddi, C., Jakimi, A., & Ouchao, B. (2024) · IEEE Access · doi:10.1109/access.2024.3408108 · Cited by 85
Exploring Universal Intrinsic Task Subspace for Few-Shot Learning via Prompt Tuning
Qin, Y., Wang, X., Su, Y., Lin, Y., Ding, N., Yi, J., Chen, W., Liu, Z., Li, J., Hou, L., et al. (2024) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2024.3430545 · Cited by 76
Zhang, J., Pu, J., Xue, J., Yang, M. Z., Xu, X., Wang, X., & Wang, F. (2023) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2023.3256982 · Cited by 78
RetractedTransGPT: Multi-modal Generative Pre-trained Transformer for Transportation
Wang, P., Wei, X., Hu, F., & Han, W. (2024) · International Conference on Computational Linguistics and Natural Language Processing (CLNLP) · doi:10.1109/clnlp64123.2024.00026 · Cited by 71
Salute the Classic: Revisiting Challenges of Machine Translation in the Age of Large Language Models
Pang, J., Ye, F., Wong, D. F., Yu, D., Shi, S.-M., Tu, Z.-P., & Wang, L. (2024) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00730 · Cited by 55
He, Y., Wang, E., Rong, Y., Cheng, Z., & Chen, H. (2024) · 2025 IEEE/ACM International Workshop on Responsible AI Engineering (RAIE) · doi:10.1109/raie66699.2025.00013 · Cited by 43
Anatomy of an AI-powered malicious social botnet
Yang, K., & Menczer, F. (2024) · Journal of Quantitative Description: Digital Media · doi:10.51685/jqd.2024.icwsm.7 · Cited by 71
Benchmarking Cognitive Biases in Large Language Models as Evaluators
Koo, R., Lee, M., Raheja, V., Park, J. I., Kim, Z. M., & Kang, D. (2024) · Findings of the Association for Computational Linguistics ACL 2024 · doi:10.18653/v1/2024.findings-acl.29 · Cited by 371
ChatGPT performance in the medical specialty exam: An observational study
Oztermeli, A. D., & Oztermeli, A. (2023) · Medicine · doi:10.1097/md.0000000000034673 · Cited by 70
Bai, S., Gonda, D. E., & Hew, K. F. (2024) · IEEE Transactions on Learning Technologies · doi:10.1109/tlt.2024.3378306 · Cited by 55
Digital Twin-Enhanced Deep Reinforcement Learning for Resource Management in Networks Slicing
Zhang, Z. J., Huang, Y., Zhang, C., Zheng, Q., Yang, L., & You, X. (2024) · IEEE Transactions on Communications · doi:10.1109/tcomm.2024.3395698 · Cited by 82
Self-citationNie, T., Sun, J., & Ma, W. (2025) · Artificial Intelligence for Transportation · doi:10.1016/j.ait.2025.100003 · Cited by 116
Yigit, Y., Ferrag, M. A., Ghanem, M. C., Sarker, I. H., Maglaras, L. A., Chrysoulas, C., Moradpoor, N., Tihanyi, N., & Janicke, H. (2025) · Sensors · doi:10.3390/s25061666 · Cited by 69
“Reinforcement Learning from Human Feedback (RLHF) [89] involves enhancing Generative AI and LLM by incorporating direct human feedback into the learning process.”
Large language models for biomedicine: foundations, opportunities, challenges, and best practices
Sahoo, S. S., Plasek, J. M., Xu, H., Uzuner, Ö., Cohen, T., Yetisgen, M., Liu, H., Meystre, S., & Wang, Y. (2024) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocae074 · Cited by 57
Memory$^3$: Language Modeling with Explicit Memory
Yang, H., Lin, Z., Wang, W., Wu, H., Li, Z., Tang, B., Wei, W., Wang, J., Tang, Z., Song, S., et al. (2024) · Journal of Machine Learning · doi:10.4208/jml.240708 · Cited by 90
Hagendorff, T., Dasgupta, I., Binz, M., Chan, S. C. Y., Lampinen, A., Wang, J. X., Akata, Z., & Schulz, E. (2023) · arXiv · doi:10.48550/arxiv.2303.13988 · Cited by 68
Yang, C.-H. H., Gu, Y., Liu, Y.-C., Ghosh, S., Bulyko, I., & Stolcke, A. (2023) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru57964.2023.10389673 · Cited by 139
Language Models in the Loop: Incorporating Prompting into Weak Supervision
Smith, R., Fries, J., Hancock, B. J., & Bach, S. H. (2024) · ACM / IMS Journal of Data Science · doi:10.1145/3617130 · Cited by 96
Decision-Oriented Dialogue for Human-AI Collaboration
Lin, J., Tomlin, N., Andreas, J., & Eisner, J. (2024) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00679 · Cited by 34
LLMs Are Also Effective Embedding Models: An In-depth Overview
Tao, C., Shen, T., Gao, S., Zhang, J., Li, Z., Hua, K., Hu, W., Tao, Z., & Ma, S. (2026) · ACM Transactions on Information Systems · doi:10.1145/3831684 · Cited by 77
From intention to implementation: automating biomedical research via LLMs
Luo, Y., Shi, L., Li, Y., Zhuang, A., Gong, Y., Liu, L., & Chen, L. (2025) · Science China Information Sciences · doi:10.1007/s11432-024-4485-0 · Cited by 88
Analyzing Dataset Annotation Quality Management in the Wild
Klie, J.-C., de Castilho, R. E., & Gurevych, I. (2024) · Computational Linguistics · doi:10.1162/coli_a_00516 · Cited by 139
ProbGuard: Proactive Runtime Monitoring for LLM Agent Safety via Probabilistic Prediction
Wang, H., POSKITT, C. M., Wei, J., & Sun, J. (2026) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1145/3832783.3837413 · Cited by 83
Metadata
- Authors
- Ouyang, L., Wu, J., Jiang, X., Almeida, D., Wainwright, C., Mishkin, P., Zhang, C., Agarwal, S., Slama, K., Ray, A., Schulman, J., Hilton, J., Kelton, F., Miller, L., Simens, M., Askell, A., Welinder, P., Christiano, P., Leike, J., & Lowe, R.
- Venue
- Advances in Neural Information Processing Systems 35
- Published
- 2022
- Pages
- 27730-27744
- ISSN
- 1049-5258 (ISSN-L)
- OpenAlex
- W7133211372
- Cited by
- 3,117
- References
- 0
- Citations by year
- 2026: 1421 · 2025: 544 · 2024: 852 · 2023: 297 · 2022: 3
- FWCI
- 234.27
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- neural information processing systems (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Keywords
- instruction following, language models, human feedback, reinforcement learning from human feedback, large language models
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.