Training Language Models to Follow Instructions with Human Feedback
The DOI matches its Crossref record; 2 of the 2 references it cites were found in a registry or an index.
Abstract
Making language models bigger does not inherently make them better at following a user's intent. For example, large language models can generate outputs that are untruthful, toxic, or simply not helpful to the user. In other words, these models are not aligned with their users. In this paper, we show an avenue for aligning language models with user intent on a wide range of tasks by fine-tuning with human feedback. Starting with a set of labeler-written prompts and prompts submitted through the OpenAI API, we collect a dataset of labeler demonstrations of the desired model behavior, which we use to fine-tune GPT-3 using supervised learning. We then collect a dataset of rankings of model outputs, which we use to further fine-tune this supervised model using reinforcement learning from human feedback. We call the resulting models InstructGPT. In human evaluations on our prompt distribution, outputs from the 1.3B parameter InstructGPT model are preferred to outputs from the 175B GPT-3, despite having 100x fewer parameters. Moreover, InstructGPT models show improvements in truthfulness and reductions in toxic output generation while having minimal performance regressions on public NLP datasets. Even though InstructGPT still makes simple mistakes, our results show that fine-tuning with human feedback is a promising direction for aligning language models with human intent.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Existing literature (Ouyang et al., 2022) does not fully describe the details of these models, such as the pretraining corpus, model sizes, and model biases.”
From Self-Refine: Iterative Refinement with Self-Feedback (2023) · cites this paper as Ouyang et al., 2022
Experimental — accuracy not yet measuredIn the citing paper
“Specifically, providers mitigate race and gender bias through reinforcement learning from human feedback (RLHF), adversarial stress-testing known as red teaming, and hard-coded refusals governed by the provider's own content policies [6, 43, 71].”
From All Public Voices Are Equal, But Are Some More Equal Than Others to LLMs? (2026) · cites this paper as [71]
In the citing paper
“Fine-tuning a model from human feedback at scale, using preference data from paid raters or drawn from a large and willing user base, is an especially potent technique.It has the potential not only to shape a model's responses to better reflect user norms (for better or worse), but also to filter out toxic language, improve factual accuracy, and mitigate the tendency to fabricate information.”
From Talking about Large Language Models (2024) · cites this paper as [26]
In the citing paper
“These include general competencies such as in-context learning (ICL) [13], chain-of-thought (CoT) [17] reasoning, and instruction following [25], as well as task-specialized skills like mathematical reasoning [30].”
From A Survey of Large Language Models (2026) · cites this paper as [25]
In the citing paper
“When external reward models or ground-truth answers are available, rejection sampling can also be applied to select higher-quality responses from multiple candidates [25].”
From A Survey of Large Language Models (2026) · cites this paper as [25]
41 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
The publisher hasn’t deposited this paper’s reference list.
Cited by
Items 1,201–1,300 of 4,340
Generative Artificial Intelligence for Industry: Opportunities, Challenges, and Impact
Saha, B. K. (2024) · 2024 International Conference on Artificial Intelligence in Information and Communication (ICAIIC) · doi:10.1109/icaiic60209.2024.10463245 · Cited by 11
Improved Video Emotion Recognition With Alignment of CNN and Human Brain Representations
Fu, K., Du, C., Wang, S., & He, H. (2023) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2023.3316173 · Cited by 12
Optimizing and Evaluating Pre- Trained Large Language Models for Alzheimer's Disease Detection
Casu, F., Grosso, E., Lagorio, A., & Trunfio, G. A. (2024) · Euromicro International Conference on Parallel, Distributed and Network-Based Processing (PDP) · doi:10.1109/pdp62718.2024.00046 · Cited by 16
Zhang, J., Kang, J., Zhang, K., Zhang, L., Liu, P., Liu, X., Sun, W., & Wang, G. (2024) · Geoenergy Science and Engineering · doi:10.1016/j.geoen.2024.212994 · Cited by 17
Adversarial Attacks on Vision-Language Model-Empowered Chatbots in Consumer Electronics
Shang, Y., Liu, Z., Kang, J., Hossain, M. S., & Wu, Y. (2024) · IEEE Transactions on Consumer Electronics · doi:10.1109/tce.2024.3417688 · Cited by 13
A New Pipeline for Generating Instruction Dataset via RAG and Self Fine-Tuning
Sung, C.-W., Lee, Y.-K., & Tsai, Y.-T. (2024) · IEEE Annual International Computer Software and Applications Conference (COMPSAC) · doi:10.1109/compsac61105.2024.00371 · Cited by 11
Diffusion-Based Graph Generative Methods
Chen, H., Xu, C., Zheng, L., Zhang, Q., & Lin, X. (2024) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2024.3466301 · Cited by 15
Learning to generate and evaluate fact-checking explanations with transformers
Feher, D., Khered, A., Zhang, H., Batista-Navarro, R., & Schlegel, V. (2024) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2024.109492 · Cited by 15
Fine-Grained Reward Optimization for Machine Translation using Error Severity Mappings
Ramos, M. M., Almeida, T., Vareta, D., Azevedo, F., Agrawal, S., Fernandes, P., & Martins, A. F. T. (2026) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl.a.646 · Cited by 16
Zhou, Y., Chu, H., Li, Q., Li, J., Zhang, S., Zhu, F., Hu, J., Wang, L., & Yang, W. (2024) · Neural Networks · doi:10.1016/j.neunet.2024.107001 · Cited by 13
Butlin, P. (2024) · Inquiry · doi:10.1080/0020174x.2024.2439995 · Cited by 13
A Survey of Human-Object Interaction Detection With Deep Learning
Geng, H., Zhao, J., Zhang, L., & Deng, F. Y. (2024) · IEEE Transactions on Emerging Topics in Computational Intelligence · doi:10.1109/tetci.2024.3518613 · Cited by 11
Human-Guided Data Augmentation via Diffusion Model for Surface Defect Recognition Under Limited Data
Fang, T., Zhang, M., Song, R., Li, X., Wei, Z., & Zhang, W. (2025) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2025.3541684 · Cited by 12
Jin, K., Wang, Y., Santos, L., Fang, T., Yang, X., & Im, S. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10887684 · Cited by 14
Cai, W., Du, Y., Wu, D., Weng, Z., & Liu, C. (2025) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2025.3547939 · Cited by 11
Efficient and explainable sequential recommendation with language model
Li, Z., Zou, L., Li, C., & Li, C. (2025) · Information Processing & Management · doi:10.1016/j.ipm.2025.104122 · Cited by 14
Gong, L., Chen, J., & Wu, F. Q. (2025) · IEEE Transactions on Learning Technologies · doi:10.1109/tlt.2025.3564177 · Cited by 11
Large Language Models as Particle Swarm Optimizers
Shinohara, Y., Xu, J., Li, T., & Iba, H. (2025) · IEEE Congress on Evolutionary Computation (CEC) · doi:10.1109/cec65147.2025.11043021 · Cited by 11
A survey of backdoor attacks and defences: From deep neural networks to large language models
Jin, L., Jiang, W., Wen, X., Lin, M.-Y., Zhan, J., Zhou, X.-Z., Habtie, M. A., & Werghi, N. (2025) · Journal of Electronic Science and Technology · doi:10.1016/j.jnlest.2025.100326 · Cited by 13
Benchmarking Large Language Models on Homework Assessment in Circuit Analysis
Chen, L., Qin, Z., Guo, Y., Rohde, J. A., & Zhang, Y. (2025) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-025-00501-w · Cited by 18
SC-LoRA: Balancing Efficient Fine-tuning and Knowledge Preservation via Subspace-Constrained LoRA
Luo, M., Kuang, F., Wang, Y. H., Liu, Z., & He, T. (2026) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn69854.2026.11728878 · Cited by 12
Smoke and Mirrors: Jailbreaking LLM-based Code Generation via Implicit Malicious Prompts
Ouyang, S., Qin, Y., Lin, B., Chen, L., Mao, X., & Wang, S. (2026) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/3744916.3764566 · Cited by 16
Gonzalez Penuela, R. E., Jung, C., Lin, S., Hu, R., & Azenkot, S. (2026) · Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3793266 · Cited by 6
Yu, M., Li, H., Singh, P., Li, X., Wang, D., & Hu, L. (2026) · International World Wide Web Conference (WWW) · doi:10.1145/3774904.3792273 · Cited by 13
Wang, Z., Yu, Z., Zhu, Y., Zhao, B., Liang, H., Wang, T., Xia, W., Zhang, J., Liu, Z., Ma, H., et al. (2026) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3767308.3835848 · Cited by 11
Survey on LLM Safety: Attacks, Defenses, Alignment, Metrics, and Guardrails
Jalan, P., Abishethvarman, V., Chandna, B., & Naseem, U. (2026) · Machine Learning · doi:10.1007/s10994-026-07060-8 · Cited by 22
Yu, Y., Wang, Y., Ma, W., Guo, Z., & Zhang, M. (2026) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3770855.3818052 · Cited by 11
Williams, M. C., & Shambrook, J. S. (2023) · Journal of cardiovascular computed tomography · doi:10.1016/j.jcct.2023.03.010 · Cited by 11
Conversational Text-to-SQL: An Odyssey into State-of-the-Art and Challenges Ahead
Parthasarathi, S. H. K., Zeng, L., & Hakkani-Tur, D. Z. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10096170 · Cited by 11
NeoDescriber: An image-to-text model for automatic style description of neoclassical architecture
Qin, W., Chen, L., Zhang, B., Chen, W., & Luo, H. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.120706 · Cited by 11
Mboma, J. G. M., Tshipata, O. T., Kambale, W. V., & Kyamakya, K. (2023) · International Conference on Circuits, Systems, Communications and Computers (CSCC) · doi:10.1109/cscc58962.2023.00018 · Cited by 15
Semi-Infinitely Constrained Markov Decision Processes and Provably Efficient Reinforcement Learning
Zhang, L., Yang, P., Yang, W., & Zhang, Z. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3348460 · Cited by 11
Continual Learning for Personalized Co-Speech Gesture Generation
Ahuja, C., Joshi, P., Ishii, R., & Morency, L. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01910 · Cited by 19
Distractor Generation Through Text-to-Text Transformer Models
de-Fitero-Dominguez, D., García‐López, E., García‐Cabot, A., del-Hoyo-Gabaldon, J.-A., & Moreno-Cediel, A. (2024) · IEEE Access · doi:10.1109/access.2024.3361673 · Cited by 14
The First ChatGPT4PCG Competition
Abdullah, F., Taveekitworachai, P., Dewantoro, M. F., Thawonmas, R., Togelius, J., & Renz, J. (2024) · IEEE Transactions on Games · doi:10.1109/tg.2024.3376429 · Cited by 14
Yue, L., & Chen, T. (2023) · IEEE Globecom Workshops (GC Wkshps) · doi:10.1109/gcwkshps58843.2023.10465211 · Cited by 11
Efficient Vision-Language Pre-Training by Cluster Masking
Wei, Z., Pan, Z., & Owens, A. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02532 · Cited by 21
Learning Evaluation Models From Large Language Models for Sequence Generation
Wang, C., Zhou, H., Chang, K., Liu, T., Zhang, C., Yang, M., Du, Q., Xiao, T., Zhang, Y., & Zhu, J. (2025) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/taslpro.2025.3587460 · Cited by 12
Self-citationMM-instruct: Generated visual instructions for large multimodal model alignment
Huang, X., Liu, J., Zheng, J., Liu, B., Wang, J., Liu, Y., Li, H., & Yoshie, O. (2025) · Neurocomputing · doi:10.1016/j.neucom.2025.131164 · Cited by 12
A competitive learning scheme for deep neural network pattern classifier training
Zheng, S., Lan, F., & Castellani, M. (2023) · Applied Soft Computing · doi:10.1016/j.asoc.2023.110662 · Cited by 11
Efficient Finetuning Large Language Models For Vietnamese Chatbot
Doan, V.-T., Truong, Q.-T., Nguyen, D.-V., Nguyen, V.-T., & Luu, T.-N. N. (2023) · International Conference on Multimedia Analysis and Pattern Recognition (MAPR) · doi:10.1109/mapr59823.2023.10288647 · Cited by 11
Large Language Model Agent in Financial Trading: A Survey
Ding, H., Li, Y., Wang, J., Chen, H., Guo, D., & Zhang, Y. (2026) · Proceedings of the 2026 9th International Conference on Computers in Management and Business · doi:10.1145/3802463.3802475 · Cited by 10
Device-Cloud Collaborative LLM Inference With Multi-Modal, Multi-Task, and Multi-Turn Conversations
Yuan, L., Han, D.-J., Wang, S., & Brinton, C. G. (2026) · IEEE Transactions on Networking · doi:10.1109/ton.2026.3712685 · Cited by 13
Jiang, J., Huang, Y., Wang, Z., Wang, C., Xiong, Y., Zhang, J., & Yu, H. (2026) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3770855.3817873 · Cited by 13
Retroformer: Retrospective Large Language Agents with Policy Gradient Optimization
Yao, W., Heinecke, S., Niebles, J. C., Liu, Z., Feng, Y., Xue, L., Murthy, R., Chen, Z., Zhang, J., Arpit, D., et al. (2023) · arXiv · doi:10.48550/arxiv.2308.02151 · Cited by 10
“The retrospective language model is fine-tuned at the end of each episode following the standard RLHF training procedures (Ouyang et al., 2022) with proximal policy optimization: where ( x, y ) are sampled from the replay buffer, r ( x, y ) is the defined reward model, and the second term in this…”
MethodRe-evaluating Theory of Mind evaluation in large language models
Hu, J., Sosa, F., & Ullman, T. (2025) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2023.0499 · Cited by 10
A knowledge-driven framework for Robotic Odor Source Localization using large language models
Mahmud, K. R., Wang, L., Hassan, S., & Zhang, Z. (2025) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2025.104915 · Cited by 10
OLMo: Accelerating the Science of Language Models
Groeneveld, D., Beltagy, I., Walsh, P., Bhagia, A., Kinney, R., Tafjord, O., Jha, A. H., Ivison, H., Magnusson, I., Wang, Y., et al. (2024) · arXiv · doi:10.48550/arxiv.2402.00838 · Cited by 10
“Following previous literature (Strubell et al., 2019; Patterson et al., 2021; Wu et al., 2022; Dodge et al., 2022), we estimate the total energy consumed and carbon released while pretraining our models by calculating the total power consumption required for training, and then multiplying it by the…”
BackgroundMethodA recent survey on controllable text generation: A causal perspective
Wang, J., Zhang, C., Zhang, D., Tong, H., Yan, C., & Jiang, C. (2024) · Fundamental Research · doi:10.1016/j.fmre.2024.01.001 · Cited by 18
Self-citationLearning to Guide Human Decision Makers with Vision-Language Models
Banerjee, D., Teso, S., Sayin, B., Pal, R., & Passerini, A. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-41086-3_8 · Cited by 10
Fan, S., Xu, W., Xie, R., Jin, S., Ng, D. W. K., & Al‐Dhahir, N. (2024) · IEEE Transactions on Communications · doi:10.1109/tcomm.2024.3384256 · Cited by 12
Speed Up! Cost-Effective Large Language Model for ADAS Via Knowledge Distillation
Taveekitworachai, P., Suntichaikul, P., Nukoolkit, C., & Thawonmas, R. (2024) · IEEE Intelligent Vehicles Symposium · doi:10.1109/iv55156.2024.10588799 · Cited by 13
Guiding ChatGPT for Better Code Generation: An Empirical Study
Liu, C., Bao, X., Zhang, H., Zhang, N., Hu, H., Zhang, X., & Yan, M. L. (2024) · IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER) · doi:10.1109/saner60148.2024.00018 · Cited by 18
Liu, N., Wei, K., Yang, Y., Tao, J., Sun, X., Yao, F., Yu, H., Jin, L., Lv, Z., & Fan, C. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3447778 · Cited by 19
Wang, X., Liu, Y., Cheng, X., Wang, Y., Tian, Y., & Wang, F. (2024) · Neurocomputing · doi:10.1016/j.neucom.2024.128973 · Cited by 10
Li, R., Wang, Y., Wen, Z., Cui, M., & Miao, Q. (2024) · Knowledge-Based Systems · doi:10.1016/j.knosys.2024.112789 · Cited by 14
Supervised contrastive deep Q-Network for imbalanced radar automatic target recognition
Liu, G., Chen, W., Chen, B., Feng, B., Wang, P., & Liu, H. (2024) · Pattern Recognition · doi:10.1016/j.patcog.2024.111264 · Cited by 10
5G INSTRUCT Forge: An Advanced Data Engineering Pipeline for Making LLMs Learn 5G
Said, A. I. A., Mekrache, A., Boutiba, K., Ramantas, K., Ksentini, A., & Rahmani, M. (2025) · IEEE Transactions on Cognitive Communications and Networking · doi:10.1109/tccn.2024.3516055 · Cited by 8
Decomposition, Synthesis, and Attack: A Multi-Instruction Fusion Method for Jailbreaking LLMs
Jiang, S., Chen, X., Xu, K., Chen, L., Ren, H., & Tang, R. (2025) · IEEE Internet of Things Journal · doi:10.1109/jiot.2025.3525741 · Cited by 16
LLM-Sentry: A Model-Agnostic Human-in-the-Loop Framework for Securing Large Language Models
Irtiza, S., Akbar, K. A., Yasmeen, A., Khan, L. R., Daescu, O., & Thuraisingham, B. M. (2024) · IEEE International Conference on Trust, Privacy and Security in Intelligent Systems and Applications (TPS-ISA) · doi:10.1109/tps-isa62245.2024.00036 · Cited by 15
Niezen, L. E., Libin, P., Cabooter, D., & Desmet, G. (2025) · Journal of Chromatography A · doi:10.1016/j.chroma.2025.465845 · Cited by 10
UniTMGE: Uniform Text-Motion Generation and Editing Model via Diffusion
Wang, R., He, Y., Sun, T., Li, X., & Shi, T. (2025) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv61041.2025.00595 · Cited by 25
PRADA: Prompt-guided Representation Alignment and Dynamic Adaption for time series forecasting
Liu, Y., Kuang, Z., Zhang, H., Chen, L., Li, F., & Ding, X. (2025) · Knowledge-Based Systems · doi:10.1016/j.knosys.2025.113478 · Cited by 12
Liu, S., Radway, R. M., Wang, X., Moro, F., Nodin, J.-F., Jana, K., Yan, L., Du, S., Upton, L. R., Chen, W.-C., et al. (2025) · IEEE Transactions on Electron Devices · doi:10.1109/ted.2025.3556113 · Cited by 10
IIIM-SAM: Zero-Shot Texture Anomaly Detection Without External Prompts
Zhang, Z., Zhou, Y., Yue, J., Zhang, R., & Ma, J. (2025) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2025.3561776 · Cited by 13
AgentBuilder: Automating agent creation via large language model-driven systems
Tang, W., Zhang, H. W., Huang, J., Wang, S., Yu, F., Yang, H., & Wang, Y. (2025) · Neurocomputing · doi:10.1016/j.neucom.2025.130476 · Cited by 10
Unraveling the potential of diffusion models in small-molecule generation
Zhang, P. C., Baker, D., Song, M., & Bi, J. (2025) · Drug Discovery Today · doi:10.1016/j.drudis.2025.104413 · Cited by 14
Li, Z., Luo, X., Yang, Z., Zhang, H., Wang, B., Ge, L., Bian, Z., Zou, J., Chen, Y., Zhang, L., et al. (2025) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocaf093 · Cited by 11
A Survey on the Scheduling of DL and LLM Training Jobs in GPU Clusters
Fu, T., Yang, Z., Ye, Z., Ma, C., Han, Y., Luo, Y., Wang, X., & Wang, Z. (2025) · Chinese Journal of Electronics · doi:10.23919/cje.2024.00.070 · Cited by 17
Motion-example-controlled Co-speech Gesture Generation Leveraging Large Language Models
Chen, B., Li, Y., Zheng, Y., Ding, Y.-X., & Zhou, K. (2025) · ACM SIGGRAPH Conference (SIGGRAPH) · doi:10.1145/3721238.3730611 · Cited by 22
Lau, G. R., Low, W. Y., Koh, S. M., Nah, F. F.-H., & Hartanto, A. (2026) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2026.2755127 · Cited by 10
Can structural correspondences ground real‐world representational content in large language models?
Williams, I. (2026) · Mind & Language · doi:10.1111/mila.70018 · Cited by 13
UAV formation control based on ensemble reinforcement learning
Wu, K., Liu, L., Liang, C., & Li, L. (2025) · Neurocomputing · doi:10.1016/j.neucom.2025.131056 · Cited by 10
3D Human Interaction Generation: A Survey
Fan, S., Huang, W., Cai, X., & Du, B. (2026) · ACM Computing Surveys · doi:10.1145/3842385 · Cited by 10
FEM-Bench: a structured scientific reasoning benchmark for evaluating code-generating LLMs
Mohammadzadeh, S., Hamdi, E., Shor, J., & Lejeune, E. (2026) · Engineering With Computers · doi:10.1007/s00366-026-02397-z · Cited by 11
VIGOR: VIdeo Geometry-Oriented Reward for Temporal Generative Alignment
Yin, T., Shi, J., Guo, H., & Wang, X. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37189-8_14 · Cited by 11
MFS enhanced SAM: Achieving superior performance in bimodal few-shot segmentation
Zhao, Y., Song, K., Cui, W., Ren, H., & Yan, Y. (2023) · Journal of Visual Communication and Image Representation · doi:10.1016/j.jvcir.2023.103946 · Cited by 11
Kaviani, S., Ryu, B., Ahmed, E., Kim, D., Kim, J. H., Spiker, C., & Harnden, B. (2023) · IEEE Military Communications Conference (MILCOM) · doi:10.1109/milcom58377.2023.10356325 · Cited by 14
Detecting goals of care conversations in clinical notes with active learning
Weissenbacher, D., Courtright, K. R., Rawal, S., Crane‐Droesch, A., O’Connor, K., Kuhl, N., Merlino, C., Foxwell, A. M., Haines, L., Puhl, J., et al. (2024) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2024.104618 · Cited by 11
Liu, J., Fang, C., Li, L., Li, B., Hu, D., & Ma, C. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10448321 · Cited by 10
Zhang, T., Meng, J., Yang, Y., & Yu, S. (2024) · Applied Sciences · doi:10.3390/app14072817 · Cited by 11
Fine-grained and coarse-grained contrastive learning for text classification
Zhang, S., & Ran, N. (2024) · Neurocomputing · doi:10.1016/j.neucom.2024.128084 · Cited by 10
A Generalized Acquisition Function for Preference-based Reward Learning
Ellis, E., Ghosal, G. R., Russell, S., Dragan, A. D., & Bıyık, E. (2024) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra57147.2024.10611472 · Cited by 15
Exploring Edge-Driven Collaborative Fine-Tuning Toward Customized AIGC Services
Zhang, Q.-N., Zong, T.-Q., Xiong, Z.-H., Sun, P., Zhu, J.-M., Qiu, W.-J., Zheng, Z.-M., & Poor, H. (2025) · IEEE Network · doi:10.1109/mnet.2024.3441040 · Cited by 10
SC- Tune: Unleashing Self-Consistent Referential Comprehension in Large Vision Language Models
Yue, T., Cheng, J. Z., Guo, L., Dai, X., Zhao, Z., He, X., Xiong, G., Lv, Y., & Liu, J. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01242 · Cited by 19
Bias-guided margin loss for robust Visual Question Answering
Sun, Y., Qi, J., Zhu, Z., Li, K., Zhao, L., & Lv, L. (2024) · Information Processing & Management · doi:10.1016/j.ipm.2024.103988 · Cited by 10
Hou, K., Li, J., Liu, Y., Sun, S., Zhang, H., & Jiang, H. (2024) · Electronics · doi:10.3390/electronics13234835 · Cited by 10
Enriched Image Captioning Based on Knowledge Divergence and Focus
Liu, A.-A., Wu, Q., Xu, N., Tian, H., & Wang, L. (2025) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2024.3525158 · Cited by 10
Elucidating Optimal Reward-Diversity Tradeoffs in Text-to-Image Diffusion Models
Jena, R., Taghibakhshi, A., Jain, S., Shen, G., Tajbakhsh, N., & Vahdat, A. (2025) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv61041.2025.00033 · Cited by 16
Should LLM Safety be More Than Refusing Harmful Instructions?
Maskey, U., Dras, M., & Naseem, U. (2026) · Machine Learning · doi:10.1007/s10994-026-07107-w · Cited by 15
Censoring chemical data to mitigate dual use risk
Campbell, Q., Herington, J., & White, A. D. (2026) · Digital Discovery · doi:10.1039/d5dd00512d · Cited by 10
Marques, B., Silva, S., Teixeira, A. J. S., Alves, J., Dias, P., & Santos, B. S. (2023) · IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW) · doi:10.1109/vrw58643.2023.00082 · Cited by 10
Prompt-based event relation identification with Constrained Prefix ATTention mechanism
Zhang, H., Ke, W., Zhang, J., Luo, Z., Ma, H., Luan, Z., & Wang, P. (2023) · Knowledge-Based Systems · doi:10.1016/j.knosys.2023.111072 · Cited by 10
End-to-End Procedural Level Generation in Educational Games with Natural Language Instruction
Kumaran, V., Carpenter, D., Rowe, J., Mott, B., & Lester, J. C. (2023) · IEEE Conference on Games (CoG) · doi:10.1109/cog57401.2023.10333195 · Cited by 16
Beyond Object Recognition: A New Benchmark towards Object Concept Learning
Li, Y., Xu, Y., Xu, X., Mao, X., Yao, Y., Liu, S., & Lu, C. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01833 · Cited by 17
GPT-DETOX: An In-Context Learning-Based Paraphraser for Text Detoxification
Pesaranghader, A., Verma, N., & Bharadwaj, M. (2023) · International Conference on Machine Learning and Applications · doi:10.1109/icmla58977.2023.00230 · Cited by 16
Hassani, H., Hallaji, E., Razavi‐Far, R., Saif, M., & Lin, L. (2025) · IEEE Transactions on Artificial Intelligence · doi:10.1109/tai.2025.3610590 · Cited by 13
RubricRL: Simple Generalizable Rewards for Text-to-Image Generation
Feng, X., Li, Y., Wan, Z., Gao, Z., Yuan, J., Chen, D., & Qiao, C. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37550-6_8 · Cited by 11
Reasoning Models Don't Always Say What They Think
Chen, Y., Benton, J., Radhakrishnan, A., Uesato, J., Denison, C., Schulman, J., Somani, A., Hase, P., Wagner, M., Roger, F., et al. (2025) · arXiv · doi:10.48550/arxiv.2505.05410 · Cited by 18
“On the other hand, reinforcement learning from human feedback (RLHF) could incentivize models to hide undesirable reasoning from their CoT (Ouyang et al., 2022; Chua and Evans, 2025).”
Self-citationFine-tuning Language Models for Factuality
Tian, K., Mitchell, E., Yao, H., Manning, C. D., & Finn, C. (2023) · arXiv · doi:10.48550/arxiv.2311.08401 · Cited by 14
“…in training large language models (LLMs), particularly methods that learn from rankings over responses such as reinforcement learning from human feedback (RLHF) (Christiano et al., 2017; Ziegler et al., 2020; Ouyang et al., 2022), have enabled the development of powerful, engaging dialogue agents.”
Metadata
- Authors
- Ouyang, L., Wu, J., Jiang, X., Almeida, D., Wainwright, C., Mishkin, P., Zhang, C., Agarwal, S., Slama, K., Ray, A., Schulman, J., Hilton, J., Kelton, F., Miller, L., Simens, M., Askell, A., Welinder, P., Christiano, P., Leike, J., & Lowe, R.
- Venue
- Advances in Neural Information Processing Systems 35
- Published
- 2022
- Pages
- 27730-27744
- ISSN
- 1049-5258 (ISSN-L)
- OpenAlex
- W7133211372
- Cited by
- 3,117
- References
- 0
- Citations by year
- 2026: 1421 · 2025: 544 · 2024: 852 · 2023: 297 · 2022: 3
- FWCI
- 234.27
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- neural information processing systems (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Keywords
- instruction following, language models, human feedback, reinforcement learning from human feedback, large language models
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.