Training Language Models to Follow Instructions with Human Feedback
The DOI matches its Crossref record; 2 of the 2 references it cites were found in a registry or an index.
Abstract
Making language models bigger does not inherently make them better at following a user's intent. For example, large language models can generate outputs that are untruthful, toxic, or simply not helpful to the user. In other words, these models are not aligned with their users. In this paper, we show an avenue for aligning language models with user intent on a wide range of tasks by fine-tuning with human feedback. Starting with a set of labeler-written prompts and prompts submitted through the OpenAI API, we collect a dataset of labeler demonstrations of the desired model behavior, which we use to fine-tune GPT-3 using supervised learning. We then collect a dataset of rankings of model outputs, which we use to further fine-tune this supervised model using reinforcement learning from human feedback. We call the resulting models InstructGPT. In human evaluations on our prompt distribution, outputs from the 1.3B parameter InstructGPT model are preferred to outputs from the 175B GPT-3, despite having 100x fewer parameters. Moreover, InstructGPT models show improvements in truthfulness and reductions in toxic output generation while having minimal performance regressions on public NLP datasets. Even though InstructGPT still makes simple mistakes, our results show that fine-tuning with human feedback is a promising direction for aligning language models with human intent.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Existing literature (Ouyang et al., 2022) does not fully describe the details of these models, such as the pretraining corpus, model sizes, and model biases.”
From Self-Refine: Iterative Refinement with Self-Feedback (2023) · cites this paper as Ouyang et al., 2022
Experimental — accuracy not yet measuredIn the citing paper
“Specifically, providers mitigate race and gender bias through reinforcement learning from human feedback (RLHF), adversarial stress-testing known as red teaming, and hard-coded refusals governed by the provider's own content policies [6, 43, 71].”
From All Public Voices Are Equal, But Are Some More Equal Than Others to LLMs? (2026) · cites this paper as [71]
In the citing paper
“Fine-tuning a model from human feedback at scale, using preference data from paid raters or drawn from a large and willing user base, is an especially potent technique.It has the potential not only to shape a model's responses to better reflect user norms (for better or worse), but also to filter out toxic language, improve factual accuracy, and mitigate the tendency to fabricate information.”
From Talking about Large Language Models (2024) · cites this paper as [26]
In the citing paper
“These include general competencies such as in-context learning (ICL) [13], chain-of-thought (CoT) [17] reasoning, and instruction following [25], as well as task-specialized skills like mathematical reasoning [30].”
From A Survey of Large Language Models (2026) · cites this paper as [25]
In the citing paper
“When external reward models or ground-truth answers are available, rejection sampling can also be applied to select higher-quality responses from multiple candidates [25].”
From A Survey of Large Language Models (2026) · cites this paper as [25]
41 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
The publisher hasn’t deposited this paper’s reference list.
Cited by
Items 1,401–1,500 of 4,340
Yang, C., Li, Z., & Zhang, L. (2024) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2024.3497976 · Cited by 8
Jin, Y., Liu, J., & Chen, S. (2024) · Knowledge-Based Systems · doi:10.1016/j.knosys.2024.112750 · Cited by 13
Xia, L., Fan, J., Parlikad, A. K., Huang, X. X., & Zheng, P. (2024) · IEEE Transactions on Big Data · doi:10.1109/tbdata.2024.3522814 · Cited by 13
Naver: a Neuro-Symbolic Compositional Automaton for Visual Grounding with Explicit Logic Reasoning
Cai, Z., Ke, F., Jahangard, S., de la Banda, M. G., Haffari, R., Stuckey, P. J., & Rezatofighi, H. (2025) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.02232 · Cited by 18
Preference-Based Multi-Objective Reinforcement Learning with Explicit Reward Modeling
Mu, N., Luan, Y., & Jia, Q. (2024) · China Automation Congress (CAC) · doi:10.1109/cac63892.2024.10865310 · Cited by 8
Kumar, A., & Ji, T. (2024) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata62323.2024.10982029 · Cited by 8
Dissociable frequency effects attenuate as large language model surprisal predictors improve
Oh, B.-D., & Schuler, W. (2025) · Journal of Memory and Language · doi:10.1016/j.jml.2025.104645 · Cited by 11
Yadav, S., Qureshi, A. M., Kaushik, A., Sharma, S., Loughran, R., Kazhuparambil, S., Shaw, A., Sabry, M., Lynch, N. S. J., Singh, N., et al. (2026) · Applied AI Letters · doi:10.1002/ail2.70037 · Cited by 8
Cai, J., Zhang, M., Ishimizu, Y., Li, M., Li, J., & Tei, K. (2026) · Journal of Computational Social Science · doi:10.1007/s42001-026-00481-4 · Cited by 8
Irregular situations in real-world intelligent systems
Mishra, A., & Kim, S. (2023) · Advances in computers · doi:10.1016/bs.adcom.2023.04.006 · Cited by 9
Analyzing Semantic Faithfulness of Language Models via Input Intervention on Question Answering
Chaturvedi, A., Bhar, S., Saha, S., Garain, U., & Asher, N. M. (2023) · Computational Linguistics · doi:10.1162/coli_a_00493 · Cited by 16
Identifying Gender Bias in Generative Models for Mental Health Synthetic Data
Lozoya, D. C., D’Alfonso, S., & Conway, M. (2023) · IEEE International Conference on Healthcare Informatics (ICHI) · doi:10.1109/ichi57859.2023.00109 · Cited by 18
Answering Uncertain, Under-Specified API Queries Assisted by Knowledge-Aware Human-AI Dialogue
Huang, Q. Y., Li, Z., Xing, Z., Zuo, Z., Peng, X., Xu, X., & Lu, Q. (2023) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2023.3346954 · Cited by 9
Peng, B., Chersoni, E., Hsu, Y.-Y., Qiu, L., & Huang, C. (2024) · Knowledge-Based Systems · doi:10.1016/j.knosys.2024.111683 · Cited by 10
Scalable Interactive Machine Learning for Future Command and Control
Madison, A., Novoseller, E., Goecks, V. G., Files, B. T., Waytowich, N. R., Yu, A., Lawhern, V. J., Thurman, S. M., Kelshaw, C., & McDowell, K. (2024) · International Conference on Military Communications and Information Systems (ICMCIS) · doi:10.1109/icmcis61231.2024.10540933 · Cited by 11
Fast Global Self-Attention for Seismic Image Fault Identification
Wang, S., Si, X., Cai, Z., Sun, L., Wang, W., & Jiang, Z. (2024) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2024.3436066 · Cited by 17
Research on Tibetan Tourism Viewpoints Information Generation System Based on LLM
Qi, J., Yan, S., Zhang, W., Zhang, Y., Liu, Z., & Wang, K. (2024) · International Conference on Intelligent Computing and Wireless Optical Communications (ICWOC) · doi:10.1109/icwoc62055.2024.10684948 · Cited by 8
Train and Constrain: Phonologically Informed Tongue Twister Generation from Topics and Paraphrases
Loakman, T., Tang, C., & Lin, C. (2025) · Computational Linguistics · doi:10.1162/coli_a_00544 · Cited by 10
Can LLMs Understand Social Norms in Autonomous Driving Games?
Wang, B., Duan, H., Feng, Y., Chen, X., Fu, Y., Mo, Z., & Di, X. S. (2024) · IEEE International Automated Vehicle Validation Conference (IAVVC) · doi:10.1109/iavvc63304.2024.10786452 · Cited by 14
End-to-end breast cancer radiotherapy planning via LMMs with consistency embedding
Kim, K., Oh, Y., Park, S. J., Byun, H. K., Lee, J., Kim, J. S., Kim, Y. B., & Ye, J. C. (2025) · Medical Image Analysis · doi:10.1016/j.media.2025.103646 · Cited by 9
ScienceIDE: Turning World's Scientific Codebase into Agent Learnable EnvironmentsPreprint
Geng, H., Huang, Z., Li, H., Li, W., Wu, K., Zhou, Z., Pang, Y., Liu, W., Xu, Z., Li, Z., et al. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2609.19134 · Cited by 8
Oh, G., Kim, S., Park, S., & Kim, B.-H. (2026) · Journal of Medical Internet Research · doi:10.2196/90693 · Cited by 7
“Llama 3 is trained using SFT followed by RL from human feed-back [47], whereas Qwen2.”
Scaling Tumor Segmentation: Best Lessons from Real and Synthetic Data
Chen, Q., Zhou, X., Liu, C. P., Chen, H., Li, W., Jiang, Z., Huang, Z., Zhao, Y. J., Yu, D., He, J., et al. (2025) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.02225 · Cited by 23
Jia, Q., Wen, Y., Liu, Y., Zhao, H., Yu, Q., Long, Y., Sun, D., & Yu, Y. (2026) · PLoS ONE · doi:10.1371/journal.pone.0348819 · Cited by 9
AI and actor-specific decisions
Felin, T., Sako, M., & Hullman, J. (2026) · AI & Society · doi:10.1007/s00146-026-03202-7 · Cited by 8
IG-RFT: An Interaction-Guided RL Framework for VLA Models in Long-Horizon Robotic Manipulation
Su, Z., Kong, W., Dong, H., & Dong, H. (2026) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2026.3719668 · Cited by 9
Privacy-Preserving LLM Embedding Transmission for End-Cloud Collaboration
Jin, S., Pang, X., Wang, Z., Wang, H., Du, J., Hu, J., & Ren, K. (2026) · IEEE Transactions on Networking · doi:10.1109/ton.2026.3729842 · Cited by 7
In-context Autoencoder for Context Compression in a Large Language Model
Ge, T., Hu, J., Wang, L., Wang, X., Chen, S.-Q., & Wei, F. (2023) · arXiv · doi:10.48550/arxiv.2307.06945 · Cited by 11
“…context extends beyond rote memorization or continuation; instead, the more common use scenario is using the provided context as a basis for accurately and appropriately responding to various prompts, ultimately accomplishing the tasks we want it to perform (Wei et al., 2021; Ouyang et al., 2022).”
BackgroundAgentDojo: A Dynamic Environment to Evaluate Prompt Injection Attacks and Defenses for LLM Agents
Debenedetti, E., Zhang, J., Balunović, M., Beurer-Kellner, L., Fischer, M., & Tramèr, F. (2024) · arXiv · doi:10.48550/arxiv.2406.13352 · Cited by 616
“This attack simply injects a message instructing the agent that the malicious task has to be performed before the original one (see Figure 19a for our exact prompt).”
BackgroundScaling Large Language Model-based Multi-Agent Collaboration
Qian, C., Xie, Z., Wang, Y., Liu, W., Zhu, K., Xia, H., Dang, Y., Du, Z., Chen, W., Yang, C., et al. (2024) · arXiv · doi:10.48550/arxiv.2406.07155 · Cited by 8
“…knowledge (Brown et al., 2020; Bubeck et al., 2023; Vaswani et al., 2017; Radford et al., 2019; Tou-vron et al., 2023; Wei et al., 2022a; Shanahan et al., 2023; Chen et al., 2021; Brants et al., 2007; Chen et al., 2021; Ouyang et al., 2022; Yang et al., 2024; Qin et al., 2023; Kaplan et al., 2020).”
Prismatic VLMs: Investigating the Design Space of Visually-Conditioned Language Models
Karamcheti, S., Nair, S., Balakrishna, A., Liang, P., Kollar, T., & Sadigh, D. (2024) · arXiv · doi:10.48550/arxiv.2402.07865 · Cited by 7
“Unfortunately, instruct tuning has drawbacks, introducing bias and regressions in performance (Ouyang et al., 2022).”
BackgroundCoelho Mollo, D., & Millière, R. (2026) · Philosophy and the Mind Sciences · doi:10.33735/phimisci.2026.12307 · Cited by 48
Puech, R., Macina, J., Chatain, J., Sachan, M., & Kapur, M. (2025) · Findings of the Association for Computational Linguistics: ACL 2025 · doi:10.18653/v1/2025.findings-acl.1348 · Cited by 11
Externalization in LLM Agents: A Unified Review of Memory, Skills, Protocols and Harness Engineering
Zhou, C., Chai, H., Chen, W., Guo, Z., Shan, R., Song, Y., Xu, T., Yang, Y., Yu, A., Zhang, W., et al. (2026) · arXiv · doi:10.48550/arxiv.2604.08224 · Cited by 1
Self-citationWhen Do Transformers Shine in RL? Decoupling Memory from Credit Assignment
Ni, T., Ma, M., Eysenbach, B., & Bacon, P.-L. (2023) · Advances in Neural Information Processing Systems 36 · doi:10.52202/075280-2194 · Cited by 7
Efficient Benchmarking (of Language Models)
Perlitz, Y., Bandel, E., Gera, A., Arviv, O., Ein-Dor, L., Shnarch, E., Slonim, N., Shmueli-Scheuer, M., & Choshen, L. (2024) · Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers) · doi:10.18653/v1/2024.naacl-long.139 · Cited by 7
FreshLLMs: Refreshing Large Language Models with Search Engine Augmentation
Vu, T., Iyyer, M., Wang, X., Constant, N., Wei, J., Wei, J., Tar, C., Sung, Y.-H., Zhou, D., Le, Q., et al. (2023) · arXiv · Cited by 7
The Siren Song of LLMs: How Users Perceive and Respond to Dark Patterns in Large Language Models
Shi, Y., Xiao, Q., Hu, Q., Shen, H., & Shen, H. (2026) · Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3791149 · Cited by 7
A plug-and-play knowledge-enhanced module for medical reports generation
Han, Q., Yang, Z., Lin, H., & Qin, T. (2024) · Knowledge-Based Systems · doi:10.1016/j.knosys.2024.112805 · Cited by 9
LangLoc: Language-Driven Localization via Formatted Spatial Description Generation
Shi, W., Chen, C., Li, K., Xiong, Y., Cao, X., & Zhou, Z. (2025) · IEEE Transactions on Image Processing · doi:10.1109/tip.2025.3546853 · Cited by 10
Yang, Z., & Arakawa, H. (2025) · Vibrational Spectroscopy · doi:10.1016/j.vibspec.2025.103842 · Cited by 8
Improving LLM Outputs Against Jailbreak Attacks With Expert Model Integration
Tsmindashvili, T., Kolkhidashvili, A., Kurtskhalia, D., Maghlakelidze, N., Mekvabishvili, E., Dentoshvili, G., Shamilov, O., Gachechiladze, Z., Saporta, S., & Choladze, D. D. (2025) · IEEE Access · doi:10.1109/access.2025.3592458 · Cited by 8
Context-dependent neuro-symbolic AI through self-supervised learning with large language models
Honda, H., & Hagiwara, M. (2025) · Neurocomputing · doi:10.1016/j.neucom.2025.131269 · Cited by 8
Scaling Textual Gradients via Sampling-Based Momentum
Ding, Z., Hong, J., Shi, Z., Wang, T., Lin, Z., Yin, L., Liu, M., Wang, Z., & Chen, Y. (2026) · ACM Conference on AI and Agentic Systems (CAIS) · doi:10.1145/3786335.3813168 · Cited by 9
PReMM: LLM-Based Program Repair for Multi-method Bugs via Divide and Conquer
Xie, L., Li, Z., Pei, Y., Wen, Z., Liu, K., Zhang, T., & Li, X. (2025) · Proceedings of the ACM on Programming Languages · doi:10.1145/3763097 · Cited by 13
Improving User Interface Generation Models from Designer Feedback
Wu, J., Swearngin, A., Vajjala, A. K., Leung, A., Nichols, J. W., & Barik, T. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3791567 · Cited by 9
Self-citationMind the XAI Gap: A Human-Centered LLM Framework for Democratizing Explainable AI
Paraschou, E., Arapakis, I., Yfantidou, S., Macaluso, S., & Vakali, A. I. (2025) · Communications in computer and information science · doi:10.1007/978-3-032-08333-3_6 · Cited by 12
Sai, S., Goyal, I., Chamola, V., & Buyya, R. (2026) · Future Generation Computer Systems · doi:10.1016/j.future.2026.108714 · Cited by 8
Davidson, T. (2025) · Nature Human Behaviour · doi:10.1038/s41562-025-02360-w · Cited by 12
Georeferencing complex relative locality descriptions with large language models
Fernando, A., Ranathunga, S., Stock, K. M., Prasanna, R., & Jones, C. B. (2026) · International Journal of Geographical Information Systems · doi:10.1080/13658816.2026.2613291 · Cited by 9
When silence is safer: a review and decision-theoretic framework for LLM abstention in healthcare
Presacan, O., Nik, A., Ojha, J., Thambawita, V., Ionescu, B., & Riegler, M. A. (2026) · npj Digital Medicine · doi:10.1038/s41746-026-02882-1 · Cited by 4
Sang, Y., Chen, Y., & Zhang, J. (2023) · Applied Sciences · doi:10.3390/app132312905 · Cited by 7
Developmental Scaffolding with Large Language Models
Celik, B., Ahmetoğlu, A., Uğur, E., & Öztop, E. (2023) · IEEE International Conference on Development and Learning (ICDL) · doi:10.1109/icdl55364.2023.10364374 · Cited by 7
Addressing the Binning Problem in Calibration Assessment through Scalar Annotations
Jiang, Z., Liu, A., & Durme, B. V. (2024) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00636 · Cited by 12
Shi, Z., Zheng, H., & Dong, J. (2024) · Ocean Engineering · doi:10.1016/j.oceaneng.2024.117748 · Cited by 11
The Future of Chatbots: Survey on Generative Pretrained Models, Ernie, and Gemini
Raut, A., & Katti, J. (2024) · International Conference on Innovations and Challenges in Emerging Technologies (ICICET) · doi:10.1109/icicet59348.2024.10616356 · Cited by 8
Uthayansuthi, N., & Vateekul, P. (2024) · IEEE Access · doi:10.1109/access.2024.3442445 · Cited by 9
5W1H Extraction With Large Language Models
Cao, Y., Lan, Y., Zhai, F., & Li, P. (2024) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn60899.2024.10651056 · Cited by 16
LLaMA-Excitor: General Instruction Tuning via Indirect Feature Interaction
Zou, B., Yang, C., Qiao, Y., Quan, C., & Zhao, Y. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01336 · Cited by 13
Personalizing Semantic Communication: A Foundation Model Approach
Chen, Z., Yang, H. H., Chong, K. F. E., & Quek, T. Q. S. (2024) · IEEE International Workshop on Signal Processing Advances in Wireless Communications (SPAWC) · doi:10.1109/spawc60668.2024.10694080 · Cited by 7
Generative AI in Multimodal Cross-Lingual Dialogue System for Inclusive Communication Support
Nataraj, V., Liao, W.-H., Chang, Y., Chiang, C.-Y., Lin, C., Lin, Y.-A., & Day, M.-Y. (2024) · IEEE International Conference on Information Reuse and Integration (IRI) · doi:10.1109/iri62200.2024.00051 · Cited by 9
Towards LLM-Enhanced Digital Twins of Intelligent Computing Center
Yang, Y., Liu, M., Jia, K., Dong, W., & Wang, J. Z. (2024) · IEEE International Conference on Software Quality, Reliability and Security Companion (QRS-C) · doi:10.1109/qrs-c63300.2024.00021 · Cited by 8
Yin, L., Han, M., & Nie, X. (2024) · Urban Science · doi:10.3390/urbansci8040222 · Cited by 7
Integrating Vision and Olfaction via Multi-Modal LLM for Robotic Odor Source Localization
Hassan, S., Wang, L., & Mahmud, K. R. (2024) · Sensors · doi:10.3390/s24247875 · Cited by 10
Closed Domain Question-Answering Techniques in an Institutional Chatbot
Saad, M., & Qawaqneh, Z. (2024) · International Conference on Electrical, Computer, Communications and Mechatronics Engineering (ICECCME) · doi:10.1109/iceccme62383.2024.10796881 · Cited by 7
Are Large Language Models Aligned with People’s Social Intuitions for Human–Robot Interactions?
Wachowiak, L., Coles, A., Çeliktutan, O., & Canal, G. (2024) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros58592.2024.10801325 · Cited by 10
Luo, T., Peng, H., Fu, A., Yang, W. Y., Pang, L., Al-Sarawi, S. F., Abbott, D., & Gao, Y. (2025) · Computer Communications · doi:10.1016/j.comcom.2025.108052 · Cited by 7
Comprehensive Study on Zero-Shot Text Classification Using Category Mapping
Zhang, K., Zhang, Q., Wang, C.-C., & Jang, J. R. (2025) · IEEE Access · doi:10.1109/access.2025.3538103 · Cited by 7
Vemula, S. (2024) · IEEE Frontiers in Education Conference (FIE) · doi:10.1109/fie61694.2024.10893561 · Cited by 7
Al-Zuraiqi, A., & Greer, D. (2024) · International Conference on Machine Learning and Applications · doi:10.1109/icmla61862.2024.00180 · Cited by 7
LoRATEE: A Secure and Efficient Inference Framework for Multi-Tenant LoRA LLMs Based on TEE
Lin, Z., Zhang, S., Wang, X., Su, Y., Wang, Y., Hou, R., & Meng, D. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10890445 · Cited by 10
TrBot: A Turkish Deep Learning Chatbot Utilizing Seq2Seq Model
Babayiğit, B., Rahmani, H., & Abubaker, M. (2025) · IEEE Access · doi:10.1109/access.2025.3550852 · Cited by 10
An Efficient Real-Time Railway Container Yard Management Method Based on Partial Decoupling
Luan, Y., Jia, Q., Xing, Y., Li, Z., & Wang, T. (2025) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2025.3559241 · Cited by 7
Han, Z., Wang, J., Yan, X., Jiang, Z., Zhang, Y., Liu, S., Gong, Q., & Song, C. (2025) · Applied Sciences · doi:10.3390/app15105663 · Cited by 8
Foundation models: the next level of AI in ART
Hammer, H. L., Thambawita, V. L., & Riegler, M. A. (2025) · Human Reproduction · doi:10.1093/humrep/deaf136 · Cited by 8
Intelligent analysis of chest X-ray based on multi-modal instruction tuning
Yao, J., Wang, J., Xiao, Z., Hao, X., & Jiang, X. (2025) · Meta-Radiology · doi:10.1016/j.metrad.2025.100172 · Cited by 7
Self-citationWord Overuse and Alignment in Large Language Models: The Influence of Learning from Human Feedback
Juzek, T. S., & Ward, Z. B. (2026) · Communications in computer and information science · doi:10.1007/978-3-032-19096-3_16 · Cited by 8
AutoV: Loss-Oriented Ranking for Visual Prompt Retrieval in LVLMs
Zhang, Y., Fan, C.-K., Yu, S., Pan, J., Huang, T., Lu, M., Cheng, K., She, Q., & Zhang, S. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37372-4_13 · Cited by 7
Scaria, N., Kennedy, S. J. J., Latinovich, T., & Subramani, D. (2025) · Computers and Education Artificial Intelligence · doi:10.1016/j.caeai.2025.100539 · Cited by 8
Managing persuasion robustly: The optimality of quota rules
Bergemann, D., Gan, T., & Li, Y. (2026) · Journal of Economic Theory · doi:10.1016/j.jet.2026.106222 · Cited by 7
Li, S., Zhou, G., Li, Z., Lu, J., & Huang, N. (2023) · IEEE International Conference on Software Quality, Reliability and Security (QRS) · doi:10.1109/qrs60937.2023.00032 · Cited by 9
Exploring Large Language Models for Low-Resource IT Information Extraction
Bhavya, B., Isaza, P. T., Deng, Y., Nidd, M., Azad, A. P., Shwartz, L., & Zhai, C. (2023) · IEEE ... International Conference on Data Mining workshops · doi:10.1109/icdmw60847.2023.00157 · Cited by 13
Revise the NLU: A Prompting Strategy for Robust Dialogue System
Rohmatillah, M., & Chien, J. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10446138 · Cited by 10
Takeda, N., Legaspi, R., Nishimura, Y., Ikeda, K., Plötz, T., & Chernova, S. (2024) · IEEE International Conference on Big Data Analytics (ICBDA) · doi:10.1109/icbda61153.2024.10607364 · Cited by 7
Kang, J. H., Dhanaraj, N., Wadaskar, S., & Gupta, S. K. (2024) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra57147.2024.10610875 · Cited by 7
AI-Driven Testing: Unleashing Autonomous Systems for Superior Software Quality Using Generative AI
Helmy, M., Sobhy, O., & ElHusseiny, F. (2024) · International Telecommunications Conference (ITC-Egypt) · doi:10.1109/itc-egypt61547.2024.10620598 · Cited by 7
Enhancing Vision-Language Pre-Training with Rich Supervisions
Gao, Y., Shi, K., Zhu, P., Belval, E., Nuriel, O., Appalaraju, S., Ghadar, S., Tu, Z., Mahadevan, V., & Soatto, S. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01280 · Cited by 23
Chen, D., Wang, S., Fan, Z., Hu, X., & Li, C. (2024) · IEEE International Conference on Smart Internet of Things (SmartIoT) · doi:10.1109/smartiot62235.2024.00056 · Cited by 7
Semantics Preserving Emoji Recommendation with Large Language Models
Qiu, Z., Qiu, K., Lyu, H., Xiong, W., & Luo, J. (2024) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata62323.2024.10825696 · Cited by 17
Zhang, Y., Huang, B., Yuan, W., Jiang, Z., Peng, L., Chen, S., & Tan‐Soo, J. (2025) · Information Processing & Management · doi:10.1016/j.ipm.2025.104090 · Cited by 8
AGR: Age Group fairness Reward for Bias Mitigation in LLMs
Cao, S., Cheng, R., & Wang, Z. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10890657 · Cited by 8
Ma, X., Xie, H., & Qin, S. J. (2025) · Information Fusion · doi:10.1016/j.inffus.2025.103419 · Cited by 15
Xu, Q., Wu, T., Wang, Y., Li, X., Yu, H., Cen, S., & Li, Z. (2025) · Journal of Pharmaceutical Analysis · doi:10.1016/j.jpha.2025.101406 · Cited by 8
An online cost minimization of the slice broker based on deep reinforcement learning
Gohar, A., & Nencioni, G. (2024) · Computer Networks · doi:10.1016/j.comnet.2024.110198 · Cited by 7
Towards interactive reinforcement learning with intrinsic feedback
Poole, B., & Lee, M. (2024) · Neurocomputing · doi:10.1016/j.neucom.2024.127628 · Cited by 8
EXPRESS: Causal Alignment: Augmenting Language Models with A/B Tests
Angelopoulos, P., Lee, K., & Misra, S. (2026) · Journal of Marketing Research · doi:10.2139/ssrn.4781850 · Cited by 8
Emergent Collusion in Long-Horizon LLM Agent InteractionPreprint
Shi, X., Zhang, Y., & Yang, D. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2609.24967 · Cited by 8
Performance Evaluation of Large Language Models: A Comprehensive Review
Meva, D., & Kukadiya, H. (2025) · International Research Journal of Computer Science · doi:10.26562/irjcs.2025.v1203.03 · Cited by 8
On Controllability in Agentic AI: A Survey
Nguyen, M. H., Nguyen, D.-H., O’Sullivan, B., & Nguyen, H. D. (2026) · Minds and Machines · doi:10.1007/s11023-026-09783-y · Cited by 10
Wu, Q., Zhang, W., Fan, P., Wang, K., Fan, Q., Chen, W., Mao, G., & Letaief, K. B. (2026) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2026.3728865 · Cited by 10
Metadata
- Authors
- Ouyang, L., Wu, J., Jiang, X., Almeida, D., Wainwright, C., Mishkin, P., Zhang, C., Agarwal, S., Slama, K., Ray, A., Schulman, J., Hilton, J., Kelton, F., Miller, L., Simens, M., Askell, A., Welinder, P., Christiano, P., Leike, J., & Lowe, R.
- Venue
- Advances in Neural Information Processing Systems 35
- Published
- 2022
- Pages
- 27730-27744
- ISSN
- 1049-5258 (ISSN-L)
- OpenAlex
- W7133211372
- Cited by
- 3,117
- References
- 0
- Citations by year
- 2026: 1421 · 2025: 544 · 2024: 852 · 2023: 297 · 2022: 3
- FWCI
- 234.27
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- neural information processing systems (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Keywords
- instruction following, language models, human feedback, reinforcement learning from human feedback, large language models
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.