Training Language Models to Follow Instructions with Human Feedback
The DOI matches its Crossref record; 2 of the 2 references it cites were found in a registry or an index.
Abstract
Making language models bigger does not inherently make them better at following a user's intent. For example, large language models can generate outputs that are untruthful, toxic, or simply not helpful to the user. In other words, these models are not aligned with their users. In this paper, we show an avenue for aligning language models with user intent on a wide range of tasks by fine-tuning with human feedback. Starting with a set of labeler-written prompts and prompts submitted through the OpenAI API, we collect a dataset of labeler demonstrations of the desired model behavior, which we use to fine-tune GPT-3 using supervised learning. We then collect a dataset of rankings of model outputs, which we use to further fine-tune this supervised model using reinforcement learning from human feedback. We call the resulting models InstructGPT. In human evaluations on our prompt distribution, outputs from the 1.3B parameter InstructGPT model are preferred to outputs from the 175B GPT-3, despite having 100x fewer parameters. Moreover, InstructGPT models show improvements in truthfulness and reductions in toxic output generation while having minimal performance regressions on public NLP datasets. Even though InstructGPT still makes simple mistakes, our results show that fine-tuning with human feedback is a promising direction for aligning language models with human intent.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Existing literature (Ouyang et al., 2022) does not fully describe the details of these models, such as the pretraining corpus, model sizes, and model biases.”
From Self-Refine: Iterative Refinement with Self-Feedback (2023) · cites this paper as Ouyang et al., 2022
Experimental — accuracy not yet measuredIn the citing paper
“Specifically, providers mitigate race and gender bias through reinforcement learning from human feedback (RLHF), adversarial stress-testing known as red teaming, and hard-coded refusals governed by the provider's own content policies [6, 43, 71].”
From All Public Voices Are Equal, But Are Some More Equal Than Others to LLMs? (2026) · cites this paper as [71]
In the citing paper
“Fine-tuning a model from human feedback at scale, using preference data from paid raters or drawn from a large and willing user base, is an especially potent technique.It has the potential not only to shape a model's responses to better reflect user norms (for better or worse), but also to filter out toxic language, improve factual accuracy, and mitigate the tendency to fabricate information.”
From Talking about Large Language Models (2024) · cites this paper as [26]
In the citing paper
“These include general competencies such as in-context learning (ICL) [13], chain-of-thought (CoT) [17] reasoning, and instruction following [25], as well as task-specialized skills like mathematical reasoning [30].”
From A Survey of Large Language Models (2026) · cites this paper as [25]
In the citing paper
“When external reward models or ground-truth answers are available, rejection sampling can also be applied to select higher-quality responses from multiple candidates [25].”
From A Survey of Large Language Models (2026) · cites this paper as [25]
41 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
The publisher hasn’t deposited this paper’s reference list.
Cited by
Items 1,501–1,600 of 4,340
LLMs do not grade essays like humans
Mathew, J. G., Taher, S., Kundu, A., & Barbosa, D. (2026) · Computers and Education Artificial Intelligence · doi:10.1016/j.caeai.2026.100666 · Cited by 7
Personalized Reward Modeling for Text-to-Image Generation
Lee, J., Heo, R., & Lee, D. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37356-4_25 · Cited by 6
AutoReSpec: A Framework for Generating Specification using Large Language Models
Ayon, R. S., & Ahmed, S. (2026) · IEEE/ACM International Conference on AI Foundation Models and Software Engineering (FORGE) · doi:10.1145/3793655.3793731 · Cited by 8
Ahmadzadeh, S., Karthick, G., & Alsafi, T. (2026) · Future Internet · doi:10.3390/fi18080393 · Cited by 8
LatSearch: Latent Reward-Guided Search for Faster Inference-Time Scaling in Video Diffusion
Zhao, Z., Liu, Z., Cao, Y., Gong, S., Zhang, Z., Song, J., Deng, J., & Patras, I. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37167-6_10 · Cited by 10
Composing Policy Gradients and Prompt Optimization for Language Model Programs
Ziems, N., Soylu, D., Agrawal, L. A., Miller, I., Lai, L., Qian, C., Song, K., Jiang, M., Klein, D., Zaharia, M., et al. (2026) · ACM Conference on AI and Agentic Systems (CAIS) · doi:10.1145/3786335.3813164 · Cited by 7
Matsui, K. (2025) · Perspectives on Medical Education · doi:10.5334/pme.1929 · Cited by 6
“These Recent discussions suggest that the lexical preferences of large language models may have been shaped by reinforcement learning from human feedback (RLHF) [18], which rewards stylistic features favored by human evaluators [19].”
Long-Term Memory for Large Language Models Through Topic-Based Vector Database
Zhang, Y., Yu, Z., Jiang, W., Shen, Y., & Li, J. (2023) · 2023 International Conference on Asian Language Processing (IALP) · doi:10.1109/ialp61005.2023.10337079 · Cited by 6
Fang, J., Peng, Y., Zhang, X., Wang, Y., Yi, X., Zhang, G., Xu, Y., Wu, B., Liu, S., Li, Z., et al. (2025) · arXiv · doi:10.48550/arxiv.2508.07407 · Cited by 6
Mitigating Sycophancy in Large Language Models via Direct Preference Optimization
Khan, A. A., Alam, S., Wang, X., Khan, A. F., Neog, D. R., & Anwar, A. (2024) · 2024 IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata62323.2024.10825538 · Cited by 6
LLM-Based Text Style Transfer: Have We Taken a Step Forward?
Toshevska, M., & Gievska, S. (2025) · IEEE Access · doi:10.1109/access.2025.3548967 · Cited by 22
Advances in conceptual process design: From conventional strategies to AI-assisted methods
Karagoz, A. T., Alqusair, O., Liu, C., & Li, J. (2025) · Chinese Journal of Chemical Engineering · doi:10.1016/j.cjche.2025.05.014 · Cited by 6
Automated Skin Cancer Report Generation via a Knowledge-Distilled Vision-Language Model
Chakrabarti, L., Zhang, B., Tian, H., Vakanski, A., & Xian, M. (2025) · IEEE Access · doi:10.1109/access.2025.3591750 · Cited by 9
Improving LLM First-Token Predictions in Multiple-Choice Question Answering via Output Prefilling
Cappelletti, S., Poppi, T., Poppi, S., Yong, Z.-X., García-Olano, D., Cornia, M., Baraldi, L., & Cucchiara, R. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-31654-7_25 · Cited by 6
AgentTune: An Agent-Based Large Language Model Framework for Database Knob Tuning
Li, Y., Li, H., Zhang, J., Borovica‐Gajic, R., Wang, S., Zhang, T., Chen, J., Shi, R., Li, C., & Chen, H. (2025) · Proceedings of the ACM on Management of Data · doi:10.1145/3769758 · Cited by 14
An AI-native experimental laboratory for autonomous biomolecular operations
Wu, M., Wang, Z., Wang, J., Dong, Z., Yang, J., Li, Q., Huang, T., Zhang, C., Song, P., Zhao, L., et al. (2026) · Nature · doi:10.1038/s41586-026-11228-6 · Cited by 7
Self-citationOmni-RRM: Advancing Omni Reward Modeling via Automatic Rubric-Grounded Preference Synthesis
Kong, Z., Ma, D., Xu, Z., Yang, A., Ru, Y., Wang, H., Zhou, Z., Bie, F., Xiang, L., Wu, H., et al. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37321-2_29 · Cited by 6
Yuan, C., Wei, T., Li, C., Yi, X., Liu, S., Zhang, Z., Cai, Y., & Du, X. (2026) · Journal of King Saud University - Computer and Information Sciences · doi:10.1007/s44443-026-00708-4 · Cited by 7
SSL-R1: Self-Supervised Visual Reinforcement Post-Training for Multimodal Large Language Models
Xie, J., Tonioni, A., Rauschmayr, N., Tombari, F., & Schiele, B. (2026) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3767308.3836276 · Cited by 6
Addis, R., Porter, K., Ryan, J., Stull, M., Xu, S., Wagner, P., Honomichl, R. J., & Forsyth, S. (2026) · IEEE Access · doi:10.1109/access.2026.3707573 · Cited by 7
Prompt Prototype Learning Based on Ranking Instruction For Few-Shot Visual Tasks
Li, S., Wang, L., Sun, J., & Okatani, T. (2023) · Proceedings - International Conference on Image Processing · doi:10.1109/icip49359.2023.10222039 · Cited by 6
Does word knowledge account for the effect of world knowledge on pronoun interpretation?
Jones, C. R., & Bergen, B. K. (2024) · Language and Cognition · doi:10.1017/langcog.2024.2 · Cited by 7
Is GPT Powerful Enough to Analyze the Emotions of Memes?
Wang, J. Z., Luo, J., Yang, G., Hong, A., & Luo, F. (2023) · International Conference on Machine Learning and Applications · doi:10.1109/icmla58977.2023.00202 · Cited by 8
Multimodal Image-Text Representation Learning for Sketch-Less Facial Image Retrieval
Dai, D., Liu, Y., Fu, S., & Wang, G. (2024) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme57554.2024.10687657 · Cited by 6
How Reliable AI Chatbots are for Disease Prediction from Patient Complaints?
Nipu, A. S., Islam, K. M. S., & Madiraju, P. (2024) · IEEE International Conference on Information Reuse and Integration (IRI) · doi:10.1109/iri62200.2024.00052 · Cited by 10
Diakhame, M. L., Diallo, C., & Mejri, M. (2024) · International Conference on Electrical, Computer and Energy Technologies (ICECET) · doi:10.1109/icecet61485.2024.10698464 · Cited by 8
An Empathetic Social Robot with Modular Anxiety Interventions for Autistic Adolescents
Xie, B., & Park, C. H. (2024) · IEEE RO-MAN · doi:10.1109/ro-man60168.2024.10731248 · Cited by 10
Xu, Q., Xu, X., Zhou, C., Liu, Z., Huang, F., Li, S., Zhu, L., Bai, Z., Xu, Y., & Hu, W. (2025) · Expert Systems with Applications · doi:10.1016/j.eswa.2025.126585 · Cited by 12
Liu, Y. (2024) · IEEE Frontiers in Education Conference (FIE) · doi:10.1109/fie61694.2024.10893046 · Cited by 6
Enhancing CS Education with LAs Using AI-Empowered AIELA Program
Ramasamy, V., Kulpinski, E., Beaupre, T., Antreassian, A., Jeong, Y., Clarke, P., Aiello, A., & Ray, C. (2024) · IEEE Frontiers in Education Conference (FIE) · doi:10.1109/fie61694.2024.10893294 · Cited by 7
Transducer-Llama: Integrating LLMs into Streamable Transducer-based Speech Recognition
Deng, K., Guo, J., Ma, Y., Moritz, N., Woodland, P. C., Kalinli, O., & Seltzer, M. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10889530 · Cited by 12
Through the Thicket: A Study of Number-Oriented LLMS Derived from Random Forest Models
Romaszewski, M., Sekuła, P., Głomb, P., Cholewa, M., & Kołodziej, K. (2025) · Journal of Artificial Intelligence and Soft Computing Research · doi:10.2478/jaiscr-2025-0014 · Cited by 8
Collaborative garment design through group chatting with generative industrial large models
Harish, A. R., Yuan, Z., Li, M., Yang, H., & Huang, G. Q. (2025) · Advanced Engineering Informatics · doi:10.1016/j.aei.2025.103366 · Cited by 10
Chuang, W.-K., Kao, Y., Liu, Y., & Lee, C.-Y. (2025) · Practical Radiation Oncology · doi:10.1016/j.prro.2025.04.009 · Cited by 6
Mahmoudi, E., Vahdati, S., Chao, C., Khosravi, B., Misra, A., López-Jiménez, F. A., & Erickson, B. J. (2025) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocaf056 · Cited by 6
Xiong, G., Liu, S., Yan, Y., Li, Q., & Li, H. (2025) · IEEE Access · doi:10.1109/access.2025.3580641 · Cited by 7
Sumsion, A. W., & Lee, D.-J. (2025) · Electronics · doi:10.3390/electronics14132665 · Cited by 6
On the Task of Designing Efficient Machine Learning Operations Architectures
Gorodnichev, M. G. (2025) · 2018Systems of Signal Synchronization, Generating and Processing in Telecommunications (SYNCHROINFO) · doi:10.1109/synchroinfo65403.2025.11079377 · Cited by 6
Saju, G., Akhib, M., & Chang, Y. (2025) · Journal of Imaging Informatics in Medicine · doi:10.1007/s10278-025-01617-0 · Cited by 10
Comparative Analysis of LLMs in Dry Eye Syndrome Healthcare Information
Wu, G., Paliath-Pathiyal, H., Khan, O., & Wang, M. C. (2025) · Diagnostics · doi:10.3390/diagnostics15151913 · Cited by 6
ELEVATE-ID: Extending Large Language Models for End-to-End Entity Linking Evaluation in Indonesian
Gusmita, R. H., Firmansyah, A. F., Zahera, H. M., & Ngomo, A.-C. N. (2025) · Data & Knowledge Engineering · doi:10.1016/j.datak.2025.102504 · Cited by 6
Misalignment or misuse? The AGI alignment tradeoff
Hellrigel-Holderbaum, M., & Dung, L. (2025) · Philosophical Studies · doi:10.1007/s11098-025-02403-y · Cited by 10
CalliReader: Contextualizing Chinese Calligraphy via an Embedding-Aligned Vision-Language Model
Luo, Y., Tang, J., Huang, C., Hao, F., & Lian, Z. (2025) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.02138 · Cited by 11
Emotional supporters often use multiple strategies in a single turn
Bai, X., Chen, G., He, T., Fan, R., Zhou, C., & Liu, Y. (2026) · Neurocomputing · doi:10.1016/j.neucom.2026.133897 · Cited by 6
Ho, Y., Nith, R., Jiang, P., He, S., Felalaga, B., Teng, S.-Y., Seeralan, R., & Lopes, P. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3790817 · Cited by 9
HPC-R1: Characterizing R1-like Large Reasoning Models on HPC
Weingram, A., Zhang, D., Chen, Z., Qi, H., & Lu, X. (2025) · International Conference for High Performance Computing, Networking, Storage and Analysis (SC) · doi:10.1145/3712285.3759827 · Cited by 7
Liu, Y., Zhang, R., Wang, J., Niyato, D. T., Wang, X., Kim, D. S., & Du, H. (2026) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2026.3668214 · Cited by 7
Meng, X., Song, Y., Bai, Q., & Wang, T. (2023) · Knowledge-Based Systems · doi:10.1016/j.knosys.2023.110796 · Cited by 6
OW-Adapter: Human-Assisted Open-World Object Detection with a Few Examples
Jamonnak, S., Guo, J., He, W., Gou, L., & Ren, L. (2023) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2023.3326577 · Cited by 6
Game Reviews Reviewed: A Game Designer’s Perspective on AI-generated Game Review Analyses
Lankes, M., & Stöckl, A. (2023) · IEEE Conference on Games (CoG) · doi:10.1109/cog57401.2023.10333238 · Cited by 11
Towards General-Purpose Text-Instruction-Guided Voice Conversion
Kuan, C.-Y., Li, C.-A., Hsu, T.-Y., Lin, T.-Y., Chung, H.-L., Chang, K., Chang, S.-Y., & Lee, H.-Y. (2023) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru57964.2023.10389672 · Cited by 17
Safari, P., & Shamsfard, M. (2024) · IEEE Access · doi:10.1109/access.2024.3360863 · Cited by 10
Memory Efficient with Parameter Efficient Fine-Tuning for Code Generation Using Quantization
Purnawansyah, P., Ali, Z., Darwis, H., Ilmawan, L. B., Jabir, S. R., & Manga, A. R. (2024) · International Conference on Ubiquitous Information Management and Communication (IMCOM) · doi:10.1109/imcom60618.2024.10418267 · Cited by 13
Kakdas, Y. C., Kockara, S., Halic, T., & Demirel, D. (2024) · IEEE Transactions on Learning Technologies · doi:10.1109/tlt.2024.3372508 · Cited by 7
ESC-ZSAR: Expanded Semantics from Categories with Cross-Attention for Zero-Shot Action Recognition
Lee, J.-C., & Lee, D.-G. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2024.124786 · Cited by 6
Online AI-Generated Content Request Scheduling with Deep Reinforcement Learning
Feng, C., Zheng, Y., & Yue-dong, X. (2024) · IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS) · doi:10.1109/infocomwkshps61880.2024.10620786 · Cited by 6
Neural Fault Injection: Generating Software Faults from Natural Language
Cotroneo, D., & Liguori, P. (2024) · IEEE/IFIP International Conference on Dependable Systems and Networks - Supplemental Volume (DSN-S) · doi:10.1109/dsn-s60304.2024.00016 · Cited by 8
DiffAgent: Fast and Accurate Text-to-Image API Selection with Large Language Model
Zhao, L., Yue, Y., Zhang, K., Shao, W., Zhang, Y., Qiao, Y., Luo, P., & Ji, R. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00611 · Cited by 22
A Software Bug Fixing Approach Based on Knowledge-Enhanced Large Language Models
Bo, L., He, Y., Sun, X., Ji, W., & Wu, X. (2024) · IEEE International Conference on Software Quality, Reliability and Security (QRS) · doi:10.1109/qrs62785.2024.00026 · Cited by 6
Personalized forward collision warning model with learning from human preferences
Xie, N., Yu, R., Sun, W., Qiu, S., Zhong, K., Xu, M., Wu, G., & Yang, Y. H. (2024) · Accident Analysis & Prevention · doi:10.1016/j.aap.2024.107791 · Cited by 7
Offline reward shaping with scaling human preference feedback for deep reinforcement learning
Li, J., Luo, B., Xu, X., & Huang, T. (2024) · Neural Networks · doi:10.1016/j.neunet.2024.106848 · Cited by 7
Bordin, R. W., Bartnack, C. C., Westphalen, V. P. D., Gasparello, G. G., Bark, M. J., Gava, T. N., & Tanaka, O. M. (2024) · Saudi Endodontic Journal · doi:10.4103/sej.sej_107_24 · Cited by 6
Rocchietti, G., Rulli, C., Nardini, F. M., Muntean, C. I., Perego, R., & Frieder, O. (2025) · IEEE Access · doi:10.1109/access.2025.3529741 · Cited by 7
LLM Augmentations to support Analytical Reasoning over Multiple Documents
Yousuf, R. B., Defelice, N., Sharma, M., Xu, S., & Ramakrishnan, N. (2024) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata62323.2024.10826114 · Cited by 12
Deng, Y., Qiu, X., Tan, X., Qu, C., Pan, J., Cheng, Y., Xu, Y., & Chu, W. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10887899 · Cited by 12
Using RLHF to align speech enhancement approaches to mean-opinion quality scores
Kumar, A., Perrault, A., & Williamson, D. S. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10888446 · Cited by 6
Shuang, K., Zhou, J., Wang, Q., Qian, B., Wei, Y., & Guo, J. (2025) · Expert Systems with Applications · doi:10.1016/j.eswa.2025.128075 · Cited by 6
Probabilistic emotion and sentiment modelling of patient-reported experiences
Murray, C., Mitchell, L., Tuke, J., & Mackay, M. (2025) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2025.103178 · Cited by 6
NeuTRL: Neural Trust-Guided Reinforcement Learning for Human-Robot Collaboration
Xu, C., Sang, H., Zhang, C., Zhou, Y., Wang, Z., Li, X., & He, B. (2025) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2025.3583508 · Cited by 6
Self-citationDrug Resistance Predictions Based on a Directed Flag Transformer
董, C. 晨. D., Liu, G., Du, H., Jones, B. R., Wee, J., Wang, R., Chen, J., Shen, J., & Wei, G. (2025) · Advanced Science · doi:10.1002/advs.202502756 · Cited by 6
Lay-Your-Scene: Natural Scene Layout Generation with Diffusion Transformers
Srivastava, D., Zhang, X., He, W., Wen, C., & Tu, Z. (2025) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.01664 · Cited by 9
POR UMA REVISÃO CRÍTICA DO USO DE INTELIGÊNCIA ARTIFICIAL NA EDUCAÇÃO
de Lima-Lopes, R. E. (2025) · Revista de Estudos de Cultura · doi:10.32748/revec.v11i27.22719 · Cited by 12
Mixup Feature: A Pretext Task Self-Supervised Learning Method for Enhanced Visual Feature Learning
Xu, J., & Stirenko, S. (2023) · IEEE Access · doi:10.1109/access.2023.3301561 · Cited by 6
Body size as a metric for the affordable world
Feng, X., Xu, S., Li, Y., & Liu, J. (2023) · eLife · doi:10.7554/elife.90583 · Cited by 6
Challenges and Opportunities in Neuro-Symbolic Composition of Foundation Models
Jha, S., Roy, A., Cobb, A. D., Berenbeim, A., & Bastian, N. D. (2023) · IEEE Military Communications Conference (MILCOM) · doi:10.1109/milcom58377.2023.10356344 · Cited by 7
Understanding Divergent Framing of the Supreme Court Controversies: Social Media vs. News Outlets
Pan, J., Wang, Z., Qi, W., Lyu, H., & Luo, J. (2023) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata59044.2023.10386532 · Cited by 10
Li, C., Chen, D., Zhang, Y., & Beerel, P. A. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10446820 · Cited by 10
Enhancing Quantitative Reasoning Skills of Large Language Models through Dimension Perception
Huang, Y., He, Q., Liang, J., Jiang, S., Xiao, Y., & Chen, Y. (2024) · IEEE International Conference on Data Engineering (ICDE) · doi:10.1109/icde60146.2024.00066 · Cited by 7
An Open-source Cross-Industry and Cloud-agnostic Generative AI Platform
Ali, A. R., Kumar, K., Siddiqui, M. A., & Zahid, M. A. H. (2024) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn60899.2024.10650688 · Cited by 8
The AI Agent in the Room: Rethinking Consumer Decision‐Making in the Age of Autonomous AI
Bilgihan, A., Ostinelli, M., Lorenz, M. P., & Zhang, Y. (2026) · Psychology and Marketing · doi:10.1002/mar.70165 · Cited by 6
JudgmentBench: Comparing Rubric and Preference Evaluation for Quality AssessmentPreprint
Yang, R., Chen, R., Kelaita, P., Ranjan, R., Ma, S., Dickens, C., Guillod, M., Ma, M., & Nyarko, J. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2605.25240 · Cited by 7
XSTest: A Test Suite for Identifying Exaggerated Safety Behaviours in Large Language Models
Röttger, P., Kirk, H. R., Vidgen, B., Attanasio, G., Bianchi, F., & Hovy, D. (2023) · arXiv · doi:10.48550/arxiv.2308.01263 · Cited by 6
Smaug: Fixing Failure Modes of Preference Optimisation with DPO-Positive
Pal, A., Karkhanis, D., Dooley, S., Roberts, M., Naidu, S., & White, C. (2024) · arXiv · doi:10.48550/arxiv.2402.13228 · Cited by 6
“Two of the most popular techniques for learning from preference data are reinforcement learning from human feedback (RLHF) [Ouyang et al., 2022, Bai et al., 2022, Ziegler et al., 2020] and direct preference optimisation (DPO) [Rafailov et al., 2023].”
MethodZhang, H., Li, Z., Qi, X., Li, M., Sun, M., Wang, S., Zhang, M., & Han, S. (2025) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.01130 · Cited by 17
Advanced Deep Reinforcement Learning for Agentic AI and Their Applications in Wireless Network
Zheng, J., Niyato, D. T., Zhang, R., Wang, J., Nie, J., Du, H., Kang, J., Zhang, H., Jamalipour, A., & Kim, D. I. (2026) · IEEE Transactions on Cognitive Communications and Networking · doi:10.1109/tccn.2026.3683896 · Cited by 12
MGFRec: Towards Reinforced Reasoning Recommendation with Multiple Groundings and Feedback
Cai, S., Gao, C., Liu, H., Shi, W., Sun, J., Tang, R., & Feng, F. (2026) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3770854.3780206 · Cited by 7
Ke, F., G, V. K. B., Leng, X., Cai, Z., Khan, Z., Wang, W., Haghighi, P. D., Rezatofighi, H., & Chandraker, M. K. (2025) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.00323 · Cited by 16
Data protection in the era of large language models: challenges and opportunities
Revesai, Z., & Chipfumbu, C. T. (2026) · AI and Ethics · doi:10.1007/s43681-026-01223-y · Cited by 5
Expert Evaluation and the Limits of Human Feedback in Mental Health AI Safety Testing
Meimandi, K. J., Rust, P. U. N., Eddy, D., Fraser, R., Vasan, N., Djordjevic, D., Dadlani, A., Lamparth, M., Kim, E., & Kochenderfer, M. J. (2026) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3805689.3812332 · Cited by 11
Linguistics and human brain: a perspective of computational neuroscience
Zhang, F., Chai, B., Wu, Y., Siok, W. T., & Wang, N. (2026) · Cognitive Neurodynamics · doi:10.1007/s11571-026-10496-2 · Cited by 7
-, S. B., Ranjan, S., Adhitya, M., Suri, V., Hassija, V., Chamola, V., & Hussain, A. (2026) · Cognitive Computation · doi:10.1007/s12559-026-10619-1 · Cited by 12
Moorthy, S. M. K., Qi, M., Rosen, A., Malhi, Y. S., & Salguero‐Gómez, R. (2026) · Methods in Ecology and Evolution · doi:10.1111/2041-210x.70403 · Cited by 5
Petridis, S., Liu, M. X., Fiannaca, A. J., Cai, C. J., & Terry, M. A. (2026) · Designing Interactive Systems Conference · doi:10.1145/3800645.3812956 · Cited by 7
Property guidance for protein sequence generative models with ProteinGuide
Xiong, J., Gaur, I., Lukarska, M., Nisonoff, H. M., Oltrogge, L. M., Savage, D. F., & Listgarten, J. (2026) · Nature Biotechnology · doi:10.1038/s41587-026-03207-z · Cited by 9
VALUE: Value-Aware Large Language Model for Query Rewriting via Weighted Trie in Sponsored Search
Zhang, X., Chen, G., Zuo, B., Li, F., Wang, P., Xu, J., & Zheng, B. (2026) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3770854.3783951 · Cited by 7
Do Models Explain Themselves? Counterfactual Simulatability of Natural Language Explanations
Chen, Y., Zhong, R., Ri, N., Zhao, C., He, H., Steinhardt, J., Yu, Z., & McKeown, K. (2023) · arXiv · doi:10.48550/arxiv.2307.08678 · Cited by 5
Should we be going MAD? A Look at Multi-Agent Debate Strategies for LLMs
Smit, A., Duckworth, P., Grinsztajn, N., Barrett, T. D., & Pretorius, A. (2023) · arXiv · doi:10.48550/arxiv.2311.17371 · Cited by 73
Liu, J., Hao, W., Cheng, K., & Jin, D. (2025) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2025.110319 · Cited by 5
Towards Authoring Open-Ended Behaviors for Narrative Puzzle Games with Large Language Model Support
Ngaw, B., Jena, G., Sedoc, J., & Normoyle, A. (2024) · Proceedings of the 19th International Conference on the Foundations of Digital Games · doi:10.1145/3649921.3656975 · Cited by 5
Darwin Godel Machine: Open-Ended Evolution of Self-Improving Agents
Zhang, J., Hu, S., Lu, C., Lange, R., & Clune, J. (2025) · arXiv · doi:10.48550/arxiv.2505.22954 · Cited by 344
Metadata
- Authors
- Ouyang, L., Wu, J., Jiang, X., Almeida, D., Wainwright, C., Mishkin, P., Zhang, C., Agarwal, S., Slama, K., Ray, A., Schulman, J., Hilton, J., Kelton, F., Miller, L., Simens, M., Askell, A., Welinder, P., Christiano, P., Leike, J., & Lowe, R.
- Venue
- Advances in Neural Information Processing Systems 35
- Published
- 2022
- Pages
- 27730-27744
- ISSN
- 1049-5258 (ISSN-L)
- OpenAlex
- W7133211372
- Cited by
- 3,117
- References
- 0
- Citations by year
- 2026: 1421 · 2025: 544 · 2024: 852 · 2023: 297 · 2022: 3
- FWCI
- 234.27
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- neural information processing systems (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Keywords
- instruction following, language models, human feedback, reinforcement learning from human feedback, large language models
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.