Training Language Models to Follow Instructions with Human Feedback
The DOI matches its Crossref record; 2 of the 2 references it cites were found in a registry or an index.
Abstract
Making language models bigger does not inherently make them better at following a user's intent. For example, large language models can generate outputs that are untruthful, toxic, or simply not helpful to the user. In other words, these models are not aligned with their users. In this paper, we show an avenue for aligning language models with user intent on a wide range of tasks by fine-tuning with human feedback. Starting with a set of labeler-written prompts and prompts submitted through the OpenAI API, we collect a dataset of labeler demonstrations of the desired model behavior, which we use to fine-tune GPT-3 using supervised learning. We then collect a dataset of rankings of model outputs, which we use to further fine-tune this supervised model using reinforcement learning from human feedback. We call the resulting models InstructGPT. In human evaluations on our prompt distribution, outputs from the 1.3B parameter InstructGPT model are preferred to outputs from the 175B GPT-3, despite having 100x fewer parameters. Moreover, InstructGPT models show improvements in truthfulness and reductions in toxic output generation while having minimal performance regressions on public NLP datasets. Even though InstructGPT still makes simple mistakes, our results show that fine-tuning with human feedback is a promising direction for aligning language models with human intent.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Existing literature (Ouyang et al., 2022) does not fully describe the details of these models, such as the pretraining corpus, model sizes, and model biases.”
From Self-Refine: Iterative Refinement with Self-Feedback (2023) · cites this paper as Ouyang et al., 2022
Experimental — accuracy not yet measuredIn the citing paper
“Specifically, providers mitigate race and gender bias through reinforcement learning from human feedback (RLHF), adversarial stress-testing known as red teaming, and hard-coded refusals governed by the provider's own content policies [6, 43, 71].”
From All Public Voices Are Equal, But Are Some More Equal Than Others to LLMs? (2026) · cites this paper as [71]
In the citing paper
“Fine-tuning a model from human feedback at scale, using preference data from paid raters or drawn from a large and willing user base, is an especially potent technique.It has the potential not only to shape a model's responses to better reflect user norms (for better or worse), but also to filter out toxic language, improve factual accuracy, and mitigate the tendency to fabricate information.”
From Talking about Large Language Models (2024) · cites this paper as [26]
In the citing paper
“These include general competencies such as in-context learning (ICL) [13], chain-of-thought (CoT) [17] reasoning, and instruction following [25], as well as task-specialized skills like mathematical reasoning [30].”
From A Survey of Large Language Models (2026) · cites this paper as [25]
In the citing paper
“When external reward models or ground-truth answers are available, rejection sampling can also be applied to select higher-quality responses from multiple candidates [25].”
From A Survey of Large Language Models (2026) · cites this paper as [25]
41 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
The publisher hasn’t deposited this paper’s reference list.
Cited by
Items 3,301–3,400 of 4,340
Explainable Rating Prediction and Sentiment-Segmented Summarization for E-Governance Applications
Pandey, P., & Singh, J. P. (2026) · SN Computer Science · doi:10.1007/s42979-026-05287-9 · Cited by 1
Uneven by Design: How Generative AI Interfaces Reinforce Digital Divides Across Modalities
Jung, S., Han, S., Yoo, G. Y., Pasch, S., Ji, Y. G., Kim, H. C., & Cha, M. C. (2026) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2026.2719091 · Cited by 2
AI models as consciousness attributors: how LLMs ascribe consciousness to other agents
Kang, B., & Kim, C.-E. (2026) · Frontiers in Psychology · doi:10.3389/fpsyg.2026.1926286
Local LLMs as a plasticity layer for fixed cloud LLMs
Itoh, K. (2026) · Discover Artificial Intelligence · doi:10.1007/s44163-026-02054-w
Toward Multimodal AI for Dementia: A Challenge-Driven Survey of LLMs and VLMs
Sheikholeslami, A., Ding, D., Beheshti, A., & Qi, Y. (2026) · IEEE International Conference on Digital Health (ICDH) · doi:10.1109/icdh72779.2026.00033
VectorSec: A Web-Based AI Security Scanner for Systematic Evaluation of LLM Vulnerabilities
Yamin, M. M. (2026) · IEEE International Conference on Artificial Intelligence Testing (AITest) · doi:10.1109/aitest70988.2026.00022
Optimizing Cognitive Density in Small Language Models: A Constraint-Aware GRPO ApproachPreprint
Zouhdi, Y., & Hdioud, B. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7352879
A Review of Retrieval-Augmented Generation Technology
Jiang, P., & Cai, X. (2026) · Symmetry · doi:10.3390/sym18091431
Alucinações em Modelos de Linguagem de Grande Escala: Uma Revisão Sistemática da Literatura
Pereira, A. S., Aquino, S. A. B. D. M., & Xavier, E. S. (2026) · Anais do LIII Seminário Integrado de Software e Hardware (SEMISH 2026) · doi:10.5753/semish.2026.23904
UPServe: Backend Agnostic Proxy for Black-box Heterogeneous LLM Scheduling
Wan, H., Hei, C., Li, F., Gao, C., Jia, Y., Liu, T., & Wang, X. (2026) · International Workshop on Quality of Service · doi:10.1109/iwqos70441.2026.11661114
Large Language Models as Distributional Baselines for Language Tasks
Trott, S., Michaelov, J. A., Jones, C., Chang, T. A., & Bergen, B. K. (2026) · Open Mind · doi:10.1162/opmi.a.373
Ünaldı, A. O., Yılmaz, M., & Clarke, P. M. (2026) · Communications in computer and information science · doi:10.1007/978-3-032-36816-4_17
Semantic-Aware Graph Schema Discovery for Heterogeneous Cloud Metadata
Ramusat, Y., Mechouche, J., Mansouri, N. E., & Maamar, Z. (2026) · IEEE ... International Conference on Cloud Computing · doi:10.1109/cloud72782.2026.00029
Beyond Coarse Verifiers: Token-Diversity Reinforcement Alignment with Verifiable Rewards
Li, H., & Liu, K. (2026) · International Conference on Electronics Technology (ICET) · doi:10.1109/icet69987.2026.11659185
Kherroubi, Z. E. A., Prakash, M., Master, T., Thangadorai, K. K., Baddeley, M., & Giacalone, J. (2026) · International Conference on Distributed Computing in Smart Systems and the Internet of Things (DCOSS-IoT) · doi:10.1109/dcoss-iot69657.2026.00068
A Shift in Trust: An Analysis of the Use of AI Chatbots Among People Living With Bipolar Disorder
Bassil, K. C., Prins, S., van Os, H., Starke, G., de Groot, E., Dols, A., & van Dellen, E. (2026) · Bipolar Disorders · doi:10.1111/bdi.70176
Liu, Z., Yang, S., & Jiang, Y. (2026) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2026.2722515
Semantic Isomorphism Attacks and Defense Evaluation for Jailbreaking Large Language Models
Yang, F., Wang, K., Dou, W., Shuai, Y., Liu, Z., & Zhou, D. (2026) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/taslpro.2026.3727929
Lehesvuori, S., Hähkiöniemi, M., Tapia-Mandiola, S., Heilala, V., Araya, R., & Hämäläinen, R. (2026) · Journal of Educational Technology Systems · doi:10.1177/00472395261480725
Chen, T., Wang, Y., Chang, H., Liu, G., Li, D., Law, R., Xu, X., & Wu, E. Q. (2026) · IEEE/CAA Journal of Automatica Sinica · doi:10.1109/jas.2026.125900
Lee, H., Gim, M., Park, D., Choi, D., & Kang, J. (2026) · IEEE Access · doi:10.1109/access.2026.3727977
REFLEX: Finding and Defending Refusal Mechanisms in LLMs using Activation GuidancePreprint
Vishwakarma, A. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7360401
Gandhi, S., & Balas, M. (2026) · Journal of Personalized Medicine · doi:10.3390/jpm16090448
Attunement Costs: How Interaction Locks Users into Specific LLMsPreprint
Hanschur, L., Obermeier, D., & Henkel, J. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7354642
Yang, H., Chang, F., Liu, Z., Zhang, W., & Cai, J. (2026) · Technology in Society · doi:10.1016/j.techsoc.2026.103535
STAR: instruction tuning for Arabic across tasks, datasets, and models
Al-shaibani, M. S., Alyafeai, Z., & Ahmad, I. (2026) · Language Resources and Evaluation · doi:10.1007/s10579-026-09942-8
Frémund, A., & Švec, J. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37249-9_4
FitRAG: Self-Improving LLM-Based Services through Feedback-Driven Adapter Lifecycle Management
Syah, R. A., Haryanto, C. Y., Lomempow, E., Malik, K., & Putra, I. (2026) · IEEE International Conference on Software Services Engineering (SSE) · doi:10.1109/sse72781.2026.00022
From Fine‐Tuning to Evaluation: How LLM Enables Automatic Domain Modeling
Shi, H., Wang, G., Liu, S., Khan, S., Mei, G., & Pan, L. (2026) · IET Software · doi:10.1049/sfw2/1690605
An Interpretable Hybrid Ensemble Model for Paraphrase Detection With SHAP-Based Explanations
Sameh, D., El-Sawy, A., Amer, E., & Nayel, H. (2026) · IEEE Access · doi:10.1109/access.2026.3729013
张, 绍. (2026) · Modern Linguistics · doi:10.12677/ml.2026.148887
Personal Data Accuracy is a Blind Spot in LLM Privacy Research - Opinion Paper
Magnussen, K., & Böhme, R. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-35899-8_2
Jiang, T., Song, Y., & An, H. (2026) · Journal of Innovation & Knowledge · doi:10.1016/j.jik.2026.101149
Wu, H., Xie, J., Hu, J., & Tian, Z. (2026) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2026.3729518
HSTV: Hidden-State Trajectory Verification for Best-of-N Mathematical ReasoningPreprint
Yu, Q., Zhou, D., Xiao, L., Zhu, B., & Jiang, K. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7390658
Multi-Path Causal Optimization for claim verification through controlling confounding
Guo, H., Di, S., Meo, P. D., Chen, Z., & Zhu, J. (2026) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2026.116117
Bayesian Perspectives in Scientific Machine Learning: Methods, Challenges, and Opportunities
Coscia, D., & Rozza, G. (2026) · Lecture notes in computational science and engineering · doi:10.1007/978-3-032-33428-2_11
GenAlign: Visual knowledge graphs as interactive substrates for property-aligned generative design
Choi, J., Seo, M., & Hyun, K. H. (2026) · Advanced Engineering Informatics · doi:10.1016/j.aei.2026.105165 · Cited by 1
Generative large language models in medicine: a scoping review of recent methodological advances
LI, F., Li, J., Cao, W., Li, H., Li, Y., Sun, Z., Chen, D., Duan, T., Li, P., Tizhoosh, H., et al. (2026) · npj Health Systems · doi:10.1038/s44401-026-00137-5 · Cited by 1
TriUTest: Internalizing execution feedback for defect-exposing python unit test generation
Li, Z., Wang, Z., & Cui, C. (2026) · Neurocomputing · doi:10.1016/j.neucom.2026.135014
A review of bias detection and fairness auditing techniques in LLMs
Kaveti, N. K., & Pattanshetti, T. R. (2026) · Discover Artificial Intelligence · doi:10.1007/s44163-026-02121-2
Son, M., & Lee, P. (2026) · Organizational Research Methods · doi:10.1177/10944281261475596
A contamination model for regression bias and residual-variance compression in LLM-generated data
Mankad, S. (2026) · Statistics & Probability Letters · doi:10.2139/ssrn.7398614
Do Large Language Models Overvalue AI Narratives?Preprint
Qin, Q., & Chen, Y. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7397642
Shi, J., Yi, S., Ya, Y., Li, F., Liu, D., & Li, Q. (2026) · Cogent Food & Agriculture · doi:10.1080/23311932.2026.2716916
A Review of Neural Question Generation: Approaches, Challenges, and Future Directions
Guo, S., Pang, L., Zhang, J., Li, C., & Chen, H. (2026) · ACM Computing Surveys · doi:10.1145/3843765
Inferring Online Retailing Product Seasonality via LLMs for Cold-Start Cases
Wang, D. (2026) · Lecture notes in networks and systems · doi:10.1007/978-3-032-31755-1_5
Data-efficient Online Training for Direct Alignment in LLMs
Zhang, C., Wang, J.-C. T., He, K., Chai, C.-L., Zhang, Y.-P., Wang, Y.-P., Zhou, X., Zheng, L.-N., Wu, L.-J., He, C.-H., et al. (2026) · Proceedings of the VLDB Endowment · doi:10.14778/3828612.3828628
Self-citationReasoning LLM Unit Test Generation Based on Tree-of-Thoughts Considering Branch Merging
Yang, C.-C., Yang, S., & Liu, L.-T. (2026) · Lecture notes in networks and systems · doi:10.1007/978-3-032-31755-1_17
Wang, Y.-Q., Xu, B., Yang, H., Chen, J.-J., Li, H., Wang, W.-Z., & Wang, H. (2026) · Water Research · doi:10.1016/j.watres.2026.126862
Li, J., Shi, D., Kuang, H., & Weng, Y. (2026) · Frontiers in Psychology · doi:10.3389/fpsyg.2026.1859697
Turning Over a New Leaf: Machine Unlearning for Malicious Code Removal in LLMsPreprint
Nguyen, M. X., Bui, A. M. T., Vu, D. H., Nguyen, P. T., Rocco, J. D., Sipio, C. D., & Ruscio, D. D. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7412271
Cao, J., & Zhao, X. (2026) · International Conference on Cyber Security, Artificial Intelligence and Digital Economy (CSAIDE) · doi:10.1145/3819836.3819974
Certiguard: a fine-tuned LLM for mastering security certification exams
Lai, C.-M., Chang, L.-D., Chang, C.-C., & Wu, Y.-C. (2026) · International Journal of Information Security · doi:10.1007/s10207-026-01317-y
Shi, J., Chen, H., & Han, L. (2026) · Electronics · doi:10.3390/electronics15174015
Benefits and challenges of integrating generative AI in health technology education—a case study
Pikkarainen, M. A., Lukic, M., Johansen, S., Admiraal, W., Berg, A., & Røe, Y. (2026) · Frontiers in Education · doi:10.3389/feduc.2026.1763138
Transforming large language models into medical specialists via knowledge injection
Kim, K., Song, J., Kim, D. Y., Nam, Y., Park, S., Shin, K., Jo, W., & Kim, N. (2026) · Cell Reports Medicine · doi:10.1016/j.xcrm.2026.103020
Structure-aware and parameter-efficient framework for editing LM-based knowledge graph embeddings
Wang, M.-H., Gan, J., Ren, W., Wang, J., Li, Z., & Zhou, J. (2026) · Knowledge-Based Systems · doi:10.1016/j.knosys.2026.116976
Yuxuan, Z., & Hussain, W. M. H. W. (2026) · Electronic Commerce Research and Applications · doi:10.1016/j.elerap.2026.101629
Mehta, M., Sharma, R., Kalluru, V., & Kotwal, A. (2026) · ACM Conference on Hypertext and Social Media (HT) · doi:10.1145/3800935.3830864
Large Language Models for Socio-Political Event Interpolation and Extrapolation
Zhang, L., & Ning, Y. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37667-1_8
Efficiency Evaluation Framework for LLM-Generated Code
Avagian, D. A., & Ball, A. L. J. (2026) · Pattern Recognition and Image Analysis · doi:10.1134/s1054661826700306
Uncertainty calibration for hallucination detection via token dependency and sequence divergence
Qin, S., Zhou, L.-K., Sun, L., & Wang, N.-B. (2026) · Applied Soft Computing · doi:10.1016/j.asoc.2026.116357
RoleCraft: Aligning Persona Stance and Style for Robust Role-Playing Agents
Gao, Y., Dang, C., He, Y., Hu, J., Luo, Y., & Yang, J. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37667-1_9
Mutual Information-Driven Multi-objective Exploration and Preference Optimization
Xie, H., Ban, Y., Fang, R., Huang, Z., Wang, D., Li, J., & Song, S. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37667-1_20
Orlando, G. M., Perillo, M., Russo, D., Gatta, V. L., & Moscato, V. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37667-1_6
KD-GAG: Knowledge-distilled graph-augmented generation via preference-aware subgraph pruning
Zhao, L., Xu, Y., Wang, Y., & Li, F. (2026) · Neural Networks · doi:10.1016/j.neunet.2026.109587
Zhu, M., Chen, F., Yang, M., Xu, G., Wu, Y., Ma, G., Cheng, G., & Zheng, X. (2026) · IEEE International Conference on Web Services (ICWS) · doi:10.1109/icws72778.2026.00064
Yin, B., Liu, Y., & Zhang, B. (2026) · IEEE International Conference on Web Services (ICWS) · doi:10.1109/icws72778.2026.00073
Trustworthy medical concept recalibration through logic-aware multimodal evidence fusion
Zhao, L., Zhu, C., Gao, Z., Liang, P., Liang, X., Cheng, A. C.-Y., & Pun, C. (2026) · Information Fusion · doi:10.1016/j.inffus.2026.104753
Wilson, J. (2026) · Journal of Linguistic Anthropology · doi:10.1111/jola.70074
Rajasekaran, S. K., Ali, A., & Devasia, C. (2026) · ITM Web of Conferences · doi:10.1051/itmconf/20269002010
Ethical Dilemmas and Paths to Reconstruction in the Era of AI-Assisted Translation
Wei-xia, C. (2026) · Journal of literature and art studies · doi:10.17265/2159-5836/2026.08.004
Taming LLMs for Codematic Indoor Scene Generation
Liang, Y., Wu, Q., Fang, C., Chen, R., Liu, J., Zhang, J., & Tan, P. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37035-8_22
Chen, T., & Sun, K. (2026) · Cybernetics and Intelligence · doi:10.26599/cai.2026.9390018 · Cited by 1
MPO: Single-Stream Policy Optimization for Efficient Text-to-Image Alignment
Gao, L., Hu, J., Wei, C., Zhong, Y., Zhao, Y., Gao, Z., & Wei, X. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37359-5_4
How Investment Position Influences Generative AI Processing of Financial InformationPreprint
Croom, J., & Gale, B. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7437858
Saffar, R. A. M. A. (2026) · Clinical Anatomy · doi:10.1002/ca.70210
Reinforcement Learning from Testing Targets for Effective SLM Test Generation
Céspedes-Arancibia, K. (2026) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/3774748.3787638
Chen, S., Chen, B., Zhang, S., Luo, Y., Ma, Y., Qiao, Y., & Wang, Y. (2026) · Pattern Recognition · doi:10.1016/j.patcog.2026.114856
Software Engineering for Foundation Models (SE4FM)
Chen, B., Lin, D., Leung, A., Chen, Z., Rajbahadur, G. K., Oliva, G. A., Chen, Y., Liu, X., Chong, C. Y., & Hassan, A. E. (2026) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/3774748.3776600
Vibe Engineering: Software Engineering for Software Makers
Gallaba, K., Fan, Z., Lin, J., Cogo, F. R., Rombaut, B., Lin, D., & Hassan, A. E. (2026) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/3774748.3776599
Ma, L., Jian-fei, Y., Li, N., Zhu, Y., & Yao, X. (2026) · Journal of Racial and Ethnic Health Disparities · doi:10.1007/s40615-026-03151-3
Position Sizing as a Risk-Control Variable: A Closed-Loop GRPO Framework for LLM Trading
Li, D., & Chen, M. (2026) · IEEE International Conference on Information Reuse and Integration (IRI) · doi:10.1109/iri69576.2026.00106
A Safety-Enhanced Reinforcement Learning Framework for Vision-Language Models in Autonomous Driving
Gao, S., Song, Q., Gong, T., Xu, R., Zhou, H., Li, C., Li, J., & Cao, Y. (2026) · Chinese Journal of Electronics · doi:10.23919/cje.2025.00.214
When Rubrics Fail: Error Enumeration as Reward for Reference-Free RL Post-training
Ikezogwo, W. O., Seyfioğlu, M. S., Krishna, R., & Bouyarmane, K. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37092-1_35
Test-Time Counterfactual Calibration for Hallucination-Resistant Temporal Grounding
Yi, C., Qu, H., Xuan, S., Yan, R., Shu, X., Zhao, F., & Xie, G.-S. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37196-6_11
VGEdit: Unlocking Video Generation Priors for Reasoning-Informed Image Editing
Lu, H., Fang, G., Ma, X., & Wang, X. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37092-1_21
Thatsaneechaiyaporn, S., Leuangsupachaikul, P., & Prasertsung, N. (2026) · National Conference on Technical Education and International Conference on Technical Education (NCTechEd & ICTechEd) · doi:10.1109/icteched69022.2026.11682842
RF-FilterLLM: A Fine-Tuned LLM Agent for Automated RF Filter Design
Sun, W., Li, Y., Wang, Z., Sui, X., Luo, X., Mei, Y., Li, Q., Wang, R., Shi, H., & Pang, J. (2026) · International Conference on Microwave and Millimeter Wave Technology (ICMMT) · doi:10.1109/icmmt69626.2026.11678389
Emotion State Recognition Combined with Traditional Chinese Emotion Theory
Leung, C. H. C., Xu, Z., & Yuan, L. (2025) · IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology (WI-IAT) · doi:10.1109/wi-iat67162.2025.00127
Think-Commit Decoupling for Accelerated and Reliable Tool Invocation in LLM Agents
Lu, X., Wang, J., He, Y., Wu, W., & Li, Y. (2026) · International Conference on Computer Information Science and Application Technology (CISAT) · doi:10.1109/cisat71030.2026.11682253
Clinical warrant in medical LLM evaluation
Sariyar, M. (2026) · Frontiers in Digital Health · doi:10.3389/fdgth.2026.1918724
Zhang, W., Feng, Z., Liu, Y., Zhong, R., Chen, S., Li, Z., 李冰燕, Liu, D., Gao, L., & Hu, K. (2026) · Frontiers in Oncology · doi:10.3389/fonc.2026.1915669
Więckowski, J., Paradowski, B., Kizielewicz, B., & Bouraima, M. B. (2026) · Applied Soft Computing · doi:10.1016/j.asoc.2026.116417 · Cited by 1
OceanSkill: An Agentic Skill Framework for Evidence-Grounded Ocean Forecast Report Generation
Yu, X., Bi, Z., Zhu, Y., Wang, Z., Liu, Z., & Lou, J. (2026) · International Conference on Large Models and Intelligent Agent Technologies (LMIAT) · doi:10.1109/lmiat70705.2026.11682146
Zhang, C. (2026) · Open Computer Science · doi:10.1515/comp-2025-0073
Self-citationPeer, J., & Reich, Y. (2026) · INCOSE International Symposium · doi:10.1002/iis2.70194
Zhong, P., Huang, G., Lv, B., & Jiang, X. (2026) · SID Symposium Digest of Technical Papers · doi:10.1002/sdtp.70001_575
Self-citation
Metadata
- Authors
- Ouyang, L., Wu, J., Jiang, X., Almeida, D., Wainwright, C., Mishkin, P., Zhang, C., Agarwal, S., Slama, K., Ray, A., Schulman, J., Hilton, J., Kelton, F., Miller, L., Simens, M., Askell, A., Welinder, P., Christiano, P., Leike, J., & Lowe, R.
- Venue
- Advances in Neural Information Processing Systems 35
- Published
- 2022
- Pages
- 27730-27744
- ISSN
- 1049-5258 (ISSN-L)
- OpenAlex
- W7133211372
- Cited by
- 3,117
- References
- 0
- Citations by year
- 2026: 1421 · 2025: 544 · 2024: 852 · 2023: 297 · 2022: 3
- FWCI
- 234.27
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- neural information processing systems (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Keywords
- instruction following, language models, human feedback, reinforcement learning from human feedback, large language models
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.