Training Language Models to Follow Instructions with Human Feedback
The DOI matches its Crossref record; 2 of the 2 references it cites were found in a registry or an index.
Abstract
Making language models bigger does not inherently make them better at following a user's intent. For example, large language models can generate outputs that are untruthful, toxic, or simply not helpful to the user. In other words, these models are not aligned with their users. In this paper, we show an avenue for aligning language models with user intent on a wide range of tasks by fine-tuning with human feedback. Starting with a set of labeler-written prompts and prompts submitted through the OpenAI API, we collect a dataset of labeler demonstrations of the desired model behavior, which we use to fine-tune GPT-3 using supervised learning. We then collect a dataset of rankings of model outputs, which we use to further fine-tune this supervised model using reinforcement learning from human feedback. We call the resulting models InstructGPT. In human evaluations on our prompt distribution, outputs from the 1.3B parameter InstructGPT model are preferred to outputs from the 175B GPT-3, despite having 100x fewer parameters. Moreover, InstructGPT models show improvements in truthfulness and reductions in toxic output generation while having minimal performance regressions on public NLP datasets. Even though InstructGPT still makes simple mistakes, our results show that fine-tuning with human feedback is a promising direction for aligning language models with human intent.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Existing literature (Ouyang et al., 2022) does not fully describe the details of these models, such as the pretraining corpus, model sizes, and model biases.”
From Self-Refine: Iterative Refinement with Self-Feedback (2023) · cites this paper as Ouyang et al., 2022
Experimental — accuracy not yet measuredIn the citing paper
“Specifically, providers mitigate race and gender bias through reinforcement learning from human feedback (RLHF), adversarial stress-testing known as red teaming, and hard-coded refusals governed by the provider's own content policies [6, 43, 71].”
From All Public Voices Are Equal, But Are Some More Equal Than Others to LLMs? (2026) · cites this paper as [71]
In the citing paper
“Fine-tuning a model from human feedback at scale, using preference data from paid raters or drawn from a large and willing user base, is an especially potent technique.It has the potential not only to shape a model's responses to better reflect user norms (for better or worse), but also to filter out toxic language, improve factual accuracy, and mitigate the tendency to fabricate information.”
From Talking about Large Language Models (2024) · cites this paper as [26]
In the citing paper
“These include general competencies such as in-context learning (ICL) [13], chain-of-thought (CoT) [17] reasoning, and instruction following [25], as well as task-specialized skills like mathematical reasoning [30].”
From A Survey of Large Language Models (2026) · cites this paper as [25]
In the citing paper
“When external reward models or ground-truth answers are available, rejection sampling can also be applied to select higher-quality responses from multiple candidates [25].”
From A Survey of Large Language Models (2026) · cites this paper as [25]
41 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
The publisher hasn’t deposited this paper’s reference list.
Cited by
Items 3,201–3,300 of 4,340
Minimal AIF-inspired response control for evidence-aware and dependable LLM behavior
Feng, C., Guo, Y., & Wang, G. (2026) · Computing · doi:10.1007/s00607-026-01723-z
Transformers as the Foundation of Large Language Models: A Comprehensive Review
Shaikh, M. R., Shahryar, N., Mahboob, K., Naiyar, Q. U. A., & Talha, M. (2025) · International Journal of Innovations in Science and Technology · doi:10.33411/ijist/1632
On finding all roots to systems of nonlinear equations using large language models
Semenov, A., Hirsch, M. J., & Pardalos, P. M. (2026) · Journal of Combinatorial Optimization · doi:10.1007/s10878-026-01451-2
LLM-Powered Agentic Data Science: Automated Analysis and Insight Generation
Keerthika, M. (2026) · Eduschool International Journal of Data Science and Machine learning (EIJDSML) · doi:10.63090/eijdsml/3139.7344.0010
Chatbots for Healthcare: A Literature Review
Gupta, A., Kaushik, A., Sharma, H., & Archita (2026) · Lecture notes in networks and systems · doi:10.1007/978-3-032-25694-2_28
From Open Weights to Practical Detection: QLoRA-Adapted GPT-OSS-20B for Vietnamese Fake News
Tu, B. T. T., Son, B. H. H., Hong, V. N., Ngan, N. T. B., & Hao, L. V. N. (2026) · Lecture notes in networks and systems · doi:10.1007/978-3-032-25694-2_24
ScholarRAG: Path-Aware Knowledge Graph-Augmented Retrieval for Scholarly QA
Ji, S., Chen, G., Liang, Y., Yuan, C., Lin, R., & Tang, Y. (2026) · Communications in computer and information science · doi:10.1007/978-981-92-0291-1_29
New knowledge source pipelines for sociocultural representations in a cognitive architecture
Dulam, S., Gay, J. R., & Dancy, C. L. (2026) · Frontiers in Psychology · doi:10.3389/fpsyg.2026.1874556
Multi-level inconsistency-aware fusion network for multimodal sarcasm detection
Qin, M., Ou, L., & Jiang, Y. (2026) · Multimedia Systems · doi:10.1007/s00530-026-02554-w
Zhu, X., & Yin, Y. (2026) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2026.1869972
FreeLayout: Free range multi-modal input to free form floorplan generation
Zhang, H., Savov, A., & Dillenburger, B. (2026) · Advanced Engineering Informatics · doi:10.1016/j.aei.2026.105110
Yan, F., Zheng, D., Yu, F., & Kang, J. (2026) · Applied Sciences · doi:10.3390/app16167956
LLMs Can Amplify Emotion While Preserving Analytic Style in AI-mediated Communication
Mazzone, S. B., Harlan, J., Islam, K. M. S., Xu, L. Z., & Ow, T. T. (2026) · ACM Transactions on Social Computing · doi:10.1145/3839336
A domain-adapted retrieval-augmented framework for transparent Earth system assessment
Kart, Ö., Caesar, L., Ludescher, J., & Sakschewski, B. (2026) · Communications Earth & Environment · doi:10.1038/s43247-026-03878-1
Wang, S., He, R., Li, H., Yang, J., & Yin, R. (2026) · International Conference on Electronic Information Technology and Computer Engineering (EITCE) · doi:10.1109/eitce70137.2026.11634335
CausalDX: Diagnosing Long-Tail and Cascading Cloud Incidents With LLM-Guided Causal Reasoning
Chang, Z., Wu, Y.-J., Feng, H., Li, Y., Fang, Y., Liu, L., Jin, Z., Huang, D.-Q., Yang, X., Chen, P., et al. (2026) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2026.3722256
Koohsari, M. J., Loo, B. P. Y., Zhao, J., Li, J., Long, Y., Lu, Y., Oka, K., & Kaczynski, A. T. (2026) · Developments in the Built Environment · doi:10.1016/j.dibe.2026.101007
Reinforcement Learning in the Era of Large Language Models: Challenges and Opportunities
Hao, Q., Chen, L., Qi, X.-K., Yuan, Y., Zong, Z., Chen, H. S., Zhao, K., Wang, S., Zhang, Y., Yuan, J., et al. (2026) · ACM Computing Surveys · doi:10.1145/3837057
Repetitive history-driven fuzzy Markov networks for long-term human motion prediction
Luo, J., Zhong, J., Ji, J., & Cao, W. (2026) · Neural Networks · doi:10.1016/j.neunet.2026.109505
BALM: Bias-Aware Generation for Large Language Models
Dorleon, G., & Shujaa, S. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-34896-8_2
Large Language Models and Hybrid Prompt Engineering for Emotional Text Steganography Based on Cloud
Hadi, A. K. (2026) · Communications in computer and information science · doi:10.1007/978-3-032-25568-6_24
Zhu, Z., Mao, M., & Zhang, Y. (2026) · International Conference on Electronic Engineering and Informatics (EEI) · doi:10.1109/eei70303.2026.11640556
Jang, W., Jo, G. Y., Lee, S. Y., Yoon, S. J., Lee, G. Y., Lee, H.-E., Kim, T. H., Baek, J. W., & Kim, J. H. (2026) · Bioengineering · doi:10.3390/bioengineering13080912
TORepair: Diffusion-Based Task-Oriented Error Repair Via Differentiable Bi-Level Optimization
Ni, W., Miao, X., Zhao, X., Wu, Y., & Yin, J. (2026) · IEEE International Conference on Data Engineering (ICDE) · doi:10.1109/icde65706.2026.00198
Deterministic Validation for Reliable LLM-Based Causal Knowledge Extraction
Foss, D. T. (2026) · International Conference on Electrical, Computer and Energy Technologies (ICECET) · doi:10.1109/icecet65726.2026.11632715
Dependency-Aware Reliable Orchestration for Smart-IoT Control with Reasoning-Aligned LLMs
Sarowar, M. S., Islam, M. T., Nuruzzaman, M., & Mozumder, M. A. I. (2026) · International Conference on Electrical, Computer and Energy Technologies (ICECET) · doi:10.1109/icecet65726.2026.11632566
Efficient Neural-Symbolic Data System via Multi-Agent Collaboration
Yuan, Y., Tang, B., Luo, Z., Li, B., Liu, R., & Wei, Z. (2026) · IEEE International Conference on Data Engineering (ICDE) · doi:10.1109/icde65706.2026.00331
An E2E Framework to Improve Agentic AI Using GRPO Reasoning and Continuous Memory Based Learning
Mandal, S., Mittal, S., Bag, S., Gupta, A., & Jain, C. (2026) · International Conference on Electrical, Computer and Energy Technologies (ICECET) · doi:10.1109/icecet65726.2026.11632426
Tabashum, T., Rifat, F. Y., Wang, S., Krzak, J. J., Kruger, K. M., Graf, A., Chafetz, R. S., Davids, J. R., Bagley, A. M., Woloff, J., et al. (2026) · IEEE International Conference on Healthcare Informatics (ICHI) · doi:10.1109/ichi69079.2026.00062
Effects of AI-Integrated VR and CVR on Speaking Anxiety and Motivation in Basic-Level EFL Learners
Chalouy, N., & Tsai, A.-C. (2026) · International Conference on e-Education, e-Business, e-Management and e-Learning · doi:10.1109/ic4e69618.2026.11631450
Repetition-Aware Reinforcement Learning from AI Feedback for Empathetic Dialogue
Ganesh, R., & Rathore, H. (2026) · IEEE International Conference on Healthcare Informatics (ICHI) · doi:10.1109/ichi69079.2026.00231
Clue-RAG: Towards Accurate and Cost-Efficient Graph-Based RAG Via Multi-Partite Graph-Based Index
Su, Y., Fang, Y., Zhou, Y., & Yang, C. (2026) · IEEE International Conference on Data Engineering (ICDE) · doi:10.1109/icde65706.2026.00179
Hierarchical Multi-Objective Reward with Adaptive PPO for Neural Machine Translation
Chen, X., & Luo, X. (2026) · International Conference on Artificial Intelligence and Electromechanical Automation (AIEA) · doi:10.1109/aiea70743.2026.11632303
Spatiotemporal Adaptive Normalization for Distribution-Aware Rainfall-Runoff Modeling
Yang, Y., Zhu, H., Gao, Z., & Quan, H. (2026) · International Conference on Electronic Technology and Information Science (ICETIS) · doi:10.1109/icetis70504.2026.11633446
Evolutionary Algorithms for Lightweight Post-Training of Language Models
Ulyanova, M., Buzaev, F. A., & Ermakov, A. (2026) · Genetic and Evolutionary Computation Conference Companion (GECCO Companion) · doi:10.1145/3795101.3805438
Culturally Responsive AI-Mediated Feedback
Kodithuwakku, D. S. (2026) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-9898-3.ch008
How well do LLMs understand code?
Xu, J., Sun, R., Ding, Z., Li, W., Han, K., Zhang, H., Wang, C., Wang, H., Wang, W. W., Sun, Y., et al. (2026) · Communications AI & Computing · doi:10.1038/s44488-026-00014-y
CodeVulReason: Incentivizing reasoning for code vulnerability detection
Li, Z., & Zhu, K. (2026) · Journal of King Saud University - Science · doi:10.25259/jksus_1438_2025
Ethical Field Theory: Computational Foundations and Philosophical ExtensionsPreprint
Tabrizi, A. M. (2026) · Research Square · doi:10.21203/rs.3.rs-10669621/v1
Gong, X., Shen, H., Niu, S., Zhang, H., Liu, H., & Cheng, S. (2026) · International Conference on Artificial Intelligence and Big Data (ICAIBD) · doi:10.1109/icaibd69640.2026.11637231
Raza, S., Chaduvula, S., Khushu, S., & Pandya, D. (2026) · ITU Kaleidoscope Academic Conference (ITU K) · doi:10.23919/ituk70038.2026.11632979
PAMI-GPT: knowledge-grounded LLMs for reliable pattern mining workflow generation
PALLA, M., Kiran, R. U., & Pogaku, A. C. (2026) · International Journal of Data Science and Analytics · doi:10.1007/s41060-026-01237-z
He, J. (2026) · ITM Web of Conferences · doi:10.1051/itmconf/20268904006
Human-Centered Design and Human-Centered AI
Faruqe, F. (2026) · Springer eBooks · doi:10.1007/978-3-032-12201-8_7
Semantic Augmented Multiview Graph Learning With Frequency-Aware Propagation for Recommendation
Liu, Y., Zhang, Y., Sang, L., & Zhang, Y. (2026) · IEEE Transactions on Computational Social Systems · doi:10.1109/tcss.2026.3716309
Adaptive Enrollment Planning for Higher Education in the Generative AI Era: A Data-Driven Framework
Liang, X. (2026) · ITM Web of Conferences · doi:10.1051/itmconf/20268904017
An End to End Trustworthiness Evaluation Framework for Enterprise AI Systems
Muppidi, V. K. (2026) · Lecture notes in networks and systems · doi:10.1007/978-3-032-34789-3_22
Costa, M. S., Tironi, J. C., Profeta, V., de Castro, R. V., França, C., Costa, R. A., & Araújo, R. (2026) · IEEE International Conference on Software Architecture Companion (ICSA-C) · doi:10.1109/icsa-c68850.2026.00024
Gundidza, F., Kikuchi, M., & Ozono, T. (2026) · IEEE Access · doi:10.1109/access.2026.3723798
AIGC-Generated Content-Driven Algorithm for B2B Anchor Feature Deviation Detection and Correction
Li, S. (2026) · International Conference on Distributed Computing and Electrical Circuits and Electronics (ICDCECE) · doi:10.1109/icdcece68961.2026.11646148
Lightweight Skill-Based LLM Workflows for Vulnerability Identification and Classification
Rashidi, P., Anoruo, D., Dhital, D., Deng, L., & Yu, W. (2026) · IEEE/ACIS International Conference on Software Engineering Research, Management and Applications (SERA) · doi:10.1109/sera69989.2026.11655058
Generative AI for Surveys on Payment Apps: AI Views on Privacy and TechnologyPreprint
Takahashi, K., & Park, J. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7292593
Artificial Intelligence in Cyberpsychology
Boch, A., & Cook, D. (2026) · Springer eBooks · doi:10.1007/978-3-031-52643-5_262-1
Baruah, P. J., Snehal, V. S., Borah, T., Paul, A. M. M., Bhattacharya, M., & Singha, T. D. (2026) · IEEE Guwahati Subsection Conference (GCON) · doi:10.1109/gcon69192.2026.11648987
How to customize generative artificial intelligence? Case Finnish hospital construction
Nyqvist, R., Peltokorpi, A., Marjavaara, P., Lehtovaara, J., & Oksanen, S. (2026) · Construction Innovation · doi:10.1108/ci-10-2025-0464
Wan, P., Huang, Z., Huang, H., Liang, G., Guo, M., Xu, S., Sun, X., Tang, W., Pei, D., Chen, J., et al. (2026) · Med · doi:10.1016/j.medj.2026.101263
An Empirical Study of Knowledge Distillation Frameworks for Financial NLP in Africa
Diasse, O. A. A. W., & Dembélé, J. M. (2026) · International Conference on Computer Communication and Artificial Intelligence (CCAI) · doi:10.1109/ccai69603.2026.11641879
Zuo, Q., Wang, Z., Li, J., Guan, Y., Chen, J., Yang, C., & Fu, Z. (2026) · Array · doi:10.1016/j.array.2026.101139
Prompt Injection as the New SQL Injection: The Emergence of Attacks on AI Reasoning
Abzal, S., Bakhtiyar, K., Sultan, O., Orlova, O., Korochkina, E. A., & Borashova, S. (2026) · International Conference on Cybersecurity, Digital Forensics, and AI Applications (ICCSDFAI) · doi:10.1109/iccsdfai70505.2026.11648022
Tian, Y., Xiao, Q., Wei, H., & Wang, F. (2026) · Electronics · doi:10.3390/electronics15163666
Ding, F., Liao, Z., & Li, Q. (2026) · International Conference on Computer Communication and Artificial Intelligence (CCAI) · doi:10.1109/ccai69603.2026.11642016
Shi, J., Zhao, Z., Guo, A., Shi, J., Wang, F., Li, L., Su, Q., & Liu, Z. (2026) · Biomimetic Intelligence and Robotics · doi:10.1016/j.birob.2026.100362
Analysis and Classification of Approaches to the Evolution of LLM-Agents
Равильевна, Ф. Р., & Sychev, A. E. (2026) · International Conference on Neural Networks and Neurotechnologies (NeuroNT) · doi:10.1109/neuront71829.2026.11651389
Chatbot for Domain-specific Document Templates Generation based on Keyphrases
Stepanov, A. P. (2026) · International Conference on Neural Networks and Neurotechnologies (NeuroNT) · doi:10.1109/neuront71829.2026.11651372
Investigating the Impact of Supervision Format on Reasoning Performance in Large Language Models
Vu, N. T., Rashid, M. M., & Sabrina, F. (2026) · Electronics · doi:10.3390/electronics15163683
Tan, C. H., & Ding, Q. (2026) · FinTech · doi:10.3390/fintech5030071
Zhang, S., Ding, Y., & Mao, Y. (2026) · Expert Systems · doi:10.1111/exsy.70395
A Multi-Agent Framework for Task Planning and Execution in Robotic Perception and Manipulation
Filippi, M., Giulietti, N., Fabiocchi, D., Bedodi, M., Carnevale, M., & Giberti, H. (2026) · IEEE International Workshop on Metrology for Industry 4.0 & IoT (MetroInd4.0&IoT) · doi:10.1109/metroind4.0iot69397.2026.11653110
Bai, Z., Ai, S., Gong, Q., Luo, D., & Shao, T. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7315096
Building and Deploying AI Agents and Workflows Using DeepSeek with n8n and Make.com
Rakesh, & Narwal, R. (2026) · International Conference on NextGen Data Science and Analytics (ICNDSA) · doi:10.1109/icndsa68777.2026.11652216
Stratified regulation: unpacking value alignment of Chinese LLMs
Liu, M., Su, Y., & Meng, T. (2026) · Chinese Sociological Review · doi:10.1080/21620555.2026.2714528
Xu, Y., Wang, C., & Xiong, H. (2026) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3841463
SpecQuant – Speculative Decoding with Multi-Parent Quantization for Adaptive LLM Inference
Harish Raj, K. B., Jagadeeswaran, M., Pradheep Narendran, P., Yuvanesh, S., & Sivakumar, T. (2026) · International Conference on Power, Control and Computing Technologies (ICPC2T) · doi:10.1109/icpc2t68221.2026.11646348
Zhang, J., Zhao, Y., & Zhang, Z. (2026) · Journal of King Saud University - Computer and Information Sciences · doi:10.1007/s44443-026-01149-9
Orji, F. A., Ataguba, G., Rudzicz, F., & Orji, R. (2026) · SeGAH ... IEEE ... International Conference on Serious Games and Applications for Health/IEEE International Conference on Serious Games and Applications for Health · doi:10.1109/segah69272.2026.11653328
Yoo, J., Kim, B., Yang, Y., & Jang, H. (2026) · IEEE Access · doi:10.1109/access.2026.3725783
RLAgent-GSSTI: Automated Grey-Box SSTI Vulnerability Detection Based on Reinforcement Learning Agent
Ma, W., Li, T., Fang, W., Li, W., Yang, G., Li, T., & He, J. (2026) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2026.3725559
Fine-tuning as Jailbreaking: A data-centric red teaming framework via logic injection
Li, Q., Xu, K., Qu, Y., & Wu, J. (2026) · Automated Software Engineering · doi:10.1007/s10515-026-00659-0
Self-citationThe LLM conjuncture: Genres in flux and progenitors of the next wave
Wei, Y., Wang, Y., Liu, X., Watada, J., & Pan, J. (2026) · Results in Engineering · doi:10.1016/j.rineng.2026.112398
Arzu, G. E., Umar, M., Fayaz, M., Ali, U., Dang, L. M., & Moon, H. (2026) · Knowledge-Based Systems · doi:10.1016/j.knosys.2026.116901
TKPE: Topic-Based Evaluation for Keyphrase Prediction
Li, B., Li, J., Chen, J., Zhuang, W., & Zhang, Y. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-36033-5_13
Large language models in bioinformatics: a comprehensive survey
Meng, Z., Yang, Z., Zhu, M., & Xu, J. (2026) · Frontiers in Genetics · doi:10.3389/fgene.2026.1797863
Liu, Z., Wang, Y., Wang, R., Bai, Y., & Wu, S. (2026) · Lecture notes in computer science · doi:10.1007/978-981-92-4805-6_19
Cai, Z., Xu, C., Li, C., Liu, S., Yue, Y., Zhang, Y., & Li, J. (2026) · IEEE International Conference on Big Data and Artificial Intelligence (BDAI) · doi:10.1109/bdai70753.2026.11655184
COALITION-VAST: Auditable Multi-Agent Alignment Under Byzantine Governance
Partow, S., & Nan, S. (2026) · International Conference on Intelligent Multimedia, Networking, and Security (IMNS) · doi:10.1109/imns67862.2026.11655305
RS-CoT: enhancing remote sensing vision-language models with self-consistency sampling
Feng, K., Feng, Y., Zhang, W., Chen, Y., Duan, G., Xiong, X., Qiang, B., & Zhou, M. (2026) · Multimedia Systems · doi:10.1007/s00530-026-02606-1
Karunanayaka, I. P. (2026) · AI and Ethics · doi:10.1007/s43681-026-01325-7
Boundary-aware tool routing framework for large language models in vertical domains scenarios
Zhang, H., Shi, X., Chen, H., Zhao, X., & Ge, S. (2026) · Multimedia Systems · doi:10.1007/s00530-026-02625-y
From perception to governance: Knowledge-enhanced intelligence for smart sustainable buildings
Liu, S., Xie, H., Lei, Y., Zhao, J., Liu, J., Song, G., Zhang, L., Yang, W., Song, X., & Zhang, H. (2026) · Energy and Buildings · doi:10.1016/j.enbuild.2026.118128
Resume Bullet Point Enhancement: A Multi-Model Fine-Tuning Comparative Study
Gupta, V., Kale, S. S., Nidadavolu, N. S., Austin, T. H., Saxena, N., & Andreopoulos, W. (2026) · IEEE International Conference on Big Data Computing Service and Applications (BigDataService) · doi:10.1109/bigdataservice70481.2026.00014
Mitigating Goodhart’s law in epitope-conditioned TCR generation using plug-and-play reward designs
Zhang, P., He, X., Guan, F., Mei, H., Grama, G., Bang, S., & Lee, H. (2026) · Bioinformatics · doi:10.1093/bioinformatics/btag499
You, E., & Oh, S. (2026) · IEEE International Conference on Big Data Computing Service and Applications (BigDataService) · doi:10.1109/bigdataservice70481.2026.00019
ReclaimRL: Efficient Tail-Batched RL Rollout via Waste Reduction and Rebalancing
Wang, Y., Huang, W., Li, Y., Hu, Y., & Zhao, L. (2026) · IEEE International Conference on Joint Cloud Computing (JCC) · doi:10.1109/jcc72984.2026.00073
Auditable LLM Safety-Judge Selection via Confidence-Interval Filtering on Unsafe Recall
Yang, J., Yi, J., Li, J., & Ma, S. (2026) · IEEE Access · doi:10.1109/access.2026.3726251
Srivastava, P. (2026) · IEEE International Conference on Big Data and Artificial Intelligence (BDAI) · doi:10.1109/bdai70753.2026.11655132
Su, P., Luo, H., Wang, Y., & Shang, F. (2026) · International Conference on Communication Engineering and Technology (ICCET) · doi:10.1109/iccet70051.2026.11659037
Faithful open-domain QA via prompt-based multi-source knowledge fusion
Zhang, Y., Chen, Y., Zheng, D., Tu, Y., & Wenju, Q. (2026) · Journal of Intelligent Information Systems · doi:10.1007/s10844-026-01084-1
Provably Efficient Risk-Sensitive Reinforcement Learning with Human Feedback
Ni, X., & Lai, L. (2026) · IEEE International Symposium on Information Theory (ISIT) · doi:10.1109/isit62367.2026.11653812
Szappan, A., & Krutilla, Z. (2026) · IEEE International Conference on Intelligent Engineering Systems (INES) · doi:10.1109/ines69513.2026.11661120
Metadata
- Authors
- Ouyang, L., Wu, J., Jiang, X., Almeida, D., Wainwright, C., Mishkin, P., Zhang, C., Agarwal, S., Slama, K., Ray, A., Schulman, J., Hilton, J., Kelton, F., Miller, L., Simens, M., Askell, A., Welinder, P., Christiano, P., Leike, J., & Lowe, R.
- Venue
- Advances in Neural Information Processing Systems 35
- Published
- 2022
- Pages
- 27730-27744
- ISSN
- 1049-5258 (ISSN-L)
- OpenAlex
- W7133211372
- Cited by
- 3,117
- References
- 0
- Citations by year
- 2026: 1421 · 2025: 544 · 2024: 852 · 2023: 297 · 2022: 3
- FWCI
- 234.27
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- neural information processing systems (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Keywords
- instruction following, language models, human feedback, reinforcement learning from human feedback, large language models
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.