Training Language Models to Follow Instructions with Human Feedback
The DOI matches its Crossref record; 2 of the 2 references it cites were found in a registry or an index.
Abstract
Making language models bigger does not inherently make them better at following a user's intent. For example, large language models can generate outputs that are untruthful, toxic, or simply not helpful to the user. In other words, these models are not aligned with their users. In this paper, we show an avenue for aligning language models with user intent on a wide range of tasks by fine-tuning with human feedback. Starting with a set of labeler-written prompts and prompts submitted through the OpenAI API, we collect a dataset of labeler demonstrations of the desired model behavior, which we use to fine-tune GPT-3 using supervised learning. We then collect a dataset of rankings of model outputs, which we use to further fine-tune this supervised model using reinforcement learning from human feedback. We call the resulting models InstructGPT. In human evaluations on our prompt distribution, outputs from the 1.3B parameter InstructGPT model are preferred to outputs from the 175B GPT-3, despite having 100x fewer parameters. Moreover, InstructGPT models show improvements in truthfulness and reductions in toxic output generation while having minimal performance regressions on public NLP datasets. Even though InstructGPT still makes simple mistakes, our results show that fine-tuning with human feedback is a promising direction for aligning language models with human intent.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Existing literature (Ouyang et al., 2022) does not fully describe the details of these models, such as the pretraining corpus, model sizes, and model biases.”
From Self-Refine: Iterative Refinement with Self-Feedback (2023) · cites this paper as Ouyang et al., 2022
Experimental — accuracy not yet measuredIn the citing paper
“Specifically, providers mitigate race and gender bias through reinforcement learning from human feedback (RLHF), adversarial stress-testing known as red teaming, and hard-coded refusals governed by the provider's own content policies [6, 43, 71].”
From All Public Voices Are Equal, But Are Some More Equal Than Others to LLMs? (2026) · cites this paper as [71]
In the citing paper
“Fine-tuning a model from human feedback at scale, using preference data from paid raters or drawn from a large and willing user base, is an especially potent technique.It has the potential not only to shape a model's responses to better reflect user norms (for better or worse), but also to filter out toxic language, improve factual accuracy, and mitigate the tendency to fabricate information.”
From Talking about Large Language Models (2024) · cites this paper as [26]
In the citing paper
“These include general competencies such as in-context learning (ICL) [13], chain-of-thought (CoT) [17] reasoning, and instruction following [25], as well as task-specialized skills like mathematical reasoning [30].”
From A Survey of Large Language Models (2026) · cites this paper as [25]
In the citing paper
“When external reward models or ground-truth answers are available, rejection sampling can also be applied to select higher-quality responses from multiple candidates [25].”
From A Survey of Large Language Models (2026) · cites this paper as [25]
41 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
The publisher hasn’t deposited this paper’s reference list.
Cited by
Items 3,901–4,000 of 4,340
Make context easier: enhancing fine-tuned NER models via LLM-based text rewriting
Guo, X., Yu, F., Liu, J., & Lu, W. P. (2026) · The Electronic Library · doi:10.1108/el-10-2025-0425
Ghojogh, B., & Ghodsi, A. (2026) · Springer eBooks · doi:10.1007/978-3-032-10738-1_1
Chen, D., Gong, Y., Chen, J., & He, R. (2026) · Energy and Buildings · doi:10.1016/j.enbuild.2026.117578 · Cited by 3
A comprehensive survey of pretrained models for autonomous driving: Methods and applications
Hu, R., Yin, Z., Nie, L., Zhou, Y., & Guo, H. (2026) · Information Fusion · doi:10.1016/j.inffus.2026.104457
Understanding Annotator Safety Policy with Interpretability
Oesterling, A., Ren, D., Assogba, Y., Moritz, D., Kim, S. S. Y., Gatys, L. A., & Hohman, F. (2026) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3805689.3806472
Jung, Y., Mun, S., & Jeong, G. (2026) · Behaviour and Information Technology · doi:10.1080/0144929x.2026.2662407
Activation Differences Reveal Backdoors: A Comparison of SAE Architectures
Kumar, S. (2026) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn69854.2026.11728532
Efficient Data Selection for Multimodal Models via Incremental Optimization Utility
Jing, J., ZhAO, Q., Huang, C., & Su, Z. (2026) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3767308.3836581
Active perception: Gaze-guided thinking for chart understanding
Huang, X., Yuanyuan, H., Wang, Y., Meng, Z., Li, H., Weng, Z., Wang, J., Shen, Y., Yan, H., Tan, K., et al. (2026) · Neurocomputing · doi:10.1016/j.neucom.2026.133935
HAM-VAE: A hierarchical adaptive modulation VAE for data augmentation in fake review detection
Chen, J., Zhang, T., Yan, Z., Zheng, Z., & Zhang, W. (2026) · Knowledge-Based Systems · doi:10.1016/j.knosys.2026.116225
Zheng, X., Chen, T. X., & Zhang, W. (2026) · International Journal of Cognitive Computing in Engineering · doi:10.1016/j.ijcce.2026.05.001
Wang, Q., Li, J., & Xu, Y. (2026) · Computer Networks · doi:10.1016/j.comnet.2026.112390
Human-AI Co-Creation: A New Interaction Paradigm for Human-AI Interaction
Davis, N., Clemens, M. P., Rezwana, J., & Browne, E. (2026) · Springer eBooks · doi:10.1007/978-981-95-3658-0_76 · Cited by 4
Empowering Hybrid RAG Models with Knowledge Graphs for Enhanced Precision and Reliability
Gupta, V., Jain, M., & Yadav, M. (2026) · Lecture notes in networks and systems · doi:10.1007/978-3-032-18910-3_25
LLM-SocRec: Enhancing Graph-based Social Recommendation via Collaborative Large Language Models
Li, Z., Tan, Z., Li, W., & Mo, T. (2026) · Machine Learning · doi:10.1007/s10994-026-07063-5 · Cited by 1
Dynamic Normativity: Learning Human Preferences
Corrêa, N. K. (2026) · The International library of ethics, law and technology · doi:10.1007/978-3-032-22150-6_5
Wang, D., Fang, Z., & Zhao, X. (2026) · Pattern Analysis and Applications · doi:10.1007/s10044-026-01663-6
ADS: Adaptive Dataset Selection for Fine-Tuning in Anomalous Text
Zhao, X., Wu, J., & Wang, L. (2026) · Computers, materials & continua/Computers, materials & continua (Print) · doi:10.32604/cmc.2026.077179
Self-citationMitigating Security Risks in Large Language Models: A Full Lifecycle Perspective
Wang, Y. K., Bai, Z., Huo, J., Wang, B., Liu, J., Cao, H., Meng, F., Yang, X., & Gao, Y. (2026) · Machine Learning · doi:10.1007/s10994-025-06930-x
Daley, N., Griswold, A., Moreno, L., Floyd, A., Duong, D., Solomon, B. D., & Waikel, R. L. (2026) · Journal of Genetic Counseling · doi:10.1002/jgc4.70296
Comparison of Text-Based Inputs for Human-in-the-Loop Feedback in Vision-Language Models
Shahriari, R., Hashky, A., Arya, S., Audino, T., Ragan, E. D., Gogate, V., & Ruiz, J. (2026) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/3816700
A hybrid intelligence approach for assessing packaging sustainability claims in e-commerce
Lorkiewicz, W. A., & Wasilewski, A. (2026) · Applied Soft Computing · doi:10.1016/j.asoc.2026.115504
RAG-Augmented LLMs for Penetration Testing: A benchmarking study of open-source LLM models
Fadhel, O. B., Fernandes, R., Ribeiro, Ó. R., Najjar, M., & Lopes, N. (2026) · Intelligent Systems with Applications · doi:10.1016/j.iswa.2026.200681
Vu, T., Nguyen, L., & Dao, Q. (2026) · IEEE Access · doi:10.1109/access.2026.3698020
Self-Prompt: Gradient-guided discrete prompt optimization for code generation
zhu, L., Zong, W., Tong, Y. P., Chen, G., Mou, X., Lu, X., & Xu, Y. (2026) · Neurocomputing · doi:10.1016/j.neucom.2026.134963
Budha, K., & Lagun, N. (2026) · Research Square · doi:10.21203/rs.3.rs-9882260/v1
Multilingual clickbait detection with BERT: An empirical evaluation of training strategies
Liebeskind, C., Lewandowska‐Tomaszczyk, B., & Vanetik, N. (2026) · Array · doi:10.1016/j.array.2026.100956
Improving Selective Classification with Pairwise Queries for Binary Classification
Vardhan, H., Choudhary, S., Modani, N., & Mazumdar, A. (2026) · Machine Learning · doi:10.1007/s10994-026-07078-y · Cited by 1
DDOR: Delta Debugging for Explainable Overrefusal Testing and Repair
Zhou, Q., (3762457), P. Z., Sun, J., Zhang, H., & Wang, D. (2026) · Proceedings of the ACM on software engineering. · doi:10.1145/3832109
Onboard Voice-to-Mission UAV Autonomy With Language-Conditioned Navigation and Semantic Perception
Xie, J., Dutta, A., Sun, P., & Singh, N. (2026) · AIAA AVIATION Forum · doi:10.2514/6.2026-4206
DARE: An Explainable AI-Visualization Framework for Ill-Defined Decision Making
Chatzimparmpas, A., & Dimara, E. (2026) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2026.3701110
Qian, B., Wu, Y., Zeng, S., Wang, Z., & 王乔晨 (2026) · Lecture notes in computer science · doi:10.1007/978-981-92-1300-9_45
Lihua, F. U., & ZHANG, L. (2026) · Progress in Disaster Science · doi:10.1016/j.pdisas.2026.100616
Tran, T. T. P., Vũ, T. H., Nguyen, V. V., & Nguyen, P. T. (2026) · IEEE Access · doi:10.1109/access.2026.3701952
Cross-Modal Spatial--Temporal--Semantic Adaptive Network for Coal--Rock Cutting Event Localization
Xu, Q., Wu, Y. N., Zhang, H., Zhengyang, Z., & Wang, Z. (2026) · IEEE Sensors Journal · doi:10.1109/jsen.2026.3699979
Ibrahum, A. D. M., & Hong, J. (2026) · IEEE Access · doi:10.1109/access.2026.3701884
Wang, Y., Zou, C., Mengruo, G., He, L. K., Lu, X., Gui, X., Xu, Z., Lin, K., Jin, H., Yao, M., et al. (2026) · Chinese general practice journal. · doi:10.1016/j.cgpj.2026.100111
A Unified Structured Query Understanding Framework for Industrial Semantic Search
Liu, P., Shen, Q., Shen, J., Yao, C., Kao, K., Arora, R., Xu, D., Zheng, B., Ren, Y., Le, B. H., et al. (2026) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3770855.3818312
Self-citationUllah, M. F., Khan, M. U., Saeed, A., Khan, S. U., Ishtiaq, M., Rezwan, H. E., & Kong, W. (2026) · Information and Software Technology · doi:10.1016/j.infsof.2026.108228
Digital phenotyping with large language models to detect depressive state changes in patients
Yuan, Y., Gao, Y., Moen, H., Isometsä, E. T., Marttinen, P., & Aledavood, T. (2026) · npj Digital Medicine · doi:10.1038/s41746-026-02883-0 · Cited by 2
Ding, C., Xue, W., 樊宪跃, Lin, Y., Chen, T., Xu, R., Xu, Y., Wu, S., & Wu, D. O. (2026) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2026.3703338
RoTRAG: Rule of Thumb Reasoning for Conversation Harm Detection with Retrieval-Augmented Generation
Lee, J., Seo, W., Koh, J., Lee, S., Chen, H., & Bu, Y. (2026) · ACM SIGIR International Conference on Theory of Information Retrieval (ICTIR) · doi:10.1145/3805713.3820397
Mutual supervision: A framework for improving reward model in preference alignment
Peng, Z., Zhang, M., Wen, G., Zhang, Q., & Chen, C. (2026) · Knowledge-Based Systems · doi:10.1016/j.knosys.2026.116467
The Rise of Generative AI in Finance: A Survey of Techniques and Studies
Feng, S., Tan, Y. L., Ren, J. S. J., Yeo, E. X. Y., Ong, R., Xie, M., & Wang, J. (2026) · Memetic Computing · doi:10.1007/s12293-026-00513-6
Jeong, H. Y., Seo, D. H., Lee, S. H., Kim, S. Y., & Kwon, J.-W. (2026) · IEEE Access · doi:10.1109/access.2026.3704947
Large language model based expert assistant for workflow consistent NPR-DDA analysis
Chen, G., Wang, X. H., & He, M. (2026) · Intelligent geoengineering. · doi:10.1016/j.ige.2026.06.010
Enhancing Robustness of Reward Models via Hidden Equilibrium Balancing in Large Language Models
Alaoui, M. C., Joudar, N., & Ettaouil, M. (2026) · IEEE Access · doi:10.1109/access.2026.3706180
DivRL: Disentangled Self-similarity Rewards for Diverse Subject-Driven Generation
Wang, Q., Li, Z., Eldesokey, A., & Wonka, P. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37467-7_35
Domain-invariant classification of AI-generated text via context-aware Function Word analysis
Wakasa, H., & Jin’no, K. (2026) · Nonlinear Theory and Its Applications IEICE · doi:10.1587/nolta.17.912
Rashid, Z., Butt, U. M., & Letchmunan, S. (2026) · IEEE Access · doi:10.1109/access.2026.3709673
Narula, H. D. S. (2026) · Remote Sensing · doi:10.3390/rs18132147
On the Time Efficiency of Code Generated and Optimized by Large Language Models
Peng, Y., Wan, J., Ren, X., Menzies, T., & Lyu, M. R.-T. (2026) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2026.3709872
Haakkim: An Arena-Style Platform for Human Preference Evaluation of LLMs in Arabic and Its Dialects
Mars, M., Barmandah, H., & Alassaf, A. (2026) · IEEE Access · doi:10.1109/access.2026.3710665
Wang, S., & Weber, R. (2026) · Automation in Construction · doi:10.1016/j.autcon.2026.107322
Reward Lightning: Fast Video Generation via Homologous Preference Distillation
Cheng, J., Ma, B. Y., Ren, X., Yu, K., Zhang, P., Zheng, T., & Lu, Q. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-36987-1_8 · Cited by 2
Cognitive parsing network for action quality assessment
Li, J., Tian, Y., Huang, K., Jin, Y., & Huang, Z. (2026) · Neurocomputing · doi:10.2139/ssrn.7077838
Empowering Job Recommendation with Large Language Models: A Generative and Attentive Approach
Jian, L., Rao, C. R., Dai, J., & Gu, X. Q. (2026) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3828655 · Cited by 1
Riyantoko, P. A., Funabiki, N., Brata, K. C., Noprianto, N., Tyas, S. W., & Prasetya, D. A. (2026) · Mathematics · doi:10.3390/math14142481
Future Audit Labs: Deep Reinforcement Learning for Research-Education-Industry Fusion
Zhou, J. (2026) · Journal of Emerging Technologies in Accounting · doi:10.2308/jeta-2025-017
A sociological-theoretical description of the bio-psycho-social background factors of health
Dombrádi, K., & Székely, A. (2026) · Belvedere Meridionale · doi:10.14232/belv.2026.1.12
Ali, M. A., & Dornaika, F. (2026) · Big Data and Cognitive Computing · doi:10.3390/bdcc10070235
Bratoev, I., Orujlu, O. F., Xu, Z., Erkoç, Z., Nießner, M., Holst, C., & Petzold, F. (2026) · Buildings · doi:10.3390/buildings16142791
VisCo: Leveraging Large Language Models as Intrinsic Encoders for Visual Token Compression
Zheng, Y., Zou, K., Liu, B., & Yu, N. (2026) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3767308.3835856
Far, S. B., Qazani, M. R. C., Hamod, F. Y. H., & Rad, A. I. (2026) · Engineering Reports · doi:10.1002/eng2.70941
Template-to-Text: Hierarchical Structure-Aware Retrieval for Controllable Document Generation
Wang, Y., Tan, Y., Song, M., & Hao, Y. (2026) · IEEE Access · doi:10.1109/access.2026.3713477
Yang, Y., Huang, H., Li, J. F., Sun, H., & Gao, Y. (2026) · ACM Transactions on Information Systems · doi:10.1145/3831687
Okike, U. J.-B., Eche, A., Amaechi, C. V., Hewage, P., Garg, A., & Houten, A. (2026) · Discover Artificial Intelligence · doi:10.1007/s44163-026-01775-2
Trustworthy Data- and ML-Ops for Intelligent Transportation Systems and Logistics
Ciná, A. E., Scodeller, G., Pasquale, C. C., Siri, S., Anguita, D., Roli, F., Sacone, S., & Oneto, L. (2026) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2026.3711756
Chung, Y., Seol, K., & Paik, W. (2026) · IEEE Access · doi:10.1109/access.2026.3714824
Tran, Q.-D. L., & Nguyen, H. T. (2026) · IEEE Access · doi:10.1109/access.2026.3715578
Yen, F.-Y., Liu, Y., & Fang, Q. (2026) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.64898/2026.07.20.738933
Terms of entanglement: Artificial mirroring and the governance of synthetic intimacy
Haskell, C. (2026) · Journal of Responsible Technology · doi:10.1016/j.jrt.2026.100182
Su, Y., & Wang, P. (2026) · IEEE Access · doi:10.1109/access.2026.3716267
GhostPrompt: Cross-Image Adversarial Prompt for Vision-Language Models
Zeng, L., Ye, Z., Xie, M., Zhang, H., Wang, X., Li, Y., & Li, Z. (2026) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3767308.3835361 · Cited by 3
A Metric-Aware Analysis of Trigger-Guided Adapter Training for Hallucination Mitigation
Zhang, J., & Noh, G. (2026) · IEEE Access · doi:10.1109/access.2026.3716949
Kaur, R., Ginige, J. A., & Obst, O. (2026) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-026-03631-w
Nguyen, V.-V., Nguyen, H.-K., Nguyen, K.-S., Luong, T. M.-H., Bui, A.-T., Vu, D.-Q., & Nguyen, T.-V. (2026) · Discover Artificial Intelligence · doi:10.1007/s44163-026-01846-4
From Clicks to Journeys: Empowering Advertising Text Generation With Social Simulator Guidance
Xie, Y., Wang, L., Nie, W., Li, W., Jin, G., & Liu, A.-A. (2026) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2026.3717481
Yin, Z., Zhang, J., Wang, J., Liang, J., Wu, X., & Dai, J. (2026) · Electronics · doi:10.3390/electronics15153274
Bjarsch, T., Holland, M., Drechsler, K., & Schilp, J. (2026) · Advanced Engineering Materials · doi:10.1002/adem.202503152
Scenario-driven control of real-time LLM agents
Borozan, L., & Matijević, D. (2026) · doi:10.1109/miprorobotics70521.2026.11761839
Beyond Epistemia: Epistemic Schizologia and Large Language Models as Techno-Semiotic MachinesPreprint
Cabitza, F., & Colombo, G. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2607.25620
RefineSVG: Visual Feedback-Driven Reinforcement Learning for Image-to-SVG Generation
Liu, S., Mao, F., Zhou, S., Tan, W., Lu, Z., Zhan, Y., & Liang, Z. (2026) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3767308.3836570 · Cited by 1
Fu, Y., Zhou, Z., Huang, C., Wang, J., Zeng, B., Dongke, H., Wang, X., Hong, W., & Fan, J. (2026) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3770854.3783937
Zhang, K., Bao, Y., Wang, J., Yang, J., Gu, N., & Liu, L. (2026) · Scientific Reports · doi:10.1038/s41598-026-64753-9
DCRS: Attention-Guided Dual-Channel Reasoning Segmentation for Industrial Anomaly Detection
Jin, R., zeng, J., Li, H., Bai, Z., Lin, H., & Yang, L. (2026) · Information Fusion · doi:10.2139/ssrn.7227212
PhDGPT: Measuring bias in academic mental health across quantised and uncensored LLMs
Duro, E. S. D., Taietta, E., D’Alfonso, S., Bentenuto, A., Rossetti, G., & Stella, M. (2026) · Information Processing & Management · doi:10.1016/j.ipm.2026.105173
Zhu, D., Shen, P., & Shen, S. (2026) · Memetic Computing · doi:10.21203/rs.3.rs-10492304/v1
Yuchen, Z. (2026) · Research Square · doi:10.21203/rs.3.rs-10594989/v1
Breaking Customized LLMs for Coding: Automated Red Teaming for Instruction Backdoor Attacks
Chen, Y., Cheng, W., Xiao, Y., Sun, W., Fang, C., Liu, Y., Chen, Z., & Xu, B. (2026) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1145/3832783.3834424
Epistemic norms for AI safety and alignment research
Navaie, K. (2026) · Artificial Intelligence Review · doi:10.1007/s10462-026-11666-8
Zamanifard, S., Goudarzi, S., Soleimani, M., & Robb, A. C. (2026) · Discover Education · doi:10.1007/s44217-026-01991-z
Multi-Agent Reinforcement Learning via Agent-Specific Preference
Mu, N., Luan, Y., Yang, Y., & Jia, Q. (2026) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2026.3722633
Progressive Alignment of Recommender Foundation Model through Multi-Phase Post-Training
최오성, Kim, H., Lee, J., Kang, B., & Jang, T. (2026) · ACM Conference on Recommender Systems (RecSys) · doi:10.1145/3773078.3831870
An Analytical Framework for the Evolution of Large Language Models: From Reasoning to LLM-as-a-Judge
Obeidat, M. (2026) · Academic Journal of Research and Scientific Publishing · doi:10.52132/ajrsp.e.2026.88.1
Ghanem, M. C. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7246621
Token-Level Credit Assignment Optimization for Generative Document Retrieval
Zhao, X., Liu, Y., Chen, R., Ma, X., Shi, D., Ren, P., Chen, Z., Ren, Z., & Xin, X. (2026) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3799682.3840833
Position: The Alignment Community is Unintentionally Building a Censor's ToolkitPreprint
Ball, S., & Hackemann, P. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2608.12346 · Cited by 1
Metadata
- Authors
- Ouyang, L., Wu, J., Jiang, X., Almeida, D., Wainwright, C., Mishkin, P., Zhang, C., Agarwal, S., Slama, K., Ray, A., Schulman, J., Hilton, J., Kelton, F., Miller, L., Simens, M., Askell, A., Welinder, P., Christiano, P., Leike, J., & Lowe, R.
- Venue
- Advances in Neural Information Processing Systems 35
- Published
- 2022
- Pages
- 27730-27744
- ISSN
- 1049-5258 (ISSN-L)
- OpenAlex
- W7133211372
- Cited by
- 3,117
- References
- 0
- Citations by year
- 2026: 1421 · 2025: 544 · 2024: 852 · 2023: 297 · 2022: 3
- FWCI
- 234.27
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- neural information processing systems (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Keywords
- instruction following, language models, human feedback, reinforcement learning from human feedback, large language models
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.