Training Language Models to Follow Instructions with Human Feedback
The DOI matches its Crossref record; 2 of the 2 references it cites were found in a registry or an index.
Abstract
Making language models bigger does not inherently make them better at following a user's intent. For example, large language models can generate outputs that are untruthful, toxic, or simply not helpful to the user. In other words, these models are not aligned with their users. In this paper, we show an avenue for aligning language models with user intent on a wide range of tasks by fine-tuning with human feedback. Starting with a set of labeler-written prompts and prompts submitted through the OpenAI API, we collect a dataset of labeler demonstrations of the desired model behavior, which we use to fine-tune GPT-3 using supervised learning. We then collect a dataset of rankings of model outputs, which we use to further fine-tune this supervised model using reinforcement learning from human feedback. We call the resulting models InstructGPT. In human evaluations on our prompt distribution, outputs from the 1.3B parameter InstructGPT model are preferred to outputs from the 175B GPT-3, despite having 100x fewer parameters. Moreover, InstructGPT models show improvements in truthfulness and reductions in toxic output generation while having minimal performance regressions on public NLP datasets. Even though InstructGPT still makes simple mistakes, our results show that fine-tuning with human feedback is a promising direction for aligning language models with human intent.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Existing literature (Ouyang et al., 2022) does not fully describe the details of these models, such as the pretraining corpus, model sizes, and model biases.”
From Self-Refine: Iterative Refinement with Self-Feedback (2023) · cites this paper as Ouyang et al., 2022
Experimental — accuracy not yet measuredIn the citing paper
“Specifically, providers mitigate race and gender bias through reinforcement learning from human feedback (RLHF), adversarial stress-testing known as red teaming, and hard-coded refusals governed by the provider's own content policies [6, 43, 71].”
From All Public Voices Are Equal, But Are Some More Equal Than Others to LLMs? (2026) · cites this paper as [71]
In the citing paper
“Fine-tuning a model from human feedback at scale, using preference data from paid raters or drawn from a large and willing user base, is an especially potent technique.It has the potential not only to shape a model's responses to better reflect user norms (for better or worse), but also to filter out toxic language, improve factual accuracy, and mitigate the tendency to fabricate information.”
From Talking about Large Language Models (2024) · cites this paper as [26]
In the citing paper
“These include general competencies such as in-context learning (ICL) [13], chain-of-thought (CoT) [17] reasoning, and instruction following [25], as well as task-specialized skills like mathematical reasoning [30].”
From A Survey of Large Language Models (2026) · cites this paper as [25]
In the citing paper
“When external reward models or ground-truth answers are available, rejection sampling can also be applied to select higher-quality responses from multiple candidates [25].”
From A Survey of Large Language Models (2026) · cites this paper as [25]
41 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
The publisher hasn’t deposited this paper’s reference list.
Cited by
Items 2,901–3,000 of 4,340
VideoEvent: Hierarchical and adaptive event modelling for complex video understanding
Zhang, F., Sun, X., Zhao, J., & Shang, Y. (2026) · Knowledge-Based Systems · doi:10.1016/j.knosys.2026.116502
CGS-RAG:Community-Aggregated Graph Semantic Retrieval-Augmented GenerationPreprint
Ji, S., Zhang, X., Huang, Y., & Li, D. J. (2026) · Research Square · doi:10.21203/rs.3.rs-9748268/v1
Beyond textual rationales: Anatomy-grounded chain-of-thought for traceable radiology reasoning
Wang, S., Wu, K., Yang, J., Xu, M., Xiong, M., Fang, W., Liu, M., Deng, H., He, B., Li, G., et al. (2026) · Knowledge-Based Systems · doi:10.1016/j.knosys.2026.116475 · Cited by 1
Rethinking the Phenomenon of Deceptive Value Alignment with Technological Logic
Yan, H., & Li, Y. (2026) · Philosophy of engineering and technology · doi:10.1007/978-981-95-8023-1_20 · Cited by 1
Influence-Aware Bayesian-Inspired Token Reweighting for Improved Code Generation
Zhu, Y., Li, G., Mei, H., Jin, Z. G., Li, J., Zheng, Q., & Zhang, J. (2026) · Proceedings of the ACM on software engineering. · doi:10.1145/3808200
Wang, G., & Cao, Y. (2026) · Philosophy of engineering and technology · doi:10.1007/978-981-95-8023-1_5 · Cited by 1
Akinwumi, P. O., Qian, M., Babatope, O. A., Ogunleye, R. O., & Olorunsogbon, T. A. (2026) · Research Square · doi:10.21203/rs.3.rs-9885996/v1
Xie, Y., Tang, F., Zhu, Y., Li, M., & Yao, F. (2026) · Big Data and Cognitive Computing · doi:10.3390/bdcc10070213
Unveiling AI-Driven Web Applications: Insights into Characteristics, Functionality, and Compliance
Wan, L., Liu, Z., Yan, C., Wan, L., Dong, N., Huang, Z. H., & Bai, G. (2026) · Proceedings of the ACM on software engineering. · doi:10.1145/3808168
FEFT: A Feedback-Enhanced Evaluation Fine-Tuning Framework for Financial Report Summarization
Gao, F., He, A. Y., Zhang, N., & Gu, J. (2026) · Communications in computer and information science · doi:10.1007/978-981-95-8525-0_11
Barut, E. (2026) · Uluslararası Dil Edebiyat ve Kültür Araştırmaları Dergisi · doi:10.37999/udekad.1934778
Multi-granularity Hierarchical RAG for Welding Parameter Recommendation
He, X., Li, Y., Zhang, S., Wang, M., Cheng, Q., & Leng, L. (2026) · Communications in computer and information science · doi:10.1007/978-981-95-8525-0_5
Wang, P., Chen, H., Oswald, F. L., & Sun, T. (2026) · Assessment · doi:10.1177/10731911261455483
The Darwinian Mind of the Machine: Rethinking LLM Training as Evolution
van Oostendorp, M., & D’Alessandro, R. (2026) · Nordlyd · doi:10.7557/12.8313
Five Educational-Psychology Lenses for Training and Evaluating AI Models
Wang, P., & PAAS, F. G. W. C. (2026) · Educational Psychology Review · doi:10.1007/s10648-026-10195-8
Validating LLM-Generated SQL Queries through Metamorphic Prompting
Lin, L. G., Zhu, Q., Hong, J., Wang, C., Liu, Y., & Wu, R. (2026) · Proceedings of the ACM on software engineering. · doi:10.1145/3797146 · Cited by 1
Red Teaming LLMs via Linguistic-Aware Fuzzing
Yuan, S., Luo, N., Sun, J., Huang, Y., & Zhang, C. (2026) · Proceedings of the ACM on software engineering. · doi:10.1145/3808204 · Cited by 2
Self-citationGao, F., Sun, Y., Li, Y., & Gu, J. (2026) · Communications in computer and information science · doi:10.1007/978-981-95-8525-0_10
InDe-LLM: Defending against Jailbreak Attacks in LLM-Powered Systems via Intention Disentangling
Wang, Y., Zhang, Q., Zhou, C., Go, G., Shi, D., & Jiang, Y. (2026) · Proceedings of the ACM on software engineering. · doi:10.1145/3797136
Li, C., & Yang, L. (2026) · Electronics · doi:10.3390/electronics15132863
URLcoat: Exploiting Web Search Capability to Jailbreak Large Language Models
Sun, Y., Du, L., Su, Z., Wang, Y., & Liu, H. (2026) · IEEE Symposium on Security and Privacy (S&P) · doi:10.1109/sp63933.2026.00082
Sun, B., Wang, X., Gao, M., Du, Y., & Dong, S. (2026) · Egyptian Informatics Journal · doi:10.1016/j.eij.2026.101025
Deep learning-assisted structural color inverse design: a perspective
Ma, T., & Guo, L. J. (2026) · Chemical Science · doi:10.1039/d6sc01773h
Liu, E., Zhang, R., Zhang, J., & Cheng, X. (2026) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2026.3709067
白明和, Chen, W., Li, S., & Zhu, J. (2026) · IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER) · doi:10.1109/saner67736.2026.00072
Hamazaki, K., & Tsuda, K. (2026) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.64898/2026.06.28.735149
Information-Regularized Attention for Visual-Centric Reasoning
Sun, G. X., Wang, X., Patel, Y., Liu, M. Y., Tao, Z., & Krishnan, P. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37321-2_30
PAPA: Online Personalized Active Preference Alignment
Sarkar, A., Nafi, N. M., Lyngaas, I., Meena, M., & Vorobeychik, Y. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37670-1_38
Progressive knowledge-enhanced instruction generation for tactical UAV swarms
Tan, C., Li, B., Wei, Z., Ma, G., Zhu, W., & Zhang, B. (2026) · Defence Technology · doi:10.1016/j.dt.2026.06.004
Quantifying the Affective Gap: A Zero-Shot Evaluation of LLMs on Fine-Grained Emotion Taxonomies
Obiuwevwi, L., Rechowicz, K., Johnson, J. M., Ashok, V., Shetty, S., & Jayarathna, S. (2026) · IEEE International Conference on Information Reuse and Integration (IRI) · doi:10.1109/iri69576.2026.00016
CLPA: A Clustering-Based Low-Power Accelerator for Energy-Efficient Matrix Multiplication
Hu, X., Li, J., Liu, Y., Li, X., Lin, Y., Huang, H., Zhan, R., Cai, S., & Xiong, X. (2026) · IEEE Transactions on Very Large Scale Integration (VLSI) Systems · doi:10.1109/tvlsi.2026.3706620
Efficient Summarization with Small Language Models via Direct Preference Optimization
Tamer, Y., Badawi, A., & Bahgat, M. (2026) · ICEENG International Conference for Innovations in Intelligent Computing and Cybersecurity (IICC) · doi:10.1109/iicc69623.2026.11581993
Temporal Requirement Formalization Using Large Language Models
Hu, Z., Ma, W., Wang, Q., Jiang, L., & Li, D. (2026) · IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER) · doi:10.1109/saner67736.2026.00099
DUA: Automated Jailbreak via Dual-Use Ambiguity and Semantic-Operational Disentanglement
Ma, S., Liu, W. T., Xie, W., Wen, L., Wang, P., Chen, R., & Chen, S. (2026) · ICEENG International Conference for Innovations in Intelligent Computing and Cybersecurity (IICC) · doi:10.1109/iicc69623.2026.11582014
Santos, L. F. F. M. (2026) · Applied Sciences · doi:10.3390/app16136608
Large Language Models as Adaptive and Context-Aware Partners in Knowledge Creation
Bhardwaj, A. (2026) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-2600-2811-7.ch013
GMTW-Ro: a deterministic benchmark for evaluating large language models on grounded Romanian tasks
Bulzan, A.-Ş., Morariu, B., Joldea, A.-R., Cernăzanu-Glăvan, D., & Cernăzanu-Glăvan, C. (2026) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2026.1831918
Neural Quadrature Rule and Autoregressive Adaptive Sampling
Lu, H., Wu, L., Wang, Z., Li, T., & Ramamoorthi, R. (2026) · ACM Transactions on Graphics · doi:10.1145/3811318
Özmen, H. B., & Senel, F. A. (2026) · International Journal of Artificial Intelligence Tools · doi:10.1142/s021821302650017x
Shanid, M., Prasad, G., Bawgi, V., & Gowda, S. (2026) · IEEE International Conference on Emerging Synergy Science and Technology (ICESST) · doi:10.1109/icesst69086.2026.11582854
IndoTaPas: A TaPas-based model for Indonesian table question answering
Syazali, M. R., & Yulianti, E. (2026) · Expert Systems with Applications · doi:10.1016/j.eswa.2026.133535
Sunkeswaram, S., Naresh, R., & Reddy, L. C. S. (2026) · Smart innovation, systems and technologies · doi:10.1007/978-3-032-22114-8_29
Enhancing Jailbreak Defense with Diverse Perturbation Combinations
Wu, T., Gao, Q., & Yu, Z.-F. (2026) · International Conference on Machine Intelligence Theory and Applications (MiTA) · doi:10.1109/mita69365.2026.11582392
Wang, G., & Sun, Y. (2026) · International Conference on Computer Supported Cooperative Work in Design (CSCWD) · doi:10.1109/cscwd68734.2026.11582104
Bridging Auxiliary Constraints to Resolve Instruction Following in Large Reasoning Models
Zhao, Z., Zhang, S., Wang, H., Wang, Z., Zhao, Y., Zheng, Y., Li, B., He, Y., Wong, K., & Wu, X. (2026) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl.a.730
Ji, M., Chen, J. Y., Zhang, C. W., Fu, T., Zhang, T., & Bei, T. (2026) · International Conference on Computer Supported Cooperative Work in Design (CSCWD) · doi:10.1109/cscwd68734.2026.11581532
Self-citationTaxAgent-MA: A Multi-Agent framework for Auditable and Explainable Tax Recommendation Generation
Gao, Y., Cao, J., xie, Z., Wang, L., & Yang, W. Z. (2026) · International Conference on Computer Supported Cooperative Work in Design (CSCWD) · doi:10.1109/cscwd68734.2026.11582797
Human-in-the-Loop Framework for Hallucination Mitigation: A Controlled Comparison of GPT and LLaMA
Kai, J. N. J., Syahidi, A. A., & Kiong, K. B. (2026) · International Conference on Business and Industrial Research (ICBIR) · doi:10.1109/icbir69932.2026.11584794
759Chapter 30 Reinforcement Learning in the Next AI Revolution
Balasundaram, E., Sivarethinamohan, R., Николаевна, М. С., Morozyuk, Y. V., & Kuznetsova, E. S. (2026) · De Gruyter eBooks · doi:10.1515/9783111633909-030
Through the Looking Glass: A Dual Perspective on Weakly Supervised Few-Shot Segmentation
Ma, J., Xie, G.-S., Zhao, F., & Li, Z. (2026) · IEEE Transactions on Image Processing · doi:10.1109/tip.2026.3708050
Akyol, H. M. (2026) · AI and Ethics · doi:10.1007/s43681-026-01231-y
Tạ, B. H., Linh, T. T., Lê, H. O., GIANG, N. T. T., Tang, T., Tien, L. T. T., & Bui, T. N. A. (2026) · Research Square · doi:10.21203/rs.3.rs-10136391/v1
ORI : Ordinal-feedback for Refining and Instructing LLMs toward Alignment
Zhang, S., Zhang, B., Liu, Y., & Zhang, Y. X. (2026) · International Conference on Computer Supported Cooperative Work in Design (CSCWD) · doi:10.1109/cscwd68734.2026.11582773
RL-Shield: Endogenous Moving Target Defense against Jailbreak Attacks in LLMs
Zhang, B., Hu, T., He, W., Li, B., Ouyang, Q., Shao, C., Zhang, C., & Ma, H. (2026) · International Conference on Computer Supported Cooperative Work in Design (CSCWD) · doi:10.1109/cscwd68734.2026.11582731
Self-citationYao, Y., Zhou, K., & Liu, Y. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-30089-8_14
DeepSeek Under Attack: An Analysis of Jailbreak Attacks and Prompt-Level Defenses
Hayashi, V. T., Neto, M. P. P., Miers, C. C., Redígolo, F., Arakaki, R., & Junior, M. A. S. (2026) · IEEE Access · doi:10.1109/access.2026.3710427
Trust the Eye or the Crowd? Unveiling Conformity in Multimodal Large Language Models
Luo, H., Niu, Y., Liu, H., Sun, Y., Yang, Z., Chen, T., Liu, D., Miao, Y., 周景师, Zhang, H., et al. (2026) · International Conference on Computer Supported Cooperative Work in Design (CSCWD) · doi:10.1109/cscwd68734.2026.11582657
Gagana, K. G., Peddibhotla, C. P., Deepak, P. J., Pasha, F., & Agarwal, P. R. (2026) · Smart innovation, systems and technologies · doi:10.1007/978-3-032-18849-6_15
Zhang, Y., Liu, F., Xu, C., & Luo, M. (2026) · Mathematics · doi:10.3390/math14132437
IC-GCG: Jailbreaking Large Language Models via Intermediate Consistency Optimization
Ren, Z., Zhu, D., Hong, H., & Shao, J. (2026) · IEEE Internet of Things Journal · doi:10.1109/jiot.2026.3707160
How Models Say No: Localizing Safety Mechanisms in Mixture-of-Experts Models
Lanquillon, C., & Schacht, S. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-30860-3_6 · Cited by 1
Furtado, N. G., & Furtado, J. V. (2026) · Research Square · doi:10.21203/rs.3.rs-10255415/v1
AB-JB (Jailbreaking): A Budgeted Hybrid Pipeline for Dataset-Scale Red-Teaming of 7B Aligned LLMs
Ahmad, A., Naseer, M., & Ahmad, M. (2026) · International Conference on Computing, Mathematics and Engineering Technologies (iCoMET) · doi:10.1109/icomet69771.2026.11591723
Advancing image-to-text: MDE-net coupled with large language models for context-aware captioning
Yang, Y., Yu, D., & Chen, C. L. P. (2026) · Expert Systems with Applications · doi:10.1016/j.eswa.2026.133552
Luo, Z. (2026) · Language Resources and Evaluation · doi:10.1007/s10579-026-09933-9
QSVideo: Query-Conditioned Semantic Temporal Retrieval for Video Understanding
Ao, W., Wang, L., & Boddeti, V. N. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37490-5_9
Liu, W., & Peltz, G. (2026) · Advanced Science · doi:10.1002/advs.76484
A Review of Modern Requirement Prioritization: From NLP Pipelines to Agentic AI
Aftab, U., Amir, I., & Akhter, A. (2026) · International Journal of Innovations in Science and Technology · doi:10.33411/ijist/1774
Prediction-in-the-Loop: a decision-making paradigm endowing agents with foresight
Liu, Y., Yuan, M., Zhang, L., Zhou, Z., & Liu, L. (2026) · Scientia Sinica Informationis · doi:10.1360/ssi-2026-0130
MQRank: Multi-quality Ranking-Aware Distillation for Abstractive Summarization
Wang, X., Wei, L., Zhang, Z., & Yin, R. (2026) · Lecture notes in computer science · doi:10.1007/978-981-92-2480-7_6
Optimizing Content Moderation and User Engagement: Leveraging LLMs for Scalable Solutions
Rawal, C., Goel, S., & Yadav, R. K. (2026) · International Conference on AI, Data Science, Cyber Security and Smart Manufacturing for Sustainable Development (ICADCS) · doi:10.1109/icadcs70036.2026.11583130
MOD2SAD: enhancing malicious office document detection through semantic-aware deobfuscation
Leng, T., Liao, T., & Yuan, B. (2026) · Scientific Reports · doi:10.1038/s41598-026-60598-4
Latent Space Probing for Adult Content Detection in Video Generative Models
Khatri, A., & Prabhu, C. (2026) · International Conference on Dependable Systems and Networks workshops · doi:10.1109/dsn-w70714.2026.00039
Justifi: An AI-Powered Legal Research and Document Automation System
Ranjan, A., Dwivedi, D., Muraday, A., Goel, D., & Devi, D. (2026) · IEEE International Conference on Computing, Power and Communication Technologies (IC2PCT) · doi:10.1109/ic2pct68894.2026.11584368
Li, Y., Hu, J., Sang, W., Ma, L., Nie, D., Zhang, W., Yu, A., Su, Y., Huang, Q., & Zhou, Q. (2026) · International Conference on Dependable Systems & Networks/Proceedings · doi:10.1109/dsn69566.2026.00054
Guang, J. C. R., & Shah, N. (2026) · Procedia Computer Science · doi:10.1016/j.procs.2026.06.235
Adaptive Scale Networks: Stable Self-Optimizing AI Models
Sood, A., & Rana, A. (2026) · Procedia Computer Science · doi:10.1016/j.procs.2026.06.057
Bal, S., & Mandal, L. (2026) · Procedia Computer Science · doi:10.1016/j.procs.2026.05.073
Sood, A., Sewal, P., & Rana, A. (2026) · Procedia Computer Science · doi:10.1016/j.procs.2026.06.378
Yan, M. (2026) · Journal of big data and computing. · doi:10.62517/jbdc.202601216
Li, Y., Sun, Q., Xue, J., Javadov, A., Milling, M., Zhang, W., Kainz, B., & Schuller, B. W. (2026) · Frontiers in Digital Health · doi:10.3389/fdgth.2026.1803433
Junior, M. P. D. L., & Miura, J. B. M. (2026) · RCMOS - Revista Científica Multidisciplinar O Saber · doi:10.51473/rcmos.v1i1.2026.2625
Reasoning About Humor: It’s No Laughing Matter
Sung, I., & Hu, R. (2026) · Lecture notes in networks and systems · doi:10.1007/978-3-032-20897-2_13
StackingNet: Collective Inference Across Independent AI Foundation Models
Li, S., Liu, C., Wu, D., Zeng, Z., & Ding, L. (2026) · Advanced Science · doi:10.1002/advs.76488
Wang, L., Sheng, K., He, Z., Li, J., Qin, Y., Dai, H., Wang, X. F., Yang, J., Yan, Q., Liu, C., et al. (2026) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2026.3711284 · Cited by 3
Adaptive DoLA-Enhanced LVLM for Power Safety Violation Detection
Wen, T., Wang, Y., Tan, Y., Zhang, G., & Mo, W. (2026) · IEEE International Conference on Electrical Power Systems and Intelligent Control (EPSIC) · doi:10.1109/epsic70071.2026.11590211
Prompt Optimization for LLM Code Generation via Reinforcement Learning
Esfahani, A. M., Kahani, N., & Ajila, S. A. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-30699-9_3 · Cited by 1
Elahi, M. F., Ell, B., Nolano, G., & Cimiano, P. (2026) · Semantic Web · doi:10.1177/22104968261449852 · Cited by 1
Vo, D. P. T., Tran, T. T., & Semwal, T. (2026) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3805712.3809979
Prompt-Unknown Promotion Attacks against LLM-based Sequential Recommender Systems
Zhao, Y., Chen, T., Yu, J., Wang, Z., Cui, L., & Yin, H. (2026) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3805712.3809691
LLM-Enhanced Topical Trend Detection at Snapchat
Zhao, H., Li, J., Bhattacharya, A., Ni, C., Yeung, J., Ye, J., Yang, K., Malu, A., & Malik, M. (2026) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3805712.3808475
Reasoning for IR & IR for Reasoning
Hoveyda, M., Eustratiadis, P., de Vries, A. P., & de Rijke, M. (2026) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3805712.3808644
T-RLHF: Trustworthy Reinforcement Learning from Human Feedback for Decision-Centric NLP
Tripathi, K. K., & Tripathi, S. (2026) · International Conference on Computational Intelligence and Communication Networks (CICN) · doi:10.1109/cicn70047.2026.11594401
LLM Agents Factory: Retrieval of Domain-Specific LLM Agents
Belov, V., Sosedka, A., Sakhovskiy, A., Kovtun, E., Boyarskikh, A., & Budennyy, S. (2026) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3805712.3808515
RedGR: Unified Generative Retrieval for Recommendation in REDnote
Fang, M., Wang, H., Niu, X., Xu, D., Wang, H., Zhuang, T., Yang, P., & Hu, Y. (2026) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3805712.3808417
GLiNER-Reg: Generalized text regression using reference prompts
Suwannapichat, P., Changaival, B., Wu, C., & Bouvry, P. (2026) · International Joint Conference on Computer Science and Software Engineering · doi:10.1109/jcsse68839.2026.11596623
AI-Powered Study Assistant Using Retrieval-Augmented Generation (RAG).
Rajeshwari, S. P. R. A. R. (2026) · International Journal of Advanced Research in Science Communication and Technology · doi:10.48175/ijarsct-37642
Pan, J., Pan, X., & Pan, H. (2026) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2026.1818923
FactOWL: A Cost-Efficient Tool for Long-Form Factuality Evaluation
Sakhovskiy, A., Sushko, N., Marina, M., Konovalov, V., Tutubalina, E. V., Panchenko, A., & Braslavski, P. (2026) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3805712.3808373
Learning to Summarize for Search Relevance with Reinforcement Learning
Yadav, N., Kang, C., & Shang, H. (2026) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3805712.3808491
Metadata
- Authors
- Ouyang, L., Wu, J., Jiang, X., Almeida, D., Wainwright, C., Mishkin, P., Zhang, C., Agarwal, S., Slama, K., Ray, A., Schulman, J., Hilton, J., Kelton, F., Miller, L., Simens, M., Askell, A., Welinder, P., Christiano, P., Leike, J., & Lowe, R.
- Venue
- Advances in Neural Information Processing Systems 35
- Published
- 2022
- Pages
- 27730-27744
- ISSN
- 1049-5258 (ISSN-L)
- OpenAlex
- W7133211372
- Cited by
- 3,117
- References
- 0
- Citations by year
- 2026: 1421 · 2025: 544 · 2024: 852 · 2023: 297 · 2022: 3
- FWCI
- 234.27
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- neural information processing systems (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Keywords
- instruction following, language models, human feedback, reinforcement learning from human feedback, large language models
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.