Training Language Models to Follow Instructions with Human Feedback
The DOI matches its Crossref record; 2 of the 2 references it cites were found in a registry or an index.
Abstract
Making language models bigger does not inherently make them better at following a user's intent. For example, large language models can generate outputs that are untruthful, toxic, or simply not helpful to the user. In other words, these models are not aligned with their users. In this paper, we show an avenue for aligning language models with user intent on a wide range of tasks by fine-tuning with human feedback. Starting with a set of labeler-written prompts and prompts submitted through the OpenAI API, we collect a dataset of labeler demonstrations of the desired model behavior, which we use to fine-tune GPT-3 using supervised learning. We then collect a dataset of rankings of model outputs, which we use to further fine-tune this supervised model using reinforcement learning from human feedback. We call the resulting models InstructGPT. In human evaluations on our prompt distribution, outputs from the 1.3B parameter InstructGPT model are preferred to outputs from the 175B GPT-3, despite having 100x fewer parameters. Moreover, InstructGPT models show improvements in truthfulness and reductions in toxic output generation while having minimal performance regressions on public NLP datasets. Even though InstructGPT still makes simple mistakes, our results show that fine-tuning with human feedback is a promising direction for aligning language models with human intent.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Existing literature (Ouyang et al., 2022) does not fully describe the details of these models, such as the pretraining corpus, model sizes, and model biases.”
From Self-Refine: Iterative Refinement with Self-Feedback (2023) · cites this paper as Ouyang et al., 2022
Experimental — accuracy not yet measuredIn the citing paper
“Specifically, providers mitigate race and gender bias through reinforcement learning from human feedback (RLHF), adversarial stress-testing known as red teaming, and hard-coded refusals governed by the provider's own content policies [6, 43, 71].”
From All Public Voices Are Equal, But Are Some More Equal Than Others to LLMs? (2026) · cites this paper as [71]
In the citing paper
“Fine-tuning a model from human feedback at scale, using preference data from paid raters or drawn from a large and willing user base, is an especially potent technique.It has the potential not only to shape a model's responses to better reflect user norms (for better or worse), but also to filter out toxic language, improve factual accuracy, and mitigate the tendency to fabricate information.”
From Talking about Large Language Models (2024) · cites this paper as [26]
In the citing paper
“These include general competencies such as in-context learning (ICL) [13], chain-of-thought (CoT) [17] reasoning, and instruction following [25], as well as task-specialized skills like mathematical reasoning [30].”
From A Survey of Large Language Models (2026) · cites this paper as [25]
In the citing paper
“When external reward models or ground-truth answers are available, rejection sampling can also be applied to select higher-quality responses from multiple candidates [25].”
From A Survey of Large Language Models (2026) · cites this paper as [25]
41 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
The publisher hasn’t deposited this paper’s reference list.
Cited by
Items 2,701–2,800 of 4,340
Wang, F., Zhang, L., Zhou, J., Han, J., Sun, Y., Qin, C., Zhu, H., & Xiong, H. (2026) · International World Wide Web Conference (WWW) · doi:10.1145/3774904.3792817 · Cited by 1
Using Knowledge Graph To Detect And Explain Misinformation Spread On The Web
Peskine, Y. (2025) · theses.fr (ABES) · doi:10.70675/efad38dcza422z419dz865ez1bc0e700ce2c
Advancements in Graph Representation Learning and Applications in Computational Biology
Chatzianastasis, M. (2025) · theses.fr (ABES) · doi:10.70675/b8144805z57bfz47c2zbf7ezb00ae1597604
ConvScale: Conversational Interviews for Scale-Aligned Measurement
Qin, P., Chen, J., Yang, Y., Meng, H., Zhu, Z., & Lee, Y. (2026) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3772363.3798684
paidi, S. K. (2026) · Research Square · doi:10.21203/rs.3.rs-9323625/v1
Shi, T., Li, Y., Li, Z., Liu, Q., Zhou, J., Xu, W., Li, Y., Dai, D., He, R., Zhou, W., et al. (2026) · Nature Machine Intelligence · doi:10.1038/s42256-026-01298-6 · Cited by 2
Applications and Challenges of Generative AI in the Medical Field
Tao, Z., & Li, L. (2026) · Advances in computational intelligence and robotics book series · doi:10.4018/407369
The epidemiology of artificial intelligence
Parikh, H., McCormick, T. H., Johnson, E. K., Hickey, L., Ranney, M. L., & Mukherjee, B. (2026) · Nature Health · doi:10.1038/s44360-026-00188-w
CoGrid & the Multi-User Gymnasium: A framework for multi-agent experimentation
McDonald, C., & González, C. (2026) · Behavior Research Methods · doi:10.3758/s13428-026-03078-x
Li, Z., Liu, Q., Pan, J., Huang, R., Hou, L., Hu, X., Ma, J., Zhang, S., Zhang, J., Tian, X., et al. (2026) · International Journal of Computer Vision · doi:10.1007/s11263-026-02842-y
LLM-KGPlan: Long-Horizon Task Planning via Knowledge-Guided Reasoning
Fang, W., Yang, D., Chen, N., Fan, G., Rao, L., Cheng, S., Song, X., & Yu, Y. (2026) · Lecture notes in computer science · doi:10.1007/978-981-95-7078-2_49
Li, X., Shang, Y., Jiang, X., Zhang, C., & Liao, Y. (2026) · Lecture notes in computer science · doi:10.1007/978-981-95-7078-2_8
Self-citationLiu, Y., Liu, F., Zhao, Z., Shen, Q., & Kuang, Y. (2025) · International Conference on Artificial Intelligence, Digital Media Technology and Interaction Design (ICADI) · doi:10.1145/3795926.3796025
Defense Methods for Adversary Patches in Autonomous Robotic Systems
Le, T. D., Clark, G. W., McDonald, J. T., & Gong, N. (2026) · IEEE SoutheastCon · doi:10.1109/southeastcon63549.2026.11476232
Prompt Attacks and Safeguards in Large Language Models: A Survey
Mojallal, K., Sadr, P., Ahmadian, S., & Alhadidi, D. (2026) · Lecture notes in computer science · doi:10.1007/978-981-95-7078-2_29
Disentangled Signals, Dynamic Prompts: A Meta-Network Framework for Robust Task-Oriented Dialogue
Xiong, C., Zou, Y., & Li, T. (2026) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp55912.2026.11462735
Liu, H., Sun, X., Zhang, Y., & Zhang, Y. (2026) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp55912.2026.11463087
TS-Agent: Reinforcement Learning Empowered LLM Agents for Financial Time Series Forecasting
Zhu, J., Yin, S., Yang, T., & Liu, Y. (2026) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp55912.2026.11461957
Enhancing Debate Dialogue Generation via Dual-Dimensional Reflection and Refinement
Sun, Y., Huang, Y., Liang, B., Yang, M., & Xu, R. (2026) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp55912.2026.11460903
LLM-Adaptive Reasoning Clustering for Automated Chain-of-Thought Prompting
He, Q., Yan, K., Qian, S., & Wang, C. (2026) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp55912.2026.11462308
Optimizing Automated Jailbreak Attacks on Large Language Models via Experience Accumulation
Zhou, Y., Ding, X., Meng, Y., Chang, T., Gao, J., Zhang, Z. G., Xiong, K., & Shi, Q. (2026) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp55912.2026.11460561
RankNB: Ranking-Aware Direct Preference Optimization for Alignment of a Nanobody Diffusion Model
Wu, Y., Wu, D., Shu, J., Linker, S. M., Hrovatin, K., Winkel, M., & Tan, F. (2026) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp55912.2026.11462703
Deopt: Synergizing Large Language Models and Differential Evolution for Join Order Optimization
Zhang, Q., Yang, J., Wu, Y. N., Xu, X. X., Zhang, S., & Ding, Z. (2026) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp55912.2026.11463910
EPO: Enhanced Preference Optimization with Multi-Response Data for LLMs via Stochastic Softmax
Wu, T., Li, Y., Gao, J., Zhu, W., Tan, M., & Leong, H. Y. (2026) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp55912.2026.11462805
InsightRec: Enhancing Sequential Recommendation through Reasoning-Aware Preference Optimization
Huang, H., Peng, Q., Shao, M., & Liu, H. (2026) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp55912.2026.11464421 · Cited by 1
A Configurable Trait-Based API Framework for Enhancing Large Language Model Output
Kumar, A., Nandwani, S., Yadav, S. K., & Ostrowski, D. A. (2025) · Conference on AI x Software Engineering (AIxSE) · doi:10.1109/aixse64906.2025.00020
PROST-LLM: Progressively Enhancing the Speech-to-Speech Translation Capability in LLMs
Xu, J., Wang, J., Tan, D., & Chen, X. (2026) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp55912.2026.11462723
Türkçe Dil Modellerinde Persona Vektörleri: Karakter Özelliklerinin İzlenmesi ve Kontrolü
Akbulut, M. (2026) · Türk Kütüphaneciliği · doi:10.24146/tk.1765562
MO-GRPO-Med: A Multi-Objective Framework for Generating Safe and High-Quality Discharge Instructions
Shen, Q., Zhang, X., Guo, Q., & Zhang, Y. (2026) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp55912.2026.11462671
Data-Bridge: A Multi-Agent System for Code-Based Multimodal Schema Alignment
Zhou, S., Dou, Z., & Feng, F. (2026) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp55912.2026.11464693
DarkCite: Unveiling Authority Bias as Implicit Rag Jailbreak Attacks
Yang, X., Tang, X., Han, J., & Hu, S. (2026) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp55912.2026.11463457
Parameter Localization and Relearning for Safety Disalignment in Large Language Models
Zhou, Y. J., Xing, W., Lin, C., Kong, D., Hu, C., & Han, M. (2026) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp55912.2026.11463981
Safety Anchor-Guided Adaptive Bias Decay for Jailbreak Defense
Wang, Z., Yang, X., Zhang, B., & Liu, W. (2026) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp55912.2026.11463266
CSPC: A High-Quality Dataset And Comprehensive Evaluation Metric For Chinese Sentence Paraphrasing
Lin, H., Xiong, Z., Zhan, S., Li, Y., Zheng, H.-T., Yu, Y., Kim, H.-G., & Yang, Y. (2026) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp55912.2026.11461619
Aligning Language Models for Lyric-to-Melody Generation with Rule-Based Musical Constraints
Meng, H., Zheng, S., Zhou, S., Wang, Q., & Song, Y. (2026) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp55912.2026.11462728
Exploring Confidence As A Reward to Advance LLMS Reasoning
Du, H., Li, B., Xie, C., Gao, C., Chen, K., & Tao, D. (2026) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp55912.2026.11462883 · Cited by 1
Breaking Cognitive Fixation in Multi-Turn Dialogue with Self-Distancing and Incubation
Gwon, H.-M., Huang, J., & Lee, Y. (2026) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp55912.2026.11464620
BadAgent Extension: Cross-Domain Robustness and Trigger Visibility in LLM Agents
Garrido, P. Y., & Arias, D. F. (2026) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-8252-4.ch010
Xue, Q., Zhang, W., & Qiao, S. (2025) · doi:10.1145/3797552.3797614
Liu, J., Li, J., Jin, B., Huang, D., & Xiong, H. (2026) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/taslpro.2026.3687034
Zablith, F., & Abbas, J. (2026) · Information Systems Frontiers · doi:10.1007/s10796-026-10738-y · Cited by 1
Deep Reinforcement Adaptive Learning with LLM Enrichment for Cybersecurity Ontology Alignment
Zaeifi, M., Kalantari, F., Zaeifi, M., & Bansal, S. K. (2026) · IEEE International Conference on Semantic Computing (ICSC) · doi:10.1109/icsc67292.2026.00029
MongoTalk: An Agentic AI Framework for Conversational and Autonomous No-Code MongoDB Management
Patle, A., Ajalkar, D. A., Siddheshwar, S., Vijay, V., & Shirsath, D. (2025) · Joint International Conference on Data Science & Management of Data (CODS-COMAD) · doi:10.1145/3799830.3799881
Ouh, E. L., Tan, K. W., Lo, S. L., & Zhang, Y. (2026) · International Conference on Learning Analytics and Knowledge (LAK) · doi:10.1145/3785022.3785037 · Cited by 1
Hallucination Prediction in Large Language Models Using Contextual Analysis
Olomowewe, A., Starkey, A. J., & Sripada, Y. (2025) · International Conference on Advances in Artificial Intelligence (ICAAI) · doi:10.1145/3787279.3787296
LLMQuA: Practical Backdoor Injection on Large Language Model Quantization
Chen, X., Zhang, P., Sun, J., Dong, J. S., Wang, W. B., & Wang, J. (2026) · International World Wide Web Conference (WWW) · doi:10.1145/3774904.3792256 · Cited by 1
RGPO: Ranking-Guided Preference Optimization for Reliable Clinical Reasoning
Hsu, C. T., Ding, J.-E., Hsu, H.-L., Hsu, C.-H., Yang, S., Yao, L.-H., Liao, C.-C., Liu, F., & Hung, F. (2026) · IEEE Transactions on Artificial Intelligence · doi:10.1109/tai.2026.3688221
Models and Algorithms for Building AI-Powered Assistants: A Case Study of PetTech Platform Vetsy.ru
Guskov, G., Shcherbina, A., & Zayneev, R. (2026) · International Russian Smart Industry Conference (SmartIndustryCon) · doi:10.1109/smartindustrycon68821.2026.11492790
Lee, S., & Cho, S. (2026) · Journal of Korean Institute of Industrial Engineers · doi:10.7232/jkiie.2026.52.2.116
The logic trap: How LLM “Helpfulness” becomes a mechanism of psychological harm
Sophia, F. P. (2026) · AI and Ethics · doi:10.1007/s43681-026-01148-6
LLM-ReSum: A Framework for LLM Reflective Summarization Through Self-Evaluation
Nguyen, H., Zhang, H., Zhang, Y., Chen, H., & Ding, J. (2026) · IEEE International Conference on Big Data Computing Service and Applications (BigDataService) · doi:10.1109/bigdataservice70481.2026.00012 · Cited by 1
Thu, T. P. T., & Gia, K. N. (2026) · International Conference on Emerging Smart Computing and Informatics (ESCI) · doi:10.1109/esci68015.2026.11493164
ITI-ViT: Instruction Token Injection Vision Transformer for Fish Species Classification
Rahul, M., Banerjee, A., Nagesh, T. S., Bhattacharjee, D., & Das, N. (2026) · International Conference on Computing, Electronics & Communications Engineering (iCCECE) · doi:10.1109/iccece69715.2026.11492996
Cheng, Y., Kang, Z., Jiang, K., Sun, C., Pan, Q., & Jiang, T. (2026) · doi:10.2196/preprints.96433
CC-RAG: A Collaborative-Critical Dual-Agent Framework for Enhanced Retrieval-Augmented Generation
Fang, Y., Cheng, Y., & Zhang, W. (2025) · International Conference on Intelligent Education and Intelligent Research (IEIR) · doi:10.1109/ieir67391.2025.11491388
Context-aware Korean sentence ordering using large language models
Park, S., Lee, H., Seo, J., Yeo, S.-Y., Kim, D., & Kwak, I. (2026) · Korean Journal of Applied Statistics · doi:10.5351/kjas.2026.39.2.221
Multi-Dimensional Sentiment-Aware Social Media Opinion Monitoring with LLaMA-2
Zhang, K., Wang, M., Liu, Z., Xu, J., & Zhang, J. (2025) · International Conference on Big Data, Artificial Intelligence and Risk Management (ICBAR) · doi:10.1145/3800227.3800288
Huang, N. (2026) · International Conference on Artificial Intelligence and Fintech · doi:10.1145/3800973.3801028
ATM: Enhanced Alignment for Text-to-Motion Generation
Han, K., Lyu, Y., Yu, W., & Sebe, N. (2026) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv61042.2026.00663
The Operational Dimension: Uses and Applications
Biagini, G. (2026) · Digital education and learning · doi:10.1007/978-3-032-15919-9_3
Kolla, M., & Goud, K. S. (2026) · IEEE International Conference on Emerging Computing and Intelligent Technologies (ICoECIT) · doi:10.1109/icoecit68303.2026.11497007
VLMs Guided Interpretable Decision Making for Autonomous Driving *
Hu, X., Jing, T., Tian, R., & Ding, Z. (2026) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv61042.2026.00437
Wang, R. (2026) · International Conference on Generative Artificial Intelligence and Digital Media · doi:10.1145/3803730.3803760
IntentQA: Intent Question Answering in Videos by Cognitive Context Reasoning
Li, J. H., Wei, P., Han, W., Zhu, S. C., & Fan, L. (2026) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2026.3690561 · Cited by 2
Comparison between SeqGaN and Conditional GAN Generation of Text on IMDb Movie Reviews
Win, K. K., & Soe, K. M. (2026) · IEEE Conference on Computer Applications (ICCA) · doi:10.1109/icca69280.2026.11485771
Temperature-Diverse Agreement Fusion for Trust-Aware RAG: Novel Ensemble and Chunking Strategies
Chowdhury, A. P., Chowdhury, M. M., Karim, M. R., & Islam, A. (2025) · International Conference on Computer and Information Technology (ICCIT) · doi:10.1109/iccit68739.2025.11491739
The Classroom and Beyond: Teacher Education in a GenAI World
Mishra, P., & Henriksen, D. (2026) · Springer international handbooks of education · doi:10.1007/978-3-031-88898-4_28-1
Paul, S., Mitra, A., Podder, A., & Roy, P. (2026) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-7320-1.ch008
Information Aggregation with AI AgentsPreprint
Galanis, S. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6479841
BRIEF: Bi-Level Coreset Selection for Efficient Instruction Tuning in LLMs
Shen, C., Zhang, C., Chai, C., Wang, J., Yuan, J., Wang, Y., Yuan, Y., Wang, G., & Cao, L. (2026) · Proceedings of the VLDB Endowment · doi:10.14778/3797919.3797933 · Cited by 2
Self-citation徐, 哲. (2026) · E-Commerce Letters · doi:10.12677/ecl.2026.155482
Target Recommendation for Home AI Device Control Commands
Madhumitha, S. D., Jeevakumari, S. A. A., & Mandal, A. K. (2026) · International Conference on Recent Advances in Electrical, Electronics, Ubiquitous Communication, and Computational Intelligence (RAEEUCCI) · doi:10.1109/raeeucci67649.2026.11504948
Discrimination Matters: A Simple but Effective Method for Zero-Shot Relation Triplet Extraction
Song, Y., Cheng, Q., Qian, T., Zou, L., Hu, X., Li, W., & Feng, Z. (2026) · Lecture notes in computer science · doi:10.1007/978-981-92-0378-9_2
Tang, X., & Liu, S. (2026) · Journal of Computer Science and Frontier Technologies · doi:10.63313/jcsft.9072
Consensus-on-Graph: Plan-Driven Exploration and Consensus Decision-Making on Knowledge Graphs
Hu, C., Zhan, B., Yuan, L., Fan, W., & Yan, S. (2026) · Lecture notes in computer science · doi:10.1007/978-981-92-0369-7_32
An Experimental Study of Retrieval Order in Text-Based and Multimodal Figure Retrieval
Ratan, T. D., Banapurmath, G. N., Chikhali, S., Hasolkar, P., Meena, S. M., & Patil, S. (2026) · IEEE International Conference for Convergence in Computing Technology (I3CTCON) · doi:10.1109/i3ctcon68242.2026.11507139
Can LLMs Mimic Household Surveys?: From Representative Agents to Population DistributionsPreprint
Dalloul, A., & Pfeifer, M. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6703798 · Cited by 1
Trust in Large Language Models: An Exploratory Validation Framework
Money, W. H., & Mew, L. (2026) · Journal of Information Systems Applied Research and Analytics · doi:10.62273/npbz2264
Semantic Aggregated Adversarial Training Framework for Hate Speech Detection
Zhang, X., Tian, H., Zheng, X. B., Peng, J., & Zeng, D. D. (2026) · INFORMS journal on computing · doi:10.1287/ijoc.2023.0508 · Cited by 1
HateMediator: Fine-Tuning Large Language Models for Counter-Hate Speech via Multiturn Mediations
Wu, X.-K., Ai, L., Li, Y., Lu, L., Xie, J., Wang, Y., Luo, J., Zeng, D., Chen, M., & Fortino, G. (2026) · IEEE Transactions on Computational Social Systems · doi:10.1109/tcss.2026.3687425
Shi, P., Shui, Y., Jin, R., & Pan, Q. (2026) · Journal of King Saud University - Computer and Information Sciences · doi:10.1007/s44443-026-00825-0 · Cited by 1
DEVELOPMENT OF A DECISION SUPPORT SYSTEM USING ARTIFICIAL NEURAL NETWORK AND GENETIC ALGORITHM
Rybak, O. (2026) · Системи управління навігації та зв’язку Збірник наукових праць · doi:10.26906/sunz.2026.2.176
Multimodal Fusion with External Knowledge (MFEK)
Lin, Z., & Li, Q. (2026) · Wireless networks · doi:10.1007/978-3-032-20416-5_3
A systematic review of meta-cognitive approaches to AGI
Nishit Bohra, M., Wagle, S. A., & Patil, S. (2026) · Discover Artificial Intelligence · doi:10.1007/s44163-026-01401-1
Deng, X., & Cai, R. (2026) · International Conference on Generative Artificial Intelligence and Information Security (GAIIS) · doi:10.1109/gaiis69281.2026.11519321
A performance analysis of a large language model for Marathi language NLP tasks
Gaikwad, H. R., Laddha, M. D., & Kiwelekar, A. W. (2026) · Language Resources and Evaluation · doi:10.1007/s10579-026-09915-x
Hao, S., Liu, G., Guo, X., Liu, X., Huang, D., & Li, W. (2026) · Applied Intelligence · doi:10.1007/s10489-026-07270-6
Samet, I., Ridene, F., Arous, M. S., & Saidane, M. (2026) · IEEE International Conference on Complex Systems and Intelligent Computing (ICCSIC) · doi:10.1109/iccsic69301.2026.11521693
Vantum AI: Lightweight Core Enterprise Grade Impact
Kirubakaran, N., Kumar, G. S., Yathissh, S., Kumar, S. R., Sundarambal, B., & Selaganesan, C. (2026) · International Conference on Emerging Computational Intelligence (ICECI) · doi:10.1109/iceci69159.2026.11519437
Yan, J. (2026) · JMIR Formative Research · doi:10.2196/preprints.100769
Mishra, H., & Soundarajan, S. (2026) · SpringerBriefs in intelligent systems · doi:10.1007/978-3-032-24145-0_6
Ma, Z., Deng, Y., Qiao, Z., Fu, Y., Yue, S., & Ren, J. (2026) · IEEE Transactions on Networking · doi:10.1109/ton.2026.3695944
Truthful Online Preference Aggregation for LLM Fine-Tuning in Mobile Crowdsourcing
Hao, S., & Duan, L. (2026) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2026.3696583
Fu, L., & Xue, Y. (2026) · International Conference on Artificial Intelligence and Electromechanical Automation (AIEA) · doi:10.1109/aiea70743.2026.11633248
Chen, X., Nie, J., Zhao, M., & He, C. (2026) · International Conference on Mechatronics Technology and Intelligent Manufacturing (ICMTIM) · doi:10.1109/icmtim69588.2026.11526643
What Makes a Good Response? Learning Personal Preferences from Interpretable Features
Afsharrad, A., Soroka, E., O’Neill, D., & Lall, S. (2026) · ICON · doi:10.1109/icnlp69856.2026.11527497
A First-Order Logic-Based Alternative to Reward Models in RLHF
Jiang, C., & Zhu, X. (2026) · ICON · doi:10.1109/icnlp69856.2026.11527781
LoRA-Fine-Tuned LLMs for Discharge Medication Recommendation on Chinese EHRs
Su, X. (2026) · Communications in computer and information science · doi:10.1007/978-981-95-7299-1_32
Metadata
- Authors
- Ouyang, L., Wu, J., Jiang, X., Almeida, D., Wainwright, C., Mishkin, P., Zhang, C., Agarwal, S., Slama, K., Ray, A., Schulman, J., Hilton, J., Kelton, F., Miller, L., Simens, M., Askell, A., Welinder, P., Christiano, P., Leike, J., & Lowe, R.
- Venue
- Advances in Neural Information Processing Systems 35
- Published
- 2022
- Pages
- 27730-27744
- ISSN
- 1049-5258 (ISSN-L)
- OpenAlex
- W7133211372
- Cited by
- 3,117
- References
- 0
- Citations by year
- 2026: 1421 · 2025: 544 · 2024: 852 · 2023: 297 · 2022: 3
- FWCI
- 234.27
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- neural information processing systems (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Keywords
- instruction following, language models, human feedback, reinforcement learning from human feedback, large language models
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.