Training Language Models to Follow Instructions with Human Feedback
The DOI matches its Crossref record; 2 of the 2 references it cites were found in a registry or an index.
Abstract
Making language models bigger does not inherently make them better at following a user's intent. For example, large language models can generate outputs that are untruthful, toxic, or simply not helpful to the user. In other words, these models are not aligned with their users. In this paper, we show an avenue for aligning language models with user intent on a wide range of tasks by fine-tuning with human feedback. Starting with a set of labeler-written prompts and prompts submitted through the OpenAI API, we collect a dataset of labeler demonstrations of the desired model behavior, which we use to fine-tune GPT-3 using supervised learning. We then collect a dataset of rankings of model outputs, which we use to further fine-tune this supervised model using reinforcement learning from human feedback. We call the resulting models InstructGPT. In human evaluations on our prompt distribution, outputs from the 1.3B parameter InstructGPT model are preferred to outputs from the 175B GPT-3, despite having 100x fewer parameters. Moreover, InstructGPT models show improvements in truthfulness and reductions in toxic output generation while having minimal performance regressions on public NLP datasets. Even though InstructGPT still makes simple mistakes, our results show that fine-tuning with human feedback is a promising direction for aligning language models with human intent.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Existing literature (Ouyang et al., 2022) does not fully describe the details of these models, such as the pretraining corpus, model sizes, and model biases.”
From Self-Refine: Iterative Refinement with Self-Feedback (2023) · cites this paper as Ouyang et al., 2022
Experimental — accuracy not yet measuredIn the citing paper
“Specifically, providers mitigate race and gender bias through reinforcement learning from human feedback (RLHF), adversarial stress-testing known as red teaming, and hard-coded refusals governed by the provider's own content policies [6, 43, 71].”
From All Public Voices Are Equal, But Are Some More Equal Than Others to LLMs? (2026) · cites this paper as [71]
In the citing paper
“Fine-tuning a model from human feedback at scale, using preference data from paid raters or drawn from a large and willing user base, is an especially potent technique.It has the potential not only to shape a model's responses to better reflect user norms (for better or worse), but also to filter out toxic language, improve factual accuracy, and mitigate the tendency to fabricate information.”
From Talking about Large Language Models (2024) · cites this paper as [26]
In the citing paper
“These include general competencies such as in-context learning (ICL) [13], chain-of-thought (CoT) [17] reasoning, and instruction following [25], as well as task-specialized skills like mathematical reasoning [30].”
From A Survey of Large Language Models (2026) · cites this paper as [25]
In the citing paper
“When external reward models or ground-truth answers are available, rejection sampling can also be applied to select higher-quality responses from multiple candidates [25].”
From A Survey of Large Language Models (2026) · cites this paper as [25]
41 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
The publisher hasn’t deposited this paper’s reference list.
Cited by
Items 2,201–2,300 of 4,340
Bigan, E., & Dufour, S. (2026) · JMIR AI · doi:10.2196/83853 · Cited by 1
Yet Another Watermark for Large Language Models
Bao, S., Shi, Y., Yang, Z., Wu, H., & Zhang, X. (2025) · International Conference on Communications and Broadband Networking (ICCBN) · doi:10.1109/iccbn67217.2025.11448000 · Cited by 2
Zhang, K., Niu, Y., Alqassim, M. Y., Inglis, A. L., Palansuriya, C., & Constantin, A. (2026) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3772363.3798774 · Cited by 1
Wang, Y., & Ge, Y. (2026) · Information Systems Research · doi:10.1287/isre.2024.1518 · Cited by 3
Geometric Perspectives on Preference Alignment: From Replicator Dynamics to Mirror Descent
Su, B. (2026) · IEEE Control Systems Letters · doi:10.1109/lcsys.2026.3689885 · Cited by 1
Transformer-Based Models for Natural Language Processing: A Review of Methods and Applications
Li, Q., & Sun, M. (2026) · International Conference on Electronics Technology and Artificial Intelligence (ETAI) · doi:10.1109/etai68332.2026.11485421 · Cited by 1
Agarwal, A., Basheer, H., Sengar, H. S., Shiragapur, B. K., & Hanumanth, S. (2026) · World Conference on Computational Science and Technology (WcCST) · doi:10.1109/wccst67302.2026.11496096 · Cited by 1
Abdullah, S., Hossain, R., & Chowdhury, M. (2026) · Discover Applied Sciences · doi:10.1007/s42452-026-08793-w · Cited by 1
HAMMER: An Automatic RAG Tuning System via Hierarchical Memory-Guided Monte Carlo Tree Search
Zhou, Y. K., Wang, Z., & Fang, Y. (2026) · Proceedings of the ACM on Management of Data · doi:10.1145/3802071 · Cited by 2
Supervisory Control Theory for LLM Revision
Li, W., & Toxtli, C. (2026) · ACM Conference on AI and Agentic Systems (CAIS) · doi:10.1145/3786335.3813152 · Cited by 1
Li, J., Wang, J., Zhao, Z., & Wei, Z. (2026) · Computer Standards & Interfaces · doi:10.1016/j.csi.2026.104181 · Cited by 1
HAT-FI: Hardware-Aware Training for Fault-Tolerant LLM Inference on RRAM-Based Compute-in-Memory
Sharma, P., Ahmed, S. T., Firouzi, F., & Chakrabarty, K. (2026) · IEEE VLSI Test Symposium (VTS) · doi:10.1109/vts69484.2026.11563304 · Cited by 1
Qu, Z., Geng, M., Mao, Y., Gu, S., Xu, C., & Wang, H. (2026) · Neural Networks · doi:10.1016/j.neunet.2026.109280 · Cited by 2
CORA: A Cognitive Reframing Dialogue Agent for Supporting Emotion Regulation
Chen, T., Li, Z., Chen, X., Shen, Y., Jin, H., Zhang, L., & Zhao, S. (2026) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2026.3709312 · Cited by 1
Gong, A., Wu, S. S., Wang, S., 吴俊本, Fan, B., Wei, X., Jia, A., & Liu, Y. (2026) · Computer Methods in Biomechanics & Biomedical Engineering · doi:10.1080/10255842.2026.2698065 · Cited by 1
The Immanent Ethics of Algorithms: Moral Materialization and the Governance Turn in Generative AI
Ma, D., Chen, Y. Z., & Pei, Q. (2026) · Philosophies · doi:10.3390/philosophies11040112 · Cited by 1
From PDF to Dataset: Semi-Automated Extraction of Fine-Tuning Data
Suvitie, N., Saari, M., & Abrahamsson, P. (2026) · International Convention on Information and Communication Technology, Electronics and Microelectronics · doi:10.1109/mipro70003.2026.11591662 · Cited by 1
Bridging Causal Reasoning and Fuzzy Calibration for Trustworthy AI Risk Assessment
McConomy, G., Liu, J., Glass, D., Bond, R., & Toner, H. (2026) · Lecture notes in computer science · doi:10.1007/978-981-92-2497-5_18 · Cited by 1
MV-MoE: A multi-view mixture-of-expert tuning method for medical LLMs
Zhang, W., Yan, Y., Wang, J., Wu, X., Yuan, C., & Ruan, T. (2026) · Expert Systems with Applications · doi:10.1016/j.eswa.2026.133593 · Cited by 1
CoRe-DoS: Inference-time denial-of-service attack against retrieval-augmented generation
Sun, H., Yuan, D., Li, M., & Deng, Y. (2026) · Computer Networks · doi:10.1016/j.comnet.2026.112567 · Cited by 1
Li, C., Gülfidan, G., & Zhang-Kopf, Y. (2026) · Computers and Education Artificial Intelligence · doi:10.1016/j.caeai.2026.100642 · Cited by 2
Võ, T., Luu, S. T., & Nguyen, L.-M. (2026) · Computers & Electrical Engineering · doi:10.1016/j.compeleceng.2026.111365 · Cited by 1
Taricco, G. (2026) · Entropy · doi:10.3390/e28070811 · Cited by 1
VAST-Blockchain: Hybrid Ledger Anchoring for Verifiable Governance and Auditability of Aligned AI
Partow, S., & Nan, S. (2026) · IEEE International Conference on AI and Data Analytics (ICAD) · doi:10.1109/icad69378.2026.11608876 · Cited by 1
From Belief to Behavior: Modeling and Tracking Moral Alignment in Autonomous Agents
Partow, S., & Nan, S. (2026) · IEEE International Conference on AI and Data Analytics (ICAD) · doi:10.1109/icad69378.2026.11608527 · Cited by 1
Meconi, T., & Henseler, H. (2026) · Forensic Science International · doi:10.1016/j.forsciint.2026.113074 · Cited by 1
Leveraging large language models (LLMs) for GeoAI-enabled digital agro-advisory
Gakhar, S., & Singh, R. K. (2026) · Frontiers in Remote Sensing · doi:10.3389/frsen.2026.1839369 · Cited by 1
Yajnik, A., & Pushkala, S. A. (2026) · IEEE Access · doi:10.1109/access.2026.3719291 · Cited by 1
A vision transformer based leakage free concept bottleneck model for clinical skin lesion diagnosis
Kandpal, K. C., & Verma, P. (2026) · Discover Computing · doi:10.1007/s10791-026-10315-6 · Cited by 1
Rocha, A., de Oliveira, P. C., Ferreira, J. P., Alves, M., & Sousa, A. J. (2026) · Applied Sciences · doi:10.3390/app16157745 · Cited by 1
MetaRanker: Human-in-the-loop Active Ranking for Metalens Image Quality
Park, Y., Chung, H., & Jang, I. (2026) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3770855.3818912 · Cited by 1
Closing the Health Policy Implementation Gap With Artificial Intelligence
McGinty, E. E., Zhang, Y., Wang, F., Ayanian, J. Z., & Schpero, W. L. (2026) · JAMA Health Forum · doi:10.1001/jamahealthforum.2026.2515 · Cited by 1
Peykani, P., Charles, V., Emrouznejad, A., Ghanidel, S., & Sabour, D. (2026) · Archives of Computational Methods in Engineering · doi:10.1007/s11831-026-10720-6 · Cited by 1
OEPO: Online Experience-based Preference Optimization for CTR Prediction
Liao, Z., Ni, Z.-H., Liu, C.-C., Fang, Z.-W., & Peng, C.-P. (2026) · IEEE International Conference on Data Engineering · doi:10.1109/icde65706.2026.00303 · Cited by 1
Yu, H., Iqbal, S., Neto, E. C. P., Buffett, S., & Taylor, A. (2026) · International Journal of Information Security · doi:10.1007/s10207-026-01321-2 · Cited by 2
Georgakopoulou, A. (2026) · Narrative Inquiry · doi:10.1075/ni.25147.geo · Cited by 1
CoLyricist: Enhancing Lyric Writing with AI through Workflow-Aligned Support
Yoshida, M., Li, B. Q., Zhao, S., Zhou, Q., Hu, S., Chen, X. '., & Peng, N. (2026) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3742413.3789099 · Cited by 4
Document Understanding with Deep Learning Techniques
Nguyen, K.-A. L. (2024) · theses.fr (ABES) · doi:10.70675/b83ce709z5fc9z4a33za0bezd7aaad779ef1 · Cited by 4
India, G., Grayson, M., Morrison, C. P., Massiceti, D., Robinson, S., Pearson, J. S., & Jones, M. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3791099 · Cited by 1
Engaging Communities Meaningfully in Defining Disability Representation for AI Image Generation
Thieme, A., Faia Marques, R., Grayson, M., Balachandar, S., Tyler Cassidy, C., Choksi, M. Z., Longden, C., Huda, R. S., Ileve Kalovwe, N., Mallon, C., et al. (2026) · Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3790768 · Cited by 1
“12: This screenshot shows the second frame (2/3) of the per-image data annotation sequence: project leads review and can make any necessary edits to the displayed prompt that is auto-generated using the image and their initial explanation for selecting it as inputs to the GPT4o model.”
Li, Y. (2026) · Journal of Research in Personality · doi:10.1016/j.jrp.2026.104744 · Cited by 1
MEEA: Mere Exposure Effect-Driven Confrontational Optimization for LLM Jailbreaking
Zhang, J., Liu, S., Zhou, Z., & Li, Z. (2026) · Lecture notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering · doi:10.1007/978-3-032-37274-1_2 · Cited by 1
Software Vulnerability Management in the Era of Artificial Intelligence: An Industry Perspective
Kholoosi, M. M., Le, T. H. M., & Babar, M. A. (2026) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/3744916.3787781 · Cited by 1
Cheng, M., Tao, X., Zhang, H., Liu, Q., Liu, Z., Luo, Y., Chen, Y., & Chen, E. (2026) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3821437 · Cited by 1
Exploiting Generative AI: How Children Bypass Safety Filters with Prompt Injection
Laczi, S. A., & Póser, V. (2026) · IEEE World Symposium on Applied Machine Intelligence and Informatics (SAMI) · doi:10.1109/sami68106.2026.11420779 · Cited by 1
Secure Code Generation With Open Source Generative AI Models
Pandey, M., & Kumar, S. (2026) · IEEE Software · doi:10.1109/ms.2026.3672189 · Cited by 2
Taxi Repositioning via LLM-Driven Multi-Agent Coordination and Experience Accumulation
Yu, H., Zhang, J., Luo, X., Yin, W., Liu, Z., Huang, J., & Liu, X. (2025) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc60802.2025.11423831 · Cited by 1
Policy-Based Tuning of Autoregressive Image Models with Instance- and Distribution-Level Rewards
Baran, O. B., Kandemir, M., & Cinbiş, R. G. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37013-6_18 · Cited by 1
Chen, D., Liu, H. L., Ge, Q., Zuo, M., An, H., Zhou, Q., Fu, S., Zhou, P., Wang, X., Chen, B., et al. (2026) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2026.3678339 · Cited by 1
Harnessing the Power of Multimodal and Textual Data in Industry 4.0
Pellegrain, V. (2023) · theses.fr (ABES) · doi:10.70675/7522c20fza9b4z4c4az8d8dz290dd3669716 · Cited by 1
Reinforcement learning for combinatorial optimization : leveraging uncertainty, structure and priors
Grinsztajn, N. (2023) · theses.fr (ABES) · doi:10.70675/596ed207zce1az43dez9b5fzb69d2c21eb2c · Cited by 2
Teodorescu, L. (2023) · theses.fr (ABES) · doi:10.70675/08e0bf33z987fz4ff6zbdd7zbf6cf87e81f0 · Cited by 3
Sparks of explainability : recent advancements in explaining large vision models
Fel, T. (2024) · theses.fr (ABES) · doi:10.70675/2306eab0z8851z470cz9dc4z01481861fb3e · Cited by 4
Um, K., Yeom, K., Yang, H., Choi, M., Yang, H., & Lee, K.-H. (2026) · International World Wide Web Conference (WWW) · doi:10.1145/3774904.3792730 · Cited by 3
Shen, H., Knearem, T., Thakkar, D., Pataranutaporn, P., Sinha, A. K., Shi, Y., Liang, J. T., Ahmad, L., Mitra, T., Myers, B. A., et al. (2026) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3772363.3778710 · Cited by 1
Metatoolagent: Towards Generalizable Tool Usage in LLMs Through Meta-Learning
Fang, Z., Mayer, W., Zhang, Z., Wang, J., Zhang, H. S., Li, W., & Feng, Z. (2026) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp55912.2026.11463658 · Cited by 1
Enhancing Value Alignment of LLMs with Multi-Agent System and Combinatorial Fusion
Wu, Y., Bouneffouf, D., & Hsu, D. F. (2026) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp55912.2026.11460611 · Cited by 2
RLBR: Reinforcement Learning with Biasing Rewards for Contextual Speech Large Language Models
Ren, B., Fan, R., Shen, Y., Chen, W., & Li, J. (2026) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp55912.2026.11464286 · Cited by 1
Optimizing Multi-Turn Interactive Recommendation Agents via Generative Intrinsic Motivation
Feng, X., Tang, J., Chen, X., Dai, Q., & Dong, Z. (2026) · International World Wide Web Conference (WWW) · doi:10.1145/3774904.3792209 · Cited by 2
Prism: Towards Lowering User Cognitive Load in LLMs via Complex Intent Understanding
Liao, Z., Liao, J., & Zhao, X. H. (2026) · International World Wide Web Conference (WWW) · doi:10.1145/3774904.3792494 · Cited by 3
Xiao, L., Wu, Y., Yu, G., Zheng, Z., Cai, Y., & Xing, Y. (2026) · Journal of Systems and Software · doi:10.1016/j.jss.2026.112917 · Cited by 1
Yuh, W. T., Ryu, S., Kim, T., & Choi, I. (2026) · Journal of Korean Neurosurgical Society · doi:10.3340/jkns.2026.0029 · Cited by 1
MAGPIE: Utilizing Agent-Specific Preferences for Multi-Agent Reinforcement Learning
Mu, N., Luan, Y., & Jia, Q. (2025) · China Automation Congress (CAC) · doi:10.1109/cac67268.2025.11486931 · Cited by 1
von Klinski, M., & Schall, M. (2026) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv61042.2026.00245 · Cited by 1
End-to-End Fine-Tuning of 3D Texture Generation using Differentiable Rewards
Zamani, A., Xie, T., Aghdam, A. G., Popa, T., & Belilovsky, E. (2026) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv61042.2026.00025 · Cited by 1
Propensity to trust in Large Language Models
Plebe, A. (2026) · PLoS ONE · doi:10.1371/journal.pone.0347328 · Cited by 1
Autonomous Multimodal Grievance Redressal System using Generative AI
Paria, A., Kumar, Y., Raj, R., Das, S., Aaman, S., & Prof. Nandini, K. (2026) · International Conference on Smart Electronic Devices and Intelligent Systems (ICSEDIS) · doi:10.1109/icsedis68157.2026.11518082 · Cited by 1
EVA: Editing for Versatile Alignment Against Jailbreaks
Wang, Y., Qiu, H., Xu, Y., Yang, S., Qin, Z., Huang, M., & Wang, W. (2026) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2026.3694189 · Cited by 1
Feature Map Compression for Split Learning in Mobile Wireless Environment: Theory and Practice
Zhou, W., Qu, Z., Ye, B., Lyu, S.-H., Cai, M., Ji, M., & Guo, S. (2026) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2026.3696694 · Cited by 1
Accelerating Long-Tail Generation in Synchronous RLHF Training via Adaptive Tensor Parallelism
Zhao, L., Wang, Q., 朱家安, Bai, Y., Jin, Z., Ruan, C., Wang, S., & Li, C. X. (2026) · Proceedings of the International Conference on Parallel Processing · doi:10.1145/3832810.3832831 · Cited by 1
A Large Language Model-Based Game Equilibrium Selection Approach for Human-Machine Shared Driving
Yang, Y., Song, C., Li, H., & Zhao, J. (2026) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2026.3692621 · Cited by 1
Imbuing Large Language Models with Bidirectional Logic for Robust Chain Repair
Cheng, Z., (95957), W. D., Sun, J., & Lukasiewicz, T. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37670-1_34 · Cited by 1
Wu, H., Sun, C., Wang, C., Lu, C., Chen, Y., Wang, J., & Zhang, Z. (2026) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2026.3700652 · Cited by 1
Instruction-Tuned LLMs for Parsing and Mining Unstructured Logs on Leadership HPC Systems
Karimi, A. M., Choi, J. Y., Cao, C., & Khan, A. (2026) · ISC High Performance (ISC) · doi:10.23919/isc.2026.11520489 · Cited by 2
IFCoT: Insights Fusion Chain of Thought for Multimodal Reasoning in LLMs
Liu, J., Du, J., Hu, T., Tong, L., Feng, Y., Zhou, J. T., Xu, M., & Liu, Z. (2026) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2026.3702539 · Cited by 1
Thejll-Madsen, T., Yongsatianchot, N., & Marsella, S. (2026) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2026.3702035 · Cited by 1
From AI Agents to AI Scientists in Health: Emerging Landscape, Challenges, and the Path ForwardPreprint
Chen, Q., Wang, X., Zhou, R., Kim, H., Wang, S., Zhao, W., Liu, T., Riaz, I., He, L., Zhao, Y., et al. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6889798 · Cited by 3
Sung, Y., Jeong, H., Xu, X., & Yoon, S. H. (2026) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3810235 · Cited by 1
A Diffractive Analysis of GenAI through Perspectives on Productivity
Swift, I. P., & Chattopadhyay, D. (2026) · Annual Symposium on Human-Computer Interaction for Work (CHIWORK) · doi:10.1145/3808045.3808074 · Cited by 1
Evol-Preference: Automatic evolution of preference data for safety alignment
Liu, Y., Huang, Y., Liu, S., & Pang, X. (2026) · Expert Systems with Applications · doi:10.1016/j.eswa.2026.133366 · Cited by 1
“Label from Somewhere”: Reflexive Annotating for Situated AI Alignment
Arzberger, A., Offerman, C., Gadiraju, U., Bozzon, A., & Yang, J. (2026) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3805689.3812268 · Cited by 5
SciEval: A Benchmark for Automatic Evaluation of K–12 Science Instructional Materials
Li, Z. D., He, P., Chen, Z., Liu, H., Wang, Z., Li, T., & Xiong, J. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-29744-0_36 · Cited by 1
Responsible NLP: Why performance is no longer enough
Lamsiyah, S. (2026) · Natural language processing. · doi:10.1017/nlp.2026.10030 · Cited by 1
Density-Guided Response Optimization: Community-Grounded Alignment via Implicit Acceptance Signals
Gerard, P., & Volkova, S. (2026) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3805689.3806449 · Cited by 1
Helpful, Harmless, Honest? RLHF as Survey Design and Content Moderation
D'Alonzo, S., Kreuter, F., & Booth, S. (2026) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3805689.3806444 · Cited by 4
PPAI: Enabling Personalized LLM Agent Interoperability for Collaborative Edge Intelligence
Wang, Z., Liu, Q., Guo, K., Wang, H., Lin, J., Hong, Z., & Guo, S. (2026) · IEEE Conference on Computer Communications (INFOCOM) · doi:10.1109/infocom59046.2026.11571683 · Cited by 3
Learning Alignment Principles Grounded in Human Reasons and Values
Bell, H., Schertel, L. N. D. C., Ding, B., & Fain, B. (2026) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3805689.3806453 · Cited by 1
See Only When Needed: Context-Aware Attention Intervention for Mitigating Hallucinations in LVLMs
Lei, Y., Lyu, W., Du, Y., Zhen, X., Snoek, C. G. M., & Shao, L. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37422-6_10 · Cited by 1
On-premises open-source large language models for privacy-preserving multimodal depression screening
Kwon, S., Kim, Y., Jhon, M., Park, J.-H., Lim, B., Jeon, E., Kim, J.-M., Kim, J.-W., & Lee, H. (2026) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2026.106577 · Cited by 1
Ji, R. (2026) · SHS Web of Conferences · doi:10.1051/shsconf/202623504010 · Cited by 1
Salvador, I., Furno, A., & Derrible, S. (2026) · Transportation Research Record Journal of the Transportation Research Board · doi:10.1177/03611981261456273 · Cited by 1
Large Language Model-augmented taxonomy for >4500 palaeopalynology genera
Stephenson, M. H., Yang, J., CARNITI, A. P., Shen, S., Fan, J., & Ye, J. (2026) · Review of Palaeobotany and Palynology · doi:10.1016/j.revpalbo.2026.105668 · Cited by 2
Carlo, M., & Takeuchi, O. (2026) · International Journal of Applied Linguistics · doi:10.1111/ijal.70284 · Cited by 1
Adaptive reinforcement learning based projected gradient descent attack
Zhu, Z. D. J. D., Zhang, Y., Ye, A., Wang, X. Y., Wang, C., & Zhu, T. (2026) · The Journal of Supercomputing · doi:10.1007/s11227-026-08687-z · Cited by 1
Reich, A., Thoms, C., & Schrimpf, T. (2026) · Communication Methods and Measures · doi:10.1080/19312458.2026.2693637 · Cited by 1
Kannojiya, V., & Dixit, V. (2026) · Procedia Computer Science · doi:10.1016/j.procs.2026.06.342 · Cited by 1
He, Y., Hu, C., Wu, H., Huang, W., & Liu, C. (2026) · Transactions in GIS · doi:10.1111/tgis.70343 · Cited by 1
Adaptive Mix Preference Optimization for Generative Recommendation
Qi, J., Zou, Y., Yang, X., Xu, S., Sun, Y. W., & Li, S. (2026) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3805712.3809727 · Cited by 1
A survey of transformers based on their input modalities
Sharma, P., & Jain, S. K. (2026) · Applied Intelligence · doi:10.1007/s10489-026-07378-9 · Cited by 1
Can AI Replace the Statistician? Evidence From a Controlled Experiment
Jank, W., Klingenberg, B., Prabhune, S., & Zantedeschi, D. (2026) · International Statistical Review · doi:10.1111/insr.70056 · Cited by 1
Metadata
- Authors
- Ouyang, L., Wu, J., Jiang, X., Almeida, D., Wainwright, C., Mishkin, P., Zhang, C., Agarwal, S., Slama, K., Ray, A., Schulman, J., Hilton, J., Kelton, F., Miller, L., Simens, M., Askell, A., Welinder, P., Christiano, P., Leike, J., & Lowe, R.
- Venue
- Advances in Neural Information Processing Systems 35
- Published
- 2022
- Pages
- 27730-27744
- ISSN
- 1049-5258 (ISSN-L)
- OpenAlex
- W7133211372
- Cited by
- 3,117
- References
- 0
- Citations by year
- 2026: 1421 · 2025: 544 · 2024: 852 · 2023: 297 · 2022: 3
- FWCI
- 234.27
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- neural information processing systems (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Keywords
- instruction following, language models, human feedback, reinforcement learning from human feedback, large language models
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.