Training Language Models to Follow Instructions with Human Feedback
The DOI matches its Crossref record; 2 of the 2 references it cites were found in a registry or an index.
Abstract
Making language models bigger does not inherently make them better at following a user's intent. For example, large language models can generate outputs that are untruthful, toxic, or simply not helpful to the user. In other words, these models are not aligned with their users. In this paper, we show an avenue for aligning language models with user intent on a wide range of tasks by fine-tuning with human feedback. Starting with a set of labeler-written prompts and prompts submitted through the OpenAI API, we collect a dataset of labeler demonstrations of the desired model behavior, which we use to fine-tune GPT-3 using supervised learning. We then collect a dataset of rankings of model outputs, which we use to further fine-tune this supervised model using reinforcement learning from human feedback. We call the resulting models InstructGPT. In human evaluations on our prompt distribution, outputs from the 1.3B parameter InstructGPT model are preferred to outputs from the 175B GPT-3, despite having 100x fewer parameters. Moreover, InstructGPT models show improvements in truthfulness and reductions in toxic output generation while having minimal performance regressions on public NLP datasets. Even though InstructGPT still makes simple mistakes, our results show that fine-tuning with human feedback is a promising direction for aligning language models with human intent.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Existing literature (Ouyang et al., 2022) does not fully describe the details of these models, such as the pretraining corpus, model sizes, and model biases.”
From Self-Refine: Iterative Refinement with Self-Feedback (2023) · cites this paper as Ouyang et al., 2022
Experimental — accuracy not yet measuredIn the citing paper
“Specifically, providers mitigate race and gender bias through reinforcement learning from human feedback (RLHF), adversarial stress-testing known as red teaming, and hard-coded refusals governed by the provider's own content policies [6, 43, 71].”
From All Public Voices Are Equal, But Are Some More Equal Than Others to LLMs? (2026) · cites this paper as [71]
In the citing paper
“Fine-tuning a model from human feedback at scale, using preference data from paid raters or drawn from a large and willing user base, is an especially potent technique.It has the potential not only to shape a model's responses to better reflect user norms (for better or worse), but also to filter out toxic language, improve factual accuracy, and mitigate the tendency to fabricate information.”
From Talking about Large Language Models (2024) · cites this paper as [26]
In the citing paper
“These include general competencies such as in-context learning (ICL) [13], chain-of-thought (CoT) [17] reasoning, and instruction following [25], as well as task-specialized skills like mathematical reasoning [30].”
From A Survey of Large Language Models (2026) · cites this paper as [25]
In the citing paper
“When external reward models or ground-truth answers are available, rejection sampling can also be applied to select higher-quality responses from multiple candidates [25].”
From A Survey of Large Language Models (2026) · cites this paper as [25]
41 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
The publisher hasn’t deposited this paper’s reference list.
Cited by
Items 1,001–1,100 of 4,340
Automated Retrosynthesis Planning of Macromolecules Using Large Language Models and Knowledge Graphs
Ma, Q., Zhou, Y., & Li, J. (2025) · Macromolecular Rapid Communications · doi:10.1002/marc.202500065 · Cited by 20
Pan, J., Lee, S. “., Cheligeer, C., Martin, E. A., Riazi, K., Quan, H., & Li, N. (2025) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2025.110161 · Cited by 23
SenCLIP: Enhancing Zero-Shot Land-Use Mapping for Sentinel-2 with Ground-Level Prompting
Jain, P., Ienco, D., Interdonato, R., Berchoux, T., & Marcos, D. (2025) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv61041.2025.00552 · Cited by 26
A decade of gender bias in machine translation
Savoldi, B., Bastings, J., Bentivogli, L., & Vanmassenhove, E. (2025) · Patterns · doi:10.1016/j.patter.2025.101257 · Cited by 43
A Framework for Domain-Specific Dataset Creation and Adaptation of Large Language Models
Balaskas, G., Papadopoulos, H., Pappa, D., Loisel, Q. E. A., & CHASTIN, S. F. M. (2025) · Computers · doi:10.3390/computers14050172 · Cited by 17
Zhou, R., Gui, W., Huang, H., Liu, X., Wei, Z., & Bian, J. (2025) · Expert Systems with Applications · doi:10.1016/j.eswa.2025.128140 · Cited by 50
Intention is All you Need: Refining your Code from your Intention
Guo, Q., Xie, X., Liu, S., Hu, M., Li, X., & Bu, L. (2025) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse55347.2025.00191 · Cited by 21
SocialGen: Modeling Multi-Human Social Interaction with Language Models
Yu, H., Zhang, J., Chen, C., Xiang, T., Fang, Y., Niebles, J. C., & Adeli, E. (2026) · International Conference on 3D Vision (3DV) · doi:10.1109/3dv69130.2026.00175 · Cited by 53
MedSynapse-V: Bridging Visual Perception and Clinical Intuition via Latent Memory Evolution
Zhu, C., Wang, Y., Zeng, J., Jiang, J., & Lin, J. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37550-6_32 · Cited by 18
MobileVLA-R1: Reinforcing Vision-Language-Action for Mobile Robots
Huang, T., Li, D., Yang, R., Zhang, Z., Yang, Z., & Tang, H. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37196-6_19 · Cited by 17
AlphaOPT: Formulating Optimization Programs with Self-Improving LLM Experience Library
Kong, M., Qu, A., Guo, X., Ouyang, W., Jiang, C., Zheng, H., Ma, Y., Zhuang, D., Tang, Y., Li, J., et al. (2026) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3770855.3817974 · Cited by 18
Answering Natural Language Questions with OpenAI's GPT in the Petroleum Industry
Eckroth, J., Gipson, M., Bodén, J., Hough, L., Elliott, J., & Quintana, J. (2023) · SPE Annual Technical Conference and Exhibition · doi:10.2118/214888-ms · Cited by 16
Zhao, Y., & Han, J. (2024) · Physica D Nonlinear Phenomena · doi:10.1016/j.physd.2024.134130 · Cited by 22
CAD - Contextual Multi-modal Alignment for Dynamic AVQA
Nadeem, A., Hilton, A., Dawes, R., Thomas, G., & Mustafa, A. (2024) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv57701.2024.00709 · Cited by 18
Humans Learn Language from Situated Communicative Interactions. What about Machines?
Beuls, K., & Eecke, P. V. (2024) · Computational Linguistics · doi:10.1162/coli_a_00534 · Cited by 37
A safe reinforcement learning algorithm for supervisory control of power plants
Sun, Y., Khairy, S., Vilim, R., Hu, R., & Dave, A. J. (2024) · Knowledge-Based Systems · doi:10.1016/j.knosys.2024.112312 · Cited by 17
Fodor, J., Deyne, S. D., & Suzuki, S. (2024) · Computational Linguistics · doi:10.1162/coli_a_00536 · Cited by 31
AeroQuery RAG and LLM for Aerospace Query in Designs, Development, Standards, Certifications
Yadav, S. (2024) · IEEE International Conference on Electronics, Computing and Communication Technologies (CONECCT) · doi:10.1109/conecct62155.2024.10677028 · Cited by 16
Control Barrier Function for Aligning Large Language Models
Miyaoka, Y., & Inoue, M. (2026) · IEEE Transactions on Control Systems Technology · doi:10.1109/tcst.2026.3675329 · Cited by 17
A new era in computational pathology: A survey on foundation and vision-language models
Chanda, D., Aryal, M., Ganji, M., Parwani, A. V., & Soltani, N. Y. (2026) · Journal of Pathology Informatics · doi:10.1016/j.jpi.2026.100714 · Cited by 22
Hao, J., Yang, M., Shi, Q., Jiang, Y., Zhang, G., & Zeng, W. (2024) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2024.3514138 · Cited by 20
Long-Term Ad Memorability: Understanding & Generating Memorable Ads
Harini, S. I., Singh, S., Singla, Y. K., Bhattacharyya, A., Baths, V., Chen, C., Shah, R. R., & Krishnamurthy, B. (2025) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv61041.2025.00557 · Cited by 25
Fine-Tuning Small Language Models for Domain-Specific AI: An Edge AI Perspective
Aralimatti, R., Shakhadri, S. A. G., Kruthika, K. R., & Angadi, K. B. (2025) · Lecture notes in networks and systems · doi:10.1007/978-3-031-99965-9_31 · Cited by 19
DSPO: Direct Semantic Preference Optimization for Real-World Image Super-Resolution
Cai, M., Li, S., Li, W., Huang, X., Chen, H., Hu, J., & Wang, Y. (2026) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3767308.3835421 · Cited by 17
Tounsi, A., Elkefi, S., & Layeb, S. B. (2023) · IEEE International Conference on Advanced Systems and Emergent Technologies (IC_ASET) · doi:10.1109/ic_aset58101.2023.10150870 · Cited by 16
Tutorial: guidance on the use of large language models for medical research
Jin, Q., Wan, N., Leaman, R., Tian, S., Wang, Z., Yang, Y., Wang, Z., Xiong, G., Lai, P.-T., Zhu, Q. L., et al. (2026) · Nature Protocols · doi:10.1038/s41596-026-01408-z · Cited by 16
Verbosity Bias in Preference Labeling by Large Language Models
Saito, K., Wachi, A., Wataoka, K., & Akimoto, Y. (2023) · arXiv · doi:10.48550/arxiv.2310.10076 · Cited by 15
A comparison of chain-of-thought reasoning strategies across datasets and models
Hebenstreit, K., Praas, R., Kiesewetter, L. P., & Samwald, M. (2024) · PeerJ Computer Science · doi:10.7717/peerj-cs.1999 · Cited by 15
Natale, S., Surace, B., Mensa, E., & Befera, L. (2025) · New Media & Society · doi:10.1177/14614448251384258 · Cited by 21
Evaluating and regulating agentic AI: A study of benchmarks, metrics, and regulation
Farooq, A., Raza, S., Karim, N., Iqbal, H., Vasilakos, A. V., & Emmanouilidis, C. (2026) · Information Fusion · doi:10.1016/j.inffus.2026.104444 · Cited by 25
CoBRA: Programming Cognitive Bias in Social Agents Using Classic Social Science Experiments
Liu, X., Shang, H., & Jin, H. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3790804 · Cited by 20
“AI psychosis” in context: how conversation history shapes LLM responses to delusional beliefs
Nicholls, L., Hutto, R., Soto, Z., Morrin, H., Pollak, T. A., Korpan, R., & Carmichael, C. L. (2026) · AI and Ethics · doi:10.1007/s43681-026-01450-3 · Cited by 20
SketchXAI: A First Look at Explainability for Human Sketches
Qu, Z., Gryaditskaya, Y., Li, K., Pang, K., Xiang, T., & Song, Y.-Z. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.02234 · Cited by 28
Secure Semantic Communication Model for Black-Box Attack Challenge Under Metaverse
Li, C., Zeng, L., Huang, X., Miao, X., & Wang, S. (2023) · IEEE Wireless Communications · doi:10.1109/mwc.005.2200622 · Cited by 15
Learning the What and How of Annotation in Video Object Segmentation
Delatolas, T., Kalogeiton, V. S., & Papadopoulos, D. P. (2024) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv57701.2024.00680 · Cited by 29
ChatGPT vs. Stack Overflow: An Exploratory Comparison of Programming Assistance Tools
Liu, J., Tang, X., Li, L., Chen, P., & Liu, Y. (2023) · IEEE International Conference on Software Quality, Reliability and Security Companion (QRS-C) · doi:10.1109/qrs-c60940.2023.00105 · Cited by 19
A closer look at reinforcement learning-based automatic speech recognition
Yang, F., Yang, M., Li, X., Wu, Y., Zhao, Z., Raj, B., & Singh, R. (2024) · Computer Speech & Language · doi:10.1016/j.csl.2024.101641 · Cited by 15
Review of ambiguity problem in text summarization using hybrid ACA and SLR
Sutriawan, S., Rustad, S., Shidik, G. F., Pujiono, P., & Muljono, M. (2024) · Intelligent Systems with Applications · doi:10.1016/j.iswa.2024.200360 · Cited by 16
Quantum compiling with reinforcement learning on a superconducting processor
Wang, Z., Chen, Q., Du, Y., Yang, Z., Cai, X., Huang, K., Zhang, J.-N., Xu, K., Du, J., Li, Y., et al. (2026) · Machine Learning Science and Technology · doi:10.1088/2632-2153/ae835e · Cited by 17
Rank2Reward: Learning Shaped Reward Functions from Passive Video
Yang, D. Z., Tjia, D., Berg, J., Damen, D., Agrawal, P., & Gupta, A. (2024) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra57147.2024.10610873 · Cited by 35
Comparative Analysis of Open-Source Language Models in Summarizing Medical Text Data
Chen, Y., Wang, Z., & Zulkernine, F. (2024) · 2024 IEEE International Conference on Digital Health (ICDH) · doi:10.1109/icdh62654.2024.00030 · Cited by 15
Toubal, I. E., Avinash, A., Alldrin, N., Dlabal, J., Zhou, W., Luo, E., Stretcu, O., Xiong, H., Lu, C.-T., Zhou, H., et al. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01662 · Cited by 25
Evaluating Large Language Models for G-Code Debugging, Manipulation, and Comprehension
Jignasu, A., Marshall, K. A., Ganapathysubramanian, B., Balu, A., Hegde, C., & Krishnamurthy, A. (2024) · IEEE LLM Aided Design Workshop (LAD) · doi:10.1109/lad62341.2024.10691700 · Cited by 21
Luan, H., Yang, K., Hu, T., Hu, J., Liu, S., Li, R., He, J., Yan, R., Guo, X., Qian, N., et al. (2024) · Future Generation Computer Systems · doi:10.1016/j.future.2024.107578 · Cited by 19
OpenROAD-Assistant: An Open-Source Large Language Model for Physical Design Tasks
Sharma, U., Wu, B.-Y., Kankipati, S. R. D., Chhabria, V. A., & Rovinski, A. (2024) · ACM/IEEE Workshop on Machine Learning for CAD (MLCAD) · doi:10.1109/mlcad62225.2024.10740242 · Cited by 18
Percept, Chat, Adapt: Knowledge transfer of foundation models for open-world video recognition
Chen, B., Chen, S., Li, K., Qing-lin, X., Qiao, Y., & Wang, Y. (2024) · Pattern Recognition · doi:10.1016/j.patcog.2024.111189 · Cited by 17
Lakshminarayanan, R., Shaik, A., & Balasundaram, A. (2025) · Results in Engineering · doi:10.1016/j.rineng.2025.103943 · Cited by 16
Hou, R., Wang, X., Zhang, W., Song, Z., Wang, K., Chen, Y., Liu, J., & Ruan, T. (2025) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2025.3529682 · Cited by 18
Hu, Y., Dong, T., & Li, S. (2025) · Transportation Research Part C Emerging Technologies · doi:10.1016/j.trc.2025.105051 · Cited by 20
Detecting and Reducing the Factual Hallucinations of Large Language Models with Metamorphic Testing
Wu, W., Cao, Y., Yi, N., Ou, R., & Zheng, Z. (2025) · Proceedings of the ACM on software engineering. · doi:10.1145/3715784 · Cited by 22
Distributed training of large language models: A survey
Zeng, F., Gan, W., Wang, Y., & Yu, P. S. (2025) · Natural Language Processing Journal · doi:10.1016/j.nlp.2025.100174 · Cited by 23
Zhu, Y., Li, Z., Wang, F., & Li, L. (2023) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2023.3235732 · Cited by 15
A review: Exploring the role of ChatGPT in the diagnosis and treatment of oral pathologies
Panwar, P., & Gupta, S. (2024) · Oral Oncology Reports · doi:10.1016/j.oor.2024.100225 · Cited by 17
Promptable Behaviors: Personalizing Multi-Objective Rewards from Human Preferences
Hwang, M., Weihs, L., Park, C., Lee, K., Kembhavi, A., & Ehsani, K. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01535 · Cited by 44
PRvL: Quantifying the Capabilities and Risks of Large Language Models for PII Redaction
Garza, L., Kotal, A., Piplai, A., Elluri, L., Das, P. K., & Chadha, A. R. (2025) · IEEE International Conference on Trust, Privacy and Security in Intelligent Systems and Applications (TPS-ISA) · doi:10.1109/tps-isa67132.2025.00025 · Cited by 15
FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generation
Min, S., Krishna, K., Lyu, X., Lewis, M., Yih, W.-T., Koh, P. W., Iyyer, M., Zettlemoyer, L., & Hajishirzi, H. (2023) · arXiv · doi:10.48550/arxiv.2305.14251 · Cited by 14
Query Rewriting for Retrieval-Augmented Large Language Models
Ma, X., Gong, Y., He, P., Zhao, H., & Duan, N. (2023) · arXiv · doi:10.48550/arxiv.2305.14283 · Cited by 14
“The experiments are implemented on T5-large (Raffel et al., 2020) as the rewriter, ChatGPT (Ouyang et al., 2022) and Vicuna-13B (Chiang et al., 2023) as the LLM reader.”
MethodThe Instruction Hierarchy: Training LLMs to Prioritize Privileged Instructions
Wallace, E., Xiao, K., Leike, R., Weng, L., Heidecke, J., & Beutel, A. (2024) · arXiv · doi:10.48550/arxiv.2404.13208 · Cited by 14
“5 Turbo using supervised finetuning and reinforcement learning from human feedback (Ouyang et al., 2022; OpenAI, 2023) on the aforementioned data, as well as data for model capabilities.”
MethodPolitical Ideology Shifts in Large Language Models
Bernardelle, P., Civelli, S., Fröhling, L., Lunardi, R., Roitero, K., & Demartini, G. (2026) · Information Processing & Management · doi:10.1016/j.ipm.2026.105124 · Cited by 14
DeepResearch-9K: A Challenging Benchmark Dataset of Deep-Research Agent
Wu, T., Wang, Y., Ma, X., He, X., Wang, S., Yin, D., & Zhao, X. (2026) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3805712.3808597 · Cited by 16
Studying Psychosis Using Natural Language Generation: A Review of Emerging Opportunities
Palaniyappan, L. K., Benrimoh, D. A., Voppel, A., & Rocca, R. (2023) · Biological Psychiatry Cognitive Neuroscience and Neuroimaging · doi:10.1016/j.bpsc.2023.04.009 · Cited by 17
A Generative Model to Embed Human Expressivity into Robot Motions
Osorio, P., Sagawa, R., Abe, N., & Venture, G. (2024) · Sensors · doi:10.3390/s24020569 · Cited by 15
The automated model of comprehension version 4.0 – Validation studies and integration of ChatGPT
Corlatescu, D.-G., Watanabe, M., Ruşeţi, Ş., Dascălu, M., & McNamara, D. S. (2024) · Computers in Human Behavior · doi:10.1016/j.chb.2024.108154 · Cited by 15
Generative AI for controllable protein sequence design: A survey
Zhu, Y., Kong, Z., Wu, J., Yin, M., Liu, W., Han, Y., Xu, H., Hsieh, C., Hou, T., & Wu, J. (2026) · npj Drug Discovery. · doi:10.1038/s44386-026-00054-5 · Cited by 17
Self-citationLLM-Assisted Data Augmentation for Chinese Dialogue-Level Dependency Parsing
Zhang, M., Jiang, G., Liu, S., Chen, J., & Zhang, M. (2024) · Computational Linguistics · doi:10.1162/coli_a_00515 · Cited by 29
Improving algorithmic trading consistency via human alignment and imitation learning
Huang, Y., Zhou, C., Cui, K., & Lu, X. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2024.124350 · Cited by 14
Adaptive Masked Autoencoder Transformer for image classification
Chen, X., Liu, C., Hu, P., Lin, J., Gong, Y., Chen, Y., Peng, D., & Geng, X. (2024) · Applied Soft Computing · doi:10.1016/j.asoc.2024.111958 · Cited by 18
Reward Learning from Suboptimal Demonstrations with Applications in Surgical Electrocautery
Karimi, Z., Ho, S.-H., Thach, B., Kuntz, A., & Brown, D. S. (2024) · International Symposium on Medical Robotics · doi:10.1109/ismr63436.2024.10585785 · Cited by 16
MORPHeus: a Multimodal One-armed Robot-assisted Peeling System with Human Users In-the-loop
Ye, R., Hu, Y., Bian, Y. A., Kulm, L., & Bhattacharjee, T. (2024) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra57147.2024.10610050 · Cited by 25
Interactive probes: Towards action-level evaluation for dialogue systems
Liesenfeld, A., & Dingemanse, M. (2024) · Discourse & Communication · doi:10.1177/17504813241267071 · Cited by 14
Comparative Analysis of Large Language Models in Chinese Medical Named Entity Recognition
Zhu, Z., Zhao, Q. Z., Li, J., Ge, Y., Ding, X., Gu, T., Zou, J., Lv, S., Wang, S., & Yang, J. (2024) · Bioengineering · doi:10.3390/bioengineering11100982 · Cited by 16
Data-driven analysis of text-mined seed-mediated syntheses of gold nanoparticles
Lee, S., Cruse, K., Gleason, S. P., Alivisatos, A. P., Ceder, G., & Jain, A. (2025) · Digital Discovery · doi:10.1039/d4dd00158c · Cited by 17
Hooshangnejad, H., Huang, G., Kelly, K., Feng, X., Luo, Y., Zhang, R., Xu, Z., Chen, Q., & Ding, K. (2024) · Cancers · doi:10.3390/cancers16234097 · Cited by 16
DeepMSD: Advancing Multimodal Sarcasm Detection Through Knowledge-Augmented Graph Reasoning
Wei, Y., Zhou, H., Yuan, S., Chen, M., Shi, H., Jia, Z., Wang, L., & He, X. (2025) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2025.3530436 · Cited by 20
One Sentence Can Kill the Bug: Auto-Replay Mobile App Crashes From One-Sentence Overviews
Huang, Y., Wang, J., Liu, Z., Li, M., Wang, S., Chen, C., Hu, Y., & Wang, Q. (2025) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2025.3535938 · Cited by 16
Saxena, S., Chang, O. L. B., Suppan, M., Meço, B. C., Vacas, S., Radtke, F. M., Matot, I., Devos, A., Maze, M., Gisselbaek, M., et al. (2025) · British Journal of Anaesthesia · doi:10.1016/j.bja.2025.01.001 · Cited by 14
TF-Attack: Transferable and fast adversarial attacks on large language models
Li, Z., Chen, K., Liu, L., Bai, X., Yang, M., Xiang, Y., & Zhang, M. (2025) · Knowledge-Based Systems · doi:10.1016/j.knosys.2025.113117 · Cited by 26
The double-edged sword of generative AI: surpassing an expert or a deceptive “false friend”?
Altorfer, F. C. S., Kelly, M., Avrumova, F., Rohatgi, V., Zhu, J., Bono, C. M., & Lebl, D. R. (2025) · The Spine Journal · doi:10.1016/j.spinee.2025.02.010 · Cited by 15
Online Learning from Strategic Human Feedback in LLM Fine-Tuning
Hao, S., & Duan, L. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10887891 · Cited by 14
CharacterFactory: Sampling Consistent Characters With GANs for Diffusion Models
Wang, Q., Li, B., Li, X., Cao, B., Ma, L., Lu, H., & Jia, X. (2025) · IEEE Transactions on Image Processing · doi:10.1109/tip.2025.3558668 · Cited by 21
Visual Prompt Learning of Foundation Models for Post-Disaster Damage Evaluation
Zhao, F., Zhang, C., Zhang, R., & Wang, T. (2025) · Remote Sensing · doi:10.3390/rs17101664 · Cited by 15
Self-citationSMUTF: Schema Matching Using Generative Tags and Hybrid Features
Zhang, Y., Mei, D., Luo, H., Xu, C., & Tsai, R. T. (2025) · Information Systems · doi:10.1016/j.is.2025.102570 · Cited by 22
LoRP: LLM-based Logical Reasoning via Prolog
Di, Z., Zhang, C., Lv, H., Cui, L., & Liu, L. (2025) · Knowledge-Based Systems · doi:10.1016/j.knosys.2025.114140 · Cited by 18
Self-citationReviewing clinical knowledge in medical large language models: Training and beyond
Li, Q. Y., Liu, H., Guo, C., Gao, C., Chen, D., Wang, M., Gao, F., van Harmelen, F., & Gu, J. (2025) · Knowledge-Based Systems · doi:10.1016/j.knosys.2025.114215 · Cited by 20
Evaluating the Impact of Advanced LLM Techniques on AI Lecture Tutors for a Robotics Course
Kahl, S., Löffler, F., Maciol, M., Ridder, F., Schmitz, M., Spanagel, J., Wienkamp, J., Burgahn, C., & Schilling, M. (2025) · Communications in computer and information science · doi:10.1007/978-3-031-93409-4_14 · Cited by 16
Latent Feature Activation Steering for Enhancing Semantic Consistency in Large Language Models
Yang, J., Li, R., Wang, W., Zhou, Z., Feng, Z., & Peng, W. (2025) · Lecture notes in computer science · doi:10.1007/978-981-95-3346-6_13 · Cited by 16
Zhou, Y., Zhu, C., & Zhu, W. (2024) · Information Processing & Management · doi:10.1016/j.ipm.2024.103705 · Cited by 14
Model Inversion Attack Against Transfer Learning: Inverting a Model Without Querying It
Ye, D., Chen, H., Zhou, S., Zhu, T., Zhou, W., & Ji, S. (2025) · IEEE Transactions on Dependable and Secure Computing · doi:10.1109/tdsc.2025.3548119 · Cited by 16
Adapting language generation to dialogue environments and users for task-oriented dialogue systems
Ohashi, A., & Higashinaka, R. (2025) · Natural Language Processing Journal · doi:10.1016/j.nlp.2025.100153 · Cited by 14
MeshLLM: Empowering Large Language Models to Progressively Understand and Generate 3D Mesh
Fang, S., Shen, I., Wang, Y., Tsai, Y., Yang, Y., Zhou, S., Ding, W., Igarashi, T., & Yang, M. (2025) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.01305 · Cited by 46
Kestrel: 3D Multimodal LLM for Part-Aware Grounded Description
Ahmed, M., Fei, J., Ding, J., Bakr, E. M., & Elhoseiny, M. (2025) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.00839 · Cited by 18
Entity Ranking with Covariates and Sparse Intrinsic Scores
Fan, J., Hou, J., & Yu, M. (2026) · Journal of the American Statistical Association · doi:10.1080/01621459.2026.2735065 · Cited by 13
Absolute Zero: Reinforced Self-play Reasoning with Zero Data
Zhao, A., Wu, Y., Yue, Y., Wu, T., Xu, Q., Yue, Y., Lin, M., Wang, S., Wu, Q., Zheng, Z., et al. (2025) · arXiv · Cited by 13
Malla: Demystifying Real-world Large Language Model Integrated Malicious Services
Lin, Z., Cui, J., Liao, X., & Wang, X. (2024) · arXiv · doi:10.48550/arxiv.2401.03315 · Cited by 13
“5/4 has undergone extensive training incorporating human feedback and red-teaming methods [36,114].”
BackgroundMethodTo Protect the LLM Agent Against the Prompt Injection Attack with Polymorphic Prompt
Wang, Z., Nagaraja, N., Zhang, L., Bahsi, H., Patil, P., & Liu, P. (2025) · 2025 55th Annual IEEE/IFIP International Conference on Dependable Systems and Networks - Supplemental Volume (DSN-S) · doi:10.1109/dsn-s65789.2025.00037 · Cited by 13
“The LLM hardening focuses on improving the model itself to resist prompt injections, typically through adversarial fine-tuning [5], or Reinforcement Learning with Human Feedback (RLHF) [6, 7].”
Wang, G., Che, J., Gao, C., Zhou, H., Shen, J., Cheng, Z., & Zhou, P. (2025) · Advanced Materials · doi:10.1002/adma.202508029 · Cited by 20
ORThought: Benchmarking and automating logistics optimization modeling via structured LLM reasoning
Yang, B., Zhou, Q., Li, J., Su, C., Angeloudis, P., & Hu, S. (2026) · Artificial Intelligence for Transportation · doi:10.1016/j.ait.2026.100059 · Cited by 18
Lin, J., Zhu, C., Kneuertz, P. J., Bai, Y., & Xue, Y. (2026) · 2026 IEEE/CVF Conference on Computer Vision and Pattern Recognition- FINDINGS Track (CVPRF) · doi:10.1109/cvprf71909.2026.00534 · Cited by 23
Zero-shot Learning for Named Entity Recognition in Software Specification Documents
Das, S., Deb, N., Cortesi, A., & Chaki, N. (2023) · IEEE International Requirements Engineering Conference (RE) · doi:10.1109/re57278.2023.00019 · Cited by 13
(2023) · doi:10.3390/s23218924 · Cited by 13
Metadata
- Authors
- Ouyang, L., Wu, J., Jiang, X., Almeida, D., Wainwright, C., Mishkin, P., Zhang, C., Agarwal, S., Slama, K., Ray, A., Schulman, J., Hilton, J., Kelton, F., Miller, L., Simens, M., Askell, A., Welinder, P., Christiano, P., Leike, J., & Lowe, R.
- Venue
- Advances in Neural Information Processing Systems 35
- Published
- 2022
- Pages
- 27730-27744
- ISSN
- 1049-5258 (ISSN-L)
- OpenAlex
- W7133211372
- Cited by
- 3,117
- References
- 0
- Citations by year
- 2026: 1421 · 2025: 544 · 2024: 852 · 2023: 297 · 2022: 3
- FWCI
- 234.27
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- neural information processing systems (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Keywords
- instruction following, language models, human feedback, reinforcement learning from human feedback, large language models
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.