Training Language Models to Follow Instructions with Human Feedback
The DOI matches its Crossref record; 2 of the 2 references it cites were found in a registry or an index.
Abstract
Making language models bigger does not inherently make them better at following a user's intent. For example, large language models can generate outputs that are untruthful, toxic, or simply not helpful to the user. In other words, these models are not aligned with their users. In this paper, we show an avenue for aligning language models with user intent on a wide range of tasks by fine-tuning with human feedback. Starting with a set of labeler-written prompts and prompts submitted through the OpenAI API, we collect a dataset of labeler demonstrations of the desired model behavior, which we use to fine-tune GPT-3 using supervised learning. We then collect a dataset of rankings of model outputs, which we use to further fine-tune this supervised model using reinforcement learning from human feedback. We call the resulting models InstructGPT. In human evaluations on our prompt distribution, outputs from the 1.3B parameter InstructGPT model are preferred to outputs from the 175B GPT-3, despite having 100x fewer parameters. Moreover, InstructGPT models show improvements in truthfulness and reductions in toxic output generation while having minimal performance regressions on public NLP datasets. Even though InstructGPT still makes simple mistakes, our results show that fine-tuning with human feedback is a promising direction for aligning language models with human intent.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Existing literature (Ouyang et al., 2022) does not fully describe the details of these models, such as the pretraining corpus, model sizes, and model biases.”
From Self-Refine: Iterative Refinement with Self-Feedback (2023) · cites this paper as Ouyang et al., 2022
Experimental — accuracy not yet measuredIn the citing paper
“Specifically, providers mitigate race and gender bias through reinforcement learning from human feedback (RLHF), adversarial stress-testing known as red teaming, and hard-coded refusals governed by the provider's own content policies [6, 43, 71].”
From All Public Voices Are Equal, But Are Some More Equal Than Others to LLMs? (2026) · cites this paper as [71]
In the citing paper
“Fine-tuning a model from human feedback at scale, using preference data from paid raters or drawn from a large and willing user base, is an especially potent technique.It has the potential not only to shape a model's responses to better reflect user norms (for better or worse), but also to filter out toxic language, improve factual accuracy, and mitigate the tendency to fabricate information.”
From Talking about Large Language Models (2024) · cites this paper as [26]
In the citing paper
“These include general competencies such as in-context learning (ICL) [13], chain-of-thought (CoT) [17] reasoning, and instruction following [25], as well as task-specialized skills like mathematical reasoning [30].”
From A Survey of Large Language Models (2026) · cites this paper as [25]
In the citing paper
“When external reward models or ground-truth answers are available, rejection sampling can also be applied to select higher-quality responses from multiple candidates [25].”
From A Survey of Large Language Models (2026) · cites this paper as [25]
41 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
The publisher hasn’t deposited this paper’s reference list.
Cited by
Items 401–500 of 4,340
Foundation Models in Agriculture: A Comprehensive Review
Yin, S., Xi, Y., Zhang, X., Sun, C., & Mao, Q. (2025) · Agriculture · doi:10.3390/agriculture15080847 · Cited by 76
Remy, F., Demuynck, K., & Demeester, T. (2024) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocae029 · Cited by 64
“The first contribution of BioLORD-2023 concerns the usage of OpenAI LLMs 15 for converting into text the information contained in biomedical ontologies and their knowledge graphs, 16,17 a task where LLM’s language fluency and latent knowledge of biomedical matters proved useful.”
An Empirical Study of the Code Generation of Safety-Critical Software Using LLMs
Liu, M., Wang, J., Lin, T., Ma, Q., Fang, Z., & Wu, Y. (2024) · Applied Sciences · doi:10.3390/app14031046 · Cited by 79
DiffMat: Data-driven inverse design of energy-absorbing metamaterials using diffusion model
Wang, H., Du, Z., Feng, F., Kang, Z., Tang, S., & Guo, X. (2024) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2024.117440 · Cited by 73
The alignment problem from a deep learning perspective
Ngo, R., Chan, L., & Mindermann, S. (2022) · arXiv · doi:10.48550/arxiv.2209.00626 · Cited by 68
“A salient example comes from InstructGPT, which was trained using RLHF to follow instructions in English, but generalized to following instructions in French— suggesting that it learned some representation of obedience which applied robustly across languages [Ouyang et al., 2022, Appendix F].”
BackgroundMethodShapeGPT: 3D Shape Generation With a Unified Multi-Modal Language Model
Yin, F., Chen, X., Zhang, C., Jiang, B., Zhao, Z., Liu, W., Yu, G., & Chen, T. (2025) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2025.3535389 · Cited by 75
Self-citationMcIntosh, T. R., Susnjak, T., Liu, T., Watters, P., & Halgamuge, M. N. (2024) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2024.3377445 · Cited by 62
“More recent efforts looked at eliciting natural language critiques or comparisons from humans that provide more informative and sophisticated feedback [17], [23], [24], [25], [35], [37].”
BackgroundMethodSystems engineering issues for industry applications of large language model
Chen, W., Yan-yi, L., Tie-zheng, G., Li, D., Tao, H., Li, Z., Yang, Q., Hui-han, W., & Ying-you, W. (2023) · Applied Soft Computing · doi:10.1016/j.asoc.2023.111165 · Cited by 78
Machine learning applied to the design and optimization of polymeric materials: A review
Pai, S. M., Shah, K. A., Sunder, S., Albuquerque, R. Q., Brütting, C., & Ruckdäschel, H. (2024) · Next Materials · doi:10.1016/j.nxmate.2024.100449 · Cited by 80
DeepSeek vs. ChatGPT: prospects and challenges
Jin, I., Tangsrivimol, J. A., Darzidehkalani, E., Virk, H. U. H., Wang, Z., Egger, J., Hacking, S. M., Glicksberg, B. S., Strauß, M., & Krittanawong, C. (2025) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2025.1576992 · Cited by 70
Data Formulator: AI-powered Concept-driven Visualization Authoring
Wang, C., Thompson, J., & Lee, B. (2023) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2023.3326585 · Cited by 104
Supervising the search process produces reliable and generalizable information-seeking agents
Xiong, G., Jin, Q., Wang, X., Yin, F., Liu, H., Yang, Y., Chen, F., Song, Z., Wang, D., Zhang, M., et al. (2026) · Nature Communications · doi:10.1038/s41467-026-78807-z · Cited by 63
Ren, L., Wang, H., Dong, J., Jia, Z., Li, S., Wang, Y., Laili, Y., Huang, D., Li, Z., & Li, B. (2025) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2025.3527632 · Cited by 72
Exploring Effective Factors for Improving Visual In-Context Learning
Sun, Y., Chen, Q., Wang, J., Wang, J., & Li, Z. (2025) · IEEE Transactions on Image Processing · doi:10.1109/tip.2025.3554410 · Cited by 74
DSPy: Compiling Declarative Language Model Calls into Self-Improving Pipelines
Khattab, O., Singhvi, A., Maheshwari, P., Zhang, Z., Santhanam, K., Vardhamanan, S., Haq, S., Sharma, A., Joshi, T. T., Moazam, H., et al. (2023) · arXiv · doi:10.48550/arxiv.2310.03714 · Cited by 911
“A growing body of work has revealed that, especially with instruction tuning (Ouyang et al., 2022), we can elicit sophisticated behavior via prompting (Wei et al., 2022; Wang et al., 2022b; Press et al., 2022; Yao et al., 2022; Khot et al., 2022; Madaan et al., 2023).”
BackgroundRay, A. T., Bhat, A. P., White, R. T., Nguyễn, V. M., Fischer, O. J. P., & Mavris, D. N. (2023) · Aerospace · doi:10.3390/aerospace10090770 · Cited by 60
Self-citationYes but.. Can ChatGPT Identify Entities in Historical Documents?
González-Gallardo, C.-E., Boroş, E., Girdhar, N., Hamdi, A. T. E., Moreno, J. G., & Doucet, A. (2023) · ACM/IEEE Joint Conference on Digital Libraries · doi:10.1109/jcdl57899.2023.00034 · Cited by 77
A comprehensive survey for generative data augmentation
Chen, Y., Yan, Z., & Zhu, Y. (2024) · Neurocomputing · doi:10.1016/j.neucom.2024.128167 · Cited by 76
ZONE: Zero-Shot Instruction-Guided Local Editing
Li, S., Zeng, B., Feng, Y., Gao, S., Liu, X.-J., Liu, J., Li, L., Tang, X., Hu, Y. G., Liu, J., et al. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00598 · Cited by 113
Influence of External Information on Large Language Models Mirrors Social Cognitive Patterns
Bian, N., Lin, H., Liu, P., Lu, Y., Zhang, C.-P., He, B., Han, X., & Sun, L. (2024) · IEEE Transactions on Computational Social Systems · doi:10.1109/tcss.2024.3476030 · Cited by 72
Self-citationLLaMoCo: Instruction Tuning of Large Language Models for Optimization Code Generation
Ma, Z., Gong, Y., Guo, H., Chen, J., Ma, Y., Cao, Z., & Zhang, J. (2026) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2026.3656374 · Cited by 78
Radiology-GPT: A Large Language Model for Radiology
Liu, Z., Zhong, A., Li, Y., Yang, L., Ju, C., Wu, Z., Ma, C., Shu, P., Chen, C., Kim, S., et al. (2023) · arXiv · doi:10.48550/arxiv.2306.08666 · Cited by 59
“Our methodology is based on the principle of instruction-tuning [35, 27, 36].”
HalluciDoctor: Mitigating Hallucinatory Toxicity in Visual Instruction Data
Yu, Q., Li, J., Wei, L., Pang, L., Ye, W., Qin, B., Tang, S., Tian, Q., & Zhuang, Y. (2024) · 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52733.2024.01230 · Cited by 59
MeSAM: Multiscale Enhanced Segment Anything Model for Optical Remote Sensing Images
Zhou, X., Liang, F., Chen, L., Liu, H., Song, Q., Vivone, G., & Chanussot, J. (2024) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2024.3398038 · Cited by 90
Scaffolding Language Learning via Multi-modal Tutoring Systems with Pedagogical Instructions
Liu, Z., Yin, S. X., Lee, C., & Chen, N. F. (2024) · IEEE Conference on Artificial Intelligence (CAI) · doi:10.1109/cai59869.2024.00223 · Cited by 73
GPT4Point: A Unified Framework for Point-Language Understanding and Generation
Qi, Z., Fang, Y., Sun, Z., Wu, X., Wu, T., Wang, J., Lin, D., & Zhao, H. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02495 · Cited by 128
Moto: Latent Motion Token as the Bridging Language for Learning Robot Manipulation from Videos
Chen, Y., Ge, Y., Tang, W., Li, Y., Ge, Y., Ding, M., Shan, Y., & Liu, X. (2025) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.01837 · Cited by 149
MemGPT: Towards LLMs as Operating Systems
Packer, C., Wooders, S., Lin, K., Fang, V., Patil, S. G., Stoica, I., & Gonzalez, J. E. (2023) · arXiv · doi:10.48550/arxiv.2310.08560 · Cited by 64
Inference-Time Intervention: Eliciting Truthful Answers from a Language Model
Li, K., Patel, O., Viégas, F., Pfister, H., & Wattenberg, M. (2023) · Advances in Neural Information Processing Systems 36 · doi:10.52202/075280-1797 · Cited by 117
“In (Bai et al., 2022a; Menick et al., 2022), RLHF barely improves base models’ performance.”
MethodInfluentialAn, J., Huang, D., Lin, C., & Tai, M. (2025) · PNAS Nexus · doi:10.1093/pnasnexus/pgaf089 · Cited by 58
“This aligns with broader findings in AI research, where language technologies have been shown to perpetuate — and in some cases, amplify — societal biases (8, 9, 15 – 18).”
Kim, S. S. Y., Vaughan, J. W., Liao, Q. V., Lombrozo, T., & Russakovsky, O. (2025) · Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3714020 · Cited by 58
“Since LLMs are often fine-tuned on human preference data via approaches such as Reinforcement Learning from Human Feedback (RLHF) [23, 91, 137], such preferences would shape the form of their outputs.”
Kajiwara, Y., Matsuoka, A., & Shinbo, F. (2023) · Computers and Education Artificial Intelligence · doi:10.1016/j.caeai.2023.100162 · Cited by 65
ChatEDA: A Large Language Model Powered Autonomous Agent for EDA
He, Z., Wu, H., Zhang, X., Yao, X., Zheng, S., Zheng, H., & Yu, B. (2023) · ACM/IEEE Workshop on Machine Learning for CAD (MLCAD) · doi:10.1109/mlcad58807.2023.10299852 · Cited by 76
FashionGPT: LLM instruction fine-tuning with multiple LoRA-adapter fusion
Gao, D., Ma, Y., Liu, S., Song, M., Jin, L., Jiang, W. R., Wang, X., Ning, W., Yu, S., Xuan, Q., et al. (2024) · Knowledge-Based Systems · doi:10.1016/j.knosys.2024.112043 · Cited by 65
LMEye: An Interactive Perception Network for Large Language Models
Li, Y., Hu, B., Chen, X., Ma, L., Xu, Y. D., & Zhang, M. (2024) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2024.3428317 · Cited by 70
A Survey of Test-time Compute: From Intuitive Inference to Deliberate Reasoning
Ji, Y., Li, J., Xiang, Y., Ye, H., Wu, K., Kai, Y., Xu, J., Mo, L., & Zhang, M. (2026) · Computational Linguistics · doi:10.1162/coli.a.629 · Cited by 66
PMC-VQA: Visual Instruction Tuning for Medical Visual Question Answering
Zhang, X., Wu, C., Zhao, Z., Lin, W., Zhang, Y., Wang, Y., & Xie, W. (2023) · arXiv · doi:10.48550/arxiv.2305.10415 · Cited by 66
“Large Language Models (LLMs) have recently achieved tremendous success [28, 27, 1] in generating high-quality text for various tasks such as language translation, summarization, and question answering.”
BackgroundCRITIC: Large Language Models Can Self-Correct with Tool-Interactive Critiquing
Gou, Z., Shao, Z., Gong, Y., Shen, Y., Yang, Y., Duan, N., & Chen, W. (2023) · arXiv · doi:10.48550/arxiv.2305.11738 · Cited by 561
“The remarkable progress of large language models (LLMs), such as ChatGPT, has been amply demonstrated across an array of language tasks (Brown et al., 2020; Ouyang et al., 2022).”
BackgroundMethodInfluentialOlausson, T., Gu, A., Lipkin, B., Zhang, C., Solar-Lezama, A., Tenenbaum, J., & Levy, R. (2023) · Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2023.emnlp-main.313 · Cited by 57
Self-citationIdentifying and Mitigating the Security Risks of Generative AI
Barrett, C., Boyd, B., Bursztein, E., Carlini, N., Chen, B., Choi, J., Chowdhury, A. R., Christodorescu, M., Datta, A., Feizi, S., et al. (2023) · Foundations and Trends® in Privacy and Security · doi:10.1561/3300000041 · Cited by 57
“The first line involves training-time interventions to align models with predefined values [72, 8].”
MethodOniani, D., Wu, X., Visweswaran, S., Kapoor, S., Kooragayalu, S., Polanska, K., & Wang, Y. (2024) · IEEE International Conference on Healthcare Informatics (ICHI) · doi:10.1109/ichi61247.2024.00111 · Cited by 87
Chen, J., Gildin, E., & Kompantsev, G. (2024) · International journal of greenhouse gas control · doi:10.1016/j.ijggc.2024.104262 · Cited by 61
Prompts Are Programs Too! Understanding How Developers Build Software Containing Prompts
Liang, J. T., Lin, M. M., Rao, N., & Myers, B. A. (2025) · Proceedings of the ACM on software engineering. · doi:10.1145/3729342 · Cited by 73
Bridging language and action: A survey of language-conditioned robot manipulation
Yao, X., Zhou, H., Mees, O., Meng, Y., Xiao, T. G., Bisk, Y., Oh, J., Johns, E., Shridhar, M., Shah, D., et al. (2026) · The International Journal of Robotics Research · doi:10.1177/02783649261468360 · Cited by 58
Know Your Limits: A Survey of Abstention in Large Language Models
Wen, B., Yao, J., Feng, S., Xu, C., Tsvetkov, Y., Howe, B., & Wang, L. L. (2025) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00754 · Cited by 56
A Survey on Symbolic Knowledge Distillation of Large Language Models
Acharya, K., Velasquez, A., & Song, H. (2024) · IEEE Transactions on Artificial Intelligence · doi:10.1109/tai.2024.3428519 · Cited by 80
Zhang, Y., Li, Q., Nahata, S., Jamal, T., Cheng, S.-K., Cauwenberghs, G., & Jung, T. (2024) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2024.3435460 · Cited by 64
Chen, Y., Sikka, K., Cogswell, M., Ji, H., & Divakaran, A. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01350 · Cited by 133
Federated and edge learning for large language models
Piccialli, F., Chiaro, D., Qi, P., Bellandi, V., & Damiani, E. (2024) · Information Fusion · doi:10.1016/j.inffus.2024.102840 · Cited by 69
Wu, Z., Zhang, L., Cao, C., Yu, X., Liu, Z., Zhao, L., Li, Y., Dai, H., Ma, C., Li, G., et al. (2025) · IEEE Transactions on Big Data · doi:10.1109/tbdata.2025.3536928 · Cited by 62
Time Series Forecasting via Reasoning: A Slow-Thinking Approach with Reinforcement Fine-Tuned LLMs
Zhou, Y., Luo, Y., Cheng, M., Liu, Q., Wang, J., Wang, D., & Chen, E. (2026) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3799682.3840737 · Cited by 59
ChatEval: Towards Better LLM-based Evaluators through Multi-Agent Debate
Chan, C.-M., Chen, W., Su, Y., Yu, J., Xue, W., Zhang, S., Fu, J., & Liu, Z. (2023) · arXiv · doi:10.48550/arxiv.2308.07201 · Cited by 725
“Moreover, various training paradigms have been proposed to endow LLMs with the ability to accomplish tasks in a zero-shot manner and better adhere to human-provided instructions (Ouyang et al., 2022; Sanh et al., 2021; Wei et al., 2021).”
BackgroundA Survey of Direct Preference Optimization: Datasets, Theories, Variants, and Applications
Xiao, W., Wang, Z., Gan, L., Zhao, S., Li, Z., Lei, R., He, W., Tuan, L. A., Chan, L., Jiang, H., et al. (2026) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2026.3704314 · Cited by 60
HaluCheck: Explainable and verifiable automation for detecting hallucinations in LLM responses
Heo, S., Son, S., & Park, H. (2025) · Expert Systems with Applications · doi:10.1016/j.eswa.2025.126712 · Cited by 67
Jiang, H., Xia, S., Yang, Y., Xu, J., Hua, Q., Mei, Z., Hou, Y., Wei, M., Lai, L., Li, N., et al. (2024) · European Journal of Radiology · doi:10.1016/j.ejrad.2024.111458 · Cited by 62
BT-Adapter: Video Conversation is Feasible Without Video Instruction Tuning
Liu, R., Li, C., Ge, Y., Li, T. H., Shan, Y., & Li, G. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01296 · Cited by 78
Few-Shot Image Classification of Crop Diseases Based on Vision–Language Models
Zhou, Y., Yan, H., Ding, K., Cai, T., & Zhang, Y. (2024) · Sensors · doi:10.3390/s24186109 · Cited by 64
AI safety landscape for large language models: taxonomy, state-of-the-art, and future directions
Chen, C., Gong, X., Liu, Z., Jiang, W. M. W. L. H., Goh, S. Q., & Lam, K. (2026) · Artificial Intelligence Review · doi:10.1007/s10462-026-11590-x · Cited by 56
AgroGPT : Efficient Agricultural Vision-Language Model with Expert Tuning
Awais, M., Alharthi, A. H. S. A., Kumar, A., Cholakkal, H., & Anwer, R. M. (2025) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv61041.2025.00555 · Cited by 87
Towards conversational artificial intelligence for disease management
Liévin, V., Palepu, A. K., Weng, W., Saab, K. K., Stutz, D., Cheng, Y., Kulkarni, K., Mahdavi, S. S., Barral, J. K., Webster, D. R., et al. (2026) · Nature · doi:10.1038/s41586-026-10764-5 · Cited by 74
LLMs are Good Action Recognizers
Qu, H., Cai, Y., & Liu, J. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01741 · Cited by 95
ChatLLM network: More brains, more intelligence
Hao, R., Hu, L., Qi, W., Wu, Q., Zhang, Y., & Nie, L. (2025) · AI Open · doi:10.1016/j.aiopen.2025.01.001 · Cited by 65
Advancing conversational diagnostic AI with multimodal reasoning
Saab, K. K., Park, C., Strother, T., Freyberg, J., Barrett, D. G. T., Cheng, Y., Weng, W., Stutz, D., Tomašev, N., Palepu, A. K., et al. (2026) · Nature Medicine · doi:10.1038/s41591-026-04371-0 · Cited by 74
Reason4Rec: Deliberative User Preference Alignment of Large Language Models for Recommendation
Fang, Y. D., Wang, W. Y., Zhang, Y., Zhu, F., Wang, Q., Feng, F., & He, X. (2026) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2026.3699701 · Cited by 55
Discovering Language Model Behaviors with Model-Written Evaluations
Perez, E., Ringer, S., Lukošiūtė, K., Nguyen, K., Chen, E., Heiner, S., Pettit, C., Olsson, C., Kundu, S., Kadavath, S., et al. (2022) · arXiv · doi:10.48550/arxiv.2212.09251 · Cited by 53
“We hope that LM advances such as instruction-tuning (Wei et al., 2021; Sanh et al., 2022; Ouyang et al., 2022) mitigate this issue in the future.”
BackgroundSelf-citationZhang, Y., Pan, Y., Zhong, T., Dong, P., Xie, K., Liu, Y., Jiang, H., Wu, Z., Liu, Z., Zhao, W., et al. (2024) · Meta-Radiology · doi:10.1016/j.metrad.2024.100103 · Cited by 52
Self-citationDe Silva, D., Mills, N., El-Ayoubi, M., Manic, M., & Alahakoon, D. (2023) · 2023 IEEE International Conference on Industrial Technology (ICIT) · doi:10.1109/icit58465.2023.10143123 · Cited by 42
Opportunities for large language models and discourse in engineering design
Göpfert, J., Weinand, J. M., Kuckertz, P., & Stolten, D. (2024) · Energy and AI · doi:10.1016/j.egyai.2024.100383 · Cited by 54
Prompt, Plan, Perform: LLM-based Humanoid Control via Quantized Imitation Learning
Sun, J., Zhang, Q., Duan, Y., Jiang, X., Chen, C., & Xu, R. (2024) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra57147.2024.10610948 · Cited by 68
Self-citationFang, S., Liu, J., Cui, Y., Lv, C., Hang, P., & Sun, J. (2025) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2025.3552922 · Cited by 52
Zhou, Y., Ouyang, X., Shao, Z., Wang, M., & Yu, J. (2025) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2025.3562422 · Cited by 64
He, J., Wang, X., Zhu, P., Wang, X., Zhang, Y., Zhao, J., Sun, W., Hu, K., He, W., & Xie, J. (2025) · EClinicalMedicine · doi:10.1016/j.eclinm.2025.103286 · Cited by 62
Jailbreak and Guard Aligned Language Models With Only Few In-Context Demonstrations
Wei, Z., Wang, Y., Li, A., Mo, Y., & Wang, Y. (2026) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2026.3660147 · Cited by 51
(2024) · doi:10.1109/cvprw63382.2024.00188 · Cited by 51
Instruction-ViT: Multi-modal prompts for instruction learning in vision transformer
Xiao, Z., Chen, Y., Yao, J., Zhang, L., Liu, Z., Wu, Z., Yu, X., Pan, Y., Zhao, L., Ma, C., et al. (2023) · Information Fusion · doi:10.1016/j.inffus.2023.102204 · Cited by 58
Self-citationNew Paradigm for Economic and Financial Research With Generative AI: Impact and Perspective
Zheng, X., Li, J., Lu, M., & Wang, F. (2024) · IEEE Transactions on Computational Social Systems · doi:10.1109/tcss.2023.3334306 · Cited by 62
Liu, S., Chen, J., Feng, Y., Xie, Z., Pan, T., & Xie, J. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2024.124511 · Cited by 63
Artificial intelligence and machine learning applications for cultured meat
Todhunter, M. E., Jubair, S., Verma, R., Saqe, R., Shen, K., & Duffy, B. (2024) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2024.1424012 · Cited by 54
Know where to go: Make LLM a relevant, responsible, and trustworthy searchers
Shi, X. D., Liu, J., Liu, Y., Cheng, Q., & Lu, W. P. (2024) · Decision Support Systems · doi:10.1016/j.dss.2024.114354 · Cited by 72
Quo Vadis ChatGPT? From large language models to Large Knowledge Models
Venkatasubramanian, V., & Chakraborty, A. (2024) · Computers & Chemical Engineering · doi:10.1016/j.compchemeng.2024.108895 · Cited by 54
Designing Social Robots with LLMs for Engaging Human Interaction
Pinto-Bernal, M. J., Biondina, M., & Belpaeme, T. (2025) · Applied Sciences · doi:10.3390/app15116377 · Cited by 51
MeanCache: User-Centric Semantic Caching for LLM Web Services
Gill, W., Elidrisi, M., Kalapatapu, P., Ahmed, A., Anwar, A., & Gulzar, M. A. (2025) · IEEE International Parallel and Distributed Processing Symposium (IPDPS) · doi:10.1109/ipdps64566.2025.00117 · Cited by 66
Dahlgren Lindström, A., Methnani, L., Krause, L., Ericson, P., de Rituerto de Troya, Í. M., Coelho Mollo, D., & Dobbe, R. (2025) · Ethics and Information Technology · doi:10.1007/s10676-025-09837-2 · Cited by 54
VisualWebArena: evaluating multimodal agents on realistic visual web tasks
Koh, J. Y., Lo, R., Jang, L., Duvvur, V., Lim, M., Huang, P.-Y., Neubig, G., Zhou, S., Salakhutdinov, R., & Fried, D. (2024) · Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2024.acl-long.50 · Cited by 50
InstructVideo: Instructing Video Diffusion Models with Human Feedback
Yuan, H., Zhang, S., Wang, X., Wei, Y., Feng, T., Pan, Y., Zhang, Y., Liu, Z., Albanie, S., & Ni, D. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00618 · Cited by 117
Under the Influence: A Survey of Large Language Models in Fake News Detection
Kuntur, S., Wróblewska, A., Paprzycki, M., & Ganzha, M. (2024) · IEEE Transactions on Artificial Intelligence · doi:10.1109/tai.2024.3471735 · Cited by 73
Automated daily report generation from construction videos using ChatGPT and computer vision
Xiao, B., Wang, Y., Zhang, Y., Chen, C., & Darko, A. (2024) · Automation in Construction · doi:10.1016/j.autcon.2024.105874 · Cited by 54
DeepSeek: Paradigm Shifts and Technical Evolution in Large AI Models
Xiong, L., Wang, H., Chen, X., Sheng, L., Xiong, Y., Liu, J., Xiao, Y., Chen, H., Han, Q., & Tang, Y. S. (2025) · IEEE/CAA Journal of Automatica Sinica · doi:10.1109/jas.2025.125495 · Cited by 60
Li, Y., Sun, Z. Y., Mangalathu, S., Li, Y., Yang, H., & He, W. (2025) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2025.111651 · Cited by 50
Aligning protein-generative models to experimental fitness with ProteinDPO
Widatalla, T., Borah, A. A., King, S. B., Driscoll, C. L., Rafailov, R., & Hie, B. (2026) · Nature Methods · doi:10.1038/s41592-026-03137-3 · Cited by 53
Brain-Inspired Remote Sensing Foundation Models and Open Problems: A Comprehensive Survey
Jiao, L., Huang, Z., Lu, X., Liu, X., Yang, Y., Zhao, J., Zhang, J., Hou, B., Yang, S., Liu, F., et al. (2023) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2023.3316302 · Cited by 58
Deep Representation Learning: Fundamentals, Technologies, Applications, and Open Challenges
Payandeh, A., Baghaei, K. T., Fayyazsanavi, P., Ramezani, S. B., Chen, Z., & Rahimi, S. (2023) · IEEE Access · doi:10.1109/access.2023.3335196 · Cited by 64
A comparative study of cross-lingual sentiment analysis
Přibáň, P., Šmíd, J., Steinberger, J., & Mištera, A. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2024.123247 · Cited by 59
Goswami, J., Prajapati, K. K., Saha, A., & Saha, A. K. (2024) · Applied Soft Computing · doi:10.1016/j.asoc.2024.111531 · Cited by 59
AvatarGPT: All-in-One Framework for Motion Understanding, Planning, Generation and Beyond
Zhou, Z., Wan, Y., & Wang, B. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00135 · Cited by 95
L2CEval : Evaluating Language-to-Code Generation Capabilities of Large Language Models
Ni, A., Yin, P., Zhao, Y., Riddell, M., Feng, T., Shen, R., Yin, S., Ye, L., Yavuz, S., Xiong, C., et al. (2024) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00705 · Cited by 75
Large language model for knowledge synthesis and AI-enhanced biomanufacturing
Li, W., Mao, Z., Xiao, Z., Liao, X., Koffas, M. A. G., Chen, Y., Ma, H., & Tang, Y. (2025) · Trends in biotechnology · doi:10.1016/j.tibtech.2025.02.008 · Cited by 55
Generative Prompt Controlled Diffusion for weakly supervised semantic segmentation
Wu, W., Dai, T., Chen, Z., Huang, X., Ma, F., & Xiao, J. (2025) · Neurocomputing · doi:10.1016/j.neucom.2025.130103 · Cited by 64
Fine-tuning a large language model for automating computational fluid dynamics simulations
Dong, Z., Zhen Hua, L. U., & Yue, Y. (2025) · Theoretical and Applied Mechanics Letters · doi:10.1016/j.taml.2025.100594 · Cited by 49
RAID: A Shared Benchmark for Robust Evaluation of Machine-Generated Text Detectors
Dugan, L., Hwang, A., Trhlík, F., Zhu, A., Ludan, J. M., Xu, H., Ippolito, D., & Callison-Burch, C. (2024) · Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2024.acl-long.674 · Cited by 48
Metadata
- Authors
- Ouyang, L., Wu, J., Jiang, X., Almeida, D., Wainwright, C., Mishkin, P., Zhang, C., Agarwal, S., Slama, K., Ray, A., Schulman, J., Hilton, J., Kelton, F., Miller, L., Simens, M., Askell, A., Welinder, P., Christiano, P., Leike, J., & Lowe, R.
- Venue
- Advances in Neural Information Processing Systems 35
- Published
- 2022
- Pages
- 27730-27744
- ISSN
- 1049-5258 (ISSN-L)
- OpenAlex
- W7133211372
- Cited by
- 3,117
- References
- 0
- Citations by year
- 2026: 1421 · 2025: 544 · 2024: 852 · 2023: 297 · 2022: 3
- FWCI
- 234.27
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- neural information processing systems (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Keywords
- instruction following, language models, human feedback, reinforcement learning from human feedback, large language models
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.