Training Language Models to Follow Instructions with Human Feedback
The DOI matches its Crossref record; 2 of the 2 references it cites were found in a registry or an index.
Abstract
Making language models bigger does not inherently make them better at following a user's intent. For example, large language models can generate outputs that are untruthful, toxic, or simply not helpful to the user. In other words, these models are not aligned with their users. In this paper, we show an avenue for aligning language models with user intent on a wide range of tasks by fine-tuning with human feedback. Starting with a set of labeler-written prompts and prompts submitted through the OpenAI API, we collect a dataset of labeler demonstrations of the desired model behavior, which we use to fine-tune GPT-3 using supervised learning. We then collect a dataset of rankings of model outputs, which we use to further fine-tune this supervised model using reinforcement learning from human feedback. We call the resulting models InstructGPT. In human evaluations on our prompt distribution, outputs from the 1.3B parameter InstructGPT model are preferred to outputs from the 175B GPT-3, despite having 100x fewer parameters. Moreover, InstructGPT models show improvements in truthfulness and reductions in toxic output generation while having minimal performance regressions on public NLP datasets. Even though InstructGPT still makes simple mistakes, our results show that fine-tuning with human feedback is a promising direction for aligning language models with human intent.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Existing literature (Ouyang et al., 2022) does not fully describe the details of these models, such as the pretraining corpus, model sizes, and model biases.”
From Self-Refine: Iterative Refinement with Self-Feedback (2023) · cites this paper as Ouyang et al., 2022
Experimental — accuracy not yet measuredIn the citing paper
“Specifically, providers mitigate race and gender bias through reinforcement learning from human feedback (RLHF), adversarial stress-testing known as red teaming, and hard-coded refusals governed by the provider's own content policies [6, 43, 71].”
From All Public Voices Are Equal, But Are Some More Equal Than Others to LLMs? (2026) · cites this paper as [71]
In the citing paper
“Fine-tuning a model from human feedback at scale, using preference data from paid raters or drawn from a large and willing user base, is an especially potent technique.It has the potential not only to shape a model's responses to better reflect user norms (for better or worse), but also to filter out toxic language, improve factual accuracy, and mitigate the tendency to fabricate information.”
From Talking about Large Language Models (2024) · cites this paper as [26]
In the citing paper
“These include general competencies such as in-context learning (ICL) [13], chain-of-thought (CoT) [17] reasoning, and instruction following [25], as well as task-specialized skills like mathematical reasoning [30].”
From A Survey of Large Language Models (2026) · cites this paper as [25]
In the citing paper
“When external reward models or ground-truth answers are available, rejection sampling can also be applied to select higher-quality responses from multiple candidates [25].”
From A Survey of Large Language Models (2026) · cites this paper as [25]
41 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
The publisher hasn’t deposited this paper’s reference list.
Cited by
Items 801–900 of 4,340
HackMentor: Fine-Tuning Large Language Models for Cybersecurity
Zhang, J., Wen, H., Deng, L., Xin, M., Li, Z., Li, L., Zhu, H., & Sun, L. (2023) · IEEE International Conference on Trust, Security and Privacy in Computing and Communications (TrustCom) · doi:10.1109/trustcom60117.2023.00076 · Cited by 36
A Superalignment Framework in Autonomous Driving with Large Language Models
Kong, X., Bräunl, T., Fahmi, M., & Wang, Y. (2024) · IEEE Intelligent Vehicles Symposium · doi:10.1109/iv55156.2024.10588403 · Cited by 29
Learning Agile Bipedal Motions on a Quadrupedal Robot
Li, Y., Li, J., Fu, W., & Wu, Y. (2024) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra57147.2024.10611442 · Cited by 37
Human Participants in AI Research: Ethics and Transparency in Practice
McKee, K. R. (2024) · IEEE Transactions on Technology and Society · doi:10.1109/tts.2024.3446183 · Cited by 31
Investigating Hallucinations in Pruned Large Language Models for Abstractive Summarization
Chrysostomou, G., Zhao, Z., Williams, M., & Αλέτρας, Ν. (2024) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00695 · Cited by 45
Regressor-Segmenter Mutual Prompt Learning for Crowd Counting
Guo, M., Yuan, L., Yan, Z., Chen, B., Wang, Y., & Ye, Q. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02681 · Cited by 38
Beyond Text: Frozen Large Language Models in Visual Signal Comprehension
Zhu, L., Wei, F., & Lu, Y. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02554 · Cited by 45
ASAM: Boosting Segment Anything Model with Adversarial Tuning
Li, B. H., Xiao, H., & Tang, L. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00355 · Cited by 37
Driving Style Alignment for LLM-powered Driver Agent
Yang, R., Zhang, X., Fernandez-Laaksonen, A., Ding, X., & Gong, J. (2024) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros58592.2024.10802629 · Cited by 24
Hyperion: Unveiling DApp Inconsistencies Using LLM and Dataflow-Guided Symbolic Execution
Yangt, S., Lin, X., Chen, J., Zhong, Q., Xiao, L., Huang, R., Wang, Y., & Zheng, Z. (2025) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse55347.2025.00015 · Cited by 24
TaskBench: Benchmarking Large Language Models for Task Automation
Shen, Y., Song, K., Tan, X., Zhang, W., Ren, K., Yuan, S., Lu, W., Li, D., & Zhuang, Y. (2023) · arXiv · doi:10.48550/arxiv.2311.18760 · Cited by 24
“Here, we choose the GPT family (Brown et al., 2020; Ouyang et al., 2022; OpenAI, 2023) and open-source LLMs (Touvron et al., 2023a; Chiang et al., 2023; Rozi`ere et al., 2023; Xu et al., 2023; Yang et al., 2023) as our main evaluation.”
BackgroundMethodInfluence of External Information on Large Language Models Mirrors Social Cognitive Patterns
Bian, N., Lin, H., Liu, P., Lu, Y., Zhang, C., He, B., Han, X., & Sun, L. (2023) · arXiv · doi:10.48550/arxiv.2305.04812 · Cited by 24
Self-citationQwen-Audio: Advancing Universal Audio Understanding via Unified Large-Scale Audio-Language Models
Chu, Y., Xu, J., Zhou, X., Yang, Q., Zhang, S., Yan, Z., Zhou, C., & Zhou, J. (2023) · arXiv · doi:10.48550/arxiv.2311.07919 · Cited by 61
“Prior works for instruction following mainly inherit the capabilities from large (multimodal) LLMs and adopt light-weight supervised fine-tuning to activate the abilities of the model to align with user intent (Ouyang et al., 2022; Wang et al., 2023a; Gong et al., 2023b).”
BackgroundInfluentialRLEF: Grounding Code LLMs in Execution Feedback with Reinforcement Learning
Gehring, J., Zheng, K., Copet, J., Mella, V., Carbonneaux, Q., Cohen, T., & Synnaeve, G. (2024) · arXiv · doi:10.48550/arxiv.2410.02089 · Cited by 23
“…agent offering a natural language interface has to possess two skills: First, the ability to accurately deduce a user’s intent when prompted; for LLMs, this is typically achieved by fine-tuning to follow instructions according to user preferences (Ouyang et al., 2022; Rafailov et al., 2023).”
LLM-controller: Dynamic robot control adaptation using large language models
Zahedifar, R., Baghshah, M. S., & Taheri, A. (2025) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2024.104913 · Cited by 33
Zhang, M., Fang, Z., Wang, T., Lu, S., Wang, X., & Shi, T. (2025) · Expert Systems with Applications · doi:10.1016/j.eswa.2025.127717 · Cited by 48
Kim, Y.-H., Doo, H., Shin, D., Lee, S. Y., Roh, Y., Park, S., Song, H., Jung, Y., Yoo, H. J., Han, S. S., et al. (2025) · Computers & Chemical Engineering · doi:10.1016/j.compchemeng.2025.109266 · Cited by 25
Kharinaev, A., Moskvoretskii, V., Shvetsov, E., Studenikina, K. A., Bykov, M., & Burnaev, E. V. (2026) · IEEE Access · doi:10.1109/access.2026.3703899 · Cited by 26
RL from Physical Feedback: Aligning Large Motion Models with Humanoid Control
Yue, J., Wang, Z., Wang, Y., Zhang, Y., Xu, X., Cao, B., Ding, Z., Zheng, S., Wang, J., & Lu, Z. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-36984-0_35 · Cited by 24
Guiding AI to Fix Its Own Flaws: An Empirical Study on LLM-Driven Secure Code Generation
Yan, H., Vaidya, S. S., Zhang, X., & Yao, Z. (2026) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3848030 · Cited by 30
Li, H., Yu, J., Cong, X., Dang, Y., Zhang-Li, D., Lu, M., Zhan, Y., Liu, H., & Liu, Z. (2026) · AI Open · doi:10.1016/j.aiopen.2026.05.001 · Cited by 25
Probing the latent hierarchical structure of data via diffusion models *
Sclocchi, A., Favero, A., Levi, N. I., & Wyart, M. (2025) · Journal of Statistical Mechanics Theory and Experiment · doi:10.1088/1742-5468/aded6c · Cited by 27
A Cross‐Disciplinary Analysis of AI Policies in Academic Peer Review
Wang, Z., & Gong, M. (2025) · Learned Publishing · doi:10.1002/leap.2035 · Cited by 28
Assessing small language models for code generation: An empirical study with benchmarks
Hasan, M. M., Waseem, M., Kemell, K., Rasku, J., Ala-Rantala, J., & Abrahamsson, P. (2026) · Journal of Systems and Software · doi:10.1016/j.jss.2026.112815 · Cited by 31
Is ChatGPT competent? Heterogeneity in the cognitive schemas of financial auditors and robots
Wei, T., Wu, H., & Chu, G. (2023) · International Review of Economics & Finance · doi:10.1016/j.iref.2023.07.108 · Cited by 28
Woźniak, S., & Kocoń, J. (2023) · IEEE ... International Conference on Data Mining workshops · doi:10.1109/icdmw60847.2023.00108 · Cited by 23
Conversational user interfaces for maritime autonomous surface ships
Hodne, P., Skåden, O. K., Alsos, O. A., Madsen, A. N., & Porathe, T. (2024) · Ocean Engineering · doi:10.1016/j.oceaneng.2024.118641 · Cited by 23
GeoLocator: A Location-Integrated Large Multimodal Model (LMM) for Inferring Geo-Privacy
Yang, Y., Wang, S., Li, D., Sun, S., & Wu, Q. (2024) · Applied Sciences · doi:10.3390/app14167091 · Cited by 23
Efficient Pretraining and Finetuning of Quantized LLMs with Low-Rank Structure
Liu, X., Zhang, J., Wang, G., Tong, W., & Walid, A. (2024) · IEEE International Conference on Distributed Computing Systems (ICDCS) · doi:10.1109/icdcs60910.2024.00036 · Cited by 24
Wang, L., & Shen, Y. (2024) · Electronics · doi:10.3390/electronics13234584 · Cited by 32
Holmes ⌕ A Benchmark to Assess the Linguistic Competence of Language Models
Waldis, A., Perlitz, Y., Choshen, L., Hou, Y., & Gurevych, I. (2024) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00718 · Cited by 56
Contextual Emotion Recognition using Large Vision Language Models
Etesam, Y., Yalçın, Ö. N., Zhang, C., & Lim, A. (2024) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros58592.2024.10802538 · Cited by 38
Self-citationMa, Y., Ye, W., Cui, C., Zhang, H., Xing, S., Ke, F., Wang, J., Miao, C., Chen, J., Rezatofighi, H., et al. (2025) · IEEE/CVF Winter Conference on Applications of Computer Vision Workshops (WACVW) · doi:10.1109/wacvw65960.2025.00114 · Cited by 35
Prompt Sentiment: The Catalyst for LLM Change
Gandhi, V., & Gandhi, S. (2025) · International Conference on Advances in Artificial Intelligence (ICAAI) · doi:10.1145/3787279.3787299 · Cited by 22
DoLa: Decoding by Contrasting Layers Improves Factuality in Large Language Models
Chuang, Y.-S., Xie, Y., Luo, H., Kim, Y., Glass, J., & He, P. (2023) · arXiv · doi:10.48550/arxiv.2309.03883 · Cited by 29
“Ways to mitigate them include reinforcement learning from human feedback (Ouyang et al., 2022).”
Backgroundvan Duijn, M., van Dijk, B., Kouwenhoven, T., de Valk, W., Spruit, M., & vanderPutten, P. (2023) · Proceedings of the 27th Conference on Computational Natural Language Learning (CoNLL) · doi:10.18653/v1/2023.conll-1.25 · Cited by 24
Wu, X., Hao, Y., Sun, K., Chen, Y., Zhu, F., Zhao, R., & Li, H. (2023) · arXiv · doi:10.48550/arxiv.2306.09341 · Cited by 22
“InstructGPT [18] proposes to align a pre-trained language model with human feedback.”
BackgroundLiu, F., Zhou, H., Wang, K., Yu, Y., Gao, Y., Sun, Z., Liu, S., Sun, S., Zou, Z., Li, Z., et al. (2025) · Cell Reports Medicine · doi:10.1016/j.xcrm.2025.102056 · Cited by 22
“11,26 While this smaller model size facilitates easier deployment, it may limit MetaGP’s ability to encode and retain extensive medical knowledge, an area in which larger models with significantly more parameters typically excel.”
GPTArticleExtractor: An automated workflow for magnetic material database construction
Zhang, Y., Itani, S., Khanal, K., Okyere, E., Smith, G., Takahashi, K., & Zang, J. (2024) · Journal of Magnetism and Magnetic Materials · doi:10.1016/j.jmmm.2024.172001 · Cited by 26
Sun, H., He, X., Xu, J., & Peng, Y. (2024) · IEEE Transactions on Image Processing · doi:10.1109/tip.2024.3459788 · Cited by 22
Large Language Model-Aided Edge Learning in Distribution System State Estimation
Xie, R., Yin, X., Li, C., Chen, G., Liu, N., Zhao, B., & Dong, Z. Y. (2024) · IEEE Internet of Things Journal · doi:10.1109/jiot.2024.3483441 · Cited by 27
MSCoTDet: Language-Driven Multi-Modal Fusion for Improved Multispectral Pedestrian Detection
Kim, T., Chung, S., Yeom, D., Yu, Y., Kim, H. G., & Ro, Y. M. (2024) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2024.3524645 · Cited by 24
Application of generative artificial intelligence in the aquacultural sector
Fini, C., Amato, S. G., Scutaru, D., Biancardi, S., Antonucci, F., Violino, S., Ortenzi, L., Nemmi, E. N., Mei, A., Pallottino, F., et al. (2025) · Aquacultural Engineering · doi:10.1016/j.aquaeng.2025.102568 · Cited by 26
Ge, J., Zhang, X., Zheng, Y., Guo, K., & Liang, J. (2025) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2025.05.002 · Cited by 32
Yang, C., Li, C., Hu, X., Yu, H., & Lu, J. (2025) · Information Processing & Management · doi:10.1016/j.ipm.2025.104280 · Cited by 26
Chen, J., Chen, Y., Pham, D. T., Song, Y., Wu, J. D., Xing, L., & Chen, Y. (2025) · Engineering · doi:10.1016/j.eng.2025.10.027 · Cited by 32
Self-citationChem-R: Learning to Reason as a Chemist
Wang, W., Chen, B., Zhang, D., Liu, W., Gao, B., Pu, S., Sun, S., Zeng, J., Yu, T., Ouyang, W., et al. (2026) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3770855.3818854 · Cited by 30
Seven security challenges in cross-domain multi-agent LLM systems
Ko, R., Chung, J., Zheng, S., Xiao, C., Kim, T.-W., Onizuka, M., & Shin, W.-Y. (2026) · npj Artificial Intelligence · doi:10.1038/s44387-026-00128-9 · Cited by 30
Investigating Large Language Models’ Perception of Emotion Using Appraisal Theory
Yongsatianchot, N., Torshizi, P. G., & Marsella, S. (2023) · International Conference on Affective Computing and Intelligent Interaction Workshops and Demos (ACIIW) · doi:10.1109/aciiw59127.2023.10388194 · Cited by 23
Lin, Y., Li, C., Ding, M., Tomizuka, M., Zhan, W., & Althoff, M. (2024) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2024.3441493 · Cited by 28
Can ChatGPT Serve as a Multi-Criteria Decision Maker? A Novel Approach to Supplier Evaluation
Wang, X., & Wu, X. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10447204 · Cited by 32
Invited Paper: Software/Hardware Co-design for LLM and Its Application for Design Verification
Wan, L. J., Huang, Y., Li, Y., Ye, H., Wang, J., Zhang, X., & Chen, D. (2024) · Asia and South Pacific Design Automation Conference (ASP-DAC) · doi:10.1109/asp-dac58780.2024.10473893 · Cited by 49
Opportunities and challenges in the application of large artificial intelligence models in radiology
Pan, L., Zhao, Z., Lu, Y., Tang, K., Fu, L., Liang, Q., & Peng, S. (2024) · Meta-Radiology · doi:10.1016/j.metrad.2024.100080 · Cited by 26
Assessing the Code Clone Detection Capability of Large Language Models
Zhang, Z., & Saber, T. (2024) · International Conference on Code Quality (ICCQ) · doi:10.1109/iccq60895.2024.10576803 · Cited by 38
Generative Artificial Intelligence: Enhancing Patient Education in Cardiovascular Imaging
Marey, A., Saad, A. M., Killeen, B. D., Gómez, C., Tregubova, M., Unberath, M., & Umair, M. (2023) · BJR|Open · doi:10.1093/bjro/tzae018 · Cited by 31
CoachLM: Automatic Instruction Revisions Improve the Data Quality in LLM Instruction Tuning
Liu, Y., Tao, S., Zhao, X., Zhu, M. L., Ma, W., Zhu, J., Su, C., Hou, Y., Zhang, M., Zhang, M., et al. (2024) · IEEE International Conference on Data Engineering (ICDE) · doi:10.1109/icde60146.2024.00390 · Cited by 46
Boosting Your Context by Dual Similarity Checkup for In-Context Learning Medical Image Segmentation
Gao, J. Y., Lao, Q., Kang, Q., Liu, P., Du, C., Li, K., & Zhang, L. (2024) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2024.3440311 · Cited by 28
Artificial intelligence as a catalyst for combustion science and engineering
Ihme, M., & Chung, W. T. (2024) · Proceedings of the Combustion Institute · doi:10.1016/j.proci.2024.105730 · Cited by 22
Usage-based constructionist approaches and large language models
Goldberg, A. E. (2024) · Constructions and Frames · doi:10.1075/cf.23017.gol · Cited by 57
Voice user interfaces for effortless navigation in medical virtual reality environments
Hombeck, J., Voigt, H., & Lawonn, K. (2024) · Computers & Graphics · doi:10.1016/j.cag.2024.104069 · Cited by 25
Power-Llava: Large Language and Vision Assistant for Power Transmission Line Inspection
Wang, J., Li, M., Luo, H., Zhu, J., Yang, A., Rong, M., & Wang, X. (2024) · Proceedings - International Conference on Image Processing · doi:10.1109/icip51287.2024.10648271 · Cited by 22
Stability Analysis of ChatGPT-Based Sentiment Analysis in AI Quality Assurance
Ouyang, T., MaungMaung, A., Konishi, K., Seo, Y., & Echizen, I. (2024) · Electronics · doi:10.3390/electronics13245043 · Cited by 27
Safe and Balanced: A Framework for Constrained Multi-Objective Reinforcement Learning
Gu, S., Sel, B., Ding, Y., Wang, L., Lin, Q., Knoll, A., & Jin, M. (2025) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2025.3528944 · Cited by 41
WaterVG: Waterway Visual Grounding Based on Text-Guided Vision and mmWave Radar
Guan, R., Jia, L., Yao, S., Yang, F., Xu, S., Purwanto, E., Zhu, X., Man, K. L., Lim, E. G., Smith, J. S., et al. (2025) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2025.3527011 · Cited by 32
Heterogeneous Value Alignment Evaluation for Large Language Models
Zhang, Z., Zhang, C., Liu, N., Qi, S., Rong, Z., Zhu, S. C., & Yang, Y. (2025) · Lecture notes in computer science · doi:10.1007/978-3-032-00800-8_34 · Cited by 22
Self-citationOn Chatbots and Generative Artificial Intelligence
Oermann, E. K., & Kondziolka, D. S. (2023) · Neurosurgery · doi:10.1227/neu.0000000000002415 · Cited by 22
Measuring the Influence of Incorrect Code on Test Generation
Huang, D., Zhang, J. M., Harman, M., Du, M., & Cui, H. (2026) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/3744916.3764532 · Cited by 25
Tool Learning in the Wild: Empowering Language Models as Automatic Tool Agents
Shi, Z., Gao, S., Yan, L., Feng, Y., Chen, X., Chen, Z., Yin, D., Verberne, S., & Ren, Z. (2025) · Proceedings of the ACM on Web Conference 2025 · doi:10.1145/3696410.3714825 · Cited by 21
Barrier Functions Inspired Reward Shaping for Reinforcement Learning
Nilaksh, N., Ranjan, A., Agrawal, S., Jain, A., Jagtap, P., & Kolathaya, S. (2024) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra57147.2024.10610391 · Cited by 25
Liu, J., Koopman, B., Brown, N. J., Chu, K., & Nguyen, A. N. (2024) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2024.103027 · Cited by 32
Artificial Intelligence in Science and Society: The Vision of USERN
Dorigo, T., Brown, G. D., Casonato, C., Cerdà, A., Ciarrochi, J., Lio, M. D., D’Souza, N., Gauger, N. R., Hayes, S. C., Hofmann, S. G., et al. (2025) · IEEE Access · doi:10.1109/access.2025.3529357 · Cited by 27
Mohammed, T. A. S. (2025) · Information · doi:10.3390/info16060440 · Cited by 27
Adjust to reality: LLM-driven test-time semantic adjustment for zero-shot fault diagnosis
Zhao, J., Yue, J., Zhao, C., & Chen, C. (2025) · Control Engineering Practice · doi:10.1016/j.conengprac.2025.106406 · Cited by 23
A Multi-Agent LLM Defense Pipeline Against Prompt Injection Attacks
Hossain, S. M. A., Shayoni, R. K., Ameen, M. R., Islam, A., Mridha, M. F., & Shin, J. (2025) · IEEE International Women in Engineering (WIE) Conference on Electrical and Computer Engineering (WIECON-ECE) · doi:10.1109/wiecon-ece69386.2025.11526251 · Cited by 27
Bajestani, M. S., Mun, D., & Kim, D. B. (2026) · Journal of Manufacturing Systems · doi:10.1016/j.jmsy.2026.04.027 · Cited by 32
Tian, Y., Tong, C., Lee, L., Mogavi, R. H., Yong, L., & Zhou, P. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-30408-7_15 · Cited by 21
Wang, X., Huang, R., Jin, Z., Fang, T., & Qu, H. (2023) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2023.3327153 · Cited by 24
ECHO: An Approach to Enhance Use Case Quality Exploiting Large Language Models
Vito, G. D., Palomba, F., Gravino, C., Martino, S. D., & Ferrucci, F. (2023) · Euromicro Conference on Software Engineering and Advanced Applications (SEAA) · doi:10.1109/seaa60479.2023.00017 · Cited by 21
Implementing Generative AI and Large Language Models in Education
Anderson, N., McGowan, A., Galway, L., Hanna, P., Collins, M. L., & Cutting, D. (2023) · International Symposium on Innovative Approaches in Smart Technologies (ISAS) · doi:10.1109/isas60782.2023.10391517 · Cited by 21
Yuan, X., Kong, W., Luo, Z., & Xu, M. (2024) · Electronics · doi:10.3390/electronics13112077 · Cited by 22
Improving BERTScore for Machine Translation Evaluation Through Contrastive Learning
Tang, G., Yousuf, O., & Jin, Z. (2024) · IEEE Access · doi:10.1109/access.2024.3406993 · Cited by 32
Applications and Challenges for Large Language Models: From Data Management Perspective
Zhang, M., Ji, Z., Luo, Z., Wu, Y., & Chai, C. (2024) · IEEE International Conference on Data Engineering (ICDE) · doi:10.1109/icde60146.2024.00441 · Cited by 21
Zero-Shot Visual Reasoning by Vision-Language Models: Benchmarking and Analysis
Nagar, A., Jaiswal, S., & Tan, C. (2024) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn60899.2024.10650020 · Cited by 37
Using AI to assess corporate climate transition disclosures
Senni, C. C., Schimanski, T., Bingler, J., Ni, J., & Leippold, M. (2024) · Environmental Research Communications · doi:10.1088/2515-7620/ad9e88 · Cited by 22
Jin, H., Papadimitriou, G., Raghavan, K., Zuk, P., Balaprakash, P., Wang, C., Mandal, A., & Deelman, E. (2024) · International Conference for High Performance Computing, Networking, Storage and Analysis (SC) · doi:10.1109/sc41406.2024.00098 · Cited by 26
RT-Grasp: Reasoning Tuning Robotic Grasping via Multi-modal Large Language Model
Xu, J., Jin, S., Lei, Y., Zhang, Y., & Zhang, L. (2024) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros58592.2024.10801718 · Cited by 32
On Sarcasm Detection with OpenAI GPT-Based Models
Gole, M., Nwadiugwu, W., & Miranskyy, A. V. (2024) · IEEE International Conference on Collaborative Advances in Software and Computing (CASCON) · doi:10.1109/cascon62161.2024.10837875 · Cited by 37
Wu, H., Zhang, Y., Han, Z., Hou, Y., Wang, L., Liu, S., Gong, Q., & Ge, Y. (2025) · Knowledge-Based Systems · doi:10.1016/j.knosys.2025.113057 · Cited by 25
What You See is What You Get: Attention-Based Self-Guided Automatic Unit Test Generation
Yin, X., Ni, C., Xu, X., & Yang, X. (2025) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse55347.2025.00105 · Cited by 29
SALMONN: Towards Generic Hearing Abilities for Large Language Models
Tang, C., Yu, W., Sun, G., Chen, X., Tan, T., Li, W., Lu, L., Ma, Z., & Zhang, C. (2023) · arXiv · doi:10.48550/arxiv.2310.13289 · Cited by 67
“Meanwhile, instruction tuning (Wei et al., 2022a; Chung et al., 2022; Ouyang et al., 2022; Peng et al., 2023), where data is organised as pairs of user instruction (or prompt) and reference response, has emerged as an LLM training paradigm that allows LLMs to follow open-ended user instructions.”
BackgroundSelf-citationToiv, A., Saleh, Z. M., Ishak, A., Alsheik, E. H., Venkat, D., Nandi, N., & Zuchelli, T. E. (2024) · Clinical and Translational Gastroenterology · doi:10.14309/ctg.0000000000000765 · Cited by 22
MedFILIP: Medical Fine-Grained Language-Image Pre-Training
Liang, X., Li, X., Li, F., Jiang, J., Dong, Q., Wang, W., Wang, K., Dong, S., Luo, G., & Li, S. (2025) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2025.3528196 · Cited by 31
Large Language Models meet moral values: A comprehensive assessment of moral abilities
Bulla, L., Giorgis, S. D., Mongiovì, M., & Aldo Gangemi, A. (2025) · Computers in Human Behavior Reports · doi:10.1016/j.chbr.2025.100609 · Cited by 31
Bloom: Designing for LLM-Augmented Behavior Change Interactions
Jörke, M., Genç, D., Teutschbein, V., Sapkota, S., Chung, S., Schmiedmayer, P., Campero, M. I., King, A. C., Brunskill, E., & Landay, J. A. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3790506 · Cited by 25
Cortex AISQL: A Production SQL Engine for Unstructured Data
Liskowski, P., Han, B., Aggarwal, P., Chen, B., Jiang, B., Jindal, N., Li, Z., Lin, A., Schmaus, K., Tayade, J., et al. (2026) · ACM SIGMOD International Conference on Management of Data (SIGMOD) · doi:10.1145/3788853.3803093 · Cited by 29
Zaman, S., Mahmud, M. S., Mollick, A. A., Lhaden, T., Dantzler, J. Z. R., Arroyo, S., Goona, N. K., Mesbah, M., Ahsan, M. A., & Lin, Y. (2026) · The International Journal of Advanced Manufacturing Technology · doi:10.1007/s00170-026-18072-y · Cited by 24
Chen, Z., Chiappalupi, D., Lin, T., Yang, Y., Beyer, J., & Pfister, H. (2023) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2023.3326568 · Cited by 25
Exploring Early Adopters' Perceptions of ChatGPT as a Code Generation Tool
Scoccia, G. L. (2023) · IEEE/ACM International Conference on Automated Software Engineering Workshops (ASEW) · doi:10.1109/asew60602.2023.00016 · Cited by 28
Video Action Recognition with Attentive Semantic Units
Chen, Y., Chen, D., Liu, R., Li, H., & Peng, W. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00933 · Cited by 30
Kensert, A., Libin, P., Desmet, G., & Cabooter, D. (2024) · Journal of Chromatography A · doi:10.1016/j.chroma.2024.464768 · Cited by 23
Metadata
- Authors
- Ouyang, L., Wu, J., Jiang, X., Almeida, D., Wainwright, C., Mishkin, P., Zhang, C., Agarwal, S., Slama, K., Ray, A., Schulman, J., Hilton, J., Kelton, F., Miller, L., Simens, M., Askell, A., Welinder, P., Christiano, P., Leike, J., & Lowe, R.
- Venue
- Advances in Neural Information Processing Systems 35
- Published
- 2022
- Pages
- 27730-27744
- ISSN
- 1049-5258 (ISSN-L)
- OpenAlex
- W7133211372
- Cited by
- 3,117
- References
- 0
- Citations by year
- 2026: 1421 · 2025: 544 · 2024: 852 · 2023: 297 · 2022: 3
- FWCI
- 234.27
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- neural information processing systems (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Keywords
- instruction following, language models, human feedback, reinforcement learning from human feedback, large language models
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.