Training Language Models to Follow Instructions with Human Feedback
The DOI matches its Crossref record; 2 of the 2 references it cites were found in a registry or an index.
Abstract
Making language models bigger does not inherently make them better at following a user's intent. For example, large language models can generate outputs that are untruthful, toxic, or simply not helpful to the user. In other words, these models are not aligned with their users. In this paper, we show an avenue for aligning language models with user intent on a wide range of tasks by fine-tuning with human feedback. Starting with a set of labeler-written prompts and prompts submitted through the OpenAI API, we collect a dataset of labeler demonstrations of the desired model behavior, which we use to fine-tune GPT-3 using supervised learning. We then collect a dataset of rankings of model outputs, which we use to further fine-tune this supervised model using reinforcement learning from human feedback. We call the resulting models InstructGPT. In human evaluations on our prompt distribution, outputs from the 1.3B parameter InstructGPT model are preferred to outputs from the 175B GPT-3, despite having 100x fewer parameters. Moreover, InstructGPT models show improvements in truthfulness and reductions in toxic output generation while having minimal performance regressions on public NLP datasets. Even though InstructGPT still makes simple mistakes, our results show that fine-tuning with human feedback is a promising direction for aligning language models with human intent.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Existing literature (Ouyang et al., 2022) does not fully describe the details of these models, such as the pretraining corpus, model sizes, and model biases.”
From Self-Refine: Iterative Refinement with Self-Feedback (2023) · cites this paper as Ouyang et al., 2022
Experimental — accuracy not yet measuredIn the citing paper
“Specifically, providers mitigate race and gender bias through reinforcement learning from human feedback (RLHF), adversarial stress-testing known as red teaming, and hard-coded refusals governed by the provider's own content policies [6, 43, 71].”
From All Public Voices Are Equal, But Are Some More Equal Than Others to LLMs? (2026) · cites this paper as [71]
In the citing paper
“Fine-tuning a model from human feedback at scale, using preference data from paid raters or drawn from a large and willing user base, is an especially potent technique.It has the potential not only to shape a model's responses to better reflect user norms (for better or worse), but also to filter out toxic language, improve factual accuracy, and mitigate the tendency to fabricate information.”
From Talking about Large Language Models (2024) · cites this paper as [26]
In the citing paper
“These include general competencies such as in-context learning (ICL) [13], chain-of-thought (CoT) [17] reasoning, and instruction following [25], as well as task-specialized skills like mathematical reasoning [30].”
From A Survey of Large Language Models (2026) · cites this paper as [25]
In the citing paper
“When external reward models or ground-truth answers are available, rejection sampling can also be applied to select higher-quality responses from multiple candidates [25].”
From A Survey of Large Language Models (2026) · cites this paper as [25]
41 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
The publisher hasn’t deposited this paper’s reference list.
Cited by
Items 901–1,000 of 4,340
Integration of cognitive tasks into artificial general intelligence test for large models
Qu, Y., Wei, C., Du, P., Che, W., Zhang, C., Ouyang, W., Bian, Y., Xu, F., Hu, B., Du, K., et al. (2024) · iScience · doi:10.1016/j.isci.2024.109550 · Cited by 25
Self-citationSänger, M., Mecquenem, N. D., Lewińska, K. E., Bountris, V., Lehmann, F., Leser, U., & Kosch, T. (2024) · GigaScience · doi:10.1093/gigascience/giae030 · Cited by 23
From sight to insight: A multi-task approach with the visual language decoding model
Huang, W., Yang, P., Tang, Y., Fan, Q., Li, H., Wu, D., Ren, W., Wang, S., Zhao, Y., Wang, J., et al. (2024) · Information Fusion · doi:10.1016/j.inffus.2024.102573 · Cited by 21
On the role of the UMLS in supporting diagnosis generation proposed by Large Language Models
Afshar, M., Gao, Y., Gupta, D. P., Croxford, E., & Demner‐Fushman, D. (2024) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2024.104707 · Cited by 27
Continual Learning of Image Classes With Language Guidance From a Vision-Language Model
Zhang, W., Huang, Y., Zhang, W., Zhang, T., Lao, Q., Yu, Y., Zheng, W., & Wang, R. (2024) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2024.3449109 · Cited by 25
Liu, J., Shen, H., Chen, K., & Li, X. (2024) · Briefings in Bioinformatics · doi:10.1093/bib/bbae430 · Cited by 20
On Large Language Models’ Resilience to Coercive Interrogation
Zhang, Z., Shen, G., Tao, G., Cheng, S., & Zhang, X. (2024) · IEEE Symposium on Security and Privacy (S&P) · doi:10.1109/sp54263.2024.00208 · Cited by 45
Wang, K., Tian, Y., & Hatzinakos, D. (2024) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw63382.2024.00190 · Cited by 32
A High-Quality Generation Approach for Educational Programming Projects Using LLM
Song, T., Zhang, H., & Xiao, Y. (2024) · IEEE Transactions on Learning Technologies · doi:10.1109/tlt.2024.3499751 · Cited by 28
Federated Transfer Learning for On-Device LLMs Efficient Fine Tuning Optimization
Li, C., Gu, B., Zhao, Z., Qu, Y., Xin, G., Huo, J., & Gao, L. (2025) · Big Data Mining and Analytics · doi:10.26599/bdma.2024.9020068 · Cited by 20
A law of next-token prediction in large language models
He, H., & Su, W. (2025) · Physical review. E · doi:10.1103/5rn3-49lc · Cited by 27
Ensemble Learning for Large Language Models in Text and Code Generation: A Survey
Ashiga, M., Wei, J., Wu, F., Voskanyan, V., Dinmohammadi, F., Brookes, P., Gong, J., Wang, Z., Giavrimis, R., Basios, M., et al. (2026) · IEEE Transactions on Artificial Intelligence · doi:10.1109/tai.2026.3670235 · Cited by 21
M4: Multi-generator, Multi-domain, and Multi-lingual Black-Box Machine-Generated Text Detection
Wang, Y., Mansurov, J., Ivanov, P., Su, J., Shelmanov, A., Tsvigun, A., Whitehouse, C., Afzal, O. M., Mahmoud, T., Sasaki, T., et al. (2023) · arXiv · doi:10.48550/arxiv.2305.14902 · Cited by 19
Comparing emotions in ChatGPT answers and human answers to the coding questions on Stack Overflow
Fatahi, S., Vassileva, J., & Roy, C. K. (2024) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2024.1393903 · Cited by 22
Chatting with bots: AI, speech acts, and the edge of assertion
Williams, I., & Bayne, T. (2024) · Inquiry · doi:10.1080/0020174x.2024.2434874 · Cited by 28
NALSpatial: A Natural Language Interface for Spatial Databases
Liu, M., Wang, X., Xu, J., Lu, H. C., & Tong, Y. (2025) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2025.3525587 · Cited by 24
Liu, H., Cao, Y., Wu, X., Qiu, C., Gu, J., Liu, M., & Hershcovich, D. (2025) · Information Processing & Management · doi:10.1016/j.ipm.2025.104099 · Cited by 29
Cheng, S.-T., Lyu, Y.-J., & Teng, C. (2025) · Applied Sciences · doi:10.3390/app15094911 · Cited by 23
Xiao, Z., & Ma, J. (2025) · Automation in Construction · doi:10.1016/j.autcon.2025.106341 · Cited by 27
GraphRAG-R1: Graph Retrieval-Augmented Generation with Process-Constrained Reinforcement Learning
Yu, C., Zhao, K., Li, Y., Chang, H., Feng, M., Jiang, X., Sun, Y., Li, J., Zhang, Y., Sun, Q., et al. (2026) · International World Wide Web Conference (WWW) · doi:10.1145/3774904.3792589 · Cited by 29
Self-citationQuery Expansion in the Age of Pre-trained and Large Language Models: A Comprehensive Survey
Li, M., Lv, X., Zou, J., Chen, T., Zhang, C., An, S., Nie, E., & Zhou, G. (2026) · ACM Transactions on Information Systems · doi:10.1145/3816248 · Cited by 24
Self-citationDual-process theory and decision-making in large language models
Brady, O., Nulty, P., Zhang, L., Ward, T. E., & McGovern, D. P. (2025) · Nature Reviews Psychology · doi:10.1038/s44159-025-00506-1 · Cited by 33
Functional alignment of protein language models via reinforcement learning
Blalock, N., Seshadri, S., Nakamura, K., Babbar, A., Fahlberg, S. A., Kulkarni, A., & Romero, P. (2026) · bioRxiv · doi:10.1038/s41467-026-77557-2 · Cited by 19
Ren, C., Lee, S.-J., & Hu, C. (2023) · Computers in Human Behavior Artificial Humans · doi:10.1016/j.chbah.2023.100007 · Cited by 24
Connecting AI: Merging Large Language Models and Knowledge Graph
Jovanovic, M., & Campbell, M. (2023) · Computer · doi:10.1109/mc.2023.3305206 · Cited by 23
Prompting Large Language Models for Malicious Webpage Detection
Li, L., & Gong, B. (2023) · IEEE International Conference on Pattern Recognition and Machine Learning (PRML) · doi:10.1109/prml59573.2023.10348229 · Cited by 25
Leveraging Large Language Models for Exploiting ASR Uncertainty
Dighe, P., Su, Y., Zheng, S., Liu, Y., Garg, V., Niu, X., & Tewfik, A. H. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10446132 · Cited by 33
Text summarization with ChatGPT for drug labeling documents
Ying, L., Liu, Z., Fang, H., Kusko, R. L., Wu, L., Harris, S., & Tong, W. (2024) · Drug Discovery Today · doi:10.1016/j.drudis.2024.104018 · Cited by 22
Rahman, M. M., Irbaz, M. S., North, K., Williams, M. S., Zampieri, M., & Lybarger, K. (2024) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2024.104727 · Cited by 25
Leveraging Cross-Modal Neighbor Representation for Improved CLIP Classification
Yi, C., Ren, L., Zhan, D., & Ye, H.-J. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02587 · Cited by 38
Zhao, S., & Sun, X. (2024) · Knowledge-Based Systems · doi:10.1016/j.knosys.2024.112571 · Cited by 18
Introduction to Generative Artificial Intelligence: Contextualizing the Future
Singh, R., Kim, J. Y., Glassy, E. F., Dash, R. C., Brodsky, V., Seheult, J. N., de Baca, M. E., Gu, Q., Hoekstra, S., & Pritt, B. S. (2024) · Archives of Pathology & Laboratory Medicine · doi:10.5858/arpa.2024-0221-ra · Cited by 25
Shang, S., Zhao, X., Yao, Z., Yao, Y., Su, L., Fan, Z., Zhang, X., & Jiang, Z. (2024) · The Computer Journal · doi:10.1093/comjnl/bxae124 · Cited by 25
JM3D & JM3D-LLM: Elevating 3D Representation With Joint Multi-Modal Cues
Ji, J., Wang, H., Wu, C., Ma, Y., Sun, X., & Ji, R. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3523675 · Cited by 33
Wu, Z., Zhao, M., Li, Y., Li, Y., Peng, S., Kato, N., & Tang, F. (2026) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2026.3692451 · Cited by 28
Keck, F., Broadbent, H., & Altermatt, F. (2026) · Ecology and Evolution · doi:10.1101/2025.01.24.634685 · Cited by 20
Preference Alignment Improves Language Model-Based TTS
Tian, J., Zhang, C., Shi, J., Zhang, H., Yu, J., Watanabe, S., & Yu, D. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10890510 · Cited by 38
Self-citationAPI-Guided Dataset Synthesis to Finetune Large Code Models
Li, Z., Wu, D., Wang, S., & Su, Z. (2025) · Proceedings of the ACM on Programming Languages · doi:10.1145/3720449 · Cited by 25
Mathur, S., van der Vleuten, N., Yager, K. G., & Tsai, E. H. R. (2025) · Machine Learning Science and Technology · doi:10.1088/2632-2153/add9e4 · Cited by 31
Prompt Inversion Attack Against Collaborative Inference of Large Language Models
Qu, W., Zhou, Y., Wu, Y., Xiao, T., Yuan, B., Li, Y., & Zhang, J. (2025) · IEEE Symposium on Security and Privacy (S&P) · doi:10.1109/sp61157.2025.00160 · Cited by 42
FlexRLHF: A Flexible Placement and Parallelism Framework for Efficient RLHF Training
Xiao, Y., Zhou, Z., Mao, F., Wu, W., Zhao, S., Ju, L., Liang, L., Zhang, X., & Jun, Z. (2025) · IEEE International Parallel and Distributed Processing Symposium (IPDPS) · doi:10.1109/ipdps64566.2025.00039 · Cited by 22
WebWalker: Benchmarking LLMs in Web Traversal
Wu, J., Yin, W., Jiang, Y., Wang, Z., Xi, Z., Fang, R., Zhang, L., He, Y., Zhou, D., Xie, P., et al. (2025) · Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2025.acl-long.508 · Cited by 18
Self-citationDistilling Wisdom: A Review on Optimizing Learning From Massive Language Models
Zhang, D., Listiyani, D., Singh, P., & Mohanty, M. (2025) · IEEE Access · doi:10.1109/access.2025.3554586 · Cited by 20
Fan, S., Wang, H., & Zhang, F. (2025) · Knowledge-Based Systems · doi:10.1016/j.knosys.2025.113846 · Cited by 18
SceneLLM: Implicit language reasoning in LLM for dynamic scene graph generation
Zhang, H., Li, Z., & Liu, J. (2025) · Pattern Recognition · doi:10.1016/j.patcog.2025.111992 · Cited by 24
Fine-tuning or prompting on LLMs: evaluating knowledge graph construction task
Ghanem, H., & Cruz, C. (2025) · Frontiers in Big Data · doi:10.3389/fdata.2025.1505877 · Cited by 25
Zhu, C., Hu, X., Wu, H., Qin, C., Zhu, H., & Xiong, H. (2025) · Information Processing & Management · doi:10.1016/j.ipm.2025.104261 · Cited by 24
Anthropomimetic Uncertainty: What Verbalized Uncertainty in Language Models is Missing
Ulmer, D., Lorson, A., Titov, I., & Hardmeier, C. (2026) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl.a.739 · Cited by 21
Li, S., & Xu, J. (2023) · Information Processing & Management · doi:10.1016/j.ipm.2023.103467 · Cited by 19
Discriminating Human-authored from ChatGPT-Generated Code Via Discernable Feature Analysis
Li, K., Hong, S., Fu, C., Zhang, Y., & Liu, M. (2023) · IEEE International Symposium on Software Reliability Engineering Workshops (ISSREW) · doi:10.1109/issrew60843.2023.00059 · Cited by 26
Exploratory machine learning with unknown unknowns
Zhao, P., Shan, J.-W., Zhang, Y., & Zhou, Z. (2023) · Artificial Intelligence · doi:10.1016/j.artint.2023.104059 · Cited by 24
Wu, S.-L., Chang, X., Wichern, G., Jung, J.-W., Germain, F. G., Roux, J. L., & Watanabe, S. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10447215 · Cited by 36
Driving through the Concept Gridlock: Unraveling Explainability Bottlenecks in Automated Driving
Echterhoff, J. M., Yan, A., Han, K., Abdelraouf, A., Gupta, R., & McAuley, J. (2024) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv57701.2024.00718 · Cited by 22
Wu, Y., Xiang, Y., Huo, S., Gong, Y., & Liang, P. (2024) · International Conference on Algorithms, Microchips, and Network Applications (AMNA) · doi:10.1117/12.3032013 · Cited by 23
Santhi, T. M., & Srinivasan, K. (2024) · IEEE Transactions on Learning Technologies · doi:10.1109/tlt.2024.3417252 · Cited by 20
DriveLLaVA: Human-Level Behavior Decisions via Vision Language Model
Zhao, R., Yuan, Q., Li, J., Fan, Y., Li, Y., & Gao, F. (2024) · Sensors · doi:10.3390/s24134113 · Cited by 18
GeDa: Improving training data with large language models for Aspect Sentiment Triplet Extraction
Mai, W., Zhang, Z., Chen, Y., Li, K., & Xue, Y. (2024) · Knowledge-Based Systems · doi:10.1016/j.knosys.2024.112289 · Cited by 20
Zero and Few Short Learning Using Large Language Models for De-Identification of Medical Records
Yashwanth, Y., & Shettar, R. (2024) · IEEE Access · doi:10.1109/access.2024.3439680 · Cited by 26
Prompting Multi-Modal Tokens to Enhance End-to-End Autonomous Driving Imitation Learning with LLMs
Duan, Y., Zhang, Q., & Xu, R. (2024) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra57147.2024.10611614 · Cited by 34
Giacomoni, L., & Parisis, G. (2024) · IEEE Conference on Computer Communications (INFOCOM) · doi:10.1109/infocom52122.2024.10621288 · Cited by 26
Action Contextualization: Adaptive Task Planning and Action Tuning Using Large Language Models
Gupta, S., Yao, K., Niederhauser, L., & Billard, A. (2024) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2024.3460408 · Cited by 25
Li, C., Zheng, Z., Du, X., Ma, X., Wang, Z., & Li, X. (2024) · Knowledge-Based Systems · doi:10.1016/j.knosys.2024.112588 · Cited by 19
Leveraging LLMs for Financial News Analysis and Macroeconomic Indicator Nowcasting
Ónozó, L. R., Arthur, F. V., & Gyires-Tóth, B. (2024) · IEEE Access · doi:10.1109/access.2024.3488363 · Cited by 18
Automated C/C++ Program Repair for High-Level Synthesis via Large Language Models
Xu, K., Zhang, G. L., Yin, X., Zhuo, C., Schlichtmann, U., & Li, B. (2024) · ACM/IEEE Workshop on Machine Learning for CAD (MLCAD) · doi:10.1109/mlcad62225.2024.10740262 · Cited by 21
Han, T., Cong, R., Yu, B., Tang, B.-J., & Wei, Y. (2024) · Energy and AI · doi:10.1016/j.egyai.2024.100440 · Cited by 18
Automation of Network Configuration Generation using Large Language Models
Chakraborty, S., Chitta, N., & Sundaresan, R. (2024) · International Conference on Network and Service Management (CNSM) · doi:10.23919/cnsm62983.2024.10814407 · Cited by 21
Fei, Y., Fan, J., & Zhou, G. (2025) · Applied Sciences · doi:10.3390/app15020628 · Cited by 18
Securing Vision-Language Models with a Robust Encoder Against Jailbreak and Adversarial Attacks
Hossain, M. Z., & Imteaj, A. (2024) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata62323.2024.10825099 · Cited by 30
On Prompt Sensitivity of ChatGPT in Affective Computing
Amin, M. M., & Schuller, B. W. (2024) · International Conference on Affective Computing and Intelligent Interaction and workshops · doi:10.1109/acii63134.2024.00028 · Cited by 18
SAM-Net: Semantic-assisted multimodal network for action recognition in RGB-D videos
Liu, D., Meng, F., Mi, J., Ye, M., Li, Q., & Zhang, J. (2025) · Pattern Recognition · doi:10.1016/j.patcog.2025.111725 · Cited by 22
Model predictive task sampling for efficient and robust adaptation
Wang, Q., Xiao, Z., Mao, Y., Qu, Y. P., Shen, J., Lv, Y., & Ji, X. (2026) · Nature Communications · doi:10.1038/s41467-026-74004-0 · Cited by 25
Yang, X., Zhu, W., Pacheco, M., Zhou, J., Wang, S., Hu, X., & Liu, K. (2025) · Proceedings of the ACM on software engineering. · doi:10.1145/3715738 · Cited by 26
Xia, Y., Xie, Z., Liu, P., Lu, K., Liu, Y., Wang, W., & Ji, S. (2025) · Proceedings of the ACM on software engineering. · doi:10.1145/3728875 · Cited by 24
RustAssistant: Using LLMs to Fix Compilation Errors in Rust Code
Deligiannis, P., Lal, A., Mehrotra, N., Poddar, R., & Rastogi, A. (2025) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse55347.2025.00022 · Cited by 22
Abstractive text summarization: A comprehensive survey of techniques, systems, and challenges
Almohaimeed, N., & Azmi, A. M. (2025) · Computer Science Review · doi:10.1016/j.cosrev.2025.100762 · Cited by 19
Luo, Z., Zhao, H., Wolff, D., Cadar, C., & Roychoudhury, A. (2026) · IEEE Symposium on Security and Privacy (S&P) · doi:10.1109/sp63933.2026.00003 · Cited by 31
In Which Fields Do ChatGPT Scores Align More Closely with Research Quality than Do Citation Rates?
Thelwall, M. A. (2026) · Journal of Data and Information Science · doi:10.1515/jdis-2026-0058 · Cited by 19
Sun, C., Wei, J., Wu, Y., Shi, Y., He, S., Ma, Z., Xie, N., & Yang, Y. (2026) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2026.3668691 · Cited by 22
OctoPack: Instruction Tuning Code Large Language Models
Muennighoff, N., Liu, Q., Zebaze, A., Zheng, Q., Hui, B., Zhuo, T. Y., Singh, S., Tang, X., von Werra, L., & Longpre, S. (2023) · arXiv · doi:10.48550/arxiv.2308.07124 · Cited by 245
“Training models to follow instructions has led to new capabilities in text (Ouyang et al., 2022; Wang et al., 2022b; Chung et al., 2022) and visual modalities (Xu et al., 2023b; OpenAI, 2023).”
BackgroundResultInfluentialRWKV: Reinventing RNNs for the Transformer Era
Peng, B., Alcaide, E., Anthony, Q., Albalak, A., Arcadinho, S., Biderman, S., Cao, H., Cheng, X., Chung, M., Grella, M., et al. (2023) · arXiv · doi:10.48550/arxiv.2305.13048 · Cited by 17
Understanding the Effects of RLHF on LLM Generalisation and Diversity
Kirk, R., Mediratta, I., Nalmpantis, C., Luketina, J., Hambro, E., Grefenstette, E., & Raileanu, R. (2023) · arXiv · doi:10.48550/arxiv.2310.06452 · Cited by 17
“More RLHF and SFT details Often, SFT and RLHF are combined by performing SFT followed by RLHF (Glaese et al., 2022; Menick et al., 2022; Nakano et al., 2022; Ouyang et al., 2022).”
MethodInfluentialWebCode2M: A Real-World Dataset for Code Generation from Webpage Designs
Gui, Y., Li, Z., Wan, Y., Shi, Y., Zhang, H., Chen, B., Su, Y., Chen, D., Wu, S., Zhou, X., et al. (2025) · Proceedings of the ACM on Web Conference 2025 · doi:10.1145/3696410.3714889 · Cited by 17
Laboratory-Scale AI: Open-Weight Models are Competitive with ChatGPT Even in Low-Resource Settings
Wolfe, R., Slaughter, I., Han, B., Wen, B., Yang, Y., Rosenblatt, L., Herman, B., Brown, E., Qu, Z., Weber, N., et al. (2024) · The 2024 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3630106.3658966 · Cited by 24
AI and the transformation of accountability and discretion in urban governance
Goldsmith, S., & Yang, J. (2026) · Urban Governance · doi:10.1016/j.ugj.2026.02.005 · Cited by 17
“Although GenAI is often discussed in terms of its technical capabilities, such as generating text, images, or predictive insights ( Ouyang et al., 2022 ; Cao et al., 2023 ), the transformative feature is its interactive capacity.”
Konwer, A., Yang, Z., Bas, E., Xiao, C., Prasanna, P., Bhatia, P., & Kass-Hout, T. (2025) · 2025 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52734.2025.01955 · Cited by 17
The Relevance of Large Language Models for Project Management
Karnouskos, S. (2024) · IEEE Open Journal of the Industrial Electronics Society · doi:10.1109/ojies.2024.3412222 · Cited by 26
Marchetti, A., Sasso, D., D’Antoni, F., Morandin, F., Parton, M., Matarrese, M. A. G., & Merone, M. (2025) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2025.110147 · Cited by 20
Mutation Testing via Iterative Large Language Model-Driven Scientific Debugging
Straubinger, P., Kreis, M., Lukasczyk, S., & Fraser, G. (2025) · IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW) · doi:10.1109/icstw64639.2025.10962485 · Cited by 21
Wu, J., Ning, Z., Ding, Y., Wang, Y., Peng, Q., & Fu, L. (2023) · Briefings in Bioinformatics · doi:10.1093/bib/bbad292 · Cited by 17
Self-citationFusing Pre-Trained Language Models with Multimodal Prompts through Reinforcement Learning
Yu, Y., Chung, J., Yun, H., Hessel, J., Park, J. S., Lu, X., Zellers, R., Ammanabrolu, P., Bras, R. J. L., Kim, G., et al. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01044 · Cited by 28
YOLOv8 for defect inspection of hexagonal directed self-assembly patterns: a data-centric approach
Dehaerne, E., Dey, B., Esfandiar, H., Verstraete, L., Suh, H. S., Halder, S., & Gendt, S. D. (2023) · European Mask and Lithography Conference (EMLC) · doi:10.1117/12.2675573 · Cited by 17
Han, B., Jiang, X., Fang, Z., Fujita, H., & Gao, Y. (2023) · Pattern Recognition · doi:10.1016/j.patcog.2023.110096 · Cited by 19
Self-citationDSAMR: Dual-Stream Attention Multi-hop Reasoning for knowledge-based visual question answering
Sun, Y., Zhu, Z., Zuo, Z., Li, K., Gong, S., & Qi, J. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.123092 · Cited by 17
AVI-Talking: Learning Audio-Visual Instructions for Expressive 3D Talking Face Generation
Sun, Y., Chu, W., Zhou, H., Wang, K., & Koike, H. (2024) · IEEE Access · doi:10.1109/access.2024.3390182 · Cited by 24
Language Evolution for Evading Social Media Regulation via LLM-Based Multi-Agent Simulation
Cai, J., Li, J., Zhang, M., Li, M., Wang, C.-S., & Tei, K. (2024) · IEEE Congress on Evolutionary Computation (CEC) · doi:10.1109/cec60901.2024.10612015 · Cited by 23
The Impact of LLM Hallucinations on Motor Skill Learning: A Case Study in Badminton
Qiu, Y. (2024) · IEEE Access · doi:10.1109/access.2024.3444783 · Cited by 27
Chen, Y., Liebau, U., Guruprasad, S. M., Trofimenko, I., & Minke, C. (2024) · Machine Learning and Knowledge Extraction · doi:10.3390/make6040122 · Cited by 21
AVTrustBench: Assessing and Enhancing Reliability and Robustness in Audio-Visual LLMs
Chowdhury, S., Nag, S., Dasgupta, S., Wang, Y., Elhoseiny, M., Gao, R., & Manocha, D. (2025) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.00156 · Cited by 27
Silva, D. D., Mills, N., Moraliyage, H., Rathnayaka, P., Wishart, S., & Jennings, A. (2025) · Smart Cities · doi:10.3390/smartcities8010034 · Cited by 27
Metadata
- Authors
- Ouyang, L., Wu, J., Jiang, X., Almeida, D., Wainwright, C., Mishkin, P., Zhang, C., Agarwal, S., Slama, K., Ray, A., Schulman, J., Hilton, J., Kelton, F., Miller, L., Simens, M., Askell, A., Welinder, P., Christiano, P., Leike, J., & Lowe, R.
- Venue
- Advances in Neural Information Processing Systems 35
- Published
- 2022
- Pages
- 27730-27744
- ISSN
- 1049-5258 (ISSN-L)
- OpenAlex
- W7133211372
- Cited by
- 3,117
- References
- 0
- Citations by year
- 2026: 1421 · 2025: 544 · 2024: 852 · 2023: 297 · 2022: 3
- FWCI
- 234.27
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- neural information processing systems (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Keywords
- instruction following, language models, human feedback, reinforcement learning from human feedback, large language models
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.