Training Language Models to Follow Instructions with Human Feedback
The DOI matches its Crossref record; 2 of the 2 references it cites were found in a registry or an index.
Abstract
Making language models bigger does not inherently make them better at following a user's intent. For example, large language models can generate outputs that are untruthful, toxic, or simply not helpful to the user. In other words, these models are not aligned with their users. In this paper, we show an avenue for aligning language models with user intent on a wide range of tasks by fine-tuning with human feedback. Starting with a set of labeler-written prompts and prompts submitted through the OpenAI API, we collect a dataset of labeler demonstrations of the desired model behavior, which we use to fine-tune GPT-3 using supervised learning. We then collect a dataset of rankings of model outputs, which we use to further fine-tune this supervised model using reinforcement learning from human feedback. We call the resulting models InstructGPT. In human evaluations on our prompt distribution, outputs from the 1.3B parameter InstructGPT model are preferred to outputs from the 175B GPT-3, despite having 100x fewer parameters. Moreover, InstructGPT models show improvements in truthfulness and reductions in toxic output generation while having minimal performance regressions on public NLP datasets. Even though InstructGPT still makes simple mistakes, our results show that fine-tuning with human feedback is a promising direction for aligning language models with human intent.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Existing literature (Ouyang et al., 2022) does not fully describe the details of these models, such as the pretraining corpus, model sizes, and model biases.”
From Self-Refine: Iterative Refinement with Self-Feedback (2023) · cites this paper as Ouyang et al., 2022
Experimental — accuracy not yet measuredIn the citing paper
“Specifically, providers mitigate race and gender bias through reinforcement learning from human feedback (RLHF), adversarial stress-testing known as red teaming, and hard-coded refusals governed by the provider's own content policies [6, 43, 71].”
From All Public Voices Are Equal, But Are Some More Equal Than Others to LLMs? (2026) · cites this paper as [71]
In the citing paper
“Fine-tuning a model from human feedback at scale, using preference data from paid raters or drawn from a large and willing user base, is an especially potent technique.It has the potential not only to shape a model's responses to better reflect user norms (for better or worse), but also to filter out toxic language, improve factual accuracy, and mitigate the tendency to fabricate information.”
From Talking about Large Language Models (2024) · cites this paper as [26]
In the citing paper
“These include general competencies such as in-context learning (ICL) [13], chain-of-thought (CoT) [17] reasoning, and instruction following [25], as well as task-specialized skills like mathematical reasoning [30].”
From A Survey of Large Language Models (2026) · cites this paper as [25]
In the citing paper
“When external reward models or ground-truth answers are available, rejection sampling can also be applied to select higher-quality responses from multiple candidates [25].”
From A Survey of Large Language Models (2026) · cites this paper as [25]
41 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
The publisher hasn’t deposited this paper’s reference list.
Cited by
Items 601–700 of 4,340
Ta-Adapter: Enhancing few-shot CLIP with task-aware encoders
Zhang, W., Zhang, Y., Deng, Y., Zhang, W., Lin, J., Huang, B., Zhang, J., & Yu, W. (2024) · Pattern Recognition · doi:10.1016/j.patcog.2024.110559 · Cited by 42
CityLLaVA: Efficient Fine-Tuning for VLMs in City Scenario
Duan, Z., Cheng, H., Xu, D., Wu, X., Zhang, X., Ye, X., & Xie, Z. (2024) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw63382.2024.00713 · Cited by 63
Generative AI Meets Wireless Networking: An Interactive Paradigm for Intent-Driven Communications
Qin, X., Sun, M., Dai, J., Ma, P., Cao, Y., Zhang, J., Wang, J., Xu, X., Zhang, P., & Niyato, D. T. (2025) · IEEE Transactions on Cognitive Communications and Networking · doi:10.1109/tccn.2025.3567613 · Cited by 44
Tucano: Advancing neural text generation for Portuguese
Corrêa, N. K., Sen, A., Falk, S., & Fatimah, S. (2025) · Patterns · doi:10.1016/j.patter.2025.101325 · Cited by 50
An Overview of Large Language Models for Statisticians
Ji, W., Yuan, W., Getzen, E. J., Cho, K., Jordan, M. I., Mei, S., Weston, J., Su, W., Xu, J., & Zhang, L. (2026) · The American Statistician · doi:10.1080/00031305.2026.2657480 · Cited by 51
Zha, E., Zeng, D., Lin, M., & Shen, Y. (2024) · Knowledge-Based Systems · doi:10.1016/j.knosys.2024.111730 · Cited by 38
Chen, L., Lei, Y., Jin, S., Zhang, Y., & Zhang, L. (2024) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2024.3400189 · Cited by 52
Cai, H., Shen, B., Jin, L., Hu, L., & Fan, X. (2026) · International Conference on Artificial Intelligence and Big Data (ICAIBD) · doi:10.1109/icaibd69640.2026.11637246 · Cited by 35
Retrieving-to-Answer: Zero-Shot Video Question Answering with Frozen Large Language Models
Pan, J., Lin, Z., Ge, Y., Zhu, X., Zhang, R., Wang, Y., Qiao, Y., & Li, H. (2023) · 2023 IEEE/CVF International Conference on Computer Vision Workshops (ICCVW) · doi:10.1109/iccvw60793.2023.00035 · Cited by 27
Integrating Generative Artificial Intelligence in Intelligent Vehicle Systems
Stappen, L., Dillmann, J., Striegel, S., Vögel, H.-J., Flores-Herr, N., & Schuller, B. W. (2023) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc57777.2023.10422003 · Cited by 44
Evolving Diverse Red-Team Language Models in Multi-Round Multi-Agent Games
Ma, C., Yang, Z., Ci, H., Gao, J., Gao, M., Pan, X., & Yang, Y. (2026) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2026.3694367 · Cited by 40
Language Models Meet World Models: Embodied Experiences Enhance Language Models
Xiang, J., Tao, T., Gu, Y., Shu, T., Wang, Z., Yang, Z., & Hu, Z. (2023) · Advances in Neural Information Processing Systems 36 · doi:10.52202/075280-3295 · Cited by 34
Weak-to-Strong Generalization: Eliciting Strong Capabilities With Weak Supervision
Burns, C., Izmailov, P., Kirchner, J. H., Baker, B., Gao, L., Aschenbrenner, L., Chen, Y., Ecoffet, A., Joglekar, M., Leike, J., et al. (2023) · arXiv · doi:10.48550/arxiv.2312.09390 · Cited by 34
“…Demski & Garrabrant, 2019; Hubinger et al., 2019), or empirically studied humans supervising today’s models—without addressing the core challenges that may arise with superhuman models (Chris-tiano et al., 2017; Wu et al., 2021; Ouyang et al., 2022; Bowman et al., 2022; Saunders et al., 2022).”
BackgroundMethodInfluentialSelf-citationMumuni, F., & Mumuni, A. (2023) · Cognitive Systems Research · doi:10.1016/j.cogsys.2023.101188 · Cited by 41
Digitalization as a double-edged sword: A deep learning analysis of risk management in Chinese banks
Wang, L., Huang, Y., & Hong, Z. (2024) · International Review of Financial Analysis · doi:10.1016/j.irfa.2024.103249 · Cited by 34
Wang, H., Li, C., Li, Y., & Tsung, F. (2024) · IEEE Transactions on Industrial Cyber-Physical Systems · doi:10.1109/ticps.2024.3414292 · Cited by 42
Lee, U., Jeon, M., Lee, Y., Byun, G., Son, Y., Shin, J., Ko, H., & Kim, H. (2024) · Computers and Education Artificial Intelligence · doi:10.1016/j.caeai.2024.100297 · Cited by 46
CIPHER: Cybersecurity Intelligent Penetration-Testing Helper for Ethical Researcher
Pratama, D., Suryanto, N., Adiputra, A. A., Le, T.-T.-H., Kadiptya, A. Y., Iqbal, M. J., & Kim, H. (2024) · Sensors · doi:10.3390/s24216878 · Cited by 49
Xu, S., Huang, X., Lo, C. K., Chen, G., & Jong, M. S. (2024) · Computers and Education Artificial Intelligence · doi:10.1016/j.caeai.2024.100325 · Cited by 34
He, Z., Zhao, H., Qiao, Y., Yang, F., Payani, A., Ma, J., & Du, M. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37676-3_11 · Cited by 37
3UR-LLM: An End-to-End Multimodal Large Language Model for 3D Scene Understanding
Xiong, H., Zhuge, Y., Zhu, J., Zhang, L., & Lu, H. (2025) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2025.3557620 · Cited by 51
Federated Offline Reinforcement Learning With Multimodal Data
Wen, J., Dai, H., He, J., Xi, M., Xiao, S., & Yang, J. (2023) · IEEE Transactions on Consumer Electronics · doi:10.1109/tce.2023.3330943 · Cited by 37
Retrieval-Augmented Generation with Graphs (GraphRAG)
Han, H., Wang, Y., Shomer, H., Guo, K., Ding, J., Lei, Y., Halappanavar, M., Rossi, R. A., Mukherjee, S., Tang, X., et al. (2025) · arXiv · doi:10.48550/arxiv.2501.00309 · Cited by 34
Burford, K. G., Itzkowitz, N. G., Ortega, A. G., Teitler, J. O., & Rundle, A. G. (2024) · JAMA Network Open · doi:10.1001/jamanetworkopen.2024.25981 · Cited by 33
Combining low-code development with ChatGPT to novel no-code approaches: A focus-group study
Martins, J., Branco, F., & Mamede, H. S. (2023) · Intelligent Systems with Applications · doi:10.1016/j.iswa.2023.200289 · Cited by 42
Free-form Conversation with Human and Symbolic Avatars in Mixed Reality
Zhu, J., Kumaran, R., Xu, C., & Höllerer, T. (2023) · Proceedings - International Symposium on Mixed and Augmented Reality, ISMAR · doi:10.1109/ismar59233.2023.00090 · Cited by 39
Scope Ambiguities in Large Language Models
Kamath, G., Schuster, S., Vajjala, S., & Reddy, S. (2024) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00670 · Cited by 61
The Role of Federated Learning in a Wireless World with Foundation Models
Chen, Z., Yang, H. H., Tay, Y. C., Chong, K. F. E., & Quek, T. Q. S. (2024) · IEEE Wireless Communications · doi:10.1109/mwc.005.2300481 · Cited by 39
LUNA: A Model-Based Universal Analysis Framework for Large Language Models
Song, D., Xie, X., Song, J., Zhu, D., Huang, Y., Juefei-Xu, F., & Ma, L. (2024) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2024.3411928 · Cited by 41
Supersonic: Learning to Generate Source Code Optimizations in C/C++
Chen, Z., Fang, S., & Monperrus, M. (2024) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2024.3423769 · Cited by 46
Han, G., Liu, W., Huang, X., & Borsari, B. E. (2024) · IEEE International Conference on Healthcare Informatics (ICHI) · doi:10.1109/ichi61247.2024.00057 · Cited by 40
A review of reinforcement learning for natural language processing and applications in healthcare
Liu, Y., Wang, H., Zhou, H., Li, M., Hou, Y., Zhou, S., Wang, F., Hoetzlein, R., & Zhang, R. (2024) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocae215 · Cited by 34
Mittal, H., Agarwal, N., Lo, S.-Y., & Lee, K. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01758 · Cited by 58
From Detection to Action: A Multimodal AI Framework for Traffic Incident Response
Ahmed, A., Farhan, M., Eesaar, H., Chong, K. T., & Tayara, H. (2024) · Drones · doi:10.3390/drones8120741 · Cited by 47
Streamlining geoscience data analysis with an LLM-driven workflow
Zhang, J., Clairmont, C., Que, X., Li, W., Chen, W., Li, C.-H., & Ma, X.-G. (2025) · Applied Computing and Geosciences · doi:10.1016/j.acags.2024.100218 · Cited by 28
LLM Meets ML: Data-efficient Anomaly Detection on Unstable Logs
Hadadi, F., Xu, Q., Bianculli, D., & Briand, L. (2026) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3771283 · Cited by 37
Yan, Y., Zou, B., Liao, Y., Xu, G., Yao, R., Fan, H., Sun, J., Wang, X., Sprinkle, J. M., An, Z., et al. (2026) · Information Fusion · doi:10.1016/j.inffus.2026.104546 · Cited by 43
Distilling Large Vision-Language Model with Out-of-Distribution Generalizability
Li, X., Fang, Y., Liu, M., Ling, Z., Tu, Z., & Su, H. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00236 · Cited by 68
The mystery of In-context learning: a comprehensive survey on interpretation and analysis
Zhou, Y., Li, J., Xiang, Y., Yan, H., Gui, L., & He, Y. (2023) · arXiv · doi:10.48550/arxiv.2311.00237 · Cited by 33
Banerjee, P., Srivastava, A. K., Adjeroh, D. A., Reddy, R., & Karimian, N. (2025) · IEEE Access · doi:10.1109/access.2024.3524102 · Cited by 32
“The intelligence metric must take into account the nature of the varying response of regenerative AIs, but also keep in mind the basic facts that the response should cover.”
Lampinen, A. (2024) · Computational Linguistics · doi:10.1162/coli_a_00525 · Cited by 32
“…particularly effective at increasing base model performance (Webson and Pavlick 2021) and should probably be replaced with examples if possible—though models trained or tuned to follow instructions (e.g., Raffel et al. 2020; Ouyang et al. 2022; Chung et al. 2024) would perhaps show larger bene-fits.”
Patra, B. G., Lepow, L. A., Kasi Reddy Jagadeesh Kumar, P., Vekaria, V., Sharma, M. M., Adekkanattu, P., Fennessy, B., Hynes, G., Landi, I., Sanchez-Ruiz, J. A., et al. (2025) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocae260 · Cited by 32
Storhaug, A., Li, J., & Hu, T. (2023) · Proceedings/Proceedings - International Symposium on Software Reliability Engineering · doi:10.1109/issre59848.2023.00035 · Cited by 47
IDAS: Intelligent Driving Assistance System Using RAG
Hernandez-Salinas, L.-B., Terven, J. R., Chávez‐Urbiola, E. A., Esparza, D. M. C., Romero-González, J.-A., Argüelles-Cruz, A.-J., & Cervantes, I. (2024) · IEEE Open Journal of Vehicular Technology · doi:10.1109/ojvt.2024.3447449 · Cited by 38
Cho, H., Yoo, S., Kim, B., Jang, S., Sunwoo, L., Kim, S., Lee, D., Kim, S., Nam, S., & Chung, J.-H. (2024) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2024.104720 · Cited by 38
Mathebula, M., Modupe, A., & Marivate, V. N. (2024) · IEEE Access · doi:10.1109/access.2024.3464374 · Cited by 37
AIM: Adaptive Inference of Multi-Modal LLMs via Token Merging and Pruning
Zhong, Y., Liu, Z., Li, Y., & Wang, L. (2025) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.01877 · Cited by 62
Estimating the quality of published medical research with ChatGPT
Thelwall, M. A., Jiang, X., & Bath, P. A. (2025) · Information Processing & Management · doi:10.1016/j.ipm.2025.104123 · Cited by 36
Self-citationBoosting Jailbreak Attack with Momentum
Zhang, Y., & Wei, Z. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10888812 · Cited by 62
FoodSky: A food-oriented large language model that can pass the chef and dietetic examinations
Zhou, P., Min, W., Fu, C., Jin, Y., Huang, M., Li, X., Mei, S., & Jiang, S. (2025) · Patterns · doi:10.1016/j.patter.2025.101234 · Cited by 43
DecLLM: LLM-Augmented Recompilable Decompilation for Enabling Programmatic Use of Decompiled Code
Wong, W. K., Wu, D., Wang, H., Li, Z., Liu, Z., Wang, S., Tang, Q., Nie, S., & Wu, S. (2025) · Proceedings of the ACM on software engineering. · doi:10.1145/3728958 · Cited by 56
Liu, Z., Zou, W., & Lin, C. (2025) · Patient Education and Counseling · doi:10.1016/j.pec.2025.109271 · Cited by 34
VeriReason: Reinforcement Learning with Testbench Feedback for Reasoning-Enhanced Verilog Generation
Wang, Y., Sun, G., Ye, W., Qu, G., & Li, A. (2026) · ACM Great Lakes Symposium on VLSI (GLSVLSI) · doi:10.1145/3787109.3815310 · Cited by 38
Automated Metamorphic-Relation Generation with ChatGPT: An Experience Report
Zhang, Y., Towey, D., & Pike, M. (2023) · IEEE Annual International Computer Software and Applications Conference (COMPSAC) · doi:10.1109/compsac57700.2023.00275 · Cited by 44
Can ChatGPT Enable ITS? The Case of Mixed Traffic Control via Reinforcement Learning
Villarreal, M., Poudel, B., & Li, W. (2023) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc57777.2023.10422410 · Cited by 49
Lampinen, A. K. (2022) · arXiv · doi:10.48550/arxiv.2210.15303 · Cited by 32
RosePO: Customized Preference Alignment in LLM-Based Recommendation
Liao, J., He, X., Xie, R., Wu, J., Yuan, Y., Sun, X., Kang, Z., Duan, J., Zang, W., & Wang, X. (2026) · ACM Transactions on Information Systems · doi:10.1145/3833420 · Cited by 32
Self-citationLiu, L., Yang, X., Lei, J., Shen, Y., Wang, J., Wei, P., Chu, Z., Qin, Z., & Ren, K. (2026) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2026.3709941 · Cited by 31
“3) Reinforcement Learning From Human Feedback: RLHF techniques [36], [37] focus on collecting human feedback on the output of model generation to guide the model for further optimization.”
Krüger, R. (2023) · Lebende Sprachen · doi:10.1515/les-2023-0024 · Cited by 37
CoTDet: Affordance Knowledge Prompting for Task Driven Object Detection
Tang, J., Zheng, G., Yu, J., & Yang, S. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00285 · Cited by 56
Training Diffusion Models Towards Diverse Image Generation with Reinforcement Learning
Miao, Z., Wang, J., Wang, Z., Yang, Z., Wang, L., Qiu, Q., & Liu, Z. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01031 · Cited by 96
Silva, D. D., Kaynak, O., El-Ayoubi, M., Mills, N., Alahakoon, D., & Manic, M. (2024) · IEEE Industrial Electronics Magazine · doi:10.1109/mie.2024.3382962 · Cited by 43
Zheng, Y., Chang, C.-H., Huang, S.-H., Chen, P., & Picek, S. (2024) · IEEE Journal on Emerging and Selected Topics in Circuits and Systems · doi:10.1109/jetcas.2024.3477348 · Cited by 47
Popeye: A Unified Visual-Language Model for Multisource Ship Detection From Remote Sensing Imagery
Zhang, W., Cai, M., Zhang, T., Lei, G., Zhuang, Y., & Mao, X. (2024) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2024.3488034 · Cited by 38
Knowledge assimilation: Implementing knowledge-guided agricultural large language model
Jiang, J., Yan, L., Liu, H., Xia, Z., Wang, H., Yang, Y., & Guan, Y. (2025) · Knowledge-Based Systems · doi:10.1016/j.knosys.2025.113197 · Cited by 37
GenAINet: Enabling Wireless Collective Intelligence via Knowledge Transfer and Reasoning
Zou, H., Zhao, Q., Lasaulce, S., Bariah, L., Bennis, M., & Debbah, M. A. (2025) · IEEE Access · doi:10.1109/access.2025.3565859 · Cited by 40
D’Oosterlinck, K., Xu, W., Develder, C., Demeester, T., Singh, A., Potts, C., Kiela, D., & Mehri, S. (2025) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00748 · Cited by 63
Research on the impact of trends related to ChatGPT
Yan, Y., Li, B., Feng, J., Du, Y., Lu, Z., Huang, M., & Li, Y. (2023) · Procedia Computer Science · doi:10.1016/j.procs.2023.08.117 · Cited by 34
Measuring and Modifying Factual Knowledge in Large Language Models
Pezeshkpour, P. (2023) · International Conference on Machine Learning and Applications · doi:10.1109/icmla58977.2023.00122 · Cited by 52
Naik, I., Naik, D., & Naik, N. (2023) · IEEE International Conference on ICT in Business Industry & Government (ICTBIG) · doi:10.1109/ictbig59752.2023.10456201 · Cited by 31
SayPlan: Grounding Large Language Models using 3D Scene Graphs for Scalable Robot Task Planning
Rana, K., Haviland, J., Garg, S., Abou-Chakra, J., Reid, I., & Suenderhauf, N. (2023) · arXiv · doi:10.48550/arxiv.2307.06135 · Cited by 29
Enhancing Zero-Shot Crypto Sentiment With Fine-Tuned Language Model and Prompt Engineering
Wahidur, R. S. M., Tashdeed, I., Kaur, M., & Lee, H.-N. (2024) · IEEE Access · doi:10.1109/access.2024.3350638 · Cited by 45
Chen, Y., Zhang, S., Han, T., Du, Y., Zhang, W., & Li, J. (2024) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2024.04.024 · Cited by 32
Riaz, I. B., Naqvi, S. A. A., Hasan, B., & Murad, M. H. (2024) · Mayo Clinic Proceedings Digital Health · doi:10.1016/j.mcpdig.2024.05.023 · Cited by 36
Nashaat, M., & Miller, J. (2024) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2024.3428324 · Cited by 47
Repeatability of Fine-Tuning Large Language Models Illustrated Using QLoRA
Alahmari, S. S., Hall, L., Mouton, P. R., & Goldgof, D. B. (2024) · IEEE Access · doi:10.1109/access.2024.3470850 · Cited by 41
Gessinger, I., Seaborn, K., Steeds, M., & Cowan, B. R. (2024) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2024.103400 · Cited by 33
Hear Me, See Me, Understand Me: Audio-Visual Autism Behavior Recognition
Deng, S., Kosloski, E. E., Patel, S. D., Barnett, Z. A., Nan, Y., Kaplan, A., Aarukapalli, S., Doan, W. T., Wang, M., Singh, H., et al. (2024) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2024.3521838 · Cited by 46
Privacy and Fairness in Machine Learning: A Survey
Shaham, S., Hajisafi, A., Quan, M. K., Nguyen, D. C., Krishnamachari, B., Peris, C., Ghinita, G., Shahabi, C., & Pathirana, P. N. (2025) · IEEE Transactions on Artificial Intelligence · doi:10.1109/tai.2025.3531326 · Cited by 34
A Comprehensive Survey of Fake Text Detection on Misinformation and LM-Generated Texts
Kwon, S.-C., & Jang, B. (2025) · IEEE Access · doi:10.1109/access.2025.3538805 · Cited by 37
Zhou, J., & Camba, J. D. (2025) · Expert Systems with Applications · doi:10.1016/j.eswa.2025.127520 · Cited by 38
Reinforcement fine-tuning for materials design
Cao, Z., & Wang, L. (2026) · Physical review. B./Physical review. B · doi:10.1103/45zh-44bg · Cited by 32
Augmenting Industrial Chatbots in Energy Systems using ChatGPT Generative AI
Gamage, G., Kahawala, S., Mills, N., Silva, D. D., Manic, M., Alahakoon, D., & Jennings, A. (2023) · IEEE International Symposium on Industrial Electronics (ISIE) · doi:10.1109/isie51358.2023.10228101 · Cited by 30
Can ChatGPT’s Responses Boost Traditional Natural Language Processing?
Amin, M. M., Cambria, E., & Schuller, B. W. (2023) · IEEE Intelligent Systems · doi:10.1109/mis.2023.3305861 · Cited by 39
Intelligent Practices of Large Language Models in Digital Government Services
Han, J., Lu, J., Xu, Y., You, J., & Wu, B. (2024) · IEEE Access · doi:10.1109/access.2024.3349969 · Cited by 32
Natural Language Processing for Arabic Sentiment Analysis: A Systematic Literature Review
Katat, S. A., Zaki, C., Hazimeh, H., Bitar, I. E., Angarita, R., & Trojman, L. (2024) · IEEE Transactions on Big Data · doi:10.1109/tbdata.2024.3366083 · Cited by 30
Xie, T., Wan, Y., Zhou, Y., Huang, W., Liu, Y., Linghu, Q., Wang, S., Kit, C., Grazian, C., Zhang, W., et al. (2024) · Patterns · doi:10.1016/j.patter.2024.100955 · Cited by 43
Long Video Understanding With Learnable Retrieval in Video-Language Models
Xu, J., Lan, C., Xie, W., Chen, X., & Lu, Y. (2026) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2026.3664996 · Cited by 36
A survey on mathematical reasoning and optimization with large language models
Forootani, A., Aliabadi, D. E., & Thrän, D. (2026) · Intelligent Systems with Applications · doi:10.1016/j.iswa.2026.200712 · Cited by 32
Jin, Y., Yang, R., Yi, Z., Shen, X., Peng, H., Liu, X., Qin, J., Li, J., Xie, J., Gao, P., et al. (2023) · arXiv · doi:10.48550/arxiv.2309.13193 · Cited by 29
KoLA: Carefully Benchmarking World Knowledge of Large Language Models
Yu, J., Wang, X., Tu, S., Cao, S., Zhang-Li, D., Lv, X., Peng, H., Yao, Z., Zhang, X., Li, H., et al. (2023) · arXiv · doi:10.48550/arxiv.2306.09296 · Cited by 29
“34 ), potentially demonstrating the widely discussed “alignment tax” (Ouyang et al., 2022).”
BackgroundLarge Language Models Are Not Robust Multiple Choice Selectors
Zheng, C., Zhou, H., Meng, F., Zhou, J., & Huang, M. (2023) · arXiv · doi:10.48550/arxiv.2309.03882 · Cited by 29
ModelShield: Adaptive and Robust Watermark Against Model Extraction Attack
Pang, K., Qi, T., Wu, C., Bai, M., Jiang, M., & Huang, Y. (2025) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2025.3530691 · Cited by 29
“Given that existing LLMs possess an almost human-like capacity for understanding and adhering to instructions [42], [43], our strategy leverages this strong instruction-following ability as a defensive mechanism in system mode.”
BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions
Zhuo, T. Y., Vu, M. C., Chim, J., Hu, H., Yu, W., Widyasari, R., Yusuf, I. N. B., Zhan, H., He, J., Paul, I., et al. (2024) · arXiv · doi:10.48550/arxiv.2406.15877 · Cited by 29
“Later, with the advance in instruction tuning [45], LLMs can generate the code snippet that aligns with the given NL instruction.”
BackgroundPrediction of Arabic Legal Rulings Using Large Language Models
Ammar, A., Koubâa, A., Benjdira, B., Nacar, O., & Sibaee, S. (2024) · Electronics · doi:10.3390/electronics13040764 · Cited by 42
Gong, Y., Shang, L., & Wang, D. (2024) · IEEE Transactions on Computational Social Systems · doi:10.1109/tcss.2024.3404236 · Cited by 34
Real-time local path planning strategy based on deep distributional reinforcement learning
Du, S., Zhu, Z., Wang, X., Han, H., & Qiao, J. (2024) · Neurocomputing · doi:10.1016/j.neucom.2024.128085 · Cited by 33
StagedVulBERT: Multigranular Vulnerability Detection With a Novel Pretrained Code Model
Jiang, Y., Zhang, Y., Su, X., Treude, C., & Wang, T. (2024) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2024.3493245 · Cited by 38
Texts without authors: ascribing literary meaning in the case of AI
Vlaad, S. (2025) · Journal of Aesthetics and Art Criticism · doi:10.1093/jaac/kpae047 · Cited by 35
Qi, Q., Luo, Y., Xu, Y., Guo, W., & Fang, Y. (2025) · Information Fusion · doi:10.1016/j.inffus.2025.103176 · Cited by 41
Metadata
- Authors
- Ouyang, L., Wu, J., Jiang, X., Almeida, D., Wainwright, C., Mishkin, P., Zhang, C., Agarwal, S., Slama, K., Ray, A., Schulman, J., Hilton, J., Kelton, F., Miller, L., Simens, M., Askell, A., Welinder, P., Christiano, P., Leike, J., & Lowe, R.
- Venue
- Advances in Neural Information Processing Systems 35
- Published
- 2022
- Pages
- 27730-27744
- ISSN
- 1049-5258 (ISSN-L)
- OpenAlex
- W7133211372
- Cited by
- 3,117
- References
- 0
- Citations by year
- 2026: 1421 · 2025: 544 · 2024: 852 · 2023: 297 · 2022: 3
- FWCI
- 234.27
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- neural information processing systems (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Keywords
- instruction following, language models, human feedback, reinforcement learning from human feedback, large language models
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.