Training Language Models to Follow Instructions with Human Feedback
The DOI matches its Crossref record; 2 of the 2 references it cites were found in a registry or an index.
Abstract
Making language models bigger does not inherently make them better at following a user's intent. For example, large language models can generate outputs that are untruthful, toxic, or simply not helpful to the user. In other words, these models are not aligned with their users. In this paper, we show an avenue for aligning language models with user intent on a wide range of tasks by fine-tuning with human feedback. Starting with a set of labeler-written prompts and prompts submitted through the OpenAI API, we collect a dataset of labeler demonstrations of the desired model behavior, which we use to fine-tune GPT-3 using supervised learning. We then collect a dataset of rankings of model outputs, which we use to further fine-tune this supervised model using reinforcement learning from human feedback. We call the resulting models InstructGPT. In human evaluations on our prompt distribution, outputs from the 1.3B parameter InstructGPT model are preferred to outputs from the 175B GPT-3, despite having 100x fewer parameters. Moreover, InstructGPT models show improvements in truthfulness and reductions in toxic output generation while having minimal performance regressions on public NLP datasets. Even though InstructGPT still makes simple mistakes, our results show that fine-tuning with human feedback is a promising direction for aligning language models with human intent.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Existing literature (Ouyang et al., 2022) does not fully describe the details of these models, such as the pretraining corpus, model sizes, and model biases.”
From Self-Refine: Iterative Refinement with Self-Feedback (2023) · cites this paper as Ouyang et al., 2022
Experimental — accuracy not yet measuredIn the citing paper
“Specifically, providers mitigate race and gender bias through reinforcement learning from human feedback (RLHF), adversarial stress-testing known as red teaming, and hard-coded refusals governed by the provider's own content policies [6, 43, 71].”
From All Public Voices Are Equal, But Are Some More Equal Than Others to LLMs? (2026) · cites this paper as [71]
In the citing paper
“Fine-tuning a model from human feedback at scale, using preference data from paid raters or drawn from a large and willing user base, is an especially potent technique.It has the potential not only to shape a model's responses to better reflect user norms (for better or worse), but also to filter out toxic language, improve factual accuracy, and mitigate the tendency to fabricate information.”
From Talking about Large Language Models (2024) · cites this paper as [26]
In the citing paper
“These include general competencies such as in-context learning (ICL) [13], chain-of-thought (CoT) [17] reasoning, and instruction following [25], as well as task-specialized skills like mathematical reasoning [30].”
From A Survey of Large Language Models (2026) · cites this paper as [25]
In the citing paper
“When external reward models or ground-truth answers are available, rejection sampling can also be applied to select higher-quality responses from multiple candidates [25].”
From A Survey of Large Language Models (2026) · cites this paper as [25]
41 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
The publisher hasn’t deposited this paper’s reference list.
Cited by
Items 701–800 of 4,340
DR-RAG: Domain-Rule-based Retrieval-Augmented Generation for aviation digital model design
Xiong, X., Cai, H., Han, Y., Shen, B., & Hu, P. (2025) · Advanced Engineering Informatics · doi:10.1016/j.aei.2025.103688 · Cited by 34
Chen, J., Liu, F., Liu, N., Luo, Y., Qin, E., Zheng, H., Dong, T., Zhu, H., Meng, Y., & Wang, X. (2026) · International Conference on Computer Supported Cooperative Work in Design (CSCWD) · doi:10.1109/cscwd68734.2026.11582237 · Cited by 29
Green AI techniques for reducing energy consumption in AI systems
Khan, S., Naz, N. S., Mazhar, T., Tariq, M. U., Shahzad, T., Guizani, S., & Hamam, H. (2025) · Array · doi:10.1016/j.array.2025.100652 · Cited by 40
Agentic AI and the rise of in silico team science in biomedical research
Li, B., Saini, A. K., Hernandez, J. G., & Moore, J. H. (2026) · Nature Biotechnology · doi:10.1038/s41587-026-03035-1 · Cited by 45
Do Large Language Models Show Human-like Biases? Exploring Confidence—Competence Gap in AI
Singh, A. K., Lamichhane, B., Devkota, S., Dhakal, U., & Dhakal, C. (2024) · Information · doi:10.3390/info15020092 · Cited by 29
Discrete Prompt Compression With Reinforcement Learning
Jung, H., & Kim, K.-J. (2024) · IEEE Access · doi:10.1109/access.2024.3403426 · Cited by 64
A Review of State of the Art Deep Learning Models for Ontology Construction
Zengeya, T., & Fonou-Dombeu, J. V. (2024) · IEEE Access · doi:10.1109/access.2024.3406426 · Cited by 33
Girton, M., Greene, D. N., Lambert-Messerlian, G. M., Keren, D. F., & Yu, M. (2024) · Clinical Chemistry · doi:10.1093/clinchem/hvae093 · Cited by 29
Koto, F., Mahendra, R., Aisyah, N., & Baldwin, T. (2024) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00726 · Cited by 75
Boosting Large Language Model for Speech Synthesis: An Empirical Study
Hao, H., Zhou, L., Liu, S., Li, J., Hu, S., Wang, R., & Wei, F. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10890588 · Cited by 32
SYNAuG: Exploiting synthetic data for data imbalance problems
Ye-Bin, M., Hyeon-Woo, N., Choi, W., Kim, N., Kwak, S., & Oh, T.-H. (2025) · Pattern Recognition Letters · doi:10.1016/j.patrec.2025.04.013 · Cited by 33
Training large language models on narrow tasks can lead to broad misalignment
Betley, J., Warncke, N., Sztyber-Betley, A., Tan, D., Bao, X., Soto, M., Srivastava, M., Labenz, N., & Evans, O. (2026) · Nature · doi:10.1038/s41586-025-09937-5 · Cited by 31
Agentic AI Security: Threats, Defenses, Evaluation, and Open Challenges
Chhabra, A., Datta, S., Nahin, S. K., & Mohapatra, P. (2026) · IEEE Access · doi:10.1109/access.2026.3675554 · Cited by 28
“Modern pretraining and supervised fine-tuning paradigms on dialogue-style data, which trains the model to learn short-term instruction-response behavior (while deprioritizing long-term embodied sequential state tracking), are likely resulting in these shortcomings [165, 162].”
Personalized Large Language Models
Woźniak, S., Koptyra, B., Janz, A., Kazienko, P., & Kocoń, J. (2024) · 2024 IEEE International Conference on Data Mining Workshops (ICDMW) · doi:10.1109/icdmw65004.2024.00071 · Cited by 28
Zhao, Y., Liu, C. H., Yi, T., Li, G., & Wu, D. O. (2024) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2024.3459039 · Cited by 28
OptLLM: Optimal Assignment of Queries to Large Language Models
Liu, Y., Zhang, H., Miao, Y., Le, V.-H., & Li, Z. (2024) · IEEE International Conference on Web Services (ICWS) · doi:10.1109/icws62655.2024.00098 · Cited by 43
ChatNav: Leveraging LLM to Zero-Shot Semantic Reasoning in Object Navigation
Zhu, Y., Wen, Z., Li, X., Shi, X., Wu, X., Dong, H. F., & Chen, J. (2024) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2024.3485907 · Cited by 35
Zhao, R., Tang, J., Zeng, W., Guo, Y., & Zhao, X. H. (2024) · Information Processing & Management · doi:10.1016/j.ipm.2024.104044 · Cited by 53
A diversity-enhanced knowledge distillation model for practical math word problem solving
Zhang, Y., Zhou, G., Xie, Z., Ma, J., & Huang, J. X. (2025) · Information Processing & Management · doi:10.1016/j.ipm.2025.104059 · Cited by 28
Rahman, M. A., Shahriar, H., Wu, F., & Cuzzocrea, A. (2024) · International Conference on Artificial Intelligence, Blockchain, and Internet of Things (AIBThings) · doi:10.1109/aibthings63359.2024.10863664 · Cited by 33
Compromising LLM Driven Embodied Agents With Contextual Backdoor Attacks
Liu, A., Zhou, Y., Liu, X., Zhang, T., Liang, S., Wang, J., Pu, Y., Li, T., Zhang, J., Zhou, W., et al. (2025) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2025.3555410 · Cited by 59
Affective computing in the era of large language models: A survey from the NLP perspective
Zhang, Y., Yang, X., Xu, X., Gao, Z., Huang, Y., Mu, S., Feng, S., Wang, D., Zhang, Y., Song, K., et al. (2026) · Knowledge-Based Systems · doi:10.1016/j.knosys.2026.115411 · Cited by 37
Automatic generation of virtual architecture using user activities in metaverse
Jang, S.-Y., & Kim, S.-A. (2023) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2023.103163 · Cited by 30
ChatGPT in Occupational Medicine: A Comparative Study with Human Experts
Padovan, M., Cosci, B., Petillo, A., Nerli, G., Porciatti, F., Scarinci, S., Carlucci, F., Dell’Amico, L., Meliani, N., Necciari, G., et al. (2024) · Bioengineering · doi:10.3390/bioengineering11010057 · Cited by 31
SAPIEN: Affective Virtual Agents Powered by Large Language Models*
Hasan, M., Ozel, C., Potter, S., & Hoque, M. E. (2023) · International Conference on Affective Computing and Intelligent Interaction Workshops and Demos (ACIIW) · doi:10.1109/aciiw59127.2023.10388188 · Cited by 42
Frequency-Aware Multi-Modal Fine-Tuning for Few-Shot Open-Set Remote Sensing Scene Classification
Zhang, J., Rao, Y., Huang, X., Li, G., Zhou, X., & Zeng, D. (2024) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2024.3372416 · Cited by 31
Asymptotics of Language Model Alignment
Yang, J. Q., Salamatian, S., Sun, Z., Suresh, A. T., & Beirami, A. (2024) · IEEE International Symposium on Information Theory (ISIT) · doi:10.1109/isit57864.2024.10619456 · Cited by 58
LLM-aided explanations of EDA synthesis errors
Qiu, S., Tan, B., & Pearce, H. A. (2024) · IEEE LLM Aided Design Workshop (LAD) · doi:10.1109/lad62341.2024.10691721 · Cited by 36
Xu, K., Zhang, K., Li, J., Huang, W., & Wang, Y. (2024) · doi:10.20944/preprints202411.1648.v1 · Cited by 28
Recommendations to Create Programming Exercises to Overcome ChatGPT
Berrezueta-Guzman, J., & Krusche, S. (2023) · 2023 IEEE 35th International Conference on Software Engineering Education and Training (CSEE&T) · doi:10.1109/cseet58097.2023.00031 · Cited by 27
Evaluating Cognitive Maps and Planning in Large Language Models with CogEval
Momennejad, I., Hasanbeig, H., Frujeri, F. V., Sharma, H., Jojic, N., Palangi, H., Ness, R., & Larson, J. (2023) · Advances in Neural Information Processing Systems 36 · doi:10.52202/075280-3056 · Cited by 27
Codepori: Large-Scale System for Autonomous Software Development Using Multi-Agent Technology
Rasheed, Z., Malik, S., Kemell, K.-K., Muhammad, W., Saari, M., Systä, K., & Abrahamsson, P. (2024) · doi:10.2139/ssrn.4979510 · Cited by 27
Deep mechanism reduction (DeePMR) method for fuel chemical kinetics
Wang, Z., Zhang, Y., Lin, P., Zhao, E., Weinan, E., Zhang, T., & Xu, Z. J. (2024) · Combustion and Flame · doi:10.1016/j.combustflame.2023.113286 · Cited by 28
Requirements Satisfiability with In-Context Learning
Santos, S., Breaux, T. D., Norton, T. B., Haghighi, S., & Ghanavati, S. (2024) · IEEE International Requirements Engineering Conference (RE) · doi:10.1109/re59067.2024.00025 · Cited by 31
A Comprehensive Evaluation of Neural SPARQL Query Generation From Natural Language Questions
Diallo, P. A. K. K., Reyd, S., & Zouaq, A. (2024) · IEEE Access · doi:10.1109/access.2024.3453215 · Cited by 38
MMSR: Symbolic regression is a multi-modal information fusion task
Li, Y., Liu, J., Wu, M., Yu, L., Li, W., Ning, X., Li, W., Hao, M., Deng, Y., & Wei, S. (2024) · Information Fusion · doi:10.1016/j.inffus.2024.102681 · Cited by 38
Cobblestone: A Divide-and-Conquer Approach for Automating Formal Verification
Kasibatla, S. R., Agrawal, A., Brun, Y., Lerner, S., Ringer, T., & First, E. (2026) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/3744916.3773178 · Cited by 30
AgentCoord: Visually exploring coordination strategy for LLM-based multi-agent collaboration
Pan, B., Lu, J., Wang, K., Li, Z., Wen, Z., Feng, Y., Zhu, M., & Chen, W. (2025) · Computers & Graphics · doi:10.1016/j.cag.2025.104338 · Cited by 38
Lauren, P., & Watta, P. B. (2023) · IEEE Frontiers in Education Conference (FIE) · doi:10.1109/fie58773.2023.10342970 · Cited by 34
Morales, M., Amado-Salvatierra, H. R., Hernández-Rizzardini, R., & Roca, M. D. L. (2023) · IEEE Frontiers in Education Conference (FIE) · doi:10.1109/fie58773.2023.10343296 · Cited by 31
TCMM: A unified database for traditional Chinese medicine modernization and therapeutic innovations
Ren, Z., Ren, Y., Li, Z., & Xu, H. (2024) · Computational and Structural Biotechnology Journal · doi:10.1016/j.csbj.2024.04.016 · Cited by 28
Transformers in source code generation: A comprehensive survey
Ghaemi, H., Alizadehsani, Z., Shahraki, A., & Corchado, J. M. (2024) · Journal of Systems Architecture · doi:10.1016/j.sysarc.2024.103193 · Cited by 31
Can LLMS Beat Humans in Debating? A Dynamic Multi-Agent Framework for Competitive Debate
Zhang, Y., Yang, X., Feng, S., Wang, D., Zhang, Y., & Song, K. (2026) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp55912.2026.11460889 · Cited by 31
Pytester: Deep reinforcement learning for text-to-testcase generation
Takerngsaksiri, W., Charakorn, R., Tantithamthavorn, C. K., & Li, Y.-F. (2025) · Journal of Systems and Software · doi:10.1016/j.jss.2025.112381 · Cited by 32
Imp: Highly Capable Large Multimodal Models for Mobile Devices
Shao, Z., Zhou, Y., Yu, J., Ouyang, X., Zheng, L., Gai, Z., Wang, M., Kuang, Z., & Ding, J. (2025) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2025.3557680 · Cited by 39
Learning visual language models for video understanding
Yang, A. (2023) · theses.fr (ABES) · doi:10.70675/802872a7z8092z4556za1fdz2c7af45f0e72 · Cited by 26
RA-DIT: Retrieval-Augmented Dual Instruction Tuning
Lin, X. V., Chen, X., Chen, M., Shi, W., Lomeli, M., James, R., Rodriguez, P., Kahn, J., Szilvasy, G., Lewis, M., et al. (2023) · arXiv · doi:10.48550/arxiv.2310.01352 · Cited by 26
AgentBoard: An analytical evaluation board of multi-turn LLM agents
Ma, C., Zhang, J., Zhu, Z., Yang, C., Yang, Y., Jin, Y., Lan, Z., Kong, L., & He, J. (2024) · Advances in Neural Information Processing Systems 37 · doi:10.52202/079017-2365 · Cited by 26
Generating Executable Action Plans with Environmentally-Aware Language Models
Gramopadhye, M., & Szafir, D. (2023) · 2023 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros55552.2023.10341989 · Cited by 26
A Survey on MLLMs in Education: Application and Future Directions
Xing, W., Zhu, T., Wang, J., & Liu, B. (2024) · Future Internet · doi:10.3390/fi16120467 · Cited by 36
Bibliometric Analysis on ChatGPT Research with CiteSpace
Nan, D., Zhao, X., Chen, C., Sun, S., Lee, K. R., & Kim, J. H. (2025) · Information · doi:10.3390/info16010038 · Cited by 30
DVPT: Dynamic Visual Prompt Tuning of large pre-trained models for medical image analysis
He, A., Wu, Y., Wang, Z., Li, T., & Fu, H. (2025) · Neural Networks · doi:10.1016/j.neunet.2025.107168 · Cited by 33
A large language model framework for literature-based disease–gene association prediction
Li, P.-H., Sun, Y.-Y., Juan, H., Chen, C., Tsai, H., & Huang, J. (2024) · Briefings in Bioinformatics · doi:10.1093/bib/bbaf070 · Cited by 29
A pre-trained large generative model for translating single-cell transcriptomes to proteomes
Liu, L., Li, W., Wang, F., Li, Y., Huang, L.-K., Wong, K., Yang, F., & Yao, J. (2025) · Nature Biomedical Engineering · doi:10.1038/s41551-025-01528-z · Cited by 34
MindDrive: A Vision-Language-Action Model for Autonomous Driving via Online Reinforcement Learning
Fu, H., Zhang, D., Zhao, Z., Cui, J., Xie, H., Wang, B., Chen, G., Ye, H., Liang, D., & Bai, X. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37026-6_28 · Cited by 33
Self-Prompt Tuning: Enable Autonomous Role-Playing in LLMs
Kong, A., Zhao, S., Chen, H., Li, Q., Qin, Y., Zhou, J., & Sun, H. (2025) · Lecture notes in computer science · doi:10.1007/978-981-95-3343-5_33 · Cited by 32
Song, Z., Xie, Y., Yang, L., & Zhao, Y. (2026) · International Journal of Production Research · doi:10.1080/00207543.2026.2641103 · Cited by 38
A multimodal vision-language model for comprehensive dental diagnosis and enhanced clinical practice
Meng, Z., Hao, J., Dai, X., Feng, Y., Liu, J., Feng, B., Wu, H., Gai, X., Zhu, H., Hu, T., et al. (2026) · Nature Communications · doi:10.1038/s41467-026-75718-x · Cited by 28
Self-citationRethinking Learning Rate Tuning in the Era of Large Language Models
Jin, H., Wei, W., Wang, X., Zhang, W., & Wu, Y. (2023) · IEEE International Conference on Cognitive Machine Intelligence (CogMI) · doi:10.1109/cogmi58952.2023.00025 · Cited by 41
TrumorGPT: Query Optimization and Semantic Reasoning over Networks for Automated Fact-Checking
Hang, C. N., Yu, P.-D., & Tan, C. W. (2024) · Conference on Information Sciences and Systems · doi:10.1109/ciss59072.2024.10480162 · Cited by 34
Xiao, S., Zhang, S., Jiang, M., & Wang, W.-Q. (2024) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2024.3398069 · Cited by 26
Acquiring and modeling abstract commonsense knowledge via conceptualization
He, M., Fang, T., Wang, W., & Song, Y. (2024) · Artificial Intelligence · doi:10.1016/j.artint.2024.104149 · Cited by 41
Reinforcement Learning with Human Feedback for Realistic Traffic Simulation
Cao, Y., Ivanovic, B., Xiao, C., & Pavone, M. (2024) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra57147.2024.10610878 · Cited by 40
Mixture-of-Agents Enhances Large Language Model Capabilities
Wang, J., Wang, J., Athiwaratkun, B., Zhang, C., & Zou, J. (2024) · arXiv · doi:10.48550/arxiv.2406.04692 · Cited by 386
“These models are pretrained on vast amounts of data and subsequently aligned with human preferences to generate helpful and coherent outputs (Ouyang et al., 2022).”
BackgroundSelf-citationTechnological folie à deux: Feedback Loops Between AI Chatbots and Mental Illness
Dohnány, S., Kurth-Nelson, Z., Spens, E., Luettgau, L., Reid, A., Gabriel, I., Summerfield, C., Shanahan, M., & Nour, M. M. (2025) · arXiv · doi:10.48550/arxiv.2507.19218 · Cited by 26
“…can include: ● Reinforcement learning from human feedback (RLHF): which uses human ratings of LLM output quality to further train the base LLM 72,73 Supervised fine tuning (SFT): training the LLM on curated examples of good conversations 74 ● Constitutional AI: which uses AI-generated feedback…”
Bridging large language model disparities: skill tagging of multilingual educational content
Kwak, Y., & Pardos, Z. A. (2024) · British Journal of Educational Technology · doi:10.1111/bjet.13465 · Cited by 25
Jiang, B., Wang, Q., Wu, S., Wang, Y., & Lu, G. (2024) · Energies · doi:10.3390/en17061381 · Cited by 25
Derner, E., Kučera, D., Oliver, N., & Zahálka, J. (2024) · Computers in Human Behavior Artificial Humans · doi:10.1016/j.chbah.2024.100088 · Cited by 34
Prompting large language models for user simulation in task-oriented dialogue systems
Algherairy, A. S., & Ahmed, M. (2024) · Computer Speech & Language · doi:10.1016/j.csl.2024.101697 · Cited by 25
Generative AI for Software Security Analysis: Fundamentals, Applications, and Challenges
Ding, A., Li, G., Yi, X., Lin, X., Li, J., & Zhang, C. (2024) · IEEE Software · doi:10.1109/ms.2024.3416036 · Cited by 34
Self-citationXu, J., Zhang, H., Zhang, H., Lu, J., & Xiao, G. (2024) · IEEE Access · doi:10.1109/access.2024.3485877 · Cited by 32
Wang, Z., Duan, J., Yuan, C., Chen, Q., Chen, T., Zhang, Y., Wang, R., Shi, X., & Xu, K. (2024) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2024.109553 · Cited by 50
Sun, Y., Li, X., Liu, C., Deng, X., Zhang, W., Wang, J.-G., Zhang, Z., Wen, T., Song, T., & Dong-Ying, J. U. (2024) · Materials & Design · doi:10.1016/j.matdes.2024.113506 · Cited by 26
Anomaly Detection on Interleaved Log Data With Semantic Association Mining on Log-Entity Graph
Chu, G., Wang, J., Qi, Q., Sun, H., Zhuang, Z., He, B., Jing, Y., Zhang, L., & Liao, J. (2025) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2025.3527856 · Cited by 28
Task Planning for a Factory Robot Using Large Language Model
Tsushima, Y., Yamamoto, S., Ravankar, A. A., Luces, J. V. S., & Hirata, Y. (2025) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2025.3531153 · Cited by 30
Few-shot learning of geological cross-sections from sparse data using large language model
Li, H., & Shi, C. (2025) · Geodata and AI. · doi:10.1016/j.geoai.2025.100010 · Cited by 27
ReinDiffuse: Crafting Physically Plausible Motions with Reinforced Diffusion Model
Han, G., Liang, M., Tang, J., Cheng, Y., Liu, W., & Huang, S. (2025) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv61041.2025.00222 · Cited by 38
Etaiwi, W., & Alhijawi, B. (2025) · Array · doi:10.1016/j.array.2025.100478 · Cited by 31
Opportunities and Challenges of Foundation Models in Industrial Manufacturing
Ayyat, M., Osman, M., & Nadeem, T. (2025) · IEEE Access · doi:10.1109/access.2025.3589777 · Cited by 31
Mou, C., Liang, A., Hu, C., Meng, F., Han, B., & Xu, F. (2023) · Animals · doi:10.3390/ani13203168 · Cited by 31
APIGen: Generative API Method Recommendation
Chen, Y., Gao, C., Zhu, M., Liao, Q., Wang, Y., & Xu, G. (2024) · IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER) · doi:10.1109/saner60148.2024.00025 · Cited by 30
PRDP: Proximal Reward Difference Prediction for Large-Scale Reward Finetuning of Diffusion Models
Deng, F., Wang, Q., Wei, W., Hou, T., & Grundmann, M. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00709 · Cited by 49
Zero-shot LLM-guided Counterfactual Generation: A Case Study on NLP Model Evaluation
Bhattacharjee, A., Moraffah, R., Garland, J., & Liu, H. (2024) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata62323.2024.10825537 · Cited by 44
A Survey of Generative Techniques for Spatial-Temporal Data Mining
Zhang, Q., Wang, H., Wen, H., Long, C., Su, L., He, X., Wu, T., Jensen, C. S., Yiu, S., & Yin, H. (2026) · Data Science and Engineering · doi:10.1007/s41019-026-00346-w · Cited by 27
A roadmap for evaluating moral competence in large language models
Haas, J., Bridgers, S., Manzini, A., Henke, B., May, J., Levine, S., Weidinger, L., Shanahan, M., Lum, K., Gabriel, I., et al. (2026) · Nature · doi:10.1038/s41586-025-10021-1 · Cited by 25
A Survey of Progress in LLM Alignment From the Perspective of Reward Design
Ji, M., Wu, Y., Wu, Z., Wang, S., Yang, J., Dras, M., & Naseem, U. (2026) · IEEE Transactions on Artificial Intelligence · doi:10.1109/tai.2026.3654921 · Cited by 30
LLMs cannot find reasoning errors, but can correct them given the error location
Tyen, G., Mansoor, H., Carbune, V., Chen, P., & Mak, T. (2024) · Findings of the Association for Computational Linguistics ACL 2024 · doi:10.18653/v1/2024.findings-acl.826 · Cited by 156
Token-Budget-Aware LLM Reasoning
Han, T., Wang, Z., Fang, C., Zhao, S., Ma, S., & Chen, Z. (2025) · Findings of the Association for Computational Linguistics: ACL 2025 · doi:10.18653/v1/2025.findings-acl.1274 · Cited by 31
Li, Z., Zhang, H., Peng, C., & Peiris, R. (2025) · 2025 IEEE Conference Virtual Reality and 3D User Interfaces (VR) · doi:10.1109/vr59515.2025.00025 · Cited by 24
Mindstorms in Natural Language-Based Societies of Mind
Zhuge, M., Liu, H., Faccio, F., Ashley, D. R., Csordás, R., Gopalakrishnan, A., Hamdi, A., Hammoud, H. A. A. K., Herrmann, V., Irie, K., et al. (2023) · arXiv · doi:10.48550/arxiv.2305.17066 · Cited by 24
Mindstorms in Natural Language-Based Societies of Mind
Zhuge, M., Liu, H., Faccio, F., Ashley, D. R., Csordás, R., Gopalakrishnan, A., Hamdi, A., Hammoud, H. A. A. K., Herrmann, V., Irie, K., et al. (2025) · Computational Visual Media · doi:10.26599/cvm.2025.9450460 · Cited by 24
Ahmed, T., Ivan, S., Munir, A., & Ahmed, S. (2024) · Natural Language Processing Journal · doi:10.1016/j.nlp.2024.100079 · Cited by 34
LaAeb: A comprehensive log-text analysis based approach for insider threat detection
Fei, K., Zhou, J., Zhou, Y., Gu, X., Fan, H., Li, B., Wang, W., & Chen, Y. (2024) · Computers & Security · doi:10.1016/j.cose.2024.104126 · Cited by 32
Ke, Z., Zou, Q., Liu, J., & Qian, S. (2025) · Transportation Research Part C Emerging Technologies · doi:10.1016/j.trc.2025.105040 · Cited by 31
Liu, S., Liu, S., Sha, L., Zeng, Z., Gašević, D., & Liu, Z. (2025) · IEEE Transactions on Learning Technologies · doi:10.1109/tlt.2025.3570775 · Cited by 27
SGE: Semantic-guided Generalization Enhancement for Few-Shot Learning
Zheng, Z., Zhu, Y., Wu, H., Lv, L., Niu, S., & Yu, G. (2025) · Knowledge-Based Systems · doi:10.1016/j.knosys.2025.113761 · Cited by 29
GTPO: Stabilizing Group Relative Policy Optimization via Gradient and Entropy Control
Simoni, M., Fontana, A., Rossolini, G., Saracino, A., & Mori, P. (2026) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl.a.800 · Cited by 24
ChatGPT: More Human-Like Than Computer-Like, but Not Necessarily in a Good Way
Azaria, A. (2023) · IEEE International Conference on Tools with Artificial Intelligence (ICTAI) · doi:10.1109/ictai59109.2023.00074 · Cited by 33
All in How You Ask for It: Simple Black-Box Method for Jailbreak Attacks
Takemoto, K. (2024) · Applied Sciences · doi:10.3390/app14093558 · Cited by 54
How to Regulate Large Language Models for Responsible AI
Berengueres, J. O. L. (2024) · IEEE Transactions on Technology and Society · doi:10.1109/tts.2024.3403681 · Cited by 30
Metadata
- Authors
- Ouyang, L., Wu, J., Jiang, X., Almeida, D., Wainwright, C., Mishkin, P., Zhang, C., Agarwal, S., Slama, K., Ray, A., Schulman, J., Hilton, J., Kelton, F., Miller, L., Simens, M., Askell, A., Welinder, P., Christiano, P., Leike, J., & Lowe, R.
- Venue
- Advances in Neural Information Processing Systems 35
- Published
- 2022
- Pages
- 27730-27744
- ISSN
- 1049-5258 (ISSN-L)
- OpenAlex
- W7133211372
- Cited by
- 3,117
- References
- 0
- Citations by year
- 2026: 1421 · 2025: 544 · 2024: 852 · 2023: 297 · 2022: 3
- FWCI
- 234.27
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- neural information processing systems (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Keywords
- instruction following, language models, human feedback, reinforcement learning from human feedback, large language models
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.