Training Language Models to Follow Instructions with Human Feedback
The DOI matches its Crossref record; 2 of the 2 references it cites were found in a registry or an index.
Abstract
Making language models bigger does not inherently make them better at following a user's intent. For example, large language models can generate outputs that are untruthful, toxic, or simply not helpful to the user. In other words, these models are not aligned with their users. In this paper, we show an avenue for aligning language models with user intent on a wide range of tasks by fine-tuning with human feedback. Starting with a set of labeler-written prompts and prompts submitted through the OpenAI API, we collect a dataset of labeler demonstrations of the desired model behavior, which we use to fine-tune GPT-3 using supervised learning. We then collect a dataset of rankings of model outputs, which we use to further fine-tune this supervised model using reinforcement learning from human feedback. We call the resulting models InstructGPT. In human evaluations on our prompt distribution, outputs from the 1.3B parameter InstructGPT model are preferred to outputs from the 175B GPT-3, despite having 100x fewer parameters. Moreover, InstructGPT models show improvements in truthfulness and reductions in toxic output generation while having minimal performance regressions on public NLP datasets. Even though InstructGPT still makes simple mistakes, our results show that fine-tuning with human feedback is a promising direction for aligning language models with human intent.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Existing literature (Ouyang et al., 2022) does not fully describe the details of these models, such as the pretraining corpus, model sizes, and model biases.”
From Self-Refine: Iterative Refinement with Self-Feedback (2023) · cites this paper as Ouyang et al., 2022
Experimental — accuracy not yet measuredIn the citing paper
“Specifically, providers mitigate race and gender bias through reinforcement learning from human feedback (RLHF), adversarial stress-testing known as red teaming, and hard-coded refusals governed by the provider's own content policies [6, 43, 71].”
From All Public Voices Are Equal, But Are Some More Equal Than Others to LLMs? (2026) · cites this paper as [71]
In the citing paper
“Fine-tuning a model from human feedback at scale, using preference data from paid raters or drawn from a large and willing user base, is an especially potent technique.It has the potential not only to shape a model's responses to better reflect user norms (for better or worse), but also to filter out toxic language, improve factual accuracy, and mitigate the tendency to fabricate information.”
From Talking about Large Language Models (2024) · cites this paper as [26]
In the citing paper
“These include general competencies such as in-context learning (ICL) [13], chain-of-thought (CoT) [17] reasoning, and instruction following [25], as well as task-specialized skills like mathematical reasoning [30].”
From A Survey of Large Language Models (2026) · cites this paper as [25]
In the citing paper
“When external reward models or ground-truth answers are available, rejection sampling can also be applied to select higher-quality responses from multiple candidates [25].”
From A Survey of Large Language Models (2026) · cites this paper as [25]
41 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
The publisher hasn’t deposited this paper’s reference list.
Cited by
Items 1,701–1,800 of 4,340
Let’s learn step by step: Enhancing in-context learning ability with curriculum learning
Liu, Y., Liu, J., Shi, X., Cheng, Q., Huang, Y., & Lu, W. (2024) · arXiv · doi:10.48550/arxiv.2402.10738 · Cited by 4
“…instruction-tuned Large Language Models (LLMs) exhibited remarkable proficiency in under-1 standing human intentions and generating human-like text (Ouyang et al., 2022), researchers have initiated the integration of curriculum learning during instruction tuning (Feng et al., 2023; Lee et al.,…”
BackgroundFrom Imitation to Introspection: Probing Self-Consciousness in Language Models
Chen, S., Yu, S., Zhao, S., & Lu, C. (2025) · Findings of the Association for Computational Linguistics: ACL 2025 · doi:10.18653/v1/2025.findings-acl.392 · Cited by 29
AV-Deepfake1M++: A Large-Scale Audio-Visual Deepfake Benchmark with Real-World Perturbations
Cai, Z., Kuckreja, K., Ghosh, S., Chuchra, A., Khan, M. H., Tariq, U., Gedeon, T., & Dhall, A. (2025) · Proceedings of the 33rd ACM International Conference on Multimedia · doi:10.1145/3746027.3761979 · Cited by 4
CiteME: Can Language Models Accurately Cite Scientific Claims?
Press, O., Hochlehnert, A., Prabhu, A., Udandarao, V., Press, O., & Bethge, M. (2024) · arXiv · doi:10.48550/arxiv.2407.12861 · Cited by 4
“HumanEval [17], for example, which consists of 164 programming problems, is among the most influential LM datasets today, appearing in virtually every SoTA LM paper recently published [66, 1, 81, 19].”
BackgroundXiao, B., Yin, Z., & Shan, Z. (2023) · arXiv · doi:10.48550/arxiv.2311.06957 · Cited by 4
“However, concerns remain about potential biases, reproducibility, interpretability, and ethics of both LLMs and GAs [48, 49].”
BackgroundAgCV: An Agentic framework for automating computer vision application
Saxena, A., Chaudhari, A. Y., & Gupta, A. (2025) · MethodsX · doi:10.1016/j.mex.2025.103424 · Cited by 4
Cockpit-Llama: Driver Intent Prediction in Intelligent Cockpit via Large Language Model
Chen, Y., Li, C., Yuan, Q., Li, J., Fan, Y., Ge, X., Li, Y., Gao, F., & Zhao, R. (2024) · Sensors · doi:10.3390/s25010064 · Cited by 4
Liu, X., Yin, D., Zhang, C., Zhao, D., & Feng, Y. (2025) · Computational Linguistics · doi:10.1162/coli_a_00548 · Cited by 10
Self-citationCPR: Mitigating Large Language Model Hallucinations with Curative Prompt Refinement
Shim, J.-W., Ju, Y.-J., Park, J.-H., & Lee, S.-W. (2024) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/smc54092.2024.10830938 · Cited by 4
PRESS: Defending Privacy in Retrieval-Augmented Generation via Embedding Space Shifting
He, J., Liu, C., Hou, G., Jiang, W., & Li, J. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10887843 · Cited by 4
Multimodal metaphor recognition based on chain-of-cognition prompting
Zhang, D., Lu, X., Zhuang, M., Yang, S., & Chen, H. (2025) · Cognitive Systems Research · doi:10.1016/j.cogsys.2025.101356 · Cited by 9
The Sectarian Divide: The Dynamics of Populism in South Korea
Jung, Y. J. (2025) · Journal of East Asian Studies · doi:10.1017/jea.2025.13 · Cited by 5
Enhancing LLM Performance on Hardware Design Generation Task via Reinforcement Learning
Zhao, Y., Fu, W., Li, S., Hu, Y., Guo, X., & Jin, Y. (2025) · IEEE International Symposium on Circuits and Systems proceedings · doi:10.1109/iscas56072.2025.11043832 · Cited by 6
Wang, S., Zhang, S., Sun, F., Chen, W., & Wu, P. (2025) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2025.3586983 · Cited by 6
SuKE: Structural Knowledge Extractor enhances large language model for knowledge graph completion
Ye, Y., & Wang, S. (2025) · Expert systems with applications · doi:10.1016/j.eswa.2025.129199 · Cited by 3
Liang, Y., Tohti, T., Hu, W., Yan, T., Wang, S., & Hamdulla, A. (2025) · Expert Systems with Applications · doi:10.1016/j.eswa.2025.129250 · Cited by 9
Li, Q., Lin, J., Wang, C., Xiao, S., Jiang, X., & Hu, Z. (2025) · Journal of Retailing and Consumer Services · doi:10.1016/j.jretconser.2025.104460 · Cited by 4
Self-citationMusicSwarm: Biologically Inspired Intelligence for Music Composition
Buehler, M. J. (2026) · Advanced Intelligent Systems · doi:10.1002/aisy.202501253 · Cited by 2
Large Action Models for Programmatic Orchestration
Piccoli, G., Rodriguez, J., & Mahmoud, A. (2025) · Business & Information Systems Engineering · doi:10.1007/s12599-025-00966-y · Cited by 5
Large scale retrieval for the LinkedIn feed using causal language models
Ramanujam, S. S., Alonso, A., Kataria, S., Dangi, S., Gupta, A. K., Tiwana, B., Somaiya, M. H., Simon, L., Byrne, D., Arun, M., et al. (2026) · AI Magazine · doi:10.1002/aaai.70078 · Cited by 4
CG-TTRL: Context-Guided Test-Time Reinforcement Learning for On-Device Large Language Models
Hosseini, P., Bohdal, O., Ceritli, T., Castro, I., Purver, M., Ozay, M., & Michieli, U. (2026) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl.a.783 · Cited by 4
Generative Bid Shading in Real-Time Bidding Advertising
Huang, Y., Ma, H., Chen, W., Wang, Z., Wang, S., Zhang, Y., Wei, X., Zhu, Y., Wang, H., & Wang, X. (2026) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3805712.3809566 · Cited by 4
Wang, X., Jiang, J., Chen, Q. K., Chen, L., Zhu, L., Wang, Y., Tian, Y., & Tang, J. (2026) · Neurocomputing · doi:10.1016/j.neucom.2026.134311 · Cited by 4
Offline reinforcement learning for badminton tactical decision-making
Liu, M., Tao, W., & Huang, H. (2025) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2025.113395 · Cited by 4
Human-Centered AI Design Principles for Generative AI
Weisz, J. D., He, J., & Muller, M. J. (2025) · Springer eBooks · doi:10.1007/978-981-95-3658-0_74 · Cited by 4
Huang, Y., Ma, T., Yang, K., & Zhang, Z. (2026) · Journal of Intelligent Information Systems · doi:10.1007/s10844-025-01020-9 · Cited by 5
An architectural perspective on MLOps: Structures, processes, tools, and stakeholders
Najafabadi, F. A., Bogner, J., Gerostathopoulos, I., & Lago, P. (2026) · Information and Software Technology · doi:10.1016/j.infsof.2026.108029 · Cited by 4
Toward Complementary Intelligence: Integrating Cognitive and Machine AI
González, C., & Malloy, T. (2026) · Current Directions in Psychological Science · doi:10.1177/09637214251407571 · Cited by 7
Li, F. M., Liu, M. X., Bennett, C. L., & Kane, S. K. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3791158 · Cited by 8
Cosentino, C., Folino, F., Marozzo, F., & Pontieri, L. (2026) · Array · doi:10.1016/j.array.2026.100705 · Cited by 4
SUVA: A Probabilistic Framework for Auditing LLMs with an Application to Social Preferences
Leng, Y., & Yuan, Y. (2026) · Information Systems Research · doi:10.1287/isre.2024.0857 · Cited by 6
Guan, B., Cui, W., & Juhász, L. (2026) · Transactions in GIS · doi:10.1111/tgis.70402 · Cited by 4
Exemplification in ChatGPT and student argumentative writing: A local grammar analysis
Jiang, F. K., & Su, H. (2026) · Linguistics and Education · doi:10.1016/j.linged.2026.101533 · Cited by 4
ChatGPT estimates of the quality of published conference papers from their titles and abstracts
Thelwall, M. A. (2026) · Data Technologies and Applications · doi:10.1108/dta-03-2025-0205 · Cited by 4
Lv, J., Liu, G., Zhou, X., & Chen, Y. (2026) · Probiotics and Antimicrobial Proteins · doi:10.1007/s12602-026-11013-x · Cited by 4
Zhang, J., Wang, F. (., Zhang, C., Liu, Y., Lu, J., & Zhao, Y. (2026) · Advanced Engineering Informatics · doi:10.1016/j.aei.2026.104794 · Cited by 7
Self-citationEVA01: Unified Native 3D Understanding and Generation via Mixture-of-Transformers
Yang, Z., Yi, M., Ma, W., Fan, C., Li, B., Liu, B., Lou, Y., Song, Y., Xiong, Y., Guo, Z., et al. (2026) · ACM Transactions on Graphics · doi:10.1145/3842532 · Cited by 4
Metacognition can mitigate AI-driven homogenization of ideas
Yan, W.-J., Yan, L., Shen, Z.-J., Lin, Z., Ferrari, M., & Hu, C. (2026) · Nature Reviews Psychology · doi:10.1038/s44159-026-00587-6 · Cited by 4
Self-Evolving AI Agents With Dual Memory for Automated Software Testing and Bug Localization
Mo, T., Zhang, C., Zou, J., Guo, Z., & Rhee, M. (2026) · IEEE Access · doi:10.1109/access.2026.3713401 · Cited by 17
Self-citationThink-to-Personalize: Unifying Reasoning and Retrieval for User-Centric Personalized Dense Retrieval
Jiang, A., Zhang, G., Song, J., Qi, K., Chen, D., Lin, W., & Lian, D. (2026) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3799682.3840844 · Cited by 4
Process Rewards for Outcome-Guided Reasoning Steps in LLM Reinforcement Learning
Ravari, M. R., Lehmann, J., & Vahdati, S. (2026) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn69854.2026.11728412 · Cited by 4
Towards Robust Neural Rankers with Large Language Model: A Contrastive Training Approach
Pan, Z., Fan, K., Liu, R., & Li, D. (2023) · Applied Sciences · doi:10.3390/app131810148 · Cited by 4
A Comparative Evaluation on Melody Generation of Large Language Models
Suzuki, K., Cai, J., Li, J., Yamauchi, T., & Tei, K. (2023) · IEEE International Conference on Consumer Electronics-Asia (ICCE-Asia) · doi:10.1109/icce-asia59966.2023.10326362 · Cited by 4
Large Language Models guided Generative Prompt for Dialogue Generation
Liu, S., Fang, Y., Cheng, H. N., Pan, Y., Liu, Y., & Gao, C. (2023) · International Conference on Cyber-Enabled Distributed Computing and Knowledge Discovery (CyberC) · doi:10.1109/cyberc58899.2023.00013 · Cited by 7
Ramyadevi, R., & Sasidharan, G. (2024) · IEEE International Conference on Computing, Power and Communication Technologies (IC2PCT) · doi:10.1109/ic2pct60090.2024.10486594 · Cited by 4
DuaPIN: Auxiliary task enhanced dual path interaction network for civil court view generation
Liu, N., Ma, L., Wu, Y., Wei, K., Fan, C., & Zhang, Y. (2024) · Knowledge-Based Systems · doi:10.1016/j.knosys.2024.111728 · Cited by 4
Recurrent event query decoder for document-level event extraction
Kong, J. Y., & Yang, Z. (2024) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2024.108533 · Cited by 4
Roso, N., Vlahović, S., Markuš, N., & Sužnjević, M. (2024) · International Conference on Quality of Multimedia Experience (QoMEX) · doi:10.1109/qomex61742.2024.10598251 · Cited by 4
Dong, B., Chen, J., Wang, Z., Deng, K., Li, Y., Lo, B. P. L., & Mylonas, G. P. (2024) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra57147.2024.10611534 · Cited by 4
Generative AI for Research Data Processing: Lessons Learnt From Three Use Cases
Mitra, M., de Vos, M. G., Cortinovis, N., & Ometto, D. (2024) · IEEE International Conference on eScience · doi:10.1109/e-science62913.2024.10678704 · Cited by 6
The Development of CanPrompt Strategy in Large Language Models for Cancer Care
Ahmad, N., Mamatjan, E., Wali, T., & Mamatjan, Y. (2024) · IEEE Conference on Computational Intelligence in Bioinformatics and Computational Biology (CIBCB) · doi:10.1109/cibcb58642.2024.10702147 · Cited by 4
An Evaluation on the Potential of Large Language Models for Use in Trauma Triage
Le, K., Chen, J., Mai, D., & Le, K. D. R. (2024) · Emergency Care and Medicine · doi:10.3390/ecm1040035 · Cited by 6
Exploring the Suitability of Conversational AI for Child-Robot Interaction
Mannava, V., Mitrevski, A., & Plöger, P. G. (2024) · IEEE RO-MAN · doi:10.1109/ro-man60168.2024.10731435 · Cited by 9
Fukui, R., Yuguchi, A., Matsumoto, Y., & Okadome, Y. (2024) · IEEE RO-MAN · doi:10.1109/ro-man60168.2024.10731410 · Cited by 4
Exploring the Challenges and Potential of Generative AI: Insights from an Empirical Study
Stróżyna, M., Węcel, K., Stolarski, P., Księżniak, E., Sawiński, M., Lewoniewski, W., & Abramowicz, W. (2024) · Procedia Computer Science · doi:10.1016/j.procs.2024.09.658 · Cited by 4
Su, Q., Li, X., Ren, Y., Ouyang, X., Hu, C., & Yin, Y. (2024) · IEEE International Symposium on Software Reliability Engineering Workshops (ISSREW) · doi:10.1109/issrew63542.2024.00092 · Cited by 4
Civilizing and Humanizing Artificial Intelligence in the Age of Large Language Models
Sheth, A., Roy, K., Purohit, H., & Das, A. (2024) · IEEE Internet Computing · doi:10.1109/mic.2024.3444928 · Cited by 6
DynaShield: A Black-Box Moving Target Defense for LLMs via Dynamic Decoding Customization
Liu, X., Qi, W., & Yan, Q. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-42939-1_6 · Cited by 4
SketchTriplet: Self-Supervised Scenarized Sketch–Text–Image Triplet Generation
Wu, Z., Wang, Q., & Yang, J. (2025) · IEEE Internet of Things Journal · doi:10.1109/jiot.2024.3523382 · Cited by 4
Shi, Y., & Hu, X. (2024) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata62323.2024.10825237 · Cited by 5
ClaimBrush: A Novel Framework for Automated Patent Claim Refinement Based on Large Language Models
Kawano, S., Nonaka, H., & Yoshino, K. (2024) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata62323.2024.10825172 · Cited by 10
Li, Y. (2025) · Journal of Computer and Communications · doi:10.4236/jcc.2025.131004 · Cited by 4
EHealth: A Chinese Biomedical Language Model Built via Multi-Level Text Discrimination
Wang, Q., Dai, S., Xu, B., Lyu, Y., Wu, H. J., & Wang, H. (2025) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/taslpro.2025.3536177 · Cited by 4
Innovation through intelligent computer-aided formulation design
Phanusupawimol, T., Prasopsanti, K., Taskiran, N. P., Venkatasubramanian, V., & Gani, R. (2025) · Current Opinion in Chemical Engineering · doi:10.1016/j.coche.2025.101099 · Cited by 4
Deng, J., Zhang, Z., Cheng, J.-K., & Ma, J. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10890050 · Cited by 4
Large Language Models Are Efficient Learners as Zero-Shot Speech Translators
Liu, C., Chen, L., Tang, P., Zhang, W., Li, X., Ghosh, S., Ye, Z., & Yu, M. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10889325 · Cited by 4
Student Preferences in Interacting with AI-Enhanced Learning Assistants (AIELA): A Comparative Study
Murry, B., Kulpinski, E., Aiello, A., Ramasamy, V., Beaupre, T., Antreassian, A., Ray, C., Zweifel, A., Martin, S. A., Sheppard, Z., et al. (2025) · IEEE SoutheastCon · doi:10.1109/southeastcon56624.2025.10971472 · Cited by 4
ResilioMate: A Resilient Multi-Agent Task Executing Framework for Enhancing Small Language Models
Xiong, Y., Huang, M., Liang, X., & Tao, M. (2025) · IEEE Access · doi:10.1109/access.2025.3567244 · Cited by 6
Enhancing RAG Performance by Representing Hierarchical Nodes in Headers for Tabular Data
Song, M. (2025) · IEEE Access · doi:10.1109/access.2025.3569872 · Cited by 6
Neural language models as content analysis tools in psychology
Acciai, A., Guerrisi, L., Plebe, A., & Suriano, R. (2025) · Philosophical Psychology · doi:10.1080/09515089.2025.2508942 · Cited by 4
Bessas, N., Tzanaki, E., Vavougios, D., & Plagianakos, V. P. (2025) · Social Sciences & Humanities Open · doi:10.1016/j.ssaho.2025.101610 · Cited by 7
MedKit: Multi-level feature distillation with knowledge injection for radiology report generation
Su, Z., Song, H., Lin, Y., Wu, Y., Weng, X., Mao, Z., Liu, B., Yin, H., & Yang, J. (2025) · Expert Systems with Applications · doi:10.1016/j.eswa.2025.129003 · Cited by 8
Gonçalves, V. P., Serrano, A. L. M., Rodrigues, G. A. P., de Oliveira, M. N., Meneguette, R. I., Bispo, G. D., Peixoto, M. G. M., & Filho, G. P. R. (2025) · Energies · doi:10.3390/en18143744 · Cited by 4
Population health management through human phenotype ontology with policy for ecosystem improvement
Henry, J. A. (2025) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2025.1496937 · Cited by 4
Custom training data: Aligning model distribution via Prefix-Guided Preference Data Synthesis
Chen, Z., Qiao, F., Chen, H., Zhang, W., Ren, P., Lin, S., Sun, J., & Li, Y. (2025) · Information Processing & Management · doi:10.1016/j.ipm.2025.104337 · Cited by 5
Zong, C. F., Wan, J., Tang, S., & Zhang, L. (2025) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2025.103246 · Cited by 6
Alignment in Decision-Making Attributes Predicts Trust and Delegation to AI Systems
Summerville, A. L., de Visser, E. J., McVay, J., Martí, L., Leung, A., & Widmer, C. L. (2025) · Journal of Cognitive Engineering and Decision Making · doi:10.1177/15553434251390012 · Cited by 6
Can large language models capture human risk preferences? A cross-cultural study
Liu, J., Song, B., Dixit, V. V., Wu, C., & Jian, S. (2026) · Communications in Transportation Research · doi:10.26599/commtr.2026.9640025 · Cited by 5
A Task-Risk Consistency Object Detection Framework Based on Deep Reinforcement Learning
Wen, J., Liu, H., & Li, J. (2023) · Remote Sensing · doi:10.3390/rs15205031 · Cited by 4
Fan, L., Liu, X., Wang, Y., Yang, G., Du, Z., & Wang, G. (2023) · IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm58861.2023.10385287 · Cited by 5
Zhang, Y., Wang, M., & Yu, J. (2023) · Proceedings · doi:10.1109/icdm58522.2023.00094 · Cited by 6
CLAP4Emo: ChatGPT-Assisted Speech Emotion Retrieval with Natural Language Supervision
Lin, W.-C., Ghaffarzadegan, S., Bondi, L., Kumar, A., Das, S., & Wu, H.-H. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10447102 · Cited by 10
Omni-supervised shadow detection with vision foundation model
Qian, Z., Wu, W., Wu, X.-T., & Chen, X.-D. (2024) · Journal of Visual Communication and Image Representation · doi:10.1016/j.jvcir.2024.104146 · Cited by 4
HRCL: Hierarchical Relation Contrastive Learning for Low-Resource Relation Extraction
Guo, Q., Guo, Y., & Zhao, J. (2024) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2024.3386611 · Cited by 6
Few-Human-Interaction Reinforcement Learning for Autonomous Transbronchial Intervention
Bian, G., Tang, X.-R., Ma, R.-C., Ye, Q., Li, Z., Zhang, M.-Y., Ren, H., & Zhai, Y.-P. (2024) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2024.3452944 · Cited by 4
Algorithms in Surgical Action Recognition: A Survey
Bian, G., Peng, Y., Zhang, L., Li, J., & Li, Z. (2024) · IEEE International Conference on Real-time Computing and Robotics (RCAR) · doi:10.1109/rcar61438.2024.10670748 · Cited by 6
Optimizing pipeline task-oriented dialogue systems using post-processing networks
Ohashi, A., & Higashinaka, R. (2024) · Computer Speech & Language · doi:10.1016/j.csl.2024.101742 · Cited by 4
Wu, H. R., Hong, H., Sun, L., Bai, X., & Pu, M. (2024) · Electronics · doi:10.3390/electronics13234581 · Cited by 5
Palmetshofer, M., Schedl, D. C., & Stöckl, A. (2024) · International Conference on Electrical, Computer, Communications and Mechatronics Engineering (ICECCME) · doi:10.1109/iceccme62383.2024.10796376 · Cited by 6
Xu, T., Piao, Z. H., Mukai, T., Murayama, Y., & Izumi, K. (2025) · Intelligent Systems with Applications · doi:10.1016/j.iswa.2025.200496 · Cited by 7
Can RAG-Driven Enhancements Amplify Audio LLMs for Low-Resource Languages?
Dutta, B., Ranjan, R., Jain, A., Singh, R., & Mayank Vatsa, A. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10889964 · Cited by 7
Zhou, L., Yan, S., Li, Z., & Ma, J. (2024) · International Annual Conference on Complex Systems and Intelligent Science (CSIS-IAC) · doi:10.1109/csis-iac63491.2024.10919351 · Cited by 4
BoKDiff: best-of-K diffusion alignment for target-specific 3D molecule generation
Yalabadi, A. K., Yazdani-Jahromi, M., & Garibay, Ö. Ö. (2024) · Bioinformatics Advances · doi:10.1093/bioadv/vbaf137 · Cited by 4
A chit-chat between Llama 2 and ChatGPT for the automated creation of exploits
Caturano, F., Ciotola, J., Romano, S. P., & Varlese, M. (2025) · Computer Networks · doi:10.1016/j.comnet.2025.111501 · Cited by 6
A Deep Reinforcement Learning-based Routing Algorithm for Unknown Erroneous Cells in DMFBs
Kawakami, T., Shiro, C., Nishikawa, H., Kong, X., Tomiyama, H., & Yamashita, S. (2023) · IEEE Interregional NEWCAS Conference (NEWCAS) · doi:10.1109/newcas57931.2023.10198067 · Cited by 4
Optimizing Continuous Development by Detecting and Preventing Unnecessary Content Generation
Baral, T., Rahman, S., Chanumolu, B. N., Balcı, B., Tuncer, T., Shi, A., & Lam, W. (2023) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase56229.2023.00216 · Cited by 5
Zero-Shot Imitation Policy Via Search In Demonstration Dataset
Malato, F., Leopold, F., Melnik, A., & Hautamäki, V. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10447339 · Cited by 15
SPOTS: Stable Placement of Objects with Reasoning in Semi-Autonomous Teleoperation Systems
Lee, J., Park, S., Park, J., Lee, K., & Choi, S. (2024) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra57147.2024.10611613 · Cited by 5
CTsynther: Contrastive Transformer Model for End-to-End Retrosynthesis Prediction
Lu, H., Wei, Z., Zhang, K., Wang, X., Ali, L., & Liu, H. (2024) · IEEE Transactions on Computational Biology and Bioinformatics · doi:10.1109/tcbb.2024.3455381 · Cited by 4
Enhancing Abstractive Dialogue Summarization with Internal Knowledge
Wang, S., Ma, H., Zhang, Y., Ma, J., & He, L. J. (2024) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn60899.2024.10650220 · Cited by 5
Metadata
- Authors
- Ouyang, L., Wu, J., Jiang, X., Almeida, D., Wainwright, C., Mishkin, P., Zhang, C., Agarwal, S., Slama, K., Ray, A., Schulman, J., Hilton, J., Kelton, F., Miller, L., Simens, M., Askell, A., Welinder, P., Christiano, P., Leike, J., & Lowe, R.
- Venue
- Advances in Neural Information Processing Systems 35
- Published
- 2022
- Pages
- 27730-27744
- ISSN
- 1049-5258 (ISSN-L)
- OpenAlex
- W7133211372
- Cited by
- 3,117
- References
- 0
- Citations by year
- 2026: 1421 · 2025: 544 · 2024: 852 · 2023: 297 · 2022: 3
- FWCI
- 234.27
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- neural information processing systems (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Keywords
- instruction following, language models, human feedback, reinforcement learning from human feedback, large language models
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.