Training Language Models to Follow Instructions with Human Feedback
The DOI matches its Crossref record; 2 of the 2 references it cites were found in a registry or an index.
Abstract
Making language models bigger does not inherently make them better at following a user's intent. For example, large language models can generate outputs that are untruthful, toxic, or simply not helpful to the user. In other words, these models are not aligned with their users. In this paper, we show an avenue for aligning language models with user intent on a wide range of tasks by fine-tuning with human feedback. Starting with a set of labeler-written prompts and prompts submitted through the OpenAI API, we collect a dataset of labeler demonstrations of the desired model behavior, which we use to fine-tune GPT-3 using supervised learning. We then collect a dataset of rankings of model outputs, which we use to further fine-tune this supervised model using reinforcement learning from human feedback. We call the resulting models InstructGPT. In human evaluations on our prompt distribution, outputs from the 1.3B parameter InstructGPT model are preferred to outputs from the 175B GPT-3, despite having 100x fewer parameters. Moreover, InstructGPT models show improvements in truthfulness and reductions in toxic output generation while having minimal performance regressions on public NLP datasets. Even though InstructGPT still makes simple mistakes, our results show that fine-tuning with human feedback is a promising direction for aligning language models with human intent.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Existing literature (Ouyang et al., 2022) does not fully describe the details of these models, such as the pretraining corpus, model sizes, and model biases.”
From Self-Refine: Iterative Refinement with Self-Feedback (2023) · cites this paper as Ouyang et al., 2022
Experimental — accuracy not yet measuredIn the citing paper
“Specifically, providers mitigate race and gender bias through reinforcement learning from human feedback (RLHF), adversarial stress-testing known as red teaming, and hard-coded refusals governed by the provider's own content policies [6, 43, 71].”
From All Public Voices Are Equal, But Are Some More Equal Than Others to LLMs? (2026) · cites this paper as [71]
In the citing paper
“Fine-tuning a model from human feedback at scale, using preference data from paid raters or drawn from a large and willing user base, is an especially potent technique.It has the potential not only to shape a model's responses to better reflect user norms (for better or worse), but also to filter out toxic language, improve factual accuracy, and mitigate the tendency to fabricate information.”
From Talking about Large Language Models (2024) · cites this paper as [26]
In the citing paper
“These include general competencies such as in-context learning (ICL) [13], chain-of-thought (CoT) [17] reasoning, and instruction following [25], as well as task-specialized skills like mathematical reasoning [30].”
From A Survey of Large Language Models (2026) · cites this paper as [25]
In the citing paper
“When external reward models or ground-truth answers are available, rejection sampling can also be applied to select higher-quality responses from multiple candidates [25].”
From A Survey of Large Language Models (2026) · cites this paper as [25]
41 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
The publisher hasn’t deposited this paper’s reference list.
Cited by
Items 3,601–3,700 of 4,340
Critique-GRPO: Advancing LLM Reasoning with Natural Language and Numerical Feedback
Zhang, X., Zhang, Y., Sun, H., Feng, K., Lu, C., Yang, C., & Meng, H. (2025) · arXiv · doi:10.48550/arxiv.2506.03106 · Cited by 92
“5-7B-Base and Qwen3-8B models, generating four responses per question for a set of 4k prompts.”
MemGym: a Long-Horizon Memory Environment for LLM Agents
Xu, W., Wang, Y., Mei, K., Liang, K., Wang, Z., Jin, M., Zhang, H., Zhang, S.-X., Hua, W., Sahu, S., et al. (2026) · arXiv · doi:10.48550/arxiv.2605.20833 · Cited by 11
“Reward models trained from human or automated feedback have become a central tool for post-training LLMs [30], and process reward models [26] extend this to step-level supervision over reasoning traces.”
Continual Learning via Sparse Memory Finetuning
Lin, J., Zettlemoyer, L., Ghosh, G., Yih, W.-T., Markosyan, A., Berges, V.-P., & Oğuz, B. (2025) · arXiv · doi:10.48550/arxiv.2510.15103 · Cited by 33
“Regularization methods such as dropout (Srivastava et al., 2014), weight decay (Loshchilov and Hutter, 2019), or KL penalties (Ouyang et al., 2022) restrict parameter updates to preserve performance to stay close to initialization.”
Forouzandeh, S., Peng, W., Moradi, P., Yu, X., & Jalili, M. (2025) · arXiv · doi:10.48550/arxiv.2512.18950 · Cited by 16
EvolMem: A Cognitive-Driven Benchmark for Multi-Session Dialogue Memory
Shen, Y., Pei, D., Guo, Y., Wang, J., Guo, Y., Zhang, Z., Jia, Q., Zhou, J., & Zhai, G. (2026) · arXiv · doi:10.48550/arxiv.2601.03543
“…models (LLMs) are increasingly deployed in interactive and long-horizon applications (Xi et al., 2025; Packer et al., 2023; Liu et al., 2024a; Ouyang et al., 2022), memory plays a central role in enabling models to preserve user preferences, accumulate knowledge, and support coherent…”
Ai, Q., Zhan, J., & Liu, Y. (2025) · arXiv · doi:10.48550/arxiv.2501.02842
“Reinforcement Learning from Human Feedback (RLHF) focuses on aligning the model with human preferences based on human feedback [43, 44].”
PAACE: A Plan-Aware Automated Agent Context Engineering Framework
Yuksel, K. A. (2025) · arXiv · doi:10.48550/arxiv.2512.16970
“Similarly, methods such as DPO (Rafailov et al., 2023), RLHF (Ouyang et al., 2022), and PRO (Saunders et al., 2024) refine instructions or preferences.”
World Simulation with Video Foundation Models for Physical AI
NVIDIA, :, Ali, A., Bai, J., Bala, M., Balaji, Y., Blakeman, A., Cai, T., Cao, J., Cao, T., et al. (2025) · arXiv · doi:10.48550/arxiv.2511.00062 · Cited by 1
Self-Improving LLM Agents at Test-Time
Acikgoz, E. C., Qian, C., Ji, H., Hakkani-Tür, D., & Tur, G. (2025) · arXiv
“It involves gathering large-scale training datasets (Ouyang et al., 2022; Wang et al., 2023; Zeng et al., 2024) (either human-curated or LLM-synthesized) and fine-tuning models on these datasets (Grattafiori et al., 2024; Zeng et al., 2024; Acikgoz et al., 2025).”
How to Steal Reasoning Without Reasoning Traces
Zhang, T., Morris, J. X., & Shmatikov, V. (2026) · arXiv · doi:10.48550/arxiv.2603.07267 · Cited by 13
“Trained via supervised fine-tuning, instruction tuning, and reinforcement learning, these models generate multi-step internal reasoning traces leading to final answers (Wei et al., 2022; Ouyang et al., 2022; Chen et al., 2025b).”
Quantifying and Mitigating Self-Preference Bias of LLM Judges
Yang, J., Hu, Z., Qiu, C., Deng, Z., Jiao, X., & Zhou, T. (2026) · arXiv · doi:10.48550/arxiv.2604.22891
“Recently, LLM-as-a-Judge has emerged as a dominant paradigm for re-placing costly human evaluation[1, 2, 3, 4], playing a critical role in model alignment[5] and leaderboard construction [6].”
Leung, E., Lumer, E., Feld, C., Huber, A., Subbiah, V. K., & Paul, K. (2026) · arXiv · doi:10.48550/arxiv.2607.08700
“Scalar reward models for RLHF are prone to reward hacking and sycophancy because a single score conflates multiple quality dimensions [Gao et al., 2023a, Sharma et al., 2024, Ouyang et al., 2022, Lambert et al., 2024b].”
All Public Voices Are Equal, But Are Some More Equal Than Others to LLMs?
Kim, S., Janssen, M. A., Wang, J., Min-Venditti, A., Karanjia, N., & Anderies, J. M. (2026) · arXiv · doi:10.48550/arxiv.2604.17247
ACTIVE-o3: Empowering MLLMs with Active Perception via Pure Reinforcement Learning
Zhu, M., Zhong, H., Zhao, C., Du, Z., Liu, M., Huang, Z., Li, A., Chen, H., Zou, C., Chen, J., et al. (2025) · arXiv · doi:10.48550/arxiv.2505.21457
Chen, S. (2026) · arXiv · doi:10.48550/arxiv.2606.22528 · Cited by 21
Towards AI-Assisted Research Writing: Benchmarking LLMs for AI/ML Introduction Generation
Garg, K., Shaik, F., Bandyopadhyay, S., & Caragea, C. (2025) · arXiv · doi:10.48550/arxiv.2508.14273
“5 (Arshad et al., 2023), GPT-4 (Achiam et al., 2023; Ouyang et al., 2022), PaLM (Chowdhery et al., 2023), LLaMA (Touvron et al., 2023), Bloom (Workshop et al., 2022), and GLaM (Du et al., 2022) have demonstrated impressive performance across summarization benchmarks.”
Roesner, F., & Kohno, T. (2026) · arXiv · doi:10.48550/arxiv.2609.17817 · Cited by 2
TopoRefine: Iterative Refinement with Reasoning Topology as High-Level Feedback
Liao, H., Hu, S., Zhu, Z., He, H., & Jin, Y. (2025) · ICASSP 2025 - 2025 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp49660.2025.10888346
ScoreFlow: Mastering LLM Agent Workflows via Score-based Preference Optimization
Wang, Y., Yang, L., Li, G., Wang, M., & Aragam, B. (2025) · arXiv · doi:10.48550/arxiv.2502.04306
Tsui, K. (2025) · arXiv · doi:10.48550/arxiv.2507.02778 · Cited by 29
Multi-Agent Design: Optimizing Agents with Better Prompts and Topologies
Zhou, H., Wan, X., Sun, R., Palangi, H., Iqbal, S., Vulić, I., Korhonen, A., & Arık, S. Ö. (2025) · arXiv · doi:10.48550/arxiv.2502.02533
A Survey of Agent Memory in the Second Half: Towards Self-Evolving and Long-Horizon Agents
Huang, W.-C., Zhang, W., Liang, Y., Bei, Y., Chen, Y., Feng, T., Pan, X., Tan, Z., Wang, Y., Wei, T., et al. (2026) · arXiv · doi:10.48550/arxiv.2602.06052 · Cited by 70
The Good, the Bad and the Constructive: Automatically Measuring Peer Review's Utility for Authors
Sadallah, A., Baumgärtner, T., Gurevych, I., & Briscoe, T. (2025) · arXiv · doi:10.48550/arxiv.2509.04484
“We conjecture that the increased performance on this aspect stems from the training regime of GPT-4, where Helpfulness has likely been incorporated during post-training, as has been reported for its predecessor InstructGPT (Ouyang et al., 2022).”
MAPLE: Multi-Aspect Panels of LLM Evaluators for Open-Ended Questions
Jinji, M., Atarashi, K., Takeuchi, K., & Kashima, H. (2026) · Findings of the Association for Computational Linguistics: ACL 2026 · doi:10.18653/v1/2026.findings-acl.1351
“Preference-based post-training methods such as Reinforcement Learning from Human Feed-back (RLHF) (Stiennon et al., 2020; Ouyang et al., 2022) and Direct Preference Optimization (DPO) (Rafailov et al., 2023; Song et al., 2024) have been central to aligning Large Language Models (LLMs) with human…”
YESciEval: Robust LLM-as-a-Judge for Scientific Question Answering
D'Souza, J., Giglou, H. B., & Münch, Q. (2025) · arXiv · doi:10.48550/arxiv.2505.14279
“While human evaluations are the gold standard, they are costly and hard to scale (Ouyang et al., 2022; Krishna et al., 2023), underscoring the need for an automated, trustworthy alternative.”
CARE: Confounder-Aware Aggregation for Reliable LLM Evaluation
Zhao, J., Shin, C., Huang, T.-H., GNVV, S. S. S. N., & Sala, F. (2026) · arXiv · doi:10.48550/arxiv.2603.00039
Mitigating Context Interference for Reliable and Efficient Search Agents
Xue, B., Wu, B., Qiao, S., Wang, S., Wang, R., Du, Y., Wang, H., Pan, J. Z., Yilmaz, E., Wong, K.-F., et al. (2026) · Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2026.acl-long.160
“Reinforcement Learning (RL) (Kaelbling et al., 1996) has emerged as a paradigm for LLM post-training or alignment (Ouyang et al., 2022).”
Chen, Y., Zhang, C., Luo, D., D'Haro, L. F., Tan, R. T., & Li, H. (2024) · arXiv · doi:10.48550/arxiv.2405.14646
Self-citationYan, T., Tang, T., Gui, X., Li, Y., Zheng, J., Huang, W., Kong, L., Han, W., Zhou, X., Zhang, X., et al. (2026) · 2026 IEEE/CVF Conference on Computer Vision and Pattern Recognition- FINDINGS Track (CVPRF) · doi:10.1109/cvprf71909.2026.00109
Does Spatial Cognition Emerge in Frontier Models?
Ramakrishnan, S. K., Wijmans, E., Kraehenbuehl, P., & Koltun, V. (2024) · arXiv · doi:10.48550/arxiv.2410.06468 · Cited by 49
Base Models Beat Aligned Models at Randomness and Creativity
West, P., & Potts, C. (2025) · arXiv · doi:10.48550/arxiv.2505.00047
Agent-R1: A Unified and Modular Framework for Agentic Reinforcement Learning
Cheng, M., Yu, S., Wang, D., Li, Q., Tao, X., Ouyang, J., Luo, Y., Zhou, Y., Liu, Q., & Chen, E. (2025) · arXiv · doi:10.48550/arxiv.2511.14460
Revolutionizing Antibody Discovery: An Innovative AI Model for Generating Robust Libraries
Wang, Y., & Sun, S. (2023) · Genomics Proteomics & Bioinformatics · doi:10.1016/j.gpb.2023.06.001
Self-supervised Bidirectional Prompt Tuning for Entity-enhanced Pre-trained Language Model
Zou, J., Xu, X., Hou, J., Yan, Q., & Zheng, H.-T. (2023) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn54540.2023.10192045
Introduction to artificial intelligence and machine learning algorithms
Bowman, A. D., & Jololian, L. (2023) · Elsevier eBooks · doi:10.1016/b978-0-443-18498-7.00010-7
Semantic Traffic Element Removal by Learning to Follow Linguistic Instructions
Feng, X., Su, Y., Liu, Y., & Zhang, C. (2023) · IEEE International Conference on Unmanned Systems (ICUS) · doi:10.1109/icus58632.2023.10318228
Self-citationHuman-in-the-Loop Evolution of Database Views for Data Exploration
de Carvalho, T. B. A., Martins, D. M. L., & Neto, F. B. D. L. (2023) · IEEE Latin American Conference on Computational Intelligence (LA-CCI) · doi:10.1109/la-cci58595.2023.10409423 · Cited by 1
Bu, C., Liu, J., Liu, J., Ji, S., & Yang, H. (2023) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/smc53992.2023.10394538
Uncovering Sentiments Expressed on GPT in Academic Papers
Hong, A., Nwoji, S. C., Murungi, J. K., Tatikonda, P. K., & Kaluvakolli, A. (2023) · International Conference on Open Source Systems and Technologies (ICOSST) · doi:10.1109/icosst60641.2023.10414229
Context Sketching for Memory-efficient Graph Representation Learning
Yao, K.-L., & Li, W.-J. (2023) · Proceedings · doi:10.1109/icdm58522.2023.00083
A Blackboard Model for Flexible and Parallel Text Annotation
Ocaña, M. G., & Opdahl, A. L. (2024) · IEEE Access · doi:10.1109/access.2024.3369409
Language representations in deep learning algorithms and the brain
Caucheteux, C. (2023) · theses.fr (ABES) · doi:10.70675/9258df96z16fbz4531zb578za0d6684b0d14 · Cited by 1
Audio-Aided Learning Framework for Image Classification with Limited Training Images
Wu, Q., Wang, C., Li, X., Wu, G., Vallejo, M., & Wang, R. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10447040
A Generative Adversarial Framework for Dialogue Generation with Neural Architecture Search
Huang, Y., Hu, W., & Feng, J. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10446133
Exploring Label Hierarchy in Dialogue Intent Classification
Huang, S.-M., Huang, P., Xu, Y., Liang, J., & Niu, J. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10448380
Cross-lingual Information Extraction for the Assessment and Prevention of Adverse Drug Reactions
Raithel, L. (2024) · theses.fr (ABES) · doi:10.70675/5478ceccz18cdz4fcbzb106z2fb1ec257de2 · Cited by 3
BORT-RD: An Improved Model for Software Engineering Design Feature Generation
Li, Z., & Lei, H. (2023) · International Conference on Network and Information Systems for Computers (ICNISC) · doi:10.1109/icnisc60562.2023.00051
Mao, T., Fu, J., & Yoshie, O. (2024) · Asia Conference on Information Engineering (ACIE) · doi:10.1109/acie61839.2024.00033 · Cited by 1
Enhancing Architectural Information Extraction Using DHAM-based Segmentation Network
Cai, W., Fei, W., & Gao, L. (2023) · IEEE International Conference on Computer and Communications (ICCC) · doi:10.1109/iccc59590.2023.10507611
Learning to Reason: Event Argument Extraction with Multi-Step Reasoning
Yang, X., Yang, J., Shuang, K., Shi, Z., & He, L. (2023) · IEEE International Conference on Computer and Communications (ICCC) · doi:10.1109/iccc59590.2023.10507482
EEHF: Learning Event Argument Extraction from Hybrid Feedback
Shi, Z., Yang, J., Shuang, K., Yang, X., & Zhang, K. (2023) · IEEE International Conference on Computer and Communications (ICCC) · doi:10.1109/iccc59590.2023.10507312
Research on power system applications based on ChatGPT
Li, B., Jiang, Y. H., Song, X., Sheng, Z., & Wei, Y. (2024) · International Conference on Energy System, Electricity, and Power (ESEP) · doi:10.1117/12.3024345
Tchouka, Y. (2023) · theses.fr (ABES) · doi:10.70675/a4ee3d70zffbfz4cceza460zd94c7b389c05 · Cited by 1
Designing EEPO: An Emissary Educator Playmate Oracle XR Conversation Agent for Children
Zhang, J., Morris, A., Martyn, N., & Zaccolo, S. (2024) · IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW) · doi:10.1109/vrw62533.2024.00031
Intelligent knowledge base search tool using large language model and graph neural network
Payumo, K., Subramanian, I., Lu, T. T., & Chow, E. T. (2024) · Pattern Recognition and Tracking · doi:10.1117/12.3014075
Recognizing Textual Entailment by Hierarchical Crowdsourcing with Diverse Labor Costs
Zhang, H., Yang, J., Huang, W., Cai, M., Li, J., Zhang, C., & Wu, K. (2024) · International Conference on Computer Supported Cooperative Work in Design (CSCWD) · doi:10.1109/cscwd61410.2024.10580016
Self-citationUnderstanding How ChatGPT Memorizes Chinese Tang Poetry
Chang, C.-Y. (2024) · IEEE International Conference on Big Data Security on Cloud, IEEE International Conference on High Performance and Smart Computing, and IEEE International Conference on Intelligent Data and Security (BigDataSecurity/HPSC/IDS) · doi:10.1109/ids62739.2024.00008
Studying the Knowledge and Behavior of ChatGPT via Journey to the West
Zhou, Z. (2024) · IEEE International Conference on Big Data Security on Cloud, IEEE International Conference on High Performance and Smart Computing, and IEEE International Conference on Intelligent Data and Security (BigDataSecurity/HPSC/IDS) · doi:10.1109/hpsc62738.2024.00012
Chai, L., Qi, L., Sun, H., & Li, J. (2024) · IEEE International Conference on Data Engineering (ICDE) · doi:10.1109/icde60146.2024.00032 · Cited by 2
Research on Dataset Generation in the Development of Large Language Models for Digital Textbooks
Lee, Y. (2023) · International Conference on Robotics, Automation and Artificial Intelligence (RAAI) · doi:10.1109/raai59955.2023.10601206
Yi, J., & Yao, Y.-F. (2024) · Applied Sciences · doi:10.3390/app14166955 · Cited by 1
Shin, H., Kim, N.-J., Min, J. H., Lee, S. E., Liao, K. Y.-K., & Lee, H.-J. (2024) · IEEE International Symposium on Biomedical Imaging (ISBI) · doi:10.1109/isbi56570.2024.10635195
Effective State Space Exploration with Phase State Graph Generation and Goal-based Path Planning
Zhang, S., Hu, J., Du, X., Yang, Z., Yu, Y., & Chen, H. (2024) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn60899.2024.10651127
Exploring Instruction Feature Adaptation for Event Argument Extraction in Large Language Models
Yang, Z., Yang, J., Tan, Y., Tian, C., Zhou, J., Ma, J., Hu, W., Luo, Z., & Luo, W. (2024) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn60899.2024.10651471
An Academic Information Collection System based on Large Language Model
Lang, Q., Lyu, S., Wang, H., & Zhang, R. (2024) · International Conference on Electronic Communication and Artificial Intelligence (ICECAI) · doi:10.1109/icecai62591.2024.10675124
Learning to generate text with auxiliary tasks
Hùng, P. Q., Nguyen, M.-T., Inoue, S., Tran-Tien, M., & Phan, X.-H. (2024) · Knowledge-Based Systems · doi:10.1016/j.knosys.2024.112570
Image Captioning With Sentiment for Indonesian
Khumaeni, & Khodra, M. L. (2024) · International Conference on Artificial Intelligence, Blockchain, Cloud Computing, and Data Analytics (ICoABCD) · doi:10.1109/icoabcd63526.2024.10704319
Recherche par image robuste par apprentissage profond
Ramzi, E. (2024) · theses.fr (ABES) · doi:10.70675/e69bb37dz78b5z48ffz8ef1z62cd68e2b2fb
Wuli-Shili-Renli-Jili System Approach and Its Application in Large Model Value Alignment
Qi, J., Jia, K., Zhang, Y., Feng, X., & Yan, H. (2024) · IEEE International Conference on Software Quality, Reliability and Security Companion (QRS-C) · doi:10.1109/qrs-c63300.2024.00069
D3D: Conditional Diffusion Model for Decision-Making Under Random Frame Dropping
Xia, B., Luo, Y., Chang, Y., Yuan, B., Li, Z., & Wang, X. (2024) · IEEE RO-MAN · doi:10.1109/ro-man60168.2024.10731194
Towards Text-based Human Search and Approach using a Robot Dog
Park, J., Silveria, J., Pan, M. K. X. J., & Choi, S. (2024) · IEEE RO-MAN · doi:10.1109/ro-man60168.2024.10731456
Bidirectional Multifunctional Diffractive Deep Neural Network under Multi-order Alignment
Zhou, H., Chen, J., & Shum, P. P. (2024) · Optoelectronics Global Conference · doi:10.1109/ogc62429.2024.10738771
Cheng, X., Zhang, P., Zhou, Y., Wang, R., Zhai, Z., Fan, Y., Gu, W., Huang, X., & Sun, D. (2024) · IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems · doi:10.1109/tcad.2024.3499897
ELO-Mask: Effective and Layerwise Optimization of Mask for Sparse LLMs
Xiang, B., Wu, J., Han, X., Gu, Q., Chao, F., Yang, X. P., Wu, F., & Fu, X. (2024) · IEEE Access · doi:10.1109/access.2024.3498904
Self-citationSamboní-Ortiz, E. A., Garzón-Benítez, P. C., Zúñiga-Hidrobo, L. V., & Rendón, O. M. C. (2024) · IEEE Latin-American Conference on Communications · doi:10.1109/latincom62985.2024.10770684
Second language learning of degree expressions: A computational approach
Cong, Y. (2024) · Natural language processing. · doi:10.1017/nlp.2024.56
Schema Retrieval for Korean Geographic Knowledge Base Question Answering Using Few-Shot Prompting
Lee, S. E., & Yu, K. (2024) · ISPRS International Journal of Geo-Information · doi:10.3390/ijgi13120453
Assessing and Scoring Difficulty of Hard-to-Solve Data in Summarization Tasks
Jung, J., Seo, H., Namgoong, H., & Jung, S. (2024) · IEEE Access · doi:10.1109/access.2024.3519548
CPLS: Optimizing the Assignment of LLM Queries
Liu, Y., Zhang, H., Li, Z., & Miao, Y. (2024) · IEEE International Conference on Software Maintenance (ICSM) · doi:10.1109/icsme58944.2024.00024 · Cited by 1
Large Language Models for Optical Communications: Techniques, Opportunities, and Challenges
Jiang, X., Zhang, M., Pang, Y., Liu, Y., Wang, Y., Zhang, Y., & Wang, D. (2024) · IEEE Photonics Conference · doi:10.1109/ipc60965.2024.10799848
Self-citationMitigating Hallucination in Visual Language Model Segmentation with Negative Sampling
Chung, T. L., Cheng, J. S., & Pang, J. (2024) · International Symposium on Chinese Spoken Language Processing (ISCSLP) · doi:10.1109/iscslp63861.2024.10800691
LLaKey: Follow My Basic Action Instructions to Your Next Key State
Zhao, Z., He, Y., Yu, F. R., Li, P., Zhuo, F., & Sun, X. (2024) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros58592.2024.10802579 · Cited by 2
Research on Development of LLMs and Manual Comparison of Applications
Liu, X., Li, J., Bai, T., Gao, J., Zhang, P., & Zhao, X. (2024) · International Conference on Big Data and Information Analytics (BigDIA) · doi:10.1109/bigdia63733.2024.10808821
Using Language Models to Generate and Forget the Narrative Memories of an Assistive Robot
Contreras, A. F. G., Chang, W.-Y., Kawano, S., Chen, Y.-N., & Yoshino, K. (2025) · Lecture notes in computer science · doi:10.1007/978-981-96-2074-6_28
Xu, B., Qiao, X., Zhang, X., Wan, J., Liu, X., Zong, L., & Lin, H. (2024) · IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm62325.2024.10822192
CoT based Few-Shot Learning of Negative Comments Filtering
Mitadera, T., & Utsuro, T. (2024) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata62323.2024.10825263
Constructing A Human-Centered Dataset for Second Language Acquisition via Large Language Models
Fan, Y., Li, B., Yang, Z., & Gao, Z. (2024) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata62323.2024.10825861
AlpaCream: an Effective Method of Data Selection on Alpaca
Li, Y., & Sun, Y. (2024) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/smc54092.2024.10831719
SndGLM-SA: A Social Network Debate Text Generation Model Based on Sentiment Analysis
Tian, T. (2024) · IEEE International Performance, Computing, and Communications Conference · doi:10.1109/ipccc59868.2024.10850019
Senelle, G. (2024) · theses.fr (ABES) · doi:10.70675/35884c76z296az4626zbc71z68bf123b95c0 · Cited by 2
Continuous Pre-training of TAPAS Model with E-commerce Structured Data
Chen, X., Du, S., & Qiu, Y. (2024) · IEEE International Conference on Information Technology, Big Data and Artificial Intelligence (ICIBA) · doi:10.1109/iciba62489.2024.10868941
Domain Adaptation Based on Human Feedback for Enhancing Image Denoising in Generative Models
Park, H.-C., Ngo, D., & Kang, S. H. (2025) · Mathematics · doi:10.3390/math13040598
General Planning Method for Humanoid Collaborative Robots Using Large Language Models
Gao, R., Shi, J., Tian, S., & Chen, S. (2024) · China Automation Congress (CAC) · doi:10.1109/cac63892.2024.10865732
Collaborating LLMs and PLMs for Medical Tasks
Xu, G., Meng, Y., Wang, R., & Qi, G. (2024) · IEEE International Conference on Knowledge Graph (ICKG) · doi:10.1109/ickg63256.2024.00060
Enhancing Feedback Mechanisms in English Language Assessments Through Deep Learning Model
Selvi, M., Zeeshan, G. A., Al-Omari, O. M., Mishra, A. K., Giftsy Dorcas, E., & Alphonse, F. R. (2024) · International Conference on Artificial Intelligence and Quantum Computation-Based Sensor Application (ICAIQSA) · doi:10.1109/icaiqsa64000.2024.10882425
Xie, F., Gao, D., Liu, R., Yang, M., Zhang, Y., & Wang, W. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10890268
DETCP: Self-Detoxifying Language Models With Contrastive Pairs
Liu, D., Liu, Y., Guo, J., & Mao, Z. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10887947 · Cited by 1
Metadata
- Authors
- Ouyang, L., Wu, J., Jiang, X., Almeida, D., Wainwright, C., Mishkin, P., Zhang, C., Agarwal, S., Slama, K., Ray, A., Schulman, J., Hilton, J., Kelton, F., Miller, L., Simens, M., Askell, A., Welinder, P., Christiano, P., Leike, J., & Lowe, R.
- Venue
- Advances in Neural Information Processing Systems 35
- Published
- 2022
- Pages
- 27730-27744
- ISSN
- 1049-5258 (ISSN-L)
- OpenAlex
- W7133211372
- Cited by
- 3,117
- References
- 0
- Citations by year
- 2026: 1421 · 2025: 544 · 2024: 852 · 2023: 297 · 2022: 3
- FWCI
- 234.27
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- neural information processing systems (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Keywords
- instruction following, language models, human feedback, reinforcement learning from human feedback, large language models
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.