Training Language Models to Follow Instructions with Human Feedback
The DOI matches its Crossref record; 2 of the 2 references it cites were found in a registry or an index.
Abstract
Making language models bigger does not inherently make them better at following a user's intent. For example, large language models can generate outputs that are untruthful, toxic, or simply not helpful to the user. In other words, these models are not aligned with their users. In this paper, we show an avenue for aligning language models with user intent on a wide range of tasks by fine-tuning with human feedback. Starting with a set of labeler-written prompts and prompts submitted through the OpenAI API, we collect a dataset of labeler demonstrations of the desired model behavior, which we use to fine-tune GPT-3 using supervised learning. We then collect a dataset of rankings of model outputs, which we use to further fine-tune this supervised model using reinforcement learning from human feedback. We call the resulting models InstructGPT. In human evaluations on our prompt distribution, outputs from the 1.3B parameter InstructGPT model are preferred to outputs from the 175B GPT-3, despite having 100x fewer parameters. Moreover, InstructGPT models show improvements in truthfulness and reductions in toxic output generation while having minimal performance regressions on public NLP datasets. Even though InstructGPT still makes simple mistakes, our results show that fine-tuning with human feedback is a promising direction for aligning language models with human intent.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Existing literature (Ouyang et al., 2022) does not fully describe the details of these models, such as the pretraining corpus, model sizes, and model biases.”
From Self-Refine: Iterative Refinement with Self-Feedback (2023) · cites this paper as Ouyang et al., 2022
Experimental — accuracy not yet measuredIn the citing paper
“Specifically, providers mitigate race and gender bias through reinforcement learning from human feedback (RLHF), adversarial stress-testing known as red teaming, and hard-coded refusals governed by the provider's own content policies [6, 43, 71].”
From All Public Voices Are Equal, But Are Some More Equal Than Others to LLMs? (2026) · cites this paper as [71]
In the citing paper
“Fine-tuning a model from human feedback at scale, using preference data from paid raters or drawn from a large and willing user base, is an especially potent technique.It has the potential not only to shape a model's responses to better reflect user norms (for better or worse), but also to filter out toxic language, improve factual accuracy, and mitigate the tendency to fabricate information.”
From Talking about Large Language Models (2024) · cites this paper as [26]
In the citing paper
“These include general competencies such as in-context learning (ICL) [13], chain-of-thought (CoT) [17] reasoning, and instruction following [25], as well as task-specialized skills like mathematical reasoning [30].”
From A Survey of Large Language Models (2026) · cites this paper as [25]
In the citing paper
“When external reward models or ground-truth answers are available, rejection sampling can also be applied to select higher-quality responses from multiple candidates [25].”
From A Survey of Large Language Models (2026) · cites this paper as [25]
41 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
The publisher hasn’t deposited this paper’s reference list.
Cited by
Items 2,001–2,100 of 4,340
OpenSQL: Data-Efficient Text-to-SQL for Open-Source LLMs via Synthesized Intermediate Supervision
Hu, R., Luo, Y., Li, G., Wu, S., & Luo, Y. (2026) · Proceedings of the VLDB Endowment · doi:10.14778/3801059.3801074 · Cited by 5
Wang, J., Yang, C., Yong, J., Xu, X., Wang, H., Koshizuka, N., Fukushima, S., Shibasaki, R., & Jiang, R. (2026) · Transportation Research Part C Emerging Technologies · doi:10.1016/j.trc.2026.105862 · Cited by 2
The Axiology of AI Agents: How Human-AI Interaction Transforms Values from Espoused to Enacted
Glaser, V., Sloan, J., Valadão, R., & Micelotta, E. R. (2026) · Academy of Management Review · doi:10.5465/amr.2024.0494 · Cited by 4
Sentient AI in robots and agents: prolegomena for an evidence-based research program
Chella, A. (2026) · Frontiers in Psychology · doi:10.3389/fpsyg.2026.1903644 · Cited by 4
Naser, M. Z., Awwad, A., McCreery, Z., Eissa, R., Naser, A. Z., Cusatis, G., Metcalf, A. R., Madathil, K. C., Abdalla, J., Kodur, V. K. R., et al. (2026) · Computers & Industrial Engineering · doi:10.1016/j.cie.2026.112333 · Cited by 2
LLM Based Bayesian Optimization for Prompt Search
Ballew, A., Wang, J., & Ren, S. (2025) · IEEE ... International Conference on Data Mining workshops · doi:10.1109/icdmw69685.2025.00057 · Cited by 2
OARS: Process-Aware Online Alignment for Generative Real-World Image Super-Resolution
Zhao, S., Zhang, X., Chen, B., Li, W., Xing, Q., Zhang, K., Wang, Y., Li, J., Zhang, L., Zhang, J., et al. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37429-5_33 · Cited by 2
Towards Verifiable AI with Lightweight Cryptographic Proofs of Inference
Anchuri, P., Campanelli, M., Cesaretti, P., Gennaro, R., Jois, T. M., Kayman, H. S., & Ozdemir, T. (2026) · IEEE Conference on Secure and Trustworthy Machine Learning (SaTML) · doi:10.1109/satml68715.2026.00058 · Cited by 3
Toward Human-Centered Explainability: Natural Language Explanations for Anomaly Detection
Padín-Torrente, H., Carneiro, V., & Ortega-Fernandez, I. (2026) · Information Systems Frontiers · doi:10.1007/s10796-026-10717-3 · Cited by 3
Agentic AI for Interview Preparation
Bokde, A., Dahane, S., Maske, P., Dhebe, P., Pandit, P., & Yenkikar, A. (2026) · International Conference on Emerging Technologies and Future Innovations (ETFI) · doi:10.1109/etfi68128.2026.11484536 · Cited by 2
V.I.P.: Iterative Online Preference Distillation for Efficient Video Diffusion Models
Kim, J., Seo, W., Kim, J., Park, S., Park, S., & Yu, Y. (2025) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.01601 · Cited by 5
EGAD: Entropy-Guided Adaptive Distillation for Token-Level Knowledge Transfer
Zhang, H., Zhang, Z., Wu, G., Ning, W., Guo, J., & Cheng, X. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37657-2_24 · Cited by 2
Robustness of Prompting: Enhancing Robustness of Large Language Models Against Prompt Attacks
Mu, L., Chu, G., Li, N., Sang, L., & Zhang, Y. (2026) · IEEE Transactions on Artificial Intelligence · doi:10.1109/tai.2026.3697684 · Cited by 3
Hu, Y., Xiong, Q., Qin, Z., Watanabe, B., Wang, Y., Prpa, M., & Yoon, I. (2026) · IEEE Conference on Artificial Intelligence (CAI) · doi:10.1109/cai68641.2026.11536351 · Cited by 2
VAR-3D: View-aware Auto-Regressive Model for Text-to-3D Generation via a 3D Tokenizer
Han, Z., Hong, Y., Sun, H., & Cao, D. (2026) · International Conference on Multimedia Retrieval · doi:10.1145/3805622.3810588 · Cited by 2
Navigating maritime emergencies with large models: A lifecycle-oriented review
Xu, J., Yang, Q., Yang, Z., Gao, Y., Yang, K., & Jiang, J. (2026) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2026.115411 · Cited by 2
Shah-Mohammadi, F., Millar, A., Facelli, J. C., & Gouripeddi, R. (2026) · JAMIA Open · doi:10.1093/jamiaopen/ooag108 · Cited by 3
Advancing Regulation in Artificial Intelligence: An Auction-Based Approach
Bornstein, M., Che, Z., Julapalli, S., Mohamed, A., Bedi, A. S., & Huang, F. (2026) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3805689.3812397 · Cited by 2
Co-Constructing Alignment: A Participatory Approach to Situating AI Values
Arzberger, A., Liscio, E., Lupetti, M. L., de Troya, Í. M. D. R., & Yang, J. (2026) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3805689.3812267 · Cited by 4
Brainrot: Deskilling and Addiction are Overlooked AI Risks
Chalkidis, I., & Søgaard, A. (2026) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3805689.3812306 · Cited by 6
Ambiguity Collapse by LLMs: A Taxonomy of Epistemic Risks
Gur-Arieh, S., Wang, A., & Fazelpour, S. (2026) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3805689.3806469 · Cited by 7
RM -RF: Reward Model for Run-Free Unit Test Evaluation
Bruches, E. P., Grebenkin, D., Klementev, M., Alperovich, V., Derunets, R., Baturova, D., Mkrtchyan, G., Sedukhin, O., Bondarenko, I., Bushkov, N., et al. (2026) · IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER) · doi:10.1109/saner67736.2026.00015 · Cited by 2
Financial advice behaviour: humans versus AI
Baeckström, Y., & Matkovskyy, R. (2026) · Journal of Corporate Finance · doi:10.1016/j.jcorpfin.2026.103044 · Cited by 4
Liu, Z., Ye, H., Zhang, X., & Qi, M. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37010-5_34 · Cited by 2
Six misconceptions about large language models: A minimal model and diagnostic taxonomy
Lin, Z. (2026) · PNAS Nexus · doi:10.1093/pnasnexus/pgag236 · Cited by 2
Ye, S., 蒋三俊, & Li, S. (2026) · Applied Psychology · doi:10.1111/apps.70121 · Cited by 2
EchoAvatar: Real-time Generative Avatar Animation from Audio Streams
Chen, B., Li, Y., Xu, Y., Zheng, Y., Weng, Y., & Zhou, K. (2026) · ACM SIGGRAPH Conference (SIGGRAPH) · doi:10.1145/3799902.3811066 · Cited by 2
Babayiğit, M., & Geyik, S. (2026) · Medicine · doi:10.1097/md.0000000000049787 · Cited by 2
Petruzzelli, A., Martina, A. F. M., Musto, C., de Gemmis, M., Lops, P., & Semeraro, G. M. (2026) · Information Systems Frontiers · doi:10.1007/s10796-026-10787-3 · Cited by 2
Wang, Y., Li, T., Zhao, Y., Zhang, B., & Huang, X. (2026) · Buildings · doi:10.3390/buildings16142882 · Cited by 2
Optimizing sample selection for large language model-based entity matching using AssistEM
Mugeni, J. B., Lynden, S. J., AMAGASA, T., & Matono, A. (2026) · International Journal of Data Science and Analytics · doi:10.1007/s41060-026-01223-5 · Cited by 2
Agentic AI Safety: A Structured Review of Open Problems and Their Regulatory Anchoring
Valenta, T., Rozinek, O., & Horálek, J. (2026) · AI · doi:10.3390/ai7080298 · Cited by 2
Sparsity Curse: Understanding RLVR Model Parameter Space from Model Merging
Wu, C., Li, Z., Bu, J., Liu, J., & Wang, H. (2026) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3770855.3817679 · Cited by 2
The Interlocutor Effect: Why LLMs Leak More Personal Data to Agents Than Humans
Yagoubi, F. E., Badu-Marfo, G., & Mallah, R. A. (2026) · IEEE European Symposium on Security and Privacy Workshops (EuroS&PW) · doi:10.1109/eurospw72509.2026.00008 · Cited by 2
Nadai, M. D., D’Amico, E., Lefarov, M., Tamborrino, A., Vohra, D., VanMiddlesworth, M., Lin, S., Wood, J., Stypka, J., Klyce, E., et al. (2026) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3770855.3817955 · Cited by 2
Sci-PRM: A Tool Aware Process Reward Model for Scientific Reasoning Verification
Zhao, X., Zhao, H., Wang, Y., Xu, W., Zhou, Y., Cao, Q., Zhou, Z., Bai, L., Zhang, W., & Wu, X.-M. (2026) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3770855.3818999 · Cited by 3
Fang, Q., & Liu, W. (2026) · Computers and Education Artificial Intelligence · doi:10.1016/j.caeai.2026.100664 · Cited by 2
Iwasaki, Y., Toyama, R., Tamura, R., Matsuda, S., Sakuraba, Y., Kotsugi, M., Igarashi, Y., & Sodeyama, K. (2026) · Communications Materials · doi:10.1038/s43246-026-01304-9 · Cited by 2
Data security in large language models: risks, defense, and directions
Chen, K., Zhou, X., Yu, Y., Lin, Y., Chen, H., Cai, C., & Shen, L. (2026) · Journal of King Saud University - Computer and Information Sciences · doi:10.1007/s44443-026-01200-9 · Cited by 2
Park, J., Lim, Y., Kim, G., Yun, T., & Min, M. (2026) · ETRI Journal · doi:10.4218/etrij.2026-0186 · Cited by 2
Generative AI Technologies, Techniques and Tensions: A Primer
Behrens, J. T. (2026) · Springer eBooks · doi:10.1007/978-3-032-24819-0_2 · Cited by 2
From the First Public ChatGPT to Astra in Scientific Collaboration
Shapovalov, V. (2026) · Conceptual Future · doi:10.53933/c75rcf79 · Cited by 2
Bounded Minds, Generative Machines
Liu, J. (2026) · Communications of the ACM · doi:10.1145/3790104 · Cited by 2
SynthCoder: Anti-pattern identification and model training for FIM mode code completion
Yu, D., Yan, X., Li, Z., Xiao, J., He, H., Yu, Y., Zhang, H., Rong, G., & Huang, X. (2026) · Empirical Software Engineering · doi:10.1007/s10664-026-10957-6 · Cited by 2
Xuan, Z., Wu, Y., Yan, Z., Namboodiri, V., & Yang, Y. (2026) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3831999 · Cited by 2
A critical assessment of the rise of agentic AI, its capabilities, task domains and open challenges
Khan, R. U., Aljuaid, H., & Ning, Z. (2026) · Discover Artificial Intelligence · doi:10.1007/s44163-026-02342-5 · Cited by 3
BALROG: Benchmarking Agentic LLM and VLM Reasoning On Games
Paglieri, D., Cupiał, B., Coward, S., Piterbarg, U., Wolczyk, M., Khan, A., Pignatelli, E., Kuciński, Ł., Pinto, L., Fergus, R., et al. (2024) · arXiv · doi:10.48550/arxiv.2411.13543 · Cited by 2
“LLMs possess vast knowledge across domains (Brown, 2020; Hendrycks et al., 2020), can reason in specific scenarios (Wei et al., 2022a; Shinn et al., 2023; Rein et al., 2023), and can reliably follow human instructions in simple settings (Ouyang et al., 2022).”
MemOS: An Operating System for Memory-Augmented Generation (MAG) in Large Language Models
Li, Z., Song, S., Wang, H., Niu, S., Chen, D., Yang, J., Xi, C., Lai, H., Zhao, J., Wang, Y., et al. (2025) · arXiv · doi:10.48550/arxiv.2505.22101 · Cited by 2
“Explicit short-term memory typically involves prompt concatenation within the context window, but remains limited by context length constraints [18, 21].”
R-Judge: Benchmarking Safety Risk Awareness for LLM Agents
Yuan, T., He, Z., Dong, L., Wang, Y., Zhao, R., Xia, T., Xu, L., Zhou, B., Li, F., Zhang, Z., et al. (2024) · arXiv · doi:10.48550/arxiv.2401.10019 · Cited by 2
“As for safeguarding LLMs, typical safety alignment methods highlight reinforcement learning from human feedback (RLHF) to promote harmless LLMs (Ouyang et al., 2022; Bai et al., 2022; Dai et al., 2023).”
BackgroundLauren, P. (2024) · 2024 IEEE Frontiers in Education Conference (FIE) · doi:10.1109/fie61694.2024.10893139 · Cited by 2
Wang, Z., Chen, J., Wei, Z., Lin, L., & Tong, G. (2026) · Sensors · doi:10.3390/s26113502 · Cited by 2
Prompting Meta-Learned Hierarchical Graph Network for Molecular Property Prediction
Zhuang, X., Ding, K., Fang, Y., Chen, H., & Zhang, Q. (2023) · IEEE International Conference on Medical Artificial Intelligence (MedAI) · doi:10.1109/medai59581.2023.00025 · Cited by 3
Purposer: Putting Human Motion Generation in Context
Ugrinovic, N., Lucas, T., Baradel, F., Weinzaepfel, P., Rogez, G., & Moreno-Noguer, F. (2024) · International Conference on 3D Vision (3DV) · doi:10.1109/3dv62453.2024.00118 · Cited by 4
Zhang, X., Zang, L., Liu, Q., Wei, S., & Hu, S. (2024) · International Conference on Computer Supported Cooperative Work in Design (CSCWD) · doi:10.1109/cscwd61410.2024.10580274 · Cited by 2
Conditionally Combining Robot Skills using Large Language Models
Zentner, K. R., Julian, R., Ichter, B., & Sukhatme, G. S. (2024) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra57147.2024.10611275 · Cited by 2
Agent Deprogramming Finetuning Away Backdoor Triggers for Secure Machine Learning Models/LLMs
Edwards, D., & Rawat, D. B. (2024) · International Conference on Computer Communications and Networks (ICCCN) · doi:10.1109/icccn61486.2024.10637573 · Cited by 3
Sequence labeling via reinforcement learning with aggregate labels
Geromel, M., & Cimiano, P. (2024) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2024.1463164 · Cited by 2
Shah-Mohammadi, F., & Finkelstein, J. (2024) · IEEE Eurasia Conference on Biomedical Engineering, Healthcare and Sustainability (ECBIOS) · doi:10.1109/ecbios61468.2024.10885505 · Cited by 2
Hidden Pieces: An Analysis of Linear Probes for GPT Representation Edits
Davis, A., & Sukthankar, G. (2024) · International Conference on Machine Learning and Applications · doi:10.1109/icmla61862.2024.00073 · Cited by 2
Instruction-Following Long-Horizon Manipulation by LLM-Empowered Symbolic Planner
Li, Z., Liu, J., Li, Z., Yu, M., Teng, T., Zhou, S., Li, M., Lam, T. L., & Chen, F. (2024) · IEEE International Conference on Robotics and Biomimetics (ROBIO) · doi:10.1109/robio64047.2024.10907585 · Cited by 2
Making sense of transformer success
Angius, N., Perconti, P., Plebe, A., & Acciai, A. (2025) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2025.1509338 · Cited by 2
EasyDetector: Using Linear Probe to Detect the Provenance of Large Language Models
Zhang, J., Li, J., Fei, H., Li, L., & Zhu, H. (2024) · IEEE International Conference on Trust, Security and Privacy in Computing and Communications (TrustCom) · doi:10.1109/trustcom63139.2024.00333 · Cited by 10
Jackson, J. (2025) · IEEE Global Engineering Education Conference (EDUCON) · doi:10.1109/educon62633.2025.11016560 · Cited by 3
Fine-grained entity typing based on hyperbolic representation and label-context interaction
Xu, M., Zhang, W., Liu, J., Ding, W., Shi, L., & Zhong, K. (2025) · Information Sciences · doi:10.1016/j.ins.2025.122434 · Cited by 2
VeriBench: Benchmarking Large Language Models for Verilog Code Generation and Design Synthesis
Agarwal, M., Momin, Z., Prasad, K., & Mekie, J. (2025) · IEEE International Symposium on Circuits and Systems proceedings · doi:10.1109/iscas56072.2025.11044004 · Cited by 2
Shen, J., Su, N.-J., & Lin, Y. (2025) · Systems · doi:10.3390/systems13070523 · Cited by 3
Yuan, W., Lin, T., Jiang, Z., & Wang, S. (2025) · Expert Systems with Applications · doi:10.1016/j.eswa.2025.128911 · Cited by 3
DivPro: diverse protein sequence design with direct structure recovery guidance
Zhou, X., Shen, G., Chen, Y.-C., Chen, G., & Heng, P. (2025) · Bioinformatics · doi:10.1093/bioinformatics/btaf258 · Cited by 2
Iterative attack-and-defend framework for improving TCR-epitope binding prediction models
Zhang, P., Mei, H., Bang, S., & Lee, H. (2025) · Bioinformatics · doi:10.1093/bioinformatics/btaf224 · Cited by 2
Real-World Gaps in AI Governance Research
Strauss, I., Moure, I., O’Reilly, T., & Rosenblat, S. (2025) · IEEE Access · doi:10.1109/access.2026.3706255 · Cited by 2
On the Role of Domain Experts in Creating Effective Tutoring Systems
Sreedharan, S., Sikes, K., Blanchard, N., Mason, L., Krishnaswamy, N., & Zarestky, J. (2025) · Communications in computer and information science · doi:10.1007/978-3-031-99261-2_5 · Cited by 2
Diffusion Preference Alignment via Attenuated Kullback–Leibler Regularization
Zhang, X., & Xiang, W. (2025) · Electronics · doi:10.3390/electronics14152939 · Cited by 2
Chen, L., Ahmed, N. K., Capotă, M., Willke, T., Hasabnis, N., & Jannesari, A. (2025) · IEEE International Parallel and Distributed Processing Symposium (IPDPS) · doi:10.1109/ipdps64566.2025.00055 · Cited by 9
Tiratatri, T., Sukittivarapunt, K., Sarasinpitak, T., & Pyae, A. (2025) · International Conference on Electrical Engineering/Electronics, Computer, Telecommunications and Information Technology (ECTI-CON) · doi:10.1109/ecti-con64996.2025.11101665 · Cited by 5
Nav2Scene: Navigation-driven fine-tuning for robot-friendly scene generation
Jiang, B., Bai, T., Zheng, P., Wu, T., & Ma, R. (2025) · Graphical Models · doi:10.1016/j.gmod.2025.101287 · Cited by 2
Li, X., Xu, W., Ye, Z., & Yuan, H. (2025) · Biomimetic Intelligence and Robotics · doi:10.1016/j.birob.2025.100258 · Cited by 6
Pay more attention to the robustness of LLMs on adversarial prompt for instruction data mining
Wang, Q., Feng, D., Zhang, X., Shen, A., Xu, Y., Ding, B., & Wang, H. (2025) · Neural Networks · doi:10.1016/j.neunet.2025.107989 · Cited by 2
Multi-agents Based User Values Mining for Recommendation
Chen, L., Yuan, W., Chen, T., Zhao, X., Nguyen, Q. V. H., & Yin, H. (2026) · Data Science and Engineering · doi:10.1007/s41019-026-00349-7 · Cited by 3
Advancing Speech Understanding in Speech-Aware Language Models with GRPO
Elmakies, A., Aronowitz, H., Shabtay, N., Schwartz, E., Hoory, R., & Dekel, A. (2026) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp55912.2026.11463105 · Cited by 5
Human-in/on-the-Loop AI: Enabling Human Controllability and Decision-Making in Spaceflight
Bensch, L., Bensch, O., Nilsson, T., Paradiso, J. A., Davidoff, S., Blanchard, L., Pataranutaporn, P., Weber, M., Kutz, J. N., & Flemisch, F. O. (2025) · Springer eBooks · doi:10.1007/978-981-95-3658-0_40 · Cited by 5
Unifying Two Operators with One PIM: Leveraging Hybrid Bonding for Efficient LLM Inference
Chen, J., Qi, Y., Sun, K., Lin, Z., Wang, T., Ma, C., & Wang, Y. (2025) · Lecture notes in computer science · doi:10.1007/978-981-95-1021-4_16 · Cited by 2
AskHPC: A ChatBot for High Performance Computing User Support
Bondapalli, A., Zheng, H., Ajayi, O. T., Keçeli, M., Som, H. S., Childers, J. T., Childers, L., Ghadar, Y., Papka, M. E., Vishwanath, V., et al. (2025) · International Conference for High Performance Computing, Networking, Storage and Analysis (SC) · doi:10.1145/3731599.3767433 · Cited by 9
Kaltenpoth, S., & Müller, O. (2026) · Lecture notes in information systems and organisation · doi:10.1007/978-3-032-08480-4_4 · Cited by 2
Yan, G., Xie, L., Shen, Q., Fang, Y., & Wu, Z. (2026) · International World Wide Web Conference (WWW) · doi:10.1145/3774904.3792144 · Cited by 6
Social and Ethical Risks Posed by General-Purpose LLMs for Settling Newcomers in Canada
Nejadgholi, I., Molamohammadi, M., & Bakhtawar, S. (2025) · Women in engineering and science · doi:10.1007/978-3-031-95890-8_11 · Cited by 5
You Are the Best Reviewer of Your Own Papers: The Isotonic Mechanism
Su, W. (2025) · Operations Research · doi:10.1287/opre.2022.0622 · Cited by 4
Li, Y., Liu, B., Huang, S., Zhang, Z., Yuan, X.-T., & Hong, R. (2026) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2026.3703316 · Cited by 2
Uncertainty Quantification and Data Efficiency in AI: An Information-Theoretic Perspective
Simeone, O., & Romano, Y. (2026) · IEEE Journal on Selected Areas in Information Theory · doi:10.1109/jsait.2026.3705302 · Cited by 2
Toward Truly Intelligent Autonomous Systems: A Taxonomy of LLM Integration for Everyday Automation
Jung, M., Hempel, T., Al-Tawil, B., Yang, Q., Wachsmuth, S., & Al-Hamadi, A. K. (2025) · Communications in computer and information science · doi:10.1007/978-3-032-00986-9_6 · Cited by 2
Learning to Decompose and Optimize for Large Scale Overlapping Problems
Tian, M., Du, W., Fang, W., Tang, Y., & Jin, Y. (2025) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2025.3622888 · Cited by 3
Large Language Models for Education and Research: An Empirical and User Survey-Based Analysis
Rahman, M. M., Shiplu, A. I., Amin, M. F. I., Watanobe, Y., & Peng, L. (2026) · Communications in computer and information science · doi:10.1007/978-3-032-28463-1_34 · Cited by 2
A value-aligned dataset (VAD) for supervised fine-tuning of large language models
Yingjie, L. I., Qidong, Y. A. N., Wu, W., Wang, D., & Ma, N. (2025) · China Scientific Data · doi:10.11922/11-6035.csd.2024.0212.zh · Cited by 2
The fake friend dilemma: relational trust and the political economy of conversational AI
Erickson, J. (2026) · Frontiers in Communication · doi:10.3389/fcomm.2026.1921101 · Cited by 2
Evaluating over-empathizing in emotional support conversations: A user-centered framework
Son, S., Koo, S., Zi, E. H., Jang, J., & Lim, H. (2026) · Expert Systems with Applications · doi:10.1016/j.eswa.2025.131059 · Cited by 5
AT-adapter: Leveraging attribute knowledge of CLIP for few-shot classification
Jo, Y. U., Kim, J., Park, C., Choi, S., Lee, J.-W., & Park, J. (2026) · Neurocomputing · doi:10.1016/j.neucom.2026.132627 · Cited by 2
Lean Clients, Full Accuracy: Hybrid Zeroth- and First-Order Split Federated Learning
Kou, Z., Chen, Z., Yang, J., & Shen, C. (2026) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2026.3739757 · Cited by 3
Zhiqing, G. U. O., Liu, G., Chai, S., Liu, W., & Jiang, F. (2026) · Results in Engineering · doi:10.1016/j.rineng.2026.109283 · Cited by 12
Can Large Language Models Generate Higher Order Thinking Math Problems? An Evaluation Study
Gómez, F., & Alvarez, A. A. (2026) · IEEE Access · doi:10.1109/access.2026.3658579 · Cited by 2
A2-LLM: An End-to-end Conversational Audio Avatar Large Language Model
Hu, X., Yuan, H., Sang, X., Yan, B., Yu, Z., Huang, C., Chen, K., & Chen, K. (2026) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3767308.3836075 · Cited by 2
Who Invests, Who Gets Funded: Gender and Racial Bias in LLM-Generated Investment Advice
Wang, Y. E., & Gu, K. (2026) · Journal of Business Ethics · doi:10.1007/s10551-026-06251-6 · Cited by 6
Metadata
- Authors
- Ouyang, L., Wu, J., Jiang, X., Almeida, D., Wainwright, C., Mishkin, P., Zhang, C., Agarwal, S., Slama, K., Ray, A., Schulman, J., Hilton, J., Kelton, F., Miller, L., Simens, M., Askell, A., Welinder, P., Christiano, P., Leike, J., & Lowe, R.
- Venue
- Advances in Neural Information Processing Systems 35
- Published
- 2022
- Pages
- 27730-27744
- ISSN
- 1049-5258 (ISSN-L)
- OpenAlex
- W7133211372
- Cited by
- 3,117
- References
- 0
- Citations by year
- 2026: 1421 · 2025: 544 · 2024: 852 · 2023: 297 · 2022: 3
- FWCI
- 234.27
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- neural information processing systems (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Keywords
- instruction following, language models, human feedback, reinforcement learning from human feedback, large language models
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.