Training Language Models to Follow Instructions with Human Feedback
The DOI matches its Crossref record; 2 of the 2 references it cites were found in a registry or an index.
Abstract
Making language models bigger does not inherently make them better at following a user's intent. For example, large language models can generate outputs that are untruthful, toxic, or simply not helpful to the user. In other words, these models are not aligned with their users. In this paper, we show an avenue for aligning language models with user intent on a wide range of tasks by fine-tuning with human feedback. Starting with a set of labeler-written prompts and prompts submitted through the OpenAI API, we collect a dataset of labeler demonstrations of the desired model behavior, which we use to fine-tune GPT-3 using supervised learning. We then collect a dataset of rankings of model outputs, which we use to further fine-tune this supervised model using reinforcement learning from human feedback. We call the resulting models InstructGPT. In human evaluations on our prompt distribution, outputs from the 1.3B parameter InstructGPT model are preferred to outputs from the 175B GPT-3, despite having 100x fewer parameters. Moreover, InstructGPT models show improvements in truthfulness and reductions in toxic output generation while having minimal performance regressions on public NLP datasets. Even though InstructGPT still makes simple mistakes, our results show that fine-tuning with human feedback is a promising direction for aligning language models with human intent.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Existing literature (Ouyang et al., 2022) does not fully describe the details of these models, such as the pretraining corpus, model sizes, and model biases.”
From Self-Refine: Iterative Refinement with Self-Feedback (2023) · cites this paper as Ouyang et al., 2022
Experimental — accuracy not yet measuredIn the citing paper
“Specifically, providers mitigate race and gender bias through reinforcement learning from human feedback (RLHF), adversarial stress-testing known as red teaming, and hard-coded refusals governed by the provider's own content policies [6, 43, 71].”
From All Public Voices Are Equal, But Are Some More Equal Than Others to LLMs? (2026) · cites this paper as [71]
In the citing paper
“Fine-tuning a model from human feedback at scale, using preference data from paid raters or drawn from a large and willing user base, is an especially potent technique.It has the potential not only to shape a model's responses to better reflect user norms (for better or worse), but also to filter out toxic language, improve factual accuracy, and mitigate the tendency to fabricate information.”
From Talking about Large Language Models (2024) · cites this paper as [26]
In the citing paper
“These include general competencies such as in-context learning (ICL) [13], chain-of-thought (CoT) [17] reasoning, and instruction following [25], as well as task-specialized skills like mathematical reasoning [30].”
From A Survey of Large Language Models (2026) · cites this paper as [25]
In the citing paper
“When external reward models or ground-truth answers are available, rejection sampling can also be applied to select higher-quality responses from multiple candidates [25].”
From A Survey of Large Language Models (2026) · cites this paper as [25]
41 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
The publisher hasn’t deposited this paper’s reference list.
Cited by
Items 1,801–1,900 of 4,340
Deep Reinforcement Learning Based Intelligent Resource Allocation in Hybrid Vehicle Scenario
Lou, C., Hou, F., Li, B., & Ding, H. (2024) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2024.3483891 · Cited by 4
Retrosynthesis Prediction via Search in (Hyper) Graph
Lan, Z., Hong, B., Xu, M., Zeng, Z., Liu, Z., Yu, L., & Ma, F. (2025) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2025.3585129 · Cited by 5
Can Large Language Models Extract Customer Needs as well as Professional Analysts?Preprint
Timoshenko, A., Mao, C., & Hauser, J. R. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5167493 · Cited by 10
SuperMemory-VQA: An Egocentric Visual Question-Answering Benchmark for Long-Horizon MemoryPreprint
Alam, S., Siam, M. S. I., Proulx, M. J., Fort, J., Newcombe, R. A., Kim, H. J., & Zhang, M. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2606.00825 · Cited by 5
An Evaluation Mechanism of LLM-based Agents on Manipulating APIs
Liu, B., Jianxiang, Z., Meng, D., & Lu, H. (2024) · Findings of the Association for Computational Linguistics: EMNLP 2024 · doi:10.18653/v1/2024.findings-emnlp.267 · Cited by 4
“In the LLM domain, ChatGPT (Ouyang et al., 2022) is the most typical proprietary LLM and represents the SOTA LLM while many open-sourced LLMs like LLaMA (Touvron et al., 2023) are also very competitive.”
Does Reinforcement Learning Really Incentivize Reasoning Capacity in LLMs Beyond the Base Model?
Yue, Y., Chen, Z., Lu, R., Zhao, A., Wang, Z., Yue, Y., Song, S., & Huang, G. (2025) · arXiv · doi:10.48550/arxiv.2504.13837 · Cited by 804
“Since the emergence of LLMs, the post-training phase has proven crucial to enhance problem-solving and reasoning abilities (Ouyang et al., 2022).”
Can Language Models Enable in-Context Database?
Pan, Y., Yu, H., Zhao, T., & Sun, J. (2025) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata66926.2025.11401589 · Cited by 4
Computational structuralism: Toward a formal theory of meaning in the age of digital intelligence
Kozlowski, A. C. (2026) · Theory and Society · doi:10.1007/s11186-026-09685-z · Cited by 4
Meng, S., Tian, B., Zhang, X., Fu, J., & Ni, X. (2025) · China Automation Congress (CAC) · doi:10.1109/cac67268.2025.11487730 · Cited by 3
Danry, V., Billa, J. G., Samaradivakara, Y., Liang, P. P., & Maes, P. (2026) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3742413.3789168 · Cited by 5
LATTICE: A Governance-First Architecture for Authorized Autonomous AI OperationsPreprint
Calboreanu, E. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6151128 · Cited by 3
Towards a theory of human creativity sustained by embodied collective intelligence
Daikoku, T. (2026) · Frontiers in Psychology · doi:10.3389/fpsyg.2026.1752280 · Cited by 3
Think-Augmented Function Calling: Improving LLM Parameter Accuracy through Embedded Reasoning
Wei, L., Ou, J., Peng, X., & Wang, B. (2026) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp55912.2026.11462757 · Cited by 3
A roadmap for medical large language models: a review of foundations, applications, and challenges
Sha, Y.-Y., Yu, L., Lin, Z.-H., Kaur, A., Lou, Y., Gornale, S. S., Zhang, T., Wong, L. S., Wang, Z., Yan, Y., et al. (2026) · Military Medical Research · doi:10.1016/j.mmr.2026.100050 · Cited by 4
Chatterjee, S., Tran, L., Nguyen, Q. D., Kirson, R., Hamlin, D., Aquino, H., Lyu, H., Luo, J., & Dye, T. (2025) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata66926.2025.11401510 · Cited by 3
Jiang, Z., Lv, Q., Zhang, Z., & Lei, L. (2026) · International Journal of Applied Linguistics · doi:10.1111/ijal.70160 · Cited by 3
AR-CoPO: Align Autoregressive Video Generation with Contrastive Policy Optimization
He, D., Feng, G., Ge, X., Zhang, Y., Ma, B., Song, G., (6938), Y. L., & Li, H. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37314-4_4 · Cited by 6
Teaching an Agent to Sketch One Part at a Time
Du, X., Xu, R., Yunis, D., Vinker, Y., & Shakhnarovich, G. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37032-7_14 · Cited by 3
SceneOrchestra: Efficient Agentic 3D Scene Synthesis via Full Tool-Call Trajectory Generation
He, Y., Yu, K., & Zwicker, M. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37359-5_29 · Cited by 7
Beyond alignment: Why robotic foundation models need context-aware safety
Robey, A., Ravichandran, Z., Jones, E. K., Perlo, J., Barez, F., Kumar, V. V., Kolter, J. Z., Hassani, H., & Pappas, G. J. (2026) · Science Robotics · doi:10.1126/scirobotics.aef2191 · Cited by 5
Bridging Information Asymmetry: A Hierarchical Framework for Deterministic Blind Face Restoration
Yao, Z., Hu, J., Li, K., He, H., Zhang, X., Zeng, S., Zhu, L., & Lu, Y. (2026) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2026.3706097 · Cited by 3
ExMe: Keep Improving With Extrapolation and Merging
Lin, Y., Xu, B., LI, Y., & Gao, Y. (2026) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2026.3708509 · Cited by 3
SoK: Robustness in Large Language Models against Jailbreak Attacks
Xu, F., Hu, H., He, C., Hang, S., Hu, H., Liu, X., Zhao, Y., Zhou, Z., Zhu, B. B., Sun, S. Y., et al. (2026) · IEEE Symposium on Security and Privacy (S&P) · doi:10.1109/sp63933.2026.00107 · Cited by 9
Safety Beyond the Interface: Detecting Harm via Latent States in Large Language Models
Khatri, A., Prabhu, C., & Neogi, O. (2026) · International Conference on Dependable Systems and Networks workshops · doi:10.1109/dsn-w70714.2026.00027 · Cited by 5
Hybrid Advantage Estimation with Unified Critic for VLM Agentic Reinforcement Learning
Zhang, W., Wang, Y., Jia, D., Shen, X., Ding, J., Viola, I., Schmidhuber, J., & Elhoseiny, M. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37044-0_3 · Cited by 3
Wang, Y., Wei, L., Liu, L., Xu, H., & Ling, H. (2026) · Journal of Cheminformatics · doi:10.1186/s13321-026-01234-1 · Cited by 3
Tone Matters: The Impact of Linguistic Tone on Hallucination in VLMs
Hong, W., Jiang, Z., Shen, B., Guan, X., Feng, Y., Xu, M., & Li, B. (2026) · IEEE/CVF Winter Conference on Applications of Computer Vision Workshops (WACVW) · doi:10.1109/wacvw68408.2026.00147 · Cited by 4
Huang, X., Xiao, M., Qin, C., Long, Q., Chen, J., Zhou, Y., & Zhu, H. (2026) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3770855.3817489 · Cited by 5
Palmeira Ferraz, T., Mehta, K., Lin, Y.-H., Chang, H.-S., Oraby, S., Liu, S., Subramanian, V., Chung, T., Bansal, M., & Peng, N. (2024) · Findings of the Association for Computational Linguistics: EMNLP 2024 · doi:10.18653/v1/2024.findings-emnlp.458 · Cited by 3
“Recent research has begun exploring open-source LLMs for LLM-as-a-Judge, aiming to reduce reliance on proprietary models.”
InfluentialZweiger, A., Pari, J., Guo, H., Akyürek, E., Kim, Y., & Agrawal, P. (2025) · arXiv · Cited by 3
“SEAL learns how to best utilize this external data for self-improvement.”
AI Control: Improving Safety Despite Intentional Subversion
Greenblatt, R., Shlegeris, B., Sachan, K., & Roger, F. (2023) · arXiv · doi:10.48550/arxiv.2312.06942 · Cited by 3
“The usual way AI developers attempt to make models safe is by fine-tuning them to avoid the generation of harmful content (Ouyang et al., 2022; OpenAI, 2023a; Touvron et al., 2023).”
BackgroundDong, Z., Tang, T., Li, J., Zhao, W. X., & Wen, J.-R. (2023) · arXiv · doi:10.48550/arxiv.2309.13345 · Cited by 7
Token-Budget-Aware LLM Reasoning
Han, T., Wang, Z., Fang, C., Zhao, S., Ma, S., & Chen, Z. (2024) · arXiv · Cited by 31
“…propose an “implicit monotonicity assumption” that when the model outputs a wrong prediction at a budget value, it always predicts in-correctly when under this budget value, and when the model outputs a correct prediction at a budget value, it always predicts correctly when above this budget value.”
Can LLMs make trade-offs involving stipulated pain and pleasure states?
Keeling, G., Street, W., Stachaczyk, M., Zakharova, D., Comsa, I. M., Sakovych, A., Logothetis, I., Zhang, Z., Arcas, B. A. Y., & Birch, J. (2024) · arXiv · doi:10.48550/arxiv.2411.02432 · Cited by 3
“Gemini 1.5 Pro and Claude 3 Opus have been finetuned for ‘harmlessness’ (Gemini Team, 2023; Anthropic, 2023a; see also Bai et al., 2022; Ouyang et al., 2022).”
BackgroundInfluentialSWE-Search: Enhancing Software Agents with Monte Carlo Tree Search and Iterative Refinement
Antoniades, A., Örwall, A., Zhang, K., Xie, Y., Goyal, A., & Wang, W. (2024) · arXiv · doi:10.48550/arxiv.2410.20285 · Cited by 3
“While machine learning has made progress in automating parts of this workflow (Li et al., 2022; OpenAI et al., 2024; Ouyang et al., 2022; Yang et al., 2024b), replicating the adaptive and strategic behavior of human engineers remains a significant challenge.”
Lightweight and Direct Document Relevance Optimization for Generative Information Retrieval
Mekonnen, K. A., Tang, Y., & de Rijke, M. (2025) · Proceedings of the 48th International ACM SIGIR Conference on Research and Development in Information Retrieval · doi:10.1145/3726302.3730023 · Cited by 3
Empowering Large Language Model Agent through Step-Level Self-Critique and Self-Training
Zhai, Y., Liu, H., Zhang, Z., Lin, T., Xu, K., Yang, C., Feng, D., Ding, B., & Wang, H. (2025) · Proceedings of the 48th International ACM SIGIR Conference on Research and Development in Information Retrieval · doi:10.1145/3726302.3729965 · Cited by 3
SkillAggregation: Reference-free LLM-Dependent Aggregation
Sun, G., Kagrecha, A., Manakul, P., Woodland, P., & Gales, M. (2025) · Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2025.acl-long.756 · Cited by 3
We're Afraid Language Models Aren't Modeling Ambiguity
Liu, A., Wu, Z., Michael, J., Suhr, A., West, P., Koller, A., Swayamdipta, S., Smith, N. A., & Choi, Y. (2023) · arXiv · doi:10.48550/arxiv.2304.14399 · Cited by 3
Drift No More? Context Equilibria in Multi-Turn LLM Interactions
Dongre, V., Rossi, R. A., Lai, V. D., Yoon, D. S., Hakkani-Tür, D., & Bui, T. (2025) · arXiv · doi:10.48550/arxiv.2510.07777 · Cited by 3
“Large Language Models (LLMs) have become central to a wide range of interactive systems, from virtual assistants and copilots to autonomous agents (Ouyang et al. 2022; Achiam et al. 2023; Brown et al. 2020; Acikgoz et al. 2025) that plan (Yao et al. 2023; Wang et al. 2023c; Li et al. 2023; Dongre…”
HelloBench: Evaluating Long Text Generation Capabilities of Large Language Models
Que, H., Duan, F., He, L., Mou, Y., Zhou, W., Liu, J., Rong, W., Wang, Z. M., Yang, J., Zhang, G., et al. (2024) · arXiv · doi:10.48550/arxiv.2409.16191 · Cited by 3
“Additionally, many instructions may request LLMs to produce longer text, but LLMs like GPT-4o, which are aligned through RLHF (Ouyang et al., 2022), are prone to reject such instructions, leading to some instructions being ignored.”
BackgroundCycle Consistency as Reward: Learning Image-Text Alignment Without Human Preferences
Bahng, H., Chan, C., Durand, F., & Isola, P. (2025) · 2025 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.02129 · Cited by 3
Let’s Chat: Integrating Large Language Models into Blended Learning of English for Specific Purposes
Yan, H. (2023) · International Symposium on Educational Technology · doi:10.1109/iset58841.2023.00044 · Cited by 3
A Recurrent Neural Network Approach to the Answering Machine Detection Problem
Altwlkany, K., Delalić, S., Selmanović, E., Alihodžić, A., & Lovrić, I. (2024) · International Convention on Information and Communication Technology, Electronics and Microelectronics · doi:10.1109/mipro60963.2024.10569812 · Cited by 5
Accelerating Contextualization in AI Large Language Models Using Vector Databases
Tareaf, R. B., AbuJarour, M., Engelman, T., Liermann, P., & Klotz, J. (2024) · International Conference on Information Networking · doi:10.1109/icoin59985.2024.10572088 · Cited by 4
ESP: Extro-Spective Prediction for Long-term Behavior Reasoning in Emergency Scenarios
Wang, D., Lai, Z., Li, Y., Wu, Y., Ma, Y., Betz, J., Yang, R., & Li, W. (2024) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra57147.2024.10610002 · Cited by 6
A delay-robust method for enhanced real-time reinforcement learning
Xia, B., Sun, H., Yuan, B., Li, Z., Liang, B., & Wang, X. (2024) · Neural Networks · doi:10.1016/j.neunet.2024.106769 · Cited by 5
Xducation of Things (XoT): Harnessing AI and Edge Computing to Educate All Things
Nurtantyana, R., Hwang, W., & Hariyanti, U. (2024) · IEEE Access · doi:10.1109/access.2024.3474015 · Cited by 3
Diallo, N., Alsagheer, D., Kamal, M., Xu, L., Lu, Y., Karanjai, R., & Shi, L. (2024) · International Conference on eDemocracy & eGovernment · doi:10.1109/icedeg61611.2024.10702065 · Cited by 3
Human or Algorithm? The Visual Turing Test of AI-Generated Images
Wang, C. (2024) · Journal of Multimedia Information System · doi:10.33851/jmis.2024.11.3.201 · Cited by 3
Learning to Compare Hardware Designs for High-Level Synthesis
Bai, Y., Sohrabizadeh, A., Ding, Z., Liang, R., Li, W., Wang, D., Ren, H. M., Sun, Y., & Cong, J. (2024) · ACM/IEEE Workshop on Machine Learning for CAD (MLCAD) · doi:10.1109/mlcad62225.2024.10740257 · Cited by 3
Xin, T., Zhai, H., Wang, J., Yang, Y. Z., Peng, T., & Ling, G. (2024) · Computers, materials & continua/Computers, materials & continua (Print) · doi:10.32604/cmc.2024.059018 · Cited by 4
Knowledge Graph as Pre-Training Corpus for Structural Reasoning via Multi-Hop Linearization
Kim, W. K., Jung, H., & Kim, W. (2024) · IEEE Access · doi:10.1109/access.2024.3523579 · Cited by 3
Enhancing Nested Named Entity Recognition in Chinese EMRs: A Collaborative Approach
Yue, H., Feng, X., Xu, H., Chu, H., Wang, Y., & Guan, R. (2024) · IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm62325.2024.10822099 · Cited by 5
AutoRed: Automated Attack Scenario Generation Framework for Red Teaming of LLMs
Wang, Z., & Tayebi, M. A. (2024) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata62323.2024.10825267 · Cited by 3
Generating Multiple Choice Questions from Scientific Literature via Large Language Models
Luo, S., Tang, Y., Jiang, M., Feng, K., Zhang, Q., & Ding, K. (2024) · IEEE International Conference on Knowledge Graph (ICKG) · doi:10.1109/ickg63256.2024.00035 · Cited by 3
Small Language Model Agent for the Operations of Continuously Updating ICT Systems
Fukuda, N., Nozue, H., & Oishi, H. (2025) · IEEE Access · doi:10.1109/access.2025.3544637 · Cited by 3
Faithful Self-Refinement in Mathematical Reasoning via Progressive Back-Translation
Liao, H., Zhu, Z., Hu, S., He, H., & Jin, Y. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10890054 · Cited by 3
PR-KGC: Text-enhanced Knowledge Graph Completion with Pair-wise Re-ranking
Gao, M., Zhang, F., Chen, W., Wang, T., Zheng, J., & Yao, J. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10889671 · Cited by 3
Emotion-aware Structural Enhancement Graph Auto-Encoder for Rumor Detection
Li, G., Yao, Z., Hu, D., Xu, Y., Zhang, X., & Lyu, H. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10889918 · Cited by 3
Dognin, P., Ríos, J., Luss, R., Sattigeri, P., Liu, M., Padhi, I., Riemer, M., Nagireddy, M., Varshney, K. R., & Bouneffouf, D. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10890426 · Cited by 3
Multi-Objective Large Language Model Unlearning
Pan, Z., Zhang, S., Zheng, Y., Li, C., Cheng, Y., & Zhao, J. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10889776 · Cited by 3
BatteryGPT: Battery Anomaly Detection Based on Multimodal Large Language Model
Cheng, D., Wang, S., Li, C., Xie, H., Sha, W., & Cao, Y. (2024) · International Conference on Power Engineering (ICPE) · doi:10.1109/icpe64565.2024.10929157 · Cited by 3
DualCIR: Enhancing Training-Free Composed Image Retrieval via Dual-Directional Descriptions
Zhao, J., Li, J., Lian, D., Sun, L., & Lv, P. (2025) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv61041.2025.00578 · Cited by 4
PromptHC: Multi-attention prompt guided haze-weather crowd counting
Shen, J., Tong, L., Li, S., & Kong, W. (2025) · Expert Systems with Applications · doi:10.1016/j.eswa.2025.128023 · Cited by 3
PRCD: A full-chain parallel residual compensation debiasing framework
Li, C., Zhang, M., & Zheng, M. (2025) · Expert Systems with Applications · doi:10.1016/j.eswa.2025.128544 · Cited by 4
IRepair: An Intent-Aware Approach to Repair Data-Driven Errors in Large Language Models
Imtiaz, S. M., Singh, A., Batole, F., & Rajan, H. (2025) · Proceedings of the ACM on software engineering. · doi:10.1145/3715775 · Cited by 5
ALM: A Two-Stage Traffic Anomaly Detection and Analysis System via the Large Language Model
Wu, S., Dong, E., He, H., Wang, Z., Han, D., Hu, H., & Yang, J. (2025) · IEEE/IFIP Network Operations and Management Symposium (NOMS) · doi:10.1109/noms57970.2025.11073622 · Cited by 3
Preference-Optimized Retrieval and Ranking for Efficient Multimodal Recommendation
Yue, Z., Zeng, H., Wang, Y., McAuley, J., & Wang, D. (2025) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3711896.3737088 · Cited by 8
Saadany, H., Orǎsan, C., Breslin, C., Barczentewicz, M., & Walker, S. (2025) · Applied Sciences · doi:10.3390/app15169205 · Cited by 4
IntentBreaker: Intent-Adaptive Jailbreak Attack on Large Language Models
Guo, S., Zhai, Y., Zhang, S., Zhao, L., & Wang, Z. (2025) · Lecture notes in computer science · doi:10.1007/978-3-032-06078-5_14 · Cited by 3
Governance of AI-Based Algorithms
Okolo, C. T. (2025) · Springer eBooks · doi:10.1007/978-981-95-3658-0_84 · Cited by 4
Pappas, I. O., & Vassilakopoulou, P. (2025) · Springer eBooks · doi:10.1007/978-981-95-3658-0_7 · Cited by 7
Market Generators: A Paradigm Shift in Financial Modeling
Horvath, B. N., Plenk, J., Vuletić, M., & Saqur, R. (2025) · Springer finance · doi:10.1007/978-3-031-97239-3_4 · Cited by 6
Watermarking large language models in Europe: interpreting the AI act in light of technology
Souverain, T. (2026) · Ethics and Information Technology · doi:10.1007/s10676-026-09918-w · Cited by 3
RLHF: A Comprehensive Survey for Cultural, Multimodal and Low Latency Alignment Methods
Sharma, R. S., Mehta, M., & Raina, S. T. (2026) · Lecture notes in networks and systems · doi:10.1007/978-3-032-21499-7_21 · Cited by 3
Tutorial on Large Language Model-Enhanced Reinforcement Learning for Wireless Networks
Cai, L., Fu, W., Huang, Y., Zhang, R., Liu, Y., Kang, J., Xiong, Z., Jiang, T., Wang, X., Mao, S., et al. (2026) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2026.3712862 · Cited by 4
When AI Gives Advice: Evaluating AI and Human Responses to Online Advice-Seeking for Well-Being
Kumar, H., Chahal, J., Zhao, Y., Zhang, Z., Wei, A. Z., Tay, L., & Anderson, A. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3791233 · Cited by 5
Zhu, Z., Qiu, X., Li, C., Zhou, D., Ma, Y., Jiang, W., Ji, C., & Wang, W. (2025) · Journal of Power Sources · doi:10.1016/j.jpowsour.2025.238512 · Cited by 3
BLM 1 : A Boundless Large Model for Cross-Space, Cross-Task, and Cross-Embodiment Learning
Tan, W., Wang, B., Zhi, H., Liu, C., Li, Z., Liu, J., Lin, Z., Dai, Y., Chen, Y., Yang, W., et al. (2026) · ACM International Conference on Multimedia (ACM MM) · doi:10.48550/arxiv.2510.24161 · Cited by 4
SAGE: Sequence-level Adaptive Gradient Evolution for Generative Recommendation
Xie, Y., Ren, X. K., Qi, Y., Yang, P., & Hu, Y. (2026) · ACM Conference on Recommender Systems (RecSys) · doi:10.1145/3773078.3831745 · Cited by 3
Efficient, Few-Shot Directed Evolution with Energy Rank Alignment
Ibarraran, S., Chennakesavalu, S., Hu, F., & Rotskoff, G. M. (2026) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.6c01333 · Cited by 4
ChronoLLM: customizing language models for physics-based simulation code generation
Wang, J., Negrut, A., Zhang, H., Slaton, K., Wang, S., Serban, R., Wu, J., & Negruţ, D. (2026) · Multibody System Dynamics · doi:10.1007/s11044-026-10152-x · Cited by 6
Self-citationLLM-SDaT: A knowledge-informed LLM framework for syndrome differentiation in TCM
Guan, B., Gao, S., Zheng, D., Xia, H., Wu, Z., Wu, J., & Xu, H. (2026) · Neural Networks · doi:10.1016/j.neunet.2026.108812 · Cited by 3
Self-citationLiu, T., Ye, L., & Yan, W. (2026) · Computers and Education Artificial Intelligence · doi:10.1016/j.caeai.2026.100565 · Cited by 4
Fernando, M. H., Perera, B. A. K. S., Nazar, S., & Ekanayake, B. (2026) · Sustainable Development · doi:10.1002/sd.70827 · Cited by 3
Fodeh, S. J., Ma, L., Puthiaraju, G., Talakokkul, S., Khan, A., Hagaman, A. K., Lowe, S., & Roundtree, A. K. (2026) · npj Digital Public Health · doi:10.1038/s44482-026-00039-1 · Cited by 3
Reasoning-guided structured planning and search in large language models
Shen, Y., & Shi, W. (2026) · Information Processing & Management · doi:10.1016/j.ipm.2026.104732 · Cited by 4
Generative AI and management education: a knowledge management perspective
Rai, H., Malik, N., & Varma, A. (2026) · Journal of Knowledge Management · doi:10.1108/jkm-01-2025-0102 · Cited by 3
Cohen, I.-C., Littor, N., Elyashar, A., Cohen, O., & Puzis, R. (2026) · Progress in Disaster Science · doi:10.1016/j.pdisas.2026.100571 · Cited by 3
Mohammed, A. M., McCarthy, M., Neumann, C., Bruder, G., Reiners, D., & Cruz‐Neira, C. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3791902 · Cited by 3
Wen, T. J., Walker, K., & Xiao, C. J. (2026) · Journal of Advertising Education · doi:10.1177/10980482261443245 · Cited by 3
How large-scale foundation models benefit precision livestock farming: A survey
Tian, M., Guo, H., Long, C., Zhu, J., Zhao, W., Li, H., Ruchay, A. N., Pezzuolo, A., & Li, B. (2026) · Artificial Intelligence in Agriculture · doi:10.1016/j.aiia.2026.04.013 · Cited by 9
Psychometrics and Linguistics in ChatGPT-Generated Reading Tests Compared with CET-4
Li, B., Qin, Q., Li, W., & Mao, C. (2026) · Journal of Psychoeducational Assessment · doi:10.1177/07342829261444828 · Cited by 3
Du, Y., Chen, Y., & Xue, C. (2026) · International Journal of Industrial Ergonomics · doi:10.1016/j.ergon.2026.103955 · Cited by 3
Real-Time Group Dynamics with LLM Facilitation: Evidence from a Charity Allocation Task
Parisi, A., Thain, N., Hallak, A., Tsai, V., & Qian, C. (2026) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3805689.3812253 · Cited by 3
Automated data synthesis and retrieval-augmented generation for legal large language models
Ren, W., Shen, L., Zhu, J., Li, S., Hong, Y., Wang, J., & Cao, D. (2026) · Knowledge-Based Systems · doi:10.1016/j.knosys.2026.116267 · Cited by 4
MetaBreak: Jailbreaking Online LLM Services via Special Token Manipulation
Zhu, W., Xiang, Z., Niu, W., & Guan, L. (2026) · IEEE Symposium on Security and Privacy (S&P) · doi:10.1109/sp63933.2026.00095 · Cited by 5
GenPage: Towards End-to-End Generative Homepage Construction at Netflix
Wang, L., Pan, J., & Baltrunas, L. (2026) · ACM Conference on Recommender Systems (RecSys) · doi:10.1145/3773078.3831915 · Cited by 4
Exploring Human‐LLM Collaboration for Creativity Through the Lens of Concepts
Bai, H., Cheng, P., Duan, J., Peng, K., & Song, T. (2026) · The Journal of Creative Behavior · doi:10.1002/jocb.70132 · Cited by 3
Metadata
- Authors
- Ouyang, L., Wu, J., Jiang, X., Almeida, D., Wainwright, C., Mishkin, P., Zhang, C., Agarwal, S., Slama, K., Ray, A., Schulman, J., Hilton, J., Kelton, F., Miller, L., Simens, M., Askell, A., Welinder, P., Christiano, P., Leike, J., & Lowe, R.
- Venue
- Advances in Neural Information Processing Systems 35
- Published
- 2022
- Pages
- 27730-27744
- ISSN
- 1049-5258 (ISSN-L)
- OpenAlex
- W7133211372
- Cited by
- 3,117
- References
- 0
- Citations by year
- 2026: 1421 · 2025: 544 · 2024: 852 · 2023: 297 · 2022: 3
- FWCI
- 234.27
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- neural information processing systems (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Keywords
- instruction following, language models, human feedback, reinforcement learning from human feedback, large language models
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.