Training Language Models to Follow Instructions with Human Feedback
The DOI matches its Crossref record; 2 of the 2 references it cites were found in a registry or an index.
Abstract
Making language models bigger does not inherently make them better at following a user's intent. For example, large language models can generate outputs that are untruthful, toxic, or simply not helpful to the user. In other words, these models are not aligned with their users. In this paper, we show an avenue for aligning language models with user intent on a wide range of tasks by fine-tuning with human feedback. Starting with a set of labeler-written prompts and prompts submitted through the OpenAI API, we collect a dataset of labeler demonstrations of the desired model behavior, which we use to fine-tune GPT-3 using supervised learning. We then collect a dataset of rankings of model outputs, which we use to further fine-tune this supervised model using reinforcement learning from human feedback. We call the resulting models InstructGPT. In human evaluations on our prompt distribution, outputs from the 1.3B parameter InstructGPT model are preferred to outputs from the 175B GPT-3, despite having 100x fewer parameters. Moreover, InstructGPT models show improvements in truthfulness and reductions in toxic output generation while having minimal performance regressions on public NLP datasets. Even though InstructGPT still makes simple mistakes, our results show that fine-tuning with human feedback is a promising direction for aligning language models with human intent.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Existing literature (Ouyang et al., 2022) does not fully describe the details of these models, such as the pretraining corpus, model sizes, and model biases.”
From Self-Refine: Iterative Refinement with Self-Feedback (2023) · cites this paper as Ouyang et al., 2022
Experimental — accuracy not yet measuredIn the citing paper
“Specifically, providers mitigate race and gender bias through reinforcement learning from human feedback (RLHF), adversarial stress-testing known as red teaming, and hard-coded refusals governed by the provider's own content policies [6, 43, 71].”
From All Public Voices Are Equal, But Are Some More Equal Than Others to LLMs? (2026) · cites this paper as [71]
In the citing paper
“Fine-tuning a model from human feedback at scale, using preference data from paid raters or drawn from a large and willing user base, is an especially potent technique.It has the potential not only to shape a model's responses to better reflect user norms (for better or worse), but also to filter out toxic language, improve factual accuracy, and mitigate the tendency to fabricate information.”
From Talking about Large Language Models (2024) · cites this paper as [26]
In the citing paper
“These include general competencies such as in-context learning (ICL) [13], chain-of-thought (CoT) [17] reasoning, and instruction following [25], as well as task-specialized skills like mathematical reasoning [30].”
From A Survey of Large Language Models (2026) · cites this paper as [25]
In the citing paper
“When external reward models or ground-truth answers are available, rejection sampling can also be applied to select higher-quality responses from multiple candidates [25].”
From A Survey of Large Language Models (2026) · cites this paper as [25]
41 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
The publisher hasn’t deposited this paper’s reference list.
Cited by
Items 3,701–3,800 of 4,340
The Chain of Narrative Framework: Advancing Controllable Generation of Financial Themes
Liu, S., Jia, G., Gu, D., Chen, L., & Yang, Q. (2024) · IEEE ... International Conference on Data Mining workshops · doi:10.1109/icdmw65004.2024.00022
Lies, Damned Lies, and the Orthogonality Thesis
Bennett, M. T. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-33010-9_5
Reliability and Suitability of Evaluation of Speech by LLM Using Voice Mode
Tagami, Y., Kojima, T., & Yamaguchi, S. (2025) · International Conference on Artificial Intelligence in Information and Communication (ICAIIC) · doi:10.1109/icaiic64266.2025.10920833
Recall Mechanism and Multi-Head Attention for Numerical Reasoning
Lai, L. F., Tan, T.-P., & Zeng, B. (2025) · Applied Sciences · doi:10.3390/app15073528
Enhance Implicit Sentiment Analysis through Multi-Step Prompting
Liu, Z., Wang, Y., Zhang, J., & Zhou, Z. (2024) · International Conference on Communication Technology and Information Technology (ICCTIT) · doi:10.1109/icctit64404.2024.10928432
A Deep Learning Approach for Yoruba Language Next Word Generation
Aliyu, E. O. (2024) · IEEE Nigeria International Conference on Disruptive Technologies for Sustainable Development (NIGERCON) · doi:10.1109/nigercon62786.2024.10927351
Wang, J., Luo, G., Yan, H., Huang, S., Liao, Z., Zhang, S., Wu, J., He, X., & Chen, L. (2024) · IEEE Smart World Congress (SWC) · doi:10.1109/swc62898.2024.00153 · Cited by 1
Self-citationContext-Prompt-Align: An Architecture For Few Posts Based Social Bots Detection
Yang, W., Fang, X., Xie, L., Wang, H., Zhang, R., Pan, Y., & Wu, D. (2024) · IEEE Smart World Congress (SWC) · doi:10.1109/swc62898.2024.00222
Pseudo-Utterance-Guided Contrastive Network for Emotion Forecasting in Conversations
Xie, Y., Liu, Y., Sun, C., & Li, S. (2025) · Expert Systems with Applications · doi:10.1016/j.eswa.2025.127382
Choi, S., Yun, J., Park, J., & Choo, J. (2025) · IEEE Workshop/Winter Conference on Applications of Computer Vision · doi:10.1109/wacv61041.2025.00879
Zhang, K., Song, M., Zhang, X., & Li, J. (2025) · International Conference on Computer Research and Development · doi:10.1109/iccrd64588.2025.10963197
Kang, F., Huang, X., & Li, B. (2025) · Expert Systems with Applications · doi:10.1016/j.eswa.2025.127614
On Adaptive Verification of Quantum States
Agrawal, R., Rao, S. V. S. N., & Shivshankar (2024) · Artificial Intelligence Revolutions (AIR) · doi:10.1109/air63653.2024.00023
From Text to Treatment: Large Language Models in Clinical Practice and Medical Research
Singh, H., Bajetha, I., Bharti, Pandey, A., Singh, S., & Singh, S. (2024) · International Conference on Progressive Innovations in Intelligent Systems and Data Science (ICPIDS) · doi:10.1109/icpids65698.2024.00069 · Cited by 1
Research on Technical Route of AI Large Models for Electric Power Knowledge Services
Peng, S., Xiao, J., Zhang, W., Zuo, Y., Liu, S., Long, Y., Huang, Z., & Wu, S. (2024) · IEEE Conference on Energy Internet and Energy System Integration (EI2) · doi:10.1109/ei264398.2024.10990616
Ren, E., Qu, C., Luo, L., Li, Y., Liu, Z., Yang, X., Wei, Q., & Qiao, F. (2025) · Design, Automation, and Test in Europe · doi:10.23919/date64628.2025.10993264
Position: Contextual Confidence and Generative AI
Jain, S., Hitzig, Z., & Mishkin, P. (2025) · IEEE Conference on Secure and Trustworthy Machine Learning (SaTML) · doi:10.1109/satml64287.2025.00022 · Cited by 1
Self-citationImitation Game for Adversarial Disillusion With Chain-of-Thought Reasoning in Generative AI
Chang, C., Chen, F.-Y., Gu, S.-H., Gao, K., Wang, H., & Echizen, I. (2025) · IEEE Access · doi:10.1109/access.2025.3574016 · Cited by 1
TSTBench: A Comprehensive Benchmark for Text Style Transfer
Xie, Y., Gui, J., Che, Z., Zhu, L., Hu, Y., & Pan, Z. (2025) · Entropy · doi:10.3390/e27060575 · Cited by 1
Towards Identifying Objectivity in Short Informal Text
Zhang, C., Zhao, C., Zhang, Z., & Huang, Y. (2025) · Entropy · doi:10.3390/e27060583
Self-citationVerifying ambiguous claims with a reasoner-translator framework
Lyu, X., Sun, M., Cao, C., Liang, B., & Xu, R. (2025) · Neurocomputing · doi:10.1016/j.neucom.2025.130536 · Cited by 2
Jiang, N., Liu, C., & Liu, X. (2025) · International Symposium on Computer Applications and Information Systems (ISCAIS) · doi:10.1109/iscait64916.2025.11010665
Perspectives on Generative Sound Design: A Generative Soundscapes Showcase
Samson, G. (2025) · Arts · doi:10.3390/arts14030067 · Cited by 1
Strengths-Leverage Chain-of-Thought: Enhancing Multimodal Reasoning with LLM and LMM
Xu, Q., & Zhang, L. (2024) · International Conference on Virtual Reality and Visualization · doi:10.1109/icvrv62410.2024.00063
NAT-CVAE: A Novel Method for Controlled Long Text Generation
Zhao, T., Quan, P., & Xiong, R. (2025) · International Seminar on Artificial Intelligence, Networking and Information Technology (AINIT) · doi:10.1109/ainit65432.2025.11035169
Monte Carlo Tree Search-Driven Photovoltaic Text Rewriting
Luo, W., Zeng, R., Liang, C., He, J., Li, W., & Fu, W. (2025) · International Seminar on Artificial Intelligence, Networking and Information Technology (AINIT) · doi:10.1109/ainit65432.2025.11036069
CoMuS-KG: A Collaborative Framework of Multimodal Unstructured Data and Knowledge Graph
Hu, S., Wang, X., Ji, X., Guo, X., Wang, L., & Shen, J. (2025) · International Conference on Computer Supported Cooperative Work in Design (CSCWD) · doi:10.1109/cscwd64889.2025.11033342
A Jailbreak Prompt Detector Based on Selective Perturbation and Contrastive Learning
Li, Y., Wang, Y., Yang, H., Liu, W., & Ning, L. (2025) · International Conference on Computer Supported Cooperative Work in Design (CSCWD) · doi:10.1109/cscwd64889.2025.11033427
Enhancing Control of Large Language Model-based AI Systems Through Declarative Memory
Omri, S., Abdelkader, M., & Hamdi, M. (2025) · International Wireless Communications and Mobile Computing Conference (IWCMC) · doi:10.1109/iwcmc65282.2025.11059638
Addressing Specific and Complex Scenarios in Semantic Parsing
Wang, Y., Fan, M. Y., & Liu, T. (2025) · IEEE/ACM International Conference on AI Foundation Models and Software Engineering (FORGE) · doi:10.1109/forge66646.2025.00030
OptCodeTrans: Boost LLMs on Low-Resource Programming Language Translation
Lin, J., Shen, Y., Li, C., Niu, C., & Luo, B. (2025) · IEEE/ACM International Conference on AI Foundation Models and Software Engineering (FORGE) · doi:10.1109/forge66646.2025.00014 · Cited by 2
SJ-ORPO: Alignment of LLMs Using Multi-Task Learning and Self-Judgment
Parashar, J., & Bhandarkar, S. M. (2025) · IEEE Conference on Artificial Intelligence (CAI) · doi:10.1109/cai64502.2025.00040
Lee, E., Do, H.-D., Kim, M., & Oh, D. (2025) · Applied Sciences · doi:10.3390/app15137561 · Cited by 1
Comparative Evaluation of Large Language Models (LLMs) for Placement-Related Prompts
Awasthi, S., Jain, B., Singh, C., Aggarwal, A., & Kohli, N. (2025) · Lecture notes in networks and systems · doi:10.1007/978-981-96-3361-6_25
Multimodal Osteoporosis Image Classification Algorithm Based on Textual Prompts
Yang, P., Chen, Y., Liang, J., & Nie, R. (2025) · Communications in computer and information science · doi:10.1007/978-981-96-9949-0_5
Aspect-Oriented Opinion Extraction with LoRA Fine-Tuning and Prompt
Yanagimoto, H., Kisaku, I., & Hashimoto, K. (2024) · IIAI International Congress on Advanced Applied Informatics (IIAI-AAI) · doi:10.1109/iiai-aai-winter65925.2024.00021
Yang, D., Feng, C., & Li, X. (2025) · International Conference on Computer and Communication Systems (ICCCS) · doi:10.1109/icccs65393.2025.11069633
Evaluating GPT-4o as a Cyberattack Simulator: Perspectives on AI and Human Decision-Making
Thakur, S., Sharma, S. K., Goyal, R., Sharma, M., Uttrani, S., & Dutt, V. (2025) · IEEE Conference on Cognitive and Computational Aspects of Situation Management (CogSIMA) · doi:10.1109/cogsima64436.2025.11079523
Creative Collaborative Applications for Virtual Language Learning Experiences
Hancı-Azizoğlu, E. B., Özgel, A., Tekin, Ş., Yilmaz, E., & Kafes, H. (2025) · IGI Global eBooks · doi:10.4018/979-8-3373-0375-8.ch010
Few-shot Data Augmentation for Named Entity Recognition base on Random Sample Partition Verification
Li, J., Lin, Y., Li, M. J., Peng, P. X., & Huang, S. (2025) · International Conference on Artificial Intelligence and Big Data (ICAIBD) · doi:10.1109/icaibd64986.2025.11081965
Anh, N. D., Hiep, L. G., & Le, A.-C. (2025) · Communications in computer and information science · doi:10.1007/978-3-031-98170-8_10
Talk the Talk, Debate the Bias: LLM Alignment via Role-Play Rumble
Cheng, R., Wang, Z., Yuan, S., Ding, Y., & Zhang, R. (2025) · Lecture notes in computer science · doi:10.1007/978-981-95-0020-8_17
Personalized Emotion Prediction Using Instruction-Tuned Large Language Models
Jiang, B., Zhang, Y., Shang, W., Wang, Y., Li, Y., Yang, M., & Kang, T. (2025) · Lecture notes in computer science · doi:10.1007/978-981-95-0020-8_19 · Cited by 1
MAF-CPR: LLM-Based Multi-agent Framework for Complex Pull Request Review in GitHub
Han, F., Peng, J., Wang, W., & Xia, X. (2025) · Lecture notes in computer science · doi:10.1007/978-981-95-0020-8_21
Do Not Say It Directly: Generating Indirect Expressions with Large Language Models
Yu, P., Mei, T., Yang, D., & Liang, J. (2025) · Lecture notes in computer science · doi:10.1007/978-981-95-0020-8_38
FlexKG: A Flexible Framework for Enhanced Reasoning Over Knowledge Graph with Large Language Model
Fu, J., Dong, Z., Wang, Y., Zha, Y., Peng, J., Yin, J., Zhou, X., & Wang, X. (2025) · Lecture notes in computer science · doi:10.1007/978-981-95-0014-7_41
Wassista, D., & Jain, A. (2025) · International Conference on Intelligent Communication Technologies and Virtual Mobile Networks (ICICV) · doi:10.1109/icicv64824.2025.11085882
FoodGPT: Reinforcement Post-Training of Large Language Models in the Food Delivery Domain
Wang, J., Dong, Z., Bai, B., Jiang, G., Yuan, A., & Cao, G. (2025) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3711896.3737222
Text-Oriented Event Extraction Combining Spectrogram
Xing, L., Wang, Z., & Li, P. (2025) · Lecture notes in computer science · doi:10.1007/978-981-96-9884-4_23
Equiangular Aligned Dual Prompt Learning for Open-Set Recognition
Li, Q., Zhang, E., Liang, D., & Geng, C. (2025) · Lecture notes in computer science · doi:10.1007/978-981-96-9884-4_12
Primero-Huerta, C., Vázquez-Reyes, S.-F., Loeza-Mejía, C.-I., & Sánchez-DelaCruz, E. (2024) · International Conference on Software Process Improvement (CIMPS) · doi:10.1109/cimps65195.2024.11095848
Citation Recognition in Large-Scale Legal Platforms Using Transformer Models
Eggmann, M., Fitz, J., Glasl, D., & Purandare, M. (2025) · IEEE Swiss Conference on Data Science (SDS) · doi:10.1109/sds66131.2025.00017
The Artificial Intelligence Revolution and The Moroccan Stock Market's Efficiency: GPT3 Versus GPT4
Oummou, Y. A., & Omerani, D. (2025) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-5499-6.ch010
LoDriver: A Region-Localized Autonomous Driver Using Large Language Models
Taourarti, I., Choudhary, A., Prajapati, M., Ramaswamy, A., Ibañez‐Guzmán, J., Monsuez, B., & Tapus, A. (2025) · IEEE Intelligent Vehicles Symposium · doi:10.1109/iv64158.2025.11097566
Information Retrieval Using Large Language Model for Various Alloys
Garg, Y., Jaiswal, A., Singh, D., & Rajendran, R. (2025) · Lecture notes in networks and systems · doi:10.1007/978-981-96-4170-3_30
Getting LLM to think and act like a human being: logical path reasoning and replanning
Zhang, L., Li, Q., Wang, Y., & Zhao, J. (2025) · International Conference on Computing and Artificial Intelligence (ICCAI) · doi:10.1109/iccai66501.2025.00054 · Cited by 2
Mukisa, R., & Matovu, R. (2025) · Lecture notes in networks and systems · doi:10.1007/978-3-031-92611-2_3
Yu, B., Song, J., Cong, L., Cong, X., Dijkstra, J., Yu, P. S., & Chen, H. (2025) · Neural Networks · doi:10.1016/j.neunet.2025.107993
Kalyan Chakravarthy, K. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5393117
Research and Analysis on Text Interaction Methods Based on Large Language Models
Yu, S.-S. (2025) · Transactions on Computer Science and Intelligent Systems Research · doi:10.62051/rs49my32
Evaluating Human-Like Qualities in Language Models
Liu, R. (2025) · Transactions on Computer Science and Intelligent Systems Research · doi:10.62051/yygprz73
Park, S. H., Shin, S., Ko, N., Kim, T. Y., & Lee, D. (2025) · Computers & Electrical Engineering · doi:10.1016/j.compeleceng.2025.110634
Can’t Say Cant? Measuring and Reasoning of Dark Jargons in Large Language Models
Ji, X., Zhang, J., Zhou, Z., Zhao, Z., Qiao, Q., Han, K., Hossen, M. I., & Hei, X. (2025) · Lecture notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering · doi:10.1007/978-3-031-94458-1_7
A Domain-Adaptive Parameter-Efficient Fine-Tuning Method for Multi-task Learning
Liu, W., Fu, M., Cheng, S., Zhang, X., & Qu, H. (2025) · Lecture notes in networks and systems · doi:10.1007/978-3-031-94892-3_54
ICDAR 2025 Competition on Understanding Chinese College Entrance Exam Papers
Yu, W., Zong, T., Zhang, H., Yang, L. F., He, Y., Wu, G., Xu, R., Yan, Q., & Gao, L. (2025) · Lecture notes in computer science · doi:10.1007/978-3-032-04630-7_30
TableCall: Boosting Table Question Answering with Tool-Driven Training-Free LLMs
Xu, C.-B., Chen, Y., Li, X.-H., Yin, F., & Liu, C. (2025) · Lecture notes in computer science · doi:10.1007/978-3-032-04630-7_8
PPTSP: patch presence test via semantic normalization and key path extraction
Xu, C., Luo, S., Duan, X., & Pan, L. (2026) · Software Quality Journal · doi:10.1007/s11219-026-09760-9
Zhang, Z., Gan, D., Wen, Z., & Liang, D. (2025) · Lecture notes in computer science · doi:10.1007/978-3-032-06004-4_25
Leveraging RLHF and PEFT to Fine-Tune FLAN-T5 for Generating Non-toxic/Positive Summaries
Ahlawat, R., Singh, M., Tiwari, S., & Jindal, S. (2025) · Lecture notes in networks and systems · doi:10.1007/978-981-96-6883-0_35
Exploring the Capabilities and Limitations of ChatGPT in Academic Research
Barakat, S., & Yaghi, K. (2025) · Advances in Science, Technology & Innovation/Advances in science, technology & innovation · doi:10.1007/978-3-031-84889-6_28
Large language model developments
Sharkey, E. J., Treleaven, P. C., & Craciun, S. (2026) · Royal Society Open Science · doi:10.1098/rsos.252099
Chen, J., & Dou, J. (2026) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn69854.2026.11729397
Zhu, X., Du, J., Huang, L., & Chen, L. (2026) · Neurocomputing · doi:10.1016/j.neucom.2026.133945 · Cited by 1
Fodor, J., Murawski, C., & Suzuki, S. (2026) · eLife · doi:10.7554/elife.108442 · Cited by 1
Methods and Mechanics for Robot Navigation in Different Environments
Sherwin, C., Singh, C., & Kumar, P. (2025) · Wiley eBooks · doi:10.1002/9781394385027.ch2
Conversational Text-to-SQL: A Comprehensive Survey of Paradigms, Challenges, and Future Directions
Yang, Y., Peng, Z., Zhou, F., Xu, Y., & Zhang, Y. (2025) · Communications in computer and information science · doi:10.1007/978-3-032-08049-3_1 · Cited by 1
de Souza, M. D., Santos, F., Nováis, P., & Zanchettin, C. (2025) · Lecture notes in computer science · doi:10.1007/978-3-032-08462-0_5
Holst, C., Wiegräbe, F., Redecker, C., & Lohweg, V. (2025) · Springer eBooks · doi:10.1007/978-3-658-48573-3_11 · Cited by 2
Crash root-cause identification via trace-rewarded causation chain reasoning large language model.
Xie, N., Huang, J., Zhou, X., & Yu, R. (2026) · Accident Analysis and Prevention · doi:10.1016/j.aap.2026.108586
Visual Interestingness Decoded: How GPT-4O Mirrors Human Interests
Abdullahu, F., & Gräbner, H. (2025) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.01424
Towards explainable language reasoning via multi-modal knowledge graphs
Lu, C., Luo, J., Yu, K., Chen, T., Wang, X., Qian, F., & xi, C. (2026) · Scientific Reports · doi:10.1038/s41598-026-51127-4
A Survey of Textual Adversarial Attacks and Defenses on Large Language Models (LLMs)
Song, S. (2025) · Science and Technology of Engineering Chemistry and Environmental Protection · doi:10.61173/m8d1p054
Testing Obedience and Control in AGI: Exploring Irrational Commands and the AI Control Problem
Yampolskiy, R. V., & Field, S. (2025) · Springer eBooks · doi:10.1007/978-981-95-3658-0_69
Investigating Zero-Shot Diagnostic Pathology in Vision-Language Models with Efficient Prompt Design
Sharma, V., Alagha, A., Khellaf, A., Trinh, V. Q., & Hosseini, M. S. (2025) · Communications in computer and information science · doi:10.1007/978-3-032-04339-9_17 · Cited by 1
Kanwal, P., Gupta, A., Jujjavarapu, S. M., & Honnavalli, P. B. (2025) · Communications in computer and information science · doi:10.1007/978-3-032-04339-9_5
Wang, Y., & Huang, H. (2025) · Lecture notes in computer science · doi:10.1007/978-981-95-2725-0_14 · Cited by 1
UMAD: Enhancing LLM Debiasing via Multi-agent Debate and Token-Level Bias Interpretation
Gu, H., Ma, J., Ying, Q., & Hu, L. (2025) · Lecture notes in computer science · doi:10.1007/978-981-95-2725-0_9
Wei, Z., Zhang, Q., Li, F., & Wang, K. (2025) · Knowledge-Based Systems · doi:10.1016/j.knosys.2025.114805
Do math-reasoning LLMs help predict the impact of public transit events?
Fang, B., Zha, R., & Di, X. (2026) · Transportation Research Part C Emerging Technologies · doi:10.1016/j.trc.2026.105802
Early study of self-perturbation learning (SPL) method for mathematical reasoning verification
Akbar, H., Farouq, M. H. A., Desandros, A., Isnan, M., & Pardamean, B. (2025) · Procedia Computer Science · doi:10.1016/j.procs.2025.08.287
Learning to Fuse Retrieval Signals: A Lightweight Meta Relevance Classifier for RAG Pipelines
Yildiz, E., & Bozkır, A. S. (2025) · Procedia Computer Science · doi:10.1016/j.procs.2025.09.085
Task-Driven Fine-Grained Authorization via Explainable LLM Reasoning
Li, M., Xi, G., Gao, N., & Zhai, L. (2025) · Communications in computer and information science · doi:10.1007/978-981-95-4088-4_38
Multi-head Low-Rank Adaptation for Parameter-Efficient Fine-Tuning
Deng, X., Xu, J., & Li, P. (2025) · Communications in computer and information science · doi:10.1007/978-981-95-4091-4_29
INSIGHT-RAG: Internal State Signals-Heightened Trustworthy Retrieval-Augmented Generation
Chen, Y., Gu, B., Qu, Y., Chen, Y., Cui, L., & Gao, L. (2025) · Communications in computer and information science · doi:10.1007/978-981-95-4091-4_4 · Cited by 1
Uncertainty-Aware Policy Search via Free Energy Optimization
Hosino, T. (2025) · Communications in computer and information science · doi:10.1007/978-981-95-4094-5_8
Reward Calibration for Continual Reinforcement Learning from Human Feedback
Lang, J., Zhao, J., Li, L., & Zeng, D. D. (2025) · Communications in computer and information science · doi:10.1007/978-981-95-4094-5_14
Einschub – wie ticken LLMs eigentlich?
Pfattheicher, T., Rug, T., & Böhmer, F. (2025) · Springer eBooks · doi:10.1007/978-3-658-50100-6_4
D-PathVer: Dynamic Reasoning Pathways for Complex Claim Verification
Zheng, L., Luo, Z., Hu, W., & Cao, Y. (2025) · Lecture notes in computer science · doi:10.1007/978-981-95-3349-7_44
Simplify and Translate: A Unified Framework for Accessible Machine Translation
Li, X., & Qiang, J. (2025) · Lecture notes in computer science · doi:10.1007/978-981-95-3349-7_22
Knowledge Graph-Enhanced Large Language Model Approach for Device Fault Diagnosis Question Answering
Tu, Y., Sun, B., Wei, Z., & Song, X. (2025) · Communications in computer and information science · doi:10.1007/978-981-95-4472-1_26
Metadata
- Authors
- Ouyang, L., Wu, J., Jiang, X., Almeida, D., Wainwright, C., Mishkin, P., Zhang, C., Agarwal, S., Slama, K., Ray, A., Schulman, J., Hilton, J., Kelton, F., Miller, L., Simens, M., Askell, A., Welinder, P., Christiano, P., Leike, J., & Lowe, R.
- Venue
- Advances in Neural Information Processing Systems 35
- Published
- 2022
- Pages
- 27730-27744
- ISSN
- 1049-5258 (ISSN-L)
- OpenAlex
- W7133211372
- Cited by
- 3,117
- References
- 0
- Citations by year
- 2026: 1421 · 2025: 544 · 2024: 852 · 2023: 297 · 2022: 3
- FWCI
- 234.27
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- neural information processing systems (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Keywords
- instruction following, language models, human feedback, reinforcement learning from human feedback, large language models
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.