Training Language Models to Follow Instructions with Human Feedback
The DOI matches its Crossref record; 2 of the 2 references it cites were found in a registry or an index.
Abstract
Making language models bigger does not inherently make them better at following a user's intent. For example, large language models can generate outputs that are untruthful, toxic, or simply not helpful to the user. In other words, these models are not aligned with their users. In this paper, we show an avenue for aligning language models with user intent on a wide range of tasks by fine-tuning with human feedback. Starting with a set of labeler-written prompts and prompts submitted through the OpenAI API, we collect a dataset of labeler demonstrations of the desired model behavior, which we use to fine-tune GPT-3 using supervised learning. We then collect a dataset of rankings of model outputs, which we use to further fine-tune this supervised model using reinforcement learning from human feedback. We call the resulting models InstructGPT. In human evaluations on our prompt distribution, outputs from the 1.3B parameter InstructGPT model are preferred to outputs from the 175B GPT-3, despite having 100x fewer parameters. Moreover, InstructGPT models show improvements in truthfulness and reductions in toxic output generation while having minimal performance regressions on public NLP datasets. Even though InstructGPT still makes simple mistakes, our results show that fine-tuning with human feedback is a promising direction for aligning language models with human intent.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Existing literature (Ouyang et al., 2022) does not fully describe the details of these models, such as the pretraining corpus, model sizes, and model biases.”
From Self-Refine: Iterative Refinement with Self-Feedback (2023) · cites this paper as Ouyang et al., 2022
Experimental — accuracy not yet measuredIn the citing paper
“Specifically, providers mitigate race and gender bias through reinforcement learning from human feedback (RLHF), adversarial stress-testing known as red teaming, and hard-coded refusals governed by the provider's own content policies [6, 43, 71].”
From All Public Voices Are Equal, But Are Some More Equal Than Others to LLMs? (2026) · cites this paper as [71]
In the citing paper
“Fine-tuning a model from human feedback at scale, using preference data from paid raters or drawn from a large and willing user base, is an especially potent technique.It has the potential not only to shape a model's responses to better reflect user norms (for better or worse), but also to filter out toxic language, improve factual accuracy, and mitigate the tendency to fabricate information.”
From Talking about Large Language Models (2024) · cites this paper as [26]
In the citing paper
“These include general competencies such as in-context learning (ICL) [13], chain-of-thought (CoT) [17] reasoning, and instruction following [25], as well as task-specialized skills like mathematical reasoning [30].”
From A Survey of Large Language Models (2026) · cites this paper as [25]
In the citing paper
“When external reward models or ground-truth answers are available, rejection sampling can also be applied to select higher-quality responses from multiple candidates [25].”
From A Survey of Large Language Models (2026) · cites this paper as [25]
41 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
The publisher hasn’t deposited this paper’s reference list.
Cited by
Items 2,801–2,900 of 4,340
Liu, Y., Pan, Y., Zhen, W., & Duan, J. (2026) · Communications in computer and information science · doi:10.1007/978-981-95-7299-1_25
Enhancing Emotion Classification with Interpretability Using LoRA-Finetuned LLaMA-3.2-3B
Pramanik, S., Bhattacharjee, S., Fouzder, T., Azad, A. A., & Chawdhury, A. (2025) · IEEE International Women in Engineering (WIE) Conference on Electrical and Computer Engineering (WIECON-ECE) · doi:10.1109/wiecon-ece69386.2025.11526645
LLM-Enabled Participatory Platforms for People-Centric Smart Cities
Domingues, M., Neto, M., Silva, A., Dias, T., Rosa, L., Tomas, P. R., Guerra, C., Martins, V., & Cordeiro, L. (2026) · International World Wide Web Conference (WWW) · doi:10.1145/3774905.3795855
Yang, H., Guo, J., Wang, Y., & Zhang, X. (2026) · Journal of Cloud Computing Advances Systems and Applications · doi:10.1186/s13677-026-00921-6
HUMAN-AI INTERACTION IN MULTILINGUAL PROFESSIONAL
Matukh, K., Liashenko, K., Liashenko, L., & Буданова, Л. (2026) · Studia Linguistica · doi:10.17721/studling2026.28.68-82
Evaluating AI Assistance in Human-in-the-Loop Scenographic Prop Authoring
Vallasciani, G., Cascarano, P., Meglioraldi, J., Giunchi, D., Bovo, R., & Marfia, G. (2026) · International Conference on Advanced Visual Interfaces (AVI) · doi:10.1145/3811427.3811432
Balancing happiness and efficiency in POI recommendation via Kahneman–Tversky optimization
Ushio, T., & Hara, Y. (2026) · Urban Informatics · doi:10.1007/s44212-025-00101-y
Zhu, J., Fan, Y., Han, G., Shi, X., Deng, F., & Chen, J. (2026) · Artificial Intelligence Review · doi:10.1007/s10462-026-11591-w · Cited by 1
A Framework for the Systematic Optimization of Brand Recommendation Rates in Large Language Models
Aarabi, P., Qin, Y., & Garmash, A. (2026) · IEEE Conference on Artificial Intelligence (CAI) · doi:10.1109/cai68641.2026.11536471
The Evolution of Kubernetes Architecture for General-Purpose AI Systems (GPAIS)
Ojea, A. (2026) · IEEE Conference on Artificial Intelligence (CAI) · doi:10.1109/cai68641.2026.11536420
Domínguez, A. R. (2026) · IEEE Conference on Artificial Intelligence (CAI) · doi:10.1109/cai68641.2026.11536549
Yurosko, R., Hevner, A. R., Jank, W., & Zantedeschi, D. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-28316-0_11
Evaluating Persona Consistency and Emotion Understanding in Small Language Models
Mina, J., Zangari, L., Alahi, A., Picca, D., & Bagnato, L. (2026) · ACM Conference on User Modeling, Adaptation and Personalization (UMAP) · doi:10.1145/3774935.3806173
Aljedaani, W., Alsulaymi, R., Alqahtani, G., & Feng, Y. (2026) · International Web for All Conference (W4A) · doi:10.1145/3800424.3800454
Robust human pose generation via uncertainty aware structural reward modeling
Zhang, D.-L., Dai, S.-Y., Xu, B.-X., Liu, H.-Z., Pan, W.-G., & Xu, C. (2026) · Discover Artificial Intelligence · doi:10.1007/s44163-026-01487-7
Optimizing Trust and Safety Regions for Text-to-Image Generation in High-Dimensional Manifold Spaces
Yang, X., Li, X., Wang, Y., & Liu, N. (2026) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2026.3699945 · Cited by 1
Prompt Optimization Using Instruction-Tuned Small Language Models for Cost-Efficient LLM Deployment
Chirasani, L. R., Mannava, S. T., Thota, A., & Mishra, S. K. (2026) · International Conference on Emerging Trends in Advancements and Applications of Computational Intelligence Techniques (ETAACT) · doi:10.1109/etaact69135.2026.11541836
A Comprehensive Analysis of Hallucinations in Large Language Models
Dakkak, N. A., Alkhazindar, M., & Bayrak, A. T. (2026) · International Congress on Human-Computer Interaction, Optimization and Robotic Applications (ICHORA) · doi:10.1109/ichora69329.2026.11537214
Information Access Strategies in Large Language Models: Base Model, Fine-Tuning, and RAG Analysis
Tural, B., Örpek, Z., Destan, Z., & Alp, E. (2026) · International Congress on Human-Computer Interaction, Optimization and Robotic Applications (ICHORA) · doi:10.1109/ichora69329.2026.11537225
Ni, L., & Xu, X. (2026) · International Conference on Intelligent Computing and Signal Processing (ICSP) · doi:10.1109/icsp69961.2026.11540917
Tri, L. T. M. (2026) · European Modern Studies Journal · doi:10.59573/emsj.10(2).2026.26
Feasibility of Zero-Shot Language Models on Answer Selection Task
Chuy, C. N., Ding, C., & Hu, Q. (2026) · ACM Symposium on Applied Computing · doi:10.1145/3748522.3780028
LOKI: Alias-based Semantic Jailbreak Strategy for Large Language Models
Suh, H., Ryu, N., Gwon, S., Lee, J., & Lee, S. (2026) · ACM Symposium on Applied Computing · doi:10.1145/3748522.3779852
Lin, B., Mao, S., Wang, P., Zhang, L., & Haosu, Z. (2026) · International Conference on Information Science, Electrical and Automation Engineering (ISEAE) · doi:10.1109/iseae69422.2026.11544810
(131810), L. Z., Zhang, Z., Rong, H., Liu, Y., Yan, Z., Li, Y., & Chen, H. (2026) · Communications in computer and information science · doi:10.1007/978-981-95-8318-8_28
Provable Long-Range Benefits of Next-Token Prediction
Cao, X., & Vempala, S. (2026) · ACM Symposium on Theory of Computing (STOC) · doi:10.1145/3798129.3800914
Krasitskii, M., Gelbukh, A. F., Kolesnikova, O., & Sidorov, G. (2026) · Communications in computer and information science · doi:10.1007/978-3-032-37441-7_3
Sun, X. (2026) · Integrated Journal for Research in Arts and Humanities · doi:10.55544/ijrah.6.3.33
Alam, U. I., Pramanik, S., & Haque, M. A. (2026) · IEEE International Conference on Quantum Photonics, Artificial Intelligence & Networking (QPAIN) · doi:10.1109/qpain69676.2026.11545756
Understanding and Supporting Online Discussion with Opinionated Chatbots
Song, T., Yang, C.-L., Liu, Z., Xu, Z., Feng, Y., & Lee, Y.-C. (2026) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3817024
Evaluating teacher-supervised small medical language models for institution-constrained clinical QA
Du, G., Dimitriadis, D., & Li, X. (2026) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2026.105095
Unifying Data, Memory, and Compute Efficiency in LLM Training: A Survey
Schmidt, V., Nguyen, H. H., Jung, C., Salehi, S., & Schmeink, A. (2026) · IEEE Transactions on Artificial Intelligence · doi:10.1109/tai.2026.3702625
A Controlled Study of Decoding-Time Truthfulness Methods on Instruction-Tuned LLMs
Sun, A. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-38410-2_15
Model-Specific Echo Chamber Formation Patterns in Repeated LLM Agent Networks
Jo, S., Kim, J., Lee, S., & Seok, H. (2026) · doi:10.1145/3816713.3816738
Zhang, Z., Liu, P., Shen, H., Zhao, T., Liu, Z., & Yin, J. (2026) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2026.3703992
OpenSGG-VL: Open-Vocabulary 3DSGG with Orthogonal Residual Fusion and Iterative Relation Refinement
Zhang, B., Zhou, F., Xiao, L., Su, Z., & Li, W. (2026) · International Conference on Multimedia Retrieval · doi:10.1145/3805622.3810857
OpenImplicit: Benchmarking Implicit Reasoning in MLLMs via Open-Ended Evaluation
Li, J., Yin, X., Guo, Y., Zhou, S., Tu, Y., Zhao, H., Duan, S., Liu, G., & Zhu, H. (2026) · International Conference on Multimedia Retrieval · doi:10.1145/3805622.3810855
Li, Z., Xue, Y., & Qiao, Y. (2026) · International Seminar on Artificial Intelligence, Networking and Information Technology (AINIT) · doi:10.1109/ainit70033.2026.11557612
An, J., Chen, H., Zhao, J., Tang, Q., Gui, X., He, X., & Ai, J. (2026) · IEEE Transactions on Reliability · doi:10.1109/tr.2026.3704165
Liu, Q., Ding, Y., Liu, H., Xu, Z. Y., & Zou, Y. (2026) · Scientific Reports · doi:10.1038/s41598-026-56518-1
LLM and Mobile App-based Intelligent Campus Navigation System
Kim, H.-S., Jang, M.-G., Hong, S.-Y., Han, S. W., Kim, H.-M., & Lee, D. (2026) · The Journal of Korean Institute of Information Technology · doi:10.14801/jkiit.2026.24.5.189
Hwang, S., Shim, M., Gong, Y., Kim, D., & Lee, K.-H. (2026) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2026.3703303
Recent Advances and Challenges in Natural Language Processing
Kalra, A., & Patil, L. N. (2026) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-3361-8.ch001
Vietnamese Legal News Classification: A Comparative Study of Transformer-Based Models
Nguyen, Q. (2026) · International Journal of Asian Language Processing · doi:10.1142/s2717554526500074
Investigating the Washback Effect on Generative AI Strategies: Insights from Engineering Students
Jensen, T. P. M., Bækgaard, P., Rattleff, P., & Khalid, M. S. (2026) · International Conference on Information and Education Technology (ICIET) · doi:10.1109/iciet69664.2026.11561584
Nguyen, T., Dang, T., Nguyen, D., & Vo, C. (2026) · International Conference on Information and Education Technology (ICIET) · doi:10.1109/iciet69664.2026.11561634
Harrag, F., Mecheddal, H., Ayat, N., Deriche, M., & Shaalan, K. F. (2026) · International Multi-Conference on Systems, Signals & Devices (SSD) · doi:10.1109/ssd69655.2026.11558974
Artificial intelligence: A catalyst for the modernization of traditional Chinese medicine
董介正, Li, S., Chen, S., & Qiu, L. (2026) · Intelligence-Based Medicine · doi:10.1016/j.ibmed.2026.100415
Enhancing Control in Chemical Processes using Reinforcement from Human Feedback
Gerold, H., Brandner, D. M., & Lucia, S. (2026) · Systems and Control Transactions · doi:10.69997/sct.156501
Policy Optimization for Reinforcement Learning in Continuous Time and Space
Zhao, H., Tang, W., & Yao, D. D. (2026) · Applied Mathematics & Optimization · doi:10.1007/s00245-026-10459-3
Benito, G. V., Descalzo, M., Pujadas, S., Fernández, J., Calandrelli, M., & Petrone, P. (2026) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2026.111806
Aggarwal, A. (2026) · International Conference on Integrated Intelligence and Cognitive Engineering (ICIICE) · doi:10.1109/iciice69672.2026.11565374
Adaptive air traffic management via large language model augmented reinforcement learning
Chen, S., Tabrizian, A., Wei, P., Wang, Y., & Qu, X. (2026) · Transportation Research Part E Logistics and Transportation Review · doi:10.1016/j.tre.2026.105027
From formal to informal: how register shift confuses LLMs in Spanish dialect recognition
Zander-Marzano, S. A., Hernández‐Orallo, J., Martínez‐Plumed, F., Amores-Giner, P., & Mehrbakhsh, B. (2026) · International Journal of Data Science and Analytics · doi:10.1007/s41060-026-01177-8
Select-to-Act: Hierarchical Reinforcement Learning via Adaptive Language Guidance
Zhang, H., Koziak, A., & Guo, Y. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37664-0_9
Zhang, Z. X., & Feng, Q. (2026) · Plants · doi:10.3390/plants15131932
Malloy, T., Wax, J., Bissyandé, T. F., & Klein, J. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6985745
Architecture-Divergent Safety: How GPT-2 and Pythia Implement Refusal Differently
Uikey, J., Gole, O., Mhaske, C. R., Patil, S., Bhoite, S., & Mirajkar, R. (2026) · International Conference on Intelligent Systems and Computational Networks (ICISCN) · doi:10.1109/iciscn67954.2026.11566105
Pluralistic-Alignment Urbanism: Operationalizing a Right to AI for Inclusive Public Space
Mushkani, R. A. (2026) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3805689.3812244
AlDahoul, N., Karim, H. B. A., & Tan, M. J. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6900538
Resource-Efficient Multilingual RAG: English-Only and Multilingual Embeddings for Indian Languages
Bilvitha, D., Isravel, D. P., & Dhas, J. P. M. (2026) · International Conference on Inventive Research in Computing Applications (ICIRCA) · doi:10.1109/icirca69024.2026.11570391
Zhang, J., Xu, B., Liu, Y., Wenqi, C. A. I., Wu, L., Qi, S., Peng, Y., Yu, J., Long, T., & Ge, B. (2026) · Acta Psychologica · doi:10.1016/j.actpsy.2026.107268
Gupta, A., Patil, N., Ghosh, S., & Gaikwad, S. S. (2026) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3805689.3812394
Efficiency-Aware Group Size Optimization for GRPO via Multi-Fidelity Bayesian Optimization
Kim, T., & Lee, K.-T. (2026) · AI · doi:10.3390/ai7070234
Bai, J., Su, Y., & Xu, K. (2026) · Springer eBooks · doi:10.1007/978-981-95-0836-5_15
Du, L., Zhong, R., 朱鎭晩, Dong, S., & ShuYuan, S. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-29755-6_42
Lee, S., & Lee, D.-G. (2026) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2026.115378
Samal, J. (2025) · International Journal of Health & Allied Sciences · doi:10.4103/ijhas.ijhas_64_25
ExpressMind: A Multimodal Pretrained Large Language Model for Expressway OperationPreprint
Wang, Z., Wang, Y., Yu, H., He, Q., Cui, Z., Liao, X., Wang, C., Tian, Y., & Tong, Y. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6993253
A Three-Stage LLM-Guided Data Augmentation Framework for Power Grid Anomaly Detection
Zhou, X., Huang, Y., Lin, X., Fu, X., Zhu, J.-H., Tian, Y.-N., & Chen, W. (2026) · International Conference on Artificial Intelligence and Industrial Technology Applications (AIITA) · doi:10.1109/aiita69518.2026.11567341
TDMoE: Tail-probability-based Dynamic-k MoE
Chen, Y., & Zhang, Z. D. (2026) · International Symposium on Autonomous Systems (ISAS) · doi:10.1109/icaisisas68969.2026.11567792
Adaptive orthogonal role‐aware transformer for robust instruction alignment
Yoon, Y. C., Kim, S., & Kim, G. (2026) · ETRI Journal · doi:10.4218/etrij.2025-0449
Calibration-aware gating for budgeted LLM supervision in graph neural network link prediction
Arshad, M. W., Lodi, S., Liu, D. Q., Adeel, U., & hassan, S. R. (2026) · Discover Computing · doi:10.1007/s10791-026-10214-w
Xu, Z., Sheng, Z., Chen, S., & Chen, T. (2026) · Transportation Research Part C Emerging Technologies · doi:10.1016/j.trc.2026.105819
Wang, F., Guo, L. P., & Zhang, Y. R. (2026) · Education and Information Technologies · doi:10.1007/s10639-026-14060-7
QQJ: Quantifying Qualitative Judgment for Scalable and Human-Aligned Evaluation of Generative AI
Veysi, M., Shamsinejadbabaki, P., Zare, M., & Sabouri, M. (2026) · International Biennial Conference on Advances in Artificial Intelligence and Data Science (IBAAIDS) · doi:10.1109/ibaaids66771.2026.11567442
HeRoN: a mediated RL-LLM framework for adaptive NPC behavior in interactive environments
Cimino, G., Deufemia, V., & Selice, A. (2026) · Neural Computing and Applications · doi:10.1007/s00521-026-12275-w · Cited by 1
Xu, L. (2026) · Landscape Architecture Frontiers · doi:10.15302/j-laf-2026-0032
Chapagain, J., & Rus, V. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-29744-0_3
Prompt Optimization with Verifiable Rewards for Synthetic Essay Generation
Nam, S. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-29744-0_9 · Cited by 1
An adversarial suffix for detecting prompt-level vulnerabilities in large language models
Yu, J., Mayer, W., Zhu, L., Li, W., & Feng, Z. (2026) · Neurocomputing · doi:10.1016/j.neucom.2026.134358
Martinenghi, A., Guidotti, S., Donabauer, G., Koyutürk, C., Ortiz-Beltrán, A., Theophilou, E., Chimisso, R., Bink, M., Garzotto, F., Taibi, D., et al. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-29763-1_29 · Cited by 1
A Reasoning-Enhanced LLM-based Multi-Role Simulation Model for Vertiport Location SelectionPreprint
Cheng, M., Li, C., Liu, W., Jin, Z., & Ma, W. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7002057
Jin, L., & So, H. (2026) · Communications in computer and information science · doi:10.1007/978-3-032-29794-5_48
A Review on Systematically Enhancing the Application Capabilities of Large Language Models
Zong, J., Yuan, L., Zhang, J., Gao, X., & Hou, Z. (2026) · Lecture notes in electrical engineering · doi:10.1007/978-981-95-7668-5_45
Zheng, Y., Chen, D., & Li, Y. (2026) · Innovation in Language Learning and Teaching · doi:10.1080/17501229.2026.2687097
Liang, X., Zhang, R., Quan, X., & Guan, Q. (2026) · Applied Geography · doi:10.1016/j.apgeog.2026.104094
A Scoping Review of Sycophancy in Large Language Models: Operational and Theoretical Recognition
Zhou, K., Littlejohn, M., & Garrard, I. (2026) · Endeavors Mississippi State Undergraduate Research Journal · doi:10.55533/3071-012x.1017
Tănase, A. D., Zaharia, C., Dinu, Ş., Mureșan, C.-O., Bojoga, D. E., Cosoroabă, R.-M., & Crăciunescu, E. L. (2026) · Healthcare · doi:10.3390/healthcare14131867 · Cited by 1
Fusing semantic and structural representations for attributed community search
Hu, B., Liu, H., Zhou, Y., Li, S., Yu, Z., & Cao, T. (2026) · Information Fusion · doi:10.1016/j.inffus.2026.104575
Sakib, A. N., Chisty, M. M. O., & Zhang, Z. (2026) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3805689.3812342
Zhang, J., Wang, Y., Wang, C., & Lou, H. (2026) · International Symposium on Computer Technology and Information Science (ISCTIS) · doi:10.1109/isctis70043.2026.11572603
FASST-LLM: Implementing Service Scanning Tools Automatically with LLM
Qin, L., Luo, Y., Li, C., Wang, Z., & Yang, J. (2026) · IEEE Conference on Computer Communications (INFOCOM) · doi:10.1109/infocom59046.2026.11571366
High Agreement, Shallow Reasoning: A Mixed-Method Study of LLMs in Refactoring Reviews
Amorim, L., Fortunato, C. B., Vale, G., & Figueiredo, E. (2026) · doi:10.1145/3803846.3807463
Revisiting Multi-Level Network Modeling and Simulation With Domain-Adapted LLMs
Wu, D., Liu, J., Lin, X., Xu, D., Gao, P., & Liu, Y. (2026) · IEEE Transactions on Network Science and Engineering · doi:10.1109/tnse.2026.3708012
Recent advances in AI-based mobile robots for human companionship: survey
Abdu, A., Algabri, R., Algburi, R. N. A., Tightiz, L., Pico, N., Hawbani, A., Abdo, A., Yumbla, F., Alsamhi, S. H., Bae, J., et al. (2026) · Artificial Intelligence Review · doi:10.1007/s10462-026-11603-9
Dery, H., Piterman, D., Refoua, E., Meinlschmidt, G., Bar, K., Ben‐Zion, Z., & Elyoseph, Z. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7022814
Meshkov, A. (2026) · Journal of Electrical Systems and Information Technology · doi:10.1186/s43067-026-00374-6
Quantum Entropy–Driven Temperature Scaling for Hallucination Mitigation in Generative Models
Kulkarni, S. V., Sheethal, J., Maller, A. S., Devasia, J. V., Maju, S. V., & Deshmukh, P. C. (2026) · Lecture notes in networks and systems · doi:10.1007/978-3-032-28379-5_48
Zhang, Z., Jiang, Z., Qi, Y., Hu, Z., Zhuang, M., Li, J., & Wang, L. (2026) · Journal of Imaging Informatics in Medicine · doi:10.1007/s10278-026-02068-x
Metadata
- Authors
- Ouyang, L., Wu, J., Jiang, X., Almeida, D., Wainwright, C., Mishkin, P., Zhang, C., Agarwal, S., Slama, K., Ray, A., Schulman, J., Hilton, J., Kelton, F., Miller, L., Simens, M., Askell, A., Welinder, P., Christiano, P., Leike, J., & Lowe, R.
- Venue
- Advances in Neural Information Processing Systems 35
- Published
- 2022
- Pages
- 27730-27744
- ISSN
- 1049-5258 (ISSN-L)
- OpenAlex
- W7133211372
- Cited by
- 3,117
- References
- 0
- Citations by year
- 2026: 1421 · 2025: 544 · 2024: 852 · 2023: 297 · 2022: 3
- FWCI
- 234.27
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- neural information processing systems (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Keywords
- instruction following, language models, human feedback, reinforcement learning from human feedback, large language models
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.