Training Language Models to Follow Instructions with Human Feedback
The DOI matches its Crossref record; 2 of the 2 references it cites were found in a registry or an index.
Abstract
Making language models bigger does not inherently make them better at following a user's intent. For example, large language models can generate outputs that are untruthful, toxic, or simply not helpful to the user. In other words, these models are not aligned with their users. In this paper, we show an avenue for aligning language models with user intent on a wide range of tasks by fine-tuning with human feedback. Starting with a set of labeler-written prompts and prompts submitted through the OpenAI API, we collect a dataset of labeler demonstrations of the desired model behavior, which we use to fine-tune GPT-3 using supervised learning. We then collect a dataset of rankings of model outputs, which we use to further fine-tune this supervised model using reinforcement learning from human feedback. We call the resulting models InstructGPT. In human evaluations on our prompt distribution, outputs from the 1.3B parameter InstructGPT model are preferred to outputs from the 175B GPT-3, despite having 100x fewer parameters. Moreover, InstructGPT models show improvements in truthfulness and reductions in toxic output generation while having minimal performance regressions on public NLP datasets. Even though InstructGPT still makes simple mistakes, our results show that fine-tuning with human feedback is a promising direction for aligning language models with human intent.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Existing literature (Ouyang et al., 2022) does not fully describe the details of these models, such as the pretraining corpus, model sizes, and model biases.”
From Self-Refine: Iterative Refinement with Self-Feedback (2023) · cites this paper as Ouyang et al., 2022
Experimental — accuracy not yet measuredIn the citing paper
“Specifically, providers mitigate race and gender bias through reinforcement learning from human feedback (RLHF), adversarial stress-testing known as red teaming, and hard-coded refusals governed by the provider's own content policies [6, 43, 71].”
From All Public Voices Are Equal, But Are Some More Equal Than Others to LLMs? (2026) · cites this paper as [71]
In the citing paper
“Fine-tuning a model from human feedback at scale, using preference data from paid raters or drawn from a large and willing user base, is an especially potent technique.It has the potential not only to shape a model's responses to better reflect user norms (for better or worse), but also to filter out toxic language, improve factual accuracy, and mitigate the tendency to fabricate information.”
From Talking about Large Language Models (2024) · cites this paper as [26]
In the citing paper
“These include general competencies such as in-context learning (ICL) [13], chain-of-thought (CoT) [17] reasoning, and instruction following [25], as well as task-specialized skills like mathematical reasoning [30].”
From A Survey of Large Language Models (2026) · cites this paper as [25]
In the citing paper
“When external reward models or ground-truth answers are available, rejection sampling can also be applied to select higher-quality responses from multiple candidates [25].”
From A Survey of Large Language Models (2026) · cites this paper as [25]
41 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
The publisher hasn’t deposited this paper’s reference list.
Cited by
Items 1,901–2,000 of 4,340
Zhan, Y., Zhu, Y., Zhao, H., Yang, F., Zheng, S., Tang, M., & Wang, J. (2026) · doi:10.1109/cvprf71909.2026.00558 · Cited by 6
Fake News Detection via Sentiment Neutralization
Huang, H., Peng, H.-T., & Pao, H.-K. (2023) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata59044.2023.10386174 · Cited by 4
VL-Few: Vision Language Alignment for Multimodal Few-Shot Meta Learning
Ma, H., Fan, B., Ng, B. K., & Lam, C. (2024) · Applied Sciences · doi:10.3390/app14031169 · Cited by 4
Can only LLMs do Reasoning?: Potential of Small Language Models in Task Planning
Choi, G., Chong, H., Kim, S., & Ahn, H. (2026) · IEEE Workshop on Advanced Robotics and its Social Impacts (ARSO) · doi:10.1109/arso68304.2026.11536123 · Cited by 4
AI Chatbot for Generating Episodic Future Thinking (EFT) Cue Texts for Health
Ahmadi, S., & Fox, E. A. (2024) · IEEE International Conference on Artificial Intelligence for Medicine, Health and Care (AIMHC) · doi:10.1109/aimhc59811.2024.00027 · Cited by 4
Li, J., Hu, J., & Zhang, G. (2024) · Computers, materials & continua/Computers, materials & continua (Print) · doi:10.32604/cmc.2024.050005 · Cited by 4
Improving Low-Resource Machine Translation Using Reinforcement Learning from Human Feedback
Wang, L., & Xiao, Y. (2024) · Intelligent Automation & Soft Computing · doi:10.32604/iasc.2024.052971 · Cited by 7
Prompt-based Chinese Event Temporal Relation Extraction on LLM Predictive Information
Yang, F., Xu, S., Li, P., & Zhu, Q. (2024) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn60899.2024.10650983 · Cited by 3
Chain-of-Program Prompting with Open-Source Large Language Models for Text-to-SQL
Xu, B., Li, S., Wu, Y., Wei, S., Du, M., Wang, H., & Song, H. (2024) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn60899.2024.10650552 · Cited by 9
Alnefaie, S., Atwell, E., & Alsalka, M. A. (2024) · doi:10.1109/icnlp60986.2024.10692797 · Cited by 10
Addressing Semantic Variability in Clinical Outcome Reporting Using Large Language Models
Shah-Mohammadi, F., & Finkelstein, J. (2024) · BioMedInformatics · doi:10.3390/biomedinformatics4040116 · Cited by 4
Improving Factuality by Contrastive Decoding with Factual and Hallucination Prompts
Lv, B., Feng, A., & Xie, C. (2024) · Sensors · doi:10.3390/s24217097 · Cited by 5
Interactive Machine Teaching by Labeling Rules and Instances
Karamanolakis, G., Hsu, D., & Gravano, L. (2024) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00707 · Cited by 5
Heo, J., Lee, Y. J., Kim, J., Kwak, M. G., Park, Y. J., & Kim, S. B. (2024) · Knowledge-Based Systems · doi:10.1016/j.knosys.2024.112824 · Cited by 9
Huang, Y., Gao, T., Zhang, J.-J., Liu, X.-H., & Wang, G.-Y. (2024) · IEEE International Conference on Bioinformatics and Biomedicine · doi:10.1109/bibm62325.2024.10822725 · Cited by 4
Sentiment works in small-cap stocks: Japanese stock’s sentiment with language models
Suzuki, M., Ishikawa, Y., Teraguchi, M., & Sakaji, H. (2025) · International Journal of Information Management Data Insights · doi:10.1016/j.jjimei.2024.100318 · Cited by 6
Zero-Shot Audio Topic Reranking Using Large Language Models
Qian, M., Ma, R., Liusie, A., Loweimi, E., Knill, K., & Gales, M. (2024) · IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt61566.2024.10832363 · Cited by 7
The 2nd Futuredial Challenge: Dialog Systems With Retrieval Augmented Generation (Futuredial-RAG)
Cai, Y., Chen, S., Wu, Y., Huang, Y., Feng, J., & Ou, Z. (2024) · IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt61566.2024.10832299 · Cited by 5
CyGPT: Knowledge Graph-Based Enhancement Techniques for Large Language Models in Cybersecurity
Ou, L., Ni, X., Wu, W., & Tian, Z. (2024) · IEEE International Conference on Data Science in Cyberspace · doi:10.1109/dsc63484.2024.00036 · Cited by 4
Martin, E., Hasegawa, S., Solis, J., Macq, B. M. M., Ronsse, R., Ricardez, G. A. G., Hafi, L. E., & Taniguchi, T. (2025) · IEEE/SICE International Symposium on System Integration (SII) · doi:10.1109/sii59315.2025.10871045 · Cited by 4
A Retrieval-Augmented Generation method based on Intent Analysis and Ranking Fusion
Kong, L., Wang, G., Liu, N. K. J., Bai, T., & He, J. (2024) · International Conference on Data Science and Information Technology (DSIT) · doi:10.1109/dsit61374.2024.10881002 · Cited by 3
Wang, Y., Zhou, H., Lu, G.-F., Gao, C., & Meng, S. (2025) · Journal of Systems and Software · doi:10.1016/j.jss.2025.112387 · Cited by 3
Large Language Model (LLM-ChatGPT) and Learner Autonomy: Teaching Present Simple Tense as a Model
Jaashan, H. M. S. (2025) · Open Journal of Applied Sciences · doi:10.4236/ojapps.2025.152029 · Cited by 3
Automatic granary sweeping strategy using visual large language model
Zhang, B., Yan, J., Gao, Y., Yang, G., Zhang, K., & Li, J. (2025) · Journal of Stored Products Research · doi:10.1016/j.jspr.2025.102619 · Cited by 3
Yu, Y., Wu, Z., Han, Y., Li, Z., & Wei, W. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10887753 · Cited by 3
Pawar, D., & Phansalkar, S. (2024) · IEEE International Conference on ICT in Business Industry & Government (ICTBIG) · doi:10.1109/ictbig64922.2024.10911079 · Cited by 3
Ghimire, B., Mahmood, A., & Elleithy, K. M. (2025) · AI · doi:10.3390/ai6040066 · Cited by 3
Wee, P., & Baghdadi, R. (2024) · IEEE/ACM International Conference on Big Data Computing, Applications and Technologies (BDCAT) · doi:10.1109/bdcat63179.2024.00048 · Cited by 3
Ke, Y., Lin, H., Ruan, Y., Tang, J., & Li, L. (2025) · Mathematics · doi:10.3390/math13091538 · Cited by 8
Personalized LLM Response Generation System for Reducing Household Food Waste
Wang, Y. (2025) · IEEE Conference on Technologies for Sustainability · doi:10.1109/sustech63138.2025.11025621 · Cited by 3
Analyzing Battery Discharging Capacity using Large Language Models
Fan, Z., Li, Q., & Huang, W. (2025) · International Symposium on Autonomous Systems (ISAS) · doi:10.1109/icaisisas64483.2025.11051367 · Cited by 3
Continuous Embedding Attacks via Clipped Inputs in Jailbreaking Large Language Models
Xu, Z., Liu, Y., Deng, G., Wang, K., Li, Y., Shi, L., & Picek, S. (2025) · IEEE Security and Privacy Workshops (SPW) · doi:10.1109/spw67851.2025.00038 · Cited by 3
Trustworthy and Responsible LLM
Ogbuokiri, B. (2025) · Springer eBooks · doi:10.1007/978-981-95-3658-0_51 · Cited by 4
A Multitask Learning Aspect-Based Model for Product Defect Detection
Li, Z., Liu, G., Xiao-bo, X., & Wang, J. (2025) · IEEE Transactions on Engineering Management · doi:10.1109/tem.2025.3591548 · Cited by 3
Godwin, J., & Athuraliya, B. (2025) · International Conference on Electronics, Computers and Artificial Intelligence (ECAI) · doi:10.1109/ecai65401.2025.11095523 · Cited by 4
He, G., Zhang, M., Su, T., Ma, L., & Zhu, X. (2025) · Expert Systems with Applications · doi:10.1016/j.eswa.2025.129273 · Cited by 6
Recent advances in finetuning multimodal large language models
Wang, Z., Li, L., & Chen, L. (2025) · AI Magazine · doi:10.1002/aaai.70025 · Cited by 6
Luo, P., Zhao, Y., Zhang, B., Yang, G., Soong, B., & Yuen, C. (2026) · IEEE Wireless Communications and Networking Conference · doi:10.1109/wcnc65185.2026.11555332 · Cited by 3
Wu, Y., & Xiao, L. (2025) · Lecture notes in computer science · doi:10.1007/978-981-95-3456-2_24 · Cited by 3
Detection, Classification, and Mitigation of Gender Bias in Large Language Models
Cheng, X., Zan, H., Kong, L., Song, J., & Peng, M. (2025) · Lecture notes in computer science · doi:10.1007/978-981-95-3352-7_42 · Cited by 3
Paper Summary Attack: Jailbreaking LLMs Through LLM Safety Papers
Lin, L., Hu, S., & Tang, X. (2026) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp55912.2026.11465062 · Cited by 3
Retrieval-Augmented Decoding for Improving Truthfulness in Open-Ended Generation
Nguyen, M., Gupta, S., & Le, H. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37673-2_2 · Cited by 3
Multi-dimensional Preference Alignment by Conditioning Reward Itself
Jang, J., Kim, J.-Y., Baek, K., & Kwak, N. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37520-9_35 · Cited by 3
LaQual: An automated framework for LLM app quality evaluation
Wang, Y., Hou, X., Si, J., Zhao, Y., Lin, W., & Wang, H. (2026) · Journal of Systems and Software · doi:10.1016/j.jss.2026.112997 · Cited by 3
Patient-specific quality assurance failure prediction with deep tabular models
Levin, R., Aravkin, A. Y., & Kim, M. (2023) · Biomedical Physics & Engineering Express · doi:10.1088/2057-1976/acd255 · Cited by 3
TraceNet : Tracing and locating the key elements in sentiment analysis
Zhao, Q., Liu, J., Kang, Z., & Zhou, Z. (2023) · Knowledge-Based Systems · doi:10.1016/j.knosys.2023.110792 · Cited by 3
Sentimental Contrastive Learning for event representation
Yan, Z., & Li, X. (2023) · Natural Language Processing Journal · doi:10.1016/j.nlp.2023.100031 · Cited by 5
Is word order considered by foundation models? A comparative task-oriented analysis
Zhao, Q., Li, J., Liu, J., Kang, Z., & Zhou, Z. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.122700 · Cited by 3
Color Pattern Analogy: AI-Assisted Chinese Blue–Green Landscape Painting Restoration
Chang, R., & Wang, J. (2023) · International Conference on Information and Network Technologies (ICINT) · doi:10.1109/icint58947.2023.00008 · Cited by 3
MVP: Optimizing Multi-view Prompts for Medical Dialogue Summarization
Duan, J., Lu, F., & Liu, J. (2023) · IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm58861.2023.10385916 · Cited by 3
ChatGPT: An Artificial Intelligence-Based Approach to Enhance Medical Applications
Chaddad, A., He, C., & Jiang, Y. (2023) · IEEE International Conference on Bioinformatics and Bioengineering (BIBE) · doi:10.1109/bibe60311.2023.00078 · Cited by 3
Actively learning costly reward functions for reinforcement learning
Eberhard, A., Metni, H., Fahland, G., Stroh, A., & Friederich, P. (2024) · Machine Learning Science and Technology · doi:10.1088/2632-2153/ad33e0 · Cited by 5
Huang, S., Cao, Z., Qin, L., Gao, J., & Zhang, J. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10447820 · Cited by 3
A Birgat Model for Multi-Intent Spoken Language Understanding with Hierarchical Semantic Frames
Xu, H., Cao, R., Zhu, S., Jiang, S., Zhang, H., Chen, L., & Yu, K. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10446325 · Cited by 3
Wesling, B. N., Deng, M., Mukherjee, C., Mikolajick, T., Trommer, J., & Maneux, C. (2024) · IEEE International Conference on Microelectronic Test Structures (ICMTS) · doi:10.1109/icmts59902.2024.10520694 · Cited by 3
Kasundra, J., & Dhankhar, S. (2023) · International Conference on AI-ML Systems (AIMLSystems) · doi:10.1145/3639856.3639888 · Cited by 6
Joshi, R. K., Chatterjee, A., & Ekbal, A. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2024.124283 · Cited by 3
Chen, L., Sun, M., Liu, J., Ding, P., Ma, Y., Li, L., Qian, L., & Yang, Y. (2023) · International Conference on Computer, Big Data and Artificial Intelligence (ICCBD+AI) · doi:10.1109/iccbd-ai62252.2023.00015 · Cited by 3
Çetinkaya, Y. M., Lee, Y., Külah, E., Toroslu, İ. H., Cowan, M. A., & Davulcu, H. (2024) · IEEE Internet Computing · doi:10.1109/mic.2024.3450090 · Cited by 8
Chinese Generation and Security Index Evaluation Based on Large Language Model
Zhang, Y., Gao, Y., Li, W., Su, Z., & Yang, L. (2024) · International Conference on Asian Language Processing · doi:10.1109/ialp63756.2024.10661189 · Cited by 4
Nguyen, H. A., Nguyen, H., Chang, M. Y., Pham, H., Narayanan, S. S., & Pazzani, M. J. (2024) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw63382.2024.00517 · Cited by 8
LLM-Assisted Analytics in Semiconductor Test (Invited)
Wang, L.-C. (2024) · ACM/IEEE Workshop on Machine Learning for CAD (MLCAD) · doi:10.1109/mlcad62225.2024.10740163 · Cited by 3
Enhanced Fine-Tuning of Lightweight Domain-Specific Q&A Model Based on Large Language Models
Zhang, S., Zhu, P., Ma, M., Wang, J., Sun, Y., Li, D., Wang, J., Guo, Q., Hua, X., Zhu, L., et al. (2024) · IEEE International Symposium on Software Reliability Engineering Workshops (ISSREW) · doi:10.1109/issrew63542.2024.00048 · Cited by 7
TALKER: A Task-Activated Language Model Based Knowledge-Extension Reasoning System
Lou, J., Shi, R., Lin, Y., Wang, Q., & Wu, W. (2024) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2024.3511434 · Cited by 8
Kim, Y., Park, S. J., & Ro, Y. M. (2026) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2026.3707832 · Cited by 4
Beyond the Bar: Generative AI as a Transformative Component in Legal Document Review
Yang, E., Omrani, R., Curtin, E., Emory, T. S., Gray, L., Pickens, J., Reff, N., Traylor, C., Underwood, S., Lewis, D. D., et al. (2024) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata62323.2024.10826089 · Cited by 7
Enhancing Out-Of-Vocabulary Word Representations with Large Language Models
Kim, M., Lee, S.-J., & Choi, J. (2024) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata62323.2024.10825494 · Cited by 3
Adaptive Composite Accuracy Scoring for Domainspecific LLM Evaluation
Teh, J. S. R., Koay, E. K., Lim, S. W., Lee, K. H., Lai, M. S., Lee, M. S., & Nee, Y. K. (2024) · International Conference on Foundation and Large Language Models (FLLM) · doi:10.1109/fllm63129.2024.10852484 · Cited by 4
Coarse-to-fine text injecting for realistic image super-resolution
Chen, X., Bai, C., Wu, Z., Wu, X., Zou, Q., Xia, Y., & Wang, S. (2025) · Neurocomputing · doi:10.1016/j.neucom.2025.129591 · Cited by 4
Zhang, Z., Zhang, Z., Zhang, Y., & Zhao, W. P. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10887938 · Cited by 4
IDE: A Multi-Agent-Driven Iterative Framework for Dynamic Evaluation of LLMs
Tong, X., Jin, B., Wang, J., Wu, X., Xia, T., & Han, M. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10890123 · Cited by 3
Integrating LLMs and RAG Techniques Into Mathematics Learning for Engineering Students
Gritli, M. M., Lasmer, M. A. B., Riahi, M. H., & Ncib, L. (2024) · Artificial Intelligence Revolutions (AIR) · doi:10.1109/air63653.2024.00021 · Cited by 3
Yang, Y., Li, X., Wang, H., Li, X., Guan, Y., & Jiang, J. (2025) · Expert Systems with Applications · doi:10.1016/j.eswa.2025.128033 · Cited by 3
Demonstration Based Explainable AI for Learning From Demonstration Methods
Gu, M., Croft, E. A., & Kulić, D. (2025) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2025.3568617 · Cited by 3
Tadrousse, K. S., Cash, C. A., Kastury, M. R., Thompson, N. T., & Simman, R. (2025) · Plastic & Reconstructive Surgery Global Open · doi:10.1097/gox.0000000000006871 · Cited by 3
Reinforcement learning with dopamine: A convergence of natural and artificial intelligence
Masset, P., & Gershman, S. J. (2025) · Handbook of behavioral neuroscience · doi:10.1016/b978-0-443-29867-7.00019-0 · Cited by 6
Liu, H., Yin, S., Hu, X., Deng, M., Yang, X., & Xu, G. (2025) · Applied Sciences · doi:10.3390/app15169012 · Cited by 3
LLMZ+: Contextual Prompt Whitelist Principles for Agentic LLMs
Pawelek, T., Patel, R., Crowell, C., Golilarz, N. A., Mittal, S., Rahimi, S., & Perkins, A. (2025) · International Conference on Machine Learning and Applications · doi:10.1109/icmla66185.2025.00213 · Cited by 5
PageLLM: A Multi-Grained Reward Framework for Whole-Page Optimization with Large Language Models
Wang, X., Wu, L., Wang, D., & Fu, Y. (2026) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3799682.3840685 · Cited by 3
iCORPP: Interleaved commonsense reasoning and probabilistic planning on robots
Zhang, S., Khandelwal, P., & Stone, P. (2024) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2023.104613 · Cited by 3
Feldman, K., & Nehme, F. (2023) · Gastroenterology · doi:10.1053/j.gastro.2023.06.006 · Cited by 3
Accelerating Virtual Directed Evolution of Proteins via Reinforcement LearningPreprint
Mi, T., Wang, Y., Zhao, J., Wang, W., Shen, Y., Xiao, N., Chen, L., Chen, G., Zhang, S., Zhang, W., et al. (2025) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2025.06.25.661516 · Cited by 4
Ueno, H. (2025) · Oxford University Press eBooks · doi:10.1093/9780198945215.003.0108 · Cited by 3
AI Finds A WayPreprint
Dharna, A., Lu, C., Sullivan, R., Lehman, J., Krakovna, V., & Clune, J. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2608.23875 · Cited by 3
Wölflein, G., Ferber, D., Truhn, D., Arandjelović, O., & Kather, J. N. (2025) · arXiv · doi:10.48550/arxiv.2502.11705 · Cited by 3
Diagnosing and Mitigating Sycophancy and Skepticism in LLM Causal Judgment
Chang, E. Y. (2026) · Findings of the Association for Computational Linguistics: ACL 2026 · doi:10.18653/v1/2026.findings-acl.427 · Cited by 2
“Sycophancy, where models agree with user biases to optimize for perceived helpfulness, is a known side-effect of Reinforcement Learning from Human Feedback (RLHF) (Ouyang et al., 2022; Bai et al., 2022).”
Yan, S., Yang, X., Huang, Z., Nie, E., Ding, Z., Li, Z., Ma, X., Bi, J., Kersting, K., Pan, J. Z., et al. (2025) · arXiv · doi:10.48550/arxiv.2508.19828 · Cited by 297
“Reinforcement Learning from Human Feedback (RLHF) (Ouyang et al., 2022) is a foundational method used to align LLM outputs with human preferences.”
FACE: Fully Overlapped PD Scheduling and Multi-Level Architecture Co-Exploration on Wafer
Xu, Z., Kong, D., Liu, J., Jiang, D., Dai, X., Deng, J., Hu, Y., & Yin, S. (2026) · IEEE International Symposium on High-Performance Computer Architecture (HPCA) · doi:10.1109/hpca68181.2026.11408518 · Cited by 2
Factorized Learning for Temporally Grounded Video-Language Models
Zeng, W., Gao, D., Shou, M. Z., & Ng, H. T. (2025) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.01923 · Cited by 7
Hong, J., Rao, P., Wang, W., & Najafizadeh, L. (2026) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2026.3693965 · Cited by 2
Umer, F., Mr, S., & Rahman, A. J. (2026) · BDJ Open · doi:10.1038/s41405-026-00462-9 · Cited by 2
Toward Scalable ASL Education: Egocentric Stereo Sensing with LLM Feedback for Error-Aware Learning
Cai, Y., Li, Z., Lu, T., Zhu, Y., Wu, Y.-S., Zhang, Q., Xu, X., Jin, Z. K., Gowda, M. K., & Jin, Y. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3790774 · Cited by 2
Accurate Table Question Answering with Accessible LLMs
Jiang, Y., Wei, F., Bao, E., Li, Y., Ding, B., Yang, Y., & Xiao, X. (2026) · IEEE International Conference on Data Engineering (ICDE) · doi:10.1109/icde65706.2026.00020 · Cited by 3
Hao, Z., Liu, X., Fan, J., Long, Y., Yu, J., Chen, W., & Zhang, Y. (2026) · Journal of Research on Technology in Education · doi:10.1080/15391523.2026.2722962 · Cited by 2
Acting Flatterers via LLMs Sycophancy: Combating Clickbait with LLMs Opposing-Stance Reasoning
Zhang, C., Luo, X., Zhang, Z., Zhu, Y. Q., Qiang, J., & Wang, L. (2026) · International World Wide Web Conference (WWW) · doi:10.1145/3774904.3792506 · Cited by 5
Self-citationKerimoğlu, C. (2026) · Dil Araştırmaları · doi:10.54316/dilarastirmalari.1879242 · Cited by 2
Narrative–affect discrepancy as a regulated degree of freedom in 351,734 relationship narratives
Kim, R. S. (2026) · PLoS ONE · doi:10.1371/journal.pone.0348715 · Cited by 2
A human-guided generative model based on diffusion processes for topology optimization
Kim, E. H., Kim, Y., & Park, K. (2026) · Journal of Computational Design and Engineering · doi:10.1093/jcde/qwag055 · Cited by 2
Acoda: Adversarial Code Obfuscation for Defending against LLM-based Analysis
Rao, H., Dong, Z., Zhao, Y., Li, H., & Wang, H. (2026) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/3774748.3793624 · Cited by 3
Yadav, I., Schindler, S., Peters, D., & Klinger, R. (2026) · Semantic Web · doi:10.1177/22104968261453132 · Cited by 5
Metadata
- Authors
- Ouyang, L., Wu, J., Jiang, X., Almeida, D., Wainwright, C., Mishkin, P., Zhang, C., Agarwal, S., Slama, K., Ray, A., Schulman, J., Hilton, J., Kelton, F., Miller, L., Simens, M., Askell, A., Welinder, P., Christiano, P., Leike, J., & Lowe, R.
- Venue
- Advances in Neural Information Processing Systems 35
- Published
- 2022
- Pages
- 27730-27744
- ISSN
- 1049-5258 (ISSN-L)
- OpenAlex
- W7133211372
- Cited by
- 3,117
- References
- 0
- Citations by year
- 2026: 1421 · 2025: 544 · 2024: 852 · 2023: 297 · 2022: 3
- FWCI
- 234.27
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- neural information processing systems (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Keywords
- instruction following, language models, human feedback, reinforcement learning from human feedback, large language models
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.