Training Language Models to Follow Instructions with Human Feedback
The DOI matches its Crossref record; 2 of the 2 references it cites were found in a registry or an index.
Abstract
Making language models bigger does not inherently make them better at following a user's intent. For example, large language models can generate outputs that are untruthful, toxic, or simply not helpful to the user. In other words, these models are not aligned with their users. In this paper, we show an avenue for aligning language models with user intent on a wide range of tasks by fine-tuning with human feedback. Starting with a set of labeler-written prompts and prompts submitted through the OpenAI API, we collect a dataset of labeler demonstrations of the desired model behavior, which we use to fine-tune GPT-3 using supervised learning. We then collect a dataset of rankings of model outputs, which we use to further fine-tune this supervised model using reinforcement learning from human feedback. We call the resulting models InstructGPT. In human evaluations on our prompt distribution, outputs from the 1.3B parameter InstructGPT model are preferred to outputs from the 175B GPT-3, despite having 100x fewer parameters. Moreover, InstructGPT models show improvements in truthfulness and reductions in toxic output generation while having minimal performance regressions on public NLP datasets. Even though InstructGPT still makes simple mistakes, our results show that fine-tuning with human feedback is a promising direction for aligning language models with human intent.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Existing literature (Ouyang et al., 2022) does not fully describe the details of these models, such as the pretraining corpus, model sizes, and model biases.”
From Self-Refine: Iterative Refinement with Self-Feedback (2023) · cites this paper as Ouyang et al., 2022
Experimental — accuracy not yet measuredIn the citing paper
“Specifically, providers mitigate race and gender bias through reinforcement learning from human feedback (RLHF), adversarial stress-testing known as red teaming, and hard-coded refusals governed by the provider's own content policies [6, 43, 71].”
From All Public Voices Are Equal, But Are Some More Equal Than Others to LLMs? (2026) · cites this paper as [71]
In the citing paper
“Fine-tuning a model from human feedback at scale, using preference data from paid raters or drawn from a large and willing user base, is an especially potent technique.It has the potential not only to shape a model's responses to better reflect user norms (for better or worse), but also to filter out toxic language, improve factual accuracy, and mitigate the tendency to fabricate information.”
From Talking about Large Language Models (2024) · cites this paper as [26]
In the citing paper
“These include general competencies such as in-context learning (ICL) [13], chain-of-thought (CoT) [17] reasoning, and instruction following [25], as well as task-specialized skills like mathematical reasoning [30].”
From A Survey of Large Language Models (2026) · cites this paper as [25]
In the citing paper
“When external reward models or ground-truth answers are available, rejection sampling can also be applied to select higher-quality responses from multiple candidates [25].”
From A Survey of Large Language Models (2026) · cites this paper as [25]
41 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
The publisher hasn’t deposited this paper’s reference list.
Cited by
Items 2,401–2,500 of 4,340
Corn Cultivation with Precision: Language Agents for Real-Time Decision Making
Chao, A. F. Y. (2025) · IEEE International Conference on Consumer Technology (ICCT-Pacific) · doi:10.1109/icct-pacific63901.2025.11012907 · Cited by 1
Kathrada, M. (2025) · doi:10.2118/225325-ms · Cited by 1
Kim, M., Kim, T., Chung, J., Choi, H., Min, S., Lim, J., & Park, S. (2025) · IEEE/ACM International Conference on Software Engineering: Software Engineering in Society (ICSE-SEIS) · doi:10.1109/icse-seis66351.2025.00022 · Cited by 4
ETL: Ensemble–at–Training for Low-cost Open-source Large Language Models
Zaki, A. M., Khalil, M. I., & Abbas, H. M. (2025) · doi:10.1109/iceeng64546.2025.11031386 · Cited by 1
Coft: Making Large Language Models Better Zero-Shot Learners for Code Generation
Li, W., Qian, Y., Gao, K., Chen, H., Wang, X., Tong, Y., Li, L., Wu, Y., & Zhao, C. (2025) · IEEE International Conference on Program Comprehension (ICPC) · doi:10.1109/icpc66645.2025.00059 · Cited by 1
Boosting LLM’s Continual Sentiment Understanding for Low-Resource Languages
Zhang, H., Wang, J., Luo, J., Zhang, M., & Zhou, G. (2025) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/taslpro.2025.3581018 · Cited by 2
Yoo, M. H., & Song, S. (2025) · Lingua · doi:10.1016/j.lingua.2025.103998 · Cited by 1
Ma, Y., Zhao, X., Rong, Z., Chai, S., Ying, W., & Yao, C. (2025) · International Conference on Computer Supported Cooperative Work in Design (CSCWD) · doi:10.1109/cscwd64889.2025.11033593 · Cited by 1
Zhang, H., Zhu, X., Wang, X., Song, Y., Gu, H., & Ma, L. (2025) · IEEE International Conference on Mobile Data Management (MDM) · doi:10.1109/mdm65600.2025.00024 · Cited by 3
Robust Offline Reinforcement Learning for Non-Markovian Decision Processes
Huang, R., Liang, Y., & Yang, J. (2025) · IEEE Transactions on Information Theory · doi:10.1109/tit.2025.3587509 · Cited by 1
Task-Classifying Retrieval Augmented Generation
Ju, J., Zang, P., Zhong, H., & Wang, L. (2025) · International Conference on Artificial Intelligence and Big Data (ICAIBD) · doi:10.1109/icaibd64986.2025.11082008 · Cited by 1
Lost in Automation: How Generative AI Puts Communication Students' Skills at Risk
Iancu, I. R. (2025) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-6018-8.ch012 · Cited by 1
A relevance model of human sparse communication in cooperation
Jiang, K., Jiang, B., Sadaghdar, A., Limb, R., & Gao, T. (2025) · Frontiers in Robotics and AI · doi:10.3389/frobt.2025.1512099 · Cited by 1
Innovative design of blended teaching for Artificial Intelligence course
Zhao, D., Li, J., Zhang, D., & Ma, X. (2025) · International Conference on Computer Science and Technologies in Education (CSTE) · doi:10.1109/cste64638.2025.11092165 · Cited by 1
Efficient Cross-Lingual Transfer for Language Models
Shah, A. F. M. S. (2025) · International Symposium on Innovative Approaches in Smart Technologies (ISAS) · doi:10.1109/isas66241.2025.11101933 · Cited by 2
NARS-GPT: An Integrated Reasoning System for Natural Language Interactions
Isaev, P., & Hammer, P. (2025) · Lecture notes in networks and systems · doi:10.1007/978-3-031-99965-9_25 · Cited by 2
How Do LLMs Work? A Deep Dive Into Transformer Models
Vats, S., Sharma, V., Singh, P., Thakur, S., & Rawat, D. (2025) · IGI Global eBooks · doi:10.4018/979-8-3373-3785-2.ch004 · Cited by 1
Wang, Y., Cui, Z., & Ruy, D. (2025) · Design Science Vision · doi:10.1016/j.dsvis.2025.100001 · Cited by 1
Layer Cake: On Language Representation and Compute Characteristics in Text Classification
Worth, P. J., & Cardei, I. (2025) · International Journal of Intelligence Science · doi:10.4236/ijis.2025.154010 · Cited by 1
A Reward-Driven Automated Webshell Malicious-Code Generator for Red-Teaming
Ding, Y., Wang, Z., Wang, H., & Li, Y. (2026) · Lecture notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering · doi:10.1007/978-3-032-22542-9_26 · Cited by 1
MARché: Fast Masked Autoregressive Image Generation with Cache-Aware Attention
Jiang, C., Kim, S., Gao, L., Zarch, H. E., Ro, W. W., & Annavaram, M. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37627-5_34 · Cited by 1
ITDR: An Instruction Tuning Dataset for Enhancing Large Language Models in Recommendations
Liu, Z., Huang, X., & Sang, J. (2026) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3770854.3785694 · Cited by 1
RelRepair: Enhancing Automated Program Repair by Retrieving Relevant Code
Liu, S., Bai, G., Utting, M., & Yang, G. (2026) · IEEE Transactions on Reliability · doi:10.1109/tr.2026.3736386 · Cited by 6
Prevalence of Security and Privacy Risk-Inducing Usage of AI-Based Conversational Agents
Grosse, K., & Ebert, N. (2026) · IEEE Access · doi:10.1109/access.2026.3714993 · Cited by 1
Friend or Foe: How LLMs’ Safety Mind Gets Fooled by Intent Shift Attack
Ding, P., Kuang, J., Sun, W., Wang, Z., Cao, X., Cai, X., Chen, J., & Huang, S. (2026) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl.a.805 · Cited by 1
Guardrails for LLMs: A Comprehensive Review and Case Study on Bias Mitigation for Responsible AI
Park, J., & Mohaghegh, M. (2025) · Communications in computer and information science · doi:10.1007/978-981-95-4575-9_12 · Cited by 1
Natural Language Interfaces to Databases
Katsogiannis-Meimarakis, G., Mitsopoulou, A., Xydas, M., & Koutrika, G. (2025) · Data-centric systems and applications · doi:10.1007/978-3-032-06905-4_1 · Cited by 1
Wang, J., Li, P., Jiang, W., Chen, J., Koshizuka, N., Shibasaki, R., & Jiang, R. (2026) · Transportation Research Part C Emerging Technologies · doi:10.1016/j.trc.2026.106110 · Cited by 1
Agater, J., Herradi, L., Mimouni, M., Memari, A., & Gómez, J. M. (2025) · Lecture notes in computer science · doi:10.1007/978-3-032-11442-6_38 · Cited by 1
Optimizing LVLMs with On-Policy Data for Effective Hallucination Mitigation
Yu, C., Xu, Y., Chen, Y., & Zhang, W. (2026) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv61042.2026.00460 · Cited by 2
Automatic Minds: Cognitive Parallels Between Hypnotic States and Large Language Model Processing
Riva, G., Wiederhold, B. K., & Mantovani, F. (2025) · Cyberpsychology Behavior and Social Networking · doi:10.1177/21522715251400733 · Cited by 2
MKE-PLLM: A benchmark for multilingual knowledge editing on pretrained large language model
Song, R., Gao, S., Gao, X., Mao, C., & Yu, Z. (2025) · Neurocomputing · doi:10.1016/j.neucom.2025.130979 · Cited by 4
A Comprehensive Review of Text and Image Generation Techniques in Generative Artificial Intelligence
Tejasvi, S., Prajwal, N. J., & Meleet, M. (2025) · Lecture notes in networks and systems · doi:10.1007/978-981-96-6066-7_12 · Cited by 1
Generating P4 data planes using LLMs
Dumitru, M.-V., Bădoiu, V.-A., Gherghescu, A. M., & Raiciu, C. (2025) · Computer Networks · doi:10.1016/j.comnet.2025.111709 · Cited by 1
LLMs highlight the importance of interaction in human language learning
Kristensen‐McLachlan, R. D., Kallens, P. C., & Christiansen, M. H. (2025) · Linguistics Vanguard · doi:10.1515/lingvan-2024-0254 · Cited by 2
Tie, Z., Chen, Q., Liu, F., Zhou, J., & He, L. (2025) · Lecture notes in computer science · doi:10.1007/978-981-95-3343-5_38 · Cited by 3
English is not all you need: Rewarding better translation to inspire multilingual capability in LLMs
Huo, W., Feng, X., Huang, Y., Fu, C., Wang, H., & Qin, B. (2025) · Neurocomputing · doi:10.1016/j.neucom.2025.132463 · Cited by 3
CustomX: Unified Character, Action, and Scene Customization in Video World Models
Wang, Y., Wei, F., Zhang, H., Dai, B., & Lu, Y. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37419-6_23 · Cited by 1
RE-GRPO: Leveraging hard negative cases through large language model guided self training
Liu, H., & Xiao, L. (2025) · Neurocomputing · doi:10.1016/j.neucom.2025.132543 · Cited by 1
Exploring prompt engineering with instructive shots to enhance LLMs as a recommender system
Xie, J., Sun, Y., & Liu, T. (2026) · Information Sciences · doi:10.1016/j.ins.2025.123064 · Cited by 5
Compulsory autonomy in AI: unmasking hidden labor through queer feminist theory
Tomita, K. (2026) · AI & Society · doi:10.1007/s00146-026-02851-y · Cited by 1
LEAPS: An LLM-Empowered Adaptive Plugin in Taobao AI Search
Wang, L., Wu, J., Wang, Z., & Li, B. (2026) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3799682.3840100 · Cited by 1
Self-citationLi, X., Li, Q., & Kim, J. (2026) · Expert Systems · doi:10.1111/exsy.70208 · Cited by 1
Gradient-Informed Monte Carlo Fine-Tuning of Diffusion Models for Low-Thrust Trajectory Design
Graebner, J., & Beeson, R. (2026) · AIAA SciTech Forum · doi:10.2514/6.2026-1075 · Cited by 1
Cui, C., Wang, S., Huang, L., Gu, Q., Huang, Z., Zeng, X., & Mao, W. (2026) · International World Wide Web Conference (WWW) · doi:10.1145/3774904.3792262 · Cited by 1
Adaptive Prompt Elicitation for Text-to-Image Generation
Wen, X., Hegemann, L., Jin, X., Ma, S., & Oulasvirta, A. (2026) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3742413.3789149 · Cited by 2
SAP-BERT: BERT Inference Acceleration Through Skip-Layer and Adaptive Patient Early Exiting
Jiang, L., Tan, Y., Ren, J., Peng, K., Qin, H., Tong, C., & Jiayang, G. (2025) · Lecture notes in computer science · doi:10.1007/978-981-96-6603-4_19 · Cited by 1
A qualitative shift in AI capabilities: A "bitter lesson" for human-AI interaction research?
Astor, K. (2026) · Comput. Hum. Behav. Artif. Humans · doi:10.1016/j.chbah.2026.100253 · Cited by 2
Training Objectives and Evaluation Metrics for Counterfactual Story Rewriting
Girard, A., Unanue, I. J., & Piccardi, M. (2026) · ACM Transactions on Asian and Low-Resource Language Information Processing · doi:10.1145/3785019 · Cited by 2
Yin, Y. (2026) · Scientific Reports · doi:10.1038/s41598-026-39296-8 · Cited by 1
UrbanAlign: Post-hoc Semantic Calibration for VLM-Human Preference Alignment
Zhang, Y., Zhao, R., Sha, Z., Li, Y., Wang, L., Hou, C., Ji, W., Huang, H., Wan, Y., Yu, J., et al. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37132-4_18 · Cited by 1
Personalized Graph-Empowered Large Language Model for Proactive Information Access
Chang, C., Yen, A.-Z., Huang, H.-H., & Chen, H.-H. (2025) · IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology (WI-IAT) · doi:10.1109/wi-iat67162.2025.00012 · Cited by 1
A large-language-model-guided progressive error-correction framework for structured process modeling
Xu, R., Fang, H., Fang, W., Wang, F., & Zhao, C. (2026) · Expert Systems with Applications · doi:10.1016/j.eswa.2026.131998 · Cited by 1
Design and Implementation of a RAG-Enhanced LLM Chatbot for Penetration Testing Tasks
Fadhel, O. B., Fernandes, R., Ribeiro, Ó. R., Najjar, M., & Lopes, N. (2026) · Procedia Computer Science · doi:10.1016/j.procs.2026.03.059 · Cited by 1
Notice of Removal: DUPLEX: Agentic Dual-System Planning via LLM-Driven Information Extraction
Hua, K., Wang, D., Gu, Y., & Ma, X. (2026) · International Conference on Robotics and Automation Sciences (ICRAS) · doi:10.1109/icras70064.2026.11717896 · Cited by 1
Ghosh, A., Kumar, N., Patnaik, N., Prakash, A., Raj, R., & Saha, S. (2026) · ACM Transactions on Computing for Healthcare · doi:10.1145/3805803 · Cited by 5
Conversational signatures: structural patterns in human–AI interaction across models and platforms
Kraishan, O. (2026) · Interacting with Computers · doi:10.1093/iwc/iwag017 · Cited by 2
Wide reflective equilibrium in LLM alignment: bridging moral epistemology and AI safety
Brophy, M. (2026) · Ethics and Information Technology · doi:10.1007/s10676-026-09897-y · Cited by 1
Li, C., & Zhang, M. F. (2026) · Information Processing & Management · doi:10.1016/j.ipm.2026.104779 · Cited by 1
Navigating the Mirage: A Dual-Path Agentic Framework for Robust Misleading Chart Question Answering
Zhang, Y., Li, Y., Sheng, R., Chen, Z., Lin, Y., Qu, H., Chen, L., & Sun, Y. (2026) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3767308.3835239 · Cited by 2
Niu, Y., Shen, L., Liu, J., Yang, Z., Wang, L., & Cheng, Y. (2026) · Abdominal Radiology · doi:10.1007/s00261-026-05492-3 · Cited by 1
MBD semantic annotation and closed-loop back-writing for aircraft components based on MLLM and MKG
Zhao, Q., Jiang, C., Li, X., Guo, X., Li, J., Li, X., Zhao, W., & Zhang, K. (2026) · Journal of Manufacturing Systems · doi:10.1016/j.jmsy.2026.03.018 · Cited by 1
Xie, J., Qi, L., Liu, W., Wang, A., Xu, X., Xiang, H., Zhang, X., Gong, W., Zhang, Y., Beheshti, A., et al. (2026) · International World Wide Web Conference (WWW) · doi:10.1145/3774904.3792302 · Cited by 1
LL.me: Supporting Identity Work through Human-AI Alignment
Hall, K., Ohsawa, M. S., Swain, V. D., & Kim, J. G. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3790890 · Cited by 1
Li, J., Zhu, S., & Xiong, D. (2026) · Information Processing & Management · doi:10.1016/j.ipm.2026.104819 · Cited by 1
Machkour, B., & Abriane, A. (2026) · ADCAIJ ADVANCES IN DISTRIBUTED COMPUTING AND ARTIFICIAL INTELLIGENCE JOURNAL · doi:10.14201/adcaij.33461 · Cited by 2
Shao, J., Li, S. W., Zhang, K., Guo, Y., & Li, M. (2026) · Transportation Research Part C Emerging Technologies · doi:10.1016/j.trc.2026.105702 · Cited by 1
Pu, M., Wu, X.-M., Lim, M. K., Chong, C. Y., Li, W., & Loy, C. C. (2026) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3767308.3835728 · Cited by 1
High-quality data selection-driven instruction tuning for biomedical large language models
Zheng, J., Sun, L., He, X., & Cao, R. (2026) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2026.105049 · Cited by 1
Du, X., Luo, F., Hu, J., Zhou, W., & Wen, J. (2026) · Applied Energy · doi:10.1016/j.apenergy.2026.127976 · Cited by 1
Reframing the AI alignment problem: insights from business applications
Breeden, J. L. (2026) · AI and Ethics · doi:10.1007/s43681-026-01137-9 · Cited by 1
Aruna Gladys, A., Aishwarya, R., Vetriselvi, V., Daphne, S., Baskar, P. N., & Rajan, A. A. (2026) · Archives of Computational Methods in Engineering · doi:10.1007/s11831-026-10598-4 · Cited by 3
TS-PET: A Novel Framework for Fine-Tuning Pretrained Time-Series Models
Zheng, L., & Jin, B. (2026) · Big Data · doi:10.1177/2167647x261439005 · Cited by 1
Cross-platform evaluation of reasoning capabilities in foundation models
de Curtò, J., de Zarzà, I., García, P., Cabot, J., Cano, J., & Calafate, C. T. (2026) · Information Processing & Management · doi:10.1016/j.ipm.2026.104878 · Cited by 2
Patel, K., Ajith, R., Thapa, S., Adhikari, S., Tanveer, M., & Naseem, U. (2026) · Neural Networks · doi:10.1016/j.neunet.2026.109073 · Cited by 1
SERA: Self-referential assessment framework for bidirectional generative commonsense reasoning
Seo, J., Moon, H., Jang, Y., & Lim, H. (2026) · Knowledge-Based Systems · doi:10.1016/j.knosys.2026.116152 · Cited by 1
Wang, Q., Shen, A., Zeng, Y., Feng, D., Zhang, X., Ding, B., & Wang, H. (2026) · Expert Systems with Applications · doi:10.1016/j.eswa.2026.132870 · Cited by 1
Fede, G. D., Alrabie, L., & Andolina, S. (2026) · Springer eBooks · doi:10.1007/978-981-95-3658-0_49 · Cited by 1
Yun, L., Hao, Y., Gong, H., & Li, B. (2026) · iScience · doi:10.1016/j.isci.2026.116056 · Cited by 1
DiffuPercom: A novel simplex-based diffusion framework for personalized comment generation
Liu, J., Cheng, P., Dai, J., & Liu, J. (2026) · Applied Soft Computing · doi:10.1016/j.asoc.2026.115493 · Cited by 1
Gültekin, A., Diri, S., & Özcan, M. (2026) · Information Processing & Management · doi:10.1016/j.ipm.2026.104911 · Cited by 1
Stochastic parrot or not, it is less of a turkey than the colleague two desks over
Falegnami, A., Tomassi, A., Levorato, M., & Costantino, F. (2026) · AI & Society · doi:10.1007/s00146-026-03095-6 · Cited by 2
Popun, J., Lee, W., Srisomboon, K., Pipanmekaporn, L., & Prayote, A. (2026) · Scientific Reports · doi:10.1038/s41598-026-54756-x · Cited by 1
Graph-GRPO: Dependency-Aware Credit Assignment for Generative E-commerce Search Relevance
Che, J., Chen, Y., Tian, Z., Wang, C., & Cheng, Z. (2026) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3799682.3840144 · Cited by 1
Bounded Behavioral Indistinguishability for Black-Box LLM Distillation
Hasan, M. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-44176-8_27 · Cited by 1
Lite-ar-cadecoder: a lightweight approach for text-guided parametric CAD modeling
Cheng, H., Sun, Y., Zheng, S., & Yu, H. (2026) · Engineering With Computers · doi:10.1007/s00366-026-02356-8 · Cited by 1
Prompt carefully! ChatGPT displays rule-based insensitivity to contingencies
Ruiz, F. J., & Cardona-Betancourt, V. (2026) · Journal of Contextual Behavioral Science · doi:10.1016/j.jcbs.2026.101012 · Cited by 1
StepPRM-RTL: Stepwise Process-Reward Guided LLM Fine-Tuning for Enhanced RTL Synthesis
Vijayaraghavan, P., Nitsure, A., Shi, L., Beymer, D., Degan, E., & Mukherjee, V. V. (2026) · ACM/IEEE Design Automation Conference (DAC) · doi:10.1145/3770743.3804218 · Cited by 2
Text-conditioned irregular floorplan generation via composable inpainting diffusion
Zhang, H., Savov, A., & Dillenburger, B. (2026) · Automation in Construction · doi:10.1016/j.autcon.2026.107037 · Cited by 1
Zhang, M., Yin, J., Han, H., Zhong, J., Li, P., Wang, Y., Yang, C., Zheng, Y., Liu, H., Tan, J., et al. (2026) · Neurocomputing · doi:10.1016/j.neucom.2026.134083 · Cited by 1
Zhang, Y., Yao, K., Zhang, L., & Zhao, C. (2026) · Expert Systems with Applications · doi:10.1016/j.eswa.2026.133242 · Cited by 2
The impact of contextual information on parameter description generation: An empirical study
Chen, X., Lin, P., Peng, R., Huang, Y., & Zhou, X. (2026) · Science of Computer Programming · doi:10.1016/j.scico.2026.103524 · Cited by 1
Progressive Induction-Aware Optimization for LLMs Safety Under Multi-turn Jailbreaks
Jing, S., Cao, H., Wang, B., Huo, J., & Gao, Y. (2026) · Machine Learning · doi:10.1007/s10994-026-07067-1 · Cited by 1
NRITYAM: Language Models Meet Art and Heritage of Dance
Singh, P. K., Ghosh, N., Joshiınst, A., Choudhary, S., Färber, M., & Yang, H. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37682-4_27 · Cited by 1
Wang, X. (., O’Malley, A., Hughes, A., & Khalid, M. S. (2026) · Education Sciences · doi:10.3390/educsci16060973 · Cited by 1
A Survey of Large-Model-Based AI Agents
Qin, C., & Jin, L. (2026) · Tsinghua Science & Technology · doi:10.26599/tst.2026.9010072 · Cited by 2
Vraila, S. P. (2026) · transLogos Translation Studies Journal · doi:10.29228/translogos.86 · Cited by 1
Cognitive Firewall: A Proactive, Zero-Trust, Multi-Gate Framework for LLM Safety
Guida, M., Shikhhamzayev, R., Penchala, S., Iannucci, S., Li, J., Rahimi, S., & Golilarz, N. A. (2026) · International Conference on Machine Learning and Applications · doi:10.1109/icmla69890.2026.00196 · Cited by 1
Game theory driven multi-agent framework mitigates language model hallucination
Liu, R., Bie, B., Wang, Z., Ma, Y., Liu, Y., Li, X., Yang, H., Yang, W., Cao, J., & Tao, S. (2026) · Nature Communications · doi:10.1038/s41467-026-78213-5 · Cited by 1
Quantifying the efficacy of scenario based jailbreaks on Llama using HarmBench and LLM-as-a-judge
Abdullah, S., Hossain, R., & Chowdhury, M. (2026) · Discover Artificial Intelligence · doi:10.1007/s44163-026-01816-w · Cited by 1
Metadata
- Authors
- Ouyang, L., Wu, J., Jiang, X., Almeida, D., Wainwright, C., Mishkin, P., Zhang, C., Agarwal, S., Slama, K., Ray, A., Schulman, J., Hilton, J., Kelton, F., Miller, L., Simens, M., Askell, A., Welinder, P., Christiano, P., Leike, J., & Lowe, R.
- Venue
- Advances in Neural Information Processing Systems 35
- Published
- 2022
- Pages
- 27730-27744
- ISSN
- 1049-5258 (ISSN-L)
- OpenAlex
- W7133211372
- Cited by
- 3,117
- References
- 0
- Citations by year
- 2026: 1421 · 2025: 544 · 2024: 852 · 2023: 297 · 2022: 3
- FWCI
- 234.27
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- neural information processing systems (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Keywords
- instruction following, language models, human feedback, reinforcement learning from human feedback, large language models
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.