Training Language Models to Follow Instructions with Human Feedback
The DOI matches its Crossref record; 2 of the 2 references it cites were found in a registry or an index.
Abstract
Making language models bigger does not inherently make them better at following a user's intent. For example, large language models can generate outputs that are untruthful, toxic, or simply not helpful to the user. In other words, these models are not aligned with their users. In this paper, we show an avenue for aligning language models with user intent on a wide range of tasks by fine-tuning with human feedback. Starting with a set of labeler-written prompts and prompts submitted through the OpenAI API, we collect a dataset of labeler demonstrations of the desired model behavior, which we use to fine-tune GPT-3 using supervised learning. We then collect a dataset of rankings of model outputs, which we use to further fine-tune this supervised model using reinforcement learning from human feedback. We call the resulting models InstructGPT. In human evaluations on our prompt distribution, outputs from the 1.3B parameter InstructGPT model are preferred to outputs from the 175B GPT-3, despite having 100x fewer parameters. Moreover, InstructGPT models show improvements in truthfulness and reductions in toxic output generation while having minimal performance regressions on public NLP datasets. Even though InstructGPT still makes simple mistakes, our results show that fine-tuning with human feedback is a promising direction for aligning language models with human intent.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Existing literature (Ouyang et al., 2022) does not fully describe the details of these models, such as the pretraining corpus, model sizes, and model biases.”
From Self-Refine: Iterative Refinement with Self-Feedback (2023) · cites this paper as Ouyang et al., 2022
Experimental — accuracy not yet measuredIn the citing paper
“Specifically, providers mitigate race and gender bias through reinforcement learning from human feedback (RLHF), adversarial stress-testing known as red teaming, and hard-coded refusals governed by the provider's own content policies [6, 43, 71].”
From All Public Voices Are Equal, But Are Some More Equal Than Others to LLMs? (2026) · cites this paper as [71]
In the citing paper
“Fine-tuning a model from human feedback at scale, using preference data from paid raters or drawn from a large and willing user base, is an especially potent technique.It has the potential not only to shape a model's responses to better reflect user norms (for better or worse), but also to filter out toxic language, improve factual accuracy, and mitigate the tendency to fabricate information.”
From Talking about Large Language Models (2024) · cites this paper as [26]
In the citing paper
“These include general competencies such as in-context learning (ICL) [13], chain-of-thought (CoT) [17] reasoning, and instruction following [25], as well as task-specialized skills like mathematical reasoning [30].”
From A Survey of Large Language Models (2026) · cites this paper as [25]
In the citing paper
“When external reward models or ground-truth answers are available, rejection sampling can also be applied to select higher-quality responses from multiple candidates [25].”
From A Survey of Large Language Models (2026) · cites this paper as [25]
41 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
The publisher hasn’t deposited this paper’s reference list.
Cited by
Items 2,301–2,400 of 4,340
Qian, Y., Wang, J., Xu, C., Wang, H., Feng, Y., Liu, Y., Sun, B., Liu, Y., & Wang, S. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37261-1_3 · Cited by 1
Liu, J., Luo, L., Pan, D., Kang, Y., Sun, Y., Lin, H., Yu, L., & Zhuang, H. (2026) · Health Information Science and Systems · doi:10.1007/s13755-026-00473-8 · Cited by 1
O’Dea, X., Chiu, Y.-L. T., Bale, R., & Pazio, M. (2026) · Studies in Higher Education · doi:10.1080/03075079.2026.2700435 · Cited by 1
Measuring disparate impact in human and machine decisions
Jung, J., Corbett‐Davies, S., Gaebler, J., Shroff, R., & Goel, S. (2026) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2509765122 · Cited by 1
RFLM: An RF Language Model for Instruction-Conditioned RF Processing
Wen, Z., Yang, C., Zhang, H., Wang, Y., Shao, H., & Wang, S. (2026) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2026.3715170 · Cited by 1
Data Foundations of Long-Context Language Models: A Survey
Sun, Z., Sun, Y., Su, Z., Tang, Z., Li, J., Zhou, A., Chen, W., & Zhang, M. (2026) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl.a.775 · Cited by 2
Wang, Z., Wang, H., Luo, N., Zhang, L., Liu, P., Cao, Y., & Sun, X. (2026) · Lecture notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering · doi:10.1007/978-3-032-32767-3_13 · Cited by 1
Beyond Benchmarks: A User-Centric Framework for Evaluating Large Language Models
Abdrabou, Y., Abdelrahman, Y., Bozkir, E., Mazen, Y., Alt, F., & Kasneci, E. (2026) · ACM Conference on Conversational User Interfaces (CUI) · doi:10.1145/3816046.3816227 · Cited by 1
OptiFlow: Towards LLM-Driven Optimization of Collective Communication Algorithms
Long, F., Yang, Z., Gao, K., Wang, S., Chen, L., Niu, Z., Shu, R., Cheng, W., Cheng, P., Xiong, Y., et al. (2026) · Asia-Pacific Workshop on Networking (APNet) · doi:10.1145/3820441.3820452 · Cited by 1
Do people rely on ChatGPT more than their peers to detect deepfake news?
Fu, Y., & Hanaki, N. (2026) · Journal of Economic Interaction and Coordination · doi:10.1007/s11403-026-00490-6 · Cited by 1
Simulating strategic interactions with AI agents
Tranchero, M., Brenninkmeijer, C.-F., Murugan, A., & Nagaraj, A. (2026) · Strategic Management Journal · doi:10.1002/smj.70112 · Cited by 5
Multi-Agent AI Systems are OrganizationsPreprint
Arrieta, J. P., He, V. F., Puranam, P., & Shrestha, Y. R. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6813862 · Cited by 2
Generative Language Models for Disease Treatment Recommendations: A Systematic Literature Review
Neto, L. M., da Silva, M. H. L. F., Monteiro, K. H. D. C., Simão, E. P., Neto, S. R. D. S., de Vasconcelos, L. F. S., Pimenta, J. P., Rodrigues, I. R., & Endo, P. T. (2026) · Journal of Healthcare Informatics Research · doi:10.1007/s41666-026-00242-y · Cited by 1
Vision Language Models Learn to Assess Images with Specialists
Do, Q. V., Yoon, S., Zhang, R., Nagarajah, T., Bui, T., & Lai, V. D. (2026) · IEEE/CVF Winter Conference on Applications of Computer Vision Workshops (WACVW) · doi:10.1109/wacvw68408.2026.00123 · Cited by 1
Generative AI in urban science and practice
Zhang, Y., Xu, F., Wang, Q., Moro, E., Yue, Y., Wang, H., Чэн, Б., Liu, Y., Fang, D., Gong, P., et al. (2026) · Nature Cities · doi:10.1038/s44284-026-00492-2 · Cited by 1
CDRRM: Contrast-Driven Rubric Generation for Reliable and Interpretable Reward Modeling
Liu, D., Yang, F., Wang, X., Yan, S., Chai, J., Li, J., Ban, Y., Mao, Z., Lin, W., & Yin, G. (2026) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3770855.3817703 · Cited by 1
Goudarzi, A., & Zonouz, A. N. (2026) · Digital studies in language and literature · doi:10.1515/dsll-2026-0052 · Cited by 1
Breaking the Likelihood Trap: Consistent Generative Recommendation with Graph-structured Model
Yang, Q., Liang, X., Xiao, Z., Cao, Y., Deng, Y., Ren, Y., Wang, Y., & Liu, Y. (2026) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3770855.3818326 · Cited by 2
Entrywise Error Bounds for Spectral Ranking with Semi-Random Adversaries
Lee, D. D., Makur, A., & Singh, J. (2026) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3770855.3818135 · Cited by 1
Perturbed Public Voices (P 2 V): A Dataset for Robust Audio Deepfake Detection
Gao, C., Postiglione, M., Gortner, I., Kraus, S., & Subrahmanian, V. S. (2026) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3770855.3817542 · Cited by 2
Pavlopoulos, V. (2026) · Analytics · doi:10.3390/analytics5030030 · Cited by 1
Ye, S., Wang, L., & Chen, P. (2026) · Frontiers in Genetics · doi:10.3389/fgene.2026.1880490 · Cited by 1
Yi, Z., Zhao, J., Lv, J., & Wang, T. (2026) · Information Fusion · doi:10.1016/j.inffus.2026.104700 · Cited by 1
Soares, D. D. C., Bittencourt, L. E. B. D. F., & Tessmann, M. S. (2026) · Journal of Behavioral and Experimental Finance · doi:10.1016/j.jbef.2026.101235 · Cited by 2
A survey of reward hacking in agentic large language model systems
Morampudi, A., Irrink, U., Grandhi, R., Pagadala, V., & Maddula, M. (2026) · Discover Artificial Intelligence · doi:10.1007/s44163-026-01980-z · Cited by 1
Kim, H., Moon, J., & Baik, N. (2026) · Electronics · doi:10.3390/electronics15163643 · Cited by 1
Cross-Domain Explainable AI for Customer Recommendations, Fraud Detection, and Network Intelligence
Sribhashyam, N. S. A. S., & Ayyamgari, S. (2026) · International Journal of Advanced Research in Science Communication and Technology · doi:10.48175/ijarsct-38057 · Cited by 1
Detecting Manipulated LLM Outputs via Siamese Transformers and Semantic Dependency Graphs
Xu, Y. (2026) · doi:10.1145/3810280.3810295 · Cited by 5
Samy, A., Moro, A., & Taher, M. (2026) · Applied Sciences · doi:10.3390/app16178443 · Cited by 1
Nyilas, G., Fleiner, R., & Kail, E. (2026) · IEEE International Conference on Intelligent Engineering Systems (INES) · doi:10.1109/ines69513.2026.11661061 · Cited by 1
Hallucination detection, verification, and correction in generative AI: A comprehensive survey
Waqas, S. M., Umer, Z., Alim, A., Arham, M., Su’ud, M. M., Kazmi, S. J. A., & Alam, M. M. (2026) · Natural Language Processing Journal · doi:10.1016/j.nlp.2026.100231 · Cited by 1
Shi, F., Yang, J., Lifelo, Z., Ding, J., & Ning, H. (2026) · Artificial Intelligence Review · doi:10.1007/s10462-026-11691-7 · Cited by 1
Privacy-Preserving Cross-Workflow Recommendation via Federated Learning on Semantic Knowledge Graphs
Zhang, J., Liu, C., Xie, X., Han, Z., Ramachandran, R., Lee, T. J., & Lee, S. (2026) · IEEE International Conference on Software Services Engineering (SSE) · doi:10.1109/sse72781.2026.00027 · Cited by 1
Chen, Y., Ma, C., Li, Q., Yan, F., Chen, Y., Li, T., Ye, J., Hu, M., Lin, Y., Li, Y., et al. (2026) · Nature Cancer · doi:10.1038/s43018-026-01220-4 · Cited by 2
Ojetunde, S. M., & Ramnarain, U. D. (2026) · Journal of Technology in Behavioral Science · doi:10.1007/s41347-026-00706-3 · Cited by 1
Ramani, A., & Venugopalan, M. (2026) · Discover Artificial Intelligence · doi:10.1007/s44163-026-02106-1
Piterman, D., Dery, H., Bar, K., Meinlschmidt, G., Geller, A., Hadar‐Shoval, D., Elyoseph, Z., & Refoua, E. (2026) · Scientific Reports · doi:10.1038/s41598-026-58013-z · Cited by 2
Herrera, L., Rojas, D., & Castro, A. (2024) · Journal of Artificial Intelligence for Healthcare Systems · doi:10.68159/b246057097 · Cited by 1
Fatouros, G., Mavrogiorgos, K., Makridis, G., Soldatos, J., & Kyriazis, D. (2026) · Journal of Cybersecurity and Privacy · doi:10.3390/jcp6050159 · Cited by 1
Towards Reliable Medical Large Vision-Language Models via Counterfactual Preference Optimization
Zhu, X., Wang, N., Patwari, K., Sun, L., Chuah, C., & Pang, C. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37098-3_29 · Cited by 1
Reject-before-aggregate reward modeling for curriculum-constrained mathematical reasoning
Chen, K., Qiu, Y., Lin, W., Xia, Q., & Chen, J. (2026) · Neurocomputing · doi:10.1016/j.neucom.2026.135077 · Cited by 1
Tool or Companion? Reframing Conversational AI to Prevent Psychological Harm
Novelli, A. M., Shergill, S. S., & Teixeira, A. S. (2026) · JMIR Mental Health · doi:10.2196/99354 · Cited by 1
Kyurkchiev, P., & Iliev, A. I. (2026) · Future Internet · doi:10.3390/fi18090481 · Cited by 1
Large language models as human proxies
Karetnikov, N., Rahwan, I., & Svetinović, D. (2026) · Nature Computational Science · doi:10.1038/s43588-026-01060-3 · Cited by 6
CoMa: Contextual Massing Generation with Vision-Language Models
Maslov, E., Vabnits, A., Vorona, V., Antsiferova, A., Khrulkov, V., Volkova, A., Gusarov, A., Кузнецов, А. В., & Oseledets, I. (2026) · Smart Cities · doi:10.3390/smartcities9090153 · Cited by 1
Cross‐lingual safety asymmetry in open‐weight LLMs
Chae, S., & 길영환 (2026) · ETRI Journal · doi:10.4218/etrij.2026-0180 · Cited by 1
UbiHearo: Bringing Scenario-Aware Sound Guidance to DHH Users with Mobile Agents
Wu, F. 中., Liu, S., Zhou, Z., Xu, C., Zhao, W., Sun, P., & Yu, Z. (2026) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3832010 · Cited by 1
BinRAG: An RAG-Based Decompilation Framework Fusing Name Prediction and Calling Context
Wong, W. K., Wu, D., Liu, Z., Wang, H., Li, Z., & Wang, S. (2026) · Proceedings of the ACM on software engineering. · doi:10.1145/3832245 · Cited by 2
Bacu, V. I., Nandra, C. I., Ştefănuţ, T., Sabou, A., Miok, K., Patoka, J., Graham, Z. A., Hartzell, S. M., Lieb, D. A., Huber, A. F., et al. (2026) · Ecological Informatics · doi:10.1016/j.ecoinf.2026.104075 · Cited by 1
TT-SI: Self-Improving LLM Agents with Test-Time Training
Acikgoz, E. C., Qian, C., Ji, H., Hakkani-Tür, D., & Tur, G. (2026) · Findings of the Association for Computational Linguistics: ACL 2026 · doi:10.18653/v1/2026.findings-acl.462 · Cited by 1
“It involves collecting large-scale training datasets (Ouyang et al., 2022; Wang et al., 2023; Zeng et al., 2024) (either human-curated or LLM-synthesized) and fine-tuning models on them (Grattafiori et al., 2024; Zeng et al., 2024; Acikgoz et al., 2025).”
Schimmelpfennig, R., Díaz, M., Prabhakaran, V., & Davani, A. (2025) · arXiv · doi:10.48550/arxiv.2512.17898 · Cited by 2
McEval: Massively Multilingual Code Evaluation
Chai, L., Liu, S., Yang, J., Yin, Y., Jin, K., Liu, J., Sun, T., Zhang, G., Ren, C., Guo, H., et al. (2024) · arXiv · doi:10.48550/arxiv.2406.07436 · Cited by 73
“Code LLMs with a large number of parameters (e.g. 7B, 13B, or larger) are pre-trained on large-scale code databases with self-supervised autoregressive objectives, followed by instruction tuning (Ouyang et al., 2022) for aligning to human preferences and downstream code-related tasks.”
BackgroundA-MemGuard: A Proactive Defense Framework for LLM-Based Agent Memory
Wei, Q., Yang, T., Wang, Y., Li, X., Li, L., Yin, Z., Zhan, Y., Holz, T., Lin, Z., & Wang, X. (2025) · arXiv · doi:10.48550/arxiv.2510.02373 · Cited by 1
“Existing defenses like prompt filtering (Inan et al., 2023), alignment (Ouyang et al., 2022), and perplexity detection (Alon & Kamfonas, 2023) are fundamentally ill-equipped for these threats because they perform isolated audits.”
SkillsBench: Benchmarking How Well Agent Skills Work Across Diverse Tasks
Li, X., Liu, Y., Chen, W., You, B., Di, Z., He, Y., Zheng, S., Choe, K. W., Sun, J., Wang, S., et al. (2026) · arXiv · doi:10.48550/arxiv.2602.12670 · Cited by 438
“Large language models (LLMs) have evolved from text generators into autonomous agents capable of executing complex, multi-step tasks in real-world environments (Brown et al., 2020; Chowdhery et al., 2023; Touvron et al., 2023; Ouyang et al., 2022; Yao et al., 2022).”
No Free Labels: Limitations of LLM-as-a-Judge Without Human Grounding
Krumdick, M., Lovering, C., Reddy, V., Ebner, S., & Tanner, C. (2025) · arXiv · doi:10.48550/arxiv.2503.05061 · Cited by 1
““None” means having no reference, “Self” means having a reference generated by the judge model, and “Human” means having a human-written gold reference. and ArenaHardAuto (Li et al., 2024b) are commonly used to evaluate the conversational capabilities of frontier language models.”
Search Arena: Analyzing Search-Augmented LLMs
Miroyan, M., Wu, T.-H., King, L., Li, T., Pan, J., Hu, X., Chiang, W.-L., Angelopoulos, A. N., Darrell, T., Norouzi, N., et al. (2025) · arXiv · doi:10.48550/arxiv.2506.05334 · Cited by 1
“Second, because conversational data with human preferences is personal and potentially valuable for model improvement [44], its release requires careful consideration of both privacy and equitable access across the community.”
RewardBench 2: Advancing Reward Model Evaluation
Malik, S., Pyatkin, V., Land, S., Morrison, J., Smith, N. A., Hajishirzi, H., & Lambert, N. (2025) · arXiv · doi:10.48550/arxiv.2506.01937 · Cited by 1
“Training for three epochs does not lead to strong benefits in any of the tested configurations (though it does occasionally slightly help, particularly at lower learning rates and in the Ties subset), even considering different training data and base models, so we drop training for three epochs…”
InfluentialArtificial Hivemind: The Open-Ended Homogeneity of Language Models (and Beyond)
Jiang, L., Chai, Y., Li, M., Liu, M., Fok, R., Dziri, N., Tsvetkov, Y., Sap, M., Albalak, A., & Choi, Y. (2025) · arXiv · doi:10.48550/arxiv.2510.22954 · Cited by 107
Do as We Do, Not as You Think: the Conformity of Large Language Models
Weng, Z., Chen, G., & Wang, W. (2025) · arXiv · doi:10.48550/arxiv.2501.13381 · Cited by 1
“5 [45], GPT-4o [46]), and nine open-source LLMs (Llama3 [47], Llama3.”
VisualWebArena: Evaluating Multimodal Agents on Realistic Visual Web Tasks
Koh, J. Y., Lo, R., Jang, L., Duvvur, V., Lim, M. C., Huang, P.-Y., Neubig, G., Zhou, S., Salakhutdinov, R., & Fried, D. (2024) · arXiv · doi:10.48550/arxiv.2401.13649 · Cited by 1
The Extractive-Abstractive Spectrum: Uncovering Verifiability Trade-offs in LLM Generations
Worledge, T., Hashimoto, T., & Guestrin, C. (2024) · arXiv · doi:10.48550/arxiv.2411.17375 · Cited by 1
GTR: Guided Thought Reinforcement Prevents Thought Collapse in RL-Based VLM Agent Training
Wei, T., Yang, Y., Xing, J., Shi, Y., Lu, Z., & Ye, D. (2025) · 2025 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.01752 · Cited by 1
“Some studies focus on RL from human feedback (RLHF), which leverages human feedback datasets to learn a reward model and then conducts reinforcement learning [1, 26, 28, 38, 40, 41, 64].”
Learning safe behaviour via justified human preferences and hypothetical queries
Kazantzidis, I., Norman, T. J., Du, Y., & Freeman, C. T. (2026) · Autonomous Agents and Multi-Agent Systems · doi:10.21203/rs.3.rs-2406802/v1 · Cited by 1
Online learning with binary feedback for multi-class problems
Lucas, E., Whitaker, S., & Havens, T. C. (2022) · IEEE Symposium Series on Computational Intelligence (SSCI) · doi:10.1109/ssci51031.2022.10022153 · Cited by 1
Interpreting Art by Leveraging Pre-Trained Models
Penzel, N., & Denzler, J. (2023) · doi:10.23919/mva57639.2023.10216010 · Cited by 2
PICO: An Approach to Build Dataset for Customer Service Chatbot
Li, D., Peng, F., Ma, G., Wang, Z., & Wang, Q. (2023) · IEEE International Conference on Real-time Computing and Robotics (RCAR) · doi:10.1109/rcar58764.2023.10250131 · Cited by 1
Research on MacBERT-Based Multi-Type Questions Extractive Machine Reading Comprehension
Wang, X., Bao, Y., Li, Y., Ge, F., Qi, Y., & Wang, S. (2023) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/smc53992.2023.10394536 · Cited by 1
Data Augmentation with GPT-3.5 for Vietnamese Natural Language Inference
Mai, H.-H., & Luong, N. H. (2023) · RIVF International Conference on Computing and Communication Technologies (RIVF) · doi:10.1109/rivf60135.2023.10471880 · Cited by 3
Generative Semantic Modeling for Structured Data Source with Large Language Model
Ding, N., Mayer, W., Geng, Y., Duan, Y., & Feng, Z. (2023) · IEEE International Conference on High Performance Computing and Communications; IEEE International Conference on Smart City; IEEE International Conference on Data Science and Systems (HPCC/SmartCity/DSS) · doi:10.1109/hpcc-dss-smartcity-dependsys60770.2023.00164 · Cited by 1
Efficient Cloud Cluster Resource Scheduling with Deep Reinforcement Learning
Liu, X., Dong, B., & Hao, F. (2023) · International Conference on Advanced Cloud and Big Data · doi:10.1109/cbd63341.2023.00015 · Cited by 1
Measuring Similarity of Dual-Modal Academic Data Based on Multi-Fusion Representation Learning
Zhang, L., Gao, Q., Liu, M., Gu, Z., & Lang, B. (2024) · IEEE Access · doi:10.1109/access.2024.3427731 · Cited by 2
A Comparative Study of Contemporary Learning Paradigms in Bug Report Priority Detection
Yılmaz, E. H., Toroslu, İ. H., & Köksal, Ö. (2024) · IEEE Access · doi:10.1109/access.2024.3451125 · Cited by 2
Training Large Language Models to Follow System Prompt with Self-Supervised Fine-tuning
Qiu, J., & Yang, Y. (2024) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn60899.2024.10651145 · Cited by 1
Exploiting Visual Relation and Multi-Grained Knowledge for Multimodal Relation Extraction
Shen, Q., Lin, H., Liu, H., Zheng, L. L., & Wang, W. (2024) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn60899.2024.10650770 · Cited by 6
Peng, R., Huang, L., & Yu, X. (2024) · Applied Sciences · doi:10.3390/app14188184 · Cited by 1
Internet Inter-Domain Path Inferring: Methods, Applications, and Future Directions
Li, X., Wang, C., Yang, Y., Hou, C., Hou, B., & Cai, Z. (2024) · Computers, materials & continua/Computers, materials & continua (Print) · doi:10.32604/cmc.2024.055186 · Cited by 1
Evaluating Few-Shot Learning Generative Honeypots in A Live Deployment
Ragsdale, J., & Boppana, R. V. (2024) · IEEE International Conference on Cyber Security and Resilience (CSR) · doi:10.1109/csr61664.2024.10679421 · Cited by 1
Towards Cross-Domain Multimodal Automated Service Regulation Systems
Yin, J., Zhao, T., & Kuang, L. (2024) · IEEE International Conference on Web Services (ICWS) · doi:10.1109/icws62655.2024.00064 · Cited by 1
UniMotion-DM: Uniform Text-Motion Generation and Editing via Diffusion Model
Lin, S., & Hou, W. (2024) · IEEE Access · doi:10.1109/access.2024.3518300 · Cited by 1
Lee, J., Park, S., Kwon, Y., Lee, J., Ahn, M., & Choi, S. (2024) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros58592.2024.10801806 · Cited by 1
Nonparallel Spoken-Text-Style Transfer for Linguistic Expression Control in Speech Generation
Yoshioka, D., Yasuda, Y., & Toda, T. (2025) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/taslpro.2024.3522757 · Cited by 1
Animating the Past: Reconstruct Trilobite via Video Generation
Wu, X., Huang, Z., & Yu, C. (2024) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata62323.2024.10825790 · Cited by 1
Lin, H., Chen, Y., Tao, W., Chen, M., Xu, X., & Xing, X. (2024) · IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt61566.2024.10832316 · Cited by 1
Translating Formal Specs: Event-B to English
Vanhari, F. K. (2024) · IEEE International Conference on Collaborative Advances in Software and Computing (CASCON) · doi:10.1109/cascon62161.2024.10838142 · Cited by 1
Lu, G., He, C., & Shen, L. (2024) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/smc54092.2024.10831420 · Cited by 1
Revolutionizing Wireless Modeling and Simulation with Network-Oriented LLMs
Liu, J., Peng, Z., Xu, D., & Liu, Y. (2024) · IEEE International Performance, Computing, and Communications Conference · doi:10.1109/ipccc59868.2024.10850042 · Cited by 5
Understanding User Continuance for Generative AI: An Exploration Through the Theory of Trying
Hou, A. C. Y., Yang, Y., & Hou, Y. T. (2024) · International Conference on Artificial Intelligence and Software Engineering (ICAISE) · doi:10.1109/icaise65384.2024.00018 · Cited by 1
ChatGPT and BERT: Comparative Analysis of Various Natural Language Processing Applications
Saranya, M., & Amutha, B. (2025) · Springer eBooks · doi:10.1007/978-981-96-2355-6_2 · Cited by 1
Liu, J., Fu, T., Zhou, F., & Wang, C. (2024) · IEEE International Conference on Robotics and Biomimetics (ROBIO) · doi:10.1109/robio64047.2024.10907522 · Cited by 1
Sentiment Bias and Security Analysis in Training Datasets of Large Language Models
Inoshita, K., & Zhou, X. (2024) · IEEE International Conference on Big Data and Cloud Computing (BDCloud) · doi:10.1109/bdcloud63169.2024.00008 · Cited by 2
Improving Generated and Retrieved Knowledge Combination Through Zero-shot Generation
Du, X., Han, Q., Lv, C., Liu, Y., Sun, Y., Shu, H., Shan, H., & Sun, M. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10889018 · Cited by 3
Zhang, Y., Zhang, B., Li, Z., Li, M., Cheng, N., Chen, M., Wei, T., Ma, J., Wang, S., & Xiao, J. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10887840 · Cited by 5
Higuchi, Y., Ogawa, T., & Kobayashi, T. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10890174 · Cited by 2
Learning Hierarchical Attribute Prompt for Vision-Language Models
Liang, J., Peng, Y., Luo, R., Zou, Y., Cheng, Y., & Chen, B. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10890675 · Cited by 1
ViCo: A Multitask Video-enhanced and Cognition-preserving Modality Alignment Training Framework
Yu, Z., Chen, J., Shen, J., Zhou, L., Fang, H., Zang, X., Ban, C., Chen, J., He, Z., Sun, H., et al. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10888636 · Cited by 1
ReMP: Reusable Motion Prior for Multi-domain 3D Human Pose Estimation and Motion Inbetweening
Jang, H., & Kim, Y. M. (2025) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv61041.2025.00246 · Cited by 1
Du, K., Zhang, X., Gao, C., Shang, W., Ma, Y., Jin, Z. X., & Li, L. (2025) · Expert Systems with Applications · doi:10.1016/j.eswa.2025.127569 · Cited by 2
EEG-ARNet: An Autoregressive Pre-training Model for Extracting EEG Features
Wu, A., Zhang, Y., Yu, Y., & Zeng, L. (2024) · International Conference on Computers and Artificial Intelligence Technology (CAIT) · doi:10.1109/cait64506.2024.10962980 · Cited by 1
Luo, Q., Shao, Q., Zhang, Z., Zhang, B., & Shi, J. D. (2025) · Engineering Research Express · doi:10.1088/2631-8695/add642 · Cited by 2
Cui, Y., Zhao, F., Jiao, Y., Su, Y. J., Zhou, Y., & Liu, J. (2025) · International Conference on Smart Grid and Artificial Intelligence (SGAI) · doi:10.1109/sgai64825.2025.11009601 · Cited by 1
Metadata
- Authors
- Ouyang, L., Wu, J., Jiang, X., Almeida, D., Wainwright, C., Mishkin, P., Zhang, C., Agarwal, S., Slama, K., Ray, A., Schulman, J., Hilton, J., Kelton, F., Miller, L., Simens, M., Askell, A., Welinder, P., Christiano, P., Leike, J., & Lowe, R.
- Venue
- Advances in Neural Information Processing Systems 35
- Published
- 2022
- Pages
- 27730-27744
- ISSN
- 1049-5258 (ISSN-L)
- OpenAlex
- W7133211372
- Cited by
- 3,117
- References
- 0
- Citations by year
- 2026: 1421 · 2025: 544 · 2024: 852 · 2023: 297 · 2022: 3
- FWCI
- 234.27
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- neural information processing systems (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Keywords
- instruction following, language models, human feedback, reinforcement learning from human feedback, large language models
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.