Training Language Models to Follow Instructions with Human Feedback
The DOI matches its Crossref record; 2 of the 2 references it cites were found in a registry or an index.
Abstract
Making language models bigger does not inherently make them better at following a user's intent. For example, large language models can generate outputs that are untruthful, toxic, or simply not helpful to the user. In other words, these models are not aligned with their users. In this paper, we show an avenue for aligning language models with user intent on a wide range of tasks by fine-tuning with human feedback. Starting with a set of labeler-written prompts and prompts submitted through the OpenAI API, we collect a dataset of labeler demonstrations of the desired model behavior, which we use to fine-tune GPT-3 using supervised learning. We then collect a dataset of rankings of model outputs, which we use to further fine-tune this supervised model using reinforcement learning from human feedback. We call the resulting models InstructGPT. In human evaluations on our prompt distribution, outputs from the 1.3B parameter InstructGPT model are preferred to outputs from the 175B GPT-3, despite having 100x fewer parameters. Moreover, InstructGPT models show improvements in truthfulness and reductions in toxic output generation while having minimal performance regressions on public NLP datasets. Even though InstructGPT still makes simple mistakes, our results show that fine-tuning with human feedback is a promising direction for aligning language models with human intent.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Existing literature (Ouyang et al., 2022) does not fully describe the details of these models, such as the pretraining corpus, model sizes, and model biases.”
From Self-Refine: Iterative Refinement with Self-Feedback (2023) · cites this paper as Ouyang et al., 2022
Experimental — accuracy not yet measuredIn the citing paper
“Specifically, providers mitigate race and gender bias through reinforcement learning from human feedback (RLHF), adversarial stress-testing known as red teaming, and hard-coded refusals governed by the provider's own content policies [6, 43, 71].”
From All Public Voices Are Equal, But Are Some More Equal Than Others to LLMs? (2026) · cites this paper as [71]
In the citing paper
“Fine-tuning a model from human feedback at scale, using preference data from paid raters or drawn from a large and willing user base, is an especially potent technique.It has the potential not only to shape a model's responses to better reflect user norms (for better or worse), but also to filter out toxic language, improve factual accuracy, and mitigate the tendency to fabricate information.”
From Talking about Large Language Models (2024) · cites this paper as [26]
In the citing paper
“These include general competencies such as in-context learning (ICL) [13], chain-of-thought (CoT) [17] reasoning, and instruction following [25], as well as task-specialized skills like mathematical reasoning [30].”
From A Survey of Large Language Models (2026) · cites this paper as [25]
In the citing paper
“When external reward models or ground-truth answers are available, rejection sampling can also be applied to select higher-quality responses from multiple candidates [25].”
From A Survey of Large Language Models (2026) · cites this paper as [25]
41 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
The publisher hasn’t deposited this paper’s reference list.
Cited by
Items 3,101–3,200 of 4,340
Large Language Model Based Multimodal Translation System
Zheng, J. (2024) · International Conference on Quantum Information and Quantum Computing (QIQC) · doi:10.1109/qiqc63873.2024.00034
AISA: A Hybrid Human-AI Evaluation Framework for Trustworthy AI Benchmarking
Hardouz, Y. E. (2026) · International Conference on Electronics, Computers and Artificial Intelligence (ECAI) · doi:10.1109/ecai69016.2026.11613802
Zhou, X. (2026) · Applied Psychological Measurement · doi:10.1177/01466216261471171
Grounding Corporate Environmental Claims in Satellite Evidence with Large Language ModelsPreprint
Vaghefi, S. A., Senni, C. C., Huggel, C., & Leippold, M. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7084378
Transformer Models and their Cross-Domain Applications: A Systematic Review
Pathania, K., Singh, S., & Sharma, A. (2026) · Archives of Computational Methods in Engineering · doi:10.1007/s11831-026-10742-0
Direct preference optimization with Pareto dominance constraint for online multi-objective alignment
Xie, H., Ban, Y., Fang, R., Wu, D., Huang, Z., Wang, D., Li, J., & Song, S. (2026) · Neurocomputing · doi:10.1016/j.neucom.2026.134604 · Cited by 1
Literacidad en IA: Funcionamiento, Sesgos y Operatividad de los LLMs
Joaquín, R. A. R. (2026) · Espila · doi:10.61454/yhetdk61
Evaluation of Plate Homogeneity in Cell-Based Potency Assays Using Large Language Models
Košir, R., Uzar, A., Brvar, L., & Oven, I. (2026) · Biophysica · doi:10.3390/biophysica6040066
Grounded Refusal in Dialogue Troubleshooting Agents via Constrained Reinforcement Learning
Li, X., Jin, D., Chen, S., Li, W., & Guo, J. (2026) · International Conference on Computer Intelligence and Software Engineering (CICSE) · doi:10.1109/cicse70286.2026.11620948
Mechanistic Perspectives on LLM Jailbreaks and Internal Defenses
Huang, Y., Wang, Y., & Zhang, Y. (2026) · International Conference on Artificial Intelligence, Big Data and Algorithms (CAIBDA) · doi:10.1109/caibda70336.2026.11621239
Knowledge Organization of Local Standards Using LLMs and Knowledge Graphs
Zhu, L., Rahman, S. A., & Timan, H. (2026) · International Conference on Artificial Intelligence, Big Data and Algorithms (CAIBDA) · doi:10.1109/caibda70336.2026.11621066
Prompt Engineering Techniques for Enhanced LLM Reasoning Capabilities
Shah, J. A., Jangid, H., Jangid, H., Patel, M., Gadiraju, R. K., & Mahmud, F. (2026) · International Conference on Intelligent Technologies (CONIT) · doi:10.1109/conit69683.2026.11621384
Saneei, P., Rahimi, P., & Bidgoli, B. M. (2026) · International Interdisciplinary Conference on Artificial Intelligence: Engineering, Health, Finance and Humanities (IICAI) · doi:10.1109/iicai70155.2026.11620905
Conceptual blending in humans and language models
Lynn, S. K. (2026) · Frontiers in Psychology · doi:10.3389/fpsyg.2026.1849083
Shared Intelligence and Misaligned Firm EntryPreprint
Chi, F., & Yang, N. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6799682
Growing Domain-Specific LLMs Through Federated Split-Phase Learning: System Design and Analysis
Zhao, S., & Keshtkar, S. (2026) · International Conference on Federated Learning and Intelligent Computing Systems (FLICS) · doi:10.1109/flics70075.2026.11621959 · Cited by 1
Prompt Engineering Strategies for Automated Software Requirements Classification
Zhu, L. (2026) · International Conference on Big Data & Artificial Intelligence & Software Engineering (ICBASE) · doi:10.1109/icbase70763.2026.11619374
Choudhary, K. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7013978
Mattsson, I., Chang, M. L., Nikookar, N., Kim, J., Eslami, M., & London, A. J. (2026) · AI and Ethics · doi:10.1007/s43681-026-01166-4
Adaptive Diffusion Vision-Language Models for Reliable Medical Image Understanding
Qamar, S., & Alshmrani, G. M. (2026) · Technologies · doi:10.3390/technologies14080464 · Cited by 1
Zhang, L., Sun, Z., Bai, Y., Lu, Y., Zeng, R., Zhang, H., & Fu, W. (2026) · International Conference on Big Data & Artificial Intelligence & Software Engineering (ICBASE) · doi:10.1109/icbase70763.2026.11619502
Shopping By Algorithm: How Agentic AI Deploys Human Heuristics as a Surrogate ConsumerPreprint
Wadi, D., & Ma, Y. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6938899
Yu, Z., Wang, C., Xu, M., Huang, Y. J., Tian, K., & Qin, Y. (2026) · Computers · doi:10.3390/computers15080487
Zeng, J., Zhu, X., Shen, S., Li, S., Liu, X., Zhang, Q., & Cao, S. (2026) · Journal of Clinical Nursing · doi:10.1111/jocn.70478 · Cited by 1
A primer on artificial intelligence for palliative care educators
Simoni, J., & Simoni, D. A. (2026) · Palliative Care and Social Practice · doi:10.1177/26323524261474075 · Cited by 1
A Human-in-the-Loop Framework for Outage Scheduling of Power Grids via LLM-RL Coordination
Ding, Z., Lv, J., Tang, W., Lv, K., Mao, X., & Zhang, Q. (2026) · Machines · doi:10.3390/machines14080860
Complexity-aware synergistic distillation for efficient abstractive summarization
Wang, G., Wang, D., Liu, S., Wang, K., Liu, X., Qiang, J., & Liu, J. (2026) · Knowledge-Based Systems · doi:10.1016/j.knosys.2026.116782
Dey, R. K., Nath, S., Mukherjee, D., Ray, B., Mahapatra, K., & Swastik, B. (2026) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3693-3751-6.ch003
Li, C., & Zhang, M. (2026) · Annals of the New York Academy of Sciences · doi:10.1111/nyas.70360
Oakenfull, G. W. (2026) · Frontiers in Computer Science · doi:10.3389/fcomp.2026.1829545
Dialogue Style Transfer for Multiple Characters
Pravosud, R., & Marchenko, O. O. (2026) · Cybernetics and Systems Analysis · doi:10.1007/s10559-026-00891-2
Tripathi, M., Dhital, D., & Aryal, H. (2026) · International Conference on Software Engineering Research and Applications · doi:10.1109/sera69989.2026.11618608
Retrieval-Augmented Generation for Trustworthy Enterprise LLM Assistants
B, B. P. (2026) · International Journal of Information Technology Research Studies (IJITRS) · doi:10.63090/ijitrs/3139.3209.0033
Shankar, G., Ma, C., & Shirke, R. (2026) · IEEE Cloud Summit · doi:10.1109/cloudsummit68932.2026.00009
Li, B., Xu, Z., Zhang, S., & Ye, W. (2026) · Neurocomputing · doi:10.1016/j.neucom.2026.134582
Zhang, H., Xu, H., Zhang, H., Huang, Y., Huang, H., Huang, Y., Ding, X., & Lin, H. (2026) · IEEE Transactions on Aerospace and Electronic Systems · doi:10.1109/taes.2026.3719218
REVERIE+: Generalized Reflective Instruction Tuning for Hallucination Mitigation in Advanced VLMs
Bi, M., Zhang, J.-R., Wang, X.-C., Jiang, X., Lu, Y., Wang, P., & Zheng, F. (2026) · International Journal of Computer Vision · doi:10.1007/s11263-026-02945-6
Self-citationIDPAD: Implicit and Dynamic Preference Alignment During Decoding
Cai, X. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-31673-8_46
Gradient Guided LoRA for Stable Fine-Tuning of LLMs
Ma, Y., Yang, P., Fang, H., & Zhang, X.-Y. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-31920-3_21
Big Data and Machine Learning Methods
Mützel, S. (2026) · Springer eBooks · doi:10.1007/978-3-032-11405-1_56
Exploring occupational prestige through large language models: A multi-dimensional approach
de Vries, R., Hill, M., & Ruis, L. (2026) · Research in Social Stratification and Mobility · doi:10.1016/j.rssm.2026.101185 · Cited by 2
PRADA-QA: Product QA with Multi-Agent Planning and Dynamic Knowledge Retrieval
Nguyen, H.-D., Do, T.-D., Nguyễn, V. C., Tran, O. T., & Le, D.-T. (2026) · Communications in computer and information science · doi:10.1007/978-981-92-2590-3_24
Nussbaum, M., & Bekerman, Z. (2026) · Systems Research and Behavioral Science · doi:10.1002/sres.70124
Artificial intelligence and PDFs: A paradigm shift from reading text to understanding meaningPreprint
Alalaq, A. S. (2026) · doi:10.24108/preprints-3116046
Reinforcement learning steers generative crystal design
Cao, Z., & Wang, L. (2026) · Nature Machine Intelligence · doi:10.1038/s42256-026-01282-0
L'IA et l'IA générative à l'université
Vialfont, A. (2026) · doi:10.3917/ems.marzo.2026.01.0053
Narayan, A., Mariajoseph, F. P., Farooq, M., Praeger, A., & Moore, J. M. (2026) · Neurosurgical Review · doi:10.1007/s10143-026-04419-2
Effect of evaluation prompt strategies on LLM-as-a-judge reliability in critical care
Yan, J.-Y., Chan, W.-S., Chiu, C., Chao, A., Hsiao, P., Ku, S., & Yeh, Y. (2026) · Anaesthesiology Intensive Therapy · doi:10.5114/ait/221943
MC-GRPO: Median-Centered Group Relative Policy Optimization for Small-Rollout Reinforcement LearningPreprint
Kim, Y. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7225572
IKEA: Intelligent Knowledge Extraction with Reasonable and Agentic AI Agents
Alghamdi, M. M. M., & Alamri, W. A. (2026) · Applied Sciences · doi:10.3390/app16157704 · Cited by 1
Everything Is Prediction: Modern Machine Learning as Bayesian Inference
Polson, N. G., Sokolov, V., & Soyer, R. (2026) · Entropy · doi:10.3390/e28080869
Vishal, A. S., Kannan, S., Durai, S. K., Preetam, T. B., Duraisamy, P., & Keerthika, T. (2026) · Lecture notes in networks and systems · doi:10.1007/978-3-032-30005-8_25
Li, W., Liu, Y., Chen, R., & Buyya, R. (2026) · Software Practice and Experience · doi:10.1002/spe.70098
STF-Diff: The key to image style transfer using extended style inversion is the style token filter
Zhao, H., Zhang, J., Yang, Q., Wang, C., Pu, Y., & Zhao, Z. (2026) · Knowledge-Based Systems · doi:10.1016/j.knosys.2026.116777
From Ranking to Reasoning: Explainable Web API Recommendation via Semantic Reasoning
Xu, Z., Yao, D., & Wan, Y. (2026) · IEEE International Conference on Distributed Computing Systems (ICDCS) · doi:10.1109/2575-8411.2026.00137
Benchmarking LLMs in Geoscience: A Serverless Approach using GeoBench and AWS
Parraga, O., Fachel, A., Antunes, R. S., Gonzaga, L., Veronez, M. R., Barros, R. C., & Kupssinskü, L. S. (2026) · Anais do I Simpósio de Infraestrutura Digital/Nuvem para Pesquisa (Pesquisa@Nuvem 2026) · doi:10.5753/pesquisanuvem.2026.22263
Sycophancy or Information Extraction? Evidence from Real-world Human-GAI InteractionsPreprint
Martin, X., Song, Y., Xu, D., & Xue, J. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7118424
From Prompts to Pressure: Evaluating LLM-driven Agents for GPU Stress-code Generation
GENSALE, A., Esposito, G., Guerrero-Balaguera, J.-D., Condia, J. E. R., Cagliero, L., & Reorda, M. S. (2026) · IEEE International On-Line Testing Symposium (IOLTS) · doi:10.1109/iolts69666.2026.11633814
Vatsal, S., Dubey, H., & Bajaj, A. (2026) · IEEE Access · doi:10.1109/access.2026.3720396
Constitutional AI: Scalable Alignment through Self-Critique and Revision
John, W. M. (2026) · Eduschool Journal of Artificial Intelligence Research (EJAIR) · doi:10.63090/ejair/3139.7336.0002 · Cited by 1
Optimization of Few-Shot Prompting Examples for Vulnerability Detection in Code
Elsheikh, M. O., Hassen, H. R., & Lones, M. A. (2026) · Communications in computer and information science · doi:10.1007/978-981-92-1546-1_46
Sun, S., & Liu, Y. (2026) · Robotics · doi:10.3390/robotics15080147
D3Fuzz: Dynamic, directed and decaying LLM-driven fuzzing for deep learning libraries
Sun, J., Dong, J., Zhang, H., Tian, Z., & Zhang, Y. (2026) · Information and Software Technology · doi:10.1016/j.infsof.2026.108289
Shin, D., Ham, Y., Lee, S. W., & Park, S. (2026) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3770855.3818907
Qian, J., Liang, X., Que, L., Pang, Z., Chen, S., & Zhao, F. (2026) · IEEE Access · doi:10.1109/access.2026.3721388
Parlare con le macchine: Il prompt engineering come competenza epistemica
Ciotti, F. (2026) · DigitCult - Scientific Journal on Digital Cultures · doi:10.54103/2531-5994/31801
UniRank: End-to-End Domain-Specific Reranking of Hybrid Text-Image Candidates
Yang, Y., Yang, L., Deng, W., Qu, L., Tu, S., & Xu, L. (2026) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3770855.3817796
Semantic Association vs. Position: Which Information Do Attention Heads Prefer?
Wang, M., Niu, S., Zhang, S., Wang, H., Song, S., Yin, Z., Yang, J., & Liang, X. (2026) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3770855.3818196
A Geometric Information Bottleneck for Activation Steering
Doan, T., Nguyen, T., & Gupta, S. (2026) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3770855.3818109
Towards Auditing AI Systems in the Wild
Vadlamani, A., Srinivasan, A., & Parthasarathy, S. (2026) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3770855.3818648
ANCHOR: Taming Entropy Dynamics for Stable and Efficient Reasoning of Large Language Models
Qin, C., Lin, J., Fu, X., Fang, Y., Hu, C., Zhang, H., Guo, Y., Gu, Z., Qin, K., Kang, J., et al. (2026) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3770855.3818081
SafeCRS: Personalized Safety Alignment for LLM-Based Conversational Recommender Systems
Hao, H., Xu, Y., Li, X., Ge, Y., & Cheng, L. (2026) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3770855.3817807
SHERLOCK: Towards Dynamic Knowledge Adaptation in LLM-enhanced E-commerce Risk Management
Lu, N., Hu, Y., Fang, J., Liu, Y., Dong, R., Wang, Y., Lin, R., & Xu, S. (2026) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3770855.3818480
Closing Reasoning Gaps in Clinical Agents with Differential Reasoning Learning
Liu, J., Jiang, Y., Krishnan, R., Padman, R., Zhang, Y., & Bian, J. (2026) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3770855.3818958
Wang, J., Lei, M., Yang, Y., Lin, X., Le, Y., Ma, Q., Xu, Z., Lv, Z., Ang, Y., Quan, Z., et al. (2026) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3770855.3818997
Generative Recommendation for Large-Scale Advertising
Xue, B., Liu, D., Wang, L., Sun, M. L., Peng, W., Zhang, P., Shi, S., Xu, T., Sha, Y., Liu, Z., et al. (2026) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3770855.3818424
PLeDO: Pain level detection for osteoarthritis from EMR data
Chen, Y., Cai, J., Sadman, N., Zulkernine, F. H., Queenan, J. A., & Barber, D. (2026) · Intelligent Data Analysis · doi:10.1177/1088467x261472133
SocraticChem: Physics-Grounded Socratic Inquiry for Safety-Critical Experimental Science
Ye, J., Yang, W., Zhang, B., Li, Z., Zhang, J., Yang, M., & Shi, Y. (2026) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3770855.3818151
R-Select: A Robust Multi-Metric Data Selection Approach for Fine-Tuning Large Language Models
Gao, X., Wang, X., Zhu, Y., Liu, Z., He, C., & Wu, L. (2026) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3770855.3817656 · Cited by 1
Trustworthy Agent Network: Trust in Agent Networks Must Be Baked In, Not Bolted On
Yao, Y., Yao, Y., Fan, X., Gao, J., Wang, J., Zhang, M., Ravi, S., & Joe‐Wong, C. (2026) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3770855.3818655 · Cited by 1
Distribution-Value Coevolution for Adaptive RLHF Data Scheduling
Yang, Z., Yang, Y., Zhou, C., Guan, X., Dong, B., Zhang, M., Ding, K., Zhu, H., Chen, H., & Zhang, Q. (2026) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3770855.3817990
RMEval: Bridging Reward Model Evaluation and Policy Evaluation through Ranking Consistency
Qiu, W., Zhang, X., Zhang, Y., Wang, A., Zhang, Z., & Yu, Y. (2026) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3770855.3817593
Iklassov, Z., Madmoun, H., Duhot, J.-J., & Lahlou, S. (2026) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3770855.3816459
MedJudge: Medical Multimodal Reward Modeling
He, Y., Zhang, K., Qian, J., Yuan, Z., Ye, Y., Huang, J. Y., & Sun, L. (2026) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3770855.3819019
UniEdit: A Graph-based MoE Alternative to Sequence Generation for Molecular Editing
Yu, J., Wu, Z., Zheng, Y., Pan, S., Bu, J., & Wang, H. (2026) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3770855.3818878 · Cited by 1
Generative Optimization for Incentivized Advertising with Global Level Constraints
Chen, G., Luo, N., Jiang, H., Li, D., Shu, W., Sha, T., Zeng, Y. J., Tai, W., Zhou, F., & Liu, X. (2026) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3770855.3818423
Reducing Hallucination in Enterprise AI Workflows via Hybrid Utility Minimum Bayes Risk (HUMBR)
Fang, C., Mola, J., Harman, M., Nawrocki, J., Shrivastava, V., Cheng, Y., Shah, J. M., Zand, K., Tripathi, M., Pudota, A., et al. (2026) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3770855.3818468
HyperEdit: Mitigating Hallucinations of Large Language Models via Hyperbolic Representation Editing
Lin, T., Du, J., Xue, Z., Liang, M., & Tang, R. (2026) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3770855.3818153
Caduceus: MoE Foundation Models for Unifying Biological and Natural Language
Yin, M., Zhu, Y., Wu, J., Ma, J., Zhou, H., Li, M., Zhou, Y., Chen, J., Hou, T., Ye, J., et al. (2026) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3770855.3818885
Self-citationKilaru, S. (2026) · Lecture notes in networks and systems · doi:10.1007/978-3-032-31523-6_3
AIGP: An LLM-Based Framework for Long-Term Value Alignment in E-Commerce Pricing
Ma, C., Zhang, Y., Hong, S., Wang, X., Xiao, F., & Yang, K. (2026) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3770855.3818316
SCOPE: Streaming Covariance-Orthogonal Post-Hoc Editing for Continual LLM Safety Governance
Yang, Y., Jiang, X., Dang, J., Wang, A., An, B., Wu, H., Wang, B., Peng, H., Zhao, G., Hu, B., et al. (2026) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3770855.3817993 · Cited by 1
Self-citationYang, P., Yan, Z., Ma, B., Wang, J., Li, R., & Pan, J. Z. (2026) · Expert Systems with Applications · doi:10.1016/j.eswa.2026.133844
HCFNet: Hierarchical and complementary feature embedding for remote sensing change captioning
Gao, H., Yan, Y., & Zhang, Z. (2026) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2026.07.020
Borges, G. A., & Pereira, F. S. F. (2026) · Anais do Brazilian Workshop on Social Network Analysis and Mining (BraSNAM) · doi:10.5753/brasnam.2026.23524
Retrieval-Guided Safety Alignment for Action Spaces in LLM-Based Embodied Agents
Yang, W., Han, M., Ren, F., & Zhang, J. (2026) · International Conference on Artificial Intelligence and Computing (AIC) · doi:10.1109/aic65131.2026.11633630
SummarAize: AI-Powered Research Assistant
Abin, D., Shinge, P., Garg, K., & Khairnar, D. (2026) · IEEE Global Symposium on Emerging and Communication Technologies (GSEACT) · doi:10.1109/gseact68539.2026.11620035
Intent-driven embodied artificial intelligence
Zheng, N. (2026) · National Science Review · doi:10.1093/nsr/nwag476 · Cited by 1
Metadata
- Authors
- Ouyang, L., Wu, J., Jiang, X., Almeida, D., Wainwright, C., Mishkin, P., Zhang, C., Agarwal, S., Slama, K., Ray, A., Schulman, J., Hilton, J., Kelton, F., Miller, L., Simens, M., Askell, A., Welinder, P., Christiano, P., Leike, J., & Lowe, R.
- Venue
- Advances in Neural Information Processing Systems 35
- Published
- 2022
- Pages
- 27730-27744
- ISSN
- 1049-5258 (ISSN-L)
- OpenAlex
- W7133211372
- Cited by
- 3,117
- References
- 0
- Citations by year
- 2026: 1421 · 2025: 544 · 2024: 852 · 2023: 297 · 2022: 3
- FWCI
- 234.27
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- neural information processing systems (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Keywords
- instruction following, language models, human feedback, reinforcement learning from human feedback, large language models
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.