Training Language Models to Follow Instructions with Human Feedback
The DOI matches its Crossref record; 2 of the 2 references it cites were found in a registry or an index.
Abstract
Making language models bigger does not inherently make them better at following a user's intent. For example, large language models can generate outputs that are untruthful, toxic, or simply not helpful to the user. In other words, these models are not aligned with their users. In this paper, we show an avenue for aligning language models with user intent on a wide range of tasks by fine-tuning with human feedback. Starting with a set of labeler-written prompts and prompts submitted through the OpenAI API, we collect a dataset of labeler demonstrations of the desired model behavior, which we use to fine-tune GPT-3 using supervised learning. We then collect a dataset of rankings of model outputs, which we use to further fine-tune this supervised model using reinforcement learning from human feedback. We call the resulting models InstructGPT. In human evaluations on our prompt distribution, outputs from the 1.3B parameter InstructGPT model are preferred to outputs from the 175B GPT-3, despite having 100x fewer parameters. Moreover, InstructGPT models show improvements in truthfulness and reductions in toxic output generation while having minimal performance regressions on public NLP datasets. Even though InstructGPT still makes simple mistakes, our results show that fine-tuning with human feedback is a promising direction for aligning language models with human intent.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Existing literature (Ouyang et al., 2022) does not fully describe the details of these models, such as the pretraining corpus, model sizes, and model biases.”
From Self-Refine: Iterative Refinement with Self-Feedback (2023) · cites this paper as Ouyang et al., 2022
Experimental — accuracy not yet measuredIn the citing paper
“Specifically, providers mitigate race and gender bias through reinforcement learning from human feedback (RLHF), adversarial stress-testing known as red teaming, and hard-coded refusals governed by the provider's own content policies [6, 43, 71].”
From All Public Voices Are Equal, But Are Some More Equal Than Others to LLMs? (2026) · cites this paper as [71]
In the citing paper
“Fine-tuning a model from human feedback at scale, using preference data from paid raters or drawn from a large and willing user base, is an especially potent technique.It has the potential not only to shape a model's responses to better reflect user norms (for better or worse), but also to filter out toxic language, improve factual accuracy, and mitigate the tendency to fabricate information.”
From Talking about Large Language Models (2024) · cites this paper as [26]
In the citing paper
“These include general competencies such as in-context learning (ICL) [13], chain-of-thought (CoT) [17] reasoning, and instruction following [25], as well as task-specialized skills like mathematical reasoning [30].”
From A Survey of Large Language Models (2026) · cites this paper as [25]
In the citing paper
“When external reward models or ground-truth answers are available, rejection sampling can also be applied to select higher-quality responses from multiple candidates [25].”
From A Survey of Large Language Models (2026) · cites this paper as [25]
41 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
The publisher hasn’t deposited this paper’s reference list.
Cited by
Items 2,601–2,700 of 4,340
CAPTURE: Disentangling Preference Drift from Memory Poisoning in Personalized LLM Agents
Hossain, S. M. A., Shayoni, R. K., & Morol, M. K. (2026) · arXiv · doi:10.48550/arxiv.2609.02265 · Cited by 3
“Alignment from human feedback fits a single population preference (Ouyang et al., 2022; Rafailov et al., 2023), and a growing line fits individuals instead, through profiles (Salemi et al., 2024), latent preferences learned from user edits (Gao et al., 2024), system-message generalization (Lee et…”
Think Before You Code: Dual Reasoning for the NLSafety–Utility Trade-Off in LLM Code Generation
Tan, H., Wang, H., & Tan, S. H. (2026) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1145/3832783.3834385
Park, S., Zamfirescu-Pereira, J. D., & Kulkarni, C. E. (2026) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3742413.3789119
Guo, Z., & Wang, H. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5128927 · Cited by 2
P-LRR: A LLM-Enhanced Retrieval and Reranking Framework for Policy Domain
Qi, G., Yi, N., Wang, S., Chang, W., & Yu, J. (2025) · Lecture notes in computer science · doi:10.1007/978-981-96-9921-6_38
Self-enhancing prompt optimization for language style generation
Liu, H., He, H., Yang, W., Zhou, J., & Zhao, N. (2026) · Knowledge-Based Systems · doi:10.1016/j.knosys.2026.116519
Responsible AI in Action: Navigating the Ethical Landscape of ChatGPT
Tiwari, A., & Kumar, P. (2025) · IGI Global eBooks · doi:10.4018/979-8-3373-0877-7.ch008
BP-LLM : Belief Propagation for Binary Feedback in Large Language Model Alignment
Liang, J. E. (2026) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl.a.734
Artificial Intelligence in Education
Dahiya, O. (2025) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-3561-2.ch005
Psychometric Comparability of LLM-Based Digital TwinsPreprint
Zhang, Y., & Ma, Z. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.5967255
Trejo-Macotela, F. R. (2026) · IGI Global eBooks · doi:10.4018/979-8-3373-6831-3.ch003
UniBreak: A Unified Evolutionary Token-Level Jailbreaking Framework for Large Language Models
You, S., Jiang, W., Mei, H., Gong, D., Li, Z., Yu, J., Ji, J., Lin, Q., Li, X., & Wong, K. (2026) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2026.3656951 · Cited by 1
Aqad, M. H. A., & Al-Saggaf, M. A. (2026) · IGI Global eBooks · doi:10.4018/979-8-3373-5717-1.ch008
Zero-Shot Linear Calibration Approach to Knowledge-Free Group Robust Classification
ISHIZAKI, R., & Irie, G. (2026) · IEICE Transactions on Information and Systems · doi:10.1587/transinf.2025edp7170
Devin, A. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6135630 · Cited by 3
Architectural Laws And Derived Constraints Of Verification And Consequential AI ReliancePreprint
Devin, A. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6135727
Dai, A., Zhang, J., Hu, H., Tang, G., Liu, L., & Cheng, Z. (2026) · IEEE International Conference on Data Engineering (ICDE) · doi:10.1109/icde65706.2026.00305
Çeltik, M., Şahin, E., Aydemir, S., Işın, Y., Çiçeklidağ, M., Başçı, O., & Özkan, M. (2026) · Medical Records · doi:10.37990/medr.1730013
Yang, H., Ge, W., Zhang, T., Zhang, G. Y., & Zhang, H. (2025) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata66926.2025.11401047
SPECTRUM: A Unifying Mechanism for Specific Preference Tailored Responses
Park, H. (2025) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata66926.2025.11401010
Liu, D., Wang, Y., Tian, Y., Zeng, Z., Liu, S., Zheng, W., & Xiao, Y. (2025) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata66926.2025.11400955
Shaon, M. S. H., Akter, S., & Cuzzocrea, A. (2025) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata66926.2025.11402220
Rethinking Ground Truth: A Case Study on Human Label Variation in MLLM Benchmarking
Ruiz, T., Ağustoslu, T., & Schwemmer, C. (2025) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata66926.2025.11401919
Enhancing Static Analysis for ICC Resolution: An LLM-Integrated Approach
Jiang, Y., Gong, Q., & Gong, X. (2025) · International Conference on Advanced Computer Theory and Engineering · doi:10.1109/icacte66284.2025.11411955
Examining Moral Judgment in Aligned LLMs
ATALAY, E. (2025) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata66926.2025.11402437
Scalable Task-Oriented Dialogue Systems with Mixture of Experts and Offline Reinforcement Learning
Prajapat, D., & Toshniwal, D. (2025) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata66926.2025.11402037
Aggarwal, A., & Ghalaty, N. F. (2025) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata66926.2025.11401700
Evaluation of Large Language Models for Understanding Counterfactual Reasoning in Texts
Adnan, S. I. M., Hameem, A., Anirban, S., Islam, M. S., & Anwar, M. M. (2025) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata66926.2025.11402112
Patent-GRPO: Group Relative Policy Optimization for Patent Text Generation
Lee, J.-S. (2025) · IEEE ... International Conference on Data Mining workshops · doi:10.1109/icdmw69685.2025.00089
Infusing Structural Knowledge for Language Generation with Relational Graph Diffusion
Wang, S. H., Zhang, W., Zhu, J., Wang, Z., & Xia, Y. (2025) · IEEE ... International Conference on Data Mining workshops · doi:10.1109/icdmw69685.2025.00211
Multi-Objective Preference Optimization with Behavioral Hierarchies for Persona-Aware AI
Wu, Y., & Wei, K. (2025) · IEEE International Conference on Cognitive Machine Intelligence (CogMI) · doi:10.1109/cogmi67134.2025.00064
Thought-for-Food: Reasoning Chain Induced Food Visual Question Answering
Jain, R., Patwardhan, M. S., Deshpande, P., & Runkana, V. (2025) · IEEE ... International Conference on Data Mining workshops · doi:10.1109/icdmw69685.2025.00081
Mitigating Copyright Violations in LLMs Via In-Context Role-Playing and Instructional Framing
Wu, L. (2025) · 2025 IEEE International Conference on Data Mining Workshops (ICDMW) · doi:10.1109/icdmw69685.2025.00296
Transforming Transformers: Content Generation with Advertiser Incentives under RoS ConstraintsPreprint
Alaei, S., Makhdoumi, A., & Malekian, A. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6233238
Emergent Biases in Large Language Models: A Critical Review of Taxonomy and Evaluations
Ismail, S., & Aygün, R. S. (2025) · IEEE International Conference on Cognitive Machine Intelligence (CogMI) · doi:10.1109/cogmi67134.2025.00036
Error Detection and Correction for English Learners using Neural Models
Dai, Z., Manitto, M., Chiruzzo, L., & Rosá, A. (2025) · International Conference of the Chilean Computer Science Society (SCCC) · doi:10.1109/sccc67219.2025.11420345
Group Deliberation Oriented Multi Agent Conversational Model for Complex Reasoning
Shi, Z., Qiu, D., & Yu, S. (2025) · International Academic Exchange Conference on Science and Technology Innovation (IAECST) · doi:10.1109/iaecst68792.2025.11415036
Xiao, G., Fan, C., You, W., Hu, Y., & Tseng, S.-P. (2025) · International Conference on Orange Technology (ICOT) · doi:10.1109/icot68409.2025.11425595
Improving Consistency in Vehicle Trajectory Prediction Through Preference Optimization
Azevedo, C., Achaji, L., Sabatini, S., Poerio, N., Bartyzel, G., Hornauer, S., & Moutarde, F. (2025) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc60802.2025.11423556
EPSP-SQL: Enhancing Text-To-SQL by Explicit Prompt-Based Self-Play Fine-Tuning
Liu, Y., Yang, Y., Zhu, T., Liang, Y., Chen, Y., & Yan, L. (2025) · IEEE International Conference on Artificial Intelligence, Computer Science and Information Processing (AICSIP) · doi:10.1109/aicsip65423.2025.11427190
Lin, J., Ran, P., Ning, X., Chen, L., Chen, C., Yang, K., He, S., & Su, L. (2025) · IEEE International Conference on Artificial Intelligence, Computer Science and Information Processing (AICSIP) · doi:10.1109/aicsip65423.2025.11427215
Samy, S. M., Duraisamy, S., Ali, M. F. B., Sangeetha, S. R., Subramani, S. M., Muthu, S., Karuppannan, A., & Murugesan, P. (2026) · IEEE International Students' Conference on Electrical, Electronics and Computer Science (SCEECS) · doi:10.1109/sceecs68810.2026.11430013
Introducción a la Inteligencia Artificial
Cassola-Bacallao, J. M. (2026) · doi:10.22199/fic400586050_2
Huang, H., Guo, J., Meng, T., Yang, W., Wang, T., & Weijia Jia, B. (2026) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2026.3676410
Jin, Z., Xiong, Y., Fan, C., Wu, R., Hu, Z., & Lv, T. (2026) · Lecture notes in computer science · doi:10.1007/978-981-95-7144-4_22
Say It Better by Rewriting Harmful Prompts for Responsible LLM Use
Raju, V. P., Nirkhi, S. M., Kulkarni, P., Joshi, V. K., Kumari, S., & Motghare, M. (2025) · International Conference on Artificial Intelligence and Quantum Computation-Based Sensor Application (ICAIQSA) · doi:10.1109/icaiqsa67794.2025.11440411
Improving Transferability of Data-Free Universal Adversarial Perturbations via Auxiliary Ensembles
Huang, L. W., Wang, H., Wan, C., Zhang, Z., Qiu, S., & Huang, Q. (2026) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2026.3676663 · Cited by 1
Pal, V., Kour, M., & Sethi, G. (2025) · IEEE Transportation Electrification Conference (ITEC-India) · doi:10.1109/itec-india67626.2025.11439142
Improving Instruction-Aware Retrieval with Query-Preserving Regularization
Kim, H., & Song, H.-J. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-21300-6_11
GRA: Graph-Based Role-Playing Attack for Single-Turn Jailbreak
Liu, A., Wu, Z., Wen, J., Peng, W., & Dou, C. (2026) · IEEE Signal Processing Letters · doi:10.1109/lsp.2026.3677330
Improving Reasoning Accuracy in Large Language Models via Length-Calibrated Reward
Cui, Z., Liu, D., & Ran, S.-J. (2025) · International Symposium on Artificial Intelligence and Big Data (AIBDF) · doi:10.1109/aibdf67964.2025.11440733
LiangKai, W. (2025) · International Symposium on Artificial Intelligence and Big Data (AIBDF) · doi:10.1109/aibdf67964.2025.11440774
Enhancing Generative AI with Retrieval-Augmented Generation: Techniques, Challenges and Applications
Gupta, V., Kumar, V., Gupta, P., Aggarwal, A., Ahmad, A., & Singh, S. P. (2025) · IEEE International Conference on Smart Innovations in Systems, Infrastructure, Mechanical, Power, AI and Computing Technologies (SISIMPACT) · doi:10.1109/sisimpact67725.2025.11439577
Direct Preference Optimization of Qwen 2.5 for Complex Reasoning and Debugging
Sirivuri, V. S. C. V., Maddala, G. V. S. R., & Vummadi, H. V. R. (2025) · International Conference on Recent Trends in Electrical, Electronics and Computing Technologies (ICRTEECT) · doi:10.1109/icrteect67512.2025.11448703
Dual Fine-Tuning and Dual Alignment Training for Medical Language Models
Lu, J., & Chen, Z. (2025) · International Conference on Cyberworlds (CW) · doi:10.1109/cw68232.2025.00066
Accelerating High-Fidelity Text-to-Image Synthesis via Group Relative Policy Optimization
Zhang, W., & Wang, Y. (2025) · International Conference on Computer Science and Management Technology (ICCSMT) · doi:10.1145/3795154.3795278
DHR-LLM: A Dynamic Heterogeneous Redundancy Framework for Resilient Large Language Model Inference
Chen, P.-Y., Yu, Z., & Zhang, S. (2025) · 2025 International Conference on Cyber Resilience and Endogenous Safety & Security (CRESS) · doi:10.1109/cress68073.2025.11452519
Online Knowledge Graph Construction and Visualization from Classroom Discourse with LLMs
Choi, W.-H., Hong, J., Kim, K. H., & Yoon, S. (2026) · International Conference on Artificial Intelligence in Information and Communication (ICAIIC) · doi:10.1109/icaiic68212.2026.11454216
Shyam Sundar, A., Thajimil Mohamed, S., & Priya, D. E. N. (2025) · International Conference on Advancement in Futuristic Technologies (ICAFT) · doi:10.1109/icaft66710.2025.11453204
Prompt Optimization Framework for Enhancing Large Language Model Response Accuracy
Sukanya, N. S., Asha, V., Srujan, D., Lasrado, S., Patil, S., & Kalgutkar, S. D. (2026) · International Conference on Sentiment Analysis and Deep Learning (ICSADL) · doi:10.1109/icsadl67539.2026.11451930
Enhancing Spatial Reasoning in Vision Language Models via Efficient Meta-Cognitive Alignment
Zhu, S., & Zhu, H. (2025) · International Conference on Computer Science and Management Technology (ICCSMT) · doi:10.1145/3795154.3795258
Ningthoujam, C., & Raj, A. (2026) · Lecture notes in networks and systems · doi:10.1007/978-3-032-13555-1_3
Learning nonparanormal concept graphs from language representations
Lai, J., & Yin, J. (2026) · Electronic Research Archive · doi:10.3934/era.2026134
Parihar, B. S., Singh, T. P., Gonnade, G., Dewangan, B. K., Shelke, N. M., & Pimpalkar, A. P. (2026) · Scientific Reports · doi:10.1038/s41598-026-47145-x
Müller, B. (2022) · theses.fr (ABES) · doi:10.70675/6984dc63z4731z4eabzb3fazaf5d012fe143
Closed-Loop RAG Optimization System Based on User Feedback
Zhang, R. (2026) · ITM Web of Conferences · doi:10.1051/itmconf/20268403024
Jailbreaking Large Language Models: Safety Alignment, Response Quality, Computational Cost
Rosengren, J., Brynielsson, J., Johansson, F., & Jonell, P. (2025) · International Conference on Machine Learning and Applications · doi:10.1109/icmla66185.2025.00172
Robust algorithms and other contributions to machine learning
Merad, I. (2023) · theses.fr (ABES) · doi:10.70675/d8ecd308z06cbz4e17zba3fzccfa3ad4f6f1
The paradigmatic organisation of morphological knowledge
Copot, M. (2023) · theses.fr (ABES) · doi:10.70675/3ed66751z9557z4a77z88b7z57500c476481
Semantic-Aware Emoji Classification using Autoencoder-based Denoising and Deep Neural Attention
Sankari, S., & Priscila, S. S. (2025) · International Conference on Smart Electronics and Communication (ICOSEC) · doi:10.1109/icosec67334.2025.11459780
Facing Data Scarcity in Dialogues for Discourse Structure Discovery and Prediction
Li, C. (2023) · theses.fr (ABES) · doi:10.70675/c379d1f5z5324z4865z9c13z84c9508836f1 · Cited by 7
Mehenni, H. A. (2023) · theses.fr (ABES) · doi:10.70675/19d57191zbdc2z4cb4za7a8z45ee6af8c863 · Cited by 2
$$\textrm{A}^{3}\text {LLM}$$: A Novel Large Language Model-Based Method For Attack Alert Analysis
Zhao, C., Li, Y., Cheng, J., Du, D., Li, Y., Li, S., Han, D., & Liu, Y. (2026) · Lecture notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering · doi:10.1007/978-3-032-21168-2_9
A Reward-Driven Controller for Text Generation with Black-Box Language Models
Morain, R., & Ventura, D. A. (2025) · International Conference on Machine Learning and Applications · doi:10.1109/icmla66185.2025.00134
Proactive models for open-domain conversational search
Erbacher, P. (2024) · theses.fr (ABES) · doi:10.70675/f7d68861zc694z49f1zb130z675cbf38ed1c · Cited by 1
Sentence Embeddings for Massively Multilingual Speech and Text Processing
Duquenne, P.-A. (2024) · theses.fr (ABES) · doi:10.70675/8465c7cbzdf69z4d79z8950zb4a862100148
Meta-Evaluation Methodology and Benchmark for Automatic Story Generation
Chhun, C. (2024) · theses.fr (ABES) · doi:10.70675/ec296eb8z87a1z4fdbzbbbdz12bb27449b8f · Cited by 2
Text-Based Semantic Image Editing
Couairon, G. (2023) · theses.fr (ABES) · doi:10.70675/c4c397d4zb2e4z41f7z9374z64ed51cfba38
Improving Cooperation in Multi-agent Deep Reinforcement Learning for Mobile Robotics
Toquebiau, M. (2024) · theses.fr (ABES) · doi:10.70675/3385d0bbzc66cz4fceza9e0z8696ff61ff4e
Modeling topic evolution for scientific archives with deep learning
Rahimi, H. (2024) · theses.fr (ABES) · doi:10.70675/c0cbc96fz0a96z4661z865bzd0caaf3dedd5
Subspaces of Policies for Deep Reinforcement Learning
Gaya, J.-B. (2024) · theses.fr (ABES) · doi:10.70675/c266cfc3z60a1z40d5zbc2fz7d342ac5d605
Automatic Symbolic Goal Abstraction via Reachability Analysis in Hierarchical Reinforcement Learning
Zadem, M. (2024) · theses.fr (ABES) · doi:10.70675/f273f52az0906z443cza443z172023a62cf5 · Cited by 2
Diverse and efficient ensembling of deep networks
Ramé, A. (2023) · theses.fr (ABES) · doi:10.70675/fa295dcfz969ez4448z9a30z7c7bbfabb740
Communicative feedback in language acquisition
Nikolaus, M. (2023) · theses.fr (ABES) · doi:10.70675/342c36b9z6940z46ebz8631ze90a4ba4ae7a · Cited by 1
Neural networks security under realistic scenario
Maho, T. (2023) · theses.fr (ABES) · doi:10.70675/690e25b2z1fb9z4d7fza6cbzcb09e2b773cf · Cited by 1
Piat, G. (2023) · theses.fr (ABES) · doi:10.70675/bb18b592z47d5z40f0z805dz97e6aa90c6e5 · Cited by 1
Spoken Language Modeling from Raw Audio
Nguyen, T. A. (2024) · theses.fr (ABES) · doi:10.70675/e81cb131z2de8z4c0fz86f5zd983c6cb8744 · Cited by 1
Domain Adaptation of Named Entity Recognition for Plant Health Monitoring
Borovikova, M. (2024) · theses.fr (ABES) · doi:10.70675/aa08ea7az594ez48adz814bz17ff1279b349
On depth prediction for autonomous driving using self-supervised learning
Boulahbal, H. E. (2023) · theses.fr (ABES) · doi:10.70675/273dde48zd8b7z42b8z9c85z52bfc7aa4bba
Xia, Y., Tan, Q., Chen, H., Chen, J., & Dong, Q. (2026) · International World Wide Web Conference (WWW) · doi:10.1145/3774904.3792130
Foundation Vision-Language models
Laurençon, H. (2025) · theses.fr (ABES) · doi:10.70675/ec0311a0zb6a4z4249zb9fbz01bf51a02c7c · Cited by 1
Beyond Factual Queries: A Novel Predictive Retrieval-Augmented Generation
Cheng, D., Deng, J., Chen, Q., Jie, J., & Gan, J. (2026) · International World Wide Web Conference (WWW) · doi:10.1145/3774904.3792364
Distribution-Aligned Synthetic Text Generation via Tail-Aware Enhancement
Fan, Y., Liu, X., Liu, B., Wang, W., Sun, J., Chen, W., Fang, H., Tao, L., & Mo, F. (2026) · International World Wide Web Conference (WWW) · doi:10.1145/3774904.3792520
AlignCP: Noise-Aware Preference Alignment for LLMs via Confidence and Polarity Reweighting
Cheng, C., Xu, H., & Wu, L. (2026) · International World Wide Web Conference (WWW) · doi:10.1145/3774904.3792972
Federation of heterogeneous models with machine learning-assisted model views
Miranda, J. P. (2025) · theses.fr (ABES) · doi:10.70675/de89abcdzc714z461cz8300z607cc2293274
Genest, P.-Y. (2024) · theses.fr (ABES) · doi:10.70675/88c65002z4b8cz466dz923bz13954d6729bf · Cited by 3
GAM: A Generative Auto-Marketing Framework in Online E-commerce Platforms
Dou, Y., Dou, S., Ma, Y., Wang, B., Wang, T., Zhang, Z., Yu, C., Xu, J., & Qi, Q. (2026) · International World Wide Web Conference (WWW) · doi:10.1145/3774904.3792805
Aligning Query Rewriting with Human Cognition and Preference in E-Commerce Search
Ou, R., Wang, K., Shao, J., Zhang, T., & Huo, C. (2026) · International World Wide Web Conference (WWW) · doi:10.1145/3774904.3792806 · Cited by 1
Contributions to evaluating and improving the faithfulness for text generation
Zhang, K. (2025) · theses.fr (ABES) · doi:10.70675/28453a20z78f2z4fa2za6edz700065e69e97
Metadata
- Authors
- Ouyang, L., Wu, J., Jiang, X., Almeida, D., Wainwright, C., Mishkin, P., Zhang, C., Agarwal, S., Slama, K., Ray, A., Schulman, J., Hilton, J., Kelton, F., Miller, L., Simens, M., Askell, A., Welinder, P., Christiano, P., Leike, J., & Lowe, R.
- Venue
- Advances in Neural Information Processing Systems 35
- Published
- 2022
- Pages
- 27730-27744
- ISSN
- 1049-5258 (ISSN-L)
- OpenAlex
- W7133211372
- Cited by
- 3,117
- References
- 0
- Citations by year
- 2026: 1421 · 2025: 544 · 2024: 852 · 2023: 297 · 2022: 3
- FWCI
- 234.27
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- neural information processing systems (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Keywords
- instruction following, language models, human feedback, reinforcement learning from human feedback, large language models
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.