Training Language Models to Follow Instructions with Human Feedback
The DOI matches its Crossref record; 2 of the 2 references it cites were found in a registry or an index.
Abstract
Making language models bigger does not inherently make them better at following a user's intent. For example, large language models can generate outputs that are untruthful, toxic, or simply not helpful to the user. In other words, these models are not aligned with their users. In this paper, we show an avenue for aligning language models with user intent on a wide range of tasks by fine-tuning with human feedback. Starting with a set of labeler-written prompts and prompts submitted through the OpenAI API, we collect a dataset of labeler demonstrations of the desired model behavior, which we use to fine-tune GPT-3 using supervised learning. We then collect a dataset of rankings of model outputs, which we use to further fine-tune this supervised model using reinforcement learning from human feedback. We call the resulting models InstructGPT. In human evaluations on our prompt distribution, outputs from the 1.3B parameter InstructGPT model are preferred to outputs from the 175B GPT-3, despite having 100x fewer parameters. Moreover, InstructGPT models show improvements in truthfulness and reductions in toxic output generation while having minimal performance regressions on public NLP datasets. Even though InstructGPT still makes simple mistakes, our results show that fine-tuning with human feedback is a promising direction for aligning language models with human intent.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Existing literature (Ouyang et al., 2022) does not fully describe the details of these models, such as the pretraining corpus, model sizes, and model biases.”
From Self-Refine: Iterative Refinement with Self-Feedback (2023) · cites this paper as Ouyang et al., 2022
Experimental — accuracy not yet measuredIn the citing paper
“Specifically, providers mitigate race and gender bias through reinforcement learning from human feedback (RLHF), adversarial stress-testing known as red teaming, and hard-coded refusals governed by the provider's own content policies [6, 43, 71].”
From All Public Voices Are Equal, But Are Some More Equal Than Others to LLMs? (2026) · cites this paper as [71]
In the citing paper
“Fine-tuning a model from human feedback at scale, using preference data from paid raters or drawn from a large and willing user base, is an especially potent technique.It has the potential not only to shape a model's responses to better reflect user norms (for better or worse), but also to filter out toxic language, improve factual accuracy, and mitigate the tendency to fabricate information.”
From Talking about Large Language Models (2024) · cites this paper as [26]
In the citing paper
“These include general competencies such as in-context learning (ICL) [13], chain-of-thought (CoT) [17] reasoning, and instruction following [25], as well as task-specialized skills like mathematical reasoning [30].”
From A Survey of Large Language Models (2026) · cites this paper as [25]
In the citing paper
“When external reward models or ground-truth answers are available, rejection sampling can also be applied to select higher-quality responses from multiple candidates [25].”
From A Survey of Large Language Models (2026) · cites this paper as [25]
41 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
The publisher hasn’t deposited this paper’s reference list.
Cited by
Items 4,001–4,100 of 4,340
Cheung, N. (2026) · Scientific Reports · doi:10.1038/s41598-026-66139-3
Spyra-20B: A Proof-of-Concept for Explicit Architectural Design Reasoning in Domain-Specialised LLMs
Ansre, N., Hirsekorn, Y., & Grunwald, G. (2026) · Smart Design Policies · doi:10.38027/smart.v3n1-2
Nguyen, M.-H., Tran, N.-N. Q., Nguyen, T. D., & Shyr, C. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2608.16831
Sequential Multimodal Evidence Optimization for Product Media Ranking in E-Commerce
Dey, P., Mcintyre, F., & Sinha, A. (2026) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3799682.3840133
Kaijun, Y., Wu, T., Zhang, W., & Li, P. (2026) · Bioinformatics · doi:10.1093/bioinformatics/btag618
Toward Personal Intelligence Through Cooperative ObservationPreprint
Talebirad, Y., Jime, O., Parsaee, A., Redman, E., Kim, Y., & Zaiane, O. R. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2608.17128
Probing large language models for autonomous driving behavior
Bao, Z., Zhao, W., & Li, Q. (2026) · Journal of Intelligent and Connected Vehicles · doi:10.26599/jicv.2026.9210095
Ontology Construction and Reasoning with LLMs: Survey and Perspective
Yang, H., Chen, J., Ma, Y., & Schmidt, R. A. (2026) · Research Explorer (The University of Manchester)
SCoRD: Semantic-Assisted Continual Retriever-Reranker Distillation for LLM-Based Recommendation
Baek, S., Lee, G., Lee, S., Kweon, W., Wang, D., & Kang, S. (2026) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3799682.3840906
Chen, X., Zhang, B., Shi, X., & Yu, J. (2026) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2026.3726309
Bridging the Trust Gap: A Hybrid Intuitive-Rational Architecture for Certified University Assistants
Pilato, G., & Sert, M. (2026) · International Journal of Semantic Computing · doi:10.1142/s1793351x26440010
Won, D., Kim, S., & Shin, H. (2026) · THE JOURNAL OF THE KOREAN ACADEMY OF PEDTATRIC DENTISTRY · doi:10.5933/jkapd.2026.53.3.320
Mind the Couch! Eliciting MLLM Reasoning in Interior Design via Weak-to-Strong Task Vector Injection
Yang, Y., Wang, J., & Mou, L. (2026) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3767308.3834925
The urban right to AI: Pluralistic co-design and governance of public spacePreprint
Mushkani, R. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2608.23999
Gamage, D., Nanayakkara, I., & Sasahara, K. (2026) · Computers in Human Behavior Reports · doi:10.2139/ssrn.7360004
Select, Don’t Train: The Benefits of Modular Entity Disambiguation with LLM-Based Selection
Polat, F., Daza, D., Zhang, P., Zaporojets, K., & Groth, P. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-42015-2_3
A Governance Framework For Trustworthy AI-Generated Data Engineering Artifacts In Cloud Environments
Kodati, P. K. (2026) · International Journal of Artificial Intelligence and Machine Learning · doi:10.51483/ijaiml.6.8s.2026.86-96
ASCII Attack: Recontextualising Harmful Requests as Artistic Critique in Large Language ModelsPreprint
Gu, D. C., Dong, Y., Yang, X., Gong, Y., & Liu, W. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2609.02215
SAM-D2Q: Aligning Multimodal Doc2Query with Search Demand and Conversion for E-commerce
Zhou, H., Ji, J. H., Ma, L., Xiao, R., & Zeng, X. (2026) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3799682.3840121
AI can cheat scientists but never itself
Ma, P., Zhang, D., Ma, Y., Du, Z., Jia, X., Tong, J., Fan, B., & Wang, F. (2026) · The Innovation · doi:10.1016/j.xinn.2026.101565
Evaluating and Improving Evidence-Grounded Fact-Checking in LLMs via Multi-Round Evidence Ablation
Deng, X., Cao, M., Aletras, N., Wang, X., & Stevenson, M. (2026) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3799682.3841076
Time-Aware Assistive Navigation
Kuribayashi, M., Shangguan, Z., & Ohn-Bar, E. (2026) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra57385.2026.11696883 · Cited by 1
The impact of GenAI on the future of requirements engineering
Breaux, T. D., & Singhal, A. (2026) · Requirements Engineering · doi:10.1007/s00766-026-00477-6
Spillover-Aware Multi-Value Steering for Pluralistic LLM AlignmentPreprint
Pan, W., Barron, X., Zhou, J., & Liu, Z. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2609.05800
Li, B., & Li, H. (2026) · World Journal of Educational Studies · doi:10.61784/wjes3203
Early Epistemic Settlement in AI-Assisted WritingPreprint
Wang, H.-Y. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2609.09332
A taxonomy of bullshit: classifying AI truth-indifference in policing contexts
May, B., Nunan, J., Marshall, J., & Palace, M. (2026) · Policing A Journal of Policy and Practice · doi:10.1093/police/paag052
Tong, H., & Yu, J. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2609.13807
Spook the Machine: Gamified Exploration of Human Imagination of Machine FearPreprint
Brinkmann, L. U. L., Yakura, H., Nicoletti, S., Solà, M. C., Eisenmann, T. F., Dasmeh, A., Sherif, O., Supriyatno, B. I., Gupta, P., Serna, I., et al. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2609.15472
Umam, R. K. (2026) · Jurnal Riset Pendidikan dan Pengajaran · doi:10.55047/jrpp.v5i2.1226
Wang, X., Wang, R., Wang, W., Wang, W., Yang, W., Jia, M., Gao, S., & Zhao, X. (2026) · Journal of Medical Internet Research · doi:10.2196/95603
Tools and architectures for agentic systems in clinical AI and radiology
Tripathi, S., Quevada, K., Faghani, S., Khandelwal, P., Enwerem, D., & Cook, M. (2026) · European Journal of Radiology Artificial Intelligence · doi:10.1016/j.ejrai.2026.100131 · Cited by 1
The Fake Friend Dilemma: Relational Trust and the Political Economy of Conversational AIPreprint
Erickson, J. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7471958
Sahana, B., S., C. H., Arshitha, S., Chandrakala, C., Krishna, N. B., Prasada, S., Bhanupriya, P., & Tiwary, A. (2026) · International Journal of Power Electronics and Drive Systems/International Journal of Electrical and Computer Engineering · doi:10.11591/ijece.v16i5.pp2795-2805
Large Language Models for Research Quality Prediction: Theoretical Issues
Thelwall, M. A. (2026) · White Rose University Press eBooks · doi:10.22599/quantitativemethods.n
Beyond Exact Match: Task-Aware GRPO for Cross-Domain PCBA Visual Question Answering
Li, J., Dai, L., Jia, P., Hu, Z., Chan, C. S., Bao, B., & Hong, R. (2026) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3767308.3836634
Conceptual search: A generative view of entrepreneurial imagination
Csaszar, F. A. (2026) · Strategic Entrepreneurship Journal · doi:10.1002/sej.70055 · Cited by 6
Entity Resolution Using Transformer-Based Language Models: A Systematic Scoping Review
Beheshti, M., Seifaddini, M., Abad, A. E. Z. S., Karthik, K., Kumar, T., Boren, S. A., & Zachary, I. (2026) · Information · doi:10.3390/info17090917
Large Language Models for Defense and Security: A Systematic ReviewPreprint
Maaiveld, T. M., Zambrano, N. A. P., Trantas, A., Weyland, L. F., Hentenaar, C., Nyegaard, D. D. N., & Schadd, M. P. D. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7509620
Shan, Z., Zhang, J., Zhang, J., Li, B., Wu, Y., & 孙成 (2026) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2026.3737252
Khudhair, K. M., & Khudhair, B. M. (2026) · Algorithms · doi:10.3390/a19090805
Statistical attribute alignment for black-box generative AI via output post-processingPreprint
Jiang, K., Austern, M., Dobriban, E., & Klusowski, J. M. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2609.31607
Fodor, J., Murawski, C., & Suzuki, S. (2026) · eLife · doi:10.7554/elife.108442.3.sa0
From Soft Targets to Reward Signals: How Assignment and Reward Objectives InteractPreprint
Lin, J., Wei, B., Liu, S., Ding, Y., & Dong, Y. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2609.34850
Expert-in-the-Loop Systems for High-Quality Training Data Construction: A Survey
Song, D., 王露笛, Xu, J., Pan, Y., Chen, B., Cui, W., & Du, Y. (2026) · IEEE Transactions on Systems Man and Cybernetics Systems · doi:10.1109/tsmc.2026.3734945 · Cited by 1
Orthogonal Witness Control for Muon Optimization via Sigmoid Spectral ReshapingPreprint
Dat, P. V., Minh, N. V., Nguyen, T., Nguyen, T., Dinh, N.-T., & Le, T. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2609.33194
BiasReducer: Adaptive Bias Mitigation for Reward ModelsPreprint
Liu, S., Miao, Y., Liu, Y., Xiong, H., & Du, M. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2609.32720
Liu, H., Zhao, R., Zhao, N., Qian, L., & Zhou, J. (2026) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/taslpro.2026.3739198
Who Owns That? Evaluating Ownership Intuitions in Large Language ModelsPreprint
Xiao, X., Wu, Y., Xu, S., & Liu, J. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2609.39483
A Comparative Evaluation of Open-Weight LLMs for Geoscientific Tasks
Parraga, O., Garcez, V. H., Marques, A., Spigolon, A. L. D., Barros, G. D., Júnior, L. G., Veronez, M. R., Fachel, A., de Oliveira, E. R., Bruski, S. D., et al. (2026) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2026.3739143
CARM: Cancellation-Aware Response Masking for LLM Reinforcement LearningPreprint
Zhang, Y., Lu, S., Liao, S., Chen, Z., & Tang, Y. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.02039
Zahraei, P. S., Singh, J., Tur, G., & Hakkani-Tur, D. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.00568
Maghool, S., Mohammadi, F., Ceravolo, P., & Damiani, E. (2026) · IEEE Access · doi:10.1109/access.2026.3740310 · Cited by 1
Tanna, A., & Jindal, A. (2026) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3799682.3840057
Yu, Z., Li, M., Yu, L., Chow, K.-H., Qin, C., Wu, X., Xing, W., Xiong, S., & Han, M. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.05472
Beyond Syntax: Action Semantics Learning for App Agents
Tang, B., Luo, D., Liu, J., Chen, J., Gong, S., Hao, J., Wang, J., & Shao, K. (2026) · doi:10.1109/cvprf71909.2026.00905
MPerS: Dynamic MLLM MixExperts Perception-Guided Remote Sensing Scene Segmentation
Wang, Z., Ma, X., Wang, Z., Zhang, H., & Pun, M. O. (2026) · doi:10.1109/cvprf71909.2026.00696
Abella, Á. R., Silvestre, J. P., Gharesifard, B., & Tabuada, P. (2026) · IEEE Control Systems · doi:10.1109/mcs.2026.3715420
LlamaRG: A Multi-View Large Language Model for Radiology Report Generation
Jayas, T., Rastogi, A., Raghavan, P., Brugnara, G., Schlamp, K., Foltyn‐Dumitru, M., & Vollmuth, P. (2026) · doi:10.1109/cvprf71909.2026.00552 · Cited by 1
HuMBLE: Human Motion-Driven Behavior Learning for Embodied LocomotionPreprint
Zhang, M., Kang, D., Bergamin, K., Burger, N., Deits, R., Foster, J., Hammoud, B., Hughes, K., Iacobelli, F., Koolen, T., et al. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.10489
Cognitive Empathy for Social Robots: Aligning LLMs via Theory-of-Mind-Guided Preference Optimization
Lee, Y. K., Lee, J., An, S., & Hahn, S. (2026) · IEEE RO-MAN · doi:10.1109/ro-man72286.2026.11714598
CogNet: Multi-Agent Collaborative Reasoning and Verification for Salient Object Ranking
Wu, Z., Shi, T., Wang, X., Li, M., Chen, C., Song, W., & Hao, A. (2026) · 2026 IEEE/CVF Conference on Computer Vision and Pattern Recognition- FINDINGS Track (CVPRF) · doi:10.1109/cvprf71909.2026.00695
A Scale For Value Alignment In Human-AI InteractionPreprint
Hegemann, L., Villa, S., Bang, H., Gordon, M., Oulasvirta, A., Welsch, R., & Ebel, P. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.09911
SpatialDreamer: Incentivizing Spatial Reasoning via Active Mental Imagery
Cao, M., Li, X., Liu, X., Reid, I. D., & Liang, X. (2026) · doi:10.1109/cvprf71909.2026.00689 · Cited by 5
Toward Alignment Scaling Laws: A Framework and First Preregistered MeasurementsPreprint
Canale, J. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.08540
ReFoCUS: Reinforcement-Guided Frame Optimization for Contextual Understanding
Lee, H., Kim, J., Kim, H., & Ro, Y. M. (2026) · doi:10.1109/cvprf71909.2026.00796
Shin, J., Kim, J., Ko, D., & Choi, J. (2026) · doi:10.1109/cvprf71909.2026.00216 · Cited by 1
Learning to Select, Learning to Judge: Active Preference Alignment for Mars Terrain Segmentation
Li, J., Li, M., Wang, J., Liu, Y., & Wang, Y. (2026) · doi:10.1109/cvprf71909.2026.00853
SuperGlasses: Benchmarking Vision Language Models as Intelligent Agents for AI Smart Glasses
Jiang, Z., Yuan, X., Qu, H., Lin, S., Liu, K., Fan, W., & Li, Q. (2026) · doi:10.1109/cvprf71909.2026.00212 · Cited by 7
PRISM: Planning with Belief Under Incomplete World Models
Yasar, M. S., Sankaradas, M., & Chakradhar, S. (2026) · IEEE RO-MAN · doi:10.1109/ro-man72286.2026.11714809
Xu, W., Solarte-Vásquez, M. C., Obstfelder, A. U., Søraa, R. A., Hurum, J. K., Su, X., Chen, H., Kangur, K., & Frennert, S. (2026) · The Gerontologist · doi:10.1093/geront/gnag239
Intelligent Photo Retouching with Language Model-Based Artist Agents
Chen, H., Tao, K., Wang, Y., Wang, X., Zhu, L., & Gu, J. (2026) · doi:10.1109/cvprf71909.2026.00124
Devil Is in Narrow Policy: Unleashing Exploration in Driving Vla Models
Chen, C., Yang, Y., Tan, Z., Wang, Y., Zhan, R., Liu, H., Mao, X., Bao, J., Tang, X., Yang, L., et al. (2026) · doi:10.1109/cvprf71909.2026.00107
Lu, J., Wu, Y., Zhao, Z., Wang, H., Jimenez, F., Majeedi, A., & Fu, Y. (2026) · doi:10.1109/cvprf71909.2026.00828 · Cited by 2
Through the Prism: Principle-Aware, Interpretable, and Multi-Scale Evaluation of Visual Designs
Gandhi, M., Joseph, K. J., Parthasarathy, S., & Nag, S. (2026) · doi:10.1109/cvprf71909.2026.00176
VideoP2R: Video Understanding from Perception to Reasoning
Jiang, Y., Wang, Y., Zhao, R., Parag, T., Chen, Z., Liao, Z., & Unnikrishnan, J. (2026) · doi:10.1109/cvprf71909.2026.00797 · Cited by 1
Turning Generators into Retrievers: Unlocking MLLMS for Natural Language-Guided Geo-Localization
Chen, Y., Zhang, X., Arrabi, A., Sultani, W., Chen, C., & Wshah, S. (2026) · doi:10.1109/cvprf71909.2026.00608
Recursive Think-Answer Process for LLMs and VLMs
Lee, B.-K., Chee, Y., & Ro, Y. M. (2026) · 2026 IEEE/CVF Conference on Computer Vision and Pattern Recognition- FINDINGS Track (CVPRF) · doi:10.1109/cvprf71909.2026.00920 · Cited by 5
Elicit and Enhance: Advancing Multimodal Reasoning in Medical Scenarios
Huang, Z., Mu, L., Gu, Y., Hu, K., Hua, S., & Zhang, X. (2026) · 2026 IEEE/CVF Conference on Computer Vision and Pattern Recognition- FINDINGS Track (CVPRF) · doi:10.1109/cvprf71909.2026.00539
Shuvo, M. I. R., Alam, N. A., Fime, A. A., Siddiqui, S. H., Bhullar, R., Dip, P. B., Lin, X., & Kim, J.-H. (2026) · IEEE RO-MAN · doi:10.1109/ro-man72286.2026.11714938
Chen, Y., Zhao, K., Wang, Y., Yang, M., Rao, B., & Li, Z. (2026) · doi:10.1109/cvprf71909.2026.00113
E-Grpo: High Entropy Steps Drive Effective Reinforcement Learning for Flow Models
Zhang, S., Zhang, Z., Dai, C., & Duan, Y. (2026) · doi:10.1109/cvprf71909.2026.00427
Amateur-Friendly Conversational Image Editing Agent via Three Stages of Multitask Alignment
Zhu, Z., Sun, Y., Zhu, M., Ma, W., Zhang, S., Wang, Z., Yang, Z., Zhang, D., Lan, K., Zhao, Z., et al. (2026) · doi:10.1109/cvprf71909.2026.00832
Yong, C., Li, L., Xu, C., Huang, J., & Shen, F. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7590072
Liu, S., & Wang, W. (2026) · Terminology International Journal of Theoretical and Applied Issues in Specialized Communication · doi:10.1075/term.26017.liu
Zhang, G., Zhang, H., & Luo, Q. (2026) · Buildings · doi:10.3390/buildings16193968
UXBench Pro: Benchmarking Personalized User Experience in Multi-Turn Dialogue InteractionsPreprint
Hong, M., Lei, Z., Shang, W., Zeng, X., Zhao, X., Zhu, Q., Zhang, C., Jiang, D., Fu, T., Zhou, Q., et al. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.11638
Self-citationRetrieval‐Augmented Lesson Generation With Large Language Models for Scenario‐Based Tutor Training
Lin, J., Zhao, S. Y., Gurung, A., meng, X., & Koedinger, K. R. (2026) · Journal of Computer Assisted Learning · doi:10.1002/jcal.70343
Feng, D., Yang, J., Zhao, X., & Wang, J. (2026) · International Conference on Digital Economy and Information Systems · doi:10.1145/3845872.3845877
Kanidou, E.-P., Nikolaidis, N., Tsimpita, K., Ampatzoglou, A., Chatzigeorgiou, A., Bamidis, P., & Konstantinidis, E. (2026) · Proceedings - IEEE Symposium on Computer-Based Medical Systems · doi:10.1109/cbms69103.2026.00314
Fast Initial Convergence Under ( L ₀, L ₁) - Smoothness: Gradient and Coordinate Methods
Lobanov, A. V., Gasnikov, A. V., Gorbunov, E., & Takaáč, M. (2026) · IEEE Access · doi:10.1109/access.2026.3741944
Constructing Knowledge for LLMs: Human Labor, AI Mediation, and Dataset Pipelines
Garcia, A. A., Wong-Villacrés, M., & Ogbonnaya-Ogburu, I. F. (2026) · ACM Conference on Computer Supported Cooperative Work (CSCW) · doi:10.1145/3785651.3831487
A Survey of Code-to-Code Translation: From Statistical Rule-Based Systems to LLM Agents
Zhang, Z., Wen, S., Yan, Z., Zhu, B., Shen, C., & Guo, H. (2026) · Algorithms · doi:10.3390/a19100857
Stylios, I., Kokolakis, S., Damopoulos, D., Tzallas, A. T., & Gritzalis, S. (2026) · Journal of Cybersecurity and Privacy · doi:10.3390/jcp6050174
Hastuti, H., Ali, Z. F., & Aulia, M. Y. (2026) · System Information and Computer Technology (SYNCTECH)
Lin, J. (2026) · International Conference on Sustainable Development and Digital Transformation · doi:10.1145/3838938.3838949
Labaran, U. Y., Aliyu, R. Y., Saidu, I. C., Kanya, R. A., & Tambaya, A. N. (2026) · Journal of Science Innovation and Technology Research · doi:10.70382/ajsitr.v13i9.096
Metadata
- Authors
- Ouyang, L., Wu, J., Jiang, X., Almeida, D., Wainwright, C., Mishkin, P., Zhang, C., Agarwal, S., Slama, K., Ray, A., Schulman, J., Hilton, J., Kelton, F., Miller, L., Simens, M., Askell, A., Welinder, P., Christiano, P., Leike, J., & Lowe, R.
- Venue
- Advances in Neural Information Processing Systems 35
- Published
- 2022
- Pages
- 27730-27744
- ISSN
- 1049-5258 (ISSN-L)
- OpenAlex
- W7133211372
- Cited by
- 3,117
- References
- 0
- Citations by year
- 2026: 1421 · 2025: 544 · 2024: 852 · 2023: 297 · 2022: 3
- FWCI
- 234.27
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- neural information processing systems (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Keywords
- instruction following, language models, human feedback, reinforcement learning from human feedback, large language models
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.