Scientists used ChatGPT to generate an entire paper from scratch — but is it any good?

Conroy, Gemma

doi:10.1038/d41586-023-02218-z

Cited by 65Academic Writing and PublishingArtificial Intelligence ApplicationsEthics and Social Impacts of AI

Scientists used ChatGPT to generate an entire paper from scratch — but is it any good?

Conroy, Gemma·2023·Nature

DOI 10.1038/d41586-023-02218-z

Open this paper in CoChat — free account

Integrity signals

Registry

Crossref · 10.1038/d41586-023-02218-z

Cites

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Some researchers have used ChatGPT to write scientific papers and have even named them as authors.
“Some researchers have used ChatGPT to write scientific papers and have even named them as authors [48, 53, 54, 167].”
From The ethics of using artificial intelligence in scientific research: new guidance needed for a new tool (2025) · cites this paper as [53]
Scientists have tried to use ChatGPT to write scientific manuscripts with varying success.
“Scientists have tried to use ChatGPT to write scientific manuscripts with varying success (12, 18)”
From Integrating AI in medical education: embracing ethical usage and critical understanding (2023) · cites this paper as [18]

Still being checked.

Sorted by citations

An exploratory survey about using ChatGPT in education, healthcare, and research
Hosseini, M., Gao, C. A., Liebovitz, D. M., Carvalho, A. M., Ahmad, F. S., Luo, Y., MacDonald, N., Holmes, K. L., & Kho, A. (2023) · PLOS ONE · doi:10.1371/journal.pone.0292216 · Cited by 238 · see citing works
The ethics of using artificial intelligence in scientific research: new guidance needed for a new tool
Resnik, D. B., & Hosseini, M. (2025) · AI and Ethics · doi:10.1007/s43681-024-00493-8 · Cited by 228 · see citing works
“Some researchers have used ChatGPT to write scientific papers and have even named them as authors [48, 53, 54, 167].”
Exploring the role of ChatGPT in patient care (diagnosis and treatment) and medical research: A systematic review
Garg, R. K., Urs, V. L., Agrawal, A. A., Chaudhary, S. K., Paliwal, V. K., & Kar, S. K. (2023) · Health Promotion Perspectives · doi:10.34172/hpp.2023.22 · Cited by 233 · see citing works
Integrating AI in medical education: embracing ethical usage and critical understanding
Alam, F., Lim, M. A., & Zulkipli, I. N. (2023) · Frontiers in Medicine · doi:10.3389/fmed.2023.1279707 · Cited by 82 · see citing works
Evaluation of Large Language Model Performance and Reliability for Citations and References in Scholarly Writing: Cross-Disciplinary Study
Mugaanyi, J., Cai, L., Cheng, S., Lu, C., & Huang, J. (2024) · Journal of Medical Internet Research · doi:10.2196/52935 · Cited by 74 · see citing works
Between human and AI: assessing the reliability of AI text detection tools
Bellini, V., Semeraro, F., Montomoli, J., Cascella, M., & Bignami, E. (2024) · Current Medical Research and Opinion · doi:10.1080/03007995.2024.2310086 · Cited by 60 · see citing works
Responsible Adoption of Generative AI in Higher Education: Developing a "Points to Consider" Approach Based on Faculty Perspectives
Dotan, R., Parker, L. S., & Radzilowicz, J. (2024) · The 2024 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3630106.3659023 · Cited by 71 · see citing works
Opportunities for retrieval and tool augmented large language models in scientific facilities
Prince, M. H., Chan, H., Vriza, A., Zhou, T., Sastry, V. K., Luo, Y., Dearing, M. T., Harder, R., Vasudevan, R. K., & Cherukara, M. J. (2024) · npj Computational Materials · doi:10.1038/s41524-024-01423-2 · Cited by 41 · see citing works
Beyond Traditional Teaching: The Potential of Large Language Models and Chatbots in Graduate Engineering EducationPreprint
Abedi, M., Alshybani, I., Shahadat, M., & Murillo, M. S. (2023) · Qeios · doi:10.32388/md04b0 · Cited by 41 · see citing works
What Does ChatGPT Mean for Qualitative Health Research ?
van Manen, M. (2023) · Qualitative Health Research · doi:10.1177/10497323231210816 · Cited by 31 · see citing works
Innovations in Medicine: Exploring ChatGPT’s Impact on Rare Disorder Management
Zampatti, S., Peconi, C., Megalizzi, D., Calvino, G., Trastulli, G., Cascella, R., Strafella, C., Caltagirone, C., & Giardina, E. (2024) · Genes · doi:10.3390/genes15040421 · Cited by 30 · see citing works
Writing without borders: AI and cross-cultural convergence in academic writing quality
Prakash, A., Aggarwal, S., Varghese, J. J., & Varghese, J. J. (2025) · Humanities and Social Sciences Communications · doi:10.1057/s41599-025-05484-6 · Cited by 29 · see citing works
Facilitator or thinking inhibitor: understanding the role of ChatGPT-generated written corrective feedback in language learning
Guo, X. (2025) · Interactive Learning Environments · doi:10.1080/10494820.2024.2445177 · Cited by 23 · see citing works
The Impact of Generative Artificial Intelligence on Research Integrity in Scholarly Publishing
Chauhan, C., & Currie, G. (2024) · The American Journal of Pathology · doi:10.1016/j.ajpath.2024.10.001 · Cited by 22 · see citing works
Beyond Traditional Teaching: The Potential of Large Language Models and Chatbots in Graduate Engineering EducationPreprint
Abedi, M., Alshybani, I., Shahadat, M., & Murillo, M. S. (2023) · Qeios · doi:10.32388/md04b0.2 · Cited by 20 · see citing works
Revolutionizing antimicrobial stewardship, infection prevention, and public health with artificial intelligence: the middle path
Marra, A. R., Langford, B. J., Nori, P., & Bearman, G. M. (2023) · Antimicrobial Stewardship & Healthcare Epidemiology · doi:10.1017/ash.2023.494 · Cited by 19 · see citing works
Embracing generative AI in education: an experiential study on preservice teachers’ acceptance and attitudes
Gao, M., Zhang, H., Dong, Y., & Li, J. (2025) · Educational Studies · doi:10.1080/03055698.2025.2483831 · Cited by 20 · see citing works
Ten simple rules to leverage large language models for getting grants
Seckel, E., Stephens, B. Y., & Rodriguez, F. (2024) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1011863 · Cited by 14 · see citing works
The impact of AI on the post‐pandemic generation of early career researchers: What we know or can predict from the published literature
Herman, E., Nicholas, D., Abrizah, A., Revez, J. M. R., Bravo, B. R., Świgoń, M., Clark, D., Xu, J., & Watkinson, A. (2024) · Learned Publishing · doi:10.1002/leap.1623 · Cited by 13 · see citing works
Artificial Intelligence is Irreversibly Bound to Academic Publishing — ChatGPT is Cleared for Scientific Writing and Peer Review
Gomes, W. J., Évora, P. R. B., & Guizilini, S. (2023) · Brazilian Journal of Cardiovascular Surgery · doi:10.21470/1678-9741-2023-0963 · Cited by 13 · see citing works
Artificial intelligence at the pen’s edge: Exploring the ethical quagmires in using artificial intelligence models like ChatGPT for assisted writing in biomedical research
Sharma, H., & Ruikar, M. (2023) · Perspectives in Clinical Research · doi:10.4103/picr.picr_196_23 · Cited by 13 · see citing works
Reliability Issues of LLMs: ChatGPT a Case Study
Majeed, A., & Hwang, S. O. (2024) · IEEE reliability magazine · doi:10.1109/mrl.2024.3420849 · Cited by 15 · see citing works
The Impact of AUTOGEN and Similar Fine-Tuned Large Language Models on the Integrity of Scholarly Writing
Resnik, D. B., & Hosseini, M. (2023) · The American Journal of Bioethics · doi:10.1080/15265161.2023.2250276 · Cited by 11 · see citing works
Man Versus Machine: A Comparative Study of Human and ChatGPT-Generated Abstracts in Plastic Surgery Research
Pressman, S. M., Garcia, J. P., Borna, S., Gomez-Cabello, C. A., Haider, S. A., Haider, C. R., & Forte, A. J. (2025) · Aesthetic Plastic Surgery · doi:10.1007/s00266-025-04836-6 · Cited by 10 · see citing works
Writing for Pediatric Critical Care Medicine: Engaging With Citations to References in the Chatbot Generative Pre-Trained Transformer Era
Tasker, R. C. (2023) · Pediatric Critical Care Medicine · doi:10.1097/pcc.0000000000003356 · Cited by 10 · see citing works
Unlocking the potential of ChatGPT in academic libraries
Hussain, A. (2024) · IP Indian Journal of Library Science and Information Technology · doi:10.18231/j.ijlsit.2024.015 · Cited by 11 · see citing works
Article retraction rates in selected MeSH term categories in PubMed published between 2010 and 2020
Alexander, R. L., Peterson, C., Yang, S., & NUGENT, K. M. (2023) · Accountability in Research · doi:10.1080/08989621.2023.2272246 · Cited by 10 · see citing works
Greetings from the editor 2024
Smolen, J. S. (2024) · Annals of the Rheumatic Diseases · doi:10.1136/ard-2023-225240 · Cited by 8 · see citing works
The Purity Myth: Why Stigmatizing GAI in Academic Writing Is Harmful
Suchikova, Y., & Tsybuliak, N. (2025) · Science Communication · doi:10.1177/10755470241313233 · Cited by 9 · see citing works
Evaluating ChatGPT as a viable research tool for typological investigations of cultural heritage artefacts—Roman clay oil lamps
Lapp, E. C., & Lapp, L. W. P. (2024) · Archaeometry · doi:10.1111/arcm.12937 · Cited by 7 · see citing works
The underappreciated wrong of AIgiarism - bypass plagiarism that risks propagation of erroneous and bias content
Tang, B. L. (2023) · EXCLI journal · doi:10.17179/excli2023-6435 · Cited by 13 · see citing works
Of editorial processes, AI models, and medical literature: the Magnetic Resonance Audiometry experiment
Cocozza, S., & Palma, G. (2024) · European Radiology · doi:10.1007/s00330-024-10668-w · Cited by 6 · see citing works
Quantifying the Scope of Artificial Intelligence–Assisted Writing in Orthopaedic Medical Literature: An Analysis of Prevalence and Validation of AI-Detection Software
Porto, J. R., Morgan, K. A., Hecht, C. J., Burkhart, R. J., & Liu, R. W. (2024) · Journal of the American Academy of Orthopaedic Surgeons · doi:10.5435/jaaos-d-24-00084 · Cited by 7 · see citing works
Strategizing AI utilization for psychological literature screening: A comparative analysis of machine learning algorithms and key factors to consider
König, L., Zitzmann, S., & Hecht, M. (2025) · Research Synthesis Methods · doi:10.1017/rsm.2025.10053 · Cited by 5 · see citing works
Community Perspectives on ChatGPT: Sentiment Analysis in Educational Forum
Lee, Y. (2024) · TechTrends · doi:10.1007/s11528-024-01012-6 · Cited by 4 · see citing works
A State-of-the-Art of Intelligent Problem-Oriented Low-Code Systems
Sá, D., Lobo, A., Cunha, J. C., Duarte, R. J. D. S., Guimarães, T. A. S., & Santos, M. F. (2025) · Procedia Computer Science · doi:10.1016/j.procs.2025.03.148 · Cited by 4 · see citing works
Rapport 24-03. Systèmes d’IA générative en santé : enjeux et perspectives
Nordlinger, B., Kirchner, C., & de Fresnoye, O. (2024) · Bulletin de l Académie Nationale de Médecine · doi:10.1016/j.banm.2024.03.005 · Cited by 4 · see citing works
Should Artificial Intelligence Play a Durable Role in Biomedical Research and Practice?
Bongrand, P. (2024) · International Journal of Molecular Sciences · doi:10.3390/ijms252413371 · Cited by 3 · see citing works
Can Researchers Write their Articles by Artificial Intelligence?
Mondal, H., & Mondal, S. (2023) · Journal of Applied Sciences and Clinical Practice · doi:10.4103/jascp.jascp_44_23 · Cited by 3 · see citing works
Let's have a chat about chatbot(s) in (biological) microscopy
Braet, F., & Poger, D. (2023) · Journal of Microscopy · doi:10.1111/jmi.13230 · Cited by 3 · see citing works
Making Large Language Models More Reliable and Beneficial: Taking ChatGPT as a Case Study
Majeed, A., & Hwang, S. O. (2024) · Computer · doi:10.1109/mc.2023.3327028 · Cited by 3 · see citing works
Generative AI can and should accelerate research evaluation reform to better recognize ‘distinctly human contributions’
Hosseini, M., Earp, B. D., Mann, S. P., & Holmes, K. (2026) · Research Evaluation · doi:10.1093/reseval/rvag020 · Cited by 2 · see citing works
Generative AI and ChatGPT in Industry and Education: Perspectives from Students, Educators and Industry Leaders
More, M., & Bothe, S. (2025) · South Asian Journal of Management · doi:10.62206/sajm.31.6.2024.9-28 · Cited by 1 · see citing works
Knowledge in Animals and Machines
Paul, L. A. (2026) · Journal of Neuroscience · doi:10.1523/jneurosci.0939-25.2025 · Cited by 1 · see citing works
Using ChatGPT in Statistical Analysis
Ordak, M. (2023) · JACC Advances · doi:10.1016/j.jacadv.2023.100776 · Cited by 1 · see citing works
Ortopedi ve travmatoloji araştırmalarında yapay zekâ uygulamaları: Doğal dil işleme potansiyeli
Köse, Ö., Yapar, D., & Boz, M. (2024) · Türk Ortopedi ve Travmatoloji Birliği Derneği · doi:10.5578/totbid.dergisi.2024.13 · Cited by 1 · see citing works
Can ChatGPT Grade Non-Native Academic English Writing?
Makarova, V., Li, Z., & Wang, Z. (2024) · Advances in educational technologies and instructional design book series · doi:10.4018/979-8-3693-1054-0.ch005 · Cited by 1 · see citing works
The need for ethical guidelines in mathematical research in the time of generative AI
Pantsar, M. (2025) · AI and Ethics · doi:10.1007/s43681-025-00660-5 · Cited by 1 · see citing works
Raison et comparaison des intelligences : ChatGPT est-il seulement logique ?
Boissier, M., & Bessis, N. (2023) · Revue du Rhumatisme · doi:10.1016/j.rhum.2023.07.008 · Cited by 1 · see citing works
The Assistance of Chatgpt-3.5 in Teaching English Academic WritingPreprint
Wang, M. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4726032 · Cited by 1 · see citing works
The possible application of artificial intelligence ChatGPT in the development of journal Recent Progress in Sciences
Recent Progress in Sciences Editorial Office (2025) · Recent Progress in Sciences · doi:10.70462/rps.2025.2.003 · Cited by 1 · see citing works
Battle of the brains: A comparison of human and ChatGPT health editorials
Boissier, M., & Bessis, N. (2023) · Joint Bone Spine · doi:10.1016/j.jbspin.2023.105610
Editorial. Using an AI interface to enhance reader experience: a test case
Shasby, G. (2023) · Journal of neurosurgery · doi:10.3171/2023.7.jns231621
MIS38 参加者企画報告「文章生成AIのもたらす学術情報への影響について」： 2023年7月時点の医学系図書館員コミュニティにおける生成系AIに関する対話の記録
郷史), S. H. (2024) · Igaku Toshokan · doi:10.7142/igakutoshokan.71.2_89
Exploring Educational Pathways for AI Literacy in Academic Libraries—An Empirical Analysis Based on Weibo Texts
叶, 芳. (2025) · Advances in Social Sciences · doi:10.12677/ass.2025.1410922
Towards a Body of Knowledge for Intelligent Low-Code/No-Code Systems Empowered by GenAI
Sá, D., Duarte, R., Barbosa, A., Guimarães, T., & Santos, M. F. (2025) · Procedia Computer Science · doi:10.1016/j.procs.2025.10.248
The AIR framework for research transparency: a critical analysis of stage-specific AI disclosure in the context of accessibility and research integrity
RUTTENBERG, D. (2026) · AI & Society · doi:10.1007/s00146-026-03082-x · Cited by 2 · see citing works
Science Friction – Wie viel Arbeit macht eine Publikation?
Friederichs, H. (2026) · doi:10.59350/pak0k-85q02
Science Friction – Wie viel Arbeit macht eine Publikation?
Friederichs, H. (2026) · doi:10.59350/90v31-45d69
GenAI in scholarly communication in light of interviews with humanists, theologians and artists in the early stages of their careers in 2023 and 2024
Świgoń, M. (2025) · Zagadnienia Informacji Naukowej - Studia Informacyjne · doi:10.36702/zin2024.02.07
Time and risk preferences among generative AI systems
Suh, W., & Atlas, S. (2026) · Journal of Business Research · doi:10.1016/j.jbusres.2026.116274
Generative Artificial Intelligence in Scientific Research and Scholarly Communication: A PRISMA-Compliant Systematic Review
Pasha, M. I. (2026) · Journal of Artificial Intelligence · doi:10.3923/jai.2026.94.99
Current status of medical students’ use of large language models for graduation thesis writing: a comparative cross-sectional survey
Liu, X., Luo, J., Chen, Y., Zhu, J., Liu, Y., & Wang, Z. (2026) · Frontiers in Medicine · doi:10.3389/fmed.2026.1948768

科学者がChatGPTを利用してデータから論文を生成
(2023) · Nature Digest · doi:10.1038/ndigest.2023.231018
Can ChatGPT write an academic paper? Review of "A Day in the Life of ChatGPT"
Foucart, A. (2023) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.7514986
ChatGPT for scientific paper writing—promises and perils
He, S., Yang, F., Zuo, J., & Lin, Z.-M. (2023) · The Innovation · doi:10.1016/j.xinn.2023.100524 · Cited by 13 · see citing works
Journals infiltrated with ‘copycat’ papers that can be written by AI
Naddaf, M. (2025) · Nature · doi:10.1038/d41586-025-03046-z · Cited by 5 · see citing works
ChatGPT v Bard v Bing v Claude 2 v Aria v human-expert. How good are AI chatbots at scientific writing? Supplementa
Lozić, E., & Štular, B. (2023) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.8345087

Authors: Conroy, G.
Corresponding author: Conroy, Gemma
Venue: Nature
Publisher: Springer Science and Business Media LLC
Published: 2023-07-07
Volume: 619
Issue: 7970
Pages: 443-444
ISSN: 0028-0836 (ISSN-L)
1476-4687
DOI: 10.1038/d41586-023-02218-z
OpenAlex: W4383551192
Cited by: 65
References: 0
Citations by year: 2026: 9 · 2025: 13 · 2024: 24 · 2023: 19
Type: other
Language: en
Open access: closed
Licence: www.springernature.com/gp/researchers/text-and-data-mining (tdm)
www.springernature.com/gp/researchers/text-and-data-mining (vor)
Locations: Nature (publishedVersion)
PubMed (publishedVersion)
RePEc: Research Papers in Economics (submittedVersion)
Topics: Social Sciences › Arts and Humanities › History and Philosophy of Science › Academic Writing and Publishing
Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence Applications
Social Sciences › Safety Research › Ethics and Social Impacts of AI
Keywords: ChatGPT, large language models, AI in scientific writing, research ethics, AI-generated content quality
MeSH terms: Authorship, Natural Language Processing, Research Report

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Scientists used ChatGPT to generate an entire paper from scratch — but is it any good?

Integrity signals

Claims the paper makes

Claims other papers make about this one

Cites

Cited by

Related

Record

About these checks