ChatGPT is fun, but not an author
Open accessThe DOI matches its Crossref record.
Abstract
In less than 2 months, the artificial intelligence (AI) program ChatGPT has become a cultural sensation. It is freely accessible through a web portal created by the tool’s developer, OpenAI. The program—which automatically creates text based on written prompts—is so popular that it’s likely to be “at capacity right now” if you attempt to use it. When you do get through, ChatGPT provides endless entertainment. I asked it to rewrite the first scene of the classic American play Death of a Salesman , but to feature Princess Elsa from the animated movie Frozen as the main character instead of Willy Loman. The output was an amusing conversation in which Elsa—who has come home from a tough day of selling—is told by her son Happy, “Come on, Mom. You’re Elsa from Frozen . You have ice powers and you’re a queen. You’re unstoppable.” Mash-ups like this are certainly fun, but there are serious implications for generative AI programs like ChatGPT in science and academia.
Overview
CoChat Summary
TL;DR
Thorp argues that ChatGPT is entertaining but unsuitable as a scientific author, citing its tendency to produce plausible-sounding errors and a study in which reviewers caught only 68% of AI-generated abstracts. Science journals are updating policies to bar ChatGPT/AI-generated text, figures, images, and graphics from papers and to prohibit AI authorship.
Key findings
- ChatGPT can be fun and conversational, but it “sometimes writes plausible-sounding but incorrect or nonsensical answers,” including referencing a scientific study that does not exist.
- In a cited recent study, abstracts created by ChatGPT were submitted to academic reviewers, who only caught 68% of these fakes.
- The Science family of journals is updating its license and Editorial Policies to specify that text generated by ChatGPT or any other AI tools cannot be used in the work, nor can figures, images, or graphics be products of such tools; an AI program cannot be an author.
- Violations will constitute scientific misconduct no different from altered images or plagiarism, though legitimate AI-generated data sets in research papers are not covered by this change.
Methods
- Editorial/commentary by the Editor-in-Chief of Science journals; no empirical study or systematic analysis is reported.
- Uses anecdotal demonstrations, including asking ChatGPT to rewrite the first scene of Death of a Salesman with Princess Elsa as the main character, and giving it an exam and final project from a science denial class taught at George Washington University.
- Cites a recent study in which ChatGPT-created abstracts were submitted to academic reviewers and only 68% were caught.
Limitations
- The paper states no formal limitations.
- Evident from the text: the argument relies on anecdotal examples and a cited study without methodological detail, and it is an editorial policy statement rather than an empirical evaluation.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
0 Valid · 1 Not valid · 1 Not checked · 6 Own results and interpretations
A result the paper states — it cites no source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“It certainly can write essays about a range of topics.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
None of the sources cited for this claim have been checked yet.
In the paper
“Nevertheless, as the website states, “ChatGPT sometimes writes plausible-sounding but incorrect or nonsensical answers.””
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“In a recent study, abstracts created by ChatGPT were submitted to academic reviewers, who only caught 68% of these fakes.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: unclear — It is unclear why the paper says it holds.
- Probably not a substantial claim. 5
- It may state two separate claims as one. 1
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source doesn’t support the claim as written.
In the citing paper
“However, there is cause for concern as one study has shown that peer reviewers can only identify 63% of abstracts written using Chat GPT, indicating that such instances of academic fraud may precipitate a reputation crisis within academia (Thorp, 2023).”
From Reflection on whether Chat GPT should be banned by academia from the perspective of education and teaching (2023) · cites this paper as Thorp, 2023
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Third, the generation of non-original, over-detailed, or excessive content can be an additional burden for researchers who should carefully supervise the ChatGPT-generated content [14,24,25,26,65,71].”
From ChatGPT Utility in Healthcare Education, Research, and Practice: Systematic Review on the Promising Perspectives and Valid Concerns (2023) · cites this paper as [24]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The disapproval of including ChatGPT or any other LLM in the list of authors was clearly explained in Science, Nature, and the Lancet editorials, which referred to such practice as scientific misconduct, and this view was echoed by many scientists [24,27,35,40,45].”
From ChatGPT Utility in Healthcare Education, Research, and Practice: Systematic Review on the Promising Perspectives and Valid Concerns (2023) · cites this paper as [24]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The need to rethink and revise the current assessment tools in health care education comes in light of ChatGPT’s ability to pass reputable exams (e.g., USMLE) and possibility of ChatGPT misuse, which would result in academic dishonesty [24,34,58,59,62,76,85,86,87].”
From ChatGPT Utility in Healthcare Education, Research, and Practice: Systematic Review on the Promising Perspectives and Valid Concerns (2023) · cites this paper as [24]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Some journals, such as Science, have banned the use of LLMs because of the ethical problems they raise concerning responsible authorship.”
From The ethics of disclosing the use of artificial intelligence tools in writing scholarly manuscripts (2023) · cites this paper as Thorp, 2023
Experimental — accuracy not yet measured
5 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Still being checked.
Cited by
Items 1,401–1,439 of 1,439
From Scrubs to Scripts: ChatGPT’s Evolving Role across the Orthopedic Career Ladder
Kushwaha, N. S., Kannaujiya, M., Chaudhary, S. K., Singh, A., Kumar, A., & Kumar, A. (2026) · Journal of Bone and Joint Diseases · doi:10.4103/jbjd.jbjd_34_25
Ding, M., Hu, P., Lan, Y., Chen, Q., Lin, Z., & Shen, G. (2026) · Journal of Urban Technology · doi:10.1080/10630732.2026.2711575
10 insights for harnessing artificial intelligence in scientific research: supervisor perspectives
Mitra, N. K., Vishnumukkala, T., & Chitra, E. (2026) · MedEdPublish · doi:10.12688/mep.21799.1
Declaring the machine: A disclosure policy on artificial intelligence for authors and reviewers
Iliescu, D., & Greiff, S. (2026) · Intelligence · doi:10.1016/j.intell.2026.102060
Chen, X., Liu, J., Ye, P., Li, Y., Sun, H., Li, R., Hou, Z., & Yan, J. (2026) · Journal of Computer Assisted Learning · doi:10.1002/jcal.70315
Duțu, A., Ives, B., Georgescu, B.-G., Dumitru, I., & Ferretti, S. (2026) · Lecture notes in networks and systems · doi:10.1007/978-3-032-33581-4_24
Control strategies for series active variable geometry suspension systems: a systematic review
Masih‐Tehrani, M. (2026) · Discover Vehicles · doi:10.1007/s44465-026-00045-w
Wang, S., & Zhao, J. (2026) · Frontiers in Psychology · doi:10.3389/fpsyg.2026.1929887
Generative AI in peer review: evolving policies and regulatory pathways for scientific rigour
Jozaghi, E. (2026) · AI and Ethics · doi:10.1007/s43681-026-01394-8
Finding the Fingerprints of Generative Artificial Intelligence in Psychology Publications
Botes, E., Teuber, Z., Vitali, N., Dewaele, J., & Colling, J. (2026) · Advances in Methods and Practices in Psychological Science · doi:10.1177/25152459261472842 · Cited by 5
yuan, W., & Zheng, J. (2026) · Research Square · doi:10.21203/rs.3.rs-10487555/v1
From prohibition to integration: LLMs in scientific publishing
Kirov, B., Marinchev, A., Peykov, S., & Galabov, V. T. (2026) · Frontiers in Genetics · doi:10.3389/fgene.2026.1947911
The Right to Be Called an Author: Generative AI, Epistemic Responsibility, and the Duty to DefendPreprint
Frimpong, V. (2026) · Qeios · doi:10.32388/i26t1l
Ünal, A. (2026) · Ethics and Information Technology · doi:10.1007/s10676-026-09921-1
Hart, M. L., Walsh, M. C., Raimondo, C., Kato, R., & Rolauffs, B. (2026) · Frontiers in Bioengineering and Biotechnology · doi:10.3389/fbioe.2026.1933082
del Giglio, A. (2026) · Journal of Hospital Librarianship · doi:10.1080/15323269.2026.2734722
Tan, W. H. E., Yeo, M. M. L., Toh, A. L. L., & Wansing, E. S. (2026) · Pedagogies An International Journal · doi:10.1080/1554480x.2026.2733074
Who answers for the machine? the ethics of AI in medical writing
McCarthy, F., Tamilselvan, S., & Alaraj, A. M. (2026) · Neurological Research · doi:10.1080/01616412.2026.2740660
AI-Directed Research and the Loss of Scientific Direction
Kim, J. W. (2026) · International Neurourology Journal · doi:10.5213/inj.2626edi03
Beyond General LLMs: Grounded AI for Active Learning
Luna, A., Chong, M., Pina, J. M. M. D., González, C., Pantoja, D., & Martínez-Montezuma, R. (2026) · Congreso de Tecnología, Aprendizaje y Enseñanza de la Electrónica (TAEE) · doi:10.1109/taee68119.2026.11702156
A Framework for AI-Driven Research Automation: The VigyaanSetu Approach
Mhalsank, A., Mane, A., Mabbu, J., & Deshmukh, J. (2026) · International Conference on Innovation & Growth in Next-Gen Intelligent Technology & Engineering (IGNITE) · doi:10.1109/ignite69592.2026.11706651
Artificial Intelligence in the Preparation of Scientific Articles
Aldoshin, S. M., Ananikov, V. P., Beletskaya, I. P., Berlin, A. A., Boinovich, L. B., Bukhtiyarov, V. I., Voshkin, A. A., Gorbunova, Y. G., Григорович, К. В., Dzhemilev, U. M., et al. (2026) · Russian Chemical Reviews · doi:10.59761/rcr5247
Ismaili, Y. (2026) · Accountability in Research · doi:10.1080/08989621.2026.2741356
The Right to Be Called an Author: Generative AI, Epistemic Responsibility, and the Duty to DefendPreprint
Frimpong, V. (2026) · Qeios · doi:10.32388/i26t1l.2
Entre Bytes y Palabras: El Impacto de la Inteligencia Artificial en la Producción Académica
Ferigato, G. C., de Almeida, S. D. C. D., & Fernandes, Á. M. (2026) · Etic net Revista científica electrónica de Educación y Comunicación en la Sociedad del Conocimiento · doi:10.30827/eticanet.v26i2.32861
Predicting the long-term impact of AI assistants on collective intelligencePreprint
Kim, J., & Park, S. W. (2026) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.64898/2026.09.29.755292
АВТОРСТВО ЗА УЧАСТІ ГЕНЕРАТИВНОГО ШІ: ВІД ПРЕЦЕДЕНТІВ ДО СТАНДАРТУ ПРОЗОРОГО ВИКОРИСТАННЯ
ЯРОШЕВСЬКА, Т., & Matukhno, K. O. (2026) · Juris Europensis Scientia · doi:10.32782/chern.v4.2026.9
Pasha, M. I. (2026) · Journal of Artificial Intelligence · doi:10.3923/jai.2026.94.99
Liu, X., Luo, J., Chen, Y., Zhu, J., Liu, Y., & Wang, Z. (2026) · Frontiers in Medicine · doi:10.3389/fmed.2026.1948768
Fernández, J. G., Sevilmiş, A., Sánchez, S. A., & Tsitskari, E. (2026) · Sport Business and Management An International Journal · doi:10.1108/sbm-01-2026-0020
Nurislom, A. (2026) · Центральноазиатский журнал образования и инноваций · doi:10.70413/cajei-v05-i10-s92243 · Cited by 1
Aulianto, D. R. (2026) · Cureus Journal of AI-Augmented Research · doi:10.7759/s44568-026-00331-x
Bağcivan, E. (2026) · Özgür Yayınları eBooks · doi:10.58830/ozgur.pub1557.c6364
Botes, E., Dewaele, J., Colling, J., & Teuber, Z. (2026) · Modern Language Journal · doi:10.1111/modl.70094
Towne, B. P. (2026) · Discover Artificial Intelligence · doi:10.1007/s44163-026-02604-2
Andonotopo, W., Pramono, M. B. A., Dewantiningrum, J., Suryawan, A., Putra, R. A., Rahardjo, T. M., Rumanti, R. T., Lengkey, R. F., Setiawan, A., Gunadi, J. W., et al. (2026) · West Kazakhstan Public Health Journal · doi:10.4103/wkpj.wkpj_44_26
Hakimi, M., Hakimi, M., & Sazish, B. (2026) · Journal of Science and Education (JSE) · doi:10.58905/jse.v7i1.62
Zaitsev, A. A., Agin, A. M., & Zaitsev, A. Y. (2026) · Культура и искусство · doi:10.7256/2454-0625.2026.10.82786
Metadata
- Authors
- Thorp, H. H.
- Affiliations
- H. Holden Thorp Editor-in-Chief, Science journals.
- Corresponding author
- Thorp, H. Holden
- ORCID
- Thorp, H. Holden
- Venue
- Science
- Published
- 2023-01-27
- Volume
- 379
- Issue
- 6630
- Pages
- 313-313
- ISSN
- 0036-8075 (ISSN-L)
- 1095-9203
- OpenAlex
- W4318263917
- Semantic Scholar
- eddfb9be78cfe94193766e3722eb0e56c3d24cef
- Cited by
- 1,437
- References
- 0
- Citations by year
- 2026: 176 · 2025: 280 · 2024: 456 · 2023: 522
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Science (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence Applications
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Keywords
- ChatGPT, generative AI, authorship, AI-generated text, academic integrity, scientific writing, artificial intelligence in education, OpenAI, Death of a Salesman
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-11-03, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-11-03 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.