Artificial intelligence-assisted academic writing: recommendations for ethical use
Open accessAbstract
Generative artificial intelligence (AI) tools have been selectively adopted across the academic community to help researchers complete tasks in a more efficient manner. The widespread release of the Chat Generative Pre-trained Transformer (ChatGPT) platform in 2022 has made these tools more accessible to scholars around the world. Despite their tremendous potential, studies have uncovered that large language model (LLM)-based generative AI tools have issues with plagiarism, AI hallucinations, and inaccurate or fabricated references. This raises legitimate concern about the utility, accuracy, and integrity of AI when used to write academic manuscripts. Currently, there is little clear guidance for healthcare simulation scholars outlining the ways that generative AI could be used to legitimately support the production of academic literature. In this paper, we discuss how widely available, LLM-powered generative AI tools (e.g. ChatGPT) can help in the academic writing process. We first explore how academic publishers are positioning the use of generative AI tools and then describe potential issues with using these tools in the academic writing process. Finally, we discuss three categories of specific ways generative AI tools can be used in an ethically sound manner and offer four key principles that can help guide researchers to produce high-quality research outputs with the highest of academic integrity.
AI snapshot
Written from the paper’s full text.
TL;DR
This paper offers ethical guidance for healthcare simulation scholars on using LLM-powered generative AI, especially ChatGPT, in academic writing. It reviews publisher policies and known risks, then proposes tiers of acceptable use and four author reflection questions.
Key findings
- Publisher and editorial guidance converges on transparency, non-authorship of AI tools, and the primacy of authors’ creative and intellectual contributions; AI cannot be accountable for accuracy or approve manuscripts.
- Cited studies report serious reference problems: among 50 ChatGPT-generated research protocols, 38% had a wrong or fabricated DOI and 16% of referenced articles were completely fabricated; among 30 short medical papers, nearly half of references were fabricated, 46% were authentic but inaccurate, and only 7% of all references were completely authentic and accurate.
- The authors classify uses into ethical tiers: most acceptable uses restructure existing text (grammar/spelling, readability, translation); contingent uses include outlines, summaries, clarity edits, and brainstorming; suspect uses include drafting de novo text, data interpretation, literature review, and checking ethical compliance or plagiarism.
- They propose four author checklist questions covering original ideas/interpretations, maintaining human competency, checking accuracy/reliability/bias of content and references, and disclosing exactly how generative AI was used.
Methods
- This is a narrative/commentary paper, not an empirical study; the authors conducted a literature search and asked ChatGPT4, “What recommendations exist for ethical use of ChatGPT in academic writing?”
- They reviewed the literature search and ChatGPT response, identified original source materials, discussed them, and incorporated edited content with original ideas from the authorship team.
- They also asked ChatGPT 4.0 for a list of ways ChatGPT can be ethically used to assist authors writing for medical journals, then reflected on, modified, or excluded items to produce their suggested ethical-use framework.
Limitations
- The paper states its concepts apply solely to ChatGPT and other similar LLM-powered generative AI tools, and that recommendations may need revision as technology evolves.
- The paper states it did not discuss generative AI tools developed specifically for the academic community, such as Scopus AI, and calls for future research on those tools.
- Evident from the text: the recommendations are based on literature review, ChatGPT outputs, and author reflection rather than systematic review or empirical validation, and the ethical tiers are presented as guidance rather than an exhaustive list of permissible or impermissible actions.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
0 of 48 cited sources checked · 0 supported · 0 flagged
- Premisecitation
LLM-based generative AI tools have issues with plagiarism.
“Studies highlight three key challenges with content created by LLM-based generative AI tools: (a) plagiarism [5, 6];”
Quote in the paperSubstantial claim0 of 2 sources checked- cites [5] Kim S-J. Research ethics and issues regarding the use of ChatGPT-like artificial intelligence platforms by authors and reviewers: a narrative review. Science Editing. 2024;11(2):96–106. source
Not checked in the free run.
- cites [6] Kacena MA, Plotkin LI, Fehrenbacher JC. The use of artificial intelligence in writing scientific review articles. Curr Osteoporos Rep. 2024;22(1):115–21. source
Not checked in the free run.
- Premisecitation
Among references generated by ChatGPT for 50 research protocols, 38% had the wrong DOI or a fabricated DOI.
“Amongst the references generated for these research protocols, 38% had the wrong DOI or a fabricated DOI”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [15] Athaluri SA, Manthena SV, Kesapragada V, Yarlagadda V, Dave T, Duddumpudi RTS. Exploring the boundaries of reality: investigating the phenomenon of artificial intelligence hallucination in scientific writing through ChatGPT references. Cureus. 2023;15(4): e37432.
Not checked in the free run.
- Premisecitation
LLM-based generative AI tools have issues with inaccurate or fabricated references.
“(c) inaccurate or fabricated references [13–17].”
Quote in the paperSubstantial claim0 of 5 sources checked- cites [13] Alkaissi H, McFarlane SI. Artificial hallucinations in ChatGPT: implications in scientific writing. Cureus. 2023;15(2): e35179.
Not checked in the free run.
- cites [14] Buholayka M, Zouabi R, Tadinada A. The readiness of ChatGPT to write scientific case reports independently: a comparative evaluation between human and artificial intelligence. Cureus. 2023;15(5): e39386.
Not checked in the free run.
- cites [15] Athaluri SA, Manthena SV, Kesapragada V, Yarlagadda V, Dave T, Duddumpudi RTS. Exploring the boundaries of reality: investigating the phenomenon of artificial intelligence hallucination in scientific writing through ChatGPT references. Cureus. 2023;15(4): e37432.
Not checked in the free run.
- cites [16] Bhattacharyya M, Miller VM, Bhattacharyya D, Miller LE. High rates of fabricated and inaccurate references in ChatGPT-generated medical content. Cureus. 2023;15(5): e39238.
Not checked in the free run.
- cites [17] Benichou L, ChatGpt. The role of using ChatGPT AI in writing medical scientific articles. J Stomatol Oral Maxillofac Surg. 2023;124(5):101456. source
Not checked in the free run.
- Premisecitation
Among references generated by ChatGPT for 50 research protocols, 16% of the referenced articles were completely fabricated.
“and 16% of the referenced articles were completely fabricated”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [15] Athaluri SA, Manthena SV, Kesapragada V, Yarlagadda V, Dave T, Duddumpudi RTS. Exploring the boundaries of reality: investigating the phenomenon of artificial intelligence hallucination in scientific writing through ChatGPT references. Cureus. 2023;15(4): e37432.
Not checked in the free run.
- Premisecitation
LLM-based generative AI tools have issues with fabricated or false information (AI hallucination).
“(b) fabricated or false information (i.e. ‘AI hallucination’) [13–15];”
Quote in the paperSubstantial claim0 of 3 sources checked- cites [13] Alkaissi H, McFarlane SI. Artificial hallucinations in ChatGPT: implications in scientific writing. Cureus. 2023;15(2): e35179.
Not checked in the free run.
- cites [14] Buholayka M, Zouabi R, Tadinada A. The readiness of ChatGPT to write scientific case reports independently: a comparative evaluation between human and artificial intelligence. Cureus. 2023;15(5): e39386.
Not checked in the free run.
- cites [15] Athaluri SA, Manthena SV, Kesapragada V, Yarlagadda V, Dave T, Duddumpudi RTS. Exploring the boundaries of reality: investigating the phenomenon of artificial intelligence hallucination in scientific writing through ChatGPT references. Cureus. 2023;15(4): e37432.
Not checked in the free run.
- Interpretationcitation
The ability of ChatGPT to generate accurate references is potentially linked to the availability of a DOI and accessibility of online articles.
“suggesting that the ability of ChatGPT to generate accurate references is potentially linked to the availability of a DOI and accessibility of online articles [15].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [15] Athaluri SA, Manthena SV, Kesapragada V, Yarlagadda V, Dave T, Duddumpudi RTS. Exploring the boundaries of reality: investigating the phenomenon of artificial intelligence hallucination in scientific writing through ChatGPT references. Cureus. 2023;15(4): e37432.
Not checked in the free run.
- Interpretationcitation
ChatGPT is notoriously unreliable in citing references.
“As noted above, published evidence indicates that ChatGPT is notoriously unreliable in citing references and can easily generate grammatically perfect references that do not actually exist.”
Quote in the paperSubstantial claim - Premisecitation
This mapping process utilises an extensive set of pre-learned token associations derived from large sets of human-generated data (typically the internet).
“This mapping process utilises an extensive set of pre-learned token associations derived from large sets of human-generated data (typically the internet).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [2] Thirunavukarasu AJ, Ting DSJ, Elangovan K, Gutierrez L, Tan TF, Ting DSW. Large language models in medicine. Nat Med. 2023;29(8):1930–40. source
Not checked in the free run.
- Premisecitation
AI tools tend to generate output that reproduces or amplifies biases inherent within the source data.
“A final issue is that AI tools will tend to generate output that reproduces or amplifies biases inherent within the source data [19].”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [19] Hosseini M, Rasmussen LM, Resnik DB. Using AI to write scholarly publications. Account Res. 2024;31(7):715–23. source
Not checked in the free run.
- Premisecitation
Generative AI has limited ability to comprehend complex commands.
“Further complicating this issue is generative AI’s limited ability to comprehend complex commands [14].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [14] Buholayka M, Zouabi R, Tadinada A. The readiness of ChatGPT to write scientific case reports independently: a comparative evaluation between human and artificial intelligence. Cureus. 2023;15(5): e39386.
Not checked in the free run.
- Interpretationreasoning
There is a reasonable chance that the indiscriminate use of ChatGPT to assure ethical, unbiased language will introduce and perpetuate, rather than remove, bias.
“Barring future developments that permit the creation of truly unbiased training datasets, there is a reasonable chance that the indiscriminate use of ChatGPT in this way will introduce and perpetuate, rather than remove, bias.”
Quote in the paperSubstantial claim - Premisecitation
It is possible to query LLMs in a manner that causes them to reproduce elements of their training set verbatim, thus potentially introducing plagiarised text.
“Training set issues also form the basis of our concerns regarding the use of AI to avoid plagiarism, as it is possible to query LLM’s in a manner that causes them to reproduce elements of their training set verbatim, thus potentially introducing plagiarised text that otherwise would not find its way into the manuscript [18].”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [18] The plagiarism problem: how generative ai models reproduce copyrighted content. Available from: https://bardai.ai/2024/01/10/the-plagiarism-problem-how-generative-ai-models-reproduce-copyrighted-content/. Accessed December 1, 2024.
Not checked in the free run.
- Premisereasoning
When asked to write medical abstracts, case reports, or research proposals, generative AI tools frequently include inaccurate statements or fabricated content fueled by false sources of data.
“Consequently, when asked to write medical abstracts, case reports, or research proposals, these generative AI tools frequently include inaccurate statements or fabricated content fueled by false sources of data [13–15].”
Quote in the paperSubstantial claim0 of 3 sources checked- cites [13] Alkaissi H, McFarlane SI. Artificial hallucinations in ChatGPT: implications in scientific writing. Cureus. 2023;15(2): e35179.
Not checked in the free run.
- cites [14] Buholayka M, Zouabi R, Tadinada A. The readiness of ChatGPT to write scientific case reports independently: a comparative evaluation between human and artificial intelligence. Cureus. 2023;15(5): e39386.
Not checked in the free run.
- cites [15] Athaluri SA, Manthena SV, Kesapragada V, Yarlagadda V, Dave T, Duddumpudi RTS. Exploring the boundaries of reality: investigating the phenomenon of artificial intelligence hallucination in scientific writing through ChatGPT references. Cureus. 2023;15(4): e37432.
Not checked in the free run.
- Interpretationreasoning
The use of ChatGPT to assure ethical, unbiased language is suspect due to unavoidable biases contained within the textual databases used to train LLM statistical models.
“The use of ChatGPT to assure ethical, unbiased language is even more suspect, due to unavoidable biases contained within the textual databases that are used to train the LLM statistical models.”
Quote in the paperSubstantial claim - Premisecitation
Among 30 short medical papers generated by ChatGPT, 46% of the references were authentic but inaccurate.
“while 46% of the references were authentic but inaccurate [16].”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [16] Bhattacharyya M, Miller VM, Bhattacharyya D, Miller LE. High rates of fabricated and inaccurate references in ChatGPT-generated medical content. Cureus. 2023;15(5): e39238.
Not checked in the free run.
- Premisecitation
Generative AI tools do not meet the generally agreed standards of authorship of academic research.
“Another core principle reflected in these statements is that, despite their ability to generate novel and new text, generative AI tools do not meet the generally agreed standards of authorship of academic research [7, 9, 11, 12].”
Quote in the paperSubstantial claim0 of 4 sources checked- cites [7] Flanagin A, Bibbins-Domingo K, Berkwits M, Christiansen SL. Nonhuman “Authors” and implications for the integrity of scientific publication and medical knowledge. JAMA. 2023;329(8):637–9. source
Not checked in the free run.
- cites [9] COPE position - Authorship and AI - English. Available from: https://publicationethics.org/guidance/cope-position/authorship-and-ai-tools. Accessed December 1, 2024.
Not checked in the free run.
- cites [11] Zielinski C, Winker MA, Aggarwal R, Ferris LE, Heinemann M, Lapena JF Jr, et al. Chatbots, generative AI, and scholarly manuscripts: WAME recommendations on chatbots and generative artificial intelligence in relation to scholarly publications. Colomb Med (Cali). 2023;54(3): e1015868. source
Not checked in the free run.
- cites [12] McNutt MK, Bradford M, Drazen JM, Hanson B, Howard B, Jamieson KH, et al. Transparency in authors’ contributions and responsibilities to promote integrity in scientific publication. Proc Natl Acad Sci U S A. 2018;115(11):2557–60. source
Not checked in the free run.
- Premisecitation
Scopus AI draws data from abstracts, author profiles, articles, books, reviews, and other reliable sources.
“Furthermore, we have not discussed generative AI tools developed specifically for the academic community, such as Scopus AI, which draws data from abstracts, author profiles, articles, books, reviews, and other reliable sources [24].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [24] Scopus AI: Trusted content. Powered by responsible AI. Available from: https://www.elsevier.com/products/scopus/scopus-ai. Accessed December 1, 2024.
Not checked in the free run.
- Premisecitation
Only 7% of all the references generated by ChatGPT were completely authentic and accurate.
“Only 7% of all the references generated by ChatGPT were completely authentic and accurate”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [16] Bhattacharyya M, Miller VM, Bhattacharyya D, Miller LE. High rates of fabricated and inaccurate references in ChatGPT-generated medical content. Cureus. 2023;15(5): e39238.
Not checked in the free run.
- Interpretationcitation
Similarities in content that are undetected and unedited by researchers raise concern for plagiarism and potential copyright infringement.
“Similarities in content that are undetected and unedited by researchers raises concern for plagiarism and potential copyright infringement (e.g. use of published figure without attribution or permission) [18].”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [18] The plagiarism problem: how generative ai models reproduce copyrighted content. Available from: https://bardai.ai/2024/01/10/the-plagiarism-problem-how-generative-ai-models-reproduce-copyrighted-content/. Accessed December 1, 2024.
Not checked in the free run.
- Premisecitation
New models of ChatGPT cannot differentiate between real and factitious data that is received, integrated and used to generate new content.
“While new models of ChatGPT have ‘learned’ compared to prior releases, they cannot differentiate between real and factitious data that is received, integrated and used to generate new content [19].”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [19] Hosseini M, Rasmussen LM, Resnik DB. Using AI to write scholarly publications. Account Res. 2024;31(7):715–23. source
Not checked in the free run.
- Interpretationcitation
Left unchecked, this may result in a snowball effect, where authors unknowingly cite AI-generated plagiarised text published in other articles (double plagiarism).
“Left unchecked, this may result in a snowball effect, where authors unknowingly cite AI-generated plagiarised text published in other articles (i.e. double plagiarism) [5].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [5] Kim S-J. Research ethics and issues regarding the use of ChatGPT-like artificial intelligence platforms by authors and reviewers: a narrative review. Science Editing. 2024;11(2):96–106. source
Not checked in the free run.
- Premisecitation
Systems such as ChatGPT represent mathematical models mapping specific segments of text and symbols (tokens) in the initial request with segments of text and symbols in the LLM's answer.
“systems such as these represent mathematical models mapping specific segments of text and symbols (often called ‘tokens’) in the initial request with segments of text and symbols in the LLM’s ‘answer’ [2].”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [2] Thirunavukarasu AJ, Ting DSJ, Elangovan K, Gutierrez L, Tan TF, Ting DSW. Large language models in medicine. Nat Med. 2023;29(8):1930–40. source
Not checked in the free run.
- Premisecitation
Among 30 short medical papers generated by ChatGPT, nearly half of the references were fabricated.
“amongst 30 short medical papers generated by ChatGPT, nearly half of the references were fabricated”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [16] Bhattacharyya M, Miller VM, Bhattacharyya D, Miller LE. High rates of fabricated and inaccurate references in ChatGPT-generated medical content. Cureus. 2023;15(5): e39238.
Not checked in the free run.
- Premisecitation
Generative AI tools have the ability to produce novel written content on their own.
“Unlike these previous tools, however, generative AI tools have introduced a challenge to traditional notions of academic integrity: rather than simply helping researchers more efficiently conduct or complete research tasks, generative AI tools now have the ability to produce novel written content on their own [5–8].”
Quote in the paperSubstantial claim0 of 4 sources checked- cites [5] Kim S-J. Research ethics and issues regarding the use of ChatGPT-like artificial intelligence platforms by authors and reviewers: a narrative review. Science Editing. 2024;11(2):96–106. source
Not checked in the free run.
- cites [6] Kacena MA, Plotkin LI, Fehrenbacher JC. The use of artificial intelligence in writing scientific review articles. Curr Osteoporos Rep. 2024;22(1):115–21. source
Not checked in the free run.
- cites [7] Flanagin A, Bibbins-Domingo K, Berkwits M, Christiansen SL. Nonhuman “Authors” and implications for the integrity of scientific publication and medical knowledge. JAMA. 2023;329(8):637–9. source
Not checked in the free run.
- cites [8] Dergaa I, Chamari K, Zmijewski P, Ben SH. From human writing to artificial intelligence generated text: examining the prospects and potential threats of ChatGPT in academic writing. Biol Sport. 2023;40(2):615–22. source
Not checked in the free run.
- Classified as probably not a substantial claim. 20
- May combine two claims. 15
Classified as probably not a substantial claim. May combine two claims.
Findingown dataChatGPT oversimplified many items in the list it provided, which may result in misleading guidance for academic authors and scholars.
“We found that ChatGPT oversimplified many items in this list, which may results in misleading guidance for academic authors and scholars.”
Quote in the paperSubstantial claimClassified as probably not a substantial claim.
InterpretationreasoningUsing ChatGPT for generating an outline, summarising content, improving clarity of drafted content, or brainstorming ideas tasks ChatGPT with generating novel text and thus has heightened potential for the introduction of bias, hallucination, or plagiarism if engaged in uncritically.
“In each case, these uses task ChatGPT with generating novel text and thus have heightened potential for the introduction of bias, hallucination, or plagiarism if engaged in uncritically.”
Quote in the paperSubstantial claimMay combine two claims.
PremisecitationThe International Committee of Medical Journal Editors, JAMA Network Journals, and the World Association of Medical Editors have all issued specific guidelines on the use of generative AI.
“Further, and especially relevant to the work of academic writers in healthcare simulation, the International Committee of Medical Journal Editors [10], JAMA Network Journals [7], and the World Association of Medical Editors [11] have all issued specific guidelines on the use of generative AI.”
Quote in the paperNot a substantial claim0 of 3 sources checked- cites [10] Editors ICoMJ. Recommendations for the conduct, reporting, editing, and publication of scholarly work in medical journals 2025. Available from: https://www.icmje.org/icmje-recommendations.pdf. Accessed April 4, 2025.
Not checked in the free run.
- cites [7] Flanagin A, Bibbins-Domingo K, Berkwits M, Christiansen SL. Nonhuman “Authors” and implications for the integrity of scientific publication and medical knowledge. JAMA. 2023;329(8):637–9. source
Not checked in the free run.
- cites [11] Zielinski C, Winker MA, Aggarwal R, Ferris LE, Heinemann M, Lapena JF Jr, et al. Chatbots, generative AI, and scholarly manuscripts: WAME recommendations on chatbots and generative artificial intelligence in relation to scholarly publications. Colomb Med (Cali). 2023;54(3): e1015868. source
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).
Interpretationnone givenLLM-powered generative AI tools can be used to provide translation of text into a semantically equivalent receptor language.
“LLM-powered generative AI tools can also be used to provide translation of text into a semantically equivalent receptor language, which may be helpful for researchers looking to submit an article in a non-native language.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim. May combine two claims.
InterpretationreasoningGenerative AI tools cannot be held responsible for the accuracy of the manuscript's content, nor approve a submitted or published manuscript or vouch to support any subsequent investigation of claims made against the work.
“These tools, however, cannot be held responsible for the accuracy of the manuscript’s content, nor approve a submitted or published manuscript or vouch to support any subsequent investigation of claims made against the work.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.
Interpretationnone givenChatGPT is not designed to directly check grammar and spelling, but it will respond to prompts by rewriting content in a grammatically correct fashion without spelling mistakes.
“While ChatGPT is not designed to directly check grammar and spelling, it will respond to prompts by rewriting content in a grammatically correct fashion without spelling mistakes.”
Quote in the paperNot a substantial claimMay combine two claims.
PremisecitationAmong the inaccurate references generated by ChatGPT, 48% were errors with the title, 52% represented errors with authorship, and 93% had the wrong PMID.
“Amongst the inaccurate references, 48% were errors with the title, 52% represented errors with authorship, and 93% of these references had the wrong PMID.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [16] Bhattacharyya M, Miller VM, Bhattacharyya D, Miller LE. High rates of fabricated and inaccurate references in ChatGPT-generated medical content. Cureus. 2023;15(5): e39238.
Not checked in the free run.
Probably not a substantial claim: may not pass S2 (checkable), S4 (based). May combine two claims.
Interpretationnone givenResearchers ultimately hold full responsibility for the originality of their manuscript, accuracy and relevance of content, and appropriate referencing of published literature.
“Researchers ultimately hold full responsibility for the originality of their manuscript, accuracy and relevance of content, and appropriate referencing of published literature.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable), S4 (based). May combine two claims.
InterpretationreasoningThe use of ChatGPT to perform the primary analysis of study data introduces the possibility of bias and hallucination and short-circuits an intellectual process that is most properly the domain of the authors.
“The use of ChatGPT to perform the primary analysis of study data introduces the possibility of bias and hallucination and effectively short-circuits an intellectual process that is most properly the domain of the authors.”
Quote in the paperNot a substantial claimMay combine two claims.
PremisecitationThe model is not explicitly utilising the meaning of tokens, but is rather generating syntactically appropriate strings of text based on statistical associations.
“While the ‘meaning’ of these tokens is implicit to some extent within these associations, the model is not explicitly utilising this meaning, but is rather generating syntactically appropriate strings of text based on statistical associations [20].”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [20] Ferrer J. How transformers work: a detailed exploration of transformer architecture 2024. Available from: https://www.datacamp.com/tutorial/how-transformers-work?utm_source=google&utm_medium=paid_search&utm_campaignid=19589720830&utm_adgroupid=157156377071&utm_device=m&utm_keyword=&utm_matchtype=&utm_network=g&utm_adpostion=&utm_creative=684592141199&utm_targetid=dsa-2218886984380&utm_loc_interest_ms=&utm_loc_physical_ms=9191512&utm_content=dsa~tofu~tutorial~machine-learning&accountid=9624585688&utm_campaign=230119_1-sea~dsa~tofu_2-b2c_3-nam_4-prc_5-na_6-na_7-le_8-pdsh-go_9-nb-e_10-na_11-na&ga
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationAI writing assistants (e.g. Grammarly) have been specifically designed for real-time writing support, proactive suggestions to rewrite sentences, and adjusting tone.
“Authors looking for real-time writing support (e.g. grammar and spelling suggestions as you write), proactive suggestions to rewrite sentences, and adjusting the tone of writing should look to AI writing assistants (e.g. Grammarly), which have been specifically designed for these purposes [21].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [21] Grammarly vs. ChatGPT: choosing the right AI writing assistant. Available from: https://www.grammarly.com/blog/grammarly-vs-competition/grammarly-vs-chatgpt/#:~:text=Here's%20an%20example%20of%20Grammarly's,Writing%20Coach%2C%20to%20get%20feedback. Accessed December 1, 2024.
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing).
InterpretationreasoningIt is possible that the issues of bias and hallucinations may be mitigated in academic generative AI tools.
“it is possible that the issues of bias and hallucinations may be mitigated in these platforms.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
InterpretationreasoningChatGPT will help with refining the readability and flow of the manuscript, assuring that it uses the best grammatical syntax.
“It will also help with refining the readability and flow of the manuscript, assuring that it uses the best grammatical syntax.”
Quote in the paperNot a substantial claimMay combine two claims.
InterpretationreasoningGenerative AI tools are not designed to assess accuracy or authenticity of content, so they are prone to produce fabricated content when trained on large amounts of unsupervised data.
“As generative AI tools are not designed to assess accuracy or authenticity of content, they are prone to produce fabricated content when trained on large amounts of unsupervised data, as is the case of ChatGPT.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S2 (checkable).
PremisecitationTransparency about the use of generative AI tools in the academic writing process is a cornerstone of academic integrity.
“Firstly, and perhaps most importantly, transparency about the use of generative AI tools in the academic writing process is a cornerstone of academic integrity [7, 9, 11].”
Quote in the paperNot a substantial claim0 of 3 sources checked- cites [7] Flanagin A, Bibbins-Domingo K, Berkwits M, Christiansen SL. Nonhuman “Authors” and implications for the integrity of scientific publication and medical knowledge. JAMA. 2023;329(8):637–9. source
Not checked in the free run.
- cites [9] COPE position - Authorship and AI - English. Available from: https://publicationethics.org/guidance/cope-position/authorship-and-ai-tools. Accessed December 1, 2024.
Not checked in the free run.
- cites [11] Zielinski C, Winker MA, Aggarwal R, Ferris LE, Heinemann M, Lapena JF Jr, et al. Chatbots, generative AI, and scholarly manuscripts: WAME recommendations on chatbots and generative artificial intelligence in relation to scholarly publications. Colomb Med (Cali). 2023;54(3): e1015868. source
Not checked in the free run.
May combine two claims.
InterpretationreasoningThere are no fact-checking components to this process in current models, which is an important source of AI hallucinations and propagation of biases within the training dataset.
“There are no ‘fact-checking’ components to this process in current models, which is an important source of the AI hallucinations and propagation of biases within the training dataset.”
Quote in the paperSubstantial claimMay combine two claims.
InterpretationcitationThese troublesome patterns may lead to the spread of misinformation or bias, or threaten researcher integrity if left unchecked.
“These troublesome patterns may lead to the spread of misinformation or bias, or threaten researcher integrity if left unchecked [5].”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [5] Kim S-J. Research ethics and issues regarding the use of ChatGPT-like artificial intelligence platforms by authors and reviewers: a narrative review. Science Editing. 2024;11(2):96–106. source
Not checked in the free run.
Probably not a substantial claim: may not pass S2 (checkable), S4 (based).
InterpretationreasoningOutsourcing some intellectual tasks to artificial tools runs the risk of necessary skills being lost over time.
“Outsourcing some of these intellectual tasks to artificial tools runs the risk of these necessary skills being lost over time.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable), S4 (based).
InterpretationreasoningEven if authors double check content for accuracy, relevance, reasoning, bias, and appropriate referencing, they are still assuming some inherent risk given the issues described above.
“Even if authors double check content for accuracy, relevance, reasoning, bias, and appropriate referencing, they are still assuming some inherent risk given the issues described above.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S4 (based).
Interpretationnone givenChatGPT is most skilled and accurate at text manipulation when the necessary ideas are already present in the initial query.
“ChatGPT is most skilled and accurate at text manipulation when the necessary ideas are already present in the initial query.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable), S4 (based).
InterpretationreasoningWithout appropriate content expertise, some authors may be unaware of AI-generated text that is plagiarised.
“Without appropriate content expertise, some authors may be unaware of AI-generated text that is plagiarised.”
Quote in the paperNot a substantial claimMay combine two claims.
PremisecitationGenerative AI tools access publicly available data to generate text, which may produce content that closely or exactly resembles the original source of information.
“Generative AI tools access publicly available data to generate text, which may produce content that closely (or exactly) resembles the original source of information [6].”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [6] Kacena MA, Plotkin LI, Fehrenbacher JC. The use of artificial intelligence in writing scientific review articles. Curr Osteoporos Rep. 2024;22(1):115–21. source
Not checked in the free run.
Probably not a substantial claim: may not pass S2 (checkable). May combine two claims.
InterpretationreasoningDrafting de novo text without providing original content in the prompt or developing new concepts for a particular section of text risks introducing factually incorrect material and deprives authors of an opportunity to engage deeply with the source material.
“For example, drafting de novo text without providing original content in the prompt or developing new concepts for a particular section of text risks not only introducing factually incorrect material but also deprives the authors of an opportunity to engage deeply with the source material on which their paper is based on a personal level.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim.
InterpretationcitationThe data sources of academic generative AI tools are notably more reliable and robust.
“Given that the data sources of academic generative AI tools are notably more reliable and robust, it is possible that the issues of bias and hallucinations may be mitigated in these platforms.”
Quote in the paperSubstantial claimClassified as probably not a substantial claim. May combine two claims.
InterpretationreasoningAny literature search performed using ChatGPT must be confirmed with a traditional search engine, thus negating the actual benefit of using generative AI.
“While some specialist products designed to support literature reviews are emerging (e.g. Elicit), any literature search performed using ChatGPT must thus be confirmed with a traditional search engine, thus negating the actual benefit of using generative AI.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationMann et al. suggested three criteria for responsible use of LLMs in scholarship: human vetting and guaranteeing; substantial human contribution; and acknowledgement and transparency.
“Mann et al. recently suggested three criteria for responsible use of LLMs in scholarship [23]: (1) Human vetting and guaranteeing; (2) Substantial human contribution; and (3) Acknowledgement and transparency.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [23] Mann SP, Vazirani AA, Mateo A, Earp BD, Minssen T, Cohen IG, et al. Guidelines for ethical use and acknowledgement of large language models in academic writing. Nature Machine Intelligence. 2024;6:1272–4. source
Not checked in the free run.
Probably not a substantial claim: may not pass S2 (checkable), S4 (based).
InterpretationreasoningHealthcare simulation scholars may not fully appreciate the scholarly benefits and scope of ethical risks associated with using LLM-powered generative AI tools for academic writing.
“As a result, healthcare simulation scholars may not fully appreciate the scholarly benefits and scope of ethical risks associated with using LLM-powered generative AI tools for academic writing.”
Quote in the paperNot a substantial claim- Rests on an assumption: There has been a notable paucity of research on this topic within the field of healthcare simulation.
The paper relies on this without support.
There has been a notable paucity of research on this topic within the field of healthcare simulation.
“There has been a notable paucity of research on this topic within the field of healthcare simulation.”
The paper relies on this without support.
Some researchers have assiduously avoided engaging with generative AI due to a concern that they represent a threat to academic integrity.
“While some researchers have embraced generative AI, others have assiduously avoided engaging with the tools due to a concern that they represent a threat to academic integrity.”
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
AI, particularly large language models, raises concerns including potential for plagiarism, generation of fabricated or inaccurate information, and prevalence of incorrect or misleading referencing practices.
“A study by [ 28 ] identified three principal concerns associated with the use of artificial intelligence, particularly large language models. These concerns include the potential for plagiarism, the generation of fabricated or inaccurate information, and the prevalence of incorrect or misleading referencing practices.”
From Redefining student assessment in AI-infused learning environments: a systematic review of challenges and strategies for academic integrity (2026) · cites this paper as [28]
Cheng et al. propose concrete recommendations for responsible AI usage in academic composition, underscoring the importance of human oversight and critical evaluation of AI-generated content.
“Similarly, Cheng et al. [3] propose concrete recommendations for responsible AI usage in academic composition, underscoring the importance of human oversight and critical evaluation of AI-generated content.”
Cheng et al. further emphasise transparency as a fundamental ethical principle in the implementation of instructional AI.
“Cheng et al. [3] further emphasise transparency as a fundamental ethical principle in the implementation of instructional AI.”
Selecting and using AI tools demands conscious pedagogical judgment, active supervision, and critical reflection.
“As Cheng et al. [3] emphasize, selecting and using AI tools demands conscious pedagogical judgment, active supervision, and critical reflection.”
Cheng et al. advocate for the incorporation of AI disclosure statements in scholarly work.
“Cheng et al. [3] advocate for the incorporation of AI disclosure statements in scholarly work”
Rodafinos and Cheng et al. also note the risk of depersonalized thinking and formulaic academic expression.
“However, they also note the risk of depersonalized thinking and formulaic academic expression.”
Rodafinos and Cheng et al. examine the positive contributions of AI to assignment writing, particularly in structuring, language precision, and statistical support.
“Rodafinos [38] and Cheng et al. [3] examine the positive contributions of AI to assignment writing, particularly in structuring, language precision, and statistical support.”
The integration of AI into university teaching is neither a neutral nor a purely technical process.
“The integration of AI into university teaching is neither a neutral nor a purely technical process.”
An increasing number of universities require or encourage disclosure of AI use in coursework, typically via an appendix documenting tools, prompts, purpose, and extent of integration.
“An increasing number of universities require or encourage disclosure of AI use in coursework, typically via an appendix that documents the tools employed, the prompts issued, the purpose, and the extent of integration, in line with the ETHICAL principles [3].”
According to Cheng et al., three core principles guide the ethical use of AI in academic writing: human oversight and evaluation; substantial human contribution to content creation; and explicit disclosure of AI involvement.
“According to Cheng et al. [3], three core principles guide the ethical use of AI in academic writing: (1) human oversight and evaluation; (2) substantial human contribution to content creation; and (3) explicit disclosure of AI involvement.”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Figure 1 identifies a different ChatGPT model
MinorThe text says the response shown in Fig. 1 came from ChatGPT 4.0, but the figure caption identifies it as a ChatGPT 4o response. These are different model designations.
“we asked ChatGPT 4.0 the following question: ‘Can you please provide a list of ways ChatGPT can be ethically used to assist authors in writing articles for medical journals?’ The results of this request are displayed in Fig. 1.”
“Figure: Fig. 1 ChatGPT 4o response to the prompt: ‘Can you please provide a list of ways ChatGPT can be ethically used to assist authors in writing articles for medical journals?’”
Cites
Large language models in medicine
Thirunavukarasu, A. J., Ting, D. S. J., Elangovan, K., Gutierrez, L., Tan, T. F., & Ting, D. S. W. (2023) · Nature Medicine · doi:10.1038/s41591-023-02448-8 · Cited by 3,944 · see citing works
Artificial hallucinations in ChatGPT: implications in scientific writing
Alkaissi, H., & McFarlane, S. I. (2023) · Cureus · doi:10.7759/cureus.35179 · Cited by 1,540 · see citing works
Dergaa, I., Chamari, K., Zmijewski, P., & Ben Saad, H. (2023) · Biology of Sport · doi:10.5114/biolsport.2023.125623 · Cited by 796 · see citing works
Zhou, Q.-H. (2015) · Chinese Nursing Research · doi:10.1016/j.cnre.2016.01.001 · Cited by 738 · see citing works
Using artificial intelligence in academic writing and research: An essential productivity tool
Khalifa, M., & Albadawy, M. (2024) · Computer Methods and Programs in Biomedicine Update · doi:10.1016/j.cmpbup.2024.100145 · Cited by 580 · see citing works
Flanagin, A., Bibbins-Domingo, K., Berkwits, M., & Christiansen, S. L. (2023) · JAMA · doi:10.1001/jama.2023.1344 · Cited by 420 · see citing works
Athaluri, S. A., Manthena, S. V., Kesapragada, V. S. R. K. M., Yarlagadda, V., Dave, T., & Duddumpudi, R. T. S. (2023) · Cureus · doi:10.7759/cureus.37432 · Cited by 403 · see citing works
McNutt, M. K., Bradford, M., Drazen, J. M., Hanson, B., Howard, B., Jamieson, K. H., Kiermer, V., Marcus, E., Pope, B. K., Schekman, R., et al. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1715374115 · Cited by 392 · see citing works
High Rates of Fabricated and Inaccurate References in ChatGPT-Generated Medical Content
Bhattacharyya, M., Miller, V. M., Bhattacharyya, D., & Miller, L. E. (2023) · Cureus · doi:10.7759/cureus.39238 · Cited by 294 · see citing works
Using AI to write scholarly publications
Hosseini, M., Rasmussen, L. M., & Resnik, D. B. (2024) · Accountability in Research · doi:10.1080/08989621.2023.2168535 · Cited by 286 · cited 2× · see citing works
“While new models of ChatGPT have ‘learned’ compared to prior releases, they cannot differentiate between real and factitious data that is received, integrated and used to generate new content [19].”
The Use of Artificial Intelligence in Writing Scientific Review Articles
Kacena, M. A., Plotkin, L. I., & Fehrenbacher, J. C. (2024) · Current Osteoporosis Reports · doi:10.1007/s11914-023-00852-0 · Cited by 193 · see citing works
Xu, X., Chen, Y., & Miao, J. (2024) · Journal of Educational Evaluation for Health Professions · doi:10.3352/jeehp.2024.21.6 · Cited by 169 · see citing works
Zielinski, C., Winker, M. A., Aggarwal, R., Ferris, L. E., Heinemann, M., Lapeña Jr, J. F., Pai, S. A., Ing, E., Citrome, L., Alam, M., et al. (2023) · Colombia Medica · doi:10.25100/cm.v54i3.5868 · Cited by 127 · see citing works
Guidelines for ethical use and acknowledgement of large language models in academic writing
Porsdam Mann, S., Vazirani, A. A., Aboy, M., Earp, B. D., Minssen, T., Cohen, I. G., & Savulescu, J. (2024) · Nature Machine Intelligence · doi:10.1038/s42256-024-00922-7 · Cited by 108 · see citing works
The role of using ChatGPT AI in writing medical scientific articles
Benichou, L. (2023) · Journal of Stomatology, Oral and Maxillofacial Surgery · doi:10.1016/j.jormas.2023.101456 · Cited by 73 · see citing works
Kim, S.-J. (2024) · Science Editing · doi:10.6087/kcse.343 · Cited by 42 · see citing works
Buholayka, M., Zouabi, R., & Tadinada, A. (2023) · Cureus · doi:10.7759/cureus.39386 · Cited by 30 · see citing works
Trends in research on ChatGPT and adoption-related issues discussed in articles: a narrative review
Kim, S.-J. (2023) · Science Editing · doi:10.6087/kcse.321 · Cited by 17 · see citing works
Flagged first, then by citations
Research works printed but not linked: 1
- Scopus AI: Trusted content. Powered by responsible AI. Available from: https://www.elsevier.com/products/scopus/scopus-ai. Accessed December 1, 2024.
Cited by
Sorted by citations
Adamakis, M., & Rachiotis, T. (2025) · Encyclopedia · doi:10.3390/encyclopedia5040180 · Cited by 76 · see citing works
Ncube, P. D. N., Dzvapatsva, G. P., Matobobo, C., & Ranga, M. M. (2026) · AI and Ethics · doi:10.1007/s43681-025-00871-w · Cited by 31 · see citing works
“A study by [ 28 ] identified three principal concerns associated with the use of artificial intelligence, particularly large language models.”
Pratama, H. (2025) · Conference on English Language Teaching · doi:10.24090/celti.2025.1335 · Cited by 1 · see citing works
AI Writing Assistants in Higher Education: A Comprehensive Review of Impact, Literacy, and Policy
Elharrouss, O., Mahmood, Y., Naouss, M., & Badidi, E. (2026) · Education Sciences · doi:10.3390/educsci16091571
Abdellatif, M. S., Alshehri, M. A., Lamouchi, A., Rahmath, M., & Nemt-allah, M. A. (2026) · Frontiers in Psychology · doi:10.3389/fpsyg.2026.1809174
“…language models, have become widely adopted for idea generation, drafting, outlining, and providing feedback on academic texts (Barrett and Pack, 2023; Cheng et al., 2025; Dergaa et al., 2023; Escalante et al., 2023; Khlaif et al., 2023; Kim et al., 2024; Nguyen et al., 2024; Song and Song, 2023).”
- Authors
- Cheng, A., Calhoun, A., & Reedy, G.
- Affiliations
- University of Calgary (CA)
- University of Louisville (US)
- King's College London (GB)
- Corresponding author
- Cheng, Adam
- Calhoun, Aaron
- Reedy, Gabriel
- Venue
- Advances in Simulation
- Published
- 2025-04-18
- Volume
- 10
- Issue
- 1
- Pages
- 22-22
- ISSN
- 2059-0628 (ISSN-L)
- PMC
- PMC12007126
- OpenAlex
- W4409588554
- Semantic Scholar
- 5f22cb4379f76d3045e22fa53bee0c52d0d392ad
- Cited by
- 140
- References
- 18
- Citations by year
- 2026: 99 · 2025: 41
- FWCI
- 144.87
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- Advances in Simulation (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Libraries and Cultural Resources (University of Calgary) (submittedVersion)
- Topics
- Social Sciences › Safety Research › Academic integrity and plagiarism
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Social Sciences › Arts and Humanities › History and Philosophy of Science › Academic Writing and Publishing
- Keywords
- generative AI, academic writing, ChatGPT, large language models, AI ethics, academic integrity, plagiarism, AI hallucination, scholarly publishing, research ethics guidelines
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-06.
Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-06.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review