Artificial Intelligence Tools in Scholarly Publishing: Guidance for Academic Medicine Authors
The DOI matches its Crossref record; 3 of the 3 references it cites were found in a registry or an index.
Abstract
With OpenAI’s release of ChatGPT in November 2022, we watched along with the rest of the world as the possibilities—and perils—of this exciting new technology emerged. Almost immediately, it was clear that ChatGPT would be used broadly in the academic community, prompting discussion about the potential role of artificial intelligence (AI) tools in scholarly publishing. In early 2023, publishers and publishing advisory groups began issuing statements and policies related to the use of AI tools in scholarly publications. While the Science family of journals has a policy prohibiting the use of AI tools,1 other journals’ policies2,3 favor clear disclosure over outright bans. There is one point on which all publishers and publishing advisory groups align: Chatbots do not qualify for authorship. The Committee on Publication Ethics4 and the World Association of Medical Editors5 note that, since chatbots cannot take responsibility for the published work and do not meet the International Committee of Medical Journal Editors (ICMJE) criteria for authorship,6 they cannot be credited as authors. We agree. A Principle-Driven Approach While ChatGPT and other chatbots may not be listed as authors of manuscripts submitted to Academic Medicine, our journal has taken a principle-driven approach to authors’ use of AI tools in their work. We ask that authors adhere to the following principles, which are reflected in our submission requirements and in Academic Medicine’s policies and guidelines related to AI tools. Accountability Academic Medicine adheres to the ethical and professional standards articulated by the ICMJE. Authors are accountable for the quality and integrity of their scholarship.7,8 Chatbots are not eligible for designation as an author. Individuals are eligible for authorship if they fulfill 4 criteria6 in the development of a scholarly work. To be recognized as an author, an individual will have contributed substantively to the conception or design of the work or to the acquisition, analysis, or interpretation of data for the work; will have participated in the drafting or revising of the scholarly work for important intellectual content; will have given final approval for the version of the scholarly work to be published; and will have agreed to be accountable for all aspects of the work, ensuring that the work has been conducted and presented in a manner that adheres to professionalism expectations and academic standards. Accountability as an author also entails that the individual is responsible for “ensuring that questions related to the accuracy or integrity of any part of the work are appropriately investigated and resolved.”6 Disclosure We have added a question to our submission form that requires authors to disclose whether they have used AI in the writing or development of their manuscripts. Our intention is to provide authors a clear mechanism for disclosure; editorial decisions will not be based on the answer to this question. When authors have relied on AI in the creation of their scholarship, the authors should add a brief description of which AI tools were used and how they were used, in the “other disclosures” section of the required structured disclosures appearing at the end of the manuscript. Transparency AI tools are just that—tools. As with any other tool that is used to conduct or enhance scholarship, such as specialized statistical software, the use of AI tools must be described in the text of the manuscript. In a Research Report or Review, such a description would appear in the Method section as part of the methodology of the work. This description is necessary both for readers to evaluate the appropriateness of the approach in light of the nature and scope of the research question and also for the replicability of the research or review. In other types of articles, such as Innovation Reports, the description should be incorporated to best suit the structure of the article. Evolution We acknowledge that AI tools will quickly evolve. In March 2023, just 4 months after the release of ChatGPT, OpenAI introduced GPT-4,9 the newest version of its language model system, which addresses some of the limitations of ChatGPT. Google has released Bard,10 emphasizing it is “an experiment,” and Microsoft’s Bing search engine is powered by AI,11 demonstrating that well-established research tools may begin to incorporate AI more substantially. All of these tools have limitations that will affect accuracy, rigor, and integrity in publishing, and authors assume the risks of these tools when using them. For example, recent reports have drawn attention to the fact that ChatGPT fabricates, or “hallucinates,” citations.12 A year from now, the landscape may look much different. We commit to evolving our policies and practices to align with the academic standards of our field. A New Policy Guided by the principles above, we have developed a new policy for authors who wish to use AI tools in work submitted to A
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ChatGPT is fun, but not an author
Thorp, H. H. (2023) · Science · doi:10.1126/science.adg7879 · Cited by 1,437
Tools such as ChatGPT threaten transparent science; here are our ground rules for their use
(2023) · Nature · doi:10.1038/d41586-023-00191-1 · Cited by 605
Flanagin, A., Bibbins-Domingo, K., Berkwits, M., & Christiansen, S. L. (2023) · JAMA · doi:10.1001/jama.2023.1344 · Cited by 420
Cited by
Lingard, L. (2023) · Perspectives on Medical Education · doi:10.5334/pme.1072 · Cited by 150
Patino, G. A., Amiel, J. M., Brown, M., Lypson, M. L., & Chan, T. M. (2024) · Academic Medicine · doi:10.1097/acm.0000000000005636 · Cited by 43
Artificial scholarship: LLMs in health professions education research
Ellaway, R. H., & Tolsgaard, M. (2023) · Advances in Health Sciences Education · doi:10.1007/s10459-023-10257-4 · Cited by 36
“As an example, the editors of Academic Medicine recently (DeVilbiss & Roberts, 2023 ) stated their position in terms of four broad principles: that authors must be accountable for their work (noting that LLMs do not meet this standard); that any use of LLMs in developing or writing papers sub -…”
MethodPratiwi, H., Suherman, Hasruddin, & Ridha, M. (2025) · European Journal of Education · doi:10.1111/ejed.70083 · Cited by 31
Residents, faculty, and artificial intelligence: brave new world or utopia?
Sullivan, G. M., Simpson, D., Yarris, L. M., & Artino, A. R. (2023) · Journal of Graduate Medical Education · doi:10.4300/jgme-d-23-00534.1 · Cited by 9
Metadata
- Authors
- DeVilbiss, M. B., & Roberts, L. W.
- Venue
- Academic Medicine
- Publisher
- Oxford University Press (OUP)
- Published
- 2023-07-21
- Volume
- 98
- Issue
- 8
- Pages
- 865-866
- ISSN
- 1040-2446 (ISSN-L)
- 1938-808X
- OpenAlex
- W4367836430
- Cited by
- 23
- References
- 3
- FWCI
- 20.14
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Artificial Intelligence Tools in Scholarly Publishing: Guidance for Academic Medicine Authors. https://app.cochat.ai/papers/10.1097/acm.0000000000005261
- The paper
- DeVilbiss, M. B., & Roberts, L. W. (2023). Artificial Intelligence Tools in Scholarly Publishing: Guidance for Academic Medicine Authors. Academic Medicine. https://doi.org/10.1097/acm.0000000000005261
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.