CoChat

Publishers’ and journals’ instructions to authors on use of generative artificial intelligence in academic and scientific publishing: bibliometric analysis

Open access

The DOI matches its Crossref record; 27 of the 27 references it cites were found in a registry or an index; 8 of the 22 sources its claims cite were checked for support.

Abstract

Objectives: To determine the extent and content of academic publishers’ and scientific journals’ guidance for authors on the use of generative artificial intelligence (GAI). Design: Cross sectional, bibliometric study. Setting: Websites of academic publishers and scientific journals, screened on 19-20 May 2023, with the search updated on 8-9 October 2023. Participants: Top 100 largest academic publishers and top 100 highly ranked scientific journals, regardless of subject, language, or country of origin. Publishers were identified by the total number of journals in their portfolio, and journals were identified through the Scimago journal rank using the Hirsch index (H index) as an indicator of journal productivity and impact. Main outcome measures: The primary outcomes were the content of GAI guidelines listed on the websites of the top 100 academic publishers and scientific journals, and the consistency of guidance between the publishers and their affiliated journals. Results: Among the top 100 largest publishers, 24% provided guidance on the use of GAI, of which 15 (63%) were among the top 25 publishers. Among the top 100 highly ranked journals, 87% provided guidance on GAI. Of the publishers and journals with guidelines, the inclusion of GAI as an author was prohibited in 96% and 98%, respectively. Only one journal (1%) explicitly prohibited the use of GAI in the generation of a manuscript, and two (8%) publishers and 19 (22%) journals indicated that their guidelines exclusively applied to the writing process. When disclosing the use of GAI, 75% of publishers and 43% of journals included specific disclosure criteria. Where to disclose the use of GAI varied, including in the methods or acknowledgments, in the cover letter, or in a new section. Variability was also found in how to access GAI guidelines shared between journals and publishers. GAI guidelines in 12 journals directly conflicted with those developed by the publishers. The guidelines developed by top medical journals were broadly similar to those of academic journals. Conclusions: Guidelines by some top publishers and journals on the use of GAI by authors are lacking. Among those that provided guidelines, the allowable uses of GAI and how it should be disclosed varied substantially, with this heterogeneity persisting in some instances among affiliated publishers and journals. Lack of standardization places a burden on authors and could limit the effectiveness of the regulations. As GAI continues to grow in popularity, standardized guidelines to protect the integrity of scientific output are needed.

Overview

CoChat Summary

TL;DR

This bibliometric analysis found substantial heterogeneity in guidance on generative artificial intelligence (GAI) across top academic publishers and scientific journals. While 87% of the top 100 highest-ranked journals had GAI guidelines, only 24% of the top 100 largest publishers did, and none of the guidelines were developed through a formal consensus process.

Key findings

  • Among the top 100 largest publishers, 24% had released GAI guidance; 63% (n=15) of those were in the top 25 publishers, and 56% cited COPE membership. Among the top 100 highest-ranked journals, 87% had GAI guidelines, and 82% cited COPE membership.
  • All 24 publishers with guidelines required disclosure in some form; 17 (71%) specified the methods section, 13 (54%) acknowledgements, and 2 (8%) the cover letter. Eighteen (75%) specified what details to disclose, only Elsevier provided a disclosure template, and 17 (71%) stated authors were accountable for AI output.
  • Of the 87 journals with guidelines, all top 25 (100%) had AI guidelines; 85 (98%) had specific guidance on including GAI as an author, and all explicitly stated AI should not be listed as an author. Nineteen (22%) limited guidelines to the writing process; 48 (55%) mentioned large language models and 44 (51%) mentioned ChatGPT.
  • Among 51 medical journals in the top 100, 44 (86%) had GAI guidelines; 31 (71%) specified methods disclosure, 22 (50%) acknowledgements, 9 (21%) cover letter, and 6 (14%) a new section; 26 (59%) stated authors were accountable. For consistency, 58 of 100 journals reported guidelines on the journal website, 12 (21%) linked to publisher guidelines, and among 15 journals with both journal and publisher guidelines, conflicts rose from 2 (13%) at first search to 12 (80%) at the second search.

Methods

  • Cross-sectional bibliometric study of the top 100 largest academic publishers, identified from Nishikawa-Pacher’s list by number of affiliated journals, and the top 100 highest-ranked scientific journals by H index from Scimago.
  • Official websites were manually searched for author guidance mentioning GPTs, large language models, or GAI. Initial data collection occurred 19–20 May 2023, with an updated search on 8–9 October 2023. If a publisher lacked guidance, at least three subsidiary journal websites were checked as a proxy; if a journal lacked guidance, publisher guidelines were used only if directly recommended or linked.
  • After training and piloting the extraction form, two reviewers independently collected data, with discrepancies resolved by a third reviewer under senior author supervision. Descriptive statistics were used, including a subanalysis of journals classified as medical.

Limitations

  • The paper states this is a snapshot at six and ten months after ChatGPT’s rise; guidelines were evolving rapidly, the number of publishers and journals included was limited, subsidiary journal proxies may not perfectly represent publisher policy, scholarly societies’ impact was not fully evaluated, and the study was largely qualitative and prone to subjectivity, mitigated by multiple reviewers.
  • Evident from the text: reliance on publicly available website guidance and machine translation may miss unposted or non-English guidance, and the paper contains at least one internal numerical inconsistency (e.g., “Of 70 journals with GAI guidelines, 86 (99%)…”), which complicates interpretation.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1136/bmj-2023-077192

Cites

27 of 27 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Figures

Fig 1 Types of recommendations and types of disclosures for generative AI recommended in author guidelines for top 100 largest academic publishers and top 100 highly ranked scientific journals. A subanalysis was performed of journals listed in the medicine and multidisciplinary subject area of Scimago. AI=artificial intelligence; COPE=Committee on Publication Ethics; GAI=generative artificial intelligence; GPT=generative pretrained transformer; LLMs=large language models
Fig 1 Types of recommendations and types of disclosures for generative AI recommended in author guidelines for top 100 largest academic publishers and top 100 highly ranked scientific journals. A subanalysis was performed of journals listed in the medicine and multidisciplinary subject area of Scimago. AI=artificial intelligence; COPE=Committee on Publication Ethics; GAI=generative artificial intelligence; GPT=generative pretrained transformer; LLMs=large language modelsCC BY-NC · PubMed Central

Verification

Claims the paper makes

6 Valid · 5 Not valid · 11 Not checked · 118 Own results and interpretations

63 more claims

Create a free account to see all 140 claims and to verify the 8 references still open.

See all claims — free account
  • Probably not a substantial claim. 40
  • It may state two separate claims as one. 44
  • The quote only partly states this claim. 2

Create a free account to see these claims.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

11 more claims about this paper

Create a free account to see every claim other papers make about this one.

See all claims — free account

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

3 of 3

Citations

Cites

Show all 27 references

Cited by

See all 266

Metadata

Authors
Ganjavi, C., Eppler, M. B., Pekcan, A., Biedermann, B., Abreu, A., Collins, G. S., Gill, I. S., & Cacciamani, G. E.
Affiliations
  • University of Southern California (US)
  • UK EQUATOR Centre, Centre for Statistics in Medicine, Nuffield Department of Orthopaedics, Rheumatology and Musculoskeletal Sciences, University of Oxford, Oxford, UK
Corresponding author
Cacciamani, Giovanni E
Venue
BMJ
Publisher
BMJ
Published
2024-01-31
Volume
384
Pages
e077192
ISSN
1756-1833 (ISSN-L)
OpenAlex
W4391403616
Cited by
266
References
25
Citations by year
2026: 108 · 2025: 97 · 2024: 60
FWCI
390.91
Type
journal article
Language
en
Open access
Locations
  • BMJ (publishedVersion, cc-by-nc)
  • PubMed Central (publishedVersion, cc-by-nc)
  • PubMed (publishedVersion)
  • University of Birmingham Research Portal (University of Birmingham) (publishedVersion, cc-by-nc)
  • HighWire Press Open Archive (submittedVersion)
Funders
  • American Diabetes Association
  • American Association for Cancer Research
  • American Heart Association
  • American Thoracic Society
  • American Association for the Study of Liver Diseases
  • American Gastroenterological Association
  • British Medical Association
  • National Cancer Institute
Topics
  • Social Sciences › Library and Information Sciences › Publishing and Scholarly Communication
  • Social Sciences › Education › Academic integrity and plagiarism
  • Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
Keywords
generative AI, author guidelines, AI disclosure, AI authorship, academic publishers, scientific journals, medical journals, research integrity, artificial intelligence in healthcare, artificial intelligence in industry, artificial intelligence in government, artificial intelligence in warfare, artificial intelligence in law
MeSH terms
Artificial Intelligence, Cross-Sectional Studies, Humans, Periodicals as Topic, Publishing, Bibliometrics

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-29, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-29 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Publishers’ and journals’ instructions to authors on use of generative artificial intelligence in academic and scientific publishing: bibliometric analysis. https://app.cochat.ai/papers/10.1136/bmj-2023-077192
The paper
Ganjavi, C., Eppler, M. B., Pekcan, A., Biedermann, B., Abreu, A., Collins, G. S., Gill, I. S., & Cacciamani, G. E. (2024). Publishers’ and journals’ instructions to authors on use of generative artificial intelligence in academic and scientific publishing: bibliometric analysis. BMJ. https://doi.org/10.1136/bmj-2023-077192

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.