Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 86 of the 86 references it cites were found in a registry or an index; 26 of the 76 sources its claims cite were checked for support.

The entities enabling scientific fraud at scale are large, resilient, and growing rapidly

Open access
Richardson, Reese A. K., Hong, Spencer S., Byrne, Jennifer A., Stoeger, Thomas, Amaral, Luís A. Nunes · 2025 · Proceedings of the National Academy of Sciences

Abstract

Science is characterized by collaboration and cooperation, but also by uncertainty, competition, and inequality. While there has always been some concern that these pressures may compel some to defect from the scientific research ethos—i.e., fail to make genuine contributions to the production of knowledge or to the training of an expert workforce—the focus has largely been on the actions of lone individuals. Recently, however, reports of coordinated scientific fraud activities have increased. Some suggest that the ease of communication provided by the internet and open-access publishing have created the conditions for the emergence of entities—paper mills (i.e., sellers of mass-produced low quality and fabricated research), brokers (i.e., conduits between producers and publishers of fraudulent research), predatory journals, who do not conduct any quality controls on submissions—that facilitate systematic scientific fraud. Here, we demonstrate through case studies that i) individuals have cooperated to publish papers that were eventually retracted in a number of journals, ii) brokers have enabled publication in targeted journals at scale, and iii), within a field of science, not all subfields are equally targeted for scientific fraud. Our results reveal some of the strategies that enable the entities promoting scientific fraud to evade interventions. Our final analysis suggests that this ability to evade interventions is enabling the number of fraudulent publications to grow at a rate far outpacing that of legitimate science.

Overview

CoChat Summary

TL;DR

This paper maps footprints of large-scale scientific fraud beyond paper mills, identifying coordinated networks of editors, authors, brokers, and journal-targeting entities. It finds that suspected paper-mill products are growing much faster than legitimate publications and that current integrity measures such as retractions and deindexing are far outpaced by the problem.

Key findings

  • In PLOS ONE, 45 flagged editors—0.25% of all editors—handled 1.3% of published articles but 30.2% of retracted articles; 22 editors anomalously accepted later-retracted articles, 33 accepted later-PubPeer-commented articles, and 88 accepted articles with short turnaround, with 21, 18, and 7 authors respectively showing anomalous assignment to those flagged editors.
  • A network of 2,213 articles connected by 4,188 image-duplication edges formed 20 connected components (maximum 622 articles); only 34.1% of these articles had been retracted, and modules were strongly concentrated by publisher and publication year.
  • ARDA listed 188 unique journals since January 2018, including 106 Scopus-indexed, 51 WoS-indexed, 29 indexed by both, and 2 MEDLINE-indexed; 17 (9.0%) were suspected hijacked journals, and 13 of 39 (33.3%) Scopus-indexed journals listed by ARDA in 2020 were later deindexed versus 147 of 27,197 (0.5%) Scopus-indexed journals active in 2020 (P < 0.0001).
  • Suspected paper-mill products doubled every 1.5 years, compared with 3.3 years for retracted articles, 3.6 years for PubPeer-commented articles, and 15.0 years for total publications; only 8,589 of 29,956 suspected paper-mill products with an OpenAlex record had been retracted (28.7%), with projections that only ~25% will ever be retracted and ~10% will ever reside in a deindexed journal.

Methods

  • The authors combined bibliometric and integrity data from Web of Science, Scopus, PubMed/MEDLINE, OpenAlex, Retraction Watch (47,387 unique retraction records), PubPeer comments on 105,325 articles, the Problematic Paper Screener (32,786 unique suspected paper-mill articles), PLOS ONE and Hindawi article metadata, IEEE conference proceedings, and ARDA website snapshots via the Wayback Machine.
  • They used Poisson binomial tests with Benjamini–Hochberg false-discovery-rate control at 0.05 to flag editors and authors with anomalous retraction, PubPeer-comment, or short-turnaround rates; built and analyzed an image-duplication network with connected components and stochastic block modeling; used Shannon entropy to test concentration of modules by publisher and year; and extrapolated log-linear trends.
  • Key samples included 276,956 PLOS ONE articles since 2006 (702 retracted, 2,241 PubPeer-commented) and 18,329 PLOS ONE editors; ten Hindawi journals; 2,294,067 IEEE conference articles from 19,969 conferences since 2003; and 20,638 documents from five ARDA-listed journals, with author nationality imputed for 13,288 (64.4%).

Limitations

  • The paper states that its analyses rely on reported instances of fraud, that many fields and journals are likely underrepresented, that the vast majority of paper-mill products are thought to remain undetected, and that some case studies focus on particular disciplines and may not generalize.
  • The paper also states that temporal changes in detection effort or attention could produce spurious trends, and that it cannot determine whether observations reflect commercial paper mills or less formal noncommercial peer networks.
  • Evident from the text: editor disambiguation required exact full-name matches, ORCiD identifiers were unavailable for 91.2% of named authors, 39.8% of PLOS ONE articles had no identifiable author, and editor tenures were right-censored because articles under review were unavailable.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1073/pnas.2420092122

Cites

86 of 86 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Figures

Fig. 1. Evidence of coordination between editors and authors for the publication of fraudulent science in PLOS ONE. (A) Number of articles published annually in PLOS ONE since its inception (Top row) and the annual number of articles retracted (second row), receiving PubPeer comments (third row), or having been accepted 30 or fewer days after submission (Bottom row). (B) Number of “active” editors and their tenures at PLOS ONE (Materials and Methods). Flagged editors tended to have overlapping tenures. (C) Detection of editors accepting an anomalous number of articles which were later retracted (second row), later commented in PubPeer (third row), or accepted after a short turnaround (Bottom row). We show each editor as a circle with an area proportional to the number of articles they accepted. At a false discovery rate (FDR) of 0.05, we identify 22 editors who accepted an anomalous number of articles later retracted, 33 editors who accepted an anomalous number of articles later receiving PubPeer comments, and 88 editors who accepted an anomalous number of articles after a short turnaround. (D) Detection of authors whose accepted articles are assigned at an anomalous rate to flagged editors for retractions (second row), PubPeer comments (third row), and short turnaround (Bottom row). At an FDR of 0.05, we flagged 21 authors for anomalous assignment of their accepted articles to editors flagged for retractions, 18 authors for anomalous assignment of their accepted articles to editors flagged for PubPeer comments, and 7 authors for anomalous assignment of their accepted articles to editors flagged for short turnaround. (E) Publication interactions among individuals flagged for retractions and/or PubPeer comments. We show every individual as a circle whose size is proportional to the number of accepted articles that they handled as editor (range of 1 to 852 articles). The black wedge inside the circle indicates the fraction of that editor’s accepted articles which were later retracted. Individuals flagged for retractions alone have a red boundary, individuals flagged for PubPeer comments alone have a blue boundary, and individuals flagged for both have a purple boundary. The individuals are connected by arrows that point from author to editor, with the width of each arrow proportional to the total number of articles for which that editor served for that author (range of 1 to 10 articles). Flagged individuals frequently handled each other’s submissions to PLOS ONE, especially within a group of editors serving from 2020 to 2023 (cluster on the Lower Right).
Fig. 1. Evidence of coordination between editors and authors for the publication of fraudulent science in PLOS ONE. (A) Number of articles published annually in PLOS ONE since its inception (Top row) and the annual number of articles retracted (second row), receiving PubPeer comments (third row), or having been accepted 30 or fewer days after submission (Bottom row). (B) Number of “active” editors and their tenures at PLOS ONE (Materials and Methods). Flagged editors tended to have overlapping tenures. (C) Detection of editors accepting an anomalous number of articles which were later retracted (second row), later commented in PubPeer (third row), or accepted after a short turnaround (Bottom row). We show each editor as a circle with an area proportional to the number of articles they accepted. At a false discovery rate (FDR) of 0.05, we identify 22 editors who accepted an anomalous number of articles later retracted, 33 editors who accepted an anomalous number of articles later receiving PubPeer comments, and 88 editors who accepted an anomalous number of articles after a short turnaround. (D) Detection of authors whose accepted articles are assigned at an anomalous rate to flagged editors for retractions (second row), PubPeer comments (third row), and short turnaround (Bottom row). At an FDR of 0.05, we flagged 21 authors for anomalous assignment of their accepted articles to editors flagged for retractions, 18 authors for anomalous assignment of their accepted articles to editors flagged for PubPeer comments, and 7 authors for anomalous assignment of their accepted articles to editors flagged for short turnaround. (E) Publication interactions among individuals flagged for retractions and/or PubPeer comments. We show every individual as a circle whose size is proportional to the number of accepted articles that they handled as editor (range of 1 to 852 articles). The black wedge inside the circle indicates the fraction of that editor’s accepted articles which were later retracted. Individuals flagged for retractions alone have a red boundary, individuals flagged for PubPeer comments alone have a blue boundary, and individuals flagged for both have a purple boundary. The individuals are connected by arrows that point from author to editor, with the width of each arrow proportional to the total number of articles for which that editor served for that author (range of 1 to 10 articles). Flagged individuals frequently handled each other’s submissions to PLOS ONE, especially within a group of editors serving from 2020 to 2023 (cluster on the Lower Right).CC BY-NC-ND · PubMed Central
Fig. 2. Evidence of coordination in the production of fraudulent science and the targeting of specific journals for its publication. (A) We build a network of articles with comments in PubPeer concerning image duplication. We identify 2,213 articles (nodes) that are connected through 4,188 edges indicative of image duplication across a pair of articles. We identify 20 connected components within this network. (B) Cartographic representation of the network. Each different colored circle represents a module identified using stochastic block modeling (73, 74). The number inside a circle indicates the number of articles in the module. The lines connecting circles indicate that the two modules are part of the same connected component and their width denotes the number of intermodule edges. (C) Fraction of retracted articles for each module. The black wedge denotes the fraction of retracted articles in the module. (D) Distribution of years of publication for articles in each module (Left) and p-value for the null hypothesis that years are distributed randomly across modules (Right). Color indicates year of publication (Left) or log10 of p (Right). (E) Distribution of the publishers of the articles in each module (Left) and p-value for the null hypothesis that publishers are distributed randomly across modules (Right). Color indicates publisher (Left) or log10 of p (Right). Dark saturated red indicates extremely low probabilities (P<10⁻⁵), suggesting rejection of the null hypothesis. It is visually apparent for both cases that the null hypothesis is rejected for all modules for which the analysis has sufficient power.
Fig. 2. Evidence of coordination in the production of fraudulent science and the targeting of specific journals for its publication. (A) We build a network of articles with comments in PubPeer concerning image duplication. We identify 2,213 articles (nodes) that are connected through 4,188 edges indicative of image duplication across a pair of articles. We identify 20 connected components within this network. (B) Cartographic representation of the network. Each different colored circle represents a module identified using stochastic block modeling (73, 74). The number inside a circle indicates the number of articles in the module. The lines connecting circles indicate that the two modules are part of the same connected component and their width denotes the number of intermodule edges. (C) Fraction of retracted articles for each module. The black wedge denotes the fraction of retracted articles in the module. (D) Distribution of years of publication for articles in each module (Left) and p-value for the null hypothesis that years are distributed randomly across modules (Right). Color indicates year of publication (Left) or log10 of p (Right). (E) Distribution of the publishers of the articles in each module (Left) and p-value for the null hypothesis that publishers are distributed randomly across modules (Right). Color indicates publisher (Left) or log10 of p (Right). Dark saturated red indicates extremely low probabilities (P<10⁻⁵), suggesting rejection of the null hypothesis. It is visually apparent for both cases that the null hypothesis is rejected for all modules for which the analysis has sufficient power.CC BY-NC-ND · PubMed Central
Fig. 3. The business ARDA maintains an evolving portfolio of targeted journals. (A) Number of journals listed on ARDA’s website over time. We identify 188 unique journals listed by ARDA. Since 2021, ARDA has maintained a portfolio of 70+ journals in which they guarantee article publication. (B) Estimated time span over which individual journals were listed by ARDA. We represent each journal as a horizontal line and use color to indicate source of journal indexing (WoS, Scopus, or both). We start a bar on the earliest snapshot date we find it listed on ARDA’s website and end it on the final snapshot date. We show year of deindexing by an empty circle at the same level as the journal bar, placing it at the start of the year (due to a lack more detailed information on exact timing), followed by a dotted line from this point to the last time the journal was listed on ARDA’s website. Note that deindexing can be retroactive (e.g. Scopus could, in 2020, deindex a journal with an effective date in 2018).
Fig. 3. The business ARDA maintains an evolving portfolio of targeted journals. (A) Number of journals listed on ARDA’s website over time. We identify 188 unique journals listed by ARDA. Since 2021, ARDA has maintained a portfolio of 70+ journals in which they guarantee article publication. (B) Estimated time span over which individual journals were listed by ARDA. We represent each journal as a horizontal line and use color to indicate source of journal indexing (WoS, Scopus, or both). We start a bar on the earliest snapshot date we find it listed on ARDA’s website and end it on the final snapshot date. We show year of deindexing by an empty circle at the same level as the journal bar, placing it at the start of the year (due to a lack more detailed information on exact timing), followed by a dotted line from this point to the last time the journal was listed on ARDA’s website. Note that deindexing can be retroactive (e.g. Scopus could, in 2020, deindex a journal with an effective date in 2018).CC BY-NC-ND · PubMed Central
Fig. 4. Closely related subfields of biomedical research display similar rates of errata, but different rates of retractions. We investigated rates of retraction and errata for six subfields within RNA biology, focusing mostly on subfields that had their onset since 2000 and have experienced a dramatic increase in the number of annual publications (Left column). The dotted lines show all publications, including reviews, while the full lines exclude reviews from the count. While annual number of publications or their growth rate can differ significantly, all subfields have similar rates of errata. In contrast, the rate of retractions shows remarkable differences across subfields (Right column). Most rates decrease after 2019, presumably due to time censoring (i.e., not all retractions or errata may have yet occurred or been reported). Studies concerning “lncRNAs” and “miRNAs and cancer” show retraction rates which peak at around 4%, higher than even the rate at which errata are written. These rates are unlikely to be compatible with good-faith mistakes and point toward concerted attempts at scientific fraud.
Fig. 4. Closely related subfields of biomedical research display similar rates of errata, but different rates of retractions. We investigated rates of retraction and errata for six subfields within RNA biology, focusing mostly on subfields that had their onset since 2000 and have experienced a dramatic increase in the number of annual publications (Left column). The dotted lines show all publications, including reviews, while the full lines exclude reviews from the count. While annual number of publications or their growth rate can differ significantly, all subfields have similar rates of errata. In contrast, the rate of retractions shows remarkable differences across subfields (Right column). Most rates decrease after 2019, presumably due to time censoring (i.e., not all retractions or errata may have yet occurred or been reported). Studies concerning “lncRNAs” and “miRNAs and cancer” show retraction rates which peak at around 4%, higher than even the rate at which errata are written. These rates are unlikely to be compatible with good-faith mistakes and point toward concerted attempts at scientific fraud.CC BY-NC-ND · PubMed Central
Fig. 5. Articles of fraudulent provenance have an apparent growth rate greater than that of the entire scientific enterprise and already far outpace the scope of science integrity measures currently in use. (A) Retractions are increasingly published in batches. The ∼2010 spike in the number of large-batch retractions is almost entirely attributable to a large swath of conference proceedings articles retracted by IEEE. For the first time since this spike, the majority of 2023 retractions were reported in batches larger than 10 articles. (B) Annual global scientific activity as measured by items labeled as “journal article” or “conference proceeding article” in OpenAlex (47), as retracted articles reported by Retraction Watch, as PubPeer-commented articles and as suspected paper mill products. We make use of the linear trends observable in the log–linear plot to extrapolate these observations for the period 2020–2030. We show the 95% CI using shaded bands. The number of suspected paper mill products shows the largest growth rate, with a doubling time of 1.5 y. (C) Annual global scientific activity captured by WoS as measured by the number of actively publishing journals, the number of journals deindexed annually by WoS, the number of journals with retractions, the number of journals with PubPeer comments, and the number of journals with suspected paper mill products. It is visually apparent that deindexing now occurs at a level far below the level of occurrence of journals publishing suspected paper mill products. These patterns hold for Scopus and MEDLINE (SI Appendix, Figs. S21–S23).
Fig. 5. Articles of fraudulent provenance have an apparent growth rate greater than that of the entire scientific enterprise and already far outpace the scope of science integrity measures currently in use. (A) Retractions are increasingly published in batches. The ∼2010 spike in the number of large-batch retractions is almost entirely attributable to a large swath of conference proceedings articles retracted by IEEE. For the first time since this spike, the majority of 2023 retractions were reported in batches larger than 10 articles. (B) Annual global scientific activity as measured by items labeled as “journal article” or “conference proceeding article” in OpenAlex (47), as retracted articles reported by Retraction Watch, as PubPeer-commented articles and as suspected paper mill products. We make use of the linear trends observable in the log–linear plot to extrapolate these observations for the period 2020–2030. We show the 95% CI using shaded bands. The number of suspected paper mill products shows the largest growth rate, with a doubling time of 1.5 y. (C) Annual global scientific activity captured by WoS as measured by the number of actively publishing journals, the number of journals deindexed annually by WoS, the number of journals with retractions, the number of journals with PubPeer comments, and the number of journals with suspected paper mill products. It is visually apparent that deindexing now occurs at a level far below the level of occurrence of journals publishing suspected paper mill products. These patterns hold for Scopus and MEDLINE (SI Appendix, Figs. S21–S23).CC BY-NC-ND · PubMed Central

Verification

Claims the paper makes

14 Valid · 3 Not valid · 13 Not checked · 90 Own results and interpretations

75 more claims

Create a free account to see all 120 claims and to verify the 1 reference still open.

See all claims — free account
  • It may state two separate claims as one. 20
  • Probably not a substantial claim. 21

Create a free account to see these claims.

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

1 of 1

Cited works that were retracted

Works this paper cites that were later retracted, from the retraction notices publishers deposit. Major when the notice came out before this paper was published.

2 of 2

Citations

Cites

2 retracted

Show all 81 references

Research works printed but not linked: 6

  1. I. Oransky Up to one in seven submissions to hundreds of Wiley journals flagged by new paper mill tool. Retraction Watch (2024). https://retractionwatch.com/2024/03/14/up-to-one-in-seven-of-submissions-to-hundreds-of-wiley-journals-show-signs-of-paper-mill-activity/. Accessed 7 July 2025.
  2. I. Oransky The retraction watch hijacked journal checker. https://retractionwatch.com/the-retraction-watchhijacked-journal-checker/. Accessed 4 March 2024.
  3. Pubmed. https://pubmed.ncbi.nlm.nih.gov. Accessed 27 February 2023.
  4. Openalex. https://www.openalex.org. Accessed 27 February 2023.
  5. Medline currently and previously indexed titles. https://www.ncbi.nlm.nih.gov/nlmcatalog/?term=reportedmedline[All+Fields]. Accessed 27 February 2023.
  6. Plos text and data mining. https://plos.org/text-and-data-mining/. Accessed 8 November 2023.

Cited by

See all 129

Metadata

Authors
Richardson, R. A. K., Hong, S. S., Byrne, J. A., Stoeger, T., & Amaral, L. A. N.
Affiliations
  • Northwestern University (US)
  • The University of Sydney (AU)
  • Department of Engineering Sciences and Applied Mathematics
Corresponding author
  • Byrne, Jennifer A.
  • Stoeger, Thomas
Venue
Proceedings of the National Academy of Sciences
Published
2025-08-04
Volume
122
Issue
32
Pages
e2420092122-e2420092122
ISSN
  • 0027-8424 (ISSN-L)
  • 1091-6490
OpenAlex
W4412934489
Cited by
129
References
81
Citations by year
2026: 88 · 2025: 41
FWCI
132.76
Type
journal article
Language
en
Open access
Locations
  • Proceedings of the National Academy of Sciences (publishedVersion, cc-by-nc-nd)
  • Europe PMC (PubMed Central) (publishedVersion, cc-by-nc-nd)
  • PubMed (publishedVersion)
  • PubMed Central (publishedVersion, cc-by-nc-nd)
Funders
  • HHS | National Institutes of Health (T32GM008449, R00AG068544, AI135964)
  • Northwestern University (John N Nicholson Fellowship, Ryan Fellowship)
  • Federal Government | DHAC | National Health and Medical Research Council (APP1184263)
  • National Science Foundation (1956338, 2410335)
Topics
  • Social Sciences › Education › Academic integrity and plagiarism
  • Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
  • Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
Keywords
scientific fraud, paper mills, predatory journals, brokers, open access publishing, online communication, scientific research integrity
MeSH terms
Fraud, Humans, Periodicals as Topic, Publishing, Scientific Misconduct

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-01, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-01 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: The entities enabling scientific fraud at scale are large, resilient, and growing rapidly. https://app.cochat.ai/papers/10.1073/pnas.2420092122
The paper
Richardson, R. A. K., Hong, S. S., Byrne, J. A., Stoeger, T., & Amaral, L. A. N. (2025). The entities enabling scientific fraud at scale are large, resilient, and growing rapidly. Proceedings of the National Academy of Sciences. https://doi.org/10.1073/pnas.2420092122

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.