The DOI matches its Crossref record; 51 of the 51 references it cites were found in a registry or an index.
Fake Publications in Biomedical Science: Red-flagging Method Indicates Mass Production
Open accessAbstract
Background: Integrity of academic publishing is increasingly undermined by fake science publications massively produced by commercial “editing services” (so-called “paper mills”). They use AI-supported, automated production techniques at scale and sell fake publications to students, scientists, and physicians under pressure to advance their careers. Because the scale of fake publications in biomedicine is unknown, we developed a simple method to red-flag them and estimate their number. Methods: To identify indicators able to red-flag fake publications (RFPs), we sent questionnaires to authors. Based on author responses, a classification rule was applied initially using the two-indicators “non-institutional email AND no international authors” (“email+NIA”) to sub-samples of 15,120 PubMed®-listed publications regarding publication date, journal, impact factor, country and RFP citations. Using the indicator “hospital affiliation” (“email+hospital”), this classification (tallying) rule was validated by comparing 400 known fakes with 400 matched presumed non-fakes. Results: Two initial indicators (“email+NIA”) revealed a rapid rise of RFP from 2010 to 2020. Countries with the highest RFP proportion were Russia, Turkey, China, Egypt, India and China (39%-55%). When using the “email+hospital” tallying-rule, sensitivity of RFP identification was 86%, the false alarm rate 44%, and the estimated RFP rate in 2020 was 11.0%. Adding a RFP-citation indicator (“email+hospital+RFP-citations”) increased the sensitivity to 90% and reduced the false alarm rate to 37%. Given 1.3 million biomedical Scimago-listed publications, the estimated annual RFP number in 2020 is about 150,000. Conclusions: Potential fake publications can be red-flagged using simple-to-use, validated classification rules to earmark them for subsequent scrutiny. RFP rates are increasing, suggesting higher actual fake rates than previously reported. The large scale and proliferation of fake publications in biomedicine can damage trust in science, endanger public health, and impact economic spending and security. Easy-to-apply fake detection methods, as proposed here, or more complex automated methods can enable the retraction of fake publications at scale and help prevent further damage to the permanent scientific record.
Overview
Integrity signals
Registry
Cites
Statistics
Figures



Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Agents for paper mills have also recently been reported to attempt to bribe journal editors (29, 30) and to “hijack” the entire editorial processes at some journals (31–33).”
From The entities enabling scientific fraud at scale are large, resilient, and growing rapidly (2025) · cites this paper as [30]
In the citing paper
“However, the evidence suggests that these mechanisms have not yet been successful in stemming the tide of defections (24–33).”
From The entities enabling scientific fraud at scale are large, resilient, and growing rapidly (2025) · cites this paper as [30]
In the citing paper
“the consensus among experts is that the vast majority of paper mill products have not been detected (30, 79, 82).”
From The entities enabling scientific fraud at scale are large, resilient, and growing rapidly (2025) · cites this paper as [30]
In the citing paper
“Journal editors have been offered substantial payments for rapid publication of selected manuscripts (29, 30)”
From The entities enabling scientific fraud at scale are large, resilient, and growing rapidly (2025) · cites this paper as [30]
Citations
Cites
3 retracted
Retracted papers originating from paper mills: cross sectional study
Candal-Pedreira, C., Ross, J. S., Ruano-Ravina, A., Egilman, D. S., Fernández, E., & Pérez-Ríos, M. (2022) · BMJ · doi:10.1136/bmj-2022-071517 · Cited by 156
RetractedRetracted articles in the biomedical literature from Indian authors
Elango, B. (2021) · Scientometrics · doi:10.1007/s11192-021-03895-1 · Cited by 62
RetractedRetracted publications in pharmacy systematic reviews
Brown, S. J., Bakker, C., & Theis-Mahon, N. R. (2022) · Journal of the Medical Library Association JMLA · doi:10.5195/jmla.2022.1280 · Cited by 41
RetractedMisconduct accounts for the majority of retracted scientific publications
Fang, F. C., Steen, R. G., & Casadevall, A. (2012) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1212247109 · Cited by 1,232
Prevalence of Articles With Honorary Authors and Ghost Authors in Peer-Reviewed Medical Journals
Flanagin, A. (1998) · JAMA · doi:10.1001/jama.280.3.222 · Cited by 553
Honorary and ghost authorship in high impact biomedical journals: a cross sectional survey
Wislar, J. S., Flanagin, A., Fontanarosa, P. B., & DeAngelis, C. D. (2011) · BMJ · doi:10.1136/bmj.d6128 · Cited by 478
Intended and unintended consequences of a publish‐or‐perish culture: A worldwide survey
van Dalen, H. P., & Henkens, K. (2012) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.22636 · Cited by 355
The Prevalence of Inappropriate Image Duplication in Biomedical Research Publications
Bik, E. M., Casadevall, A., & Fang, F. C. (2016) · mBio · doi:10.1128/mbio.00809-16 · Cited by 287
Statistical Rituals: The Replication Delusion and How We Got There
Gigerenzer, G. (2018) · Advances in Methods and Practices in Psychological Science · doi:10.1177/2515245918771329 · Cited by 263
Self-citationThe fight against fake-paper factories that churn out sham science
Else, H., & Van Noorden, R. (2021) · Nature · doi:10.1038/d41586-021-00733-5 · Cited by 251
Research works printed but not linked: 2
- Abalkina A (2021) Publication and collaboration anomalies in academic papers originating from a paper mill: evidence from Russia arXiv preprint arXiv.2112.13322 · arXiv
- 2013, An empirical analysis on number and monetary value of ghostwritten papers in, China Current Science, 105, 1230
Cited by
The entities enabling scientific fraud at scale are large, resilient, and growing rapidly
Richardson, R. A. K., Hong, S. S., Byrne, J. A., Stoeger, T., & Amaral, L. A. N. (2025) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2420092122 · Cited by 129
Morris, M. X., Fiocco, D., Caneva, T., Yiapanis, P., & Orgill, D. P. (2024) · Frontiers in Surgery · doi:10.3389/fsurg.2024.1393898 · Cited by 117
Kendall, G., & Teixeira da Silva, J. A. (2024) · Learned Publishing · doi:10.1002/leap.1578 · Cited by 100
The landscape of biomedical research
González-Márquez, R., Schmidt, L., Schmidt, B. M., Berens, P., & Kobak, D. (2024) · Patterns · doi:10.1016/j.patter.2024.100968 · Cited by 89
The misalignment of incentives in academic publishing and implications for journal reform
Trueblood, J. S., Allison, D. B., Field, S. M., Fishbach, A., Gaillard, S. D. M., Gigerenzer, G., Holmes, W. R., Lewandowsky, S., Matzke, D., Murphy, M. C., et al. (2025) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2401231121 · Cited by 56
Self-citation
Metadata
- Authors
- Sabel, B. A., Knaack, E., Gigerenzer, G., & Bilc, M.
- Affiliations
- Center for Behavioral Brain Sciences (DE)
- Otto-von-Guericke-Universität Magdeburg (DE)
- Max Planck Institute for Human Development (DE)
- Corresponding author
- Sabel, Bernhard A.
- Venue
- Naunyn-Schmiedeberg s Archives of Pharmacology
- Publisher
- openRxiv
- Published
- 2023-05-08
- Volume
- 399
- Issue
- 2
- Pages
- 2943-2955
- ISSN
- 0028-1298 (ISSN-L)
- PMC
- PMC12901079
- OpenAlex
- W4414490687
- Cited by
- 51
- References
- 51
- Citations by year
- 2026: 12 · 2025: 15 · 2024: 17 · 2023: 7
- FWCI
- 27.94
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- Locations
- Naunyn-Schmiedeberg s Archives of Pharmacology (publishedVersion, cc-by)
- medRxiv (acceptedVersion, cc-by-nd)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed (publishedVersion)
- PubMed Central (publishedVersion, cc-by)
- MPG.PuRe (Max Planck Society) (submittedVersion, other-oa)
- Funders
- Eberhard Karls Universität Tübingen
- Otto von Guericke University Magdeburg
- Topics
- Social Sciences › Education › Academic integrity and plagiarism
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Keywords
- paper mills, research integrity, bibliometric analysis, Bayes' theorem, publication fraud, biomedical literature, retraction, AI-generated content
- MeSH terms
- Humans, Periodicals as Topic, Publishing, Surveys and Questionnaires, Bibliometrics, Biomedical Research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Fake Publications in Biomedical Science: Red-flagging Method Indicates Mass Production. https://app.cochat.ai/papers/10.1101/2023.05.06.23289563
- The paper
- Sabel, B. A., Knaack, E., Gigerenzer, G., & Bilc, M. (2023). Fake Publications in Biomedical Science: Red-flagging Method Indicates Mass Production. Naunyn-Schmiedeberg s Archives of Pharmacology. https://doi.org/10.1101/2023.05.06.23289563
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.