Fake Publications in Biomedical Science: Red-flagging Method Indicates Mass Production
Open accessThe DOI matches its Crossref record; 51 of the 51 references it cites were found in a registry or an index.
Abstract
Background: Integrity of academic publishing is increasingly undermined by fake science publications massively produced by commercial “editing services” (so-called “paper mills”). They use AI-supported, automated production techniques at scale and sell fake publications to students, scientists, and physicians under pressure to advance their careers. Because the scale of fake publications in biomedicine is unknown, we developed a simple method to red-flag them and estimate their number. Methods: To identify indicators able to red-flag fake publications (RFPs), we sent questionnaires to authors. Based on author responses, a classification rule was applied initially using the two-indicators “non-institutional email AND no international authors” (“email+NIA”) to sub-samples of 15,120 PubMed®-listed publications regarding publication date, journal, impact factor, country and RFP citations. Using the indicator “hospital affiliation” (“email+hospital”), this classification (tallying) rule was validated by comparing 400 known fakes with 400 matched presumed non-fakes. Results: Two initial indicators (“email+NIA”) revealed a rapid rise of RFP from 2010 to 2020. Countries with the highest RFP proportion were Russia, Turkey, China, Egypt, India and China (39%-55%). When using the “email+hospital” tallying-rule, sensitivity of RFP identification was 86%, the false alarm rate 44%, and the estimated RFP rate in 2020 was 11.0%. Adding a RFP-citation indicator (“email+hospital+RFP-citations”) increased the sensitivity to 90% and reduced the false alarm rate to 37%. Given 1.3 million biomedical Scimago-listed publications, the estimated annual RFP number in 2020 is about 150,000. Conclusions: Potential fake publications can be red-flagged using simple-to-use, validated classification rules to earmark them for subsequent scrutiny. RFP rates are increasing, suggesting higher actual fake rates than previously reported. The large scale and proliferation of fake publications in biomedicine can damage trust in science, endanger public health, and impact economic spending and security. Easy-to-apply fake detection methods, as proposed here, or more complex automated methods can enable the retraction of fake publications at scale and help prevent further damage to the permanent scientific record.
Overview
Integrity signals
Registry
Cites
Statistics
Figures



Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Agents for paper mills have also recently been reported to attempt to bribe journal editors (29, 30) and to “hijack” the entire editorial processes at some journals (31–33).”
From The entities enabling scientific fraud at scale are large, resilient, and growing rapidly (2025) · cites this paper as [30]
In the citing paper
“However, the evidence suggests that these mechanisms have not yet been successful in stemming the tide of defections (24–33).”
From The entities enabling scientific fraud at scale are large, resilient, and growing rapidly (2025) · cites this paper as [30]
In the citing paper
“the consensus among experts is that the vast majority of paper mill products have not been detected (30, 79, 82).”
From The entities enabling scientific fraud at scale are large, resilient, and growing rapidly (2025) · cites this paper as [30]
In the citing paper
“Journal editors have been offered substantial payments for rapid publication of selected manuscripts (29, 30)”
From The entities enabling scientific fraud at scale are large, resilient, and growing rapidly (2025) · cites this paper as [30]
Citations
Cites
3 retracted
Retracted papers originating from paper mills: cross sectional study
Candal-Pedreira, C., Ross, J. S., Ruano-Ravina, A., Egilman, D. S., Fernández, E., & Pérez-Ríos, M. (2022) · BMJ · doi:10.1136/bmj-2022-071517 · Cited by 156
RetractedRetracted articles in the biomedical literature from Indian authors
Elango, B. (2021) · Scientometrics · doi:10.1007/s11192-021-03895-1 · Cited by 62
RetractedRetracted publications in pharmacy systematic reviews
Brown, S. J., Bakker, C. J., & Theis-Mahon, N. R. (2022) · Journal of the Medical Library Association · doi:10.5195/jmla.2022.1280 · Cited by 34
RetractedMisconduct accounts for the majority of retracted scientific publications
Fang, F. C., Steen, R. G., & Casadevall, A. (2012) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1212247109 · Cited by 1,232
Prevalence of Articles With Honorary Authors and Ghost Authors in Peer-Reviewed Medical Journals
Flanagin, A. (1998) · JAMA · doi:10.1001/jama.280.3.222 · Cited by 553
Honorary and ghost authorship in high impact biomedical journals: a cross sectional survey
Wislar, J. S., Flanagin, A., Fontanarosa, P. B., & DeAngelis, C. D. (2011) · BMJ · doi:10.1136/bmj.d6128 · Cited by 478
Intended and unintended consequences of a publish‐or‐perish culture: A worldwide survey
van Dalen, H. P., & Henkens, K. (2012) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.22636 · Cited by 355
The Prevalence of Inappropriate Image Duplication in Biomedical Research Publications
Bik, E. M., Casadevall, A., & Fang, F. C. (2016) · mBio · doi:10.1128/mbio.00809-16 · Cited by 287
Statistical Rituals: The Replication Delusion and How We Got There
Gigerenzer, G. (2018) · Advances in Methods and Practices in Psychological Science · doi:10.1177/2515245918771329 · Cited by 263
Self-citationThe fight against fake-paper factories that churn out sham science
Else, H., & Van Noorden, R. (2021) · Nature · doi:10.1038/d41586-021-00733-5 · Cited by 251
False individual patient data and zombie randomised controlled trials submitted to Anaesthesia
Carlisle, J. B. (2021) · Anaesthesia · doi:10.1111/anae.15263 · Cited by 173
Retractions in the research literature: misconduct or mistakes?
Nath, S. B., Marcus, S. C., & Druss, B. G. (2006) · Medical Journal of Australia · doi:10.5694/j.1326-5377.2006.tb00504.x · Cited by 161
Byrne, J. A., & Christopher, J. (2020) · FEBS Letters · doi:10.1002/1873-3468.13747 · Cited by 133
Tian, M., Su, Y., & Ru, X. (2016) · Publications · doi:10.3390/publications4020009 · Cited by 129
Lei, L., & Zhang, Y. W. (2017) · Science and Engineering Ethics · doi:10.1007/s11948-017-9962-7 · Cited by 116
How big is science’s fake-paper problem?
Van Noorden, R. (2023) · Nature · doi:10.1038/d41586-023-03464-x · Cited by 114
The raw truth about paper mills
Christopher, J. (2021) · FEBS Letters · doi:10.1002/1873-3468.14143 · Cited by 99
(2022) · doi:10.24318/jtbg8ihl · Cited by 93
The landscape of biomedical research
González-Márquez, R., Schmidt, L., Schmidt, B. M., Berens, P., & Kobak, D. (2024) · Patterns · doi:10.1016/j.patter.2024.100968 · Cited by 89
Retractions in cancer research: a systematic survey
Bozzo, A., Bali, K., Evaniew, N., & Ghert, M. (2017) · Research Integrity and Peer Review · doi:10.1186/s41073-017-0031-1 · Cited by 83
Prevalence of nonsensical algorithmically generated papers in the scientific literature
Cabanac, G., & Labbé, C. (2021) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.24495 · Cited by 83
Threats to scholarly research integrity arising from paper mills: a rapid scoping review
Pérez-Neri, I., Pineda, C., & Sandoval, H. (2022) · Clinical Rheumatology · doi:10.1007/s10067-022-06198-9 · Cited by 70
How Naunyn-Schmiedeberg’s Archives of Pharmacology deals with fraudulent papers from paper mills
Seifert, R. (2021) · Naunyn-Schmiedeberg's Archives of Pharmacology · doi:10.1007/s00210-021-02056-8 · Cited by 62
Avenell, A., Stewart, F., Grey, A., Gamble, G., & Bolland, M. (2019) · BMJ Open · doi:10.1136/bmjopen-2019-031909 · Cited by 59
‘Stamp out paper mills’ — science sleuths on how to fight fake research
Abalkina, A., Aquarius, R., Bik, E., Bimler, D., Bishop, D., Byrne, J., Cabanac, G., Day, A., Labbé, C., & Wise, N. (2025) · Nature · doi:10.1038/d41586-025-00212-1 · Cited by 59
Regional and institutional trends in assessment for academic promotion
Lim, B. H., D’Ippoliti, C., Dominik, M., Hernández-Mondragón, A. C., Vermeir, K., Chong, K. K., Hussein, H., Morales-Salgado, V. S., Cloete, K. J., Kimengsi, J. N., et al. (2025) · Nature · doi:10.1038/s41586-024-08422-9 · Cited by 53
Byrne, J. A., Park, Y., Richardson, R. A. K., Pathmendra, P., Sun, M., & Stoeger, T. (2022) · Nucleic Acids Research · doi:10.1093/nar/gkac1139 · Cited by 46
China conducts first nationwide review of retractions and research misconduct
Mallapaty, S. (2024) · Nature · doi:10.1038/d41586-024-00397-x · Cited by 44
Classification in the Wild: The Science and Art of Transparent Decision Making
Katsikopoulos, K. V., Şimşek, Ö., Buckmann, M., & Gigerenzer, G. (2021) · doi:10.7551/mitpress/11790.001.0001 · Cited by 42
Self-citationWorld Map of Scientific Misconduct
Ataie‐Ashtiani, B. (2017) · Science and Engineering Ethics · doi:10.1007/s11948-017-9939-6 · Cited by 39
We need to talk about systematic fraud
Byrne, J. (2019) · Nature · doi:10.1038/d41586-019-00439-9 · Cited by 39
Identification of human gene research articles with wrongly identified nucleotide sequences
Park, Y., West, R. A., Pathmendra, P., Favier, B., Stoeger, T., Capes-Davis, A., Cabanac, G., Labbé, C., & Byrne, J. A. (2022) · Life Science Alliance · doi:10.26508/lsa.202101203 · Cited by 37
Wittau, J., & Seifert, R. (2024) · Naunyn-Schmiedeberg s Archives of Pharmacology · doi:10.1007/s00210-024-03272-8 · Cited by 36
Heck, S., Bianchini, F., Souren, N. Y., Wilhelm, C., Ohl, Y., & Plass, C. (2021) · International Journal of Cancer · doi:10.1002/ijc.33604 · Cited by 35
China introduces sweeping reforms to crack down on academic misconduct
Cyranoski, D. (2018) · Nature · doi:10.1038/d41586-018-05359-8 · Cited by 32
Sabel, B. A., & Seifert, R. (2021) · Naunyn-Schmiedeberg's Archives of Pharmacology · doi:10.1007/s00210-021-02158-3 · Cited by 27
Self-citationPaper-mill detector put to the test in push to stamp out fake science
Else, H. (2022) · Nature · doi:10.1038/d41586-022-04245-8 · Cited by 27
The Changing Medical Publishing Industry: Economics, Expansion, and Equity
Booth, C. M., Ross, J. S., & Detsky, A. S. (2023) · Journal of General Internal Medicine · doi:10.1007/s11606-023-08307-z · Cited by 27
da Silva, J. A. T., Daly, T. P., Türp, J. C., Sabel, B. A., & Kendall, G. (2024) · Naunyn-Schmiedeberg s Archives of Pharmacology · doi:10.1007/s00210-024-03177-6 · Cited by 25
Self-citationScammers impersonate guest editors to get sham papers published
Else, H. (2021) · Nature · doi:10.1038/d41586-021-03035-y · Cited by 23
China's research-misconduct rules target 'paper mills' that churn out fake studies.
Mallapaty, S. (2020) · Nature · doi:10.1038/d41586-020-02445-8 · Cited by 21
Science integrity has been never more important: it's all about trust
Behl, C. (2021) · Journal of Cellular Biochemistry · doi:10.1002/jcb.29906 · Cited by 20
Scientific Misconduct (Fraud) in Medical Writing
Mavrogenis, A. F., Panagopoulos, G. N., Megaloikonomos, P. D., Panagopoulos, V. N., Mauffrey, C., Quaile, A., & Scarlat, M. M. (2018) · Orthopedics · doi:10.3928/01477447-20180123-06 · Cited by 17
van Diest, R. A., Seifert, R., & van der Heyden, M. A. G. (2025) · Naunyn-Schmiedeberg s Archives of Pharmacology · doi:10.1007/s00210-024-03697-1 · Cited by 15
Keeping them honest: fighting fraud in academic publishing
Frederickson, R. M., & Herzog, R. W. (2021) · Molecular Therapy · doi:10.1016/j.ymthe.2021.02.011 · Cited by 13
How a site peddles author slots in reputable publishers’ journals
Chawla, D. S. (2022) · Science · doi:10.1126/science.abq4276 · Cited by 9
China’s supreme court calls for crack down on paper mills
Mallapaty, S. (2025) · Nature · doi:10.1038/d41586-025-00612-3 · Cited by 9
RSC Advances Editorial: retraction of falsified manuscripts
(2021) · RSC Advances · doi:10.1039/d1ra90009a · Cited by 5
Fake-Mafia in der Wissenschaft: KI, Gier und Betrug in der Forschung
Sabel, B. A. (2024) · doi:10.17433/978-3-17-045558-0 · Cited by 3
Self-citationErratum to: World Map of Scientific Misconduct
Ataie‐Ashtiani, B. (2017) · Science and Engineering Ethics · doi:10.1007/s11948-017-9942-y · Cited by 3
Paper Mills: global Knowledge Contamination by industrial-style Fake Science Publishing
Sabel, B. A. (2022) · doi:10.26226/morressier.61d3a5d04a84e7b4701d9885 · Cited by 2
Self-citation
Research works printed but not linked: 2
- Abalkina A (2021) Publication and collaboration anomalies in academic papers originating from a paper mill: evidence from Russia arXiv preprint arXiv.2112.13322 · arXiv
- 2013, An empirical analysis on number and monetary value of ghostwritten papers in, China Current Science, 105, 1230
Cited by
The entities enabling scientific fraud at scale are large, resilient, and growing rapidly
Richardson, R. A. K., Hong, S. S., Byrne, J. A., Stoeger, T., & Amaral, L. A. N. (2025) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2420092122 · Cited by 129
Morris, M. X., Fiocco, D., Caneva, T., Yiapanis, P., & Orgill, D. P. (2024) · Frontiers in Surgery · doi:10.3389/fsurg.2024.1393898 · Cited by 117
Kendall, G., & Teixeira da Silva, J. A. (2024) · Learned Publishing · doi:10.1002/leap.1578 · Cited by 100
The landscape of biomedical research
González-Márquez, R., Schmidt, L., Schmidt, B. M., Berens, P., & Kobak, D. (2024) · Patterns · doi:10.1016/j.patter.2024.100968 · Cited by 89
The misalignment of incentives in academic publishing and implications for journal reform
Trueblood, J. S., Allison, D. B., Field, S. M., Fishbach, A., Gaillard, S. D. M., Gigerenzer, G., Holmes, W. R., Lewandowsky, S., Matzke, D., Murphy, M. C., et al. (2025) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2401231121 · Cited by 56
Self-citation
Metadata
- Authors
- Sabel, B. A., Knaack, E., Gigerenzer, G., & Bilc, M.
- Affiliations
- Center for Behavioral Brain Sciences (DE)
- Otto-von-Guericke-Universität Magdeburg (DE)
- Max Planck Institute for Human Development (DE)
- Corresponding author
- Sabel, Bernhard A.
- Venue
- Naunyn-Schmiedeberg s Archives of Pharmacology
- Publisher
- openRxiv
- Published
- 2023-05-08
- Volume
- 399
- Issue
- 2
- Pages
- 2943-2955
- ISSN
- 0028-1298 (ISSN-L)
- PMC
- PMC12901079
- OpenAlex
- W4414490687
- Cited by
- 51
- References
- 51
- Citations by year
- 2026: 12 · 2025: 15 · 2024: 17 · 2023: 7
- FWCI
- 27.94
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- Locations
- Naunyn-Schmiedeberg s Archives of Pharmacology (publishedVersion, cc-by)
- medRxiv (acceptedVersion, cc-by-nd)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed (publishedVersion)
- PubMed Central (publishedVersion, cc-by)
- MPG.PuRe (Max Planck Society) (submittedVersion, other-oa)
- Funders
- Eberhard Karls Universität Tübingen
- Otto von Guericke University Magdeburg
- Topics
- Social Sciences › Education › Academic integrity and plagiarism
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Keywords
- paper mills, research integrity, bibliometric analysis, Bayes' theorem, publication fraud, biomedical literature, retraction, AI-generated content
- MeSH terms
- Humans, Periodicals as Topic, Publishing, Surveys and Questionnaires, Bibliometrics, Biomedical Research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.