Threats to scholarly research integrity arising from paper mills: a rapid scoping review
The DOI matches its Crossref record; 30 of the 30 references it cites were found in a registry or an index.
Abstract
"Paper mills" are unethical outsourcing agencies proficient in fabricating fraudulent manuscripts submitted to scholarly journals. In earlier years, the activity of such companies involved plagiarism, but their processes have gained complexity, involving the fabrication of images and fake results. The objective of this study is to examine the main features of retracted paper mills' articles registered in the Retraction Watch database, from inception to the present, analyzing the number of articles per year, their number of citations, and their authorship network. Eligibility criteria for inclusion: retracted articles in any language due to paper mill activity. Retraction letters, notes, and notices, for exclusion. We collected the associated citations and the journals' impact factors of the retracted papers from Web of Science (Clarivate) and performed a data network analysis using VOSviewer software. This scoping review complies with PRISMA 2020 statement and main extensions. After a thorough analysis of the data, we identified 325 retracted articles due to suspected operations published in 31 journals (with a mean impact factor of 3.1). These retractions have produced 3708 citations. Nearly all retracted papers have come from China. Journal's impact factor lower than 7, life sciences journals, cancer, and molecular biology topics were common among retracted studies. The rapid increase of retractions is highly challenging. Paper mills damage scientific research integrity, ex…
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The major source of fake publications are 1,000 + “academic support” agencies—so-called paper mills—located mainly in China, India, Russia, UK, and USA (Abalkina 2021; Else 2021; Pérez-Neri et al. 2022; consider Wittau and Seifert 2024 for a comprehensive review).”
From Fake publications in biomedical science: red-flagging method indicates mass production (2026) · cites this paper as Pérez-Neri et al. 2022
In the citing paper
“Paper mill customers—students, physicians, and scientists—experience pressure by incentive systems of their academic or government institutions or university-affiliated hospitals to publish in SCI journals (Pérez-Neri et al. 2022).”
From Fake publications in biomedical science: red-flagging method indicates mass production (2026) · cites this paper as Pérez-Neri et al. 2022
In the citing paper
“However, these benefits are accompanied by risks, including undisclosed AI authorship, manipulated content, and the emergence of papermills.”
From AI for scientific integrity: detecting ethical breaches, errors, and misconduct in manuscripts (2025) · cites this paper as Pérez-Neri et al., 2022
Citations
Cites
PRISMA Extension for Scoping Reviews (PRISMA-ScR): Checklist and Explanation
Tricco, A. C., Lillie, E., Zarin, W., O'Brien, K. K., Colquhoun, H., Levac, D., Moher, D., Peters, M. D. J., Horsley, T., Weeks, L., et al. (2018) · Annals of Internal Medicine · doi:10.7326/m18-0850 · Cited by 43,565 · cited 1×
“Scoping reviews are evidence synthesis methods aimed to “examine the extent (that is, size), range (variety), and nature (characteristics) of the evidence on a topic or question; determine the value of undertaking a systematic review; summarize findings from a body of knowledge that is heterogeneous in methods or disc…”
BackgroundRayyan-a web and mobile app for systematic reviews.
Ouzzani, M., Hammady, H., Fedorowicz, Z., & Elmagarmid, A. (2016) · Systematic Reviews · doi:10.1186/s13643-016-0384-4 · Cited by 26,092 · cited 1×
“We de-duplicated retrieved references through manual inspection first using a spreadsheet, then using Rayyan QCRI’s [23] default algorithm [24].”
MethodSoftware survey: VOSviewer, a computer program for bibliometric mapping
van Eck, N. J., & Waltman, L. (2010) · Scientometrics · doi:10.1007/s11192-009-0146-3 · Cited by 21,484
Shamseer, L., Moher, D., Clarke, M., Ghersi, D., Liberati, A., Petticrew, M., Shekelle, P., Stewart, L. A., & the PRISMA-P Group (2015) · BMJ · doi:10.1136/bmj.g7647 · Cited by 13,120 · cited 1×
“Data were extracted by one researcher and verified by a second researcher [27].”
MethodPRESS Peer Review of Electronic Search Strategies: 2015 Guideline Statement
McGowan, J., Sampson, M., Salzwedel, D. M., Cogo, E., Foerster, V., & Lefebvre, C. (2016) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2016.01.021 · Cited by 5,700
JBI Manual for Evidence Synthesis
(2020) · JBI eBooks · doi:10.46658/jbimes-20-01 · Cited by 4,165
Cochrane Rapid Reviews Methods Group offers evidence-informed guidance to conduct rapid reviews
Garritty, C., Gartlehner, G., Nussbaumer-Streit, B., King, V. J., Hamel, C., Kamel, C., Affengruber, L., & Stevens, A. (2021) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2020.10.007 · Cited by 1,141
Rethlefsen, M. L., Kirtley, S., Waffenschmidt, S., Ayala, A. P., Moher, D., Page, M. J., Koffel, J. B., & Group, P.-S. (2021) · Journal of the Medical Library Association · doi:10.5195/jmla.2021.962 · Cited by 409 · cited 1×
“As depicted in supplementary material 3, we report the search strategy according to the PRISMA-S extension [20].”
MethodGood Publication Practice for Communicating Company-Sponsored Medical Research: GPP3
Battisti, W. P., Wager, E., Baltzer, L., Bridges, D., Cairns, A., Carswell, C. I., Citrome, L., Gurr, J. A., Mooney, L. A., Moore, B. J., et al. (2015) · Annals of Internal Medicine · doi:10.7326/m15-0288 · Cited by 358
Hvistendahl, M. (2013) · Science · doi:10.1126/science.342.6162.1035 · Cited by 256
McKeown, S., & Mir, Z. M. (2021) · Systematic Reviews · doi:10.1186/s13643-021-01583-y · Cited by 251 · cited 2×
“All identified duplicates were manually revised and eliminated [24].”
BackgroundMethodByrne, J. A., & Christopher, J. (2020) · FEBS Letters · doi:10.1002/1873-3468.13747 · Cited by 133
Jacobs, A., & Wager, E. (2005) · Current Medical Research and Opinion · doi:10.1185/030079905x25578 · Cited by 117
The raw truth about paper mills
Christopher, J. (2021) · FEBS Letters · doi:10.1002/1873-3468.14143 · Cited by 99 · cited 1×
“PM may have already generated thousands of fake studies up to now, most of them not yet correctly identified by the affected scholarly journals [10].”
BackgroundIntegrity of Authorship and Peer Review Practices: Challenges and Opportunities for Improvement
Misra, D. P., Ravindran, V. K., & Agarwal, V. (2018) · Journal of Korean Medical Science · doi:10.3346/jkms.2018.33.e287 · Cited by 76
How Naunyn-Schmiedeberg’s Archives of Pharmacology deals with fraudulent papers from paper mills
Seifert, R. (2021) · Naunyn-Schmiedeberg's Archives of Pharmacology · doi:10.1007/s00210-021-02056-8 · Cited by 62 · cited 3×
“Ghostwriting of pseudo-original articles containing no raw data but fake, stolen, or manipulated data [4], including image manipulation [16].”
BackgroundMedia and social media attention to retracted articles according to Altmetric
Serghiou, S., Marton, R. M., & Ioannidis, J. P. A. (2021) · PLOS ONE · doi:10.1371/journal.pone.0248625 · Cited by 55 · cited 1×
“org/) in May 2021, from inception to the present, as in previous studies [22].”
ResultPolhemus, A. M., Bergquist, R., de Basea, M. B., Brittain, G., Buttery, S. C., Chynkiamis, N., Costa, G. D., Delgado‐Ortiz, L., Demeyer, H., Emmert, K., et al. (2020) · BMJ Open · doi:10.1136/bmjopen-2020-038704 · Cited by 46
Cheating goes hi-tech: online term paper mills
Campbell, C. R., Swift, C. O., & Denton, L. (2000) · Journal of Management Education · doi:10.1177/105256290002400605 · Cited by 43 · cited 1×
“These practices were the background for the rising of a series of fraudulent companies—at that time called “term paper mills” [1] and “essay mills”—[2] that appeared next.”
BackgroundPredatory Publishing Is a Threat to Non-Mainstream Science
Gasparyan, A. Y., Nurmashev, B., Udovik, E. E., Am, K., & Kitas, G. D. (2017) · Journal of Korean Medical Science · doi:10.3346/jkms.2017.32.5.713 · Cited by 43
Hiring a professional medical writer: is it equivalent to ghostwriting?
Das, N., & Das, S. (2014) · Biochemia Medica · doi:10.11613/bm.2014.004 · Cited by 27
Emerging Concern of Scientific Fraud: Deep Learning and Image Manipulation
Qi, C., Zhang, J., & Luo, P. (2020) · doi:10.1101/2020.11.24.395319 · Cited by 21 · cited 1×
“On this matter, new machine learning frameworks—such as Generative Adversarial Networks—can produce Western blot realistic images practically indistinguishable from the real ones [15].”
BackgroundA retrospective review of snake bite victims admitted in a tertiary level teaching institute
Kumar, M., Babu, P., Kumar, S., Subrahmanyam, B., Rammohan, P., Srinivas, M., Agrawal, A., & MVeeraprasad (2014) · Annals of African Medicine · doi:10.4103/1596-3519.129879 · Cited by 21 · cited 1×
“We evaluated inter-rater agreement by Cohen’s kappa [25] using PSPP [26], as in previous studies.”
MethodPlagiarism Continues to Affect Scholarly Journals
Hong, S. (2017) · Journal of Korean Medical Science · doi:10.3346/jkms.2017.32.2.183 · Cited by 20 · cited 1×
“PM’s main target is non-English-speaking regions [5, 6], mainly in Asian countries like China, where some authors have conservatively valued this business model at more than USD 4.”
BackgroundAuthorship and Contributorship in Scholarly Journals
Gasparyan, A. Y. (2013) · Journal of Korean Medical Science · doi:10.3346/jkms.2013.28.6.801 · Cited by 17
Predatory Preprint Servers Join Predatory Journals in the Paper Mill Industry…
Moore, A. (2020) · BioEssays · doi:10.1002/bies.202000259 · Cited by 10 · cited 1×
“For example, plagiarism-detection software—such as iThenticate—cannot recognize photoshopped images, stock images, or data-set plagiarism [14].”
MethodA reality check on publishing integrity tools in biomedical science
da Silva, J. A. T. (2021) · Clinical Rheumatology · doi:10.1007/s10067-021-05668-w · Cited by 8 · cited 1×
“A previous letter addressing “publishing integrity tools in biomedical science” has discussed some of the limitations experienced by Journal Editors during the peer review process, and the fraudulent strategies employed to “legitimate” fake authors by paper mills [18] but to the best of our knowledge, no evidence synt…”
BackgroundCombatting the rise of paper mills
Calver, M. (2021) · Pacific Conservation Biology · doi:10.1071/pcv27n1_ed · Cited by 6 · cited 3×
“Provision of fraudulent or plagiarized data sets [11].”
BackgroundReflecting on the achievements and looking to the future of an established rheumatology journal
Gasparyan, A. Y. (2017) · Rheumatology International · doi:10.1007/s00296-017-3822-2 · Cited by 3
Forest, C. D., Haiech, J., & Hervé, C. (2020) · Ethics Medicine and Public Health · doi:10.1016/j.jemep.2020.100592 · Cited by 2
Research works printed but not linked: 3
- Hersey C, Lancaster T (2015) The online industry of paper mills, contract cheating services, and auction sites. In: Clute Institute Education Conference, London
- Jennifer Byrne And Jana Christopher (2020) How can editors detect manuscripts and publications from paper mills? https://www.wiley.com/network/archive/how-can-editors-detect-manuscripts-and-publications-from-paper-mills. Accessed Mar 21, 2021
- Booth A, Sutton A, Papaioannou D (2016) Systematic approaches to a successful literature review. SAGE Publications
Cited by
Sarstedt, M., Adler, S. J., Rau, L., & Schmitt, B. (2024) · Psychology & Marketing · doi:10.1002/mar.21982 · Cited by 149
“Publishers, journal editors, and reviewers need to be aware of this tug ‐ of ‐ war, which other fields are already witnessing in the context of paper mills (Candal ‐ Pedreira et al., 2022; Day, 2022; Pérez ‐ Neri et al., 2022).”
BackgroundKendall, G., & Teixeira da Silva, J. A. (2024) · Learned Publishing · doi:10.1002/leap.1578 · Cited by 100
“The current commercial ghostwriting industry (Chirico & Bramstedt, 2023; Mehregan, 2022; Pérez-Neri et al., 2022) is already very advanced and highly pro fi table.”
BackgroundRudan, I., Song, P., Adeloye, D., & Campbell, H. (2025) · Journal of Global Health · doi:10.7189/jogh.15.01004 · Cited by 75
Fake Publications in Biomedical Science: Red-flagging Method Indicates Mass Production
Sabel, B. A., Knaack, E., Gigerenzer, G., & Bilc, M. (2023) · doi:10.1101/2023.05.06.23289563 · Cited by 51
Byrne, J. A., Park, Y., Richardson, R. A. K., Pathmendra, P., Sun, M., & Stoeger, T. (2022) · Nucleic Acids Research · doi:10.1093/nar/gkac1139 · Cited by 46
“These results are similar to those described by a recent scoping review that identified over 300 retracted articles due to suspected paper mill operations, where ‘mir’ (miRNA) represented the most frequently identified keyword (61).”
Metadata
- Authors
- Pérez-Neri, I., Pineda, C., & Sandoval, H.
- Affiliations
- Instituto Nacional de Rehabilitación (MX)
- Corresponding author
- Sandoval, Hugo
- Venue
- Clinical Rheumatology
- Published
- 2022-05-06
- Volume
- 41
- Issue
- 7
- Pages
- 2241-2248
- ISSN
- 0770-3198 (ISSN-L)
- 1434-9949
- OpenAlex
- W4229051371
- Cited by
- 70
- References
- 30
- Citations by year
- 2026: 12 · 2025: 21 · 2024: 24 · 2023: 10 · 2022: 3
- FWCI
- 2.75
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- www.springer.com/tdm (vor)
- Locations
- Clinical Rheumatology (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Education › Academic integrity and plagiarism
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Keywords
- paper mills, research integrity, retracted article, Retraction Watch, research misconduct, plagiarism, image editing, citation impact, journal impact factor, authorship networks, rheumatology research
- MeSH terms
- Authorship, Humans, Publications, Plagiarism, Scientific Misconduct, Biomedical Research, Journal Impact Factor
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.