Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 18 of the 18 references it cites were found in a registry or an index.

Retracted papers originating from paper mills: cross sectional study

Open access
Candal-Pedreira, Cristina, Ross, Joseph S, Ruano-Ravina, Alberto, Egilman, David S, Fernández, Esteve, Pérez-Ríos, Mónica · 2022 · BMJ

Abstract

Objectives: To describe retracted papers originating from paper mills, including their characteristics, visibility, and impact over time, and the journals in which they were published. Design: Cross sectional study. Setting: The Retraction Watch database was used for identification of retracted papers from paper mills, Web of Science was used for the total number of published papers, and data from Journal Citation Reports were collected to show characteristics of journals. Participants: All paper mill papers retracted from 1 January 2004 to 26 June 2022 were included in the study. Papers bearing an expression of concern were excluded. Main outcome measures: Descriptive statistics were used to characterise the sample and analyse the trend of retracted paper mill papers over time, and to analyse their impact and visibility by reference to the number of citations received. Results: 1182 retracted paper mill papers were identified. The publication of the first paper mill paper was in 2004 and the first retraction was in 2016; by 2021, paper mill retractions accounted for 772 (21.8%) of the 3544 total retractions. Overall, retracted paper mill papers were mostly published in journals of the second highest Journal Citation Reports quartile for impact factor (n=529 (44.8%)) and listed four to six authors (n=602 (50.9%)). Of the 1182 papers, almost all listed authors of 1143 (96.8%) paper mill retractions came from Chinese institutions and 909 (76.9%) listed a hospital as a primary affiliation. 15 journals accounted for 812 (68.7%) of 1182 paper mill retractions, with one journal accounting for 166 (14.0%). Nearly all (n=1083, 93.8%) paper mill retractions had received at least one citation since publication, with a median of 11 (interquartile range 5-22) citations received. Conclusions: Papers retracted originating from paper mills are increasing in frequency, posing a problem for the research community. Retracted paper mill papers most commonly originated from China and were published in a small number of journals. Nevertheless, detected paper mill papers might be substantially different from those that are not detected. New mechanisms are needed to identify and avoid this relatively new type of misconduct.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1136/bmj-2022-071517This paper is marked retracted.

Cites

18 of 18 references verified0 citation errors · 0 not checkable

Statistics

Figures

Fig 1 Proportion, per 100 000, of paper mill papers published and then retracted per year with respect to total publications
Fig 1 Proportion, per 100 000, of paper mill papers published and then retracted per year with respect to total publicationsCC BY-NC · PubMed Central
Fig 2 Percentage of paper mill retractions with respect to total retractions
Fig 2 Percentage of paper mill retractions with respect to total retractionsCC BY-NC · PubMed Central
Fig 3 Citations received by papers retracted for originating from paper mills, by quartile of journal in which they were published based on the impact factor. 24 values were missing. The box represents the interquartile range of the variable, the horizontal line inside the box indicates the median, the lower whisker indicates the lowest value excluding the outliers and the upper whisker indicates the highest value excluding the outliers. The circles represent the outliers of the variables
Fig 3 Citations received by papers retracted for originating from paper mills, by quartile of journal in which they were published based on the impact factor. 24 values were missing. The box represents the interquartile range of the variable, the horizontal line inside the box indicates the median, the lower whisker indicates the lowest value excluding the outliers and the upper whisker indicates the highest value excluding the outliers. The circles represent the outliers of the variablesCC BY-NC · PubMed Central

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 18 references

Research works printed but not linked: 3

  1. Abalkina A. Publication and collaboration anomalies in academic papers originating from a paper mill: evidence from Russia. 2021. https://arxiv.org/abs/2112.13322 · arXiv
  2. Ministry of Science and Technology of the People’s Republic of China. Notice from the Ministry of Science and Technology on the recent investigation and handling of thesis falsification. https://www.most.gov.cn/zxgz/kycxjs/kycxgzdt/202112/t20211201_178285.html
  3. Retraction Watch. Journal retracts 122 papers at once.https://retractionwatch.com/2021/12/15/journal-retracts-122-papers-at-once/#more-123768

Cited by

See all 156

Metadata

Authors
Candal-Pedreira, C., Ross, J. S., Ruano-Ravina, A., Egilman, D. S., Fernández, E., & Pérez-Ríos, M.
Affiliations
  • Preventive Medicine and Public Health, University of Santiago de Compostela, Santiago de Compostela, Galicia, Spain
  • Yale New Haven Hospital (US)
  • Brown University (US)
  • Centro de Investigación Biomédica en Red de Enfermedades Respiratorias (ES)
Venue
BMJ
Publisher
BMJ
Published
2022-11-28
Volume
379
Pages
e071517
ISSN
1756-1833 (ISSN-L)
OpenAlex
W4310186689
Cited by
156
References
18
Citations by year
2026: 41 · 2025: 44 · 2024: 41 · 2023: 28 · 2022: 2
FWCI
33.30
Type
journal article
Language
en
Status
Retracted
Open access
Locations
  • BMJ (publishedVersion, cc-by-nc)
  • PubMed Central (publishedVersion, cc-by-nc)
  • PubMed (publishedVersion)
  • Hispana (submittedVersion, cc-by-nc)
  • Dipòsit Digital de la Universitat de Barcelona (Universitat de Barcelona) (submittedVersion, cc-by-nc)
Funders
Instituto de Salud Carlos III
Topics
  • Social Sciences › Education › Academic integrity and plagiarism
  • Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
  • Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
Keywords
paper mills, retracted article, research misconduct, duplicate publication, citation impact, journal impact factor, Chinese institutions, Retraction Watch, research integrity
MeSH terms
China, Cross-Sectional Studies, Hospitals, Humans, Databases, Factual, Asian People

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Retracted papers originating from paper mills: cross sectional study. https://app.cochat.ai/papers/10.1136/bmj-2022-071517
The paper
Candal-Pedreira, C., Ross, J. S., Ruano-Ravina, A., Egilman, D. S., Fernández, E., & Pérez-Ríos, M. (2022). Retracted papers originating from paper mills: cross sectional study. BMJ. https://doi.org/10.1136/bmj-2022-071517

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.