The DOI matches its Crossref record; 14 of the 14 references it cites were found in a registry or an index.
How Metrics-Based Academic Evaluation Could Systematically Induce Academic Misconduct: A Case Study
Abstract
This article analyzes a case of postproduction misconduct, that is, the BioMed Central (BMC) retraction incident, which is the beginning of a series of massive retraction incidents that China has encountered in recent years. Our analysis echoes the pioneering research of STS scholar Mario Biagioli, who argues that our academic culture is shifting from “publish or perish” to “impact or perish.” Getting a good score on the metrics of academic evaluation becomes the goal of some scholars, leading to the emergency of postproduction misconduct. As revealed in the BMC retraction incident, commercial agencies that claimed to be able to facilitate academic publishing manipulated the peer-review process of academic papers by fabricating their peer reviews to help some clinicians meet the requirements of the title assessment system. This article advances Biagioli’s argument by expounding on the following two characteristics of the BMC retraction incident: first, peer reviews were fabricated by agencies instead of the authors themselves; second, the incident was induced systematically by the title assessment system, instead of particularly by individual factors of the authors. Through analyzing this case, we obtain important insight into postproduction misconduct, which is beneficial to more thoroughly understanding and then mitigating this new type of academic misconduct.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“paper mills have been most widely discussed in the context of academics and medical doctors in China (25, 48, 49, 50, 51, 52, 53, 54, 55).”
From Identification of human gene research articles with wrongly identified nucleotide sequences (2022) · cites this paper as [50]
In the citing paper
“Stringent publication requirements may represent a particular challenge for hospital doctors in China, where some hospital doctors have described limited time, training and/or opportunities to undertake research (25, 49, 50, 51, 52, 53, 54, 55).”
From Identification of human gene research articles with wrongly identified nucleotide sequences (2022) · cites this paper as [50]
In the citing paper
“Our results combined with previous reports (25, 49, 50, 51, 52, 53, 54, 55) indicate that publication pressure upon hospital doctors in China may be exerting measurable effects upon the human gene research literature.”
From Identification of human gene research articles with wrongly identified nucleotide sequences (2022) · cites this paper as [50]
In the citing paper
“Hospital-based clinicians may be particularly vulnerable to publication quotas (34,35,45,46), as their time, training and resources are directed towards patient care as opposed to research (47).”
From Protection of the human gene research literature from contract cheating organizations known as research paper mills (2022) · cites this paper as [35]
In the citing paper
“Some researchers describe publication quotas to achieve or retain career positions, where quotas are not matched by available research time, training, funding, infrastructure, personnel and/or language support (32,35,43).”
From Protection of the human gene research literature from contract cheating organizations known as research paper mills (2022) · cites this paper as [35]
8 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Pharmaceutical company funding and its consequences: A qualitative systematic review
Sismondo, S. (2008) · Contemporary Clinical Trials · doi:10.1016/j.cct.2007.08.001 · Cited by 304
Ghosts in the Machine: Publication Planning in the Medical Sciences
Sismondo, S. (2009) · Social Studies of Science · doi:10.1177/0306312708101047 · Cited by 297
Ghost Authorship in Industry-Initiated Randomised Trials
Gøtzsche, P. C., Hróbjartsson, A., Johansen, H. K., Haahr, M. T., Altman, D. G., & Chan, A.-W. (2007) · PLoS Medicine · doi:10.1371/journal.pmed.0040019 · Cited by 289
The Contract Research Organization and the Commercialization of Scientific Research
Mirowski, P., & Van Horn, R. (2005) · Social Studies of Science · doi:10.1177/0306312705052103 · Cited by 260
Sismondo, S. (2007) · PLoS Medicine · doi:10.1371/journal.pmed.0040286 · Cited by 259
Key opinion leaders: independent experts or drug representatives in disguise?
Moynihan, R. (2008) · BMJ · doi:10.1136/bmj.39575.675787.651 · Cited by 181
Watch out for cheats in citation game
Biagioli, M. (2016) · Nature · doi:10.1038/535201a · Cited by 140
Ghost Marketing: Pharmaceutical Companies and Ghostwritten Journal Articles
Moffatt, B., & Elliott, C. (2007) · Perspectives in biology and medicine · doi:10.1353/pbm.2007.0009 · Cited by 133
Haunted Manuscripts: Ghost Authorship in the Medical Literature
Ngai, S., Gold, J., Gill, S. S., & Rochon, P. A. (2005) · Accountability in Research · doi:10.1080/08989620590957175 · Cited by 82
Pharma Goes to the Laundry: Public Relations and the Business of Medical Education
Elliott, C. (2004) · The Hastings Center Report · doi:10.2307/3527586 · Cited by 78
Research works printed but not linked: 3
- Li Jingbo, 2011, Science-Technology and Publication, 8, 80
- Wen Jin, 2015, Chinese Journal of Evidence-Based Medicine, 2, 133
- Zhang Xinqing 张新庆, 2014, China Hospital CEO, 7, 47
Cited by
Byrne, J. A., Park, Y., Richardson, R. A. K., Pathmendra, P., Sun, M., & Stoeger, T. (2022) · Nucleic Acids Research · doi:10.1093/nar/gkac1139 · Cited by 46
“Hospitalbased clinicians may be particularly vulnerable to publication quotas (34,35,45,46), as their time, training and resources are directed towards patient care as opposed to research (47).”
InfluentialIdentification of human gene research articles with wrongly identified nucleotide sequences
Park, Y., West, R. A., Pathmendra, P., Favier, B., Stoeger, T., Capes-Davis, A., Cabanac, G., Labbé, C., & Byrne, J. A. (2022) · Life Science Alliance · doi:10.26508/lsa.202101203 · Cited by 37
“Although researchers in different countries may use paper mills to meet publication targets or quotas (47), paper mills have been most widely discussed in the context of academics and medical doctors in China (25, 48, 49, 50, 51, 52, 53, 54, 55).”
InfluentialA call for research to address the threat of paper mills
Byrne, J. A., Abalkina, A., Akinduro-Aje, O., Christopher, J., Eaton, S. E., Joshi, N., Scheffler, U., Wise, N. H., & Wright, J. (2024) · PLoS Biology · doi:10.1371/journal.pbio.3002931 · Cited by 39
Copiello, S. (2019) · Learned Publishing · doi:10.1002/leap.1235 · Cited by 32
Pathmendra, P., Park, Y., Enguita, F. J., & Byrne, J. A. (2024) · Naunyn-Schmiedeberg s Archives of Pharmacology · doi:10.1007/s00210-023-02846-2 · Cited by 14
Metadata
- Authors
- Han, J., & Li, Z.
- Affiliations
- Institute of Science, Technology, and Society, Tsinghua University, China
- Tsinghua University (CN)
- ORCID
- Li, Zhengfeng
- Venue
- East Asian Science, Technology and Society: An International Journal
- Publisher
- Informa UK Limited
- Published
- 2018-06-01
- Volume
- 12
- Issue
- 2
- Pages
- 165-179
- ISSN
- 1875-2152 (ISSN-L)
- 1875-2160
- OpenAlex
- W2793404165
- Cited by
- 13
- References
- 14
- Citations by year
- 2026: 1 · 2025: 3 · 2024: 3 · 2022: 3 · 2021: 1 · 2019: 2
- FWCI
- 1.49
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- East Asian Science Technology and Society An International Journal (publishedVersion)
- Project Muse (Johns Hopkins University) (submittedVersion)
- Topics
- Social Sciences › Education › Academic integrity and plagiarism
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Social Sciences › Library and Information Sciences › Publishing and Scholarly Communication
- Keywords
- academic misconduct, retraction, publish or perish, research metrics, academic assessment, peer review manipulation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: How Metrics-Based Academic Evaluation Could Systematically Induce Academic Misconduct: A Case Study. https://app.cochat.ai/papers/10.1215/18752160-4275144
- The paper
- Han, J., & Li, Z. (2018). How Metrics-Based Academic Evaluation Could Systematically Induce Academic Misconduct: A Case Study. East Asian Science, Technology and Society: An International Journal. https://doi.org/10.1215/18752160-4275144
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.