The Retraction Penalty: Evidence from the Web of Science
Open accessThe DOI matches its Crossref record; 15 of the 15 references it cites were found in a registry or an index.
Abstract
Scientific articles are retracted at increasing rates, with the highest rates among top journals. Here we show that a single retraction triggers citation losses through an author's prior body of work. Compared to closely-matched control papers, citations fall by an average of 6.9% per year for each prior publication. These chain reactions are sustained on authors' papers (a) published up to a decade earlier and (b) connected within the authors' own citation network by up to 4 degrees of separation from the retracted publication. Importantly, however, citation losses among prior work disappear when authors self-report the error. Our analyses and results span the range of scientific disciplines.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures




Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Other work has examined the dissemination of retracted papers in scientific communities, focusing mainly on the associated citation penalty (5, 14, 30–36).”
From Dynamics of cross-platform attention to retracted papers (2022) · cites this paper as [30]
In the citing paper
“research indicates that retractions can lead to a substantial decrease in citations to researchers’ prior work [77].”
From The natural selection of bad science (2016) · cites this paper as [77]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Fanelli, D. (2009) · PLoS ONE · doi:10.1371/journal.pone.0005738 · Cited by 1,911
Misconduct accounts for the majority of retracted scientific publications
Fang, F. C., Steen, R. G., & Casadevall, A. (2012) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1212247109 · Cited by 1,232
Distribution-free estimation of some nonlinear panel data models
Wooldridge, J. M. (1999) · Journal of Econometrics · doi:10.1016/s0304-4076(98)00033-5 · Cited by 858
Phenomena of Retraction: Reasons for Retraction and Citations to the Publications
Budd, J. M., Sievert, M., & Schultz, T. R. (1998) · JAMA · doi:10.1001/jama.280.3.296 · Cited by 230
The Continued Use of Retracted, Invalid Scientific Literature
Pfeifer, M. P. (1990) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.1990.03440100140020 · Cited by 188
Governing knowledge in the scientific community: Exploring the role of retractions in biomedicine
Furman, J. L., Jensen, K., & Murray, F. (2012) · Research Policy · doi:10.1016/j.respol.2011.11.001 · Cited by 151
Effects of article retraction on citation and practice in medicine.
(1999) · Europe PMC (PubMed Central) · Cited by 101
Plastic fantastic: how the biggest fraud in physics shook the scientific world
(2009) · Choice Reviews Online · doi:10.5860/choice.47-2065 · Cited by 91
Analysis of Citations to Biomedical Articles Affected by Scientific Misconduct
Neale, A. V., Dailey, R. K., & Abrams, J. (2010) · Science and Engineering Ethics · doi:10.1007/s11948-009-9151-4 · Cited by 66
Korpela, K. M. (2010) · Current Medical Research and Opinion · doi:10.1185/03007991003603804 · Cited by 58
Cited by
The natural selection of bad science
Smaldino, P. E., & McElreath, R. (2016) · Royal Society Open Science · doi:10.1098/rsos.160384 · Cited by 860
“This last assumption may appear unrealistically harsh, but research indicates that retractions can lead to a substantial decrease in citations to researchers’ prior work [77].”
ResultThe science of science: From the perspective of complex systems
Zeng, A., Shen, Z., Zhou, J., Wu, J., Fan, Y., Wang, Y., & Stanley, H. E. (2017) · Physics Reports · doi:10.1016/j.physrep.2017.10.001 · Cited by 410
“focused on the penalty caused by retracting papers [349].”
BackgroundReputation and impact in academic careers
Petersen, A. M., Fortunato, S., Pan, R. K., Kaski, K., Penner, O., Rungi, A., Riccaboni, M., Stanley, H. E., & Pammolli, F. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1323111111 · Cited by 304
“Indeed, recent evidence indicates that the retraction of a publication can have a negative impact on the potential growth of Ci (30).”
BackgroundChallenges for assessing replicability in preclinical cancer biology
Errington, T. M., Denis, A., Perfito, N., Iorns, E., & Nosek, B. A. (2021) · eLife · doi:10.7554/elife.67995 · Cited by 267
The incidence and role of negative citations in science
Catalini, C., Lacetera, N., & Oettl, A. (2015) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1502280112 · Cited by 189
Metadata
- Authors
- Lu, S. F., Jin, G. Z., Uzzi, B., & Jones, B.
- Affiliations
- University of Rochester (US)
- National Bureau of Economic Research (US)
- Northwestern University (US)
- Corresponding author
- Jones, Benjamin
- Venue
- Scientific Reports
- Published
- 2013-11-06
- Volume
- 3
- Issue
- 1
- Pages
- 3146-3146
- ISSN
- 2045-2322 (ISSN-L)
- PMC
- PMC3818648
- OpenAlex
- W2153924055
- Cited by
- 191
- References
- 15
- Citations by year
- 2026: 7 · 2025: 18 · 2024: 16 · 2023: 18 · 2022: 21 · 2021: 21 · 2020: 17 · 2019: 9 · 2018: 19 · 2017: 14 · 2016: 11 · 2015: 10 · 2014: 7 · 2013: 2
- FWCI
- 11.02
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/3.0/ (tdm)
- creativecommons.org/licenses/by/3.0/ (vor)
- Locations
- Scientific Reports (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Funders
- Northwestern University
- National Institutes of Health (UL1TR000150)
- Defense Advanced Research Projects Agency (BAA-11-64, W911NF-09-2-0053)
- National Center for Advancing Translational Sciences
- Army Research Laboratory (W911NF, W911NF-09-2-0053)
- Topics
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Social Sciences › Education › Academic integrity and plagiarism
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Keywords
- retracted article, citation networks, research misconduct, scholarly publishing, Web of Science
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.