Propagation of errors in citation networks: a study involving the entire citation network of a widely cited paper published in, and later retracted from, the journal Nature
Open accessThe DOI matches its Crossref record; the references it cites are not checked yet.
Abstract
Background: In about one in 10,000 cases, a published article is retracted. This very often means that the results it reports are flawed. Several authors have voiced concerns about the presence of retracted research in the memory of science. In particular, a retracted result is propagated by citing it. In the published literature, many instances are given of retracted articles that are cited both before and after their retraction. Even worse is the possibility that these articles in turn are cited in such a way that the retracted result is propagated further. Methods: We have conducted a case study to find out how a retracted article is cited and whether retracted results are propagated through indirect citations. We have constructed the entire citation network for this case. Results: We show that directly citing articles is an important source of propagation of retracted research results. In contrast, in our case study, indirect citations do not contribute to the propagation of the retracted result. Conclusions: While admitting the limitations of a study involving a single case, we think there are reasons for the non-contribution of indirect citations that hold beyond our case study.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures



Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Low proportions of postretraction citations acknowledging the retraction were also reported in some case studies (Schneider et al., 2020; van der Vet & Nijveen, 2016) and older studies (Budd et al., 1999; Pfeifer & Snodgrass, 1990).”
From Continued use of retracted papers: Temporal trends in citations and (lack of) awareness of retractions shown in citation contexts in biomedicine (2021) · cites this paper as van der Vet & Nijveen, 2016
The cited source says what the claim attributes to it.
In the citing paper
“Many databases and search engines, such as Web of Science, Google Scholar and Scopus provide nearly no warning of the retraction in their search results (Teixeira da Silva and Bornemann-Cimenti 2017; van der Vet and Nijveen 2016).”
From Continued post-retraction citation of a fraudulent clinical trial report, 11 years after it was retracted for falsifying data (2020) · cites this paper as van der Vet and Nijveen 2016
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
The citation lists are queued
They are fetched later and appear here then.
References 56 · Cited by 50
Research works printed but not linked: 3
- Budd JM, Coble ZC, Anderson KM. Retracted publications in biomedicine: cause for concern In: Mueller DM, editor. Declaration of Interdependence: the Proceedings of the ACRL 2011 Conference, March 30–April 2, 2011. Philadelphia, Pa: Association of College and Research Libraries: 2011. p. 390–5.
- De Mot R. The need to correct suspect data as speedily as possible. Posted at Science online, 20 June 2006. 2006. http://science.sciencemag.org/content/312/5770/38.e-letters.
- National Institutes of Health. SIRT2 inhibitors as novel therapeutics for myocardial infarction and ischemic stroke and to prevent necrosis. Fed Regist. 2013; 78(18):5818–9.
Metadata
- Authors
- van der Vet, P. E., & Nijveen, H.
- Affiliations
- Wageningen University & Research (NL)
- Corresponding author
- Nijveen, Harm
- ORCID
- Nijveen, Harm
- Venue
- Research Integrity and Peer Review
- Published
- 2016-05-03
- Volume
- 1
- Issue
- 1
- Pages
- 3-3
- ISSN
- 2058-8615 (ISSN-L)
- PMC
- PMC5793988
- OpenAlex
- W2343758449
- Cited by
- 50
- References
- 56
- Citations by year
- 2026: 5 · 2025: 6 · 2024: 8 · 2023: 5 · 2022: 8 · 2021: 7 · 2020: 4 · 2019: 1 · 2018: 2 · 2017: 3 · 2016: 1
- FWCI
- 2.18
- Type
- journal article
- Language
- en
- Update notices
- correction (2024-12-20)
- Open access
- gold
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/4.0 (tdm)
- creativecommons.org/licenses/by/4.0 (vor)
- Locations
- Research Integrity and Peer Review (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Socio-Environmental Systems Modeling (acceptedVersion, cc-by)
- University of Twente Research Information (submittedVersion, cc-by-nc-nd)
- University of Twente Research Information (submittedVersion, other-oa)
- Data Archiving and Networked Services (DANS) (submittedVersion, cc-by)
- Funders
- Radboud Universiteit
- University of Twente
- Universiteit Maastricht
- National Institutes of Health
- Wageningen University and Research
- Topics
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Social Sciences › Education › Academic integrity and plagiarism
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Keywords
- retracted article, citation networks, error propagation, indirect citations, scientific memory, research integrity, nature
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Propagation of errors in citation networks: a study involving the entire citation network of a widely cited paper published in, and later retracted from, the journal Nature. https://app.cochat.ai/papers/10.1186/s41073-016-0008-5
- The paper
- van der Vet, P. E., & Nijveen, H. (2016). Propagation of errors in citation networks: a study involving the entire citation network of a widely cited paper published in, and later retracted from, the journal Nature. Research Integrity and Peer Review. https://doi.org/10.1186/s41073-016-0008-5
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.