CoChat

Propagation of errors in citation networks: a study involving the entire citation network of a widely cited paper published in, and later retracted from, the journal Nature

Open access
van der Vet, Paul E., Nijveen, Harm · 2016 · Research Integrity and Peer Review

The DOI matches its Crossref record; the references it cites are not checked yet.

Abstract

Background: In about one in 10,000 cases, a published article is retracted. This very often means that the results it reports are flawed. Several authors have voiced concerns about the presence of retracted research in the memory of science. In particular, a retracted result is propagated by citing it. In the published literature, many instances are given of retracted articles that are cited both before and after their retraction. Even worse is the possibility that these articles in turn are cited in such a way that the retracted result is propagated further. Methods: We have conducted a case study to find out how a retracted article is cited and whether retracted results are propagated through indirect citations. We have constructed the entire citation network for this case. Results: We show that directly citing articles is an important source of propagation of retracted research results. In contrast, in our case study, indirect citations do not contribute to the propagation of the retracted result. Conclusions: While admitting the limitations of a study involving a single case, we think there are reasons for the non-contribution of indirect citations that hold beyond our case study.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1186/s41073-016-0008-5

Cites

Statistics

Figures

Fig. 1 The 2014 citation network for the Narayan paper. Node names have been replaced by dots. Every nodestands for a paper. Every arrowstands for a citation relation. The arrowpoints from the citing paper to the paper that is being cited. The Narayan paper is represented by the blue circle with the N inside
Fig. 1 The 2014 citation network for the Narayan paper. Node names have been replaced by dots. Every nodestands for a paper. Every arrowstands for a citation relation. The arrowpoints from the citing paper to the paper that is being cited. The Narayan paper is represented by the blue circle with the N insideCC BY · PubMed Central
Fig. 2 The 2015 citation network of the Narayan paper. The network is shown here as a combination of the 2014 network (blue) and the 2015 additions (red). As is Fig. 1, every nodestands for a paper and every arrowfor a citation relation. The Narayan paper is represented by the blue circle with the N inside
Fig. 2 The 2015 citation network of the Narayan paper. The network is shown here as a combination of the 2014 network (blue) and the 2015 additions (red). As is Fig. 1, every nodestands for a paper and every arrowfor a citation relation. The Narayan paper is represented by the blue circle with the N insideCC BY · PubMed Central
Fig. 3 Screenshot of a Google Scholar search. The search was performed in March 2015 and used the keywords at the top. The Narayan paper is first on the list. Clearly, it is not marked as being retracted. Also the retraction, even though it has exactly the same title preceded by the word “Retraction”, is not among the results shown. It does turn up on the second page, however (not shown here)
Fig. 3 Screenshot of a Google Scholar search. The search was performed in March 2015 and used the keywords at the top. The Narayan paper is first on the list. Clearly, it is not marked as being retracted. Also the retraction, even though it has exactly the same title preceded by the word “Retraction”, is not among the results shown. It does turn up on the second page, however (not shown here)CC BY · PubMed Central

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

The citation lists are queued

They are fetched later and appear here then.

References 56 · Cited by 50

Research works printed but not linked: 3

  1. Budd JM, Coble ZC, Anderson KM. Retracted publications in biomedicine: cause for concern In: Mueller DM, editor. Declaration of Interdependence: the Proceedings of the ACRL 2011 Conference, March 30–April 2, 2011. Philadelphia, Pa: Association of College and Research Libraries: 2011. p. 390–5.
  2. De Mot R. The need to correct suspect data as speedily as possible. Posted at Science online, 20 June 2006. 2006. http://science.sciencemag.org/content/312/5770/38.e-letters.
  3. National Institutes of Health. SIRT2 inhibitors as novel therapeutics for myocardial infarction and ischemic stroke and to prevent necrosis. Fed Regist. 2013; 78(18):5818–9.

Metadata

Authors
van der Vet, P. E., & Nijveen, H.
Affiliations
Wageningen University & Research (NL)
Corresponding author
Nijveen, Harm
Venue
Research Integrity and Peer Review
Published
2016-05-03
Volume
1
Issue
1
Pages
3-3
ISSN
2058-8615 (ISSN-L)
OpenAlex
W2343758449
Cited by
50
References
56
Citations by year
2026: 5 · 2025: 6 · 2024: 8 · 2023: 5 · 2022: 8 · 2021: 7 · 2020: 4 · 2019: 1 · 2018: 2 · 2017: 3 · 2016: 1
FWCI
2.18
Type
journal article
Language
en
Open access
Licence
Locations
  • Research Integrity and Peer Review (publishedVersion, cc-by)
  • Europe PMC (PubMed Central) (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • Socio-Environmental Systems Modeling (acceptedVersion, cc-by)
  • University of Twente Research Information (submittedVersion, cc-by-nc-nd)
  • University of Twente Research Information (submittedVersion, other-oa)
  • Data Archiving and Networked Services (DANS) (submittedVersion, cc-by)
Funders
  • Radboud Universiteit
  • University of Twente
  • Universiteit Maastricht
  • National Institutes of Health
  • Wageningen University and Research
Topics
  • Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
  • Social Sciences › Education › Academic integrity and plagiarism
  • Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
Keywords
retracted article, citation networks, error propagation, indirect citations, scientific memory, research integrity, nature

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Propagation of errors in citation networks: a study involving the entire citation network of a widely cited paper published in, and later retracted from, the journal Nature. https://app.cochat.ai/papers/10.1186/s41073-016-0008-5
The paper
van der Vet, P. E., & Nijveen, H. (2016). Propagation of errors in citation networks: a study involving the entire citation network of a widely cited paper published in, and later retracted from, the journal Nature. Research Integrity and Peer Review. https://doi.org/10.1186/s41073-016-0008-5

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.