Fraud: retracted articles are still being cited
The DOI matches its Crossref record; 3 of the 3 references it cites were found in a registry or an index.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Moreover, even firmly discredited research is often cited by scholars unaware of the discreditation [53].”
From The natural selection of bad science (2016) · cites this paper as [53]
Citations
Cites
Phenomena of Retraction: Reasons for Retraction and Citations to the Publications
Budd, J. M., Sievert, M., & Schultz, T. R. (1998) · JAMA · doi:10.1001/jama.280.3.296 · Cited by 230
The Continued Use of Retracted, Invalid Scientific Literature
Pfeifer, M. P. (1990) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.1990.03440100140020 · Cited by 188
Kochan, C. (1992) · doi:10.1002/(sici)1097-4571(199208)43:7<488::aid-asi3>3.0.co;2-7
Cited by
The natural selection of bad science
Smaldino, P. E., & McElreath, R. (2016) · Royal Society Open Science · doi:10.1098/rsos.160384 · Cited by 860
“Moreover, even firmly discredited research is often cited by scholars unaware of the discreditation (Campanario, 2000).”
BackgroundThe science of science: From the perspective of complex systems
Zeng, A., Shen, Z., Zhou, J., Wu, J., Fan, Y., Wang, Y., & Stanley, H. E. (2017) · Physics Reports · doi:10.1016/j.physrep.2017.10.001 · Cited by 410
“Based on three early works [344–346], in a correspondence paper, Campanario argued that some retracted articles are still being positively cited and proposed some possible solutions for making researchers more aware of retracted papers [347].”
BackgroundPost retraction citations in context: a case study
Bar-Ilan, J., & Halevi, G. (2017) · Scientometrics · doi:10.1007/s11192-017-2242-0 · Cited by 191
“Some studies have shown that retracted articles that received a high number of citations pre-retraction are more likely to receive additional citations post-retraction (Campanario 2000; Redman et al. 2008).”
BackgroundThe incidence and role of negative citations in science
Catalini, C., Lacetera, N., & Oettl, A. (2015) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1502280112 · Cited by 189
Impact factors: uses and abuses
Neuberger, J., & Counsell, C. (2002) · European Journal of Gastroenterology & Hepatology · doi:10.1097/00042737-200203000-00001 · Cited by 122
The (lack of) Impact of Retraction on Citation Networks
Madlock-Brown, C. R., & Eichmann, D. (2015) · Science and Engineering Ethics · doi:10.1007/s11948-014-9532-1 · Cited by 89
Vaughan, L., Glänzel, W., Korch, C., & Capes-Davis, A. (2017) · Cancer Research · doi:10.1158/0008-5472.can-16-2258 · Cited by 63
“104 Erroneous ideas, incorrect results, and even fraud can be cited (25,26) and thus have an impact 105”
BackgroundLimits of bibliometrics indicators in biomedical scientific research evaluation.
Camps, D. (2008) · Colombia medica · doi:10.25100/cm.v39i1.552 · Cited by 60
Korpela, K. M. (2010) · Current Medical Research and Opinion · doi:10.1185/03007991003603804 · Cited by 58
Post retraction citations among manuscripts reporting a radiology-imaging diagnostic method
Bolboacă, S. D., Buhai, D.-V., Aluaș, M., & Bulboacă, A. E. (2019) · PLOS ONE · doi:10.1371/journal.pone.0217918 · Cited by 42
Continued citation of retracted radiation oncology literature—Do we have a problem?
Hamilton, D. G. (2019) · International Journal of Radiation Oncology*Biology*Physics · doi:10.1016/j.ijrobp.2018.11.014 · Cited by 42
Google Scholar duped and deduped – the aura of “robometrics”
Jacsó, P. (2011) · Online Information Review · doi:10.1108/14684521111113632 · Cited by 40
“Very importantly, such new fraudulent practices by scientists broaden the spectrum of negative consequences on science in general and implicitly on bibliometrics, scientometrics and informetrics as was indicated in earlier papers ( Campanario, 2000”
BackgroundCitation of Retracted Articles in Engineering: A Study of the Web of Science Database
Rubbo, P., Pilatti, L. A., & Picinin, C. T. (2019) · Ethics & Behavior · doi:10.1080/10508422.2018.1559064 · Cited by 30
“For Unger and Couzin (2006) and Campanario (2000), there are two main types of citations for a retracted article: the citations that the article received before the retraction and the citations that it received after publication of the retraction.”
BackgroundMethodThe landscape of urological retractions: the prevalence of reported research misconduct
Mena, J. D., Ndoye, M., Cohen, A. J., Kamal, P., & Breyer, B. N. (2019) · British Journal of Urology · doi:10.1111/bju.14706 · Cited by 42
Analytic model for academic research productivity having factors, interactions and implications
Kern, S. E. (2011) · Cancer Biology & Therapy · doi:10.4161/cbt.12.11.18368 · Cited by 27
“Data exist to show that incorrect research continues to be cited even after a publication is retracted for fraud.(16) Some patterns of citation are best explained as a type of fad rather than a form of analytically rigorous knowledge pursuit.”
BackgroundStagnation and herd mentality in the biomedical sciences
Brody, J. R., & Kern, S. E. (2004) · Cancer Biology & Therapy · doi:10.4161/cbt.3.9.1082 · Cited by 23
Woo, S., & Walsh, J. P. (2024) · Quantitative Science Studies · doi:10.1162/qss_a_00303 · Cited by 22
“…scientific findings (Bar-Ilan & Halevi, 2017; Bordignon, 2020; Budd, Sievert, Schultz, & Scoville, 1999; Hamilton, 2019; Kochan & Budd, 1992; Pfeifer & Snodgrass, 1990), which raises concerns about the integrity of science across scientific communities (Campanario, 2000; Unger & Couzin, 2006).”
Comparative citation analysis of duplicate or highly related publications
Knothe, G. (2006) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.20409 · Cited by 18
Post Retraction Citations in Context
Halevi, G., & Bar‐Ilan, J. (2016) · Cited by 17
Normand, M. P. (2017) · Perspectives on Behavior Science · doi:10.1007/s40614-017-0123-8 · Cited by 14
“The available evidence suggests, unfortunately, that retraction is not enough; the retracted papers tend to live on via existing citations in other papers and new citations (probably from second-hand sources) in new papers (Campanario, 2000; Teixeira da Silva & Bornemann-Cimenti, 2016).”
BackgroundAmiri, M., Yaghtin, M., & Sotudeh, H. (2023) · Scientometrics · doi:10.1007/s11192-023-04871-7 · Cited by 11
“For scientific outputs, this may be indicated by the continued citation of the retracted papers (Bar-Ilan & Halevi, 2017; Campanario, 2000; Unger & Couzin, 2006; Van Der Vet & Nijveen, 2016), which is generally confirmative (Bar-Ilan & Halevi, 2017; Da Silva & Dobránszki, 2017; Hamilton, 2019;…”
How to write a critical letter and respond to one
Goodman, N. W. (2001) · Hospital Medicine · doi:10.12968/hosp.2001.62.7.2396 · Cited by 10
Considerations for conducting research in agricultural biotechnology
Shelton, A. M. (2003) · Journal of Invertebrate Pathology · doi:10.1016/s0022-2011(03)00063-6 · Cited by 8
“Even articles that are retracted continue to be cited frequently in the scientific literature (Campanario, 2000), as well as in the public memory.”
BackgroundFahimifar, S., Ghorbi, A., & Ausloos, M. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2201.09090 · Cited by 2
“Interestingly, citing these papers can have a positive, negative, or neutral effect (Bar-Ilan & Halevi, 2017) before or after a paper's retraction (Campanario, 2000; Couzin & Unger 2006).”
BackgroundSalisbury, L., Roggio, R., Fajardo, D. J., & Smith, J. J. (2026) · Science & Technology Libraries · doi:10.1080/0194262x.2026.2656747 · Cited by 1
Morreim, H. (2019) · The American Journal of Bioethics · doi:10.1080/15265161.2019.1545507 · Cited by 1
“Moreover, even when scientific publications are retracted as being false or fraudulent, they still tend to be cited and relied on (Bernstein 2015; Companario 2000).”
BackgroundPresidential Address: Truth and error in scientific publishing
Jones, R. T. (2015) · Journal of the Southern African Institute of Mining and Metallurgy · doi:10.17159/2411-9717/2015/v115n9a1
Pseudodarwinizm selekcjonistycznych modeli rozwoju nauki
Wagner, M. J. (2022) · Filozofia Nauki · doi:10.14394/filnau.2022.0026
Scientific ghosts: Life after retraction – A case of Nature Index journals
Akbulut, M. (2026) · Journal of Information Science · doi:10.1177/01655515261424867
Metadata
- Authors
- Campanario, J. M.
- Affiliations
- Universidad de Alcalá (ES)
- Corresponding author
- Campanario, Juan Miguel
- Venue
- Nature
- Published
- 2000-11-16
- Volume
- 408
- Issue
- 6810
- Pages
- 288-288
- ISSN
- 0028-0836 (ISSN-L)
- 1476-4687
- OpenAlex
- W1659584642
- Cited by
- 28
- References
- 3
- Citations by year
- 2026: 2 · 2024: 1 · 2023: 1 · 2022: 1 · 2019: 3 · 2018: 2 · 2017: 4 · 2016: 2 · 2015: 2 · 2014: 1
- FWCI
- 3.94
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springernature.com/gp/researchers/text-and-data-mining (tdm)
- www.springernature.com/gp/researchers/text-and-data-mining (vor)
- Locations
- Nature (publishedVersion)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- DigitalGeorgetown (Georgetown University Library) (submittedVersion)
- Topics
- Social Sciences › Education › Academic integrity and plagiarism
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Keywords
- retracted article, scientific fraud, research integrity, citation analysis, bibliometric analysis
- MeSH terms
- Retraction of Publication as Topic, Bibliometrics, Scientific Misconduct, Databases, Bibliographic, MEDLINE
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.