The DOI matches its Crossref record; 112 of the 117 references it cites were found in a registry or an index, and 2 are not checked yet; 13 of the 64 sources its claims cite were checked for support.
Continued post-retraction citation of a fraudulent clinical trial report, 11 years after it was retracted for falsifying data
Open accessAbstract
This paper presents a case study of long-term post-retraction citation to falsified clinical trial data (Matsuyama et al. in Chest 128(6):3817–3827, 2005. 10.1378/chest.128.6.3817 ), demonstrating problems with how the current digital library environment communicates retraction status. Eleven years after its retraction, the paper continues to be cited positively and uncritically to support a medical nutrition intervention, without mention of its 2008 retraction for falsifying data. To date no high quality clinical trials reporting on the efficacy of omega-3 fatty acids on reducing inflammatory markers have been published. Our paper uses network analysis, citation context analysis, and retraction status visibility analysis to illustrate the potential for extended propagation of misinformation over a citation network, updating and extending a case study of the first 6 years of post-retraction citation (Fulton et al. in Publications 3(1):7–26, 2015. 10.3390/publications3010017 ). The current study covers 148 direct citations from 2006 through 2019 and their 2542 second-generation citations and assesses retraction status visibility of the case study paper and its retraction notice on 12 digital platforms as of 2020. The retraction is not mentioned in 96% (107/112) of direct post-retraction citations for which we were able to conduct citation context analysis. Over 41% (44/107) of direct post-retraction citations that do not mention the retraction describe the case study paper in detail, giving a risk of diffusing misinformation from the case paper. We analyze 152 second-generation citations to the most recent 35 direct citations (2010–2019) that do not mention the retraction but do mention methods or results of the case paper, finding 23 possible diffusions of misinformation from these non-direct citations to the case paper. Link resolving errors from databases show a significant challenge in a reader reaching the retraction notice via a database search. Only 1/8 databases (and 1/9 database records) consistently resolved the retraction notice to its full-text correctly in our tests. Although limited to evaluation of a single case ( N = 1), this work demonstrates how retracted research can continue to spread and how the current information environment contributes to this problem.
Verified 2026-10-05 · 2 references not checked yet
Overview
CoChat Summary
TL;DR
This case study shows that a fraudulent 2005 COPD omega-3 randomized trial continued to be cited positively and uncritically 11 years after its 2008 retraction, while retraction status remained poorly communicated across digital platforms. It combines network analysis, citation context analysis, and retraction-visibility assessment to trace direct and second-generation diffusion of the retracted findings.
Key findings
- Of 148 direct citations (32 pre-retraction, 116 post-retraction), the retraction was not mentioned in 96% (107/112) of post-retraction citations examined; only 5/144 (3.5%) were negative and mentioned the retraction.
- Over 41% (44/107) of post-retraction citations that did not mention the retraction described the paper’s methods or results, creating risk of misinformation diffusion; the second-generation network contained 2542 citations, and among 152 second-generation citations to 35 recent direct citations, 23 were marked as possible misinformation, mostly via Giudetti and Cagnazzo (2012) (18/23).
- Visibility was poor: the retraction notice appeared before the article in only 4/12 searches, was absent from default Google Scholar and Web of Science-Core searches, no watermarks were used, retraction status was not indicated on any PDF or HTML full-text, and only 1/8 databases (and 1/9 database records) consistently resolved the retraction notice to its full text correctly.
Methods
- Case study of Matsuyama et al. (2005), retracted in 2008 for falsified data. The authors searched Web of Science and Google Scholar for all citing publications before December 31, 2019, in any language, identifying 148 direct citations and 2542 second-generation citations.
- Citation context analysis of 144 direct citations (112 post-retraction), annotating positive/negative citation, whether methods/results or a general concept were cited, and whether the retraction was mentioned; second-generation context analysis covered 152 citations to the most recent 35 direct citations (2010–2019) that did not mention the retraction but did mention methods or results.
- Visibility assessment of the Matsuyama paper and its retraction notice across 12 digital platforms as of 2020, checking search results, full-text displays, database records, and link resolution.
Limitations
- Stated: the work is limited to evaluation of a single case (N = 1); the authors call for large-scale examination of the correlation between retraction-status visibility and post-retraction citation.
- Evident: citation context analysis relied on manual extraction and Google Translate for non-English contexts; the second-generation context analysis was restricted to 35 recent direct citations and 152 accessible second-generation citations; the visibility assessment is a 2020 snapshot and depends on Web of Science and Google Scholar coverage.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
12 Valid · 3 Not valid · 30 Not checked · 79 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Within the digital publishing era, the longest documented instance of positive post-retraction citation we are aware of is 9years: Bar-Ilan and Halevi documented an article both published and retracted in 2007 receiving only positive post-retraction citations in 2015 and 2016 (Bar-Ilan and Halevi 2017)”
What the sources say
- Partly supportedcites Bar-Ilan and Halevi 2017 sourceExperimental — accuracy not yet measured
Findings, Case 6 (page unavailable) documents an article published and retracted in 2007 that received citations in 2015 and 2016, nine years after retraction. It says all 11 recent citations the authors could access were positive, but it does not establish that the inaccessible citations were positive. The citing authors’ description of this as the longest instance they know of is their own framing, not a finding attributed to the source. (LLM, conf=0.88)
hedgedSingle case- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“Many databases and search engines, such as Web of Science, Google Scholar and Scopus provide nearly no warning of the retraction in their search results (Teixeira da Silva and Bornemann-Cimenti 2017; van der Vet and Nijveen 2016).”
What the sources say
- Not checked — no full text of the sourcecites Teixeira da Silva and Bornemann-Cimenti 2017 source
- Supportedcites van der Vet and Nijveen 2016 source
The Discussion states that, in the authors’ experience, Google Scholar, Scopus and Web of Science do not add retraction warnings to papers in search-result lists. It also documents an unmarked Google Scholar result (Fig. 3). (LLM, conf=0.94)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Other studies (Azoulay etal. 2015; Furman etal. 2012; Mott et al. 2019) have found decreases in citation after retraction.”
What the sources say
- Not matchedcites Azoulay etal. 2015
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Not matchedcites Furman etal. 2012
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Supportedcites Mott et al. 2019 source
The Results report a 22.9% reduction in citations in the month after retraction, followed by a further decline over 24 months relative to the expected trend. The Discussion likewise states that citations decreased following retraction of the studied randomized controlled trial reports. (LLM, conf=0.94)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Not matched
Every source the paper cites for this claim was checked and supports it.
In the paper
“The high-profile cases received fewer citations: Fujii and Boldt's RCTs (mean 5.2) as compared to non-high profile retracted RCTs (mean 21.7).”
What the sources say
- Supportedcites Mott et al. 2019 source
The Sensitivity analysis reports that Fujii and Boldt’s 154 articles received a mean of 5.2 citations per article over the four-year study period, compared with 21.7 for articles by other groups. The paper also describes the Fujii and Boldt retractions as having received considerable media attention. Page numbers are not provided in our copy. (LLM, conf=0.95)
plainstates an associationn = 2- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The retraction is not mentioned in 96% (107/112) of direct post-retraction citations for which we were able to conduct citation context analysis.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
55 more claims
Create a free account to see all 124 claims and every source verdict.
- Probably not a substantial claim. 34
- It may state two separate claims as one. 38
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“over 95% of citations made to retracted articles are in error ( 47 )”
From scite: a smart citation index that displays the context of citations and classifies their intent using deep learning (2021) · cites this paper as [47]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“However, postretraction citations can persist for more than 10 years (Kim, Yi et al., 2019; Schneider et al., 2020)”
From Continued use of retracted papers: Temporal trends in citations and (lack of) awareness of retractions shown in citation contexts in biomedicine (2021) · cites this paper as Schneider et al., 2020
The cited source says what the claim attributes to it.
In the citing paper
“Previous studies (Bar-Ilan & Halevi, 2018; Schneider et al., 2020) reported that the retraction notice did not always appear when a retracted paper was searched.”
From Continued use of retracted papers: Temporal trends in citations and (lack of) awareness of retractions shown in citation contexts in biomedicine (2021) · cites this paper as Schneider et al., 2020
The cited source says what the claim attributes to it.
In the citing paper
“Low proportions of postretraction citations acknowledging the retraction were also reported in some case studies (Schneider et al., 2020; van der Vet & Nijveen, 2016) and older studies (Budd et al., 1999; Pfeifer & Snodgrass, 1990).”
From Continued use of retracted papers: Temporal trends in citations and (lack of) awareness of retractions shown in citation contexts in biomedicine (2021) · cites this paper as Schneider et al., 2020
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Citation context analysis applied toselected second-generation citations topublications discussing methods andresults oftheMatsuyama paper
“There were 44 direct post-retraction (2009-2019) citations citing methods and results of the Matsuyama paper and their 1481 citations.”
§ Diffusion ofmisinformation frompublications discussing methods andresults oftheMatsuyama paper
“Figure 6 covers all 60 articles describe the methods and results of the Matsuyama paper that do not (post-retraction) or could not (preretraction) cite the Matsuyama paper's retraction notice; there are 1481second-generation citations to these 60 direct citations.”
Cited works that were retracted
Works this paper cites that were later retracted, from the retraction notices publishers deposit. Major when the notice came out before this paper was published.
Rated major: it would touch a result — a value a result rests on, reported and recomputed p-values on opposite sides of the significance level, two passages that conflict with no sign which is right, or a cited work retracted before this paper was published.
In the paper
“”, the HTML links to the retraction notice (Matsuyama et al. 2008), and the first page of the PDF includes a copy of the retraction notice itself.”
Cited work 10.2169/internalmedicine.46.0072 · retracted 2008-01-01 · notice 10.2169/internalmedicine.47.r001 · this paper published 2020-10-14
A note, not an issue: for example, a cited work that was retracted only after this paper was published, which its authors could not have known.
In the paper
“Matsuyama, W., Mitsuyama, H., Watanabe, M., Oonakahara, K., Higashimoto, I., Osame, M., et al. (2005). [RETRACTED] Effects of omega-3 polyunsaturated fatty acids on inflammatory markers in COPD. Chest, 128(6), 3817–3827. https://doi.org/10.1378/chest.128.6.3817.”
Cited work 10.1378/chest.128.6.3817 · retraction date not known · this paper published 2020-10-14
A note, not an issue: for example, a cited work that was retracted only after this paper was published, which its authors could not have known.
In the paper
“Matsuyama, W., Mitsuyama, H., Koreeda, Y., Higashimoto, I., Osame, M., & Arimura, K. (2008). RETRACTION: Use of tiotropium bromide for pre-operative treatment in chronic obstructive pulmonary disease patients: comparison with oxitropium bromide. Internal Medicine, 47(14), 1371. https://doi.org/10.2169/internalmedicine.47.R001.”
Cited work 10.2169/internalmedicine.47.r001 · retraction date not known · this paper published 2020-10-14
A note, not an issue: for example, a cited work that was retracted only after this paper was published, which its authors could not have known.
In the paper
“CHEST. (2008). Retraction [of effects of omega-3 polyunsaturated fatty acids on inflammatory markers in COPD]. Chest, 134(4), 893. https://doi.org/10.1016/S0012-3692(08)60339-6.”
Cited work 10.1016/s0012-3692(08)60339-6 · retraction date not known · this paper published 2020-10-14
Citations
Cites
4 retracted
RETRACTED: Effects of Omega-3 Polyunsaturated Fatty Acids on Inflammatory Markers in COPD
Matsuyama, W., Mitsuyama, H., Watanabe, M., Oonakahara, K.-I., Higashimoto, I., Osame, M., & Arimura, K. (2005) · Chest · doi:10.1378/chest.128.6.3817 · Cited by 108
RetractedMatsuyama, W., Mitsuyama, H., Koreeda, Y., Higashimoto, I., Osame, M., & Arimura, K. (2007) · Internal Medicine · doi:10.2169/internalmedicine.46.0072 · Cited by 8 · cited 1×
“”, the HTML links to the retraction notice (Matsuyama et al. 2008), and the first page of the PDF includes a copy of the retraction notice itself.”
BackgroundRetractedMatsuyama, W., Mitsuyama, H., Koreeda, Y., et al. (2008) · Internal Medicine · doi:10.2169/internalmedicine.47.r001 · Cited by 2
Retracted(2008) · Chest · doi:10.1016/s0012-3692(08)60339-6 · Cited by 2
RetractedHome visits: a strategy to improve newborn survival - Authors' reply
(2008) · Americanae (AECID Library) · doi:10.1016/s0140 · Cited by 22,524
The International Committee of Medical Journal Editors
van der Weyden, M. (2006) · Proceedings of the Workshop on Publishing for Biomedical Journal Editors and Reviewers · doi:10.2349/biij.2.4.e54-13 · Cited by 1,998
An overview of clinical research: the lay of the land
Grimes, D. A., & Schulz, K. F. (2002) · The Lancet · doi:10.1016/s0140-6736(02)07283-5 · Cited by 734
Polyunsaturated fatty acids and inflammation
Calder, P. C. (2006) · Prostaglandins, Leukotrienes and Essential Fatty Acids · doi:10.1016/j.plefa.2006.05.012 · Cited by 638
Omega-3 fatty acids for the primary and secondary prevention of cardiovascular disease
Abdelhamid, A. S., Brown, T. J., Brainard, J. S., Biswas, P., Thorpe, G. C., Moore, H. J., Deane, K. H., AlAbdulghafoor, F. K., Summerbell, C. D., Worthington, H. V., et al. (2018) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd003177.pub3 · Cited by 630 · cited 1×
“Researchers specifically citing the results of the Matsuyama paper seem unaware of the fact that the paper has been retracted: only 5 direct citations to the Matsuyama paper mentioned the retraction (Abdelhamid et al. 2018; Fulton et al. 2013, 2015a, b; Samp et al. 2012), and those same 5 alone described it as poor re…”
BackgroundHow citation distortions create unfounded authority: analysis of a citation network
Greenberg, S. A. (2009) · BMJ · doi:10.1136/bmj.b2680 · Cited by 499 · cited 1×
“Greenberg coined the term ‘citation bias’ to refer to selective citation of the literature, and demonstrated how unsubstantiated claims about Alzheimer’s disease were bolstered in papers and in funded NIH grants by citation bias (Greenberg 2009).”
Background
Research works printed but not linked: 6
- International Committee of Medical Journal Editors. (n. d.). Journals stating that they follow the ICMJE Recommendations. International Committee of Medical Journal Editors. Retrieved January 2, 2020, from http://www.icmje.org/journals-following-the-icmje-recommendations/#C.
- Jha, R. (2016). Preparation of Tishyauri and optimization of flaxseed and black gram paste ratio. In Food Research Bulletin (pp. 138–144). Government of Nepal, Ministry of Agricultural Development, Department of Food Technology and Quality Control.
- Lin, Y.-C., Lin, Y.-J., Wu, T.-C., Cheng, C.-C., & Yeh, S.-L. (2016). Supplementation of fish oil improves functional capacity and quality of life in patients with chronic obstructive pulmonary disease. Current Topics in Nutraceutical Research, 14(3), 191–198. https://www.nchpjournals.com/Manuscript?id=550.
- Lozano, C. C., Valdez, J. G. C., & Medina, J. R. S. (2011). Terapia nutricional en la enfermedad pulmonar obstructiva crónica [Nutritional therapy in chronic obstructive pulmonary disease]. In R. A. Prado, H. A. Márquez, & D. A. Moya (Eds.), Nutrición enteral y parenteral [Enteral and Parenteral Nutrition]. New York: McGraw-Hill Interamericana.
- Pison, C., Pichard, C., Moniard, C., Roth, H., & Cano, N. (2016). Nutrition et maladie respiratoire chronique [Nutrition and chronic respiratory disease]. In D. Quilliot, R. Thibault, P. Bachmann, E. Guex, G. Zéanandin, & P. Coti-Bertrand (Eds.), Traité de Nutrition Clinique à Tous les âges de la Vie [Treatise on Clinical Nutrition at All Ages of Life] (2016th ed., pp. 1165–1182). Le Kremlin-Bicetre: Editions K’Noë.
- Wager, E., Barbour, V., Kleinert, S., & Yentis, S. (2019). COPE Guidelines for retracting articles [2019]. Committee on Publication Ethics. https://doi.org/10.24318/cope.2019.1.4. · DOI · Paper page
Cited by
The Peer Review Process: Past, Present, and Future
Drozdz, J. A., & Ladomery, M. R. (2024) · British Journal of Biomedical Science · doi:10.3389/bjbs.2024.12054 · Cited by 120
“96% of these citations failed to mention the retraction [62], which suggests that retraction notices do not prevent the dissemination of erroneous data.”
BackgroundHsiao, T.-K., & Schneider, J. (2021) · Quantitative Science Studies · doi:10.1162/qss_a_00155 · Cited by 98
“Five out of nine previous studies published in the last five years (2016 – 2021) reported fewer than 7% of citations acknowledging retractions (Bolboaca (cid:1) et al., 2019; Budd et al., 2016; Hamilton, 2019; Schneider et al., 2020; van der Vet & Nijveen, 2016).”
BackgroundResultInfluentialSelf-citationMissing Verification of Source Data in Hypertension Research: The HYGIA PROJECT in Perspective
Brunström, M., Kjeldsen, S. E., Kreutz, R. H., Gjesdal, K., Narkiewicz, K., Burnier, M., Oparil, S., & Mancia, G. (2021) · Hypertension · doi:10.1161/hypertensionaha.121.17356 · Cited by 58
Frampton, G. K., Woods, L., & Scott, D. A. (2021) · PLoS ONE · doi:10.1371/journal.pone.0258935 · Cited by 58
“Continued citation of retracted articles was a well-known problem prior to the Covid-19 pandemic [3, 5, 7–9, 14, 18, 20, 23, 24, 26, 27], with some articles being cited for more than a decade after their retraction [20, 24, 27].”
BackgroundIdentification of human gene research articles with wrongly identified nucleotide sequences
Park, Y., West, R. A., Pathmendra, P., Favier, B., Stoeger, T., Capes-Davis, A., Cabanac, G., Labbé, C., & Byrne, J. A. (2022) · Life Science Alliance · doi:10.26508/lsa.202101203 · Cited by 37
“We included retracted articles, to align with previous descriptions of SGK articles (11, 12, 13), and in recognition of the possibility of retracted articles continuing to be cited (85).”
Metadata
- Authors
- Schneider, J., Ye, D., Hill, A. M., & Whitehorn, A. S.
- Affiliations
- University of Illinois Urbana-Champaign (US)
- University of South Australia (AU)
- Corresponding author
- Schneider, Jodi
- Venue
- Scientometrics
- Published
- 2020-10-14
- Volume
- 125
- Issue
- 3
- Pages
- 2877-2913
- ISSN
- 0138-9130 (ISSN-L)
- 1588-2861
- OpenAlex
- W3092867125
- Semantic Scholar
- 3c7aa12da601d9cf261237519d5fdb43f82baf43
- Cited by
- 88
- References
- 115
- Citations by year
- 2026: 9 · 2025: 14 · 2024: 17 · 2023: 16 · 2022: 13 · 2021: 18 · 2020: 1
- FWCI
- 16.36
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/4.0 (tdm)
- creativecommons.org/licenses/by/4.0 (vor)
- Locations
- Scientometrics (publishedVersion, cc-by)
- UniSA Research Outputs Repository (University of South Australia) (acceptedVersion, other-oa)
- RePEc: Research Papers in Economics (submittedVersion)
- Adelaide Research & Scholarship (AR&S) (University of Adelaide) (submittedVersion, cc-by)
- Funders
- Alfred P. Sloan Foundation (G-2020-12623)
- Topics
- Social Sciences › Education › Academic integrity and plagiarism
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Keywords
- retracted research, research misconduct, data falsification, citation networks, misinformation propagation, digital library platforms, omega-3 fatty acids, citation context analysis, bibliographic databases
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-02, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-02 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Continued post-retraction citation of a fraudulent clinical trial report, 11 years after it was retracted for falsifying data. https://app.cochat.ai/papers/10.1007/s11192-020-03631-1
- The paper
- Schneider, J., Ye, D., Hill, A. M., & Whitehorn, A. S. (2020). Continued post-retraction citation of a fraudulent clinical trial report, 11 years after it was retracted for falsifying data. Scientometrics. https://doi.org/10.1007/s11192-020-03631-1
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.