The DOI matches its Crossref record; 26 of the 26 references it cites were found in a registry or an index.
Assessing the impact of retraction on the citation of randomized controlled trial reports: an interrupted time-series analysis
Abstract
Objectives: To assess the impact of retraction on the citation of randomized controlled trials. Methods: We used an interrupted time-series with matched controls. PubMed, CINHAL, Google and the Retraction Watch Database were searched. We identified retracted publications reporting the results of randomized controlled trials involving human participants with two years of available data before and after retraction. We obtained monthly citation counts across all articles for the 24 months before and after retraction, from Web of Science. We used a Poisson segmented regression to detect changes in the level and trend of citation following retraction. We also undertook a matched control analysis of unretracted randomized controlled trials and a sensitivity analysis to account for cases of large-scale, well-advertised fraud. Results: We identified 387 retracted randomized controlled trial reports, of which 218 (56.3%) were included in the interrupted time-series analysis. A reduction of 22.9% (95% CI 4.0% to 38.2%, p = 0.02) was observed in the number of citations in the month after retraction, and a further reduction of 1.9% (95% CI 0.4% to 3.5%, p = 0.02) per month in the following 24 months, relative to the expected trend. There was no evidence of a statistically significant reduction among the matched controls. Authors with a large number of retractions saw a 48.2% reduction at the time of retraction (95% CI 17.7% to 67.3%, p = 0.01). Other cases had a more gradual reduction with no change at the time of retraction and a 1.8% reduction per month in the following 24 months (95% CI 0.2% to 3.4%, p = 0.03). Conclusions: Retractions of randomized controlled trial reports can be effective in reducing citations. Other factors, such as the scale of the retractions and media attention, may play a role in the effectiveness of the reduction.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Our findings are consistent with those of others who have investigated the impact of publications affected by research misconduct on subsequent publications and systematic reviews.74 76 80–83”
From An investigation into the impact and implications of published papers from retracted research: systematic search of affected literature (2019) · cites this paper as [83]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“citations to the 64 RCTs decreased 1.8% per month, compared to the trend in matched controls”
From Continued post-retraction citation of a fraudulent clinical trial report, 11 years after it was retracted for falsifying data (2020) · cites this paper as Mott et al. 2019
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“They reported that retracted papers that were part of large-scale retractions that received broad media attention had a larger reduction in postretraction citations than other retracted papers (Mott et al., 2019).”
From Continued use of retracted papers: Temporal trends in citations and (lack of) awareness of retractions shown in citation contexts in biomedicine (2021) · cites this paper as Mott et al., 2019
The cited source says what the claim attributes to it.
In the citing paper
“Dinh et al. (2019) and Mott et al. (2019) reported that retracted papers’ citation counts dropped after the retraction.”
From Continued use of retracted papers: Temporal trends in citations and (lack of) awareness of retractions shown in citation contexts in biomedicine (2021) · cites this paper as Mott et al. (2019)
The cited source says what the claim attributes to it.
In the citing paper
“Mott and colleagues found a 46% reduction in citations of randomised clinical trial reports in the first year after retraction,83”
From An investigation into the impact and implications of published papers from retracted research: systematic search of affected literature (2019) · cites this paper as [83]
5 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
1 retracted
Retraction rates are on the rise
Cokol, M., Ozbay, F., & Rodriguez‐Esteban, R. (2008) · The EMBO Reports · doi:10.1038/sj.embor.7401143 · Cited by 149
RetractedSegmented regression analysis of interrupted time series studies in medication use research
Wagner, A. K., Soumerai, S. B., Zhang, F., & Ross-Degnan, D. (2002) · Journal of Clinical Pharmacy and Therapeutics · doi:10.1046/j.1365-2710.2002.00430.x · Cited by 3,279
Interrupted time series regression for the evaluation of public health interventions: a tutorial
Lopez Bernal, J., Cummins, S., & Gasparrini, A. (2016) · International Journal of Epidemiology · doi:10.1093/ije/dyw098 · Cited by 3,049
Misconduct accounts for the majority of retracted scientific publications
Fang, F. C., Steen, R. G., & Casadevall, A. (2012) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1212247109 · Cited by 1,232
Time series regression studies in environmental epidemiology
Bhaskaran, K., Gasparrini, A., Hajat, S., Smeeth, L., & Armstrong, B. (2013) · International Journal of Epidemiology · doi:10.1093/ije/dyt092 · Cited by 1,150
Zarychanski, R., Abou-Setta, A. M., Turgeon, A. F., Houston, B. L., McIntyre, L., Marshall, J. C., & Fergusson, D. A. (2013) · JAMA · doi:10.1001/jama.2013.430 · Cited by 649
Relative Citation Impact of Various Study Designs in the Health Sciences
Patsopoulos, N. A. (2005) · JAMA · doi:10.1001/jama.293.19.2362 · Cited by 498
A Comprehensive Survey of Retracted Articles from the Scholarly Literature
Grieneisen, M. L., & Zhang, M. (2012) · PLoS ONE · doi:10.1371/journal.pone.0044118 · Cited by 355
Zhang, F., Wagner, A. K., & Ross-Degnan, D. (2011) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2011.02.007 · Cited by 291
The incidence and role of negative citations in science
Catalini, C., Lacetera, N., & Oettl, A. (2015) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1502280112 · Cited by 189
Research works printed but not linked: 4
- Bernal JL, 2017, Int J Epidemiol, 46, 348
- Tobias A, 1998, Stata Tech Bull, 46, 33
- Budd JM, Coble ZC, Anderson KM. Retracted publications in biomedicine: cause for concern. In: Declaration of interdependence: the proceedings of the ACRL 2011 conference , 30 March–2 April 2011, pp.390–395. Philadelphia, PA: Association of College and Research Libraries.
- Guthrie S, Krapels J, Lichten CA, et al. 100 Metrics to assess and communicate the value of biomedical research . Washington DC, USA: Research Reports, Association of American Medical Colleges, 2016, p.71. · doi:10.7249/rr1606
Cited by
Hsiao, T.-K., & Schneider, J. (2021) · Quantitative Science Studies · doi:10.1162/qss_a_00155 · Cited by 98
“Mott et al. (2019) studied citations to 387 retracted randomized controlled trials (RCTs).”
BackgroundMethodResultInfluentialSchneider, J., Ye, D., Hill, A. M., & Whitehorn, A. S. (2020) · Scientometrics · doi:10.1007/s11192-020-03631-1 · Cited by 88
Citation of retracted publications: A challenging problem
Bolland, M. J., Grey, A., & Avenell, A. (2022) · Accountability in Research · doi:10.1080/08989621.2021.1886933 · Cited by 78
“…retracted articles (Pfeifer and Snodgrass 1990; Budd, Sievert, and Schultz 1998; Sox and Rennie 2006; Neale, Dailey, and Abrams 2010; BornemannCimenti, Szilagyi, and Sandner-Kiesling 2016; Bar-Ilan and Halevi 2017; Bolboaca et al. 2019; Mott, Fairhurst, and Torgerson 2019; Dal-Re and Ayuso 2020).”
BackgroundDoes retraction after misconduct have an impact on citations? A pre–post study
Candal-Pedreira, C., Ruano-Ravina, A., Fernández, E., Ramos, J., Campos-Varela, I., & Pérez-Ríos, M. (2020) · BMJ Global Health · doi:10.1136/bmjgh-2020-003719 · Cited by 67
Avenell, A., Stewart, F., Grey, A., Gamble, G., & Bolland, M. (2019) · BMJ Open · doi:10.1136/bmjopen-2019-031909 · Cited by 59
Metadata
- Authors
- Mott, A., Fairhurst, C., & Torgerson, D.
- Affiliations
- University of York (GB)
- Corresponding author
- Mott, Andrew
- Venue
- Journal of Health Services Research & Policy
- Publisher
- SAGE Publications
- Published
- 2018-09-24
- Volume
- 24
- Issue
- 1
- Pages
- 44-51
- ISSN
- 1355-8196 (ISSN-L)
- 1758-1060
- OpenAlex
- W2893976406
- Cited by
- 36
- References
- 26
- Citations by year
- 2026: 4 · 2025: 6 · 2024: 1 · 2023: 4 · 2022: 8 · 2021: 7 · 2020: 3 · 2019: 2 · 2018: 1
- FWCI
- 6.48
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
- Locations
- Journal of Health Services Research & Policy (publishedVersion)
- PubMed (publishedVersion)
- White Rose Research Online (University of Leeds, The University of Sheffield, University of York) (acceptedVersion)
- Topics
- Social Sciences › Education › Academic integrity and plagiarism
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Keywords
- retraction, citation impact, randomized controlled trials, citation counts, research integrity, scientific fraud, media attention, Retraction Watch
- MeSH terms
- Humans, Retraction of Publication as Topic, Serial Publications, Poisson Distribution, Randomized Controlled Trials as Topic, Interrupted Time Series Analysis
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Assessing the impact of retraction on the citation of randomized controlled trial reports: an interrupted time-series analysis. https://app.cochat.ai/papers/10.1177/1355819618797965
- The paper
- Mott, A., Fairhurst, C., & Torgerson, D. (2019). Assessing the impact of retraction on the citation of randomized controlled trial reports: an interrupted time-series analysis. Journal of Health Services Research & Policy. https://doi.org/10.1177/1355819618797965
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.