The DOI matches its Crossref record; 24 of the 24 references it cites were found in a registry or an index.
Timeliness and content of retraction notices for publications by a single research group
Open accessAbstract
Publications of expressions of concern and retractions should be timely, accurate and comprehensive. We as sessed these characteristics for 292 publications by a research group about which we submitted concerns about publication integrity to 77 journals and 29 publishers between March 2013 and February 2020. By October 2020, 115 publications were corrected (3), had expressions of concern (18), or were retracted (94). The median (95% CI) time from submission of concerns to the first journal correction was 22.1 (18.2-26.9) months: this did not diminish by year of submission of concerns, varied between publishers, and was shorter for journals with higher impact factors. Eighty-four publications of original research were retracted. The median (range) proportion of concerns raised with the journal that were mentioned in the ensuing retraction notices was 9.5% (2-49). At least 75% of retraction notices included the suggested content for 7/9, 3/9 and 3/16 items in the Committee for Publication Ethics and Retraction Watch minimum and optimal recommended formats, respectively. Thus, assessment of concerns about publication integrity was delayed and incomplete. Adherence to recommended content of retraction notices was moderate at best. Strategies are needed to improve the efficiency, accuracy and transparency of processes for resolving concerns about publication integrity.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“The median time from the submission of concern to the first journal correction is estimated to be 22.1 months.108”
From Investigating the impact of trial retractions on the healthcare evidence ecosystem (VITALITY Study I): retrospective cohort study (2025) · cites this paper as [108]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
No raw data, no science: another possible source of the reproducibility crisis
Miyakawa, T. (2020) · Molecular Brain · doi:10.1186/s13041-020-0552-2 · Cited by 268 · cited 2×
“…with overarching concerns (The Editors 2019a; Ellis 2015; Rennie 2010), attention has focused on permissive manuscript submission processes (Miyakawa 2020), inconsistent, opaque and inadequate publisher and institutional assessments (Grey, Bolland, Gamble, and Avenell 2019, 2020a;…”
BackgroundMoylan, E. C., & Kowalczuk, M. K. (2016) · BMJ Open · doi:10.1136/bmjopen-2016-012047 · Cited by 212 · cited 1×
“…of affected publications is incomplete (McHugh and Yentis 2019; Drimer-Batca, Iaccarino, and Fine 2019; Elia, Wager, and Tramer 2014), and the simple recommendations made by COPE for content of retraction notices are not always followed (McHugh and Yentis 2019; Moylan and Kowalczuk 2016).”
BackgroundFalse individual patient data and zombie randomised controlled trials submitted to Anaesthesia
Carlisle, J. B. (2021) · Anaesthesia · doi:10.1111/anae.15263 · Cited by 173 · cited 1×
“In combination with more frequent scrutiny of raw data (Carlisle 2020) and the application of independent expertise to the assessment of publication integrity concerns (Bolland et al. 2020), these changes would assist key stakeholders who rely on a robust literature, such as scientists, clinicians…”
BackgroundCheck for publication integrity before misconduct
Grey, A., Bolland, M. J., Avenell, A., Klein, A. A., & Gunsalus, C. K. (2020) · Nature · doi:10.1038/d41586-019-03959-6 · Cited by 114 · cited 3×
“Because we took a systematic approach to collating and submitting the concerns, using a publication integrity checklist (Grey et al. 2020b), and our submissions were responsible for all but a few of the retractions, we had the opportunity to analyze the timeliness of publication…”
BackgroundMethodInfluentialSelf-citationSystematic review and statistical analysis of the integrity of 33 randomized controlled trials
Bolland, M. J., Avenell, A., Gamble, G. D., & Grey, A. (2016) · Neurology · doi:10.1212/wnl.0000000000003387 · Cited by 106 · cited 5×
“For these 25 publications we recorded the date of our submission of concerns as 30 September 2016, and we coded the concerns as those reported in the systematic review, which was published in November 2016 (Bolland et al. 2016).”
BackgroundMethodInfluentialSelf-citationda Silva, J. A. T., & Dobránszki, J. (2016) · Science and Engineering Ethics · doi:10.1007/s11948-016-9769-y · Cited by 80 · cited 1×
“© 2021 Informa UK Limited, trading as Taylor & Francis Group Silva and Dobránszki 2017).”
BackgroundElia, N., Wager, E., & Tramèr, M. R. (2014) · PLoS ONE · doi:10.1371/journal.pone.0085846 · Cited by 67 · cited 1×
“…or of known unethical conduct, retraction of affected publications is incomplete (McHugh and Yentis 2019; Drimer-Batca, Iaccarino, and Fine 2019; Elia, Wager, and Tramer 2014), and the simple recommendations made by COPE for content of retraction notices are not always followed (McHugh and…”
BackgroundInstitutional Research Misconduct Reports Need More Credibility
Gunsalus, C. K., Marcus, A. R., & Oransky, I. (2018) · JAMA · doi:10.1001/jama.2018.0358 · Cited by 67 · cited 1×
“…focused on permissive manuscript submission processes (Miyakawa 2020), inconsistent, opaque and inadequate publisher and institutional assessments (Grey, Bolland, Gamble, and Avenell 2019, 2020a; Gunsalus, Marcus, and Oransky 2018), and the impact of unreliable publications (Avenell et al. 2019).”
BackgroundAvenell, A., Stewart, F., Grey, A., Gamble, G., & Bolland, M. (2019) · BMJ Open · doi:10.1136/bmjopen-2019-031909 · Cited by 59 · cited 3×
“…focused on permissive manuscript submission processes (Miyakawa 2020), inconsistent, opaque and inadequate publisher and institutional assessments (Grey, Bolland, Gamble, and Avenell 2019, 2020a; Gunsalus, Marcus, and Oransky 2018), and the impact of unreliable publications (Avenell et al. 2019).”
BackgroundSelf-citationAn analysis of retractions of papers authored by Scott Reuben, Joachim Boldt and Yoshitaka Fujii
McHugh, U. M., & Yentis, S. M. (2018) · Anaesthesia · doi:10.1111/anae.14414 · Cited by 53 · cited 3×
“…of affected publications is incomplete (McHugh and Yentis 2019; Drimer-Batca, Iaccarino, and Fine 2019; Elia, Wager, and Tramer 2014), and the simple recommendations made by COPE for content of retraction notices are not always followed (McHugh and Yentis 2019; Moylan and Kowalczuk 2016).”
BackgroundResult
Research works printed but not linked: 1
- The Editors. 2019b. “Retraction To: Vitamin D Deficiency and Osteopenia in the Hemiplegic Limbs of Stroke Patients.” Stroke 50 (8): e246–e246.
Cited by
Hwang, S. Y., Yon, D. K., Lee, S. W., Kim, M. S., Kim, J. Y., Smith, L., Koyanagi, A., Solmi, M., Carvalho, A. F., Kim, E. Y., et al. (2023) · Journal of Korean Medical Science · doi:10.3346/jkms.2023.38.e333 · Cited by 75
INSPECT-SR tool for assessing trustworthiness of randomised controlled trials
Wilkinson, J., Heal, C., Flemyng, E., Antoniou, G. A., Aburrow, T., Alfirevic, Z., Avenell, A., Virginia, B., Berghella, V., Bishop, D. V. M., et al. (2026) · BMJ · doi:10.1136/bmj-2026-100611 · Cited by 48
Self-citationRetracted publications in pharmacy systematic reviews
Brown, S. J., Bakker, C., & Theis-Mahon, N. R. (2022) · Journal of the Medical Library Association JMLA · doi:10.5195/jmla.2022.1280 · Cited by 41
“However, retraction notices are often vague, lacking in sufficient detail to determine exactly which parts of the paper may be problematic and the nature of the concerns [48].”
BackgroundRetractedXu, C., Fan, S., Tian, Y., Liu, F., Furuya-Kanamori, L., Clark, J., Zhang, C., Li, S., Lin, L., Chu, H., et al. (2025) · BMJ · doi:10.1136/bmj-2024-082068 · Cited by 39
Identification of retracted publications and completeness of retraction notices in public health
Bakker, C. J., Reardon, E. E., Brown, S. J., Theis-Mahon, N., Schroter, S., Bouter, L., & Zeegers, M. P. (2024) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2024.111427 · Cited by 32
Metadata
- Authors
- Grey, A., Avenell, A., & Bolland, M.
- Affiliations
- University of Auckland (NZ)
- University of Aberdeen (GB)
- Corresponding author
- Grey, Andrew
- Venue
- Accountability in Research
- Publisher
- Informa UK Limited
- Published
- 2021-05-05
- Volume
- 29
- Issue
- 6
- Pages
- 347-378
- ISSN
- 0898-9621 (ISSN-L)
- 1545-5815
- OpenAlex
- W3154382555
- Cited by
- 41
- References
- 24
- Citations by year
- 2026: 9 · 2025: 11 · 2024: 5 · 2023: 10 · 2022: 5 · 2021: 1
- FWCI
- 6.56
- Type
- journal article
- Language
- en
- Open access
- green
- hdl.handle.net
- Licence
- public-domain
- Locations
- Accountability in Research (publishedVersion, public-domain)
- PubMed (publishedVersion)
- Aberdeen University Research Archive (Aberdeen University) (submittedVersion, public-domain)
- Funders
- no
- Topics
- Social Sciences › Education › Academic integrity and plagiarism
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Social Sciences › Library and Information Sciences › Publishing and Scholarly Communication
- Keywords
- expression of concern, publication integrity, research misconduct, Retraction Watch
- MeSH terms
- Humans, Scientific Misconduct, Biomedical Research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Timeliness and content of retraction notices for publications by a single research group. https://app.cochat.ai/papers/10.1080/08989621.2021.1920409
- The paper
- Grey, A., Avenell, A., & Bolland, M. (2022). Timeliness and content of retraction notices for publications by a single research group. Accountability in Research. https://doi.org/10.1080/08989621.2021.1920409
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.