A Novel Rubric for Rating the Quality of Retraction Notices
Open accessThe DOI matches its Crossref record; 8 of the 8 references it cites were found in a registry or an index.
Abstract
When a scientific article is found to be either fraudulent or erroneous, one course of action available to both the authors and the publisher is to retract said article. Unfortunately, not all retraction notices properly inform the reader of the problems with a retracted article. This study developed a novel rubric for rating and standardizing the quality of retraction notices, and used it to assess the retraction notices of 171 retracted articles from 15 journals. Results suggest the rubric to be a robust, if preliminary, tool. Analysis of the retraction notices suggest that their quality has not improved over the last 50 years, that it varies both between and within journals, and that it is dependent on the field of science, the author of the retraction notice, and the reason for retraction. These results indicate a lack of uniformity in the retraction policies of individual journals and throughout the scientific literature. The rubric presented in this study could be adopted by journals to help standardize the writing of retraction notices.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Misconduct accounts for the majority of retracted scientific publications
Fang, F. C., Steen, R. G., & Casadevall, A. (2012) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1212247109 · Cited by 1,232 · cited 3×
“Firstly, the misconduct category consisted of fraud (43%), plagiarism (10%) and duplicate publication (14%) [12].”
BackgroundResultRetractions in the scientific literature: is the incidence of research fraud increasing?
Steen, R. G. (2011) · Journal of Medical Ethics · doi:10.1136/jme.2010.040923 · Cited by 405 · cited 1×
“8% of retracted articles were not noted as such in any way [13].”
BackgroundWhy and how do journals retract articles? An analysis of Medline retractions 1988–2008
Wager, E., & Williams, P. (2011) · Journal of Medical Ethics · doi:10.1136/jme.2010.040964 · Cited by 263 · cited 1×
“This differs from a previous study [11], with 17% more author retractions.”
ResultRetractions in the scientific literature: do authors deliberately commit research fraud?
Steen, R. G. (2011) · Journal of Medical Ethics · doi:10.1136/jme.2010.038125 · Cited by 217
The Retraction Penalty: Evidence from the Web of Science
Lu, S. F., Jin, G. Z., Uzzi, B., & Jones, B. (2013) · Scientific Reports · doi:10.1038/srep03146 · Cited by 191 · cited 1×
“These results can be interpreted numerous ways: Greater care may be taken with retraction notices of prominent articles; researchers may cite articles from high-impact journals regardless of retraction; researchers might be unaware of the retraction; though retracted, some unaffected parts of an article might still be…”
BackgroundRetractions in the research literature: misconduct or mistakes?
Nath, S. B., Marcus, S. C., & Druss, B. G. (2006) · Medical Journal of Australia · doi:10.5694/j.1326-5377.2006.tb00504.x · Cited by 161
Governing knowledge in the scientific community: Exploring the role of retractions in biomedicine
Furman, J. L., Jensen, K., & Murray, F. (2012) · Research Policy · doi:10.1016/j.respol.2011.11.001 · Cited by 151 · cited 1×
“The recent attention on retractions in the scientific literature has generated research [6–16].”
BackgroundThe Economics of Scientific Misconduct
Lacetera, N., & Zirulia, L. (2011) · Journal of Law, Economics, and Organization · doi:10.1093/jleo/ewp031 · Cited by 5
Cited by
Moylan, E. C., & Kowalczuk, M. K. (2016) · BMJ Open · doi:10.1136/bmjopen-2016-012047 · Cited by 212
Teixeira da Silva, J. A., & Dobránszki, J. (2015) · Accountability in Research · doi:10.1080/08989621.2014.899909 · Cited by 158
The visibility of scientific misconduct: A review of the literature on retracted journal articles
Hesselmann, F., Graf, V., Schmidt, M., & Reinhart, M. (2017) · Current Sociology · doi:10.1177/0011392116663807 · Cited by 153
Temporal characteristics of retracted articles
Bar-Ilan, J., & Halevi, G. (2018) · Scientometrics · doi:10.1007/s11192-018-2802-y · Cited by 107
“The Wakefield article was published and retracted from The Lancet, however for some unknown reason Elsevier’s Scopus does not index this item.”
BackgroundInfluentialWhat studies of retractions tell us
Marcus, A., & Oransky, I. (2014) · Journal of Microbiology & Biology Education · doi:10.1128/jmbe.v15i2.855 · Cited by 81
“A 2014 study rated notices at 15 journals and found significant variations (4), and as Wager and Williams concluded, “Journals’ retraction practices are not uniform.”
Metadata
- Authors
- Bilbrey, E., O'Dell, N., & Creamer, J.
- Venue
- Publications
- Publisher
- MDPI AG
- Published
- 2014-01-24
- Volume
- 2
- Issue
- 1
- Pages
- 14-26
- ISSN
- 2304-6775 (ISSN-L)
- OpenAlex
- W2082330957
- Cited by
- 37
- References
- 8
- FWCI
- 14.77
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: A Novel Rubric for Rating the Quality of Retraction Notices. https://app.cochat.ai/papers/10.3390/publications2010014
- The paper
- Bilbrey, E., O'Dell, N., & Creamer, J. (2014). A Novel Rubric for Rating the Quality of Retraction Notices. Publications. https://doi.org/10.3390/publications2010014
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.