Correction of scientific literature: Too little, too late!
Open accessThe DOI matches its Crossref record; 12 of the 12 references it cites were found in a registry or an index.
Abstract
The Coronavirus Disease 2019 (COVID-19) pandemic has highlighted the limitations of the current scientific publication system, in which serious post-publication concerns are often addressed too slowly to be effective. In this Perspective, we offer suggestions to improve academia's willingness and ability to correct errors in an appropriate time frame.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Journal retractions happen at a glacial speed, and author protests can sometimes be enough to prevent them wholesale 59,60 .”
From Fraudulent studies are undermining the reliability of systematic reviews: on the prevalence of problematic images in preclinical depression studies (2025) · cites this paper as [60]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Correcting errors after publication is extremely burdensome [2, 3]; hence, focusing on prevention may be more efficient.”
From Is the future of peer review automated? (2022) · cites this paper as [3]
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“Crossref membership may be terminated for ' fraudulent use of Identifiers or Metadata. ' 5”
From Sneaked references: Fabricated reference metadata distort citation counts (2024) · cites this paper as [5]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
1 retracted
Hill, A. M., Garratt, A., Levi, J., Falconer, J., Ellis, L., McCann, K., Pilkington, V., Qavi, A., Wang, J., & Wentzel, H. (2021) · Open Forum Infectious Diseases · doi:10.1093/ofid/ofab394 · Cited by 18
RetractedOpen science saves lives: lessons from the COVID-19 pandemic
Besançon, L., Peiffer-Smadja, N., Segalas, C., Jiang, H., Masuzzo, P., Smout, C., Billy, E., Deforet, M., & Leyrat, C. (2021) · BMC Medical Research Methodology · doi:10.1186/s12874-021-01304-y · Cited by 249 · cited 1×
“During the COVID-19 pandemic, many basic quality control and transparency principles have been violated on a regular basis [2].”
BackgroundSelf-citationGaming the Metrics: Misconduct and Manipulation in Academic Research
(2020) · The MIT Press eBooks · doi:10.7551/mitpress/11087.001.0001 · Cited by 198
Reforming Science: Methodological and Cultural Reforms
Casadevall, A., & Fang, F. C. (2012) · Infection and Immunity · doi:10.1128/iai.06183-11 · Cited by 156 · cited 1×
“While some papers are retracted for reasons of serious research misconduct, other papers are retracted because of unintentional errors [9].”
BackgroundHigh-profile coronavirus retractions raise concerns about data oversight
Ledford, H. K., & Noorden, R. V. (2020) · Nature · doi:10.1038/d41586-020-01695-w · Cited by 88 · cited 1×
“This is perhaps most apparent in the Surgisphere debacle [3], in which global policy on COVID-19 treatment was changed overnight on the basis of a database that later turned out not to exist.”
BackgroundDoing the Right Thing: A Qualitative Investigation of Retractions Due to Unintentional Error
Hosseini, M., Hilhorst, M. T., de Beaufort, I., & Fanelli, D. (2017) · Science and Engineering Ethics · doi:10.1007/s11948-017-9894-2 · Cited by 52 · cited 1×
“Scientists must acknowledge that any process comes with an error rate, and correcting mistakes should not limit careers, but instead enhance them [10].”
BackgroundCOVID-19 and misinformation: how an infodemic fuelled the prominence of vitamin D
Henrina, J., Lim, M. A., & Pranata, R. (2020) · British Journal Of Nutrition · doi:10.1017/s0007114520002950 · Cited by 42 · cited 1×
“For example, a retracted and proven false study on vitamin D from 2020 [5] that was pulled from the preprint server it was hosted on was still being cited uncritically as recently as November 2021.”
BackgroundCOVID and 2020: An extraordinary year for science
Callaway, E., Ledford, H. K., Viglione, G. A., Watson, T., & Witze, A. (2020) · Nature · doi:10.1038/d41586-020-03437-4 · Cited by 38
Grey, A. B., Avenell, A., Gamble, G. D., & Bolland, M. J. (2019) · Science and Engineering Ethics · doi:10.1007/s11948-019-00152-w · Cited by 27 · cited 1×
“All of these issues are compounded by the glacial pace at which scientific correction is likely to occur [6].”
BackgroundPubPeer: Scientific Assessment Without Metrics
Barbour, B., & Stell, B. M. (2020) · Gaming the Metrics · doi:10.7551/mitpress/11087.003.0015 · Cited by 22 · cited 1×
“Public, open, and moderated review on PubPeer [8] and similar websites that expose serious concerns should be rewarded with praise rather than scorn, personal attacks, or threats (either legal or on the reviewers’ lives).”
Background
Cited by
Is the future of peer review automated?
Schulz, R., Barnett, A., Bernard, R., Brown, N. J. L., Byrne, J. A., Eckmann, P., Gazda, M. A., Kilicoglu, H., Prager, E. M., Salholz-Hillel, M., et al. (2022) · BMC Research Notes · doi:10.1186/s13104-022-06080-6 · Cited by 80
“Correcting errors after publication is extremely burdensome [2, 3]; hence, focusing on prevention may be more efficient.”
BackgroundByrne, J. A., Park, Y., Richardson, R. A. K., Pathmendra, P., Sun, M., & Stoeger, T. (2022) · Nucleic Acids Research · doi:10.1093/nar/gkac1139 · Cited by 46
“Although few corrected papers may reflect well-recognised barriers to post-publication correction (52,53), the lack of corrections to many papers with identical errors could also reflect the unwillingness of paper mills to draw critical attention to their products (39).”
Sneaked references: Cooked reference metadata inflate citation counts
Besançon, L., Cabanac, G., Labbé, C., & Magazinov, A. (2023) · arXiv · doi:10.48550/arxiv.2310.02192 · Cited by 31
“The publishing community must give extra attention to correct erroneous reference metadata in addition to correcting the scholarly literature in due time (Besançon et al., 2022).”
Self-citationSneaked references: Fabricated reference metadata distort citation counts
Besançon, L., Cabanac, G., Labbé, C., & Magazinov, A. (2024) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.24896 · Cited by 31
“The publishing community must give extra attention to correct erroneous reference metadata in addition to correcting the scholarly literature in due time (Besançon et al., 2022).”
Self-citationTransparency and reporting characteristics of COVID-19 randomized controlled trials
Kapp, P., Esmail, L., Ghosn, L., Ravaud, P., & Boutron, I. (2022) · BMC Medicine · doi:10.1186/s12916-022-02567-y · Cited by 25
“Some authors proposed new approaches to speed up the scientific correction process and to improve the science communication through open science [8, 43].”
Background
Metadata
- Authors
- Besançon, L., Bik, E., Heathers, J., & Meyerowitz-Katz, G.
- Affiliations
- Monash University (AU)
- Corresponding author
- Besançon, Lonni
- Bik, Elisabeth
- Heathers, James
- Venue
- PLOS Biology
- Publisher
- Public Library of Science (PLoS)
- Published
- 2022-03-03
- Volume
- 20
- Issue
- 3
- Pages
- e3001572
- ISSN
- 1544-9173 (ISSN-L)
- 1545-7885
- PMC
- PMC8923430
- OpenAlex
- W4214873878
- Cited by
- 46
- References
- 11
- Citations by year
- 2026: 3 · 2025: 11 · 2024: 16 · 2023: 8 · 2022: 8
- Type
- journal article
- Language
- en
- Update notices
- new_version (2022-03-15)
- Open access
- gold
- doi.org
- Licence
- Locations
- PLoS Biology (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Research Online (University of Wollongong) (submittedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Topics
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Social Sciences › Library and Information Sciences › Publishing and Scholarly Communication
- Social Sciences › Library and Information Sciences › Academic Writing and Publishing
- Keywords
- retraction, COVID-19 pandemic, peer review
- MeSH terms
- COVID-19, SARS-CoV-2, Humans, Publishing, Pandemics
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Correction of scientific literature: Too little, too late! https://app.cochat.ai/papers/10.1371/journal.pbio.3001572
- The paper
- Besançon, L., Bik, E., Heathers, J., & Meyerowitz-Katz, G. (2022). Correction of scientific literature: Too little, too late! PLOS Biology. https://doi.org/10.1371/journal.pbio.3001572
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.