Correction of scientific literature: Too little, too late!
Open accessThe DOI matches its Crossref record; 12 of the 12 references it cites were found in a registry or an index.
Abstract
The Coronavirus Disease 2019 (COVID-19) pandemic has highlighted the limitations of the current scientific publication system, in which serious post-publication concerns are often addressed too slowly to be effective. In this Perspective, we offer suggestions to improve academia's willingness and ability to correct errors in an appropriate time frame.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Journal retractions happen at a glacial speed, and author protests can sometimes be enough to prevent them wholesale 59,60 .”
From Fraudulent studies are undermining the reliability of systematic reviews: on the prevalence of problematic images in preclinical depression studies (2025) · cites this paper as [60]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Correcting errors after publication is extremely burdensome [2, 3]; hence, focusing on prevention may be more efficient.”
From Is the future of peer review automated? (2022) · cites this paper as [3]
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“Crossref membership may be terminated for ' fraudulent use of Identifiers or Metadata. ' 5”
From Sneaked references: Fabricated reference metadata distort citation counts (2024) · cites this paper as [5]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
1 retracted
Hill, A. M., Garratt, A., Levi, J., Falconer, J., Ellis, L., McCann, K., Pilkington, V., Qavi, A., Wang, J., & Wentzel, H. (2021) · Open Forum Infectious Diseases · doi:10.1093/ofid/ofab394 · Cited by 18
RetractedOpen science saves lives: lessons from the COVID-19 pandemic
Besançon, L., Peiffer-Smadja, N., Segalas, C., Jiang, H., Masuzzo, P., Smout, C., Billy, E., Deforet, M., & Leyrat, C. (2021) · BMC Medical Research Methodology · doi:10.1186/s12874-021-01304-y · Cited by 249 · cited 1×
“During the COVID-19 pandemic, many basic quality control and transparency principles have been violated on a regular basis [2].”
BackgroundSelf-citationGaming the Metrics: Misconduct and Manipulation in Academic Research
(2020) · The MIT Press eBooks · doi:10.7551/mitpress/11087.001.0001 · Cited by 198
Reforming Science: Methodological and Cultural Reforms
Casadevall, A., & Fang, F. C. (2012) · Infection and Immunity · doi:10.1128/iai.06183-11 · Cited by 156 · cited 1×
“While some papers are retracted for reasons of serious research misconduct, other papers are retracted because of unintentional errors [9].”
BackgroundHigh-profile coronavirus retractions raise concerns about data oversight
Ledford, H. K., & Noorden, R. V. (2020) · Nature · doi:10.1038/d41586-020-01695-w · Cited by 88 · cited 1×
“This is perhaps most apparent in the Surgisphere debacle [3], in which global policy on COVID-19 treatment was changed overnight on the basis of a database that later turned out not to exist.”
BackgroundDoing the Right Thing: A Qualitative Investigation of Retractions Due to Unintentional Error
Hosseini, M., Hilhorst, M. T., de Beaufort, I., & Fanelli, D. (2017) · Science and Engineering Ethics · doi:10.1007/s11948-017-9894-2 · Cited by 52 · cited 1×
“Scientists must acknowledge that any process comes with an error rate, and correcting mistakes should not limit careers, but instead enhance them [10].”
BackgroundCOVID-19 and misinformation: how an infodemic fuelled the prominence of vitamin D
Henrina, J., Lim, M. A., & Pranata, R. (2020) · British Journal Of Nutrition · doi:10.1017/s0007114520002950 · Cited by 42 · cited 1×
“For example, a retracted and proven false study on vitamin D from 2020 [5] that was pulled from the preprint server it was hosted on was still being cited uncritically as recently as November 2021.”
BackgroundCOVID and 2020: An extraordinary year for science
Callaway, E., Ledford, H. K., Viglione, G. A., Watson, T., & Witze, A. (2020) · Nature · doi:10.1038/d41586-020-03437-4 · Cited by 38
Grey, A. B., Avenell, A., Gamble, G. D., & Bolland, M. J. (2019) · Science and Engineering Ethics · doi:10.1007/s11948-019-00152-w · Cited by 27 · cited 1×
“All of these issues are compounded by the glacial pace at which scientific correction is likely to occur [6].”
BackgroundPubPeer: Scientific Assessment Without Metrics
Barbour, B., & Stell, B. M. (2020) · Gaming the Metrics · doi:10.7551/mitpress/11087.003.0015 · Cited by 22 · cited 1×
“Public, open, and moderated review on PubPeer [8] and similar websites that expose serious concerns should be rewarded with praise rather than scorn, personal attacks, or threats (either legal or on the reviewers’ lives).”
Background
Cited by
Is the future of peer review automated?
Schulz, R., Barnett, A., Bernard, R., Brown, N. J. L., Byrne, J. A., Eckmann, P., Gazda, M. A., Kilicoglu, H., Prager, E. M., Salholz-Hillel, M., et al. (2022) · BMC Research Notes · doi:10.1186/s13104-022-06080-6 · Cited by 80
“Correcting errors after publication is extremely burdensome [2, 3]; hence, focusing on prevention may be more efficient.”
BackgroundByrne, J. A., Park, Y., Richardson, R. A. K., Pathmendra, P., Sun, M., & Stoeger, T. (2022) · Nucleic Acids Research · doi:10.1093/nar/gkac1139 · Cited by 46
“Although few corrected papers may reflect well-recognised barriers to post-publication correction (52,53), the lack of corrections to many papers with identical errors could also reflect the unwillingness of paper mills to draw critical attention to their products (39).”
Sneaked references: Cooked reference metadata inflate citation counts
Besançon, L., Cabanac, G., Labbé, C., & Magazinov, A. (2023) · arXiv · doi:10.48550/arxiv.2310.02192 · Cited by 31
“The publishing community must give extra attention to correct erroneous reference metadata in addition to correcting the scholarly literature in due time (Besançon et al., 2022).”
Self-citationSneaked references: Fabricated reference metadata distort citation counts
Besançon, L., Cabanac, G., Labbé, C., & Magazinov, A. (2024) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.24896 · Cited by 31
“The publishing community must give extra attention to correct erroneous reference metadata in addition to correcting the scholarly literature in due time (Besançon et al., 2022).”
Self-citationTransparency and reporting characteristics of COVID-19 randomized controlled trials
Kapp, P., Esmail, L., Ghosn, L., Ravaud, P., & Boutron, I. (2022) · BMC Medicine · doi:10.1186/s12916-022-02567-y · Cited by 25
“Some authors proposed new approaches to speed up the scientific correction process and to improve the science communication through open science [8, 43].”
BackgroundNo evidence that mandatory open data policies increase error correction
Berberi, I., & Roche, D. G. (2022) · Nature Ecology & Evolution · doi:10.1038/s41559-022-01879-9 · Cited by 29
Is biomedical research self-correcting? Modelling insights on the persistence of spurious science
Grimes, D. R. (2024) · Royal Society Open Science · doi:10.1098/rsos.231056 · Cited by 18
Scientific Integrity Requires Publishing Rebuttals and Retracting Problematic Papers
Barrière, J., Frank, F., Besançon, L., Samuel, A., Saada, V., Billy, E., Al-Ahmad, A. J., Seitz‐Polski, B., & Robert, J. (2022) · Stem Cell Reviews and Reports · doi:10.1007/s12015-022-10465-2 · Cited by 15
“Fighting against scientific disinformation may be risky, too slow and insufficient [23, 24].”
BackgroundSelf-citationA structured, journal-led peer-review mentoring program enhances peer review training
Lyons-Warren, A. M., Aamodt, W. W., Pieper, K. M., & Strowd, R. E., III (2024) · Research Integrity and Peer Review · doi:10.1186/s41073-024-00143-x · Cited by 21
“Recent initiatives such as PubPeer, a website that allows users to review published manuscripts, extends the peer-review process into the post-publication realm as well [3].”
BackgroundResearch misconduct as a challenge for academic institutions and scientific journals
Candal-Pedreira, C., Ross, J. S., Marušić, A., & Ruano-Raviña, A. (2023) · Journal of Epidemiology and Community Health · doi:10.1136/jech-2023-220554 · Cited by 13
Frank, F., Florens, N., Meyerowitz‐Katz, G., Barrière, J., Billy, É., Saada, V., Samuel, A., Robert, J., & Besançon, L. (2023) · Research Integrity and Peer Review · doi:10.1186/s41073-023-00134-4 · Cited by 18
“…interests combined with expeditive peer review [3], inconsistent publications with, e.g., missing data [8], failure to retract or delayed retractions [6, 7], and irregularities in legal permissions are among the most common concerns seen in biomedical publications relating to the COVID-19 pandemic.”
Self-citationGrimes, D. R. (2022) · eLife · doi:10.7554/elife.79573 · Cited by 11
Grey, A. B., Avenell, A., Gaby, A. R., & Bolland, M. J. (2025) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2025.111918 · Cited by 10
Marshall, M. B., Pinfield, S., Abbott, P. Y., Cox, A. M., Alperín, J. P., Barata, G., Chtena, N., Dorsch, I., Fleerackers, A., de Oliveira, M. B., et al. (2024) · Humanities and Social Sciences Communications · doi:10.1057/s41599-024-03804-w · Cited by 13
Aquarius, R., van de Voort, M., Boogaarts, H. D., Reesink, P. M., & Wever, K. E. (2025) · PLoS Biology · doi:10.1371/journal.pbio.3003438 · Cited by 9
“Recommendations from experts might further help during this process [38].”
Why the article that led to the widespread use of hydroxychloroquine in COVID-19 should be retracted
Barraud, D., Besançon, L., Bik, E. M., Billy, E., Clarot, F., Frank, F., Guihur, A., Hajage, D., Lacombe, K., Maisonneuve, H., et al. (2023) · Therapies · doi:10.1016/j.therap.2023.06.001 · Cited by 7
“Many scientists have raised concerns about the slow correction of scientific literature, in particular in the medical field [9].”
BackgroundSelf-citation*READ**THIS*!! Spam as a threat for open science
Cohoon, J. (2024) · New Media & Society · doi:10.1177/14614448241248655 · Cited by 9
“Such issues were raised about preprint archives in the wake of the COVID-19 pandemic; while preprints deemed unreliable may be retracted, that “does not undo any harm caused in the meantime” (Besancon et al., 2022: 2).”
The research literature is an unsafe workplace
Byrne, J. A., & Barnett, A. G. (2024) · Accountability in Research · doi:10.1080/08989621.2024.2428205 · Cited by 6
“In the short term, PubPeer notices could be directly linked to the affected papers (Besançon et al. 2022).”
Best practices for considering retractions
Edlund, J. E., Okdie, B. M., & Scherer, C. R. (2022) · Current Psychology · doi:10.1007/s12144-022-03764-x · Cited by 5
“Recently, some authors (Besançon et al., 2022 ) have suggested that timelines should be specified to”
Better nanoscience through open, collaborative, and critical discussions
Rost, N. C. V., Said, M., Gharib, M., Lévy, R., & Boem, F. (2024) · Materials Horizons · doi:10.1039/d3mh01781h · Cited by 4
Berrío, J. P., & Kalliokoski, O. (2025) · FEBS Letters · doi:10.1002/1873-3468.70077 · Cited by 7
ChatGPT in Scientific Research and Writing: A Beginner’s Guide
Han, J., Qiu, W., & Lichtfouse, É. (2024) · Springer eBooks · doi:10.1007/978-3-031-66940-8_1 · Cited by 9
Do Journalists Update Retracted Science News?
Valinčiūtė, A., & Halffman, W. (2025) · Journalism Practice · doi:10.1080/17512786.2025.2540460 · Cited by 4
“…play towards greater accountability of science, first, by drawing publicity to questionable research and, consequently, by promoting timely retraction of scientific papers in a system that is often criticized for its lackadai-sical attitude in dealing with flawed research (Besançon et al., 2022).”
“Cake causes herpes?” - promiscuous dichotomisation induces false positives
Grimes, D. R., & Heathers, J. A. J. (2025) · BMC Medical Research Methodology · doi:10.1186/s12874-025-02712-0 · Cited by 5
Self-citationSeeing Is Believing? Scientific Misconduct and the Detection of Problematic Images
Bik, E. M. (2026) · Anesthesia & Analgesia · doi:10.1213/ane.0000000000008033 · Cited by 4
Self-citationDecatastrophizing research irreproducibility
Jarvis, M. F. (2024) · Biochemical Pharmacology · doi:10.1016/j.bcp.2024.116090 · Cited by 3
Ribeiro, M. D., & Vasconcelos, S. M. R. (2024) · Anais da Academia Brasileira de Ciências · doi:10.1590/0001-3765202420240038 · Cited by 3
Treat societally impactful scientific insights as open-source software artifacts
Liem, C. C. S., & Demetriou, A. M. (2023) · IEEE/ACM International Conference on Software Engineering: Software Engineering in Society (ICSE-SEIS) · doi:10.1109/icse-seis58686.2023.00020 · Cited by 4
Rétractations dans la recherche biomédicale (2000-présent): État des lieux
Haiech, J., Noûs, C., & Forest, C. D. (2025) · médecine/sciences · doi:10.1051/medsci/2025162 · Cited by 2
“La correction de la littérature peut ainsi paraître trop lente [11].”
Is biomedical research self-correcting? Modeling insights on the persistence of spurious sciencePreprint
Grimes, D. R. (2023) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2023.07.17.549436 · Cited by 2
Wang, J. (2025) · Science Editing · doi:10.6087/kcse.360 · Cited by 1
“However, the proportional decrease in retractions for these reasons may also indicate a reduced interest by editorial teams in following up on expressions of concern amid an accelerated publishing context [14].”
Whamond, A., Vazire, S., Clarke, B., Moodie, N., Schiavone, S. R., Thibault, R. T., & Hardwicke, T. E. (2025) · Advances in Methods and Practices in Psychological Science · doi:10.1177/25152459251366102 · Cited by 2
“Other factors that may deter submission of postpublication critique include fear of retaliation, such as public defamation and legal threats from individuals whose research they questioned (Besançon et al., 2022).”
Issues with Ethics in Research – A Case Study of the IHU Mediterranee InfectionPreprint
Frank, F., Florens, N., Barrière, J., Billy, É., Saada, V., Samuel, A., & Besançon, L. (2023) · doi:10.31219/osf.io/rymtz · Cited by 1
Self-citationBesançon, L., Claude, S., Dauby, N., Kesteman, T., Meyerowitz‐Katz, G., & Leyrat, C. (2023) · doi:10.31219/osf.io/j8ykx
Self-citationGetting Beyond “CRAAP”: Scientific Literacy in FYW and WAD
Duran, E., & Springer, L. M. M. (2023) · Journal of the Assembly for Expanded Perspectives on Learning · doi:10.7290/jaepl28hgcz
Kapp, P., Esmail, L. C., Ghosn, L., Ravaud, P., & Boutron, I. (2022) · Figshare · doi:10.6084/m9.figshare.21207016
Experimenting with new review methods, open practices, and interactive publications in HCI
Besançon, L., Echtler, F., Kay, M., & Wacharamanotham, C. (2024) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3613905.3643987
Self-citationCorrection in Scientific Publication: Why, How, and by Whom?
Mukhida, S. S., Das, N. K., Desai, D., Patil, R., & Khan, S. (2024) · Medical Journal of Dr D Y Patil Vidyapeeth · doi:10.4103/mjdrdypu.mjdrdypu_225_24
Gregory, J. S. (2024) · Biomedical visualization · doi:10.1007/978-3-031-73270-6_5
Découverte d’une fraude scientifique pour booster artificiellement l’impact des recherches
Besançon, L., & Cabanac, G. (2024) · The Conversation · doi:10.64628/aak.yqjav5axs
Self-citationNaudet, F. (2025) · doi:10.3917/edmat.segin.2025.01.0247
Genre Camouflage: How Fraudulent Scientific Images are Successful
Pflugfelder, E. H. (2025) · ACM International Conference on Design of Communication (SIGDOC) · doi:10.1145/3711670.3764620
Terré, A., Becker, O., Ioannidis, J. P. A., & Naudet, F. (2025) · BMC Medicine · doi:10.1186/s12916-025-04499-9
“There is considerable data on the limitations of post-publication peer review as currently implemented [135–138].”
Frank, F., Florens, N., Meyerowitz‐Katz, G., Barrière, J., Billy, É., Saada, V., Samuel, A., Robert, J., & Besançon, L. (2024) · Figshare · doi:10.6084/m9.figshare.26603983
Self-citationFrank, F., Florens, N., Meyerowitz‐Katz, G., Barrière, J., Billy, E., Saada, V., Samuel, A., Robert, J., & Besançon, L. (2024) · Figshare · doi:10.6084/m9.figshare.26603989
Self-citationFrank, F., Florens, N., Meyerowitz‐Katz, G., Barrière, J., Billy, E., Saada, V., Samuel, A., Robert, J., & Besançon, L. (2024) · Figshare · doi:10.6084/m9.figshare.26603986
Self-citationKapp, P., Esmail, L. C., Ghosn, L., Ravaud, P., & Boutron, I. (2022) · Figshare · doi:10.6084/m9.figshare.21207013
A conference taught me that scientists and journalists must work together to protect research
Besançon, L. (2026) · Nature · doi:10.1038/d41586-026-00824-1
Self-citationSridharan, K., & Sivaramakrishnan, G. (2026) · Journal of Empirical Research on Human Research Ethics · doi:10.1177/15562646261488630
Metadata
- Authors
- Besançon, L., Bik, E., Heathers, J., & Meyerowitz-Katz, G.
- Affiliations
- Monash University (AU)
- Corresponding author
- Besançon, Lonni
- Bik, Elisabeth
- Heathers, James
- Venue
- PLOS Biology
- Publisher
- Public Library of Science (PLoS)
- Published
- 2022-03-03
- Volume
- 20
- Issue
- 3
- Pages
- e3001572
- ISSN
- 1544-9173 (ISSN-L)
- 1545-7885
- PMC
- PMC8923430
- OpenAlex
- W4214873878
- Cited by
- 46
- References
- 11
- Citations by year
- 2026: 3 · 2025: 11 · 2024: 16 · 2023: 8 · 2022: 8
- Type
- journal article
- Language
- en
- Update notices
- new_version (2022-03-15)
- Open access
- gold
- doi.org
- Licence
- Locations
- PLoS Biology (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Research Online (University of Wollongong) (submittedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Topics
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Social Sciences › Library and Information Sciences › Publishing and Scholarly Communication
- Social Sciences › Library and Information Sciences › Academic Writing and Publishing
- Keywords
- retraction, COVID-19 pandemic, peer review
- MeSH terms
- COVID-19, SARS-CoV-2, Humans, Publishing, Pandemics
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.