Empirical developments in retraction
Open accessAbstract
This study provides current data on key questions about retraction of scientific articles. Findings confirm that the rate of retractions remains low but is increasing. The most commonly cited reason for retraction was research error or inability to reproduce results; the rate from research misconduct is an underestimate, since some retractions necessitated by research misconduct were reported as being due to inability to reproduce. Retraction by parties other than authors is increasing, especially for research misconduct. Although retractions are on average occurring sooner after publication than in the past, citation analysis shows that they are not being recognised by subsequent users of the work. Findings suggest that editors and institutional officials are taking more responsibility for correcting the scientific record but that reasons published in the retraction notice are not always reliable. More aggressive means of notification to the scientific community appear to be necessary.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
0 of 12 cited sources checked · 0 supported · 0 flagged
- Findingown data
Average citations before and after retraction differed significantly among six reasons for retraction.
“Differences in the average number of citations before (F = 5.39, p,0.0001) and after retraction (F = 3.02, p = 0.0113) among the six reasons for retraction (table 3) were statistically significant”
Quote in the paperNot a substantial claim - Findingown data
Articles in higher-impact journals were more highly cited after retraction (r=0.61, p<0.0001).
“with those in higher-impact journals more highly cited after retraction (r = 0.61, p,0.0001).”
Quote in the paperNot a substantial claim - Findingown data
In 90% of cases the whole article was retracted.
“Usually (in 90% of cases) the whole article was retracted.”
Quote in the paperNot a substantial claim - Findingown data
Studies highly cited before retraction remained highly cited after retraction (r=0.60, p<0.0001).
“the studies highly cited before retraction remained highly cited postretraction (r = 0.60, p,0.0001)”
Quote in the paperSubstantial claim - Findingown data
Retractions with publicity had significantly more average citations (29.38) than those without (14.27).
“The average number of citations of manuscripts whose retractions had publicity (29.38) was significantly larger than of those with no publicity (14.27) (t = 2.98, p = 0.0031)”
Quote in the paperNot a substantial claim
- Findingown data
10 papers had high late post-retraction citation rates, cited 225 times 4+ years after retraction (range 10-96).
“There were 10 papers with high late post-retraction citation rates and these were cited a total of 225 times 4 or more years after retraction (range 10-96).”
Quote in the paperSubstantial claim - Findingown data
The mean time from publication to retraction decreased from 28 months to 21 months.
“a decrease in the mean time from publication to retraction (from 28 months to 21 months)”
- Also stated in: § ABSTRACT · plain
“Although retractions are on average occurring sooner after publication than in the past”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [1] source
Not checked in the free run.
- Also stated in: § ABSTRACT · plain
- Findingown data
The 315 retracted articles were cited 3942 times before retraction and 4501 times after retraction.
“the 315 retracted articles cumulatively were cited 3942 times before retraction and 4501 times after retraction.”
Quote in the paperNot a substantial claim - Findingown data
In nine of ten high late-citation papers, fewer than 3% of late citations acknowledged the retraction.
“In nine of these cases, the rate of acknowledgement of the retraction in these late citations was less than 3%.”
Quote in the paperSubstantial claim - Findingown data
In PubMed, 328 of 5,041,587 records (0.0065%) for 1995-2004 were retracted.
“The number of records in PubMed for the study period was 5 041 587; of these, 328 (0.0065%) were retracted.”
Quote in the paperSubstantial claim - Findingown data
The most common primary reason for retraction was research error or inability to reproduce.
“The most commonly cited reason for retraction was research error or inability to reproduce results”
Quote in the paperSubstantial claim - Findingown data
12 retraction notices cited data fabrication or falsification as reason.
“Twelve retraction notices straightforwardly cited data fabrication or falsification as the reason for retraction.”
Quote in the paperNot a substantial claim - Interpretationown data
Reasons published in retraction notices are not always reliable.
“reasons published in the retraction notice are not always reliable.”
- Also stated in: § Additional information · plain
“Things haven't changed.”
Quote in the paperSubstantial claim - Also stated in: § Additional information · plain
- Interpretationown data
The rate of retraction due to research misconduct is underestimated because some retractions necessitated by research misconduct were reported as being due to inability to reproduce.
“the rate from research misconduct is an underestimate, since some retractions necessitated by research misconduct were reported as being due to inability to reproduce.”
- Also stated in: § Additional information · plain
“The rest (14) gave as reasons ''unable to reproduce'', ''data are invalid'', ''for complicated reasons'', ''not supportable by reproducible evidence'' or ''appears to have been falsified'' (without identifying which author was at fault), with the remainder offering no reason for the retraction.”
Quote in the paperSubstantial claim - Also stated in: § Additional information · plain
- Premisecitation
Citations to retracted articles continue long after retraction.
“Citation continues long after retrac- tion, raising questions about the adequacy of current methods of notification.3”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [3] source
Not checked in the free run.
- Interpretationown data
Editors and institutional officials are taking more responsibility for correcting the scientific record.
“Findings suggest that editors and institutional officials are taking more responsibility for correcting the scientific record”
- Also stated in: § RESULTS · hedged
“suggesting that others have become involved in oversight.”
Quote in the paperSubstantial claim - Also stated in: § RESULTS · hedged
- Interpretationown data
The higher citation of publicized retractions reflects the high impact factor of Science and Nature.
“reflecting the high impact factor of the journals (Science, Nature) in which publication was tracked.”
Quote in the paperSubstantial claim - Interpretationcitation
Continued citation of retracted work remains a problem.
“Continued citation of invalid, retracted work, already documented in 1990 3 and in 1998, 1 remains a problem, even though retractions are now clearly identified in the Medline and PubMed databases.6”
Quote in the paperSubstantial claim0 of 3 sources checked- cites [3] source
Not checked in the free run.
- cites [1] source
Not checked in the free run.
- cites [6] Anon. What’s the difference between MEDLINE and PubMed? [fact sheet]. Bethesda, Maryland: United States National Library of Medicine, 2006. http://www.nlm.nih.gov/pubs/factsheets/dif_med_pub.html (accessed 23 July 2008).
Not checked in the free run.
- Interpretationcitation
Retraction notices still often obfuscate reasons for retraction.
“Things haven't changed.”
- Also stated in: § Additional information · plain
“The rest (14) gave as reasons ''unable to reproduce'', ''data are invalid'', ''for complicated reasons'', ''not supportable by reproducible evidence'' or ''appears to have been falsified'' (without identifying which author was at fault), with the remainder offering no reason for the retraction.”
Quote in the paperSubstantial claim - Also stated in: § Additional information · plain
- May combine two claims. 12
- Classified as probably not a substantial claim. 6
May combine two claims.
Findingown dataThe rate of retraction of scientific articles remains low but has increased over time, from 0.0021% in 1966-1994 to 0.0065% in 1995-2004.
“Findings confirm that the rate of retractions remains low but is increasing.”
- Also stated in: § RESULTS · plain
“Compared with an earlier study of retractions for the years 1966-1994, 1 the present study found (1) a significantly higher rate of retraction (0.0021% versus 0.0065%, p,0.0001 by test of proportions)”
- Also stated in: § Additional information · plain
“rates of retraction, although very low, have increased between the periods 1966-1997 and 1995-2004”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [1] source
Not checked in the free run.
- Also stated in: § RESULTS · plain
May combine two claims.
Findingown data32 retractions (10%) received publicity in Science or Nature news sections, most frequently for research misconduct.
“Thirty-two cases of retraction (10%) resulted in publicity in the news sections of Science or Nature, most frequently reporting on cases of research misconduct.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataThe primary reasons for retraction were research error, inability to reproduce, research misconduct, and plagiarism.
“The primary reasons for retraction were research error, inability to reproduce, research misconduct and plagiarism.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataAfter retraction, citations differed significantly between research misconduct and plagiarism, and between inability to reproduce and plagiarism.
“with significant differences between research misconduct and plagiarism (t = 2.90, p = 0.0040) and between inability to reproduce and plagiarism (t = 2.50, p = 0.0131) after retraction.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingnone givenPost-retraction citation rate remains high, especially associated with retraction for research misconduct and inability to reproduce.
“The post-retraction citation rate remains high, especially associated with retraction for reasons of research misconduct and inability to reproduce.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataThe paper with 96 late post-retraction citations dealt with a supposedly settled controversy with significant environmental implications and was immediately questioned; its retraction was acknowledged in 29% of post-retraction citations.
“The paper with 96 late post-retraction citations dealt with a supposedly settled controversy with significant environmental implications 7 and was immediately questioned by other scientists; the retraction of this paper was acknowledged in 29% of the post-retraction citations.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [7] source
Not checked in the free run.
May combine two claims.
Findingown data26 of 315 retractions were required by ORI findings of confirmed data fabrication/falsification, involving 17 authors.
“Twenty-six such retractions were found (26/315), involving 17 authors.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataThe largest proportion of retractions were by all authors, followed by some authors and editors/publishers.
“the largest proportion of retractions were by all authors, followed by some authors and by editors/publishers.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataRetracted articles continue to be cited after retraction, and late citations rarely acknowledge the retraction.
“citation analysis shows that they are not being recognised by subsequent users of the work.”
- Also stated in: § RESULTS · plain
“In nine of these cases, the rate of acknowledgement of the retraction in these late citations was less than 3%.”
- Also stated in: § Additional information · plain
“The post-retraction citation rate remains high”
Quote in the paperSubstantial claim- Also stated in: § RESULTS · plain
May combine two claims.
Findingown dataRetractions by parties other than authors increased, especially for research misconduct.
“Retraction by parties other than authors is increasing, especially for research misconduct.”
- Also stated in: § RESULTS · plain
“a decrease in the proportion of retractions initiated by authors (from 81% to 67%)”
- Also stated in: § Additional information · plain
“retractions are occurring more quickly and are more frequently initiated by parties other than authors.”
Quote in the paperSubstantial claim- Also stated in: § RESULTS · plain
May combine two claims.
Findingown data14 of the 26 ORI-related retractions gave other reasons, including inability to reproduce, invalid data, complicated reasons, not supportable, or appears falsified, and some gave no reason.
“The rest (14) gave as reasons ''unable to reproduce'', ''data are invalid'', ''for complicated reasons'', ''not supportable by reproducible evidence'' or ''appears to have been falsified'' (without identifying which author was at fault), with the remainder offering no reason for the retraction.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationPrior studies found that the dominant reason for retraction is research error or inability to reproduce.
“Previous studies of retraction of scientific articles have shown that the dominant reason for retraction is research error or inability to reproduce results”
Quote in the paperNot a substantial claim0 of 2 sources checkedClassified as probably not a substantial claim.
Interpretationnone givenThese standards are in some instances not followed.
“these standards are in some instances not followed.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationParrish noted that retraction notices often obfuscated reasons for retraction, particularly in cases of research misconduct.
“An early study by Parrish noted that retraction notices often obfuscated the reasons for retraction, particularly in cases of research misconduct 8”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [8] Parrish, 1999, Scientific misconduct and correcting the scientific literature., Acad Med source
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationInternational standards require retraction notices to explain why the article is retracted.
“International standards are clear that the text of the retraction should explain why the article is being retracted; 10”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [10] International Committee of Medical Journal Editors. Uniform requirements for manuscripts submitted to biomedical journals: writing and editing for biomedical publication. Philadelphia: ICMJE, 2007. http://www.icmje.org/index.html#authorsur (accessed 23 July 2008).
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationRetractions are now clearly identified in Medline and PubMed.
“even though retractions are now clearly identified in the Medline and PubMed databases.6”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [6] Anon. What’s the difference between MEDLINE and PubMed? [fact sheet]. Bethesda, Maryland: United States National Library of Medicine, 2006. http://www.nlm.nih.gov/pubs/factsheets/dif_med_pub.html (accessed 23 July 2008).
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Study design and conductown dataA 10% sample of records was independently coded, with 3% disagreement resolved by negotiation.
“Ten per cent of the records were coded independently, yielding a 3% disagreement, which was negotiated to agreement.”
Quote in the paperNot a substantial claim
The paper relies on this without support.
Journal impact factor is a valid indicator of a journal's prestige and the likelihood that its papers are widely cited.
“Those with the highest impact factor are considered the most prestigious and their papers are likely to be widely cited, making it important that retractions be noted.”
The paper relies on this without support.
News coverage in Science and Nature is a valid proxy for publicity to the scientific community.
“reported in the news sections of Science and Nature and matched to cases in our data set were retrieved as proxy measures of publicity to the scientific community.”
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
A marked recent rise in the frequency of retraction was confirmed, but was not uniform among the various causes of retraction.
“A marked recent rise in the frequency of retraction was confirmed (2, 13), but was not uniform among the various causes of retraction (Fig. 1A).”
From Misconduct accounts for the majority of retracted scientific publications (2012) · cites this paper as [13]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Earlier comparison period has conflicting end years
MinorThe results identify the earlier study period as ending in 1994, but the summary says it ended in 1997.
“Compared with an earlier study of retractions for the years 1966-1994,”
“rates of retraction, although very low, have increased between the periods 1966-1997 and 1995-2004”
Cites
1 retracted
Synergistic Activation of Estrogen Receptor with Combinations of Environmental Chemicals
Arnold, S. F., Klotz, D. M., Collins, B. M., Vonier, P. M., Guillette, L. J., & McLachlan, J. A. (1996) · Science · doi:10.1126/science.272.5267.1489 · Cited by 499 · see citing works
RetractedThe History and Meaning of the Journal Impact Factor
Garfield, E. (2006) · JAMA · doi:10.1001/jama.295.1.90 · Cited by 2,770 · see citing works
Munhoz, E. (2006) · Epidemiologia e Serviços de Saúde · doi:10.5123/s1679-49742006000100002 · Cited by 417 · see citing works
International Committee of Medical Journal Editors.
Riis, P. J. (1990) · PubMed · Cited by 415 · see citing works
Phenomena of Retraction: Reasons for Retraction and Citations to the Publications
Budd, J. M., Sievert, M., & Schultz, T. R. (1998) · JAMA · doi:10.1001/jama.280.3.296 · Cited by 230 · see citing works
Molar Tooth Diversity, Disparity, and Ecology in Cenozoic Ungulate Radiations
Jernvall, J., Hunter, J. P., & Fortelius, M. (1996) · Science · doi:10.1126/science.274.5292.1489 · Cited by 207 · see citing works
Sox, H. C., & Rennie, D. (2006) · Annals of Internal Medicine · doi:10.7326/0003-4819-144-8-200604180-00123 · Cited by 200 · see citing works
The Continued Use of Retracted, Invalid Scientific Literature
Pfeifer, M. P. (1990) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.1990.03440100140020 · Cited by 188 · see citing works
Retractions in the research literature: misconduct or mistakes?
Nath, S. B., Marcus, S. C., & Druss, B. G. (2006) · Medical Journal of Australia · doi:10.5694/j.1326-5377.2006.tb00504.x · Cited by 161 · see citing works
The International Committee of Medical Journal Editors
van der Weyden, M. V. (2006) · doi:10.2349/biij.2.4.e54-13 · Cited by 110 · see citing works
Scientific misconduct and correcting the scientific literature.
Parrish, D. M. (1999) · Academic Medicine · doi:10.1097/00001888-199903000-00009 · Cited by 28 · see citing works
Flagged first, then by citations
Research works printed but not linked: 1
- Journal Citation Reports. Philadelphia: Thomson ISI, 2003.
Cited by
Sorted by citations
Nosek (2012) · doi:10.1177/1745691612459058 · Cited by 1,301 · see citing works
Misconduct accounts for the majority of retracted scientific publications
Fang, F. C., Steen, R. G., & Casadevall, A. (2012) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1212247109 · Cited by 1,232 · see citing works
Retracted Science and the Retraction Index
Fang, F. C., & Casadevall, A. (2011) · Infection and Immunity · doi:10.1128/iai.05661-11 · Cited by 405 · see citing works
RetractedRetractions in the scientific literature: is the incidence of research fraud increasing?
Steen, R. G. (2011) · Journal of Medical Ethics · doi:10.1136/jme.2010.040923 · Cited by 405 · see citing works
A Comprehensive Survey of Retracted Articles from the Scholarly Literature
Grieneisen, M. L., & Zhang, M. (2012) · PLoS ONE · doi:10.1371/journal.pone.0044118 · Cited by 355 · see citing works
Post retraction citations in context: a case study
Bar-Ilan, J., & Halevi, G. (2017) · Scientometrics · doi:10.1007/s11192-017-2242-0 · Cited by 191 · see citing works
Governing knowledge in the scientific community: Exploring the role of retractions in biomedicine
Furman, J. L., Jensen, K., & Murray, F. (2012) · Research Policy · doi:10.1016/j.respol.2011.11.001 · Cited by 151 · see citing works
The visibility of scientific misconduct: A review of the literature on retracted journal articles
Hesselmann, F., Graf, V., Schmidt, M., & Reinhart, M. (2017) · Current Sociology · doi:10.1177/0011392116663807 · Cited by 153 · see citing works
Vuong, Q. (2020) · Learned Publishing · doi:10.1002/leap.1282 · Cited by 126 · see citing works
Hsiao, T.-K., & Schneider, J. (2021) · Quantitative Science Studies · doi:10.1162/qss_a_00155 · Cited by 98 · see citing works
Schneider, J., Ye, D., Hill, A. M., & Whitehorn, A. S. (2020) · Scientometrics · doi:10.1007/s11192-020-03631-1 · Cited by 88 · see citing works
The (lack of) Impact of Retraction on Citation Networks
Madlock-Brown, C. R., & Eichmann, D. (2015) · Science and Engineering Ethics · doi:10.1007/s11948-014-9532-1 · Cited by 89 · see citing works
Retractions in cancer research: a systematic survey
Bozzo, A., Bali, K., Evaniew, N., & Ghert, M. (2017) · Research Integrity and Peer Review · doi:10.1186/s41073-017-0031-1 · Cited by 83 · see citing works
The persistence of error: a study of retracted articles on the Internet and in personal libraries
Davis, P. M. (2012) · Journal of the Medical Library Association : JMLA · doi:10.3163/1536-5050.100.3.008 · Cited by 74 · see citing works
Visibility of retractions: a cross-sectional one-year study
Decullier, E., Huot, L., Samson, G., & Maisonneuve, H. (2013) · BMC Research Notes · doi:10.1186/1756-0500-6-238 · Cited by 69 · see citing works
Does retraction after misconduct have an impact on citations? A pre–post study
Candal-Pedreira, C., Ruano-Ravina, A., Fernández, E., Ramos, J., Campos-Varela, I., & Pérez-Ríos, M. (2020) · BMJ Global Health · doi:10.1136/bmjgh-2020-003719 · Cited by 67 · see citing works
Korpela, K. M. (2010) · Current Medical Research and Opinion · doi:10.1185/03007991003603804 · Cited by 58 · see citing works
Post retraction citations among manuscripts reporting a radiology-imaging diagnostic method
Bolboacă, S. D., Buhai, D.-V., Aluaș, M., & Bulboacă, A. E. (2019) · PLOS ONE · doi:10.1371/journal.pone.0217918 · Cited by 42 · see citing works
Continued citation of retracted radiation oncology literature—Do we have a problem?
Hamilton, D. G. (2019) · International Journal of Radiation Oncology*Biology*Physics · doi:10.1016/j.ijrobp.2018.11.014 · Cited by 42 · see citing works
Systematic examination of pre‐ and post‐retraction citations
Dinh, L., Sarol, J., Cheng, Y., Hsiao, T., Parulian, N., & Schneider, J. (2019) · Proceedings of the Association for Information Science and Technology · doi:10.1002/pra2.35 · Cited by 23 · see citing works
Retracted articles on stem cells are continuously cited in publications and used by ChatGPT
Zhang, X., Gu, T., Loganathan, S., Xie, Y., & Chen, J. (2025) · Scientometrics · doi:10.1007/s11192-025-05484-y · Cited by 1 · see citing works
Retracted
- Authors
- Redman, B. K., Yarandi, H. N., & Merz, J. F.
- Affiliations
- Wayne State University (US)
- University of Pennsylvania (US)
- Corresponding author
- Redman, B K
- Venue
- Journal of Medical Ethics
- Publisher
- BMJ
- Published
- 2008-10-30
- Volume
- 34
- Issue
- 11
- Pages
- 807-809
- ISSN
- 0306-6800 (ISSN-L)
- 1473-4257
- OpenAlex
- W2016914734
- Cited by
- 91
- References
- 11
- Citations by year
- 2026: 7 · 2025: 1 · 2024: 5 · 2023: 8 · 2022: 8 · 2021: 6 · 2020: 7 · 2019: 5 · 2018: 6 · 2017: 2 · 2016: 5 · 2015: 5 · 2014: 8 · 2013: 1 · 2012: 9
- FWCI
- 7.50
- Type
- journal article
- Language
- en
- Open access
- green
- repository.upenn.edu
- Locations
- Journal of Medical Ethics (publishedVersion)
- PubMed (publishedVersion)
- Scholarly Commons (University of Pennsylvania) (submittedVersion)
- ScholarlyCommons (University of Pennsylvania) (submittedVersion)
- DigitalGeorgetown (Georgetown University Library) (submittedVersion)
- Funders
- U.S. National Library of Medicine
- Topics
- Social Sciences › Safety Research › Academic integrity and plagiarism
- Social Sciences › Decision Sciences › Information Systems and Management › Academic Publishing and Open Access
- Social Sciences › Arts and Humanities › History and Philosophy of Science › Publishing and Scholarly Communication
- Keywords
- research misconduct, research errors, reproducibility, citation analysis, journal editors, scientific records
- MeSH terms
- Authorship, Humans, Retraction of Publication as Topic, Editorial Policies, Biomedical Research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-09-28.
Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-09-28.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review