How long does it take for the scientific literature to purge itself of fraudulent material?: the Breuning case revisited
The DOI matches its Crossref record; 25 of the 26 references it cites were found in a registry or an index.
Abstract
OBJECTIVE: It has been proposed that the scientific literature purges itself of articles known to be fraudulent. To test this, an investigation was carried out of post-retraction citations over a 19-year period in the Breuning case. METHODS: On 10 March 2008 a cited reference search was conducted (all languages, all document types) using the name 'Breuning SE*'. The time limit was 1989-2007 with an option to exclude self-citations. The search included the ISI Web of Science Database including the Science Citation Index Expanded, the Social Sciences Citations Index and the Arts & Humanities Citation Index. To ascertain the citation context, citations of Breuning were classified by two raters as affirmative, negative or neutral. FINDINGS: For the period 1989-2000 both negative and affirmative citations were found. For the period 2001-2006 only affirmative citations (even to retracted articles) were found, some in journals with higher impact factors than those citing the case as fraudulent. In spite of the small number of citations of Breuning's articles, it is alarming that the affirmative citing of fraudulent research has not completely ceased but continues 24 years post-retraction (retracted 1982, cited 2006). While the limitations of a single case study are conceded, the results challenge the belief of scientific literature purging itself of fraudulent material. CONCLUSIONS: Retraction databases and widespread availability of computer software to check lists of references free of charge in any database or the internet are called for. Moreover, if a paper is never formally retracted, software for searching author names in the internet for fully investigated and proven scientific misconduct might be developed. The ethical guidelines on duplicate publication for purposes of disseminating the information as widely as possible should be reviewed.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“it is known that positive post-retraction citations can persist over decades in individual cases-for instance, 24years for 'an article retracted in 1982, but cited in 2006' in the field of psychiatry (Korpela 2010).”
From Continued post-retraction citation of a fraudulent clinical trial report, 11 years after it was retracted for falsifying data (2020) · cites this paper as Korpela 2010
Citations
Cites
Martinson, B. C., Anderson, M. S., & de Vries, R. (2005) · Nature · doi:10.1038/435737a · Cited by 1,096 · cited 1×
“Proposed solutions concentrate on controlling or consulting the behaviour of individuals and on the institutional and systemic structures 19 .”
BackgroundPhenomena of Retraction: Reasons for Retraction and Citations to the Publications
Budd, J. M., Sievert, M., & Schultz, T. R. (1998) · JAMA · doi:10.1001/jama.280.3.296 · Cited by 230
Sox, H. C., & Rennie, D. (2006) · Annals of Internal Medicine · doi:10.7326/0003-4819-144-8-200604180-00123 · Cited by 200
Effects of article retraction on citation and practice in medicine.
(1999) · Europe PMC (PubMed Central) · Cited by 101
Empirical developments in retraction
Redman, B. K., Yarandi, H. N., & Merz, J. F. (2008) · Journal of Medical Ethics · doi:10.1136/jme.2007.023069 · Cited by 91
Responsible conduct in research
Drenth, P. J. D. (2006) · Science and Engineering Ethics · doi:10.1007/s11948-006-0003-1 · Cited by 66 · cited 1×
“Moreover, it has been shown that authors do not seem to notice the retraction and erratum tags such as those in the PubMed database 16 .”
BackgroundBornmann, L., Nast, I., & Daniel, H.-D. (2008) · Scientometrics · doi:10.1007/s11192-007-1950-2 · Cited by 66 · cited 1×
“It is known that the peer review system is not geared toward detecting scientific misconduct or fraud but is largely based on trust 17 .”
BackgroundRetraction policies of high-impact biomedical journals.
Atlas, M. (2004) · Europe PMC (PubMed Central) · Cited by 59
Aman, M. G., Teehan, C. J., White, A. J., Turbott, S. H., & Vaithianathan, C. (1989) · PubMed · Cited by 56
(1990) · PubMed · Cited by 52
... And How the Problems Eluded Peer Reviewers and Editors
Couzin, J. (2006) · Science · doi:10.1126/science.311.5757.23 · Cited by 49 · cited 1×
“Since around 2000 some major medical journals (for example, JAMA) have begun to require all authors to declare in detail their contribution to the work 21 .”
BackgroundThe Scientific Community's Response to Evidence of Fraudulent Publication: The Robert Slutsky Case
Whitely, W. P. (1994) · JAMA · doi:10.1001/jama.1994.03520020096029 · Cited by 47
The Impact of Fraudulent Research on the Scientific Literature: The Stephen E. Breuning Case
Garfield, E. (1990) · JAMA · doi:10.1001/jama.1990.03440100144021 · Cited by 44
Neuroleptics in Pediatric Psychiatry
Whitaker, A. H., & Rao, U. (1992) · Psychiatric Clinics of North America · doi:10.1016/s0193-953x(18)30267-3 · Cited by 38 · cited 1×
“Of the remaining 13 articles (Table 2), three cited Breuning as a case of fraud 13–15 .”
BackgroundFraud: retracted articles are still being cited
Campanario, J. M. (2000) · Nature · doi:10.1038/35042753 · Cited by 28
Publishing Ethics in Psychiatry
Walter, G., & Bloch, S. (2001) · Australian & New Zealand Journal of Psychiatry · doi:10.1046/j.1440-1614.2001.00838.x · Cited by 27
An analysis of citations to retracted articles in the scientific literature
Gabehart, M. E. (2005) · Carolina Digital Repository (University of North Carolina at Chapel Hill) · doi:10.17615/dy5f-y998 · Cited by 20
Recent Studies in Psychopharmacology in Mental Retardation
Aman, M. G. (1997) · International review of research in mental retardation · doi:10.1016/s0074-7750(08)60278-5 · Cited by 9 · cited 1×
“Of the remaining 13 articles (Table 2), three cited Breuning as a case of fraud 13–15 .”
BackgroundSprague, R. L. (1998) · Science and Engineering Ethics · doi:10.1007/s11948-998-0005-2 · Cited by 9 · cited 1×
“Applied Research in Mental Retardation, 1(3-4): 175–192.”
Publishing Ethics in Child and Adolescent Psychiatry: Essentials for Authors and Readers
Walter, G., Rey, J. M., Soh, N. L., & Bloch, S. (2007) · Child and Adolescent Psychiatric Clinics of North America · doi:10.1016/j.chc.2007.07.002 · Cited by 3 · cited 1×
“Of these 16 articles citing Breuning, three articles were specifically about publishing ethics and cited the Breuning case as a fraud 1–3 .”
BackgroundThe consequences of a fraudulent scientist on his innocent coinvestigators
Wysocki, T. (1990) · JAMA · doi:10.1001/jama.264.24.3145 · Cited by 3
(2002) · Nature Neuroscience · doi:10.1038/nn1202-1249 · Cited by 2
The Consequences of a Fraudulent Scientist on His Innocent Coinvestigators-Reply
Rennie, D. (1990) · JAMA · doi:10.1001/jama.1990.03450240047025 · Cited by 1
Cardiac Surgery in La Jolla: An Error Perpetuated
Carmichael, D. B. (1990) · JAMA · doi:10.1001/jama.1990.03450240048026 · Cited by 1
Kochan, C. (1992) · doi:10.1002/(sici)1097-4571(199208)43:7<488::aid-asi3>3.0.co;2-7
Research works printed but not linked: 6
- Budd JM, 1999, Bull Med Libr Assoc, 87, 437
- 10.1001/jama.264.24.3146 · doi:10.1001/jama.264.24.3146
- Aman MG, 1989, Am J Ment Retard, 93, 452
- Neale AV, 2007, Sci Eng Ethics, 13, 5
- Atlas MC, 2004, J Med Libr Assoc, 92, 242
- Council of Science Editors. CSE’s white paper on promoting integrity in scientific journal publications, 2009. Available at: www.councilscienceeditors.org /editorial_policies/white_paper.cfm [Last accessed 11 November 2009]
Cited by
Why has the number of scientific retractions increased?
Steen, R. G., Casadevall, A., & Fang, F. C. (2013) · PLoS ONE · doi:10.1371/journal.pone.0068397 · Cited by 415
Retracted Science and the Retraction Index
Fang, F. C., & Casadevall, A. (2011) · Infection and Immunity · doi:10.1128/iai.05661-11 · Cited by 405
RetractedA Comprehensive Survey of Retracted Articles from the Scholarly Literature
Grieneisen, M. L., & Zhang, M. (2012) · PLoS ONE · doi:10.1371/journal.pone.0044118 · Cited by 355
“Although retraction usually occurs a few years post-publication ([6] and Table S2), roughly 1/3 (19/ 58) of the articles mentioned in these notices had been formally retracted by 2 Aug 2011.”
BackgroundRetractions in the scientific literature: do authors deliberately commit research fraud?
Steen, R. G. (2011) · Journal of Medical Ethics · doi:10.1136/jme.2010.038125 · Cited by 217
“Science is said to be self-correcting, so the literature purges itself of papers deemed fraudulent.(4) If indeed the literature self-corrects, then research fraud should be futile.”
BackgroundThe Retraction Penalty: Evidence from the Web of Science
Lu, S. F., Jin, G. Z., Uzzi, B., & Jones, B. (2013) · Scientific Reports · doi:10.1038/srep03146 · Cited by 191
Metadata
- Authors
- Korpela, K. M.
- Affiliations
- University of Tampere (FI)
- Corresponding author
- Korpela, K.M.
- ORCID
- Korpela, K.M.
- Venue
- Current Medical Research and Opinion
- Publisher
- Informa Healthcare
- Published
- 2010-02-08
- Volume
- 26
- Issue
- 4
- Pages
- 843-847
- ISSN
- 0300-7995 (ISSN-L)
- 1473-4877
- OpenAlex
- W2148833989
- Cited by
- 58
- References
- 26
- Citations by year
- 2026: 1 · 2025: 2 · 2024: 2 · 2023: 4 · 2022: 3 · 2021: 7 · 2020: 6 · 2019: 1 · 2018: 5 · 2016: 3 · 2015: 3 · 2014: 4 · 2013: 6 · 2012: 6
- FWCI
- 14.26
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Current Medical Research and Opinion (publishedVersion)
- PubMed (publishedVersion)
- DigitalGeorgetown (Georgetown University Library) (submittedVersion)
- Funders
- Center for Advanced Study, University of Illinois at Urbana-Champaign
- Topics
- Social Sciences › Education › Academic integrity and plagiarism
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Keywords
- research misconduct, retracted article, scientific fraud, citation analysis, duplicate publication
- MeSH terms
- Humans, Retraction of Publication as Topic, Bibliometrics, Scientific Misconduct, Databases, Bibliographic, Information Storage and Retrieval, Information Dissemination, Biomedical Research, History, 20th Century
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.