Fate of Articles That Warranted Retraction Due to Ethical Concerns: A Descriptive Cross-Sectional Study
Open accessThe DOI matches its Crossref record; 16 of the 16 references it cites were found in a registry or an index.
Abstract
OBJECTIVE: To study journals' responses to a request from the State Medical Association of Rheinland-Pfalz, Germany, to retract 88 articles due to ethical concerns, and to check whether the resulting retractions followed published guidelines. DESIGN: Descriptive cross-sectional study. POPULATION: 88 articles (18 journals) by the anaesthesiologist Dr. Boldt, that warranted retraction. METHOD: According to the recommendations of the Committee on Publication Ethics, we regarded a retraction as adequate when a retraction notice was published, linked to the retracted article, identified the title and authors of the retracted article in its heading, explained the reason and who took responsibility for the retraction, and when the retracted article was freely accessible and marked using a transparent watermark that preserved original content. Two authors extracted data independently (January 2013) and contacted editors-in-chief and publishers for clarification in cases of inadequate retraction. RESULTS: Five articles (6%) fulfilled all criteria for adequate retraction. Nine (10%) were not retracted (no retraction notice published, full text article not marked). 79 (90%) retraction notices were published, 76 (86%) were freely accessible, but only 15 (17%) were complete. 73 (83%) full text articles were marked as retracted, of which 14 (16%) had an opaque watermark hiding parts of the original content, and 11 (13%) had all original content deleted. 59 (67%) retracted articles were freely accessible. One editor-in-chief stated personal problems as a reason for incomplete retractions, eight blamed their publishers. Two publishers cited legal threats from Dr. Boldt's co-authors which prevented them from retracting articles. CONCLUSION: Guidelines for retracting articles are incompletely followed. The role of publishers in the retraction process needs to be clarified and standards are needed on marking retracted articles. It remains unclear who should check that retractions are done properly. Legal safeguards are required to allow retraction of articles against the wishes of authors.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures



Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Delays in retraction by journals, even in response to official notification by investigating authorities, continue to be problematic and contribute to the impact of retracted work.93”
From An investigation into the impact and implications of published papers from retracted research: systematic search of affected literature (2019) · cites this paper as [93]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“In a study of 88 articles by anaesthesiologist Dr. Boldt, which 18 journals had agreed to retract in 2011, 9/88 (10%) had yet to be retracted by 2013 [19].”
From Media and social media attention to retracted articles according to Altmetric (2021) · cites this paper as [19]
In the citing paper
“and only 48 (61%) were adequately marked as retracted.”
From Media and social media attention to retracted articles according to Altmetric (2021) · cites this paper as [19]
In the citing paper
“Of the 79 retracted, only 15 (19%) were accompanied with an “adequate” retraction notice”
From Media and social media attention to retracted articles according to Altmetric (2021) · cites this paper as [19]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
1 retracted
Retracted Science and the Retraction Index
Fang, F. C., & Casadevall, A. (2011) · Infection and Immunity · doi:10.1128/iai.05661-11 · Cited by 405 · cited 2×
“Once an institution has determined that misconduct involving a research publication has occurred, journals are obliged to consider retraction of the work [11].”
BackgroundRetractedWhy and how do journals retract articles? An analysis of Medline retractions 1988–2008
Wager, E., & Williams, P. (2011) · Journal of Medical Ethics · doi:10.1136/jme.2010.040964 · Cited by 263 · cited 2×
“In earlier cases, some occurring before these recommendations were published, journals were found not to have retracted articles appropriately [5,6].”
BackgroundSelf-citationSox, H. C., & Rennie, D. (2006) · Annals of Internal Medicine · doi:10.7326/0003-4819-144-8-200604180-00123 · Cited by 200 · cited 3×
“In addition (following other recommendations) we checked whether the full text article was freely accessible [5], and whether the original content was preserved [10].”
BackgroundThe Continued Use of Retracted, Invalid Scientific Literature
Pfeifer, M. P. (1990) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.1990.03440100140020 · Cited by 188 · cited 1×
“As long ago as 1990 it was recognised that authors, editors, reviewers, and librarians all needed to be involved in a multifaceted approach to address the continued use of invalid data [15]; interestingly, publishers were ignored at that time.”
BackgroundCorrecting the Literature Following Fraudulent Publication
Friedman, P. J. (1990) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.1990.03440100136019 · Cited by 72 · cited 2×
“It has been claimed that, once an institution has identified fraud or significant error, it is then up to the journals to respond promptly and properly [4,14].”
BackgroundRetraction policies of high-impact biomedical journals.
Atlas, M. (2004) · Europe PMC (PubMed Central) · Cited by 59
(1990) · PubMed · Cited by 52
The Scientific Community's Response to Evidence of Fraudulent Publication: The Robert Slutsky Case
Whitely, W. P. (1994) · JAMA · doi:10.1001/jama.1994.03520020096029 · Cited by 47 · cited 1×
“Since science must be selfcorrecting, retraction of unreliable articles is an essential step for rectifying the scientific knowledge-base [11], although it has been shown that it is probably insufficient to inform the scientific community [12].”
BackgroundThe Impact of Fraudulent Research on the Scientific Literature: The Stephen E. Breuning Case
Garfield, E. (1990) · JAMA · doi:10.1001/jama.1990.03440100144021 · Cited by 44
Tramèr, M. R. (2013) · European Journal of Anaesthesiology · doi:10.1097/eja.0b013e328360a0db · Cited by 36 · cited 1×
“Since, an even larger case of scientific misconduct, necessitating the retraction of 183 articles, has been uncovered [21].”
BackgroundSelf-citation
Research works printed but not linked: 1
- EIC Joint Statement on Retractions Available:http://journals.lww.com/ejanaesthesiology/Documents/EIC%20Joint%20Statement%20on%20Retractions%2012Mar2011.pdf. Accessed 12 August 2013.
Cited by
Moylan, E. C., & Kowalczuk, M. K. (2016) · BMJ Open · doi:10.1136/bmjopen-2016-012047 · Cited by 212
The visibility of scientific misconduct: A review of the literature on retracted journal articles
Hesselmann, F., Graf, V., Schmidt, M., & Reinhart, M. (2017) · Current Sociology · doi:10.1177/0011392116663807 · Cited by 153
“In a similar study of Joachim Boldt’s case, Elia et al. (2014) find that 10% of the incriminated articles were not retracted and that the retractions do not exhibit a standard format.”
BackgroundWhy do some retracted papers continue to be cited?
Teixeira da Silva, J. A., & Bornemann-Cimenti, H. (2017) · Scientometrics · doi:10.1007/s11192-016-2178-9 · Cited by 111
“Elia et al. (2014) demonstrated, however, that only 6% of retracted articles fulfilled all criteria adequately while only 83% had the full text marked as retracted.”
BackgroundSchneider, J., Ye, D., Hill, A. M., & Whitehorn, A. S. (2020) · Scientometrics · doi:10.1007/s11192-020-03631-1 · Cited by 88
Bornemann-Cimenti, H., Szilagyi, I. S., & Sandner-Kiesling, A. (2016) · Science and Engineering Ethics · doi:10.1007/s11948-015-9680-y · Cited by 87
“Up to 32 % of the withdrawn articles are not labeled as retracted (Steen 2011; Elia et al. 2014).”
Background
Metadata
- Authors
- Elia, N., Wager, E., & Tramèr, M. R.
- Affiliations
- University of Geneva (CH)
- Corresponding author
- Elia, Nadia
- Venue
- PLoS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2014-01-22
- Volume
- 9
- Issue
- 1
- Pages
- e85846
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC3899113
- OpenAlex
- W2067893443
- Cited by
- 67
- References
- 16
- Citations by year
- 2026: 2 · 2025: 5 · 2024: 4 · 2023: 7 · 2022: 3 · 2021: 5 · 2020: 3 · 2019: 7 · 2018: 7 · 2017: 3 · 2016: 7 · 2015: 7 · 2014: 7
- FWCI
- 22.28
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- PLoS ONE (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Archive ouverte UNIGE (University of Geneva) (publishedVersion, other-oa)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Archive ouverte UNIGE (University of Geneva) (submittedVersion, cc-by)
- Topics
- Social Sciences › Education › Academic integrity and plagiarism
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Social Sciences › Library and Information Sciences › Publishing and Scholarly Communication
- Keywords
- retraction, publication ethics, Committee on Publication Ethics, watermarking, journal editors, publishers, research misconduct
- MeSH terms
- Humans, Periodicals as Topic, Publishing, Retraction of Publication as Topic, Scientific Misconduct, Editorial Policies, Biomedical Research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Fate of Articles That Warranted Retraction Due to Ethical Concerns: A Descriptive Cross-Sectional Study. https://app.cochat.ai/papers/10.1371/journal.pone.0085846
- The paper
- Elia, N., Wager, E., & Tramèr, M. R. (2014). Fate of Articles That Warranted Retraction Due to Ethical Concerns: A Descriptive Cross-Sectional Study. PLoS ONE. https://doi.org/10.1371/journal.pone.0085846
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.