A Case-Control Comparison of Retracted and Non-Retracted Clinical Trials: Can Retraction Be Predicted?
Open accessThe DOI matches its Crossref record; 27 of the 27 references it cites were found in a registry or an index.
Abstract
Does scientific misconduct severe enough to result in retraction disclose itself with warning signs? We test a hypothesis that variables in the results section of randomized clinical trials (RCTs) are associated with retraction, even without access to raw data. We evaluated all English-language RCTs retracted from the PubMed database prior to 2011. Two controls were selected for each case, matching publication journal, volume, issue, and page as closely as possible. Number of authors, subjects enrolled, patients at risk, and patients treated were tallied in cases and controls. Among case RCTs, 17.5% had ≤2 authors, while 6.3% of control RCTs had ≤2 authors. Logistic regression shows that having few authors is associated with retraction (p < 0.03), although the number of subjects enrolled, patients at risk, or treated patients is not. However, none of the variables singly, nor all of the variables combined, can reliably predict retraction, perhaps because retraction is such a rare event. Exploratory analysis suggests that retraction rate varies by medical field (p < 0.001). Although retraction cannot be predicted on the basis of the variables evaluated, concern is warranted when there are few authors, enrolled subjects, patients at risk, or treated patients. Ironically, these features urge caution in evaluating any RCT, since they identify studies that are statistically weaker.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures


Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“The retracted trials (89.0%) were not usually multicentre studies, typically received academic funding or failed to report funding sources (89.5%), and were more likely to be unregistered (81.3%); these findings are in accordance with previous studies.14 98 99”
From Investigating the impact of trial retractions on the healthcare evidence ecosystem (VITALITY Study I): retrospective cohort study (2025) · cites this paper as [99]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
1 retracted
Bezwoda, W. R., Seymour, L., & Dansey, R. D. (1995) · Journal of Clinical Oncology · doi:10.1200/jco.1995.13.10.2483 · Cited by 400 · cited 2×
“Werner Bezwoda claimed to show that high-dose chemotherapy with stem cell rescue was a useful treatment for breast cancer [17].”
BackgroundRetractedWhy Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · PLoS Medicine · doi:10.1371/journal.pmed.0020124 · Cited by 10,505
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · CHANCE · doi:10.1080/09332480.2005.10722754 · Cited by 4,702 · cited 1×
“We concur that the best overall predictor of the replication of published work is the sample size of subjects enrolled [26], not only because a large sample size is more likely to lead to a replicable finding [27], but also because a large sample size may be harder to fabricate.”
BackgroundContradicted and Initially Stronger Effects in Highly Cited Clinical Research
Ioannidis, J. P. A. (2005) · JAMA · doi:10.1001/jama.294.2.218 · Cited by 1,465 · cited 1×
“We concur that the best overall predictor of the replication of published work is the sample size of subjects enrolled [26], not only because a large sample size is more likely to lead to a replicable finding [27], but also because a large sample size may be harder to fabricate.”
BackgroundStadtmauer, E. A., O'Neill, A., Goldstein, L. J., Crilley, P. A., Mangan, K. F., Ingle, J. N., Brodsky, I., Martino, S., Lazarus, H. M., Erban, J. K., et al. (2000) · New England Journal of Medicine · doi:10.1056/nejm200004133421501 · Cited by 460
Retractions in the scientific literature: is the incidence of research fraud increasing?
Steen, R. G. (2011) · Journal of Medical Ethics · doi:10.1136/jme.2010.040923 · Cited by 405 · cited 1×
“What should balance these factors is an ethical consideration for the wellbeing of the patient, since fraudulent clinical research may put patients at risk [2–5].”
BackgroundSelf-citationBergh, J., Wiklund, T., Erikstein, B., Lidbrink, E., Lindman, H., Malmström, P., Kellokumpu-Lehtinen, P., Bengtsson, N.-O., Söderlund, G., Anker, G., et al. (2000) · The Lancet · doi:10.1016/s0140-6736(00)02841-5 · Cited by 339 · cited 1×
“Subsequent clinical trials showed that high-dose treatment with stem cell rescue did little [20] or nothing to extend survival of breast cancer patients [21–24], though such treatment was associated with more frequent adverse events [22], at least in the short term [25].”
BackgroundHigh-Dose Chemotherapy with Hematopoietic Stem-Cell Rescue for High-Risk Breast Cancer
Rodenhuis, S., Bontenbal, M., Beex, L. V. A. M., Wagstaff, J., Richel, D. J., Nooij, M. A., Voest, E. E., Hupperets, P., van Tinteren, H., Peterse, H. L., et al. (2003) · New England Journal of Medicine · doi:10.1056/nejmoa022794 · Cited by 258 · cited 1×
“Subsequent clinical trials showed that high-dose treatment with stem cell rescue did little [20] or nothing to extend survival of breast cancer patients [21–24], though such treatment was associated with more frequent adverse events [22], at least in the short term [25].”
BackgroundRetractions in the scientific literature: do authors deliberately commit research fraud?
Steen, R. G. (2011) · Journal of Medical Ethics · doi:10.1136/jme.2010.038125 · Cited by 217 · cited 2×
“Papers that met these criteria were further evaluated, using an established analytic approach [3].”
BackgroundMethodSelf-citationTallman, M. S., Gray, R., Robert, N. J., LeMaistre, C. F., Osborne, C. K., Vaughan, W. P., Gradishar, W. J., Pisansky, T. M., Fetting, J., Paietta, E., et al. (2003) · New England Journal of Medicine · doi:10.1056/nejmoa030684 · Cited by 191 · cited 1×
“Subsequent clinical trials showed that high-dose treatment with stem cell rescue did little [20] or nothing to extend survival of breast cancer patients [21–24], though such treatment was associated with more frequent adverse events [22], at least in the short term [25].”
Background
Research works printed but not linked: 1
- Steen, 2011, Retractions in the medical literature: Who is responsible for scientific integrity?, AMWA J., 26, 2
Cited by
The visibility of scientific misconduct: A review of the literature on retracted journal articles
Hesselmann, F., Graf, V., Schmidt, M., & Reinhart, M. (2017) · Current Sociology · doi:10.1177/0011392116663807 · Cited by 153
“(Continued) Publication Data sampling strategies Sample size, retraction rates Reasons for retraction Snodgrass and Pfeifer, 1992 PubMed 1975–1991 Publication type: ‘Retraction of Publication’ 97 retraction notices Steen and Hamer, 2014 PubMed ?”
BackgroundMethodSelf-correction in biomedical publications and the scientific impact
Gasparyan, A. Y., Ayvazyan, L., Akazhanov, N. A., & Kitas, G. D. (2014) · Croatian Medical Journal · doi:10.3325/cmj.2014.55.61 · Cited by 73
Xu, C., Fan, S., Tian, Y., Liu, F., Furuya-Kanamori, L., Clark, J., Zhang, C., Li, S., Lin, L., Chu, H., et al. (2025) · BMJ · doi:10.1136/bmj-2024-082068 · Cited by 39
Schneider, J., Woods, N. D., Proescholdt, R., Fu, Y., & The RISRS Team (2021) · MetArXiv (OSF Preprints) · doi:10.31222/osf.io/ms579 · Cited by 18
Research on retractions: A systematic review and research agenda
Mertkan, Ş., Mills, D., Takır, A., & Sarıkaya, E. E. (2025) · Accountability in Research · doi:10.1080/08989621.2025.2542203 · Cited by 11
Metadata
- Authors
- Steen, R., & Hamer, R.
- Affiliations
- Medical Communications Consultants LLC, 103 Van Doren Place, Chapel Hill, NC 27517, USA
- University of North Carolina at Chapel Hill (US)
- Corresponding author
- Steen, R.
- ORCID
- Steen, R.
- Venue
- Publications
- Publisher
- MDPI AG
- Published
- 2014-01-27
- Volume
- 2
- Issue
- 1
- Pages
- 27-37
- ISSN
- 2304-6775 (ISSN-L)
- OpenAlex
- W2044381503
- Cited by
- 7
- References
- 27
- Citations by year
- 2025: 3 · 2024: 1 · 2021: 1 · 2016: 1 · 2014: 1
- FWCI
- 1.86
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Publications (publishedVersion, cc-by)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Topics
- Social Sciences › Education › Academic integrity and plagiarism
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Keywords
- retraction, research misconduct, randomized controlled trials, number of authors, study size, warning signs, research integrity
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: A Case-Control Comparison of Retracted and Non-Retracted Clinical Trials: Can Retraction Be Predicted? https://app.cochat.ai/papers/10.3390/publications2010027
- The paper
- Steen, R., & Hamer, R. (2014). A Case-Control Comparison of Retracted and Non-Retracted Clinical Trials: Can Retraction Be Predicted? Publications. https://doi.org/10.3390/publications2010027
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.