Unsuccessful trial accrual and human subjects protections: An empirical analysis of recently closed trials
Open accessThe DOI matches its Crossref record; 17 of the 17 references it cites were found in a registry or an index.
Abstract
Background: Ethical evaluation of risk–benefit in clinical trials is premised on the achievability of resolving research questions motivating an investigation. Objective: To determine the fraction and number of patients enrolled in trials that were at risk of not meaningfully addressing their primary research objective due to unsuccessful patient accrual. Methods: We used the National Library of Medicine clinical trial registry to capture all initiated phases 2 and 3 intervention clinical trials that were registered as closed in 2011. We then determined the number that had been terminated due to unsuccessful accrual and the number that had closed after less than 85% of the target number of human subjects had been enrolled. Five factors were tested for association with unsuccessful accrual. Results: Of 2579 eligible trials, 481 (19%) either terminated for failed accrual or completed with less than 85% expected enrolment, seriously compromising their statistical power. Factors associated with unsuccessful accrual included greater number of eligibility criteria (p = 0.013), non-industry funding (25% vs 16%, p < 0.0001), earlier trial phase (23% vs 16%, p < 0.0001), fewer number of research sites at trial completion (p < 0.0001) and at registration (p < 0.0001), and an active (non-placebo) comparator (23% vs 16%, p < 0.001). Conclusion: A total of 48,027 patients had enrolled in trials closed in 2011 who were unable to answer the primary research question meaningfully. Ethics bodies, investigators, and data monitoring committees should carefully scrutinize trial design, recruitment plans, and feasibility of achieving accrual targets when designing and reviewing trials, monitor accrual once initiated, and take corrective action when accrual is lagging.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“It has been estimated that approximately 86% of clinical trials fail to meet recruitment goals within their specified timeframe [3].”
From Recruitment of low-income pregnant women into a dietary and dental care intervention: lessons from a feasibility trial (2020) · cites this paper as [3]
In the citing paper
“A systematic review published in 2015 investigating causes of unsuccessful trial accrual found that 19% of trials had either an early termination due to recruitment failure or completion reaching only 85% of the expected enrolment target [3].”
From Recruitment of low-income pregnant women into a dietary and dental care intervention: lessons from a feasibility trial (2020) · cites this paper as [3]
In the citing paper
“Recruitment challenges, low adherence, and high rates of attrition commonly compromise randomised controlled trials [55, 56]”
Citations
Cites
(2003) · Manual for Research Ethics Committees · doi:10.1017/cbo9780511550089.028 · Cited by 3,413
Barriers to Participation in Randomised Controlled Trials
Ross, S., Grant, A., Counsell, C., Gillespie, W., Russell, I., & Prescott, R. (1999) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(99)00141-9 · Cited by 907 · cited 1×
“At the outset of our study, we identified five factors that we believed may confer risk of unsuccessful accrual: earlier study phase, non-industry lead sponsor, smaller number of research sites,(12) more eligibility criteria, and use of placebo comparators.(8,13,14) Our hypothesis was that trials in earlier stages of…”
BackgroundThe Continuing Unethical Conduct of Underpowered Clinical Trials
Halpern, S. D. (2002) · JAMA · doi:10.1001/jama.288.3.358 · Cited by 547
Scoggins, J. F., & Ramsey, S. D. (2010) · JNCI Journal of the National Cancer Institute · doi:10.1093/jnci/djq291 · Cited by 318 · cited 1×
“A subsequent IOM report indicated that 40% or more NCI-sponsored phase 3 trials failed to meet accrual goals.(5) An NCI study of 149 trials estimated that 28.”
BackgroundPrayle, A. P., Hurley, M. N., & Smyth, A. R. (2012) · BMJ · doi:10.1136/bmj.d7373 · Cited by 290 · cited 1×
“First, the NLM clinical trial register contains many erroneous entries.(16) We confirmed that target recruitment numbers at registration are consistent with expected enrolment at first date of enrolment.”
Background(1973) · Educational Researcher · doi:10.3102/0013189x002011010 · Cited by 195
(1973) · Educational Researcher · doi:10.2307/1175176 · Cited by 150
Cheng, S. K., Dietrich, M. S., & Dilts, D. M. (2010) · Clinical Cancer Research · doi:10.1158/1078-0432.ccr-10-0133 · Cited by 124 · cited 4×
“For example, had we chosen to define unsuccessful accrual as a failure to achieve 100% of expected enrolment (the same cut-off used by Cheng et al.(4)) rather than our actual 85% cut-off, 676 trials, representing 26% of our identified eligible trials, and 146,157 patients would fall below this threshold.”
BackgroundMethodInfluentialSurvey among 78 studies showed that Lasagna's law holds in Dutch primary care research
van der Wouden, J. C., Blankenstein, A. H., Huibers, M. J. H., van der Windt, D. A. W. M., Stalman, W. A. B., & Verhagen, A. P. (2007) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2006.11.010 · Cited by 122 · cited 1×
“Louis Lasagna famously observed that when trial recruitment starts, ‘the supply of suitable patients becomes a fraction of what it was assumed to be before the trial began’.(7) Failure to enrol and retain a target sample reduces a study’s statistical power, compromising its prospect of delivering a statistically infor…”
BackgroundPeters-Lawrence, M. H., Bell, M. C., Hsu, L. L.-Y., Osunkwo, I., Seaman, P., Blackwood, M., Guillaume, E., Bellevue, R., Krishnamurti, L., Smith, W. R., et al. (2011) · Contemporary Clinical Trials · doi:10.1016/j.cct.2011.11.018 · Cited by 74 · cited 1×
“At the outset of our study, we identified five factors that we believed may confer risk of unsuccessful accrual: earlier study phase, non-industry lead sponsor, smaller number of research sites,(12) more eligibility criteria, and use of placebo comparators.(8,13,14) Our hypothesis was that trials in earlier stages of…”
Background
Cited by
Fogel, D. B. (2018) · Contemporary Clinical Trials Communications · doi:10.1016/j.conctc.2018.08.001 · Cited by 1,035
Huang, G. D., Bull, J., Johnston McKee, K., Mahon, E., Harper, B., & Roberts, J. N. (2018) · Contemporary Clinical Trials · doi:10.1016/j.cct.2018.01.003 · Cited by 294
Williams, R. J., Tse, T., DiPiazza, K., & Zarin, D. A. (2015) · PLOS ONE · doi:10.1371/journal.pone.0127242 · Cited by 226
“[11, 12] More recently, clinical trial registries have been used to evaluate reasons for termination across a broader range of trials,[13] but less attention has been given to understanding the extent to which primary outcome data from terminated trials are currently disseminated in the ClinicalTrials.”
BackgroundA Framework for Ethical Payment to Research Participants
Gelinas, L., Largent, E. A., Cohen, I. G., Kornetsky, S., Bierer, B. E., & Fernandez Lynch, H. (2018) · New England Journal of Medicine · doi:10.1056/nejmsb1710591 · Cited by 193
Discontinuation and Nonpublication of Randomized Clinical Trials Conducted in Children
Pica, N., & Bourgeois, F. (2016) · Pediatrics · doi:10.1542/peds.2016-0223 · Cited by 191
“22 Trial discontinuation due to safety or efficacy findings, or changes in standard of care 23 were considered informative terminations.(26) 24”
BackgroundResult
Metadata
- Authors
- Carlisle, B., Kimmelman, J., Ramsay, T., & MacKinnon, N.
- Affiliations
- McGill University (CA)
- Ottawa Hospital Research Institute (CA)
- Venue
- Clinical Trials
- Publisher
- SAGE Publications
- Published
- 2014-12-04
- Volume
- 12
- Issue
- 1
- Pages
- 77-83
- ISSN
- 1740-7745 (ISSN-L)
- 1740-7753
- PMC
- PMC4516407
- OpenAlex
- W2128251606
- Semantic Scholar
- 1a983ca27ffb28de53b5bc560ea9d9f0f00c749c
- Cited by
- 367
- References
- 16
- Citations by year
- 2026: 29 · 2025: 35 · 2024: 44 · 2023: 37 · 2022: 55 · 2021: 53 · 2020: 37 · 2019: 24 · 2018: 23 · 2017: 18 · 2016: 8 · 2015: 3
- FWCI
- 9.58
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Licence
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
- Locations
- Clinical Trials (publishedVersion)
- PubMed (publishedVersion)
- Europe PMC (PubMed Central) (acceptedVersion)
- PubMed Central (acceptedVersion)
- Funders
- Canadian Institutes of Health Research (MOP119574, 119574_1)
- Topics
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Ethics in Clinical Research
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Health Sciences › Nursing › Issues, ethics and legal aspects › Biomedical Ethics and Regulation
- Keywords
- clinical trial accrual, trial closure, research participant protection, risk-benefit assessment, statistical power, eligibility criteria, trial funding, trial phase, study sites, active comparator, trial design, data monitoring committees, ethical review
- MeSH terms
- Humans, Human Experimentation, Research Design, United States, Clinical Trials, Phase II as Topic, Clinical Trials, Phase III as Topic, Risk Assessment, Patient Selection, Early Termination of Clinical Trials
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Unsuccessful trial accrual and human subjects protections: An empirical analysis of recently closed trials. https://app.cochat.ai/papers/10.1177/1740774514558307
- The paper
- Carlisle, B., Kimmelman, J., Ramsay, T., & MacKinnon, N. (2015). Unsuccessful trial accrual and human subjects protections: An empirical analysis of recently closed trials. Clinical Trials. https://doi.org/10.1177/1740774514558307
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.