The DOI matches its Crossref record; 21 of the 21 references it cites were found in a registry or an index.
Stopping Randomized Trials Early for Benefit and Estimation of Treatment Effects<subtitle>Systematic Review and Meta-regression Analysis</subtitle>
Abstract
CONTEXT: Theory and simulation suggest that randomized controlled trials (RCTs) stopped early for benefit (truncated RCTs) systematically overestimate treatment effects for the outcome that precipitated early stopping. OBJECTIVE: To compare the treatment effect from truncated RCTs with that from meta-analyses of RCTs addressing the same question but not stopped early (nontruncated RCTs) and to explore factors associated with overestimates of effect. DATA SOURCES: Search of MEDLINE, EMBASE, Current Contents, and full-text journal content databases to identify truncated RCTs up to January 2007; search of MEDLINE, Cochrane Database of Systematic Reviews, and Database of Abstracts of Reviews of Effects to identify systematic reviews from which individual RCTs were extracted up to January 2008. STUDY SELECTION: Selected studies were RCTs reported as having stopped early for benefit and matching nontruncated RCTs from systematic reviews. Independent reviewers with medical content expertise, working blinded to trial results, judged the eligibility of the nontruncated RCTs based on their similarity to the truncated RCTs. DATA EXTRACTION: Reviewers with methodological expertise conducted data extraction independently. RESULTS: The analysis included 91 truncated RCTs asking 63 different questions and 424 matching nontruncated RCTs. The pooled ratio of relative risks in truncated RCTs vs matching nontruncated RCTs was 0.71 (95% confidence interval, 0.65-0.77). This difference was independent of the presence of a statistical stopping rule and the methodological quality of the studies as assessed by allocation concealment and blinding. Large differences in treatment effect size between truncated and nontruncated RCTs (ratio of relative risks <0.75) occurred with truncated RCTs having fewer than 500 events. In 39 of the 63 questions (62%), the pooled effects of the nontruncated RCTs failed to demonstrate significant benefit. CONCLUSIONS: Truncated RCTs were associated with greater effect sizes than RCTs not stopped early. This difference was independent of the presence of statistical stopping rules and was greatest in smaller studies.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Norman, G. R., Sloan, J. A., & Wyrwich, K. W. (2003) · Medical Care · doi:10.1097/01.mlr.0000062554.74615.4c · Cited by 4,700
Publication bias in clinical trials due to statistical significance or direction of trial results
Hopewell, S., Loudon, K., Clarke, M. J., Oxman, A. D., & Dickersin, K. (2009) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.mr000006.pub3 · Cited by 898
Multiplicity in randomised trials II: subgroup and interim analyses
Schulz, K. F., & Grimes, D. A. (2005) · The Lancet · doi:10.1016/s0140-6736(05)66516-6 · Cited by 357
A proposed charter for clinical trial data monitoring committees: helping them to do their job well
(2005) · The Lancet · doi:10.1016/s0140-6736(05)17965-3 · Cited by 324
Ethical issues in stopping randomized trials early because of apparent benefit.
Mueller, P. S., Montori, V. M., Bassler, D., Koenig, B. A., & Guyatt, G. H. (2007) · Annals of Internal Medicine · doi:10.7326/0003-4819-146-12-200706190-00009 · Cited by 202
When (Not) to Stop a Clinical Trial for Benefit
Pocock, S. J. (2005) · JAMA · doi:10.1001/jama.294.17.2228 · Cited by 163
Practical problems in interim analyses, with particular regard to estimation
Pocock, S. J., & Hughes, M. D. (1989) · Controlled Clinical Trials · doi:10.1016/0197-2456(89)90059-7 · Cited by 160
Early stopping of randomized clinical trials for overt efficacy is problematic.
Bassler, D., Montori, V. M., Briel, M., Glasziou, P., & Guyatt, G. (2008) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2007.07.016 · Cited by 130
Trials stopped early: too good to be true?
Pocock, S., & White, I. R. (1999) · The Lancet · doi:10.1016/s0140-6736(98)00379-1 · Cited by 117
Stopping Medical Research to Save Money
Psaty, B. M., & Rennie, D. (2003) · JAMA · doi:10.1001/jama.289.16.2128 · Cited by 102
Current controversies in data monitoring for clinical trials
Pocock, S. (2006) · Clinical Trials · doi:10.1177/1740774506073467 · Cited by 93
Stopping at Nothing? Some Dilemmas of Data Monitoring in Clinical Trials
Goodman, S. N. (2007) · Annals of Internal Medicine · doi:10.7326/0003-4819-146-12-200706190-00010 · Cited by 90
Stopping clinical trials early for benefit: impact on estimation
Freidlin, B., & Korn, E. L. (2009) · Clinical Trials · doi:10.1177/1740774509102310 · Cited by 82
Be skeptical about unexpected large apparent treatment effects:
Wheatley, K., & Clayton, D. G. (2003) · Controlled Clinical Trials · doi:10.1016/s0197-2456(02)00273-8 · Cited by 73
Systematic reviewers neglect bias that results from trials stopped early for benefit
Bassler, D., González, I. F., Briel, M., Cook, D. J., Devereaux, P. J., Heels-Ansdell, D., Kirpalani, H. M., Meade, M. O., Montori, V. M., Rozenberg, A., et al. (2007) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2006.12.006 · Cited by 63
Self-citationStopping a trial early in oncology: for patients or for industry?
Trotta, F., Apolone, G., Garattini, S. K., & Tafuri, G. (2008) · Annals of Oncology · doi:10.1093/annonc/mdn042 · Cited by 55
Korn, E. L., Freidlin, B., & Mooney, M. (2009) · Journal of Clinical Oncology · doi:10.1200/jco.2008.19.5339 · Cited by 54
Briel, M., Lane, M. A., Montori, V. M., Bassler, D., Glasziou, P., Málaga, G., Akl, E. A., González, I. F., Alonso‐Coello, P., Urrútia, G., et al. (2009) · Trials · doi:10.1186/1745-6215-10-49 · Cited by 30
Self-citationRandomized Trials Stopped Early for Benefit: A Systematic Review
Montori, V. M., Devereaux, P. J., Adhikari, N. K. J., Burns, K. E. A., Eggert, C. H., Briel, M., Lacchetti, C., Leung, T. W., Darling, E., Bryant, D. M., et al. (2005) · JAMA · doi:10.1001/jama.294.17.2203 · Cited by 26
Sargent, D. J. (2009) · Journal of Clinical Oncology · doi:10.1200/jco.2008.20.8611 · Cited by 9
Interim monitoring of efficacy data is important and appropriate
Sydes, M. R., & Parmar, M. (2008) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2007.08.002 · Cited by 9
Cited by
GRADE guidelines: 4. Rating the quality of evidence—study limitations (risk of bias)
Guyatt, G. H., Oxman, A. D., Vist, G., Kunz, R., Brozek, J., Alonso-Coello, P., Montori, V., Akl, E. A., Djulbegovic, B., & Falck-Ytter, Y. (2011) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.07.017 · Cited by 2,798
GRADE guidelines 6. Rating the quality of evidence—imprecision
Guyatt, G. H., Oxman, A. D., Kunz, R., Brozek, J., Alonso-Coello, P., Rind, D., Devereaux, P. J., Montori, V. M., Freyschuss, B., Vist, G., et al. (2011) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2011.01.012 · Cited by 2,693
VTE, Thrombophilia, Antithrombotic Therapy, and Pregnancy
Bates, S. M., Greer, I. A., Middeldorp, S., Veenstra, D. L., Prabulos, A.-M., & Vandvik, P. O. (2012) · Chest · doi:10.1378/chest.11-2300 · Cited by 1,525
Self-citationKangaroo mother care to reduce morbidity and mortality in low birthweight infants
Conde-Agudelo, A., & Díaz-Rossello, J. L. (2016) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd002771.pub4 · Cited by 1,349
The Mediterranean Diet and Cardiovascular Health: A Critical Review
Martínez-González, M. A., Gea, A., & Ruiz-Canela, M. (2019) · Circulation Research · doi:10.1161/circresaha.118.313348 · Cited by 878
Metadata
- Authors
- Bassler, D.
- Venue
- JAMA
- Publisher
- American Medical Association (AMA)
- Published
- 2010-03-24
- Volume
- 303
- Issue
- 12
- Pages
- 1180
- ISSN
- 0002-9955 (ISSN-L)
- 0098-7484
- OpenAlex
- W2163724055
- Cited by
- 611
- References
- 21
- FWCI
- 52.60
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.