The DOI matches its Crossref record; 21 of the 21 references it cites were found in a registry or an index.
Stopping Randomized Trials Early for Benefit and Estimation of Treatment Effects<subtitle>Systematic Review and Meta-regression Analysis</subtitle>
Abstract
CONTEXT: Theory and simulation suggest that randomized controlled trials (RCTs) stopped early for benefit (truncated RCTs) systematically overestimate treatment effects for the outcome that precipitated early stopping. OBJECTIVE: To compare the treatment effect from truncated RCTs with that from meta-analyses of RCTs addressing the same question but not stopped early (nontruncated RCTs) and to explore factors associated with overestimates of effect. DATA SOURCES: Search of MEDLINE, EMBASE, Current Contents, and full-text journal content databases to identify truncated RCTs up to January 2007; search of MEDLINE, Cochrane Database of Systematic Reviews, and Database of Abstracts of Reviews of Effects to identify systematic reviews from which individual RCTs were extracted up to January 2008. STUDY SELECTION: Selected studies were RCTs reported as having stopped early for benefit and matching nontruncated RCTs from systematic reviews. Independent reviewers with medical content expertise, working blinded to trial results, judged the eligibility of the nontruncated RCTs based on their similarity to the truncated RCTs. DATA EXTRACTION: Reviewers with methodological expertise conducted data extraction independently. RESULTS: The analysis included 91 truncated RCTs asking 63 different questions and 424 matching nontruncated RCTs. The pooled ratio of relative risks in truncated RCTs vs matching nontruncated RCTs was 0.71 (95% confidence interval, 0.65-0.77). This difference was independent of the presence of a statistical stopping rule and the methodological quality of the studies as assessed by allocation concealment and blinding. Large differences in treatment effect size between truncated and nontruncated RCTs (ratio of relative risks <0.75) occurred with truncated RCTs having fewer than 500 events. In 39 of the 63 questions (62%), the pooled effects of the nontruncated RCTs failed to demonstrate significant benefit. CONCLUSIONS: Truncated RCTs were associated with greater effect sizes than RCTs not stopped early. This difference was independent of the presence of statistical stopping rules and was greatest in smaller studies.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Norman, G. R., Sloan, J. A., & Wyrwich, K. W. (2003) · Medical Care · doi:10.1097/01.mlr.0000062554.74615.4c · Cited by 4,700
Publication bias in clinical trials due to statistical significance or direction of trial results
Hopewell, S., Loudon, K., Clarke, M. J., Oxman, A. D., & Dickersin, K. (2009) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.mr000006.pub3 · Cited by 898 · cited 1×
“However,weknowthattrials withpositivefindingshavenearly4times the odds of being published compared with those with negative findings.(15) To theextentthatpublicationbias ispresent, inclusion of unpublished studies would lead to a diminished pooled effect from the nontruncated RCTs.”
BackgroundMultiplicity in randomised trials II: subgroup and interim analyses
Schulz, K. F., & Grimes, D. A. (2005) · The Lancet · doi:10.1016/s0140-6736(05)66516-6 · Cited by 357
A proposed charter for clinical trial data monitoring committees: helping them to do their job well
(2005) · The Lancet · doi:10.1016/s0140-6736(05)17965-3 · Cited by 324
Ethical issues in stopping randomized trials early because of apparent benefit.
Mueller, P. S., Montori, V. M., Bassler, D., Koenig, B. A., & Guyatt, G. H. (2007) · Annals of Internal Medicine · doi:10.7326/0003-4819-146-12-200706190-00009 · Cited by 202
When (Not) to Stop a Clinical Trial for Benefit
Pocock, S. J. (2005) · JAMA · doi:10.1001/jama.294.17.2228 · Cited by 163
Practical problems in interim analyses, with particular regard to estimation
Pocock, S. J., & Hughes, M. D. (1989) · Controlled Clinical Trials · doi:10.1016/0197-2456(89)90059-7 · Cited by 160
Early stopping of randomized clinical trials for overt efficacy is problematic.
Bassler, D., Montori, V. M., Briel, M., Glasziou, P., & Guyatt, G. (2008) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2007.07.016 · Cited by 130
Trials stopped early: too good to be true?
Pocock, S., & White, I. R. (1999) · The Lancet · doi:10.1016/s0140-6736(98)00379-1 · Cited by 117
Stopping Medical Research to Save Money
Psaty, B. M., & Rennie, D. (2003) · JAMA · doi:10.1001/jama.289.16.2128 · Cited by 102
Cited by
GRADE guidelines: 4. Rating the quality of evidence—study limitations (risk of bias)
Guyatt, G. H., Oxman, A. D., Vist, G., Kunz, R., Brozek, J., Alonso-Coello, P., Montori, V., Akl, E. A., Djulbegovic, B., & Falck-Ytter, Y. (2011) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.07.017 · Cited by 2,798
GRADE guidelines 6. Rating the quality of evidence—imprecision
Guyatt, G. H., Oxman, A. D., Kunz, R., Brozek, J., Alonso-Coello, P., Rind, D., Devereaux, P. J., Montori, V. M., Freyschuss, B., Vist, G., et al. (2011) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2011.01.012 · Cited by 2,693
VTE, Thrombophilia, Antithrombotic Therapy, and Pregnancy
Bates, S. M., Greer, I. A., Middeldorp, S., Veenstra, D. L., Prabulos, A.-M., & Vandvik, P. O. (2012) · Chest · doi:10.1378/chest.11-2300 · Cited by 1,525
Self-citationKangaroo mother care to reduce morbidity and mortality in low birthweight infants
Conde-Agudelo, A., & Díaz-Rossello, J. L. (2016) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd002771.pub4 · Cited by 1,349
The Mediterranean Diet and Cardiovascular Health: A Critical Review
Martínez-González, M. A., Gea, A., & Ruiz-Canela, M. (2019) · Circulation Research · doi:10.1161/circresaha.118.313348 · Cited by 878
Five-Year Outcomes with PCI Guided by Fractional Flow Reserve
Xaplanteris, P., Fournier, S., Pijls, N. H. J., Fearon, W. F., Barbato, E., Tonino, P. A. L., Engstrøm, T., Kääb, S., Dambrink, J.-H., Rioufol, G., et al. (2018) · New England Journal of Medicine · doi:10.1056/nejmoa1803538 · Cited by 866
Bayes factor design analysis: Planning for compelling evidence
Schönbrodt, F. D., & Wagenmakers, E.-J. (2018) · Psychonomic Bulletin & Review · doi:10.3758/s13423-017-1230-y · Cited by 729
Acute Stroke Intervention: A Systematic Review
Prabhakaran, S., Ruff, I., & Bernstein, R. A. (2015) · JAMA · doi:10.1001/jama.2015.3058 · Cited by 671
A Randomized Trial of Intensive versus Standard Blood-Pressure Control
(2016) · New England Journal of Medicine · doi:10.1056/nejmc1602668 · Cited by 654
Trastuzumab containing regimens for early breast cancer
Moja, L., Tagliabue, L., Balduzzi, S., Parmelli, E., Pistotti, V., Guarneri, V., & D'Amico, R. (2012) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd006243.pub2 · Cited by 604
Medical management of paraquat ingestion
Gawarammana, I. B., & Buckley, N. A. (2011) · British Journal of Clinical Pharmacology · doi:10.1111/j.1365-2125.2011.04026.x · Cited by 562
Timing of Antiretroviral Therapy after Diagnosis of Cryptococcal Meningitis
Boulware, D. R., Meya, D. B., Muzoora, C., Rolfes, M. A., Huppler Hullsiek, K., Musubire, A., Taseera, K., Nabeta, H. W., Schutz, C., Williams, D. A., et al. (2014) · New England Journal of Medicine · doi:10.1056/nejmoa1312884 · Cited by 497
Angus, D. C., Berry, S., Lewis, R. J., Al-Beidh, F., Arabi, Y., van Bentum-Puijk, W., Bhimani, Z., Bonten, M., Broglio, K., Brunkhorst, F., et al. (2020) · Annals of the American Thoracic Society · doi:10.1513/annalsats.202003-192sd · Cited by 446
Askie, L. M., Darlow, B. A., Finer, N., Schmidt, B., Stenson, B., Tarnow-Mordi, W., Davis, P. G., Carlo, W. A., Brocklehurst, P., Davies, L. C., et al. (2018) · JAMA · doi:10.1001/jama.2018.5725 · Cited by 430
Prevalence, Characteristics, and Publication of Discontinued Randomized Trials
Kasenda, B., von Elm, E., You, J., Blümle, A., Tomonaga, Y., Saccilotto, R., Amstutz, A., Bengough, T., Meerpohl, J. J., Stegert, M., et al. (2014) · JAMA · doi:10.1001/jama.2014.1361 · Cited by 415
Self-citationPastorino, U., Rossi, M., Rosato, V., Marchianò, A., Sverzellati, N., Morosi, C., Fabbri, A., Galeone, C., Negri, E., Sozzi, G., et al. (2012) · European Journal of Cancer Prevention · doi:10.1097/cej.0b013e328351e1b6 · Cited by 414
Schmidt, B., Whyte, R. K., Asztalos, E. V., Moddemann, D., Poets, C., Rabi, Y., Solimano, A., Roberts, R. S., & Canadian Oxygen Trial (COT) Group, F. T. (2013) · JAMA · doi:10.1001/jama.2013.5555 · Cited by 409
Jørgensen, L., Paludan-Müller, A. S., Laursen, D. R. T., Savović, J., Boutron, I., Sterne, J. A. C., Higgins, J. P. T., & Hróbjartsson, A. (2016) · Systematic Reviews · doi:10.1186/s13643-016-0259-8 · Cited by 396
Review Article: Vulnerability to Heat-related Mortality
Benmarhnia, T., Deguen, S., Kaufman, J. S., & Smargiassi, A. (2015) · Epidemiology · doi:10.1097/ede.0000000000000375 · Cited by 396
Renú, A., Millán, M., San Román, L., Blasco, J., Martí-Fàbregas, J., Terceño, M., Amaro, S., Serena, J., Urra, X., Laredo, C., et al. (2022) · JAMA · doi:10.1001/jama.2022.1645 · Cited by 380
Hyperbaric oxygen for carbon monoxide poisoning
Buckley, N. A., Juurlink, D. N., Isbister, G., Bennett, M. H., & Lavonas, E. J. (2011) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd002041.pub3 · Cited by 371
Mascia, L., Pasero, D., Slutsky, A. S., Arguis, M. J., Berardino, M., Grasso, S., Munari, M., Boifava, S., Cornara, G., Della Corte, F., et al. (2010) · JAMA · doi:10.1001/jama.2010.1796 · Cited by 361
Iavarone, M., Cabibbo, G., Piscaglia, F., Zavaglia, C., Grieco, A., Villa, E., Cammà, C., & Colombo, M. (2010) · Hepatology · doi:10.1002/hep.24644 · Cited by 352
Savović, J., Weeks, L., Sterne, J. A., Turner, L., Altman, D. G., Moher, D., & Higgins, J. P. (2014) · Systematic Reviews · doi:10.1186/2046-4053-3-37 · Cited by 340
Boswood, A., Häggström, J., Gordon, S. G., Wess, G., Stepien, R. L., Oyama, M. A., Keene, B. W., Bonagura, J., MacDonald, K. A., Patteson, M., et al. (2016) · Journal of Veterinary Internal Medicine · doi:10.1111/jvim.14586 · Cited by 325
Siemieniuk, R. A. C., Meade, M. O., Alonso-Coello, P., Briel, M., Evaniew, N., Prasad, M., Alexander, P. E., Fei, Y., Vandvik, P. O., Loeb, M., et al. (2015) · Annals of Internal Medicine · doi:10.7326/m15-0715 · Cited by 324
Nordmann, A. J., Suter-Zimmermann, K., Bucher, H. C., Shai, I., Tuttle, K. R., Estruch, R., & Briel, M. (2011) · The American Journal of Medicine · doi:10.1016/j.amjmed.2011.04.024 · Cited by 300
Faruque, L. I., Wiebe, N., Ehteshami-Afshar, A., Liu, Y., Dianati-Maleki, N., Hemmelgarn, B. R., Manns, B. J., & Tonelli, M. (2017) · Canadian Medical Association Journal · doi:10.1503/cmaj.150885 · Cited by 281
Schultz, J. K., Yaqub, S., Wallon, C., Blecic, L., Forsmo, H. M., Folkesson, J., Buchwald, P., Körner, H., Dahl, F. A., & Øresland, T. (2015) · JAMA · doi:10.1001/jama.2015.12076 · Cited by 292
Page, M. J., Higgins, J. P. T., Clayton, G., Sterne, J. A. C., Hróbjartsson, A., & Savović, J. (2016) · PLOS ONE · doi:10.1371/journal.pone.0159267 · Cited by 284
Kangaroo mother care to reduce morbidity and mortality in low birthweight infants
Conde-Agudelo, A., Belizán, J. M., & Diaz-Rossello, J. (2011) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd002771.pub2 · Cited by 283
(2021) · Research Design in Clinical Psychology · doi:10.1017/9781108993647.010 · Cited by 276
Meduri, G. U., Bridges, L., Shih, M.-C., Marik, P. E., Siemieniuk, R. A. C., & Kocak, M. (2016) · Intensive Care Medicine · doi:10.1007/s00134-015-4095-4 · Cited by 262
Self-monitoring and self-management of oral anticoagulation
Heneghan, C. J., Garcia-Alamino, J. M., Spencer, E. A., Ward, A. M., Perera, R., Bankhead, C., Alonso Coello, P., Fitzmaurice, D., Mahtani, K. R., & Onakpoya, I. J. (2016) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd003839.pub3 · Cited by 256
Mechanisms and the Evidence Hierarchy
Clarke, B., Gillies, D., Illari, P., Russo, F., & Williamson, J. (2014) · Topoi · doi:10.1007/s11245-013-9220-9 · Cited by 253
“If further evidence was needed of the exceptional nature of unequivocal RCTs, it can be found in the practice of terminating prematurely RCTs that show such results (Bassler et al, 2010).”
BackgroundResearch Design in Clinical Psychology
Kazdin, A. E. (2021) · doi:10.1017/9781108993647 · Cited by 240
Rodríguez-Gutiérrez, R., & Montori, V. M. (2016) · Circulation: Cardiovascular Quality and Outcomes · doi:10.1161/circoutcomes.116.002901 · Cited by 176
Ezekowitz, J. A., Colin-Ramirez, E., Ross, H., Escobedo, J., Macdonald, P., Troughton, R., Saldarriaga, C., Alemayehu, W., McAlister, F. A., Arcand, J., et al. (2022) · The Lancet · doi:10.1016/s0140-6736(22)00369-5 · Cited by 179
Pereira, T. V., & Ioannidis, J. P. A. (2011) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.12.012 · Cited by 160
Problems of stopping trials early
Guyatt, G. H., Briel, M., Glasziou, P., Bassler, D., & Montori, V. M. (2012) · BMJ · doi:10.1136/bmj.e3863 · Cited by 115
Self-citationEmpirical evaluation of which trial characteristics are associated with treatment effect estimates
Dechartres, A., Trinquart, L., Faber, T., & Ravaud, P. (2016) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2016.04.005 · Cited by 85
A systematic review of vasopressor blood pressure targets in critically ill adults with hypotension.
Hylands, M., Moller, M. H., Asfar, P., Toma, A., Frenette, A. J., Beaudoin, N., Belley-Côté, É., D’Aragon, F., Laake, J. H., Siemieniuk, R. A., et al. (2017) · Canadian Journal of Anesthesia/Journal canadien d'anesthésie · doi:10.1007/s12630-017-0877-1 · Cited by 69
Wang, Y., Parpia, S., Couban, R., Wang, Q., Armijo-Olivo, S., Bassler, D., Briel, M., Brignardello-Petersen, R., Gluud, L. L., Keitz, S. A., et al. (2024) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2023.11.001 · Cited by 58
Self-citationDimairo, M., Pallmann, P., Wason, J., Todd, S., Jaki, T., Julious, S. A., Mander, A. P., Weir, C. J., Koenig, F., Walton, M. K., et al. (2020) · Trials · doi:10.1186/s13063-020-04334-x · Cited by 58
Single-case experimental research designs.
Kazdin, A. E. (2015) · Methodological issues and strategies in clinical research (4th ed.). · doi:10.1037/14805-029 · Cited by 39
Therapeutic strategies for patients with neuroendocrine neoplasms: current perspectives
Modica, R., Liccardi, A., Minotta, R., Cannavale, G., Benevento, E., & Colao, A. (2022) · Expert Review of Endocrinology & Metabolism · doi:10.1080/17446651.2022.2099840 · Cited by 37
Muthu, S., & Ramakrishnan, E. (2021) · Spine · doi:10.1097/brs.0000000000003645 · Cited by 30
More Versus Less Blood Pressure Lowering: An Update
Atkins, E. R., & Rodgers, A. (2016) · Clinical Therapeutics · doi:10.1016/j.clinthera.2016.08.007 · Cited by 12
Paludan-Müller, A. S., Ogden, M. C., Marquardsen, M., Jørgensen, K. J., & Gøtzsche, P. C. (2021) · BMC Medical Ethics · doi:10.1186/s12910-021-00681-9 · Cited by 3
Metadata
- Authors
- Bassler, D.
- Venue
- JAMA
- Publisher
- American Medical Association (AMA)
- Published
- 2010-03-24
- Volume
- 303
- Issue
- 12
- Pages
- 1180
- ISSN
- 0002-9955 (ISSN-L)
- 0098-7484
- OpenAlex
- W2163724055
- Cited by
- 611
- References
- 21
- FWCI
- 52.60
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.