Adaptive designs in clinical trials: why use them, and how to run and report them
Open accessAbstract
Adaptive designs can make clinical trials more flexible by utilising results accumulating in the trial to modify the trial's course in accordance with pre-specified rules. Trials with an adaptive design are often more efficient, informative and ethical than trials with a traditional fixed design since they often make better use of resources such as time and money, and might require fewer participants. Adaptive designs can be applied across all phases of clinical research, from early-phase dose escalation to confirmatory trials. The pace of the uptake of adaptive designs in clinical research, however, has remained well behind that of the statistical literature introducing new methods and highlighting their potential advantages. We speculate that one factor contributing to this is that the full range of adaptations available to trial designs, as well as their goals, advantages and limitations, remains unfamiliar to many parts of the clinical community. Additionally, the term adaptive design has been misleadingly used as an all-encompassing label to refer to certain methods that could be deemed controversial or that have been inadequately implemented.We believe that even if the planning and analysis of a trial is undertaken by an expert statistician, it is essential that the investigators understand the implications of using an adaptive design, for example, what the practical challenges are, what can (and cannot) be inferred from the results of such a trial, and how to report and communicate the results. This tutorial paper provides guidance on key aspects of adaptive designs that are relevant to clinical triallists. We explain the basic rationale behind adaptive designs, clarify ambiguous terminology and summarise the utility and pitfalls of adaptive designs. We discuss practical aspects around funding, ethical approval, treatment supply and communication with stakeholders and trial participants. Our focus, however, is on the interpretation and reporting of results from adaptive design trials, which we consider vital for anyone involved in medical research. We emphasise the general principles of transparency and reproducibility and suggest how best to put them into practice.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Digital clinical trials could leverage multiple sources of participants' data to enable automatic phenotyping and subgrouping, which could be useful for adaptive clinical trial designs that use ongoing results to modify the trial in real time.
“Digital clinical trials could leverage multiple sources of participants' data to enable automatic phenotyping and subgrouping 34 , which could be useful for adaptive clinical trial designs that use ongoing results to modify the trial in real time 39,40 .”
From Multimodal biomedical AI (2022) · cites this paper as [39]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
An Introduction to the Bootstrap
Efron, B., & Tibshirani, R. J. (1994) · doi:10.1201/9780429246593 · Cited by 40,500 · see citing works
An Introduction to the Bootstrap
Efron, B., & Tibshirani, R. J. (1993) · doi:10.1007/978-1-4899-4541-9 · Cited by 21,230 · see citing works
CONSORT 2010 Statement: updated guidelines for reporting parallel group randomised trials
the CONSORT Group, Schulz, K. F., Altman, D. G., & Moher, D. (2010) · BMC Medicine · doi:10.1186/1741-7015-8-18 · Cited by 13,371 · see citing works
CONSORT 2010 Statement: updated guidelines for reporting parallel group randomised trials
Schulz, K. F., Altman, D. G., Moher, D., & for the CONSORT Group (2010) · BMJ · doi:10.1136/bmj.c332 · Cited by 9,329 · see citing works
Assessing the quality of controlled clinical trials
Jüni, P., Altman, D. G., & Egger, M. (2001) · BMJ · doi:10.1136/bmj.323.7303.42 · Cited by 3,309 · cited 1× · see citing works
“Reporting adaptive designs High-quality reporting of results is a vital part of running any successful trial [124].”
BackgroundFundamentals of Clinical Trials
Friedman, L. M., Furberg, C. D., DeMets, D. L., Reboussin, D. M., & Granger, C. B. (2015) · doi:10.1007/978-3-319-18539-2 · Cited by 2,237 · see citing works
Group Sequential Methods with Applications to Clinical Trials
Jennison, C., & Turnbull, B. W. (1999) · Chapman & Hall/CRC eBooks · doi:10.1201/9780367805326 · Cited by 1,361 · see citing works
Dose Escalation Methods in Phase I Cancer Clinical Trials
Le Tourneau, C., Lee, J. J., & Siu, L. L. (2009) · JNCI: Journal of the National Cancer Institute · doi:10.1093/jnci/djp079 · Cited by 867 · see citing works
Designed Extension of Studies Based on Conditional Power
Proschan, M. A., & Hunsberger, S. (1995) · Biometrics · doi:10.2307/2533262 · Cited by 536 · see citing works
Fundamentals of Clinical Trials
Friedman, L. M., Furberg, C. D., & DeMets, D. L. (2010) · Springer eBooks · doi:10.1007/978-1-4419-1586-3 · Cited by 532 · see citing works
Bayesian Adaptive Methods for Clinical Trials
Berry, S. M., Carlin, B. P., Lee, J. J., & Muller, P. (2010) · CRC Press eBooks · doi:10.1201/ebk1439825488 · Cited by 520 · see citing works
Adaptive design methods in clinical trials–a review
Chow, S.-C., & Chang, M. (2008) · Orphanet Journal of Rare Diseases · doi:10.1186/1750-1172-3-11 · Cited by 482 · see citing works
Adaptive increase in sample size when interim results are promising: a practical guide with examples
Mehta, C. R., & Pocock, S. J. (2011) · Statistics in Medicine · doi:10.1002/sim.4102 · Cited by 367 · see citing works
A proposed charter for clinical trial data monitoring committees: helping them to do their job well
(2005) · The Lancet · doi:10.1016/s0140-6736(05)17965-3 · Cited by 324 · see citing works
Adaptive Designs in Clinical Drug Development—An Executive Summary of the PhRMA Working Group
Gallo, P. P., Chuang‐Stein, C., Dragalin, V., Gaydos, B. L., Krams, M., & Pinheiro, J. C. (2006) · Journal of Biopharmaceutical Statistics · doi:10.1080/10543400600614742 · Cited by 323 · see citing works
Patient-centric trials for therapeutic development in precision oncology
Biankin, A. V., Piantadosi, S., & Hollingsworth, S. J. (2015) · Nature · doi:10.1038/nature15819 · Cited by 282 · see citing works
Adaptive designs for confirmatory clinical trials
Bretz, F., König, F., Brannath, W., Glimm, E., & Posch, M. (2009) · Statistics in Medicine · doi:10.1002/sim.3538 · Cited by 265 · see citing works
Interim Analyses: The Repeated Confidence Interval Approach
Jennison, C., & Turnbull, B. W. (1989) · Journal of the Royal Statistical Society Series B (Statistical Methodology) · doi:10.1111/j.2517-6161.1989.tb01433.x · Cited by 246 · see citing works
Testing and estimation in flexible group sequential designs with adaptive treatment selection
Posch, M., König, F., Branson, M., Brannath, W., Dunger‐Baldauf, C., & Bauer, P. (2005) · Statistics in Medicine · doi:10.1002/sim.2389 · Cited by 244 · see citing works
On the bias of maximum likelihood estimation following a sequential test
Whitehead, J. (1986) · Biometrika · doi:10.1093/biomet/73.3.573 · Cited by 243 · see citing works
Twenty‐five years of confirmatory adaptive designs: opportunities and pitfalls
Bauer, P., Bretz, F., Dragalin, V., König, F., & Wassmer, G. (2015) · Statistics in Medicine · doi:10.1002/sim.6472 · Cited by 231 · see citing works
Practical Bayesian adaptive randomisation in clinical trials
Thall, P. F., & Wathen, J. K. (2007) · European Journal of Cancer · doi:10.1016/j.ejca.2007.01.006 · Cited by 230 · see citing works
Parameter Estimation Following Group Sequential Hypothesis Testing
Emerson, S. S., & Fleming, T. R. (1990) · Biometrika · doi:10.1093/biomet/77.4.875 · Cited by 225 · see citing works
Dose Finding by the Continual Reassessment Method
Cheung, Y. K. (2011) · Chapman & Hall/CRC eBooks · doi:10.1201/b10783 · Cited by 210 · see citing works
Correcting for multiple-testing in multi-arm trials: is it necessary and is it done?
Wason, J. M. S., Stecher, L., & Mander, A. (2014) · Trials · doi:10.1186/1745-6215-15-364 · Cited by 180 · see citing works
Self-citationGroup Sequential and Confirmatory Adaptive Designs in Clinical Trials
Wassmer, G., & Brannath, W. (2016) · Springer Series in Pharmaceutical Statistics · doi:10.1007/978-3-319-32562-0 · Cited by 178 · see citing works
Sydes, M. R., Parmar, M., Mason, M. D., Clarke, N. W., Amos, C. L., Anderson, J., Bono, J. S. D., Dearnaley, D. P., Dwyer, J., Green, C., et al. (2012) · Trials · doi:10.1186/1745-6215-13-168 · Cited by 173 · see citing works
Self-citationAdaptive Design Methods in Clinical Trials
Chow, S., & Pong, A. (2010) · Informa Healthcare eBooks · doi:10.3109/9781439822463.003 · Cited by 165 · see citing works
A generalized Dunnett test for multi-arm multi-stage clinical studies with treatment selection
Magirr, D., Jaki, T., & Whitehead, J. (2012) · Biometrika · doi:10.1093/biomet/ass002 · Cited by 162 · see citing works
Self-citationSydes, M. R., Parmar, M., James, N. D., Clarke, N. W., Dearnaley, D. P., Mason, M. D., Morgan, R. C., Sanders, K., & Royston, P. J. (2009) · Trials · doi:10.1186/1745-6215-10-39 · Cited by 150 · see citing works
Self-citationDimairo, M., Pallmann, P., Wason, J. M. S., Todd, S., Jaki, T., Julious, S. A., Mander, A., Weir, C. J., König, F., Walton, M. K., et al. (2020) · BMJ · doi:10.1136/bmj.m115 · Cited by 148 · see citing works
Self-citationAn observational study of Donor Ex Vivo Lung Perfusion in UK lung transplantation: DEVELOP-UK
Fisher, A., Andreasson, A. S. I., Chrysos, A., Lally, J. E., Mamasoula, C., Exley, C., Wilkinson, J. S., Qian, J., Watson, G. C., Lewington, O., et al. (2016) · Health Technology Assessment · doi:10.3310/hta20850 · Cited by 147 · see citing works
Adaptive Seamless Phase II/III Designs—Background, Operational Aspects, and Examples
Maca, J., Bhattacharya, S., Dragalin, V., Gallo, P. P., & Krams, M. (2006) · Drug Information Journal · doi:10.1177/216847900604000412 · Cited by 143 · see citing works
Evaluating Many Treatments and Biomarkers in Oncology: A New Design
Kaplan, R. S., Maughan, T., Crook, A. M., Fisher, D. J., Wilson, R. H., Brown, L. C., & Parmar, M. (2013) · Journal of Clinical Oncology · doi:10.1200/jco.2013.50.7905 · Cited by 143 · see citing works
Speeding up the Evaluation of New Agents in Cancer
Parmar, M., Barthel, F. M.-S., Sydes, M. R., Langley, R. E., Kaplan, R. S., Eisenhauer, E. A., Brady, M. F., James, N. D., Bookman, M. A., Swart, A. M., et al. (2008) · JNCI Journal of the National Cancer Institute · doi:10.1093/jnci/djn267 · Cited by 143 · see citing works
Self-citationStatistical Consideration of Adaptive Methods in Clinical Development
Chow, S., Chang, M., & Pong, A. (2005) · Journal of Biopharmaceutical Statistics · doi:10.1081/bip-200062277 · Cited by 136 · see citing works
Statistical Methods for Dose‐Finding Experiments
(2006) · Wiley eBooks · doi:10.1002/0470861258 · Cited by 134 · see citing works
Simple procedures for blinded sample size adjustment that do not affect the type I error rate
Kieser, M., & Friede, T. (2003) · Statistics in Medicine · doi:10.1002/sim.1585 · Cited by 126 · see citing works
Biomarker-Guided Adaptive Trial Designs in Phase II and Phase III: A Methodological Review
Antoniou, M., Jorgensen, A., & Kolamunnage‐Dona, R. (2016) · PLoS ONE · doi:10.1371/journal.pone.0149803 · Cited by 125 · see citing works
Adaptive designs undertaken in clinical research: a review of registered clinical trials
Hatfield, I., Allison, A., Flight, L., Julious, S. A., & Dimairo, M. (2016) · Trials · doi:10.1186/s13063-016-1273-9 · Cited by 107 · see citing works
Self-citationA proposed charter for clinical trial data monitoring committees: helping them to do their job well
(2005) · The Lancet · doi:10.1016/s0140-6736(05)70939-9 · Cited by 104 · see citing works
Selection and bias—Two hostile brothers
Bauer, P., König, F., Brannath, W., & Posch, M. (2009) · Statistics in Medicine · doi:10.1002/sim.3716 · Cited by 99 · see citing works
Giles, F. J., Kantarjian, H. M., Cortes, J. E., Garcia‐Manero, G., Verstovšek, S., Faderl, S. H., Thomas, D. A., Ferrajoli, A., O'Brien, S. M., Wathen, J. K., et al. (2003) · Journal of Clinical Oncology · doi:10.1200/jco.2003.11.016 · Cited by 99 · see citing works
Elsäßer, A., Regnström, J., Vetter, T., König, F., Hemmings, R. J., Greco, M., Papaluca‐Amati, M., & Posch, M. (2014) · Trials · doi:10.1186/1745-6215-15-383 · Cited by 96 · see citing works
Unbiased estimation following a group sequential test
Liu, A. (1999) · Biometrika · doi:10.1093/biomet/86.1.71 · Cited by 91 · see citing works
Hierarchical testing of multiple endpoints in group‐sequential trials
Glimm, E., Maurer, W., & Bretz, F. (2010) · Statistics in Medicine · doi:10.1002/sim.3748 · Cited by 89 · see citing works
Frequentist evaluation of group sequential clinical trial designs
Emerson, S. S., Kittelson, J. M., & Gillen, D. L. (2007) · Statistics in Medicine · doi:10.1002/sim.2901 · Cited by 87 · see citing works
Ho, T. W., Pearlman, E. M., Lewis, D. W., Hämäläinen, M. L., Connor, K. M., Michelson, D., Zhang, Y., Assaid, C. A., Mozley, L. H., Strickler, N., et al. (2012) · Cephalalgia · doi:10.1177/0333102412451358 · Cited by 86 · see citing works
Implementing Adaptive Designs: Logistical and Operational Considerations
Quinlan, J., & Krams, M. (2006) · Drug Information Journal · doi:10.1177/216847900604000409 · Cited by 84 · see citing works
Unbiased Estimation of Selected Treatment Means in Two‐Stage Trials
Bowden, J., & Glimm, E. (2008) · Biometrical Journal · doi:10.1002/bimj.200810442 · Cited by 84 · see citing works
No solution yet for combining two independent studies in the presence of heterogeneity
Gonnermann, A., Framke, T., Großhennig, A., & Koch, A. (2015) · Statistics in Medicine · doi:10.1002/sim.6473 · Cited by 83 · see citing works
Stallard, N., & Todd, S. (2010) · Statistical Methods in Medical Research · doi:10.1177/0962280210379035 · Cited by 83 · see citing works
Coffey, C. S., & Kairalla, J. A. (2008) · Drugs in R&D · doi:10.2165/00126839-200809040-00003 · Cited by 75 · see citing works
Gerety, E., Lawrence, E. M., Wason, J. M. S., et al. (2015) · Annals of Oncology · doi:10.1093/annonc/mdv289 · Cited by 73 · see citing works
Self-citationData Monitoring Committees — Expect the Unexpected
DeMets, D. L., & Ellenberg, S. S. (2016) · New England Journal of Medicine · doi:10.1056/nejmra1510066 · Cited by 73 · see citing works
A practical guide to Bayesian group sequential designs
Gsponer, T., Gerber, F., Bornkamp, B., Ohlssen, D. I., Vandemeulebroecke, M., & Schmidli, H. (2013) · Pharmaceutical Statistics · doi:10.1002/pst.1593 · Cited by 72 · see citing works
Maintaining confidentiality of interim data to enhance trial integrity and credibility
Fleming, T. R., SHARPLES, K. J., McCall, J. L., Moore, A., Rodgers, A., & Stewart, R. (2008) · Clinical Trials · doi:10.1177/1740774508089459 · Cited by 71 · see citing works
Quinlan, J., Gaydos, B. L., Maca, J., & Krams, M. (2010) · Clinical Trials · doi:10.1177/1740774510361542 · Cited by 70 · see citing works
Statistical methods for dose-finding experiments
Chevret, S. (2006) · Medical Entomology and Zoology · Cited by 68 · see citing works
Adaptive Design: Results of 2012 Survey on Perception and Use
Morgan, C. C., Huyck, S. B., Jenkins, M. A., Chen, L., Bedding, A. W., Coffey, C. S., Gaydos, B. L., & Wathen, J. K. (2014) · Therapeutic Innovation & Regulatory Science · doi:10.1177/2168479014522468 · Cited by 67 · see citing works
Self-citationAdaptive sample size modification in clinical trials: start small then ask for more?
Jennison, C., & Turnbull, B. W. (2015) · Statistics in Medicine · doi:10.1002/sim.6575 · Cited by 63 · see citing works
Confidentiality and Trial Integrity Issues for Adaptive Designs
Gallo, P. P. (2006) · Drug Information Journal · doi:10.1177/216847900604000410 · Cited by 62 · see citing works
Nie, L., Rubin, E. H., Mehrotra, N., Pinheiro, J. C., Fernandes, L. L., Roy, A., Bailey, S., & de Alwis, D. P. (2016) · Clinical Cancer Research · doi:10.1158/1078-0432.ccr-15-2644 · Cited by 61 · see citing works
Shrinkage estimation in two‐stage adaptive designs with midtrial treatment selection
Carreras, M., & Brannath, W. (2012) · Statistics in Medicine · doi:10.1002/sim.5463 · Cited by 59 · see citing works
An overview of the design and conduct of the BATTLE trials.
Liu, S., & Lee, J. J. (2015) · PubMed · doi:10.3978/j.issn.2304-3865.2015.06.07 · Cited by 58 · see citing works
Stevely, A. K., Dimairo, M., Todd, S., Julious, S. A., Nicholl, J. P., Hind, D., & Cooper, C. L. (2015) · PLoS ONE · doi:10.1371/journal.pone.0141104 · Cited by 58 · see citing works
Self-citationBayesian adaptive clinical trials: a dream for statisticians only?
Chevret, S. (2011) · Statistics in Medicine · doi:10.1002/sim.4363 · Cited by 58 · see citing works
Recommendations for data monitoring committees from the Clinical Trials Transformation Initiative
Calis, K. A., Archdeacon, P., Bain, R., DeMets, D., Donohue, M., Elzarrad, M. K., Forrest, A., McEachern, J., Pencina, M. J., Perlmutter, J., et al. (2017) · Clinical Trials · doi:10.1177/1740774517707743 · Cited by 58 · see citing works
Bayesian clinical trial designs
Jansen, J. O., Pallmann, P., MacLennan, G., & Campbell, M. (2017) · The Journal of Trauma: Injury, Infection, and Critical Care · doi:10.1097/ta.0000000000001638 · Cited by 56 · see citing works
Self-citationWhen is a seamless study desirable? Case studies from different pharmaceutical sponsors
Cuffe, R. L., Lawrence, D., Stone, A. M., & Vandemeulebroecke, M. (2014) · Pharmaceutical Statistics · doi:10.1002/pst.1622 · Cited by 55 · see citing works
Application of Adaptive Designs – a Review
Bauer, P., & Einfalt, J. (2006) · Biometrical Journal · doi:10.1002/bimj.200510204 · Cited by 54 · see citing works
Bayesian adaptive designs for clinical trials
Yi, C., & Shen, Y. (2005) · Biometrika · doi:10.1093/biomet/92.3.633 · Cited by 54 · see citing works
Dimairo, M., Boote, J. D., Julious, S. A., Nicholl, J. P., & Todd, S. (2015) · Trials · doi:10.1186/s13063-015-0958-9 · Cited by 52 · see citing works
Self-citationYap, C., Billingham, L. J., Cheung, Y. K., Craddock, C., & O’Quigley, J. (2017) · Clinical Cancer Research · doi:10.1158/1078-0432.ccr-17-0582 · Cited by 51 · see citing works
Self-citationPosch, M., Maurer, W., & Bretz, F. (2010) · Pharmaceutical Statistics · doi:10.1002/pst.413 · Cited by 50 · see citing works
A group sequential Holm procedure with multiple primary endpoints
Ye, Y., Li, A., Liu, L., & Yao, B. (2012) · Statistics in Medicine · doi:10.1002/sim.5700 · Cited by 48 · see citing works
Lorch, U., O’Kane, M., & Täubel, J. (2014) · BMC Medical Research Methodology · doi:10.1186/1471-2288-14-84 · Cited by 47 · see citing works
Wang, S.-J., & Hung, H. (2013) · Contemporary Clinical Trials · doi:10.1016/j.cct.2013.09.008 · Cited by 45 · see citing works
Implementation of adaptive methods in early‐phase clinical trials
Petroni, G. R., Wages, N. A., Paux, G., & Dubois, F. (2016) · Statistics in Medicine · doi:10.1002/sim.6910 · Cited by 45 · see citing works
Exact inference for adaptive group sequential designs
Gao, P., Liu, L., & Mehta, C. R. (2013) · Statistics in Medicine · doi:10.1002/sim.5847 · Cited by 44 · see citing works
On the Independence of Data Monitoring Committee in Adaptive Design Clinical Trials
Chow, S., Corey, R., & Lin, M. J. (2012) · Journal of Biopharmaceutical Statistics · doi:10.1080/10543406.2012.676536 · Cited by 44 · see citing works
Lewis, R. J., Lipsky, A. M., & Berry, D. A. (2007) · Clinical Trials · doi:10.1177/1740774506075764 · Cited by 44 · see citing works
Multi-arm clinical trials with treatment selection: what can be gained and at what price?
Jaki, T. (2015) · Clinical Investigation · doi:10.4155/cli.15.13 · Cited by 43 · see citing works
Self-citationRecent Developments in Adaptive Designs for Phase I/II Dose-Finding Studies
Zohar, S., & Chevret, S. (2007) · Journal of Biopharmaceutical Statistics · doi:10.1080/10543400701645116 · Cited by 42 · see citing works
Uptake of novel statistical methods for early-phase clinical studies in the UK public sector
Jaki, T. (2013) · Clinical Trials · doi:10.1177/1740774512474375 · Cited by 40 · see citing works
Self-citationStallard, N., Whitehead, J., & Cleall, S. (2005) · Pharmaceutical Statistics · doi:10.1002/pst.164 · Cited by 40 · see citing works
Implementing the EffTox dose-finding design in the Matchpoint trial
Brock, K., Billingham, L. J., Copland, M., et al. (2017) · BMC Medical Research Methodology · doi:10.1186/s12874-017-0381-x · Cited by 40 · see citing works
Bayesian Designs and the Control of Frequentist Characteristics: A Practical Solution
Ventz, S., & Trippa, L. (2014) · Biometrics · doi:10.1111/biom.12226 · Cited by 39 · see citing works
Meurer, W. J., Legocki, L. J., Mawocha, S., Frederiksen, S. M., Guetterman, T. C., Barsan, W. G., Lewis, R. J., Berry, D. A., & Fetters, M. D. (2016) · Trials · doi:10.1186/s13063-016-1493-z · Cited by 39 · see citing works
Exploring changes in treatment effects across design stages in adaptive trials
Friede, T., & Henderson, R. (2008) · Pharmaceutical Statistics · doi:10.1002/pst.332 · Cited by 36 · see citing works
Operational challenges in adaptive design implementation
Gallo, P. P. (2006) · Pharmaceutical Statistics · doi:10.1002/pst.221 · Cited by 36 · see citing works
Graf, A. C., Bauer, P., Glimm, E., & König, F. (2014) · Biometrical Journal · doi:10.1002/bimj.201300153 · Cited by 35 · see citing works
Bayesian evaluation of group sequential clinical trial designs
Emerson, S. S., Kittelson, J. M., & Gillen, D. L. (2006) · Statistics in Medicine · doi:10.1002/sim.2640 · Cited by 35 · see citing works
Bowden, J., & Glimm, E. (2013) · Biometrical Journal · doi:10.1002/bimj.201200245 · Cited by 34 · see citing works
Exploring the role and function of trial steering committees: results of an expert panel meeting
Harman, N. L., Conroy, E. J., Lewis, S. C., Murray, G., Norrie, J., Sydes, M. R., Lane, J. A., Altman, D. G., Baigent, C., Bliss, J. M., et al. (2015) · Trials · doi:10.1186/s13063-015-1125-z · Cited by 33 · see citing works
Self-citationChoodari‐Oskooei, B., Parmar, M., Royston, P. J., & Bowden, J. (2013) · Trials · doi:10.1186/1745-6215-14-23 · Cited by 32 · see citing works
Self-citationDimairo, M., Julious, S. A., Todd, S., Nicholl, J. P., & Boote, J. D. (2015) · Trials · doi:10.1186/s13063-015-1119-x · Cited by 32 · see citing works
Self-citationWaldron-Lynch, F., Kareclas, P., Kathryn, I., Walker, N. M., Mander, A., Wicker, L. S., Todd, J. A., & Bond, S. J. (2014) · BMJ Open · doi:10.1136/bmjopen-2014-005559 · Cited by 31 · see citing works
Self-citationPractical Considerations for Adaptive Trial Design and Implementation
He, W., Pinheiro, J. C., & Kuznetsova, O. M. (2014) · Statistics for biology and health · doi:10.1007/978-1-4939-1100-4 · Cited by 30 · see citing works
Campbell, G. (2013) · Statistics in Biopharmaceutical Research · doi:10.1080/19466315.2013.846873 · Cited by 30 · see citing works
The independent statistician for data monitoring committees
DeMets, D. L., & Fleming, T. R. (2004) · Statistics in Medicine · doi:10.1002/sim.1786 · Cited by 30 · see citing works
Unblinded Adaptive Statistical Information Design Based on Clinical Endpoint or Biomarker
Wang, S.-J., Brannath, W., Brückner, M., Hung, H., & Koch, A. (2013) · Statistics in Biopharmaceutical Research · doi:10.1080/19466315.2013.791639 · Cited by 30 · see citing works
Response‐adaptive clinical trials: case studies in the medical literature
Grieve, A. P. (2016) · Pharmaceutical Statistics · doi:10.1002/pst.1778 · Cited by 30 · see citing works
Estimation after subpopulation selection in adaptive seamless trials
Kimani, P., Todd, S., & Stallard, N. (2015) · Statistics in Medicine · doi:10.1002/sim.6506 · Cited by 29 · see citing works
Group Sequential Methods and Software Applications
Zhu, L., Ni, L., & Yao, B. (2011) · The American Statistician · doi:10.1198/tast.2011.10213 · Cited by 28 · see citing works
Simultaneous confidence intervals that are compatible with closed testing in adaptive designs
Magirr, D., Jaki, T., Posch, M., & Klinglmueller, F. (2013) · Biometrika · doi:10.1093/biomet/ast035 · Cited by 28 · see citing works
Self-citationThe role of adaptive trial designs in drug development
Curtin, F., & Heritier, S. R. (2017) · Expert Review of Clinical Pharmacology · doi:10.1080/17512433.2017.1321985 · Cited by 28 · see citing works
Warner, P., Weir, C. J., Hansen, C. H., Douglas, A. J., Madhra, M., Hillier, S. G., Saunders, P. T. K., Iredale, J. P., Semple, S. I. K., Walker, B. R., et al. (2015) · BMJ Open · doi:10.1136/bmjopen-2014-006837 · Cited by 27 · see citing works
Self-citationPushpakom, S. P., Taylor, C., Kolamunnage‐Dona, R., Spowart, C., Vora, J. P., García‐Fiñana, M., Kemp, G. J., Whitehead, J., Jaki, T., Khoo, S., et al. (2015) · BMJ Open · doi:10.1136/bmjopen-2015-009566 · Cited by 27 · see citing works
Self-citationAn Overview of Statistical Approaches for Adaptive Designs and Design Modifications
Schäfer, H., Timmesfeld, N., & Müller, H. (2006) · Biometrical Journal · doi:10.1002/bimj.200510234 · Cited by 26 · see citing works
What should be the role of homogeneity testing in adaptive trials?
Gallo, P. P., & Chuang‐Stein, C. (2008) · Pharmaceutical Statistics · doi:10.1002/pst.342 · Cited by 26 · see citing works
Multiple Testing Problems in Pharmaceutical Statistics
Pacheco, G. D., & Roche, F. H.-L. (2011) · Journal of the Royal Statistical Society Series A (Statistics in Society) · doi:10.1111/j.1467-985x.2011.00725_3.x · Cited by 26 · see citing works
A Bayesian–frequentist two‐stage single‐arm phase II clinical trial design
Dong, G., Shih, W. J., Moore, D. F., et al. (2012) · Statistics in Medicine · doi:10.1002/sim.5330 · Cited by 25 · see citing works
Graf, A. C., & Bauer, P. (2011) · Statistics in Medicine · doi:10.1002/sim.4230 · Cited by 25 · see citing works
Bratton, D. J., Parmar, M., Phillips, P. P. J., et al. (2016) · Trials · doi:10.1186/s13063-016-1382-5 · Cited by 25 · see citing works
Conroy, E. J., Harman, N., Lane, J. A., Lewis, S. C., Murray, G. D., Norrie, J. D., Sydes, M. R., & Gamble, C. L. (2015) · Clinical Trials · doi:10.1177/1740774515589959 · Cited by 24 · see citing works
Self-citationDaykin, A. R., Selman, L. E., Cramer, H., McCann, S., Shorter, G. W., Sydes, M. R., Gamble, C. L., Macefield, R. C., Lane, J. A., & Shaw, A. R. G. (2016) · Trials · doi:10.1186/s13063-016-1425-y · Cited by 24 · see citing works
Self-citationA Review of Available Software and Capabilities for Adaptive Designs
Tymofyeyev, Y. (2014) · Statistics for biology and health · doi:10.1007/978-1-4939-1100-4_8 · Cited by 21 · see citing works
Lorch, U., Berelowitz, K., Ozen, C., Naseem, A., Akuffo, E., & Täubel, J. (2011) · European Journal of Clinical Pharmacology · doi:10.1007/s00228-011-1176-3 · Cited by 21 · see citing works
An exact method for analysis following a two‐stage phase II cancer clinical trial
Jovic, G., & Whitehead, J. (2010) · Statistics in Medicine · doi:10.1002/sim.3837 · Cited by 20 · see citing works
Addressing Challenges and Opportunities of “Less Well-Understood” Adaptive Designs
He, W., Gallo, P. P., Miller, E. R., Jemiai, Y., Maca, J., Koury, K., Fan, X. F., Jiang, Q., Wang, C., & Lin, M. J. (2016) · Therapeutic Innovation & Regulatory Science · doi:10.1177/2168479016663265 · Cited by 20 · see citing works
Practical Considerations and Strategies for Executing Adaptive Clinical Trials
He, W., Kuznetsova, O. M., Harmer, M., Leahy, C., Anderson, K. M., Dossin, N., Li, L., Bolognese, J. A., Tymofyeyev, Y., & Schindler, J. S. (2012) · Drug Information Journal · doi:10.1177/0092861512436580 · Cited by 19 · see citing works
Bias and Trials Stopped Early for Benefit
Ellenberg, S. S. (2010) · JAMA · doi:10.1001/jama.2010.933 · Cited by 19 · see citing works
Views on Emerging Issues Pertaining to Data Monitoring Committees for Adaptive Trials
Antonijevic, Z., Gallo, P. P., Chuang‐Stein, C., et al. (2013) · Therapeutic Innovation & Regulatory Science · doi:10.1177/2168479013486996 · Cited by 19 · see citing works
Miller, E. R., Gallo, P. P., He, W., Kammerman, L. A., Koury, K. J., Maca, J., Jiang, Q., Walton, M. K., Wang, C., Woo, K., et al. (2016) · Therapeutic Innovation & Regulatory Science · doi:10.1177/2168479016665434 · Cited by 19 · see citing works
Bowden, J., Brannath, W., & Glimm, E. (2013) · Statistics in Medicine · doi:10.1002/sim.5920 · Cited by 18 · see citing works
A Practical Guide to Data Monitoring Committees in Adaptive Trials
Sanchez‐Kam, M., Gallo, P. P., Loewy, J. W., Menon, S., Antonijevic, Z., Christensen, J., Chuang‐Stein, C., & Laage, T. A. (2013) · Therapeutic Innovation & Regulatory Science · doi:10.1177/2168479013509805 · Cited by 17 · see citing works
Sample size re‐estimation in group‐sequential response‐adaptive clinical trials
Morgan, C. C. (2003) · Statistics in Medicine · doi:10.1002/sim.1677 · Cited by 16 · see citing works
Estimation in multi-arm two-stage trials with treatment selection and time-to-event endpoint
Brückner, M., Titman, A., & Jaki, T. (2017) · Statistics in Medicine · doi:10.1002/sim.7367 · Cited by 16 · see citing works
Self-citationA comparison of methods for constructing confidence intervals after phase II/III clinical trials
Kimani, P., Todd, S., & Stallard, N. (2013) · Biometrical Journal · doi:10.1002/bimj.201300036 · Cited by 15 · see citing works
Identifying combined design and analysis procedures in two‐stage trials with a binary end point
Bowden, J., & Wason, J. M. S. (2012) · Statistics in Medicine · doi:10.1002/sim.5468 · Cited by 15 · see citing works
Self-citationTesting for qualitative interactions between stages in an adaptive study
Parker, R. A. (2009) · Statistics in Medicine · doi:10.1002/sim.3757 · Cited by 15 · see citing works
Whitehead, J., Thygesen, H. H., Jaki, T., et al. (2012) · Statistics in Medicine · doi:10.1002/sim.5331 · Cited by 15 · see citing works
Self-citationOperational Challenges and Solutions with Implementation of an Adaptive Seamless Phase 2/3 Study
Spencer, K. A., Colvin, K., Braunecker, B., et al. (2012) · Journal of Diabetes Science and Technology · doi:10.1177/193229681200600608 · Cited by 15 · see citing works
Practical guidelines for adaptive seamless phase II/III clinical trials that use Bayesian methods
Kimani, P., Glimm, E., Maurer, W., Hutton, J. L., & Stallard, N. (2012) · Statistics in Medicine · doi:10.1002/sim.5326 · Cited by 15 · see citing works
Adaptive Design Methods in Clinical Trials
Pong, A. (2012) · CRC Press eBooks · doi:10.1201/b14674-4 · Cited by 15 · see citing works
Adaptive blinded sample size adjustment for comparing two normal means—a mostly Bayesian approach
Hartley, A. M. (2012) · Pharmaceutical Statistics · doi:10.1002/pst.538 · Cited by 13 · see citing works
Predicting clinical trial results based on announcements of interim analyses
Broglio, K. R., Stivers, D. N., & Berry, D. A. (2014) · Trials · doi:10.1186/1745-6215-15-73 · Cited by 13 · see citing works
Żebrowska, M., Posch, M., & Magirr, D. (2015) · Statistics in Medicine · doi:10.1002/sim.6848 · Cited by 13 · see citing works
Plan to be Flexible: A Commentary on Adaptive Designs
Shih, W. J. (2006) · Biometrical Journal · doi:10.1002/bimj.200610241 · Cited by 12 · see citing works
Gaydos, B. L., Koch, A., Miller, F. G., et al. (2012) · Clinical Investigation · doi:10.4155/cli.12.5 · Cited by 11 · see citing works
Wang, S., Hung, H., & O’Neill, R. T. (2011) · Journal of Biopharmaceutical Statistics · doi:10.1080/10543406.2011.552878 · Cited by 10 · see citing works
Novel Statistical Designs for Phase I/II and Phase II Clinical Trials With Dose-Finding Objectives
Sverdlov, O., & Wong, W. K. (2014) · Therapeutic Innovation & Regulatory Science · doi:10.1177/2168479014523765 · Cited by 10 · see citing works
Mason, A. J., Gonzalez‐Maffe, J., Quinn, K., Doyle, N., Legg, K., Norsworthy, P. J., Trevelion, R., Winston, A., & Ashby, D. (2016) · Statistics in Medicine · doi:10.1002/sim.7169 · Cited by 9 · see citing works
Multiple testing problems in pharmaceutical statistics
Finch, R. (2014) · Pharmaceutical Statistics · doi:10.1002/pst.1610 · Cited by 8 · see citing works
Yap, C., Craddock, C., Collins, G., et al. (2013) · Trials · doi:10.1186/1745-6215-14-s1-o75 · Cited by 8 · see citing works
Self-citationPlanning and Executing Response-Adaptive Learn-Phase Clinical Trials: 2. Case Studies
Fardipour, P., Littman, G. S., Burns, D. D., et al. (2009) · Drug Information Journal · doi:10.1177/009286150904300610 · Cited by 8 · see citing works
Die Pathogenese und die Erscheinungsform der Herzneurosen
Matthes, M. (1926) · Journal of Molecular Medicine · doi:10.1007/bf01752248 · Cited by 5 · see citing works
Analysis Following a Sequential Test
(1999) · Chapman & Hall/CRC machine learning & pattern recognition/Chapman & Hall/CRC machine learning & pattern recognition series · doi:10.1201/9781584888581.ch8 · Cited by 4 · see citing works
The Utility of Adaptive Designs in Publicly Funded Confirmatory Trials
Dimairo, M. (2016) · White Rose eTheses Online (University of Leeds, The University of Sheffield, University of York) · Cited by 4 · see citing works
Self-citationGaunt, P., Mehanna, H. M., & Yap, C. (2015) · Trials · doi:10.1186/1745-6215-16-s2-o16 · Cited by 2 · see citing works
Self-citationA pragmatic approach to the design and calibration of a Bayesian CRM dose finding trial
Cole, M. F., Stocken, D. D., & Yap, C. (2015) · Trials · doi:10.1186/1745-6215-16-s2-p210 · Cited by 2 · see citing works
Self-citationA Study of Donor Ex-Vivo Lung Perfusion in UK Lung Transplantation (DEVELOP-UK)
Fisher, A. J., Yonan, N. A., Mascaró, J., et al. (2016) · The Journal of Heart and Lung Transplantation · doi:10.1016/j.healun.2016.01.219 · Cited by 2 · see citing works
Khan, J., Yap, C., Clark, R. E., et al. (2013) · Trials · doi:10.1186/1745-6215-14-s1-p20 · Cited by 1 · see citing works
Self-citation
Flagged first, then by citations
Cited by
Sorted by citations
Acosta, J. N., Falcone, G. J., Rajpurkar, P., & Topol, E. J. (2022) · Nature Medicine · doi:10.1038/s41591-022-01981-2 · Cited by 1,365 · see citing works
Preventive psychiatry: a blueprint for improving the mental health of young people
Fusar‐Poli, P., Correll, C. U., Arango, C., Berk, M., Patel, V., & Ioannidis, J. P. A. (2021) · World Psychiatry · doi:10.1002/wps.20869 · Cited by 497 · see citing works
Experimental and quasi-experimental designs in implementation research
Miller, C. J., Smith, S. N., & Pugatch, M. (2020) · Psychiatry Research · doi:10.1016/j.psychres.2019.06.027 · Cited by 373 · see citing works
Aday, J. S., Heifets, B. D., Pratscher, S. D., Bradley, E., Rosen, R., & Woolley, J. D. (2022) · Psychopharmacology · doi:10.1007/s00213-022-06123-7 · Cited by 237 · see citing works
Interpretation of chronic pain clinical trial outcomes: IMMPACT recommended considerations
Smith, S. M., Dworkin, R. H., Turk, D. C., McDermott, M. P., Eccleston, C., Farrar, J. T., Rowbotham, M. C., Bhagwagar, Z., Burke, L. B., Cowan, P., et al. (2020) · Pain · doi:10.1097/j.pain.0000000000001952 · Cited by 194 · see citing works
Barbato, E., Azizi, M., Schmieder, R. E., Lauder, L., Böhm, M., Brouwers, S., Bruno, R. M., Dudek, D., Kahan, T., Kandzari, D. E., et al. (2023) · European Heart Journal · doi:10.1093/eurheartj/ehad054 · Cited by 188 · see citing works
Single‐case experimental designs: Characteristics, changes, and challenges
Kazdin, A. E. (2021) · Journal of the Experimental Analysis of Behavior · doi:10.1002/jeab.638 · Cited by 166 · see citing works
Hayes, S. C., Merwin, R. M., McHugh, L., Sandoz, E. K., A-Tjak, J. G. L., Ruiz, F. J., Barnes-Holmes, D., Bricker, J. B., Ciarrochi, J., Dixon, M. R., et al. (2021) · Journal of Contextual Behavioral Science · doi:10.1016/j.jcbs.2021.03.007 · Cited by 136 · see citing works
Agile research to complement agile development: A proposal for an mHealth research lifecycle
Wilson, K., Bell, C., Wilson, L., & Witteman, H. (2018) · npj Digital Medicine · doi:10.1038/s41746-018-0053-1 · Cited by 118 · see citing works
The registration continuum in clinical science: A guide toward transparent practices
Benning, S. D., Bachrach, R. L., Smith, E. A., Freeman, A. J., & Wright, A. G. C. (2019) · Journal of Abnormal Psychology · doi:10.1037/abn0000451 · Cited by 77 · see citing works
Orsso, C. E., Montes‐Ibarra, M., Findlay, M., van der Meij, B. S., de van der Schueren, M. A. E., Landi, F., Laviano, A., & Prado, C. M. (2022) · Journal of Cachexia, Sarcopenia and Muscle · doi:10.1002/jcsm.12954 · Cited by 73 · see citing works
Dimairo, M., Pallmann, P., Wason, J., Todd, S., Jaki, T., Julious, S. A., Mander, A. P., Weir, C. J., Koenig, F., Walton, M. K., et al. (2020) · Trials · doi:10.1186/s13063-020-04334-x · Cited by 58 · see citing works
“Notably, classification of ADs in the literature is inconsistent [13, 22], while the scope and complexity of trial adaptations and underpinning statistical methods continues to broaden [18, 20, 106].”
BackgroundInfluentialSelf-citationKane, J. C., Sharma, A., Murray, L. K., Chander, G., Kanguya, T., Skavenski, S., Chitambi, C., Lasater, M. E., Paul, R., Cropsey, K., et al. (2022) · AIDS and Behavior · doi:10.1007/s10461-021-03408-4 · Cited by 49 · see citing works
How to Design AI-Driven Clinical Trials in Nuclear Medicine
Delso, G., Cirillo, D., Kaggie, J. D., Valencia, A., Metser, U., & Veit-Haibach, P. (2021) · Seminars in Nuclear Medicine · doi:10.1053/j.semnuclmed.2020.09.003 · Cited by 36 · see citing works
Mathieu, C., Wych, J., Hendriks, A. E. J., Van Ryckeghem, L., Tree, T., Chmura, P., Möller, C., Casteels, K., Danne, T., Reschke, F., et al. (2025) · The Lancet · doi:10.1016/s0140-6736(25)01674-5 · Cited by 17 · see citing works
Self-citationDrawing causal inferences from randomized controlled trials in psychotherapy research
Kazdin, A. E. (2023) · Psychotherapy Research · doi:10.1080/10503307.2022.2130112 · Cited by 16 · see citing works
- Authors
- Pallmann, P., Bedding, A. W., Choodari-Oskooei, B., Dimairo, M., Flight, L., Hampson, L. V., Holmes, J., Mander, A. P., Odondi, L., Sydes, M. R., Villar, S. S., Wason, J. M. S., Weir, C. J., Wheeler, G. M., Yap, C., & Jaki, T.
- Affiliations
- Lancaster University (GB)
- Roche (United Kingdom) (GB)
- University of Sheffield (GB)
- AstraZeneca (United Kingdom) (GB)
- University of Oxford (GB)
- University of Cambridge (GB)
- MRC Clinical Trials Unit at UCL (GB)
- University of Edinburgh (GB)
- Cancer Research UK Clinical Trials Unit (GB)
- Corresponding author
- Pallmann, Philip
- ORCID
- Venue
- BMC Medicine
- Published
- 2018-02-28
- Volume
- 16
- Issue
- 1
- Pages
- 29-29
- ISSN
- 1741-7015 (ISSN-L)
- PMC
- PMC5830330
- OpenAlex
- W2791498037
- Cited by
- 829
- References
- 155
- Citations by year
- 2026: 93 · 2025: 131 · 2024: 124 · 2023: 131 · 2022: 94 · 2021: 100 · 2020: 97 · 2019: 50 · 2018: 7 · 2014: 1
- FWCI
- 52.90
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- BMC Medicine (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- White Rose Research Online (University of Leeds, The University of Sheffield, University of York) (acceptedVersion)
- ORCA Online Research @Cardiff (Cardiff University) (acceptedVersion)
- University of Birmingham Research Portal (University of Birmingham) (submittedVersion, other-oa)
- Edinburgh Research Explorer (University of Edinburgh) (submittedVersion, cc-by)
- Apollo (University of Cambridge) (submittedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- UCL Discovery (University College London) (submittedVersion)
- University of Birmingham Research Portal (University of Birmingham) (submittedVersion, cc-by)
- Spiral (Imperial College London) (submittedVersion, cc-by)
- Apollo
- Apollo (cc-by)
- Funders
- Medical Research Council (MR/L004933/1-R/N/P/B1, MR/K025635/1, MC_UU_12023/29, MC_UU_12023/24, MC_UU_12023/25, MC_EX_UU_G0800814, G0800860)
- Programme Grants for Applied Research (NIHR-SRF-2015-08-001, DRF-2015-08-013)
- Cancer Research UK (C22436/A15958)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Health Sciences › Medicine › Pediatrics, Perinatology and Child Health › Pharmaceutical studies and practices
- Keywords
- adaptive design, clinical trial design, dose escalation, confirmatory trials, trial reporting, trial interpretation, transparency, reproducibility, research ethics approval, stakeholder communication, trial funding
- MeSH terms
- Clinical Trials as Topic, Humans, Research Design, Reproducibility of Results
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review