A Practical Comparison of Group-Sequential and Adaptive Designs
The DOI matches its Crossref record; 1 of the 1 references it cites were found in a registry or an index.
Abstract
Sequential methods provide a formal framework by which clinical trial data can be monitored as they accumulate. The results from interim analyses can be used either to modify the design of the remainder of the trial or to stop the trial as soon as sufficient evidence of either the presence or absence of a treatment effect is available. The circumstances under which the trial will be stopped with a claim of superiority for the experimental treatment, must, however, be determined in advance so as to control the overall type I error rate. One approach to calculating the stopping rule is the group-sequential method. A relatively recent alternative to group-sequential approaches is the adaptive design method. This latter approach provides considerable flexibility in changes to the design of a clinical trial at an interim point. However, a criticism is that the method by which evidence from different parts of the trial is combined means that a final comparison of treatments is not based on a sufficient statistic for the treatment difference, suggesting that the method may lack power. The aim of this paper is to compare two adaptive design approaches with the group-sequential approach. We first compare the form of the stopping boundaries obtained using the different methods. We then focus on a comparison of the power of the different trials when they are designed so as to be as similar as possible. We conclude that all methods acceptably control type I error rate and power when the sample size is modified based on a variance estimate, provided no interim analysis is so small that the asymptotic properties of the test statistic no longer hold. In the latter case, the group-sequential approach is to be preferred. Provided that asymptotic assumptions hold, the adaptive design approaches control the type I error rate even if the sample size is adjusted on the basis of an estimate of the treatment effect, showing that the adaptive designs allow more modifications than the group-sequential method.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Discrete sequential boundaries for clinical trials
GORDON LAN, K. K., & DEMETS, D. L. (1983) · Biometrika · doi:10.1093/biomet/70.3.659 · Cited by 2,310 · cited 4×
“…reject H0 at or before look j H0 = ∗U tj (1) and Pr stop and do not reject H0 at or before look j H0 = ∗L tj (2) with tj , the observed information time at the jth look, equal to the ratio of Vj to Vmax, where Vmax is the planned information, at the final interim analysis (Lan and DeMets, 1983).”
BackgroundMethodInfluential
Research works printed but not linked: 22
- 10.2307/2343787 · DOI · Paper page
- Bauer P., 1992, Biom. Und Inf. In Med. U. Biol., 20, 130
- Bauer P., 1994, Biometrics, 51, 1029, 10.2307/2533441 · DOI · Paper page
- 10.1111/j.0006-341X.1999.00853.x · DOI · Paper page
- Facey K. M., 1992, Controlled Clinical Trials, 13, 122, 10.1016/0197-2456(92)90018-U · DOI
- 10.1002/(SICI)1097-0258(19980730)17:14<1551::AID-SIM868>3.0.CO;2-E · DOI · Paper page
- 10.1080/03610929208830947 · DOI · Paper page
- 10.1002/sim.4780140922 · DOI · Paper page
- 10.1002/sim.4780091207 · DOI · Paper page
- Jennison C., 2000, Group Sequential Methods with Applications to Clinical Trials
- 10.1002/sim.1457 · DOI · Paper page
- Kim K., 1987, Biometrika, 74, 149, 10.1093/biomet/74.1.149 · DOI · Paper page
- Lan K. K. G., 1983, Biometrika, 70, 659, 10.2307/2336502 · DOI · Paper page
- 10.1111/j.0006-341X.1999.01286.x · DOI · Paper page
- 10.1111/j.0006-341X.2001.00886.x · DOI · Paper page
- Scharfstein D. O., 1997, Journal of the American Statistical Association, 92, 1342, 10.1080/01621459.1997.10473655 · DOI · Paper page
- Slud E. V., 1982, Journal of the American Statistical Association, 77, 862, 10.1080/01621459.1982.10477899 · DOI · Paper page
- 10.1080/10543409608835149 · DOI
- 10.1093/biomet/90.2.367 · DOI · Paper page
- Wassmer G., 1999, Biometrical Journal, 41, 279, 10.1002/(SICI)1521-4036(199906)41:3<279::AID-BIMJ279>3.0.CO;2-V · doi:10.1002/(sici)1521-4036(199906)41:3<279::aid-bimj279>3.0.co;2-v
- Whitehead J., 1997, The Design and Analysis of Sequential Clinical Trials, 10.2307/2533535 · DOI · Paper page
- 10.1002/1097-0258(20010130)20:2<165::AID-SIM649>3.0.CO;2-A · doi:10.1002/1097-0258(20010130)20:2<165::aid-sim649>3.0.co;2-a
Cited by
Moher, D., Hopewell, S., Schulz, K. F., Montori, V., Gotzsche, P. C., Devereaux, P. J., Elbourne, D., Egger, M., & Altman, D. G. (2010) · BMJ · doi:10.1136/bmj.c869 · Cited by 8,883
Moher, D., Hopewell, S., Schulz, K. F., Montori, V., Gøtzsche, P. C., Devereaux, P. J., Elbourne, D., Egger, M., & Altman, D. G. (2012) · International Journal of Surgery · doi:10.1016/j.ijsu.2011.10.001 · Cited by 2,345
Trial sequential analysis may establish when firm evidence is reached in cumulative meta-analysis
Wetterslev, J., Thorlund, K., Brok, J., & Gluud, C. (2008) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2007.03.013 · Cited by 1,881
Moher, D., Hopewell, S., Schulz, K. F., Montori, V., Gøtzsche, P. C., Devereaux, P. J., Elbourne, D., Egger, M., & Altman, D. G. (2010) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.03.004 · Cited by 1,858
Dose finding—a challenge in statistics.
Bretz, F., Hsu, J., Pinheiro, J., & Liu, Y. (2008) · Biometrical Journal · doi:10.1002/bimj.200810438 · Cited by 101
“It can be shown that if the interim analyses occur at the pre-planned information fractions and the design is not adapted during the conduct of the trial, the resulting stopping boundaries are the same as in classical group sequential methods but not the test statistics (Kelly et al., 2005).”
Background
Metadata
- Authors
- Kelly, P. J., Roshini Sooriyarachchi, M., Stallard, N., & Todd, S.
- Venue
- Journal of Biopharmaceutical Statistics
- Publisher
- Informa UK Limited
- Published
- 2005-07-01
- Volume
- 15
- Issue
- 4
- Pages
- 719-738
- ISSN
- 1054-3406 (ISSN-L)
- 1520-5711
- OpenAlex
- W2046292029
- Cited by
- 44
- References
- 1
- FWCI
- 2.50
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.