An evaluation of constrained randomization for the design and analysis of group‐randomized trials with binary outcomes
Open accessThe DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.
Abstract
Group‐randomized trials are randomized studies that allocate intact groups of individuals to different comparison arms. A frequent practical limitation to adopting such research designs is that only a limited number of groups may be available, and therefore, simple randomization is unable to adequately balance multiple group‐level covariates between arms. Therefore, covariate‐based constrained randomization was proposed as an allocation technique to achieve balance. Constrained randomization involves generating a large number of possible allocation schemes, calculating a balance score that assesses covariate imbalance, limiting the randomization space to a prespecified percentage of candidate allocations, and randomly selecting one scheme to implement. When the outcome is binary, a number of statistical issues arise regarding the potential advantages of such designs in making inference. In particular, properties found for continuous outcomes may not directly apply, and additional variations on statistical tests are available. Motivated by two recent trials, we conduct a series of Monte Carlo simulations to evaluate the statistical properties of model‐based and randomization‐based tests under both simple and constrained randomization designs, with varying degrees of analysis‐based covariate adjustment. Our results indicate that constrained randomization improves the power of the linearization F‐test, the KC‐corrected GEE t‐test (Kauermann and Carroll, 2001, Journal of the American Statistical Association 96, 1387‐1396), and two permutation tests when the prognostic group‐level variables are controlled for in the analysis and the size of randomization space is reasonably small. We also demonstrate that constrained randomization reduces power loss from redundant analysis‐based adjustment for non‐prognostic covariates. Design considerations such as the choice of the balance metric and the size of randomization space are discussed.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Quasi-likelihood functions, generalized linear models, and the Gauss—Newton method
WEDDERBURN, R. W. M. (1974) · Biometrika · doi:10.1093/biomet/61.3.439 · Cited by 2,122
Design and analysis of group-randomized trials: a review of recent methodological developments
Murray, D. M., Varnell, S. P., & Blitstein, J. L. (2004) · American Journal of Public Health · doi:10.2105/ajph.94.3.423 · Cited by 677 · cited 12×
“Given the existing discrepancies in statistical practice, we reinforce the general recommendation on analysis-based covariate adjustment in the context of small GRTs. Motivated by two recent GRTs with binary outcomes, we focus on constrained randomization designs and compare, using simulations, different analytical me…”
InfluentialSelf-citationA Covariance Estimator for GEE with Improved Small‐Sample Properties
Mancl, L. A., & DeRouen, T. A. (2001) · Biometrics · doi:10.1111/j.0006-341x.2001.00126.x · Cited by 656
Stratified Randomization for Clinical Trials
Kernan, W. N., Viscoli, C. M., Makuch, R. W., Brass, L. M., & Horwitz, R. I. (1999) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(98)00138-3 · Cited by 627
Pitfalls of and controversies in cluster randomization trials
Donner, A., & Klar, N. (2004) · American Journal of Public Health · doi:10.2105/ajph.94.3.416 · Cited by 442 · cited 10×
“Given the existing discrepancies in statistical practice, we reinforce the general recommendation on analysis-based covariate adjustment in the context of small GRTs. Motivated by two recent GRTs with binary outcomes, we focus on constrained randomization designs and compare, using simulations, different analytical me…”
InfluentialMethods to reduce the impact of intraclass correlation in group-randomized trials.
Murray, D. M., & Blitstein, J. L. (2003) · Evaluation Review · doi:10.1177/0193841x02239019 · Cited by 221 · cited 10×
“Given the existing discrepancies in statistical practice, we reinforce the general recommendation on analysis-based covariate adjustment in the context of small GRTs. Motivated by two recent GRTs with binary outcomes, we focus on constrained randomization designs and compare, using simulations, different analytical me…”
InfluentialSelf-citationReview of recent methodological developments in group-randomized trials: part 2—analysis
Turner, E. L., Prague, M., Gallis, J. A., Li, F., & Murray, D. M. (2017) · American Journal of Public Health · doi:10.2105/ajph.2017.303707 · Cited by 195 · cited 1×
“Although variations in group sizes should not affect the validity of permutation tests,(41) the appropriate choice of model-based tests may depend on the degree of group size variability.(35,47) Another possible limitation is that we only considered group-level binary covariates in generating the outcome data.”
Self-citationLi, P., & Redden, D. T. (2015) · BMC Medical Research Methodology · doi:10.1186/s12874-015-0026-x · Cited by 142
A comparison of two bias-corrected covariance estimators for generalized estimating equations
Lu, B., Preisser, J. S., Qaqish, B. F., Suchindran, C., Bangdiwala, S. I., & Wolfson, M. (2007) · Biometrics · doi:10.1111/j.1541-0420.2007.00764.x · Cited by 118
Cited by
Review of recent methodological developments in group-randomized trials: part 2—analysis
Turner, E. L., Prague, M., Gallis, J. A., Li, F., & Murray, D. M. (2017) · American Journal of Public Health · doi:10.2105/ajph.2017.303707 · Cited by 195
Self-citationCraig, S. L., Eaton, A. D., Leung, V. W. Y., Iacono, G., Pang, N., Dillon, F., Austin, A., Pascoe, R., & Dobinson, C. (2021) · BMC Psychology · doi:10.1186/s40359-021-00595-6 · Cited by 88
Ara, G., Khanam, M., Papri, N., Nahar, B., Kabir, I., Sanin, K. I., Khan, S. S., Sarker, M. S. A., & Dibley, M. J. (2019) · Current Developments in Nutrition · doi:10.1093/cdn/nzz072 · Cited by 27
“Due to the limited number of clusters, we used restricted randomization to allocate the treatments in this trial (22, 26).”
Method
Metadata
- Authors
- Li, F., Turner, E. L., Heagerty, P. J., Murray, D. M., Vollmer, W. M., & DeLong, E. R.
- Venue
- Statistics in Medicine
- Publisher
- Wiley
- Published
- 2017-08-07
- Volume
- 36
- Issue
- 24
- Pages
- 3791-3806
- ISSN
- 0277-6715 (ISSN-L)
- 1097-0258
- OpenAlex
- W2744478159
- Cited by
- 102
- References
- 9
- FWCI
- 5.47
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.