Review of Recent Methodological Developments in Group-Randomized Trials: Part 1—Design
Open accessThe DOI matches its Crossref record; 19 of the 19 references it cites were found in a registry or an index.
Abstract
In 2004, Murray et al. reviewed methodological developments in the design and analysis of group-randomized trials (GRTs). We have highlighted the developments of the past 13 years in design with a companion article to focus on developments in analysis. As a pair, these articles update the 2004 review. We have discussed developments in the topics of the earlier review (e.g., clustering, matching, and individually randomized group-treatment trials) and in new topics, including constrained randomization and a range of randomized designs that are alternatives to the standard parallel-arm GRT. These include the stepped-wedge GRT, the pseudocluster randomized trial, and the network-randomized GRT, which, like the parallel-arm GRT, require clustering to be accounted for in both their design and analysis.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Consort 2010 statement: extension to cluster randomised trials
Campbell, M. K., Piaggio, G., Elbourne, D. R., Altman, D. G., & for the CONSORT Group (2012) · BMJ · doi:10.1136/bmj.e5661 · Cited by 3,510
CONSORT statement: extension to cluster randomised trials
Campbell, M. K., Elbourne, D. R., & Altman, D. G. (2004) · BMJ · doi:10.1136/bmj.328.7441.702 · Cited by 2,557
The stepped wedge cluster randomised trial: rationale, design, analysis, and reporting
Hemming, K., Haines, T. P., Chilton, P. J., Girling, A. J., & Lilford, R. J. (2015) · BMJ · doi:10.1136/bmj.h391 · Cited by 1,410
The stepped wedge trial design: a systematic review
Brown, C. A., & Lilford, R. J. (2006) · BMC Medical Research Methodology · doi:10.1186/1471-2288-6-54 · Cited by 907
Design and analysis of group-randomized trials: a review of recent methodological developments
Murray, D. M., Varnell, S. P., & Blitstein, J. L. (2004) · American Journal of Public Health · doi:10.2105/ajph.94.3.423 · Cited by 677 · cited 7×
“in Group-Randomized Trials: Part 1—Design In 2004, Murray et al. reviewed methodological developments in the design and analysis of group-randomized trials (GRTs).”
InfluentialSelf-citationEldridge, S. M., Ashby, D., & Kerry, S. (2006) · International Journal of Epidemiology · doi:10.1093/ije/dyl129 · Cited by 529
Pitfalls of and controversies in cluster randomization trials
Donner, A., & Klar, N. (2004) · American Journal of Public Health · doi:10.2105/ajph.94.3.416 · Cited by 442
Mdege, N. D., Man, M.-S., Taylor (nee Brown), C. A., & Torgerson, D. J. (2011) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.12.003 · Cited by 425
Design and analysis of clinical trials with clustering effects due to treatment
Roberts, C., & Roberts, S. A. (2005) · Clinical Trials · doi:10.1191/1740774505cn076oa · Cited by 299
Campbell, M. K., Fayers, P. M., & Grimshaw, J. M. (2005) · Clinical Trials · doi:10.1191/1740774505cn071oa · Cited by 275
Carlbring, P., Bohman, S., Brunt, S., Buhrman, M., Westling, B. E., Ekselius, L., & Andersson, G. (2006) · American Journal of Psychiatry · doi:10.1176/ajp.2006.163.12.2119 · Cited by 262
Hemming, K., Lilford, R., & Girling, A. J. (2015) · Statistics in Medicine · doi:10.1002/sim.6325 · Cited by 236
Sample size calculations for stepped wedge and cluster randomised trials: a unified approach
Hemming, K., & Taljaard, M. (2016) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2015.08.015 · Cited by 230
Review of recent methodological developments in group-randomized trials: part 2—analysis
Turner, E. L., Prague, M., Gallis, J. A., Li, F., & Murray, D. M. (2017) · American Journal of Public Health · doi:10.2105/ajph.2017.303707 · Cited by 195 · cited 2×
“In practice, if covariate imbalance is present even after using 1 of the design strategies described, such imbalance can be accounted for by using adjusted analysis that is either preplanned in the protocol or through post hoc sensitivity analysis.(7) In summary, constrained randomization seeks to provide both interna…”
Self-citationHow big should the pilot study for my cluster randomised trial be?
Eldridge, S. M., Costelloe, C. E., Kahan, B. C., Lancaster, G. A., & Kerry, S. M. (2016) · Statistical Methods in Medical Research · doi:10.1177/0962280215588242 · Cited by 135
Beard, E., Lewis, J. J., Copas, A., Davey, C., Osrin, D., Baio, G., Thompson, J. A., Fielding, K. L., Omar, R. Z., Ononge, S., et al. (2015) · Trials · doi:10.1186/s13063-015-0839-2 · Cited by 135
Pals, S. L., Murray, D. M., Alfano, C. M., Shadish, W. R., Hannan, P. J., & Baker, W. L. (2008) · American Journal of Public Health · doi:10.2105/ajph.2007.127027 · Cited by 104
Self-citationSample size formulae for trials comparing group and individual treatments in a multilevel model
Moerbeek, M., & Wong, W. K. (2008) · Statistics in Medicine · doi:10.1002/sim.3115 · Cited by 92
Arnup, S. J., Forbes, A. B., Kahan, B. C., Morgan, K. E., & McKenzie, J. E. (2016) · Trials · doi:10.1186/s13063-016-1685-6 · Cited by 20
Research works printed but not linked: 121
- Murray DM, 1998, Design and Analysis of Group-Randomized Trials
- 10.1201/9781584888178 · DOI · Paper page
- Donner A, 2000, Design and Analysis of Cluster Randomization Trials in Health Research
- 10.1002/9781119966241 · DOI · Paper page
- 10.1002/9781118763452 · DOI · Paper page
- 10.1111/j.1751-5823.2009.00092.x · DOI · Paper page
- 10.1186/s13063-016-1201-z · DOI
- 10.1016/j.jclinepi.2014.10.006 · DOI · Paper page
- 10.1111/j.0006-341X.1999.00137.x · DOI · Paper page
- 10.1016/j.cct.2009.04.005 · DOI
- 10.1002/sim.3582 · DOI
- 10.1093/aje/kwr183 · DOI · Paper page
- 10.1177/1740774511423851 · DOI
- 10.1016/j.cct.2012.05.004 · DOI · Paper page
- 10.1002/sim.5548 · DOI
- 10.1002/bimj.201500093 · DOI
- 10.1002/sim.1643 · DOI
- 10.1111/j.0006-341X.2004.00232.x · DOI · Paper page
- 10.1002/sim.1721 · DOI · Paper page
- 10.1191/1740774505cn072oa · DOI · Paper page
- 10.1002/sim.2304 · DOI
- 10.1177/1740774515606377 · DOI
- 10.1016/j.cct.2013.07.003 · DOI
- Moerbeek M, 2016, Power Analysis of Trials With Multilevel Data
- 10.1136/bmjopen-2016-013972 · DOI
- 10.1186/s13063-016-1530-y · DOI · Paper page
- 10.1093/jnci/83.22.1620 · DOI · Paper page
- 10.1093/jnci/djn066 · DOI · Paper page
- 10.1002/sim.4780110605 · DOI · Paper page
- 10.1186/1471-2288-6-17 · DOI · Paper page
- 10.1002/sim.4050 · DOI · Paper page
- 10.1002/sim.1121 · DOI · Paper page
- 10.1002/1521-4036(200102)43:1<75::AID-BIMJ75>3.0.CO;2-N · DOI · Paper page
- 10.1002/1097-0258(20010215)20:3<377::AID-SIM799>3.0.CO;2-N · DOI · Paper page
- 10.1002/sim.2740 · DOI · Paper page
- Candel MJ, 2010, Stat Med, 29, 1488, 10.1002/sim.3857 · DOI · Paper page
- 10.1177/1740774510391492 · DOI
- 10.1002/sim.6851 · DOI
- 10.1002/sim.6565 · DOI · Paper page
- 10.1016/j.jclinepi.2014.12.006 · DOI
- 10.1186/1745-6215-13-120 · DOI · Paper page
- 10.1002/sim.2662 · DOI
- 10.1214/08-STS274 · DOI · Paper page
- 10.1214/09-STS274A · doi:10.1214/09-sts274a
- 10.1214/09-STS274B · DOI
- 10.1214/09-STS274REJ · DOI
- 10.1002/(SICI)1097-0258(19970815)16:15<1753::AID-SIM597>3.0.CO;2-E · DOI · Paper page
- 10.1002/1097-0258(20010215)20:3<351::AID-SIM797>3.0.CO;2-C · DOI
- 10.1186/1471-2288-8-65 · DOI · Paper page
- 10.1016/j.jclinepi.2011.05.006 · DOI
- 10.1002/sim.6813 · DOI
- 10.1191/1740774504cn024oa · DOI · Paper page
- Snedecor GW, 1989, Statistical Methods
- 10.1177/0193841X9602000305 · DOI · Paper page
- 10.1093/oxfordjournals.aje.a113261 · DOI · Paper page
- 10.1093/oxfordjournals.aje.a112592 · DOI · Paper page
- 10.1002/sim.5352 · DOI · Paper page
- Heo M, 2010, Stat Med, 29, 382, 10.1002/sim.3806 · DOI · Paper page
- 10.1002/sim.2714 · DOI
- 10.1111/j.1541-0420.2009.01374.x · DOI · Paper page
- 10.1111/j.1541-0420.2008.00993.x · DOI · Paper page
- 10.1177/1740774508096476 · DOI · Paper page
- 10.1080/10543406.2014.888442 · DOI
- 10.1002/sim.3527 · DOI · Paper page
- 10.1177/0962280214547381 · DOI
- 10.1016/j.csda.2012.11.016 · DOI
- 10.1177/0193841X09337991 · DOI
- 10.1186/1471-2288-11-102 · DOI · Paper page
- 10.1016/j.cct.2009.03.007 · DOI
- 10.1002/sim.3620 · DOI
- 10.1002/sim.3681 · DOI
- 10.1093/ije/dyv113 · DOI · Paper page
- 10.1016/j.cct.2015.02.011 · DOI
- 10.2105/AJPH.2016.303068 · DOI · Paper page
- 10.1016/j.cct.2006.05.007 · DOI · Paper page
- 10.1186/s13063-015-0841-8 · DOI · Paper page
- 10.1177/1740774507076937 · DOI · Paper page
- 10.1186/s13063-015-0837-4 · DOI · Paper page
- 10.1186/1745-6215-14-132 · DOI
- 10.1016/j.jclinepi.2012.06.004 · DOI
- 10.1016/j.jclinepi.2012.06.016 · DOI
- 10.1093/jncimonographs/lgq014 · DOI
- 10.1191/096228000670953670 · DOI
- 10.1186/s13063-015-0842-7 · DOI · Paper page
- 10.1186/s13063-015-0840-9 · DOI · Paper page
- 10.3122/jabfm.2011.05.110067 · DOI · Paper page
- Hemming K, 2014, Stata J, 14, 363, 10.1177/1536867X1401400208 · DOI · Paper page
- 10.1016/j.spl.2015.01.024 · DOI
- 10.1002/sim.6850 · DOI · Paper page
- 10.1198/016214508000000292 · DOI · Paper page
- 10.1177/1740774514523351 · DOI
- 10.1111/add.12095 · DOI
- 10.1038/srep17581 · DOI
- 10.1177/1740774516673355 · DOI
- 10.1038/nature01343 · DOI · Paper page
- 10.3201/eid1005.030419 · DOI
- 10.1126/science.347.6219.219 · DOI
- Ebola Ça Suffit Ring Vaccination Trial Consortium, 2015, BMJ, 351, h3740
- 10.1191/1740774505cn073oa · DOI · Paper page
- 10.1002/sim.2200 · DOI · Paper page
- 10.1186/1472-6963-5-65 · DOI
- Pence BW, 2015, Am J Epidemiol, 182, 1039
- 10.1016/j.jclinepi.2007.12.001 · DOI
- 10.1097/QAD.0000000000000797 · DOI
- 10.1016/j.jclinepi.2005.10.003 · DOI
- 10.1037/a0023464 · DOI · Paper page
- 10.1038/oby.2006.100 · DOI
- 10.1037/0278-6133.25.1.34 · DOI · Paper page
- 10.1186/1471-2288-13-58 · DOI · Paper page
- Pals SL, 2011, AIDS, 25, 989, 10.1097/QAD.0b013e3283467198 · DOI
- 10.1136/bmj.330.7483.142 · DOI · Paper page
- 10.1016/j.jclinepi.2007.10.018 · DOI
- 10.1186/s12874-015-0006-1 · DOI
- 10.1002/sim.5521 · DOI
- 10.1002/sim.6083 · DOI
- 10.1146/annurev-publhealth-032315-021702 · DOI
- 10.3102/1076998610379136 · DOI · Paper page
- 10.1002/sim.3383 · DOI · Paper page
- 10.1016/j.jclinepi.2014.06.004 · DOI
- 10.1002/sim.4237 · DOI
- 10.3102/1076998609332748 · DOI · Paper page
Cited by
Selecting and Improving Quasi-Experimental Designs in Effectiveness and Implementation Research
Handley, M. A., Lyles, C. R., McCulloch, C., & Cattamanchi, A. (2018) · Annual Review of Public Health · doi:10.1146/annurev-publhealth-040617-014128 · Cited by 428
Review of recent methodological developments in group-randomized trials: part 2—analysis
Turner, E. L., Prague, M., Gallis, J. A., Li, F., & Murray, D. M. (2017) · American Journal of Public Health · doi:10.2105/ajph.2017.303707 · Cited by 195
“They found that the adjusted F test and the permutation test maintained the nominal size and had similar power but cautioned that the randomization distribution must be calculated within the constrained randomization space to prevent inflation of the type I error rate.19 1080 Surveillance Peer Reviewed Turner et al. A…”
MethodInfluentialSelf-citationStepped wedge cluster randomized trials: a methodological overview
Li, F., & Wang, R. (2022) · World Neurosurgery · doi:10.1016/j.wneu.2021.10.136 · Cited by 37
Self-citationCluster randomized trials of individual-level interventions were at high risk of bias
Easter, C., Thompson, J. A., Eldridge, S., Taljaard, M., & Hemming, K. (2021) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2021.06.021 · Cited by 34
Methods for dealing with unequal cluster sizes in cluster randomized trials: a scoping review
Zhan, D., Xu, L., Ouyang, Y., Sawatzky, R., & Wong, H. (2021) · PLOS ONE · doi:10.1371/journal.pone.0255389 · Cited by 18
“[5, 6] reviewed recent methodological developments for the design and the analysis of CRTs, respectively.”
Background
Metadata
- Authors
- Turner, E. L., Li, F., Gallis, J. A., Prague, M., & Murray, D. M.
- Venue
- American Journal of Public Health
- Publisher
- American Public Health Association
- Published
- 2017-06
- Volume
- 107
- Issue
- 6
- Pages
- 907-915
- ISSN
- 0090-0036 (ISSN-L)
- 1541-0048
- OpenAlex
- W4231859069
- Cited by
- 165
- References
- 19
- FWCI
- 9.61
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.