Reflection on modern methods: when is a stepped-wedge cluster randomized trial a good study design choice?
Open accessThe DOI matches its Crossref record; 15 of the 15 references it cites were found in a registry or an index.
Abstract
The stepped-wedge cluster randomized trial (SW-CRT) involves the sequential transition of clusters (such as hospitals, public health units or communities) from control to intervention conditions in a randomized order. The use of the SW-CRT is growing rapidly. Yet the SW-CRT is at greater risks of bias compared with the conventional parallel cluster randomized trial (parallel-CRT). For this reason, the CONSORT extension for SW-CRTs requires that investigators provide a clear justification for the choice of study design. In this paper, we argue that all other things being equal, the SW-CRT is at greater risk of bias due to misspecification of the secular trends at the analysis stage. This is particularly problematic for studies randomizing a small number of heterogeneous clusters. We outline the potential conditions under which an SW-CRT might be an appropriate choice. Potentially appropriate and often overlapping justifications for conducting an SW-CRT include: (i) the SW-CRT provides a means to conduct a randomized evaluation which otherwise would not be possible; (ii) the SW-CRT facilitates cluster recruitment as it enhances the acceptability of a randomized evaluation either to cluster gatekeepers or other stakeholders; (iii) the SW-CRT is the only feasible design due to pragmatic and logistical constraints (for example the roll-out of a scare resource); and (iv) the SW-CRT has increased statistical power over other study designs (which will include situations with a limited number of clusters). As the number of arguments in favour of an SW-CRT increases, the likelihood that the benefits of using the SW-CRT, as opposed to a parallel-CRT, outweigh its risks also increases. We argue that the mere popularity and novelty of the SW-CRT should not be a factor in its adoption. In situations when a conventional parallel-CRT is feasible, it is likely to be the preferred design.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The stepped wedge trial design: a systematic review
Brown, C. A., & Lilford, R. J. (2006) · BMC Medical Research Methodology · doi:10.1186/1471-2288-6-54 · Cited by 907
Hemming, K., Taljaard, M., McKenzie, J. E., Hooper, R., Copas, A., Thompson, J. A., Dixon-Woods, M., Aldcroft, A., Doussau, A., Grayling, M., et al. (2018) · BMJ · doi:10.1136/bmj.k1614 · Cited by 475
Self-citationPitfalls of and controversies in cluster randomization trials
Donner, A., & Klar, N. (2004) · American Journal of Public Health · doi:10.2105/ajph.94.3.416 · Cited by 442
Puffer, S., Torgerson, D., & Watson, J. (2003) · BMJ · doi:10.1136/bmj.327.7418.785 · Cited by 351
Campbell, M. K., Fayers, P. M., & Grimshaw, J. M. (2005) · Clinical Trials · doi:10.1191/1740774505cn071oa · Cited by 275
How to design efficient cluster randomised trials
Hemming, K., Eldridge, S., Forbes, G., Weijer, C., & Taljaard, M. (2017) · BMJ · doi:10.1136/bmj.j3064 · Cited by 270
Self-citationHemming, K., Lilford, R., & Girling, A. J. (2015) · Statistics in Medicine · doi:10.1002/sim.6325 · Cited by 236
Self-citationSample size calculations for stepped wedge and cluster randomised trials: a unified approach
Hemming, K., & Taljaard, M. (2016) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2015.08.015 · Cited by 230
Self-citationAnalysis of cluster randomised stepped wedge trials with repeated cross-sectional samples
Hemming, K., Taljaard, M., & Forbes, A. (2017) · Trials · doi:10.1186/s13063-017-1833-7 · Cited by 166
Bias in identifying and recruiting participants in cluster randomised trials: what can be done?
Eldridge, S., Kerry, S., & Torgerson, D. J. (2009) · BMJ · doi:10.1136/bmj.b4006 · Cited by 159
Research works printed but not linked: 28
- Murray, 1998, Design and Analysis of Group Randomized Trials
- Eldridge, 2012, A Practical Guide to Cluster Randomized Trials in Health Services Research, 10.1002/9781119966241 · DOI · Paper page
- Ellenberg, 2018, The stepped-wedge clinical trial: evaluation by rolling deployment, JAMA, 319, 607, 10.1001/jama.2017.21993 · DOI
- Grayling, 2017, Stepped wedge cluster randomized controlled trial designs: a review of reporting quality and design features, Trials, 18, 33., 10.1186/s13063-017-1783-0 · DOI · Paper page
- Haines, 2018, Stepped-wedge cluster-randomized trials: level of evidence, feasibility and reporting, J Physiother, 64, 63, 10.1016/j.jphys.2017.11.008 · DOI
- Hargreaves, 2015, Five questions to consider before conducting a stepped wedge trial, Trials, 16, 350., 10.1186/s13063-015-0841-8 · DOI · Paper page
- Doussau, 2016, Deciphering assumptions about stepped wedge designs: the case of Ebola vaccine research, J Med Ethics, 42, 797, 10.1136/medethics-2015-103292 · DOI
- Binik, 2019, Delaying and withholding interventions: ethics and the stepped wedge trial, J Med Ethics, 45, 662, 10.1136/medethics-2018-105138 · DOI
- Higgins, 2016, A revised tool for assessing risk of bias in randomized trials, Cochrane Database Syst Rev, 10, 1
- Hussey, 2007, Design and analysis of stepped wedge cluster randomized trials, Contemp Clin Trials, 28, 182, 10.1016/j.cct.2006.05.007 · DOI · Paper page
- Hooper, 2016, Sample size calculation for stepped wedge and other longitudinal cluster randomized trials, Stat Med, 35, 4718, 10.1002/sim.7028 · DOI · Paper page
- Kasza, 2019, Impact of non-uniform correlation structure on sample size and power in multiple-period cluster randomized trials, Stat Methods Med Res, 28, 703, 10.1177/0962280217734981 · DOI
- Grantham, 2019, Accounting for a decaying correlation structure in cluster randomized trials with continuous recruitment, Stat Med, 38, 1918, 10.1002/sim.8089 · DOI
- Thompson, 2017, Bias and inference from misspecified mixed-effect models in stepped wedge trial analysis, Stat Med, 36, 3670, 10.1002/sim.7348 · DOI · Paper page
- Kasza, 2019, Inference for the treatment effect in multiple-period cluster randomized trials when random effect correlation structure is misspecified, Stat Methods Med Res, 28, 3112, 10.1177/0962280218797151 · DOI
- Taljaard, 2013, The Ottawa Statement on the ethical design and conduct of cluster randomized trials: precis for researchers and research ethics committees, BMJ, 346, f2838, 10.1136/bmj.f2838 · DOI
- Copas, 2015, Designing a stepped wedge trial: three main designs, carry-over effects and randomization approaches, Trials, 16, 352., 10.1186/s13063-015-0842-7 · DOI · Paper page
- Ivers, 2012, Allocation techniques for balance at baseline in cluster randomized trials: a methodological review, Trials, 13, 120., 10.1186/1745-6215-13-120 · DOI · Paper page
- Li, 2017, An evaluation of constrained randomization for the design and analysis of group-randomized trials with binary outcomes, Stat Med, 36, 3791, 10.1002/sim.7410 · DOI
- Moulton, 2007, Statistical design of THRio: a phased implementation clinic-randomized study of a tuberculosis preventive therapy intervention, Clin Trials, 4, 190, 10.1177/1740774507076937 · DOI
- Ayorinde, 2019, PreImplantation Trial of Histopathology In renal Allografts (PITHIA): a stepped-wedge cluster randomized controlled trial protocol, BMJ Open, 9, e026166., 10.1136/bmjopen-2018-026166 · DOI
- Edwards, 1999, Ethical issues in the design and conduct of cluster randomized controlled trials, BMJ, 318, 1407, 10.1136/bmj.318.7195.1407 · DOI · Paper page
- Prost, 2015, Logistic, ethical, and political dimensions of stepped wedge trials: critical review and case studies, Trials, 16, 351., 10.1186/s13063-015-0837-4 · DOI · Paper page
- Heim, 2017, HELP! Problems in executing a pragmatic, randomized, stepped wedge trial on the Hospital Elder Life Program to prevent delirium in older patients, Trials, 18, 220., 10.1186/s13063-017-1933-4 · DOI
- Girling, 2018, Relative efficiency of unequal cluster sizes in stepped wedge and other trial designs under longitudinal or cross-sectional sampling, Stat Med, 10.1002/sim.7943 · DOI
- Campbell, 2004, Intracluster correlation coefficients in cluster randomized trials: empirical insights into how should they be reported, BMC Med Res Methodol, 4, 9., 10.1186/1471-2288-4-9 · DOI
- Cook, 2012, Clustering in surgical trials - database of intracluster correlations, Trials, 13, 2, 10.1186/1745-6215-13-2 · DOI
- Hemming, 2018, Modeling clustering and treatment effect heterogeneity in parallel and stepped-wedge cluster randomized trials, Stat Med, 37, 883, 10.1002/sim.7553 · DOI
Cited by
Designing and undertaking randomised implementation trials: guide for researchers
Wolfenden, L., Foy, R., Presseau, J., Grimshaw, J. M., Ivers, N. M., Powell, B. J., Taljaard, M., Wiggers, J., Sutherland, R., Nathan, N., et al. (2021) · BMJ · doi:10.1136/bmj.m3721 · Cited by 270
Self-citationStepped wedge cluster randomized trials: a methodological overview
Li, F., & Wang, R. (2022) · World Neurosurgery · doi:10.1016/j.wneu.2021.10.136 · Cited by 37
Contamination: How much can an individually randomized trial tolerate?
Hemming, K., Taljaard, M., Moerbeek, M., & Forbes, A. (2021) · Statistics in Medicine · doi:10.1002/sim.8958 · Cited by 31
Self-citationVolandes, A. E., Chang, Y., Lakin, J. R., Paasche-Orlow, M. K., Lindvall, C., Zupanc, S. N., Martins-Welch, D., Carney, M. T., Burns, E. A., Itty, J., et al. (2025) · JAMA Network Open · doi:10.1001/jamanetworkopen.2025.9150 · Cited by 24
Nguyen, A. M., Cleland, C. M., Dickinson, L. M., Barry, M. P., Cykert, S., Duffy, F. D., Kuzel, A. J., Lindner, S. R., Parchman, M. L., Shelley, D. R., et al. (2022) · The Annals of Family Medicine · doi:10.1370/afm.2810 · Cited by 23
Metadata
- Authors
- Hemming, K., & Taljaard, M.
- Venue
- International Journal of Epidemiology
- Publisher
- Oxford University Press (OUP)
- Published
- 2020-05-09
- Volume
- 49
- Issue
- 3
- Pages
- 1043-1052
- ISSN
- 0300-5771 (ISSN-L)
- 1464-3685
- OpenAlex
- W3021448502
- Cited by
- 155
- References
- 15
- FWCI
- 12.27
- Type
- journal article
- Language
- en
- Open access
- hybrid
- Funders
- UK NIHR Collaborations for Leadership in Applied Health Research and Care West Midlands initiative
- NIHR Senior Research Fellowship (SRF-2017-10-002)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Reflection on modern methods: when is a stepped-wedge cluster randomized trial a good study design choice? https://app.cochat.ai/papers/10.1093/ije/dyaa077
- The paper
- Hemming, K., & Taljaard, M. (2020). Reflection on modern methods: when is a stepped-wedge cluster randomized trial a good study design choice? International Journal of Epidemiology. https://doi.org/10.1093/ije/dyaa077
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.