Substantial risks associated with few clusters in cluster randomized and stepped wedge designs
The DOI matches its Crossref record; 5 of the 5 references it cites were found in a registry or an index.
Abstract
Given the growing attention to quality improvement, comparative effectiveness research, and pragmatic trials embedded within learning health systems, the use of the cluster randomization design is bound to increase. The number of clusters available for randomization is often limited in such trials. Designs that incorporate pre-intervention measurements (e.g. cluster cross-over, repeated parallel arm, and stepped wedge designs) can substantially reduce the required numbers of clusters by decreasing between-cluster sources of variation. However, there are substantial risks associated with few clusters, including increased probability of chance imbalances and type I and type II error, limited perceived or actual generalizability, and fewer options for statistical analysis. Furthermore, current sample size methods for the stepped wedge design make a strong underlying assumption with respect to the correlation structure—in particular, that the intracluster and inter-period correlations are equal. This is in contrast with methods for the cluster cross-over design that explicitly allow for a smaller inter-period correlation. Failing to similarly allow for the inter-period correlation in the design of a stepped wedge trial may yield perilously low sample sizes. Further methodological and empirical work is required to inform sample size methods and guidance for the stepped wedge trial and to provide minimum thresholds for this design.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Sufficient Sample Sizes for Multilevel Modeling
Maas, C. J. M., & Hox, J. J. (2005) · Methodology · doi:10.1027/1614-2241.1.3.86 · Cited by 3,582
Hemming, K., Lilford, R., & Girling, A. J. (2015) · Statistics in Medicine · doi:10.1002/sim.6325 · Cited by 236 · cited 1×
“Possibly in an attempt to maximize the informational value from relatively few clusters, there has been an upsurge in interest in the use of novel designs, including cluster cross-over designs,(2) designs with repeated pre- and post-intervention crosssections,(3) and stepped wedge designs.(4) The implications of such…”
BackgroundSample size calculations for stepped wedge and cluster randomised trials: a unified approach
Hemming, K., & Taljaard, M. (2016) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2015.08.015 · Cited by 230 · cited 1×
“Comparisons of the relative efficiencies of stepped wedge and parallel arm designs have, however, found that stepped wedge designs usually require fewer clusters than parallel arm designs when r is large (‘‘how large,’’ depends on cluster size).(6,7) The increased potential statistical efficiency in a stepped wedge de…”
BackgroundSelf-citationIvers, N. M., Taljaard, M., Dixon, S., Bennett, C., McRae, A., Taleban, J., Skea, Z., Brehaut, J. C., Boruch, R. F., Eccles, M. P., et al. (2011) · BMJ · doi:10.1136/bmj.d5886 · Cited by 193 · cited 1×
“In a review of a random sample of 300 published cluster randomized trials of which 285 reported the number of clusters, 41 (14%) randomized fewer than four clusters per arm.(23) In a systematic review of 32 stepped wedge trials, 9 (28%) allocated fewer than 10 clusters.”
BackgroundSelf-citationAustin, P. C. (2010) · The International Journal of Biostatistics · doi:10.2202/1557-4679.1195 · Cited by 193
Cited by
Hemming, K., Taljaard, M., McKenzie, J. E., Hooper, R., Copas, A., Thompson, J. A., Dixon-Woods, M., Aldcroft, A., Doussau, A., Grayling, M., et al. (2018) · BMJ · doi:10.1136/bmj.k1614 · Cited by 475
Self-citationHow to design efficient cluster randomised trials
Hemming, K., Eldridge, S., Forbes, G., Weijer, C., & Taljaard, M. (2017) · BMJ · doi:10.1136/bmj.j3064 · Cited by 270
Self-citationDesigning and undertaking randomised implementation trials: guide for researchers
Wolfenden, L., Foy, R., Presseau, J., Grimshaw, J. M., Ivers, N. M., Powell, B. J., Taljaard, M., Wiggers, J., Sutherland, R., Nathan, N., et al. (2021) · BMJ · doi:10.1136/bmj.m3721 · Cited by 270
Self-citationKahan, B. C., Forbes, G., Ali, Y., Jairath, V., Bremner, S., Harhay, M. O., Hooper, R., Wright, N., Eldridge, S. M., & Leyrat, C. (2016) · Trials · doi:10.1186/s13063-016-1571-2 · Cited by 185
“Including only a very small number of clusters also has other implications for the study’s validity [28].”
BackgroundAnalysis of cluster randomised stepped wedge trials with repeated cross-sectional samples
Hemming, K., Taljaard, M., & Forbes, A. (2017) · Trials · doi:10.1186/s13063-017-1833-7 · Cited by 166
“An alternate but equivalent specification is with the use of ρI/ρW rather than ρI, which has been termed the cluster autocorrelation [25].”
Background
Metadata
- Authors
- Taljaard, M., Teerenstra, S., Ivers, N. M., & Fergusson, D. A.
- Venue
- Clinical Trials
- Publisher
- SAGE Publications
- Published
- 2016-03-03
- Volume
- 13
- Issue
- 4
- Pages
- 459-463
- ISSN
- 1740-7745 (ISSN-L)
- 1740-7753
- OpenAlex
- W2313243722
- Cited by
- 96
- References
- 5
- FWCI
- 9.74
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Substantial risks associated with few clusters in cluster randomized and stepped wedge designs. https://app.cochat.ai/papers/10.1177/1740774516634316
- The paper
- Taljaard, M., Teerenstra, S., Ivers, N. M., & Fergusson, D. A. (2016). Substantial risks associated with few clusters in cluster randomized and stepped wedge designs. Clinical Trials. https://doi.org/10.1177/1740774516634316
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.