Bias and inference from misspecified mixed‐effect models in stepped wedge trial analysis
Open accessThe DOI matches its Crossref record; 3 of the 3 references it cites were found in a registry or an index.
Abstract
Many stepped wedge trials (SWTs) are analysed by using a mixed‐effect model with a random intercept and fixed effects for the intervention and time periods (referred to here as the standard model). However, it is not known whether this model is robust to misspecification. We simulated SWTs with three groups of clusters and two time periods; one group received the intervention during the first period and two groups in the second period. We simulated period and intervention effects that were either common‐to‐all or varied‐between clusters. Data were analysed with the standard model or with additional random effects for period effect or intervention effect. In a second simulation study, we explored the weight given to within‐cluster comparisons by simulating a larger intervention effect in the group of the trial that experienced both the control and intervention conditions and applying the three analysis models described previously. Across 500 simulations, we computed bias and confidence interval coverage of the estimated intervention effect. We found up to 50% bias in intervention effect estimates when period or intervention effects varied between clusters and were treated as fixed effects in the analysis. All misspecified models showed undercoverage of 95% confidence intervals, particularly the standard model. A large weight was given to within‐cluster comparisons in the standard model. In the SWTs simulated here, mixed‐effect models were highly sensitive to departures from the model assumptions, which can be explained by the high dependence on within‐cluster comparisons. Trialists should consider including a random effect for time period in their SWT analysis model. © 2017 The Authors. Statistics in Medicine published by John Wiley & Sons Ltd.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Consort 2010 statement: extension to cluster randomised trials
Campbell, M. K., Piaggio, G., Elbourne, D. R., Altman, D. G., & for the CONSORT Group (2012) · BMJ · doi:10.1136/bmj.e5661 · Cited by 3,510
Sample size calculations for stepped wedge and cluster randomised trials: a unified approach
Hemming, K., & Taljaard, M. (2016) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2015.08.015 · Cited by 230 · cited 1×
“Since the standard error from the standard model is used in most current methods of SWT sample size calculations [12, 16-18], they should not be applied when the period effect or intervention effect are expected to vary between clusters, at least in relation to the characteristics of the trial exemplar used in this pa…”
MethodDavey, C., Aiken, A. M., Hayes, R. J., & Hargreaves, J. R. (2015) · International Journal of Epidemiology · doi:10.1093/ije/dyv128 · Cited by 100 · cited 1×
“This does help to explain the counterintuitive results seen in the motivating example [2].”
ResultSelf-citation
Cited by
Using simulation studies to evaluate statistical methods
Morris, T. P., White, I. R., & Crowther, M. J. (2019) · Statistics in Medicine · doi:10.1002/sim.8086 · Cited by 1,305
A randomized trial of a family-support intervention in intensive care units
White, D. B., Angus, D. C., Shields, A.-M., Buddadhumaruk, P., Pidro, C., Paner, C., Chaitin, E., Chang, C.-C. H., Pike, F., Weissfeld, L., et al. (2018) · New England Journal of Medicine · doi:10.1056/nejmoa1802637 · Cited by 524
Hemming, K., Taljaard, M., McKenzie, J. E., Hooper, R., Copas, A., Thompson, J. A., Dixon-Woods, M., Aldcroft, A., Doussau, A., Grayling, M., et al. (2018) · BMJ · doi:10.1136/bmj.k1614 · Cited by 475
Self-citationStepped wedge cluster randomized trials: a methodological overview
Li, F., & Wang, R. (2022) · World Neurosurgery · doi:10.1016/j.wneu.2021.10.136 · Cited by 37
Hemming, K., Carroll, K., Thompson, J., Forbes, A., Taljaard, M., Dutton, S. J., Madurasinghe, V., Morgan, K., Stuart, B., Fielding, K., et al. (2019) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2018.11.017 · Cited by 26
Self-citation
Metadata
- Authors
- Thompson, J. A., Fielding, K. L., Davey, C., Aiken, A. M., Hargreaves, J. R., & Hayes, R. J.
- Venue
- Statistics in Medicine
- Publisher
- Wiley
- Published
- 2017-05-28
- Volume
- 36
- Issue
- 23
- Pages
- 3670-3682
- ISSN
- 0277-6715 (ISSN-L)
- 1097-0258
- OpenAlex
- W2617542875
- Cited by
- 64
- References
- 3
- FWCI
- 5.28
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Bias and inference from misspecified mixed‐effect models in stepped wedge trial analysis. https://app.cochat.ai/papers/10.1002/sim.7348
- The paper
- Thompson, J. A., Fielding, K. L., Davey, C., Aiken, A. M., Hargreaves, J. R., & Hayes, R. J. (2017). Bias and inference from misspecified mixed‐effect models in stepped wedge trial analysis. Statistics in Medicine. https://doi.org/10.1002/sim.7348
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.