Stepped wedge cluster randomised trials: a review of the statistical methodology used and available
Open accessThe DOI matches its Crossref record; 18 of the 18 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Previous reviews have focussed on the rationale for employing the stepped wedge design (SWD), the areas of research to which the design has been applied and the general characteristics of the design. However these did not focus on the statistical methods nor addressed the appropriateness of sample size methods used.This was a review of the literature of the statistical methodology used in stepped wedge cluster randomised trials. METHODS: Literature Review. The Medline, Embase, PsycINFO, CINAHL and Cochrane databases were searched for methodological guides and RCTs which employed the stepped wedge design. RESULTS: This review identified 102 trials which employed the stepped wedge design compared to 37 from the most recent review by Beard et al. 2015. Forty six trials were cohort designs and 45 % (n = 46) had fewer than 10 clusters. Of the 42 articles discussing the design methodology 10 covered analysis and seven covered sample size. For cohort stepped wedge designs there was only one paper considering analysis and one considering sample size methods. Most trials employed either a GEE or mixed model approach to analysis (n = 77) but only 22 trials (22 %) estimated sample size in a way which accounted for the stepped wedge design that was subsequently used. CONCLUSIONS: Many studies which employ the stepped wedge design have few clusters but use methods of analysis which may require more clusters for unbiased and efficient intervention effect estimates. There is the need for research on the minimum number of clusters required for both types of stepped wedge design. Researchers should distinguish in the sample size calculation between cohort and cross sectional stepped wedge designs. Further research is needed on the effect of adjusting for the potential confounding of time on the study power.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The stepped wedge cluster randomised trial: rationale, design, analysis, and reporting
Hemming, K., Haines, T. P., Chilton, P. J., Girling, A. J., & Lilford, R. J. (2015) · BMJ · doi:10.1136/bmj.h391 · Cited by 1,410
The stepped wedge trial design: a systematic review
Brown, C. A., & Lilford, R. J. (2006) · BMC Medical Research Methodology · doi:10.1186/1471-2288-6-54 · Cited by 907
Fernald, L. C., Gertler, P. J., & Neufeld, L. M. (2008) · The Lancet · doi:10.1016/s0140-6736(08)60382-7 · Cited by 596 · cited 1×
“Fernald [142] Cohort 506 (2) GLM adjusting for sampling design and clustering (Normal and Binomial) No Yes: Cluster Design Effect Adjustment Results”
MethodMdege, N. D., Man, M.-S., Taylor (nee Brown), C. A., & Torgerson, D. J. (2011) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.12.003 · Cited by 425 · cited 4×
“For some interventions the cost of simultaneous implementation to multiple clusters may be too high or logistically impractical [9, 10].”
BackgroundMethodResultInfluentialHemming, K., Lilford, R., & Girling, A. J. (2015) · Statistics in Medicine · doi:10.1002/sim.6325 · Cited by 236 · cited 2×
“extend the Hussey and Hughes method to several variations of the cross sectional SWD such as those which do not measure the outcome from every cluster at every step [37].”
BackgroundMethodAustin, P. C. (2010) · The International Journal of Biostatistics · doi:10.2202/1557-4679.1195 · Cited by 193 · cited 1×
“Models of this type are interchangeably referred to as mixed, hierarchical, multilevel or random effects models [21] and for the purposes of this paper these will hereafter be referred to simply as GLMMs.”
Brown, C., Hofer, T., Johal, A., Thomson, R., Nicholl, J., Franklin, B. D., & Lilford, R. J. (2008) · Quality and Safety in Health Care · doi:10.1136/qshc.2007.023648 · Cited by 186
Beard, E., Lewis, J. J., Copas, A., Davey, C., Osrin, D., Baio, G., Thompson, J. A., Fielding, K. L., Omar, R. Z., Ononge, S., et al. (2015) · Trials · doi:10.1186/s13063-015-0839-2 · Cited by 135
Larsen, D. A., Bennett, A., Silumbe, K., Hamainza, B., Yukich, J. O., Keating, J., Littrell, M., Miller, J. M., Steketee, R. W., & Eisele, T. P. (2015) · The American Society of Tropical Medicine and Hygiene · doi:10.4269/ajtmh.14-0347 · Cited by 108
Dynamic wait-listed designs for randomized trials: new designs for prevention of youth suicide
Brown, C. H., Wyman, P. A., Guo, J., & Peña, J. (2006) · Clinical Trials · doi:10.1191/1740774506cn152oa · Cited by 99
Research works printed but not linked: 173
- Pocock SJ. Clinical trials: a practical approach. Chichester: Wiley; 1983.
- Hayes RJ, Moulton LH. Cluster Randomised Trials. Boca Raton: Chapman & Hall; 2009. · DOI · Paper page
- Donner A, Klar N. Design and Analysis of Cluster Randomization Trials in Health Research. London: Arnold; 2000 · DOI
- Hayes RJ, Bennett S. Simple sample size calculation for cluster-randomized trials. Int J Epidemiol. 1999;28(2):319–26. · DOI · Paper page
- Donner A. Some Aspects of the Design and Analysis of Cluster Randomization Trials. J R Stat Soc: Ser C: Appl Stat. 1998;47(1):95–113. · DOI · Paper page
- Wears RL. Advanced statistics: statistical methods for analyzing cluster and cluster-randomized data. Acad Emerg Med. 2002;9(4):330–41. · DOI · Paper page
- Murray DM. Design and Analysis of GroupRandomized Trials. New York: Oxford University Press Inc; 1998.
- Campbell MJ, Walters SJ. How to design, analyse and report cluster randomised trials in medicine and health related research. Chichester: Wiley-Blackwell; 2014. · DOI · Paper page
- Handley MA, Schillinger D, Shiboski S. Quasi-experimental designs in practice-based research settings: design and implementation considerations. J Am Board Fam Med. 2011;24(5):589–96. · DOI
- Weijer C et al. The Ottawa Statement on the Ethical Design and Conduct of Cluster Randomized Trials. PLoS Med. 2012;9(11):e1001346. · DOI · Paper page
- Melis RJ et al. Pseudo cluster randomization performed well when used in practice. J Clin Epidemiol. 2008;61(11):1169–75. · DOI
- The Gambia Hepatitis Intervention Study. The Gambia Hepatitis Study Group. Cancer Res. 1987;47(21):5782–7.
- Woertman W et al. Stepped wedge designs could reduce the required sample size in cluster randomized trials. J Clin Epidemiol. 2013;66(7):752–8. · DOI · Paper page
- Hemming K et al. Stepped wedge cluster randomized trials are efficient and provide a method of evaluation without which some interventions would not be evaluated. J Clin Epidemiol. 2013;66(9):1058–9. · DOI
- Haines T et al. A novel research design can aid disinvestment from existing health technologies with uncertain effectiveness, cost-effectiveness, and/or safety. J Clin Epidemiol. 2014;67(2):144–51. · DOI
- Liang K-Y, Zeger SL. Longitudinal data analysis using generalized linear models. Biometrika. 1986;73(1):13–22. · DOI · Paper page
- Kauermann G, Carroll RJ. A Note on the Efficiency of Sandwich Covariance Matrix Estimation. J Am Stat Assoc. 2001;96(456):1387–96. · DOI · Paper page
- Moher D et al. Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement. PLoS Med. 2009;6(7):e1000097. · DOI · Paper page
- Moulton LH et al. Statistical design of THRio: a phased implementation clinic-randomized study of a tuberculosis preventive therapy intervention. Clin Trials. 2007;4(2):190–9. · DOI
- Gruber JS et al. Estimation of treatment efficacy with complier average causal effects (CACE) in a randomized stepped wedge trial. Am J Epidemiol. 2014;179(9):1134–42. · DOI
- Hussey MA, Hughes JP. Design and analysis of stepped wedge cluster randomized trials. Contemp Clin Trials. 2007;28(2):182–91. · DOI · Paper page
- Scott JM, et al. Finite-sample corrected generalized estimating equation of population average treatment effects in stepped wedge cluster randomized trials. Stat Methods Med Res. 2014. · DOI · Paper page
- Van den Heuvel, E.R., R.J. Zwanenburg, and C.M. Van Ravenswaaij-Arts, A stepped wedge design for testing an effect of intranasal insulin on cognitive development of children with Phelan-McDermid syndrome: A comparison of different designs. Stat Methods Med Res, 2014. · DOI
- Wyman PA et al. Designs for Testing Group-Based Interventions with Limited Numbers of Social Units: The Dynamic Wait-Listed and Regression Point Displacement Designs. Prev Sci. 2015;16(7):956–66. · DOI · Paper page
- Lipsitz SR, Laird NM, Harrington DP. Using the jackknife to estimate the variance of regression estimators from repeated measures studies. Commun Stat Theory Methods. 1990;19(3):821–45. · DOI
- Golden MR et al. Uptake and Population-Level Impact of Expedited Partner Therapy (EPT) on Chlamydia trachomatis and Neisseria gonorrhoeae: The Washington State Community-Level Randomized Trial of EPT. PLoS Med. 2015;12(1):1–22. · DOI
- Davey C et al. Analysis and reporting of stepped wedge randomised controlled trials: synthesis and critical appraisal of published studies, 2010 to 2014. Trials. 2015;16:358. · DOI · Paper page
- Baio G et al. Sample size calculation for a stepped wedge trial. Trials. 2015;16(1):1–15. · DOI · Paper page
- StataCorp. Stata 13 Base Reference Manual. College Station, TX: Stata Press; 2013.
- Hemming K, Girling A. A menu-driven facility for power and detectable-difference calculations in stepped-wedge cluster-randomized trials. Stata J. 2014;14(2):363–80. · DOI
- de Hoop E, Woertman W, Teerenstra S. The stepped wedge cluster randomized trial always requires fewer clusters but not always fewer measurements, that is, participants than a parallel cluster randomized trial in a cross-sectional design In reply. J Clin Epidemiol. 2013;66(12):1428. · DOI
- Hemming K, Girling A. The efficiency of stepped wedge vs. cluster randomized trials: stepped wedge studies do not always require a smaller sample size. J Clin Epidemiol. 2013;66(12):1427–8. · DOI
- Copas AJ et al. Designing a stepped wedge trial: three main designs, carry-over effects and randomisation approaches. Trials. 2015;16:352. · DOI · Paper page
- Kotz D et al. The stepped wedge design does not inherently have more power than a cluster randomized controlled trial. J Clin Epidemiol. 2013;66(9):1059–60. · DOI
- Davis MP, Mitchell GK. Topics in research: structuring studies in palliative care. Curr Opin Support Palliat Care. 2012;6(4):483–9. · DOI
- Bacchieri G et al. A community intervention to prevent traffic accidents among bicycle commuters. Rev Saude Publica. 2010;44(5):867–75. · DOI
- Hill AM et al. Fall rates in hospital rehabilitation units after individualised patient and staff education programmes: a pragmatic, stepped-wedge, cluster-randomised controlled trial. Lancet. 2015;385(9987):2592–9. · DOI · Paper page
- Durovni B et al. Effect of improved tuberculosis screening and isoniazid preventive therapy on incidence of tuberculosis and death in patients with HIV in clinics in Rio de Janeiro, Brazil: a stepped wedge, cluster-randomised trial. Lancet Infect Dis. 2013;13(10):852–8. · DOI
- Golub JE et al. Long-term protection from isoniazid preventive therapy for tuberculosis in HIV-infected patients in a medium-burden tuberculosis setting: the TB/HIV in Rio (THRio) study. Clin Infect Dis. 2015;60(4):639–45. · DOI
- Bouwsma EV et al. The cost effectiveness of a tailored, web-based care program to enhance postoperative recovery in gynecologic patients in comparison with usual care: protocol of a stepped wedge cluster randomized controlled trial. JMIR Res Protoc. 2014;3(2):e30. · DOI
- Due TD et al. The effectiveness of a semi-tailored facilitator-based intervention to optimise chronic care management in general practice: a stepped-wedge randomised controlled trial. BMC Fam Pract. 2014;15:65. · DOI
- Grunewaldt KH et al. Working memory training improves cognitive function in VLBW preschoolers. Pediatrics. 2013;131(3):e747–54. · DOI
- Doherty S et al. National project seeking to improve pain management in the emergency department setting: findings from the NHMRC-NICS National Pain Management Initiative. Emerg Med Australas. 2013;25(2):120–6. · DOI
- Viera AJ, Garrett JM. Preliminary study of a school-based program to improve hypertension awareness in the community. Fam Med. 2008;40(4):264–70.
- Skrovseth SO et al. Data-Driven Personalized Feedback to Patients with Type 1 Diabetes: A Randomized Trial. Diabetes Technol Ther. 2015;17(7):482–9. · DOI
- Somerville M et al. From local concern to randomized trial: the Watcombe Housing Project. Health Expect. 2002;5(2):127–35. · DOI · Paper page
- Barton A et al. The Watcombe Housing Study: the short term effect of improving housing conditions on the health of residents. J Epidemiol Community Health. 2007;61:771–7. · DOI
- Schnelle JF et al. Reducing and managing restraints in long-term-care facilities. J Am Geriatr Soc. 1992;40(4):381–5. · DOI · Paper page
- Dilworth S et al. Examining clinical supervision as a mechanism for changes in practice: a research protocol. J Adv Nurs. 2014;70(2):421–30. · DOI
- Mouchoux C et al. Impact of a multifaceted program to prevent postoperative delirium in the elderly: the CONFUCIUS stepped wedge protocol. BMC Geriatr. 2011;11:25. · DOI
- van den Broek IV et al. Evaluation design of a systematic, selective, internet-based, Chlamydia screening implementation in the Netherlands, 2008-2010: implications of first results for the analysis. BMC Infect Dis. 2010;10:89. · DOI
- van den Broek IV et al. Effectiveness of yearly, register based screening for chlamydia in the Netherlands: controlled trial with randomised stepped wedge implementation. BMJ. 2012;345:e4316. · DOI
- Cowan JF et al. Early ART initiation among HIV-positive pregnant women in central Mozambique: a stepped wedge randomized controlled trial of an optimized Option B+ approach. Implement Sci. 2015;10(1):61. · DOI
- Craine N et al. A stepped wedge cluster randomized control trial of dried blood spot testing to improve the uptake of hepatitis C antibody testing within UK prisons. Eur J Public Health. 2015;25(2):351–7. · DOI
- Groshaus H et al. Use of clinical decision support to improve the quality of care provided to older hospitalized patients. Appl Clin Inform. 2012;3(1):94–102. · DOI
- Kelly PJ et al. Study protocol: a stepped wedge cluster randomised controlled trial of a healthy lifestyle intervention for people attending residential substance abuse treatment. BMC Public Health. 2015;15(1):465. · DOI
- Weiner M et al. A web-based generalist-specialist system to improve scheduling of outpatient specialty consultations in an academic center. J Gen Intern Med. 2009;24(6):710–5. · DOI · Paper page
- Williamson A et al. Supporting Policy In health with Research: an Intervention Trial (SPIRIT)-protocol for a stepped wedge trial. BMJ Open. 2014;4(7):e005293. · DOI
- Ciliberto MA et al. Comparison of home-based therapy with ready-to-use therapeutic food with standard therapy in the treatment of malnourished Malawian children: a controlled, clinical effectiveness trial. Am J Clin Nutr. 2005;81(4):864–70. · DOI · Paper page
- Patel MP et al. Supplemental feeding with ready-to-use therapeutic food in Malawian children at risk of malnutrition. J Health Popul Nutr. 2005;23(4):351–7.
- Haugen AS et al. Effect of the World Health Organization checklist on patient outcomes: a stepped wedge cluster randomized controlled trial. Ann Surg. 2015;261(5):821–8. · DOI · Paper page
- Badenbroek IF et al. Design of the INTEGRATE study: effectiveness and cost-effectiveness of a cardiometabolic risk assessment and treatment program integrated in primary care. BMC Fam Pract. 2014;15:90. · DOI
- Bailey IW, Archer L. The impact of the introduction of treated water on aspects of community health in a rural community in Kwazulu-Natal, South Africa. Water Sci Technol. 2004;50(1):105–10. · DOI
- Banga FR et al. The impact of transmural multiprofessional simulation-based obstetric team training on perinatal outcome and quality of care in the Netherlands. BMC Med Educ. 2014;14:175. · DOI
- Proeschold-Bell RJ et al. Use of a randomized multiple baseline design: rationale and design of the spirited life holistic health intervention study. Contemp Clin Trials. 2013;35(2):138–52. · DOI
- Brimblecombe J et al. Stores Healthy Options Project in Remote Indigenous Communities (SHOP@RIC): a protocol of a randomised trial promoting healthy food and beverage purchases through price discounts and in-store nutrition education. BMC Public Health. 2013;13:744. · DOI
- Fuller C et al. The Feedback Intervention Trial (FIT)--improving hand-hygiene compliance in UK healthcare workers: a stepped wedge cluster randomised controlled trial. PLoS One. 2012;7(10):e41617. · DOI · Paper page
- Bailey FA et al. Intervention to improve care at life’s end in inpatient settings: The BEACON trial. J Gen Intern Med. 2014;29(6):836–43. · DOI
- Palmer VJ et al. The CORE study protocol: a stepped wedge cluster randomised controlled trial to test a co-design technique to optimise psychosocial recovery outcomes for people affected by mental illness in the community mental health setting. BMJ Open. 2015;5(3):e006688. · DOI · Paper page
- Tielsch JM et al. Designs of two randomized, community-based trials to assess the impact of alternative cookstove installation on respiratory illness among young children and reproductive outcomes in rural Nepal. BMC Public Health. 2014;14:1271. · DOI
- van Daalen FV et al. A cluster randomized trial for the implementation of an antibiotic checklist based on validated quality indicators: the AB-checklist. BMC Infect Dis. 2015;15(1):134. · DOI
- Lilly CM et al. Hospital mortality, length of stay, and preventable complications among critically ill patients before and after tele-ICU reengineering of critical care processes. JAMA. 2011;305(21):2175–83. · DOI · Paper page
- Priestley G et al. Introducing Critical Care Outreach: a ward-randomised trial of phased introduction in a general hospital. Intensive Care Med. 2004;30(7):1398–404. · DOI · Paper page
- Strijbos MJ et al. Design and methods of the Hospital Elder Life Program (HELP), a multicomponent targeted intervention to prevent delirium in hospitalized older patients: efficacy and cost-effectiveness in Dutch health care. BMC Geriatr. 2013;13:78. · DOI
- Kotz D et al. Use of the stepped wedge design cannot be recommended: a critical appraisal and comparison with the classic cluster randomized controlled trial design. J Clin Epidemiol. 2012;65(12):1249–52. · DOI
- Mancl LA, DeRouen TA. A covariance estimator for GEE with improved small-sample properties. Biometrics. 2001;57(1):126–34. · DOI · Paper page
- Snijders TAB, Bosker RJ. Multilevel Analysis: An Introduction to Basic and Advanced Multilevel Modeling. 2nd ed. Sage Publications Ltd; 1999.
- Bellan SE et al. Statistical power and validity of Ebola vaccine trials in Sierra Leone: a simulation study of trial design and analysis. Lancet Infect Dis. 2015;15(6):703–10. · DOI
- Beard E et al. Stepped wedge randomised controlled trials: systematic review of studies published between 2010 and 2014. Trials. 2015;16(1):1–14. · DOI · Paper page
- Fatemi Y, Jacobson RM. The stepped wedge cluster randomized trial and its potential for child health services research: a narrative review. Acad Pediatr. 2015;15(2):128–33. · DOI
- Hargreaves JR et al. Five questions to consider before conducting a stepped wedge trial. Trials. 2015;16:350. · DOI
- Hargreaves JR et al. How important is randomisation in a stepped wedge trial? Trials. 2015;16:359. · DOI
- Keriel-Gascou M et al. A stepped wedge cluster randomized trial is preferable for assessing complex health interventions. J Clin Epidemiol. 2014;67(7):831–3. · DOI
- Kotz D et al. Researchers should convince policy makers to perform a classic cluster randomized controlled trial instead of a stepped wedge design when an intervention is rolled out. J Clin Epidemiol. 2012;65(12):1255–6. · DOI
- Mdege ND et al. There are some circumstances where the stepped-wedge cluster randomized trial is preferable to the alternative: no randomized trial at all. Response to the commentary by Kotz and colleagues. J Clin Epidemiol. 2012;65(12):1253–4. · DOI
- Mdege ND, Kanaan M. Response to Keriel-Gascou et al. Addressing assumptions on the stepped wedge randomized trial design. J Clin Epidemiol. 2014;67(7):833–4. · DOI
- Pater J et al. Future research and methodological approaches. Ann Oncol. 2011;22 Suppl 7:vii57–61. · DOI
- Prost A et al. Logistic, ethical, and political dimensions of stepped wedge trials: critical review and case studies. Trials. 2015;16:351. · DOI · Paper page
- Sanson-Fisher RW et al. Evaluation of systems-oriented public health interventions: alternative research designs. Annu Rev Public Health. 2014;35:9–27. · DOI · Paper page
- Schelvis RM et al. Evaluation of occupational health interventions using a randomized controlled trial: challenges and alternative research designs. Scand J Work Environ Health. 2015;41(5):491–503. · DOI
- van der Tweel I, van der Graaf R. Issues in the use of stepped wedge cluster and alternative designs in the case of pandemics. Am J Bioeth. 2013;13(9):23–4. · DOI
- Viechtbauer W et al. Response to Keriel-Gascou et al.: higher efficiency and other alleged advantages are not inherent to the stepped wedge design. J Clin Epidemiol. 2014;67(7):834–6. · DOI
- Wolkewitz M et al. Interventions to control nosocomial infections: study designs and statistical issues. J Hosp Infect. 2014;86(2):77–82. · DOI
- Zhan Z et al. Strengths and weaknesses of a stepped wedge cluster randomized design: Its application in a colorectal cancer follow-up study. J Clin Epidemiol. 2014;67(4):454–61. · DOI
- Aoun S et al. Supporting family caregivers to identify their own needs in end-of-life care: Qualitative findings from a stepped wedge cluster trial. Palliat Med. 2015;29(6):508–17. · DOI
- Aoun S et al. Enabling a family caregiver-led assessment of support needs in home-based palliative care: Potential translation into practice. Palliat Med. 2015;29(10):929–38. · DOI
- Aoun S et al. Implementing and evaluating the impact of the carer support needs assessment tool (CSNAT) in community palliative care in Australia. Palliat Med. 2014;28(6):606.
- Aoun SM et al. The Impact of the Carer Support Needs Assessment Tool (CSNAT) in Community Palliative Care Using a Stepped Wedge Cluster Trial. PLoS One. 2015;10(4):e0123012. · DOI
- Austin L, Ewing G, Grande G. Facilitating a shift to comprehensive carer-led assessment in palliative home care: The CSNAT approach. Palliat Med. 2014;4(1):612–3.
- GrandeG.E, et al. Assessing the impact of a Carer Support Needs Assessment Tool (CSNAT) intervention in palliative home care: a stepped wedge cluster trial. BMJ Support Palliat Care, 2015. · DOI
- Lo AC et al. Prevalence of molecular markers of drug resistance in an area of seasonal malaria chemoprevention in children in Senegal. Malar J. 2013;12:137–7. · DOI
- Bailet LL et al. Emergent literacy intervention for prekindergarteners at risk for reading failure. J Learn Disabil. 2009;42(4):336–55. · DOI
- Bashour HN, et al. The effect of training doctors in communication skills on women’s satisfaction with doctor-woman relationship during labour and delivery: a stepped wedge cluster randomised trial in Damascus. BMJ Open, 2013. 3(8). · DOI
- Bennett PN et al. The impact of an exercise physiologist coordinated resistance exercise program on the physical function of people receiving hemodialysis: a stepped wedge randomised control study. BMC Nephrol. 2013;14(1):204. · DOI
- Bernabe-Ortiz A et al. Launching a salt substitute to reduce blood pressure at the population level: a cluster randomized stepped wedge trial in Peru. Trials. 2014;15:93. · DOI
- Brown BB et al. Clinician-led improvement in cancer care (CLICC)--testing a multifaceted implementation strategy to increase evidence-based prostate cancer care: phased randomised controlled trial--study protocol. Implement Sci. 2014;9:64. · DOI
- Brownell MD et al. Long-term benefits of full-day kindergarten: a longitudinal population-based study. Early Child Dev Care. 2015;185(2):291–316. · DOI
- Chavane L et al. Implementation of evidence-based antenatal care in Mozambique: a cluster randomized controlled trial: study protocol. BMC Health Serv Res. 2014;14:228. · DOI
- Chinbuah MA et al. Impact of community management of fever (using antimalarials with or without antibiotics) on childhood mortality: a cluster-randomized controlled trial in Ghana. Am J Trop Med Hyg. 2012;87(5 Suppl):11–20. · DOI
- Chinbuah MA et al. Impact of treating young children with antimalarials with or without antibiotics on morbidity: a cluster-randomized controlled trial in Ghana. Int Health. 2013;5(3):228–35. · doi:10.1093/inthealth/iht021
- Crain AL et al. Designing and implementing research on a statewide quality improvement initiative: the DIAMOND study and initiative. Med Care. 2013;51(9):e58–66. · DOI
- Solberg LI et al. Partnership research: a practical trial design for evaluation of a natural experiment to improve depression care. Med Care. 2010;48(7):576–82. · DOI
- Dainty KN et al. A knowledge translation collaborative to improve the use of therapeutic hypothermia in post-cardiac arrest patients: protocol for a stepped wedge randomized trial. Implement Sci. 2011;6:4. · DOI
- Morrison LJ et al. Improving Use of Targeted Temperature Management After Out-of-Hospital Cardiac Arrest: A Stepped Wedge Cluster Randomized Controlled Trial. Crit Care Med. 2015;43(5):954–64. · DOI
- De Allegri M et al. Step-wedge cluster-randomised community-based trials: an application to the study of the impact of community health insurance. Health Res Policy Syst. 2008;6:10. · DOI
- Gnawali DP et al. The effect of community-based health insurance on the utilization of modern health care services: evidence from Burkina Faso. Health Policy. 2009;90(2-3):214–22. · DOI
- Turner J et al. A randomised trial of a psychosocial intervention for cancer patients integrated into routine care: the PROMPT study (promoting optimal outcomes in mood through tailored psychosocial therapies). BMC Cancer. 2011;11:48. · DOI · Paper page
- Dreischulte T et al. A cluster randomised stepped wedge trial to evaluate the effectiveness of a multifaceted information technology-based intervention in reducing high-risk prescribing of non-steroidal anti-inflammatory drugs and antiplatelets in primary medical care: the DQIP study protocol. Implement Sci. 2012;7:24. · DOI
- Duijster D et al. Associations between oral health-related impacts and rate of weight gain after extraction of pulpally involved teeth in underweight preschool Filipino children. BMC Public Health. 2013;13:533. · DOI
- Monse B et al. The effects of extraction of pulpally involved primary teeth on weight, height and BMI in underweight Filipino children. A cluster randomized clinical trial. BMC Public Health. 2012;12:725. · DOI
- Durovni B et al. Impact of Replacing Smear Microscopy with Xpert MTB/RIF for Diagnosing Tuberculosis in Brazil: A Stepped-Wedge Cluster-Randomized Trial. PLoS Med. 2014;11(12):e1001766. · DOI · Paper page
- Trajman A et al. Impact on Patients’ Treatment Outcomes of XpertMTB/RIF Implementation for the Diagnosis of Tuberculosis: Follow-Up of a Stepped-Wedge Randomized Clinical Trial. PLoS One. 2015;10(4):e0123252. · DOI
- Emond YE et al. Improving the implementation of perioperative safety guidelines using a multifaceted intervention approach: protocol of the IMPROVE study, a stepped wedge cluster randomized trial. Implement Sci. 2015;10(1):3. · DOI
- Enns E et al. A controlled quality improvement trial to reduce the use of physical restraints in older hospitalized adults. J Am Geriatr Soc. 2014;62(3):541–5. · DOI
- Etchells E et al. Real-time automated paging and decision support for critical laboratory abnormalities. BMJ Qual Saf. 2011;20(11):924–30. · DOI
- Franklin BD et al. The effect of the electronic transmission of prescriptions on dispensing errors and prescription enhancements made in English community pharmacies: A naturalistic stepped wedge study. BMJ Qual Saf. 2014;23(8):629–38. · DOI
- Gerritsen DL et al. Act In case of Depression: the evaluation of a care program to improve the detection and treatment of depression in nursing homes. Study Protocol BMC Psychiatry. 2011;11:91. · DOI
- Leontjevas R et al. Process evaluation to explore internal and external validity of the “Act in Case of Depression” care program in nursing homes. J Am Med Dir Assoc. 2012;13(5):488 e1–8. · DOI
- Leontjevas R et al. A structural multidisciplinary approach to depression management in nursing-home residents: a multicentre, stepped-wedge cluster-randomised trial. Lancet. 2013;381(9885):2255–64. · DOI
- Leontjevas R et al. More insight into the concept of apathy: a multidisciplinary depression management program has different effects on depressive symptoms and apathy in nursing homes. Int Psychogeriatr. 2013;25(12):1941–52. · DOI
- Gruber JS et al. A stepped wedge, cluster-randomized trial of a household UV-disinfection and safe storage drinking water intervention in rural Baja California Sur, Mexico. Am J Trop Med Hyg. 2013;89(2):238–45. · DOI
- Gucciardi E et al. Will Mobile Diabetes Education Teams (MDETs) in primary care improve patient care processes and health outcomes? Study protocol for a randomized controlled trial. Trials. 2012;13:165. · DOI
- Haines TP et al. Study protocol for two randomized controlled trials examining the effectiveness and safety of current weekend allied health services and a new stakeholder-driven model for acute medical/surgical patients versus no weekend allied health services. Trials. 2015;16(1):133. · DOI
- Haukka E et al. Efficacy of temporary work modifications on disability related to musculoskeletal pain or depressive symptoms-study protocol for a controlled trial. BMJ Open. 2015;5(5):e008300. · DOI
- Hayden MK et al. Prevention of colonization and infection by klebsiella pneumoniae carbapenemase-producing enterobacteriaceae in long-term acute-care hospitals. Clin Infect Dis. 2015;60(8):1154–61. · DOI · Paper page
- Hill AM et al. A stepped-wedge cluster randomised controlled trial for evaluating rates of falls among inpatients in aged care rehabilitation units receiving tailored multimedia education in addition to usual care: A trial protocol. BMJ Open. 2014;4(1):e004195. · DOI
- Horner C et al. The longitudinal prevalence of MRSA in care home residents and the effectiveness of improving infection prevention knowledge and practice on colonisation using a stepped wedge study design. BMJ Open. 2012;2(1):e000423. · DOI
- Howlin P et al. The effectiveness of Picture Exchange Communication System (PECS) training for teachers of children with autism: a pragmatic, group randomised controlled trial. J Child Psychol Psychiatry. 2007;48(5):473–81. · DOI · Paper page
- Hunter SB et al. Continuous quality improvement (CQI) in addiction treatment settings: design and intervention protocol of a group randomized pilot study. Addict Sci Clin Pract. 2014;9(1):1–11. · DOI
- Husaini BA et al. A church-based program on prostate cancer screening for African American men: reducing health disparities. Ethn Dis. 2008;18(2 Suppl 2):S2-179-84.
- Kitson AL et al. The prevention and reduction of weight loss in an acute tertiary care setting: protocol for a pragmatic stepped wedge randomised cluster trial (the PRoWL project). BMC Health Serv Res. 2013;13:299. · DOI
- Schultz TJ et al. Does a multidisciplinary nutritional intervention prevent nutritional decline in hospital patients? A stepped wedge randomised cluster trial. e-SPEN J. 2014;9(2):e84–90. · DOI
- Kjeken I et al. Evaluation of a structured goal planning and tailored follow-up programme in rehabilitation for patients with rheumatic diseases: protocol for a pragmatic, stepped-wedge cluster randomized trial. BMC Musculoskelet Disord. 2014;15:153. · DOI
- Li S et al. Rational and design of a stepped-wedge cluster randomized trial evaluating quality improvement initiative for reducing cardiovascular events among patients with acute coronary syndromes in resource-constrained hospitals in China. Am Heart J. 2015;169(3):349–55. · DOI
- Liddy C et al. Improved delivery of cardiovascular care (IDOCC) through outreach facilitation: study protocol and implementation details of a cluster randomized controlled trial in primary care. Implement Sci. 2011;6:110. · DOI
- Marrin K et al. Option Grids to facilitate shared decision making for patients with Osteoarthritis of the knee: protocol for a single site, efficacy trial. BMC Health Serv Res. 2014;14:160. · doi:10.1186/1472-6963-14-160
- Marshall T et al. Mixed methods evaluation of targeted case finding for cardiovascular disease prevention using a stepped wedged cluster RCT. BMC Public Health. 2012;12:908. · DOI
- Mhurchu CN et al. Effects of a free school breakfast programme on children’s attendance, academic achievement and short-term hunger: results from a stepped-wedge, cluster randomised controlled trial. J Epidemiol Community Health. 2013;67(3):257–64. · DOI
- Ni Mhurchu C et al. Effects of a free school breakfast programme on school attendance, achievement, psychosocial function, and nutrition: a stepped wedge cluster randomised trial. BMC Public Health. 2010;10:738. · DOI
- Muntinga ME et al. Implementing the chronic care model for frail older adults in the Netherlands: study protocol of ACT (frail older adults: care in transition). BMC Geriatr. 2012;12:19. · DOI
- Palmay L et al. Hospital-wide rollout of antimicrobial stewardship: A stepped-wedge randomized trial. Clin Infect Dis. 2014;59(6):867–74. · DOI · Paper page
- Pickering BW et al. The implementation of clinician designed, human-centered electronic medical record viewer in the intensive care unit: a pilot step-wedge cluster randomized trial. Int J Med Inform. 2015;84(5):299–307. · DOI
- Poldervaart JM et al. The impact of the HEART risk score in the early assessment of patients with acute chest pain: design of a stepped wedge, cluster randomised trial. BMC Cardiovasc Disord. 2013;13(1):77. · DOI · Paper page
- Rasmussen CD et al. Prevention of low back pain and its consequences among nurses’ aides in elderly care: a stepped-wedge multi-faceted cluster-randomized controlled trial. BMC Public Health. 2013;13:1088. · DOI · Paper page
- Reuther S et al. Effect evaluation of two types of dementia-specific case conferences in German nursing homes (FallDem) using a stepped-wedge design: study protocol for a randomized controlled trial. Trials. 2014;15:319. · DOI
- Roy A et al. Universal HIV testing in London tuberculosis clinics: a cluster randomised controlled trial. Eur Respir J. 2013;41(3):627–34. · DOI
- Solomon E et al. The Devon Active Villages Evaluation (DAVE) trial: study protocol of a stepped wedge cluster randomised trial of a community-level physical activity intervention in rural southwest England. BMC Public Health. 2012;12:581. · DOI
- Solomon E et al. The Devon Active Villages Evaluation (DAVE) trial of a community-level physical activity intervention in rural south-west England: a stepped wedge cluster randomised controlled trial. Int J Behav Nutr Phys Act. 2014;11:94. · DOI
- Suman A et al. Cost-effectiveness of a multifaceted implementation strategy for the Dutch multidisciplinary guideline for nonspecific low back pain: design of a stepped-wedge cluster randomised controlled trial. BMC Public Health. 2015;15:522. · DOI
- Tiono AB et al. The AvecNet Trial to assess whether addition of pyriproxyfen, an insect juvenile hormone mimic, to long-lasting insecticidal mosquito nets provides additional protection against clinical malaria over current best practice in an area with pyrethroid-resistant vectors in rural Burkina Faso: study protocol for a randomised controlled trial. Trials. 2015;16(1):1–12. · DOI
- Tirlea L, Truby H, Haines TP. Investigation of the effectiveness of the “Girls on the Go!” program for building self-esteem in young women: trial protocol. SpringerPlus. 2013;2:683. · DOI
- Tirlea L, Truby H, Haines TP. Pragmatic, Randomized Controlled Trials of the Girls on the Go! Program to Improve Self-Esteem in Girls. Am J Health Promot, 2015. · doi:10.4278/ajhp.140725-quan-367
- Toftegaard BS, Bro F, Vedsted P. A geographical cluster randomised stepped wedge study of continuing medical education and cancer diagnosis in general practice. Implement Sci. 2014;9:159. · DOI
- Ward J et al. STI in remote communities: improved and enhanced primary health care (STRIVE) study protocol: a cluster randomised controlled trial comparing ‘usual practice’ STI care to enhanced care in remote primary health care services in Australia. BMC Infect Dis. 2013;13(1):1–9. · DOI
- Williams AL et al. The effect of work-based mentoring on patient outcome in musculoskeletal physiotherapy: study protocol for a randomised controlled trial. Trials. 2014;15:409. · DOI
- Wilrycx GK et al. Mental health recovery: evaluation of a recovery-oriented training program. Sci World J. 2012;2012:820846. · DOI
- Zwijsen SA et al. Grip on challenging behaviour: a multidisciplinary care programme for managing behavioural problems in nursing home residents with dementia. Study protocol. BMC Health Serv Res. 2011;11:41. · DOI
- Zwijsen SA et al. Coming to grips with challenging behavior: A cluster randomized controlled trial on the effects of a multidisciplinary care program for challenging behavior in Dementia. J Am Med Dir Assoc. 2014;15(7):531.e1–531.e10. · DOI
- Zwijsen SA et al. Grip on challenging behavior: Process evaluation of the implementation of a care program. Trials. 2014;15(1):302. · DOI
- Zwijsen SA et al. Coming to grips with challenging behaviour: a cluster randomised controlled trial on the effects of a new care programme for challenging behaviour on burnout, job satisfaction and job demands of care staff on dementia special care units. Int J Nurs Stud. 2015;52(1):68–74. · doi:10.1016/j.ijnurstu.2014.10.003
- Van de Steeg L et al. The effect of a complementary e-learning course on implementation of a quality improvement project regarding care for elderly patients: a stepped wedge trial. Implement Sci. 2012;7:13. · DOI
- van de Steeg L et al. Can an e-learning course improve nursing care for older people at risk of delirium: a stepped wedge cluster randomised trial. BMC Geriatr. 2014;14:69. · DOI
- van Holland BJ et al. Sustained employability of workers in a production environment: design of a stepped wedge trial to evaluate effectiveness and cost-benefit of the POSE program. BMC Public Health. 2012;12:1003. · DOI
Cited by
Hemming, K., Taljaard, M., McKenzie, J. E., Hooper, R., Copas, A., Thompson, J. A., Dixon-Woods, M., Aldcroft, A., Doussau, A., Grayling, M., et al. (2018) · BMJ · doi:10.1136/bmj.k1614 · Cited by 475
Self-citationAnalysis of cluster randomised stepped wedge trials with repeated cross-sectional samples
Hemming, K., Taljaard, M., & Forbes, A. (2017) · Trials · doi:10.1186/s13063-017-1833-7 · Cited by 166
“A recent systematic review found that a substantial proportion of stepped wedge studies published to date had failed to adjust for secular trends in the estimated treatment effect [9, 10]; and recent papers in high-impact journals have also failed to adjust for this confounder [14, 29].”
BackgroundResultWiggers, J., McElwaine, K., Freund, M., Campbell, L., Bowman, J., Wye, P., Wolfenden, L., Tremain, D., Barker, D., Slattery, C., et al. (2017) · Implementation Science · doi:10.1186/s13012-017-0636-2 · Cited by 37
“The stepped-wedge design has a number of advantages for the conduct of complex and system-wide health service research; including (a) allowing for all facilities to receive and benefit from the intervention, (b) the sequential implementation of the intervention allowing for the monitoring of extraneous variables, and…”
BackgroundMethodSelf-citationCausal models for longitudinal and panel data: a survey
Arkhangelsky, D., & Imbens, G. (2024) · The Econometrics Journal · doi:10.1093/ectj/utae014 · Cited by 50
Iyer, S. N., Shah, J., Boksa, P., Lal, S., Joober, R., Andersson, N., Fuhrer, R., Abdel-Baki, A., Beaton, A. M., Reaume-Zimmer, P., et al. (2019) · BMC Psychiatry · doi:10.1186/s12888-019-2232-2 · Cited by 44
Metadata
- Authors
- Barker, D., McElduff, P., D’Este, C., & Campbell, M. J.
- Venue
- BMC Medical Research Methodology
- Published
- 2016-06-06
- Volume
- 16
- Issue
- 1
- Pages
- 69-69
- ISSN
- 1471-2288 (ISSN-L)
- OpenAlex
- W2411498438
- Cited by
- 157
- References
- 18
- FWCI
- 14.28
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Stepped wedge cluster randomised trials: a review of the statistical methodology used and available. https://app.cochat.ai/papers/10.1186/s12874-016-0176-5
- The paper
- Barker, D., McElduff, P., D’Este, C., & Campbell, M. J. (2016). Stepped wedge cluster randomised trials: a review of the statistical methodology used and available. BMC Medical Research Methodology. https://doi.org/10.1186/s12874-016-0176-5
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.