Determinants of the intracluster correlation coefficient in cluster randomized trials: the case of implementation research
Abstract
The objective of this research was to identify determinants of the magnitude of intracluster correlation coefficients (ICCs) in cluster randomized trials from the field of implementation research. A survey of experts was conducted to generate a priori hypotheses of factors that might affect ICC size. Hypotheses were tested on empirical estimates of ICCs calculated from 21 implementation research datasets, mainly from the UK. Effects of setting (primary or secondary care), type of variable (process or outcome), type of measurement (objective or subjective), prevalence of outcome and size of cluster were tested. In total, 220 ICCs were available (range 0 to 0.415). Significant differences in ICC magnitude were found. The ICCs were significantly higher for process than for outcome variables, and for secondary care outcomes compared with primary care outcomes. The effects of prevalence and size were less clear cut. There was no evidence to suggest that type of measurement affected ICC size. In conclusion, accurate estimates of ICCs are essential for sample size calculations for cluster randomized trials of professional behaviour change interventions. This study demonstrates that ICCs are sensitive to a number of trial factors, particularly setting and outcome type. These factors must be considered when planning such cluster randomized trials.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Campbell et al extracted 220 ICCs from 21 data sets and reported the results separately for both primary and secondary care settings.
“Campbell et al extracted 220 ICCs from 21 data sets and reported the results separately for both primary and secondary care settings.”
From Tailored interventions to address determinants of practice (2015) · cites this paper as Campbell 2005
Sensitivity analyses in the meta-regression assumed a larger clustering effect than in the standard analyses by using higher ICC estimates taken from Campbell.
“In the meta‐regression analyses, we carried out sensitivity analyses assuming a larger clustering effect than had been accounted for in the standard analyses, by using higher ICC estimates (i.e. the reported upper quartile range values) taken from Campbell (Campbell 2005).”
From Tailored interventions to address determinants of practice (2015) · cites this paper as Campbell 2005
Cites
Ouellette, J. A., & Wood, W. (1998) · Psychological Bulletin · doi:10.1037/0033-2909.124.1.54 · Cited by 3,480 · see citing works
Introducing Multilevel Modeling
Kreft, I., & de Leeuw, J. (1998) · doi:10.4135/9781849209366 · Cited by 2,997 · see citing works
Regression standard errors in clustered samples
Rogers, W. H. (1993) · Stata technical bulletin · Cited by 2,775 · see citing works
A Note on Robust Variance Estimation for Cluster‐Correlated Data
Williams, R. L. (2000) · Biometrics · doi:10.1111/j.0006-341x.2000.00645.x · Cited by 2,501 · see citing works
Design and Analysis of Cluster Randomization Trials in Health Research
DONNER, A. P., & Klar, N. S. (2000) · Cited by 1,236 · see citing works
Ukoumunne, Gulliford, M. C., Chinn, Sterne, & Burney, P. (1999) · Health Technology Assessment · doi:10.3310/hta3050 · Cited by 1,209 · see citing works
Design and Analysis of Group-Randomized Trials
Sonnad, S. S. (1999) · Medicine & Science in Sports & Exercise · doi:10.1097/00005768-199902000-00025 · Cited by 1,130 · see citing works
Design and Analysis of Group-Randomized Trials
Murray, D. M. (2007) · doi:10.1093/oso/9780195120363.001.0001 · Cited by 1,114 · see citing works
Gulliford, M. C., Ukoumunne, O. C., & Chinn, S. (1999) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a009904 · Cited by 853 · see citing works
Donner, A. P., Birkett, N., & Buck, C. W. (1981) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a113261 · Cited by 698 · see citing works
Context, composition and heterogeneity: using multilevel models in health research
Duncan, C., Jones, K., & Moon, G. (1998) · Social Science & Medicine · doi:10.1016/s0277-9536(97)00148-2 · Cited by 689 · see citing works
Evidence of self-report bias in assessing adherence to guidelines
Adams, A., Soumerai, S., Lomas, J., & Ross-Degnan, D. (1999) · International Journal for Quality in Health Care · doi:10.1093/intqhc/11.3.187 · Cited by 679 · cited 1× · see citing works
“For example, there is empirical evidence that self-reports of activity tend to overestimate the prevalence of appropriate or "correct" behaviour [26,27].”
BackgroundDesign and analysis of group-randomized trials: a review of recent methodological developments
Murray, D. M., Varnell, S. P., & Blitstein, J. L. (2004) · American Journal of Public Health · doi:10.2105/ajph.94.3.423 · Cited by 677 · see citing works
Research designs for studies evaluating the effectiveness of change and improvement strategies
Eccles, M. (2003) · Quality and Safety in Health Care · doi:10.1136/qhc.12.1.47 · Cited by 586 · see citing works
Design and Analysis of Cluster Randomization Trials in Health Research
Davis, W. W. (2001) · Journal of the American Statistical Association · doi:10.1198/jasa.2001.s433 · Cited by 442 · see citing works
The Estimation of Intraclass Correlation in the Analysis of Family Data
Donner, A. P., & Koval, J. J. (1980) · Biometrics · doi:10.2307/2530491 · Cited by 305 · see citing works
Campbell, M., Mollison, J., & Grimshaw, J. (2001) · Statistics in Medicine · doi:10.1002/1097-0258(20010215)20:3 · Cited by 299 · see citing works
Self-citationON DESIGN CONSIDERATIONS AND RANDOMIZATION-BASED INFERENCE FOR COMMUNITY INTERVENTION TRIALS
Gail, M. H., Mark, S. D., Carroll, R. J., Green, S. B., & Pee, D. (1996) · Statistics in Medicine · doi:10.1002/(sici)1097-0258(19960615)15:11 · Cited by 249 · see citing works
Methods to reduce the impact of intraclass correlation in group-randomized trials.
Murray, D. M., & Blitstein, J. L. (2003) · Evaluation Review · doi:10.1177/0193841x02239019 · Cited by 221 · see citing works
New Statistical Methods for Analysing Social Structures: an introduction to multilevel models
Paterson, L., & Goldstein, H. (1991) · British Educational Research Journal · doi:10.1080/0141192910170408 · Cited by 209 · see citing works
Some Aspects of the Design and Analysis of Cluster Randomization Trials
Donner, A. P. (1998) · Journal of the Royal Statistical Society Series C (Applied Statistics) · doi:10.1111/1467-9876.00100 · Cited by 178 · see citing works
Intraclass correlation coefficients for cluster randomized trials in primary care
Smeeth, L. L., & Ng, E. S.-W. (2002) · Controlled Clinical Trials · doi:10.1016/s0197-2456(02)00208-8 · Cited by 168 · see citing works
Siddiqui, O. I., Hedeker, D., Flay, B. R., & Hu, F. B. (1996) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a008945 · Cited by 152 · see citing works
An Empirical Study of Cluster Randomization
Donner, A. P. (1982) · International Journal of Epidemiology · doi:10.1093/ije/11.3.283 · Cited by 104 · see citing works
Hauck, W. W., GILLISS, C. L., Donner, A. P., & Gortner, S. R. (1991) · Nursing Research · doi:10.1097/00006199-199111000-00007 · Cited by 75 · see citing works
Design considerations in the estimation of intraclass correlation
Donner, A. P., & Koval, J. J. (1982) · Annals of Human Genetics · doi:10.1111/j.1469-1809.1982.tb00718.x · Cited by 66 · see citing works
Feng, Z., & Grizzle, J. E. (1992) · Statistics in Medicine · doi:10.1002/sim.4780111208 · Cited by 61 · see citing works
Eccles, M., Ford, G. A., Duggan, S., & Steen, N. (1999) · Europe PMC (PubMed Central) · doi:10.25405/ncl.34593567 · Cited by 43 · see citing works
Designing Evaluations of Interventions to Change Professional Practice
Mason, J. M., Wood, J., & Freemantle, N. (1999) · Journal of Health Services Research & Policy · doi:10.1177/135581969900400209 · Cited by 35 · see citing works
Butler, C., & Bachmann, M. O. (1996) · Family Practice · doi:10.1093/fampra/13.4.402 · Cited by 18 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Consort 2010 statement: extension to cluster randomised trials
Campbell, M. K., Piaggio, G., Elbourne, D. R., Altman, D. G., & for the CONSORT Group (2012) · BMJ · doi:10.1136/bmj.e5661 · Cited by 3,510 · see citing works
Self-citationOrganizational readiness for implementing change: a psychometric assessment of a new measure
Shea, C. M., Jacobs, S., Esserman, D. A., Bruce, K., & Weiner, B. J. (2014) · Implementation Science · doi:10.1186/1748-5908-9-7 · Cited by 863 · see citing works
Tailored interventions to address determinants of practice
Baker, R., Camosso-Stefinovic, J., Gillies, C., Shaw, E. J., Cheater, F., Flottorp, S., Robertson, N., Wensing, M., Fiander, M., Eccles, M. P., et al. (2015) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd005470.pub3 · Cited by 711 · see citing works
Cals, J., Butler, C., Hopstaken, R., Hood, K., & Dinant, G. (2009) · BMJ · doi:10.1136/bmj.b1374 · Cited by 499 · see citing works
Methods for sample size determination in cluster randomized trials
Rutterford, C., Copas, A., & Eldridge, S. (2015) · International Journal of Epidemiology · doi:10.1093/ije/dyv113 · Cited by 429 · see citing works
Summarizing historical information on controls in clinical trials
Neuenschwander, B. E., Capkun-Niggli, G., Branson, M., & Spiegelhalter, D. J. (2010) · Clinical Trials · doi:10.1177/1740774509356002 · Cited by 398 · see citing works
Sample size calculations for cluster randomised controlled trials with a fixed number of clusters
Hemming, K., Girling, A. J., Sitch, A. J., Marsh, J., & Lilford, R. J. (2011) · BMC Medical Research Methodology · doi:10.1186/1471-2288-11-102 · Cited by 317 · see citing works
van Dessel, N., den Boeft, M., van der Wouden, J. C., Kleinstäuber, M., Leone, S. S., Terluin, B., Numans, M. E., van der Horst, H. E., & van Marwijk, H. (2014) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd011142.pub2 · Cited by 302 · see citing works
Cluster randomized trials with a small number of clusters: which analyses should be used?
Leyrat, C., Morgan, K. E., Leurent, B., & Kahan, B. C. (2018) · International Journal of Epidemiology · doi:10.1093/ije/dyx169 · Cited by 244 · see citing works
Sample size calculations for stepped wedge and cluster randomised trials: a unified approach
Hemming, K., & Taljaard, M. (2016) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2015.08.015 · Cited by 230 · see citing works
De Allegri, M., Ridde, V., Louis, V. R., Sarker, M., Tiendrebéogo, J., Yé, M., Müller, O., & Jahn, A. (2011) · Health Policy · doi:10.1016/j.healthpol.2010.10.010 · Cited by 215 · see citing works
Review of recent methodological developments in group-randomized trials: part 2—analysis
Turner, E. L., Prague, M., Gallis, J. A., Li, F., & Murray, D. M. (2017) · American Journal of Public Health · doi:10.2105/ajph.2017.303707 · Cited by 195 · see citing works
Raine, R., Fitzpatrick, R. M., Barratt, H., Bevan, G., Black, N. A., Boaden, R., Bower, P., Campbell, M., Denis, J., Devers, K. J., et al. (2016) · Health Services and Delivery Research · doi:10.3310/hsdr04160 · Cited by 187 · see citing works
Self-citationThe Intra‐Cluster Correlation Coefficient in Cluster Randomized Trials: A Review of Definitions
Eldridge, S. M., Ukoumunne, O. C., & Carlin, J. B. (2009) · International Statistical Review · doi:10.1111/j.1751-5823.2009.00092.x · Cited by 181 · see citing works
Review of Recent Methodological Developments in Group-Randomized Trials: Part 1—Design
Turner, E. L., Li, F., Gallis, J. A., Prague, M., & Murray, D. M. (2017) · American Journal of Public Health · doi:10.2105/ajph.2017.303706 · Cited by 167 · see citing works
Turner, S., Karahalios, A., Forbes, A. B., Taljaard, M., Grimshaw, J., & McKenzie, J. E. (2021) · BMC Medical Research Methodology · doi:10.1186/s12874-021-01306-w · Cited by 159 · see citing works
Self-citationFrench, S. D., McKenzie, J. E., O’Connor, D. A., Grimshaw, J., Mortimer, D., Francis, J., Michie, S., Spike, N., Schattner, P. L., Kent, P. M., et al. (2013) · PLoS ONE · doi:10.1371/journal.pone.0065471 · Cited by 153 · see citing works
Self-citationHemming, K., & Taljaard, M. (2020) · International Journal of Epidemiology · doi:10.1093/ije/dyaa077 · Cited by 152 · see citing works
Developing Appropriate Methods for Cost-Effectiveness Analysis of Cluster Randomized Trials
Gomes, M., Ng, E. S. W., Grieve, R., Nixon, R. M., Carpenter, J. R., & Thompson, S. G. (2011) · Medical Decision Making · doi:10.1177/0272989x11418372 · Cited by 153 · see citing works
Lilford, R. J., Chilton, P. J., Hemming, K., Girling, A. J., Taylor, C. A., & Barach, P. (2010) · BMJ · doi:10.1136/bmj.c4413 · Cited by 146 · see citing works
Dziak, J. J., Nahum-Shani, I., & Collins, L. M. (2012) · Psychological Methods · doi:10.1037/a0026972 · Cited by 142 · see citing works
Lawton, R., O'Hara, J. K., Sheard, L., Armitage, G., Cocks, K., Buckley, H., Corbacho, B., Reynolds, C., Marsh, C., Moore, S. G., et al. (2017) · BMJ Quality & Safety · doi:10.1136/bmjqs-2016-005570 · Cited by 138 · see citing works
Pagel, C., Prost, A., Lewycka, S. O., Das, S., Colbourn, T., Mahapatra, R., Azad, K., Costello, A. M. D. L., & Osrin, D. (2011) · Trials · doi:10.1186/1745-6215-12-151 · Cited by 118 · see citing works
Screening for genital chlamydia infection
Low, N. N., Redmond, S. M. S., Uusküla, A., van Bergen, J. E. A. M., Ward, H., Andersen, B. S., & Götz, H. M. (2016) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd010866.pub2 · Cited by 100 · see citing works
Sample size calculation for cluster randomized cross‐over trials
Giraudeau, B., Ravaud, P., & Donner, A. P. (2008) · Statistics in Medicine · doi:10.1002/sim.3383 · Cited by 98 · see citing works
Key considerations for designing, conducting and analysing a cluster randomized trial
Hemming, K., & Taljaard, M. (2023) · International Journal of Epidemiology · doi:10.1093/ije/dyad064 · Cited by 90 · see citing works
Clustering in surgical trials - database of intracluster correlations
Cook, J. A., Bruckner, T. M., MacLennan, G., & Seiler, C. M. (2012) · Trials · doi:10.1186/1745-6215-13-2 · Cited by 85 · see citing works
Shaygan, M., Yazdani, Z., & Valibeygi, A. (2021) · BMC Psychiatry · doi:10.1186/s12888-021-03085-6 · Cited by 83 · see citing works
Cranney, A., Lam, M., Rühland, L., Brison, R., Godwin, M., Harrison, M., Harrison, M. B., Anastassiades, T., Grimshaw, J., & Graham, I. D. (2008) · Osteoporosis International · doi:10.1007/s00198-008-0669-0 · Cited by 76 · see citing works
Self-citationGoud, R., de Keizer, N. F., ter Riet, G., Wyatt, J. C., Hasman, A., Hellemans, I. M., & Peek, N. B. (2009) · BMJ · doi:10.1136/bmj.b1440 · Cited by 75 · see citing works
Taljaard, M., Donner, A. P., Villar, J., WOJDYLA, D. M., Velazco, A., Bataglia, V., Faúndes, A., Langer, A., Narváez, A., Valladares, E. C., et al. (2008) · Paediatric and Perinatal Epidemiology · doi:10.1111/j.1365-3016.2007.00901.x · Cited by 74 · see citing works
Littenberg, B., & MacLean, C. D. (2006) · BMC Medical Research Methodology · doi:10.1186/1471-2288-6-20 · Cited by 73 · see citing works
Arnup, S. J., McKenzie, J. E., Hemming, K., Pilcher, D. V., & Forbes, A. B. (2017) · Trials · doi:10.1186/s13063-017-2113-2 · Cited by 74 · see citing works
Sandbæk, A., Griffin, S. J., Sharp, S. J., Simmons, R. K., Borch‐Johnsen, K., Rutten, G. E. H. M., van den Donk, M., Wareham, N. J., Lauritzen, T., Davies, M. J., et al. (2014) · Diabetes Care · doi:10.2337/dc13-1544 · Cited by 69 · see citing works
Ruikes, F. G. H., Zuidema, S. U., Akkermans, R. P., Assendelft, W. J., Schers, H., & Koopmans, R. T. C. M. (2016) · The Journal of the American Board of Family Medicine · doi:10.3122/jabfm.2016.02.150214 · Cited by 66 · see citing works
Statistical Methods for Cost-Effectiveness Analyses That Use Data from Cluster Randomized Trials
Gomes, M., Grieve, R., Nixon, R. M., & Edmunds, W. J. (2011) · Medical Decision Making · doi:10.1177/0272989x11407341 · Cited by 60 · see citing works
Stigsdotter, U. K., Corazon, S. S., Sidenius, U., Nyed, P. K., Larsen, H. B., & Fjorback, L. O. (2018) · The British Journal of Psychiatry · doi:10.1192/bjp.2018.2 · Cited by 59 · see citing works
Wang, D., Zhu, F., Xi, S., Niu, L., Tebes, J. K., Xiao, S., & Yu, Y. (2021) · Psychology Research and Behavior Management · doi:10.2147/prbm.s320126 · Cited by 62 · see citing works
Barbui, C., & Cipriani, A. (2011) · Epidemiology and Psychiatric Sciences · doi:10.1017/s2045796011000515 · Cited by 60 · see citing works
the LCP Randomised Italian Cluster Trial Study Group, Costantini, M., Ottonelli, S., Canavacci, L., Pellegrini, F., & Beccaro, M. (2011) · BMC Health Services Research · doi:10.1186/1472-6963-11-13 · Cited by 57 · see citing works
Tilburgs, B., Koopmans, R. T. C. M., Vernooij-Dassen, M. J. F. J., Adang, E., Schers, H., Teerenstra, S., van de Pol, M. H. J., Smits, C. H. M., Engels, Y., & Perry, M. (2019) · Journal of the American Medical Directors Association · doi:10.1016/j.jamda.2019.09.010 · Cited by 57 · see citing works
Grieve, R., Nixon, R. M., & Thompson, S. G. (2009) · Medical Decision Making · doi:10.1177/0272989x09341752 · Cited by 57 · see citing works
Simons, D., De Bourdeaudhuij, I., Clarys, P., De Cocker, K., Vandelanotte, C., & Deforche, B. (2018) · JMIR mHealth and uHealth · doi:10.2196/10003 · Cited by 56 · see citing works
Korevaar, E., Kasza, J., Taljaard, M., Hemming, K., Haines, T. P., Turner, E. L., Thompson, J. A., Hughes, J. P., & Forbes, A. B. (2021) · Clinical Trials · doi:10.1177/17407745211020852 · Cited by 57 · see citing works
Mceachan, R., Santorelli, G., Bryant, M., Sahota, P., Farrar, D., Small, N., Akhtar, S., Sargent, J., Barber, S., Taylor, N., et al. (2016) · BMC Public Health · doi:10.1186/s12889-016-2861-z · Cited by 43 · see citing works
Ashish, K. C., Bergström, A., Chaulagain, D. R., Brunell, O., Ewald, U., Gurung, A., Eriksson, L., Litorp, H., Wrammert, J., Grönqvist, E., et al. (2017) · BMJ Global Health · doi:10.1136/bmjgh-2017-000497 · Cited by 54 · see citing works
Unverzagt, S., Oemler, M., Braun, K., & Klement, A. (2013) · Family Practice · doi:10.1093/fampra/cmt080 · Cited by 53 · see citing works
Hartman, E. A. R., van de Pol, A. C., Heltveit-Olsen, S. R., Lindbæk, M., Høye, S., Lithén, S. S., Sundvall, P., Sundvall, S., Arnljots, E. S., Gunnarsson, R. K., et al. (2023) · BMJ · doi:10.1136/bmj-2022-072319 · Cited by 51 · see citing works
METHODS FOR COVARIATE ADJUSTMENT IN COST‐EFFECTIVENESS ANALYSIS THAT USE CLUSTER RANDOMISED TRIALS
Gomes, M., Grieve, R., Nixon, R. M., Ng, E. S. W., Carpenter, J. R., & Thompson, S. G. (2012) · Health Economics · doi:10.1002/hec.2812 · Cited by 50 · see citing works
Carter, B. L., Levy, B., Gryzlak, B., Xu, Y., Chrischilles, E., Dawson, J., Vander Weg, M., Christensen, A., James, P., & Polgreen, L. (2018) · Circulation: Cardiovascular Quality and Outcomes · doi:10.1161/circoutcomes.117.004188 · Cited by 46 · see citing works
Parker, K., Nunns, M., Xiao, Z., Ford, T. J., & Ukoumunne, O. C. (2023) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2023.03.020 · Cited by 45 · see citing works
Goal-setting in geriatric rehabilitation: a systematic review and meta-analysis
Smit, E. B., Bouwstra, H., Hertogh, C. M. P. M., Wattel, E., & van der Wouden, J. C. (2018) · Clinical Rehabilitation · doi:10.1177/0269215518818224 · Cited by 46 · see citing works
Sample size calculations for 3-level cluster randomized trials
Teerenstra, S., Moerbeek, M., van Achterberg, T., Pelzer, B. J., & Borm, G. F. (2008) · Clinical Trials · doi:10.1177/1740774508096476 · Cited by 44 · see citing works
Singh, J., Liddy, C. E., Hogg, W. E., & Taljaard, M. (2015) · BMC Research Notes · doi:10.1186/s13104-015-1042-y · Cited by 44 · see citing works
Case management for integrated care of older people with frailty in community settings
Sadler, E., Khadjesari, Z., Ziemann, A., Sheehan, K. J., Whitney, J. C., Wilson, D., Bakolis, I., Sevdalis, N., Sandall, J., Soukup, T., et al. (2023) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd013088.pub2 · Cited by 45 · see citing works
Zwarenstein, M., Shiller, S. K., Croxford, R., Grimshaw, J., Kelsall, D., Paterson, J. M., Laupacis, A., Austin, P. C., Tu, K., Yun, L., et al. (2014) · Implementation Science · doi:10.1186/1748-5908-9-87 · Cited by 40 · see citing works
Self-citationKoetsenruijter, J., van Lieshout, J., Vassilev, I., Portillo, M. C., Serrano, M., Knutsen, I. R., Roukova, P., Lionis, C. D., Todorova, E., Foss, C., et al. (2014) · Health and Quality of Life Outcomes · doi:10.1186/1477-7525-12-29 · Cited by 39 · see citing works
Berezowski, L., Ludwig, L., Martin, A., Löwe, B., & Mora, M. C. S. (2021) · Psychosomatic Medicine · doi:10.1097/psy.0000000000001011 · Cited by 40 · see citing works
Landais, M., Nay, M.-A., Auchabie, J., Hubert, N., Frerou, A., Yehia, A., Mercat, A., Jonas, M., Martino, F., Moriconi, M., et al. (2023) · The Lancet Respiratory Medicine · doi:10.1016/s2213-2600(22)00413-1 · Cited by 36 · see citing works
Communication skills of healthcare professionals in paediatric diabetes services
Hambly, H., Robling, M. R., Crowne, E. C., Hood, K., Gregory, J. W., & for the DEPICTED Study Team (2009) · Diabetic Medicine · doi:10.1111/j.1464-5491.2009.02708.x · Cited by 36 · see citing works
Peters-Klimm, F., Campbell, S., Müller‐Tasch, T., Schellberg, D., Gelbrich, G., Herzog, W., & Szécsényi, J. (2009) · Trials · doi:10.1186/1745-6215-10-68 · Cited by 36 · see citing works
Berg, R. C., Ross, M. W., & Tikkanen, R. H. (2011) · AIDS Education and Prevention · doi:10.1521/aeap.2011.23.6.533 · Cited by 36 · see citing works
Intraclass Correlation Coefficient
Campbell, M., Grimshaw, J., & Piaggio, G. G. (2008) · Wiley Encyclopedia of Clinical Trials · doi:10.1002/9780471462422.eoct482 · Cited by 36 · see citing works
Self-citationPower, B., Kiezebrink, K., Allan, J., & Campbell, M. (2014) · BMC Obesity · doi:10.1186/s40608-014-0023-3 · Cited by 35 · see citing works
Self-citationMeasures of between‐cluster variability in cluster randomized trials with binary outcomes
Thomson, A., Hayes, R., & Cousens, S. N. (2009) · Statistics in Medicine · doi:10.1002/sim.3582 · Cited by 34 · see citing works
Major, R., Brown, C., Shepherd, D. J., Rogers, S., Pickering, W. P., Warwick, G. L., Barber, S. R., Ashra, N., Morris, T., & Brunskill, N. J. (2019) · Journal of the American Society of Nephrology · doi:10.1681/asn.2018101042 · Cited by 34 · see citing works
Bowden, F. J., Currie, M. J., Toyne, H., McGuiness, C., Lim, L. L.-Y., Butler, J. R. G., & Glasgow, N. (2008) · The Medical Journal of Australia · doi:10.5694/j.1326-5377.2008.tb01526.x · Cited by 34 · see citing works
Hayes‐Ryan, D., Khashan, A. S., Hemming, K., Easter, C., Devane, D., Murphy, D. J., Hunter, A. J., Cotter, A. M., McAuliffe, F. M., Morrison, J. J., et al. (2021) · BMJ · doi:10.1136/bmj.n1857 · Cited by 56 · see citing works
Cook, J. A., Julious, S. A., Sones, W. R., Hampson, L. V., Hewitt, C. E., Berlin, J. A., Ashby, D., Emsley, R., Fergusson, D. A., Walters, S. J., et al. (2019) · Health Technology Assessment · doi:10.3310/hta23600 · Cited by 33 · see citing works
Légaré, F., Brière, N., Stacey, D., Lacroix, G., Desroches, S., Dumont, S., Fraser, K. D., Rivest, L., Durand, P. J., Turcotte, S., et al. (2016) · BMJ Open · doi:10.1136/bmjopen-2016-014023 · Cited by 32 · see citing works
Anjara, S., Bonetto, C., Ganguli, P., Setiyawati, D., Mahendradhata, Y., Yoga, B. H., Trisnantoro, L., Brayne, C., & Bortel, T. V. V. (2019) · PLoS ONE · doi:10.1371/journal.pone.0224724 · Cited by 32 · see citing works
Contamination: How much can an individually randomized trial tolerate?
Hemming, K., Taljaard, M., Moerbeek, M., & Forbes, A. (2021) · Statistics in Medicine · doi:10.1002/sim.8958 · Cited by 31 · see citing works
Getachew, S., Addissie, A., Seife, E., Wakuma, T., Unverzagt, S., Jemal, A., Taylor, L., Wienke, A., & Kantelhardt, E. J. (2022) · The Oncologist · doi:10.1093/oncolo/oyac081 · Cited by 31 · see citing works
Clemes, S. A., Varela-Mato, V., Bodicoat, D. H., Brookes, C. L., Chen, Y., Edwardson, C. L., Gray, L. J., Guest, A. J., Johnson, V., Munir, F., et al. (2022) · BMC Medicine · doi:10.1186/s12916-022-02372-7 · Cited by 32 · see citing works
Allegri, M. D., Louis, V. R., Tiendrébeogo, J., Souares, A., Yé, M., Tozan, Y., Jahn, A., & Mueller, O. (2012) · The International Journal of Health Planning and Management · doi:10.1002/hpm.2116 · Cited by 30 · see citing works
Rutten, J. J. S., van Buul, L. W., Smalbrugge, M., Geerlings, S. E., Gerritsen, D. L., Natsch, S., Sloane, P. D., van der Wouden, J. C., Twisk, J. W. R., & Hertogh, C. M. P. M. (2021) · Journal of the American Medical Directors Association · doi:10.1016/j.jamda.2021.11.010 · Cited by 30 · see citing works
Aubin-Auger, I., Laouenan, C., Bel, J. L., Mercier, A., Baruch, D., Lebeau, J., Youssefian, A., Trung, T. L., Peremans, L., & Royen, P. V. (2015) · European Journal of Cancer Care · doi:10.1111/ecc.12310 · Cited by 30 · see citing works
Gregory, J. W., Robling, M. R., Bennert, K., Channon, S., Cohen, D. R., Crowne, E. C., Hambly, H., Hawthorne, K., Hood, K., Longo, M., et al. (2011) · Health Technology Assessment · doi:10.3310/hta15290 · Cited by 30 · see citing works
Ouyang, Y., Hemming, K., Li, F., & Taljaard, M. (2023) · International Journal of Epidemiology · doi:10.1093/ije/dyad062 · Cited by 29 · see citing works
Hollingworth, W., McKell-Redwood, D., Hampson, L. V., & Metcalfe, C. D. (2012) · Clinical Trials · doi:10.1177/1740774512465358 · Cited by 29 · see citing works
Love, T. E., Cebul, R. D., Einstadter, D., Jain, A., Miller, H., Harris, C. M., Greco, P. J., Husak, S. S., Dawson, N. V., & for the DIG-IT Investigators (2008) · Journal of General Internal Medicine · doi:10.1007/s11606-007-0454-3 · Cited by 27 · see citing works
Shapiro, V. B., Hawkins, J. D., & Oesterle, S. (2015) · Prevention Science · doi:10.1007/s11121-015-0562-y · Cited by 27 · see citing works
Sheard, L., O'Hara, J. K., Armitage, G., Wright, J., Cocks, K., McEachan, R., Watt, I. S., & Lawton, R. (2014) · Trials · doi:10.1186/1745-6215-15-420 · Cited by 26 · see citing works
John, E. D., Gallagher, D., Playle, R., Jewell, K., Cohen, D. R., Duncan, D., Newcombe, R. G., Busse, M. E., Owen-Jones, E., Williams, N. H., et al. (2014) · BMC Public Health · doi:10.1186/1471-2458-14-439 · Cited by 26 · see citing works
Lajos, G. J., Haddad, S. M., Tedesco, R. P., Passini, R., Dias, T. Z., Nomura, M. L., Rheder, P. M., de Sousa, M. H., & Cecatti, J. G. (2014) · BMC Medical Research Methodology · doi:10.1186/1471-2288-14-54 · Cited by 25 · see citing works
Turan, J. M., Steinfeld, R. L., Onono, M. A., Bukusi, E. A., Woods, M., Shade, S. B., Washington, S., Marima, R., Penner, J. A., Ackers, M., et al. (2012) · PLoS ONE · doi:10.1371/journal.pone.0044181 · Cited by 25 · see citing works
Lee, Y. L., Lim, Y. M. F., Law, K. B., & Sivasampu, S. (2020) · Trials · doi:10.1186/s13063-020-04349-4 · Cited by 25 · see citing works
Ruikes, F. G. H., Meys, A. R., van de Wetering, G., Akkermans, R., van Gaal, B. G. I., Zuidema, S. U., Schers, H., van Achterberg, T., & Koopmans, R. T. C. M. (2012) · BMC Family Practice · doi:10.1186/1471-2296-13-115 · Cited by 25 · see citing works
Bosch, M., McKenzie, J. E., Mortimer, D., Tavender, E. J., Francis, J., Brennan, S., Knott, J. C., Ponsford, J. L., Pearce, A. P., O’Connor, D. A., et al. (2014) · Trials · doi:10.1186/1745-6215-15-281 · Cited by 25 · see citing works
Self-citationEnsayos clínicos aleatorizados comunitarios (CONSORT CLUSTER)
Campbell, M., Elbourne, D. R., & Altman, D. G. (2005) · Medicina Clínica · doi:10.1016/s0025-7753(05)72206-5 · Cited by 26 · see citing works
Self-citationEmond, Y., Calsbeek, H., Peters, Y., Bloo, G., Teerenstra, S., Westert, G. P., Damen, J., Wollersheim, H. C. H., & Wolff, A. P. (2022) · British Journal of Anaesthesia · doi:10.1016/j.bja.2021.12.019 · Cited by 24 · see citing works
Emond, Y., Calsbeek, H., Teerenstra, S., Bloo, G., Westert, G. P., Damen, J., Wolff, A. P., & Wollersheim, H. C. H. (2015) · Implementation Science · doi:10.1186/s13012-014-0198-5 · Cited by 24 · see citing works
Hustedt, J. C., Doum, D., Keo, V., Ly, S., Sam, B., Chan, V., Alexander, N. D. E., Bradley, J., Liverani, M., Prasetyo, D. B., et al. (2021) · American Journal of Tropical Medicine and Hygiene · doi:10.4269/ajtmh.20-1088 · Cited by 26 · see citing works
Cuypers, M., Lamers, R. E. D., Kil, P. J. M., van de Poll-Franse, L. V., & de Vries, M. (2015) · Trials · doi:10.1186/s13063-015-0750-x · Cited by 22 · see citing works
de Groot, J. J. A., Maessen, J. M. C., Slangen, B. F. M., Winkens, B., Dirksen, C. D., & van der Weijden, T. (2015) · Implementation Science · doi:10.1186/s13012-015-0298-x · Cited by 23 · see citing works
Allison, J. J., Nguyen, H. L., Ha, D. A., Chiriboga, G., Ly, H. N., Tran, H. T. D., Phan, N. T., Nguyen, V. C., Kim, M., & Goldberg, R. J. (2016) · Trials · doi:10.1186/s13063-015-1147-6 · Cited by 22 · see citing works
Taylor, N. J., Clay‐Williams, R., Hogden, E., Pye, V., Li, Z., Groene, O., Suñol, R., & Braithwaite, J. (2015) · BMJ Open · doi:10.1136/bmjopen-2015-010349 · Cited by 21 · see citing works
Trent, S. A., Havranek, E. P., Ginde, A. A., & Haukoos, J. S. (2018) · American Journal of Medical Quality · doi:10.1177/1062860618796947 · Cited by 21 · see citing works
Stuart, B. L., Becque, T., Moore, M. V., & Little, P. S. (2020) · BMC Medical Research Methodology · doi:10.1186/s12874-020-00971-7 · Cited by 23 · see citing works
Required sample size to detect mediation in 3-level implementation studies
Williams, N. J., Preacher, K. J., Allison, P. D., Mandell, D. S., & Marcus, S. C. (2022) · Implementation Science · doi:10.1186/s13012-022-01235-2 · Cited by 21 · see citing works
- Authors
- Campbell, M. K., Fayers, P. M., & Grimshaw, J. M.
- Affiliations
- University of Aberdeen (GB)
- Ottawa Hospital Research Institute (CA)
- Corresponding author
- Campbell, Marion K
- Venue
- Clinical Trials
- Publisher
- SAGE Publications
- Published
- 2005-04
- Volume
- 2
- Issue
- 2
- Pages
- 99-107
- ISSN
- 1740-7745 (ISSN-L)
- 1740-7753
- OpenAlex
- W2164947695
- Cited by
- 275
- References
- 30
- Citations by year
- 2026: 11 · 2025: 9 · 2024: 13 · 2023: 20 · 2022: 18 · 2021: 32 · 2020: 14 · 2019: 15 · 2018: 10 · 2017: 15 · 2016: 14 · 2015: 15 · 2014: 16 · 2013: 8 · 2012: 17
- FWCI
- 9.80
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Clinical Trials (publishedVersion)
- PubMed (publishedVersion)
- Funders
- Canada Research Chairs
- Topics
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Keywords
- intra-cluster correlation, implementation research, primary care, secondary care, sample size determination, cluster size, measurement types
- MeSH terms
- Data Interpretation, Statistical, Health Services Research, Humans, Surveys and Questionnaires, Research Design, Models, Statistical, Cluster Analysis, Randomized Controlled Trials as Topic, Sample Size, Evidence-Based Medicine, Biomedical Research, Empirical Research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review