The DOI matches its Crossref record; 30 of the 30 references it cites were found in a registry or an index.
Determinants of the intracluster correlation coefficient in cluster randomized trials: the case of implementation research
Abstract
The objective of this research was to identify determinants of the magnitude of intracluster correlation coefficients (ICCs) in cluster randomized trials from the field of implementation research. A survey of experts was conducted to generate a priori hypotheses of factors that might affect ICC size. Hypotheses were tested on empirical estimates of ICCs calculated from 21 implementation research datasets, mainly from the UK. Effects of setting (primary or secondary care), type of variable (process or outcome), type of measurement (objective or subjective), prevalence of outcome and size of cluster were tested. In total, 220 ICCs were available (range 0 to 0.415). Significant differences in ICC magnitude were found. The ICCs were significantly higher for process than for outcome variables, and for secondary care outcomes compared with primary care outcomes. The effects of prevalence and size were less clear cut. There was no evidence to suggest that type of measurement affected ICC size. In conclusion, accurate estimates of ICCs are essential for sample size calculations for cluster randomized trials of professional behaviour change interventions. This study demonstrates that ICCs are sensitive to a number of trial factors, particularly setting and outcome type. These factors must be considered when planning such cluster randomized trials.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Campbell et al extracted 220 ICCs from 21 data sets and reported the results separately for both primary and secondary care settings.”
From Tailored interventions to address determinants of practice (2015) · cites this paper as Campbell 2005
In the citing paper
“In the meta‐regression analyses, we carried out sensitivity analyses assuming a larger clustering effect than had been accounted for in the standard analyses, by using higher ICC estimates (i.e. the reported upper quartile range values) taken from Campbell (Campbell 2005).”
From Tailored interventions to address determinants of practice (2015) · cites this paper as Campbell 2005
Citations
Cites
Ouellette, J. A., & Wood, W. (1998) · Psychological Bulletin · doi:10.1037/0033-2909.124.1.54 · Cited by 3,480
Introducing Multilevel Modeling
Kreft, I., & de Leeuw, J. (1998) · doi:10.4135/9781849209366 · Cited by 2,997
Regression standard errors in clustered samples
Rogers, W. H. (1993) · Stata technical bulletin · Cited by 2,694
A Note on Robust Variance Estimation for Cluster‐Correlated Data
Williams, R. L. (2000) · Biometrics · doi:10.1111/j.0006-341x.2000.00645.x · Cited by 2,501
Design and Analysis of Cluster Randomization Trials in Health Research
Davis, W. W. (2001) · Journal of the American Statistical Association · doi:10.1198/jasa.2001.s433 · Cited by 1,735
Design and Analysis of Cluster Randomization Trials in Health Research
DONNER, A. P., & Klar, N. S. (2000) · Cited by 1,236
Ukoumunne, Gulliford, M. C., Chinn, Sterne, & Burney, P. (1999) · Health Technology Assessment · doi:10.3310/hta3050 · Cited by 1,211
Design and Analysis of Group-Randomized Trials
Sonnad, S. S. (1999) · Medicine & Science in Sports & Exercise · doi:10.1097/00005768-199902000-00025 · Cited by 1,130
Design and Analysis of Group-Randomized Trials
Murray, D. M. (2007) · doi:10.1093/oso/9780195120363.001.0001 · Cited by 1,117
Gulliford, M. C., Ukoumunne, O. C., & Chinn, S. (1999) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a009904 · Cited by 853
Donner, A. P., Birkett, N., & Buck, C. W. (1981) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a113261 · Cited by 698
Context, composition and heterogeneity: using multilevel models in health research
Duncan, C., Jones, K., & Moon, G. (1998) · Social Science & Medicine · doi:10.1016/s0277-9536(97)00148-2 · Cited by 689
Evidence of self-report bias in assessing adherence to guidelines
Adams, A., Soumerai, S., Lomas, J., & Ross-Degnan, D. (1999) · International Journal for Quality in Health Care · doi:10.1093/intqhc/11.3.187 · Cited by 679 · cited 1×
“For example, there is empirical evidence that self-reports of activity tend to overestimate the prevalence of appropriate or "correct" behaviour [26,27].”
BackgroundDesign and analysis of group-randomized trials: a review of recent methodological developments
Murray, D. M., Varnell, S. P., & Blitstein, J. L. (2004) · American Journal of Public Health · doi:10.2105/ajph.94.3.423 · Cited by 677
Research designs for studies evaluating the effectiveness of change and improvement strategies
Eccles, M. (2003) · Quality and Safety in Health Care · doi:10.1136/qhc.12.1.47 · Cited by 586
The Estimation of Intraclass Correlation in the Analysis of Family Data
Donner, A. P., & Koval, J. J. (1980) · Biometrics · doi:10.2307/2530491 · Cited by 305
ON DESIGN CONSIDERATIONS AND RANDOMIZATION-BASED INFERENCE FOR COMMUNITY INTERVENTION TRIALS
Gail, M. H., Mark, S. D., Carroll, R. J., Green, S. B., & Pee, D. (1996) · Statistics in Medicine · doi:10.1002/(sici)1097-0258(19960615)15:11 · Cited by 246
Methods to reduce the impact of intraclass correlation in group-randomized trials.
Murray, D. M., & Blitstein, J. L. (2003) · Evaluation Review · doi:10.1177/0193841x02239019 · Cited by 221
New Statistical Methods for Analysing Social Structures: an introduction to multilevel models
Paterson, L., & Goldstein, H. (1991) · British Educational Research Journal · doi:10.1080/0141192910170408 · Cited by 209
Some Aspects of the Design and Analysis of Cluster Randomization Trials
Donner, A. P. (1998) · Journal of the Royal Statistical Society Series C (Applied Statistics) · doi:10.1111/1467-9876.00100 · Cited by 178
Intraclass correlation coefficients for cluster randomized trials in primary care
Smeeth, L. L., & Ng, E. S.-W. (2002) · Controlled Clinical Trials · doi:10.1016/s0197-2456(02)00208-8 · Cited by 168
Siddiqui, O. I., Hedeker, D., Flay, B. R., & Hu, F. B. (1996) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a008945 · Cited by 152
Are distinctive ethical principles required for cluster randomized controlled trials?
Hutton, J. L. (2001) · Statistics in Medicine · doi:10.1002/1097-0258(20010215)20:3 · Cited by 125
Self-citationAn Empirical Study of Cluster Randomization
Donner, A. P. (1982) · International Journal of Epidemiology · doi:10.1093/ije/11.3.283 · Cited by 104
Hauck, W. W., GILLISS, C. L., Donner, A. P., & Gortner, S. R. (1991) · Nursing Research · doi:10.1097/00006199-199111000-00007 · Cited by 75
Design considerations in the estimation of intraclass correlation
Donner, A. P., & Koval, J. J. (1982) · Annals of Human Genetics · doi:10.1111/j.1469-1809.1982.tb00718.x · Cited by 63
Feng, Z., & Grizzle, J. E. (1992) · Statistics in Medicine · doi:10.1002/sim.4780111208 · Cited by 61
Eccles, M., Ford, G. A., Duggan, S., & Steen, N. (1999) · Europe PMC (PubMed Central) · doi:10.25405/ncl.34593567 · Cited by 43
Designing Evaluations of Interventions to Change Professional Practice
Mason, J. M., Wood, J., & Freemantle, N. (1999) · Journal of Health Services Research & Policy · doi:10.1177/135581969900400209 · Cited by 35
Butler, C., & Bachmann, M. O. (1996) · Family Practice · doi:10.1093/fampra/13.4.402 · Cited by 18
Research works printed but not linked: 8
- Donner A, 1998, Appl Stat, 47, 95
- Campbell MK, 2000, JHSRP, 5, 12
- Mason J, 1999, JHSRP, 4, 106
- Rogers WH, 1993, Stata Technical Bulletin, 3, 88
- NHS Cervical Screening Programme, 2001, Cervical Screening: a pocket guide
- Adams G, 2003, JHSRP, 8, 87
- Eccles M, 1999, BJGP, 49, 35
- Turner RM, 2000, Proceedings of the International Society of Clinical Biostatistics, 49
Cited by
Sorted by citations
Consort 2010 statement: extension to cluster randomised trials
Campbell, M. K., Piaggio, G., Elbourne, D. R., Altman, D. G., & for the CONSORT Group (2012) · BMJ · doi:10.1136/bmj.e5661 · Cited by 3,510
Self-citationOrganizational readiness for implementing change: a psychometric assessment of a new measure
Shea, C., Jacobs, S., Esserman, D. A., Bruce, K., & Weiner, B. (2014) · Implementation Science · doi:10.1186/1748-5908-9-7 · Cited by 785
Tailored interventions to address determinants of practice
Baker, R., Camosso-Stefinovic, J., Gillies, C., Shaw, E. J., Cheater, F., Flottorp, S., Robertson, N., Wensing, M., Fiander, M., Eccles, M. P., et al. (2015) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd005470.pub3 · Cited by 711
Cals, J., Butler, C., Hopstaken, R., Hood, K., & Dinant, G. (2009) · BMJ · doi:10.1136/bmj.b1374 · Cited by 499
Methods for sample size determination in cluster randomized trials
Rutterford, C., Copas, A., & Eldridge, S. (2015) · International Journal of Epidemiology · doi:10.1093/ije/dyv113 · Cited by 429
Metadata
- Authors
- Campbell, M. K., Fayers, P. M., & Grimshaw, J. M.
- Affiliations
- University of Aberdeen (GB)
- Ottawa Hospital Research Institute (CA)
- Corresponding author
- Campbell, Marion K
- Venue
- Clinical Trials
- Publisher
- SAGE Publications
- Published
- 2005-04
- Volume
- 2
- Issue
- 2
- Pages
- 99-107
- ISSN
- 1740-7745 (ISSN-L)
- 1740-7753
- OpenAlex
- W2164947695
- Cited by
- 275
- References
- 30
- Citations by year
- 2026: 11 · 2025: 9 · 2024: 13 · 2023: 20 · 2022: 18 · 2021: 32 · 2020: 14 · 2019: 15 · 2018: 10 · 2017: 15 · 2016: 14 · 2015: 15 · 2014: 16 · 2013: 8 · 2012: 17
- FWCI
- 9.80
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Clinical Trials (publishedVersion)
- PubMed (publishedVersion)
- Funders
- Canada Research Chairs
- Topics
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Keywords
- intra-cluster correlation, implementation research, primary care, secondary care, sample size determination, cluster size, measurement types
- MeSH terms
- Data Interpretation, Statistical, Health Services Research, Humans, Surveys and Questionnaires, Research Design, Models, Statistical, Cluster Analysis, Randomized Controlled Trials as Topic, Sample Size, Evidence-Based Medicine, Biomedical Research, Empirical Research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review