The use of random effects models to allow for clustering in individually randomized trials
The DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.
Abstract
Background We describe different forms of clustering that may occur in individually randomized trials, where the observed outcomes for different individuals cannot be regarded as independent. We propose random effects models to allow for such clustering, across a range of contexts and trial designs, and investigate their effect on estimation and interpretation of the treatment effect. Methods We apply our proposed models to two individually randomized trials with potential for clustering, a trial of teleconsultation in hospital referral (the main outcome being offer of a further hospital appointment) and a trial of exercise therapy delivered by physiotherapists for low back pain (the outcome being a back pain score). Extensions to the methods include the possibility of explaining heterogeneity between clusters using cluster level characteristics and the potential dilution of cluster effects due to noncompliance. Results In the teleconsultation trial, the odds ratio was significant (1.52, 95% CI 1.27 to 1.82) when clustering was ignored, but smaller and nonsignificant (1.36, 95% CI 0.85 to 2.13) when clustering by hospital consultant was taken into account. The 95% range of estimated treatment effects across consultants was from 0.21 to 8.76. This variability was only partially explained by the specialty of the consultant. In the back pain trial, although there was an overall benefit of exercise (change of 20.51 points on the back pain score) and little evidence of clustering, the estimated treatment effects for different physiotherapists ranged from 21.26 to +0.26 points. Conclusions Clustering is an important issue in many individually randomized trials. Ignoring it can lead to underestimates of the uncertainty and too extreme P-values. Even when there is little apparent heterogeneity across clusters, it can still have a large impact on the estimation and interpretation of the treatment effect.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A Study of the Natural History of Back Pain: Part I
ROLAND, M., & MORRIS, R. (1983) · Spine · doi:10.1097/00007632-198303000-00004 · Cited by 3,395 · cited 1×
“The primary outcome was the change from baseline to 1, 3 and 12 months in the Roland Disability Questionnaire score [18], a measure of disability caused by back pain rated from 0 to 24, with 24 being severe disability.”
BackgroundDefining and measuring patient satisfaction with medical care
Ware, J. E., Snyder, M. K., Wright, W. R., & Davies, A. R. (1983) · Evaluation and Program Planning · doi:10.1016/0149-7189(83)90005-8 · Cited by 1,259 · cited 1×
“A secondary outcome in the teleconsultation trial was patient satisfaction, a score ranging from 1 (poor) to 5 (good), which we consider as a continuous outcome, derived from responses to the WARE questionnaire [16] after the initial teleconsultation or hospital appointment.”
MethodReference Bayesian Methods for Generalized Linear Mixed Models
Natarajan, R., & Kass, R. E. (2000) · Journal of the American Statistical Association · doi:10.1080/01621459.2000.10473916 · Cited by 209
Wallace, P., Haines, A., Harrison, R., Barbour, J., Thompson, S., Jacklin, P., Roberts, J., Lewis, L., & Wainwright, P. (2002) · The Lancet · doi:10.1016/s0140-6736(02)08828-1 · Cited by 145
Self-citation
Cited by
Boutron, I., Moher, D., Altman, D. G., Schulz, K. F., Ravaud, P., & for the CONSORT Group* (2008) · Annals of Internal Medicine · doi:10.7326/0003-4819-148-4-200802190-00008 · Cited by 2,292
Boutron, I., Altman, D. G., Moher, D., Schulz, K. F., Ravaud, P., & for the CONSORT NPT Group* (2017) · Annals of Internal Medicine · doi:10.7326/m17-0046 · Cited by 1,538
“underestimation of the sample size required and provide incorrect treatment-effect estimates (26-28).”
BackgroundWhen Should You Adjust Standard Errors for Clustering?
Abadie, A., Athey, S., Imbens, G., & Wooldridge, J. (2017) · National Bureau of Economic Research · doi:10.3386/w24003 · Cited by 1,360
Pals, S. L., Murray, D. M., Alfano, C. M., Shadish, W. R., Hannan, P. J., & Baker, W. L. (2008) · American Journal of Public Health · doi:10.2105/ajph.2007.127027 · Cited by 104
Walwyn, R., & Roberts, C. (2010) · Statistical Methods in Medical Research · doi:10.1177/0962280209105017 · Cited by 93
Metadata
- Authors
- Lee, K. J., & Thompson, S. G.
- Venue
- Clinical Trials
- Publisher
- SAGE Publications
- Published
- 2005-04
- Volume
- 2
- Issue
- 2
- Pages
- 163-173
- ISSN
- 1740-7745 (ISSN-L)
- 1740-7753
- OpenAlex
- W2159012776
- Cited by
- 86
- References
- 4
- FWCI
- 2.18
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: The use of random effects models to allow for clustering in individually randomized trials. https://app.cochat.ai/papers/10.1191/1740774505cn082oa
- The paper
- Lee, K. J., & Thompson, S. G. (2005). The use of random effects models to allow for clustering in individually randomized trials. Clinical Trials. https://doi.org/10.1191/1740774505cn082oa
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.