Quantifying the impact of fixed effects modeling of clusters in multiple imputation for cluster randomized trials
Open accessThe DOI matches its Crossref record; 5 of the 5 references it cites were found in a registry or an index.
Abstract
In cluster randomized trials (CRTs), identifiable clusters rather than individuals are randomized to study groups. Resulting data often consist of a small number of clusters with correlated observations within a treatment group. Missing data often present a problem in the analysis of such trials, and multiple imputation (MI) has been used to create complete data sets, enabling subsequent analysis with well-established analysis methods for CRTs. We discuss strategies for accounting for clustering when multiply imputing a missing continuous outcome, focusing on estimation of the variance of group means as used in an adjusted t-test or ANOVA. These analysis procedures are congenial to (can be derived from) a mixed effects imputation model; however, this imputation procedure is not yet available in commercial statistical software. An alternative approach that is readily available and has been used in recent studies is to include fixed effects for cluster, but the impact of using this convenient method has not been studied. We show that under this imputation model the MI variance estimator is positively biased and that smaller intraclass correlations (ICCs) lead to larger overestimation of the MI variance. Analytical expressions for the bias of the variance estimator are derived in the case of data missing completely at random, and cases in which data are missing at random are illustrated through simulation. Finally, various imputation methods are applied to data from the Detroit Middle School Asthma Project, a recent school-based CRT, and differences in inference are compared.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Multidimensional Scale of Perceived Social Support
Zimet, G. D., Dahlem, N. W., Zimet, S. G., & Farley, G. K. (1988) · Journal of Personality Assessment · doi:10.1207/s15327752jpa5201_2 · Cited by 13,339
Statistical Analysis with Missing Data
Little, R. J. A., & Rubin, D. B. (2002) · Wiley Series in Probability and Statistics · doi:10.1002/9781119013563 · Cited by 8,473
Psychometric Characteristics of the Multidimensional Scale of Perceived Social Support
Zimet, G. D., Powell, S. S., Farley, G. K., Werkman, S., & Berkoff, K. A. (1990) · Journal of Personality Assessment · doi:10.1080/00223891.1990.9674095 · Cited by 4,855
Psychometric Characteristics of the Multidimensional Scale of Perceived Social Support
Zimet, G., Powell, S., Farley, G., Werkman, S., & Berkoff, K. (1990) · Journal of Personality Assessment · doi:10.1207/s15327752jpa5503&4_17 · Cited by 4,854
Methods to reduce the impact of intraclass correlation in group-randomized trials.
Murray, D. M., & Blitstein, J. L. (2003) · Evaluation Review · doi:10.1177/0193841x02239019 · Cited by 221 · cited 2×
“Though CRTs rarely have ICCs above 0.1 (Murray and Blitstein, 2003), the value of r5 0.5 was included to evaluate relative performance of the methods in the extreme.”
BackgroundMethodInfluential
Cited by
Multiple imputation as a flexible tool for missing data handling in clinical research
Enders, C. K. (2017) · Behaviour Research and Therapy · doi:10.1016/j.brat.2016.11.008 · Cited by 355
Multiple Imputation of Missing Data for Multilevel Models: Simulations and Recommendations
Grund, S., Lüdtke, O., & Robitzsch, A. (2018) · Organizational Research Methods · doi:10.1177/1094428117703686 · Cited by 224
Enders, C. K., Mistler, S. A., & Keller, B. T. (2016) · Psychological Methods · doi:10.1037/met0000063 · Cited by 207
Review of recent methodological developments in group-randomized trials: part 2—analysis
Turner, E. L., Prague, M., Gallis, J. A., Li, F., & Murray, D. M. (2017) · American Journal of Public Health · doi:10.2105/ajph.2017.303707 · Cited by 195
Madill, R. A., Gest, S. D., & Rodkin, P. C. (2014) · School Psychology Review · doi:10.1080/02796015.2014.12087456 · Cited by 67
“Researchers often include dummy-coded classroom indicators as auxiliary variables in the imputation model to retain within-cluster similarity, but this approach may result in ICCs that are substantially larger than those in real life (Andridge, 2011).”
Background
Metadata
- Authors
- Andridge, R. R.
- Venue
- Biometrical Journal
- Publisher
- Wiley
- Published
- 2011-01-24
- Volume
- 53
- Issue
- 1
- Pages
- 57-74
- ISSN
- 0323-3847 (ISSN-L)
- OpenAlex
- W1976891556
- Cited by
- 89
- References
- 5
- FWCI
- 5.84
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.