Evaluating models for partially clustered designs.
Open accessThe DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.
Abstract
Partially clustered designs, where clustering occurs in some conditions and not others, are common in psychology, particularly in prevention and intervention trials. This article reports results from a simulation comparing 5 approaches to analyzing partially clustered data, including Type I errors, parameter bias, efficiency, and power. Results indicate that multilevel models adapted for partially clustered data are relatively unbiased and efficient and consistently maintain the nominal Type I error rate when using appropriate degrees of freedom. To attain sufficient power in partially clustered designs, researchers should attend primarily to the number of clusters in the study. An illustration using data from a partially clustered eating disorder prevention trial is provided.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Small sample inference for fixed effects from restricted maximum likelihood
Kenward, M. G., & Roger, J. H. (1997) · Biometrics · doi:10.2307/2533558 · Cited by 4,552 · cited 1×
“…of freedom in multilevel models: (a) the between-within method, (b) the Satterthwaite (1946) approximation, and (c) the Kenward-Roger method (Kenward & Roger, 1997).1 The between-within method is based on a loose analogy to repeated measures ANOVA and separates the degrees of freedom into…”
An Approximate Distribution of Estimates of Variance Components
Satterthwaite, F. E. (1946) · Biometrics Bulletin · doi:10.2307/3002019 · Cited by 4,373 · cited 1×
“Power (y-axis) for tests of the intervention effect for multilevel models using the Satterthwaite (1946) method for computing degrees of freedom.”
Stice, E. (2001) · Journal of Abnormal Psychology · doi:10.1037/0021-843x.110.1.124 · Cited by 1,251 · cited 2×
“To illustrate the multilevel model for partially clustered data, we reanalyzed data from Stice, Shaw, Burton, and Wade (2006), which evaluated the Body Project, a dissonance-based eating disorder prevention intervention.”
Self-citationUsing SAS PROC MIXED to Fit Multilevel Models, Hierarchical Models, and Individual Growth Models
Singer, J. D. (1998) · Journal of Educational and Behavioral Statistics · doi:10.2307/1165280 · Cited by 1,092
Efficacy of the third wave of behavioral therapies: A systematic review and meta- analysis
Öst, L.-G. (2008) · Behaviour Research and Therapy · doi:10.1016/j.brat.2007.12.005 · Cited by 727
Design and analysis of clinical trials with clustering effects due to treatment
Roberts, C., & Roberts, S. A. (2005) · Clinical Trials · doi:10.1191/1740774505cn076oa · Cited by 299 · cited 8×
“Five papers have documented methods for estimating intervention effects in partially clustered designs (Bauer et al., 2008; Hoover, 2002; Lee & Thompson, 2005; Myers, DiCecco, & Lorch, 1981; Roberts & Roberts, 2005).”
InfluentialBaldwin, S. A., Murray, D. M., & Shadish, W. R. (2005) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.73.5.924 · Cited by 209
Self-citationBeck, J. G., Coffey, S. F., Foy, D. W., Keane, T. M., & Blanchard, E. B. (2009) · Behavior Therapy · doi:10.1016/j.beth.2008.01.003 · Cited by 132
Beyond the individual: Group effects in mindfulness-based stress reduction
Imel, Z., Baldwin, S., Bonus, K., & MacCoon, D. (2008) · Psychotherapy Research · doi:10.1080/10503300802326038 · Cited by 119
Self-citationSample size formulae for trials comparing group and individual treatments in a multilevel model
Moerbeek, M., & Wong, W. K. (2008) · Statistics in Medicine · doi:10.1002/sim.3115 · Cited by 92
Cited by
Review of recent methodological developments in group-randomized trials: part 2—analysis
Turner, E. L., Prague, M., Gallis, J. A., Li, F., & Murray, D. M. (2017) · American Journal of Public Health · doi:10.2105/ajph.2017.303707 · Cited by 195
Circle of Security–Parenting: A randomized controlled trial in Head Start
Cassidy, J., Brett, B. E., Gross, J. T., Stern, J. A., Martin, D. R., Mohr, J. J., & Woodhouse, S. S. (2017) · Development and Psychopathology · doi:10.1017/s0954579417000244 · Cited by 167
Analyzing multiple outcomes in clinical research using multivariate multilevel models.
Baldwin, S. A., Imel, Z. E., Braithwaite, S. R., & Atkins, D. C. (2014) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0035628 · Cited by 167
Self-citationWergeland, G. J. H., Fjermestad, K. W., Marin, C. E., Haugland, B. S.-M., Bjaastad, J. F., Oeding, K., Bjelland, I., Silverman, W. K., Öst, L.-G., Havik, O. E., et al. (2014) · Behaviour Research and Therapy · doi:10.1016/j.brat.2014.03.007 · Cited by 163
Long-term effectiveness of cognitive behavioral therapy for youth with anxiety disorders
Kodal, A., Fjermestad, K., Bjelland, I., Gjestad, R., Öst, L.-G., Bjaastad, J. F., Haugland, B. S. M., Havik, O. E., Heiervang, E., & Wergeland, G. J. (2018) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2017.11.003 · Cited by 118
Metadata
- Authors
- Baldwin, S. A., Bauer, D. J., Stice, E., & Rohde, P.
- Venue
- Psychological Methods
- Published
- 2011
- Volume
- 16
- Issue
- 2
- Pages
- 149-165
- ISSN
- 1082-989X (ISSN-L)
- 1939-1463
- OpenAlex
- W2086733802
- Cited by
- 122
- References
- 10
- FWCI
- 3.34
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.