Bayesian methods for the analysis of small sample multilevel data with a complex variance structure.
The DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Abstract
Inferences from multilevel models can be complicated in small samples or complex data structures. When using (restricted) maximum likelihood methods to estimate multilevel models, standard errors and degrees of freedom often need to be adjusted to ensure that inferences for fixed effects are correct. These adjustments do not address problems in estimating variance/covariance components. An alternative to the adjusted likelihood method is to use Bayesian methods, which can produce accurate inferences about fixed effects and variance/covariance parameters. In this article, the authors contrast the benefits and limitations of likelihood and Bayesian methods in the estimation of multilevel models. The issues are discussed in the context of a partially clustered intervention study, a common intervention design that has been shown to require an adjusted likelihood analysis. The authors report a Monte Carlo study that compares the performance of an adjusted restricted maximum likelihood (REML) analysis to a Bayesian analysis. The results suggest that for fixed effects, the models perform equally well with respect to bias, efficiency, and coverage of interval estimates. Bayesian models with a carefully selected gamma prior for the variance components were more biased but also more efficient with respect to estimation of the variance components than the REML model. However, the results also show that the inferences about the variance components in partially clustered studies are sensitive to the prior distribution when sample sizes are small. Finally, the authors compare the results of a Bayesian and adjusted likelihood model using data from a partially clustered intervention trial.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Data Analysis Using Regression and Multilevel/Hierarchical Models
Gelman, A., & Hill, J. (2006) · doi:10.1017/cbo9780511790942 · Cited by 13,597
Small sample inference for fixed effects from restricted maximum likelihood
Kenward, M. G., & Roger, J. H. (1997) · Biometrics · doi:10.2307/2533558 · Cited by 4,552
An Approximate Distribution of Estimates of Variance Components
Satterthwaite, F. E. (1946) · Biometrics Bulletin · doi:10.2307/3002019 · Cited by 4,373
Why We (Usually) Don't Have to Worry About Multiple Comparisons
Gelman, A., Hill, J., & Yajima, M. (2012) · Journal of Research on Educational Effectiveness · doi:10.1080/19345747.2011.618213 · Cited by 1,274
Doing Bayesian Data Analysis: A Tutorial with R and BUGS
Barry, J. (2011) · Europe’s Journal of Psychology · doi:10.5964/ejop.v7i4.163 · Cited by 563
Bayesian perspectives for epidemiological research: I. Foundations and basic methods
Greenland, S. (2006) · International Journal of Epidemiology · doi:10.1093/ije/dyi312 · Cited by 383
Link, W. A., & Eaton, M. J. (2012) · Methods in Ecology and Evolution · doi:10.1111/j.2041-210x.2011.00131.x · Cited by 351
Design and analysis of clinical trials with clustering effects due to treatment
Roberts, C., & Roberts, S. A. (2005) · Clinical Trials · doi:10.1191/1740774505cn076oa · Cited by 299
Baldwin, S. A., Murray, D. M., & Shadish, W. R. (2005) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.73.5.924 · Cited by 209
Self-citationStice, E., Trost, A., & Chase, A. (2003) · International Journal of Eating Disorders · doi:10.1002/eat.10109 · Cited by 186
Beyond the individual: Group effects in mindfulness-based stress reduction
Imel, Z., Baldwin, S., Bonus, K., & MacCoon, D. (2008) · Psychotherapy Research · doi:10.1080/10503300802326038 · Cited by 119
Self-citation
Cited by
The Effect of Small Sample Size on Two-Level Model Estimates: A Review and Illustration
McNeish, D. M., & Stapleton, L. M. (2016) · Educational Psychology Review · doi:10.1007/s10648-014-9287-x · Cited by 715
On Using Bayesian Methods to Address Small Sample Problems
McNeish, D. (2016) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1080/10705511.2016.1186549 · Cited by 570
Modeling Clustered Data with Very Few Clusters
McNeish, D., & Stapleton, L. M. (2016) · Multivariate Behavioral Research · doi:10.1080/00273171.2016.1167008 · Cited by 430
A systematic review of Bayesian articles in psychology: The last 25 years.
van de Schoot, R., Winter, S. D., Ryan, O., Zondervan-Zwijnenburg, M., & Depaoli, S. (2017) · Psychological Methods · doi:10.1037/met0000100 · Cited by 374
McNeish, D., & Kelley, K. (2019) · Psychological Methods · doi:10.1037/met0000182 · Cited by 336
Metadata
- Authors
- Baldwin, S. A., & Fellingham, G. W.
- Venue
- Psychological Methods
- Published
- 2013
- Volume
- 18
- Issue
- 2
- Pages
- 151-164
- ISSN
- 1082-989X (ISSN-L)
- 1939-1463
- OpenAlex
- W2159532703
- Cited by
- 155
- References
- 11
- FWCI
- 3.90
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.