The DOI matches its Crossref record; 18 of the 18 references it cites were found in a registry or an index.
The effect of estimation method and sample size in multilevel structural equation modeling
Abstract
Multilevel structural equation modeling (multilevel SEM) has become an established method to analyze multilevel multivariate data. The first useful estimation method was the pseudobalanced method. This method is approximate because it assumes that all groups have the same size, and ignores unbalance when it exists. In addition, full information maximum likelihood (ML) estimation is now available, which is often combined with robust chi‐squares and standard errors to accommodate unmodeled heterogeneity (MLR). In addition, diagonally weighted least squares (DWLS) methods have become available as estimation methods. This article compares the pseudobalanced estimation method, ML(R), and two DWLS methods by simulating a multilevel factor model with unbalanced data. The simulations included different sample sizes at the individual and group levels and different intraclass correlation (ICC). The within‐group part of the model posed no problems. In the between part of the model, the different ICC sizes had no effect. There is a clear interaction effect between number of groups and estimation method. ML reaches unbiasedness fastest, then the two DWLS methods, then MLR, and then the pseudobalanced method (which needs more than 200 groups). We conclude that both ML(R) and DWLS are genuine improvements on the pseudobalanced approximation. With small sample sizes, the robust methods are not recommended.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Curran, P. J., West, S. G., & Finch, J. F. (1996) · Psychological Methods · doi:10.1037/1082-989x.1.1.16 · Cited by 5,512
Maximum Likelihood Estimation of Misspecified Models
White, H. (1982) · Econometrica · doi:10.2307/1912526 · Cited by 4,098
Hox, J., Moerbeek, M., & van de Schoot, R. (2002) · doi:10.4324/9781410604118 · Cited by 2,419
Self-citationMultilevel Covariance Structure Analysis
MUTHÉN, B. O. (1994) · Sociological Methods & Research · doi:10.1177/0049124194022003006 · Cited by 1,171
Latent Variable Modeling in Heterogeneous Populations
Muthén, B. O. (1989) · Psychometrika · doi:10.1007/bf02296397 · Cited by 1,008
Chou, C., Bentler, P. M., & Satorra, A. (1991) · British Journal of Mathematical and Statistical Psychology · doi:10.1111/j.2044-8317.1991.tb00966.x · Cited by 643
People are variables too: Multilevel structural equations modeling.
Mehta, P. D., & Neale, M. C. (2005) · Psychological Methods · doi:10.1037/1082-989x.10.3.259 · Cited by 467
The Accuracy of Multilevel Structural Equation Modeling With Pseudobalanced Groups and Small Samples
Hox, J. J., & Maas, C. J. M. (2001) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1207/s15328007sem0802_1 · Cited by 411
Self-citationMaas, C. J. M., & Hox, J. J. (2004) · Computational Statistics & Data Analysis · doi:10.1016/j.csda.2003.08.006 · Cited by 399
Self-citationA General Model for the Analysis of Multilevel Data
Goldstein, H., & McDonald, R. P. (1988) · Psychometrika · doi:10.1007/bf02294400 · Cited by 240
Cited by
Boer, M., Stevens, G., Finkenauer, C., & van den Eijnden, R. (2020) · Child Development · doi:10.1111/cdev.13334 · Cited by 157
Arens, A. K., Marsh, H. W., Pekrun, R., Lichtenfeld, S., Murayama, K., & vom Hofe, R. (2017) · Journal of Educational Psychology · doi:10.1037/edu0000163 · Cited by 140
Going Beyond Convergence in Bayesian Estimation: Why Precision Matters Too and How to Assess It
Zitzmann, S., & Hecht, M. (2019) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1080/10705511.2018.1545232 · Cited by 122
Thorson, K. R., West, T. V., & Mendes, W. B. (2018) · Psychological Methods · doi:10.1037/met0000166 · Cited by 106
Huhtala, M., Geurts, S., Mauno, S., & Feldt, T. (2021) · Journal of Advanced Nursing · doi:10.1111/jan.14861 · Cited by 98
Metadata
- Authors
- Hox, J. J., Maas, C. J. M., & Brinkhuis, M. J. S.
- Venue
- Statistica Neerlandica
- Publisher
- Wiley
- Published
- 2010-04-15
- Volume
- 64
- Issue
- 2
- Pages
- 157-170
- ISSN
- 0039-0402 (ISSN-L)
- 1467-9574
- OpenAlex
- W349982207
- Cited by
- 330
- References
- 18
- FWCI
- 2.19
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: The effect of estimation method and sample size in multilevel structural equation modeling. https://app.cochat.ai/papers/10.1111/j.1467-9574.2009.00445.x
- The paper
- Hox, J. J., Maas, C. J. M., & Brinkhuis, M. J. S. (2010). The effect of estimation method and sample size in multilevel structural equation modeling. Statistica Neerlandica. https://doi.org/10.1111/j.1467-9574.2009.00445.x
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.