Robustness Studies in Covariance Structure Modeling: An Overview and a Meta-Analysis
The DOI matches its Crossref record, with a small difference in title or year; 45 of the 45 references it cites were found in a registry or an index.
Abstract
In covariance structure modeling, several estimation methods are available. The robustness of an estimator against specific violations of assumptions can be determined empirically by means of a Monte Carlo study. Many such studies in covariance structure analysis have been published, but the conclusions frequently seem to contradict each other. An overview of robustness studies in covariance structure analysis is given, and an attempt is made to generalize findings. Robustness studies are described and distinguished from each other systematically by means of certain characteristics. These characteristics serve as explanatory variables in a meta-analysis concerning the behavior of parameter estimators, standard error estimators, and goodness-of-fit statistics when the model is correctly specified.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Testing Structural Equation Models.
Mueller, C. W., Bollen, K. A., & Long, J. S. (1994) · Contemporary Sociology · doi:10.2307/2074955 · Cited by 14,120
EQS : structural equations program manual
Bentler, P. M. (1989) · Medical Entomology and Zoology · Cited by 9,669
Curran, P. J., West, S. G., & Finch, J. F. (1996) · Psychological Methods · doi:10.1037/1082-989x.1.1.16 · Cited by 5,512
Structural equations with latent variables
(1989) · Choice Reviews Online · doi:10.5860/choice.27-0974 · Cited by 2,150
Anderson, J. C., & Gerbing, D. W. (1984) · Psychometrika · doi:10.1007/bf02294170 · Cited by 1,833
A comparison of some methodologies for the factor analysis of non‐normal Likert variables
Muthén, B., & Kaplan, D. (1985) · British Journal of Mathematical and Statistical Psychology · doi:10.1111/j.2044-8317.1985.tb00832.x · Cited by 1,778
Asymptotically distribution‐free methods for the analysis of covariance structures
Browne, M. W. (1984) · British Journal of Mathematical and Statistical Psychology · doi:10.1111/j.2044-8317.1984.tb00789.x · Cited by 1,768
Advanced Structural Equation Modeling: Issues and Techniques
Rigdon, E. E. (1998) · Applied Psychological Measurement · doi:10.1177/01466216980221008 · Cited by 1,631
Can test statistics in covariance structure analysis be trusted?
Hu, L., Bentler, P. M., & Kano, Y. (1992) · Psychological Bulletin · doi:10.1037//0033-2909.112.2.351 · Cited by 1,425
NON-NORMALITY AND TESTS ON VARIANCES
BOX, G. E. P. (1953) · Biometrika · doi:10.1093/biomet/40.3-4.318 · Cited by 1,302
Research works printed but not linked: 16
- Baldwin, Beatrice O. 1986. “The Effects of Structural Model Misspecification and Sample Size on the Robustness of LISREL Maximum Likelihood Parameter Estimates.” Ph.D. dissertation, Lousiana State University.
- Boomsma, Anne. 1983. “On the Robustness of LISREL (Maximum Likelihood Estimation) Against Small Sample Size and Non-Normality.” Ph.D. dissertation, Sociometric Research Foundation, Rijksuniversiteit Groningen, Amsterdam.
- Browne, Michael W., Topics in Multivariate Analysis, 72
- Browne, Michael W., SYSTAT for DOS: Advanced Applications, 163
- 10.1037/0033-2909.105.2.317 · doi:10.1037/0033-2909.105.2.317 · Paper page
- Harlow, Lisa L. 1985. “Behaviour of Some Elliptical Theory Estimators With Nonnormal Data in a Covariance Structures Framework: A Monte Carlo Study.” Ph.D. dissertation, University of California, Los Angeles.
- Harlow, Lisa L., Psychometric Society meeting
- 10.1037/0033-2909.112.2.351 · doi:10.1037/0033-2909.112.2.351 · Paper page
- 10.1037/0033-2909.117.2.348 · doi:10.1037/0033-2909.117.2.348 · Paper page
- 10.1037/0033-2909.96.1.201 · doi:10.1037/0033-2909.96.1.201 · Paper page
- Klein, Andreas, Advances in Statistical Software 6, 479
- Meijerink, Frits, A Nonlinear Structural Equations Model
- Sachs, Lothar, Angewandte Statistik (Applied Statistics)
- Satorra, Albert, “Scaling Corrections for Statistics in Covariance Structure Analysis.”
- Steiger, James H., STATISTICA 5.0, 283
- Tanaka, Jeffrey S. 1984. “Some Results on the Estimation of Covariance Structure Models.” Ph.D. dissertation, University of California, Los Angeles.
Cited by
Schermelleh-Engel, K., Moosbrugger, H., & Müller, H. (2003) · Department of Psychology - University of Koblenz-Landau · doi:10.23668/psycharchives.12784 · Cited by 8,975
Li, C.-H. (2016) · Behavior Research Methods · doi:10.3758/s13428-015-0619-7 · Cited by 3,031
Rhemtulla, M., Brosseau-Liard, P. É., & Savalei, V. (2012) · Psychological Methods · doi:10.1037/a0029315 · Cited by 2,816
“…free estimation method for continuous data (Browne, 1984) and similarly breaks down unless the sample size is very large (DiStefano, 2002; Dolan, 1994; Flora & Curran, 2004; Hoogland & Boomsma, 1998; Lei, 2009; Maydeu-Olivares, 2001; Potthast, 1993; Yang-Wallentin, Jöreskog, & Luo, 2010).”
MethodKyriazos, T. A. (2018) · Psychology · doi:10.4236/psych.2018.98126 · Cited by 1,882
“If the data is highly kurtotic an N: q > 10 was proposed (Wang & Wang, 2012 quoting Hoogland & Boomsma, 1998).”
BackgroundThe Analysis of Mechanisms and Their Contingencies: PROCESS versus Structural Equation Modeling
Hayes, A. F., Montoya, A. K., & Rockwood, N. J. (2017) · Australasian Marketing Journal · doi:10.1016/j.ausmj.2017.02.001 · Cited by 1,534
Metadata
- Authors
- HOOGLAND, J. J., & BOOMSMA, A.
- Affiliations
- University of Groningen (NL)
- Venue
- Sociological Methods & Research
- Publisher
- SAGE Publications
- Published
- 1998-02
- Volume
- 26
- Issue
- 3
- Pages
- 329-367
- ISSN
- 0049-1241 (ISSN-L)
- 1552-8294
- OpenAlex
- W2031595395
- Cited by
- 734
- References
- 45
- Citations by year
- 2026: 30 · 2025: 35 · 2024: 40 · 2023: 42 · 2022: 43 · 2021: 60 · 2020: 46 · 2019: 52 · 2018: 43 · 2017: 40 · 2016: 25 · 2015: 39 · 2014: 39 · 2013: 28 · 2012: 22
- FWCI
- 6.69
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
- Locations
- Sociological Methods & Research (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Topics
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Statistical Methods and Models
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Keywords
- robustness, structural equation modeling, estimator robustness, assumption violations, Monte Carlo simulation, parameter estimators, goodness-of-fit statistics, model misspecification
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Robustness Studies in Covariance Structure Modeling: An Overview and a Meta-Analysis. https://app.cochat.ai/papers/10.1177/0049124198026003003
- The paper
- HOOGLAND, J. J., & BOOMSMA, A. (1998). Robustness Studies in Covariance Structure Modeling: An Overview and a Meta-Analysis. Sociological Methods & Research. https://doi.org/10.1177/0049124198026003003
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.