Robustness Studies in Covariance Structure Modeling: An Overview and a Meta-Analysis
The DOI matches its Crossref record, with a small difference in title or year; 45 of the 45 references it cites were found in a registry or an index.
Abstract
In covariance structure modeling, several estimation methods are available. The robustness of an estimator against specific violations of assumptions can be determined empirically by means of a Monte Carlo study. Many such studies in covariance structure analysis have been published, but the conclusions frequently seem to contradict each other. An overview of robustness studies in covariance structure analysis is given, and an attempt is made to generalize findings. Robustness studies are described and distinguished from each other systematically by means of certain characteristics. These characteristics serve as explanatory variables in a meta-analysis concerning the behavior of parameter estimators, standard error estimators, and goodness-of-fit statistics when the model is correctly specified.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Testing Structural Equation Models.
Mueller, C. W., Bollen, K. A., & Long, J. S. (1994) · Contemporary Sociology · doi:10.2307/2074955 · Cited by 14,120
EQS : structural equations program manual
Bentler, P. M. (1989) · Medical Entomology and Zoology · Cited by 9,669
Curran, P. J., West, S. G., & Finch, J. F. (1996) · Psychological Methods · doi:10.1037/1082-989x.1.1.16 · Cited by 5,512
Structural equations with latent variables
(1989) · Choice Reviews Online · doi:10.5860/choice.27-0974 · Cited by 2,150
Anderson, J. C., & Gerbing, D. W. (1984) · Psychometrika · doi:10.1007/bf02294170 · Cited by 1,833
A comparison of some methodologies for the factor analysis of non‐normal Likert variables
Muthén, B., & Kaplan, D. (1985) · British Journal of Mathematical and Statistical Psychology · doi:10.1111/j.2044-8317.1985.tb00832.x · Cited by 1,778
Asymptotically distribution‐free methods for the analysis of covariance structures
Browne, M. W. (1984) · British Journal of Mathematical and Statistical Psychology · doi:10.1111/j.2044-8317.1984.tb00789.x · Cited by 1,768
Advanced Structural Equation Modeling: Issues and Techniques
Rigdon, E. E. (1998) · Applied Psychological Measurement · doi:10.1177/01466216980221008 · Cited by 1,631
Can test statistics in covariance structure analysis be trusted?
Hu, L., Bentler, P. M., & Kano, Y. (1992) · Psychological Bulletin · doi:10.1037//0033-2909.112.2.351 · Cited by 1,425
NON-NORMALITY AND TESTS ON VARIANCES
BOX, G. E. P. (1953) · Biometrika · doi:10.1093/biomet/40.3-4.318 · Cited by 1,302
Estimating the nonlinear and interactive effects of latent variables.
Kenny, D. A., & Judd, C. M. (1984) · Psychological Bulletin · doi:10.1037//0033-2909.96.1.201 · Cited by 938
Muthen, B., & Kaplan, D. (1992) · British Journal of Mathematical and Statistical Psychology · doi:10.1111/j.2044-8317.1992.tb00975.x · Cited by 682
Chou, C., Bentler, P. M., & Satorra, A. (1991) · British Journal of Mathematical and Statistical Psychology · doi:10.1111/j.2044-8317.1991.tb00966.x · Cited by 643
Analysis of correlation matrices using covariance structure models.
Cudeck, R. (1989) · Psychological Bulletin · doi:10.1037//0033-2909.105.2.317 · Cited by 567
COVARIANCE STRUCTURE ANALYSIS: Statistical Practice, Theory, and Directions
Bentler, P. M., & Dudgeon, P. (1996) · Annual Review of Psychology · doi:10.1146/annurev.psych.47.1.563 · Cited by 566
Linear Structural Equations with Latent Variables
Bentler, P. M., & Weeks, D. G. (1980) · Psychometrika · doi:10.1007/bf02293905 · Cited by 525
Sample Size Effects on Chi Square and Other Statistics Used in Evaluating Causal Models
Bearden, W. O., Sharma, S., & Teel, J. E. (1982) · Journal of Marketing Research · doi:10.2307/3151716 · Cited by 499
Simulating Multivariate Nonnormal Distributions
Vale, C. D., & Maurelli, V. A. (1983) · Psychometrika · doi:10.1007/bf02293687 · Cited by 446
Jaccard, J. J., & Wan, C. K. (1995) · Psychological Bulletin · doi:10.1037//0033-2909.117.2.348 · Cited by 444
South African Statistical Journal
(2022) · South African Statistical Journal · doi:10.37920/sasj · Cited by 439
Structural Equation Models in the Social Sciences
Coxon, T., Goldberger, A. S., & Duncan, O. D. (1974) · The British Journal of Sociology · doi:10.2307/590167 · Cited by 429
An Alternative Two Stage Least Squares (2SLS) Estimator for Latent Variable Equations
Bollen, K. A. (1996) · Psychometrika · doi:10.1007/bf02296961 · Cited by 364
Generalized least squares estimators in the analysis of covariance structures
Browne, M. W. (1974) · South African Statistical Journal · Cited by 358
Babakus, E., Ferguson, C. E., & Jöreskog, K. G. (1987) · Journal of Marketing Research · doi:10.1177/002224378702400209 · Cited by 304
Dolan, C. V. (1994) · British Journal of Mathematical and Statistical Psychology · doi:10.1111/j.2044-8317.1994.tb01039.x · Cited by 278
A Parsimonious Estimating Technique for Interaction and Quadratic Latent Variables
Ping, R. A. (1995) · Journal of Marketing Research · doi:10.2307/3151985 · Cited by 274
Gerbing, D. W., & Anderson, J. C. (1985) · Multivariate Behavioral Research · doi:10.1207/s15327906mbr2003_2 · Cited by 266
LISREL Issues, Debates and Strategies
Hayduk, L. (1996) · Johns Hopkins University Press eBooks · doi:10.56021/9780801853364 · Cited by 251
A two‐stage estimation of structural equation models with continuous and polytomous variables
Lee, S., Poon, W., & Bentler, P. M. (1995) · British Journal of Mathematical and Statistical Psychology · doi:10.1111/j.2044-8317.1995.tb01067.x · Cited by 247
On The Robustness Of Factor Analysis Against Crude Classification Of The Observations
Olsson, U. (1979) · Multivariate Behavioral Research · doi:10.1207/s15327906mbr1404_7 · Cited by 207
Sharma, S., Durvasula, S., & Dillon, W. R. (1989) · Journal of Marketing Research · doi:10.2307/3172607 · Cited by 173
Babakus, E., Ferguson, C. E., & Jöreskog, K. G. (1987) · Journal of Marketing Research · doi:10.2307/3151512 · Cited by 147
Structural Equation Models That are Nonlinear in Latent Variables: A Least-Squares Estimator
Bollen, K. A. (1995) · Sociological Methodology · doi:10.2307/271068 · Cited by 110
Bootstrap‐corrected ADF test statistics in covariance structure analysis
Yung, Y., & Bentler, P. M. (1994) · British Journal of Mathematical and Statistical Psychology · doi:10.1111/j.2044-8317.1994.tb01025.x · Cited by 104
Benson, J., & Fleishman, J. A. (1994) · Quality & Quantity · doi:10.1007/bf01102757 · Cited by 103
Effects of Ignoring Correlated Measurement Error in Structural Equation Models
Reddy, S. K. (1992) · Educational and Psychological Measurement · doi:10.1177/0013164492052003005 · Cited by 91
Confirmatory factor analysis of ordered categorical variables with large models
Potthast, M. J. (1993) · British Journal of Mathematical and Statistical Psychology · doi:10.1111/j.2044-8317.1993.tb01016.x · Cited by 72
Kaplan, D. (1989) · Multivariate Behavioral Research · doi:10.1207/s15327906mbr2401_3 · Cited by 72
Limited Information Parameter Estimates for Latent or Mixed Manifest and Latent Variable Models
Lance, C. E., Cornwell, J. M., & Mulaik, S. A. (1988) · Multivariate Behavioral Research · doi:10.1207/s15327906mbr2302_3 · Cited by 46
Robustness of some estimators for the analysis of covariance structures
Henly, S. J. (1993) · British Journal of Mathematical and Statistical Psychology · doi:10.1111/j.2044-8317.1993.tb01019.x · Cited by 31
Causal Models in the Social Sciences
(2017) · Routledge eBooks · doi:10.4324/9781315081663 · Cited by 26
Non-linear structural equation models : simulation studies of the Kenny-Judd model
Jonsson, F. Y. (1997) · Acta Universitatis Upsaliensis eBooks · Cited by 22
The Robustness of LISREL Estimates in Structural Equation Models with Categorical Variables
Ethington, C. A. (1987) · The Journal of Experimental Education · doi:10.1080/00220973.1987.10806438 · Cited by 16
The Robustness of 2SLS Estimation of a Non-normally Distributed Confirmatory Factor Analysis Model
Brown, R. (1990) · Multivariate Behavioral Research · doi:10.1207/s15327906mbr2504_3 · Cited by 14
Gallini, J. K., & Mandeville, G. K. (1984) · The Journal of Experimental Education · doi:10.1080/00220973.1984.10806357 · Cited by 11
Research works printed but not linked: 16
- Baldwin, Beatrice O. 1986. “The Effects of Structural Model Misspecification and Sample Size on the Robustness of LISREL Maximum Likelihood Parameter Estimates.” Ph.D. dissertation, Lousiana State University.
- Boomsma, Anne. 1983. “On the Robustness of LISREL (Maximum Likelihood Estimation) Against Small Sample Size and Non-Normality.” Ph.D. dissertation, Sociometric Research Foundation, Rijksuniversiteit Groningen, Amsterdam.
- Browne, Michael W., Topics in Multivariate Analysis, 72
- Browne, Michael W., SYSTAT for DOS: Advanced Applications, 163
- 10.1037/0033-2909.105.2.317 · doi:10.1037/0033-2909.105.2.317 · Paper page
- Harlow, Lisa L. 1985. “Behaviour of Some Elliptical Theory Estimators With Nonnormal Data in a Covariance Structures Framework: A Monte Carlo Study.” Ph.D. dissertation, University of California, Los Angeles.
- Harlow, Lisa L., Psychometric Society meeting
- 10.1037/0033-2909.112.2.351 · doi:10.1037/0033-2909.112.2.351 · Paper page
- 10.1037/0033-2909.117.2.348 · doi:10.1037/0033-2909.117.2.348 · Paper page
- 10.1037/0033-2909.96.1.201 · doi:10.1037/0033-2909.96.1.201 · Paper page
- Klein, Andreas, Advances in Statistical Software 6, 479
- Meijerink, Frits, A Nonlinear Structural Equations Model
- Sachs, Lothar, Angewandte Statistik (Applied Statistics)
- Satorra, Albert, “Scaling Corrections for Statistics in Covariance Structure Analysis.”
- Steiger, James H., STATISTICA 5.0, 283
- Tanaka, Jeffrey S. 1984. “Some Results on the Estimation of Covariance Structure Models.” Ph.D. dissertation, University of California, Los Angeles.
Cited by
Schermelleh-Engel, K., Moosbrugger, H., & Müller, H. (2003) · Department of Psychology - University of Koblenz-Landau · doi:10.23668/psycharchives.12784 · Cited by 8,975
Li, C.-H. (2016) · Behavior Research Methods · doi:10.3758/s13428-015-0619-7 · Cited by 3,031
Rhemtulla, M., Brosseau-Liard, P. É., & Savalei, V. (2012) · Psychological Methods · doi:10.1037/a0029315 · Cited by 2,816
“…free estimation method for continuous data (Browne, 1984) and similarly breaks down unless the sample size is very large (DiStefano, 2002; Dolan, 1994; Flora & Curran, 2004; Hoogland & Boomsma, 1998; Lei, 2009; Maydeu-Olivares, 2001; Potthast, 1993; Yang-Wallentin, Jöreskog, & Luo, 2010).”
MethodKyriazos, T. A. (2018) · Psychology · doi:10.4236/psych.2018.98126 · Cited by 1,882
“If the data is highly kurtotic an N: q > 10 was proposed (Wang & Wang, 2012 quoting Hoogland & Boomsma, 1998).”
BackgroundThe Analysis of Mechanisms and Their Contingencies: PROCESS versus Structural Equation Modeling
Hayes, A. F., Montoya, A. K., & Rockwood, N. J. (2017) · Australasian Marketing Journal · doi:10.1016/j.ausmj.2017.02.001 · Cited by 1,534
Metadata
- Authors
- HOOGLAND, J. J., & BOOMSMA, A.
- Affiliations
- University of Groningen (NL)
- Venue
- Sociological Methods & Research
- Publisher
- SAGE Publications
- Published
- 1998-02
- Volume
- 26
- Issue
- 3
- Pages
- 329-367
- ISSN
- 0049-1241 (ISSN-L)
- 1552-8294
- OpenAlex
- W2031595395
- Cited by
- 734
- References
- 45
- Citations by year
- 2026: 30 · 2025: 35 · 2024: 40 · 2023: 42 · 2022: 43 · 2021: 60 · 2020: 46 · 2019: 52 · 2018: 43 · 2017: 40 · 2016: 25 · 2015: 39 · 2014: 39 · 2013: 28 · 2012: 22
- FWCI
- 6.69
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
- Locations
- Sociological Methods & Research (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Topics
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Statistical Methods and Models
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Keywords
- robustness, structural equation modeling, estimator robustness, assumption violations, Monte Carlo simulation, parameter estimators, goodness-of-fit statistics, model misspecification
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.