Can test statistics in covariance structure analysis be trusted?

Abstract

Covariance structure analysis uses chi 2 goodness-of-fit test statistics whose adequacy is not known. Scientific conclusions based on models may be distorted when researchers violate sample size, variate independence, and distributional assumptions. The behavior of 6 test statistics is evaluated with a Monte Carlo confirmatory factor analysis study. The tests performed dramatically differently under 7 distributional conditions at 6 sample sizes. Two normal-theory tests worked well under some conditions but completely broke down under other conditions. A test that permits homogeneous nonzero kurtoses performed variably. A test that permits heterogeneous marginal kurtoses performed better. A distribution-free test performed spectacularly badly in all conditions at all but the largest sample sizes. The Satorra-Bentler scaled test statistic performed best overall.

Cites (1)

1. A comparison of some methodologies for the factor analysis of non‐normal Likert variables
   Muthén, Bengt, Kaplan, David · 1985 · British Journal of Mathematical and Statistical Psychology

Show all 1 references

Cited by (64)

1. Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives
   Hu, Li‐tze, Bentler, Peter M. · 1999 · Structural Equation Modeling A Multidisciplinary Journal
2. Fit indices in covariance structure modeling: Sensitivity to underparameterized model misspecification
   Hu, Li-tze, Bentler, Peter M. · 1998 · Psychological Methods
3. Evaluating the use of exploratory factor analysis in psychological research.
   Fabrigar, Leandre R., Wegener, Duane T., MacCallum, Robert C., Strahan, Erin J. · 1999 · Psychological Methods
4. Evaluating the Fit of Structural Equation Models: Tests of Significance and Descriptive Goodness-of-Fit Measures
   Schermelleh-Engel, Karin, Moosbrugger, Helfried, Müller, Hans · 2003 · Department of Psychology - University of Koblenz-Landau
5. Using Self-Report Assessment Methods to Explore Facets of Mindfulness
   Baer, Ruth A., Smith, Gregory T., Hopkins, Jaclyn, Krietemeyer, Jennifer, Toney, Leslie · 2006 · Assessment

See all 1,425