The DOI matches its Crossref record.
A comparison of some methodologies for the factor analysis of non‐normal Likert variables: A note on the size of the model
Abstract
This paper expands on a recent study by Muthen & Kaplan (1985) by examining the impact of non‐normal Likert variables on testing and estimation in factor analysis for models of various size. Normal theory GLS and the recently developed ADF estimator are compared for six cases of non‐normality, two sample sizes, and four models of increasing size in a Monte Carlo framework with a large number of replications. Results show that GLS and ADF chi‐square tests are increasingly sensitive to non‐normality when the size of the model increases. No parameter estimate bias was observed for GLS and only slight parameter bias was found for ADF. A downward bias in estimated standard errors was found for GLS which remains constant across model size. For ADF, a downward bias in estimated standard errors was also found which became increasingly worse with the size of the model.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cited by
Hu, L.-T., & Bentler, P. M. (1998) · Psychological Methods · doi:10.1037/1082-989x.3.4.424 · Cited by 12,298
Schermelleh-Engel, K., Moosbrugger, H., & Müller, H. (2003) · Department of Psychology - University of Koblenz-Landau · doi:10.23668/psycharchives.12784 · Cited by 8,975
Curran, P. J., West, S. G., & Finch, J. F. (1996) · Psychological Methods · doi:10.1037/1082-989x.1.1.16 · Cited by 5,512
Principles and practice in reporting structural equation analyses.
McDonald, R. P., & Ho, M.-H. R. (2002) · Psychological Methods · doi:10.1037/1082-989x.7.1.64 · Cited by 4,734
Flora, D. B., & Curran, P. J. (2004) · Psychological Methods · doi:10.1037/1082-989x.9.4.466 · Cited by 3,019
Li, C.-H. (2016) · Behavior Research Methods · doi:10.3758/s13428-015-0619-7 · Cited by 3,031
El análisis factorial exploratorio de los ítems: una guía práctica, revisada y actualizada
Lloret-Segura, S., Ferreres-Traver, A., Hernández-Baeza, A., & Tomás-Marco, I. (2014) · Anales de Psicología · doi:10.6018/analesps.30.3.199361 · Cited by 1,616
Complex Sample Data in Structural Equation Modeling
Muthen, B. O., & Satorra, A. (1995) · Sociological Methodology · doi:10.2307/271070 · Cited by 1,586
Can test statistics in covariance structure analysis be trusted?
Hu, L., Bentler, P. M., & Kano, Y. (1992) · Psychological Bulletin · doi:10.1037//0033-2909.112.2.351 · Cited by 1,425
Bandalos, D. L. (2002) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1207/s15328007sem0901_5 · Cited by 1,377
Structural Equation Modeling in Marketing: Some Practical Reminders
Chin, W. W., Peterson, R. A., & Brown, S. P. (2008) · Journal of Marketing Theory and Practice · doi:10.2753/mtp1069-6679160402 · Cited by 997
Russell, D. W. (2002) · Personality and Social Psychology Bulletin · doi:10.1177/014616702237645 · Cited by 954
“Unfortunately, this method requires relatively large samples (more than 1,000 cases) to derive accurate estimations of model fit (Curran, West, & Finch, 1996; Hu, Bentler, & Kano, 1992; Muthén & Kaplan, 1992).”
MethodEnders, C. K. (2001) · Psychological Methods · doi:10.1037/1082-989x.6.4.352 · Cited by 932
Item Parceling in Structural Equation Modeling: A Primer
Matsunaga, M. (2008) · Communication Methods and Measures · doi:10.1080/19312450802458935 · Cited by 931
Structural Equation Modeling: Strengths, Limitations, and Misconceptions
Tomarken, A. J., & Waller, N. G. (2005) · Annual Review of Clinical Psychology · doi:10.1146/annurev.clinpsy.1.102803.144239 · Cited by 882
Integrative data analysis: The simultaneous analysis of multiple data sets
Curran, P. J., & Hussong, A. M. (2009) · Psychological Methods · doi:10.1037/a0015914 · Cited by 867
Ding, L., Velicer, W. F., & Harlow, L. L. (1995) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1080/10705519509540000 · Cited by 789
Gregorich, S. E. (2006) · Medical Care · doi:10.1097/01.mlr.0000245454.12228.8f · Cited by 789
Analyzing ordinal data with metric models: What could possibly go wrong?
Liddell, T. M., & Kruschke, J. K. (2018) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2018.08.009 · Cited by 805
Robustness Studies in Covariance Structure Modeling: An Overview and a Meta-Analysis
HOOGLAND, J. J., & BOOMSMA, A. (1998) · Sociological Methods & Research · doi:10.1177/0049124198026003003 · Cited by 734
The Effect of Varying Degrees of Nonnormality in Structural Equation Modeling
Lei, M., & Lomax, R. G. (2005) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1207/s15328007sem1201_1 · Cited by 704
Factor Analysis with Ordinal Indicators: A Monte Carlo Study Comparing DWLS and ULS Estimation
Forero, C. G., Maydeu-Olivares, A., & Gallardo-Pujol, D. (2009) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1080/10705510903203573 · Cited by 685
“WLS is not considered because it is well established that it performs very poorly unless sample size is large and model size is small (Dolan, 1994; Flora & Curran, 2004; Muthén & Kaplan, 1992).”
BackgroundStructural Equation Modeling with Small Samples: Test Statistics
Bentler, P. M., & Yuan, K.-H. (1999) · Multivariate Behavioral Research · doi:10.1207/s15327906mb340203 · Cited by 624
Two-dimensional self-esteem: Theory and measurement
Tafarodi, R. W., & Swann, W. B. (2001) · Personality and Individual Differences · doi:10.1016/s0191-8869(00)00169-0 · Cited by 606
Structural Equation Modeling in Practice: Testing a Theory for Research Use
Johnson, K. W. (1999) · Journal of Social Service Research · doi:10.1300/j079v24n03_06 · Cited by 592
Mîndrilă, D. (2010) · International Journal for Digital Society · doi:10.20533/ijds.2040.2570.2010.0010 · Cited by 566
COVARIANCE STRUCTURE ANALYSIS: Statistical Practice, Theory, and Directions
Bentler, P. M., & Dudgeon, P. (1996) · Annual Review of Psychology · doi:10.1146/annurev.psych.47.1.563 · Cited by 566
Golino, H., Shi, D., Christensen, A. P., Garrido, L. E., Nieto, M. D., Sadana, R., Thiyagarajan, J. A., & Martinez-Molina, A. (2020) · Psychological Methods · doi:10.1037/met0000255 · Cited by 532
Structural equation modeling in medical research: a primer
Beran, T. N., & Violato, C. (2010) · BMC Research Notes · doi:10.1186/1756-0500-3-267 · Cited by 489
Coefficient Alpha: A Reliability Coefficient for the 21st Century?
Yang, Y., & Green, S. B. (2011) · Journal of Psychoeducational Assessment · doi:10.1177/0734282911406668 · Cited by 479
Rogers, W. M., & Schmitt, N. (2004) · Multivariate Behavioral Research · doi:10.1207/s15327906mbr3903_1 · Cited by 390
Testing differences between nested covariance structure models: Power analysis and null hypotheses.
MacCallum, R. C., Browne, M. W., & Cai, L. (2006) · Psychological Methods · doi:10.1037/1082-989x.11.1.19 · Cited by 385
Bandalos, D. L. (2014) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1080/10705511.2014.859510 · Cited by 381
“…quite consistent across parameter types and models, with one exception: Overall standard error bias for the WLS estimator was approximately 20% to 30% lower for the small than for the large CFA and structural models, demonstrating the sensitivity to model size noted by Muthén and Kaplan (1992).”
BackgroundMethodHave Multilevel Models Been Structural Equation Models All Along?
Curran, P. J. (2003) · Multivariate Behavioral Research · doi:10.1207/s15327906mbr3804_5 · Cited by 381
Assessing Fit in Ordinal Factor Analysis Models: SRMR vs. RMSEA
Shi, D., Maydeu-Olivares, A., & Rosseel, Y. (2020) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1080/10705511.2019.1611434 · Cited by 380
An Alternative Two Stage Least Squares (2SLS) Estimator for Latent Variable Equations
Bollen, K. A. (1996) · Psychometrika · doi:10.1007/bf02296961 · Cited by 364
De Corte, K., Buysse, A., Verhofstadt, L. L., Roeyers, H., Ponnet, K., & Davis, M. H. (2007) · Psychologica Belgica · doi:10.5334/pb-47-4-235 · Cited by 349
Monte Carlo Experiments: Design and Implementation
Paxton, P., Curran, P. J., Bollen, K. A., Kirby, J., & Chen, F. (2001) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1207/s15328007sem0802_7 · Cited by 344
The Development and Validation of the Game User Experience Satisfaction Scale (GUESS)
Phan, M. H., Keebler, J. R., & Chaparro, B. S. (2016) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720816669646 · Cited by 342
The Development of a Measure of Engineering Identity
Godwin, A. (2016) · 2016 ASEE Annual Conference & Exposition Proceedings · doi:10.18260/p.26122 · Cited by 335
Confirmatory Factor Analysis of Ordinal Variables With Misspecified Models
Yang-Wallentin, F., Joreskog, K., & Luo, H. (2010) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1080/10705511.2010.489003 · Cited by 307
Giromini, L., Velotti, P., de Campora, G., Bonalume, L., & Cesare Zavattini, G. (2012) · Journal of Clinical Psychology · doi:10.1002/jclp.21876 · Cited by 301
Homburg, C., Grozdanovic, M., & Klarmann, M. (2007) · Journal of Marketing · doi:10.1509/jmkg.71.3.018 · Cited by 300
A factor-analytic study of the Social Problem-Solving Inventory: An integration of theory and data
Maydeu-Olivares, A., & D'Zurilla, T. J. (1996) · Cognitive Therapy and Research · doi:10.1007/bf02228030 · Cited by 277
The Impact of Categorization With Confirmatory Factor Analysis
DiStefano, C. (2002) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1207/s15328007sem0903_2 · Cited by 276
Measurement Properties of the Communities That Care� Youth Survey Across Demographic Groups
Glaser, R. R., Horn, M. L. V., Arthur, M. W., Hawkins, J. D., & Catalano, R. F. (2005) · Journal of Quantitative Criminology · doi:10.1007/s10940-004-1788-1 · Cited by 272
Hung, K., & Petrick, J. F. (2011) · Tourism Management · doi:10.1016/j.tourman.2010.03.008 · Cited by 272
Basic Psychological Need Satisfaction in Leisure Activities and Adolescents’ Life Satisfaction
Leversen, I., Danielsen, A. G., Birkeland, M. S., & Samdal, O. (2012) · Journal of Youth and Adolescence · doi:10.1007/s10964-012-9776-5 · Cited by 254
Bernaards, C. A., & Sijtsma, K. (2000) · Multivariate Behavioral Research · doi:10.1207/s15327906mbr3503_03 · Cited by 177
Curran, P. J., Bollen, K. A., Paxton, P., Kirby, J., & Chen, F. (2002) · Multivariate Behavioral Research · doi:10.1207/s15327906mbr3701_01 · Cited by 137
Heflin, C., Sandberg, J., & Rafail, P. (2009) · Social Problems · doi:10.1525/sp.2009.56.4.746 · Cited by 131
Montero-Marin, J., Tops, M., Manzanera, R., Piva Demarzo, M. M., Álvarez de Mon, M., & García-Campayo, J. (2015) · Frontiers in Psychology · doi:10.3389/fpsyg.2015.01895 · Cited by 120
“Polychoric correlation matrices (Olsson, 1979) with regard to the MAAS, CD-RISC, PANAS, and BCSQ items were calculated because of the item distributions (Muthen and Kaplan, 1992).”
MethodMontero-Marin, J., Zubiaga, F., Cereceda, M., Piva Demarzo, M. M., Trenc, P., & Garcia-Campayo, J. (2016) · PLOS ONE · doi:10.1371/journal.pone.0157499 · Cited by 110
Soler Sánchez, M. I., Meseguer de Pedro, M., & García Izquierdo, M. (2016) · Revista Latinoamericana de Psicología · doi:10.1016/j.rlp.2015.09.002 · Cited by 70
Montero-Marín, J., Gaete, J., Demarzo, M., Rodero, B., Lopez, L. C. S., & García-Campayo, J. (2016) · Frontiers in Psychology · doi:10.3389/fpsyg.2016.01281 · Cited by 66
Asensio-Martínez, Á., Masluk, B., Montero-Marin, J., Olivan-Blázquez, B., Navarro-Gil, M. T., García-Campayo, J., & Magallón-Botaya, R. (2019) · PLOS ONE · doi:10.1371/journal.pone.0214503 · Cited by 45
A Twin Study on Perceived Stress, Depressive Symptoms, and Marriage
Beam, C. R., Dinescu, D., Emery, R., & Turkheimer, E. (2017) · Journal of Health and Social Behavior · doi:10.1177/0022146516688242 · Cited by 39
Problematic Social Network Use: Structure and Assessment
González-Nuevo, C., Cuesta, M., Postigo, Á., Menéndez-Aller, Á., & Muñiz, J. (2023) · International Journal of Mental Health and Addiction · doi:10.1007/s11469-021-00711-y · Cited by 22
Metadata
- Authors
- Muthen, B., & Kaplan, D.
- Venue
- British Journal of Mathematical and Statistical Psychology
- Publisher
- Wiley
- Published
- 1992-05
- Volume
- 45
- Issue
- 1
- Pages
- 19-30
- ISSN
- 0007-1102 (ISSN-L)
- 2044-8317
- OpenAlex
- W150374347
- Cited by
- 682
- References
- 0
- FWCI
- 7.93
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.