Model Fit and Item Factor Analysis: Overfactoring, Underfactoring, and a Program to Guide Interpretation
The DOI matches its Crossref record; 49 of the 50 references it cites were found in a registry or an index.
Abstract
In exploratory item factor analysis (IFA), researchers may use model fit statistics and commonly invoked fit thresholds to help determine the dimensionality of an assessment. However, these indices and thresholds may mislead as they were developed in a confirmatory framework for models with continuous, not categorical, indicators. The present study used Monte Carlo simulation methods to investigate the ability of popular model fit statistics (chi-square, root mean square error of approximation, the comparative fit index, and the Tucker-Lewis index) and their standard cutoff values to detect the optimal number of latent dimensions underlying sets of dichotomous items. Models were fit to data generated from three-factor population structures that varied in factor loading magnitude, factor intercorrelation magnitude, number of indicators, and whether cross loadings or minor factors were included. The effectiveness of the thresholds varied across fit statistics, and was conditional on many features of the underlying model. Together, results suggest that conventional fit thresholds offer questionable utility in the context of IFA.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The factor loadings were generally acceptable since they were all greater than 0.50 [60]. The emotional exhaustion domain showed strong factors loading with values ranging between 0.74 and 0.87. For depersonalization, the lowest factor loading was 0.73 with the highest factor loading being 0.83. The items for personal accomplishment demonstrated strong factor loadings on their respective factors”
Citations
Cites
Hu, L., & Bentler, P. M. (1999) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1080/10705519909540118 · Cited by 108,788
Testing Structural Equation Models.
Mueller, C. W., Bollen, K. A., & Long, J. S. (1994) · Contemporary Sociology · doi:10.2307/2074955 · Cited by 14,120
The Scree Test For The Number Of Factors
Cattell, R. B. (1966) · Multivariate Behavioral Research · doi:10.1207/s15327906mbr0102_10 · Cited by 13,554
The application of electronic computers to factor analysis
Kaiser, H. F. (1960) · Educational and Psychological Measurement · doi:10.1177/001316446002000116 · Cited by 12,459
Sensitivity of Goodness of Fit Indexes to Lack of Measurement Invariance
Chen, F. F. (2007) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1080/10705510701301834 · Cited by 12,217
A Rationale and Test for the Number of Factors in Factor Analysis
Horn, J. L. (1965) · Psychometrika · doi:10.1007/bf02289447 · Cited by 8,714 · cited 1×
“A more advanced technique, parallel analysis, involves comparing the actual eigenvalues to a plot of eigenvalues generated from random data with the same number of observations and items as the actual data (Horn, 1965).”
MethodMarsh, H. W., Hau, K.-T., & Wen, Z. (2004) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1207/s15328007sem1103_2 · Cited by 6,691
Handbook of Structural Equation Modeling
Howard, A. L. (2013) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1080/10705511.2013.769397 · Cited by 3,440
Flora, D. B., & Curran, P. J. (2004) · Psychological Methods · doi:10.1037/1082-989x.9.4.466 · Cited by 3,019
The Performance of RMSEA in Models With Small Degrees of Freedom
Kenny, D. A., Kaniskan, B., & McCoach, D. B. (2015) · Sociological Methods & Research · doi:10.1177/0049124114543236 · Cited by 2,841
Research works printed but not linked: 22
- 10.1080/105510801922340 · doi:10.1080/105510801922340
- 10.1080/1075511.2014.934850 · doi:10.1080/1075511.2014.934850
- Beauducel, A. (2001). On the generalizability of factors: The influence of changing contexts of variables on different methods of factor extraction. Methods of Psychological Research Online, 6(1), 69–96.
- 10.1207/s15328007sem13022 · doi:10.1207/s15328007sem13022
- 10.1207/s15328007sem12013 · doi:10.1207/s15328007sem12013
- Brown, T. A. (2006). Confirmatory factor analysis for applied researchers. New York, NY: The Guilford Press.
- 10.1207/S15328007SEM09025 · doi:10.1207/s15328007sem09025
- Edwards, M. C., Wirth, R. J., Houts, C. R., & Xi, N. (2012). Categorical data in the structural equation modeling framework. In Handbook of structural equation modeling (pp. 289–311). New York, NY: The Guilford Press.
- 10.1207/s15328007sem12031 · doi:10.1207/s15328007sem12031
- Goldberg, L. R., & Velicer, W. F. (2006). Principles of exploratory factor analysis. In S. Strack (Ed.), Differentiating normal and abnormal personality: Second edition (pp. 1–31). New York, NY: Springer.
- 10.1207/S15328007SEM10031 · doi:10.1207/s15328007sem10031
- 10.1207/s15327906mbr33021 · doi:10.1207/s15327906mbr33021
- 10.101037/0021-9010.93.3.568 · doi:10.101037/0021-9010.93.3.568
- Muthen, B. O. (1993). Goodness of fit with categorical and other nonnormal variables. In K. A. Bollen & J. S. Long (Eds.), Testing structural equation models (pp. 205–234). Newbury Park, CA: SAGE Punblications, Inc.
- Muthen, L. K., & Muthen, B. O. (1998–2015). Mplus user's guide. Seventh Edition. Los Angeles, CA: Muthen & Muthen.
- R Core Team. (2016). R: A language and environment for statistical computing. (3.3.1) [computer program]. Vienna, Austria: R Foundation for Statistical Computing.
- Reise, S. P., Cook, K. F., & Moore, T. M. (2015). Evaluating the impact of multidimensionality on unidimensional item response theory model parameters. In S. P. Reise & D. A. Revicki (Eds.) Handbook of item response theory modeling (pp. 13–40). New York, NY: Taylor & Francis.
- Shin, H. C. (2013). Weighted least squares estimation with sampling weights. Journal of Mathematics and Statistics.
- West, S. G., Taylor, A. B., & Wu, W. (2012). Model fit and model selection in structural equation modeling. In Handbook of structural equation modeling (pp. 209–231). New York, NY: The Guilford Press.
- 10.1037/1082-989X.12.1.58 · DOI · Paper page
- Wothke, W. (1993). Nonpositive definite matrices in structural modeling. In K. A. Bollen & J. S. Long (Eds.), Testing structural equation models (pp. 256–293). Newbury Park, CA: SAGE Publications.
- 10.1207/s15327906mbr4001 · doi:10.1207/s15327906mbr4001
Cited by
Finch, W. H. (2020) · Educational and Psychological Measurement · doi:10.1177/0013164419865769 · Cited by 248
Montoya, A. K., & Edwards, M. C. (2020) · Educational and Psychological Measurement · doi:10.1177/0013164420942899 · Cited by 194
“Clark and Bowles (2018) found similar results with dichotomous data and tetrachoric correlations, suggesting the model fit indices were not well suited to select number of factors.”
BackgroundMethodResultInfluentialSwami, V., Todd, J., & Barron, D. S. (2021) · Body Image · doi:10.1016/j.bodyim.2021.03.002 · Cited by 109
Golino, H. F., Moulder, R. G., Jr., Shi, D., Christensen, A. P., Garrido, L. E., Nieto, M. D., Nesselroade, J. R., Sadana, R., Thiyagarajan, J. A., & Boker, S. M. (2020) · Multivariate Behavioral Research · doi:10.1080/00273171.2020.1779642 · Cited by 128
Effects of Cross-loadings on Determining the Number of Factors to Retain
Li, Y., Wen, Z., Hau, K., Yuan, K., & Peng, Y. (2020) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1080/10705511.2020.1745075 · Cited by 111
Metadata
- Authors
- Clark, D. A., & Bowles, R. P.
- Affiliations
- Michigan State University (US)
- Corresponding author
- Clark, D. Angus
- ORCID
- Bowles, Ryan P.
- Venue
- Multivariate Behavioral Research
- Publisher
- Informa UK Limited
- Published
- 2018-04-23
- Volume
- 53
- Issue
- 4
- Pages
- 544-558
- ISSN
- 0027-3171 (ISSN-L)
- 1532-7906
- OpenAlex
- W2781180134
- Cited by
- 134
- References
- 50
- Citations by year
- 2026: 26 · 2025: 29 · 2024: 23 · 2023: 20 · 2022: 15 · 2021: 10 · 2020: 8 · 2019: 3
- FWCI
- 4.18
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Multivariate Behavioral Research (publishedVersion)
- PubMed (publishedVersion)
- OSF Preprints (OSF Preprints) (submittedVersion)
- Funders
- Institute of Education Sciences (R305A110293, R324A150063)
- Topics
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Mental Health Research Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Keywords
- model fit statistics, overfitting, underfitting, dimensionality, dichotomous items, categorical indicators, chi-square, RMSEA, CFI, thallium iodide, cross-loadings, Monte Carlo simulation
- MeSH terms
- Computer Simulation, Data Interpretation, Statistical, Factor Analysis, Statistical, Humans, Monte Carlo Method, Models, Statistical
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Model Fit and Item Factor Analysis: Overfactoring, Underfactoring, and a Program to Guide Interpretation. https://app.cochat.ai/papers/10.1080/00273171.2018.1461058
- The paper
- Clark, D. A., & Bowles, R. P. (2018). Model Fit and Item Factor Analysis: Overfactoring, Underfactoring, and a Program to Guide Interpretation. Multivariate Behavioral Research. https://doi.org/10.1080/00273171.2018.1461058
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.