Sensitivity of Goodness of Fit Indexes to Lack of Measurement Invariance
The DOI matches its Crossref record; 40 of the 40 references it cites were found in a registry or an index.
Abstract
Two Monte Carlo studies were conducted to examine the sensitivity of goodness of fit indexes to lack of measurement invariance at 3 commonly tested levels: factor loadings, intercepts, and residual variances. Standardized root mean square residual (SRMR) appears to be more sensitive to lack of invariance in factor loadings than in intercepts or residual variances. Comparative fit index (CFI) and root mean square error of approximation (RMSEA) appear to be equally sensitive to all 3 types of lack of invariance. The most intriguing finding is that changes in fit statistics are affected by the interaction between the pattern of invariance and the proportion of invariant items: when the pattern of lack of invariance is uniform, the relation is nonmonotonic, whereas when the pattern of lack of invariance is mixed, the relation is monotonic. Unequal sample sizes affect changes across all 3 levels of invariance: Changes are bigger when sample sizes are equal rather than when they are unequal. Cutoff points for testing invariance at different levels are recommended.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Changes in CFI greater than − 0.01 and in RMSEA greater than 0.015 were considered a meaningful decrease in model fit67.”
From Adolescent leisure reading and its longitudinal association with prosocial behavior and social adjustment (2023) · cites this paper as [67]
In the citing paper
“Evidence of invariance was determined based on changes in fit indices: ΔCFI ≤ 0.010 and ΔRMSEA ≤ 0.015 [64, 65].”
From Psychometric validation and measurement invariance of the Health-Promoting Lifestyle Profile II in Honduran university students (2025) · cites this paper as [65]
In the citing paper
“An increase in the root mean square error of approximation (RMSEA) exceeding 0.01 suggests non-invariance and leads us to reject the model (Cheung and Rensvold, 2002; Chen, 2007).”
In the citing paper
“Changes in model fit (ΔCFI = .016, ΔRMSEA = −.011, ΔSRMR = .007) did not support metric invariance using suggested cut-offs of .005 in ΔCFI, .01 for ΔRMSEA, and .025 for ΔSRMR for metric invariance (Chen, 2007).”
From Measuring Decentering – Development and Validation of the French Version of the Experiences Questionnaire (EQ-F) (2024) · cites this paper as Chen, 2007
In the citing paper
“The results indicated that the Configural invariance model, the metric invariance model, the scalar invariance model, and the strict invariance model were reliable cross-gender (Cheung and Rensvold, 2002; Chen, 2007).”
From Measuring self-as-context in Chinese college students: Validity and reliability of the Chinese version of self-as-context scale (C-SACS) (2022) · cites this paper as Chen, 2007
3 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Hu, L., & Bentler, P. M. (1999) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1080/10705519909540118 · Cited by 108,788
Tabachnick, B. G., & Fidell, L. S. (1983) · Cited by 80,042
Alternative Ways of Assessing Model Fit
Browne, M. W., & Cudeck, R. (1992) · Sociological Methods & Research · doi:10.1177/0049124192021002005 · Cited by 27,200
Comparative fit indexes in structural models.
Bentler, P. M. (1990) · Psychological Bulletin · doi:10.1037/0033-2909.107.2.238 · Cited by 25,266
Structural Equations with Latent Variables.
Clogg, C. C., & Bollen, K. A. (1991) · Contemporary Sociology · doi:10.2307/2072165 · Cited by 17,442
Structural Equations with Latent Variables
Bollen, K. A. (1989) · Wiley series in probability and statistics · doi:10.1002/9781118619179 · Cited by 17,277
Evaluating Goodness-of-Fit Indexes for Testing Measurement Invariance
Cheung, G. W., & Rensvold, R. B. (2002) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1207/s15328007sem0902_5 · Cited by 16,280
Testing Structural Equation Models.
Mueller, C. W., Bollen, K. A., & Long, J. S. (1994) · Contemporary Sociology · doi:10.2307/2074955 · Cited by 14,120
Hu, L.-T., & Bentler, P. M. (1998) · Psychological Methods · doi:10.1037/1082-989x.3.4.424 · Cited by 12,298
EQS : structural equations program manual
Bentler, P. M. (1989) · Medical Entomology and Zoology · Cited by 9,669
Research works printed but not linked: 11
- Bollen K. A., 1983, Testing structural equation models
- Chen F. F., 2007, The Impact of making inappropriate comparisons in cross-cultural research
- Chen F. F., Journal of Research in Personality
- Horn J. L., 1983, Southern Psychologist, 4, 179
- Jöreskog K. G., 1999, LISREL 8: User's reference guide (2nd ed.)
- 10.1037/0022-3514.73.5.1038 · doi:10.1037/0022-3514.73.5.1038 · Paper page
- 10.1037/0033-2909.103.3.391 · doi:10.1037/0033-2909.103.3.391 · Paper page
- 10.1037/0033-2909.107.2.247 · doi:10.1037/0033-2909.107.2.247 · Paper page
- Muthén L. K., 1998, Mplus user's guide
- Steiger J. H., 1989, EzPATH: A supplementary module for SYSTAT and SYGRAPH
- Steiger J. H., 1980, Paper presented at the annual meeting of the Psychometric Society
Cited by
Putnick, D. L., & Bornstein, M. H. (2016) · Developmental Review · doi:10.1016/j.dr.2016.06.004 · Cited by 4,369
“Overall, the Δχ2 was reported for 62.6% of tests, the change in CFI was reported for 73.2% of tests, and the change in another alternative fit index (e.g., ΔRMSEA, ΔTLI, ΔSRMR) was reported for 56.1% of tests.”
BackgroundMethodInfluentialThanks coefficient alpha, we’ll take it from here.
McNeish, D. (2018) · Psychological Methods · doi:10.1037/met0000144 · Cited by 2,533
Principles of Linguistic Change: Internal Factors
Labov, W. (1994) · Cited by 3,232
The Body Appreciation Scale-2: Item refinement and psychometric evaluation
Tylka, T. L., & Wood-Barcalow, N. L. (2015) · Body Image · doi:10.1016/j.bodyim.2014.09.006 · Cited by 1,298
de Leeuw, A., Valois, P., Ajzen, I., & Schmidt, P. (2015) · Journal of Environmental Psychology · doi:10.1016/j.jenvp.2015.03.005 · Cited by 1,120
Metadata
- Authors
- Chen, F. F.
- Affiliations
- a Department of Psychology , University of Delaware
- Venue
- Structural Equation Modeling: A Multidisciplinary Journal
- Publisher
- Informa UK Limited
- Published
- 2007-07-31
- Volume
- 14
- Issue
- 3
- Pages
- 464-504
- ISSN
- 1070-5511 (ISSN-L)
- 1532-8007
- OpenAlex
- W2005532382
- Cited by
- 12,217
- References
- 40
- Citations by year
- 2026: 2137 · 2025: 1601 · 2024: 1351 · 2023: 1331 · 2022: 1170 · 2021: 1060 · 2020: 791 · 2019: 637 · 2018: 506 · 2017: 446 · 2016: 360 · 2015: 262 · 2014: 188 · 2013: 145 · 2012: 83
- FWCI
- 31.96
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Structural Equation Modeling A Multidisciplinary Journal (publishedVersion)
- The HKU Scholars Hub (University of Hong Kong) (submittedVersion)
- Funders
- University of North Carolina at Chapel Hill
- Topics
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Mental Health Research Topics
- Keywords
- measurement invariance, goodness of fit index, comparative fit index, RMSEA, factor loadings, intercepts, residual variance, sample size effects, non-monotonicity
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Sensitivity of Goodness of Fit Indexes to Lack of Measurement Invariance. https://app.cochat.ai/papers/10.1080/10705510701301834
- The paper
- Chen, F. F. (2007). Sensitivity of Goodness of Fit Indexes to Lack of Measurement Invariance. Structural Equation Modeling: A Multidisciplinary Journal. https://doi.org/10.1080/10705510701301834
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.