A Monte-Carlo Study of Confirmatory Factor Analytic Tests of Measurement Equivalence/Invariance
The DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.
Abstract
In recent years, confirmatory factor analytic (CFA) techniques have become the most common method of testing for measurement equivalence/invariance (ME/I). However, no study has simulated data with known differences to determine how well these CFA techniques perform. This study utilizes data with a variety of known simulated differences in factor loadings to determine how well traditional tests of ME/I can detect these specific simulated differences. Results show that traditional CFA tests of ME/I perform well under ideal situations but that large sample sizes, a sufficient number of manifest indicators, and at least moderate communalities are crucial for assurance that ME/I conditions exist.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hu, L.-T., & Bentler, P. M. (1998) · Psychological Methods · doi:10.1037/1082-989x.3.4.424 · Cited by 12,298
Vandenberg, R. J., & Lance, C. E. (2000) · Organizational Research Methods · doi:10.1177/109442810031002 · Cited by 7,997 · cited 7×
“Vandenberg and Lance (2000) conducted a thorough review of the ME/I literature of CFA-based procedures and based on this review, they identified several tests of ME/I that have been used in past studies and recommended several “best practices” for testing for ME/I based on the works of Jöreskog…”
BackgroundMethodInfluentialSample size in factor analysis.
MacCallum, R. C., Widaman, K. F., Zhang, S., & Hong, S. (1999) · Psychological Methods · doi:10.1037/1082-989x.4.1.84 · Cited by 5,497
Measurement Invariance, Factor Analysis and Factorial Invariance
Meredith, W. (1993) · Psychometrika · doi:10.1007/bf02294825 · Cited by 4,536 · cited 1×
“…ME/I literature of CFA-based procedures and based on this review, they identified several tests of ME/I that have been used in past studies and recommended several “best practices” for testing for ME/I based on the works of Jöreskog (1971), Meredith (1993), and many others over the past 3 decades.”
MethodByrne, B. M., Shavelson, R. J., & Muthén, B. (1989) · Psychological Bulletin · doi:10.1037//0033-2909.105.3.456 · Cited by 4,115
Simultaneous Factor Analysis in Several Populations
Jöreskog, K. G. (1971) · Psychometrika · doi:10.1007/bf02291366 · Cited by 2,051
A practical and theoretical guide to measurement invariance in aging research
Horn, J. L., & Mcardle, J. J. (1992) · Experimental Aging Research · doi:10.1080/03610739208253916 · Cited by 1,592 · cited 2×
“E-mail: adam_meade@ncsu.edu necessary to show that the two measurements are psychometrically equivalent to make valid comparisons regarding change over time or across groups of respondents (Horn & McArdle, 1992).”
Background
Cited by
Sensitivity of Goodness of Fit Indexes to Lack of Measurement Invariance
Chen, F. F. (2007) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1080/10705510701301834 · Cited by 12,217
Power and sensitivity of alternative fit indices in tests of measurement invariance.
Meade, A. W., Johnson, E. C., & Braddy, P. W. (2008) · Journal of Applied Psychology · doi:10.1037/0021-9010.93.3.568 · Cited by 1,668
Self-citationMeasurement invariance: Review of practice and implications
Schmitt, N., & Kuljanin, G. (2008) · Human Resource Management Review · doi:10.1016/j.hrmr.2008.03.003 · Cited by 759
Sass, D. A., Schmitt, T. A., & Marsh, H. W. (2014) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1080/10705511.2014.882658 · Cited by 421
A Primer to (Cross-Cultural) Multi-Group Invariance Testing Possibilities in R
Fischer, R., & Karl, J. A. (2019) · Frontiers in Psychology · doi:10.3389/fpsyg.2019.01507 · Cited by 383
Confirmatory Factor Analytic Procedures for the Determination of Measurement Invariance
French, B. F., & Finch, W. H. (2006) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1207/s15328007sem1303_3 · Cited by 313
Meade, A. W., & Lautenschlager, G. J. (2004) · Organizational Research Methods · doi:10.1177/1094428104268027 · Cited by 301
Self-citationMoore, J. B., Yin, Z., Hanes, J., Duda, J., Gutin, B., & Barbeau, P. (2009) · Journal of Applied Sport Psychology · doi:10.1080/10413200802593612 · Cited by 288
Power and Precision in Confirmatory Factor Analytic Tests of Measurement Invariance
Meade, A. W., & Bauer, D. J. (2007) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1080/10705510701575461 · Cited by 226
“In one published study, Meade and Lautenschlager (2004) simulated data for both a 6- and 12-item scale, then manipulated the number of items showing loading differences between simulated samples (sometimes called differential functioning [DF] items), and the directionality of the simulated…”
BackgroundMethodResultInfluentialSelf-citationYoon, M., & Millsap, R. E. (2007) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1080/10705510701301677 · Cited by 219
“Meade and Lautenschlager (2004) conducted a Monte Carlo study to evaluate CFA tests for testing measurement invariance.”
MethodResultInfluentialStereotype Threat and Group Differences in Test Performance: A Question of Measurement Invariance.
Wicherts, J. M., Dolan, C. V., & Hessen, D. J. (2005) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.89.5.696 · Cited by 126
“Nevertheless, the fact that bias was clearly detected in our studies indicates that MGCFA is a powerful tool in detecting measurement bias (cf. Cheung & Rensvold, 2002; Meade & Lautenschlager, 2004), even if these effects are only present at the covariance level (Study 1).”
MethodHopper, J. W., Frewen, P. A., Sack, M., Lanius, R. A., & van der Kolk, B. A. (2007) · Journal of Psychopathology and Behavioral Assessment · doi:10.1007/s10862-007-9046-0 · Cited by 86
Methodological and Substantive Issues in Conducting Multinational and Cross-Cultural Research
Spector, P. E., Liu, C., & Sanchez, J. I. (2015) · Annual Review of Organizational Psychology and Organizational Behavior · doi:10.1146/annurev-orgpsych-032414-111310 · Cited by 82
Bartholomew, T. T., Keum, B. T., Lockard, A. J., Pérez‐Rojas, A. E., Robbins, K. A., & Zhao, F. (2023) · Journal of Clinical Psychology · doi:10.1002/jclp.23476 · Cited by 6
Metadata
- Authors
- Meade, A. W., & Lautenschlager, G. J.
- Venue
- Structural Equation Modeling: A Multidisciplinary Journal
- Publisher
- Informa UK Limited
- Published
- 2004-01
- Volume
- 11
- Issue
- 1
- Pages
- 60-72
- ISSN
- 1070-5511 (ISSN-L)
- 1532-8007
- OpenAlex
- W1987627593
- Cited by
- 188
- References
- 7
- FWCI
- 13.10
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.