The DOI matches its Crossref record; 41 of the 41 references it cites were found in a registry or an index.
What to do when scalar invariance fails: The extended alignment method for multi-group factor analysis comparison of latent means across many groups.
Abstract
Scalar invariance is an unachievable ideal that in practice can only be approximated; often using potentially questionable approaches such as partial invariance based on a stepwise selection of parameter estimates with large modification indices. Study 1 demonstrates an extension of the power and flexibility of the alignment approach for comparing latent factor means in large-scale studies (30 OECD countries, 8 factors, 44 items, N = 249,840), for which scalar invariance is typically not supported in the traditional confirmatory factor analysis approach to measurement invariance (CFA-MI). Importantly, we introduce an alignment-within-CFA (AwC) approach, transforming alignment from a largely exploratory tool into a confirmatory tool, and enabling analyses that previously have not been possible with alignment (testing the invariance of uniquenesses and factor variances/covariances; multiple-group MIMIC models; contrasts on latent means) and structural equation models more generally. Specifically, it also allowed a comparison of gender differences in a 30-country MIMIC AwC (i.e., a SEM with gender as a covariate) and a 60-group AwC CFA (i.e., 30 countries × 2 genders) analysis. Study 2, a simulation study following up issues raised in Study 1, showed that latent means were more accurately estimated with alignment than with the scalar CFA-MI, and particularly with partial invariance scalar models based on the heavily criticized stepwise selection strategy. In summary, alignment augmented by AwC provides applied researchers from diverse disciplines considerable flexibility to address substantively important issues when the traditional CFA-MI scalar model does not fit the data. (PsycINFO Database Record
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hu, L., & Bentler, P. M. (1999) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1080/10705519909540118 · Cited by 108,788
Multiple Imputation for Nonresponse in Surveys
Rubin, D. B. (1987) · Wiley Series in Probability and Statistics · doi:10.1002/9780470316696 · Cited by 20,701
Evaluating Goodness-of-Fit Indexes for Testing Measurement Invariance
Cheung, G. W., & Rensvold, R. B. (2002) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1207/s15328007sem0902_5 · Cited by 16,280
Sensitivity of Goodness of Fit Indexes to Lack of Measurement Invariance
Chen, F. F. (2007) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1080/10705510701301834 · Cited by 12,217
Vandenberg, R. J., & Lance, C. E. (2000) · Organizational Research Methods · doi:10.1177/109442810031002 · Cited by 7,997
(2010) · Cited by 7,034
Harrell (2015) · Springer Series in Statistics · doi:10.1007/978-3-319-19425-7 · Cited by 6,878
Marsh, H. W., Hau, K.-T., & Wen, Z. (2004) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1207/s15328007sem1103_2 · Cited by 6,691
Self-citationMeasurement Invariance, Factor Analysis and Factorial Invariance
Meredith, W. (1993) · Psychometrika · doi:10.1007/bf02294825 · Cited by 4,536
Byrne, B. M., Shavelson, R. J., & Muthén, B. (1989) · Psychological Bulletin · doi:10.1037//0033-2909.105.3.456 · Cited by 4,115
Self-citationGoodness-of-fit indexes in confirmatory factor analysis: The effect of sample size.
Marsh, H. W., Balla, J. R., & McDonald, R. P. (1988) · Psychological Bulletin · doi:10.1037//0033-2909.103.3.391 · Cited by 3,824
Self-citationExploratory Structural Equation Modeling
Asparouhov, T., & Muthén, B. (2009) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1080/10705510903008204 · Cited by 2,665
Self-citationMarsh, H. W., Morin, A. J. S., Parker, P. D., & Kaur, G. (2014) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-032813-153700 · Cited by 1,801
Self-citationModel modifications in covariance structure analysis: The problem of capitalization on chance.
MacCallum, R. C., Roznowski, M., & Necowitz, L. B. (1992) · Psychological Bulletin · doi:10.1037//0033-2909.111.3.490 · Cited by 1,632
Statistical Approaches to Measurement Invariance
Millsap, R. E. (2012) · doi:10.4324/9780203821961 · Cited by 1,554
Little, T. D. (1997) · Multivariate Behavioral Research · doi:10.1207/s15327906mbr3201_3 · Cited by 1,393
Reise, S. P., Widaman, K. F., & Pugh, R. H. (1993) · Psychological Bulletin · doi:10.1037//0033-2909.114.3.552 · Cited by 1,224
Widaman, K. F., & Reise, S. P. (1997) · The science of prevention: Methodological advances from alcohol and substance abuse research. · doi:10.1037/10222-009 · Cited by 1,146
Marsh, H. W., Muthén, B., Asparouhov, T., Lüdtke, O., Robitzsch, A., Morin, A. J. S., & Trautwein, U. (2009) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1080/10705510903008220 · Cited by 1,093
Self-citationChen, F. F. (2008) · Journal of Personality and Social Psychology · doi:10.1037/a0013193 · Cited by 962
Data Analysis: A Model-Comparison Approach
Vining, G., Judd, C. M., & McClelland, G. H. (1992) · Technometrics · doi:10.2307/1269570 · Cited by 922
Multiple-Group Factor Analysis Alignment
Asparouhov, T., & Muthén, B. (2014) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1080/10705511.2014.919210 · Cited by 836
Self-citationRutkowski, L., & Svetina, D. (2014) · Educational and Psychological Measurement · doi:10.1177/0013164413498257 · Cited by 767
Measurement Equivalence in Cross-National Research
Davidov, E., Meuleman, B., Cieciuch, J., Schmidt, P., & Billiet, J. (2014) · Annual Review of Sociology · doi:10.1146/annurev-soc-071913-043137 · Cited by 766
Measurement invariance: Review of practice and implications
Schmitt, N., & Kuljanin, G. (2008) · Human Resource Management Review · doi:10.1016/j.hrmr.2008.03.003 · Cited by 759
A GENERAL METHOD FOR STUDYING DIFFERENCES IN FACTOR MEANS AND FACTOR STRUCTURE BETWEEN GROUPS
Sörbom, D. (1974) · British Journal of Mathematical and Statistical Psychology · doi:10.1111/j.2044-8317.1974.tb00543.x · Cited by 666
Marsh, H. W., Hau, K.-T., Artelt, C., Baumert, J., & Peschar, J. L. (2006) · International Journal of Testing · doi:10.1207/s15327574ijt0604_1 · Cited by 593
Self-citationMarsh, H. W., Nagengast, B., & Morin, A. J. S. (2013) · Developmental Psychology · doi:10.1037/a0026913 · Cited by 422
Self-citationMarsh, H. W., Lüdtke, O., Nagengast, B., Morin, A. J. S., & von Davier, M. (2013) · Psychological Methods · doi:10.1037/a0032773 · Cited by 378
Self-citationUsing the Modification Index and Standardized Expected Parameter Change for Model Modification
Whittaker, T. A. (2012) · The Journal of Experimental Education · doi:10.1080/00220973.2010.531299 · Cited by 357
Muthén, B., & Asparouhov, T. (2018) · Sociological Methods & Research · doi:10.1177/0049124117701488 · Cited by 259
Self-citation2001 Presidential Address: Working with Imperfect Models
MacCallum, R. C. (2003) · Multivariate Behavioral Research · doi:10.1207/s15327906mbr3801_5 · Cited by 241
Discussion, Emphasizing the Connection Between Analysis of Variance and Spectrum Analysis
Tukey, J. W. (1961) · Technometrics · doi:10.1080/00401706.1961.10489940 · Cited by 214
Jak, S., Oort, F. J., & Dolan, C. V. (2013) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1080/10705511.2013.769392 · Cited by 147
Some Problems of Statistics and Everyday Life
Box, G. E. P. (1979) · Journal of the American Statistical Association · doi:10.1080/01621459.1979.10481600 · Cited by 138
Thurstone, L. L. (1930) · The Journal of General Psychology · doi:10.1080/00221309.1930.9918225 · Cited by 120
Longitudinal stability of latent means and individual differences: A unified approach
Marsh, H. W., & Grayson, D. (1994) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1080/10705519409539984 · Cited by 94
Self-citationStructural Models and the Art of Approximation
McDonald, R. P. (2010) · Perspectives on Psychological Science · doi:10.1177/1745691610388766 · Cited by 90
Rotation to Simple Loadings Using Component Loss Functions: The Oblique Case
Jennrich, R. I. (2006) · Psychometrika · doi:10.1007/s11336-003-1136-b · Cited by 85
Zercher, F., Schmidt, P., Cieciuch, J., & Davidov, E. (2015) · Frontiers in Psychology · doi:10.3389/fpsyg.2015.00733 · Cited by 73
Data comparability in the teaching and learning international survey (TALIS) 2008 and 2013
He, J., & Kubacka, K. (2015) · OECD education working papers · doi:10.1787/5jrp6fwtmhf2-en · Cited by 18
Cited by
Greenier, V., Derakhshan, A., & Fathi, J. (2021) · System · doi:10.1016/j.system.2020.102446 · Cited by 576
Swami, V., & Barron, D. (2019) · Body Image · doi:10.1016/j.bodyim.2018.08.014 · Cited by 454
Leitgöb, H., Seddig, D., Asparouhov, T., Behr, D., Davidov, E., De Roover, K., Jak, S., Meitinger, K., Menold, N., Muthén, B., et al. (2023) · Social Science Research · doi:10.1016/j.ssresearch.2022.102805 · Cited by 271
Self-citationSischka, P. E., Costa, A. P., Steffgen, G., & Schmidt, A. F. (2020) · Journal of Affective Disorders Reports · doi:10.1016/j.jadr.2020.100020 · Cited by 245
Greiff, S., & Scherer, R. (2018) · European Journal of Psychological Assessment · doi:10.1027/1015-5759/a000487 · Cited by 76
Metadata
- Authors
- Marsh, H. W., Guo, J., Parker, P. D., Nagengast, B., Asparouhov, T., Muthén, B., & Dicke, T.
- Venue
- Psychological Methods
- Published
- 2018-09
- Volume
- 23
- Issue
- 3
- Pages
- 524-545
- ISSN
- 1082-989X (ISSN-L)
- 1939-1463
- OpenAlex
- W2574643688
- Cited by
- 278
- References
- 41
- FWCI
- 15.48
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.