An Essay on Measurement and Factorial Invariance
Abstract
BACKGROUND: Analysis of subgroups such as different ethnic, language, or education groups selected from among a parent population is common in health disparities research. One goal of such analyses is to examine measurement equivalence, which includes both qualitative review of the meaning of items as well as quantitative examination of different levels of factorial invariance and differential item functioning. OBJECTIVES: The purpose of this essay is to review the definitions and assumptions associated with factorial invariance, placing this formulation in the context of bias, fairness, and equity. The connection between the concepts of factorial invariance and item bias (differential item functioning) using a variant of item response theory is discussed. The situations under which different forms of invariance (weak, strong, and strict) are required are discussed. METHODS: Establishing factorial invariance involves a hierarchy of levels that include tests of weak, strong, and strict invariance. Pattern (metric or weak) factorial invariance implies that the regression slopes are invariant across groups. Pattern invariance requires only invariant factor loadings. Strong factorial invariance implies that the conditional expectation of the response, given the common and specific factors, is invariant across groups. Strong factorial invariance requires that specific factor means (represented as invariant intercepts) also be identical across groups. Strict factorial invariance implies that, in addition, the conditional variance of the response, given the common and specific factors, is invariant across groups. Strict factorial invariance requires that, in addition to equal factor loadings and intercepts, the residual (specific factor plus error variable) variances are equivalent across groups. The concept of measurement invariance that is most closely aligned to that of item response theory considers the latent variable as a common factor measured by manifest variables; the specific factors can be characterized as nuisance variables. CONCLUSIONS: Invariance of factor loadings across studied groups is required for valid comparisons of scale score or latent variable means. Strong and strict invariance may be less important in the context of basic research in which group differences in specific factors are indicative of individual differences that are important for scientific exploration. However, for most applications in which the aim is to ensure fairness and equity, strict factorial invariance is required. Health disparities research often focuses on self-reported clinical outcomes such as quality of life that are not observed directly. Latent variable models such as factor analyses are central to establishing valid assessment of such outcomes.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Scalar invariance allows comparisons of latent means, but full comparability of observed scores would require evidence of strict invariance.
“While scalar invariance allows comparisons of latent means, full comparability of observed scores would require evidence of strict invariance [77]”
From Psychometric validation and measurement invariance of the Health-Promoting Lifestyle Profile II in Honduran university students (2025) · cites this paper as [77]
Cites
Rozeboom, W. W., Lord, F. M., Novick, M. R., & Birnbaum, A. (1969) · American Educational Research Journal · doi:10.2307/1162101 · Cited by 8,012 · see citing works
Measurement Invariance, Factor Analysis and Factorial Invariance
Meredith, W. (1993) · Psychometrika · doi:10.1007/bf02294825 · Cited by 4,536 · see citing works
Self-citationByrne, B. M., Shavelson, R. J., & Muthén, B. (1989) · Psychological Bulletin · doi:10.1037/0033-2909.105.3.456 · Cited by 3,928 · see citing works
Muthén, B. (1984) · Psychometrika · doi:10.1007/bf02294210 · Cited by 2,029 · see citing works
Latent Variable Modeling in Heterogeneous Populations
Muthén, B. (1989) · Psychometrika · doi:10.1007/bf02296397 · Cited by 1,008 · see citing works
Do Self-Report Instruments Allow Meaningful Comparisons Across Diverse Population Groups?
Gregorich, S. E. (2006) · Medical Care · doi:10.1097/01.mlr.0000245454.12228.8f · Cited by 784 · see citing works
Differential Item Performance and the Mantel–Haenszel Procedure
(2013) · Routledge eBooks · doi:10.4324/9780203056905-19 · Cited by 715 · see citing works
Factor Analysis and Related Methods
Widaman, K. F., & McDonald, R. P. (1987) · Journal of Educational Statistics · doi:10.2307/1164692 · Cited by 669 · see citing works
New methods for the analysis of change
Collins, L. M., & Sayer, A. (2001) · American Psychological Association eBooks · doi:10.1037/10409-000 · Cited by 578 · see citing works
Item bias and item response theory
Mellenbergh, G. J. (1989) · International Journal of Educational Research · doi:10.1016/0883-0355(89)90002-5 · Cited by 553 · see citing works
Lubke, G. H., & Muthén, B. (2004) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1207/s15328007sem1104_2 · Cited by 489 · see citing works
Factor Analysis of Dichotomized Variables
Christoffersson, A. (1975) · Psychometrika · doi:10.1007/bf02291477 · Cited by 401 · see citing works
The role of factorial invariance in modeling growth and change.
Meredith, W. H., & Horn, J. L. (2001) · American Psychological Association eBooks · doi:10.1037/10409-007 · Cited by 286 · see citing works
Self-citationDifferential Item Functioning Analysis With Ordinal Logistic Regression Techniques
Crane, P. K., Gibbons, L. E., Jolley, L., & van Belle, G. (2006) · Medical Care · doi:10.1097/01.mlr.0000245183.28384.ed · Cited by 285 · see citing works
Applied Psychological Measurement
(1977) · Applied Psychological Measurement · doi:10.1177/014662167700100201 · Cited by 236 · see citing works
Guttman, L. (1955) · British Journal of Statistical Psychology · doi:10.1111/j.2044-8317.1955.tb00321.x · Cited by 234 · see citing works
Simultaneous Factor Analysis of Dichotomous Variables in Several Groups
Muthén, B., & Christoffersson, A. (1981) · Psychometrika · doi:10.1007/bf02293798 · Cited by 225 · see citing works
Zwick, R. (1990) · Journal of Educational Statistics · doi:10.3102/10769986015003185 · Cited by 158 · see citing works
Morales, L. S., Flowers, C. P., Gutierrez, P., et al. (2006) · Medical Care · doi:10.1097/01.mlr.0000245141.70946.29 · Cited by 73 · see citing works
Inferential Conditions in the Statistical Detection of Measurement Bias
Millsap, R. E., & Meredith, W. H. (1992) · Applied Psychological Measurement · doi:10.1177/014662169201600411 · Cited by 61 · see citing works
Self-citationLubke, G. H., & Dolan, C. V. (2003) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1207/s15328007sem1002_1 · Cited by 59 · see citing works
Differential Item Functioning on the Mini-Mental State Examination
Dorans, N. J., & Kulick, E. (2006) · Medical Care · doi:10.1097/01.mlr.0000245182.36914.4a · Cited by 53 · see citing works
Factor structure in groups selected on observed scores
Muthén, B. (1989) · British Journal of Mathematical and Statistical Psychology · doi:10.1111/j.2044-8317.1989.tb01116.x · Cited by 48 · see citing works
Edelen, M. O., Thissen, D., Teresi, J. A., Kleinman, M., & Ocepek‐Welikson, K. (2006) · Medical Care · doi:10.1097/01.mlr.0000245251.83359.8c · Cited by 31 · see citing works
Self-citationStatistical Evidence in Salary Discrimination Studies: Nonparametric Inferential Conditions
Millsap, R. E., & Meredith, W. H. (1994) · Multivariate Behavioral Research · doi:10.1207/s15327906mbr2904_2 · Cited by 12 · see citing works
Self-citation
Flagged first, then by citations
Cited by
Sorted by citations
Caprara, G. V., Alessandri, G., Eisenberg, N., Kupfer, A., Steca, P., Caprara, M. G., Yamaguchi, S., Fukuzawa, A., & Abela, J. (2012) · Psychological Assessment · doi:10.1037/a0026681 · Cited by 393 · see citing works
Kliem, S., Mößle, T., Rehbein, F., Hellmann, D. F., Zenger, M., & Brähler, E. (2015) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2014.11.003 · Cited by 263 · see citing works
Elhai, J. D., & Palmieri, P. A. (2011) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2011.04.007 · Cited by 257 · see citing works
Marsh, H. W., Nagengast, B., Morin, A. J. S., Parada, R. H., Craven, R. G., & Hamilton, L. R. (2011) · Journal of Educational Psychology · doi:10.1037/a0024122 · Cited by 232 · see citing works
Nilsson, J., Lebedev, A. V., Rydström, A., & Lövdén, M. (2017) · Psychological Science · doi:10.1177/0956797617698139 · Cited by 118 · see citing works
Bartram, D. J., Sinclair, J. M., & Baldwin, D. S. (2013) · Quality of Life Research · doi:10.1007/s11136-012-0144-4 · Cited by 76 · see citing works
Kliem, S., Schmidt, R., Vogel, M., Hiemisch, A., Kiess, W., & Hilbert, A. (2017) · International Journal of Eating Disorders · doi:10.1002/eat.22658 · Cited by 67 · see citing works
Varni, J. W., Beaujean, A. A., & Limbers, C. A. (2013) · Quality of Life Research · doi:10.1007/s11136-013-0370-4 · Cited by 56 · see citing works
A systematic review of sexual distress measures
Santos-Iglesias, P., Mohamed, B., & Walker, L. M. (2018) · The Journal of Sexual Medicine · doi:10.1016/j.jsxm.2018.02.020 · Cited by 51 · see citing works
Blankson, A. N., & McArdle, J. J. (2015) · The Journals of Gerontology Series B: Psychological Sciences and Social Sciences · doi:10.1093/geronb/gbt106 · Cited by 43 · see citing works
The impact of psychological distress on exacerbation rates in COPD
Laurin, C., Moullec, G., Bacon, S. L., & Lavoie, K. L. (2011) · Therapeutic Advances in Respiratory Disease · doi:10.1177/1753465810382818 · Cited by 25 · see citing works
Pauls, F., Petermann, F., & Lepach, A. C. (2013) · Journal of Clinical and Experimental Neuropsychology · doi:10.1080/13803395.2013.820257 · Cited by 13 · see citing works
Castillo-Díaz, M. A., & Periañez, C. A. H. (2025) · BMC Public Health · doi:10.1186/s12889-025-25899-9 · Cited by 4 · see citing works
- Authors
- Meredith, W., & Teresi, J. A.
- Affiliations
- University of California, Berkeley (US)
- Hebrew Home (US)
- Corresponding author
- Meredith, William
- Venue
- Medical Care
- Published
- 2006-11
- Volume
- 44
- Issue
- Suppl 3
- Pages
- S69-S77
- ISSN
- 0025-7079 (ISSN-L)
- OpenAlex
- W2042748046
- Cited by
- 664
- References
- 26
- Citations by year
- 2026: 12 · 2025: 24 · 2024: 41 · 2023: 49 · 2022: 37 · 2021: 47 · 2020: 40 · 2019: 49 · 2018: 41 · 2017: 45 · 2016: 43 · 2015: 31 · 2014: 53 · 2013: 33 · 2012: 26
- FWCI
- 18.74
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Medical Care (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Social Sciences › Education › Health Education and Validation
- Social Sciences › Education › Educational Assessment and Pedagogy
- Keywords
- measurement invariance, differential item functioning, item response theory, health disparities, equity and fairness, latent variable models, quality of life assessment, subgroup comparison
- MeSH terms
- Data Collection, Data Interpretation, Statistical, Ethnicity, Factor Analysis, Statistical, Humans, Terminology as Topic, Psychometrics, Bias
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review