A practical and theoretical guide to measurement invariance in aging research
Abstract
We describe mathematical and statistical models for factor invariance. We demonstrate that factor invariance is a condition of measurement invariance. In any study of change (as over age) measurement invariance is necessary for valid inference and interpretation. Two important forms of factorial invariance are distinguished: "configural" and "metric". Tests for factorial invariance and the range of tests from strong to weak are illustrated with multiple group factor and structural equation modeling analyses (with programs such as LISREL, COSAN, and RAM). The tests are for models of the organization and age changes of intellectual abilities. The models are derived from current theory of fluid (Gf) and crystallized (Gc) abilities. The models are made manifest with measurements of the WAIS-R in the standardization sample. Although this is a methodological paper, the key issues and major principles and conclusions are presented in basic English, devoid of technical details and obscure notation. Conceptual principles of multivariate methods of data analysis are presented in terms of substantive issues of importance for the science of the psychology of aging.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Scalar invariance is necessary and sufficient to meaningfully interpret differences in scale means across countries.
“Scalar invariance is necessary und sufficient to meaningfully interpret differences in scale means across countries (Horn & McArdle, 1992).”
From Cultural norm fulfillment, interpersonal belonging, or getting ahead? A large-scale cross-cultural test of three perspectives on the function of self-esteem. (2015) · cites this paper as Horn & McArdle, 1992
Metric invariance is necessary and sufficient to meaningfully interpret differences in correlations across countries.
“Metric invariance is necessary und sufficient to meaningfully interpret differences in correlations across countries (Horn & McArdle, 1992).”
From Cultural norm fulfillment, interpersonal belonging, or getting ahead? A large-scale cross-cultural test of three perspectives on the function of self-esteem. (2015) · cites this paper as Horn & McArdle, 1992
Cites
Simultaneous Factor Analysis in Several Populations
Jöreskog, K. G. (1971) · Psychometrika · doi:10.1007/bf02291366 · Cited by 2,051 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Evaluating Goodness-of-Fit Indexes for Testing Measurement Invariance
Cheung, G. W., & Rensvold, R. B. (2002) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1207/s15328007sem0902_5 · Cited by 16,280 · see citing works
Vandenberg, R. J., & Lance, C. E. (2000) · Organizational Research Methods · doi:10.1177/109442810031002 · Cited by 7,997 · see citing works
Hedonic and utilitarian motivations for online retail shopping behavior
Childers, T. L., Carr, C. L., Peck, J., & Carson, S. (2001) · Journal of Retailing · doi:10.1016/s0022-4359(01)00056-2 · Cited by 3,219 · see citing works
Contingencies of Self-Worth in College Students: Theory and Measurement.
Crocker, J., Luhtanen, R. K., Cooper, M. L., & Bouvrette, A. (2003) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.85.5.894 · Cited by 1,018 · see citing works
Evolutionary Personality Psychology
Buss, D. M. (1991) · Annual Review of Psychology · doi:10.1146/annurev.ps.42.020191.002331 · Cited by 930 · see citing works
Integrative data analysis: The simultaneous analysis of multiple data sets
Curran, P. J., & Hussong, A. M. (2009) · Psychological Methods · doi:10.1037/a0015914 · Cited by 867 · see citing works
Mackinnon, A., Jorm, A. F., Christensen, H., Korten, A. E., Jacomb, P. A., & Rodgers, B. (1999) · Personality and Individual Differences · doi:10.1016/s0191-8869(98)00251-7 · Cited by 850 · see citing works
Rutkowski, L., & Svetina, D. (2014) · Educational and Psychological Measurement · doi:10.1177/0013164413498257 · Cited by 767 · see citing works
Cooper, M. L., Shapiro, C. M., & Powers, A. M. (1998) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.75.6.1528 · Cited by 586 · see citing works
McCrae, R. R., Costa, P. T., Terracciano, A., Parker, W. D., Mills, C. J., De Fruyt, F., & Mervielde, I. (2002) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.83.6.1456 · Cited by 499 · see citing works
Enjoyment mediates effects of a school-based physical-activity intervention
DISHMAN, R. K., MOTL, R. W., SAUNDERS, R., FELTON, G., WARD, D. S., DOWDA, M., & PATE, R. R. (2005) · Medicine & Science in Sports & Exercise · doi:10.1249/01.mss.0000155391.62733.a7 · Cited by 474 · see citing works
Swami, V., & Barron, D. (2019) · Body Image · doi:10.1016/j.bodyim.2018.08.014 · Cited by 454 · see citing works
Dishman, R. (2004) · Preventive Medicine · doi:10.1016/j.ypmed.2003.12.007 · Cited by 373 · see citing works
A more general model for testing measurement invariance and differential item functioning
Bauer, D. J. (2017) · Psychological Methods · doi:10.1037/met0000077 · Cited by 363 · see citing works
E-satisfaction: A re-examination
EVANSCHITZKY, H., IYER, G., HESSE, J., & AHLERT, D. (2004) · Journal of Retailing · doi:10.1016/j.jretai.2004.08.002 · Cited by 343 · see citing works
A 20-year longitudinal study of body weight, dieting, and eating disorder symptoms.
Keel, P. K., Baxter, M. G., Heatherton, T. F., & Joiner, T. E. (2007) · Journal of Abnormal Psychology · doi:10.1037/0021-843x.116.2.422 · Cited by 309 · see citing works
Assessing psychological change in adulthood: An overview of methodological issues
Hertzog, C., & Nesselroade, J. R. (2003) · Psychology and Aging · doi:10.1037/0882-7974.18.4.639 · Cited by 286 · see citing works
Memory Maintenance and Inhibitory Control Differentiate from Early Childhood to Adolescence
Shing, Y. L., Lindenberger, U., Diamond, A., Li, S.-C., & Davidson, M. C. (2010) · Developmental Neuropsychology · doi:10.1080/87565641.2010.508546 · Cited by 239 · see citing works
Ellis, R. D., & Allaire, J. C. (1999) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872099779610996 · Cited by 243 · see citing works
The Assessment of Psychological Strain in Work Contexts
Mohr, G., Müller, A., Rigotti, T., Aycan, Z., & Tschan, F. (2006) · European Journal of Psychological Assessment · doi:10.1027/1015-5759.22.3.198 · Cited by 236 · see citing works
Measurement Invariance in International Surveys: Categorical Indicators and Fit Measure Performance
Rutkowski, L., & Svetina, D. (2017) · Applied Measurement in Education · doi:10.1080/08957347.2016.1243540 · Cited by 225 · see citing works
Levant, R. F., Hall, R. J., & Rankin, T. J. (2013) · Journal of Counseling Psychology · doi:10.1037/a0031545 · Cited by 222 · see citing works
Stereotype threat among older employees: relationship with job attitudes and turnover intentions
von Hippel, C., Kalokerinos, E. K., & Henry, J. D. (2013) · Psychology and Aging · doi:10.1037/a0029825 · Cited by 182 · see citing works
Downer, J. T., López, M. L., Grimm, K. J., Hamagami, A., Pianta, R. C., & Howes, C. (2012) · Early Childhood Research Quarterly · doi:10.1016/j.ecresq.2011.07.005 · Cited by 180 · see citing works
Ausderau, K., Sideris, J., Furlong, M., Little, L. M., Bulluck, J., & Baranek, G. T. (2014) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-013-1945-1 · Cited by 166 · see citing works
Dakanalis, A., Zanetti, M. A., Clerici, M., Madeddu, F., Riva, G., & Caccialanza, R. (2013) · Appetite · doi:10.1016/j.appet.2013.08.010 · Cited by 130 · see citing works
Testing a hierarchical model of anxiety and depression in adolescents: a tri-level model
Prenoveau, J. M., Zinbarg, R. E., Craske, M. G., Mineka, S., Griffith, J. W., & Epstein, A. M. (2010) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2010.01.006 · Cited by 113 · see citing works
Pedersen, G., Kvarstein, E. H., & Wilberg, T. (2017) · Personality and Mental Health · doi:10.1002/pmh.1382 · Cited by 90 · see citing works
Gebauer, J. E., Sedikides, C., Wagner, J., Bleidorn, W., Rentfrow, P. J., Potter, J., & Gosling, S. D. (2015) · Journal of Personality and Social Psychology · doi:10.1037/pspp0000052 · Cited by 84 · see citing works
Web-based measurement: Effect of completing single or multiple items per webpage
Thorndike, F. P., Carlbring, P., Smyth, F. L., Magee, J. C., Gonder-Frederick, L., Ost, L.-G., & Ritterband, L. M. (2009) · Computers in Human Behavior · doi:10.1016/j.chb.2008.05.006 · Cited by 83 · see citing works
Schöllgen, I., Huxhold, O., Schüz, B., & Tesch-Römer, C. (2011) · Health Psychology · doi:10.1037/a0022514 · Cited by 78 · see citing works
Preferred leisure type, value orientations, and psychological well-being among East Asian Youth
Lee, E.-Y., Yi, K. J., Walker, G. J., & Spence, J. C. (2017) · Leisure Sciences · doi:10.1080/01490400.2016.1209139 · Cited by 55 · see citing works
Core dimensions of anxiety and depression change independently during adolescence.
Conway, C. C., Zinbarg, R. E., Mineka, S., & Craske, M. G. (2017) · Journal of Abnormal Psychology · doi:10.1037/abn0000222 · Cited by 51 · see citing works
Grygiel, P., Humenny, G., & Rębisz, S. (2019) · Assessment · doi:10.1177/1073191116682298 · Cited by 44 · see citing works
Blankson, A. N., & McArdle, J. J. (2015) · The Journals of Gerontology Series B: Psychological Sciences and Social Sciences · doi:10.1093/geronb/gbt106 · Cited by 43 · see citing works
Self-citationTsaousis, I., & Alghamdi, M. H. (2022) · Frontiers in Psychology · doi:10.3389/fpsyg.2022.896638 · Cited by 40 · see citing works
Cassidy, A. R. (2016) · Child Neuropsychology · doi:10.1080/09297049.2014.994484 · Cited by 37 · see citing works
Bowden, S. C., Gregg, N., Bandalos, D., Davis, M., Coleman, C., Holdnack, J. A., & Weiss, L. G. (2008) · Educational and Psychological Measurement · doi:10.1177/0013164407310126 · Cited by 26 · see citing works
Shi, D., Song, H., DiStefano, C., Maydeu-Olivares, A., McDaniel, H. L., & Jiang, Z. (2019) · Multivariate Behavioral Research · doi:10.1080/00273171.2018.1514484 · Cited by 19 · see citing works
Konradt, U., Ellwart, T., & Gevers, J. (2021) · Learning and Individual Differences · doi:10.1016/j.lindif.2021.102003 · Cited by 11 · see citing works
Modeling trait depression amplifies the effect of childbearing on postpartum depression
Merkitch, K. G., Jonas, K. G., & O’Hara, M. W. (2017) · Journal of Affective Disorders · doi:10.1016/j.jad.2017.07.017 · Cited by 6 · see citing works
- Authors
- Horn, J. L., & Mcardle, J. J.
- Affiliations
- University of Southern California (US)
- University of Virginia (US)
- Venue
- Experimental Aging Research
- Publisher
- Informa UK Limited
- Published
- 1992-09
- Volume
- 18
- Issue
- 3
- Pages
- 117-144
- ISSN
- 0361-073X (ISSN-L)
- 1096-4657
- OpenAlex
- W2010699191
- Cited by
- 1,592
- References
- 1
- Citations by year
- 2026: 28 · 2025: 39 · 2024: 63 · 2023: 60 · 2022: 54 · 2021: 69 · 2020: 113 · 2019: 58 · 2018: 80 · 2017: 68 · 2016: 99 · 2015: 94 · 2014: 90 · 2013: 89 · 2012: 84
- FWCI
- 4.49
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Experimental Aging Research (publishedVersion)
- PubMed (publishedVersion)
- Funders
- National Institutes of Health (5r01ag004704-02)
- National Institute on Aging (AG04704, AG02695, AG-07137)
- Topics
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Social Sciences › Psychology › Neuropsychology and Physiological Psychology › Aging and Gerontology Research
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Cognitive Abilities and Testing
- Keywords
- measurement invariance, configural invariance, metric invariance, aging research, intellectual ability, fluid intelligence, crystallized intelligence, WAIS-R, age-related changes, structural equation modeling, standardization sample
- MeSH terms
- Aged, Geriatrics, Humans, Models, Theoretical, Research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review