Cited by 358Psychometric Methodologies and TestingStatistical Methods and Bayesian InferenceMental Health Research Topics

The DOI matches its Crossref record; 42 of the 43 references it cites were found in a registry or an index.

Testing measurement invariance in longitudinal data with ordered-categorical measures.

Open access

Liu, Yu, Millsap, Roger E., West, Stephen G., Tein, Jenn-Yun, Tanaka, Rika, Grimm, Kevin J.·2017·Psychological Methods

DOI 10.1037/met0000075PMC PMC5121102

Open this paper in CoChat — free account

Abstract

A goal of developmental research is to examine individual changes in constructs over time. The accuracy of the models answering such research questions hinges on the assumption of longitudinal measurement invariance: The repeatedly measured variables need to represent the same construct in the same metric over time. Measurement invariance can be studied through factor models examining the relations between the observed indicators and the latent constructs. In longitudinal research, ordered-categorical indicators such as self- or observer-report Likert scales are commonly used, and these measures often do not approximate continuous normal distributions. The present didactic article extends previous work on measurement invariance to the longitudinal case for ordered-categorical indicators. We address a number of problems that commonly arise in testing measurement invariance with longitudinal data, including model identification and interpretation, sparse data, missing data, and estimation issues. We also develop a procedure and associated R program for gauging the practical significance of the violations of invariance. We illustrate these issues with an empirical example using a subscale from the Mexican American Cultural Values scale. Finally, we provide comparisons of the current capabilities of 3 major latent variable programs (lavaan, Mplus, OpenMx) and computer scripts for addressing longitudinal measurement invariance. (PsycINFO Database Record

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Integrity signals

Registry

Crossref · 10.1037/met0000075

Cites

42 of 43 references verified1 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Comparative fit indexes in structural models.
Bentler, P. M. (1990) · Psychological Bulletin · doi:10.1037/0033-2909.107.2.238 · Cited by 25,266
Significance tests and goodness of fit in the analysis of covariance structures.
Bentler, P. M., & Bonett, D. G. (1980) · Psychological Bulletin · doi:10.1037/0033-2909.88.3.588 · Cited by 20,015
Evaluating Goodness-of-Fit Indexes for Testing Measurement Invariance
Cheung, G. W., & Rensvold, R. B. (2002) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1207/s15328007sem0902_5 · Cited by 16,280
Sensitivity of Goodness of Fit Indexes to Lack of Measurement Invariance
Chen, F. F. (2007) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1080/10705510701301834 · Cited by 12,217
Inference and missing data
RUBIN, D. B. (1976) · Biometrika · doi:10.1093/biomet/63.3.581 · Cited by 9,925
A Reliability Coefficient for Maximum Likelihood Factor Analysis
Tucker, L. R., & Lewis, C. (1973) · Psychometrika · doi:10.1007/bf02291170 · Cited by 7,330 · cited 1×
“…measurement invariance used by standard statistical packages to calculate the CFI (and other relative fit indices like the TuckerLewis index; Tucker & Lewis, 1973) places no constraint on the mean structure or the unique factor structure, and becomes an inappropriate comparison model (cf.…”
Missing data analysis: making it work in the real world
Graham, J. W. (2009) · Annual Review of Psychology · doi:10.1146/annurev.psych.58.110405.085530 · Cited by 6,163
A scaled difference chi-square test statistic for moment structure analysis
Satorra, A., & Bentler, P. M. (2001) · Psychometrika · doi:10.1007/bf02296192 · Cited by 5,282
Principles and practice in reporting structural equation analyses.
McDonald, R. P., & Ho, M.-H. R. (2002) · Psychological Methods · doi:10.1037/1082-989x.7.1.64 · Cited by 4,734 · cited 1×
“Thus, it is important to also examine local fit indices (residuals; modification indices; cf. McDonald & Ho, 2002).”
Measurement Invariance, Factor Analysis and Factorial Invariance
Meredith, W. (1993) · Psychometrika · doi:10.1007/bf02294825 · Cited by 4,536

Flagged first, then by citations

Show all 15 references

Research works printed but not linked: 9

Bollen KA 1989 Structural equations with latent variables New York Wiley
Browne MW Arminger G 1995 Specification and estimation of mean-and covariance-structure models Arminger G Clogg CC Sobel ME Handbook of statistical modeling for the social and behavioral sciences 185 249 New York Springer
Grimm KJ Ram N Estabrook R in press Growth modeling: An illustrative approach New York Guilford Press
Millsap RE 2011 Statistical approaches to measurement invariance New York Routledge
Mislevy RJ in press Missing responses in item response theory van der Linden WJ Hambleton RK Handbook of modern item response theory 2 2 Boca Raton, FL Chapman & Hall/CRC Press
Rosseel Y 2012 lavaan: An R package for structural equation modeling Journal of Statistical Software 48 2 1 36 http://www.jstatsoft.org/v48/i02/
Rubin DB 1987 Multiple imputation for nonresponse in surveys New York J. Wiley & Sons
Samejima F 1969 Estimation of latent ability using a response pattern of graded scores Psychometric Monograph No. 17 Richmond, VA Psychometric Society Retrieved from http://www.psychometrika.org/journal/online/MN17.pdf
Wirth RJ 2008 The effects of measurement non-invariance on parameter estimation in latent growth models Doctoral dissertation Retrieved from ProQuest dissertation and theses database. (UMI No. 3331053)

Sorted by citations

Items 301–358 of 358

Examining Items’ Suitability as the Marker Indicator in Testing Measurement Invariance
Charalampi, A., Michalopoulou, C., & Richardson, C. (2022) · The Springer series on demographic methods and population analysis · doi:10.1007/978-3-030-93005-9_25
Estimating longitudinal change in latent variable means: a comparison of non-negative matrix factorization and other item non-response methods
Ayilara, O. F., Sajobi, T. T., Barclay, R., Jozani, M. J., & Lix, L. M. (2022) · Journal of Statistical Computation and Simulation · doi:10.1080/00949655.2022.2098499
Interessenentwicklung im Kontext von Klassenprofilierung in der Sekundarstufe I
Krieg, M. (2022) · Erziehungswissenschaftliche Studien · doi:10.17875/gup2022-1950
Primary-School Students’ Motivational Profiles: Stability, Antecedents, and Connections with Arithmetic AchievementPreprint
Rawlings, A. M., Aunola, K., Koponen, T. K., Poikkeus, A., Lerkkanen, M., & Vasalampi, K. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4628060
preprint1_primary_students_motivational_profilesPreprint
Rawlings, A. M., Aunola, K., Koponen, T. K., Poikkeus, A., Lerkkanen, M., & Vasalampi, K. (2023) · doi:10.31234/osf.io/wk7qe
Estimating the dimensionality of learning: The model for decomposed change
Federiakin, D. A., Zlatkin‐Troitschanskaia, O., & Walstad, W. B. (2024) · Studies In Educational Evaluation · doi:10.1016/j.stueduc.2024.101377
Adolescence Mental Health in School and University
(2024) · Frontiers research topics · doi:10.3389/978-2-8325-5237-7
The Between-Not-Within fallacy coined and exemplified: why studying a within-person uniform measurement bias is driven by between-person differences in intensive longitudinal dataPreprint
Krammer, G. (2024) · doi:10.31219/osf.io/7x8sg
Psychometric Properties of the Spanish Version of the Cannabis Refusal Self-Efficacy Questionnaire (S-CRSEQ) in Young Adults Who Use CannabisPreprint
González‐Ponce, B. M., Carmona, J., Lozano, O. M., & Fernández‐Calderón, F. (2024) · doi:10.31219/osf.io/nkb8q
Further Validation of the Triarchic Model of Grit Scale (TMGS) in Chinese Adolescents
Gong, J., Bei, D.-L., Pi, D.-L., & Luo, J. (2024) · Journal of Personality Assessment · doi:10.1080/00223891.2024.2430318
Testing the incongruence model with longitudinal data: How employment status preferences affect mental health over time
Paul, K. I., Zechmann, A., Mlynek, M., Stiglbauer, B., Batinic, B., Moser, K., & Selenko, E. (2024) · Journal of Occupational and Organizational Psychology · doi:10.1111/joop.12562
Testing Measurement Invariance Across Time and Groups of Emerging Adults
Ni, Y. (., Manapat, D., Infurna, F. J., & Grimm, K. J. (2024) · Oxford University Press eBooks · doi:10.1093/oso/9780197677797.003.0013
Self-citation
Invariância Longitudinal e Entre Sexos no Questionário de Gratidão: Exemplificando o Processo
Souza, J. F. L. P. D., & Zanon, C. (2024) · Interação em Psicologia · doi:10.5380/riep.v28i2.88765
Longitudinal Measurement Invariance of the Parenting Sense of Competence (PSoC): Evidence to Question Its Use?
Gridley, N., Mooney, K. E., Blower, S. L., Meléndez‐Torres, G. J., Berry, V., & Bywater, T. J. (2024) · Child Care Health and Development · doi:10.1111/cch.70030
Turkish adaptation of the digital literacy scale: A rasch analysis
Yang, H., Alanoğlu, M., Karabatak, S., & Bradley, K. D. (2025) · International Journal of Assessment Tools in Education · doi:10.21449/ijate.1545220
Change in Child and Adolescent Needs and Strengths (CANS) scores over time among children and youth in out-of-home care: A latent growth curve analysis
Tomlinson, C. A., Collins‐Camargo, C., Minton, L., & Winters, A. M. (2025) · Child Abuse & Neglect · doi:10.1016/j.chiabu.2025.107350
Longitudinal relations between mathematics self-efficacy, test anxiety, and performance in co- and solo-taught classroomsPreprint
Lehikoinen, H., Tuominen, H., Väisänen, P., Niemivirta, M., & Viljaranta, J. (2024) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/8ngz7_v1
Depressive symptoms predict divergent trajectories of well-being in US adults
Lyman, C., Ong, A. D., & Rottenberg, J. A. (2026) · Nature Mental Health · doi:10.1038/s44220-026-00705-6
Evaluating a Hierarchical Structural Model of Psychopathology Symptoms Across Pregnancy and the Postpartum PeriodPreprint
Brandes, C. M., Clark, H. M., Demers, C. H., Davis, E. P., & Hankin, B. L. (2025) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/t5sav_v2
Neurobehavioral disorders after severe acquired brain injury: Discrepancies between patients and caregivers’ perception
Basagni, B., Abbruzzese, L., Mancuso, M., Magnani, N., Virzì, A. T., Zoccolotti, P., Zuffianò, A., & The BIRT Italian group (2025) · The Clinical Neuropsychologist · doi:10.1080/13854046.2025.2567466
Assessment of Longitudinal Measurement Invariance of Short Versions of the CES-D in Maternal Caregivers
Villalobos-Gallegos, L., Trejo, S., Cruz, D. M., Toledo-Fernández, A., & González-García, D. A. (2025) · Psychiatry International · doi:10.3390/psychiatryint6040126
Longitudinal Measurement Invariance Testing of the Model Minority Stereotype Response Scale Among Asian American STEM Students
Suh, H. N., & Kim, B. S. K. (2025) · Journal of Psychoeducational Assessment · doi:10.1177/07342829251395913
Additional file 2 of Disentangling change across the time and true stability of employees’ resilience using latent state model
Ollis, L., Cropley, M., Plans, D., & Cogo‐Moreira, H. (2022) · Figshare · doi:10.6084/m9.figshare.21376377
Additional file 4 of Longitudinal measurement invariance in urbanization index of Chinese communities across 2000 and 2015: a Bayesian approximate measurement invariance approach
Fong, T. C. T., & Ho, R. T. H. (2021) · Figshare · doi:10.6084/m9.figshare.16606943
Additional file 1 of Disentangling change across the time and true stability of employees’ resilience using latent state model
Ollis, L., Cropley, M., Plans, D., & Cogo‐Moreira, H. (2022) · Figshare · doi:10.6084/m9.figshare.21376374
Additional file 2 of Longitudinal measurement invariance in urbanization index of Chinese communities across 2000 and 2015: a Bayesian approximate measurement invariance approach
Fong, T. C. T., & Ho, R. T. H. (2021) · Figshare · doi:10.6084/m9.figshare.16606937
Additional file 3 of Longitudinal measurement invariance in urbanization index of Chinese communities across 2000 and 2015: a Bayesian approximate measurement invariance approach
Fong, T. C. T., & Ho, R. T. H. (2021) · Figshare · doi:10.6084/m9.figshare.16606940
Additional file 1 of Factor structure and measurement invariance of the 8-item CES-D: a national longitudinal sample of Chinese adolescents
Liu, S., Fang, Y., Su, Z., Cai, J., & Chen, Z. (2024) · Figshare · doi:10.6084/m9.figshare.26643868
Responsiveness correlations involving ordinal clinical outcomes assessment scores
Rockwood, N., Qin, S., & Yarr, S. (2026) · Advances in Patient-Reported Outcomes · doi:10.1016/j.apro.2026.100318
Predictors of State and Trait Components of Depression From Early Adolescence Into Emerging Adulthood
Schlechter, P., Ford, T. J., Wilkinson, P. O., & Neufeld, S. (2026) · Clinical Psychological Science · doi:10.1177/21677026261422140
Validation of a health literacy assessment tool in a nationwide population: a measurement invariance study using confirmatory factor analysis and multiple-group latent class analysis
Lee, H., & Han, J. (2026) · BMC Public Health · doi:10.1186/s12889-026-26910-7
Improving the Evaluation of Construct Change Over Time: Advantages of Longitudinal Moderated Nonlinear Factor Analysis Over Conventional First-Order Growth Models
Chen, S. M., & Bauer, D. J. (2026) · Multivariate Behavioral Research · doi:10.1080/00273171.2026.2640576
Détresse psychologique, image du corps et qualité de vie des patients atteints d’un cancer du rectum traités par chirurgie avec stomie temporaire : construction et mise à l’épreuve d’une intervention psycho-sociale
Faury, S. (2018) · theses.fr (ABES) · doi:10.70675/23de06ecze7dez447czbd48z1df044475a52
Assessing the psychometric properties of the Youth Externalizing Problems Screener (YEPS) in peruvian adolescents
Millones, D. L. M., Peña-Calero, B. N., Paredes-Valencia, G. J., Martínez-Camacho, M. L., Alcedo, J. M. G., Villarreal‐Zegarra, D., & Wiium, N. (2026) · BMC Psychology · doi:10.1186/s40359-026-04495-5
Adaptation and Validation of the 14-Item Religious and Spiritual Struggles Scale Among Russian Orthodox Christian Women
Shankov, F., Böttche, M., & Lotzin, A. (2026) · Journal of Religion and Health · doi:10.1007/s10943-026-02645-y
Factor structure and measurement invariance of the EuroQol 5-dimensional questionnaire: a secondary analysis of the Korea Health Panel survey
Park, B., & Choi, H. (2026) · Osong Public Health and Research Perspectives · doi:10.24171/j.phrp.2025.0440
Comparison of Commonly Applied Outcome Inventories as Measures of General Internalizing Pathology in Psychological Therapies
Lintula, S. J., Saarni, S. E., Barkham, M., & Rosenström, T. H. (2026) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.70270
The German Workplace FoMO Scale: A psychometrically valid instrument for assessing Workplace Fear of Missing Out among German‐Speaking professionals
Ebner, K., Souček, R., & Iliescu, D. (2026) · Applied Psychology · doi:10.1111/apps.70095
Escala de Estrés Laboral de la OIT-OMS en Trabajadores de la Macroregión Sur del Perú: Propuesta de una Versión Breve
Gallegos, W. L. A., Caycho-Caja, A., Núñez, E. M., Achahuanco, D. G. Á., Caballero, J. L. V., & Rivera, R. (2026) · Revista Interamericana de Psicología Ocupacional · doi:10.71332/kjrwjk04
Evaluating the Longitudinal Measurement Properties of the Social Media Disorder Scale in Early Adolescents: Associations with Depressive Symptoms and Health-Related Behaviors
Spyropoulou, E., & Mastrotheodoros, S. (2026) · Journal of Psychopathology and Behavioral Assessment · doi:10.1007/s10862-026-10306-3
Self-development inquiry (SDi) scale: a process-oriented measure of psychological integration in an organismic-transpersonal framework
Bronlet, X., & Lattuada, P. L. (2026) · Frontiers in Psychology · doi:10.3389/fpsyg.2026.1834600
Socio‐emotional dynamics across one year of lower secondary education: A one‐year cross‐lagged panel study and links to achievement
Schlesier, J., & Obermeier, R. (2026) · British Journal of Educational Psychology · doi:10.1111/bjep.70116
Reply to “Person separation and longitudinal invariance: overlooked considerations in validating generic QOL instruments for non-dialysis CKD”
Lin, C., Lin, C., Wang, J.-D., & Sung, J. (2026) · Journal of the Formosan Medical Association · doi:10.1016/j.jfma.2026.08.013
Divergent Trajectories of Teacher Enthusiasm Perceptions: A Longitudinal Study of Second Language Learners
Vo, H., Ho, H., & Mai, D. (2026) · European Journal of Education · doi:10.1111/ejed.70837
Expert consensus: Considerations for developmental scientists working with puberty data longitudinally in humans
McCann, C. F., Byrne, M. L., Barendse, M. E. A., Shirtcliff, E. A., Herting, M. M., Bottenhorn, K. L., Dahl, R. E., Goddings, A., Williamson, V. G., Ladouceur, C. D., et al. (2026) · Frontiers in Neuroendocrinology · doi:10.1016/j.yfrne.2026.101284
Integrated Psychometric Evaluation of the Self-Report SDQ Emotional Problems Scale Across Adolescence
Morin, A. H., Frostad, P., & Haugan, J. A. (2026) · European Journal of Psychological Assessment · doi:10.1027/1015-5759/a000966
Aesthetic experience as a candidate process linking group art therapy to social anxiety relief: a randomized trial with repeated process assessment
Long, W., Luo, Y., Du, J., & Tang, Y. (2026) · Frontiers in Psychology · doi:10.3389/fpsyg.2026.1953607
Longitudinal measurement invariance of the Psychotic-Like Experiences Questionnaire for Children (PLEQ-C)
Purdon, R. C., Carpendale, E. J., & Laurens, K. R. (2026) · Schizophrenia Research · doi:10.1016/j.schres.2026.09.003
Within‐person dynamics of identity‐based discrimination, life satisfaction, self‐esteem, and social support among multicultural adolescents in South Korea
Choe, D., & Oh, H. (2026) · Journal of Research on Adolescence · doi:10.1111/jora.70280
Finding salvage in standardization? Structural and longitudinal evaluation of the patient health questionnaire anxiety and depression scale in a UK representative sample
Crawford, J. J., & Adamson, G. (2026) · British Journal of Clinical Psychology · doi:10.1111/bjc.70103
Establishing Measurement Invariance Over Time to Enable Data Harmonization: A Case Study in Environmental Health to Harmonize PFAS Burden Scores from 1999 to 2020
Feuerstahler, L. M., Chen, Y., & Liu, S. H. (2026) · Measurement Interdisciplinary Research and Perspectives · doi:10.1080/15366367.2026.2741155
Italian adaptation and validation of the International Cognitive Ability Resource 16 sample test
Tolomeo, E., Ceraudo, L., Balducci, M., & Liuzza, M. T. (2026) · Frontiers in Psychology · doi:10.3389/fpsyg.2026.1998035
Small Enough to Use, Sharper Together: VQIDS and FIRM in U.S. Youth Ages 6–18Preprint
Algorta, G. P., Li, L. Y., Liu, Y., Youngstrom, E. A., Rodda, P. A., & Rush, A. J. (2026) · medRxiv · doi:10.64898/2026.10.13.26365411
Self-citation
Latent Growth Modeling Trajectories of Cultural Values and Parental Monitoring as Predictors of Alcohol, Cigarette, and Drug Use Initiation Among Mexican-Origin Youth
Hernandez, C. M., Bravo, A. J., Bermejo-McGee, O., Riofrio, I., Clark, J. D., Cobb, C. O., Robins, R. W., & Moreno, O. (2026) · Behavioral Medicine · doi:10.1080/08964289.2026.2646503
Measuring change in mathematics enjoyment: longitudinal invariance, local dependence of negatively worded items, and complex-sample inference
Sideridis, G. D., & Alghamdi, M. (2026) · Frontiers in Psychology · doi:10.3389/fpsyg.2026.1971121
Dimensional Structure of PTSD, Anxiety, and Depression Symptoms in Treatment-Seeking First Responders
Maguire, E. R., de Andrade, T. M., & Potts-Arnell, P. (2026) · Journal of Psychopathology and Behavioral Assessment · doi:10.1007/s10862-026-10328-x
From Writer's Block to Clarity: Enhancing Argumentative Writing and Metacognition in ESP Students through AI-Augmented Flipped Learning
Salem, A. A. M. S. (2026) · Journal of language and Education · doi:10.17323/jle.2026.28227
Measurement Invariance and Prevalence of Sexual Harassment Among University Students in Jordan
Spencer, R. A., Yount, K. M., Hadd, A. R., Essaid, A. A., Taleb, R. A., Sajdi, J., Batayeh, B., Bergenfeld, I., & Clark, C. J. (2026) · Archives of Sexual Behavior · doi:10.1007/s10508-026-03541-y

Authors: Liu, Y., Millsap, R. E., West, S. G., Tein, J.-Y., Tanaka, R., & Grimm, K. J.
Affiliations: Arizona State University (US)
University Health Network (CA)
ORCID: Liu, Yu
Millsap, Roger E.
Tein, Jenn-Yun
Tanaka, Rika
Grimm, Kevin J.
Venue: Psychological Methods
Publisher: American Psychological Association (APA)
Published: 2017-09
Volume: 22
Issue: 3
Pages: 486-506
ISSN: 1082-989X (ISSN-L)
1939-1463
DOI: 10.1037/met0000075
PMC: PMC5121102
OpenAlex: W2395889112
Cited by: 351
References: 15
Citations by year: 2026: 45 · 2025: 32 · 2024: 45 · 2023: 49 · 2022: 46 · 2021: 53 · 2020: 36 · 2019: 20 · 2018: 15 · 2017: 6
FWCI: 16.08
Type: journal article
Language: en
Open access: hybrid
doi.org
Licence: other-oa
www.apa.org/pubs/journals/resources/open-access.aspx (am)
Locations: Psychological Methods (publishedVersion, other-oa)
PubMed (publishedVersion)
Europe PMC (PubMed Central) (acceptedVersion)
PubMed Central (acceptedVersion)
Funders: National Institute of Mental Health (R01 MH68920)
Topics: Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
Social Sciences › Psychology › Experimental and Cognitive Psychology › Mental Health Research Topics
Keywords: measurement invariance, longitudinal data, factor models, system identification, data sparsity, missing data, developmental research
MeSH terms: Data Interpretation, Statistical, Factor Analysis, Statistical, Humans, Individuality, Longitudinal Studies, Models, Statistical

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Testing measurement invariance in longitudinal data with ordered-categorical measures.

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Self-check

Citations

Cites

Cited by

Related

Metadata

Record

About these checks