Cited by 358Psychometric Methodologies and TestingStatistical Methods and Bayesian InferenceMental Health Research Topics

The DOI matches its Crossref record; 42 of the 43 references it cites were found in a registry or an index.

Testing measurement invariance in longitudinal data with ordered-categorical measures.

Open access

Liu, Yu, Millsap, Roger E., West, Stephen G., Tein, Jenn-Yun, Tanaka, Rika, Grimm, Kevin J.·2017·Psychological Methods

DOI 10.1037/met0000075PMC PMC5121102

Open this paper in CoChat — free account

Abstract

A goal of developmental research is to examine individual changes in constructs over time. The accuracy of the models answering such research questions hinges on the assumption of longitudinal measurement invariance: The repeatedly measured variables need to represent the same construct in the same metric over time. Measurement invariance can be studied through factor models examining the relations between the observed indicators and the latent constructs. In longitudinal research, ordered-categorical indicators such as self- or observer-report Likert scales are commonly used, and these measures often do not approximate continuous normal distributions. The present didactic article extends previous work on measurement invariance to the longitudinal case for ordered-categorical indicators. We address a number of problems that commonly arise in testing measurement invariance with longitudinal data, including model identification and interpretation, sparse data, missing data, and estimation issues. We also develop a procedure and associated R program for gauging the practical significance of the violations of invariance. We illustrate these issues with an empirical example using a subscale from the Mexican American Cultural Values scale. Finally, we provide comparisons of the current capabilities of 3 major latent variable programs (lavaan, Mplus, OpenMx) and computer scripts for addressing longitudinal measurement invariance. (PsycINFO Database Record

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Integrity signals

Registry

Crossref · 10.1037/met0000075

Cites

42 of 43 references verified1 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Comparative fit indexes in structural models.
Bentler, P. M. (1990) · Psychological Bulletin · doi:10.1037/0033-2909.107.2.238 · Cited by 25,266
Significance tests and goodness of fit in the analysis of covariance structures.
Bentler, P. M., & Bonett, D. G. (1980) · Psychological Bulletin · doi:10.1037/0033-2909.88.3.588 · Cited by 20,015
Evaluating Goodness-of-Fit Indexes for Testing Measurement Invariance
Cheung, G. W., & Rensvold, R. B. (2002) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1207/s15328007sem0902_5 · Cited by 16,280
Sensitivity of Goodness of Fit Indexes to Lack of Measurement Invariance
Chen, F. F. (2007) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1080/10705510701301834 · Cited by 12,217
Inference and missing data
RUBIN, D. B. (1976) · Biometrika · doi:10.1093/biomet/63.3.581 · Cited by 9,925
A Reliability Coefficient for Maximum Likelihood Factor Analysis
Tucker, L. R., & Lewis, C. (1973) · Psychometrika · doi:10.1007/bf02291170 · Cited by 7,330 · cited 1×
“…measurement invariance used by standard statistical packages to calculate the CFI (and other relative fit indices like the TuckerLewis index; Tucker & Lewis, 1973) places no constraint on the mean structure or the unique factor structure, and becomes an inappropriate comparison model (cf.…”
Missing data analysis: making it work in the real world
Graham, J. W. (2009) · Annual Review of Psychology · doi:10.1146/annurev.psych.58.110405.085530 · Cited by 6,163
A scaled difference chi-square test statistic for moment structure analysis
Satorra, A., & Bentler, P. M. (2001) · Psychometrika · doi:10.1007/bf02296192 · Cited by 5,282
Principles and practice in reporting structural equation analyses.
McDonald, R. P., & Ho, M.-H. R. (2002) · Psychological Methods · doi:10.1037/1082-989x.7.1.64 · Cited by 4,734 · cited 1×
“Thus, it is important to also examine local fit indices (residuals; modification indices; cf. McDonald & Ho, 2002).”
Measurement Invariance, Factor Analysis and Factorial Invariance
Meredith, W. (1993) · Psychometrika · doi:10.1007/bf02294825 · Cited by 4,536

Show all 15 references

Research works printed but not linked: 9

Bollen KA 1989 Structural equations with latent variables New York Wiley
Browne MW Arminger G 1995 Specification and estimation of mean-and covariance-structure models Arminger G Clogg CC Sobel ME Handbook of statistical modeling for the social and behavioral sciences 185 249 New York Springer
Grimm KJ Ram N Estabrook R in press Growth modeling: An illustrative approach New York Guilford Press
Millsap RE 2011 Statistical approaches to measurement invariance New York Routledge
Mislevy RJ in press Missing responses in item response theory van der Linden WJ Hambleton RK Handbook of modern item response theory 2 2 Boca Raton, FL Chapman & Hall/CRC Press
Rosseel Y 2012 lavaan: An R package for structural equation modeling Journal of Statistical Software 48 2 1 36 http://www.jstatsoft.org/v48/i02/
Rubin DB 1987 Multiple imputation for nonresponse in surveys New York J. Wiley & Sons
Samejima F 1969 Estimation of latent ability using a response pattern of graded scores Psychometric Monograph No. 17 Richmond, VA Psychometric Society Retrieved from http://www.psychometrika.org/journal/online/MN17.pdf
Wirth RJ 2008 The effects of measurement non-invariance on parameter estimation in latent growth models Doctoral dissertation Retrieved from ProQuest dissertation and theses database. (UMI No. 3331053)

Sorted by citations

semTools: Useful Tools for Structural Equation Modeling
Jorgensen, T. D., Pornprasertmanit, S., Schoemann, A. M., & Rosseel, Y. (2012) · doi:10.32614/cran.package.semtools · Cited by 664
Relations among teachers’ self-efficacy beliefs, engagement, and work satisfaction: a social cognitive view.
Granziera, H., & Perera, H. N. (2019) · Contemporary Educational Psychology · doi:10.1016/j.cedpsych.2019.02.003 · Cited by 281
Cognitive appraisals, achievement emotions, and students’ math achievement: A longitudinal analysis.
Forsblom, L., Pekrun, R. H., Stockinger, K., & Peixoto, F. (2021) · Journal of Educational Psychology · doi:10.1037/edu0000671 · Cited by 287
Are robots becoming unpopular? Changes in attitudes towards autonomous robotic systems in Europe
Gnambs, T., & Appel, M. (2018) · Computers in Human Behavior · doi:10.1016/j.chb.2018.11.045 · Cited by 256
Evaluation of Pressing Issues in Ecological Momentary Assessment
Stone, A. A., Schneider, S., & Smyth, J. M. (2022) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-080921-083128 · Cited by 247
Relations among math self efficacy, interest, intentions, and achievement: A social cognitive perspective
Grigg, S., Perera, H. N., McIlveen, P., & Svetleff, Z. (2018) · Contemporary Educational Psychology · doi:10.1016/j.cedpsych.2018.01.007 · Cited by 180
A Critical Evaluation of the Reflective Functioning Questionnaire (RFQ)
Müller, S., Wendt, L. P., Spitzer, C., Masuhr, O., Back, S. N., & Zimmermann, J. (2022) · Journal of Personality Assessment · doi:10.1080/00223891.2021.1981346 · Cited by 138
The development of emotional and behavioral self-regulation and their effects on academic achievement in childhood
Edossa, A. K., Schroeders, U., Weinert, S., & Artelt, C. (2017) · International Journal of Behavioral Development · doi:10.1177/0165025416687412 · Cited by 159
Towards an integrative perspective on the structure of teacher work engagement
Perera, H. N., Vosicka, L., Granziera, H., & McIlveen, P. (2018) · Journal of Vocational Behavior · doi:10.1016/j.jvb.2018.05.006 · Cited by 110
Short Index of Job Satisfaction: Validity evidence from Portugal and Brazil
Sinval, J., & Marôco, J. P. (2020) · PLoS ONE · doi:10.1371/journal.pone.0231474 · Cited by 132
A Longitudinal and Gender Invariance Analysis of the Strengths and Difficulties Questionnaire Across Ages 3, 5, 7, 11, 14, and 17 in a Large U.K.-Representative Sample
Murray, A. L., Speyer, L. G., Hall, H. A., Valdebenito, S., & Hughes, C. H. (2021) · Assessment · doi:10.1177/10731911211009312 · Cited by 86
Teacher Versus Parent Informant Measurement Invariance of the Strengths and Difficulties Questionnaire
Murray, A., Speyer, L., Hall, H. A., Valdebenito, S., & Hughes, C. (2021) · Journal of Pediatric Psychology · doi:10.1093/jpepsy/jsab062 · Cited by 47
Factor structure of the Chinese CES-D and invariance analyses across gender and over time among Chinese adolescents
Zhu, X., Shek, D. T. L., & Dou, D. (2021) · Journal of Affective Disorders · doi:10.1016/j.jad.2021.08.122 · Cited by 79
Development of subjective well‐being and its relationship with self‐esteem in early adolescence
Katsantonis, I., McLellan, R., & Marquez, J. (2022) · British Journal of Developmental Psychology · doi:10.1111/bjdp.12436 · Cited by 87
How we ask matters: The impact of question wording in single-item measurement of suicidal thoughts and behaviors
Ammerman, B. A., Burke, T. A., Jacobucci, R., & McClure, K. E. (2021) · Preventive Medicine · doi:10.1016/j.ypmed.2021.106472 · Cited by 78
It's the therapist and the treatment: The structure of common therapeutic relationship factors
Finsrud, I., Nissen‐Lie, H. A., Vrabel, K. R., Høstmælingen, A., Wampold, B. E., & Ulvenes, P. (2021) · Psychotherapy Research · doi:10.1080/10503307.2021.1916640 · Cited by 70
Revisiting the dimensionality of subjective task value: Towards clarification of competing perspectives
Part, R., Perera, H. N., Marchand, G. C., & Bernacki, M. L. (2020) · Contemporary Educational Psychology · doi:10.1016/j.cedpsych.2020.101875 · Cited by 70
Posttraumatic stress disorder and loneliness are associated over time: A longitudinal study on PTSD symptoms and loneliness, among older adults
Fox, R. J., Power, J. M., Coogan, A. N., Beekman, A. T. F., van Tilburg, T. G., & Hyland, P. (2021) · Psychiatry Research · doi:10.1016/j.psychres.2021.113846 · Cited by 71
Trajectories of sleep problems in childhood: associations with mental health in adolescence
Shimizu, M., Zeringue, M. M., Erath, S. A., Hinnant, J. B., & El‐Sheikh, M. (2020) · SLEEP · doi:10.1093/sleep/zsaa190 · Cited by 65
Why do individuals suffer during unemployment? Analyzing the role of deprived psychological needs in a six-wave longitudinal study.
Zechmann, A., & Paul, K. I. (2019) · Journal of Occupational Health Psychology · doi:10.1037/ocp0000154 · Cited by 72
Coping with the COVID-19 Pandemic: Perceived Changes in Psychological Vulnerability, Resilience and Social Cohesion before, during and after Lockdown
Silveira, S., Hecht, M., Matthaeus, H., Adli, M., Voelkle, M. C., & Singer, T. (2022) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph19063290 · Cited by 60
A Psychometric Analysis of the Social Anxiety Scale for Adolescents Among Youth With Autism Spectrum Disorder: Caregiver–Adolescent Agreement, Factor Structure, and Validity
Schiltz, H. K., Magnus, B. E., McVey, A. J., Haendel, A. D., Dolan, B. K., Stanley, R. E., Willar, K. S., Pleiss, S. S., Carson, A. M., Carlson, M., et al. (2019) · Assessment · doi:10.1177/1073191119851563 · Cited by 59
The when and what of measuring ECE quality: Analysis of variation in the Classroom Assessment Scoring System (CLASS) across the ECE day
Thorpe, K. J., Rankin, P. S., Beatton, T., Houen, S., Sandi, M., Siraj, I., & Staton, S. (2020) · Early Childhood Research Quarterly · doi:10.1016/j.ecresq.2020.05.003 · Cited by 57
Curve of Factors Model: A Latent Growth Modeling Approach for Educational Research
Isiordia, M., & Ferrer, E. E. (2016) · Educational and Psychological Measurement · doi:10.1177/0013164416677143 · Cited by 58
Child maltreatment and the risk of antisocial behaviour: A population-based cohort study spanning 50 years
Esposti, M. D., Pereira, S. M. P., Humphreys, D. K., Sale, R. D., & Bowes, L. (2019) · Child Abuse & Neglect · doi:10.1016/j.chiabu.2019.104281 · Cited by 62
Critical examination of current response shift methods and proposal for advancing new methods
Sebille, V., Lix, L. M., Ayilara, O. F., Sajobi, T. T., Janssens, A. C. J. W., Sawatzky, R. G., Sprangers, M. A. G., Verdam, M. G. E., & the Response Shift – in Sync Working Group (2021) · Quality of Life Research · doi:10.1007/s11136-020-02755-4 · Cited by 51
Challenging the “static” quo: Trajectories of engagement in team processes toward a deadline.
Larson, N., McLarnon, M. J. W., & O’Neill, T. (2020) · Journal of Applied Psychology · doi:10.1037/apl0000479 · Cited by 54
Testing Measurement Invariance with Ordinal Missing Data: A Comparison of Estimators and Missing Data Techniques
Chen, P., Wu, W., Garnier‐Villarreal, M., Kite, B. A., & Jia, F. (2019) · Multivariate Behavioral Research · doi:10.1080/00273171.2019.1608799 · Cited by 47
We do not measure what we aim to measure: Testing Three Measurement Models for Nationalism and Patriotism
Mußotter, M. (2021) · Quality & Quantity · doi:10.1007/s11135-021-01212-9 · Cited by 47
The reciprocal relationship among Chinese senior secondary students’ intrinsic and extrinsic motivation and cognitive engagement in learning mathematics: a three-wave longitudinal study
Zhang, Y., Yang, X., Sun, X., & Kaiser, G. (2023) · ZDM · doi:10.1007/s11858-022-01465-0 · Cited by 46
Konfirmatorische Faktorenanalyse (CFA)
Gäde, J. C., Schermelleh-Engel, K., & Brandt, H. (2020) · Springer eBooks · doi:10.1007/978-3-662-61532-4_24 · Cited by 59
The impact of COVID-19 lockdown stringency on loneliness in five European countries
Caro, J. C., Clark, A. E., D’Ambrosio, C., & Vögele, C. (2022) · Social Science & Medicine · doi:10.1016/j.socscimed.2022.115492 · Cited by 49
Developmental trajectories of second language learner classroom engagement: Do students’ task value beliefs and teacher emotional support matter?
Vo, H., Hoang, H., & Hu, G. (2024) · System · doi:10.1016/j.system.2024.103325 · Cited by 44
Testing the Longitudinal Structure and Change in Sluggish Cognitive Tempo and Inattentive Behaviors From Early Through Middle Childhood
Dvorsky, M. R., Becker, S. P., Tamm, L., & Willoughby, M. T. (2021) · Assessment · doi:10.1177/1073191119872247 · Cited by 43
The Eight-Item Center for Epidemiological Studies Depression Scale in the English Longitudinal Study of Aging: Longitudinal and Gender Invariance, Sum Score Models, and External Associations
Schlechter, P., Ford, T. J., & Neufeld, S. (2022) · Assessment · doi:10.1177/10731911221138930 · Cited by 43
Perceived classroom support: Longitudinal effects on students' achievement emotions
Forsblom, L., Peixoto, F., & Mata, L. (2020) · Learning and Individual Differences · doi:10.1016/j.lindif.2020.101959 · Cited by 45
Identifying reciprocities in school motivation research: A review of issues and solutions associated with cross-lagged effects models.
Núñez‐Regueiro, F., Juhel, J., Bressoux, P., & Nurra, C. (2021) · Journal of Educational Psychology · doi:10.1037/edu0000700 · Cited by 47
Does strict invariance matter? Valid group mean comparisons with ordered-categorical items
Tse, W. W.-Y., Lai, M. H. C., & Zhang, Y. (2023) · Behavior Research Methods · doi:10.3758/s13428-023-02247-6 · Cited by 42
Sources of variability in the prospective relation of language to social, emotional, and behavior problem symptoms: Implications for developmental language disorder.
Yew, S. G. K., the SCALES Team, Griffiths, S., & Norbury, C. (2021) · Journal of Abnormal Psychology · doi:10.1037/abn0000691 · Cited by 40
Multilevel IRT analysis of the Everyday Discrimination Scale and the Racial/Ethnic Discrimination Index.
Ye, F., Cheon, Y. M., Yip, T., & Cham, H. (2021) · Psychological Assessment · doi:10.1037/pas0000906 · Cited by 39
Factor structure and measurement invariance of the 8-item CES-D: a national longitudinal sample of Chinese adolescents
Liu, S., Fang, Y., Su, Z., Cai, J., & Chen, Z. (2023) · BMC Psychiatry · doi:10.1186/s12888-023-05316-4 · Cited by 42
Further Validation of the Inventory of Callous–Unemotional Traits in Chinese Children: Cross-Informants Invariance and Longitudinal Invariance
Wang, M., Shou, Y., Liang, J., Lai, H., Zeng, H., Chen, L., & Gao, Y. (2019) · Assessment · doi:10.1177/1073191119845052 · Cited by 37
Dimensionality of the Chinese CES-D: Is It Stable across Gender, Time, and Samples?
Dou, D., Shek, D. T. L., Zhu, X., & Zhao, L. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph182211818 · Cited by 36
Deep learning on graphs for multi-omics classification of COPD
Zhuang, Y., Xing, F., Ghosh, D., Hobbs, B. D., Hersh, C. P., Banaei‐Kashani, F., Bowler, R. P., & Kechris, K. J. (2023) · PLoS ONE · doi:10.1371/journal.pone.0284563 · Cited by 34
Reading amount as a mediator between intrinsic reading motivation and reading comprehension in the early elementary grades
Soemer, A., & Schiefele, U. (2018) · Learning and Individual Differences · doi:10.1016/j.lindif.2018.06.006 · Cited by 34
Psychometric properties of the Alcohol Use Disorders Identification Test (AUDIT) across cross-cultural subgroups, genders, and sexual orientations: Findings from the International Sex Survey (ISS)
Horváth, Z., Nagy, L., Koós, M., Kraus, S. W., Demetrovics, Z., Potenza, M. N., Ballester‐Arnal, R., Batthyány, D., Bergeron, S., Billieux, J., et al. (2023) · Comprehensive Psychiatry · doi:10.1016/j.comppsych.2023.152427 · Cited by 32
Dimensionality and factorial invariance of religiosity among Christians and the religiously unaffiliated: A cross-cultural analysis based on the International Social Survey Programme
Lemos, C. M., Gore, R. J., Puga‐Gonzalez, I., & Shults, F. L. (2019) · PLoS ONE · doi:10.1371/journal.pone.0216352 · Cited by 32
Impact of disaster exposure severity: Cascading effects across parental distress, adolescent PTSD symptoms, as well as parent-child conflict and communication
Bountress, K. E., Gilmore, A. K., Metzger, I. W., Aggen, S. H., Tomko, R. L., Danielson, C. K., Williamson, V. S., Vladmirov, V., Ruggiero, K. J., & Amstadter, A. B. (2020) · Social Science & Medicine · doi:10.1016/j.socscimed.2020.113293 · Cited by 32
Impact of violations of measurement invariance in cross-lagged panel mediation models
Xu, J., Zhang, Q., & Yang, Y. (2020) · Behavior Research Methods · doi:10.3758/s13428-020-01426-z · Cited by 31
Critical Action and Ethnic–Racial Identity: Tools of Racial Resistance at the College Transition
Mathews, C. J., Durkee, M. I., & Hope, E. C. (2022) · Journal of Research on Adolescence · doi:10.1111/jora.12790 · Cited by 31
Psychological Processes Underlying the Impact of Gender-Related Discrimination on Psychological Distress in Transgender and Gender Nonconforming People.
Lloyd, J., Chalklin, V., & Bond, F. W. (2019) · Journal of Counseling Psychology · doi:10.1037/cou0000371 · Cited by 30
On Longitudinal Item Response Theory Models: A Didactic
Wang, C., & Nydick, S. W. (2019) · Journal of Educational and Behavioral Statistics · doi:10.3102/1076998619882026 · Cited by 30
Bifactor Model of the Sport Concussion Assessment Tool Symptom Checklist: Replication and Invariance Across Time in the CARE Consortium Sample
Brett, B. L., Kramer, M. D., McCrea, M., Broglio, S. P., McAllister, T. W., Nelson, L. D., Hazzard, J. B., Kelly, L. A., Ortega, J. D., Port, N., et al. (2020) · The American Journal of Sports Medicine · doi:10.1177/0363546520946056 · Cited by 30
Psychometric Properties, Factor Structure, and Gender and Educational Level Invariance of the Abbreviated Math Anxiety Scale (AMAS) in Spanish Children and Adolescents
Martín‐Puga, M. E., Justicia‐Galiano, M. J., Gómez-Pérez, M. M., & Pelegrina, S. (2020) · Assessment · doi:10.1177/1073191120980064 · Cited by 33
The EURO-D Measure of Depressive Symptoms in the Aging Population: Comparability Across European Countries and Israel
Maskileyson, D., Seddig, D., & Davidov, E. (2021) · Frontiers in Political Science · doi:10.3389/fpos.2021.665004 · Cited by 30
Adolescent leisure reading and its longitudinal association with prosocial behavior and social adjustment
Lenhart, J., Richter, T., Appel, M., & Mar, R. A. (2023) · Scientific Reports · doi:10.1038/s41598-023-35346-7 · Cited by 29
The Spanish Version of the Empathy Questionnaire (EmQue): Evidence for Longitudinal Measurement Invariance and Relationship With Emotional Regulation
Lucas‐Molina, B., Sarmento‐Henrique, R., Quintanilla, L., & Giménez‐Dasí, M. (2018) · Early Education and Development · doi:10.1080/10409289.2018.1427929 · Cited by 29
Longitudinal measurement invariance of the Satisfaction With Life Scale in adolescence
Esnaola, I., Benito, M., Antonio‐Agirre, I., Axpe, I., & de Reizábal, M. L. (2019) · Quality of Life Research · doi:10.1007/s11136-019-02224-7 · Cited by 29
Testing Measurement Invariance over Time with Intensive Longitudinal Data and Identifying a Source of Non-invariance
Kim, E., Cao, C., Liu, S., Wang, Y., & Dedrick, R. F. (2022) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1080/10705511.2022.2130331 · Cited by 28
Measuring violence against children: The adequacy of the International Society for the Prevention of Child Abuse and Neglect (ISPCAN) child abuse screening tool - Child version in 9 Balkan countries
Meinck, F., Murray, A. L., Dunne, M. P., Schmidt, P., Nikolaidis, G., Petroulaki, K., Zarokosta, F., Tsirigoti, A., Hazizaj, A., Cenko, E., et al. (2020) · Child Abuse & Neglect · doi:10.1016/j.chiabu.2020.104636 · Cited by 27
Psychometric properties of the 10-item Connor-Davidson Resilience Scale in Chinese military personnel
Tu, Z., He, J., Wang, Z., Song, M., Tian, J., Wang, C., Ba, J., & Shen, X. (2023) · Frontiers in Psychology · doi:10.3389/fpsyg.2023.1163382 · Cited by 28
Longitudinal Invariance of the Strengths and Difficulties Questionnaire Across Ages 4 to 16 in the ALSPAC Sample
Speyer, L. G., Auyeung, B., & Murray, A. L. (2023) · Assessment · doi:10.1177/10731911221128948 · Cited by 25
Life satisfaction and mental health from age 17 to 21 years in a general population sample
Marquez, J., Katsantonis, I., Sellers, R., & Knies, G. (2022) · Current Psychology · doi:10.1007/s12144-022-03685-9 · Cited by 25
Large-Scale Cognitive Assessment
Maehler, D. B., & Rammstedt, B. (2020) · Methodology of educational measurement and assessment · doi:10.1007/978-3-030-47515-4 · Cited by 28
A critical period for pandemic adaptation: The evolution of depressive symptomatology in a representative sample of adults across a 17-month period during COVID-19.
Ebrahimi, O. V., Bauer, D. J., Hoffart, A., & Johnson, S. U. (2022) · Journal of Psychopathology and Clinical Science · doi:10.1037/abn0000786 · Cited by 25
Stress development during emergency remote teaching in higher education
Obermeier, R., Gläser‐Zikuda, M., Bedenlier, S., Kammerl, R., Kopp, B., Ziegler, A., & Händel, M. (2022) · Learning and Individual Differences · doi:10.1016/j.lindif.2022.102178 · Cited by 24
Achievement emotions and arithmetic fluency – Development and parallel processes during the early school years
Rawlings, A. M., Niemivirta, M., Korhonen, J., Lindskog, M., Tuominen, H., & Mononen, R. (2023) · Learning and Instruction · doi:10.1016/j.learninstruc.2023.101776 · Cited by 29
Invariance of the Bifactor Structure of Mild Traumatic Brain Injury (mTBI) Symptoms on the Rivermead Postconcussion Symptoms Questionnaire Across Time, Demographic Characteristics, and Clinical Groups: A TRACK-TBI Study
Agtarap, S., Kramer, M. D., Campbell‐Sills, L., Yuh, E. L., Mukherjee, P., Manley, G. T., McCrea, M., DIKMEN, S. S., Giacino, J. T., Stein, M. B., et al. (2020) · Assessment · doi:10.1177/1073191120913941 · Cited by 23
Financial inadequacy and the disadvantageous changes in time perspective and goal‐striving strategies throughout life
Wang, Y., & Ford, M. T. (2020) · Journal of Organizational Behavior · doi:10.1002/job.2475 · Cited by 24
Reference Values of the QOLIBRI from General Population Samples in the United Kingdom and The Netherlands
Gorbunova, A., Zeldovich, M., Voormolen, D. C., Krenz, U., Polinder, S., Haagsma, J. A., Hagmayer, Y., Čović, A., Real, R. G. L., Asendorf, T., et al. (2020) · Journal of Clinical Medicine · doi:10.3390/jcm9072100 · Cited by 23
Measurement Invariance in Longitudinal Bifactor Models: Review and Application Based on the p Factor
Neufeld, S., Clair, M. S., Brodbeck, J., Wilkinson, P. O., Goodyer, I. M., & Jones, P. B. (2023) · Assessment · doi:10.1177/10731911231182687 · Cited by 23
The academically engaged life of mastery-oriented students: Causal ordering among positive emotions, mastery-approach goals, and academic engagement
Datu, J. A. D., Valdez, J. P. M., & Yang, W. (2021) · Revista de Psicodidáctica (English ed ) · doi:10.1016/j.psicoe.2021.02.001 · Cited by 24
Assessing the temporal stability of psychological constructs: An illustration of Type D personality, anxiety and depression
Lodder, P., Kupper, N. H. M., Mols, F., Emons, W. H. M., & Wicherts, J. M. (2022) · Journal of Research in Personality · doi:10.1016/j.jrp.2022.104299 · Cited by 28
Gender, age, and longitudinal measurement invariance of child and adolescent depression scales: A systematic review
Schlechter, P., Hillmann, M., & Neufeld, S. (2024) · Clinical Psychology Review · doi:10.1016/j.cpr.2024.102481 · Cited by 23
A latent state–trait model for analyzing states, traits, situations, method effects, and their interactions
Hintz, F. A., Geiser, C., & Shiffman, S. M. (2018) · Journal of Personality · doi:10.1111/jopy.12400 · Cited by 21
The interplay between parental behaviors and adolescents' sports-related values in understanding adolescents' dropout of organized sports activities
Jaf, D., Wagnsson, S., Skoog, T., Glatz, T., & Özdemir, M. (2023) · Psychology of sport and exercise · doi:10.1016/j.psychsport.2023.102448 · Cited by 28
I belong; hence, I engage? A cohort study of transitions between school engagement classes and academic achievement: The role of relational school climate
Katsantonis, I. (2024) · The Australian Educational Researcher · doi:10.1007/s13384-024-00698-0 · Cited by 24
Does Reassessment Enhance the Prediction of Imminent Criminal Recidivism? Replicating Lloyd et al. (2020) With High-Risk Parolees
Davies, S. T., Lloyd, C. D., & Polaschek, D. L. L. (2021) · Assessment · doi:10.1177/1073191121993216 · Cited by 19
Longitudinal Measurement Non-Invariance with Ordered-Categorical Indicators: How are the Parameters in Second-Order Latent Linear Growth Models Affected?
Liu, Y., & West, S. G. (2018) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1080/10705511.2017.1419353 · Cited by 19
Self-citation
Should different countries participating in PISA interpret socioeconomic background in the same way? A measurement invariance approach
Eryılmaz, N., Rivera-Gutiérrez, M., & Sandoval-Hernández, A. (2020) · Revista Iberoamericana de Educación · doi:10.35362/rie8413981 · Cited by 19
A Methodology for Determining and Validating Latent Factor Dimensionality of Complex Multi-Factor Science Constructs Measuring Knowledge-In-Use
Kaldaras, L., Akaeze, H., & Krajcik, J. S. (2021) · Educational Assessment · doi:10.1080/10627197.2021.1971966 · Cited by 19
Developmental Trajectories of Science Identity Beliefs: Within-Group Differences among Black, Latinx, Asian, and White Students
Puente, K., Starr, C. R., Eccles, J. S., & Simpkins, S. D. (2021) · Journal of Youth and Adolescence · doi:10.1007/s10964-021-01493-1 · Cited by 21
Comparability of (Post-Concussion) Symptoms across Time in Individuals after Traumatic Brain Injury: Results from the CENTER-TBI Study
Rivera, D., Greving, S., Arango‐Lasprilla, J. C., von Steinbüchel, N., & Zeldovich, M. (2022) · Journal of Clinical Medicine · doi:10.3390/jcm11144090 · Cited by 22
Motivation and Perceived Learning of Secondary Education History Students. Analysis of a Programme on Initial Teacher Training
Carrasco, C. J. G., Rodríguez‐Medina, J., Martínez, P. M., & Facal, R. L. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.661780 · Cited by 17
Inventory of Callous-Unemotional Traits (ICU) Factor Structure and Measurement Invariance in an Adolescent Multinational Sample
Kemp, E. C., Ray, J. V., Frick, P. J., Robertson, E., Fanti, K. A., Essau, C. A., Baroncelli, A., Ciucci, E., & Bijttebier, P. (2022) · Journal of Clinical Child & Adolescent Psychology · doi:10.1080/15374416.2022.2148531 · Cited by 17
Quality of Life after Brain Injury in Children and Adolescents (QOLIBRI-KID/ADO)—The First Disease-Specific Self-Report Questionnaire after Traumatic Brain Injury
von Steinbüchel, N., Zeldovich, M., Greving, S., Olabarrieta‐Landa, L., Krenz, U., Timmermann, D., Koerte, I. K., Bonfert, M. V., Berweck, S., Kieslich, M., et al. (2023) · Journal of Clinical Medicine · doi:10.3390/jcm12154898 · Cited by 17
How guilty and innocent suspects perceive the police and themselves: suspect interviews in Germany
May, L., Gewehr, E., Zimmermann, J., Raible, Y., & Volbert, R. (2020) · Legal and Criminological Psychology · doi:10.1111/lcrp.12184 · Cited by 17
Longitudinal analysis of the ABCD® study
Hawes, S. W., Littlefield, A. K., Lopez, D. A., Sher, K. J., Thompson, E. L., González, R., Aguinaldo, L. D., Adams, A. R., Bayat, M., Byrd, A. L., et al. (2025) · Developmental Cognitive Neuroscience · doi:10.1016/j.dcn.2025.101518 · Cited by 16
Longitudinal Linkages Between Parent-Child Discrepancies in Reports on Parental Autonomy Support and Informants’ Depressive Symptoms
Vrolijk, P., Lissa, C. J. V., Branje, S., & Keizer, R. (2023) · Journal of Youth and Adolescence · doi:10.1007/s10964-022-01733-y · Cited by 16
Exposure to violence predicts callous‐unemotional traits and aggression in adolescence in the context of persistent ethnic‐political conflict and violence
Docherty, M., Decrop, R., McManamon, B. M., Boxer, P., Dubow, E. F., & Huesmann, L. R. (2023) · Aggressive Behavior · doi:10.1002/ab.22103 · Cited by 19
The Reciprocal Effects of Perceived Accuracy and Trust in News Media: A Two-Wave Online Panel Study in the Context of the 2021 German Federal Election
Holtrup, S., Henke, J., Steffan, D., & Möhring, W. (2023) · Journalism & Mass Communication Quarterly · doi:10.1177/10776990231202692 · Cited by 10
Factor Structure and Measurement Invariance Across Gender of the Beck Depression Inventory-II in Adolescent Psychiatric Patients
Keller, F., Kirschbaum‐Lesch, I., & Straub, J. (2020) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2020.527559 · Cited by 16
Efectos de un programa de formación del profesorado en la motivación y satisfacción de los estudiantes de historia en enseñanza secundaria
Carrasco, C. J. G., Rodríguez‐Medina, J., Martínez, P. M., & Arias, V. B. (2020) · Revista de Psicodidáctica · doi:10.1016/j.psicod.2020.07.002 · Cited by 16
Measurement invariance of the Kessler Psychological Distress Scale (K10) among children of Chinese rural‐to‐urban migrant workers
Ren, Q., Li, Y., & Chen, D. (2021) · Brain and Behavior · doi:10.1002/brb3.2417 · Cited by 15
Measurement Invariance of Children’s SEL Competencies
Anthony, C. J., Lei, P., Elliott, S. N., DiPerna, J. C., Cefai, C., Bartolo, P. A., Camilleri, L., O’Riordan, M. R., Grazzani, I., Cavioni, V., et al. (2023) · European Journal of Psychological Assessment · doi:10.1027/1015-5759/a000753 · Cited by 15
Valid and Reliable Measures of Generalized Trust: Evidence from a Nationally Representative Survey and Behavioral Experiment
Robbins, B. G. (2023) · Socius Sociological Research for a Dynamic World · doi:10.1177/23780231231192841 · Cited by 17
Psychometric properties of Science Motivation Questionnaire II‐Chinese version in two waves of longitudinal data
Dong, Z., Li, M., Minstrell, J., & Cui, Y. (2020) · Psychology in the Schools · doi:10.1002/pits.22370 · Cited by 15
Dutch beginning teachers’ intrinsic orientation for the profession: Measurement and consistency during the first year
Feng, X., Helms‐Lorenz, M., Maulana, R., & Jansen, E. P. W. A. (2021) · Studies In Educational Evaluation · doi:10.1016/j.stueduc.2021.101059 · Cited by 18
Sexual orientation disparities in the developmental trajectories of emotional and behavioral difficulties from childhood to early adolescence
Xu, Y., & Rahman, Q. (2022) · Journal of Child Psychology and Psychiatry · doi:10.1111/jcpp.13603 · Cited by 16
Workplace Bullying and Cyberbullying Scales: An Overview
Escartín, J., Vranješ, I., Baillien, E., & Notelaers, G. (2018) · Springer eBooks · doi:10.1007/978-981-10-5334-4_10-1 · Cited by 15

Authors: Liu, Y., Millsap, R. E., West, S. G., Tein, J.-Y., Tanaka, R., & Grimm, K. J.
Affiliations: Arizona State University (US)
University Health Network (CA)
ORCID: Liu, Yu
Millsap, Roger E.
Tein, Jenn-Yun
Tanaka, Rika
Grimm, Kevin J.
Venue: Psychological Methods
Publisher: American Psychological Association (APA)
Published: 2017-09
Volume: 22
Issue: 3
Pages: 486-506
ISSN: 1082-989X (ISSN-L)
1939-1463
DOI: 10.1037/met0000075
PMC: PMC5121102
OpenAlex: W2395889112
Cited by: 351
References: 15
Citations by year: 2026: 45 · 2025: 32 · 2024: 45 · 2023: 49 · 2022: 46 · 2021: 53 · 2020: 36 · 2019: 20 · 2018: 15 · 2017: 6
FWCI: 16.08
Type: journal article
Language: en
Open access: hybrid
doi.org
Licence: other-oa
www.apa.org/pubs/journals/resources/open-access.aspx (am)
Locations: Psychological Methods (publishedVersion, other-oa)
PubMed (publishedVersion)
Europe PMC (PubMed Central) (acceptedVersion)
PubMed Central (acceptedVersion)
Funders: National Institute of Mental Health (R01 MH68920)
Topics: Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
Social Sciences › Psychology › Experimental and Cognitive Psychology › Mental Health Research Topics
Keywords: measurement invariance, longitudinal data, factor models, system identification, data sparsity, missing data, developmental research
MeSH terms: Data Interpretation, Statistical, Factor Analysis, Statistical, Humans, Individuality, Longitudinal Studies, Models, Statistical

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Testing measurement invariance in longitudinal data with ordered-categorical measures.

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Self-check

Citations

Cites

Cited by

Related

Metadata

Record

About these checks