Measurement invariance within and between individuals: a distinct problem in testing the equivalence of intra- and inter-individual model structures
Open accessThe DOI matches its Crossref record; 18 of the 18 references it cites were found in a registry or an index.
Abstract
We address the question of equivalence between modeling results obtained on intra-individual and inter-individual levels of psychometric analysis. Our focus is on the concept of measurement invariance and the role it may play in this context. We discuss this in general against the background of the latent variable paradigm, complemented by an operational demonstration in terms of a linear state-space model, i.e., a time series model with latent variables. Implemented in a multiple-occasion and multiple-subject setting, the model simultaneously accounts for intra-individual and inter-individual differences. We consider the conditions-in terms of invariance constraints-under which modeling results are generalizable (a) over time within subjects, (b) over subjects within occasions, and (c) over time and subjects simultaneously thus implying an equivalence-relationship between both dimensions. Since we distinguish the measurement model from the structural model governing relations between the latent variables of interest, we decompose the invariance constraints into those that involve structural parameters and those that involve measurement parameters and relate to measurement invariance. Within the resulting taxonomy of models, we show that, under the condition of measurement invariance over time and subjects, there exists a form of structural equivalence between levels of analysis that is distinct from full structural equivalence, i.e., ergodicity. We demonstrate how measurement invariance between and within subjects can be tested in the context of high-frequency repeated measures in personality research. Finally, we relate problems of measurement variance to problems of non-ergodicity as currently discussed and approached in the literature.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
An Introduction to the Five‐Factor Model and Its Applications
McCrae, R. R., & John, O. P. (1992) · Journal of Personality · doi:10.1111/j.1467-6494.1992.tb00970.x · Cited by 6,835
Measurement Invariance, Factor Analysis and Factorial Invariance
Meredith, W. (1993) · Psychometrika · doi:10.1007/bf02294825 · Cited by 4,536 · cited 6×
“…that variation in measurement intercepts and variation in specific factor means cancel each other out across occasions and subjects respectively (cf. Meredith, 1993; Lubke et al., 2003a,b). the latent states, P i , t , can be expressed as a function of B i , t , and P i , t − 1 and (cid:2) i , t .”
InfluentialForecasting, Structural Time Series Models and the Kalman Filter
Harvey, A. C. (1990) · doi:10.1017/cbo9781107049994 · Cited by 4,195
Byrne, B. M., Shavelson, R. J., & Muthén, B. (1989) · Psychological Bulletin · doi:10.1037//0033-2909.105.3.456 · Cited by 4,115
Time Series Analysis by State Space Methods: Second Edition
Durbin, J., & Koopman, S. J. (2012) · doi:10.1093/acprof:oso/9780199641178.001.0001 · Cited by 3,301
Hox, J., Moerbeek, M., & van de Schoot, R. (2002) · doi:10.4324/9781410604118 · Cited by 2,419
Simultaneous Factor Analysis in Several Populations
Jöreskog, K. G. (1971) · Psychometrika · doi:10.1007/bf02291366 · Cited by 2,051
Molenaar, P. C. M. (2004) · Measurement: Interdisciplinary Research & Perspective · doi:10.1207/s15366359mea0204_1 · Cited by 1,943 · cited 14×
“Each individual can thus potentially represent a sys-tem that is quantitatively or qualitatively unique (Molenaar, 2004).”
InfluentialA practical and theoretical guide to measurement invariance in aging research
Horn, J. L., & Mcardle, J. J. (1992) · Experimental Aging Research · doi:10.1080/03610739208253916 · Cited by 1,592 · cited 4×
“This notion of MI as theoretical invariance , as compared to the above notion of unbiasedness , can mainly be found for operationalizations of MI in the linear factor model.”
InfluentialThe theoretical status of latent variables.
Borsboom, D., Mellenbergh, G. J., & van Heerden, J. (2003) · Psychological Review · doi:10.1037/0033-295x.110.2.203 · Cited by 1,566 · cited 2×
“This is arguably a philosophical question, which has been addressed intensively by Borsboom et al. (2003, 2009) and by Cervone (2004, 2005).”
Self-citationStatistical Approaches to Measurement Invariance
Millsap, R. E. (2012) · doi:10.4324/9780203821961 · Cited by 1,554
Fleeson, W. (2001) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.80.6.1011 · Cited by 1,436 · cited 1×
“These may then be used to differentiate among people and may thus themselves be regarded as personality characteristics (Fleeson, 2001; Hamaker et al., 2007).”
Maximum Likelihood Estimation of Latent Interaction Effects with the LMS Method
Klein, A., & Moosbrugger, H. (2000) · Psychometrika · doi:10.1007/bf02296338 · Cited by 1,429 · cited 1×
“Non-normally distributed continuous indicators (due to nonlinear effects) can be approximated by mixtures of (un-)conditional normal distributions (e.g., Klein and Moosbrugger, 2000).”
BackgroundThe new person-specific paradigm in psychology
Molenaar, P. C. M., & Campbell, C. G. (2009) · Current Directions in Psychological Science · doi:10.1111/j.1467-8721.2009.01619.x · Cited by 1,088
A dynamical model of general intelligence: The positive manifold of intelligence by mutualism.
Van Der Maas, H. L. J., Dolan, C. V., Grasman, R. P. P. P., Wicherts, J. M., Huizenga, H. M., & Raijmakers, M. E. J. (2006) · Psychological Review · doi:10.1037/0033-295x.113.4.842 · Cited by 1,006
Self-citationItem bias and item response theory
Mellenbergh, G. J. (1989) · International Journal of Educational Research · doi:10.1016/0883-0355(89)90002-5 · Cited by 553 · cited 10×
“A general formal definition of MI in the latent variable paradigm was given by Mellenbergh (1989) designed to measure a given latent variable Z , and suppose we have a variable X .”
InfluentialLubke, G. (2003) · Intelligence · doi:10.1016/s0160-2896(03)00051-5 · Cited by 122
Two failures of Spearman's hypothesis: The GATB in Holland and the JAT in South Africa
Dolan, C. (2004) · Intelligence · doi:10.1016/j.intell.2003.09.001 · Cited by 50 · cited 3×
“Moreover, biased items can lead to biased estimates of parameters pertaining to the latent variable (Mellenbergh, 1989; Wicherts and Dolan, 2010).”
Self-citation
Cited by
Psychometric Network Models from Time-Series and Panel Data
Epskamp, S. (2020) · Psychometrika · doi:10.1007/s11336-020-09697-3 · Cited by 345
Editorial: Measurement Invariance
Van De Schoot, R., Schmidt, P., De Beuckelaer, A., Lek, K., & Zondervan-Zwijnenburg, M. (2015) · Frontiers in Psychology · doi:10.3389/fpsyg.2015.01064 · Cited by 330
Psychopathological networks: Theory, methods and practice
Bringmann, L. F., Albers, C., Bockting, C., Borsboom, D., Ceulemans, E., Cramer, A., Epskamp, S., Eronen, M. I., Hamaker, E., Kuppens, P., et al. (2022) · Behaviour Research and Therapy · doi:10.1016/j.brat.2021.104011 · Cited by 300
Self-citationLeitgöb, H., Seddig, D., Asparouhov, T., Behr, D., Davidov, E., De Roover, K., Jak, S., Meitinger, K., Menold, N., Muthén, B., et al. (2023) · Social Science Research · doi:10.1016/j.ssresearch.2022.102805 · Cited by 271
van Roekel, E., Keijsers, L., & Chung, J. M. (2019) · Journal of Research on Adolescence · doi:10.1111/jora.12471 · Cited by 191
Metadata
- Authors
- Adolf, J., Schuurman, N. K., Borkenau, P., Borsboom, D., & Dolan, C. V.
- Venue
- Frontiers in Psychology
- Publisher
- Frontiers Media SA
- Published
- 2014-09-19
- Volume
- 5
- Pages
- 883-883
- ISSN
- 1664-1078 (ISSN-L)
- OpenAlex
- W2126777183
- Cited by
- 89
- References
- 18
- FWCI
- 6.98
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.