Measurement invariance within and between individuals: a distinct problem in testing the equivalence of intra- and inter-individual model structures
Open accessThe DOI matches its Crossref record; 18 of the 18 references it cites were found in a registry or an index.
Abstract
We address the question of equivalence between modeling results obtained on intra-individual and inter-individual levels of psychometric analysis. Our focus is on the concept of measurement invariance and the role it may play in this context. We discuss this in general against the background of the latent variable paradigm, complemented by an operational demonstration in terms of a linear state-space model, i.e., a time series model with latent variables. Implemented in a multiple-occasion and multiple-subject setting, the model simultaneously accounts for intra-individual and inter-individual differences. We consider the conditions-in terms of invariance constraints-under which modeling results are generalizable (a) over time within subjects, (b) over subjects within occasions, and (c) over time and subjects simultaneously thus implying an equivalence-relationship between both dimensions. Since we distinguish the measurement model from the structural model governing relations between the latent variables of interest, we decompose the invariance constraints into those that involve structural parameters and those that involve measurement parameters and relate to measurement invariance. Within the resulting taxonomy of models, we show that, under the condition of measurement invariance over time and subjects, there exists a form of structural equivalence between levels of analysis that is distinct from full structural equivalence, i.e., ergodicity. We demonstrate how measurement invariance between and within subjects can be tested in the context of high-frequency repeated measures in personality research. Finally, we relate problems of measurement variance to problems of non-ergodicity as currently discussed and approached in the literature.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
An Introduction to the Five‐Factor Model and Its Applications
McCrae, R. R., & John, O. P. (1992) · Journal of Personality · doi:10.1111/j.1467-6494.1992.tb00970.x · Cited by 6,835
Measurement Invariance, Factor Analysis and Factorial Invariance
Meredith, W. (1993) · Psychometrika · doi:10.1007/bf02294825 · Cited by 4,536 · cited 6×
“…that variation in measurement intercepts and variation in specific factor means cancel each other out across occasions and subjects respectively (cf. Meredith, 1993; Lubke et al., 2003a,b). the latent states, P i , t , can be expressed as a function of B i , t , and P i , t − 1 and (cid:2) i , t .”
InfluentialForecasting, Structural Time Series Models and the Kalman Filter
Harvey, A. C. (1990) · doi:10.1017/cbo9781107049994 · Cited by 4,195
Byrne, B. M., Shavelson, R. J., & Muthén, B. (1989) · Psychological Bulletin · doi:10.1037//0033-2909.105.3.456 · Cited by 4,115
Time Series Analysis by State Space Methods: Second Edition
Durbin, J., & Koopman, S. J. (2012) · doi:10.1093/acprof:oso/9780199641178.001.0001 · Cited by 3,301
Hox, J., Moerbeek, M., & van de Schoot, R. (2002) · doi:10.4324/9781410604118 · Cited by 2,419
Simultaneous Factor Analysis in Several Populations
Jöreskog, K. G. (1971) · Psychometrika · doi:10.1007/bf02291366 · Cited by 2,051
Molenaar, P. C. M. (2004) · Measurement: Interdisciplinary Research & Perspective · doi:10.1207/s15366359mea0204_1 · Cited by 1,943 · cited 14×
“Each individual can thus potentially represent a sys-tem that is quantitatively or qualitatively unique (Molenaar, 2004).”
InfluentialA practical and theoretical guide to measurement invariance in aging research
Horn, J. L., & Mcardle, J. J. (1992) · Experimental Aging Research · doi:10.1080/03610739208253916 · Cited by 1,592 · cited 4×
“This notion of MI as theoretical invariance , as compared to the above notion of unbiasedness , can mainly be found for operationalizations of MI in the linear factor model.”
InfluentialThe theoretical status of latent variables.
Borsboom, D., Mellenbergh, G. J., & van Heerden, J. (2003) · Psychological Review · doi:10.1037/0033-295x.110.2.203 · Cited by 1,566 · cited 2×
“This is arguably a philosophical question, which has been addressed intensively by Borsboom et al. (2003, 2009) and by Cervone (2004, 2005).”
Self-citation
Cited by
Psychometric Network Models from Time-Series and Panel Data
Epskamp, S. (2020) · Psychometrika · doi:10.1007/s11336-020-09697-3 · Cited by 345
Editorial: Measurement Invariance
Van De Schoot, R., Schmidt, P., De Beuckelaer, A., Lek, K., & Zondervan-Zwijnenburg, M. (2015) · Frontiers in Psychology · doi:10.3389/fpsyg.2015.01064 · Cited by 330
Psychopathological networks: Theory, methods and practice
Bringmann, L. F., Albers, C., Bockting, C., Borsboom, D., Ceulemans, E., Cramer, A., Epskamp, S., Eronen, M. I., Hamaker, E., Kuppens, P., et al. (2022) · Behaviour Research and Therapy · doi:10.1016/j.brat.2021.104011 · Cited by 300
Self-citationLeitgöb, H., Seddig, D., Asparouhov, T., Behr, D., Davidov, E., De Roover, K., Jak, S., Meitinger, K., Menold, N., Muthén, B., et al. (2023) · Social Science Research · doi:10.1016/j.ssresearch.2022.102805 · Cited by 271
van Roekel, E., Keijsers, L., & Chung, J. M. (2019) · Journal of Research on Adolescence · doi:10.1111/jora.12471 · Cited by 191
Longitudinal Experience–Wide Association Studies—A Framework for Studying Personality Change
Bleidorn, W., Hopwood, C. J., Back, M. D., Denissen, J. J. A., Hennecke, M., Jokela, M., Kandler, C., Lucas, R. E., Luhmann, M., Orth, U., et al. (2020) · European Journal of Personality · doi:10.1002/per.2247 · Cited by 127
Zimmermann, J., Woods, W. C., Ritter, S., Happel, M., Masuhr, O., Jaeger, U., Spitzer, C., & Wright, A. G. C. (2019) · Psychological Assessment · doi:10.1037/pas0000625 · Cited by 87
Moderators of Outcome for Youth Anxiety Treatments: Current Findings and Future Directions
Norris, L. A., & Kendall, P. C. (2021) · Journal of Clinical Child & Adolescent Psychology · doi:10.1080/15374416.2020.1833337 · Cited by 46
“However, group-level moderators may be informative in some cases, depending on where moderation processes fall along the continuum of ergodicity (Adolf et al., 2014; Adolf & Fried, 2019; Brose et al., 2015; Voelkle et al., 2014, 2018; for an opposing argument see Medaglia et al., 2019).”
Background
Metadata
- Authors
- Adolf, J., Schuurman, N. K., Borkenau, P., Borsboom, D., & Dolan, C. V.
- Venue
- Frontiers in Psychology
- Publisher
- Frontiers Media SA
- Published
- 2014-09-19
- Volume
- 5
- Pages
- 883-883
- ISSN
- 1664-1078 (ISSN-L)
- OpenAlex
- W2126777183
- Cited by
- 89
- References
- 18
- FWCI
- 6.98
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.