How to compare cross-lagged associations in a multilevel autoregressive model.
Open accessThe DOI matches its Crossref record; 57 of the 57 references it cites were found in a registry or an index.
Abstract
By modeling variables over time it is possible to investigate the Granger-causal cross-lagged associations between variables. By comparing the standardized cross-lagged coefficients, the relative strength of these associations can be evaluated in order to determine important driving forces in the dynamic system. The aim of this study was twofold: first, to illustrate the added value of a multilevel multivariate autoregressive modeling approach for investigating these associations over more traditional techniques; and second, to discuss how the coefficients of the multilevel autoregressive model should be standardized for comparing the strength of the cross-lagged associations. The hierarchical structure of multilevel multivariate autoregressive models complicates standardization, because subject-based statistics or group-based statistics can be used to standardize the coefficients, and each method may result in different conclusions. We argue that in order to make a meaningful comparison of the strength of the cross-lagged associations, the coefficients should be standardized within persons. We further illustrate the bivariate multilevel autoregressive model and the standardization of the coefficients, and we show that disregarding individual differences in dynamics can prove misleading, by means of an empirical example on experienced competence and exhaustion in persons diagnosed with burnout. (PsycINFO Database Record
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
R: A Language and Environment for Statistical Computing
R Core Team (2025) · doi:10.32614/r.manuals · Cited by 352,181
Fitting Linear Mixed-Effects Models Using lme4
Bates, D., Mächler, M., Bolker, B., & Walker, S. (2015) · Journal of Statistical Software · doi:10.18637/jss.v067.i01 · Cited by 86,835
Gelman, A., Carlin, J. B., Stern, H. S., & Rubin, D. B. (2003) · doi:10.1201/9780429258480 · Cited by 27,276
Investigating causal relations by econometric models and cross-spectral methods
Granger, C. W. J. (1969) · Econometrica · doi:10.2307/1912791 · Cited by 22,989
Inference from iterative simulation using multiple sequences
Gelman, A., & Rubin, D. B. (1992) · Statistical Science · doi:10.1214/ss/1177011136 · Cited by 16,627
The measurement of experienced burnout
Maslach, C., & Jackson, S. E. (1981) · Journal of Organizational Behavior · doi:10.1002/job.4030020205 · Cited by 14,496
Breitung, J., & Hamilton, J. D. (1995) · Contemporary Sociology · doi:10.2307/2076916 · Cited by 10,966
Applied Multiple Regression/Correlation Analysis for the Behavioral Sciences
Kemp, F. (2003) · Journal of the Royal Statistical Society: Series D (The Statistician) · doi:10.1046/j.1467-9884.2003.t01-2-00383_4.x · Cited by 9,293
WinBUGS - A Bayesian modelling framework: Concepts, structure, and extensibility
Lunn, D. J., Thomas, A., Best, N., & Spiegelhalter, D. (2000) · Statistics and Computing · doi:10.1023/a:1008929526011 · Cited by 5,368
JAGS: A program for analysis of Bayesian graphical models using Gibbs sampling
Plummer, M. (2003) · Cited by 4,720
Cited by
The Gaussian Graphical Model in Cross-Sectional and Time-Series Data
Epskamp, S., Waldorp, L. J., Mõttus, R., & Borsboom, D. (2018) · Multivariate Behavioral Research · doi:10.1080/00273171.2018.1454823 · Cited by 1,134
Mental disorders as networks of problems: a review of recent insights
Fried, E. I., van Borkulo, C. D., Cramer, A. O. J., Boschloo, L., Schoevers, R. A., & Borsboom, D. (2017) · Social Psychiatry and Psychiatric Epidemiology · doi:10.1007/s00127-016-1319-z · Cited by 1,040
Moving Forward: Challenges and Directions for Psychopathological Network Theory and Methodology
Fried, E. I., & Cramer, A. O. J. (2017) · Perspectives on Psychological Science · doi:10.1177/1745691617705892 · Cited by 938
Robinaugh, D. J., Hoekstra, R. H. A., Toner, E. R., & Borsboom, D. (2020) · Psychological Medicine · doi:10.1017/s0033291719003404 · Cited by 861
Effect size guidelines for cross-lagged effects.
Orth, U., Meier, L. L., Bühler, J. L., Dapp, L. C., Krauss, S., Messerli, D., & Robins, R. W. (2024) · Psychological Methods · doi:10.1037/met0000499 · Cited by 720
A primer on two-level dynamic structural equation models for intensive longitudinal data in Mplus.
McNeish, D., & Hamaker, E. L. (2020) · Psychological Methods · doi:10.1037/met0000250 · Cited by 591
Self-citationHamaker, E. L., Asparouhov, T., Brose, A., Schmiedek, F., & Muthén, B. (2018) · Multivariate Behavioral Research · doi:10.1080/00273171.2018.1446819 · Cited by 549
Self-citationNo Time Like the Present: Discovering the Hidden Dynamics in Intensive Longitudinal Data
Hamaker, E. L., & Wichers, M. (2017) · Current Directions in Psychological Science · doi:10.1177/0963721416666518 · Cited by 500
Self-citationA unified framework of longitudinal models to examine reciprocal relations.
Usami, S., Murayama, K., & Hamaker, E. L. (2019) · Psychological Methods · doi:10.1037/met0000210 · Cited by 437
Self-citationThe fixed versus random effects debate and how it relates to centering in multilevel modeling.
Hamaker, E. L., & Muthén, B. (2020) · Psychological Methods · doi:10.1037/met0000239 · Cited by 285
Self-citationMoving forward: how depression heterogeneity hinders progress in treatment and research
Fried, E. (2017) · Expert Review of Neurotherapeutics · doi:10.1080/14737175.2017.1307737 · Cited by 220
Flückiger, C., Rubel, J., Del Re, A. C., Horvath, A. O., Wampold, B. E., Crits-Christoph, P., Atzil-Slonim, D., Compare, A., Falkenström, F., Ekeblad, A., et al. (2020) · Journal of Consulting and Clinical Psychology · doi:10.1037/ccp0000594 · Cited by 180
Foundations of idiographic methods in psychology and applications for psychotherapy
Piccirillo, M. L., & Rodebaugh, T. L. (2019) · Clinical Psychology Review · doi:10.1016/j.cpr.2019.01.002 · Cited by 160
Drawing conclusions from cross-lagged relationships: Re-considering the role of the time-interval
Kuiper, R. M., & Ryan, O. (2018) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1080/10705511.2018.1431046 · Cited by 155
“For example, Schuurman et al. (2016) inspect and interpret the sign of the cross-lagged effects before comparing the ordering.”
BackgroundOn Measuring and Modeling Physiological Synchrony in Dyads
Helm, J. L., Miller, J. G., Kahle, S., Troxel, N. R., & Hastings, P. D. (2018) · Multivariate Behavioral Research · doi:10.1080/00273171.2018.1459292 · Cited by 112
Neville, R. D., McArthur, B. A., Eirich, R., Lakes, K. D., & Madigan, S. (2021) · Journal of Child Psychology and Psychiatry · doi:10.1111/jcpp.13425 · Cited by 109
A Continuous-Time Approach to Intensive Longitudinal Data: What, Why, and How?
Ryan, O., Kuiper, R. M., & Hamaker, E. L. (2018) · Continuous Time Modeling in the Behavioral and Related Sciences · doi:10.1007/978-3-319-77219-6_2 · Cited by 67
Self-citationIndividual differences in contingencies between situation characteristics and personality states.
Kuper, N., Breil, S. M., Horstmann, K. T., Roemer, L., Lischetzke, T., Sherman, R. A., Back, M. D., Denissen, J. J. A., & Rauthmann, J. F. (2022) · Journal of Personality and Social Psychology · doi:10.1037/pspp0000435 · Cited by 63
Longitudinal associations between screen use and reading in preschool-aged children
McArthur, B. A., Browne, D., McDonald, S., Tough, S., & Madigan, S. (2021) · Pediatrics · doi:10.1542/peds.2020-011429 · Cited by 45
Siebers, T., Beyens, I., Pouwels, J. L., & Valkenburg, P. M. (2023) · Current Psychology · doi:10.1007/s12144-022-03844-y · Cited by 24
Rubel, J. A., Hilpert, P., Wolfer, C., Held, J., Vîslă, A., & Flückiger, C. (2019) · Journal of Consulting and Clinical Psychology · doi:10.1037/ccp0000433 · Cited by 19
A Primer on Two-Level Dynamic Structural Equation Models for Intensive Longitudinal Data
McNeish, D. (2018) · doi:10.31234/osf.io/j56bm · Cited by 12
Adolescent Emotion Network Dynamics in Daily Life and Implications for Depression
Lydon-Staley, D. M., Xia, M., Mak, H. W., & Fosco, G. (2018) · doi:10.31234/osf.io/7j92y · Cited by 8
Metadata
- Authors
- Schuurman, N. K., Ferrer, E., de Boer-Sonnenschein, M., & Hamaker, E. L.
- Venue
- Psychological Methods
- Published
- 2016
- Volume
- 21
- Issue
- 2
- Pages
- 206-221
- ISSN
- 1082-989X (ISSN-L)
- 1939-1463
- OpenAlex
- W2337812714
- Cited by
- 315
- References
- 57
- FWCI
- 20.13
- Type
- journal article
- Language
- en
- Open access
- green
- Funders
- Netherlands Organization for Scientific Research (452-10-007)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.