The DOI matches its Crossref record; 57 of the 57 references it cites were found in a registry or an index.
How to compare cross-lagged associations in a multilevel autoregressive model.
Open accessAbstract
By modeling variables over time it is possible to investigate the Granger-causal cross-lagged associations between variables. By comparing the standardized cross-lagged coefficients, the relative strength of these associations can be evaluated in order to determine important driving forces in the dynamic system. The aim of this study was twofold: first, to illustrate the added value of a multilevel multivariate autoregressive modeling approach for investigating these associations over more traditional techniques; and second, to discuss how the coefficients of the multilevel autoregressive model should be standardized for comparing the strength of the cross-lagged associations. The hierarchical structure of multilevel multivariate autoregressive models complicates standardization, because subject-based statistics or group-based statistics can be used to standardize the coefficients, and each method may result in different conclusions. We argue that in order to make a meaningful comparison of the strength of the cross-lagged associations, the coefficients should be standardized within persons. We further illustrate the bivariate multilevel autoregressive model and the standardization of the coefficients, and we show that disregarding individual differences in dynamics can prove misleading, by means of an empirical example on experienced competence and exhaustion in persons diagnosed with burnout. (PsycINFO Database Record
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
R: A Language and Environment for Statistical Computing
R Core Team (2025) · doi:10.32614/r.manuals · Cited by 352,181
Fitting Linear Mixed-Effects Models Using lme4
Bates, D., Mächler, M., Bolker, B., & Walker, S. (2015) · Journal of Statistical Software · doi:10.18637/jss.v067.i01 · Cited by 86,835
Gelman, A., Carlin, J. B., Stern, H. S., & Rubin, D. B. (2003) · doi:10.1201/9780429258480 · Cited by 27,276
Investigating causal relations by econometric models and cross-spectral methods
Granger, C. W. J. (1969) · Econometrica · doi:10.2307/1912791 · Cited by 22,989
Inference from iterative simulation using multiple sequences
Gelman, A., & Rubin, D. B. (1992) · Statistical Science · doi:10.1214/ss/1177011136 · Cited by 16,627
The measurement of experienced burnout
Maslach, C., & Jackson, S. E. (1981) · Journal of Organizational Behavior · doi:10.1002/job.4030020205 · Cited by 14,496
Breitung, J., & Hamilton, J. D. (1995) · Contemporary Sociology · doi:10.2307/2076916 · Cited by 10,966
Applied Multiple Regression/Correlation Analysis for the Behavioral Sciences
Kemp, F. (2003) · Journal of the Royal Statistical Society: Series D (The Statistician) · doi:10.1046/j.1467-9884.2003.t01-2-00383_4.x · Cited by 9,293
WinBUGS - A Bayesian modelling framework: Concepts, structure, and extensibility
Lunn, D. J., Thomas, A., Best, N., & Spiegelhalter, D. (2000) · Statistics and Computing · doi:10.1023/a:1008929526011 · Cited by 5,368
JAGS: A program for analysis of Bayesian graphical models using Gibbs sampling
Plummer, M. (2003) · Cited by 4,720
Network analysis: An integrative approach to the structure of psychopathology
Borsboom, D., & Cramer, A. O. J. (2013) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-050212-185608 · Cited by 4,359
Gelman, A. (2006) · Bayesian Analysis · doi:10.1214/06-ba117a · Cited by 4,050
A critique of the cross-lagged panel model
Hamaker, E. L., Kuiper, R. M., & Grasman, R. P. P. P. (2015) · Psychological Methods · doi:10.1037/a0038889 · Cited by 4,005
Self-citationCODA: convergence diagnosis and output analysis for MCMC
Plummer, M., Best, N., Cowles, K., & Vines, K. (2006) · Open Research Online (The Open University) · Cited by 3,317
Maslach, C., & Jackson, S. E. (2024) · PsycTESTS Dataset · doi:10.1037/t55656-000 · Cited by 2,359
Molenaar, P. C. M. (2004) · Measurement: Interdisciplinary Research & Perspective · doi:10.1207/s15366359mea0204_1 · Cited by 1,943
The BUGS project: evolution, critique and future directions
Lunn, D., Spiegelhalter, D., Thomas, A., & Best, N. (2009) · Statistics in Medicine · doi:10.1002/sim.3680 · Cited by 1,876
Bayesian Data Analysis, 2nd edn
Brix, A. (2005) · Journal of the Royal Statistical Society Series A: Statistics in Society · doi:10.1111/j.1467-985x.2004.00347_4.x · Cited by 1,767
The theoretical status of latent variables.
Borsboom, D., Mellenbergh, G. J., & van Heerden, J. (2003) · Psychological Review · doi:10.1037/0033-295x.110.2.203 · Cited by 1,566
R2WinBUGS: A Package for Running WinBUGS from R
Sturtz, S., Ligges, U., & Gelman, A. (2005) · Journal of Statistical Software · doi:10.18637/jss.v012.i03 · Cited by 1,565
State-Space Models with Regime Switching: Classical and Gibbs-Sampling Approaches with Applications
Kim, C.-J., & Halbert, D. C. R. (1999) · The MIT Press eBooks · doi:10.7551/mitpress/6444.001.0001 · Cited by 1,295
Multiple regression in psychological research and practice.
Darlington, R. B. (1968) · Psychological Bulletin · doi:10.1037/h0025471 · Cited by 1,132
Deconstructing the construct: a network perspective on psychological phenomena
Schmittmann, V. D., Cramer, A. O. J., Waldorp, L. J., Epskamp, S., Kievit, R. A., & Borsboom, D. (2013) · New Ideas in Psychology · doi:10.1016/j.newideapsych.2011.02.007 · Cited by 740
Emotional Inertia and Psychological Maladjustment
Kuppens, P., Allen, N. B., & Sheeber, L. B. (2010) · Psychological Science · doi:10.1177/0956797610372634 · Cited by 724
A Network Approach to Psychopathology: New Insights into Clinical Longitudinal Data
Bringmann, L. F., Vissers, N., Wichers, M., Geschwind, N., Kuppens, P., Peeters, F., Borsboom, D., & Tuerlinckx, F. (2013) · PLoS ONE · doi:10.1371/journal.pone.0060188 · Cited by 680
Nezlek, J. B. (2001) · Personality and Social Psychology Bulletin · doi:10.1177/0146167201277001 · Cited by 676
A critique of cross-lagged correlation.
Rogosa, D. (1980) · Psychological Bulletin · doi:10.1037//0033-2909.88.2.245 · Cited by 666
De Lange *, A. H., Taris, T. W., Kompier, M. A. J., Houtman, I. L. D., & Bongers, P. M. (2004) · Work & Stress · doi:10.1080/02678370412331270860 · Cited by 534
Attitudes "cause" behaviors: A structural equation analysis.
Bentler, P. M., & Speckart, G. (1981) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.40.2.226 · Cited by 492
Why researchers should think "within-person": A paradigmatic rationale.
Hamaker, E. L. (2012) · Cited by 472
Self-citationRuminative self-focus and negative affect: An experience sampling study.
Moberly, N. J., & Watkins, E. R. (2008) · Journal of Abnormal Psychology · doi:10.1037/0021-843x.117.2.314 · Cited by 432
Emotional Reactivity to Everyday Problems, Affective Inertia, and Neuroticism
Suls, J., Green, P., & Hillis, S. (1998) · Personality and Social Psychology Bulletin · doi:10.1177/0146167298242002 · Cited by 421
de Jonge, J., Dormann, C., Janssen, P. P. M., Dollard, M. F., Landeweerd, J. A., & Nijhuis, F. J. N. (2001) · Journal of Occupational and Organizational Psychology · doi:10.1348/096317901167217 · Cited by 381
An SEM approach to continuous time modeling of panel data: Relating authoritarianism and anomia.
Voelkle, M. C., Oud, J. H. L., Davidov, E., & Schmidt, P. (2012) · Psychological Methods · doi:10.1037/a0027543 · Cited by 317
An Introduction to Multilevel Modeling Techniques
Heck, R., Heck, R. H., Thomas, S. L., & Thomas, S. L. (1999) · Psychology Press eBooks · doi:10.4324/9781410604767 · Cited by 306
Specificity of Infants' Response to Mothers' Affective Behavior
COHN, J. F., & TRONICK, E. (1989) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1097/00004583-198903000-00016 · Cited by 299
Christens, B. D., Peterson, N. A., & Speer, P. W. (2011) · Health Education & Behavior · doi:10.1177/1090198110372880 · Cited by 206
Nezlek, J. B., & Gable, S. L. (2001) · Personality and Social Psychology Bulletin · doi:10.1177/01461672012712012 · Cited by 167
Causal Inferences, Closed Populations, and Measures of Association
Blalock, H. M. (1967) · American Political Science Review · doi:10.2307/1953880 · Cited by 167
Bayesian Evaluation of Informative Hypotheses
(2008) · Springer eBooks · doi:10.1007/978-0-387-09612-4 · Cited by 165
R2WinBUGS: A Package for Running WinBUGS from R
Sturtz, S., Ligges, U., & Gelman, A. (2005) · DOAJ (DOAJ: Directory of Open Access Journals) · doi:10.7916/d80c55hh · Cited by 140
Nezlek, J. B., & Allen, M. R. (2006) · European Journal of Personality · doi:10.1002/per.566 · Cited by 131
Standardized regression coefficients: a further critique and review of some alternatives.
Greenland, S., Maclure, M., Schlesselman, J. J., Poole, C., & Morgenstern, H. (1991) · PubMed · Cited by 124
Schuurman, N. K., Grasman, R. P. P. P., & Hamaker, E. L. (2016) · Multivariate Behavioral Research · doi:10.1080/00273171.2015.1065398 · Cited by 123
Self-citationA test of the bidirectional association between sleep and mood in bipolar disorder and insomnia.
Talbot, L. S., Stone, S. I., Gruber, J., Hairston, I. S., Eidelman, P., & Harvey, A. G. (2011) · Journal of Abnormal Psychology · doi:10.1037/a0024946 · Cited by 108
Incorporating measurement error in n = 1 psychological autoregressive modeling
Schuurman, N. K., Houtveen, J. H., & Hamaker, E. L. (2015) · Frontiers in Psychology · doi:10.3389/fpsyg.2015.01038 · Cited by 103
Self-citationAbusus Non Tollit Usum: Standardized Coefficients, Correlations, and R 2 s
Luskin, R. C. (1991) · American Journal of Political Science · doi:10.2307/2111505 · Cited by 100
A Hierarchical Ornstein–Uhlenbeck Model for Continuous Repeated Measurement Data
Oravecz, Z., Tuerlinckx, F., & Vandekerckhove, J. (2009) · Psychometrika · doi:10.1007/s11336-008-9106-8 · Cited by 81
Investigating spousal influence using moment-to-moment affect data from marital conflict.
Madhyastha, T. M., Hamaker, E. L., & Gottman, J. M. (2011) · Journal of Family Psychology · doi:10.1037/a0023028 · Cited by 73
Self-citation"Truth" Is Stranger than Prediction, More Questionable than Causal Inference
King, G. (1991) · American Journal of Political Science · doi:10.2307/2111506 · Cited by 67
A hierarchical state space approach to affective dynamics
Lodewyckx, T., Tuerlinckx, F., Kuppens, P., Allen, N. B., & Sheeber, L. (2010) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2010.08.004 · Cited by 67
Mind the Gap: A Psychometric Approach to the Reduction Problem
Kievit, R., Romeijn, J., Waldorp, L., Wicherts, J. M., Scholte, H. S., & Borsboom, D. (2011) · Psychological Inquiry · doi:10.1080/1047840x.2011.550181 · Cited by 65
Kinnunen, M.-L., Feldt, T., Kinnunen, U. M., & Pulkkinen, L. (2007) · Journal of Research in Personality · doi:10.1016/j.jrp.2007.06.004 · Cited by 64
The Advantages of Using Standardized Scores in Causal Analysis
Hunter, J. E., & Hamilton, M. A. (2002) · Human Communication Research · doi:10.1111/j.1468-2958.2002.tb00823.x · Cited by 57
Electronic diary evidence on energy erosion in clinical burnout.
Sonnenschein, M., Sorbi, M. J., van Doornen, L. J. P., Schaufeli, W. B., & Maas, C. J. M. (2007) · Journal of Occupational Health Psychology · doi:10.1037/1076-8998.12.4.402 · Cited by 45
How Not to Lie with Statistics: Avoiding Common Mistakes in Quantitative Political Science
King, G. (1986) · American Journal of Political Science · doi:10.2307/2111095 · Cited by 41
Feasibility of an electronic diary in clinical burnout
Sonnenschein, M., Sorbi, M. J., van Doornen, L. J. P., & Maas, C. J. M. (2006) · International Journal of Behavioral Medicine · doi:10.1207/s15327558ijbm1304_6 · Cited by 17
Cited by
The Gaussian Graphical Model in Cross-Sectional and Time-Series Data
Epskamp, S., Waldorp, L. J., Mõttus, R., & Borsboom, D. (2018) · Multivariate Behavioral Research · doi:10.1080/00273171.2018.1454823 · Cited by 1,134
Mental disorders as networks of problems: a review of recent insights
Fried, E. I., van Borkulo, C. D., Cramer, A. O. J., Boschloo, L., Schoevers, R. A., & Borsboom, D. (2017) · Social Psychiatry and Psychiatric Epidemiology · doi:10.1007/s00127-016-1319-z · Cited by 1,040
Moving Forward: Challenges and Directions for Psychopathological Network Theory and Methodology
Fried, E. I., & Cramer, A. O. J. (2017) · Perspectives on Psychological Science · doi:10.1177/1745691617705892 · Cited by 938
Robinaugh, D. J., Hoekstra, R. H. A., Toner, E. R., & Borsboom, D. (2020) · Psychological Medicine · doi:10.1017/s0033291719003404 · Cited by 861
Effect size guidelines for cross-lagged effects.
Orth, U., Meier, L. L., Bühler, J. L., Dapp, L. C., Krauss, S., Messerli, D., & Robins, R. W. (2024) · Psychological Methods · doi:10.1037/met0000499 · Cited by 720
Metadata
- Authors
- Schuurman, N. K., Ferrer, E., de Boer-Sonnenschein, M., & Hamaker, E. L.
- Venue
- Psychological Methods
- Published
- 2016
- Volume
- 21
- Issue
- 2
- Pages
- 206-221
- ISSN
- 1082-989X (ISSN-L)
- 1939-1463
- OpenAlex
- W2337812714
- Cited by
- 315
- References
- 57
- FWCI
- 20.13
- Type
- journal article
- Language
- en
- Open access
- green
- Funders
- Netherlands Organization for Scientific Research (452-10-007)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.