Modeling reciprocal effects in medical research: Critical discussion on the current practices and potential alternative models
Open accessThe DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.
Abstract
Longitudinal designs provide a strong inferential basis for uncovering reciprocal effects or causality between variables. For this analytic purpose, a cross-lagged panel model (CLPM) has been widely used in medical research, but the use of the CLPM has recently been criticized in methodological literature because parameter estimates in the CLPM conflate between-person and within-person processes. The aim of this study is to present some alternative models of the CLPM that can be used to examine reciprocal effects, and to illustrate potential consequences of ignoring the issue. A literature search, case studies, and simulation studies are used for this purpose. We examined more than 300 medical papers published since 2009 that applied cross-lagged longitudinal models, finding that in all studies only a single model (typically the CLPM) was performed and potential alternative models were not considered to test reciprocal effects. In 49% of the studies, only two time points were used, which makes it impossible to test alternative models. Case studies and simulation studies showed that the CLPM and alternative models often produce different (or even inconsistent) parameter estimates for reciprocal effects, suggesting that research that relies only on the CLPM may draw erroneous conclusions about the presence, predominance, and sign of reciprocal effects. Simulation studies also showed that alternative models are sometimes susceptible to improper solutions, even when reseachers do not misspecify the model.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Investigating Causal Relations by Econometric Models and Cross-Spectral Methods
Granger, C. W. J. (2010) · Essays in Econometrics · doi:10.1017/cbo9780511753978.002 · Cited by 4,762
A critique of the cross-lagged panel model
Hamaker, E. L., Kuiper, R. M., & Grasman, R. P. P. P. (2015) · Psychological Methods · doi:10.1037/a0038889 · Cited by 4,005 · cited 7×
“To address this inherent problem with the CLPM, Hamaker et al [6] proposed a randomintercepts CLPM (RI-CLPM) as a possible analytic option.”
InfluentialThe disaggregation of within-person and between-person effects in longitudinal models of change
Curran, P. J., & Bauer, D. J. (2011) · Annual Review of Psychology · doi:10.1146/annurev.psych.093008.100356 · Cited by 2,056
Mediation Analysis: A Practitioner's Guide
VanderWeele, T. J. (2016) · Annual Review of Public Health · doi:10.1146/annurev-publhealth-032315-021402 · Cited by 1,985 · cited 2×
“, Richiardi, Bellocco, & Zugna [24]; Ten Have & Joffe [25]; VanderWeele [26]), and they are often assessed in a longitudinal design (e.”
Optimal time lags in panel studies.
Dormann, C., & Griffin, M. A. (2015) · Psychological Methods · doi:10.1037/met0000041 · Cited by 856 · cited 1×
“…different results obtained from different models, we recommend that applied researchers collect longitudinal data at more than two time points, even if the time lag between occasions is set to be optimal to effectively capture the theoretical process (see Dormann & Grif-fin [21] on this point).”
A unified framework of longitudinal models to examine reciprocal relations.
Usami, S., Murayama, K., & Hamaker, E. L. (2019) · Psychological Methods · doi:10.1037/met0000210 · Cited by 437
Self-citationA review of causal estimation of effects in mediation analyses
Ten Have, T. R., & Joffe, M. M. (2012) · Statistical Methods in Medical Research · doi:10.1177/0962280210391076 · Cited by 103 · cited 1×
“, Richiardi, Bellocco, & Zugna [24]; Ten Have & Joffe [25]; VanderWeele [26]), and they are often assessed in a longitudinal design (e.”
Background
Cited by
Testing prospective effects in longitudinal research: Comparing seven competing cross-lagged models.
Orth, U., Clark, D. A., Donnellan, M. B., & Robins, R. W. (2021) · Journal of Personality and Social Psychology · doi:10.1037/pspp0000358 · Cited by 801
Effect size guidelines for cross-lagged effects.
Orth, U., Meier, L. L., Bühler, J. L., Dapp, L. C., Krauss, S., Messerli, D., & Robins, R. W. (2024) · Psychological Methods · doi:10.1037/met0000499 · Cited by 720
Why the cross-lagged panel model is almost never the right choice
Lucas, R. E. (2023) · Advances in Methods and Practices in Psychological Science · doi:10.1177/25152459231158378 · Cited by 361
“that Westfall and Yarkoni (2016) discussed and those that I highlighted in Figure 4. Because the latent X and Y traits are measured imperfectly on each occasion, controlling for Time 1 Y when predicting Time 2 Y from Time 1 X does not fully account for the true association between X and Y. There will still be a residu…”
BackgroundResting brain activity in early childhood predicts IQ at 18 years
Tan, E., Tang, A., Debnath, R., Humphreys, K. L., Zeanah, C. H., Nelson, C. A., & Fox, N. A. (2023) · Developmental Cognitive Neuroscience · doi:10.1016/j.dcn.2023.101287 · Cited by 22
“The CLPM is the most widely used cross-lagged model in longitudinal research (Orth et al., 2021; Usami et al., 2019).”
Marsh, H. W., Lüdtke, O., Pekrun, R., Parker, P. D., Murayama, K., Guo, J., Basarkod, G., Dicke, T., Donald, J. N., & Morin, A. J. S. (2023) · Contemporary Educational Psychology · doi:10.1016/j.cedpsych.2023.102170 · Cited by 19
Self-citation
Metadata
- Authors
- Usami, S., Todo, N., & Murayama, K.
- Venue
- PLOS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2019-09-27
- Volume
- 14
- Issue
- 9
- Pages
- e0209133
- ISSN
- 1932-6203 (ISSN-L)
- OpenAlex
- W2977237750
- Cited by
- 71
- References
- 7
- FWCI
- 4.45
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.