Using time‐lagged panel data analysis to study mechanisms of change in psychotherapy research: Methodological recommendations
Open accessThe DOI matches its Crossref record; 13 of the 13 references it cites were found in a registry or an index.
Abstract
The introduction of novel methodologies in the past decade has advanced research on mechanisms of change in observational studies. Time‐lagged panel models allow us to track session‐by‐session changes and focus on within‐patient associations between predictors and outcomes. This shift is crucial as change in mechanisms inherently takes place at a within‐patient level. These models also enable preliminary casual inferences, which can guide the development of effective personalised interventions that target mechanisms of change, used at specific treatment phases for optimal effect. Given their complexity, panel models need to be implemented with caution, as different modelling choices can significantly affect results and reduce replicability. We outline three central methodological recommendations for use of time‐lagged panel analysis to study mechanisms of change: (a) taking patient‐specific effects into account, separating out stable between‐person differences from within‐person fluctuations over time; (b) properly controlling for autoregressive effects; and (c) considering long‐term time trends. We demonstrate these recommendations in an applied example examining the session‐by‐session alliance–outcome association in a naturalistic psychotherapy study. We present limitations of time‐lagged panel analysis and future directions.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A critique of the cross-lagged panel model
Hamaker, E. L., Kuiper, R. M., & Grasman, R. P. P. P. (2015) · Psychological Methods · doi:10.1037/a0038889 · Cited by 4,005
Fixed Effects Regression Models
Allison, P. (2009) · doi:10.4135/9781412993869 · Cited by 3,999
On making causal claims: A review and recommendations
Antonakis, J., Bendahan, S., Jacquart, P., & Lalive, R. (2010) · The Leadership Quarterly · doi:10.1016/j.leaqua.2010.10.010 · Cited by 2,441
The disaggregation of within-person and between-person effects in longitudinal models of change
Curran, P. J., & Bauer, D. J. (2011) · Annual Review of Psychology · doi:10.1146/annurev.psych.093008.100356 · Cited by 2,056
Latent Variable Modeling of Differences and Changes with Longitudinal Data
McArdle, J. J. (2009) · Annual Review of Psychology · doi:10.1146/annurev.psych.60.110707.163612 · Cited by 1,952 · cited 2×
“There are several Structural Equation Models designed for this purpose (Allison et al., 2017; Bollen & Curran, 2004; Curran, Howard, Bainter, Lane, & McGinley, 2014; Hamaker et al., 2015; McArdle, 2009; Zyphur et al., 2019), and discussing their differences is beyond the scope of the present paper (but see Usami, Mura…”
BackgroundThe Great Psychotherapy Debate: The Evidence for What Makes Psychotherapy Work
Wampold, B. E. (2015) · doi:10.4324/9780203582015 · Cited by 1,773
Development and validation of a revised short version of the working alliance inventory
Hatcher, R. L., & Gillaspy, J. A. (2006) · Psychotherapy Research · doi:10.1080/10503300500352500 · Cited by 1,355 · cited 1×
“All participants completed the Clinical Outcomes in Routine Evaluation – Outcome Measure (CORE-OM; Evans et al., 2002) before each session, and the Working Alliance Inventory – Short form Revised (WAI-SR; Hatcher & Gillaspy, 2006) after each session.”
MethodThe new person-specific paradigm in psychology
Molenaar, P. C. M., & Campbell, C. G. (2009) · Current Directions in Psychological Science · doi:10.1111/j.1467-8721.2009.01619.x · Cited by 1,088
Towards a standardised brief outcome measure: Psychometric properties and utility of the CORE–OM
Evans, C., Connell, J., Barkham, M., Margison, F., McGrath, G., Mellor-Clark, J., & Audin, K. (2002) · British Journal of Psychiatry · doi:10.1192/bjp.180.1.51 · Cited by 934 · cited 1×
“All participants completed the Clinical Outcomes in Routine Evaluation – Outcome Measure (CORE-OM; Evans et al., 2002) before each session, and the Working Alliance Inventory – Short form Revised (WAI-SR; Hatcher & Gillaspy, 2006) after each session.”
MethodAutoregressive Latent Trajectory (ALT) Models A Synthesis of Two Traditions
Bollen, K. A., & Curran, P. J. (2004) · Sociological Methods & Research · doi:10.1177/0049124103260222 · Cited by 447
Research works printed but not linked: 12
- 10.1177/2378023117710578 · DOI · Paper page
- 10.2307/2297968 · DOI · Paper page
- 10.1037/a0035297 · DOI · Paper page
- 10.1037/ccp0000203 · DOI · Paper page
- 10.1037/a0032258 · DOI · Paper page
- Hamaker E. L., 2012, Handbook of research methods for studying daily life, 43
- 10.3109/08039488.2013.797023 · DOI
- Kiviet J. F., 2015, Accuracy and efficiency of various GMM inference techniques in dynamic micro panel data models, 10.2139/ssrn.2560749 · DOI
- 10.2307/1911408 · DOI · Paper page
- VanderWeele T. J., 2015, Explanation in causal inference: Methods for mediation and interaction
- 10.1037/met0000030 · DOI · Paper page
- 10.1177/1094428119847278 · DOI · Paper page
Cited by
Psychedelic-assisted psychotherapy: Where is the psychotherapy research
Aday, J. S., Horton, D., Fernandes-Osterhold, G., O’Donovan, A., Bradley, E. R., Rosen, R. C., & Woolley, J. D. (2024) · Psychopharmacology · doi:10.1007/s00213-024-06620-x · Cited by 54
Pruessner, L., Timm, C., Kalmar, J., Bents, H., Barnow, S., & Mander, J. (2024) · Depression and Anxiety · doi:10.1155/2024/9081139 · Cited by 37
“To fi ll these gaps in our understanding of the mechanisms of mindfulness, the present longitudinal study was designed to track the temporal progression of the proposed mediators, predictors, and treatment outcomes [44, 56, 57].”
BackgroundSilverman, W. K., Rey, Y., Marin, C. E., Jaccard, J., & Pettit, J. W. (2022) · Clinical Psychological Science · doi:10.1177/21677026211016402 · Cited by 30
Metadata
- Authors
- Falkenström, F., Solomonov, N., & Rubel, J.
- Venue
- Counselling and Psychotherapy Research
- Publisher
- Wiley
- Published
- 2020-01-26
- Volume
- 20
- Issue
- 3
- Pages
- 435-441
- ISSN
- 1473-3145 (ISSN-L)
- 1746-1405
- OpenAlex
- W3003865099
- Cited by
- 71
- References
- 13
- FWCI
- 3.53
- Type
- journal article
- Language
- en
- Open access
- hybrid
- Funders
- National Institute of Mental Health (T32, MH019132)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Using time‐lagged panel data analysis to study mechanisms of change in psychotherapy research: Methodological recommendations. https://app.cochat.ai/papers/10.1002/capr.12293
- The paper
- Falkenström, F., Solomonov, N., & Rubel, J. (2020). Using time‐lagged panel data analysis to study mechanisms of change in psychotherapy research: Methodological recommendations. Counselling and Psychotherapy Research. https://doi.org/10.1002/capr.12293
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.