The use of digitally assessed stress levels to model change processes in CBT -A feasibility study on seven case examples
Open accessAbstract
In psychotherapy research, the measurement of treatment processes and outcome are predominantly based on self-reports. However, given new technological developments, other potential sources can be considered to improve measurements. In a feasibility study, we examined whether Ecological Momentary Assessments (EMA) using digital phenotyping (stress level) can be a valuable tool to investigate change processes during cognitive behavioral therapy (CBT). Seven outpatients undergoing psychological treatment were assessed using EMA. Continuous stress levels (heart rate variability) were assessed via fitness trackers (Garmin) every 3 min over a 2-week time period (6,720 measurements per patient). Time-varying change point autoregressive (TVCP-AR) models were employed to detect both gradual and abrupt changes in stress levels. Results for seven case examples indicate differential patterns of change processes in stress. More precisely, inertia of stress level changed gradually over time in one of the participants, whereas the other participants showed both gradual and abrupt changes. This feasibility study demonstrates that intensive longitudinal assessments enriched by digitally assessed stress levels have the potential to investigate intra- and interindividual differences in treatment change processes and their relations to treatment outcome. Further, implementation issues and implications for future research and developments using digital phenotyping are discussed.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
More recent developments in data-informed psychotherapy deal with tools from e-mental health apps and intensive longitudinal assessments, which can also be used to create, improve and customize CF.
“More recent developments in data-informed psychotherapy deal with tools from e-mental health apps and intensive longitudinal assessments, which can also be used to create, improve and customize CF (Hehlmann et al., 2021).”
From Data-Informed Case Formulation with the Trier Treatment Navigator (2022) · cites this paper as Hehlmann et al., 2021
The Introduction describes intensive repeated assessments using mobile devices, and the Limitations and Conclusion section says digitally assessed information might help therapists adapt treatment to individual patients. The paper does not say these tools can create, improve, or customize CF specifically; it discusses treatment monitoring and adaptation instead. No page numbers are available in our copy. (LLM, conf=0.86)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
The PHQ-9: Validity of a brief depression severity measure
Kroenke, K., Spitzer, R. L., & Williams, J. B. W. (2001) · Journal of General Internal Medicine · doi:10.1046/j.1525-1497.2001.016009606.x · Cited by 44,910 · see citing works
Kroenke, K., Spitzer, R. L., Williams, J. B. W., & Löwe, B. (2010) · General Hospital Psychiatry · doi:10.1016/j.genhosppsych.2010.03.006 · Cited by 4,057 · see citing works
The Efficacy of Cognitive Behavioral Therapy: A Review of Meta-analyses
Hofmann, S. G., Asnaani, A., Vonk, I. J. J., Sawyer, A. T., & Fang, A. (2012) · Cognitive Therapy and Research · doi:10.1007/s10608-012-9476-1 · Cited by 3,445 · see citing works
The Great Psychotherapy Debate: The Evidence for What Makes Psychotherapy Work
Wampold, B. E. (2015) · doi:10.4324/9780203582015 · Cited by 1,773 · see citing works
Cuijpers, P., Berking, M., Andersson, G., Quigley, L., Kleiboer, A., & Dobson, K. S. (2013) · The Canadian Journal of Psychiatry · doi:10.1177/070674371305800702 · Cited by 1,066 · see citing works
Trull, T. J., & Ebner-Priemer, U. (2013) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-050212-185510 · Cited by 761 · see citing works
Sudden gains and critical sessions in cognitive-behavioral therapy for depression.
Tang, T. Z., & DeRubeis, R. J. (1999) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.67.6.894 · Cited by 684 · see citing works
Investigating sources of inaccuracy in wearable optical heart rate sensors
Bent, B., Goldstein, B. A., Kibbe, W. A., & Dunn, J. P. (2020) · npj Digital Medicine · doi:10.1038/s41746-020-0226-6 · Cited by 673 · cited 2× · see citing works
“(46) found accurate results for resting heart rate when investigating several devices, among others, the Garmin vivo smart.”
BackgroundDeRubeis, R. J., Cohen, Z. D., Forand, N. R., Fournier, J. C., Gelfand, L. A., & Lorenzo-Luaces, L. (2014) · PLoS ONE · doi:10.1371/journal.pone.0083875 · Cited by 509 · see citing works
Outcome in psychotherapy: The past and important advances.
Lambert, M. J. (2013) · Psychotherapy · doi:10.1037/a0030682 · Cited by 286 · see citing works
Moore, R. C., Depp, C. A., Wetherell, J. L., & Lenze, E. J. (2016) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2016.01.011 · Cited by 274 · see citing works
Guidelines for wrist-worn consumer wearable assessment of heart rate in biobehavioral research
Nelson, B. W., Low, C. A., Jacobson, N., Areán, P., Torous, J., & Allen, N. B. (2020) · npj Digital Medicine · doi:10.1038/s41746-020-0297-4 · Cited by 241 · see citing works
Lutz, W., Rubel, J. A., Schwartz, B., Schilling, V., & Deisenhofer, A.-K. (2019) · Behaviour Research and Therapy · doi:10.1016/j.brat.2019.103438 · Cited by 196 · see citing works
Self-citationJacobson, N. C., & Chung, Y. J. (2020) · Sensors · doi:10.3390/s20123572 · Cited by 139 · cited 2× · see citing works
“Besides identifying diagnostic groups, Jacobson and Chung (35) used passive sensor data from smartphones and wearable sensors to predict major depressive disorder severity and changes in severity across days and weeks.”
BackgroundMethodAccuracy of commercially available heart rate monitors in athletes: a prospective study
Pasadyn, S. R., Soudan, M., Gillinov, M., Houghtaling, P., Phelan, D., Gillinov, N., Bittel, B., & Desai, M. Y. (2019) · Cardiovascular Diagnosis and Therapy · doi:10.21037/cdt.2019.06.05 · Cited by 135 · see citing works
Zilcha-Mano, S. (2021) · American Psychologist · doi:10.1037/amp0000629 · Cited by 123 · see citing works
Wojnarowski, C., Firth, N., Finegan, M., & Delgadillo, J. (2019) · Behavioural and Cognitive Psychotherapy · doi:10.1017/s1352465819000080 · Cited by 108 · see citing works
Flagged first, then by citations
Research works printed but not linked: 37
- Delgadillo, 2020, A development pathway towards precision mental health care, JAMA Psychiatry., 77, 889, 10.1001/jamapsychiatry.2020.1048 · DOI
- Cohen, 2018, Treatment selection in depression, Annu Rev Clin Psychol., 14, 209, 10.1146/annurev-clinpsy-050817-084746 · DOI · Paper page
- Delgadillo, 2020, Towards personalized allocation of patients to therapists, J Consult Clin Psychol, 88, 799, 10.1037/ccp0000507 · DOI
- Fisher, 2016, Enhancing the personalization of psychotherapy with dynamic assessment and modeling, Assessment., 23, 496, 10.1177/1073191116638735 · DOI
- Schwartz, 2020, Personalized treatment selection in routine care: integrating machine learning and statistical algorithms to recommend cognitive behavioral or psychodynamic therapy, Psychother Res, 31, 33, 10.1080/10503307.2020.1769219 · DOI
- Tschitsaz-Stucki, 2009, Identifikation und Aufklärung von Veränderungssprüngen im individuellen Psychotherapieverlauf, Zeitschrift Klin Psychol Psychother., 38, 13, 10.1026/1616-3443.38.1.13 · DOI
- Lutz, 2013, The ups and downs of psychotherapy: sudden gains and sudden losses identified with session reports, Psychother Res., 23, 14, 10.1080/10503307.2012.693837 · DOI
- Wucherpfennig, 2017, Sudden gains in routine care cognitive behavioral therapy for depression: a replication with extensions, Behav Res Ther., 89, 24, 10.1016/j.brat.2016.11.003 · DOI
- Lutz, 2020, Working towards the development and implementation of precision mental healthcare – an example, Adm Policy Ment Health., 47, 856, 10.1007/s10488-020-01053-y · DOI
- van de Leemput, 2014, Critical slowing down as early warning for the onset and termination of depression, Proc Natl Acad Sci USA., 111, 87, 10.1073/pnas.1312114110 · DOI
- Kuppens, 2010, Emotional inertia and psychological maladjustment, Psychol Sci., 21, 984, 10.1177/0956797610372634 · DOI
- Nelson, 2020, Everyday emotional dynamics in major depression, Emotion, 20, 179, 10.1037/emo0000541 · DOI
- Fisher, 2020, Identifying the presence and timing of discrete mood states prior to therapy, Behav Res Ther., 128, 103596, 10.1016/j.brat.2020.103596 · DOI
- Wright, 2019, Applied ambulatory assessment: integrating idiographic and nomothetic principles of measurement, Psychol Assess., 31, 1467, 10.1037/pas0000685 · DOI
- Pryss, 2019, Exploring the time trend of stress levels while using the crowdsensing mobile health platform, trackyourstress, and the influence of perceived stress reactivity: ecological momentary assessment pilot study, JMIR Mhealth Uhealth., 7, e13978, 10.2196/13978 · DOI
- Landmann, 2020, Changes in the daily life experience of patients with obsessive-compulsive disorder following mindfulness-based cognitive therapy: looking beyond symptom reduction using ecological momentary assessment, Psychiatry Res., 286, 112842, 10.1016/j.psychres.2020.112842 · DOI
- Husen, 2016, Daily affect dynamics predict early response in CBT: feasibility and predictive validity of EMA for outpatient psychotherapy, J Affect Disord., 206, 305, 10.1016/j.jad.2016.08.025 · DOI
- Lutz, 2018, Using network analysis for the prediction of treatment dropout in patients with mood and anxiety disorders. A methodological proof-of-concept study, Sci Rep., 8, 7819, 10.1038/s41598-018-25953-0 · DOI
- Onnela, 2016, Harnessing smartphone-based digital phenotyping to enhance behavioral and mental health, Neuropsychopharmacology., 41, 1691, 10.1038/npp.2016.7 · DOI · Paper page
- Wright, 2020, Personalized models of psychopathology, Ann Rev Clin Psychol., 16, 49, 10.1146/annurev-clinpsy-102419-125032 · DOI
- Asare, 2019, Towards early detection of depression through smartphone sensing, Assoc Comp Mach, 1158, 10.1145/3341162.3347075 · DOI · Paper page
- Blanck, 2019, Heart rate variability in individual psychotherapy: associations with alliance and outcome, J Nerv Ment Dis., 207, 451, 10.1097/NMD.0000000000000994 · DOI
- Jacobson, 2019, Using digital phenotyping to accurately detect depression severity, J Nerv Ment Dis., 207, 893, 10.1097/NMD.0000000000001042 · DOI · Paper page
- Albers, 2020, Inspecting gradual and abrupt changes in emotion dynamics with the time-varying change point autoregressive model, Eur J Psychol Assess., 36, 492, 10.1027/1015-5759/a000589 · DOI
- First, 2002, Structured Clinical Interview for DSM-IV-TR Axis I Disorders, Research Version
- Lutz, 2006, The development, validation, and reliability of short-forms of current instruments for the evaluation of therapeutic progress in psychotherapy and psychiatry, Diagnostica., 52, 11, 10.1026/0012-1924.52.1.11 · DOI
- Derogatis, 1992, SCL-90-R, Administration, Scoring and Procedures Manual-II for the R(evised) Version and Other Instruments of the Psychopathology Rating Scale Series
- Ellsworth, 2006, A comparison of the outcome questionnaire-45 and outcome questionnaire-30 in classification and prediction of treatment outcome, Clin Psychol Psychother., 13, 380, 10.1002/cpp.503 · DOI
- Collins, 2019, Version reporting and assessment approaches for new and updated activity and heart rate monitors, Sensors., 19, 1705, 10.3390/s19071705 · DOI
- Krone, 2017, A multivariate statistical model for emotion dynamics, Emotion., 18, 739, 10.1037/emo0000384 · DOI
- Koval, 2012, Changing emotion dynamics: individual differences in the effect of anticipatory social stress on emotional inertia, Emotion., 12, 256, 10.1037/a0024756 · DOI
- Nelson, 2017, Moving from static to dynamic models of the onset of mental disorder: a review, JAMA Psychiatry., 74, 528, 10.1001/jamapsychiatry.2017.0001 · DOI
- Bringmann, 2017, Changing dynamics: time-varying autoregressive models using generalized additive modeling, Psychol Methods., 22, 409, 10.1037/met0000085 · DOI
- Hamilton, 1989, a new approach to the economic analysis of nonstationary time series and the business cycle, Econometrica., 57, 357, 10.2307/1912559 · DOI
- Hamilton, 1994, Time Series Analysis, 10.1515/9780691218632 · DOI
- Wood, 2006, Generalized Additive Models: An Introduction With R, 10.1201/9781420010404 · DOI · Paper page
- Koval, 2012, Getting stuck in depression: the roles of rumination and emotional inertia, Cogn Emot., 26, 1412, 10.1080/02699931.2012.667392 · DOI
Cited by
Sorted by citations
Steinberg, N., Moshe-Cohen, R., Sheena, L., & Kivity, Y. (2024) · Current Psychology · doi:10.1007/s12144-023-04963-w · Cited by 8 · see citing works
Studies of Social Anxiety Using Ambulatory Assessment: Systematic Review
Fernández-Álvarez, J., Colombo, D., Gómez Penedo, J. M., Pierantonelli, M., Baños, R. M., & Botella, C. (2024) · JMIR Mental Health · doi:10.2196/46593 · Cited by 8 · see citing works
Self-citationData-Informed Case Formulation with the Trier Treatment Navigator
Moggia, D., Schaffrath, J., Bommer, J., Weinmann-Lutz, B., & Lutz, W. (2022) · Revista de Psicoterapia · doi:10.33898/rdp.v33i123.35971 · Cited by 4 · see citing works
Self-citation
- Authors
- Hehlmann, M. I., Schwartz, B., Lutz, T., Gómez Penedo, J. M., Rubel, J. A., & Lutz, W.
- Affiliations
- Universität Trier (DE)
- Justus-Liebig-Universität Gießen (DE)
- Corresponding author
- Hehlmann, Miriam I.
- Venue
- Frontiers in Psychiatry
- Publisher
- Frontiers Media SA
- Published
- 2021-03-09
- Volume
- 12
- Pages
- 613085-613085
- ISSN
- 1664-0640 (ISSN-L)
- PMC
- PMC7985334
- OpenAlex
- W3134372219
- Cited by
- 43
- References
- 17
- Citations by year
- 2026: 3 · 2025: 11 · 2024: 8 · 2023: 9 · 2022: 4 · 2021: 8
- FWCI
- 5.32
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Frontiers in Psychiatry (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- CONICET Digital (CONICET) (submittedVersion, cc-by)
- Greater South Information System
- Funders
- Deutsche Forschungsgemeinschaft (LU 660-10/1, LU 660/8–1 and LU 660/10–1, 660/10-1, LU 660/8‐1)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Mental Health Research Topics
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Social Sciences › Psychology › Clinical Psychology › Psychotherapy Techniques and Applications
- Keywords
- cognitive behavioral therapy, digital phenotyping, ecological momentary assessment, heart rate variability, wearable activity trackers, stress levels, intensive longitudinal data, treatment outcomes, individual differences
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review