Examining the Impact of Digital Components Across Different Phases of Treatment in a Blended Care Cognitive Behavioral Therapy Intervention for Depression and Anxiety: Pragmatic Retrospective Study
Open accessPublished version of a preprint
The DOI matches its Crossref record; 44 of the 44 references it cites were found in a registry or an index.
Abstract
Background: Depression and anxiety incur significant personal and societal costs. Effective psychotherapies exist, such as cognitive behavioral therapy (CBT); however, timely access to quality care is limited by myriad barriers. Blended care therapy models incorporate traditional face-to-face therapy with scalable, digital components of care, expanding the reach of evidence-based care. Objective: The aim of this study is to determine the effectiveness of a blended care CBT program (BC-CBT) in real-world settings and examine the unique impacts of the (1) digital components of care (video lessons and digital exercises) and (2) phase of treatment (early versus late) in decreasing symptoms of anxiety and depression. Methods: This retrospective cohort analysis included 3401 US-based individuals enrolled in a BC-CBT program, who presented with clinical levels of depression and/or anxiety. The treatment program consisted of regular therapy sessions augmented by clinician-assigned digital video lessons and exercises. A growth curve model incorporating time-varying covariates examined the relationship between engagement with BCT components (ie, therapy sessions, digital video lessons, and digital exercises) during the early (weeks 0-7) and late (weeks 8-15) phases of treatment, and weekly symptom reports on depression and anxiety measures. Results: On average, a significant decline in depression and anxiety symptoms was observed during the initial weeks of treatment (P<.001), with a continued, though slower, decline over subsequent weeks (P<.001). Each session completed was associated with significant decreases in anxiety (b=–0.72) and depression (b=–0.83) in the early phase, as well as in the late phase (anxiety, b=–0.47; depression, b=–0.27). Significant decreases in anxiety (b=–0.15) and depression (b=–0.12) were observed for time spent on video lessons (measured in 10-minute intervals) in the early phase of treatment. Engaging with exercises was associated with statistically significant increases in anxiety symptoms (b=0.03) during the early phase of treatment. However, sensitivity analyses examining the effects of exercises in isolation revealed significant decreases in anxiety (b=–0.05) in the early phase, suggesting a potential suppression effect in the larger model. Conclusions: Using a retrospective cohort design, therapy sessions and digital video lessons were uniquely predictive of improvements in depression and anxiety symptoms, and their effects were modulated based on the phase of treatment (early vs late). Future research should investigate whether other treatment variables, such as therapeutic alliance or familiarity with technology, are related to differential effects on various components of care.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures



Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The bCBT appears to be an acceptable, clinically effective, and cost-effective option for treating depression and anxiety disorders [27-32].”
From Barriers to and Facilitators of a Blended Cognitive Behavioral Therapy Program for Depression and Anxiety Based on Experiences of University Students: Qualitative Interview Study (2023) · cites this paper as [30]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Prior research has shown that use of these digital tools in LCT is associated with greater reductions in symptoms of anxiety and depression [22,30].”
The cited source says what the claim attributes to it.
In the citing paper
“In addition to prior research showing that bCBT is effective in reducing symptomology [29-32], the results of our qualitative investigation further indicate that the use of the app along with face-to-face sessions also seems to be associated with positive feelings regarding the therapy process among students.”
The cited source says what the claim attributes to it.
In the citing paper
“In accordance with the results achieved by Wu et al [30], who conducted a quantitative study with patients with symptoms of anxiety or depression, our results show that using DTx in bCBT can be especially useful for psychoeducation, as it helps to reinforce the uptake of the content of therapy sessions, such as coping skills, and key concepts such as the biopsychosocial framework [55].”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The PHQ-9: Validity of a brief depression severity measure
Kroenke, K., Spitzer, R. L., & Williams, J. B. W. (2001) · Journal of General Internal Medicine · doi:10.1046/j.1525-1497.2001.016009606.x · Cited by 44,910
Multiple regression: testing and interpreting interactions
(1992) · Choice Reviews Online · doi:10.5860/choice.29-3352 · Cited by 36,654
A Brief Measure for Assessing Generalized Anxiety Disorder: The GAD-7
Spitzer, R. L., Kroenke, K., Williams, J. B. W., & Löwe, B. (2006) · Archives of Internal Medicine · doi:10.1001/archinte.166.10.1092 · Cited by 31,765
Kroenke, K., Spitzer, R. L., Williams, J. B. W., & Löwe, B. (2010) · General Hospital Psychiatry · doi:10.1016/j.genhosppsych.2010.03.006 · Cited by 4,057 · cited 1×
“Both symptom severity measures have undergone extensive validation in numerous clinical trials, demonstrating strong psychometric properties as supported by high validity, reliability, and treatment sensitivity [28].”
BackgroundThe empirical status of cognitive-behavioral therapy: A review of meta-analyses
Butler, A. C., Chapman, J. E., Forman, E. M., & Beck, A. T. (2006) · Clinical Psychology Review · doi:10.1016/j.cpr.2005.07.003 · Cited by 3,215
Plummer, F., Manea, L., Trepel, D., & McMillan, D. (2016) · General Hospital Psychiatry · doi:10.1016/j.genhosppsych.2015.11.005 · Cited by 1,882 · cited 1×
“A cutoff score on the GAD-7 of ≥8 has been used to indicate a likely diagnosis of generalized anxiety disorder [27].”
MethodInternet-based cognitive behaviour therapy for symptoms of depression and anxiety: A meta-analysis
SPEK, V., CUIJPERS, P., NYKLÍČEK, I., RIPER, H., KEYZER, J., & POP, V. (2007) · Psychological Medicine · doi:10.1017/s0033291706008944 · Cited by 1,586 · cited 1×
“Targeting anxiety and depression through iCBT has shown significant decreases in symptom severity [9,10], although greater treatment effects are observed when iCBT is performed with therapist support versus without [11].”
BackgroundThe impact of guidance on Internet-based mental health interventions — A systematic review
Baumeister, H., Reichler, L., Munzinger, M., & Lin, J. (2014) · Internet Interventions · doi:10.1016/j.invent.2014.08.003 · Cited by 1,037
Andrews, G., Basu, A., Cuijpers, P., Craske, M. G., McEvoy, P., English, C. L., & Newby, J. M. (2018) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2018.01.001 · Cited by 922 · cited 1×
“Targeting anxiety and depression through iCBT has shown significant decreases in symptom severity [9,10], although greater treatment effects are observed when iCBT is performed with therapist support versus without [11].”
BackgroundKessler, R. C. (2012) · Psychiatric Clinics of North America · doi:10.1016/j.psc.2011.11.005 · Cited by 871
Generalized anxiety disorder: prevalence, burden, and cost to society
Wittchen, H.-U. (2002) · Depression and Anxiety · doi:10.1002/da.10065 · Cited by 733
A phase model of psychotherapy outcome: Causal mediation of change.
Howard, K. I., Lueger, R. J., Maling, M. S., & Martinovich, Z. (1993) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.61.4.678 · Cited by 576 · cited 1×
“These findings also highlight the importance of setting positive expectations and obtaining client buy-in early on in therapy [33], given that the early phase of treatment often incites hope and a sense of agency [34].”
BackgroundHayes, A. M., Laurenceau, J.-P., Feldman, G., Strauss, J. L., & Cardaciotto, L. (2007) · Clinical Psychology Review · doi:10.1016/j.cpr.2007.01.008 · Cited by 508
Handbook of multimethod measurement in psychology.
(2006) · American Psychological Association eBooks · doi:10.1037/11383-000 · Cited by 481
Health, T. L. G. (2020) · The Lancet Global Health · doi:10.1016/s2214-109x(20)30432-0 · Cited by 417
Improving access to psychological treatments: lessons from developing countries
Patel, V., Chowdhary, N., Rahman, A., & Verdeli, H. (2011) · Behaviour Research and Therapy · doi:10.1016/j.brat.2011.06.012 · Cited by 394 · cited 1×
“These benefits are particularly important to consider when resources are limited and therapy sessions cannot be conducted with regularity, which can be affected by financial barriers, difficulties obtaining reliable transportation to/from sessions, or lack of access to trained professionals [38,39].”
BackgroundPăsărelu, C. R., Andersson, G., Bergman Nordgren, L., & Dobrean, A. (2017) · Cognitive Behaviour Therapy · doi:10.1080/16506073.2016.1231219 · Cited by 335 · cited 1×
“Targeting anxiety and depression through iCBT has shown significant decreases in symptom severity [9,10], although greater treatment effects are observed when iCBT is performed with therapist support versus without [11].”
BackgroundThe Relationship Between Homework Compliance and Therapy Outcomes: An Updated Meta-Analysis
Mausbach, B. T., Moore, R., Roesch, S., Cardenas, V., & Patterson, T. L. (2010) · Cognitive Therapy and Research · doi:10.1007/s10608-010-9297-z · Cited by 309
Poverty and Mental Health: How Do Low‐Income Adults and Children Fare in Psychotherapy?
Santiago, C. D., Kaltman, S., & Miranda, J. (2013) · Journal of Clinical Psychology · doi:10.1002/jclp.21951 · Cited by 267
Fernandez, E., Woldgabreal, Y., Day, A., Pham, T., Gleich, B., & Aboujaoude, E. (2021) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.2594 · Cited by 167 · cited 1×
“Video-based teletherapy allows treatment sessions to occur over a videoconferencing platform in real time, and it has shown similarly robust treatment outcomes when compared to in-person CBT for depression and anxiety [6].”
ResultGlenn, D., Golinelli, D., Rose, R. D., Roy-Byrne, P., Stein, M. B., Sullivan, G., Bystritksy, A., Sherbourne, C., & Craske, M. G. (2013) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0033403 · Cited by 166
Baumel, A., Edan, S., & Kane, J. M. (2019) · Translational Behavioral Medicine · doi:10.1093/tbm/ibz147 · Cited by 143 · cited 1×
“Indeed, difficulties with retention and smaller treatment effects arise without therapist guidance [12], especially when implemented in real word conditions [13], highlighting the potency of therapist involvement.”
BackgroundRelationship Between Homework Completion and Outcome in Cognitive Behaviour Therapy
Rees, C. S., McEvoy, P. M., & Nathan, P. R. (2005) · Cognitive Behaviour Therapy · doi:10.1080/16506070510011548 · Cited by 141
Guided internet-based CBT for common mental disorders
Andersson, G., Carlbring, P., Ljótsson, B., & Hedman, E. (2013) · Journal of Contemporary Psychotherapy · doi:10.1007/s10879-013-9237-9 · Cited by 119
A meta-analysis of sudden gains in psychotherapy: Outcome and moderators
Shalom, J. G., & Aderka, I. M. (2020) · Clinical Psychology Review · doi:10.1016/j.cpr.2020.101827 · Cited by 100
Starting off on the right foot: Common factor elements in early psychotherapy process.
DeFife, J. A., & Hilsenroth, M. J. (2011) · Journal of Psychotherapy Integration · doi:10.1037/a0023889 · Cited by 92
Reardon, M. L., Cukrowicz, K. C., Reeves, M. D., & Joiner, T. E. (2002) · Psychotherapy Research · doi:10.1080/713664390 · Cited by 88
Bennett, C. B., Ruggero, C. J., Sever, A. C., & Yanouri, L. (2020) · Journal of Psychotherapy Integration · doi:10.1037/int0000217 · Cited by 87 · cited 1×
“In these cases, digital video lessons can be pivotal in expanding access to evidence-based treatment, given the support that digital interventions have received for effectively reducing access barriers [40].”
BackgroundKooistra, L. C., Wiersma, J. E., Ruwaard, J., Neijenhuijs, K., Lokkerbol, J., van Oppen, P., Smit, F., & Riper, H. (2019) · Journal of Medical Internet Research · doi:10.2196/14261 · Cited by 84
Beard, J. I. L., & Delgadillo, J. (2019) · Depression and Anxiety · doi:10.1002/da.22931 · Cited by 81 · cited 1×
“Early response and treatment gains at the beginning of therapy have received particular attention [19], as clients who experience early response to treatment tend to achieve better posttreatment outcomes for anxiety and depression [20].”
BackgroundLungu, A., Jun, J. J., Azarmanesh, O., Leykin, Y., & Chen, C. E.-J. (2020) · Journal of Medical Internet Research · doi:10.2196/18723 · Cited by 75 · cited 3×
“More details regarding the BC-CBT online platform can be accessed via Lungu et al (2020) [16].”
BackgroundMethodSelf-citationWeightman, M. (2020) · Journal of International Medical Research · doi:10.1177/0300060520928686 · Cited by 62 · cited 1×
“Teletherapy facilitates access to therapy regardless of travel limitations or lack of resources in certain geographic locations, expanding the reach of evidence-based care [7].”
BackgroundWilliams, A. D., O'Moore, K., Mason, E., & Andrews, G. (2014) · Internet Interventions · doi:10.1016/j.invent.2014.11.001 · Cited by 53 · cited 1×
“Digital video lessons employ a storytelling approach, which has been shown to be helpful for enhancing relatability and normalization of the presenting issues [24].”
BackgroundGloster, A. T., Klotsche, J., Gerlach, A. L., Hamm, A., Ströhle, A., Gauggel, S., Kircher, T., Alpers, G. W., Deckert, J., & Wittchen, H.-U. (2014) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0034555 · Cited by 49 · cited 1×
“As various treatment components and process variables may be more or less potent at different times [18], examining these variables in a time-sensitive manner will allow for increased precision and personalization of care to optimize treatment outcomes.”
BackgroundThe use of homework in behavior therapy for anxiety disorders
Huppert, J. D., Roth Ledley, D., & Foa, E. B. (2006) · Journal of Psychotherapy Integration · doi:10.1037/1053-0479.16.2.128 · Cited by 36 · cited 1×
“Indeed, facing challenging situations and implementing regular out-of-session skills practices lead to long-term decreases in symptom severity and strengthen the durability of treatment gains [22,23].”
BackgroundSburlati, E. S., Lyneham, H. J., Schniering, C. A., & Rapee, R. M. (2014) · Cited by 35
Chu, B. C., Skriner, L. C., & Zandberg, L. J. (2013) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0033390 · Cited by 33 · cited 1×
“As such, it is not surprising to see a slower decline in symptoms in the latter stage of therapy, which is expected due to the increased difficulty of therapeutic tasks [17,35].”
BackgroundBaumeister, H., Bauereiss, N., Zarski, A.-C., Braun, L., Buntrock, C., Hoherz, C., Idrees, A. R., Kraft, R., Meyer, P., Nguyen, T. B. D., et al. (2021) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2021.660534 · Cited by 30
Holtforth, M. G., Grawe, K., & Castonguay, L. G. (2006) · Psychotherapy Research · doi:10.1080/10503300600608215 · Cited by 29
Payne, K., & Myhr, G. (2010) · Healthcare Policy | Politiques de Santé · doi:10.12927/hcpol.2013.21647 · Cited by 28
Therapist effects and the impacts of therapy nonattendance.
Xiao, H., Hayes, J. A., Castonguay, L. G., McAleavey, A. A., & Locke, B. D. (2017) · Psychotherapy · doi:10.1037/pst0000103 · Cited by 26
Application of blended care as a mechanism of action in the construction of digital therapeutics
Netto, A. V. (2020) · Einstein (São Paulo) · doi:10.31744/einstein_journal/2020md5640 · Cited by 18
Facilitating Homework and Generalization of Skills to the Real World
Cummings, C. M., Kazantzis, N., & Kendall, P. C. (2014) · Wiley eBooks · doi:10.1002/9781118500576.ch11 · Cited by 8
Dysphoria (Anxiety/Depression) Protocol
Hinton, D. E., & Jalal, B. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108671217.014 · Cited by 1
Research works printed but not linked: 4
- Payne, KA, 2010, Healthc Policy, 5, e173
- 2014, SAS/STAT Documentation (Version 9.4)
- Flynn, HA, 2014, Curr Psychiatry, 13, 45
- 10.1037//0022-006x.61.4.678 · doi:10.1037//0022-006x.61.4.678 · Paper page
Cited by
(2024) · doi:10.2196/49660 · Cited by 45
Biskupiak, Z., Ha, V. V., Rohaj, A., & Bulaj, G. W. (2024) · Journal of Clinical Medicine · doi:10.3390/jcm13020403 · Cited by 52
Dweik, R. A., Ajaj, R., Kotb, R. E., Halabi, D. E., Sadier, N. S., Sarsour, H. H. H., & Elhadi, Y. A. M. (2024) · BMC Public Health · doi:10.1186/s12889-024-19980-y · Cited by 43
Owusu, J. T., Wang, P., Wickham, R. E., Varra, A. A., Chen, C., & Lungu, A. (2022) · Telemedicine and e-Health · doi:10.1089/tmj.2021.0590 · Cited by 24
Self-citationBraun, P., Atik, E., Guthardt, L., Apolinário-Hagen, J., & Schückes, M. (2023) · JMIR Formative Research · doi:10.2196/45970 · Cited by 17
“In accordance with the results achieved by Wu et al [30], who conducted a quantitative study with patients with symptoms of anxiety or depression, our results show that using DTx in bCBT can be especially useful for psychoeducation, as it helps to reinforce the uptake of the content of therapy sessions, such as coping…”
BackgroundResult
Metadata
- Authors
- Wu, M. S., Wickham, R. E., Chen, S.-Y., Chen, C., & Lungu, A.
- Affiliations
- Palo Alto University (US)
- Corresponding author
- Wu, Monica S
- Venue
- JMIR Formative Research
- Publisher
- JMIR Publications Inc.
- Published
- 2021-12-17
- Volume
- 5
- Issue
- 12
- Pages
- e33452
- ISSN
- 2561-326X (ISSN-L)
- PMC
- PMC8726023
- OpenAlex
- W4200229509
- Semantic Scholar
- 12fd04cd9b0eca79234daa92cb7101923ba58747
- Cited by
- 15
- References
- 44
- Citations by year
- 2026: 1 · 2025: 1 · 2024: 9 · 2023: 2 · 2022: 2
- FWCI
- 2.92
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- JMIR Formative Research (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- Topics
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Anxiety, Depression, Psychometrics, Treatment, Cognitive Processes
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Telemedicine and Telehealth Implementation
- Keywords
- depression, anxiety, treatment engagement, symptom change over time, real-world effectiveness, suppression effect, growth curve models, time-varying covariates, patient-reported outcomes
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.