Cost and Effectiveness of Blended Versus Standard Cognitive Behavioral Therapy for Outpatients With Depression in Routine Specialized Mental Health Care: Pilot Randomized Controlled Trial
Open accessThe DOI matches its Crossref record; 57 of the 57 references it cites were found in a registry or an index.
Abstract
Background: Cognitive behavioral therapy (CBT) is an effective treatment, but access is often restricted due to costs and limited availability of trained therapists. Blending online and face-to-face CBT for depression might improve cost-effectiveness and treatment availability. Objective: This pilot study aimed to examine the costs and effectiveness of blended CBT compared with standard CBT for depressed patients in specialized mental health care to guide further research and development of blended CBT. Methods: Patients were randomly allocated to blended CBT (n=53) or standard CBT (n=49). Blended CBT consisted of 10 weekly face-to-face sessions and 9 Web-based sessions. Standard CBT consisted of 15 to 20 weekly face-to-face sessions. At baseline and 10, 20, and 30 weeks after start of treatment, self-assessed depression severity, quality-adjusted life-years (QALYs), and costs were measured. Clinicians, blinded to treatment allocation, assessed psychopathology at all time points. Data were analyzed using linear mixed models. Uncertainty intervals around cost and effect estimates were estimated with 5000 Monte Carlo simulations. Results: Blended CBT treatment duration was mean 19.0 (SD 12.6) weeks versus mean 33.2 (SD 23.0) weeks in standard CBT (P<.001). No significant differences were found between groups for depressive episodes (risk difference [RD] 0.06, 95% CI −0.05 to 0.19), response to treatment (RD 0.03, 95% CI −0.10 to 0.15), and QALYs (mean difference 0.01, 95% CI −0.03 to 0.04). Mean societal costs for blended CBT were €1183 higher than standard CBT. This difference was not significant (95% CI −399 to 2765). Blended CBT had a probability of being cost-effective compared with standard CBT of 0.02 per extra QALY and 0.37 for an additional treatment response, at a ceiling ratio of €25,000. For health care providers, mean costs for blended CBT were €176 lower than standard CBT. This difference was not significant (95% CI −659 to 343). At €0 per additional unit of effect, the probability of blended CBT being cost-effective compared with standard CBT was 0.75. The probability increased to 0.88 at a ceiling ratio of €5000 for an added treatment response, and to 0.85 at €10,000 per QALY gained. For avoiding new depressive episodes, blended CBT was deemed not cost-effective compared with standard CBT because the increase in costs was associated with negative effects. Conclusions: This pilot study shows that blended CBT might be a promising way to engage depressed patients in specialized mental health care. Compared with standard CBT, blended CBT was not considered cost-effective from a societal perspective but had an acceptable probability of being cost-effective from the health care provider perspective. Results should be carefully interpreted due to the small sample size. Further research in larger replication studies focused on optimizing the clinical effects of blended CBT and its budget impact is warranted. Trial Registration: Netherlands Trial Register NTR4650; https://www.trialregister.nl/trial/4408 International Registered Report Identifier (IRRID): RR2-10.1186/s12888-014-0290-z
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures


Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“research has shown that bCBT achieves similar outcomes to traditional CBT, despite reduced face-to-face time with therapists [27,33-35].”
From Barriers to and Facilitators of a Blended Cognitive Behavioral Therapy Program for Depression and Anxiety Based on Experiences of University Students: Qualitative Interview Study (2023) · cites this paper as [27]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The bCBT appears to be an acceptable, clinically effective, and cost-effective option for treating depression and anxiety disorders [27-32].”
From Barriers to and Facilitators of a Blended Cognitive Behavioral Therapy Program for Depression and Anxiety Based on Experiences of University Students: Qualitative Interview Study (2023) · cites this paper as [27]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Fitting Linear Mixed-Effects Models Using lme4
Bates, D., Mächler, M., Bolker, B., & Walker, S. (2015) · Journal of Statistical Software · doi:10.18637/jss.v067.i01 · Cited by 86,835
(1998) · The Journal of Clinical Psychiatry · Cited by 19,139
EuroQol: a new facility for the measurement of health-related quality of life
(1990) · Health Policy · doi:10.1016/0168-8510(90)90421-9 · Cited by 15,736 · cited 1×
“To calculate quality-adjusted life-years (QALYs), the EQ-5D three-level version [52] questionnaire was administered online at all four time points.”
(1998) · PubMed · Cited by 10,216
Jacobson, N. S., & Truax, P. (1991) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.59.1.12 · Cited by 7,770
Trivedi, M. H., Rush, A. J., Wisniewski, S. R., Nierenberg, A. A., Warden, D., Ritz, L., Norquist, G., Howland, R. H., Lebowitz, B., McGrath, P. J., et al. (2006) · American Journal of Psychiatry · doi:10.1176/appi.ajp.163.1.28 · Cited by 3,879 · cited 1×
“Remission was defined as the combination of an RCI less than −1.96 and an IDS-SR 30 score less than 13, indicating no depression severity on the IDS-SR 30 severity index [46,51].”
InfluentialRush, A. J., Trivedi, M. H., Ibrahim, H. M., Carmody, T. J., Arnow, B., Klein, D. N., Markowitz, J. C., Ninan, P. T., Kornstein, S., Manber, R., et al. (2003) · Biological Psychiatry · doi:10.1016/s0006-3223(02)01866-8 · Cited by 3,829 · cited 1×
“As part of the treatment, patients in both treatment groups were encouraged to fill in the 16-item Quick Inventory of Depressive Symptomatology Self-Report on a weekly basis to allow patients and their therapists to monitor change in depression severity [45].”
The empirical status of cognitive-behavioral therapy: A review of meta-analyses
Butler, A. C., Chapman, J. E., Forman, E. M., & Beck, A. T. (2006) · Clinical Psychology Review · doi:10.1016/j.cpr.2005.07.003 · Cited by 3,215
The Inventory of Depressive Symptomatology (IDS): Psychometric properties
Rush, A. J., Gullion, C. M., Basco, M. R., Jarrett, R. B., & Trivedi, M. H. (1996) · Psychological Medicine · doi:10.1017/s0033291700035558 · Cited by 2,177
(2011) · Cited by 2,032
Research works printed but not linked: 17
- Kohn, R, 2004, Bull World Health Organ, 82, 858
- Bremmer, F, 2013, Een analyse van de verwachte kosten en baten van eHealth-blended behandelen en begeleiden
- 2017, Ont Health Technol Assess Ser, 17, 1
- Ruwaard, J, 2015, Eur Health Psychol, 17, 45
- 10.1111/cpsp.12173 · doi:10.1111/cpsp.12173 · Paper page
- Hickie, IB, 2010, Med J Aust, 192, S31
- 2000, Diagnostic and Statistical Manual of Mental Disorders, 4th Edition, Text Revision (DSM-IV-TR)
- Spijker, J, 2013, Multidisciplinaire richtlijn depressie (derde revisie). Richtlijn voor de diagnostiek, behandeling en begeleiding van volwassen patiënten met een depressieve stoornis
- Sheehan, DV, 1998, J Clin Psychiatry, 59 Suppl 20, 22
- van Vliet, IM, 2007, Tijdschrift voor de Psychiatrie, 49, 197
- Beck, AT, 1980, Cognitive Therapy of Depression
- Jacobson, NS, 1991, Methodological Issues and Strategies in Clinical Research, 631
- Hakkaart-van Roijen, L, 2002, Trimbos/iMTA questionnaire for costs associated with psychiatric illness (TIC-P)
- Hakkaart-van Roijen, L, 2016, Kostenhandleiding: methodologie van kostenonderzoek en referentieprijzen voor economische evaluaties in de gezondheidszorg
- Hakkaart-Van Roijen, L, 2010, Handleiding voor kostenonderzoek--methoden en standaard kostprijzen voor economische evaluaties in de gezondheidszorg
- 2016, Z-index
- 2018, R: a language and environment for statistical computing
Cited by
The COVID-19 pandemic: the ‘black swan’for mental health care and a turning point for e-health
Wind, T. R., Rijkeboer, M., Andersson, G., & Riper, H. (2020) · Internet Interventions · doi:10.1016/j.invent.2020.100317 · Cited by 782
Self-citationMitchell, L. M., Joshi, U., Patel, V., Lu, C., & Naslund, J. A. (2021) · Journal of Affective Disorders · doi:10.1016/j.jad.2021.01.092 · Cited by 80
“both internet self-help and in-person sessions (Kenter et al., 2015; Kooistra et al., 2019), and”
BackgroundInfluentialSchuster, R., Topooco, N., Keller, A., Radvogin, E., & Laireiter, A.-R. (2020) · Internet Interventions · doi:10.1016/j.invent.2020.100326 · Cited by 77
Mol, M., van Genugten, C., Dozeman, E., van Schaik, D. J. F., Draisma, S., Riper, H., & Smit, J. H. (2019) · Journal of Clinical Medicine · doi:10.3390/jcm9010091 · Cited by 61
Self-citationBührmann, L., Schuurmans, J., Ruwaard, J., Fleuren, M. A. H., Etzelmueller, A., Piera-Jiménez, J., Finch, T. L., Rapley, T., Potthoff, S., Aouizerate, B., et al. (2020) · Trials · doi:10.1186/s13063-020-04686-4 · Cited by 57
Self-citation
Metadata
- Authors
- Kooistra, L. C., Wiersma, J. E., Ruwaard, J., Neijenhuijs, K., Lokkerbol, J., van Oppen, P., Smit, F., & Riper, H.
- Affiliations
- Amsterdam Public Health (NL)
- Trimbos Institute (NL)
- Corresponding author
- Kooistra, Lisa Catharine
- ORCID
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2019-10-29
- Volume
- 21
- Issue
- 10
- Pages
- e14261
- ISSN
- 1438-8871 (ISSN-L)
- PMC
- PMC6914243
- OpenAlex
- W2982335768
- Cited by
- 84
- References
- 57
- Citations by year
- 2026: 8 · 2025: 14 · 2024: 11 · 2023: 9 · 2022: 16 · 2021: 14 · 2020: 11 · 2019: 1
- FWCI
- 11.86
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- Journal of Medical Internet Research (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Amsterdam UMC (VU Amsterdam) - Institutional Repository (submittedVersion, other-oa)
- Data Archiving and Networked Services (DANS) (submittedVersion, other-oa)
- Funders
- ZonMw (837001007)
- Topics
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Social Sciences › Economics, Econometrics and Finance › Economics and Econometrics › Health Systems, Economic Evaluations, Quality of Life
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Anxiety, Depression, Psychometrics, Treatment, Cognitive Processes
- Keywords
- depression, online therapy, online intervention, cost-effectiveness, quality-adjusted life years, treatment response, outpatients, specialized mental health care, treatment duration, social costs, depression severity, psychopathology, Monte Carlo simulation, therapist availability, access to mental health care, digital mental health interventions
- MeSH terms
- Adult, Cost-Benefit Analysis, Depression, Female, Humans, Male, Mental Health, Outpatients, Pilot Projects, Cognitive Behavioral Therapy, Treatment Outcome, Quality-Adjusted Life Years
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.