CoChat

Cost and Effectiveness of Blended Versus Standard Cognitive Behavioral Therapy for Outpatients With Depression in Routine Specialized Mental Health Care: Pilot Randomized Controlled Trial

Open access
Kooistra, Lisa Catharine, Wiersma, Jenneke Elize, Ruwaard, Jeroen, Neijenhuijs, Koen, Lokkerbol, Joran, van Oppen, Patricia, Smit, Filip, Riper, Heleen · 2019 · Journal of Medical Internet Research

The DOI matches its Crossref record; 57 of the 57 references it cites were found in a registry or an index.

Abstract

Background: Cognitive behavioral therapy (CBT) is an effective treatment, but access is often restricted due to costs and limited availability of trained therapists. Blending online and face-to-face CBT for depression might improve cost-effectiveness and treatment availability. Objective: This pilot study aimed to examine the costs and effectiveness of blended CBT compared with standard CBT for depressed patients in specialized mental health care to guide further research and development of blended CBT. Methods: Patients were randomly allocated to blended CBT (n=53) or standard CBT (n=49). Blended CBT consisted of 10 weekly face-to-face sessions and 9 Web-based sessions. Standard CBT consisted of 15 to 20 weekly face-to-face sessions. At baseline and 10, 20, and 30 weeks after start of treatment, self-assessed depression severity, quality-adjusted life-years (QALYs), and costs were measured. Clinicians, blinded to treatment allocation, assessed psychopathology at all time points. Data were analyzed using linear mixed models. Uncertainty intervals around cost and effect estimates were estimated with 5000 Monte Carlo simulations. Results: Blended CBT treatment duration was mean 19.0 (SD 12.6) weeks versus mean 33.2 (SD 23.0) weeks in standard CBT (P<.001). No significant differences were found between groups for depressive episodes (risk difference [RD] 0.06, 95% CI −0.05 to 0.19), response to treatment (RD 0.03, 95% CI −0.10 to 0.15), and QALYs (mean difference 0.01, 95% CI −0.03 to 0.04). Mean societal costs for blended CBT were €1183 higher than standard CBT. This difference was not significant (95% CI −399 to 2765). Blended CBT had a probability of being cost-effective compared with standard CBT of 0.02 per extra QALY and 0.37 for an additional treatment response, at a ceiling ratio of €25,000. For health care providers, mean costs for blended CBT were €176 lower than standard CBT. This difference was not significant (95% CI −659 to 343). At €0 per additional unit of effect, the probability of blended CBT being cost-effective compared with standard CBT was 0.75. The probability increased to 0.88 at a ceiling ratio of €5000 for an added treatment response, and to 0.85 at €10,000 per QALY gained. For avoiding new depressive episodes, blended CBT was deemed not cost-effective compared with standard CBT because the increase in costs was associated with negative effects. Conclusions: This pilot study shows that blended CBT might be a promising way to engage depressed patients in specialized mental health care. Compared with standard CBT, blended CBT was not considered cost-effective from a societal perspective but had an acceptable probability of being cost-effective from the health care provider perspective. Results should be carefully interpreted due to the small sample size. Further research in larger replication studies focused on optimizing the clinical effects of blended CBT and its budget impact is warranted. Trial Registration: Netherlands Trial Register NTR4650; https://www.trialregister.nl/trial/4408 International Registered Report Identifier (IRRID): RR2-10.1186/s12888-014-0290-z

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.2196/14261

Cites

57 of 57 references verified0 citation errors · 0 not checkable

Statistics

Figures

Figure 1 Flowchart. bCBT: blended cognitive behavioral therapy; CBT: standard cognitive behavioral therapy.
Figure 1 Flowchart. bCBT: blended cognitive behavioral therapy; CBT: standard cognitive behavioral therapy.CC BY · PubMed Central
Figure 2 Cost-effectiveness planes for response to treatment (blended CBT versus standard CBT) from the societal perspective (top left) and health care provider perspective (top right), and cost-effectiveness acceptability curves for response to treatment (blended CBT versus standard CBT) from the societal perspective (bottom left) and health care provider perspective (bottom right). CBT: cognitive behavioral therapy
Figure 2 Cost-effectiveness planes for response to treatment (blended CBT versus standard CBT) from the societal perspective (top left) and health care provider perspective (top right), and cost-effectiveness acceptability curves for response to treatment (blended CBT versus standard CBT) from the societal perspective (bottom left) and health care provider perspective (bottom right). CBT: cognitive behavioral therapyCC BY · PubMed Central

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Research works printed but not linked: 17

  1. Kohn, R, 2004, Bull World Health Organ, 82, 858
  2. Bremmer, F, 2013, Een analyse van de verwachte kosten en baten van eHealth-blended behandelen en begeleiden
  3. 2017, Ont Health Technol Assess Ser, 17, 1
  4. Ruwaard, J, 2015, Eur Health Psychol, 17, 45
  5. 10.1111/cpsp.12173 · doi:10.1111/cpsp.12173 · Paper page
  6. Hickie, IB, 2010, Med J Aust, 192, S31
  7. 2000, Diagnostic and Statistical Manual of Mental Disorders, 4th Edition, Text Revision (DSM-IV-TR)
  8. Spijker, J, 2013, Multidisciplinaire richtlijn depressie (derde revisie). Richtlijn voor de diagnostiek, behandeling en begeleiding van volwassen patiënten met een depressieve stoornis
  9. Sheehan, DV, 1998, J Clin Psychiatry, 59 Suppl 20, 22
  10. van Vliet, IM, 2007, Tijdschrift voor de Psychiatrie, 49, 197
  11. Beck, AT, 1980, Cognitive Therapy of Depression
  12. Jacobson, NS, 1991, Methodological Issues and Strategies in Clinical Research, 631
  13. Hakkaart-van Roijen, L, 2002, Trimbos/iMTA questionnaire for costs associated with psychiatric illness (TIC-P)
  14. Hakkaart-van Roijen, L, 2016, Kostenhandleiding: methodologie van kostenonderzoek en referentieprijzen voor economische evaluaties in de gezondheidszorg
  15. Hakkaart-Van Roijen, L, 2010, Handleiding voor kostenonderzoek--methoden en standaard kostprijzen voor economische evaluaties in de gezondheidszorg
  16. 2016, Z-index
  17. 2018, R: a language and environment for statistical computing

Cited by

See all 85

Metadata

Authors
Kooistra, L. C., Wiersma, J. E., Ruwaard, J., Neijenhuijs, K., Lokkerbol, J., van Oppen, P., Smit, F., & Riper, H.
Affiliations
  • Amsterdam Public Health (NL)
  • Trimbos Institute (NL)
Corresponding author
Kooistra, Lisa Catharine
Venue
Journal of Medical Internet Research
Published
2019-10-29
Volume
21
Issue
10
Pages
e14261
ISSN
1438-8871 (ISSN-L)
OpenAlex
W2982335768
Cited by
84
References
57
Citations by year
2026: 8 · 2025: 14 · 2024: 11 · 2023: 9 · 2022: 16 · 2021: 14 · 2020: 11 · 2019: 1
FWCI
11.86
Type
journal article
Language
en
Open access
Licence
cc-by
Locations
  • Journal of Medical Internet Research (publishedVersion, cc-by)
  • Europe PMC (PubMed Central) (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • Amsterdam UMC (VU Amsterdam) - Institutional Repository (submittedVersion, other-oa)
  • Data Archiving and Networked Services (DANS) (submittedVersion, other-oa)
Funders
ZonMw (837001007)
Topics
  • Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
  • Social Sciences › Economics, Econometrics and Finance › Economics and Econometrics › Health Systems, Economic Evaluations, Quality of Life
  • Social Sciences › Psychology › Experimental and Cognitive Psychology › Anxiety, Depression, Psychometrics, Treatment, Cognitive Processes
Keywords
depression, online therapy, online intervention, cost-effectiveness, quality-adjusted life years, treatment response, outpatients, specialized mental health care, treatment duration, social costs, depression severity, psychopathology, Monte Carlo simulation, therapist availability, access to mental health care, digital mental health interventions
MeSH terms
Adult, Cost-Benefit Analysis, Depression, Female, Humans, Male, Mental Health, Outpatients, Pilot Projects, Cognitive Behavioral Therapy, Treatment Outcome, Quality-Adjusted Life Years

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.