The DOI matches its Crossref record; 57 of the 57 references it cites were found in a registry or an index.
Cost and Effectiveness of Blended Versus Standard Cognitive Behavioral Therapy for Outpatients With Depression in Routine Specialized Mental Health Care: Pilot Randomized Controlled Trial
Open accessAbstract
Background: Cognitive behavioral therapy (CBT) is an effective treatment, but access is often restricted due to costs and limited availability of trained therapists. Blending online and face-to-face CBT for depression might improve cost-effectiveness and treatment availability. Objective: This pilot study aimed to examine the costs and effectiveness of blended CBT compared with standard CBT for depressed patients in specialized mental health care to guide further research and development of blended CBT. Methods: Patients were randomly allocated to blended CBT (n=53) or standard CBT (n=49). Blended CBT consisted of 10 weekly face-to-face sessions and 9 Web-based sessions. Standard CBT consisted of 15 to 20 weekly face-to-face sessions. At baseline and 10, 20, and 30 weeks after start of treatment, self-assessed depression severity, quality-adjusted life-years (QALYs), and costs were measured. Clinicians, blinded to treatment allocation, assessed psychopathology at all time points. Data were analyzed using linear mixed models. Uncertainty intervals around cost and effect estimates were estimated with 5000 Monte Carlo simulations. Results: Blended CBT treatment duration was mean 19.0 (SD 12.6) weeks versus mean 33.2 (SD 23.0) weeks in standard CBT (P<.001). No significant differences were found between groups for depressive episodes (risk difference [RD] 0.06, 95% CI −0.05 to 0.19), response to treatment (RD 0.03, 95% CI −0.10 to 0.15), and QALYs (mean difference 0.01, 95% CI −0.03 to 0.04). Mean societal costs for blended CBT were €1183 higher than standard CBT. This difference was not significant (95% CI −399 to 2765). Blended CBT had a probability of being cost-effective compared with standard CBT of 0.02 per extra QALY and 0.37 for an additional treatment response, at a ceiling ratio of €25,000. For health care providers, mean costs for blended CBT were €176 lower than standard CBT. This difference was not significant (95% CI −659 to 343). At €0 per additional unit of effect, the probability of blended CBT being cost-effective compared with standard CBT was 0.75. The probability increased to 0.88 at a ceiling ratio of €5000 for an added treatment response, and to 0.85 at €10,000 per QALY gained. For avoiding new depressive episodes, blended CBT was deemed not cost-effective compared with standard CBT because the increase in costs was associated with negative effects. Conclusions: This pilot study shows that blended CBT might be a promising way to engage depressed patients in specialized mental health care. Compared with standard CBT, blended CBT was not considered cost-effective from a societal perspective but had an acceptable probability of being cost-effective from the health care provider perspective. Results should be carefully interpreted due to the small sample size. Further research in larger replication studies focused on optimizing the clinical effects of blended CBT and its budget impact is warranted. Trial Registration: Netherlands Trial Register NTR4650; https://www.trialregister.nl/trial/4408 International Registered Report Identifier (IRRID): RR2-10.1186/s12888-014-0290-z
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Figures


Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“research has shown that bCBT achieves similar outcomes to traditional CBT, despite reduced face-to-face time with therapists [27,33-35].”
From Barriers to and Facilitators of a Blended Cognitive Behavioral Therapy Program for Depression and Anxiety Based on Experiences of University Students: Qualitative Interview Study (2023) · cites this paper as [27]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The bCBT appears to be an acceptable, clinically effective, and cost-effective option for treating depression and anxiety disorders [27-32].”
From Barriers to and Facilitators of a Blended Cognitive Behavioral Therapy Program for Depression and Anxiety Based on Experiences of University Students: Qualitative Interview Study (2023) · cites this paper as [27]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Fitting Linear Mixed-Effects Models Using lme4
Bates, D., Mächler, M., Bolker, B., & Walker, S. (2015) · Journal of Statistical Software · doi:10.18637/jss.v067.i01 · Cited by 86,835
(1998) · The Journal of Clinical Psychiatry · Cited by 19,139
EuroQol: a new facility for the measurement of health-related quality of life
(1990) · Health Policy · doi:10.1016/0168-8510(90)90421-9 · Cited by 15,736
(1998) · PubMed · Cited by 10,216
Jacobson, N. S., & Truax, P. (1991) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.59.1.12 · Cited by 7,770
Trivedi, M. H., Rush, A. J., Wisniewski, S. R., Nierenberg, A. A., Warden, D., Ritz, L., Norquist, G., Howland, R. H., Lebowitz, B., McGrath, P. J., et al. (2006) · American Journal of Psychiatry · doi:10.1176/appi.ajp.163.1.28 · Cited by 3,879
Rush, A. J., Trivedi, M. H., Ibrahim, H. M., Carmody, T. J., Arnow, B., Klein, D. N., Markowitz, J. C., Ninan, P. T., Kornstein, S., Manber, R., et al. (2003) · Biological Psychiatry · doi:10.1016/s0006-3223(02)01866-8 · Cited by 3,829
The empirical status of cognitive-behavioral therapy: A review of meta-analyses
Butler, A. C., Chapman, J. E., Forman, E. M., & Beck, A. T. (2006) · Clinical Psychology Review · doi:10.1016/j.cpr.2005.07.003 · Cited by 3,215
The Inventory of Depressive Symptomatology (IDS): Psychometric properties
Rush, A. J., Gullion, C. M., Basco, M. R., Jarrett, R. B., & Trivedi, M. H. (1996) · Psychological Medicine · doi:10.1017/s0033291700035558 · Cited by 2,177
(2011) · Cited by 2,032
Research works printed but not linked: 17
- Kohn, R, 2004, Bull World Health Organ, 82, 858
- Bremmer, F, 2013, Een analyse van de verwachte kosten en baten van eHealth-blended behandelen en begeleiden
- 2017, Ont Health Technol Assess Ser, 17, 1
- Ruwaard, J, 2015, Eur Health Psychol, 17, 45
- 10.1111/cpsp.12173 · doi:10.1111/cpsp.12173 · Paper page
- Hickie, IB, 2010, Med J Aust, 192, S31
- 2000, Diagnostic and Statistical Manual of Mental Disorders, 4th Edition, Text Revision (DSM-IV-TR)
- Spijker, J, 2013, Multidisciplinaire richtlijn depressie (derde revisie). Richtlijn voor de diagnostiek, behandeling en begeleiding van volwassen patiënten met een depressieve stoornis
- Sheehan, DV, 1998, J Clin Psychiatry, 59 Suppl 20, 22
- van Vliet, IM, 2007, Tijdschrift voor de Psychiatrie, 49, 197
- Beck, AT, 1980, Cognitive Therapy of Depression
- Jacobson, NS, 1991, Methodological Issues and Strategies in Clinical Research, 631
- Hakkaart-van Roijen, L, 2002, Trimbos/iMTA questionnaire for costs associated with psychiatric illness (TIC-P)
- Hakkaart-van Roijen, L, 2016, Kostenhandleiding: methodologie van kostenonderzoek en referentieprijzen voor economische evaluaties in de gezondheidszorg
- Hakkaart-Van Roijen, L, 2010, Handleiding voor kostenonderzoek--methoden en standaard kostprijzen voor economische evaluaties in de gezondheidszorg
- 2016, Z-index
- 2018, R: a language and environment for statistical computing
Cited by
The COVID-19 pandemic: the ‘black swan’for mental health care and a turning point for e-health
Wind, T. R., Rijkeboer, M., Andersson, G., & Riper, H. (2020) · Internet Interventions · doi:10.1016/j.invent.2020.100317 · Cited by 782
Self-citationMitchell, L. M., Joshi, U., Patel, V., Lu, C., & Naslund, J. A. (2021) · Journal of Affective Disorders · doi:10.1016/j.jad.2021.01.092 · Cited by 80
Schuster, R., Topooco, N., Keller, A., Radvogin, E., & Laireiter, A.-R. (2020) · Internet Interventions · doi:10.1016/j.invent.2020.100326 · Cited by 77
Mol, M., van Genugten, C., Dozeman, E., van Schaik, D. J. F., Draisma, S., Riper, H., & Smit, J. H. (2019) · Journal of Clinical Medicine · doi:10.3390/jcm9010091 · Cited by 61
Self-citationBührmann, L., Schuurmans, J., Ruwaard, J., Fleuren, M. A. H., Etzelmueller, A., Piera-Jiménez, J., Finch, T. L., Rapley, T., Potthoff, S., Aouizerate, B., et al. (2020) · Trials · doi:10.1186/s13063-020-04686-4 · Cited by 51
Self-citation
Metadata
- Authors
- Kooistra, L. C., Wiersma, J. E., Ruwaard, J., Neijenhuijs, K., Lokkerbol, J., van Oppen, P., Smit, F., & Riper, H.
- Affiliations
- Amsterdam Public Health (NL)
- Trimbos Institute (NL)
- Corresponding author
- Kooistra, Lisa Catharine
- ORCID
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2019-10-29
- Volume
- 21
- Issue
- 10
- Pages
- e14261
- ISSN
- 1438-8871 (ISSN-L)
- PMC
- PMC6914243
- OpenAlex
- W2982335768
- Cited by
- 84
- References
- 57
- Citations by year
- 2026: 8 · 2025: 14 · 2024: 11 · 2023: 9 · 2022: 16 · 2021: 14 · 2020: 11 · 2019: 1
- FWCI
- 11.86
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- Journal of Medical Internet Research (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Amsterdam UMC (VU Amsterdam) - Institutional Repository (submittedVersion, other-oa)
- Data Archiving and Networked Services (DANS) (submittedVersion, other-oa)
- Funders
- ZonMw (837001007)
- Topics
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Social Sciences › Economics, Econometrics and Finance › Economics and Econometrics › Health Systems, Economic Evaluations, Quality of Life
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Anxiety, Depression, Psychometrics, Treatment, Cognitive Processes
- Keywords
- depression, online therapy, online intervention, cost-effectiveness, quality-adjusted life years, treatment response, outpatients, specialized mental health care, treatment duration, social costs, depression severity, psychopathology, Monte Carlo simulation, therapist availability, access to mental health care, digital mental health interventions
- MeSH terms
- Adult, Cost-Benefit Analysis, Depression, Female, Humans, Male, Mental Health, Outpatients, Pilot Projects, Cognitive Behavioral Therapy, Treatment Outcome, Quality-Adjusted Life Years
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Cost and Effectiveness of Blended Versus Standard Cognitive Behavioral Therapy for Outpatients With Depression in Routine Specialized Mental Health Care: Pilot Randomized Controlled Trial. https://app.cochat.ai/papers/10.2196/14261
- The paper
- Kooistra, L. C., Wiersma, J. E., Ruwaard, J., Neijenhuijs, K., Lokkerbol, J., van Oppen, P., Smit, F., & Riper, H. (2019). Cost and Effectiveness of Blended Versus Standard Cognitive Behavioral Therapy for Outpatients With Depression in Routine Specialized Mental Health Care: Pilot Randomized Controlled Trial. Journal of Medical Internet Research. https://doi.org/10.2196/14261
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.