The Clinical Effectiveness of Blended Cognitive Behavioral Therapy Compared With Face-to-Face Cognitive Behavioral Therapy for Adult Depression: Randomized Controlled Noninferiority Trial
Open accessThe DOI matches its Crossref record; 71 of the 72 references it cites were found in a registry or an index.
Abstract
Background: Internet-based cognitive behavioral therapy (iCBT) has been demonstrated to be cost- and clinically effective. There is a need, however, for increased therapist contact for some patient groups. Combining iCBT with traditional face-to-face (FtF) consultations in a blended format may produce a new treatment format (B-CBT) with multiple benefits from both traditional CBT and iCBT, such as individual adaptation, lower costs than traditional therapy, wide geographical and temporal availability, and possibly lower threshold to implementation. Objective: The primary aim of this study is to compare directly the clinical effectiveness of B-CBT with FtF-CBT for adult major depressive disorder. Methods: A 2-arm randomized controlled noninferiority trial compared B-CBT for adult depression with treatment as usual (TAU). The trial was researcher blinded (unblinded for participants and clinicians). B-CBT comprised 6 sessions of FtF-CBT alternated with 6-8 web-based CBT self-help modules. TAU comprised 12 sessions of FtF-CBT. All participants were aged 18 or older and met the diagnostic criteria for major depressive disorder and were recruited via a national iCBT clinic. The primary outcome was change in depression severity on the 9-item Patient Health Questionnaire (PHQ-9). Secondary analyses included client satisfaction (8-item Client Satisfaction Questionnaire [CSQ-8]), patient expectancy (Credibility and Expectancy Questionnaire [CEQ]), and working (Working Alliance Inventory [WAI] and Technical Alliance Inventory [TAI]). The primary outcome was analyzed by a mixed effects model including all available data from baseline, weekly measures, 3-, 6, and 12-month follow-up. Results: A total of 76 individuals were randomized, with 38 allocated to each treatment group. Age ranged from 18 to 71 years (SD 13.96) with 56 (74%) females. Attrition rate was 20% (n=15), which was less in the FtF-CBT group (n=6, 16%) than in the B-CBT group (n=9, 24%). As many as 53 (70%) completed 9 or more sessions almost equally distributed between the groups (nFtF-CBT=27, 71%; nB-CBT=26, 68%). PHQ-9 reduced 11.38 points in the FtF-CBT group and 8.10 in the B-CBT group. At 6 months, the mean difference was a mere 0.17 points. The primary analyses confirmed large and significant within-group reductions in both groups (FtF-CBT: β=–.03; standard error [SE] 0.00; P<.001 and B-CBT: β=–.02; SE 0.00; P<.001). A small but significant interaction effect was observed between groups (β=.01; SE 0.00; P=.03). Employment status influenced the outcome differently between groups, where the B-CBT group was seen to profit more from not being full-time employed than the FtF group. Conclusions: With large within-group effects in both treatment arms, the study demonstrated feasibility of B-CBT in Denmark. At 6 months’ follow-up, there appeared to be no difference between the 2 treatment formats, with a small but nonsignificant difference at 12 months. The study seems to demonstrate that B-CBT is capable of producing treatment effects that are close to FtF-CBT and that completion rates and satisfaction rates were comparable between groups. However, the study was limited by small sample size and should be interpreted with caution. Trial Registration: ClinicalTrials.gov NCT02796573; https://clinicaltrials.gov/ct2/show/NCT02796573 International Registered Report Identifier (IRRID): RR2-10.1186/s12888-016-1140-y
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures



Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The bCBT appears to be an acceptable, clinically effective, and cost-effective option for treating depression and anxiety disorders [27-32].”
From Barriers to and Facilitators of a Blended Cognitive Behavioral Therapy Program for Depression and Anxiety Based on Experiences of University Students: Qualitative Interview Study (2023) · cites this paper as [31]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“In addition to prior research showing that bCBT is effective in reducing symptomology [29-32], the results of our qualitative investigation further indicate that the use of the app along with face-to-face sessions also seems to be associated with positive feelings regarding the therapy process among students.”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Fitting Linear Mixed-Effects Models Using lme4
Bates, D., Mächler, M., Bolker, B., & Walker, S. (2015) · Journal of Statistical Software · doi:10.18637/jss.v067.i01 · Cited by 86,835
The PHQ-9: Validity of a brief depression severity measure
Kroenke, K., Spitzer, R. L., & Williams, J. B. W. (2001) · Journal of General Internal Medicine · doi:10.1046/j.1525-1497.2001.016009606.x · Cited by 44,910
lmerTest Package: Tests in Linear Mixed Effects Models
Kuznetsova, A., Brockhoff, P. B., & Christensen, R. H. B. (2017) · Journal of Statistical Software · doi:10.18637/jss.v082.i13 · Cited by 24,346
Kessler, R. C., Chiu, W. T., Demler, O., & Walters, E. E. (2005) · Archives of General Psychiatry · doi:10.1001/archpsyc.62.6.617 · Cited by 12,052
Random effects structure for confirmatory hypothesis testing: Keep it maximal
Barr, D. J., Levy, R., Scheepers, C., & Tily, H. J. (2013) · Journal of Memory and Language · doi:10.1016/j.jml.2012.11.001 · Cited by 10,328 · cited 1×
“Time was included as a fixed effect and as a random effect nested within participant (random slope and intercept) [55].”
(1998) · PubMed · Cited by 10,216
Cohen, J. (1992) · Psychological Bulletin · doi:10.1037//0033-2909.112.1.155 · Cited by 8,771
Kroenke, K., Spitzer, R. L., Williams, J. B. W., & Löwe, B. (2010) · General Hospital Psychiatry · doi:10.1016/j.genhosppsych.2010.03.006 · Cited by 4,057 · cited 2×
“Furthermore, a score of at least five on the 9-item Patient Health Questionnaire-9 (PHQ-9) [39,40] was required.”
Rush, A. J., Trivedi, M. H., Ibrahim, H. M., Carmody, T. J., Arnow, B., Klein, D. N., Markowitz, J. C., Ninan, P. T., Kornstein, S., Manber, R., et al. (2003) · Biological Psychiatry · doi:10.1016/s0006-3223(02)01866-8 · Cited by 3,829 · cited 1×
“The 16-item Quick Inventory of Depressive Symptomatology Self-Report (QIDS-16-SR) [47,48] was used in addition to the PHQ-9 because it is a promising questionnaire for assessing depressive symptoms, especially in specialized mental health care and to conduct secondary analyses of primary latent…”
Research works printed but not linked: 5
- Alonso, J, 2007, J Clin Psychiatry, 68 Suppl 2, 3
- 2000, Diagnostic and Statistical Manual of Metal Disorders (4th ed. TR)
- 10.1016/j.invent.2018.02.001 · DOI · Paper page
- 10.1037/0022-0167.36.2.223 · doi:10.1037/0022-0167.36.2.223 · Paper page
- 10.1037/0033-2909.112.1.155 · doi:10.1037/0033-2909.112.1.155 · Paper page
Cited by
Hedman‐Lagerlöf, E., Carlbring, P., Svärdman, F., Riper, H., Cuijpers, P., & Andersson, G. (2023) · World Psychiatry · doi:10.1002/wps.21088 · Cited by 259
Self-citation(2024) · doi:10.2196/49660 · Cited by 45
Kruse, C. S., Molina-Nava, A., Kapoor, Y., Anerobi, C., & Maddukuri, H. (2022) · Journal of Medical Internet Research · doi:10.2196/43601 · Cited by 45
Bai, P. (2023) · Journal of Cancer · doi:10.7150/jca.82632 · Cited by 25
Kemmeren, L. L., van Schaik, A., Draisma, S., Kleiboer, A., Riper, H., & Smit, J. H. (2023) · Cognitive Therapy and Research · doi:10.1007/s10608-023-10363-y · Cited by 22
“Furthermore, trials are not fully comparable regarding the treatments that were received in the comparison groups, consisting of either standard CBT (Kooistra et al., 2019; Ly et al., 2015; Mathiasen et al., 2022; Thase et al., 2018), usual treatment with a psychotherapist (Berger et al.”
BackgroundResultSelf-citationBraun, P., Atik, E., Guthardt, L., Apolinário-Hagen, J., & Schückes, M. (2023) · JMIR Formative Research · doi:10.2196/45970 · Cited by 17
“The bCBT appears to be an acceptable, clinically effective, and cost-effective option for treating depression and anxiety disorders [27-32].”
Macrynikola, N., Chen, K., Lane, E., Nguyen, N. S., Pinto, J., Yen, S., & Torous, J. B. (2024) · JMIR Mental Health · doi:10.2196/65222 · Cited by 22
Kalde, J., Atik, E., Stricker, J., Schückes, M., Neudeck, P., Pittig, A., & Pietrowsky, R. (2023) · Psychotherapy Research · doi:10.1080/10503307.2023.2277866 · Cited by 17
Drüge, M., Guthardt, L., Haller, E., Michalak, J., & Apolinário-Hagen, J. (2024) · Advances in Experimental Medicine and Biology · doi:10.1007/978-981-97-4402-2_11 · Cited by 11
Gupta, N., Leuba, S., Seifritz, E., Berger, T., & Kawohl, W. (2024) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2024.1417784 · Cited by 11
Transdiagnostic psychological interventions for emotional disorders: A comprehensive meta-analysis
Jiménez-Orenga, N., Miguel, C., González-Robles, A., Fernández‐Álvarez, J., Grimaldos, J., Bretón-López, J. M., Botella, C., Cuijpers, P. J., García‐Palacios, A., Papola, D., et al. (2025) · Journal of Affective Disorders · doi:10.1016/j.jad.2025.119537 · Cited by 13
Self-citationSudarshan, S., Mehrotra, S., & Thirthalli, J. (2024) · Indian Journal of Psychological Medicine · doi:10.1177/02537176241238289 · Cited by 5
Gilchrist, G., Dheensa, S., Johnson, A., Henderson, J., Radcliffe, P., Dwyer, G., Turner, R. C., Thomson, K., Brooks, C. P., Love, B., et al. (2024) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2023.1253126 · Cited by 6
Sextl-Plötz, T., Titzler, I., Schmidt-Hantke, J., Denninger, M., Steubl, L., Baumeister, H., Ebert, D. D., & Zarski, A. (2025) · Digital Health · doi:10.1177/20552076251377943 · Cited by 5
Miller, R. K., O'Moore, K., Kikas, K., Matheson, J.-A. T., Whitton, A. E., Baldwin, P., Li, S., Black, M., Kampel, L., Cockayne, N., et al. (2025) · JMIR Human Factors · doi:10.2196/68789 · Cited by 3
Willemsen, R. F., Versluis, A., Aardoom, J. J., Petrus, A. H. J., Silven, A. V., Chavannes, N. H., & van Dijke, A. (2024) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2024.105485 · Cited by 2
Kato, S., Tanoue, H., Fukuzoe, J., & Ishida, Y. (2024) · SAGE Open Nursing · doi:10.1177/23779608241290717 · Cited by 3
The present and future of blended care: current research and introduction to the B-FIT framework
Bielinski, L. L., Büscher, R., Hennemann, S., Henning, C., Kohl, S. H., Meyer, C., Reinhold, A. S., Steubl, L., Titzler, I., Vogel, L., et al. (2026) · npj Digital Medicine · doi:10.1038/s41746-026-02526-4 · Cited by 2
Jiménez-Orenga, N., Díaz‐García, A., García‐Palacios, A., & Bretón-López, J. M. (2024) · Internet Interventions · doi:10.1016/j.invent.2024.100761 · Cited by 2
Clinical outcomes from blended care therapy for anxiety and depression in the year after treatment
Lee, J. L., Chen, S.-Y., Wickham, R. E., Wang, P., Wu, M. S., Varra, A. A., Chen, C., & Lungu, A. (2024) · Internet Interventions · doi:10.1016/j.invent.2024.100798 · Cited by 4
Yin, Y.-Y., Wan, Z.-Z., & Wang, B. (2025) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2025.1530615 · Cited by 2
Eicher, S., Fenski, F., Behr, S., Hammelrath, L., Boettcher, J., Schaeuffele, C., & Knaevelsrud, C. (2026) · npj Digital Medicine · doi:10.1038/s41746-026-02546-0 · Cited by 3
Widyarto, W. G., Rasyid, M., Muslihati, M., Hambali, I., Atmoko, A., Hadi, D., & Zuhdi, M. S. (2025) · General Hospital Psychiatry · doi:10.1016/j.genhosppsych.2025.01.019 · Cited by 1
Miller, R. K., O’Moore, K., Kikas, K., Matheson, J.-A. T., Whitton, A. E., Baldwin, P. A., Li, S. H., Black, M., Kampel, L., Cockayne, N. L., et al. (2024) · doi:10.2196/preprints.68789 · Cited by 1
Martínez‐García, L., Schaeuffele, C., Péris-Baquero, Ó., Torres-Alfosea, M. Á., & Osma, J. (2025) · Psychotherapy Research · doi:10.1080/10503307.2025.2541707
Baumeister, A., Schuurmans, L., & Moritz, S. (2025) · Internet Interventions · doi:10.1016/j.invent.2025.100867 · Cited by 1
Zhong, L., Liu, Q., Luo, J., Tao, L., Huang, L., Zhao, Z., Zheng, L., Wang, K., Yang, Y., & Wei, B. (2025) · International Journal of Clinical Practice · doi:10.1155/ijcp/8363471
Velthuizen, S. L. M., Lutz, M. C., van den Bos, E., Miers, A. C., & Westenberg, P. M. (2025) · Cognitive Behaviour Therapy · doi:10.1080/16506073.2025.2583114 · Cited by 1
Kirk, A., King, C. S., Gallop, R., Doan, B. D., Rowe, L. S., Rivera, M., & Randa, L. E. (2026) · doi:10.2196/preprints.92448
Kirk, A., King, C. S., Gallop, R., Doan, B. D., Rowe, L. S., Rivera, M., & Randa, L. E. (2026) · JMIR Human Factors · doi:10.2196/92448
From Resistance to Redesign—The Emerging Logic of Hybrid Care in Treatment-Resistant Depression
Mucci, F., Gurrieri, R., Bouanani, S., Gambini, M., Russomanno, G., & Marazziti, D. (2026) · Brain Sciences · doi:10.3390/brainsci16060612
Peake, E. E., Swirbul, M. S., Rodio, M. J., & Padmanabhan, A. (2026) · Frontiers in Digital Health · doi:10.3389/fdgth.2026.1821642 · Cited by 1
A blended intervention for adjustment disorder: Results from a feasibility trial
Fernández-Buendía, S., la Coba-Cañizares, L. D., Grimaldos, J., Castilla, D., Alonso-Guillén, S., Cuijpers, P. J., & Quero, S. (2026) · Internet Interventions · doi:10.1016/j.invent.2026.100976
Zhou, X., Huang, H., Bi, R., Verdeli, L., & Lyu, H. (2026) · Journal of Zhejiang University SCIENCE B · doi:10.1631/jzus.b2500701 · Cited by 1
Metadata
- Authors
- Mathiasen, K., Andersen, T. E., Lichtenstein, M. B., Ehlers, L. H., Riper, H., Kleiboer, A., & Roessler, K. K.
- Affiliations
- University of Southern Denmark (DK)
- Aalborg University (DK)
- Vrije Universiteit Amsterdam (NL)
- Corresponding author
- Mathiasen, Kim
- ORCID
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2022-09-07
- Volume
- 24
- Issue
- 9
- Pages
- e36577
- ISSN
- 1438-8871 (ISSN-L)
- PMC
- PMC9543221
- OpenAlex
- W4282932394
- Semantic Scholar
- a8919d801b7c07a619992e771e1429a08a6a3728
- Cited by
- 34
- References
- 72
- Citations by year
- 2026: 8 · 2025: 9 · 2024: 11 · 2023: 5 · 2022: 1
- FWCI
- 5.73
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- Journal of Medical Internet Research (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Pure Amsterdam UMC (publishedVersion, other-oa)
- Amsterdam UMC (VU Amsterdam) - Institutional Repository (publishedVersion, other-oa)
- University of Southern Denmark Research Portal (University of Southern Denmark) (acceptedVersion, cc-by)
- VBN Forskningsportal (Aalborg Universitet) (submittedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- VU Research Portal (submittedVersion, other-oa)
- Data Archiving and Networked Services (DANS) (submittedVersion, other-oa)
- Funders
- Innovationsfonden (5159-00002B)
- Topics
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Anxiety, Depression, Psychometrics, Treatment, Cognitive Processes
- Social Sciences › Psychology › Clinical Psychology › Psychotherapy Techniques and Applications
- Keywords
- internet-based cognitive behavioral therapy, major depressive disorder, adult depression, face-to-face therapy, non-inferiority, depression severity, client satisfaction, therapeutic relationship, attrition, therapist contact, cost-effectiveness, PHQ-9
- MeSH terms
- Adolescent, Adult, Aged, Depression, Major Depressive Disorder, Female, Humans, Male, Middle Aged, Cognitive Behavioral Therapy, Treatment Outcome, Patient Satisfaction, Young Adult
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.