Blended e-Health in Cognitive Behavioural Therapy: Usage Intensity, Attitude and Therapeutic Alliance in Clinical Practice
Open accessAbstract
Background: Though internet based cognitive behaviour therapy is proven to be effective, e-health is applied only in a minority of treatments in specialised mental health care. The low application rates are associated with therapists’ attitudes towards e-health. One of the major concerns is limitations in the therapeutic relation and communication between patient and therapist. Since therapist involvement is important in an effective e-health treatment, negative attitudes towards e-health can be a risk for effective e-health application. Aims: This study aimed to examine the relationship between patients’ e-health usage as well as patients’ attitudes towards e-health and the therapeutic alliance. The possible influence of therapists’ attitudes on patients’ e-health usage is also examined. Method: In an outpatient mental health setting, patients attended a blended treatment program for major depressive disorder and completed questionnaires on attitudes towards e-health and the therapeutic alliance. Therapists completed an alliance and attitude questionnaire as well. Results: Patients with more positive attitudes used the e-health application more intensively. Higher work alliance rates were related to sharing digital homework assignments and seeking contact with their therapist. Also, when treated by therapists with more positive attitudes towards e-health, patients shared more assignments with their therapist. Patients with high symptom rates at start, had more negative attitude rates and tended to use the e-health application less frequently. Conclusions: In a treatment cohesion in which therapists are positive about blended e-health, patients’ attitudes are positively related to e-health usage and therefore a factor of interest in improvement of effective e-health application. Patients with severe symptoms may need extra attention like active support and iteration to promote adherence to the e-health program.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The blended care delivery model used in this study could have provided a sense of connectedness with the research team for the participants.
“The blended care delivery model used in this study, although simple, promoting knowledge that the research team is only one phone call or text message away, could also have provided a sense of connectedness with the research team for the participants [62,63].”
From Short-Term Findings From Testing EPIO, a Digital Self-Management Program for People Living With Chronic Pain: Randomized Controlled Trial (2023) · cites this paper as [62]
The Intervention section describes blended face-to-face and online care in which patients could message their therapist. The Discussion reports that a stronger therapeutic alliance was associated with more therapist contact. These passages support a possible connection through blended care, but they do not address participants feeling connected to a research team or being able to reach it by phone or text. (LLM, conf=0.82)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
An inventory for measuring depression
BECK, A. T. (1961) · Archives of General Psychiatry · doi:10.1001/archpsyc.1961.01710120031004 · Cited by 38,032 · see citing works
Development and validation of the working alliance inventory
Horvath, A. O., & Greenberg, L. S. (1989) · Journal of Counseling Psychology · doi:10.1037//0022-0167.36.2.223 · Cited by 3,520 · see citing works
Research summary on the therapeutic relationship and psychotherapy outcome.
Lambert, M. J., & Barley, D. E. (2001) · Psychotherapy: Theory, Research, Practice, Training · doi:10.1037/0033-3204.38.4.357 · Cited by 1,621 · cited 1× · see citing works
“In face-to-face treatment, the therapeutic relationship is a mediating factor for therapy efficacy (Lambert & Barley, 2002) and explains a significant percentage (7% - 17”
BackgroundInternet-based cognitive behaviour therapy for symptoms of depression and anxiety: A meta-analysis
SPEK, V., CUIJPERS, P., NYKLÍČEK, I., RIPER, H., KEYZER, J., & POP, V. (2007) · Psychological Medicine · doi:10.1017/s0033291706008944 · Cited by 1,586 · see citing works
Internet-Based and Other Computerized Psychological Treatments for Adult Depression: A Meta-Analysis
Andersson, G., & Cuijpers, P. (2009) · Cognitive Behaviour Therapy · doi:10.1080/16506070903318960 · Cited by 1,368 · see citing works
Andrews, G., Cuijpers, P., Craske, M. G., McEvoy, P., & Titov, N. (2010) · PLoS ONE · doi:10.1371/journal.pone.0013196 · Cited by 1,311 · see citing works
Persuasive System Design Does Matter: a Systematic Review of Adherence to Web-based Interventions
Kelders, S. M., Kok, R. N., Ossebaard, H. C., & Van Gemert-Pijnen, J. E. (2012) · Journal of Medical Internet Research · doi:10.2196/jmir.2104 · Cited by 1,308 · see citing works
Carlbring, P., Andersson, G., Cuijpers, P., Riper, H., & Hedman-Lagerlöf, E. (2018) · Cognitive Behaviour Therapy · doi:10.1080/16506073.2017.1401115 · Cited by 1,232 · see citing works
Andersson, G., Cuijpers, P., Carlbring, P., Riper, H., & Hedman, E. (2014) · World Psychiatry · doi:10.1002/wps.20151 · Cited by 1,077 · see citing works
A Systematic Review of the Impact of Adherence on the Effectiveness of e-Therapies
Donkin, L., Christensen, H., Naismith, S. L., Neal, B., Hickie, I. B., & Glozier, N. (2011) · Journal of Medical Internet Research · doi:10.2196/jmir.1772 · Cited by 876 · see citing works
SCL-90. Handleiding bij een multidimensionele psychopathologie-indicator
Arrindell, W. A., & Ettema, J. H. M. (2003) · Research portal (Tilburg University) · Cited by 629 · see citing works
Munder, T., Wilmers, F., Leonhart, R., Linster, H. W., & Barth, J. (2010) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.658 · Cited by 538 · see citing works
A national survey of practicing psychologists' attitudes toward psychotherapy treatment manuals
Addis, M. E., & Krasnow, A. D. (2000) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.68.2.331 · Cited by 509 · see citing works
A national survey of practicing psychologists' attitudes toward psychotherapy treatment manuals.
Addis, M. E., & Krasnow, A. D. (2000) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.68.2.331 · Cited by 508 · see citing works
Karyotaki, E., Kleiboer, A., Smit, F., Turner, D. T., Pastor, A. M., Andersson, G., Berger, T., Botella, C., Breton, J. M., Carlbring, P., et al. (2015) · Psychological Medicine · doi:10.1017/s0033291715000665 · Cited by 408 · see citing works
Wagner, B., Horn, A. B., & Maercker, A. (2014) · Journal of Affective Disorders · doi:10.1016/j.jad.2013.06.032 · Cited by 311 · see citing works
Ebert, D. D., Berking, M., Cuijpers, P., Lehr, D., Pörtner, M., & Baumeister, H. (2015) · Journal of Affective Disorders · doi:10.1016/j.jad.2015.01.056 · Cited by 268 · cited 12× · see citing works
“DOI: 10.4236/psych.2018.910139 2425 Psychology”
BackgroundInfluentialDonkin, L., & Glozier, N. (2012) · Journal of Medical Internet Research · doi:10.2196/jmir.2100 · Cited by 212 · see citing works
Factors that influence public engagement with eHealth: A literature review
Hardiker, N. R., & Grant, M. J. (2010) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2010.10.017 · Cited by 207 · see citing works
A systematic review of internet-based therapy for the treatment of addictions
Gainsbury, S., & Blaszczynski, A. (2011) · Clinical Psychology Review · doi:10.1016/j.cpr.2010.11.007 · Cited by 192 · see citing works
Meyer, B., Bierbrodt, J., Schröder, J., Berger, T., Beevers, C. G., Weiss, M., Jacob, G., Späth, C., Andersson, G., Lutz, W., et al. (2015) · Internet Interventions · doi:10.1016/j.invent.2014.12.003 · Cited by 188 · see citing works
Vis, C., Mol, M., Kleiboer, A., Bührmann, L., Finch, T., Smit, J., & Riper, H. (2018) · JMIR Mental Health · doi:10.2196/mental.9769 · Cited by 183 · see citing works
An Exploratory Study of Client Perceptions of Internet Counseling and the Therapeutic Alliance
Leibert, T. W., Archer, J., Munson, J., & York, G. (2006) · Journal of Mental Health Counseling · doi:10.17744/mehc.28.1.f0h37djrw89nv6vb · Cited by 172 · see citing works
Chiu, T., & Eysenbach, G. (2010) · BMC Medical Informatics and Decision Making · doi:10.1186/1472-6947-10-73 · Cited by 142 · see citing works
Spek, V., Cuijpers, P., Nyklíček, I., Smits, N., Riper, H., Keyzer, J., & Pop, V. (2008) · Psychological Medicine · doi:10.1017/s0033291707002590 · Cited by 139 · see citing works
Attitudes towards computerized CBT for depression amongst a student population
Mitchell, N., & Gordon, P. K. (2007) · Behavioural and Cognitive Psychotherapy · doi:10.1017/s1352465807003700 · Cited by 106 · see citing works
Grist, R., & Cavanagh, K. (2013) · Journal of Contemporary Psychotherapy · doi:10.1007/s10879-013-9243-y · Cited by 100 · see citing works
El Alaoui, S., Ljótsson, B., Hedman, E., Kaldo, V., Andersson, E., Rück, C., Andersson, G., & Lindefors, N. (2015) · PLOS ONE · doi:10.1371/journal.pone.0124258 · Cited by 98 · cited 1× · see citing works
“Our findings are in line with a study of El Alaoui et al. (2015) which showed that patients’ beliefs and expectations are important for adherence in e-health, while the influence of the therapist is less distinct.”
ResultKelders, S. M., Bohlmeijer, E. T., & Van Gemert-Pijnen, J. E. (2013) · Journal of Medical Internet Research · doi:10.2196/jmir.2258 · Cited by 88 · see citing works
Wagner, B., Brand, J., Schulz, W., & Knaevelsrud, C. (2012) · Depression and Anxiety · doi:10.1002/da.21962 · Cited by 84 · see citing works
Controversy clarified: an updated review of clinical psychology and tele-health
Perle, J. G., Langsam, L. C., & Nierenberg, B. (2011) · Clinical Psychology Review · doi:10.1016/j.cpr.2011.08.003 · Cited by 83 · cited 2× · see citing works
“Psychologists, when indicating treatment methods, hardly ever prefer online treatment (Mora, Nevid, & Chaplin, 2008; Perle et al., 2011).”
BackgroundResultDonovan, C., Poole, C., Boyes, N., Redgate, J., & March, S. (2015) · Internet Interventions · doi:10.1016/j.invent.2015.09.001 · Cited by 83 · see citing works
Psychologist treatment recommendations for Internet-based therapeutic interventions
Mora, L., Nevid, J. S., & Chaplin, W. F. (2008) · Computers in Human Behavior · doi:10.1016/j.chb.2008.05.011 · Cited by 71 · see citing works
Jasper, K., Weise, C., Conrad, I., Andersson, G., Hiller, W., & Kleinstäuber, M. (2014) · Internet Interventions · doi:10.1016/j.invent.2014.04.002 · Cited by 68 · see citing works
Stallard, P., Velleman, S., & Richardson, T. (2010) · Child and Adolescent Mental Health · doi:10.1111/j.1475-3588.2009.00540.x · Cited by 58 · see citing works
The Treatment Motivation Scales for Forensic Outpatient Treatment (TMS-F)
Drieschner, K. H., & Boomsma, A. (2008) · Assessment · doi:10.1177/1073191107311650 · Cited by 55 · see citing works
Tummers, M., Knoop, H., van Dam, A., & Bleijenberg, G. (2012) · Psychological Medicine · doi:10.1017/s0033291712000232 · Cited by 53 · see citing works
Self-citationStinckens, N., Ulburghs, A., & Claes, L. (2009) · Cited by 47 · see citing works
Urech, A., Krieger, T., Möseneder, L., Biaggi, A., Vincent, A., Poppe, C., Meyer, B., Riper, H., & Berger, T. (2019) · Psychotherapy Research · doi:10.1080/10503307.2018.1430910 · Cited by 43 · see citing works
Internet interventions for depressive disorders: an overview
Cuijpers, P., & Riper, H. (2015) · Revista de Psicopatología y Psicología Clínica · doi:10.5944/rppc.vol.19.num.3.2014.13902 · Cited by 32 · see citing works
Wiborg, J. F., Knoop, H., Wensing, M., & Bleijenberg, G. (2012) · Behaviour Research and Therapy · doi:10.1016/j.brat.2012.03.002 · Cited by 31 · see citing works
De ontwikkeling van de Group Cohesion Questionnaire (GCQ)
Trijsburg, R. W., Bogaerds, H., Letiche, M., Bidzjel, L., & Duivenvoorden, H. J. (2004) · UvA-DARE (University of Amsterdam) · Cited by 11 · see citing works
E-health attitudelijst: wat drijft de behandelaar?
Aerts, J., & van Dam, A. (2015) · Psychopraktijk · doi:10.1007/s13170-015-0090-2 · Cited by 3 · see citing works
Self-citation
Flagged first, then by citations
Research works printed but not linked: 2
- Beutler, L. E., Malik, M., Alimohamed, S., Harwood, T. M., Talebi, H., Noble, S., & Wong, E. (2004).Therapist Variables. In M. J. Lambert (Eds.), Bergin and Garfield's Handbook of Psychotherapy and Behaviour Change (5th ed., pp. 227-306). New York: Wiley.
- van der Does, A. J. W. (2002). BDI-II-NL. Handleiding. De Nederlandse Versie van de Beck Depression Inventory (2nd ed.). Lisse: Harcourt Test Publishers.
Cited by
Sorted by citations
Kemmeren, L. L., van Schaik, A., Smit, J. H., Ruwaard, J., Rocha, A., Henriques, M., Ebert, D. D., Titzler, I., Hazo, J.-B., Dorsey, M., et al. (2019) · JMIR Mental Health · doi:10.2196/12707 · Cited by 36 · see citing works
Bostrøm, K., Børøsund, E., Eide, H., Varsi, C., Kristjansdottir, Ó. B., Schreurs, K. M. G., Waxenberg, L. B., Weiss, K. E., Morrison, E. J., Stavenes Støle, H., et al. (2023) · Journal of Medical Internet Research · doi:10.2196/47284 · Cited by 12 · see citing works
“The blended care delivery model used in this study, although simple, promoting knowledge that the research team is only one phone call or text message away, could also have provided a sense of connectedness with the research team for the participants [62,63].”
Worm-Smeitink, M., van Dam, A., van Es, S., van der Vaart, R., Evers, A. W. M., Wensing, M., & Knoop, H. (2019) · Journal of Medical Internet Research · doi:10.2196/14037 · Cited by 13 · see citing works
Self-citationWilson, H. S., Hayward, P., & Donkin, L. (2023) · Frontiers in Digital Health · doi:10.3389/fdgth.2023.1008564 · Cited by 11 · see citing works
Blended care in psychosis – A systematic review
Cohen, M., Roe, D., Savir, T., & Baumel, A. (2024) · Schizophrenia Research · doi:10.1016/j.schres.2024.03.041 · Cited by 10 · see citing works
Mittmann, G., Steiner‐Hofbauer, V., & Schrank, B. (2024) · Wiener klinische Wochenschrift · doi:10.1007/s00508-024-02391-9 · Cited by 10 · see citing works
Solberg Nes, L., Børøsund, E., Varsi, C., Eide, H., Waxenberg, L. B., Weiss, K. E., Morrison, E. J., Støle, H. S., Kristjansdottir, Ó. B., Bostrøm, K., et al. (2024) · Pain Reports · doi:10.1097/pr9.0000000000001174 · Cited by 7 · see citing works
“1,11,51,60 Study participants recommended incorporating EPIO into pain rehabilitation programs and including EPIO in a multidisciplinary setting (eg, combined with physical therapy 24 ), might enhance impact, particularly where fear of pain and movement are impediments for physical improvement.”
BackgroundOudshoorn, C. E. M., Frielink, N., Riper, H. M., & Embregts, P. J. C. M. (2024) · JMIR Formative Research · doi:10.2196/52788 · Cited by 7 · see citing works
Branquinho, M., Canavarro, M. C., & Fonseca, A. (2024) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.70007 · Cited by 5 · see citing works
E-Mental Health Interventions in Inpatient Care: Scoping Review
Diel, A., Schröter, I. C., Robitzsch, A., Jansen, C., Teufel, M., & Bäuerle, A. (2025) · Journal of Medical Internet Research · doi:10.2196/65947 · Cited by 5 · see citing works
Einfluss akzeptanzfördernder Interventionen auf die Nutzung einer Online-Selbsthilfe
Kreis, A., Becker, J., Beutel, M., & Zwerenz, R. (2021) · Psychotherapeut (Berlin) · doi:10.1007/s00278-021-00530-5 · Cited by 5 · see citing works
Strand, E. B., Varsi, C., Børøsund, E., Eide, H., Schreurs, K. M. G., Waxenberg, L. B., Weiss, K. E., Morrison, E. J. P., Støle, H. S., Kristjánsdóttir, Ó. B., et al. (2025) · Frontiers in Psychology · doi:10.3389/fpsyg.2025.1540852 · Cited by 2 · see citing works
Diel, A., Hölsken, S., Christoph, J., Lalgi, T. J., Lena, H., Martin, T. C., & Bäuerle, A. (2026) · Mental Health & Prevention · doi:10.1016/j.mhp.2026.200503 · Cited by 1 · see citing works
Blended Care für Jugendliche mit depressiven Erkrankungen aus der Sicht von Behandelnden
Lincke, L., Kilb, H., Martin-Döring, T., Bienioschek, S., Nolkemper, D., Daunke, A., Reis, O., & Kölch, M. G. (2025) · Kindheit und Entwicklung · doi:10.1026/0942-5403/a000484 · Cited by 1 · see citing works
Torres, A. P. F., Ribeiro, N. S., de-Almeida, L. F., Costa, M. B., Santos, C. G. B., Melo, A. L. C., & Sartes, L. M. A. (2022) · Revista Brasileira de Terapias Cognitivas · doi:10.5935/1808-5687.20220004 · Cited by 2 · see citing works
Erfaringer med bruk av nettbrett i en barne- og ungdomspsykiatrisk døgnavdeling
Svamo, N. T. Ø., & Stensrud, B. (2023) · Tidsskrift for psykisk helsearbeid · doi:10.18261/tph.20.1.4
- Authors
- Aerts, J. E. M., & Dam, A. V.
- Affiliations
- Tilburg University (NL)
- Venue
- Psychology
- Publisher
- Scientific Research Publishing, Inc.
- Published
- 2018
- Volume
- 09
- Issue
- 10
- Pages
- 2422-2435
- ISSN
- 2152-7180 (ISSN-L)
- 2152-7199
- OpenAlex
- W2889916527
- Cited by
- 16
- References
- 42
- Citations by year
- 2026: 1 · 2025: 3 · 2024: 5 · 2023: 3 · 2022: 1 · 2021: 1 · 2019: 2
- FWCI
- 0.95
- Type
- journal article
- Language
- en
- Open access
- diamond
- doi.org
- Locations
- Psychology (publishedVersion, cc-by)
- Research portal (Tilburg University) (submittedVersion, other-oa)
- Data Archiving and Networked Services (DANS) (submittedVersion, other-oa)
- Topics
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Telemedicine and Telehealth Implementation
- Social Sciences › Psychology › Clinical Psychology › Psychotherapy Techniques and Applications
- Keywords
- internet-based cognitive behavioral therapy, therapeutic relationship, major depressive disorder, therapist attitudes, outpatient psychiatric care, medication adherence
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review