The association between therapeutic alliance and outcome in internet-based psychological interventions: A meta-analysis
The DOI matches its Crossref record; 48 of the 48 references it cites were found in a registry or an index.
Abstract
Abstract Background Internet-based psychological interventions have proven effective and yield advantages that make them a viable alternative to face-to-face therapy in many fields. Yet, the role of therapeutic alliance in technologically mediated interventions has been discussed critically. The aim of this meta-analysis is to summarize the association between therapeutic alliance and outcome in therapist-assisted online interventions. Methods A systematic search of the databases PubMed, Web of Science, PsycINFO and PubPsych was conducted for articles published before February 2020 that assess the association between therapeutic alliance and outcome in internet-based interventions involving remote therapist contact. Results were systematically screened and information on the alliance-outcome-association was extracted. A multilevel meta-analysis was conducted. Results Overall, 51 effect sizes were extracted from 20 included studies. The average weighted effect size is r = 0.203 (p Conclusions Therapeutic alliance and outcome are significantly correlated in internet-based therapy. This points to the relevance of a stable alliance in internet-based interventions and suggests that fostering alliance might be beneficial to treatment success.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The generalizability of the psychoanalytic concept of the working alliance.
Bordin, E. S. (1979) · Psychotherapy: Theory, Research & Practice · doi:10.1037/h0085885 · Cited by 5,238
Relation of the therapeutic alliance with outcome and other variables: a meta-analytic review
Martin, D. J., Garske, J. P., & Davis, M. K. (2000) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.68.3.438 · Cited by 3,355
Relation between working alliance and outcome in psychotherapy: A meta-analysis
Horvath, A. O., & Symonds, B. D. (1991) · Journal of Counseling Psychology · doi:10.1037/0022-0167.38.2.139 · Cited by 2,673
Alliance in individual psychotherapy
Horvath, A. O., Del Re, A. C., Flückiger, C., & Symonds, D. (2011) · Psychotherapy · doi:10.1037/a0022186 · Cited by 2,072
The alliance in adult psychotherapy: A meta-analytic synthesis
Flückiger, C., Del Re, A. C., Wampold, B. E., & Horvath, A. O. (2018) · Psychotherapy · doi:10.1037/pst0000172 · Cited by 1,763
On the Use of Beta Coefficients in Meta-Analysis.
Peterson, R. A., & Brown, S. P. (2005) · Journal of Applied Psychology · doi:10.1037/0021-9010.90.1.175 · Cited by 1,643
Cheung, M. W.-L. (2014) · Psychological Methods · doi:10.1037/a0032968 · Cited by 1,342
Andersson, G., Cuijpers, P., Carlbring, P., Riper, H., & Hedman, E. (2014) · World Psychiatry · doi:10.1002/wps.20151 · Cited by 1,077
Spijkerman, M. P. J., Pots, W. T. M., & Bohlmeijer, E. T. (2016) · Clinical Psychology Review · doi:10.1016/j.cpr.2016.03.009 · Cited by 975
Hedman, E., Ljótsson, B., & Lindefors, N. (2012) · Expert Review of Pharmacoeconomics & Outcomes Research · doi:10.1586/erp.12.67 · Cited by 672
Therapist adherence/competence and treatment outcome: A meta-analytic review.
Webb, C. A., DeRubeis, R. J., & Barber, J. P. (2010) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0018912 · Cited by 657
How central is the alliance in psychotherapy? A multilevel longitudinal meta-analysis.
Flückiger, C., Del Re, A. C., Wampold, B. E., Symonds, D., & Horvath, A. O. (2012) · Journal of Counseling Psychology · doi:10.1037/a0025749 · Cited by 576
Therapeutic alliance in videoconferencing psychotherapy: A review
Simpson, S. G., & Reid, C. L. (2014) · Australian Journal of Rural Health · doi:10.1111/ajr.12149 · Cited by 420
Knaevelsrud, C., & Maercker, A. (2007) · BMC Psychiatry · doi:10.1186/1471-244x-7-13 · Cited by 398
Berger, T. (2017) · Psychotherapy Research · doi:10.1080/10503307.2015.1119908 · Cited by 364
The Therapeutic Relationship in E-Therapy for Mental Health: A Systematic Review
Sucala, M., Schnur, J. B., Constantino, M. J., Miller, S. J., Brackman, E. H., & Montgomery, G. H. (2012) · Journal of Medical Internet Research · doi:10.2196/jmir.2084 · Cited by 344
Is internet-based CBT for panic disorder and agoraphobia as effective as face-to-face CBT?
Kiropoulos, L. A., Klein, B., Austin, D. W., Gilson, K., Pier, C., Mitchell, J., & Ciechomski, L. (2008) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2008.01.008 · Cited by 290
Kuester, A., Niemeyer, H., & Knaevelsrud, C. (2016) · Clinical Psychology Review · doi:10.1016/j.cpr.2015.11.004 · Cited by 261
Clarke, G., Reid, E., Eubanks, D., O'Connor, E., DeBar, L. L., Kelleher, C., Lynch, F., & Nunley, S. (2002) · Journal of Medical Internet Research · doi:10.2196/jmir.4.3.e14 · Cited by 256
Individually-tailored, internet-based treatment for anxiety disorders: a randomized controlled trial
Carlbring, P., Maurin, L., Törngren, C., Linna, E., Eriksson, T., Sparthan, E., Strååt, M., Marquez von Hage, C., Bergman-Nordgren, L., & Andersson, G. (2011) · Behaviour Research and Therapy · doi:10.1016/j.brat.2010.10.002 · Cited by 227
Vernmark, K., Lenndin, J., Bjärehed, J., Carlsson, M., Karlsson, J., Öberg, J., Carlbring, P., Eriksson, T., & Andersson, G. (2010) · Behaviour Research and Therapy · doi:10.1016/j.brat.2010.01.005 · Cited by 226
Andersson, G., Paxling, B., Wiwe, M., Vernmark, K., Felix, C. B., Lundborg, L., Furmark, T., Cuijpers, P., & Carlbring, P. (2012) · Behaviour Research and Therapy · doi:10.1016/j.brat.2012.05.003 · Cited by 202
Brown, M., Glendenning, A., Hoon, A. E., & John, A. (2016) · Journal of Medical Internet Research · doi:10.2196/jmir.6200 · Cited by 198
Musiat, P., & Tarrier, N. (2014) · Psychological Medicine · doi:10.1017/s0033291714000245 · Cited by 188
Meyer, B., Bierbrodt, J., Schröder, J., Berger, T., Beevers, C. G., Weiss, M., Jacob, G., Späth, C., Andersson, G., Lutz, W., et al. (2015) · Internet Interventions · doi:10.1016/j.invent.2014.12.003 · Cited by 188
Karyotaki, E., Kemmeren, L., Riper, H., Twisk, J., Hoogendoorn, A., Kleiboer, A., Mira, A., Mackinnon, A., Meyer, B., Botella, C., et al. (2018) · Psychological Medicine · doi:10.1017/s0033291718000648 · Cited by 167
Andersson, G., Carlbring, P., Furmark, T., & on behalf of the S. O. F. I. E. Research Group (2012) · PLoS ONE · doi:10.1371/journal.pone.0037411 · Cited by 166
Preschl, B., Maercker, A., & Wagner, B. (2011) · BMC Psychiatry · doi:10.1186/1471-244x-11-189 · Cited by 158
Berger, T., Boettcher, J., & Caspar, F. (2014) · Psychotherapy · doi:10.1037/a0032527 · Cited by 158
Telemental health: A status update
Aboujaoude, E., Salame, W., & Naim, L. (2015) · World Psychiatry · doi:10.1002/wps.20218 · Cited by 154
Paxling, B., Almlöv, J., Dahlin, M., Carlbring, P., Breitholtz, E., Eriksson, T., & Andersson, G. (2011) · Cognitive Behaviour Therapy · doi:10.1080/16506073.2011.576699 · Cited by 147
Pihlaja, S., Stenberg, J.-H., Joutsenniemi, K., Mehik, H., Ritola, V., & Joffe, G. (2018) · Internet Interventions · doi:10.1016/j.invent.2017.11.005 · Cited by 134
Alfonsson, S., Olsson, E., & Hursti, T. (2016) · Journal of Medical Internet Research · doi:10.2196/jmir.5352 · Cited by 118
Acceptance based behavior therapy for social anxiety disorder through videoconferencing
Yuen, E. K., Herbert, J. D., Forman, E. M., Goetter, E. M., Juarascio, A. S., Rabin, S., Goodwin, C., & Bouchard, S. (2013) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2013.03.002 · Cited by 117
Chong, J., & Moreno, F. (2012) · Telemedicine and e-Health · doi:10.1089/tmj.2011.0126 · Cited by 107
Hedman, E., Axelsson, E., Görling, A., Ritzman, C., Ronnheden, M., Alaoui, S. E., Andersson, E., Lekander, M., & Ljótsson, B. (2014) · British Journal of Psychiatry · doi:10.1192/bjp.bp.113.140913 · Cited by 103
Anderson, R. E. E., Spence, S. H., Donovan, C. L., March, S., Prosser, S., & Kenardy, J. (2012) · Journal of Medical Internet Research · doi:10.2196/jmir.1848 · Cited by 102
Bergman Nordgren, L., Carlbring, P., Linna, E., & Andersson, G. (2013) · JMIR Research Protocols · doi:10.2196/resprot.2292 · Cited by 92
Wagner, B., Brand, J., Schulz, W., & Knaevelsrud, C. (2012) · Depression and Anxiety · doi:10.1002/da.21962 · Cited by 84
Jasper, K., Weise, C., Conrad, I., Andersson, G., Hiller, W., & Kleinstäuber, M. (2014) · Internet Interventions · doi:10.1016/j.invent.2014.04.002 · Cited by 68
Xu, H., & Tracey, T. J. G. (2015) · Journal of Counseling Psychology · doi:10.1037/cou0000089 · Cited by 68
Hadjistavropoulos, H. D., Pugh, N. E., Hesser, H., & Andersson, G. (2017) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.2014 · Cited by 61
Hedman, E., Andersson, E., Lekander, M., & Ljótsson, B. (2015) · Behaviour Research and Therapy · doi:10.1016/j.brat.2014.11.009 · Cited by 56
Ormrod, J. A., Kennedy, L., Scott, J., & Cavanagh, K. (2010) · Cognitive Behaviour Therapy · doi:10.1080/16506071003675614 · Cited by 55
Richards, D., Timulak, L., & Hevey, D. (2013) · Counselling and Psychotherapy Research · doi:10.1080/14733145.2012.733715 · Cited by 55
Andersson, E., Ljótsson, B., Hedman, E., Enander, J., Kaldo, V., Andersson, G., Lindefors, N., & Rück, C. (2015) · Journal of Obsessive-Compulsive and Related Disorders · doi:10.1016/j.jocrd.2014.10.003 · Cited by 52
Scherer, S., Alder, J., Gaab, J., Berger, T., Ihde, K., & Urech, C. (2016) · Journal of Psychosomatic Research · doi:10.1016/j.jpsychores.2015.10.011 · Cited by 51
Working Alliance in Internet-Based Cognitive-Behavioral Therapy for Obsessive-Compulsive Disorder
Herbst, N., Franzen, G., Voderholzer, U., Thiel, N., Knaevelsrud, C., Hertenstein, E., Nissen, C., & Külz, A. K. (2016) · Psychotherapy and Psychosomatics · doi:10.1159/000441282 · Cited by 18
Research works printed but not linked: 19
- Alfonsson, 2015, The effects of therapist support and treatment presentation on the clinical outcomes of an Internet based applied relaxation program, Internet Interventions, 2, 289, 10.1016/j.invent.2015.07.005 · DOI · Paper page
- Anderson, 2017, Working alliance, interpersonal problems, and depressive symptoms in tele‐interpersonal psychotherapy for hiv‐infected rural persons: Evidence for indirect effects, Journal of Clinical Psychology. Advance online publication
- Beckner, 2007, Alliance in two telephone-administered treatments: Relationship with depression and health outcomes, Journal of Consulting and Clinical Psychology, 75, 508, 10.1037/0022-006X.75.3.508 · DOI · Paper page
- Bordin, 1994, Theory and research on the therapeutic working alliance: New directions, The Working Alliance: Theory, Research, and Practice, 173, 13
- Carlbring, 2018, Internet-based vs. Face-to-face cognitive behavior therapy for psychiatric and somatic disorders: An updated systematic review and meta-analysis, Cognitive Behaviour Therapy, 47, 1, 10.1080/16506073.2017.1401115 · DOI · Paper page
- Duval, 2000, Trim and fill: A simple funnel-plot-based method of testing and adjusting for publication bias in meta-analysis, Biometrics, 56, 455, 10.1111/j.0006-341X.2000.00455.x · DOI · Paper page
- Eckman, 2018, Shared decision-making tool for thromboprophylaxis in atrial fibrillation - a feasibility study, American Heart Journal, 199, 13, 10.1016/j.ahj.2018.01.003 · DOI
- Falkenström, 2014, Working alliance predicts psychotherapy outcome even while controlling for prior symptom improvement, Psychotherapy Research, 24, 146, 10.1080/10503307.2013.847985 · DOI · Paper page
- Freeman, 2013, Behavioral health care for adolescents with poorly controlled diabetes via Skype: Does working alliance remain intact?, Journal of Diabetes Science and Technology, 7, 727, 10.1177/193229681300700318 · DOI · Paper page
- Gieselmann, 2016, Treating procrastination chat-based versus face-to-face: An RCT evaluating the role of self-disclosure and perceived counselor's characteristics, Computers in Human Behavior, 54, 444, 10.1016/j.chb.2015.08.027 · DOI
- Herbst, 2014, No talking, just writing! Efficacy of an Internet-based cognitive behavioral therapy with exposure and response prevention in obsessive compulsive disorder, Psychotherapy and Psychosomatics, 83, 165, 10.1159/000357570 · DOI · Paper page
- Higgins, 2003, Measuring inconsistency in meta-analyses, BMJ, 327, 557, 10.1136/bmj.327.7414.557 · DOI · Paper page
- Karyotaki, 2017, Efficacy of self-guided internet-based cognitive behavioral therapy in the treatment of depressive symptoms: A meta-analysis of individual participant data, Jama Psychiatry, 74, 351, 10.1001/jamapsychiatry.2017.0044 · DOI · Paper page
- Knaevelsrud, 2006, Does the quality of the working alliance predict treatment outcome in online psychotherapy for traumatized patients?, Journal of Medical Internet Research, 8, e31, 10.2196/jmir.8.4.e31 · DOI · Paper page
- Moher, 2009, Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement, PLoS Medicine, 6, 10.1371/journal.pmed.1000097 · DOI · Paper page
- Robak, 2013, The working alliance in group counseling: An exploratory study, Psychological Reports, 113, 591, 10.2466/21.02.PR0.113x19z7 · DOI
- Rüegg, 2018, Metacognitive training online: A pilot study of an internet-based intervention for people with schizophrenia, Zeitschrift für Neuropsychologie, 29, 35, 10.1024/1016-264X/a000213 · DOI
- Viechtbauer, 2010, Conducting meta-analyses in R with the metafor package, Journal of Statistical Software, 36, 1, 10.18637/jss.v036.i03 · DOI · Paper page
- Wasserman, 1988, Statistical methods for meta-analysis, Journal of Educational Statistics, 13, 75
Cited by
Liu, H., Peng, H., Song, X., Xu, C., & Zhang, M. (2022) · Internet Interventions · doi:10.1016/j.invent.2022.100495 · Cited by 296
“…to reduce the stigma associated with seeing a therapist, but it struggles to establish a therapeutic alliance with the clients (Donkin et al., 2013) and have a relatively poor adherence rate, which was reported in (Kaiser et al., 2021) to have a positive impact on user acceptance and adherence.”
BackgroundLincke, L., Ulbrich, L., Reis, O., Wandinger, E., Brähler, E., Dück, A., & Kölch, M. (2022) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2022.889555 · Cited by 24
Saxler, E., Schindler, T., Philipsen, A., Schulze, M., & Lux, S. (2024) · Frontiers in Psychology · doi:10.3389/fpsyg.2024.1293851 · Cited by 17
Technology-based cognitive behavioral therapy interventions
Newby, J. M., Upton, E., Mason, E., & Black, M. (2024) · Psychiatric Clinics of North America · doi:10.1016/j.psc.2024.02.004 · Cited by 11
O'Kane, K. M. K., Otamendi, T., Silverberg, N. D., Choi, E., Sicard, V., Zemek, R., Healey, K., Brown, O., Butterfield, L., Smith, A., et al. (2024) · JMIR Formative Research · doi:10.2196/49133 · Cited by 7
Metadata
- Authors
- Kaiser, J., Hanschmidt, F., & Kersting, A.
- Venue
- Computers in Human Behavior
- Publisher
- Elsevier BV
- Published
- 2021-01
- Volume
- 114
- Pages
- 106512
- ISSN
- 0747-5632 (ISSN-L)
- OpenAlex
- W3049262897
- Cited by
- 106
- References
- 48
- FWCI
- 1.08
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.elsevier.com/tdm/userlicense/1.0/ (tdm)
- www.elsevier.com/legal/tdmrep-license (tdm)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.