Man vs. machine: A meta-analysis on the added value of human support in text-based internet treatments (“e-therapy”) for mental disorders
Open accessThe DOI matches its Crossref record; 32 of the 32 references it cites were found in a registry or an index.
Abstract
Guided internet-based treatment is more efficacious than completely unguided or self-guided internet-based treatment, yet within the spectrum of guidance, little is known about the added value of human support compared to more basic forms of guidance. The primary aims of this meta-analysis were: (1) to examine whether human guidance was more efficacious than technological guidance in text-based internet treatments ("e-therapy") for mental disorders, and (2) whether more intensive human guidance outperformed basic forms of human guidance. PsycINFO, PubMed and Web of Science were systematically searched for randomized controlled trials that directly compared various types and degrees of online guidance. Thirty-one studies, totaling 6215 individuals, met inclusion criteria. Results showed that human guidance was slightly more efficacious than technological guidance, both in terms of symptom reduction (g = 0.11; p < .01) and adherence (0.26 < g < 0.29; p's < 0.01). On the spectrum of human support, results were slightly more favorable for regular guidance compared to optional guidance, but only in terms of adherence (OR = 1.89, g = 0.35; p < .05). Higher qualification of online counselors was not associated with efficacy. These findings extend and refine previous reports on guided and unguided online treatments.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A guideline of selecting and reporting intraclass correlation coefficients for reliability research
Koo, T. K., & Li, M. Y. (2016) · Journal of Chiropractic Medicine · doi:10.1016/j.jcm.2016.02.012 · Cited by 31,709
Funnel plots for detecting bias in meta-analysis
Sterne, J. A. C., & Egger, M. (2001) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(01)00377-8 · Cited by 3,779 · cited 1×
“Publication bias is assumed to be present when the effect sizes of small studies - with larger sampling variation than large studies - are represented asymmetrically within and around the funnel (Sterne & Egger, 2001).”
The Great Psychotherapy Debate: The Evidence for What Makes Psychotherapy Work
Wampold, B. E. (2015) · doi:10.4324/9780203582015 · Cited by 1,773
Internet-based cognitive behaviour therapy for symptoms of depression and anxiety: A meta-analysis
SPEK, V., CUIJPERS, P., NYKLÍČEK, I., RIPER, H., KEYZER, J., & POP, V. (2007) · Psychological Medicine · doi:10.1017/s0033291706008944 · Cited by 1,586 · cited 2×
“Most meta-analyses suggested that guidance renders e-therapy more efficacious (Andersson & Cuijpers, 2009; Johansson & Andersson, 2012; Richards & Richardson, 2012; Spek et al., 2007; Van 't Hof, Cuijpers, & Stein, 2009).”
Internet-Based and Other Computerized Psychological Treatments for Adult Depression: A Meta-Analysis
Andersson, G., & Cuijpers, P. (2009) · Cognitive Behaviour Therapy · doi:10.1080/16506070903318960 · Cited by 1,368 · cited 2×
“Most meta-analyses suggested that guidance renders e-therapy more efficacious (Andersson & Cuijpers, 2009; Johansson & Andersson, 2012; Richards & Richardson, 2012; Spek et al., 2007; Van 't Hof, Cuijpers, & Stein, 2009).”
Carlbring, P., Andersson, G., Cuijpers, P., Riper, H., & Hedman-Lagerlöf, E. (2018) · Cognitive Behaviour Therapy · doi:10.1080/16506073.2017.1401115 · Cited by 1,232
Advantages and limitations of Internet-based interventions for common mental disorders
Andersson, G., & Titov, N. (2014) · World Psychiatry · doi:10.1002/wps.20083 · Cited by 1,160
The impact of guidance on Internet-based mental health interventions — A systematic review
Baumeister, H., Reichler, L., Munzinger, M., & Lin, J. (2014) · Internet Interventions · doi:10.1016/j.invent.2014.08.003 · Cited by 1,037
Karyotaki, E., Efthimiou, O., Miguel, C., Maas genannt Bermpohl, F., Furukawa, T. A., Cuijpers, P., Individual Patient Data Meta-Analyses for Depression (IPDMA-DE) Collaboration, Riper, H., Patel, V., Mira, A., et al. (2021) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2020.4364 · Cited by 866
Cuijpers, P., Donker, T., van Straten, A., Li, J., & Andersson, G. (2010) · Psychological Medicine · doi:10.1017/s0033291710000772 · Cited by 832
Internet-delivered psychological treatments: from innovation to implementation
Andersson, G., Titov, N., Dear, B. F., Rozental, A., & Carlbring, P. (2019) · World Psychiatry · doi:10.1002/wps.20610 · Cited by 750 · cited 1×
“In addition to providing more flexibility and autonomy, some people may prefer to receive treatment in the privacy of their homes, likely related to stigma surrounding mental health problems (Andersson, Titov, Dear, Rozental, & Carlbring, 2019).”
The Role of Common Factors in Psychotherapy Outcomes
Cuijpers, P., Reijnders, M., & Huibers, M. J. H. (2019) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-050718-095424 · Cited by 748
Internet-based psychological treatments for depression
Johansson, R., & Andersson, G. (2012) · Expert Review of Neurotherapeutics · doi:10.1586/ern.12.63 · Cited by 509 · cited 2×
“Most meta-analyses suggested that guidance renders e-therapy more efficacious (Andersson & Cuijpers, 2009; Johansson & Andersson, 2012; Richards & Richardson, 2012; Spek et al., 2007; Van 't Hof, Cuijpers, & Stein, 2009).”
Titov, N., Andrews, G., Davies, M., McIntyre, K., Robinson, E., & Solley, K. (2010) · PLoS ONE · doi:10.1371/journal.pone.0010939 · Cited by 406 · cited 3×
“Yet, at the same time, in several studies included in these analyses, the more qualified counselor offered more support and/or moderated an online forum designed to assist a group of patients, instead of providing individual guidance (Robinson et al., 2010; Titov et al., 2009, 2010).”
InfluentialMixing Online and Face-to-Face Therapy: How to Benefit From Blended Care in Mental Health Care
Wentzel, J., van der Vaart, R., Bohlmeijer, E. T., & van Gemert-Pijnen, J. E. W. C. (2016) · JMIR Mental Health · doi:10.2196/mental.4534 · Cited by 371
Fu, Z., Burger, H., Arjadi, R., & Bockting, C. L. H. (2020) · The Lancet Psychiatry · doi:10.1016/s2215-0366(20)30256-x · Cited by 336 · cited 1×
“In the future, the questions raised in this meta-analysis should be extended to internet treatments in low and middle income countries, which were shown to be efficacious as well (Fu, Burger, Arjadi, & Bockting, 2020).”
Videoconferencing psychotherapy and depression: a systematic review
Berryhill, M. B., Culmer, N., Williams, N., Halli-Tierney, A., Betancourt, A., Roberts, H., & King, M. (2019) · Telemedicine and e-Health · doi:10.1089/tmj.2018.0058 · Cited by 275
Berger, T., Caspar, F., Richardson, R., Kneubühler, B., Sutter, D., & Andersson, G. (2011) · Behaviour Research and Therapy · doi:10.1016/j.brat.2010.12.007 · Cited by 265 · cited 4×
“These studies consisted of those comparing regular vs. optional guidance (Berger et al., 2011; Farrer et al., 2011; Gilbody et al., 2017; Hadjistavropoulos et al., 2017; Klei-boer et al., 2015; Oromendia et al., 2016), and those that compared a (fixed) higher frequency (i.e., 2 or 3 times a week)…”
InfluentialVernmark, K., Lenndin, J., Bjärehed, J., Carlsson, M., Karlsson, J., Öberg, J., Carlbring, P., Eriksson, T., & Andersson, G. (2010) · Behaviour Research and Therapy · doi:10.1016/j.brat.2010.01.005 · Cited by 226
Deady, M., Choi, I., Calvo, R. A., Glozier, N., Christensen, H., & Harvey, S. B. (2017) · BMC Psychiatry · doi:10.1186/s12888-017-1473-1 · Cited by 222 · cited 1×
“Moreover, e-therapy, when implemented on a large scale, offers great potential for the prevention of mental disorders (Deady et al., 2017).”
Domhardt, M., Geßlein, H., von Rezori, R. E., & Baumeister, H. (2019) · Depression and Anxiety · doi:10.1002/da.22860 · Cited by 218 · cited 7×
“To complement the electronic search, reference lists of recent meta-analyses and reviews on this topic (i.e., Baumeister et al., 2014; Domhardt et al., 2019; Karyotaki et al., 2021) were screened for relevant articles during the first phase.”
InfluentialLovell, K., & Richards, D. (2000) · Behavioural and Cognitive Psychotherapy · doi:10.1017/s1352465800004070 · Cited by 216 · cited 1×
“E-therapy offers many other benefits for people with mental health issues, as they have the potential to overcome barriers to regular mental health services (Andersson, 2015; Lovell & Richards, 2000).”
Ruwaard, J., Schrieken, B., Schrijver, M., Broeksteeg, J., Dekker, J., Vermeulen, H., & Lange, A. (2009) · Cognitive Behaviour Therapy · doi:10.1080/16506070802408086 · Cited by 183
Hof, E. V., Cuijpers, P., & Stein, D. J. (2009) · CNS Spectrums · doi:10.1017/s1092852900027279 · Cited by 156
Johnston, L., Titov, N., Andrews, G., Spence, J., & Dear, B. F. (2011) · PLoS ONE · doi:10.1371/journal.pone.0028079 · Cited by 150 · cited 5×
“…some studies the “ technical ” support refers to scheduled, motivational support, and encouragement from psychologists (e.g., Dirkse et al., 2020; Johnston et al., 2011); a component considered a “ common factor ” of effective therapies (Cuijpers, Reijnd-ers, & Huibers, 2019; Wampold & Imel,…”
InfluentialFarrand, P., & Woodford, J. (2013) · Clinical Psychology Review · doi:10.1016/j.cpr.2012.11.001 · Cited by 125
Dear, B. F., Staples, L. G., Terides, M. D., Fogliati, V. J., Sheehan, J., Johnston, L., Kayrouz, R., Dear, R., McEvoy, P. M., & Titov, N. (2016) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2016.05.004 · Cited by 114 · cited 1×
“…phobia, social anxiety disorder, generalized anxiety disorder or severe rumination (Berger et al., 2011; Campos et al., 2019; Cook et al., 2019; Dear et al., 2015, 2016; Fogliati et al., 2016; Ivanov et al., 2016; Johnston et al., 2011; Klein et al., 2009; Oromendia et al., 2016; Robinson et…”
Kooistra, L. C., Ruwaard, J., Wiersma, J. E., van Oppen, P., van der Vaart, R., van Gemert-Pijnen, J. E. W. C., & Riper, H. (2016) · Internet Interventions · doi:10.1016/j.invent.2016.01.003 · Cited by 92
Hadjistavropoulos, H. D., Schneider, L. H., Edmonds, M., Karin, E., Nugent, M. N., Dirkse, D., Dear, B. F., & Titov, N. (2017) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2017.09.006 · Cited by 71 · cited 2×
“These studies consisted of those comparing regular vs. optional guidance (Berger et al., 2011; Farrer et al., 2011; Gilbody et al., 2017; Hadjistavropoulos et al., 2017; Klei-boer et al., 2015; Oromendia et al., 2016), and those that compared a (fixed) higher frequency (i.e., 2 or 3 times a week)…”
Weisel, K. K., Zarski, A.-C., Berger, T., Krieger, T., Schaub, M. P., Moser, C. T., Berking, M., Dey, M., Botella, C., Baños, R., et al. (2019) · Internet Interventions · doi:10.1016/j.invent.2018.04.002 · Cited by 57
Oromendia, P., Orrego, J., Bonillo, A., & Molinuevo, B. (2016) · Cognitive Behaviour Therapy · doi:10.1080/16506073.2016.1163615 · Cited by 52 · cited 5×
“…vs. optional guidance (Berger et al., 2011; Farrer et al., 2011; Gilbody et al., 2017; Hadjistavropoulos et al., 2017; Klei-boer et al., 2015; Oromendia et al., 2016), and those that compared a (fixed) higher frequency (i.e., 2 or 3 times a week) or speed (i.e., within one business day) of…”
InfluentialDirkse, D., Hadjistavropoulos, H. D., Alberts, N. A., Karin, E., Schneider, L. H., Titov, N., & Dear, B. F. (2020) · Journal of Cancer Survivorship · doi:10.1007/s11764-019-00810-9 · Cited by 29
Cited by
Considering the role of human empathy in AI-driven therapy
Rubin, M., Arnon, H., Huppert, J. D., & Perry, A. (2024) · JMIR Mental Health · doi:10.2196/56529 · Cited by 111
Bolinski, F., Kleiboer, A., Neijenhuijs, K., Karyotaki, E., Wiers, R., de Koning, L., Jacobi, C., Zarski, A.-C., Weisel, K. K., Cuijpers, P., et al. (2022) · Journal of Medical Internet Research · doi:10.2196/40892 · Cited by 24
“Previous research has consistently indicated the superiority of individually guided interventions, specifically those involving human rather than technical support [85], although this applies less so for subclinical stages of depression [86].”
Self-citationSchmidt, M., Schoenenberg, K., Engelkamp, J. E., Staufenbiel, T., Martin, A., Ebert, D. D., & Hartmann, A. S. (2025) · BMC Psychiatry · doi:10.1186/s12888-025-06797-1 · Cited by 8
“Internet-based CBT (iCBT) may represent a suitable way to address these needs, as it has been shown in a recent meta-analysis to result in comparable effect sizes as face-to-face CBT [20], with therapist guided interventions showing superior results to automatic guided interventions [21].”
Metadata
- Authors
- Koelen, J. A., Vonk, A., Klein, A., de Koning, L., Vonk, P., de Vet, S., & Wiers, R.
- Venue
- Clinical Psychology Review
- Publisher
- Elsevier BV
- Published
- 2022-08
- Volume
- 96
- Pages
- 102179
- ISSN
- 0272-7358 (ISSN-L)
- OpenAlex
- W4281727908
- Cited by
- 55
- References
- 32
- FWCI
- 2.23
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.