The DOI matches its Crossref record; 84 of the 84 references it cites were found in a registry or an index.
Does Internet-based guided-self-help for depression cause harm? An individual participant data meta-analysis on deterioration rates and its moderators in randomized controlled trials
Open accessAbstract
Background: Almost nothing is known about the potential negative effects of Internet-based psychological treatments for depression. This study aims at investigating deterioration and its moderators within randomized trials on Internet-based guided self-help for adult depression, using an individual patient data meta-analyses (IPDMA) approach. Method: Studies were identified through systematic searches (PubMed, PsycINFO, EMBASE, Cochrane Library). Deterioration in participants was defined as a significant symptom increase according to the reliable change index (i.e. 7.68 points in the CES-D; 7.63 points in the BDI). Two-step IPDMA procedures, with a random-effects model were used to pool data. Results: A total of 18 studies (21 comparisons, 2079 participants) contributed data to the analysis. The risk for a reliable deterioration from baseline to post-treatment was significantly lower in the intervention v . control conditions (3.36 v . 7.60; relative risk 0.47, 95% confidence interval 0.29–0.75). Education moderated effects on deterioration, with patients with low education displaying a higher risk for deterioration than patients with higher education. Deterioration rates for patients with low education did not differ statistically significantly between intervention and control groups. The benefit–risk ratio for patients with low education indicated that 9.38 patients achieve a treatment response for each patient experiencing a symptom deterioration. Conclusions: Internet-based guided self-help is associated with a mean reduced risk for a symptom deterioration compared to controls. Treatment and symptom progress of patients with low education should be closely monitored, as some patients might face an increased risk for symptom deterioration. Future studies should examine predictors of deterioration in patients with low education.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“In a similar patientlevel analysis on guided ICBT 81 (18 stud ies, 2,079 participants), the deterioration rate was 3.36% in the treatment groups and 7.60% in the control groups (relative risk=0.47,95% CI: 0.29 to 0.75).”
From Internet-delivered psychological treatments: from innovation to implementation (2019) · cites this paper as [81]
The cited source says what the claim attributes to it.
In the citing paper
“Patients with lower education presented a higher risk for deterioration than those with higher education.”
From Internet-delivered psychological treatments: from innovation to implementation (2019) · cites this paper as [81]
The cited source says what the claim attributes to it.
In the citing paper
“Although deterioration rates are infrequently reported in the literature, the proportion of individuals experiencing symptom deterioration during face-to-face psychological interventions is estimated to range between 3-14% (Ebert et al., 2016; Cujipers et al., 2018; Ronk et al., 2013), which is comparable to deterioration rates for online interventions (Ebert et al., 2016).”
From A randomised trial comparing a brief online delivery of mindfulness-plus-values versus values only for symptoms of depression: Does baseline severity matter? (2020) · cites this paper as Ebert et al., 2016
The cited source says what the claim attributes to it.
In the citing paper
“However, the potential negative effect could be that self-help treatments could lead to a delayed help-seeking, which could result in further deterioration of symptoms, if the initial self-help treatment should be not sufficient.23”
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“This is in line with previous research that suggests the use of synchronous support, such as weekly check-ins with a therapist or group support sessions as being beneficial for engaging individuals in self-guided in terventions (Baumeister, Reichler, Munzinger, & Lin 2014; Ebert et al., 2016).”
From An ACT self-help intervention for adults with a visible difference in appearance: A pilot feasibility and acceptability randomized controlled study. (2023) · cites this paper as Ebert et al., 2016
Experimental — accuracy not yet measured
In the citing paper
“The results of deterioration rates (3.2% in depression and 3.1% in anxiety studies) were slightly lower, but within the 95% CI of findings based on RCTs for internet-based guided self-help interventions (3.36%) for depression [164] and anxiety (5.8% [165]), and also comparable with deterioration rates in face-to-face psychotherapy for depression [166].”
From Effects of Internet-based cognitive behavioral therapy in routine care for adults in treatment for depression and anxiety: systematic review and meta-analysis (2020) · cites this paper as [164]
In the citing paper
“However, these studies also support the findings that deterioration rates are low and that psychological treatment reduces these rates.”
From Negative effects of psychotherapies for adult depression: A meta-analysis of deterioration rates (2018) · cites this paper as Ebert et al., 2016
In the citing paper
“one recent IPD meta-analysis of trials on internet-based treatments of depression also found lower deterioration rates for patients receiving treatment compared to control groups”
From Negative effects of psychotherapies for adult depression: A meta-analysis of deterioration rates (2018) · cites this paper as Ebert et al., 2016
In the citing paper
“The results of this study are in line with a growing number of metaanalytic studies showing that psychological treatments result in a significant reduction of deterioration in patients.”
From Negative effects of psychotherapies for adult depression: A meta-analysis of deterioration rates (2018) · cites this paper as Ebert et al., 2016
In the citing paper
“and one type of intervention (internet-based CBT; (Ebert et al., 2016))”
From Negative effects of psychotherapies for adult depression: A meta-analysis of deterioration rates (2018) · cites this paper as Ebert et al., 2016
In the citing paper
“but also found that patients with lower education had a higher risk for deterioration than patients with higher education (Ebert et al., 2016)”
From Negative effects of psychotherapies for adult depression: A meta-analysis of deterioration rates (2018) · cites this paper as Ebert et al., 2016
In the citing paper
“A recent meta-analysis of individual participant data showed that guided iCBT for adults with depression is associated with a mean reduced risk for symptom deterioration compared to other control conditions [33].”
From Effectiveness and cost-effectiveness of guided Internet- and mobile-based CBT for adolescents and young adults with chronic somatic conditions and comorbid depression and anxiety symptoms (youthCOACHCD): study protocol for a multicentre randomized controlled trial (2020) · cites this paper as [33]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Bias in meta-analysis detected by a simple, graphical test
Egger, M., Smith, G. D., Schneider, M., & Minder, C. (1997) · BMJ · doi:10.1136/bmj.315.7109.629 · Cited by 56,722
The CES-D Scale: A Self-Report Depression Scale for Research in the General Population
Radloff, L. S. (1977) · Applied Psychological Measurement · doi:10.1177/014662167700100306 · Cited by 53,267
Meta-analysis in clinical trials
DerSimonian, R., & Laird, N. (1986) · Controlled Clinical Trials · doi:10.1016/0197-2456(86)90046-2 · Cited by 39,552
An inventory for measuring depression
BECK, A. T. (1961) · Archives of General Psychiatry · doi:10.1001/archpsyc.1961.01710120031004 · Cited by 38,032
Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2009) · doi:10.1002/9780470743386 · Cited by 14,225
Duval, S., & Tweedie, R. (2000) · Biometrics · doi:10.1111/j.0006-341x.2000.00455.x · Cited by 14,099
Kessler, R. C., Chiu, W. T., Demler, O., & Walters, E. E. (2005) · Archives of General Psychiatry · doi:10.1001/archpsyc.62.6.617 · Cited by 12,052
Missing data: our view of the state of the art
Schafer, J. L., & Graham, J. W. (2002) · Psychological Methods · doi:10.1037/1082-989x.7.2.147 · Cited by 11,638
Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2021) · doi:10.1002/9781119558378 · Cited by 9,799
Jacobson, N. S., & Truax, P. (1991) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.59.1.12 · Cited by 7,770
Research works printed but not linked: 1
- Higgins, 2011, Cochrane Handbook for Systematic Reviews of Interventions, version 5.1.0 (updated March 2011)
Cited by
Sorted by citations
Items 101–154 of 154
Bijker, L., de Wit, L. M., Cuijpers, P. J., Poolman, E. Y., Scholten-Peeters, G. G. M., & Coppieters, M. W. (2022) · BMJ Open · doi:10.1136/bmjopen-2021-050808 · Cited by 13
Self-citationResearch on negative effects of psychotherapies: The next steps.
Cuijpers, P. J. (2021) · Clinical Psychology Science and Practice · doi:10.1037/cps0000011 · Cited by 8
Self-citationBaumeister, A., Schmotz, S., Weidinger, S., & Moritz, S. (2023) · Behavior Therapy · doi:10.1016/j.beth.2023.05.013 · Cited by 10
Lüdtke, T., Rüegg, N., Moritz, S., Berger, T., & Westermann, S. (2021) · Psychiatry Research · doi:10.1016/j.psychres.2021.114223 · Cited by 8
Self-citationGalante, J., Friedrich, C., Dalgleish, T., White, I. R., & Jones, P. B. (2022) · BMJ Open · doi:10.1136/bmjopen-2021-058976 · Cited by 8
Børtveit, L., Nordgreen, T., & Nordahl‐Hansen, A. (2023) · Frontiers in Psychology · doi:10.3389/fpsyg.2023.1236895 · Cited by 9
Интернет и самоповреждения подростков: кто виноват – что делать
Любов, Е. Б., & Zotov, P. B. (2019) · Суицидология · doi:10.32878/suiciderus.19-10-03(36)-3-18 · Cited by 7
Moggia, D., Lutz, W., Kazantzis, N., Schwartz, B., & Bakker, D. (2023) · Behavior Therapy · doi:10.1016/j.beth.2023.05.014 · Cited by 8
Rubeis, G., & Ketteler, D. (2020) · PPmP - Psychotherapie · Psychosomatik · Medizinische Psychologie · doi:10.1055/a-1104-5459 · Cited by 7
Telehealth and Women’s Perinatal Mental Health
Kingston, D. E., & Rocha, R. (2020) · Springer eBooks · doi:10.1007/978-3-030-29081-8_23 · Cited by 8
Schulte, C. E., Sextl-Plötz, T., Baumeister, H., Titzler, I., Sander, L., Sachser, C., Steubl, L., & Zarski, A. (2024) · Internet Interventions · doi:10.1016/j.invent.2024.100710 · Cited by 5
Assessing Synthetic Voices for Mental Health Chatbots
Amorese, T., McConvey, G., Cuciniello, M., Cordasco, G., Bond, R., Mulvenna, M. D., Ennis, E., Callejas, Z., & Esposito, A. A. (2023) · Lecture notes in networks and systems · doi:10.1007/978-981-99-3043-2_6 · Cited by 5
Lindegaard, T., Persson, L., Thorängen, M., & Rozental, A. (2024) · Psychotherapy Research · doi:10.1080/10503307.2024.2420717 · Cited by 4
Özer, Ö., & Köksal, B. (2023) · OSMANGAZİ JOURNAL OF MEDICINE · doi:10.20515/otd.1309551 · Cited by 5
A guide to what works for depression: An evidence-based review
Morgan, A. J., Reavley, N. J., Jorm, A. F., Bassilios, B., Hopwood, M., Allen, N. B., & Purcell, R. (2019) · Cited by 4
Hlynsson, J. I., Kristjánsson, T., Andersson, G., & Carlbring, P. (2025) · Frontiers in Psychology · doi:10.3389/fpsyg.2025.1568141 · Cited by 3
Self-citationSystemische Therapie goes online
Meßner, E.-M., & Feikes, K. I. (2021) · Psychotherapeut · doi:10.1007/s00278-021-00544-z · Cited by 3
Simon, L., Terhorst, Y., Küchler, A., Riemann, D. W., Ebert, D. D., Rozental, A., Spiegelhalder, K., & Baumeister, H. (2025) · Sleep Medicine · doi:10.1016/j.sleep.2025.02.044 · Cited by 3
Self-citationFernbehandlung aus psychotherapeutischer Sicht
Munz, D., Jansen, A., & Böhmig, C. (2019) · Fortschritte der Neurologie · Psychiatrie · doi:10.1055/a-0846-4908 · Cited by 3
Bloch‐Elkouby, S., Eubanks, C. F., Knopf, L., Gorman, B. S., & Muran, J. C. (2019) · Frontiers in Psychology · doi:10.3389/fpsyg.2019.01180 · Cited by 3
Areán, P. A., & Allred, R. (2022) · Elsevier eBooks · doi:10.1016/b978-0-323-90045-4.00011-3 · Cited by 3
Esfandiari, N., Mazaheri, M. A., Sadeghi‐Firoozabadi, V., & Cheraghi, M. (2020) · doi:10.2196/preprints.18275 · Cited by 3
Banbury Forum Consensus Statement on the Path Forward for Digital Mental Health Treatment
Mohr, D. C., Azocar, F., Bertagnolli, A., Choudhury, T., Chrisp, P., Frank, R. G., Harbin, H. T., Histon, T., Kaysen, D. L., Nebeker, C., et al. (2025) · FOCUS The Journal of Lifelong Learning in Psychiatry · doi:10.1176/appi.focus.25023021 · Cited by 2
Self-citationDie Rolle von E-Mental Health am Beispiel depressiver Erkrankungen
Hegerl, U., Dogan-Sander, E., Oehler, C., Sander, C., & Stöber, F. (2018) · Springer eBooks · doi:10.1007/978-3-662-57611-3_4 · Cited by 2
Sextl-Plötz, T., Franke, M., Baumeister, H., & Ebert, D. D. (2023) · Springer eBooks · doi:10.1007/978-3-662-65816-1_3 · Cited by 2
Self-citationBücker, L., Berger, T., Bruhns, A., & Westermann, S. (2022) · JMIR Formative Research · doi:10.2196/37287 · Cited by 3
Self-citationGalante, J., Friedrich, C., Dalgleish, T., White, I. R., & Jones, P. B. (2021) · doi:10.31234/osf.io/3gsv9 · Cited by 2
Larionov, K., Petrova, E., Demirbuga, N., Werth, O., Breitner, M. H., Gebhardt, P., Caldarone, F., Duncker, D., Westhoff-Bleck, M., Sensenhauser, A., et al. (2023) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2023.1138475 · Cited by 1
“Regarding the negative effects of Internet-based therapy in anxiety and depression among patients in the treatment group, adverse effects can vary from 4 to 10% (55, 56).”
BackgroundCare for the Caregiver : Internet intervention for informal caregivers in Lithuania
Biliūnaitė, I. (2022) · Linköping studies in behavioural science · doi:10.3384/9789179291877 · Cited by 1
Furukawa, T. A., Noma, H., Kojima, M., Tajika, A., Toyomoto, R., Sakata, M., Luo, Y., Kosuke Inoue, Horikoshi, M., Akechi, T., et al. (2026) · BMJ Open · doi:10.1136/bmjopen-2025-113603 · Cited by 1
Self-citationBørtveit, L., Nordgreen, T., & Nordahl‐Hansen, A. (2023) · Frontiers in Psychology · doi:10.3389/fpsyg.2023.1274464 · Cited by 1
Robles, V. A. G. (2019) · Tesis Doctorals en Xarxa (Consorci de Serveis Universitaris de Catalunya) · doi:10.6035/14109.2019.233592
Digitalisierte Psychotherapie: Die Frage nach dem “Wie”
Baumeister, H., Ebert, D. D., & Moritz, S. (2019) · Verhaltenstherapie · doi:10.1159/000502785
Self-citationMarchant, A. L. (2020) · Cronfa (Swansea University) · doi:10.23889/suthesis.56821
Technological Interventions for Depression
Cuijpers, P. J., Karyotaki, E., & Riper, H. M. (2020) · Elsevier eBooks · doi:10.1016/b978-0-12-818697-8.00027-3
Self-citationSettingspezifische Psychotherapie
Baumeister, H., Bodenmann, G., Domhardt, M., Ebert, D. D., Köllner, V., Kröger, C. B., Kuhn, R., Martin, A., Meßner, E.-M., Spitzer, C., et al. (2021) · Elsevier eBooks · doi:10.1016/b978-3-437-22601-4.00037-1
Self-citationTracy, D. K., Joyce, D. W., & Shergill, S. S. (2016) · The British Journal of Psychiatry · doi:10.1192/bjp.209.6.533
Jesús-Romero, R. D., Wasil, A. R., & Lorenzo‐Luaces, L. (2022) · doi:10.2196/preprints.39508
Geirhos, A., Bendig, E., SCHMITT, A. J., Ebert, D. D., & Baumeister, H. (2023) · Springer eBooks · doi:10.1007/978-3-662-65816-1_16
Self-citationWeisel, K. K., Baumeister, H., & Ebert, D. D. (2023) · Springer eBooks · doi:10.1007/978-3-662-65816-1_24
Self-citationSextl-Plötz, T., Schulte, C. E., Baumeister, H., Titzler, I., Sander, L., Sachser, C., Steubl, L., & Zarski, A. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4620592
Ginoux, C., Legrand, F. D., Herring, M. P., Abdullah, M. F. I. L. B., & Stubbs, B. (2023) · doi:10.31219/osf.io/me65v
Baumeister, A., Schuurmans, L., Schultz, J., Schröder, J., Moritz, S., & Jelinek, L. (2024) · Behaviour Research and Therapy · doi:10.1016/j.brat.2024.104673
Hamilton, J., Brennan, K., Brown, D., & Barnhofer, T. (2025) · Mindfulness · doi:10.1007/s12671-025-02598-5
Rolvien, L., Sönmez, D., Schuurmans, L., Borgmann, L., Schmüser, A., Moritz, S., & Baumeister, A. (2025) · Internet Interventions · doi:10.1016/j.invent.2025.100893
Liem, A., Garabiles, M. R., Pakingan, K. A., Chen, W., Lam, A. I. F., Burchert, S., & Hall, B. J. (2021) · Figshare · doi:10.6084/m9.figshare.14433437
Lunkenheimer, F., Domhardt, M., Geirhos, A., Kilian, R., Mueller-Stierlin, A. S., Holl, R. W., Meissner, T., Minden, K., Moshagen, M., Ranz, R., et al. (2020) · Figshare · doi:10.6084/m9.figshare.11978766
Liem, A., Garabiles, M. R., Pakingan, K. A., Chen, W., Lam, A. I. F., Burchert, S., & Hall, B. J. (2021) · Figshare · doi:10.6084/m9.figshare.14433434
Internet-based CBT for depression: a pilot study
Pasztor, J., Praško, J., Ocisková, M., Nesnídal, V., Kantor, K., Vrbová, K., Maté, Z., Kwolek, D., Sverlov, A., Vlček, F., et al. (2026) · Psychiatrie pro praxi · doi:10.36290/psy.2026.006
Niemi, M., Michalak, J., Velana, M., Barnhofer, T., & Harrer, M. (2026) · BMJ Open · doi:10.1136/bmjopen-2025-106362
Fournier, A., Rivest, M.-C., Price, J. A. B., & Hadjistavropoulos, H. D. (2026) · Revue québécoise de psychologie · doi:10.7202/1126758ar
Standal, B., Kenter, R. M. F., Gullslett, M. K., Nordgreen, T., Heggelund, J., & Teig, I. L. (2026) · Frontiers in Psychology · doi:10.3389/fpsyg.2026.1924186
Settingspezifische Psychotherapie
Rief, W., Schramm, E., & Strauss, B. M. (2026) · Elsevier eBooks · doi:10.1016/b978-3-437-21352-6.00037-7
Metadata
- Authors
- Ebert, D. D., Donkin, L., Andersson, G., Andrews, G., Berger, T., Carlbring, P., Rozenthal, A., Choi, I., Laferton, J. A. C., Johansson, R., Kleiboer, A., Lange, A., Lehr, D., Reins, J. A., Funk, B., Newby, J., Perini, S., Riper, H., Ruwaard, J., Sheeber, L., Snoek, F. J., Titov, N., Ünlü Ince, B., van Bastelaar, K., Vernmark, K., van Straten, A., Warmerdam, L., Salsman, N., & Cuijpers, P.
- Affiliations
- Friedrich-Alexander-Universität Erlangen-Nürnberg (DE)
- The University of Sydney (AU)
- Linköping University (SE)
- UNSW Sydney (AU)
- University of Bern (CH)
- Stockholm University (SE)
- Psychologische Hochschule Berlin (DE)
- Vrije Universiteit Amsterdam (NL)
- University of Amsterdam (NL)
- Leuphana University of Lüneburg (DE)
- Macquarie University (AU)
- Oregon Research Institute (US)
- Amsterdam UMC Location University of Amsterdam (NL)
- Xavier University (US)
- Corresponding author
- Ebert, D. D.
- ORCID
- Venue
- Psychological Medicine
- Publisher
- Cambridge University Press (CUP)
- Published
- 2016-09-20
- Volume
- 46
- Issue
- 13
- Pages
- 2679-2693
- ISSN
- 0033-2917 (ISSN-L)
- 1469-8978
- PMC
- PMC5560500
- OpenAlex
- W2522560600
- Cited by
- 154
- References
- 84
- Citations by year
- 2026: 6 · 2025: 6 · 2024: 9 · 2023: 23 · 2022: 14 · 2021: 17 · 2020: 21 · 2019: 23 · 2018: 21 · 2017: 12 · 2016: 2
- FWCI
- 3.11
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Psychological Medicine (publishedVersion)
- PubMed (publishedVersion)
- UvA-DARE (University of Amsterdam) (publishedVersion)
- Pure Amsterdam UMC (publishedVersion, other-oa)
- Amsterdam UMC (VU Amsterdam) - Institutional Repository (publishedVersion)
- PubMed Central (acceptedVersion)
- Data Archiving and Networked Services (DANS) (submittedVersion)
- Bern Open Repository and Information System (University of Bern) (submittedVersion, other-oa)
- Multilingual Matters (Channel View Publications) (submittedVersion, other-oa)
- VU Research Portal (submittedVersion)
- Funders
- European Commission (2007DE161PR001, 603098, CCI 2007DE161PR001)
- European Regional Development Fund (CCI 2007DE161PR001, 2007DE161PR001)
- Eunice Kennedy Shriver National Institute of Child Health and Human Development (R01HD081362)
- H2020 European Research Council
- Topics
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Anxiety, Depression, Psychometrics, Treatment, Cognitive Processes
- Health Sciences › Medicine › Psychiatry and Mental health › Mental Health Treatment and Access
- Keywords
- depression, symptom deterioration, educational attainment, treatment moderators, risk-benefit ratio, reliable change index, treatment response
- MeSH terms
- Major Depressive Disorder, Humans, Self Care, Randomized Controlled Trials as Topic, Outcome Assessment, Health Care, Internet
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
