For better or worse: An individual patient data meta-analysis of deterioration among participants receiving Internet-based cognitive behavior therapy.
The DOI matches its Crossref record; 118 of the 118 references it cites were found in a registry or an index.
Abstract
OBJECTIVE: Psychological treatments can relieve mental distress and improve well-being, and the dissemination of evidence-based methods can help patients gain access to the right type of aid. Meanwhile, Internet-based cognitive-behavioral therapy (ICBT) has shown promising results for many psychiatric disorders. However, research on the potential for negative effects of psychological treatments has been lacking. METHOD: An individual patient data meta-analysis of 29 clinical trials of ICBT (N = 2,866) was performed using the Reliable Change Index for each primary outcome measures to distinguish deterioration rates among patients in treatment and control conditions. Statistical analyses of predictors were conducted using generalized linear mixed models. Missing data was handled by multiple imputation. RESULTS: Deterioration rates were 122 (5.8%) in treatment and 130 (17.4%) in control conditions. Relative to receiving treatment, patients in a control condition had higher odds of deteriorating, odds ratios (ORs) = 3.10, 95% confidence interval (CI) [2.21, 4.34]. Clinical severity at pretreatment was related to lower odds, OR = 0.62, 95% CI [0.50, 0.77], and OR = 0.51, 95% CI [0.51, 0.80], for treatment and control conditions. In terms of sociodemographic variables, being in a relationship, OR = 0.58, 95% CI [0.35, 0.95], having at least a university degree, OR = 0.54, 95% CI [0.33, 0.88], and being older, OR = 0.78, 95% CI, [0.62, 0.98], were also associated with lower odds of deterioration, but only for patients assigned to a treatment condition. CONCLUSION: Deterioration among patients receiving ICBT or being in a control condition can occur and should be monitored by researchers to reverse and prevent a negative treatment trend. (PsycINFO Database Record
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“a significant minority of people do experience negative effects”
From Internet-delivered psychological treatments: from innovation to implementation (2019) · cites this paper as [79]
In the citing paper
“and lower than for control conditions.”
From Internet-delivered psychological treatments: from innovation to implementation (2019) · cites this paper as [79]
In the citing paper
“Being in a relationship, being older and having at least a university degree were associated with lower odds of deteriora tion, but only in patients assigned to the treatment condition.”
From Internet-delivered psychological treatments: from innovation to implementation (2019) · cites this paper as [79]
In the citing paper
“a patientlevel metaanalysis 79 , which includ ed 2,866 patients from 29 clinical trials of ICBT.Using the Reliable Change Index, the deterioration rate was 5.8% in the treatment and 17.4% in the control conditions (odds ratio=3.10,95% CI: 2.21 to 4.34).”
From Internet-delivered psychological treatments: from innovation to implementation (2019) · cites this paper as [79]
In the citing paper
“Still, no patients in iACT reported any deterioration which compares favorably to the reported 5.8% of patients in iCBT.”
From Efficacy of internet-delivered acceptance and commitment therapy for severe health anxiety: results from a randomized, controlled trial. (2021) · cites this paper as Rozental et al., 2017
1 more claim about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Fitting Linear Mixed-Effects Models Using lme4
Bates, D., Mächler, M., Bolker, B., & Walker, S. (2015) · Journal of Statistical Software · doi:10.18637/jss.v067.i01 · Cited by 86,835
An inventory for measuring depression
BECK, A. T. (1961) · Archives of General Psychiatry · doi:10.1001/archpsyc.1961.01710120031004 · Cited by 38,032
A Brief Measure for Assessing Generalized Anxiety Disorder: The GAD-7
Spitzer, R. L., Kroenke, K., Williams, J. B. W., & Löwe, B. (2006) · Archives of Internal Medicine · doi:10.1001/archinte.166.10.1092 · Cited by 31,765
(1998) · The Journal of Clinical Psychiatry · Cited by 19,139
mice: Multivariate Imputation by Chained Equations in R
Buuren, S. V., & Groothuis-Oudshoorn, K. (2011) · Journal of Statistical Software · doi:10.18637/jss.v045.i03 · Cited by 13,870 · cited 1×
“T hi s ar tic le is in te nd ed so le ly fo r th e pe rs on al us e of th e in di vi du al us er an d is no t to be di ss em in at ed br oa dl y. tivariate Imputation by Chained Equations (Version 2.25; van Buuren & Groothuis-Oudshoorn, 2011).”
InfluentialJacobson, N. S., & Truax, P. (1991) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.59.1.12 · Cited by 7,770
Rosen, R. C., Riley, A., Wagner, G., Osterloh, I. H., Kirkpatrick, J., & Mishra, A. (1997) · Urology · doi:10.1016/s0090-4295(97)00238-0 · Cited by 5,849 · cited 1×
“…Questionnaire (nine items) r .94 2 weeks Patient Zuithoff et al. (2010) International Index of Erectile Functioning (five items)a r .84 4 weeks Patient Rosen et al. (1997) Beck Depression Inventory r .77b Normal Beck and Steer (1996) Impact of Event Scale–Revised r .89–.94c M .92 6 months…”
BackgroundThe development of a Clinician-Administered PTSD Scale
Blake, D. D., Weathers, F. W., Nagy, L. M., Kaloupek, D. G., Gusman, F. D., Charney, D. S., & Keane, T. M. (1995) · Journal of Traumatic Stress · doi:10.1002/jts.2490080106 · Cited by 5,024 · cited 4×
“, 1998) or a structured clinical interview for a specific psychiatric disorder, for example, Clinician-Administered PTSD Scale (Blake et al., 1995).”
BackgroundMethodInfluentialDiagnostic and Statistical Manual of Mental Disorders ( DSM ‐ IV ‐ TR )
Segal, D. L. (2010) · The Corsini Encyclopedia of Psychology · doi:10.1002/9780470479216.corpsy0271 · Cited by 4,666
The Efficacy of Cognitive Behavioral Therapy: A Review of Meta-analyses
Hofmann, S. G., Asnaani, A., Vonk, I. J. J., Sawyer, A. T., & Fang, A. (2012) · Cognitive Therapy and Research · doi:10.1007/s10608-012-9476-1 · Cited by 3,445
Cited by
Items 101–137 of 137
Dear, B. F., Heriseanu, A. I., Johnson, B., Sander, D., Farmer, K., & Titov, N. (2024) · Internet Interventions · doi:10.1016/j.invent.2024.100791 · Cited by 4
Bloch‐Elkouby, S., Eubanks, C. F., Knopf, L., Gorman, B. S., & Muran, J. C. (2019) · Frontiers in Psychology · doi:10.3389/fpsyg.2019.01180 · Cited by 4
Esfandiari, N., Mazaheri, M. A., Sadeghi‐Firoozabadi, V., & Cheraghi, M. (2020) · doi:10.2196/preprints.18275 · Cited by 4
Patient experiences of internet-based enhanced cognitive behavior therapy for eating disorders
Wiberg, A.-C., Ghaderi, A., Parling, T., Jansson, M., & Welch, E. (2025) · Internet Interventions · doi:10.1016/j.invent.2025.100801 · Cited by 4
Frye, N., O’Neal, C. W., & Lucier‐Greer, M. (2025) · Family and Consumer Sciences Research Journal · doi:10.1002/fcsr.70031 · Cited by 3
Digitale Ansätze bei Depression und Angst
Landgrebe, M., & Zwanzger, P. (2023) · InFo Neurologie + Psychiatrie · doi:10.1007/s15005-022-3122-6 · Cited by 3
Etzelmueller, A., Heber, E., Horvath, H., Radkovsky, A., Lehr, D., & Ebert, D. D. (2024) · Journal of Medical Internet Research · doi:10.2196/42976 · Cited by 4
Clients' narratives of healing and harm in psychotherapy: A qualitative method
Tavallaii, V., Najarpourian, S., & Rastegar, Y. (2024) · Counselling and Psychotherapy Research · doi:10.1002/capr.12855 · Cited by 3
Ottergård, M.-L. H., Pretzmann, L., Lundgren, T., McCracken, L. M., Buhrman, M., Molander, P., & Rozental, A. (2025) · Journal of Contextual Behavioral Science · doi:10.1016/j.jcbs.2025.100914 · Cited by 2
Self-citationFenski, F., Heinrich, M., Schaeuffele, C., Zagorscak, P., Knaevelsrud, C., & Boettcher, J. (2025) · Cognitive Behaviour Therapy · doi:10.1080/16506073.2025.2565674 · Cited by 2
Self-citationFrom Detection to Intervention Psychological Aspects of Online Hearing Rehabilitation
Molander, P. (2018) · Studies from the Swedish Institute for Disability Research · doi:10.3384/diss.diva-152429 · Cited by 2
Schladitz, K., Luppa, M., Riedel-Heller, S. G., & Löbner, M. (2023) · BMJ Open · doi:10.1136/bmjopen-2022-067930 · Cited by 3
Larionov, K., Petrova, E., Demirbuga, N., Werth, O., Breitner, M. H., Gebhardt, P., Caldarone, F., Duncker, D., Westhoff-Bleck, M., Sensenhauser, A., et al. (2023) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2023.1138475 · Cited by 1
Berger, T., Friedl, N., Weisel, K. K., Baumeister, H., & Ebert, D. D. (2023) · Springer eBooks · doi:10.1007/978-3-662-65816-1_4 · Cited by 1
Baumeister, A., Schuurmans, L., Bruhns, A., & Moritz, S. (2025) · JMIR Mental Health · doi:10.2196/71274 · Cited by 2
Dyvinger, P., Radhe, N., & Rozental, A. (2025) · Psychotherapy Research · doi:10.1080/10503307.2025.2592967 · Cited by 1
Self-citationPhilips, B., Mechler, J., Uckelstam, C.-J., Andersson, G., Carlbring, P., Edbrooke-Childs, J. H., Falkenström, F., Johansson, R., Lilliengren, P., Bergsten, K. L., et al. (2026) · Internet Interventions · doi:10.1016/j.invent.2026.100923 · Cited by 1
Self-citationSalgado, J., Gomes, M., Csabai, M., Daele, T. V., Doyle, F., Eimontas, J., Elster, R. N., Gosar, D., Haddouk, L., Karekla, M., et al. (2026) · European Psychologist · doi:10.1027/1016-9040/a000588 · Cited by 1
Internet-based psychotherapies
Andersson, G. (2021) · Elsevier eBooks · doi:10.1016/b978-0-12-822201-0.00008-3 · Cited by 1
Self-citationTemple, J. (2019) · University of Liverpool · doi:10.17638/03033174
Robles, V. A. G. (2019) · Tesis Doctorals en Xarxa (Consorci de Serveis Universitaris de Catalunya) · doi:10.6035/14109.2019.233592
REACHING PEOPLE IN NEED OF MENTAL HEALTH SERVICES THROUGH NOVEL MODELS OF INTERVENTION DELIVERY
Kazdin, A. E. (2019) · ACTA PSICOLÓGICA PERUANA · Cited by 2
Behandlungsschwierigkeiten bei geleiteter Online-Therapie
Bär, J., Ziehn, P., Ewert-Altenhain, D., Seidl, L., Schaeuffele, C., & Boettcher, J. (2021) · Psychotherapeut · doi:10.1007/s00278-021-00522-5 · Cited by 1
Self-citationNakao, S., Nakagawa, A., Oguchi, Y., Mitsuda, D., Kato, N., Nakagawa, Y., Tamura, N., Kudo, Y., Abe, T., Hiyama, M., et al. (2018) · doi:10.2196/preprints.10743
Negative effects of low intensity interventions in children and young people
Rozental, A. (2022) · Oxford University Press eBooks · doi:10.1093/med-psych/9780198867791.003.0006
Self-citationLundorff, M., Damholdt, M. F., Nissen, E. R., & Zachariae, B. (2021) · Psyke & Logos · doi:10.7146/pl.v42i1.128774
Böttche, M., Knaevelsrud, C., & Niemeyer, H. (2023) · Springer eBooks · doi:10.1007/978-3-662-65816-1_6
Weisel, K. K., Baumeister, H., & Ebert, D. D. (2023) · Springer eBooks · doi:10.1007/978-3-662-65816-1_24
Moya-Tamayo, J. A. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4950493
Rolvien, L., Sönmez, D., Schuurmans, L., Borgmann, L., Schmüser, A., Moritz, S., & Baumeister, A. (2025) · Internet Interventions · doi:10.1016/j.invent.2025.100893
Haubrock, L. S., Azevedo, V., Hillert, J., Briken, P., Letourneau, E. J., Rahm, C., Seto, M. C., Fix, R. L., Gomes, H. S., Joleby, M., et al. (2026) · Criminal Justice and Behavior · doi:10.1177/00938548251407643
Evidence of Internet- and Mobile-Based Interventions for Mental Disorders
Löchner, J., Schoenenberg, K., & Zarski, A. (2026) · Springer eBooks · doi:10.1007/978-3-032-08980-9_3
Heltne, A., Kenter, R. M. F., Gulseth, R., & Nordgreen, T. (2026) · Internet Interventions · doi:10.1016/j.invent.2026.100922
Brähmer, S. F., Iffland, B., Bertino, M., Drießen, M., Boettcher, J., & Steuwe, C. (2026) · BMC Psychology · doi:10.1186/s40359-026-04738-5
Self-citationMechler, J., Lindqvist, K., Falkenström, F., Carlbring, P., Lilliengren, P., Andersson, G., & Philips, B. (2026) · Psychotherapy Research · doi:10.1080/10503307.2026.2686693 · Cited by 1
Self-citationMolander, P., Hesser, H., & Rozental, A. (2026) · Journal of Pain · doi:10.1016/j.jpain.2026.106423
Self-citationMapping negative experiences in psychotherapy: A network analysis
Bobei, T., Flückiger, C., & Podina, I. R. (2026) · Psychotherapy Research · doi:10.1080/10503307.2026.2743645
Metadata
- Authors
- Rozental, A., Magnusson, K., Boettcher, J., Andersson, G., & Carlbring, P.
- Affiliations
- Karolinska Institutet (SE)
- Freie Universität Berlin (DE)
- Venue
- Journal of Consulting and Clinical Psychology
- Published
- 2017-02
- Volume
- 85
- Issue
- 2
- Pages
- 160-177
- ISSN
- 0022-006X (ISSN-L)
- 1939-2117
- OpenAlex
- W2539211266
- Semantic Scholar
- 7bb2e24de6a8e5cd7f8dceabb09f3c0ac9c493b7
- Cited by
- 137
- References
- 118
- Citations by year
- 2026: 12 · 2025: 16 · 2024: 14 · 2023: 21 · 2022: 7 · 2021: 9 · 2020: 15 · 2019: 19 · 2018: 13 · 2017: 11
- FWCI
- 2.31
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of Consulting and Clinical Psychology (publishedVersion)
- PubMed (publishedVersion)
- Funders
- Swedish Research Council for Health, Working Life, and Welfare (FORTE 2013-1107)
- Topics
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Anxiety, Depression, Psychometrics, Treatment, Cognitive Processes
- Social Sciences › Psychology › Clinical Psychology › Psychotherapy Techniques and Applications
- Keywords
- internet-based cognitive behavioral therapy, treatment deterioration, reliable change index, mental illness, clinical severity, sociodemographic predictors, medication adherence, online psychological intervention
- MeSH terms
- Adult, Mental Disorders, Female, Humans, Male, Severity of Illness Index, Cognitive Behavioral Therapy, Treatment Failure, Telemedicine, Internet
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.