For better or worse: An individual patient data meta-analysis of deterioration among participants receiving Internet-based cognitive behavior therapy.
The DOI matches its Crossref record; 118 of the 118 references it cites were found in a registry or an index.
Abstract
OBJECTIVE: Psychological treatments can relieve mental distress and improve well-being, and the dissemination of evidence-based methods can help patients gain access to the right type of aid. Meanwhile, Internet-based cognitive-behavioral therapy (ICBT) has shown promising results for many psychiatric disorders. However, research on the potential for negative effects of psychological treatments has been lacking. METHOD: An individual patient data meta-analysis of 29 clinical trials of ICBT (N = 2,866) was performed using the Reliable Change Index for each primary outcome measures to distinguish deterioration rates among patients in treatment and control conditions. Statistical analyses of predictors were conducted using generalized linear mixed models. Missing data was handled by multiple imputation. RESULTS: Deterioration rates were 122 (5.8%) in treatment and 130 (17.4%) in control conditions. Relative to receiving treatment, patients in a control condition had higher odds of deteriorating, odds ratios (ORs) = 3.10, 95% confidence interval (CI) [2.21, 4.34]. Clinical severity at pretreatment was related to lower odds, OR = 0.62, 95% CI [0.50, 0.77], and OR = 0.51, 95% CI [0.51, 0.80], for treatment and control conditions. In terms of sociodemographic variables, being in a relationship, OR = 0.58, 95% CI [0.35, 0.95], having at least a university degree, OR = 0.54, 95% CI [0.33, 0.88], and being older, OR = 0.78, 95% CI, [0.62, 0.98], were also associated with lower odds of deterioration, but only for patients assigned to a treatment condition. CONCLUSION: Deterioration among patients receiving ICBT or being in a control condition can occur and should be monitored by researchers to reverse and prevent a negative treatment trend. (PsycINFO Database Record
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“a significant minority of people do experience negative effects”
From Internet-delivered psychological treatments: from innovation to implementation (2019) · cites this paper as [79]
In the citing paper
“and lower than for control conditions.”
From Internet-delivered psychological treatments: from innovation to implementation (2019) · cites this paper as [79]
In the citing paper
“Being in a relationship, being older and having at least a university degree were associated with lower odds of deteriora tion, but only in patients assigned to the treatment condition.”
From Internet-delivered psychological treatments: from innovation to implementation (2019) · cites this paper as [79]
In the citing paper
“a patientlevel metaanalysis 79 , which includ ed 2,866 patients from 29 clinical trials of ICBT.Using the Reliable Change Index, the deterioration rate was 5.8% in the treatment and 17.4% in the control conditions (odds ratio=3.10,95% CI: 2.21 to 4.34).”
From Internet-delivered psychological treatments: from innovation to implementation (2019) · cites this paper as [79]
In the citing paper
“Still, no patients in iACT reported any deterioration which compares favorably to the reported 5.8% of patients in iCBT.”
From Efficacy of internet-delivered acceptance and commitment therapy for severe health anxiety: results from a randomized, controlled trial. (2021) · cites this paper as Rozental et al., 2017
1 more claim about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Fitting Linear Mixed-Effects Models Using lme4
Bates, D., Mächler, M., Bolker, B., & Walker, S. (2015) · Journal of Statistical Software · doi:10.18637/jss.v067.i01 · Cited by 86,835
An inventory for measuring depression
BECK, A. T. (1961) · Archives of General Psychiatry · doi:10.1001/archpsyc.1961.01710120031004 · Cited by 38,032
A Brief Measure for Assessing Generalized Anxiety Disorder: The GAD-7
Spitzer, R. L., Kroenke, K., Williams, J. B. W., & Löwe, B. (2006) · Archives of Internal Medicine · doi:10.1001/archinte.166.10.1092 · Cited by 31,765
(1998) · The Journal of Clinical Psychiatry · Cited by 19,139
mice: Multivariate Imputation by Chained Equations in R
Buuren, S. V., & Groothuis-Oudshoorn, K. (2011) · Journal of Statistical Software · doi:10.18637/jss.v045.i03 · Cited by 13,870 · cited 1×
“T hi s ar tic le is in te nd ed so le ly fo r th e pe rs on al us e of th e in di vi du al us er an d is no t to be di ss em in at ed br oa dl y. tivariate Imputation by Chained Equations (Version 2.25; van Buuren & Groothuis-Oudshoorn, 2011).”
InfluentialJacobson, N. S., & Truax, P. (1991) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.59.1.12 · Cited by 7,770
Rosen, R. C., Riley, A., Wagner, G., Osterloh, I. H., Kirkpatrick, J., & Mishra, A. (1997) · Urology · doi:10.1016/s0090-4295(97)00238-0 · Cited by 5,849 · cited 1×
“…Questionnaire (nine items) r .94 2 weeks Patient Zuithoff et al. (2010) International Index of Erectile Functioning (five items)a r .84 4 weeks Patient Rosen et al. (1997) Beck Depression Inventory r .77b Normal Beck and Steer (1996) Impact of Event Scale–Revised r .89–.94c M .92 6 months…”
BackgroundThe development of a Clinician-Administered PTSD Scale
Blake, D. D., Weathers, F. W., Nagy, L. M., Kaloupek, D. G., Gusman, F. D., Charney, D. S., & Keane, T. M. (1995) · Journal of Traumatic Stress · doi:10.1002/jts.2490080106 · Cited by 5,024 · cited 4×
“, 1998) or a structured clinical interview for a specific psychiatric disorder, for example, Clinician-Administered PTSD Scale (Blake et al., 1995).”
BackgroundMethodInfluentialDiagnostic and Statistical Manual of Mental Disorders ( DSM ‐ IV ‐ TR )
Segal, D. L. (2010) · The Corsini Encyclopedia of Psychology · doi:10.1002/9780470479216.corpsy0271 · Cited by 4,666
The Efficacy of Cognitive Behavioral Therapy: A Review of Meta-analyses
Hofmann, S. G., Asnaani, A., Vonk, I. J. J., Sawyer, A. T., & Fang, A. (2012) · Cognitive Therapy and Research · doi:10.1007/s10608-012-9476-1 · Cited by 3,445
Structured clinical interview for DSM-IV axis I disorders : SCID-I : clinical version : scoresheet
First, M. B., Spitzer, R. L., Gibbon, M., & Williams, J. B. W. (1997) · American Psychiatric Press eBooks · Cited by 3,101
The clinical global impressions scale: applying a research tool in clinical practice.
Busner, J., & Targum, S. D. (2007) · PubMed · Cited by 2,759
Meta-analysis of individual participant data: rationale, conduct, and reporting
Riley, R. D., Lambert, P. C., & Abo-Zaid, G. (2010) · BMJ · doi:10.1136/bmj.c221 · Cited by 1,701
Jacobson, N. S., Follette, W. C., & Revenstorf, D. (1984) · Behavior Therapy · doi:10.1016/s0005-7894(84)80002-7 · Cited by 1,294 · cited 1×
“Jacobson, Follette, and Revenstorf (1984) were among the first to recognize these concerns, “There is no obvious counterpart to our distributional cutoff for clinical significance in the assessment of deterioration rates” (p. 350), suggesting that the investigation of deterioration is limited to…”
BackgroundDavydov, D. M., Stewart, R., Ritchie, K., & Chaudieu, I. (2010) · Clinical Psychology Review · doi:10.1016/j.cpr.2010.03.003 · Cited by 1,189
Advantages and limitations of Internet-based interventions for common mental disorders
Andersson, G., & Titov, N. (2014) · World Psychiatry · doi:10.1002/wps.20083 · Cited by 1,160
Self-citationAdherence in Internet Interventions for Anxiety and Depression
Christensen, H., Griffiths, K. M., & Farrer, L. (2009) · Journal of Medical Internet Research · doi:10.2196/jmir.1194 · Cited by 1,133 · cited 1×
“This runs contrary to the findings of Christensen et al. (2009), stating that clinical severity at pretreatment was a predictor of dropout, and opposes the idea that distress may predict deterioration and, in turn, increase the risk of dropping out.”
ResultPremature discontinuation in adult psychotherapy: A meta-analysis
Swift, J. K., & Greenberg, R. P. (2012) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0028226 · Cited by 978 · cited 1×
“…previous findings give some credence to these assumptions, indicating that comorbidity, less education, and lower socioeconomic status are all factors related to higher dropout rates in face-to-face psychotherapy (Cooper & Conklin, 2015; Sharf, Primavera, & Diener, 2010; Swift & Greenberg, 2012).”
ResultPsychological Treatments That Cause Harm
Lilienfeld, S. O. (2007) · Perspectives on Psychological Science · doi:10.1111/j.1745-6916.2007.00029.x · Cited by 959
McHugh, R. K., & Barlow, D. H. (2010) · American Psychologist · doi:10.1037/a0018121 · Cited by 909 · cited 1×
“In addition, great efforts have been made to improve the access to evidence-based methods, such as, cognitive– behavioral therapy (CBT), in an effort to disseminate effective psychological treatments to patients suffering from a variety of psychiatric disorders (McHugh & Barlow, 2010).”
BackgroundCuijpers, P., Donker, T., van Straten, A., Li, J., & Andersson, G. (2010) · Psychological Medicine · doi:10.1017/s0033291710000772 · Cited by 832
Self-citationThe psychotherapy dose-response effect and its implications for treatment delivery services.
Hansen, N. B., Lambert, M. J., & Forman, E. M. (2002) · Clinical Psychology: Science and Practice · doi:10.1093/clipsy.9.3.329 · Cited by 783
Psychometric description of some specific-fear questionnaires
Klorman, R., Weerts, T. C., Hastings, J. E., Melamed, B. G., & Lang, P. J. (1974) · Behavior Therapy · doi:10.1016/s0005-7894(74)80008-0 · Cited by 765
Impact of Event Scale: psychometric properties
Sundin, E. C., & Horowitz, M. J. (2002) · British Journal of Psychiatry · doi:10.1192/bjp.180.3.205 · Cited by 685
Stewart, L. A., & Tierney, J. F. (2002) · Evaluation & the Health Professions · doi:10.1177/0163278702025001006 · Cited by 571
CORE: Clinical Outcomes in Routine Evaluation
Evans, C., Mellor-Clark, J., Margison, F., Barkham, M., Audin, K., Connell, J., & McGrath, G. (2000) · Journal of Mental Health · doi:10.1080/713680250 · Cited by 560 · cited 2×
“Likewise, using data from primary care, Young (2006) discovered that, although most patients remain stable over time or even improve, 3.5% deteriorated on the Clinical Outcomes in Routine Evaluation (Evans et al., 2000) during a mean wait of 29.4 days.”
MethodInfluentialSimmonds, M. C., Higginsa, J. P. T., Stewartb, L. A., Tierneyb, J. F., Clarke, M. J., & Thompson, S. G. (2005) · Clinical Trials · doi:10.1191/1740774505cn087oa · Cited by 555
Furukawa, T. A., Noma, H., Caldwell, D. M., Honyashiki, M., Shinohara, K., Imai, H., Chen, P., Hunot, V., & Churchill, R. (2014) · Acta Psychiatrica Scandinavica · doi:10.1111/acps.12275 · Cited by 521 · cited 1×
“Furukawa et al. (2014), conducting a network meta-analysis to compare different control conditions to CBT for major depression, found far larger between group effect sizes when using waitlist than both no treatment and psychological placebo, suggesting that this could be caused by patients…”
BackgroundEvans, C., Margison, F., & Barkham, M. (1998) · Evidence Based Mental Health · doi:10.1136/ebmh.1.3.70 · Cited by 470
Lambert, M. (2007) · Psychotherapy Research · doi:10.1080/10503300601032506 · Cited by 461 · cited 1×
“An average deterioration rate of 5–10% is often referred to as a reasonable estimate in face-to-face settings (Lambert, 2007).”
BackgroundNegative effects from psychological treatments: a perspective
Barlow, D. H. (2010) · American Psychologist · doi:10.1037/a0015643 · Cited by 426 · cited 3×
“In addition, great efforts have been made to improve the access to evidence-based methods, such as, cognitive– behavioral therapy (CBT), in an effort to disseminate effective psychological treatments to patients suffering from a variety of psychiatric disorders (McHugh & Barlow, 2010).”
BackgroundKaryotaki, E., Kleiboer, A., Smit, F., Turner, D. T., Pastor, A. M., Andersson, G., Berger, T., Botella, C., Breton, J. M., Carlbring, P., et al. (2015) · Psychological Medicine · doi:10.1017/s0033291715000665 · Cited by 408 · cited 3×
“…gender, low educational level, and clinical severity at pretreatment were also associated with increased dropout rates in psychological treatments via the Internet, while older age was linked to less dropout (Christensen, Griffiths, & Farrer, 2009; Karyotaki et al., 2015; Waller & Gilbody, 2009).”
BackgroundResultSelf-citationWise, E. A. (2004) · Journal of Personality Assessment · doi:10.1207/s15327752jpa8201_10 · Cited by 399 · cited 2×
“Wise (2004), therefore, proposed several reliable change indexes to discriminate between different confidence levels related to deterioration, z 1.28 for moderate deterioration (p .10), as well as z 0.84 for mild deterioration (p .20), which could reveal negative effects that might otherwise have…”
MethodInfluentialLinden, M. (2013) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.1765 · Cited by 397 · cited 1×
“…problems and enable the monitoring of negative effects other than deterioration have recently been put forward, including both therapist checklists and self-report measures distributed to the patient (cf. Linden, 2013), but their use is currently limited and their validity is not yet established.”
BackgroundWaller, R., & Gilbody, S. (2009) · Psychological Medicine · doi:10.1017/s0033291708004224 · Cited by 393 · cited 2×
“Educational level has also been found to improve adherence during ICBT (Waller & Gilbody, 2009), possibly by making the treatment content easier to comprehend.”
BackgroundAndersson, G., Carlbring, P., Holmström, A., Sparthan, E., Furmark, T., Nilsson-Ihrfelt, E., Buhrman, M., & Ekselius, L. (2006) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.74.4.677 · Cited by 382
Self-citationWhipple, J. L., Lambert, M. J., Vermeersch, D. A., Smart, D. W., Nielsen, S. L., & Hawkins, E. J. (2003) · Journal of Counseling Psychology · doi:10.1037//0022-0167.50.1.59 · Cited by 374
Treatment of panic disorder: live therapy vs. self-help via the Internet
Carlbring, P., Nilsson-Ihrfelt, E., Waara, J., Kollenstam, C., Buhrman, M., Kaldo, V., Söderberg, M., Ekselius, L., & Andersson, G. (2005) · Behaviour Research and Therapy · doi:10.1016/j.brat.2004.10.002 · Cited by 372
Self-citationConsensus statement on defining and measuring negative effects of internet interventions
Rozental, A., Andersson, G., Boettcher, J., Ebert, D. D., Cuijpers, P., Knaevelsrud, C., Ljótsson, B., Kaldo, V., Titov, N., & Carlbring, P. (2014) · Internet Interventions · doi:10.1016/j.invent.2014.02.001 · Cited by 371 · cited 2×
“…exist a variation in deterioration rates between sites that examine the efficacy of ICBT, which should be investigated further, for instance, by having researchers report deterioration rates at a more regular basis when providing information about the treatment outcome (Rozental et al., 2014).”
BackgroundSelf-citationDropout and therapeutic alliance: A meta-analysis of adult individual psychotherapy.
Sharf, J., Primavera, L. H., & Diener, M. J. (2010) · Psychotherapy: Theory, Research, Practice, Training · doi:10.1037/a0021175 · Cited by 352
Get real in individual participant data (IPD) meta‐analysis: a review of the methodology
Debray, T. P. A., Moons, K. G. M., van Valkenhoef, G., Efthimiou, O., Hummel, N., Groenwold, R. H. H., Reitsma, J. B., & on behalf of the GetReal methods review group (2015) · Research Synthesis Methods · doi:10.1002/jrsm.1160 · Cited by 348 · cited 10×
“Second, data used in the IPDM were comprised of a wide range of patients, treatment modalities, and psychiatric disorders, which, in some respect, can be considered quite heterogeneous in nature and being suitable for the purpose of the current study.”
BackgroundMethodInfluentialBower, P., Kontopantelis, E., Sutton, A., Kendrick, T., Richards, D. A., Gilbody, S., Knowles, S., Cuijpers, P., Andersson, G., Christensen, H., et al. (2013) · BMJ · doi:10.1136/bmj.f540 · Cited by 341
Self-citationArnberg, F. K., Linton, S. J., Hultcrantz, M., Heintz, E., & Jonsson, U. (2014) · PLoS ONE · doi:10.1371/journal.pone.0098118 · Cited by 330
How would we know if psychotherapy were harmful?
Dimidjian, S., & Hollon, S. D. (2010) · American Psychologist · doi:10.1037/a0017299 · Cited by 314 · cited 1×
“…decreased interpersonal functioning, dependency, and lowered self-esteem have all been put forward as detrimental effects of treatment, and could result in a better understanding of the mechanisms that may be responsible for negative effects if further scrutinized (Dimidjian & Hollon, 2010).”
BackgroundCarlbring, P., Gunnarsdóttir, M., Hedensjö, L., Andersson, G., Ekselius, L., & Furmark, T. (2007) · British Journal of Psychiatry · doi:10.1192/bjp.bp.105.020107 · Cited by 293
Self-citationStawski, R. S., Sliwinski, M. J., Almeida, D. M., & Smyth, J. M. (2008) · Psychology and Aging · doi:10.1037/0882-7974.23.1.52 · Cited by 289
Outcome in psychotherapy: The past and important advances.
Lambert, M. J. (2013) · Psychotherapy · doi:10.1037/a0030682 · Cited by 286 · cited 2×
“On the other hand, it does merit some caution in relation to the results presented, as prior research implies that deterioration rates differ between age groups and psychiatric disorders (Lambert, 2013), possibly underestimating the number of patients that deteriorate along certain features.”
BackgroundResultStrupp, H. H., & Hadley, S. W. (1977) · American Psychologist · doi:10.1037/0003-066x.32.3.187 · Cited by 286
Clinically significant change: Jacobson and Truax (1991) revisited.
Speer, D. C. (1992) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.60.3.402 · Cited by 270
Cooper, A. A., & Conklin, L. R. (2015) · Clinical Psychology Review · doi:10.1016/j.cpr.2015.05.001 · Cited by 264 · cited 1×
“…previous findings give some credence to these assumptions, indicating that comorbidity, less education, and lower socioeconomic status are all factors related to higher dropout rates in face-to-face psychotherapy (Cooper & Conklin, 2015; Sharf, Primavera, & Diener, 2010; Swift & Greenberg, 2012).”
ResultClinical Significance Methods: A Comparison of Statistical Techniques
Bauer, S., Lambert, M. J., & Nielsen, S. L. (2004) · Journal of Personality Assessment · doi:10.1207/s15327752jpa8201_11 · Cited by 257
Some implications of psychotherapy research for therapeutic practice.
Bergin, A. E. (1966) · Journal of Abnormal Psychology · doi:10.1037/h0023577 · Cited by 257
Scott, K. M., Wells, J. E., Angermeyer, M., Brugha, T. S., Bromet, E., Demyttenaere, K., de Girolamo, G., Gureje, O., Haro, J. M., Jin, R., et al. (2010) · Psychological Medicine · doi:10.1017/s0033291709991942 · Cited by 256
Guided and unguided self-help for social anxiety disorder: randomised controlled trial
Furmark, T., Carlbring, P., Hedman, E., Sonnenstein, A., Clevberger, P., Bohman, B., Eriksson, A., Hållén, A., Frykman, M., Holmström, A., et al. (2009) · British Journal of Psychiatry · doi:10.1192/bjp.bp.108.060996 · Cited by 256
Self-citationInternet-based mindfulness treatment for anxiety disorders: a randomized controlled trial
Boettcher, J., Åström, V., Påhlsson, D., Schenström, O., Andersson, G., & Carlbring, P. (2014) · Behavior Therapy · doi:10.1016/j.beth.2013.11.003 · Cited by 245
Self-citationTraining implications of harmful effects of psychological treatments.
Castonguay, L. G., Boswell, J. F., Constantino, M. J., Goldfried, M. R., & Hill, C. E. (2010) · American Psychologist · doi:10.1037/a0017330 · Cited by 243
Stewart, G. B., Altman, D. G., Askie, L. M., Duley, L., Simmonds, M. C., & Stewart, L. A. (2012) · PLoS ONE · doi:10.1371/journal.pone.0046042 · Cited by 232
Individually-tailored, internet-based treatment for anxiety disorders: a randomized controlled trial
Carlbring, P., Maurin, L., Törngren, C., Linna, E., Eriksson, T., Sparthan, E., Strååt, M., Marquez von Hage, C., Bergman-Nordgren, L., & Andersson, G. (2011) · Behaviour Research and Therapy · doi:10.1016/j.brat.2010.10.002 · Cited by 227
Self-citationVernmark, K., Lenndin, J., Bjärehed, J., Carlsson, M., Karlsson, J., Öberg, J., Carlbring, P., Eriksson, T., & Andersson, G. (2010) · Behaviour Research and Therapy · doi:10.1016/j.brat.2010.01.005 · Cited by 226
Self-citationRozental, A., Kottorp, A., Boettcher, J., Andersson, G., & Carlbring, P. (2016) · PLOS ONE · doi:10.1371/journal.pone.0157503 · Cited by 223
Self-citationZuithoff, N. P., Vergouwe, Y., King, M., Nazareth, I., van Wezep, M. J., Moons, K. G., & Geerlings, M. I. (2010) · BMC Family Practice · doi:10.1186/1471-2296-11-98 · Cited by 218
Posternak, M. A., & Miller, I. (2001) · Journal of Affective Disorders · doi:10.1016/s0165-0327(00)00304-9 · Cited by 215 · cited 1×
“Similarly, a meta-analysis by Posternak and Miller (2001) of patients with major depression revealed a mean decrease in symptoms of 10– 15% during a time span of 2–20 weeks, arguing that up to one fifth of all waitlist patients might be achieving spontaneous remission without receiving any…”
BackgroundA comparison of two spider fear questionnaires
Muris, P., & Merckelbach, H. (1996) · Journal of Behavior Therapy and Experimental Psychiatry · doi:10.1016/s0005-7916(96)00022-5 · Cited by 215
An Experiment in the Prevention of Delinquency: The Cambridge-Somerville Youth Study
Shalloo, J. P., Powers, E., & Witmer, H. (1952) · The Journal of Criminal Law, Criminology, and Police Science · doi:10.2307/1139954 · Cited by 211
Individual Participant Data Meta-Analysis for a Binary Outcome: One-Stage or Two-Stage?
Debray, T. P. A., Moons, K. G. M., Abo-Zaid, G. M. A., Koffijberg, H., & Riley, R. D. (2013) · PLoS ONE · doi:10.1371/journal.pone.0060650 · Cited by 201
Fantino, B., & Moore, N. (2009) · BMC Psychiatry · doi:10.1186/1471-244x-9-26 · Cited by 200 · cited 1×
“…r .78 1 month Normal Klorman, Weerts, Hastings, Melamed, and Lang (1974) Montgomery–Åsberg Depression Rating Scale–Self-Report ICC .78 1 week Patient Fantino and Moore (2009) Spider Phobia Questionnaire r .94 3 weeks Normal Muris and Merckelbach (1996) The NORC Diagnostic Screen…”
Reliability of the Dyadic Adjustment Scale.
Carey, M. P., Spector, I. P., Lantinga, L. J., & Krauss, D. J. (1993) · Psychological Assessment · doi:10.1037//1040-3590.5.2.238 · Cited by 198
Assessing Clinical Significance: Proposed Extensions to Method
Tingey, R., Lambert, M., Burlingame, G., & Hansen, N. (1996) · Psychotherapy Research · doi:10.1080/10503309612331331638 · Cited by 197
Andersson, G., Hesser, H., Veilord, A., Svedling, L., Andersson, F., Sleman, O., Mauritzson, L., Sarkohi, A., Claesson, E., Zetterqvist, V., et al. (2013) · Journal of Affective Disorders · doi:10.1016/j.jad.2013.08.022 · Cited by 195
Self-citationJolani, S., Debray, T. P. A., Koffijberg, H., van Buuren, S., & Moons, K. G. M. (2015) · Statistics in Medicine · doi:10.1002/sim.6451 · Cited by 192
Rozental, A., Boettcher, J., Andersson, G., Schmidt, B., & Carlbring, P. (2015) · Cognitive Behaviour Therapy · doi:10.1080/16506073.2015.1008033 · Cited by 189 · cited 1×
“Rozental et al. (2015), in a qualitative content analysis of patients’ responses to open-ended questions distributed at posttreatment regarding negative effects in ICBT, found that certain patients experienced deterioration and novel symptoms in the beginning of the treatment period, related to…”
BackgroundSelf-citationAndersson, G., Paxling, B., Roch-Norlund, P., Östman, G., Norgren, A., Almlöv, J., Georén, L., Breitholtz, E., Dahlin, M., Cuijpers, P., et al. (2012) · Psychotherapy and Psychosomatics · doi:10.1159/000339371 · Cited by 183
Self-citationCarlbring, P., Hägglund, M., Luthström, A., Dahlin, M., Kadowaki, Å., Vernmark, K., & Andersson, G. (2013) · Journal of Affective Disorders · doi:10.1016/j.jad.2012.12.020 · Cited by 177
Self-citationJonsson, U., Alaie, I., Parling, T., & Arnberg, F. K. (2014) · Contemporary Clinical Trials · doi:10.1016/j.cct.2014.02.005 · Cited by 175
Test-Taking and the Stability of Adjustment Scales: Can We Assess Patient Deterioration?
Edwards, D. W., Yarvis, R. M., Mueller, D. P., Zingale, H. C., & Wagman, W. J. (1978) · Evaluation Quarterly · doi:10.1177/0193841x7800200206 · Cited by 172
Wallace, M. L., Frank, E., & Kraemer, H. C. (2013) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2013.1960 · Cited by 166
Vessey, J. T., & Howard, K. I. (1993) · Psychotherapy · doi:10.1037/0033-3204.30.4.546 · Cited by 154
Nordgren, L. B., Hedman, E., Etienne, J., Bodin, J., Kadowaki, Å., Eriksson, S., Lindkvist, E., Andersson, G., & Carlbring, P. (2014) · Behaviour Research and Therapy · doi:10.1016/j.brat.2014.05.007 · Cited by 145
Self-citationTillfors, M., Carlbring, P., Furmark, T., Lewenhaupt, S., Spak, M., Eriksson, A., Westling, B. E., & Andersson, G. (2008) · Depression and Anxiety · doi:10.1002/da.20416 · Cited by 132
Self-citationSharpe, J. P., & Gilbert, D. G. (1998) · Personality and Individual Differences · doi:10.1016/s0191-8869(97)00193-1 · Cited by 129
Are waiting-list control groups needed in future marital therapy outcome research?
Baucom, D. H., Hahlweg, K., & Kuschel, A. (2003) · Behavior Therapy · doi:10.1016/s0005-7894(03)80012-6 · Cited by 128
Dagöö, J., Asplund, R. P., Bsenko, H. A., Hjerling, S., Holmberg, A., Westh, S., Öberg, L., Ljótsson, B., Carlbring, P., Furmark, T., et al. (2014) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2014.02.003 · Cited by 121
Self-citationModeration and mediation of the effect of attention training in social anxiety disorder
Kuckertz, J. M., Gildebrant, E., Liliequist, B., Karlström, P., Väppling, C., Bodlund, O., Stenlund, T., Hofmann, S. G., Andersson, G., Amir, N., et al. (2014) · Behaviour Research and Therapy · doi:10.1016/j.brat.2013.12.003 · Cited by 117
Self-citationFrom Science to Practice: Meta-analyses Using Individual Patient Data Are Needed
Oxman, A. D. (1995) · JAMA · doi:10.1001/jama.1995.03530100085040 · Cited by 108
Buntrock, C., Ebert, D., Lehr, D., Riper, H., Smit, F., Cuijpers, P., & Berking, M. (2015) · Psychotherapy and Psychosomatics · doi:10.1159/000438673 · Cited by 102
Andersson, G., Waara, J., Jonsson, U., Malmaeus, F., Carlbring, P., & Öst, L. (2009) · Cognitive Behaviour Therapy · doi:10.1080/16506070902931326 · Cited by 101 · cited 10×
“(2011) Liebowitz Social Anxiety Scale–Self-Report r .93 8 weeks Normal Heeren et al. (2012) Panic Disorder Severity Scale–Self-Report .94 2 days Patient Lee, Kim, and Yu (2009) Patient Health Questionnaire (nine items) r .”
BackgroundMethodInfluentialSelf-citationIvarsson, D., Blom, M., Hesser, H., Carlbring, P., Enderby, P., Nordberg, R., & Andersson, G. (2014) · Internet Interventions · doi:10.1016/j.invent.2014.03.002 · Cited by 101
Self-citationTitov, N., Andrews, G., Kemp, A., & Robinson, E. (2010) · PLoS ONE · doi:10.1371/journal.pone.0010885 · Cited by 97
The effect of waiting: a meta-analysis of wait-list control groups in trials for tinnitus distress
Hesser, H., Weise, C., Rief, W., & Andersson, G. (2011) · Journal of Psychosomatic Research · doi:10.1016/j.jpsychores.2010.12.006 · Cited by 95
Self-citationBoisvert, C. M., & Faust, D. (2002) · American Journal of Psychotherapy · doi:10.1176/appi.psychotherapy.2002.56.2.244 · Cited by 93
Lancee, J., Eisma, M. C., van Straten, A., & Kamphuis, J. H. (2015) · Cognitive Behaviour Therapy · doi:10.1080/16506073.2015.1026386 · Cited by 93
The challenger app for social anxiety disorder: New advances in mobile psychological treatment
Miloff, A., Marklund, A., & Carlbring, P. (2015) · Internet Interventions · doi:10.1016/j.invent.2015.08.001 · Cited by 89
Self-citationSide effects in internet-based interventions for social anxiety disorder
Boettcher, J., Rozental, A., Andersson, G., & Carlbring, P. (2014) · Internet Interventions · doi:10.1016/j.invent.2014.02.002 · Cited by 88
Self-citationInferences on missing information under multiple imputation and two-stage multiple imputation
Harel, O. (2006) · Statistical Methodology · doi:10.1016/j.stamet.2006.03.002 · Cited by 87
Dahlin, M., Andersson, G., Magnusson, K., Johansson, T., Sjögren, J., Håkansson, A., Pettersson, M., Kadowaki, Å., Cuijpers, P., & Carlbring, P. (2016) · Behaviour Research and Therapy · doi:10.1016/j.brat.2015.12.007 · Cited by 86
Self-citationSome Comments on “Assessing Clinical Significance”
Martinovich, Z., Saunders, S., & Howard, K. (1996) · Psychotherapy Research · doi:10.1080/10503309612331331648 · Cited by 81
Internet-based treatment of pathological gambling with a three-year follow-up
Carlbring, P., Degerman, N., Jonsson, J., & Andersson, G. (2012) · Cognitive Behaviour Therapy · doi:10.1080/16506073.2012.689323 · Cited by 78
Self-citationIndividual patient data meta-analyses.
Clarke, M. (2005) · Best Practice & Research: Clinical Obstetrics & Gynaecology · doi:10.1016/j.bpobgyn.2004.10.011 · Cited by 74
Andersson, E., Walén, C., Hallberg, J., Paxling, B., Dahlin, M., Almlöv, J., Källström, R., Wijma, K., Carlbring, P., & Andersson, G. (2011) · The Journal of Sexual Medicine · doi:10.1111/j.1743-6109.2011.02391.x · Cited by 73
Self-citationBoettcher, J., Hasselrot, J., Sund, E., Andersson, G., & Carlbring, P. (2014) · Cognitive Behaviour Therapy · doi:10.1080/16506073.2013.809141 · Cited by 68
Self-citationIdentification of patients at risk for nonresponse and negative outcome in psychotherapy.
Mohr, D. C., Beutler, L. E., Engle, D., & Shoham-Salomon, V. (1990) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.58.5.622 · Cited by 67
Ström, M., Uckelstam, C.-J., Andersson, G., Hassmén, P., Umefjord, G., & Carlbring, P. (2013) · PeerJ · doi:10.7717/peerj.178 · Cited by 66
Self-citationVaughan, B., Goldstein, M. H., Alikakos, M., Cohen, L. J., & Serby, M. J. (2014) · Comprehensive Psychiatry · doi:10.1016/j.comppsych.2014.01.001 · Cited by 63
Hsu, L. M. (1995) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.63.1.141 · Cited by 61
Heeren, A., Maurage, P., Rossignol, M., Vanhaelen, M., Peschard, V., Eeckhout, C., & Philippot, P. (2012) · Canadian Journal of Behavioural Science / Revue canadienne des sciences du comportement · doi:10.1037/a0026249 · Cited by 61
Andersson, G., Waara, J., Jonsson, U., Malmaeus, F., Carlbring, P., & Öst, L.-G. (2013) · Cognitive Behaviour Therapy · doi:10.1080/16506073.2013.844202 · Cited by 59
Self-citationThe fear of fear concept: Stability, retest artefact and predictive power
Arrindell, W. A. (1993) · Behaviour Research and Therapy · doi:10.1016/0005-7967(93)90065-3 · Cited by 56
Reliability and validity of the self-report version of the Panic Disorder Severity Scale in Korea
Lee, E.-H., Kim, J.-H., & Yu, B.-H. (2009) · Depression and Anxiety · doi:10.1002/da.20461 · Cited by 55 · cited 1×
“…(2011) Liebowitz Social Anxiety Scale–Self-Report r .93 8 weeks Normal Heeren et al. (2012) Panic Disorder Severity Scale–Self-Report .94 2 days Patient Lee, Kim, and Yu (2009) Patient Health Questionnaire (nine items) r .94 2 weeks Patient Zuithoff et al. (2010) International Index of Erectile…”
BackgroundPALLESEN, S., NORDHUS, I. H., CARLSTEDT, B., THAYER, J. F., & JOHNSEN, T. B. (2006) · Scandinavian Journal of Psychology · doi:10.1111/j.1467-9450.2006.00518.x · Cited by 52
Martinez, R., Whitfield, G., Dafters, R., & Williams, C. (2008) · Behavioural and Cognitive Psychotherapy · doi:10.1017/s1352465807004067 · Cited by 48
Therapist Effects in Guided Internet-Delivered CBT for Anxiety Disorders
Almlöv, J., Carlbring, P., Källqvist, K., Paxling, B., Cuijpers, P., & Andersson, G. (2011) · Behavioural and Cognitive Psychotherapy · doi:10.1017/s135246581000069x · Cited by 48
Self-citationHadjistavropoulos, H. D., Pugh, N. E., Hesser, H., & Andersson, G. (2016) · Behavior Therapy · doi:10.1016/j.beth.2015.10.006 · Cited by 42
Self-citationLindner, P., Ivanova, E., Ly, K. H., Andersson, G., & Carlbring, P. (2013) · Trials · doi:10.1186/1745-6215-14-437 · Cited by 39
Self-citationSæmundsson, B. R., Þórsdóttir, F., Kristjánsdóttir, H., Ólason, D. Þ., Smári, J., & Sigurðsson, J. F. (2011) · European Journal of Psychological Assessment · doi:10.1027/1015-5759/a000059 · Cited by 33
Carlbring, P., Lindner, P., Martell, C., Hassmén, P., Forsberg, L., Ström, L., & Andersson, G. (2013) · Trials · doi:10.1186/1745-6215-14-35 · Cited by 26
Self-citationWalker, S., Liberti, L. E., & McAuslane, N. (2011) · Clinical Pharmacology & Therapeutics · doi:10.1038/clpt.2010.290 · Cited by 23
FOR BETTER OR FOR WORSE? PSYCHOTHERAPY AND VARIANCE CHANGE: A CRITICAL REVIEW OF THE LITERATURE
MAY, P. R. A. (1971) · The Journal of Nervous and Mental Disease · doi:10.1097/00005053-197103000-00004 · Cited by 19
(2014) · Psychotherapy Research · doi:10.1080/10503307.2014.942531 · Cited by 3
Cited by
Carlbring, P., Andersson, G., Cuijpers, P., Riper, H., & Hedman-Lagerlöf, E. (2018) · Cognitive Behaviour Therapy · doi:10.1080/16506073.2017.1401115 · Cited by 1,232
Self-citationLinardon, J., Cuijpers, P., Carlbring, P., Messer, M., & Fuller‐Tyszkiewicz, M. (2019) · World Psychiatry · doi:10.1002/wps.20673 · Cited by 860
Self-citationInternet-delivered psychological treatments: from innovation to implementation
Andersson, G., Titov, N., Dear, B. F., Rozental, A., & Carlbring, P. (2019) · World Psychiatry · doi:10.1002/wps.20610 · Cited by 750
Self-citationEbert, D. D., Van Daele, T., Nordgreen, T., Karekla, M., Compare, A., Zarbo, C., Brugnera, A., Øverland, S., Trebbi, G., Jensen, K. L., et al. (2018) · European Psychologist · doi:10.1027/1016-9040/a000318 · Cited by 437
Recent Progress in Virtual Reality Exposure Therapy for Phobias: A Systematic Review
Botella, C., Fernández-Álvarez, J., Guillén, V., García-Palacios, A., & Baños, R. (2017) · Current Psychiatry Reports · doi:10.1007/s11920-017-0788-4 · Cited by 460
Metadata
- Authors
- Rozental, A., Magnusson, K., Boettcher, J., Andersson, G., & Carlbring, P.
- Affiliations
- Karolinska Institutet (SE)
- Freie Universität Berlin (DE)
- Venue
- Journal of Consulting and Clinical Psychology
- Published
- 2017-02
- Volume
- 85
- Issue
- 2
- Pages
- 160-177
- ISSN
- 0022-006X (ISSN-L)
- 1939-2117
- OpenAlex
- W2539211266
- Semantic Scholar
- 7bb2e24de6a8e5cd7f8dceabb09f3c0ac9c493b7
- Cited by
- 137
- References
- 118
- Citations by year
- 2026: 12 · 2025: 16 · 2024: 14 · 2023: 21 · 2022: 7 · 2021: 9 · 2020: 15 · 2019: 19 · 2018: 13 · 2017: 11
- FWCI
- 2.31
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of Consulting and Clinical Psychology (publishedVersion)
- PubMed (publishedVersion)
- Funders
- Swedish Research Council for Health, Working Life, and Welfare (FORTE 2013-1107)
- Topics
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Anxiety, Depression, Psychometrics, Treatment, Cognitive Processes
- Social Sciences › Psychology › Clinical Psychology › Psychotherapy Techniques and Applications
- Keywords
- internet-based cognitive behavioral therapy, treatment deterioration, reliable change index, mental illness, clinical severity, sociodemographic predictors, medication adherence, online psychological intervention
- MeSH terms
- Adult, Mental Disorders, Female, Humans, Male, Severity of Illness Index, Cognitive Behavioral Therapy, Treatment Failure, Telemedicine, Internet
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.