Effectiveness of Internet-based cognitive–behavior therapy for social anxiety disorder in clinical psychiatry.
The DOI matches its Crossref record; 59 of the 60 references it cites were found in a registry or an index.
Abstract
OBJECTIVE: Internet-based cognitive-behavioral therapy (ICBT) has received increased attention as an innovative approach to improve access to evidence-based psychological treatments. Although the efficacy of ICBT for social anxiety disorder has been established in several studies, there is limited knowledge of its effectiveness and application in clinical psychiatric care. The purpose of this study was to evaluate the effectiveness of ICBT in the treatment of social anxiety disorder and to determine the significance of patient adherence and the clinic's years of experience in delivering ICBT. METHOD: A longitudinal cohort study was conducted using latent growth curve modeling of patients (N = 654) treated with ICBT at an outpatient psychiatric clinic between 2009 and 2013. The primary outcome measure was the Liebowitz Social Anxiety Scale-Self-Rated. RESULTS: Significant reductions in symptoms of social anxiety were observed after treatment (effect size d = 0.86, 99% CI [0.74, 0.98]). Improvements were sustained at 6-month follow-up (d = 1.15, 99% CI [0.99, 1.32]). Patient adherence had a positive effect on the rate of improvement. A positive association between the clinic's years of experience with ICBT and treatment outcome was also observed. CONCLUSIONS: This study suggests that ICBT for social anxiety disorder is effective when delivered within the context of a unit specialized in Internet-based psychiatric care and may be considered as a treatment alternative for implementation within the mental health care system.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Both groups have published data from their routine clinical practice, indicating that ICBT works when delivered as a regular intervention with ordinary clients.”
From Internet-delivered psychological treatments: from innovation to implementation (2019) · cites this paper as [99]
Citations
Cites
Statistical power analysis for the behavioral sciences
(1990) · Computers, Environment and Urban Systems · doi:10.1016/0198-9715(90)90050-4 · Cited by 65,269
Kessler, R. C., Berglund, P., Demler, O., Jin, R., Merikangas, K. R., & Walters, E. E. (2005) · Archives of General Psychiatry · doi:10.1001/archpsyc.62.6.593 · Cited by 20,391
(1998) · The Journal of Clinical Psychiatry · Cited by 19,139
Statistical Analysis With Missing Data
Lahiff, M., Little, R. J. A., & Rubin, D. B. (1989) · Journal of the American Statistical Association · doi:10.2307/2289883 · Cited by 17,265
(2010) · Cited by 7,034
Schulz (1995) · doi:10.1001/jama.1995.03520290060030 · Cited by 5,634
A cognitive model of social phobia
Adrian Wells, A. (1995) · Research Explorer (The University of Manchester) · Cited by 2,701
Morris, S. B., & DeShon, R. P. (2002) · Psychological Methods · doi:10.1037/1082-989x.7.1.105 · Cited by 2,502
The client satisfaction questionnaire
Attkisson, C. C., & Zwick, R. (1982) · Evaluation and Program Planning · doi:10.1016/0149-7189(82)90074-x · Cited by 1,743 · cited 2×
“The eight-item version of the Client Satisfaction Questionnaire (CSQ–8; Attkisson & Zwick, 1982; Nguyen, Attkisson, & Stegner, 1983) was used to measure patients’ satisfaction with the care received.”
BackgroundMethodLatent Curve Models: A Structural Equation Perspective
Bollen, K. A., & Curran, P. J. (2005) · Wiley Series in Probability and Statistics · doi:10.1002/0471746096 · Cited by 1,729
Internet-based cognitive behaviour therapy for symptoms of depression and anxiety: A meta-analysis
SPEK, V., CUIJPERS, P., NYKLÍČEK, I., RIPER, H., KEYZER, J., & POP, V. (2007) · Psychological Medicine · doi:10.1017/s0033291706008944 · Cited by 1,586
Andrews, G., Cuijpers, P., Craske, M. G., McEvoy, P., & Titov, N. (2010) · PLoS ONE · doi:10.1371/journal.pone.0013196 · Cited by 1,311
Stein, M. B., & Stein, D. J. (2008) · The Lancet · doi:10.1016/s0140-6736(08)60488-2 · Cited by 1,137
Adherence in Internet Interventions for Anxiety and Depression
Christensen, H., Griffiths, K. M., & Farrer, L. (2009) · Journal of Medical Internet Research · doi:10.2196/jmir.1194 · Cited by 1,133
Psychometric properties of the Liebowitz Social Anxiety Scale
HEIMBERG, R. G., HORNER, K. J., JUSTER, H. R., SAFREN, S. A., BROWN, E. J., SCHNEIER, F. R., & LIEBOWITZ, M. R. (1999) · Psychological Medicine · doi:10.1017/s0033291798007879 · Cited by 968 · cited 2×
“The 12-week test–retest reliability has been reported as high (r .83; Baker et al., 2002; Heimberg et al., 1999).”
BackgroundMethodApplication of random-effects pattern-mixture models for missing data in longitudinal studies.
Hedeker, D., & Gibbons, R. D. (1997) · Psychological Methods · doi:10.1037/1082-989x.2.1.64 · Cited by 907
Social fears and social phobia in the USA: results from the National Comorbidity survey replication
Ruscio, A. M., Brown, T. A., Chiu, W. T., Sareen, J., Stein, M. B., & Kessler, R. C. (2008) · Psychological Medicine · doi:10.1017/s0033291707001699 · Cited by 835 · cited 2×
“Considering that SAD is one of the most common anxiety disorders (Ruscio et al., 2008) and that access to CBT is relatively limited (Brugha et al., 2004; Cavanagh, 2014), ICBT could significantly increase the availability of evidence-based effective treatments for a large patient group, partly…”
BackgroundAssessment of patient satisfaction: Development and refinement of a Service Evaluation Questionnaire
Nguyen, T. D., Attkisson, C. C., & Stegner, B. L. (1983) · Evaluation and Program Planning · doi:10.1016/0149-7189(83)90010-1 · Cited by 736
Svanborg, P., & Åsberg, M. (1994) · Acta Psychiatrica Scandinavica · doi:10.1111/j.1600-0447.1994.tb01480.x · Cited by 693 · cited 3×
“S; Svanborg & Åsberg, 1994; 35) and/or moderate to high risk of suicide in which monitoring is required (which also excludes patients who have recently carried out a suicide attempt); (b) patients with low motivation, severe apathy, or difficulty concentrating; (c) patients with psychosis; (d)…”
BackgroundMethodInfluentialHedman, E., Ljótsson, B., & Lindefors, N. (2012) · Expert Review of Pharmacoeconomics & Outcomes Research · doi:10.1586/erp.12.67 · Cited by 672 · cited 2×
“A systematic review by Hedman, Ljótsson, and Lindefors (2012) and a meta-analysis by Andrews, Cuijpers, Craske, McEvoy, and Titov (2010) demonstrated effect sizes of guided ICBT similar to those of live CBT for several common psychiatric disorders, including SAD.”
BackgroundSelf-citationThe Liebowitz social anxiety scale as a self-report instrument: a preliminary psychometric analysis
Baker, S. L., Heinrichs, N., Kim, H.-J., & Hofmann, S. G. (2002) · Behaviour Research and Therapy · doi:10.1016/s0005-7967(01)00060-2 · Cited by 640
Internet-administered cognitive behavior therapy for health problems: a systematic review
Cuijpers, P., van Straten, A., & Andersson, G. (2008) · Journal of Behavioral Medicine · doi:10.1007/s10865-007-9144-1 · Cited by 555
Self-citationFunctional impairment in social phobia.
Schneier, F. R., Heckelman, L., Garfinkel, R. S., Campeas, R. B., Fallon, B. A., Gitow, A., Street, L. L., Bene, D. D., & Liebowitz, M. R. (1994) · PubMed · Cited by 534
Analyzing incomplete longitudinal clinical trial data
Molenberghs, G. (2004) · Biostatistics · doi:10.1093/biostatistics/5.3.445 · Cited by 463
Rytwinski, N. K., Fresco, D. M., Heimberg, R. G., Coles, M. E., Liebowitz, M. R., Cissell, S., Stein, M. B., & Hofmann, S. G. (2009) · Depression and Anxiety · doi:10.1002/da.20503 · Cited by 432 · cited 1×
“In the analyses of categorical improvement, a cut-off of 30 or less on LSAS–SR was used, indicative of probable absence from SAD (Rytwinski et al., 2009).”
MethodAndersson, G., Carlbring, P., Holmström, A., Sparthan, E., Furmark, T., Nilsson-Ihrfelt, E., Buhrman, M., & Ekselius, L. (2006) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.74.4.677 · Cited by 382
Self-citationSareen, J., Jacobi, F., Cox, B. J., Belik, S.-L., Clara, I., & Stein, M. B. (2006) · Archives of Internal Medicine · doi:10.1001/archinte.166.19.2109 · Cited by 361 · cited 1×
“…curve analysis Social anxiety disorder (SAD) is one of the most common anxiety disorders (Ruscio et al., 2008) characterized by an intense fear in social situations causing considerable functional impair- ment in social and occupational domains of life (Sareen et al., 2006; Stein et al., 2005).”
BackgroundPsychological treatment of social anxiety disorder: a meta-analysis
Acarturk, C., Cuijpers, P., van Straten, A., & de Graaf, R. (2009) · Psychological Medicine · doi:10.1017/s0033291708003590 · Cited by 333
Analyzing longitudinal data with missing values
Enders, C. K. (2011) · Rehabilitation Psychology · doi:10.1037/a0025579 · Cited by 321
Carlbring, P., Gunnarsdóttir, M., Hedensjö, L., Andersson, G., Ekselius, L., & Furmark, T. (2007) · British Journal of Psychiatry · doi:10.1192/bjp.bp.105.020107 · Cited by 293
Self-citationHedman, E., Andersson, G., Ljótsson, B., Andersson, E., Rück, C., Mörtberg, E., & Lindefors, N. (2011) · PLoS ONE · doi:10.1371/journal.pone.0018001 · Cited by 285
Self-citationGuided and unguided self-help for social anxiety disorder: randomised controlled trial
Furmark, T., Carlbring, P., Hedman, E., Sonnenstein, A., Clevberger, P., Bohman, B., Eriksson, A., Hållén, A., Frykman, M., Holmström, A., et al. (2009) · British Journal of Psychiatry · doi:10.1192/bjp.bp.108.060996 · Cited by 256 · cited 2×
“The treatment was based on the manual developed by Andersson and colleagues (Andersson et al., 2006; Furmark et al., 2009) with documented effects in several randomized controlled trials.”
BackgroundMethodSelf-citationMissing not at random models for latent growth curve analyses.
Enders, C. K. (2011) · Psychological Methods · doi:10.1037/a0022640 · Cited by 253
Christensen, H., Griffiths, K. M., Korten, A. E., Brittliffe, K., & Groves, C. (2004) · Journal of Medical Internet Research · doi:10.2196/jmir.6.4.e46 · Cited by 240
Functional Impact and Health Utility of Anxiety Disorders in Primary Care Outpatients
Stein, M. B., Roy-Byrne, P. P., Craske, M. G., Bystritsky, A., Sullivan, G., Pyne, J. M., Katon, W., & Sherbourne, C. D. (2005) · Medical Care · doi:10.1097/01.mlr.0000185750.18119.fd · Cited by 233
Hedman, E., Ljótsson, B., Kaldo, V., Hesser, H., El Alaoui, S., Kraepelien, M., Andersson, E., Rück, C., Svanborg, C., Andersson, G., et al. (2014) · Journal of Affective Disorders · doi:10.1016/j.jad.2013.10.023 · Cited by 224
Self-citationFarvolden, P., Denisoff, E., Selby, P., Bagby, R. M., & Rudy, L. (2005) · Journal of Medical Internet Research · doi:10.2196/jmir.7.1.e7 · Cited by 223
Hedman, E., Ljótsson, B., Rück, C., Furmark, T., Carlbring, P., Lindefors, N., & Andersson, G. (2010) · Computers in Human Behavior · doi:10.1016/j.chb.2010.01.010 · Cited by 220 · cited 1×
“All self-assessments were completed online, which has been shown to be a valid administration (Hedman et al., 2010).”
BackgroundSelf-citationInternet-based treatment for social phobia: A randomized controlled trial
Berger, T., Hohl, E., & Caspar, F. (2009) · Journal of Clinical Psychology · doi:10.1002/jclp.20603 · Cited by 198
A Meta–Analytic Review of Psychological Treatments for Social Anxiety Disorder
Powers, M. B., Sigmarsson, S. R., & Emmelkamp, P. M. G. (2008) · International Journal of Cognitive Therapy · doi:10.1521/ijct.2008.1.2.94 · Cited by 191
Hedman, E., Andersson, E., Ljótsson, B., Andersson, G., Rück, C., & Lindefors, N. (2011) · Behaviour Research and Therapy · doi:10.1016/j.brat.2011.07.009 · Cited by 183
Self-citationShyness 1: Distance Treatment of Social Phobia Over the Internet
Titov, N., Andrews, G., Schwencke, G., Drobny, J., & Einstein, D. (2008) · Australian & New Zealand Journal of Psychiatry · doi:10.1080/00048670802119762 · Cited by 180
An internet-based self-help treatment for fear of public speaking: a controlled trial.
Botella, C., Gallego, M. J., Garcia-Palacios, A., Guillen, V., Baños, R. M., Quero, S., & Alcañiz, M. (2010) · Cyberpsychology, Behavior, and Social Networking · doi:10.1089/cyber.2009.0224 · Cited by 169 · cited 1×
“Further, independent research groups have found ICBT to be as effective as conventional CBT in the treatment of SAD through three RCTs (Andrews et al., 2011; Botella et al., 2010; Hedman, Andersson, Ljótsson, Andersson, Rück, Mörtberg, & Lindefors, 2011).”
BackgroundAndrews, G., Davies, M., & Titov, N. (2011) · Australian & New Zealand Journal of Psychiatry · doi:10.3109/00048674.2010.538840 · Cited by 152
Hedman, E., Ljótsson, B., Rück, C., Bergström, J., Andersson, G., Kaldo, V., Jansson, L., Andersson, E., Andersson, E., Blom, K., et al. (2013) · Acta Psychiatrica Scandinavica · doi:10.1111/acps.12079 · Cited by 144
Self-citationShyness 2: Treating Social Phobia Online: Replication and Extension
Titov, N., Andrews, G., & Schwencke, G. (2008) · Australian & New Zealand Journal of Psychiatry · doi:10.1080/00048670802119820 · Cited by 133
Tillfors, M., Carlbring, P., Furmark, T., Lewenhaupt, S., Spak, M., Eriksson, A., Westling, B. E., & Andersson, G. (2008) · Depression and Anxiety · doi:10.1002/da.20416 · Cited by 132 · cited 1×
“…randomized controlled trials (RCT) showing that it can produce large reductions in social anxiety as well as improvements on measures of comorbid depressive symptoms (Berger, Hohl, & Caspar, 2009; Furmark et al., 2009; Tillfors et al., 2008; Titov, Andrews, Schwencke, Drobny, & Einstein, 2008).”
BackgroundSelf-citationSelf-assessment of DSM-IV criteria for major depression in psychiatric out- and inpatients *
SVANBORG, P., & EKSELIUS, L. (2003) · Nordic Journal of Psychiatry · doi:10.1080/08039480307281 · Cited by 129
McEvoy, P. M. (2007) · Behaviour Research and Therapy · doi:10.1016/j.brat.2007.08.002 · Cited by 124
Yonkers, K. A., DYCK, I. R., & Keller, M. B. (2001) · Psychiatric Services · doi:10.1176/appi.ps.52.5.637 · Cited by 122
Hofmann, S. G., Smits, J. A. J., Rosenfield, D., Simon, N., Otto, M. W., Meuret, A. E., Marques, L., Fang, A., Tart, C., & Pollack, M. H. (2013) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2013.12070974 · Cited by 121 · cited 1×
“Remission rates were estimated at 20% at posttreatment and 36% at 6-month follow-up, which is comparable with face-to-face CBT for SAD; for example, 24.4% of patients attained remission after a placebo-augmented CBT for SAD (Hofmann et al., 2013).”
MethodInfluentialTrends in service use and treatment for mental disorders in adults throughout Great Britain
Brugha, T. S., Bebbington, P. E., Singleton, N., Melzer, D., Jenkins, R., Lewis, G., Farrell, M., Bhugra, D., Lee, A., & Meltzer, H. (2004) · British Journal of Psychiatry · doi:10.1192/bjp.185.5.378 · Cited by 114 · cited 1×
“Considering that SAD is one of the most common anxiety disorders (Ruscio et al., 2008) and that access to CBT is relatively limited (Brugha et al., 2004; Cavanagh, 2014), ICBT could significantly increase the availability of evidence-based effective treatments for a large patient group, partly…”
BackgroundThe Client Satisfaction Questionnaire: Psychometric Properties in a Dutch Addict Population
De Wilde, E. F., & Hendriks, V. M. (2005) · European Addiction Research · doi:10.1159/000086396 · Cited by 110
A prospective follow-along study of the course of social phobia
Reich, J. H., Goldenberg, I. M., Vasile, R. G., Goisman, R. M., & Keller, M. B. (1994) · Psychiatry Research · doi:10.1016/0165-1781(94)90019-1 · Cited by 86
Cavanagh, K. (2014) · Behavioural and Cognitive Psychotherapy · doi:10.1017/s1352465813000568 · Cited by 84
Aydos, L., Titov, N., & Andrews, G. (2009) · Australasian Psychiatry · doi:10.1080/10398560903284943 · Cited by 49
Kaldo, V., Haak, T., Buhrman, M., Alfonsson, S., Larsen, H.-C., & Andersson, G. (2013) · Cognitive Behaviour Therapy · doi:10.1080/16506073.2013.769622 · Cited by 48
Self-citationEfficacy and Effectiveness of Online Cognitive Behavioral Treatment: A Decade of Interapy Research
Ruwaard, J., Lange, A., Schrieken, B., & Emmelkamp, P. M. G. (2011) · Studies in health technology and informatics · doi:10.3233/978-1-60750-766-6-9 · Cited by 36
Furukawa, T. A., Nakano, Y., Funayama, T., Ogawa, S., Ietsugu, T., Noda, Y., Chen, J., Watanabe, N., & Akechi, T. (2013) · Psychiatry and Clinical Neurosciences · doi:10.1111/pcn.12035 · Cited by 9
Cited by
Andrews, G., Basu, A., Cuijpers, P., Craske, M. G., McEvoy, P., English, C. L., & Newby, J. M. (2018) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2018.01.001 · Cited by 922
Internet-delivered psychological treatments: from innovation to implementation
Andersson, G., Titov, N., Dear, B. F., Rozental, A., & Carlbring, P. (2019) · World Psychiatry · doi:10.1002/wps.20610 · Cited by 750
Self-citationInternet-Delivered Psychological Treatments
Andersson, G. (2016) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-021815-093006 · Cited by 595
Self-citationEbert, D. D., Van Daele, T., Nordgreen, T., Karekla, M., Compare, A., Zarbo, C., Brugnera, A., Øverland, S., Trebbi, G., Jensen, K. L., et al. (2018) · European Psychologist · doi:10.1027/1016-9040/a000318 · Cited by 437
Etzelmueller, A., Vis, C., Karyotaki, E., Baumeister, H., Titov, N., Berking, M., Cuijpers, P., Riper, H., & Ebert, D. D. (2020) · Journal of Medical Internet Research · doi:10.2196/18100 · Cited by 356
Metadata
- Authors
- El Alaoui, S., Hedman, E., Kaldo, V., Hesser, H., Kraepelien, M., Andersson, E., Rück, C., Andersson, G., Ljótsson, B., & Lindefors, N.
- Affiliations
- Karolinska University Hospital (SE)
- Linköping University (SE)
- ORCID
- Venue
- Journal of Consulting and Clinical Psychology
- Published
- 2015-10
- Volume
- 83
- Issue
- 5
- Pages
- 902-914
- ISSN
- 0022-006X (ISSN-L)
- 1939-2117
- OpenAlex
- W1737071184
- Cited by
- 99
- References
- 60
- Citations by year
- 2026: 6 · 2025: 8 · 2024: 9 · 2023: 2 · 2022: 4 · 2021: 7 · 2020: 12 · 2019: 12 · 2018: 16 · 2017: 6 · 2016: 12 · 2015: 5
- FWCI
- 20.88
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of Consulting and Clinical Psychology (publishedVersion)
- PubMed (publishedVersion)
- Funders
- Stockholm County Council (ALF 20130413)
- Topics
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Anxiety, Depression, Psychometrics, Treatment, Cognitive Processes
- Social Sciences › Psychology › Clinical Psychology › Psychological Treatments and Assessments
- Keywords
- internet-based cognitive behavioral therapy, social anxiety disorder, treatment effectiveness, patient adherence, outpatient psychiatric care, Liebowitz Social Anxiety Scale, treatment outcomes
- MeSH terms
- Adolescent, Adult, Aged, Female, Follow-Up Studies, Humans, Longitudinal Studies, Male, Middle Aged, Patient Compliance, Phobic Disorders, Cohort Studies, Cognitive Behavioral Therapy, Treatment Outcome, Internet, Young Adult
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.