The DOI matches its Crossref record; 49 of the 49 references it cites were found in a registry or an index; none of the 9 sources its claims cite is checked for support yet.
More than doubling the clinical benefit of each hour of therapist time: a randomised controlled trial of internet cognitive therapy for social anxiety disorder
Open accessAbstract
Background: Cognitive therapy for social anxiety disorder (CT-SAD) is recommended by NICE (2013) as a first-line intervention. Take up in routine services is limited by the need for up to 14 ninety-min face-to-face sessions, some of which are out of the office. An internet-based version of the treatment (iCT-SAD) with remote therapist support may achieve similar outcomes with less therapist time. Methods: 102 patients with social anxiety disorder were randomised to iCT-SAD, CT-SAD, or waitlist (WAIT) control, each for 14 weeks. WAIT patients were randomised to the treatments after wait. Assessments were at pre-treatment/wait, midtreatment/wait, posttreatment/wait, and follow-ups 3 & 12 months after treatment. The pre-registered (ISRCTN 95 458 747) primary outcome was the social anxiety disorder composite, which combines 6 independent assessor and patient self-report scales of social anxiety. Secondary outcomes included disability, general anxiety, depression and a behaviour test. Results: CT-SAD and iCT-SAD were both superior to WAIT on all measures. iCT-SAD did not differ from CT-SAD on the primary outcome at post-treatment or follow-up. Total therapist time in iCT-SAD was 6.45 h. CT-SAD required 15.8 h for the same reduction in social anxiety. Mediation analysis indicated that change in process variables specified in cognitive models accounted for 60% of the improvements associated with either treatment. Unlike the primary outcome, there was a significant but small difference in favour of CT-SAD on the behaviour test. Conclusions: When compared to conventional face-to-face therapy, iCT-SAD can more than double the amount of symptom change associated with each therapist hour.
Overview
CoChat Summary
## TL;DR
This randomized controlled trial found that internet cognitive therapy for social anxiety disorder (iCT-SAD) produced similar outcomes to standard face-to-face cognitive therapy (CT-SAD) while using much less therapist time. By the end of treatment, iCT-SAD achieved the same LSAS reduction as CT-SAD with 6.45 therapist hours versus 15.8 hours, or 2.45 times more symptom change per hour.
## Key findings
- Both active treatments beat waitlist: CT-SAD and iCT-SAD were “superior to WAIT on all measures,” with large post-treatment effect sizes on the primary social anxiety composite of d = 2.20 for iCT-SAD and d = 2.38 for CT-SAD.
- Comparable primary outcomes between therapies: iCT-SAD did not differ significantly from CT-SAD on the primary outcome at post-treatment or follow-up; between-treatment effect sizes on the primary outcome were small (ds range 0.22 to 0.31).
- Therapist time was much lower in iCT-SAD: iCT-SAD required 6.45 h of therapist contact, whereas CT-SAD required 15.8 h for the same LSAS reduction; the paper reports this as 2.45 times more symptom change per hour of therapist contact time.
- Process change mattered: Mediation analysis indicated that changes in the cognitive-model process variables accounted for about 60% of the improvements associated with both treatments.
## Methods
- Design: Randomized controlled trial with 102 patients assigned to iCT-SAD, CT-SAD, or waitlist (WAIT) for 14 weeks; WAIT participants were later randomized to treatment if still eligible. Patients receiving treatment were followed up at 3 and 12 months.
- Sample/data: Adults aged 18–65 meeting DSM-IV criteria for social anxiety disorder, with SAD as the main problem, internet access from home, and no recent change in psychotropic medication; referrals came from Improving Access to Psychological Therapy (IAPT) services in Oxford and London.
- Main analysis: Continuous outcomes were analyzed with linear mixed-effects regression using all available data and covariates including baseline score and PHQ; mediation analyses tested whether changes in process variables mediated treatment effects, and effect sizes were reported as Cohen’s d.
## Limitations
- Stated by the paper: The authors note that using the same experienced therapists for both delivery modes was a rigorous test, but that further studies are required to see whether therapists in routine services with less prior CT experience can achieve similarly positive results with iCT-SAD.
- Stated by the paper: The behavior test comparison was complicated by the fact that it was conducted in the clinic where CT-SAD patients had their treatment, and the authors say future behavior tests should be conducted elsewhere.
- Evident from the text: The trial compared iCT-SAD against CT-SAD delivered by highly experienced therapists and did not assess competence for iCT-SAD because no measure was available, so generalizability to routine practice and comparative delivery fidelity are uncertain.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
0 Valid · 0 Not valid · 7 Not checked · 36 Own results and interpretations
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Total therapist time in iCT-SAD was 6.45 h.”
- Also stated in: § Therapeutic change per hour of therapy · plain
“iCT patients had dropped 45.5 points on the LSAS after an average of 6.45 h contact with their therapist.”
§ More than doubling the clinical benefit of each hour of therapist time: a randomised controlled trial of internet cognitive therapy for social anxiety disorder > Abstract > Results
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § Therapeutic change per hour of therapy · plain
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Mediation analysis indicated that change in process variables specified in cognitive models accounted for 60% of the improvements associated with either treatment.”
- Also stated in: § Discussion · hedged
“For both internet and face-to-face versions, change in processes specified in the models accounted for around 60% improvement associated with treatment.”
§ More than doubling the clinical benefit of each hour of therapist time: a randomised controlled trial of internet cognitive therapy for social anxiety disorder > Abstract > Results
hedgedstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § Discussion · hedged
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The presence of avoidant personality disorder did not predict outcome in either treatment.”
§ More than doubling the clinical benefit of each hour of therapist time: a randomised controlled trial of internet cognitive therapy for social anxiety disorder > Results > Predictors of treatment response
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Within iCT, individuals who practised giving presentations to a virtual audience more frequently had better outcomes (standardised β = −0.420, p = 0.003).”
§ More than doubling the clinical benefit of each hour of therapist time: a randomised controlled trial of internet cognitive therapy for social anxiety disorder > Results > Predictors of treatment response
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“For both iCT-SAD and CT-SAD scores on the process composite at mid-treatment/wait mediated the relationship between randomisation (treatment v. wait) and scores on the primary outcome measure at post-treatment/wait”
§ More than doubling the clinical benefit of each hour of therapist time: a randomised controlled trial of internet cognitive therapy for social anxiety disorder > Results > Mediation analysis
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
15 more claims
Create a free account to see all 43 claims and to verify the 9 references still open.
- It may state two separate claims as one. 11
- Probably not a substantial claim. 15
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“we used a conservative estimated mean difference of half this value (22 points). This calculation (using β = 0.9, α = 0.05, and a LSAS standard deviation of 19) indicated a required minimum sample of 16 participants per arm. Given the planned analyses of secondary measures and allowing for attrition (up to 20% dropout), we need 30 participants per group, making a total sample size of 60”
From Translated and culturally adapted internet-delivered cognitive therapy for social anxiety disorder in Japanese clinical settings: study protocol for a randomised controlled trial (2024) · cites this paper as [8]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“In the UK, an internet-delivered version of this treatment protocol (iCT-SAD) was developed to support wider access and dissemination [8, 9].”
The cited source says what the claim attributes to it.
In the citing paper
“A randomised controlled trial in the UK found it to show strong efficacy, with outcomes comparable to face-to-face CT-SAD, but requiring much less therapist time per client [8].”
Statistics that don’t add up
Each reported p-value recomputed from its test statistic and degrees of freedom.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
“t(65) = 3.3, p < 0.001”
§ More than doubling the clinical benefit of each hour of therapist time: a randomised controlled trial of internet cognitive therapy for social anxiety disorder > Results > Treatment credibility and therapeutic alliance
Reported p < .001 · recomputed p = .002
Statistics recomputed
Every reported test result, recomputed from its test statistic and degrees of freedom. A result shows as not adding up only once an independent check has confirmed it.
- Doesn’t add upt(65) = 3.3reported p < .001 · recomputed p = .002
“t(65) = 3.3, p < .001”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Self-check results appear here once an independent check has confirmed them.
Citations
Cites
R: A Language and Environment for Statistical Computing
R Core Team (2025) · doi:10.32614/r.manuals · Cited by 352,181
Baron, R. M., & Kenny, D. A. (1986) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.51.6.1173 · Cited by 91,532
The PHQ-9: Validity of a brief depression severity measure
Kroenke, K., Spitzer, R. L., & Williams, J. B. W. (2001) · Journal of General Internal Medicine · doi:10.1046/j.1525-1497.2001.016009606.x · Cited by 44,910
A Brief Measure for Assessing Generalized Anxiety Disorder: The GAD-7
Spitzer, R. L., Kroenke, K., Williams, J. B. W., & Löwe, B. (2006) · Archives of Internal Medicine · doi:10.1001/archinte.166.10.1092 · Cited by 31,765
Measurement of social-evaluative anxiety.
Watson, D., & Friend, R. (1969) · Journal of Consulting and Clinical Psychology · doi:10.1037/h0027806 · Cited by 3,467 · cited 1×
“…Social Anxiety Scale (LSAS: Baker, Heinrichs, Kim, & Hofmann, 2002), Social Phobia Inventory (SPIN: Connor et al., 2000), Social Phobia Scale (SPS: Mattick and Clarke, 1998), Social Interaction Anxiety Scale (SIAS: Mattick & Clarke, 1998), Fear of Negative Evaluation (FNE: Watson & Friend, 1969).”
Mattick, R. P., & Clarke, J. C. (1998) · Behaviour Research and Therapy · doi:10.1016/s0005-7967(97)10031-6 · Cited by 3,367
A cognitive-behavioral model of anxiety in social phobia
Rapee, R. M., & Heimberg, R. G. (1997) · Behaviour Research and Therapy · doi:10.1016/s0005-7967(97)00022-3 · Cited by 2,987
The Work and Social Adjustment Scale: a simple measure of impairment in functioning
Mundt, J. C., Marks, I. M., Shear, M. K., & Greist, J. M. (2002) · British Journal of Psychiatry · doi:10.1192/bjp.180.5.461 · Cited by 2,515
Psychosomatic medicine in Germany: more timely than ever
Zipfel, S., Herzog, W., Kruse, J., & Henningsen, P. (2016) · Psychotherapy and Psychosomatics · doi:10.1159/000447701 · Cited by 2,323
Psychometric properties of the credibility/expectancy questionnaire
Devilly, G. J., & Borkovec, T. D. (2000) · Journal of Behavior Therapy and Experimental Psychiatry · doi:10.1016/s0005-7916(00)00012-4 · Cited by 2,295 · cited 1×
“Initial ratings of the credibility of psychological treatment have also often been shown to predict outcome (Devilly & Borkovec, 2000) and did so in iCT-SAD.”
Research works printed but not linked: 5
- First, 1995, User's guide for the structured clinical interview for DSM-IV axis I disorders: SCID-I clinician version
- Brown, 1994, Anxiety disorders interview schedule for DSM-IV
- 2013, Social anxiety disorder: Recognition, assessment and treatment (clinical guideline 159)
- 1994, Diagnostic and statistical manual of mental disorders, 4th
- Rosenthal, 1991, Essentials of behavioural research: Methods and data analysis
Cited by
Hedman‐Lagerlöf, E., Carlbring, P., Svärdman, F., Riper, H., Cuijpers, P., & Andersson, G. (2023) · World Psychiatry · doi:10.1002/wps.21088 · Cited by 259
The use of artificial intelligence in psychotherapy: development of intelligent therapeutic systems
Spytska, L. (2025) · BMC Psychology · doi:10.1186/s40359-025-02491-9 · Cited by 113
The Neuropsychology of Anxiety: An enquiry into the functions of the septo-hippocampal system
McNaughton, N., & Gray, J. A. (2024) · doi:10.1093/oso/9780198843313.001.0001 · Cited by 113
Creswell, C., Taylor, L., Giles, S., Howitt, S., Radley, L., Whitaker, E., Brooks, E., Knight, F., Raymont, V., Hill, C., et al. (2024) · The Lancet Psychiatry · doi:10.1016/s2215-0366(23)00429-7 · Cited by 45
Anxiety Screening: Evidence Report and Systematic Review for the US Preventive Services Task Force
O’Connor, E., Henninger, M. L., Perdue, L. A., Coppola, E. L., Thomas, R. G., & Gaynes, B. N. (2023) · JAMA · doi:10.1001/jama.2023.6369 · Cited by 52
Metadata
- Authors
- Clark, D. M., Wild, J., Warnock-Parkes, E., Stott, R., Grey, N., Thew, G., & Ehlers, A.
- Affiliations
- University of Oxford (GB)
- King's College London (GB)
- Sussex Partnership NHS Foundation Trust (GB)
- Corresponding author
- Clark, David M.
- Venue
- Psychological Medicine
- Publisher
- Cambridge University Press (CUP)
- Published
- 2022-07-15
- Volume
- 53
- Issue
- 11
- Pages
- 5022-5032
- ISSN
- 0033-2917 (ISSN-L)
- 1469-8978
- PMC
- PMC10476054
- OpenAlex
- W4285491857
- Semantic Scholar
- e823d97799dd3c8062b072ebe54e786fa8647ab1
- Cited by
- 88
- References
- 49
- Citations by year
- 2026: 18 · 2025: 19 · 2024: 36 · 2023: 11 · 2022: 4
- FWCI
- 15.46
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Locations
- Psychological Medicine (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Funders
- Wellcome (200796)
- Topics
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Anxiety, Depression, Psychometrics, Treatment, Cognitive Processes
- Social Sciences › Psychology › Clinical Psychology › Psychological Treatments and Assessments
- Keywords
- social anxiety disorder, cognitive therapy, process parameters, mediation analysis, treatment outcomes, general anxiety, depression
- MeSH terms
- Phobia, Social, Anxiety, Humans, Therapy, Computer-Assisted, Cognitive Behavioral Therapy, Treatment Outcome, Internet
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-10-11, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-11 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: More than doubling the clinical benefit of each hour of therapist time: a randomised controlled trial of internet cognitive therapy for social anxiety disorder. https://app.cochat.ai/papers/10.1017/s0033291722002008
- The paper
- Clark, D. M., Wild, J., Warnock-Parkes, E., Stott, R., Grey, N., Thew, G., & Ehlers, A. (2023). More than doubling the clinical benefit of each hour of therapist time: a randomised controlled trial of internet cognitive therapy for social anxiety disorder. Psychological Medicine. https://doi.org/10.1017/s0033291722002008
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.

