Cited by 41Anxiety, Depression, Psychometrics, Treatment, Cognitive ProcessesVirtual Reality Applications and ImpactsDigital Mental Health Interventions

Attention guidance augmentation of virtual reality exposure therapy for social anxiety disorder: a pilot randomized controlled trial

Open access
Rubin, Mikael, Muller, Karl, Hayhoe, Mary M., Telch, Michael J.·2022·Cognitive Behaviour Therapy

Published version of a preprint

Abstract

Biased attention to social threats has been implicated in social anxiety disorder. Modifying visual attention during exposure therapy offers a direct test of this mechanism. We developed and tested a brief virtual reality exposure therapy (VRET) protocol using 360°-video and eye tracking. Participants (N = 21) were randomized to either standard VRET or VRET + attention guidance training (AGT). Multilevel Bayesian models were used to test (1) whether there was an effect of condition over time and (2) whether post-treatment changes in gaze patterns mediated the effect of condition at follow-up. There was a large overall effect of the intervention on symptoms of social anxiety, as well as an effect of the AGT augmentation on changes in visual attention to audience members. There was weak evidence against an effect of condition on fear of public speaking and weak evidence supporting a mediation effect, however these estimates were strongly influenced by model priors. Taken together, our findings suggest that attention can be modified within and during VRET and that modification of visual gaze avoidance may be casually linked to reductions in social anxiety. Replication with a larger sample size is needed.

Integrity signals

Registry

Crossref · 10.1080/16506073.2022.2053882

Cites

42 of 42 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Claims the paper makes

0 of 25 cited sources checked · 0 supported · 0 flagged

  • Findingown data

    The evidence was weak against an effect of condition on fear of public speaking.

    “There was weak evidence against an effect of condition on fear of public speaking”
    Quote in the paperNot a substantial claim
  • Findingown data

    The attention guidance augmentation affected changes in visual attention to audience members.

    “as well as an effect of the AGT augmentation on changes in visual attention to audience members.”
    Quote in the paperSubstantial claim
  • Findingown data

    In this pilot trial, the intervention had a large overall effect on social anxiety symptoms.

    “There was a large overall effect of the intervention on symptoms of social anxiety”
    Quote in the paperSubstantial claim
  • Findingown data

    The evidence was weak in support of a mediation effect.

    “weak evidence supporting a mediation effect”
    Quote in the paperSubstantial claim
  • Findingnone given

    The mediation estimates were strongly influenced by the model priors.

    “however these estimates were strongly influenced by model priors.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim. 23
  • May combine two claims. 7
  • Classified as probably not a substantial claim. May combine two claims.

    Study design and conductown data

    The pilot trial randomly assigned 21 adults with social anxiety disorder to standard VRET or VRET plus attention guidance training (11 vs 10).

    “Participants (N = 21) were randomized to either standard VRET or VRET + attention guidance training (AGT).”
    • Also stated in: § Study Design · plain
      “Participants were randomly assigned to one of two conditions: (a) Virtual reality exposure therapy plus attention guidance training (VRET + AGT, n = 11) or (b) Standard virtual reality exposure therapy (VRET, n = 10).”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductown data

    The trial was registered under NCT03683823.

    “The trial was registered as “Efficacy of an Attention Guidance VR Intervention for Social Anxiety Disorder”, trial number: NCT03683823 and can be accessed through clinicaltrials.gov.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Study design and conductown data

    Randomization used balanced block randomization in R with a block size of four.

    “eligible participants were randomized (using a balanced block-randomization procedure conducted in R using the blockrand package (Snow & Snow, 2013) implemented by M.R.; block size was 4)”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Snow & Snow, 2013

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    The PRPSA is a 34-item measure of public speaking anxiety.

    “The PRPSA (McCroskey, 1970) is a 34-item instrument that is designed to assess public speaking anxiety.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites McCroskey, 1970

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Study design and conductown data

    The assessing clinician allocated participants and delivered treatment, and neither clinicians nor participants were blinded to condition after allocation or at follow-up.

    “The clinician that conducted the assessment also allocated the participant (they were not blind to the condition prior to allocation) and conducted the intervention. Neither the clinician nor participant were blind to the condition of the intervention following allocation or during the follow-up assessments.”
    • Also stated in: § Posttreatment Assessments · plain
      “Follow-up assessment clinicians were not blinded to intervention allocation.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    The LSAS self-report is a 48-item measure of fear and avoidance in social interactions and performance situations.

    “The LSAS self-report scale (Liebowitz, 1987) is a 48-item measure of fear and avoidance concerning social interactions and performance situations.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Liebowitz, 1987

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S2 (checkable), S4 (based).

    Interpretationnone given

    It is likely that interactions are an important ingredient to the efficacy of social exposures broadly.

    “it is likely that interactions are an important ingredient to the efficacy of social exposures broadly.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    There is evidence that non-interactive public speaking challenges with 360°-video can be an effective treatment modality (Reeves et al., 2021).

    “while there is evidence that non-interactive public speaking challenges with 360°-video can be an effective treatment modality (Reeves et al., 2021)”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Reeves et al., 2021

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductcitation

    The methods used for processing gaze data were the same as those previously used (Rubin et al., 2020).

    “The methods used for processing gaze data were the same as those previously used (Rubin et al., 2020)”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Rubin et al., 2020

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductnone given

    For the follow-up assessment, clinicians were not blind to the treatment condition.

    “Additionally, for the follow-up assessment, clinicians were not blind to the treatment condition.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductown data

    The study tested the sensitivity of priors using less informative and uninformative default priors.

    “We tested the sensitivity of the priors by using less informative (smaller effects) parameter estimates as well as uninformative default (flat) priors centered on zero to determine the influence of different priors on the posterior estimates.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductcitation

    The study computed Bayes Factors using the Savage-Dickey Density ratio (Wagenmakers et al., 2010).

    “We computed Bayes Factors (BFs) using the Savage-Dickey Density ratio (Wagenmakers et al., 2010) for all models where we set priors using the hypothesis function in brms.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Wagenmakers et al., 2010

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S2 (checkable).

    Premisecitation

    It can be useful to identify support for the null at early stages in testing potential treatment mechanisms (Elsey et al., 2020).

    “It can be useful to identify support for the null at early stages in testing potential treatment mechanisms (Elsey et al., 2020)”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Elsey et al., 2020

      Not checked in the free run.

  • May combine two claims.

    Premisecitation

    The study used a brief 2-session protocol because reduced efficacy compared with a full-length protocol makes it more feasible to test mechanisms (Niles et al., 2015).

    “We conducted a brief 2-session protocol, because the reduced efficacy compared with a full-length (e.g., 8-week) protocol makes it more feasible to test the influence of potential mechanisms (see for instance Niles et al., 2015).”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Niles et al., 2015

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductcitation

    The study partially standardized model coefficients following recommendations for indirect effect sizes when X is dichotomous (Hayes & Rockwood, 2017; Preacher & Kelley, 2011).

    “To facilitate interpretation of the mediation analysis, we partially standardized the model coefficients after completing the analyses using unstandardized variables following recommendations in the literature regarding indirect effect sizes when X is dichotomous (Hayes & Rockwood, 2017; Preacher & Kelley, 2011).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Hayes & Rockwood, 2017; Preacher & Kelley, 2011

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    The C-SSRS is a semi-structured clinician-administered measure of suicidality.

    “The C-SSRS (Posner et al., 2011) is a semi-structured clinician-administered measure to assess suicidality.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Posner et al., 2011

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    The SCID-5 is a semi-structured clinician-administered interview considered the gold standard for DSM-5 diagnoses.

    “The SCID-5 (First et al., 2015) is a semi-structured clinician administered interview that is the gold-standard for determining mental health diagnoses for DSM-5.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites First et al., 2015

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductown data

    A prior simulation power analysis indicated a sample size of 60 would be sufficient to detect a meaningful effect for both aims 1 and 2.

    “We had initially conducted a power analysis through a simulation study prior to COVID-19, which indicated a sample size of 60 would be sufficient to detect a meaningful effect for both aims 1 and 2.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable). May combine two claims.

    Interpretationreasoning

    These concerns suggest that ABM may work but its mechanism is unclear, so other ways to test attentional change in social anxiety treatment are needed.

    “Together, these concerns suggest that while ABM may be effective, the reason why is unclear, making it important to consider additional ways to test attentional change in the treatment of social anxiety.”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: Attention bias modification frequently fails to beat the attention control condition.
    • Rests on an assumption: Changes in clinical symptoms after ABM do not appear to correspond to changes in attention bias.
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductown data

    The study included average proportion of fixations to audience members during intervention sessions as a covariate to control for variation in treatment adherence.

    “In all models, we included average proportion of fixations to audience members during intervention sessions as a covariate to control for variation in treatment adherence.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    The SATI is a two-factor measure of maladaptive cognitions related to speech anxiety.

    “The SATI (Cho et al., 2004) is a two factor (prediction of poor performance and fear of negative evaluation by audience) instrument, measuring maladaptive cognitions associated with speech anxiety.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Cho et al., 2004

      Not checked in the free run.

  • May combine two claims.

    Study design and conductnone given

    The study did not assess presence during assessments or treatment, which may have played a role in limiting the efficacy of the intervention for some.

    “Moreover, we did not assess presence (the feeling that you are really ‘there’) during assessments or treatment, which may have played a role in limiting the efficacy of the intervention for some.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductcitation

    The study largely followed the WAMBS checklist (Depaoli & van de Schoot, 2017).

    “We largely followed the WAMBS (When to worry and how to Avoid the Misuse of Bayesian Statistics) checklist (Depaoli & van de Schoot, 2017).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Depaoli & van de Schoot, 2017

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductnone given

    No participant noticed that the same 360°-video was reused.

    “However, no participant observed that the same 360°-video was used multiple times.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim.

    Study design and conductcitation

    Fixations were detected using a well-established in-house algorithm (Kit et al., 2014; Li et al., 2016; Tong et al., 2017).

    “Fixations were detected using a well-established in-house algorithm (Kit et al., 2014; Li et al., 2016; Tong et al., 2017).”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Kit et al., 2014; Li et al., 2016; Tong et al., 2017

      Not checked in the free run.

25 of 25
  • The paper relies on this without support.

    Attention bias modification frequently fails to beat the attention control condition.

    “First, ABM does not often outperform the attention control condition (where the probe distribution is 50/50), making it unclear whether the attention bias being targeted is really responsible for the treatment effects.”
  • The paper relies on this without support.

    Changes in clinical symptoms after ABM do not appear to correspond to changes in attention bias.

    “Third, response to ABM in terms of clinical symptoms does not seem to be reflected in a change in attention bias.”
  • The paper relies on this without support.

    360°-video is more realistic than computer-generated digital avatars.

    “360°-video is more realistic than digital computer-generated avatars”
  • The paper relies on this without support.

    It is difficult to test attentional change directly within psychotherapy.

    “Directly testing attentional change in the context of psychotherapy is challenging.”
  • The paper relies on this without support.

    Clinicians cannot easily judge how much a patient looks at audience members during an in-person speech task.

    “it can be difficult, if not impossible, for a clinician to accurately assess the degree to which a patient is actually looking at audience members during an in vivo public speaking exposure, to assess the degree of attentional avoidance.”
  • The paper relies on this without support.

    Most VRET studies have used digital avatars.

    “while most VRET studies have used digital avatars”
  • The paper relies on this without support.

    Uninterested audience members in the 360° videos are perceived as socially threatening by participants.

    “We primarily evaluated the role of proportion of fixations to uninterested (socially threatening) audience members”
7 of 7

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Studies that had three or four sessions of VR intervention reported significant symptom reduction, as did studies that had many sessions over several weeks.

    “Studies that had three or four sessions of VR intervention reported significant symptom reduction (11, 32, 41), as did studies that had many sessions over several weeks (20, 42).”

    From A systematic review on the efficacy of virtual reality and gamification interventions for managing anxiety and depression (2023) · cites this paper as [11]

    The Methods (Intervention) state that this trial used two 45-minute VRET sessions over one week, not three or four sessions or many sessions over several weeks. The Results (Effects of Virtual Reality Exposure Therapy) report reductions in fear of public speaking and social anxiety symptoms, but under that two-session protocol. (LLM, conf=0.88)

    Checked by a reasoning model — may be wrong.

    Experimental — accuracy not yet measured
  • VR interventions can provide simulated social environments, allowing individuals to engage in exposure therapy and practice social skills in a controlled and supportive setting.

    “VR interventions can provide simulated social environments, allowing individuals to engage in exposure therapy and practice social skills in a controlled and supportive setting (11).”

    From A systematic review on the efficacy of virtual reality and gamification interventions for managing anxiety and depression (2023) · cites this paper as [11]

    Methods (Materials and Intervention; page numbers unavailable) describes a controlled VR audience and clinician-led, repeated public-speaking exposures, supporting the simulated social setting and exposure-therapy portions of the claim. It does not describe social-skills practice beyond public speaking; the Discussion specifically calls the VR challenge non-interactive. The broader claim about practicing social skills in a supportive setting is therefore not fully supported. (LLM, conf=0.84)

    Experimental — accuracy not yet measured
  • Twelve of the 15 included studies found a positive treatment outcome, evidenced by a statistical decrease in symptoms of depression.

    “Twelve studies found a positive treatment outcome, as evidenced by a statistical decrease in symptoms of depression (7–13, 20, 24, 32, 41, 42).”

    From A systematic review on the efficacy of virtual reality and gamification interventions for managing anxiety and depression (2023) · cites this paper as [11]

    The Results section (Effects of Virtual Reality Exposure Therapy; page unavailable) reports post-treatment reductions in fear of public speaking and general social anxiety symptoms, supporting a positive treatment outcome for this study. The Methods (Measures; page unavailable) lists anxiety-related measures, not a depression outcome, and the paper does not report a statistical decrease in depressive symptoms. As one of the cited studies, it also cannot establish the citing paper’s aggregate count of twelve. (LLM, conf=0.84)

    Experimental — accuracy not yet measured
  • Some studies suffered from small sample sizes, which hindered the ability to conduct statistically powerful analyses and direct comparisons between groups.

    “Additionally, some studies suffered from small sample sizes, which hindered the ability to conduct statistically powerful analyses and direct comparisons between groups (9, 11, 24).”

    From A systematic review on the efficacy of virtual reality and gamification interventions for managing anxiety and depression (2023) · cites this paper as [11]

    The Methods (Power analysis; page unavailable) say recruitment ended before the planned sample of 60 was reached, and the Discussion says the small sample may have limited detection of an indirect effect. But the paper reports that it conducted a meaningful Bayesian analysis and made direct comparisons between treatment groups, so it does not support the claim that sample size hindered its ability to conduct those comparisons. (LLM, conf=0.86)

    Experimental — accuracy not yet measured
  • The majority of the studies have implemented gamification and persuasive technology features in VR interventions specifically targeting anxiety and depression.

    “The majority of the studies have implemented gamification and persuasive technology features in VR interventions specifically targeting anxiety and depression (7, 8, 10–13, 20, 32, 41, 42, 44).”

    From A systematic review on the efficacy of virtual reality and gamification interventions for managing anxiety and depression (2023) · cites this paper as [11]

    The Methods > Intervention passage describes a VR intervention for social anxiety that gave participants gaze-percentage feedback and encouragement, supporting this paper as an example of an intervention with a guidance feature. It does not establish that a majority of studies used gamification or persuasive-technology features, and this trial targeted social anxiety, not depression. Page numbers were not available in our copy. (LLM, conf=0.84)

    Experimental — accuracy not yet measured

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

  • Bayes-factor calculation conflicts with its interpretation

    Minor

    The stated calculation-posterior density divided by prior density at the null-makes a value of 0.28 evidence against the null. The paper instead calls that value evidence against a group effect, which reverses its stated Bayes-factor convention.

  • Anecdotal-evidence rule conflicts with reported evidence

    Minor

    The stated rule classifies every BF below 3, including 0.28, as only anecdotal evidence. The results instead describe BF = 0.28 as moderate evidence. The rule's "or > .33" clause would also classify large Bayes factors as anecdotal.

2 of 2

Cites

Flagged first, then by citations

Research works printed but not linked: 1

  1. First M. B., 2015, Structured clinical interview for DSM-5 research version

Cited by

Sorted by citations

Authors
Rubin, M., Muller, K., Hayhoe, M. M., & Telch, M. J.
Affiliations
The University of Texas at Austin (US)
Corresponding author
Rubin, Mikael
Venue
Cognitive Behaviour Therapy
Published
2022-04-06
Volume
51
Issue
5
Pages
371-387
ISSN
  • 1650-6073 (ISSN-L)
  • 1651-2316
OpenAlex
W4226119107
Cited by
38
References
36
Citations by year
2026: 11 · 2025: 7 · 2024: 8 · 2023: 10 · 2022: 1 · 2021: 1
FWCI
5.98
Type
journal article
Language
en
Open access
Licence
cc-by
Locations
  • Cognitive Behaviour Therapy (publishedVersion)
  • PubMed (publishedVersion)
  • PubMed Central (acceptedVersion)
  • OSF Preprints (OSF Preprints) (submittedVersion)
  • OSF Preprints (OSF Preprints) (submittedVersion, cc-by)
Funders
  • National Eye Institute
  • National Institute of Mental Health
Topics
  • Social Sciences › Psychology › Experimental and Cognitive Psychology › Anxiety, Depression, Psychometrics, Treatment, Cognitive Processes
  • Physical Sciences › Computer Science › Human-Computer Interaction › Virtual Reality Applications and Impacts
  • Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
Keywords
virtual reality exposure therapy, social anxiety disorder, visual attention, gaze avoidance, eye tracking, 360-degree video, public speaking anxiety
MeSH terms
Phobia, Social, Bayes Theorem, Humans, Pilot Projects, Virtual Reality Exposure Therapy

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Claims read under definition version 3 (extract-v3) on 2026-09-28.

Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-09-28.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review