Attention guidance augmentation of virtual reality exposure therapy for social anxiety disorder: a pilot randomized controlled trial
Open accessPublished version of a preprint
Abstract
Biased attention to social threats has been implicated in social anxiety disorder. Modifying visual attention during exposure therapy offers a direct test of this mechanism. We developed and tested a brief virtual reality exposure therapy (VRET) protocol using 360°-video and eye tracking. Participants (N = 21) were randomized to either standard VRET or VRET + attention guidance training (AGT). Multilevel Bayesian models were used to test (1) whether there was an effect of condition over time and (2) whether post-treatment changes in gaze patterns mediated the effect of condition at follow-up. There was a large overall effect of the intervention on symptoms of social anxiety, as well as an effect of the AGT augmentation on changes in visual attention to audience members. There was weak evidence against an effect of condition on fear of public speaking and weak evidence supporting a mediation effect, however these estimates were strongly influenced by model priors. Taken together, our findings suggest that attention can be modified within and during VRET and that modification of visual gaze avoidance may be casually linked to reductions in social anxiety. Replication with a larger sample size is needed.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
0 of 25 cited sources checked · 0 supported · 0 flagged
- Findingown data
The evidence was weak against an effect of condition on fear of public speaking.
“There was weak evidence against an effect of condition on fear of public speaking”
Quote in the paperNot a substantial claim - Findingown data
The attention guidance augmentation affected changes in visual attention to audience members.
“as well as an effect of the AGT augmentation on changes in visual attention to audience members.”
Quote in the paperSubstantial claim - Findingown data
In this pilot trial, the intervention had a large overall effect on social anxiety symptoms.
“There was a large overall effect of the intervention on symptoms of social anxiety”
Quote in the paperSubstantial claim - Findingown data
The evidence was weak in support of a mediation effect.
“weak evidence supporting a mediation effect”
Quote in the paperSubstantial claim - Findingnone given
The mediation estimates were strongly influenced by the model priors.
“however these estimates were strongly influenced by model priors.”
Quote in the paperSubstantial claim
- Findingown data
There was no meaningful difference between groups in overall change in proportion of fixations to uninterested audience members at one-week follow-up (b = 0.23, 95% HDI [−0.08, 0.53], BF = 2.00).
“or at one-week follow-up b = 0.23, 95% HDI [−0.08, 0.53], BF = 2.00.”
Quote in the paperNot a substantial claim - Findingown data
In the attention-guidance condition, participants allocated a greater proportion of gaze to audience members during treatment than in the standard-exposure condition (b = 0.27, 95% HDI [0.11, 0.41], BF = 70.14).
“There were meaningful differences in the proportion of gaze allocated to audience members during treatment in the standard-exposure compared to attention-guidance conditions b = 0.27, 95% highest posterior density interval (HDI) [0.11, 0.41], Bayes Factor (BF) = 70.14, with greater gaze allocated to audience members in the attention-guidance condition during the intervention trials.”
- Also stated in: § Discussion · hedged
“Additionally, our data indicated that there was reduced avoidance of all audience members in the attention augmentation group.”
Quote in the paperSubstantial claim - Also stated in: § Discussion · hedged
- Findingown data
There was no effect of group on general social anxiety symptoms at one-week follow-up (b = −3.20, 95% HDI [−15.27, 22.15], BF = 0.44).
“or one-week follow-up b = −3.20, 95% HDI [−15.27, 22.15], BF = 0.44.”
Quote in the paperSubstantial claim - Findingown data
There was no effect of group on fear of public speaking at one-week follow-up (b = 3.19, 95% HDI [−10.16, 16.57], BF = 0.37).
“or at one-week follow-up b = 3.19, 95% HDI [−10.16, 16.57], BF = 0.37.”
Quote in the paperSubstantial claim - Findingown data
There was a meaningful group × assessment interaction on proportion of fixations to uninterested audience members at post-treatment (b = 0.16, 95% HDI [0.07, 0.26], BF = 2.52).
“There was a meaningful group (VRET vs. VRET + attention guidance) × assessment interaction at post-treatment b = 0.16, 95% HDI [0.07, 0.26], BF = 2.52”
Quote in the paperNot a substantial claim - Findingown data
There was a large effect of time for general symptoms of social anxiety at 1-week follow-up (b = −21.99, 95% HDI [−29.08, −14.70], BF = 615.78, dGMA-raw = −2.07, 95% HDI [−2.94, −1.16]).
“and large effect at 1-week follow-up b = −21.99, 95% HDI [−29.08, −14.70], BF = 615.78, dGMA-raw = −2.07 95% HDI [−2.94, −1.16].”
Quote in the paperSubstantial claim - Findingown data
There was no effect of group on fear of public speaking at post-treatment (b = 6.14, 95% HDI [−1.57, 13.95], BF = 0.38).
“Moreover, we did find not find an effect of group at post-treatment b = 6.14, 95% HDI [−1.57, 13.95], BF = 0.38”
Quote in the paperSubstantial claim - Findingown data
Greater proportion of fixations to uninterested audience members at post-treatment mediated the effect of group on general symptoms of social anxiety at one-week follow-up, with anecdotal evidence (partially standardized indirect effect = −0.097, 95% HDI [−0.197, −0.024], BF = 1.58).
“or general symptoms of social anxiety (partially standardized indirect effect = −0.097, 95% HDI −0.197, −0.024], BF = 1.58) at the one-week follow-up.”
Quote in the paperNot a substantial claim- Rests on an assumption: Uninterested audience members in the 360° videos are perceived as socially threatening by participants.
- Findingown data
There was a moderate main effect of time for general symptoms of social anxiety at post-intervention (b = −11.72, 95% HDI [−18.61, −4.58], BF = 6.45, dGMA-raw = −0.60, 95% HDI [−1.02, −0.15]).
“We found a moderate main effect of time for general symptoms of social anxiety at post-intervention b = −11.72, 95% HDI [−18.61, −4.58], Bayes Factor (BF) = 6.45, dGMA-raw = −0.60 95% HDI [−1.02, −0.15]”
Quote in the paperSubstantial claim - Findingown data
There was no main effect of group on proportion of fixations to uninterested audience members (b = 0.09, 95% HDI [−0.30, 0.48], BF = 1.02).
“There was also no main effect of group b = 0.09, 95% HDI [−0.30, 0.48], BF = 1.02.”
Quote in the paperNot a substantial claim - Findingown data
There was a large main effect of time on fear of public speaking at 1-week follow-up (b = −13.16, 95% HDI [−21.28, −9.01], BF = 26.14, dGMA-raw = −1.68, 95% HDI [−2.68, −0.70]).
“and at 1-week follow-up b = −13.16, 95% HDI [−21.28, −9.01], BF = 26.14, dGMA-raw = −1.68, 95% HDI [−2.68, −0.70].”
Quote in the paperSubstantial claim - Findingown data
There was no meaningful difference between groups in overall change in proportion of fixations to uninterested (socially threatening) audience members at post-treatment (b = 0.14, 95% HDI [−0.16, 0.44], BF = 1.02).
“There were no meaningful differences in the overall change in proportion of fixations to uninterested (socially threatening) audience members at post-treatment b = 0.14, 95% HDI [−0.16, 0.44], BF = 1.02”
Quote in the paperNot a substantial claim - Findingown data
There was moderate evidence against a main effect of group on fear of public speaking (b = −5.55, 95% HDI [−13.88, 2.53], BF = 0.28).
“We found moderate evidence against a main effect of group (standard exposure vs. attention augmentation) on fear of public speaking b = −5.55, 95% HDI [−13.88, 2.53], BF = 0.28.”
Quote in the paperSubstantial claim - Findingown data
Greater proportion of fixations to uninterested audience members at post-treatment mediated the effect of group on fear of public speaking at one-week follow-up, with anecdotal evidence (partially standardized indirect effect = −0.218, 95% HDI [−0.605, 0.026], BF = 2.85).
“We found anecdotal evidence (based on the BFs) that greater proportion of fixations to Uninterested audience members at the post-treatment assessment, mediated the effect of group (standard exposure vs. attention guidance augmentation) on fear of public speaking (partially standardized indirect effect = −0.218, 95% HDI [−0.605, 0.026], BF = 2.85)”
Quote in the paperNot a substantial claim- Rests on an assumption: Uninterested audience members in the 360° videos are perceived as socially threatening by participants.
- Findingown data
There was no main effect of group on general social anxiety symptoms (b = −4.86, 95% HDI [−17.08, 11.48], BF = 0.84).
“We did not find a main effect of group on general social anxiety symptoms b = −4.86, 95% HDI [−17.08, 11.48], BF = 0.84”
Quote in the paperSubstantial claim - Findingnone given
In the current context, the divergence between gaze and head orientation was sufficiently large to make comparisons between them extremely problematic.
“In the current context the divergence between gaze and head orientation was sufficiently large to make such comparisons extremely problematic.”
Quote in the paperNot a substantial claim - Findingown data
There was no effect of group on general social anxiety symptoms at post-treatment (b = −2.05, 95% HDI [−13.48, 18.18], BF = 0.24).
“similarly, we found no effect of group at post-treatment b = −2.05, 95% HDI [−13.48, 18.18], BF = 0.24”
Quote in the paperSubstantial claim - Findingown data
The estimation of the indirect effect had a large degree of bias.
“the large degree of bias further emphasizes the importance of obtaining a larger sample to evaluate the stability of the estimates of these effects.”
Quote in the paperSubstantial claim - Findingown data
There was a large main effect of time on fear of public speaking, with a meaningful reduction post-treatment (b = −17.37, 95% HDI [−21.64, −9.63], BF = 510.80, dGMA-raw = −1.11, 95% HDI [−1.58, −0.63]).
“There was a large main effect of time on fear of public speaking, with a meaningful reduction in fear of public speaking post-treatment b = −17.37, 95% highest posterior density interval (HDI) [−21.64, −9.63], Bayes Factor (BF) = 510.80, dGMA-raw = −1.11, 95% HDI [−1.58, −0.63]”
Quote in the paperSubstantial claim - Findingown data
Across groups, there was a large reduction in cognitions related to public speaking anxiety.
“There was a large reduction in fear of public speaking, general symptoms of social anxiety, and cognitions related to public speaking anxiety across groups.”
Quote in the paperNot a substantial claim - Findingown data
There was a meaningful group × assessment interaction on proportion of fixations to uninterested audience members at one-week follow-up (b = 0.30, 95% HDI [0.20, 0.39], BF = 0.91).
“and at one-week follow-up b = 0.30, 95% HDI [0.20, 0.39], BF = 0.91.”
Quote in the paperNot a substantial claim - Interpretationown data
It is possible to change attention during a course of VRET.
“our findings suggest that attention can be modified within and during VRET”
Quote in the paperSubstantial claim - Interpretationreasoning
Less avoidance of looking at others may lead to lower social anxiety.
“modification of visual gaze avoidance may be casually linked to reductions in social anxiety.”
Quote in the paperSubstantial claim - Premisecitation
VRET is a highly effective intervention for social anxiety disorder.
“There is substantial evidence that virtual reality exposure therapy (VRET) for SAD is a highly effective intervention modality (Carl et al., 2019; Chesham et al., 2018).”
Quote in the paperSubstantial claim0 of 2 sources checked- cites Carl et al., 2019
Not checked in the free run.
- cites Chesham et al., 2018
Not checked in the free run.
- Study design and conductown data
The groups did not differ meaningfully at baseline.
“there were no meaningful differences between groups at baseline”
Quote in the paperSubstantial claim - Premisecitation
Recent work has shown that 360°-video VRET is effective.
“Recent research has demonstrated the use of 360°-video for VRET to be effective (Reeves et al., 2021).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Reeves et al., 2021
Not checked in the free run.
- Interpretationreasoning
Changing visual attention during exposure therapy provides a direct way to test whether biased attention is a mechanism in social anxiety disorder.
“Modifying visual attention during exposure therapy offers a direct test of this mechanism.”
Quote in the paperSubstantial claim - Premisecitation
Attention bias modification has moderate efficacy for reducing social anxiety symptoms.
“Results from Attention Bias Modification (ABM) have been promising with meta-analysis indicating that it has moderate efficacy for reducing symptoms of social anxiety (Heeren, Mogoase, et al., 2015).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Heeren, Mogoase, et al., 2015
Not checked in the free run.
- Premisecitation
Within people with social anxiety, attentional bias is not consistently present.
“there is some evidence that within individuals with social anxiety there is no consistent attentional bias (Kruijt et al., 2019).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Kruijt et al., 2019
Not checked in the free run.
- Premisecitation
Attentional biases, including avoidance of social threat, are implicated in social anxiety disorder.
“Biased attention to social threat has been implicated in social anxiety disorder.”
- Also stated in: § Abstract · plain
“Attentional processes figure prominently in most contemporary models of SAD (Clark & Wells, 1995; Wong & Rapee, 2016) and have been the focus of considerable empirical work (Bögels & Mansell, 2004).”
Quote in the paperSubstantial claim0 of 3 sources checked- cites Clark & Wells, 1995
Not checked in the free run.
- cites Wong & Rapee, 2016
Not checked in the free run.
- cites Bögels & Mansell, 2004
Not checked in the free run.
- Also stated in: § Abstract · plain
- Premisecitation
Avoidance of social threat may maintain social anxiety disorder.
“Both theoretical models of Social Anxiety Disorder (Clark & Wells, 1995; Wong & Rapee, 2016) and some prior research (Kim et al., 2018; Rubin et al., 2020) support the hypothesis that avoidance of social threat may serve as a maintaining factor of the disorder.”
Quote in the paperSubstantial claim0 of 3 sources checked- cites Clark & Wells, 1995
Not checked in the free run.
- cites Wong & Rapee, 2016
Not checked in the free run.
- cites Kim et al., 2018
Not checked in the free run.
- Interpretationown data
The findings offer further validation that VRET for social anxiety disorder is a highly effective treatment.
“Taken together our findings offer further validation that VRET for social anxiety disorder is a highly effective treatment.”
Quote in the paperSubstantial claim - Study design and conductreasoning
The sample size of the current study may have limited the possibility of detecting the indirect effect.
“It is important to acknowledge that the sample size of the current study may have limited the possibility of detecting this indirect effect.”
Quote in the paperSubstantial claim - Interpretationown data
There was anecdotal evidence in favor of the null hypothesis that there was no difference between the two intervention groups.
“There was anecdotal (based on the BFs) evidence in favor of the null (that there was no difference between the two intervention groups).”
Quote in the paperSubstantial claim - Study design and conductown data
The study did not conduct a power analysis reflecting the sample size for the current pilot study.
“We did not conduct a power analysis that reflected the sample size for the current pilot study.”
Quote in the paperSubstantial claim - Interpretationreasoning
Virtual environments with eye tracking can overcome the difficulty of assessing attention during in vivo exposure.
“However, this difficulty can be addressed with virtual environments that incorporate eye tracking.”
Quote in the paperSubstantial claim- Rests on an assumption: Clinicians cannot easily judge how much a patient looks at audience members during an in-person speech task.
- Interpretationown data
Evidence regarding decreased avoidance as a potential mechanism maintaining social anxiety was slight.
“However, evidence regarding decreased avoidance as a potential mechanism maintaining social anxiety was slight.”
Quote in the paperSubstantial claim - Interpretationown data
The results provide very weak evidence supporting the role of attention change on symptoms of fear of public speaking and general social anxiety.
“Taken together our results suggest that there is very weak evidence supporting the role of attention change on symptoms of fear of public speaking and general social anxiety, but further research is needed with larger samples.”
Quote in the paperSubstantial claim - Study design and conductreasoning
Due to COVID-19, enrollment ended before recruitment goals were met.
“However, due to COVID-19 enrollment ended before we could meet our recruitment goals.”
Quote in the paperSubstantial claim - Study design and conductnone given
The study did not include at baseline a non-socially anxious group to confirm the presence of biased attention among individuals with social anxiety.
“Second, we did not include at baseline a non-socially anxious group to confirm the presence of biased attention among individuals with social anxiety.”
Quote in the paperNot a substantial claim - Interpretationown data
The findings highlight the utility of a Bayesian approach as the study was able to conduct a meaningful analysis despite a small sample size.
“Our findings highlight the utility of a Bayesian approach as we were able to conduct a meaningful analysis despite a small sample size and interpret our ambiguous findings in a way that serves to inform future research.”
Quote in the paperSubstantial claim - Interpretationreasoning
A virtual reality setting makes it feasible to directly test whether attentional avoidance is causally involved in maintaining social anxiety disorder.
“A virtual reality context makes it practicable to directly test whether attentional avoidance is causally implicated as a mechanism maintaining SAD.”
Quote in the paperSubstantial claim- Rests on an assumption: It is difficult to test attentional change directly within psychotherapy.
- Rests on an assumption: Clinicians cannot easily judge how much a patient looks at audience members during an in-person speech task.
- Interpretationown data
The intervention engaged the target mechanism: the exposure augmentation led to a meaningful change in attention allocation, with substantially greater proportion of gaze toward uninterested audience members compared to the standard exposure group following the intervention.
“There was strong evidence that our intervention engaged the target mechanism - the exposure augmentation led to a meaningful change in attention allocation, with a substantially greater proportion of gaze toward uninterested (socially threatening) audience members compared to the standard exposure group following the intervention.”
Quote in the paperSubstantial claim - Interpretationown data
Preliminary evidence does not support an effect of the attention guidance augmentation on fear of public speaking or general symptoms of social anxiety.
“However, preliminary evidence does not support the presence of an effect of the attention guidance augmentation on fear of public speaking or general symptoms of social anxiety.”
Quote in the paperSubstantial claim - Interpretationown data
Attentional processes can be directly altered during exposure therapy.
“Additionally, we showed that attentional processes can be directly altered during exposure therapy.”
Quote in the paperSubstantial claim - Study design and conductreasoning
The study screened participants based on self-reported fear following the pre-treatment public speaking challenge to ensure responsivity to the 360°-video stimuli during VRET.
“Finally, we screened participants based on their self-reported fear following the pre-treatment public speaking challenge. This was to ensure responsivity to the 360°-video stimuli during VRET.”
Quote in the paperSubstantial claim
- Classified as probably not a substantial claim. 23
- May combine two claims. 7
Classified as probably not a substantial claim. May combine two claims.
Study design and conductown dataThe pilot trial randomly assigned 21 adults with social anxiety disorder to standard VRET or VRET plus attention guidance training (11 vs 10).
“Participants (N = 21) were randomized to either standard VRET or VRET + attention guidance training (AGT).”
- Also stated in: § Study Design · plain
“Participants were randomly assigned to one of two conditions: (a) Virtual reality exposure therapy plus attention guidance training (VRET + AGT, n = 11) or (b) Standard virtual reality exposure therapy (VRET, n = 10).”
Quote in the paperSubstantial claim- Also stated in: § Study Design · plain
Probably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductown dataThe trial was registered under NCT03683823.
“The trial was registered as “Efficacy of an Attention Guidance VR Intervention for Social Anxiety Disorder”, trial number: NCT03683823 and can be accessed through clinicaltrials.gov.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Study design and conductown dataRandomization used balanced block randomization in R with a block size of four.
“eligible participants were randomized (using a balanced block-randomization procedure conducted in R using the blockrand package (Snow & Snow, 2013) implemented by M.R.; block size was 4)”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Snow & Snow, 2013
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationThe PRPSA is a 34-item measure of public speaking anxiety.
“The PRPSA (McCroskey, 1970) is a 34-item instrument that is designed to assess public speaking anxiety.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites McCroskey, 1970
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Study design and conductown dataThe assessing clinician allocated participants and delivered treatment, and neither clinicians nor participants were blinded to condition after allocation or at follow-up.
“The clinician that conducted the assessment also allocated the participant (they were not blind to the condition prior to allocation) and conducted the intervention. Neither the clinician nor participant were blind to the condition of the intervention following allocation or during the follow-up assessments.”
- Also stated in: § Posttreatment Assessments · plain
“Follow-up assessment clinicians were not blinded to intervention allocation.”
Quote in the paperNot a substantial claim- Also stated in: § Posttreatment Assessments · plain
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationThe LSAS self-report is a 48-item measure of fear and avoidance in social interactions and performance situations.
“The LSAS self-report scale (Liebowitz, 1987) is a 48-item measure of fear and avoidance concerning social interactions and performance situations.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Liebowitz, 1987
Not checked in the free run.
Probably not a substantial claim: may not pass S2 (checkable), S4 (based).
Interpretationnone givenIt is likely that interactions are an important ingredient to the efficacy of social exposures broadly.
“it is likely that interactions are an important ingredient to the efficacy of social exposures broadly.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationThere is evidence that non-interactive public speaking challenges with 360°-video can be an effective treatment modality (Reeves et al., 2021).
“while there is evidence that non-interactive public speaking challenges with 360°-video can be an effective treatment modality (Reeves et al., 2021)”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Reeves et al., 2021
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductcitationThe methods used for processing gaze data were the same as those previously used (Rubin et al., 2020).
“The methods used for processing gaze data were the same as those previously used (Rubin et al., 2020)”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Rubin et al., 2020
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductnone givenFor the follow-up assessment, clinicians were not blind to the treatment condition.
“Additionally, for the follow-up assessment, clinicians were not blind to the treatment condition.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductown dataThe study tested the sensitivity of priors using less informative and uninformative default priors.
“We tested the sensitivity of the priors by using less informative (smaller effects) parameter estimates as well as uninformative default (flat) priors centered on zero to determine the influence of different priors on the posterior estimates.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductcitationThe study computed Bayes Factors using the Savage-Dickey Density ratio (Wagenmakers et al., 2010).
“We computed Bayes Factors (BFs) using the Savage-Dickey Density ratio (Wagenmakers et al., 2010) for all models where we set priors using the hypothesis function in brms.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Wagenmakers et al., 2010
Not checked in the free run.
Probably not a substantial claim: may not pass S2 (checkable).
PremisecitationIt can be useful to identify support for the null at early stages in testing potential treatment mechanisms (Elsey et al., 2020).
“It can be useful to identify support for the null at early stages in testing potential treatment mechanisms (Elsey et al., 2020)”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Elsey et al., 2020
Not checked in the free run.
May combine two claims.
PremisecitationThe study used a brief 2-session protocol because reduced efficacy compared with a full-length protocol makes it more feasible to test mechanisms (Niles et al., 2015).
“We conducted a brief 2-session protocol, because the reduced efficacy compared with a full-length (e.g., 8-week) protocol makes it more feasible to test the influence of potential mechanisms (see for instance Niles et al., 2015).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Niles et al., 2015
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductcitationThe study partially standardized model coefficients following recommendations for indirect effect sizes when X is dichotomous (Hayes & Rockwood, 2017; Preacher & Kelley, 2011).
“To facilitate interpretation of the mediation analysis, we partially standardized the model coefficients after completing the analyses using unstandardized variables following recommendations in the literature regarding indirect effect sizes when X is dichotomous (Hayes & Rockwood, 2017; Preacher & Kelley, 2011).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Hayes & Rockwood, 2017; Preacher & Kelley, 2011
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationThe C-SSRS is a semi-structured clinician-administered measure of suicidality.
“The C-SSRS (Posner et al., 2011) is a semi-structured clinician-administered measure to assess suicidality.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Posner et al., 2011
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
PremisecitationThe SCID-5 is a semi-structured clinician-administered interview considered the gold standard for DSM-5 diagnoses.
“The SCID-5 (First et al., 2015) is a semi-structured clinician administered interview that is the gold-standard for determining mental health diagnoses for DSM-5.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites First et al., 2015
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductown dataA prior simulation power analysis indicated a sample size of 60 would be sufficient to detect a meaningful effect for both aims 1 and 2.
“We had initially conducted a power analysis through a simulation study prior to COVID-19, which indicated a sample size of 60 would be sufficient to detect a meaningful effect for both aims 1 and 2.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable). May combine two claims.
InterpretationreasoningThese concerns suggest that ABM may work but its mechanism is unclear, so other ways to test attentional change in social anxiety treatment are needed.
“Together, these concerns suggest that while ABM may be effective, the reason why is unclear, making it important to consider additional ways to test attentional change in the treatment of social anxiety.”
Quote in the paperNot a substantial claim- Rests on an assumption: Attention bias modification frequently fails to beat the attention control condition.
- Rests on an assumption: Changes in clinical symptoms after ABM do not appear to correspond to changes in attention bias.
Probably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductown dataThe study included average proportion of fixations to audience members during intervention sessions as a covariate to control for variation in treatment adherence.
“In all models, we included average proportion of fixations to audience members during intervention sessions as a covariate to control for variation in treatment adherence.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationThe SATI is a two-factor measure of maladaptive cognitions related to speech anxiety.
“The SATI (Cho et al., 2004) is a two factor (prediction of poor performance and fear of negative evaluation by audience) instrument, measuring maladaptive cognitions associated with speech anxiety.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Cho et al., 2004
Not checked in the free run.
May combine two claims.
Study design and conductnone givenThe study did not assess presence during assessments or treatment, which may have played a role in limiting the efficacy of the intervention for some.
“Moreover, we did not assess presence (the feeling that you are really ‘there’) during assessments or treatment, which may have played a role in limiting the efficacy of the intervention for some.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductcitationThe study largely followed the WAMBS checklist (Depaoli & van de Schoot, 2017).
“We largely followed the WAMBS (When to worry and how to Avoid the Misuse of Bayesian Statistics) checklist (Depaoli & van de Schoot, 2017).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Depaoli & van de Schoot, 2017
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductnone givenNo participant noticed that the same 360°-video was reused.
“However, no participant observed that the same 360°-video was used multiple times.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim.
Study design and conductcitationFixations were detected using a well-established in-house algorithm (Kit et al., 2014; Li et al., 2016; Tong et al., 2017).
“Fixations were detected using a well-established in-house algorithm (Kit et al., 2014; Li et al., 2016; Tong et al., 2017).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Kit et al., 2014; Li et al., 2016; Tong et al., 2017
Not checked in the free run.
The paper relies on this without support.
Attention bias modification frequently fails to beat the attention control condition.
“First, ABM does not often outperform the attention control condition (where the probe distribution is 50/50), making it unclear whether the attention bias being targeted is really responsible for the treatment effects.”
The paper relies on this without support.
Changes in clinical symptoms after ABM do not appear to correspond to changes in attention bias.
“Third, response to ABM in terms of clinical symptoms does not seem to be reflected in a change in attention bias.”
The paper relies on this without support.
360°-video is more realistic than computer-generated digital avatars.
“360°-video is more realistic than digital computer-generated avatars”
The paper relies on this without support.
It is difficult to test attentional change directly within psychotherapy.
“Directly testing attentional change in the context of psychotherapy is challenging.”
The paper relies on this without support.
Clinicians cannot easily judge how much a patient looks at audience members during an in-person speech task.
“it can be difficult, if not impossible, for a clinician to accurately assess the degree to which a patient is actually looking at audience members during an in vivo public speaking exposure, to assess the degree of attentional avoidance.”
The paper relies on this without support.
Most VRET studies have used digital avatars.
“while most VRET studies have used digital avatars”
The paper relies on this without support.
Uninterested audience members in the 360° videos are perceived as socially threatening by participants.
“We primarily evaluated the role of proportion of fixations to uninterested (socially threatening) audience members”
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Studies that had three or four sessions of VR intervention reported significant symptom reduction, as did studies that had many sessions over several weeks.
“Studies that had three or four sessions of VR intervention reported significant symptom reduction (11, 32, 41), as did studies that had many sessions over several weeks (20, 42).”
From A systematic review on the efficacy of virtual reality and gamification interventions for managing anxiety and depression (2023) · cites this paper as [11]
The Methods (Intervention) state that this trial used two 45-minute VRET sessions over one week, not three or four sessions or many sessions over several weeks. The Results (Effects of Virtual Reality Exposure Therapy) report reductions in fear of public speaking and social anxiety symptoms, but under that two-session protocol. (LLM, conf=0.88)
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredVR interventions can provide simulated social environments, allowing individuals to engage in exposure therapy and practice social skills in a controlled and supportive setting.
“VR interventions can provide simulated social environments, allowing individuals to engage in exposure therapy and practice social skills in a controlled and supportive setting (11).”
From A systematic review on the efficacy of virtual reality and gamification interventions for managing anxiety and depression (2023) · cites this paper as [11]
Methods (Materials and Intervention; page numbers unavailable) describes a controlled VR audience and clinician-led, repeated public-speaking exposures, supporting the simulated social setting and exposure-therapy portions of the claim. It does not describe social-skills practice beyond public speaking; the Discussion specifically calls the VR challenge non-interactive. The broader claim about practicing social skills in a supportive setting is therefore not fully supported. (LLM, conf=0.84)
Experimental — accuracy not yet measuredTwelve of the 15 included studies found a positive treatment outcome, evidenced by a statistical decrease in symptoms of depression.
“Twelve studies found a positive treatment outcome, as evidenced by a statistical decrease in symptoms of depression (7–13, 20, 24, 32, 41, 42).”
From A systematic review on the efficacy of virtual reality and gamification interventions for managing anxiety and depression (2023) · cites this paper as [11]
The Results section (Effects of Virtual Reality Exposure Therapy; page unavailable) reports post-treatment reductions in fear of public speaking and general social anxiety symptoms, supporting a positive treatment outcome for this study. The Methods (Measures; page unavailable) lists anxiety-related measures, not a depression outcome, and the paper does not report a statistical decrease in depressive symptoms. As one of the cited studies, it also cannot establish the citing paper’s aggregate count of twelve. (LLM, conf=0.84)
Experimental — accuracy not yet measuredSome studies suffered from small sample sizes, which hindered the ability to conduct statistically powerful analyses and direct comparisons between groups.
“Additionally, some studies suffered from small sample sizes, which hindered the ability to conduct statistically powerful analyses and direct comparisons between groups (9, 11, 24).”
From A systematic review on the efficacy of virtual reality and gamification interventions for managing anxiety and depression (2023) · cites this paper as [11]
The Methods (Power analysis; page unavailable) say recruitment ended before the planned sample of 60 was reached, and the Discussion says the small sample may have limited detection of an indirect effect. But the paper reports that it conducted a meaningful Bayesian analysis and made direct comparisons between treatment groups, so it does not support the claim that sample size hindered its ability to conduct those comparisons. (LLM, conf=0.86)
Experimental — accuracy not yet measuredThe majority of the studies have implemented gamification and persuasive technology features in VR interventions specifically targeting anxiety and depression.
“The majority of the studies have implemented gamification and persuasive technology features in VR interventions specifically targeting anxiety and depression (7, 8, 10–13, 20, 32, 41, 42, 44).”
From A systematic review on the efficacy of virtual reality and gamification interventions for managing anxiety and depression (2023) · cites this paper as [11]
The Methods > Intervention passage describes a VR intervention for social anxiety that gave participants gaze-percentage feedback and encouragement, supporting this paper as an example of an intervention with a guidance feature. It does not establish that a majority of studies used gamification or persuasive-technology features, and this trial targeted social anxiety, not depression. Page numbers were not available in our copy. (LLM, conf=0.84)
Experimental — accuracy not yet measured
VR scenes aimed to expose individuals to feared conditions or situations, such as public speaking, social interactions, or phobias, have shown promising results in various anxiety-related disorders.
“VR Scenes aimed to expose individuals to feared conditions or situations, such as public speaking, social interactions, or phobias has shown promising results in various anxiety-related disorders (10–12, 21, 32, 42, 44).”
From A systematic review on the efficacy of virtual reality and gamification interventions for managing anxiety and depression (2023) · cites this paper as [11]
The Methods (Intervention and Materials; page not provided) describe VR public-speaking exposures for people with social anxiety disorder, and the Results report reduced public-speaking fear and social anxiety symptoms after treatment. This supports the public-speaking example, but the study does not establish promising results for phobias or various anxiety-related disorders. (LLM, conf=0.86)
Experimental — accuracy not yet measuredVisual attention to a virtual audience was shown to change as an effect of complementing VRET with an attention guidance training.
“in a recent trial, visual attention to a virtual audience was shown to change as an effect of complementing VRET with an attention guidance training (Rubin et al., 2022).”
From Virtual Reality exposure therapy in the treatment of public speaking anxiety and social anxiety disorder (2024) · cites this paper as Rubin et al., 2022
The findings indicate the presence of four distinct types of scenes across the included studies: exposure to feared conditions, relaxation/mindfulness, teaching coping skills, and games to reinforce learned skills.
“The findings indicate the presence of four distinct types of scenes across the included studies. These include scenarios designed to expose participants to feared conditions (10–12, 21, 32, 42, 44), visually appealing scenery intended for relaxation and mindfulness (9, 13, 43), scenes created for teaching coping skills specific to diagnosed conditions (7, 8, 41), and games developed to reinforce”
From A systematic review on the efficacy of virtual reality and gamification interventions for managing anxiety and depression (2023) · cites this paper as [11]
Out of 15 included studies, seven focused on VRET, one on IM-VR-CBT, four on VRS, one on VR-DTB, and three implemented VR intervention aimed at relaxation.
“Out of the 15 studies included, seven focused on VRET (10–12, 20, 32, 42, 44), one on IM-VR-CBT (24), four on VRS (7, 8, 20, 21), one on VR-DTB (9) and three implemented VR intervention aimed at relaxation (13, 41, 43).”
From A systematic review on the efficacy of virtual reality and gamification interventions for managing anxiety and depression (2023) · cites this paper as [11]
Eleven studies utilised an individual setting, while four used a group setting.
“The results showed that 11 studies utilised an individual setting (7–13, 21, 24, 32, 42, 44), while four used a group setting (7, 8, 20, 41, 43).”
From A systematic review on the efficacy of virtual reality and gamification interventions for managing anxiety and depression (2023) · cites this paper as [11]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Bayes-factor calculation conflicts with its interpretation
MinorThe stated calculation-posterior density divided by prior density at the null-makes a value of 0.28 evidence against the null. The paper instead calls that value evidence against a group effect, which reverses its stated Bayes-factor convention.
“The Savage-Dickey Density ratio was calculated in the current context by dividing the posterior density by the prior density at zero (a null effect).”
“We found moderate evidence against a main effect of group (standard exposure vs. attention augmentation) on fear of public speaking b = −5.55, 95% HDI [−13.88, 2.53], BF = 0.28.”
Anecdotal-evidence rule conflicts with reported evidence
MinorThe stated rule classifies every BF below 3, including 0.28, as only anecdotal evidence. The results instead describe BF = 0.28 as moderate evidence. The rule's "or > .33" clause would also classify large Bayes factors as anecdotal.
“Note that BFs < 3 or > .33 reflect only anecdotal evidence, suggesting only a small degree of confidence in the estimates in relation to prior evidence.”
“We found moderate evidence against a main effect of group (standard exposure vs. attention augmentation) on fear of public speaking b = −5.55, 95% HDI [−13.88, 2.53], BF = 0.28.”
Cites
Diagnostic and Statistical Manual of Mental Disorders
American Psychiatric Association (2013) · doi:10.1176/appi.books.9780890425596 · Cited by 116,369 · see citing works
OpenPose: Realtime Multi-Person 2D Pose Estimation Using Part Affinity Fields
Cao, Z., Hidalgo, G., Simon, T., Wei, S.-E., & Sheikh, Y. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2929257 · Cited by 5,536 · see citing works
Posner, K., Brown, G. K., Stanley, B., Brent, D. A., Yershova, K. V., Oquendo, M. A., Currier, G. W., Melvin, G. A., Greenhill, L., Shen, S., et al. (2011) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2011.10111704 · Cited by 5,157 · cited 2× · see citing works
“The C-SSRS was administered by a graduate clinician.”
BackgroundPreacher, K. J., & Kelley, K. (2011) · Psychological Methods · doi:10.1037/a0022658 · Cited by 3,060 · cited 1× · see citing works
“…of the mediation analysis, we partially standardized the model coefficients after completing the analyses using unstandardized variables following recommendations in the literature regarding indirect effect sizes when X is dichotomous (Hayes & Rockwood, 2017; Preacher & Kelley, 2011).”
MethodAdvanced Bayesian Multilevel Modeling with the R Package brms
Bürkner, P.-C. (2018) · The R Journal · doi:10.32614/rj-2018-017 · Cited by 3,015 · see citing works
A cognitive-behavioral model of anxiety in social phobia
Rapee, R. M., & Heimberg, R. G. (1997) · Behaviour Research and Therapy · doi:10.1016/s0005-7967(97)00022-3 · Cited by 2,987 · cited 2× · see citing works
“…social evaluative cues (Rapee & Heimberg, 1997), attentional avoidance (Cisler & Koster, 2010), self-focused attention (Clark & Wells, 1995), attentional switching between internal and external social-evaluative threat cues (Rapee & Heimberg, 1997) and attentional hyperscanning (Chen et al., 2015).”
BackgroundHayes, A. F., & Rockwood, N. J. (2017) · Behaviour Research and Therapy · doi:10.1016/j.brat.2016.11.001 · Cited by 2,350 · cited 1× · see citing works
“…of the mediation analysis, we partially standardized the model coefficients after completing the analyses using unstandardized variables following recommendations in the literature regarding indirect effect sizes when X is dichotomous (Hayes & Rockwood, 2017; Preacher & Kelley, 2011).”
MethodLiebowitz, M. R. (2015) · Modern Trends in Pharmacopsychiatry · doi:10.1159/000414022 · Cited by 2,266 · see citing works
Mechanisms of attentional biases towards threat in anxiety disorders: An integrative review
Cisler, J. M., & Koster, E. H. W. (2010) · Clinical Psychology Review · doi:10.1016/j.cpr.2009.11.003 · Cited by 1,753 · cited 1× · see citing works
“These include attentional hypervigilance to social evaluative cues (Rapee & Heimberg, 1997), attentional avoidance (Cisler & Koster, 2010), self-focused attention (Clark & Wells, 1995), attentional switching between internal and external social-evaluative threat cues (Rapee & Heimberg, 1997) and…”
BackgroundSocial Phobia: Diagnosis, Assessment, and Treatment
Amada, G. (1996) · American Journal of Psychotherapy · doi:10.1176/appi.psychotherapy.1996.50.3.373 · Cited by 1,248 · see citing works
Stein, M. B., & Stein, D. J. (2008) · The Lancet · doi:10.1016/s0140-6736(08)60488-2 · Cited by 1,137 · see citing works
Carl, E., Stein, A. T., Levihn-Coon, A., Pogue, J. R., Rothbaum, B., Emmelkamp, P., Asmundson, G. J. G., Carlbring, P., & Powers, M. B. (2019) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2018.08.003 · Cited by 889 · see citing works
Behaviour research and therapy
(1993) · Behaviour Research and Therapy · doi:10.1016/0005-7967(93)90091-8 · Cited by 877 · see citing works
Social fears and social phobia in the USA: results from the National Comorbidity survey replication
Ruscio, A. M., Brown, T. A., Chiu, W. T., Sareen, J., Stein, M. B., & Kessler, R. C. (2008) · Psychological Medicine · doi:10.1017/s0033291707001699 · Cited by 835 · cited 2× · see citing works
“SAD is a highly prevalent common psychological concern with a lifetime prevalence of 12% (Ruscio et al., 2008), and confers significant impairment in multiple spheres of functioning (Aderka et al.”
BackgroundBayesian hypothesis testing for psychologists: A tutorial on the Savage–Dickey method
Wagenmakers, E.-J., Lodewyckx, T., Kuriyal, H., & Grasman, R. (2010) · Cognitive Psychology · doi:10.1016/j.cogpsych.2009.12.001 · Cited by 740 · cited 1× · see citing works
“We computed Bayes Factors (BFs) using the Savage-Dickey Density ratio (Wagenmakers et al., 2010) for all models where we set priors using the hypothesis function in brms.”
MethodMeasures of communication‐bound anxiety
McCroskey, J. C. (1970) · Speech Monographs · doi:10.1080/03637757009375677 · Cited by 723 · cited 7× · see citing works
“To test our primary hypotheses regarding the influence of the intervention on fear of public speaking (PRPSA), we conducted Bayesian multilevel models using the brms package version 2.15 (Bürkner, 2018).”
BackgroundInfluentialThe NIMH research domain criteria initiative: Background, issues, and pragmatics
Kozak, M. J., & Cuthbert, B. N. (2016) · Psychophysiology · doi:10.1111/psyp.12518 · Cited by 655 · see citing works
Lemoine, N. P. (2019) · Oikos · doi:10.1111/oik.05985 · Cited by 617 · see citing works
Bögels, S., & Mansell, W. (2004) · Clinical Psychology Review · doi:10.1016/j.cpr.2004.06.005 · Cited by 592 · cited 1× · see citing works
“…Keeton, Austin, TX, USA Supplemental data for this article can be accessed here © 2022 Swedish Association for Behaviour Therapy prominently in most contemporary models of SAD (Clark & Wells, 1995; Wong & Rapee, 2016) and have been the focus of considerable empirical work (Bögels & Mansell, 2004).”
MethodImproving transparency and replication in Bayesian statistics: The WAMBS-Checklist.
Depaoli, S., & van de Schoot, R. (2017) · Psychological Methods · doi:10.1037/met0000065 · Cited by 448 · cited 1× · see citing works
“We largely followed the WAMBS (When to worry and how to Avoid the Misuse of Bayesian Statistics) checklist (Depaoli & van de Schoot, 2017).”
MethodBayesian data analysis for newcomers
Kruschke, J. K., & Liddell, T. M. (2017) · Psychonomic Bulletin & Review · doi:10.3758/s13423-017-1272-1 · Cited by 409 · see citing works
Functional impairment in social anxiety disorder
Aderka, I. M., Hofmann, S. G., Nickerson, A., Hermesh, H., Gilboa-Schechtman, E., & Marom, S. (2012) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2012.01.003 · Cited by 343 · cited 1× · see citing works
“SAD is a highly prevalent common psychological concern with a lifetime prevalence of 12% (Ruscio et al., 2008), and confers significant impairment in multiple spheres of functioning (Aderka et al., 2012).”
BackgroundAttention bias modification for social anxiety: A systematic review and meta-analysis
Heeren, A., Mogoașe, C., Philippot, P., & McNally, R. J. (2015) · Clinical Psychology Review · doi:10.1016/j.cpr.2015.06.001 · Cited by 312 · see citing works
Wong, Q. J. J., & Rapee, R. M. (2016) · Journal of Affective Disorders · doi:10.1016/j.jad.2016.05.069 · Cited by 277 · cited 2× · see citing works
“Both theoretical models of Social Anxiety Disorder (Clark & Wells, 1995; Wong & Rapee, 2016) and some prior research (Kim et al., 2018; Rubin et al., 2020) support the hypothesis that avoidance of social threats may serve as a maintaining factor of the disorder.”
BackgroundMethodJournal of Modern Applied Statistical Methods
(2007) · Encyclopedia of Measurement and Statistics · doi:10.4135/9781412952644.n235 · Cited by 180 · see citing works
Meta-analysis of the efficacy of virtual reality exposure therapy for social anxiety
Chesham, R. K., Malouff, J. M., & Schutte, N. S. (2018) · Behaviour Change · doi:10.1017/bec.2018.15 · Cited by 135 · see citing works
Affect labeling enhances exposure effectiveness for public speaking anxiety
Niles, A. N., Craske, M. G., Lieberman, M. D., & Hur, C. (2015) · Behaviour Research and Therapy · doi:10.1016/j.brat.2015.03.004 · Cited by 115 · cited 1× · see citing works
“We conducted a brief 2-session protocol, because the reduced efficacy compared with a full-length (e.g. 8-week) protocol makes it more feasible to test the influence of potential mechanisms (see, for instance, Niles et al., 2015).”
MethodKruijt, A., Parsons, S. D., & Fox, E. (2019) · Journal of Abnormal Psychology · doi:10.1037/abn0000406 · Cited by 103 · cited 1× · see citing works
“Second, there is some evidence that within individuals with social anxiety there is no consistent attentional bias (Kruijt et al., 2019).”
BackgroundLindner, P., Dagöö, J., Hamilton, W., Miloff, A., Andersson, G., Schill, A., & Carlbring, P. (2020) · Cognitive Behaviour Therapy · doi:10.1080/16506073.2020.1795240 · Cited by 84 · see citing works
Reeves, R., Elliott, A., Curran, D., Dyer, K., & Hanna, D. (2021) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2021.102451 · Cited by 82 · cited 2× · see citing works
“First, while there is evidence that noninteractive public speaking challenges with 360°-video can be an effective treatment modality (Reeves et al., 2021), it is likely that interactions are an important ingredient to the efficacy of social exposures broadly.”
BackgroundMemory and visual search in naturalistic 2D and 3D environments
Li, C.-L., Aivar, M. P., Kit, D. M., Tong, M. H., & Hayhoe, M. (2016) · Journal of Vision · doi:10.1167/16.8.9 · Cited by 70 · cited 1× · see citing works
“Fixations were detected using a well-established in-house algorithm (Kit et al., 2014; Li et al., 2016; Tong et al., 2017).”
MethodSelf-citationEye Movements, Visual Search and Scene Memory, in an Immersive Virtual Environment
Kit, D. M., Katz, L. N., Sullivan, B. T., Snyder, K., Ballard, D. H., & Hayhoe, M. (2014) · PLoS ONE · doi:10.1371/journal.pone.0094362 · Cited by 64 · cited 1× · see citing works
“Fixations were detected using a well-established in-house algorithm (Kit et al., 2014; Li et al., 2016; Tong et al., 2017).”
MethodSelf-citationHyperscanning and avoidance in social anxiety disorder: The visual scanpath during public speaking
Chen, N. T. M., Thomas, L. M., Clarke, P., Hickie, I. B., & Guastella, A. J. (2014) · Psychiatry Research · doi:10.1016/j.psychres.2014.11.025 · Cited by 63 · see citing works
The Speech Anxiety Thoughts Inventory: scale development and preliminary psychometric data
Cho, Y., Smits, J. A. J., & Telch, M. J. (2003) · Behaviour Research and Therapy · doi:10.1016/s0005-7967(03)00067-6 · Cited by 55 · see citing works
Self-citationControl of gaze while walking: Task structure, reward, and uncertainty
Tong, M. H., Zohar, O., & Hayhoe, M. (2017) · Journal of Vision · doi:10.1167/17.1.28 · Cited by 53 · cited 1× · see citing works
“Fixations were detected using a well-established in-house algorithm (Kit et al., 2014; Li et al., 2016; Tong et al., 2017).”
MethodSelf-citationLazarov, A., Marom, S., Yahalom, N., Pine, D. S., Hermesh, H., & Bar‐Haim, Y. (2017) · Psychological Medicine · doi:10.1017/s003329171700366x · Cited by 52 · see citing works
Moreno-Peral, P., Bellón, J. Á., Huibers, M. J. H., Mestre, J. M., García-López, L. J., Taubner, S., Rodríguez-Morejón, A., Bolinski, F., Sales, C. M. D., & Conejo-Cerón, S. (2020) · Clinical Psychology Review · doi:10.1016/j.cpr.2020.101813 · Cited by 51 · cited 1× · see citing works
“There is increasing emphasis on the importance of understanding mechanisms underpinning psychological disorders (Moreno-Peral et al., 2020).”
BackgroundElsey, J. W. B., Filmer, A. I., Galvin, H. R., Kurath, J., Vossoughi, L., Thomander, L. S., Zavodnik, M., & Kindt, M. (2020) · Translational Psychiatry · doi:10.1038/s41398-020-0857-z · Cited by 44 · cited 1× · see citing works
“It can be useful to identify support for the null at early stages in testing potential treatment mechanisms (Elsey et al., 2020), since even with small samples strong support for the null can curtail avenues of research that are unlikely to yield meaningful results.”
BackgroundAversive eye gaze during a speech in virtual environment in patients with social anxiety disorder
Kim, H., Shin, J. E., Hong, Y.-J., Shin, Y., Shin, Y. S., Han, K., Kim, J., & Choi, S. (2017) · Australian & New Zealand Journal of Psychiatry · doi:10.1177/0004867417714335 · Cited by 34 · see citing works
Altoè, G., Bertoldo, G., Callegher, C. Z., Toffalini, E., Calcagnì, A., Finos, L., & Pastore, M. (2020) · Frontiers in Psychology · doi:10.3389/fpsyg.2019.02893 · Cited by 31 · see citing works
Rubin, M., Minns, S. A., Muller, K., Tong, M. H., Hayhoe, M., & Telch, M. J. (2020) · Behaviour Research and Therapy · doi:10.1016/j.brat.2020.103706 · Cited by 30 · cited 4× · see citing works
“The methods used for processing gaze data were the same as those previously used (Rubin et al., 2020): Vizard 4 (WorldViz) was used to display the 360°-video and collect the eye tracking data.”
BackgroundMethodInfluentialSelf-citation
Flagged first, then by citations
Research works printed but not linked: 1
- First M. B., 2015, Structured clinical interview for DSM-5 research version
Cited by
Sorted by citations
Virtual reality in the diagnostic and therapy for mental disorders: A systematic review
Wiebe, A., Kannen, K., Selaskowski, B., Mehren, A., Thöne, A.-K., Pramme, L., Blumenthal, N., Li, M., Asché, L., Jonas, S., et al. (2022) · Clinical Psychology Review · doi:10.1016/j.cpr.2022.102213 · Cited by 223 · see citing works
Jingili, N., Oyelere, S. S., Nyström, M. B. T., & Anyshchenko, L. (2023) · Frontiers in Digital Health · doi:10.3389/fdgth.2023.1239435 · Cited by 69 · see citing works
A Preliminary Study of the Eye Tracker in the Meta Quest Pro
Wei, S., Bloemers, D., & Rovira, A. (2023) · ACM International Conference on Interactive Media Experiences · doi:10.1145/3573381.3596467 · Cited by 64 · see citing works
“A growing body of psychology research has incorporated eyetracking in VR social scenarios for behavioural insights [3, 4, 12, 13, 18].”
BackgroundExploring the psychological effects of Metaverse on mental health and well-being
Din, I. U., & Almogren, A. (2023) · Information Technology & Tourism · doi:10.1007/s40558-023-00259-8 · Cited by 55 · see citing works
Effectiveness and User Experience of Virtual Reality for Social Anxiety Disorder: Systematic Review
Shahid, S., Kelson, J. N., & Saliba, A. J. (2023) · JMIR Mental Health · doi:10.2196/48916 · Cited by 49 · see citing works
“In all RCT studies [48,49,51,52,56,61,62,64], randomization was reported, but schedule details were unclear in 11% (2/18) of the studies [48,61].”
BackgroundResultInfluentialWong, K. P., Lai, C. Y. Y., & Qin, J. (2023) · Journal of Affective Disorders · doi:10.1016/j.jad.2023.04.043 · Cited by 32 · see citing works
Zeng, W., Xu, J., Yu, J., & Chu, X. (2025) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2025.1553290 · Cited by 40 · see citing works
Seuling, P. D., Czernin, N. S., & Schiele, M. A. (2024) · Neuroscience Applied · doi:10.1016/j.nsa.2024.104074 · Cited by 28 · see citing works
Zeka, F., Clemmensen, L., Valmaggia, L., Veling, W., Hjorthøj, C. R., & Glenthøj, L. B. (2024) · Acta Psychiatrica Scandinavica · doi:10.1111/acps.13777 · Cited by 28 · see citing works
“Rubin et al. [91], examined attention guidance augmentation of virtual reality exposure therapy (VRET) using eye-tracking technology versus standard VRET in an RCT concluding that modifying gaze avoidance in 360° videos may be effective for reducing social anxiety.”
Jia, Y., & Mvondo, G. F. N. (2025) · Journal of Retailing and Consumer Services · doi:10.1016/j.jretconser.2025.104321 · Cited by 22 · see citing works
Extended Reality for Mental Health Evaluation: Scoping Review
Omisore, O. M., Odenigbo, I. P., Orji, J., Beltran, A. I. H., Meier, S. M., Baghaei, N., & Orji, R. (2024) · JMIR Serious Games · doi:10.2196/38413 · Cited by 23 · see citing works
A transdiagnostic meta-analysis of acute augmentations to psychological therapy
Nord, C. L., Longley, B. F., Dercon, Q., Phillips, V., Funk, J., Gormley, S., Knight, R., Smith, A., & Dalgleish, T. (2023) · Nature Mental Health · doi:10.1038/s44220-023-00048-6 · Cited by 13 · see citing works
Fehlmann, B., Mueller, F. D., Wang, N., Ibach, M. K., Schlitt, T., Bentz, D., Zimmer, A., Papassotiropoulos, A., & de Quervain, D. J. ‐. (2023) · Journal of Affective Disorders Reports · doi:10.1016/j.jadr.2023.100627 · Cited by 11 · see citing works
Zeka, F., Clemmensen, L., Arnfred, B. T., Nordentoft, M., & Glenthøj, L. B. (2023) · BMJ Open · doi:10.1136/bmjopen-2023-071927 · Cited by 9 · see citing works
“48 We aim to extend these preliminary findings by including three novel naturalistic social evaluative tasks using 360° stimuli in VR in a clinical sample of SAD.”
BackgroundBeyond Pharmacology: A Narrative Review of Alternative Therapies for Anxiety Disorders
Antos, Z., Zackiewicz, K., Tomaszek, N., Modzelewski, S., & Waszkiewicz, N. (2024) · Diseases · doi:10.3390/diseases12090216 · Cited by 9 · see citing works
Kim, H., Han, E. C., Muntz, P. B., & Kemp, J. J. (2025) · Current Psychiatry Reports · doi:10.1007/s11920-025-01624-6 · Cited by 7 · see citing works
“Data from these features can offer a more objective, quantifiable measure of a patient’s engagement with the stimulus and real-time markers of physiological arousal, which are associated with effective exposure delivery [ 21 , 29 , 30].”
InfluentialErnst, M. T., Bouchard, S., Andersen, T. E., Ørskov, P. T., Tarp, K., & Lichtenstein, M. B. (2024) · JMIR Formative Research · doi:10.2196/55679 · Cited by 6 · see citing works
“However, one study found no difference in presence [34], and other 360° VR exposure studies for SAD emphasize realism as a deciding factor in choosing 360° VR [31,33].”
BackgroundParsafar, A., Farid, A. A. A., Dortāj, F., & Bahramabadi, M. Z. (2024) · doi:10.61838/kman.jayps.5.3.6 · Cited by 3 · see citing works
Takahashi, M., Kikuchi, M., Yamamoto, J., & Hirai, M. (2023) · Journal of Behavioral and Cognitive Therapy · doi:10.1016/j.jbct.2023.10.004 · Cited by 5 · see citing works
Attentional Heterogeneity in Social Anxiety Disorder: Evidence from Hidden Markov Models
Rubin, M., Muller, K., Hayhoe, M., & Telch, M. J. (2021) · Behaviour Research and Therapy · doi:10.1016/j.brat.2023.104461 · Cited by 2 · see citing works
Self-citationMultimodal Remote Research on Social Anxiety Using a New Teleconferencing Paradigm
Rubin, M., Gebhardt, E. S., Malloy, L. T., & Telch, M. J. (2023) · Cognitive Therapy and Research · doi:10.1007/s10608-023-10371-y · Cited by 2 · see citing works
“…using pre-recorded audiences for public speaking challenges (typically in virtual reality, e.g., Reeves et al., 2021), indicating their effectiveness in eliciting socialevaluative threat - even when the participants know that the audience is pre-recorded (Rubin et al., 2020; Rubin et al., 2022).”
BackgroundSelf-citationSchmidt-Peter, T., Mühlberger, A., & Wechsler, T. F. (2026) · Frontiers in Virtual Reality · doi:10.3389/frvir.2026.1787939 · Cited by 2 · see citing works
Quevedo-Bayona, I., Llamazares, M. D. C. E., & Martín, M. Á. M. (2025) · Acta Psychologica · doi:10.1016/j.actpsy.2025.105829 · Cited by 1 · see citing works
Doğan, U., Sarıcaoğlu, H., Sinem, A. C. A. R., Türkçapar, M. H., Sağkal, A. S., Büyüköksüz, E., Erözkan, A., Zeybek, S. U., Üzmez, H., Dağılgan, E. B., et al. (2025) · Current Psychology · doi:10.1007/s12144-025-07376-z · Cited by 1 · see citing works
“…highlighted the potential benefits of exposure therapy using virtual reality, including the use of 360° videos, in enhancing treatment outcomes for anxiety disorders like social anxiety (Boeldt et al., 2019; Clemmensen et al., 2020; Craske et al., 2014a; Kampmann et al., 2016; Rubin et al., 2022).”
Exposure Therapy in the Treatment of Phobias Using Virtual Reality
Hussain, G. F., & Reddy, P. (2025) · Cognitive science and technology · doi:10.1007/978-981-97-9266-5_23 · Cited by 1 · see citing works
An initial test of a new self-guided internet-based intervention for social anxiety: iExposure
Rubin, M., Gebhardt, E. S., Malloy, L. T., & Telch, M. J. (2024) · Cognitive Behaviour Therapy · doi:10.1080/16506073.2024.2368519 · Cited by 1 · see citing works
“In a pilot virtual reality clinical trial for social anxiety using an attention guidance augmentation (Rubin et al., 2022), the authors found preliminary evidence that changes in attention may mediate changes in symptoms of social anxiety.”
Self-citationAn Alternative Approach in the Treatment of Anxiety Disorders: Current DirectionsPreprint
Antos, Z., Zackiewicz, K., Tomaszek, N., Modzelewski, S., & Waszkiewicz, N. (2024) · Preprints.org · doi:10.20944/preprints202406.1166.v1 · Cited by 1 · see citing works
Shahid, S., Kelson, J. N., & Saliba, A. J. (2023) · doi:10.2196/preprints.48916 · Cited by 1 · see citing works
Extended Reality for Mental Health Evaluation: Scoping Review (Preprint)Preprint
Omisore, O. M., Odenigbo, I., Orji, J., et al. (2022) · doi:10.2196/preprints.38413 · Cited by 1 · see citing works
Efficacy of three virtual reality interventions for social anxiety disorder: A meta-analysis
He, X., Liu, Z., Ji, Y., Zou, C., & Liu, J. (2026) · Acta Psychologica · doi:10.1016/j.actpsy.2026.107811
APPLICATIONS OF VIRTUAL REALITY TECHNOLOGY IN PSYCHIATRY – A REVIEW
Rybicki, W., Dutczak, R., Sobieska, A., Korpacka, A., Mularczyk, P., Okoń, M., Lecyk, Z., Gawlik, A., & Lubowiecka, M. (2026) · International Journal of Innovative Technologies in Social Science · doi:10.31435/ijitss.3(51).2026.6405
Exercise as an adjunct intervention for social anxiety disorder: a mini-review
Lele, L., Xin, Y., & Song, Y.-G. (2026) · Frontiers in Psychology · doi:10.3389/fpsyg.2026.1894573
“Virtual reality has already been applied to exposure therapy (Rubin et al., 2022; Arif et al., 2023) and social skills training (Reichenberger et al., 2022) for social anxiety; future work could embed exercise biofeedback (e.g., heart rate, movement metrics) into VR environments to create…”
CBT & ACT Virtual Reality Innovative Solutions in Treating Social Anxiety Disorder: A Pilot Study
Profir, A., GHEORGHIU, R., & David, D. (2026) · Cognitive Behaviour Therapy · doi:10.1080/16506073.2026.2688124
Li, Y., Zhang, Z., He, L.-P., Zhou, X.-Q., Yu, B., Huang, X.-M., Yang, D., Xia, D., & Wang, D. (2026) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2026.1883150
Validity of Eye-Tracking Measures in Immersive Virtual Reality: Using Cognitive Theories of Learning
Lee, J. Y., Moon, J., PAAS, F. G. W. C., Cho, M., Darejeh, A., Holmer, S., & Ayres, P. (2026) · Educational Psychology Review · doi:10.1007/s10648-026-10186-9
Quevedo-Bayona, I., Llamazares, M. D. C. E., Martínez-Martín, M. Á., & González, A. L. O. (2026) · Nexus Multidisciplinary Research Journal · doi:10.66615/xj1tdf26
The main directions of using VR technology in education, medicine and fundamental research
Kaverina, M. Y. (2026) · Journal of Modern Foreign Psychology · doi:10.17759/jmfp.2026150203
Xiong, Y., Xiao, N., Ding, X., Zhang, J., & Luo, H.-S. (2026) · Frontiers in Psychology · doi:10.3389/fpsyg.2026.1787151 · Cited by 1 · see citing works
Prescribed Interventions to Reduce Depression
Sunzeri, F. (2026) · Springer eBooks · doi:10.1007/978-3-032-14465-2_22
Otto, M. W., Long, L. J., Papini, S., Culver, T., Taylor, C. T., Rubin, M., Fitzgerald, H. E., Liu, Q., Smits, J. A. J., Anderson, R., et al. (2025) · JMIR Research Protocols · doi:10.2196/80010 · Cited by 1 · see citing works
“This study was designed to provide guidance on the role of positive affect in treatment response to aid personalized medicine decisions, including, perhaps, pretreatment efforts to modify the moderator [36,67, 68].”
Self-citationErnst, M. T., Bouchard, S., Andersen, T. E., et al. (2023) · doi:10.2196/preprints.55679
- Authors
- Rubin, M., Muller, K., Hayhoe, M. M., & Telch, M. J.
- Affiliations
- The University of Texas at Austin (US)
- Corresponding author
- Rubin, Mikael
- Venue
- Cognitive Behaviour Therapy
- Publisher
- Informa UK Limited
- Published
- 2022-04-06
- Volume
- 51
- Issue
- 5
- Pages
- 371-387
- ISSN
- 1650-6073 (ISSN-L)
- 1651-2316
- PMC
- PMC9458616
- OpenAlex
- W4226119107
- Semantic Scholar
- 991bfd3d217990e154cf12300ff8e3c461c604f3
- Cited by
- 38
- References
- 36
- Citations by year
- 2026: 11 · 2025: 7 · 2024: 8 · 2023: 10 · 2022: 1 · 2021: 1
- FWCI
- 5.98
- Type
- journal article
- Language
- en
- Open access
- green
- doi.org
- Licence
- cc-by
- Locations
- Cognitive Behaviour Therapy (publishedVersion)
- PubMed (publishedVersion)
- PubMed Central (acceptedVersion)
- OSF Preprints (OSF Preprints) (submittedVersion)
- OSF Preprints (OSF Preprints) (submittedVersion, cc-by)
- Funders
- National Eye Institute
- National Institute of Mental Health
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Anxiety, Depression, Psychometrics, Treatment, Cognitive Processes
- Physical Sciences › Computer Science › Human-Computer Interaction › Virtual Reality Applications and Impacts
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Keywords
- virtual reality exposure therapy, social anxiety disorder, visual attention, gaze avoidance, eye tracking, 360-degree video, public speaking anxiety
- MeSH terms
- Phobia, Social, Bayes Theorem, Humans, Pilot Projects, Virtual Reality Exposure Therapy
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Claims read under definition version 3 (extract-v3) on 2026-09-28.
Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-09-28.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review