Meta-analysis of virtual reality exposure therapy for social anxiety disorder
Open accessThe DOI matches its Crossref record, with a small difference in title or year; 25 of the 25 references it cites were found in a registry or an index; none of the 14 sources its claims cite is checked for support yet.
Abstract
Virtual reality exposure therapy (VRET) for social anxiety disorder (SAD) is a new technology-based form of exposure therapy that uses computer-generated virtual social envir-onments as a means of systematically exposing patients to feared stimuli. An advantage of VRET relative to exposure in vivo is that virtual exposure takes place in a highly controllable environment. Recently, Horigome et al. (2020) published a meta-analysis on the efficacy of VRET for SAD and reported that 22 studies [11 randomized controlled trials (RCTs) and 11 non-randomized studies] fulfilled their inclusion criteria. We have previously systematically reviewed the literature on the efficacy of VRET for SAD (Carl et al., 2019; Emmelkamp, Meyerbröker,
Overview
CoChat Summary
TL;DR
This reanalysis argues that Horigome et al.’s meta-analysis overcounted studies of virtual reality exposure therapy (VRET) for social anxiety disorder, leaving only 12 includable studies after stricter criteria. In those 12 studies, VRET showed large within-group and waitlist-controlled effects but did not differ significantly from exposure in vivo.
Key findings
- Horigome et al. reported 22 studies/publications, but the authors say two trials were counted twice (Anderson et al., 2013; Safir et al., 2012), two were not VRET (Lister et al. used VR only for assessment; Yuen et al. included in vivo exposure and <50% VRET), and six had <10 participants in VRET; they conclude only 12 studies should be included.
- In the reanalysis of 12 studies, the pre–post within-group effect was large: Hedges’ g = 1.20 (95% CI 0.91–1.50; k = 12, n = 228), and the longest available follow-up within-group effect was g = 1.06 (95% CI 0.71–1.41; k = 5, n = 110).
- VRET versus waitlist at post-treatment was also large: g = 0.88 (95% CI 0.43–1.34; k = 5, n = 222).
- VRET versus exposure in vivo showed no significant difference at post-treatment (g = 0.07, 95% CI −0.32 to 0.17; k = 7, n = 272) or at longest available follow-up (g = −0.24, 95% CI −0.83 to 0.35; k = 4, n = 206), whereas Horigome et al. reported significant follow-up differences in both directions.
Methods
- The authors critically applied Horigome et al.’s inclusion criteria and additionally required treatments labeled VRET to consist of at least 50% virtual reality components; their reanalysis included 12 studies, six RCTs and six non-controlled studies.
- They calculated Hedges’ g for uncontrolled (pre–post/follow-up) and controlled (VRET vs waitlist; VRET vs exposure in vivo) comparisons using random-effects models in R 3.5 with the metafor package (v.1.9.8).
- They deviated from Horigome et al. by not meta-analyzing single trials and by using the longest available follow-up per trial, except for Anderson et al. (2013), where the 12-month rather than 72-month follow-up was retained.
Limitations
- Stated: the results should be interpreted with caution because they are based on a limited number of RCTs; uncontrolled effect sizes do not account for time, so controlled effect sizes are more reliable.
- Evident: several follow-up analyses relied on very few trials (k = 1–3), and some comparisons had high heterogeneity (e.g., VRET vs exposure in vivo at 3 months, I² = 84.28; longest follow-up, I² = 76.70) with prediction intervals including zero.
- Evident: the reanalysis depends on the authors’ own exclusion decisions and criteria (e.g., <10 participants per condition, ≥50% VRET), which may affect the pooled estimates.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
0 Valid · 0 Not valid · 9 Not checked · 14 Own results and interpretations
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Effect sizes were further large when pre-assessment scores of social anxiety were compared to follow-up assessment scores at different time points.”
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Across all interventions, a large pre–post effect size was found.”
- Also stated in: § Meta-analysis of virtual reality exposure therapy for social anxiety disorder · plain
“| Post-treatment | 12 | 228 | 1.20 | 0.91–1.50 | <0.001 | 53.02 | 23.68 | 0.014 | 0.40–2.01 |”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § Meta-analysis of virtual reality exposure therapy for social anxiety disorder · plain
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“These analyses revealed that the pooled between-group effect size comparing VRET to waitlist at post-treatment was also large.”
- Also stated in: § Meta-analysis of virtual reality exposure therapy for social anxiety disorder · plain
“| At post-treatment | 5 | 222 | 0.88 | 0.43–1.34 | <0.001 | 61.34 | 10.16 | 0.038 | 0.03–1.79 |”
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § Meta-analysis of virtual reality exposure therapy for social anxiety disorder · plain
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Finally, the comparison of VRET to exposure in vivo yielded no significant differences between the two treatments, neither at post-assessment nor at follow-up.”
- Also stated in: § Meta-analysis of virtual reality exposure therapy for social anxiety disorder · plain
“| at post | 7 | 272 | 0.07 | −0.32 to 0.17 | 0.562 | 10.65 | 6.57 | 0.362 | −0.40 to 0.25 |”
- Also stated in: § Meta-analysis of virtual reality exposure therapy for social anxiety disorder · plain
“| Longest available FUb | 4 | 206 | −0.24 | −0.83 to 0.35 | 0.426 | 76.70 | 11.21 | 0.011 | −1.42 to 0.94 |”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § Meta-analysis of virtual reality exposure therapy for social anxiety disorder · plain
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“As can be seen in Table 1, change from pretreatment to follow-up resulted in a large effect size across VRET treatments.”
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
7 more claims
Create a free account to see all 23 claims and to verify the 14 references still open.
- Probably not a substantial claim. 3
- It may state two separate claims as one. 9
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Recent meta-analyses (Carl et al., 2019; Reeves et al., 2022; Morina et al., 2023; van Loenen et al., 2022; Horigome et al., 2020; Kampmann et al., 2016a) underscore the efficacy of conducting VRET for SAD with significant and enduring effect sizes (Hedges' g ranging from −0.86 to −1.14) over follow-up periods of up to 12 months.”
From Virtual Reality exposure therapy in the treatment of public speaking anxiety and social anxiety disorder (2024) · cites this paper as Morina et al., 2023
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“VRET demonstrates comparable efficacy to traditional in vivo exposure.”
From Virtual Reality exposure therapy in the treatment of public speaking anxiety and social anxiety disorder (2024) · cites this paper as Morina et al., 2023
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Compared to active control conditions, meta-analyses have revealed no significant difference (p values between 0.5 and 0.3; Morina et al., 2023; van Loenen et al., 2022; Kampmann et al., 2016a), indicating comparable efficacy of VRET to CBT with in vivo exposure.”
From Virtual Reality exposure therapy in the treatment of public speaking anxiety and social anxiety disorder (2024) · cites this paper as Morina et al., 2023
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Effect sizes for VRET compared to waitlist control conditions are estimated to be large (Hedge's g between 0.86 and 1.46) for SAD (Reeves et al., 2022; Morina et al., 2023; Horigome et al., 2020; Kampmann et al., 2016a) and PSA (Reeves et al., 2022), and moderate to large (Hedge's g between 0.49 and 0.78) for anxiety disorders in general (Carl et al., 2019; van Loenen et al., 2022).”
From Virtual Reality exposure therapy in the treatment of public speaking anxiety and social anxiety disorder (2024) · cites this paper as Morina et al., 2023
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated major: it would touch a result — a value a result rests on, reported and recomputed p-values on opposite sides of the significance level, two passages that conflict with no sign which is right, or a cited work retracted before this paper was published.
In the paper
§ Meta-analysis of virtual reality exposure therapy for social anxiety disorder
“six of which were RCTs (Anderson et al., 2013; Bouchard et al., 2017; Kampmann et al., 2016a; Klinger et al., 2005; Safir et al., 2012; Wallach et al., 2011)”
§ Meta-analysis of virtual reality exposure therapy for social anxiety disorder
“| at post | 7 | 272 | 0.07 | −0.32 to 0.17 | 0.562 | 10.65 | 6.57 | 0.362 | −0.40 to 0.25 |”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
“| at post | 7 | 272 | 0.07 | −0.32 to 0.17 | 0.562 | 10.65 | 6.57 | 0.362 | −0.40 to 0.25 |”
Reported 0.07 · recomputed -0.075
Citations
Cites
R: A Language and Environment for Statistical Computing
R Core Team (2025) · doi:10.32614/r.manuals · Cited by 352,181
Conducting Meta-Analyses in R with the metafor Package
Viechtbauer, W. (2010) · Journal of Statistical Software · doi:10.18637/jss.v036.i03 · Cited by 20,464
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · PLoS Medicine · doi:10.1371/journal.pmed.0020124 · Cited by 10,505
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · CHANCE · doi:10.1080/09332480.2005.10722754 · Cited by 4,702 · cited 1×
“Research, however, strongly suggests that trials with small samples (i.e. low statistical power) reduce the likelihood that a statistically significant result reflects a true effect (Ioannidis, 2005).”
BackgroundKjaergard, L. L., Villumsen, J., & Gluud, C. (2001) · Annals of Internal Medicine · doi:10.7326/0003-4819-135-11-200112040-00010 · Cited by 2,283
Carl, E., Stein, A. T., Levihn-Coon, A., Pogue, J. R., Rothbaum, B., Emmelkamp, P., Asmundson, G. J. G., Carlbring, P., & Powers, M. B. (2019) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2018.08.003 · Cited by 889 · cited 5×
“Horigome and colleagues reported the following inclusion criteria for their meta-analyses: (1) a diagnosis of SAD, fear of public speaking, or public speaking anxiety; (2) VRET consisted of at least three sessions; and (3) study participants numbered a minimum of 10 patients.”
MethodSelf-citationThe impact of study size on meta-analyses: examination of underpowered studies in Cochrane reviews
Turner, R. M., Bird, S. M., & Higgins, J. P. T. (2013) · PLoS ONE · doi:10.1371/journal.pone.0059202 · Cited by 672
Influence of trial sample size on treatment effect estimates: meta-epidemiological study
Dechartres, A., Trinquart, L., Boutron, I., & Ravaud, P. (2013) · BMJ · doi:10.1136/bmj.f2304 · Cited by 544
Morina, N., Ijntema, H., Meyerbröker, K., & Emmelkamp, P. M. G. (2015) · Behaviour Research and Therapy · doi:10.1016/j.brat.2015.08.010 · Cited by 439 · cited 1×
“A minimum of 10 participants per condition was also applied in other related meta-analyses (e.g. Kampmann et al., 2016b; Morina et al., 2015).”
BackgroundSelf-citationVirtual reality exposure therapy for social anxiety disorder: A randomized controlled trial.
Anderson, P. L., Price, M., Edwards, S. M., Obasaju, M. A., Schmertz, S. K., Zimand, E., & Calamaras, M. R. (2013) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0033559 · Cited by 371 · cited 5×
“A close look at Table 1 in Horigome et al. reveals that the authors counted the trial by Anderson et al. (2013) as well as the one by Safir, Wallach, and Bar-Zvi (2012) twice, respectively.”
MethodInfluential
Cited by
Pilot randomized trial of self-guided virtual reality exposure therapy for social anxiety disorder
Zainal, N. H., Chan, W. W., Saxena, A. P., Taylor, C. B., & Newman, M. G. (2021) · Behaviour Research and Therapy · doi:10.1016/j.brat.2021.103984 · Cited by 84
Effectiveness and User Experience of Virtual Reality for Social Anxiety Disorder: Systematic Review
Shahid, S., Kelson, J. N., & Saliba, A. J. (2023) · JMIR Mental Health · doi:10.2196/48916 · Cited by 58
“This consistent pattern of symptom reduction can be observed across various contexts, such as participant countries (eg, the United States, France, Israel, and South Korea) and treatment settings (eg, universities, hospitals, and clinics) [6,20-24].”
BackgroundResultHoppen, T. H., Lindemann, A. S., & Morina, N. (2022) · The British Journal of Psychiatry · doi:10.1192/bjp.2022.111 · Cited by 43
Self-citationGorinelli, S., Gallego, A., Lappalainen, P., & Lappalainen, R. (2023) · Journal of Contextual Behavioral Science · doi:10.1016/j.jcbs.2023.05.004 · Cited by 28
Seuling, P. D., Czernin, N. S., & Schiele, M. A. (2024) · Neuroscience Applied · doi:10.1016/j.nsa.2024.104074 · Cited by 28
Metadata
- Authors
- Morina, N., Kampmann, I., Emmelkamp, P., Barbui, C., & Hoppen, T. H.
- Affiliations
- University of Münster (DE)
- University of Amsterdam (NL)
- University of Verona (IT)
- Venue
- Psychological Medicine
- Publisher
- Cambridge University Press (CUP)
- Published
- 2021-05-18
- Volume
- 53
- Issue
- 5
- Pages
- 2176-2178
- ISSN
- 0033-2917 (ISSN-L)
- 1469-8978
- PMC
- PMC10106288
- OpenAlex
- W3161925626
- Cited by
- 75
- References
- 25
- Citations by year
- 2026: 25 · 2025: 18 · 2024: 10 · 2023: 14 · 2022: 6 · 2021: 2
- FWCI
- 0.89
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Locations
- Psychological Medicine (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- GoeScholar The Publication Server of the Georg-August-Universität Göttingen (Georg-August-Universität Göttingen) (submittedVersion, other-oa)
- Topics
- Physical Sciences › Computer Science › Human-Computer Interaction › Virtual Reality Applications and Impacts
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Anxiety, Depression, Psychometrics, Treatment, Cognitive Processes
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Keywords
- virtual reality exposure therapy, social anxiety disorder, virtual reality, exposure therapy, treatment efficacy
- MeSH terms
- Phobia, Social, Anxiety, Anxiety Disorders, Humans, Phobic Disorders, Meta-Analysis as Topic, Virtual Reality Exposure Therapy
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-09-30, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-09-30 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Meta-analysis of virtual reality exposure therapy for social anxiety disorder. https://app.cochat.ai/papers/10.1017/s0033291721001690
- The paper
- Morina, N., Kampmann, I., Emmelkamp, P., Barbui, C., & Hoppen, T. H. (2023). Meta-analysis of virtual reality exposure therapy for social anxiety disorder. Psychological Medicine. https://doi.org/10.1017/s0033291721001690
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.