Response to Morina et al.'s criticisms of Horigome et al.'s recent report on the efficacy of virtual reality exposure therapy for social anxiety disorder
Open accessThe DOI matches its Crossref record, with a small difference in title or year; 7 of the 10 references it cites were found in a registry or an index; none of the 16 sources its claims cite is checked for support yet.
Overview
CoChat Summary
TL;DR
This correspondence responds to Morina et al.’s criticisms of the authors’ 2020 meta-analysis on virtual reality exposure therapy (VRET) for social anxiety disorder (SAD). The authors argue that their broader inclusion criteria were intentional and that the criticized studies were handled without duplicating data in the analyses.
Key findings
- The authors say their review found “more studies than previously reported in meta-analyses,” and they included these newly identified studies to assess VR interventions for SAD and public speaking anxiety.
- They acknowledge that Table 1 should have said “22 publications reporting 20 studies,” not “22 studies,” because Anderson et al. (2013) and Safir et al. (2012) each had follow-up studies on the same population.
- They state that the data from those follow-up studies were not duplicated: baseline-to-post-intervention analyses used only those time points, while follow-up studies were used only for long-term outcomes.
- They argue that their broader meta-analysis was meant to examine whether VR interventions have therapeutic effects, whether effects are sustained, and how VR compares with other treatments, rather than only comparing VRET with in vivo exposure.
Methods
- This is a correspondence letter defending and clarifying the authors’ 2020 systematic review and meta-analysis of VR interventions for SAD and public speaking anxiety.
- The paper discusses their inclusion criteria: at least 10 participants per study, inclusion of studies using VR in varied ways, and inclusion of studies with in vivo exposure in the VR intervention arm if other criteria were met.
- Their main analytical distinction, as described here, was between baseline vs post-intervention outcomes and long-term follow-up outcomes, with separate handling of comparison groups such as waiting list and treatment-as-usual.
Limitations
- The authors state that the studies examined VR in “diverse ways,” and that many had “problems with the quality of the reported research.”
- They note that some studies had small sample sizes, and acknowledge that results from smaller studies may over-report effects; this is a concern stated in the text and attributed partly to the studies themselves.
- Evident from the text: this correspondence does not present new primary outcome data or a new meta-analysis; it is a response and clarification piece, so it is limited to defending prior methodological choices.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
0 Valid · 2 Not valid · 13 Not checked · 9 Own results and interpretations
In the paper
“We found that there were more studies than previously reported in meta-analyses, and we have included these newly identified studies in our analysis to understand the effectiveness of VRET interventions (Horigome et al., 2020).”
What the sources say
- Not checked yetcites Horigome et al., 2020
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“However, exposure to SAD inevitably occurs outside of sessions as well, and treatment sessions were only held once a week for an hour in most studies.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: unclear — It is unclear why the paper says it holds.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“However, the data from these studies were not included twice in our analysis.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“However, our eligibility criteria did not exclude in vivo exposure in the VR intervention group, and all other criteria were met; consequently, we decided to include the study in order to obtain a broader picture of the effectiveness of VR interventions.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
In the paper
“We also agree with Morina ' s assertion about the possibility of over-reporting effects in studies with smaller numbers of participants, but their reanalysis, which excluded studies with smaller numbers of participants, seemed to show even stronger effects (Morina et al., 2021).”
What the sources say
- Not checked yetcites Morina et al., 2021
hedgedstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
7 more claims
Create a free account to see all 24 claims and to verify the 16 references still open.
- Probably not a substantial claim. 6
- It may state two separate claims as one. 6
Citations
Cites
Virtual reality exposure therapy for social anxiety disorder: A randomized controlled trial.
Anderson, P. L., Price, M., Edwards, S. M., Obasaju, M. A., Schmertz, S. K., Zimand, E., & Calamaras, M. R. (2013) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0033559 · Cited by 371 · cited 7×
“We found that there were more studies than previously reported in meta-analyses, and we have included these newly identified studies in our analysis to understand the effectiveness of VRET interventions (Horigome et al., 2020). In response to our paper, Morina, Kampmann, Emmelkamp, Barbui, and Hoppen (2021) published…”
BackgroundResultInfluentialVirtual Reality Cognitive Behavior Therapy for Public Speaking Anxiety: A Randomized Clinical Trial
Wallach, H. S., Safir, M. P., & Bar-Zvi, M. (2009) · Behavior Modification · doi:10.1177/0145445509331926 · Cited by 218
Virtual reality exposure therapy for social anxiety disorder: a systematic review and meta-analysis
Horigome, T., Kurokawa, S., Sawada, K., Kudo, S., Shiga, K., Mimura, M., & Kishimoto, T. (2020) · Psychological Medicine · doi:10.1017/s0033291720003785 · Cited by 160 · cited 1×
“We found that there were more studies than previously reported in meta-analyses, and we have included these newly identified studies in our analysis to understand the effectiveness of VRET interventions (Horigome et al., 2020).”
ResultSelf-citationVirtual Reality Cognitive-Behavior Therapy for Public Speaking Anxiety: One-Year Follow-Up
Safir, M. P., Wallach, H. S., & Bar-Zvi, M. (2012) · Behavior Modification · doi:10.1177/0145445511429999 · Cited by 107
Meta-analysis of virtual reality exposure therapy for social anxiety disorder
Morina, N., Kampmann, I., Emmelkamp, P., Barbui, C., & Hoppen, T. H. (2023) · Psychological Medicine · doi:10.1017/s0033291721001690 · Cited by 75 · cited 8×
“We also agree with Morina’s assertion about the possibility of over-reporting effects in studies with smaller numbers of participants, but their reanalysis, which excluded studies with smaller numbers of participants, seemed to show even stronger effects (Morina et al., 2021). Finally, Morina et al., stated that we ar…”
BackgroundMethodResultInfluentialYuen, E. K., Goetter, E. M., Stasio, M. J., Ash, P., Mansour, B., McNally, E., Sanchez, M., Hobar, E., Forte, S., Zulaica, K., et al. (2019) · Journal of Contextual Behavioral Science · doi:10.1016/j.jcbs.2019.01.006 · Cited by 43 · cited 2×
“On the other hand, we were concerned about the fact that Yuen et al. (2019) also conducted exposure exercises in the VR group session.”
BackgroundWallach, H. S., Safir, M. P., & Bar-Zvi, M. (2011) · PubMed · Cited by 30
Research works printed but not linked: 1
- Lister, 2010, The effectiveness of 3-D video virtual reality for the treatment of fear of public speaking, Journal of Cyber Therapy and Rehabilitation, 3, 375
Cited by
Planert, J., Hildebrand, A. S., Machulska, A., Roesmann, K., Neubert, M., Pilgramm, S., Pilgramm, J., & Klucken, T. (2025) · JMIR Human Factors · doi:10.2196/60957 · Cited by 7
Metadata
- Authors
- Horigome, T., Kurokawa, S., Sawada, K., Kudo, S., Shiga, K., Mimura, M., & Kishimoto, T.
- Affiliations
- Keio University (JP)
- Corresponding author
- Kishimoto, Taishiro
- Venue
- Psychological Medicine
- Publisher
- Cambridge University Press (CUP)
- Published
- 2021-10-19
- Volume
- 53
- Issue
- 5
- Pages
- 2179-2180
- ISSN
- 0033-2917 (ISSN-L)
- 1469-8978
- OpenAlex
- W3206759764
- Semantic Scholar
- 684af86b04659faf58e86d281e06a3755230f82b
- Cited by
- 1
- References
- 10
- Citations by year
- 2025: 1
- FWCI
- 0.00
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Psychological Medicine (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Anxiety, Depression, Psychometrics, Treatment, Cognitive Processes
- Physical Sciences › Computer Science › Human-Computer Interaction › Virtual Reality Applications and Impacts
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Keywords
- virtual reality exposure therapy, social anxiety disorder, treatment efficacy, virtual reality
- MeSH terms
- Phobia, Social, Anxiety Disorders, Humans, Phobic Disorders, Virtual Reality Exposure Therapy
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-10-11, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-11 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Response to Morina et al.'s criticisms of Horigome et al.'s recent report on the efficacy of virtual reality exposure therapy for social anxiety disorder. https://app.cochat.ai/papers/10.1017/s0033291721004086
- The paper
- Horigome, T., Kurokawa, S., Sawada, K., Kudo, S., Shiga, K., Mimura, M., & Kishimoto, T. (2023). Response to Morina et al.'s criticisms of Horigome et al.'s recent report on the efficacy of virtual reality exposure therapy for social anxiety disorder. Psychological Medicine. https://doi.org/10.1017/s0033291721004086
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.