Users’ Opinion About a Virtual Reality System as an Adjunct to Psychological Treatment for Stress-Related Disorders: A Quantitative and Qualitative Mixed-Methods Study
Open accessThe DOI matches its Crossref record; 44 of the 44 references it cites were found in a registry or an index.
Abstract
This study aims to explore patients’ and therapists’ attitudes about the psychological treatment they received (patients) or applied (therapists). The treatments were standard CBT protocols for Posttraumatic Stress Disorder (PTSD), Complicated Grief (CG), or Adjustment Disorders (AD), depending on each patient diagnosis. The treatments were delivered following a traditional format or supported by a Virtual Reality (VR) system “EMMA’s WORLD” designed for the treatment of Stress-related disorders. “EMMA’s WORLD” is a VR application in which patients can explore negative experiences using different virtual elements that can be customized to make them more meaningful to the user. The sample was composed of two groups: The “professionals” (N=10) were all clinical psychologists who applied the same psychological treatment in both the traditional format (“traditional condition”) and using the VR system ("EMMA" condition). The second group consisted of a sample of patients (N=50) who met the criteria for at least one of three different diagnoses: PTSD (N= 15), CG (N= 15), or AD (N= 20). 25 patients received treatment in the traditional format and 25 supported by the VR system. The patients were asked about their expectations (before treatment) and satisfaction (after treatment) with the treatment they received. All the therapists were asked their opinions about both treatment conditions. A mixed-methods approach using quantitative and qualitative methodologies was used. In both conditions, high scores were observed, and the patient’s opinions were even better when they have already received the treatments. A more pronounced pretest-postest change in the EMMA therapy group than in the traditional group was observed. EMMA’s World was well accepted by both patients and therapists, and it helped to foster motivation in patients, while helping the therapist to apply the treatment. Thus, VR can be useful as an adjunct tool to enhance the treatment.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A Guide to Conducting Consensual Qualitative Research
Hill, C. E., Thompson, B. J., & Williams, E. N. (1997) · The Counseling Psychologist · doi:10.1177/0011000097254001 · Cited by 2,884 · cited 1×
“Consensus is a key part of the CQR method, which “relies on mutual respect, equal involvement, and shared power” (Hill et al., 1997).”
MethodProblem solving and behavior modification.
D'Zurilla, T. J., & Goldfried, M. R. (1971) · Journal of Abnormal Psychology · doi:10.1037/h0031360 · Cited by 2,257
Estimating effect sizes from pretest-posttest-control group designs
Morris, S. B. (2008) · Organizational Research Methods · doi:10.1177/1094428106291059 · Cited by 2,133
Inventory of complicated grief: a scale to measure maladaptive symptoms of loss.
Prigerson, H. G., Maciejewski, P. K., Reynolds, C. F., Bierhals, A. J., Newsom, J. T., Fasiczka, A., Frank, E., Doman, J., & Miller, M. (1995) · Psychiatry Research · doi:10.1016/0165-1781(95)02757-2 · Cited by 1,582
Credibility of analogue therapy rationales
Borkovec, T. D., & Nau, S. D. (1972) · Journal of Behavior Therapy and Experimental Psychiatry · doi:10.1016/0005-7916(72)90045-6 · Cited by 1,553
Virtual Reality in the Assessment, Understanding, and Treatment of Mental Health Disorders
Freeman, D., Reeve, S., Robinson, A., Ehlers, A., Clark, D., Spanlang, B., & Slater, M. (2017) · Psychological Medicine · doi:10.1017/s003329171700040x · Cited by 1,428 · cited 2×
“These tools have already shown their efficacy, and they are considered very promising and helpful elements in delivering psychological treatments (Clough and Casey, 2011; Turner and Casey, 2014; Freeman et al., 2017).”
BackgroundPositive Psychology in Clinical Practice
Lee Duckworth, A., Steen, T. A., & Seligman, M. E. P. (2005) · Annual Review of Clinical Psychology · doi:10.1146/annurev.clinpsy.1.102803.144154 · Cited by 1,095 · cited 1×
“It also includes positive psychology strategies that attempt to increase the human beings’ natural ability to resist adversity and use it to grow (Duckworth et al., 2005).”
BackgroundVirtual reality exposure therapy for anxiety disorders: A meta-analysis
Powers, M. B., & Emmelkamp, P. M. G. (2008) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2007.04.006 · Cited by 904
Feingold, A. (2009) · Psychological Methods · doi:10.1037/a0014699 · Cited by 851
A survey of psychologists’ attitudes towards and utilization of exposure therapy for PTSD
Becker, C. B., Zayfert, C., & Anderson, E. (2004) · Behaviour Research and Therapy · doi:10.1016/s0005-7967(03)00138-4 · Cited by 759
Virtual reality exposure therapy in anxiety disorders: a quantitative meta-analysis
Opriş, D., Pintea, S., García-Palacios, A., Botella, C., Szamosközi, Ş., & David, D. (2012) · Depression and Anxiety · doi:10.1002/da.20910 · Cited by 636 · cited 1×
“In the past 15 years, the use of VR as an exposure technique has increased in terms of the number of problems it addresses and their complexity, and review studies and meta-analyses have been published on this topic (Powers and Emmelkamp, 2008; Gerardi et al., 2010; Meyerbröker and Emmelkamp, 2010; Opris et al., 2012;…”
BackgroundSelf-citationFriedman, M. J., Resick, P. A., Bryant, R. A., & Brewin, C. R. (2011) · Depression and Anxiety · doi:10.1002/da.20767 · Cited by 629 · cited 13×
“et al., 1990, 1995) This interview rates whether there have been traumatic events in the person’s life and the symptomatology associated with these events, and it makes it possible to establish the diagnosis of PTSD according to the DSM-IV.”
BackgroundInfluentialSearching for the meaning of meaning: Grief therapy and the process of reconstruction
Neimeyer, R. A. (2000) · Death Studies · doi:10.1080/07481180050121480 · Cited by 591 · cited 2×
“The treatment protocol for the traditional component was created by our group partly following the guidelines and strategies recommended by Neimeyer (2000) and Neimeyer et al. (2002).”
MethodTreatment of specific phobia in adults
Choy, Y., Fyer, A. J., & Lipsitz, J. D. (2007) · Clinical Psychology Review · doi:10.1016/j.cpr.2006.10.002 · Cited by 571 · cited 1×
“The data indicate that, when they realize that the exposure involves direct confrontation with the feared object or context, approximately 25% of patients reject or abandon it after starting (Marks and O’Sullivan, 1992; Choy et al., 2007; García-Palacios et al., 2007; Ong et al., 2016) because it is too aversive for t…”
BackgroundUsing the Internet to provide cognitive behaviour therapy
Andersson, G. (2009) · Behaviour Research and Therapy · doi:10.1016/j.brat.2009.01.010 · Cited by 560
Newman, M. G., Szkodny, L. E., Llera, S. J., & Przeworski, A. (2011) · Clinical Psychology Review · doi:10.1016/j.cpr.2010.09.008 · Cited by 480 · cited 1×
“The expectation is that these types of systems will increasingly be developed (Newman et al., 2011).”
BackgroundMorina, N., Ijntema, H., Meyerbröker, K., & Emmelkamp, P. M. G. (2015) · Behaviour Research and Therapy · doi:10.1016/j.brat.2015.08.010 · Cited by 439 · cited 2×
“In the past 15 years, the use of VR as an exposure technique has increased in terms of the number of problems it addresses and their complexity, and review studies and meta-analyses have been published on this topic (Powers and Emmelkamp, 2008; Gerardi et al., 2010; Meyerbröker and Emmelkamp, 2010; Opris et al., 2012;…”
BackgroundRiva, G., Baños, R. M., Botella, C., Mantovani, F., & Gaggioli, A. (2016) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2016.00164 · Cited by 425
Self-citationGarcia-Palacios, A., Botella, C., Hoffman, H., & Fabregat, S. (2007) · CyberPsychology & Behavior · doi:10.1089/cpb.2007.9962 · Cited by 410 · cited 2×
“…when they realize that the exposure involves direct confrontation with the feared object or context, approximately 25% of patients reject or abandon it after starting (Marks and O’Sullivan, 1992; Choy et al., 2007; García-Palacios et al., 2007; Ong et al., 2016) because it is too aversive for them.”
BackgroundSelf-citationCognitive and behavioral treatments for anxiety disorders: A review of meta‐analytic findings
Deacon, B. J., & Abramowitz, J. S. (2004) · Journal of Clinical Psychology · doi:10.1002/jclp.10255 · Cited by 400 · cited 1×
“A significant empirical base supports the efficacy of in vivo exposure, and data from meta-analyses consistently show its usefulness (Deacon and Abramowitz, 2004).”
BackgroundNEIMEYER, R. A., PRIGERSON, H. G., & DAVIES, B. (2002) · American Behavioral Scientist · doi:10.1177/000276402236676 · Cited by 373 · cited 1×
“Exercises are used to extract positive aspects of the situation experienced (Neimeyer, 2000; Neimeyer et al., 2002) and train the patient in coping with problems.”
MethodMeyerbröker, K., & Emmelkamp, P. M. G. (2010) · Depression and Anxiety · doi:10.1002/da.20734 · Cited by 290
The Cruelest Cure? Ethical Issues in the Implementation of Exposure-Based Treatments
Olatunji, B. O., Deacon, B. J., & Abramowitz, J. S. (2009) · Cognitive and Behavioral Practice · doi:10.1016/j.cbpra.2008.07.003 · Cited by 273 · cited 2×
“Without a doubt, exposure therapy can be considered one of the great success stories within the field of mental health (Olatunji et al., 2009).”
BackgroundVirtual reality treatment of claustrophobia: a case report
Botella, C., Baños, R. M., Perpiñá, C., Villa, H., Alcañiz, M., & Rey, A. (1998) · Behaviour Research and Therapy · doi:10.1016/s0005-7967(97)10006-7 · Cited by 247
Self-citationVirtual reality exposure in the treatment of panic disorder and agoraphobia: A controlled study
Botella, C., García‐Palacios, A., Villa, H., Baños, R. M., Quero, S., Alcañiz, M., & Riva, G. (2007) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.524 · Cited by 242
Self-citationBotella, C., Serrano, B., baños, R., & García-Palacios, A. (2015) · Neuropsychiatric Disease and Treatment · doi:10.2147/ndt.s89542 · Cited by 223
Self-citationRedefining therapeutic success with virtual reality exposure therapy
Garcia-Palacios, A., Hoffman, H. G., Kwong See, S., Tsai, A., & Botella, C. (2001) · CyberPsychology & Behavior · doi:10.1089/109493101300210231 · Cited by 212
Self-citationLindner, P., Miloff, A., Hamilton, W., Reuterskiöld, L., Andersson, G., Powers, M. B., & Carlbring, P. (2017) · Cognitive Behaviour Therapy · doi:10.1080/16506073.2017.1280843 · Cited by 187 · cited 1×
“The new VR generation offers new opportunities for the presentation of stimuli and contexts in ways that are impossible in traditional in vivo exposure therapy (Lindner et al., 2017).”
BackgroundOng, C. W., Clyde, J. W., Bluett, E. J., Levin, M. E., & Twohig, M. P. (2016) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2016.03.006 · Cited by 160 · cited 2×
“…when they realize that the exposure involves direct confrontation with the feared object or context, approximately 25% of patients reject or abandon it after starting (Marks and O’Sullivan, 1992; Choy et al., 2007; García-Palacios et al., 2007; Ong et al., 2016) because it is too aversive for them.”
BackgroundVirtual Reality Exposure Therapy for Post-Traumatic Stress Disorder and Other Anxiety Disorders
Gerardi, M., Cukor, J., Difede, J., Rizzo, A., & Rothbaum, B. O. (2010) · Current Psychiatry Reports · doi:10.1007/s11920-010-0128-4 · Cited by 154
Baños, R. M., Guillen, V., Quero, S., García-Palacios, A., Alcaniz, M., & Botella, C. (2011) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2011.06.002 · Cited by 137 · cited 2×
“More detailed descriptions can be found in Rey et al. (2005), Botella et al. (2006), and Baños et al. (2009, 2011).”
BackgroundMethodSelf-citationMcCann, R. A., Armstrong, C. M., Skopp, N. A., Edwards-Stewart, A., Smolenski, D. J., June, J. D., Metzger-Abamukong, M., & Reger, G. M. (2014) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2014.05.010 · Cited by 134
Becker, C. B., Darius, E., & Schaumberg, K. (2007) · Behaviour Research and Therapy · doi:10.1016/j.brat.2007.05.006 · Cited by 133
Technological adjuncts to increase adherence to therapy: A review
Clough, B. A., & Casey, L. M. (2011) · Clinical Psychology Review · doi:10.1016/j.cpr.2011.03.006 · Cited by 125
Outcomes associated with virtual reality in psychological interventions: where are we now?
Turner, W. A., & Casey, L. M. (2014) · Clinical Psychology Review · doi:10.1016/j.cpr.2014.10.003 · Cited by 116
Botella, C., Osma, J., Garcia‐Palacios, A., Quero, S., & Baños, R. M. (2004) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.404 · Cited by 86
Exposure therapy has a public relations problem
Richard, D. C. S., & Gloster, A. T. (2007) · Handbook of Exposure Therapies · doi:10.1016/b978-012587421-2/50019-3 · Cited by 77
An adaptive display to treat stress-related disorders: EMMA’s World
Baños, R. M., Botella, C., Guillen, V., García-Palacios, A., Quero, S., Bretón-López, J., & Alcañiz, M. (2009) · British Journal of Guidance & Counselling · doi:10.1080/03069880902957064 · Cited by 65 · cited 3×
“Based on the literature on using VR for other psychological problems (Botella et al., 2007; Baños et al., 2009; McCann et al., 2014; Freeman et al., 2017), we expect the VR system to be considered useful for therapy and well-accepted by both patients and therapists.”
BackgroundResultSelf-citationTelepsychology and self-help: the treatment of phobias using the internet
Botella, C., Quero, S., Banos, R. M., Garcia-Palacios, A., Breton-Lopez, J., Alcaniz, M., & Fabregat, S. (2008) · CyberPsychology & Behavior · doi:10.1089/cpb.2008.0012 · Cited by 56
Self-citationPresence-Inducing Media for Mental Health Applications
Riva, G., Botella, C., Baños, R., Mantovani, F., García-Palacios, A., Quero, S., Serino, S., Triberti, S., Repetto, C., Dakanalis, A., et al. (2015) · Immersed in Media · doi:10.1007/978-3-319-10190-3_12 · Cited by 55
Self-citationBotella, C., Mira, A., Moragrega, I., García-Palacios, A., Bretón-López, J., Castilla, D., Riera López del Amo, A., Soler, C., Molinari, G., Quero, S., et al. (2016) · Neuropsychiatric Disease and Treatment · doi:10.2147/ndt.s93315 · Cited by 42
Self-citationQuero, S., Pérez-Ara, M. Á., Bretón-López, J., García-Palacios, A., Baños, R. M., & Botella, C. (2014) · British Journal of Guidance & Counselling · doi:10.1080/03069885.2013.852159 · Cited by 42
Self-citationDeacon, B. J., Lickel, J. J., Possis, E. A., Abramowitz, J. S., Mahaffey, B., & Wolitzky-Taylor, K. (2012) · Journal of Cognitive Psychotherapy · doi:10.1891/0889-8391.26.3.257 · Cited by 39
Psychological Treatments for Panic Disorders, Phobias, and Social and Generalized Anxiety Disorders
Barlow, D. H., Conklin, L. R., & Bentley, K. H. (2015) · Oxford Clinical Psychology · doi:10.1093/med:psych/9780199342211.003.0014 · Cited by 12
Cited by
Framework of Affordances for Virtual Reality and Augmented Reality
Steffen, J. H., Gaskin, J. E., Meservy, T. O., Jenkins, J. L., & Wolman, I. (2019) · Journal of Management Information Systems · doi:10.1080/07421222.2019.1628877 · Cited by 298
Virtual reality in the diagnostic and therapy for mental disorders: A systematic review
Wiebe, A., Kannen, K., Selaskowski, B., Mehren, A., Thöne, A.-K., Pramme, L., Blumenthal, N., Li, M., Asché, L., Jonas, S., et al. (2022) · Clinical Psychology Review · doi:10.1016/j.cpr.2022.102213 · Cited by 223
Virtual Reality for the Enhancement of Emotion Regulation
Colombo, D., Díaz‐García, A., Fernandez‐Álvarez, J., & Botella, C. (2021) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.2618 · Cited by 120
Self-citationLindner, P., Rozental, A., Jurell, A., Reuterskiöld, L., Andersson, G., Hamilton, W., Miloff, A., & Carlbring, P. (2020) · JMIR Serious Games · doi:10.2196/17807 · Cited by 71
“Congruently, previous qualitative research in adjacent fields has revealed that VR allows users to experience rather simply perceive different situations [23], and that VR technology has an appealing allure in itself, being exciting, novel, and enjoyable through the inherent feature of creating a sense of presence [24…”
BackgroundMental health professionals’ attitudes towards virtual reality therapies: a systematic review
Bin, S., Alrashdi, D. H., Whitehead, T., Riches, S., & Drini, E. (2025) · Journal of Technology in Behavioral Science · doi:10.1007/s41347-025-00499-x · Cited by 21
“Multiple studies reported that patients feel more secure in VR therapy spaces (Chung et al., 2022; Guillén et al., 2018; Haeyen et al., 2021a, b) and less embarrassment during treatment (Lindner et al., 2019; Segal et al., 2011).”
Influential
Metadata
- Authors
- Guillén, V., Baños, R. M., & Botella, C.
- Venue
- Frontiers in Psychology
- Publisher
- Frontiers Media SA
- Published
- 2018-06-22
- Volume
- 9
- Pages
- 1038-1038
- ISSN
- 1664-1078 (ISSN-L)
- OpenAlex
- W2805589959
- Cited by
- 38
- References
- 44
- FWCI
- 4.59
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.