Measuring Alliance Toward Embodied Virtual Therapists in the Era of Automated Treatments With the Virtual Therapist Alliance Scale (VTAS): Development and Psychometric Evaluation
Open accessThe DOI matches its Crossref record; 61 of the 61 references it cites were found in a registry or an index; 10 of the 65 sources its claims cite were checked for support.
Abstract
Background: Automated virtual reality exposure therapies (VRETs) are self-help treatments conducted by oneself and supported by a virtual therapist embodied visually and/or with audio feedback. This simulates many of the nonspecific relational elements and common factors present in face-to-face therapy and may be a means of improving adherence to and efficacy of self-guided treatments. However, little is known about alliance toward the virtual therapist, despite alliance being an important predictor of treatment outcome. Objective: In this study, we aimed to evaluate the first alliance instrument developed for use with embodied virtual therapists in an automated treatment format—the Virtual Therapist Alliance Scale (VTAS)—by (1) assessing its psychometric properties, (2) verifying the dimensionality of the scale, and (3) determining the predictive ability of the scale with treatment outcome. Methods: A psychometric evaluation and exploratory factor analysis of the VTAS was conducted using data from two samples of spider-fearful patients treated with VRET and the help of an embodied, voice-based virtual therapist (n=70). Multiple regression models and bivariate correlations were used to assess the VTAS relationship with treatment outcome, according to self-reported fear and convergence with presence and user-friendliness process measures. Results: The VTAS showed a sound two-factor solution composed of a primary factor covering task, goal, and copresence; adequate internal consistency; and good convergent validity, including moderate correlation (r=.310, P=.01) with outcomes over follow-up. Conclusions: These preliminary results suggest that alliance toward a virtual therapist is a significant predictor of treatment outcome, favors the importance of a task-goal over bond-factor, and should be explored in studies with larger sample sizes and in additional forms of embodiment.
Overview
CoChat Summary
## TL;DR
This study developed and psychometrically evaluated the Virtual Therapist Alliance Scale (VTAS) for automated virtual reality exposure therapy (VRET) with embodied virtual therapists. In two spider-fearful patient samples, the VTAS showed a two-factor structure and good overall reliability, and alliance scores were positively related to follow-up outcome.
## Key findings
- The VTAS had a 17-item format and showed a two-factor solution: factor 1 covered task, goal, and copresence items, and factor 2 covered bond and empathy items.
- Internal consistency was high for the full scale: Cronbach alpha = .921 and McDonald omega = .921 overall; by study, alpha/omega were .915/.917 and .936/.938.
- Factor 1 explained 38.8% of total variance and factor 2 explained 14.0%.
- VTAS total scores correlated with outcome at follow-up: the abstract reports r = .310, P = .01, while the discussion describes a posttreatment correlation of r = .213 and a follow-up correlation of r = .310.
## Methods
- Psychometric evaluation and exploratory factor analysis of the VTAS were conducted using data from two independent samples of spider-fearful patients treated with automated VRET and an embodied, voice-based virtual therapist.
- The combined final sample with VTAS data was 70 participants; the two studies had 50 eligible and 25 eligible participants, respectively, and were conducted in a university laboratory environment.
- Analyses included maximum likelihood exploratory factor analysis with oblimin rotation, internal consistency estimates (Cronbach alpha, McDonald omega), Pearson correlations, Steiger tests, and multiple regression models to assess convergent validity and prediction of outcome.
## Limitations
- The paper states that the sample size was relatively small and that the two treatments differed in small ways (for example, language and whether a technician was present), so measurement invariance had to be assumed but could not be formally tested.
- The single-session treatment format prevented testing cross-lagged and mediation models for symptom reduction.
- The study examined only client-reported alliance ratings; it did not include therapist, observer, or friend/family ratings.
- Evidence from the text also suggests a limitation: the virtual therapist was primarily voice-based and noninteractive, with limited embodiment, so findings may not generalize to other embodiment styles.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures



Verification
Claims the paper makes
7 Valid · 1 Not valid · 50 Not checked · 53 Own results and interpretations
At least one cited source doesn’t support this claim or points to a different paper, and none confirmed it — see the verdicts below.
In the paper
“In a systematic review of VRET process and outcome research, only two studies were identified that captured alliance information [15]: a study of fear of flying, but not an acrophobia study, found a significant correlation with outcome.”
§ Measuring Alliance Toward Embodied Virtual Therapists in the Era of Automated Treatments With the Virtual Therapist Alliance Scale (VTAS): Development and Psychometric Evaluation > Introduction
What the sources say
- Disputedcites [15] sourceExperimental — accuracy not yet measured
The Abstract says only one study explicitly addressed therapeutic alliance in VRET. The section “Therapeutic Alliance and Expectancy of Therapeutic Gains” explains that the two process studies examined different mechanisms—therapeutic alliance and treatment-outcome expectancy—not that both captured alliance information. It does support the sentence’s later distinction: alliance predicted outcome in the fear-of-flying group but not the acrophobia group. (LLM, conf=0.89)
Checked by a reasoning model — may be wrong.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Disputed
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“However, previous research suggests that treatments conducted without therapist support suffer from lower adherence and efficacy as compared to treatments that include contact [19,20].”
§ Measuring Alliance Toward Embodied Virtual Therapists in the Era of Automated Treatments With the Virtual Therapist Alliance Scale (VTAS): Development and Psychometric Evaluation > Introduction
What the sources say
- Partly supportedcites [19] sourceExperimental — accuracy not yet measured
The Treatment Approach section says guided internet-delivered CBT tends to be more effective than self-guided CBT. The Evidence Base to Date section reports high dropout in early unguided studies, but does not directly compare their adherence with guided treatments, so the lower-adherence comparison is not established by this paper. (LLM, conf=0.85)
- Partly supportedcites [20] sourceExperimental — accuracy not yet measured
The Discussion (Implications for Future Work; page unavailable) reports that telephone and email reminders were likely important for retention and improvement, and that case management may support adherence. It does not establish that treatments without therapist support have lower adherence and efficacy than otherwise comparable treatments with therapist contact. (LLM, conf=0.84)
hedgedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“Few studies, however, have assessed alliance during VRET treatments, perhaps due to an expectation that alliance will be poor in treatments that prevent face-to-face contact with a therapist [9].”
§ Measuring Alliance Toward Embodied Virtual Therapists in the Era of Automated Treatments With the Virtual Therapist Alliance Scale (VTAS): Development and Psychometric Evaluation > Introduction
What the sources say
- Supportedcites [15] source
The Abstract says only one study had explicitly addressed therapeutic alliance in VRET. The Concluding Remarks likewise describe research on alliance during VRET as scarce. Page numbers are not provided in our copy. (LLM, conf=0.94)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“Alliance is considered a generic common factor, with meaning and usefulness expected to be preserved across theoretical orientations [2] and evidence suggests that a range of technology-based interventions can facilitate alliance [36].”
§ Measuring Alliance Toward Embodied Virtual Therapists in the Era of Automated Treatments With the Virtual Therapist Alliance Scale (VTAS): Development and Psychometric Evaluation > Introduction
What the sources say
- Supportedcites [2] source
The Introduction describes alliance as a “common factor,” a generic variable that, at least in theory, has similar utility and meaning across theoretical orientations. The claim preserves that qualification by saying its meaning and usefulness are expected to carry across orientations. (LLM, conf=0.95)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“however, a high coefficient alpha is difficult to obtain in scales with few items, given its relationship to length (ie, 12 versus five items on factor 2) [49].”
§ Measuring Alliance Toward Embodied Virtual Therapists in the Era of Automated Treatments With the Virtual Therapist Alliance Scale (VTAS): Development and Psychometric Evaluation > Discussion
What the sources say
- Supportedcites [49] source
In “Psychometric evaluation: An iterative process,” Clark and Watson state that coefficient alpha depends on scale length and average interitem correlation, and that many items make a high reliability estimate difficult to avoid. This supports the claim that obtaining a high alpha is harder with fewer items; the 12-versus-five-item comparison is the citing paper’s illustration, not a result reported by the source. (LLM, conf=0.87)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
36 more claims
Create a free account to see all 111 claims and to verify the 55 references still open.
- Probably not a substantial claim. 46
- It may state two separate claims as one. 43
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“and that the quality of this relationship predicted long-term improvements (Miloff et al. 2020).”
From Better, Virtually: the Past, Present, and Future of Virtual Reality Cognitive Behavior Therapy (2021) · cites this paper as Miloff et al. 2020
The cited source says what the claim attributes to it.
In the citing paper
“Although initial research has revealed a correlation between alliance and outcomes [53]”
From Experiences of gamified and automated virtual reality exposure therapy for spider phobia: qualitative study (2020) · cites this paper as [53]
In the citing paper
“Precisely how common factors investigated in traditional psychotherapy translate into the mHealth context, particularly unguided mHealth, is an area of active research122,123.”
From A common factors perspective on mindfulness-based interventions (2022) · cites this paper as [123]
In the citing paper
“showing that a relationship similar to a working alliance does seem to form with the virtual therapist”
From Better, Virtually: the Past, Present, and Future of Virtual Reality Cognitive Behavior Therapy (2021) · cites this paper as Miloff et al. 2020
In the citing paper
“Recent research has shown that users can develop a relationship similar to a working alliance with either the VR intervention itself [52] or a VR therapist [53].”
From Experiences of gamified and automated virtual reality exposure therapy for spider phobia: qualitative study (2020) · cites this paper as [53]
Citations
Cites
The generalizability of the psychoanalytic concept of the working alliance.
Bordin, E. S. (1979) · Psychotherapy: Theory, Research & Practice · doi:10.1037/h0085885 · Cited by 5,238 · cited 1×
“Alliance is conceptualized as requiring three distinct processes: agreement on therapeutic goals, consensus on tasks that make up therapy, and bond between therapist and patient [3].”
BackgroundAn Empirical Evaluation of the System Usability Scale
Bangor, A., Kortum, P. T., & Miller, J. T. (2008) · International Journal of Human–Computer Interaction · doi:10.1080/10447310802205776 · Cited by 5,181 · cited 1×
“The System Usability Scale (SUS) is a 10-item scale for assessing user friendliness [43] and appropriateness of a tool for a given context [44]; it is considered technology agnostic, showing utility across a range of interface types, including graphical and speech-based systems.”
Usability Evaluation In Industry
(1996) · CRC Press eBooks · doi:10.1201/9781498710411 · Cited by 4,354
Development and validation of the working alliance inventory
Horvath, A. O., & Greenberg, L. S. (1989) · Journal of Counseling Psychology · doi:10.1037//0022-0167.36.2.223 · Cited by 3,520 · cited 16×
“Contrary to this expectation, studies of patients treated with VRET and in vivo exposure therapy for social anxiety disorder found no significant difference between interventions as measured by the WAI [10-12].”
BackgroundMethodInfluentialFactor Retention Decisions in Exploratory Factor Analysis: a Tutorial on Parallel Analysis
Hayton, J. C., Allen, D. G., & Scarpello, V. (2004) · Organizational Research Methods · doi:10.1177/1094428104263675 · Cited by 3,104 · cited 1×
“Parallel analysis [48] was used to extract factor loading of items using maximum likelihood explorative factor analysis with oblimin rotation.”
MethodThe Experience of Presence: Factor Analytic Insights
Schubert, T., Friedmann, F., & Regenbrecht, H. (2001) · Presence: Teleoperators and Virtual Environments · doi:10.1162/105474601300343603 · Cited by 2,303 · cited 6×
“Presence according to the IPQ, and the Gatineau Presence Questionnaire (GPQ) below, were taken as a measure of convergent validity with VTAS copresence items.”
MethodInfluentialThe alliance in adult psychotherapy: A meta-analytic synthesis
Flückiger, C., Del Re, A. C., Wampold, B. E., & Horvath, A. O. (2018) · Psychotherapy · doi:10.1037/pst0000172 · Cited by 1,763 · cited 2×
“Nevertheless, overall results in this study compare favorably to current meta-analytic best evidence for the relationship between alliance and outcome [57].”
BackgroundResultFactor structure of the working alliance inventory
Tracey, T. J., & Kokotovic, A. M. (1989) · Psychological Assessment: A Journal of Consulting and Clinical Psychology · doi:10.1037/1040-3590.1.3.207 · Cited by 1,501 · cited 3×
“The WAI-VAR [31], however, was developed to address comfort and trust with the virtual environment itself, replacing “my therapist” with “virtual environment” for all items of the Spanish version of the WAI-S.”
BackgroundInfluentialConstructing validity: New developments in creating objective measuring instruments.
Clark, L. A., & Watson, D. (2019) · Psychological Assessment · doi:10.1037/pas0000626 · Cited by 1,470 · cited 6×
“As recommended by Clark and Watson [49], a sensitivity analysis was carried out that removed similarly cross-loading items, with the threshold set at 0.”
BackgroundMethodInfluentialVirtual Reality in the Assessment, Understanding, and Treatment of Mental Health Disorders
Freeman, D., Reeve, S., Robinson, A., Ehlers, A., Clark, D., Spanlang, B., & Slater, M. (2017) · Psychological Medicine · doi:10.1017/s003329171700040x · Cited by 1,428 · cited 2×
“Automated VRET treatments—replacing in vivo stimuli with virtual stimuli in addition to replacing human therapist with virtual therapist [16]—are an example of autonomous digital treatments, and being self-guided may be among the most scalable of psychological interventions [17,18].”
Background
Research works printed but not linked: 5
- Luborsky, L, 1996, J Psychother Pract Res, 5, 260
- HartantoDBrinkmanWPKampmannIlMorinaNEmmelkampPGNeerincxMAHome-based virtual reality exposure therapy with virtual health agent supportProceedings of the International Symposium on Pervasive Computing Paradigms for Mental Health, MindCare 20152016International Symposium on Pervasive Computing Paradigms for Mental Health, MindCare 2015September 24-25, 2015Milan, ItalyCham, SwitzerlandSpringer International Publishing8598
- Andrusyna, TP, 2001, J Psychother Pract Res, 10, 173
- Law, M, 2015, J Acad Bus Ethics, 10, 1
- Bangor, A, 2009, J Usability Stud, 4, 114
Cited by
Dincelli, E., & Yayla, A. (2022) · The Journal of Strategic Information Systems · doi:10.1016/j.jsis.2022.101717 · Cited by 490
Artificial intelligence technologies and compassion in healthcare: A systematic scoping review
Morrow, E., Zidaru, T., Ross, F., Mason, C., Patel, K. D., Ream, M., & Stockley, R. (2023) · Frontiers in Psychology · doi:10.3389/fpsyg.2022.971044 · Cited by 250
“← Automated VR exposure therapies (VRETs) for patient adherence and efficacy of self-guided treatments (Brandt et al., 2018; Miloff et al., 2020)”
BackgroundVirtual reality in the diagnostic and therapy for mental disorders: A systematic review
Wiebe, A., Kannen, K., Selaskowski, B., Mehren, A., Thöne, A.-K., Pramme, L., Blumenthal, N., Li, M., Asché, L., Jonas, S., et al. (2022) · Clinical Psychology Review · doi:10.1016/j.cpr.2022.102213 · Cited by 223
A new era in Internet interventions: The advent of Chat-GPT and AI-assisted therapist guidance
Carlbring, P., Hadjistavropoulos, H., Kleiboer, A., & Andersson, G. (2023) · Internet Interventions · doi:10.1016/j.invent.2023.100621 · Cited by 118
Self-citationBetter, Virtually: the Past, Present, and Future of Virtual Reality Cognitive Behavior Therapy
Lindner, P. (2021) · International Journal of Cognitive Therapy · doi:10.1007/s41811-020-00090-7 · Cited by 120
Self-citationMediated Social Support for Distress Reduction: AI Chatbots vs. Human
Meng, J., Rheu, M. (., Zhang, Y., Dai, Y., & Peng, W. (2023) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3579505 · Cited by 74
Herrero, R., Vara, M. D., Miragall, M., Botella, C., García-Palacios, A., Riper, H., Kleiboer, A., & Baños, R. M. (2020) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph17176169 · Cited by 81
“[50] adopted this approach of developing novel items and validated the Virtual Therapist Alliance Scale (VTAS), which assesses the three components of the TA with virtual therapists in an automated exposure treatment format for patients with fear of spiders.”
MethodA common factors perspective on mindfulness-based interventions
Goldberg, S. B. (2022) · Nature Reviews Psychology · doi:10.1038/s44159-022-00090-8 · Cited by 75
Alliance with an unguided smartphone app: validation of the digital working alliance inventory
Goldberg, S. B., Baldwin, S. A., Riordan, K. M., Torous, J., Dahl, C. J., Davidson, R. J., & Hirshberg, M. J. (2022) · Assessment · doi:10.1177/10731911211015310 · Cited by 74
“Two studies (Miloff et al., 2020; Miragall et al., 2015) adapted the WAI for virtual reality and/or augmented reality therapies, primarily by replacing “my therapist” with “the virtual environment” or “the virtual therapist.”
BackgroundLindner, P., Rozental, A., Jurell, A., Reuterskiöld, L., Andersson, G., Hamilton, W., Miloff, A., & Carlbring, P. (2020) · JMIR Serious Games · doi:10.2196/17807 · Cited by 71
“Recent research has shown that users can develop a relationship similar to a working alliance with either the VR intervention itself [52] or a VR therapist [53].”
BackgroundSelf-citationQuestionnaires for evaluating virtual reality: A systematic scoping review
Bareišytė, L., Slatman, S., Austin, J., Rosema, M., van Sintemaartensdijk, I., Watson, S. J., & Bode, C. (2024) · Computers in Human Behavior Reports · doi:10.1016/j.chbr.2024.100505 · Cited by 76
Extended Reality for Enhanced Telehealth During and Beyond COVID-19: Viewpoint
Ong, T., Wilczewski, H., Paige, S. R., Soni, H., Welch, B. M., & Bunnell, B. E. (2021) · JMIR Serious Games · doi:10.2196/26520 · Cited by 61
“Miloff and colleagues [134] developed an automated AR hologram embedded in VR exposure therapy and demonstrated that therapeutic alliance measures generalized to the virtual therapist.”
BackgroundThe Working Alliance Inventory's Measurement Properties: A Systematic Review
Paap, D., Karel, Y., Verhagen, A. P., Dijkstra, P. U., Geertzen, J. H. B., & Pool, G. (2022) · Frontiers in Psychology · doi:10.3389/fpsyg.2022.945294 · Cited by 52
Fagernäs, S., Hamilton, W., Espinoza, N., Miloff, A., Carlbring, P., & Lindner, P. (2021) · Internet Interventions · doi:10.1016/j.invent.2021.100370 · Cited by 48
“by featuring an embodied virtual therapist (Miloff et al., 2020).”
Self-citationNavigating the metaverse: A technical review of emerging virtual worlds
Herath, H. M. K. K. M. B., Mittal, M., & Kataria, A. (2024) · Wiley Interdisciplinary Reviews Data Mining and Knowledge Discovery · doi:10.1002/widm.1538 · Cited by 44
“…al., Goldenhersch et al., 2020; Jung et al., 2020; Kim et al., 2020; Lee et al., 2020; Lin et al., 2020; Lombart et al., 2020; Mattila et al., 2020; Miloff et al., 2020; Pedram et al., 2020; Pot-Kolder et al., 2020; Saredakis, Keage, et al., 2020; Saredakis, Szpak, et al., 2020; Seabrook et al.,…”
Kahlon, S., Lindner, P., & Nordgreen, T. (2023) · Frontiers in Virtual Reality · doi:10.3389/frvir.2023.1240778 · Cited by 40
Self-citationUnderstanding Human-AI Collaboration in Music Therapy Through Co-Design with Therapists
Sun, J., Yang, J., Zhou, G., Jin, Y., & Gong, J. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642764 · Cited by 33
“Although human-AI collaboration in therapy shows promise, critical challenges have been identified, such as the lack of human-like empathy [17], impact on the therapeutic alliance [92], and client attitudes towards AI guidance [65].”
BackgroundReal-world use of large language models for mental health in 2024
Stade, E. C., Tait, Z., Campione, S. T., Stirman, S. W., & Eichstaedt, J. C. (2026) · npj Digital Medicine · doi:10.1038/s41746-026-02842-9 · Cited by 38
“We assessed participant alliance with the AI agent using the Virtual Therapist Alliance Scale 55 , modi fi ed to be relevant to AI chatbots for the current study.”
Talking Mental Health: a Battle of Wits Between Humans and AI
Lopes, E., Jain, G., Carlbring, P., & Pareek, S. (2023) · Journal of Technology in Behavioral Science · doi:10.1007/s41347-023-00359-6 · Cited by 36
“Due to their non-human nature, patients’ expectations and perceptions of interactions may differ, impacting engagement and treatment adherence (Miloff et al., 2020; Bond et al., 2019; Wampold & Flückiger, 2023).”
Self-citationWei, S., Freeman, D. H., & Rovira, A. (2023) · Scientific Reports · doi:10.1038/s41598-023-38499-7 · Cited by 30
“Alliance with the virtual coach was measured by the Virtual Therapist Al-liance Scale (VTAS) 6 .”
MethodMortimer, R., Somerville, M. P., Mechler, J., Lindqvist, K., Leibovich, L., Guerrero-Tates, B., Edbrooke-Childs, J. H., Martin, P., & Midgley, N. (2022) · Clinical Child Psychology and Psychiatry · doi:10.1177/13591045221081193 · Cited by 27
“Many measures have been developed for assessing therapeutic alliance in face-to-face therapy, and recently researchers have begun adapting these for various internet-based interventions (Berry et al., 2018; Gómez Penedo et al., 2020; Miloff et al., 2020).”
MethodCrone, C., & Kallen, R. W. (2024) · Computers in Human Behavior Reports · doi:10.1016/j.chbr.2024.100422 · Cited by 27
Kruse, L., Hertel, J., Mostajeran, F., Schmidt, S., & Steinicke, F. (2023) · Proceedings - International Symposium on Mixed and Augmented Reality, ISMAR · doi:10.1109/ismar59233.2023.00082 · Cited by 28
“…like depression [51,78], developmental speech or language disorders [70,77], anxiety or fear-related disorders such as public speaking anxiety [27,39,78], disorders specifically associated with stress such as the post-traumatic stress disorder [60,73,74], the autism spectrum disorder [72], and…”
BackgroundResultInfluentialDaele, T. V., Mathiasen, K., Carlbring, P., Bernaerts, S., Brugnera, A., Compare, A., Duque, A., Eimontas, J., Gosar, D., Haddouk, L., et al. (2022) · Internet Interventions · doi:10.1016/j.invent.2022.100571 · Cited by 27
“However, the underlying dynamics of such online contacts remain inconclusive, as well as whether these contacts can also occur and take shape in a virtual environment (de Bitencourt Machado et al., 2016; Miloff et al., 2020).”
BackgroundSelf-citationThe gold-standard treatment for social anxiety disorder: A roadmap for the future
Chowdhury, N., & Khandoker, A. H. (2023) · Frontiers in Psychology · doi:10.3389/fpsyg.2022.1070975 · Cited by 17
“However, VRET sessions can also be conducted in the comfort of one’s home (Hartanto et al., 2015; Emmelkamp et al., 2020; Miloff et al., 2020; Stefaniak et al., 2022).”
BackgroundLindner, P., Dafgård, P., Miloff, A., Andersson, G., Reuterskiöld, L., Hamilton, W., & Carlbring, P. (2021) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2021.645273 · Cited by 18
Self-citationElectrophysiological correlates of in vivo and virtual reality exposure therapy in spider phobia
Wiens, S., Eklund, R., Szychowska, M., Miloff, A., Cosme, D., Pierzchajlo, S., & Carlbring, P. (2022) · Psychophysiology · doi:10.1111/psyp.14117 · Cited by 16
“…reality exposure therapy (VRET; Miloff et al., 2016) composed of multiple levels of increasingly realistic spiders, game- playing elements such as points and puzzles, and a virtual embodied therapist (Miloff et al., 2020) to help guide the patient, reinforce progress, and provide psychoeducation.”
BackgroundSelf-citationJohnson, C., Egan, S. J., Carlbring, P., Shafran, R., & Wade, T. D. (2024) · Internet Interventions · doi:10.1016/j.invent.2024.100795 · Cited by 17
“Embedding principles from frameworks such as the Virtual Therapist Alliance Scale (VTAS; Miloff et al., 2020) may help foster trust and a sense of partnership that simulates a collaborative therapeutic relationship.”
Self-citationMental health in the virtual world: Challenges and opportunities in the metaverse era
del Hoyo, Y. L., Elices, M., & García‐Campayo, J. (2024) · World Journal of Clinical Cases · doi:10.12998/wjcc.v12.i17.2939 · Cited by 17
Bolpagni, M., & Gabrielli, S. (2025) · Informatics · doi:10.3390/informatics12010033 · Cited by 19
“The Virtual Therapist Alliance Scale (VTAS) [34] has been used [35] to evaluate these dimensions, providing insights into users’ perceptions of the chatbot as a supportive and trustworthy therapeutic agent.”
Rowshon, M., Mosaddeque, A., Ahmed, T., & Twaha, U. (2025) · International Journal of Multidisciplinary Research and Growth Evaluation · doi:10.54660/.ijmrge.2022.3.1.784-796 · Cited by 17
Chard, I., Zalk, N. V., & Picinali, L. (2023) · Frontiers in Virtual Reality · doi:10.3389/frvir.2023.1159549 · Cited by 12
Vlaescu, G., Carlbring, P., & Andersson, G. (2026) · Internet Interventions · doi:10.1016/j.invent.2026.100955 · Cited by 12
Self-citationRan, M. O., Zuozhi, F. A. N. G., & Jiandong, F. A. N. G. (2022) · Advances in Psychological Science · doi:10.3724/sp.j.1042.2023.00669 · Cited by 10
“…et al., 2018; Jonell, 2019; Kuo et al., 2021; Lee et al., 2020; Liu & Yang, 2021),并提供 诸如文字、图像、选项、语音等交互形式,以适应不同群体的习惯。此外,还可结合 虚拟现实(Virtual Reality, VR)技术来弥补虚拟与真实交互的差距,强化沉浸感及社 会存在(Donker et al., 2019; Miloff et al,. 2020)。 (Newby et al., 2017; Titov et al., 2015),但仍有部分群体并 c h i n a X i v : 202210 .”
A Review of Virtual Therapists in Anxiety and Phobias Alleviating Applications
Mitruț, O., Moldoveanu, A. D. B., Petrescu, L., Petrescu, C., & Moldoveanu, F. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-77599-5_6 · Cited by 10
A digital therapeutic alliance in digital mental health
Kaveladze, B., & Schueller, S. M. (2023) · Digital Therapeutics for Mental Health and Addiction · doi:10.1016/b978-0-323-90045-4.00009-5 · Cited by 8
Evaluating the Contribution of New Factors in the Assessment of eHealth Therapeutic Alliance
Ashur, O., Muench, F. J., & Baumel, A. (2023) · Journal of Technology in Behavioral Science · doi:10.1007/s41347-023-00336-z · Cited by 8
“To develop this set of items, we followed the methodology presented in Miloff et al. (2020), constructing the new subscales’ items based on previous studies and existing scales.”
van Lotringen, C. M., ten Klooster, P. M., Austin, J., Westerhof, G. J., Kelders, S. M., & Noordzij, M. L. (2024) · BMC Digital Health · doi:10.1186/s44247-024-00132-6 · Cited by 8
Goldberg, S. B., Jiwani, Z., Bolt, D. M., Riordan, K. M., Davidson, R. J., & Hirshberg, M. J. (2023) · Clinical Psychological Science · doi:10.1177/21677026231184890 · Cited by 9
“…empirical studies that examined the association between outcomes and existing measures purported to assess digital alliance within unguided mHealth interventions have been mixed; some have detected the expected association (e.g., Miloff et al., 2020), and others have not (e.g., Kiluk et al., 2014).”
BackgroundVirtual Humans in Virtual Reality Mental Health Research: Systematic Review
Wei, S., Freeman, D. H., & Rovira, A. (2025) · JMIR XR and spatial computing. · doi:10.2196/75087 · Cited by 6
“Generally, increasing the engagement and friendliness of communication from virtual coaches is likely to improve their effectiveness and the outcomes of VR therapy [68].”
Hlynsson, J. I., Mechler, J., Lindqvist, K., Andersson, G., & Carlbring, P. (2026) · Internet Interventions · doi:10.1016/j.invent.2026.100960 · Cited by 6
“Despite potential for agreement on treatment tasks and goals, the development of a bond with AI remains limited (Miloff et al., 2020).”
Self-citationEllis, D. M., & Anderson, P. L. (2023) · JMIR Mental Health · doi:10.2196/43929 · Cited by 6
“Similarly, the Virtual Therapist Alliance Scale [31] measures perceptions of the therapeutic alliance with digital therapist avatars common to automated virtual reality exposure therapies.”
Marcoux, A., Tessier, M.-H., Grondin, F., Reduron, L. R., & Jackson, P. L. (2021) · Santé mentale au Québec · doi:10.7202/1081509ar · Cited by 6
When LLMs Recognize Your Space: Research on Experiences with Spatially Aware LLM Agents
Oh, S., An, N., Cho, Y., Jung, M., & Kim, K. K. (2025) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2025.3616809 · Cited by 4
“Because we used counselling content, we incorporated a therapist-related scale [43] and evaluated all user dialogues for self-disclosure.”
InfluentialPhysiological Responses to Affective Virtual Coach Design in a VR Fear of Heights Consultation
Wei, S., Ali, A. E., Cesar, P. S., Freeman, D. H., & Rovira, A. (2025) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3706599.3719715 · Cited by 4
“We collected participants’ subjective ratings of therapeutic alliance by the Virtual Therapist Alliance Scale [28] and treatment credibility/expectancy [7] after the VR indoor consultation.”
Providing Psychological Support After Miscarriage Through a Customizable Virtual Reality Experience
Cameirão, M. S., Agrela, J. G., Mendes, D. C. G., Costa, R., & Badia, S. B. I. (2023) · SeGAH ... IEEE ... International Conference on Serious Games and Applications for Health/IEEE International Conference on Serious Games and Applications for Health · doi:10.1109/segah57547.2023.10253763 · Cited by 5
“Further, the gamification of such tasks has proven to promote motivation and engagement, especially in self-help platforms [11].”
BackgroundRings, S., Kruse, L., Rudschies, C., Rolvien, L., Schauenburg, G., Gallinat, J., Schneider, I., & Steinicke, F. (2025) · Mensch und Computer (MuC) · doi:10.1145/3743049.3743063 · Cited by 4
Schläpfer, S., Barth, J., Heinz, P., Held, U., Kowatsch, T., & Witt, C. M. (2026) · Internet Interventions · doi:10.1016/j.invent.2026.100929 · Cited by 2
“It also aligns with findings from a recent meta-analysis on the digital working alliance in guided interventions, which showed that the task subscale was generally more predictive of treatment outcomes than bond (Probst Greta H et al., 2022; Miloff et al., 2020; Bur et al., 2022).”
Sine of the times: Can sinusoidal waves model changes in the therapeutic alliance over time?
Shalom, J. G., Korem, M., Strauss, A. Y., Huppert, J. D., Andersson, G., & Aderka, I. M. (2025) · Internet Interventions · doi:10.1016/j.invent.2025.100845 · Cited by 1
“Third, additional factors such as the user interface of the treatment (e.g., Miloff et al., 2020) as well as client characteristics such as attachment and internalized support can potentially influence the therapeutic alliance.”
Self-citationVirtual Intelligent Agent for Hand Therapy Support
Jiménez-Moreno, R. (2025) · Journal of Hunan University Natural Sciences · doi:10.55463/issn.1674-2974.52.6.3 · Cited by 1
"Say Bye for Hi": XR Mourning Ritual with AI-powered Avatars in the Aftermath of a National Tragedy
Suk, H., Laine, T. H., & Jang, Y.-B. (2026) · Electronic Imaging · doi:10.2352/ei.2026.38.13.ervr-187 · Cited by 1
Examining the Potential of Social Robots to Increase Adherence in Internet-based CBT
Konijn, E. A., Peeper, G., Portegies, T. C., Garnefski, N., Kraaij, V., & Struijs, S. Y. (2026) · International Journal of Social Robotics · doi:10.1007/s12369-026-01417-8 · Cited by 1
“Alliance formed between the iCBT facilitator and the participant was measured after each session with the Virtual Therapist Alliance Scale (VTAS; [ 33 ]; Cronbach’s alpha = 0.92).”
InfluentialInternet-based psychotherapies
Andersson, G. (2021) · Elsevier eBooks · doi:10.1016/b978-0-12-822201-0.00008-3 · Cited by 1
Self-citation[DC] Dynamic facial expressions on virtual humans for virtual reality (VR) mental health therapy
Wei, S. (2022) · IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW) · doi:10.1109/vrw55335.2022.00314 · Cited by 2
Prusiński, T. (2022) · Przegląd Psychologiczny · doi:10.31648/przegldpsychologiczny.9103 · Cited by 1
Mental health in the virtual world: Are we ready for the metaverse era?
Mamede, T., & Lordêlo, P. (2024) · World Journal of Methodology · doi:10.5662/wjm.v14.i4.95064 · Cited by 1
Building a Dialogue Model using Generative Pre-trained Transformer
Chowanda, A., & Ariff, M. I. M. (2024) · International Seminar on Research of Information Technology and Intelligent Systems (ISRITI) · doi:10.1109/isriti64779.2024.10963600 · Cited by 1
“Modelling human conversation can generally be implemented in several virtual humans or Embodied Conversational Agents (ECA) applications, such as virtual assistant [1]–[3], virtual coach [4], virtual therapist [5], [6], virtual game agent [7], [8], and many more.”
Editorial: Multimodal interaction technologies for mental well-being
Lefter, I., Rook, L., & Chaspari, T. (2024) · Frontiers in Computer Science · doi:10.3389/fcomp.2024.1412727 · Cited by 1
Application of Virtual Interaction Technology in Rehabilitation Robot
余, 学. (2023) · Artificial Intelligence and Robotics Research · doi:10.12677/airr.2023.122005
Prusiński, T. (2022) · Przegląd Psychologiczny · doi:10.31648/przegldpsychologiczny.8671 · Cited by 1
Determinants of Quality in the Design, Development and Evaluation of Digital Health Programs
Stoyanov, S. R. (2025) · Queensland University of Technology · doi:10.5204/thesis.eprints.261406
Hallmann, M., Peperkorn, N., Vona, F., Shiban, Y., & Voigt‐Antons, J. (2026) · JMIR XR and spatial computing. · doi:10.2196/81537
“Previous research on automated VRET interventions has suggested that virtual therapists can contribute to therapeutic processes by providing psychoeducation, guidance, and supporting a relationship similar to a therapeutic alliance [27,31].”
Pavão, J., Bastardo, R., Silva, A. G., & Rocha, N. P. (2026) · JMIR Human Factors · doi:10.2196/102911
“…terms of the purposes of the HCAs described in the included articles, 4 major categories were identified: • Patient care: 73 studies [81,82,85,87,89,92,95-97, • Health education and prevention: 33 studies [86,90,93,103, 109,110,112,116-118, • Health data collection: 15 studies [88,91,98,99,…”
InfluentialYoung, J. (2026) · Journal of Technology in Counselor Education and Supervision · doi:10.61888/2692-4129.1155
Seierstad, A., Bull, H. C., Brevik, P., Bryn, K., Yasmin, H., Løvgren, A., Røssberg, J. I., & Lystad, J. U. (2026) · Frontiers in Virtual Reality · doi:10.3389/frvir.2026.1898848
Zhang, F., Chen, Y., Liu, M., Xu, J., & Xu, J. (2026) · Scientific Reports · doi:10.1038/s41598-026-72496-w
A Theory-Driven Approach to Measuring Human-Robot Bonding: The Bonding QuestionnairePreprint
van Minkelen, P., & Konijn, E. A. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7625200
Metadata
- Authors
- Miloff, A., Carlbring, P., Hamilton, W., Andersson, G., Reuterskiöld, L., & Lindner, P.
- Affiliations
- Stockholm University (SE)
- Mimerse (Sweden) (SE)
- Linköping University (SE)
- Karolinska Institutet (SE)
- Corresponding author
- Miloff, Alexander
- ORCID
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2020-03-24
- Volume
- 22
- Issue
- 3
- Pages
- e16660
- ISSN
- 1438-8871 (ISSN-L)
- PMC
- PMC7139418
- OpenAlex
- W3012939091
- Semantic Scholar
- 9ada8fdce5d8438189224235500df93001408030
- Cited by
- 60
- References
- 61
- Citations by year
- 2026: 7 · 2025: 7 · 2024: 10 · 2023: 14 · 2022: 12 · 2021: 7 · 2020: 3
- FWCI
- 3.59
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- Journal of Medical Internet Research (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DiVA (Linkoping University) (submittedVersion, other-oa)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Topics
- Social Sciences › Psychology › Clinical Psychology › Psychotherapy Techniques and Applications
- Physical Sciences › Computer Science › Human-Computer Interaction › Virtual Reality Applications and Impacts
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Keywords
- virtual reality exposure therapy, spider phobia, treatment outcome prediction, co-presence, presence, ease of use, scale development
- MeSH terms
- Factor Analysis, Statistical, Female, Humans, Male, Psychometrics, Surveys and Questionnaires, Treatment Outcome, Telemedicine, Virtual Reality Exposure Therapy
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-11, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-11 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.