CoChat

Measuring Alliance Toward Embodied Virtual Therapists in the Era of Automated Treatments With the Virtual Therapist Alliance Scale (VTAS): Development and Psychometric Evaluation

Open access
Miloff, Alexander, Carlbring, Per, Hamilton, William, Andersson, Gerhard, Reuterskiöld, Lena, Lindner, Philip · 2020 · Journal of Medical Internet Research

The DOI matches its Crossref record; 61 of the 61 references it cites were found in a registry or an index; 10 of the 65 sources its claims cite were checked for support.

Abstract

Background: Automated virtual reality exposure therapies (VRETs) are self-help treatments conducted by oneself and supported by a virtual therapist embodied visually and/or with audio feedback. This simulates many of the nonspecific relational elements and common factors present in face-to-face therapy and may be a means of improving adherence to and efficacy of self-guided treatments. However, little is known about alliance toward the virtual therapist, despite alliance being an important predictor of treatment outcome. Objective: In this study, we aimed to evaluate the first alliance instrument developed for use with embodied virtual therapists in an automated treatment format—the Virtual Therapist Alliance Scale (VTAS)—by (1) assessing its psychometric properties, (2) verifying the dimensionality of the scale, and (3) determining the predictive ability of the scale with treatment outcome. Methods: A psychometric evaluation and exploratory factor analysis of the VTAS was conducted using data from two samples of spider-fearful patients treated with VRET and the help of an embodied, voice-based virtual therapist (n=70). Multiple regression models and bivariate correlations were used to assess the VTAS relationship with treatment outcome, according to self-reported fear and convergence with presence and user-friendliness process measures. Results: The VTAS showed a sound two-factor solution composed of a primary factor covering task, goal, and copresence; adequate internal consistency; and good convergent validity, including moderate correlation (r=.310, P=.01) with outcomes over follow-up. Conclusions: These preliminary results suggest that alliance toward a virtual therapist is a significant predictor of treatment outcome, favors the importance of a task-goal over bond-factor, and should be explored in studies with larger sample sizes and in additional forms of embodiment.

Overview

CoChat Summary

## TL;DR

This study developed and psychometrically evaluated the Virtual Therapist Alliance Scale (VTAS) for automated virtual reality exposure therapy (VRET) with embodied virtual therapists. In two spider-fearful patient samples, the VTAS showed a two-factor structure and good overall reliability, and alliance scores were positively related to follow-up outcome.

## Key findings

  • The VTAS had a 17-item format and showed a two-factor solution: factor 1 covered task, goal, and copresence items, and factor 2 covered bond and empathy items.
  • Internal consistency was high for the full scale: Cronbach alpha = .921 and McDonald omega = .921 overall; by study, alpha/omega were .915/.917 and .936/.938.
  • Factor 1 explained 38.8% of total variance and factor 2 explained 14.0%.
  • VTAS total scores correlated with outcome at follow-up: the abstract reports r = .310, P = .01, while the discussion describes a posttreatment correlation of r = .213 and a follow-up correlation of r = .310.

## Methods

  • Psychometric evaluation and exploratory factor analysis of the VTAS were conducted using data from two independent samples of spider-fearful patients treated with automated VRET and an embodied, voice-based virtual therapist.
  • The combined final sample with VTAS data was 70 participants; the two studies had 50 eligible and 25 eligible participants, respectively, and were conducted in a university laboratory environment.
  • Analyses included maximum likelihood exploratory factor analysis with oblimin rotation, internal consistency estimates (Cronbach alpha, McDonald omega), Pearson correlations, Steiger tests, and multiple regression models to assess convergent validity and prediction of outcome.

## Limitations

  • The paper states that the sample size was relatively small and that the two treatments differed in small ways (for example, language and whether a technician was present), so measurement invariance had to be assumed but could not be formally tested.
  • The single-session treatment format prevented testing cross-lagged and mediation models for symptom reduction.
  • The study examined only client-reported alliance ratings; it did not include therapist, observer, or friend/family ratings.
  • Evidence from the text also suggests a limitation: the virtual therapist was primarily voice-based and noninteractive, with limited embodiment, so findings may not generalize to other embodiment styles.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.2196/16660

Cites

61 of 61 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Figures

Figure 1 Physical embodiment of the primarily voice-based virtual therapist.
Figure 1 Physical embodiment of the primarily voice-based virtual therapist.CC BY · PubMed Central
Figure 2 Histograms of the Virtual Therapist Alliance Scale (VTAS) total and subscale scores.
Figure 2 Histograms of the Virtual Therapist Alliance Scale (VTAS) total and subscale scores.CC BY · PubMed Central
Figure 3 Parallel analysis scree plot of Virtual Therapist Alliance Scale (VTAS) items.
Figure 3 Parallel analysis scree plot of Virtual Therapist Alliance Scale (VTAS) items.CC BY · PubMed Central

Verification

Claims the paper makes

7 Valid · 1 Not valid · 50 Not checked · 53 Own results and interpretations

36 more claims

Create a free account to see all 111 claims and to verify the 55 references still open.

See all claims — free account
  • Probably not a substantial claim. 46
  • It may state two separate claims as one. 43

Create a free account to see these claims.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Research works printed but not linked: 5

  1. Luborsky, L, 1996, J Psychother Pract Res, 5, 260
  2. HartantoDBrinkmanWPKampmannIlMorinaNEmmelkampPGNeerincxMAHome-based virtual reality exposure therapy with virtual health agent supportProceedings of the International Symposium on Pervasive Computing Paradigms for Mental Health, MindCare 20152016International Symposium on Pervasive Computing Paradigms for Mental Health, MindCare 2015September 24-25, 2015Milan, ItalyCham, SwitzerlandSpringer International Publishing8598
  3. Andrusyna, TP, 2001, J Psychother Pract Res, 10, 173
  4. Law, M, 2015, J Acad Bus Ethics, 10, 1
  5. Bangor, A, 2009, J Usability Stud, 4, 114

Cited by

See all 68

Metadata

Authors
Miloff, A., Carlbring, P., Hamilton, W., Andersson, G., Reuterskiöld, L., & Lindner, P.
Affiliations
  • Stockholm University (SE)
  • Mimerse (Sweden) (SE)
  • Linköping University (SE)
  • Karolinska Institutet (SE)
Corresponding author
Miloff, Alexander
Venue
Journal of Medical Internet Research
Published
2020-03-24
Volume
22
Issue
3
Pages
e16660
ISSN
1438-8871 (ISSN-L)
OpenAlex
W3012939091
Cited by
60
References
61
Citations by year
2026: 7 · 2025: 7 · 2024: 10 · 2023: 14 · 2022: 12 · 2021: 7 · 2020: 3
FWCI
3.59
Type
journal article
Language
en
Open access
Licence
cc-by
Locations
  • Journal of Medical Internet Research (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • DiVA (Linkoping University) (submittedVersion, other-oa)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Topics
  • Social Sciences › Psychology › Clinical Psychology › Psychotherapy Techniques and Applications
  • Physical Sciences › Computer Science › Human-Computer Interaction › Virtual Reality Applications and Impacts
  • Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
Keywords
virtual reality exposure therapy, spider phobia, treatment outcome prediction, co-presence, presence, ease of use, scale development
MeSH terms
Factor Analysis, Statistical, Female, Humans, Male, Psychometrics, Surveys and Questionnaires, Treatment Outcome, Telemedicine, Virtual Reality Exposure Therapy

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-11, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-11 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.