Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 37 of the 37 references it cites were found in a registry or an index; 13 of the 35 sources its claims cite were checked for support.

Usability and Acceptance of the Embodied Conversational Agent Anne by People with Dementia and their Caregivers: an exploratory study in home environment settings (Preprint)

Open access
Stara, Vera, Vera, Benjamin, Bolliger, Daniel, Rossi, Lorena, Felici, Elisa, Di Rosa, Mirko, de Jong, Michiel, Paolini, Susy · 2020 · JMIR mHealth and uHealth

Abstract

BACKGROUND: Information and communication technologies are tools that are able to support cognitive functions, monitor health and movements, provide reminders to maintain residual memory abilities, and promote social support, especially among patients with dementia. Among these technologies, embodied conversational agents (ECAs) are seen as screen-based entities designed to stimulate human face-to-face conversation skills, allowing for natural human-machine interaction. Unfortunately, the evidence that such agents deliver care benefits in supporting people affected by dementia and their caregivers has not yet been well studied. Therefore, research in this area is essential for the entire scientific community. OBJECTIVE: This study aims to evaluate the usability and acceptability of the virtual agent Anne by people living with dementia. The study is also designed to assess the ability of target users to use the system independently and receive valuable information from it. METHODS: We conducted a 4-week trial that involved 20 older adults living with dementia and 14 family caregivers in home environment settings in Italy. This study used a mixed methods approach, balancing quantitative and qualitative instruments to gather data from users. Telemetry data were also collected. RESULTS: Older users were particularly engaged in providing significant responses and participating in system improvements. Some of them clearly discussed how technical problems related to speech recognition had a negative impact on the intention to use, adaptiveness, usefulness, and trust. Moreover, the usability of the system achieved an encouraging score, and half of the sample recognized a role of the agent Anne. This study confirms that the quality of automatic speech recognition and synthesis is still a technical issue and has room for improvement, whereas the touch screen modality is almost stable and positively used by patients with dementia. CONCLUSIONS: This study demonstrated the ability of target users to use the system independently in their home environment; overall, the involved participants shared good engagement with the system, approaching the virtual agents as a companion able to support memory and enjoyment needs. Therefore, this research provides data that sustain the use of ECAs as future eHealth systems that are able to address the basic and higher-level needs of people living with dementia. This specific field of research is novel and poorly discussed in the scientific community. This could be because of its novelty, yet there is an urgent need to strengthen data, research, and innovation to accelerate the implementation of ECAs as a future method to offer nonpharmacological support to community-dwelling people with dementia.

Overview

CoChat Summary

## TL;DR

This 4-week home-based exploratory study found that 20 older adults living with dementia and 14 family caregivers could use the embodied conversational agent Anne independently, with overall good engagement and encouraging usability scores. Speech recognition and synthesis were the main weak points, while the touch-screen interface was used successfully and seemed more stable.

## Key findings

  • The trial involved 20 older adults with dementia and 14 family caregivers over 4 weeks in home environment settings in Italy.
  • Usability was encouraging: Anne’s SUS score was 67.1 for older adults and 71.4 for caregivers; all participants completed the SUS.
  • Telemetry recorded 93,299 events during the trial; the most used feature was games (52,008 events), followed by medication (2,205), news (931), and radio (881).
  • With use, older adults became less anxious (P=.007) and showed positive changes in perceived enjoyment (P=.04) and social presence (P<.001), but perceived usefulness (P=.02) and trust decreased; caregivers showed negative changes in adaptedness (P=.02), perceived enjoyment (P=.005), perceived sociability (P=.005), perceived usefulness (P<.001), and trust (P=.01).
  • Half of the older-adult sample recognized a role for Anne, and 14/20 (70%) said Anne could improve their well-being.

## Methods

  • Exploratory 4-week field trial in participants’ homes, using a mixed-methods design plus telemetry.
  • Sample: 20 volunteers diagnosed with dementia (age 65+, MMSE 24–27) and 14 family caregivers; participants were recruited in Ancona, Italy from the Neurology Unit of IRCCS INRCA.
  • Main measures/analysis: Almere model for acceptance, SUS for usability, closeness scale, unstructured questions, and paired two-tailed t tests comparing pre/post acceptability; telemetry tracked transition and target events over time.

## Limitations

  • The paper states that 4 weeks were not enough to evaluate a significant level of acceptability and usability, especially given technical discomfort with speech recognition.
  • The authors say the Italian national context and culture may bias the findings and limit generalizability.
  • Evident from the text: the sample was small and restricted to people with early-stage dementia who could live independently, so the findings may not extend to more advanced dementia or other settings.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.2196/25891

Cites

37 of 37 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Figures

Figure 1 Screenshots of current available modules showing an example layout. The layout can be different, or the module hidden or disabled, depending on user abilities.
Figure 1 Screenshots of current available modules showing an example layout. The layout can be different, or the module hidden or disabled, depending on user abilities.CC BY · PubMed Central
Figure 2 Home screenshots.
Figure 2 Home screenshots.CC BY · PubMed Central
Figure 3 The seven pairs of increasingly overlapping circles describing the relationship between the older users and Anne.
Figure 3 The seven pairs of increasingly overlapping circles describing the relationship between the older users and Anne.CC BY · PubMed Central
Figure 4 Target and transition events over time.
Figure 4 Target and transition events over time.CC BY · PubMed Central

Verification

Claims the paper makes

4 Valid · 4 Not valid · 4 Not checked · 67 Own results and interpretations

28 more claims

Create a free account to see all 79 claims and to verify the 5 references still open.

See all claims — free account
  • It may state two separate claims as one. 38
  • The quote only partly states this claim. 1
  • Probably not a substantial claim. 13

Create a free account to see these claims.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Self-check results appear here once an independent check has confirmed them.

Cited works that were retracted

Works this paper cites that were later retracted, from the retraction notices publishers deposit. Major when the notice came out before this paper was published.

1 of 1

Citations

Cites

1 retracted

Show all 30 references

Cited by

See all 36

Metadata

Authors
Stara, V., Vera, B., Bolliger, D., Rossi, L., Felici, E., Di Rosa, M., de Jong, M., & Paolini, S.
Affiliations
  • Istituto Nazionale di Riposo e Cura per Anziani (IT)
  • Lucerne University of Applied Sciences and Arts (CH)
Corresponding author
Stara, Vera
Venue
JMIR mHealth and uHealth
Published
2020-11-19
Volume
9
Issue
6
Pages
e25891-e25891
ISSN
2291-5222 (ISSN-L)
OpenAlex
W3130337437
Cited by
36
References
30
Citations by year
2026: 7 · 2025: 8 · 2024: 8 · 2023: 5 · 2022: 6 · 2021: 2
FWCI
3.55
Type
journal article
Language
en
Open access
Licence
cc-by
Locations
  • JMIR mhealth and uhealth (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
  • University of Twente Research Information (submittedVersion, cc-by)
Topics
  • Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
  • Health Sciences › Medicine › Geriatrics and Gerontology › Technology Use by Older Adults
  • Health Sciences › Medicine › Psychiatry and Mental health › Dementia and Cognitive Impairment Research
Keywords
embodied conversational agents, dementia, caregivers, usability, acceptance, family environment, e-health, speech recognition, speech synthesis, touchscreen interaction, user engagement, trust, technology acceptance, older adults
MeSH terms
Aged, Communication, Dementia, Humans, Italy, Caregivers, Telemedicine

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (qwen3.8-omni-flash and gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Usability and Acceptance of the Embodied Conversational Agent Anne by People with Dementia and their Caregivers: an exploratory study in home environment settings (Preprint). https://app.cochat.ai/papers/10.2196/25891
The paper
Stara, V., Vera, B., Bolliger, D., Rossi, L., Felici, E., Di Rosa, M., de Jong, M., & Paolini, S. (2020). Usability and Acceptance of the Embodied Conversational Agent Anne by People with Dementia and their Caregivers: an exploratory study in home environment settings (Preprint). JMIR mHealth and uHealth. https://doi.org/10.2196/25891

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.