Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 33 of the 33 references it cites were found in a registry or an index; 12 of the 27 sources its claims cite were checked for support.

Voice-Enabled Intelligent Virtual Agents for People With Amnesia: Systematic Review

Open access

Published version of a preprint

Abstract

BACKGROUND: Older adults often have increasing memory problems (amnesia), and approximately 50 million people worldwide have dementia. This syndrome gradually affects a patient over a period of 10-20 years. Intelligent virtual agents may support people with amnesia. OBJECTIVE: This study aims to identify state-of-the-art experimental studies with virtual agents on a screen capable of verbal dialogues with a target group of older adults with amnesia. METHODS: We conducted a systematic search of PubMed, SCOPUS, Microsoft Academic, Google Scholar, Web of Science, and CrossRef on virtual agent and amnesia on papers that describe such experiments. Search criteria were (Virtual Agent OR Virtual Assistant OR Virtual Human OR Conversational Agent OR Virtual Coach OR Chatbot) AND (Amnesia OR Dementia OR Alzheimer OR Mild Cognitive Impairment). Risk of bias was evaluated using the QualSyst tool (University of Alberta), which scores 14 study quality items. Eligible studies are reported in a table including country, study design type, target sample size, controls, study aims, experiment population, intervention details, results, and an image of the agent. RESULTS: A total of 8 studies was included in this meta-analysis. The average number of participants in the studies was 20 (SD 12). The verbal interactions were generally short. The usability was generally reported to be positive. The human utterance was seen in 7 (88%) out of 8 studies based on short words or phrases that were predefined in the agent's speech recognition algorithm. The average study quality score was 0.69 (SD 0.08) on a scale of 0 to 1. CONCLUSIONS: The number of experimental studies on talking about virtual agents that support people with memory problems is still small. The details on the verbal interaction are limited, which makes it difficult to assess the quality of the interaction and the possible effects of confounding parameters. In addition, the derivation of the aggregated data was difficult. Further research with extended and prolonged dialogues is required.

Overview

CoChat Summary

## TL;DR

This systematic review found only 8 experimental studies of voice-enabled intelligent virtual agents (IVAs) with older adults with amnesia or memory problems. Across those studies, interactions were generally short, usability was generally positive, and the evidence base was small and hard to aggregate because reporting was sparse.

## Key findings

  • The review included 8 studies; the average number of participants was 20 (SD 12), and the average study quality score was 0.69 (SD 0.08) on a 0 to 1 scale.
  • In 7/8 studies (88%), the human utterance was limited to short words or phrases predefined in the agent’s speech recognition algorithm.
  • Usability was generally reported to be positive; however, the paper says the usability measures differed enough that an aggregated mean could not be calculated.
  • Only 1/8 (13%) studies used random allocation to separate conditions, and the paper reports that verbal interactions were generally short and often limited to yes/no or a few short commands.

## Methods

  • Design: Systematic review of experimental studies of onscreen virtual agents capable of 2-way verbal dialogue with older adults with memory problems.
  • Data/sample: Searched PubMed, SCOPUS, Microsoft Academic, Google Scholar, Web of Science, and CrossRef for papers from 2010 to present; after screening 2599 papers, 8 studies met eligibility criteria.
  • Main analysis: Two reviewers screened titles/abstracts/full texts and assessed study quality with the QualSyst/Kmet et al. checklist, producing scores from 0 to 1; the review summarized study characteristics, dialogue features, usability, and other reported outcomes.

## Limitations

  • The authors state that some studies may have been overlooked, despite careful screening and snowballing.
  • They state that in many studies the actual dialogue implementation and information exchange were difficult to assess, and that many papers provided little or no experimental detail.
  • They note that using “memory problems” as an umbrella concept rather than an explicit search term may have caused a study to be missed.
  • Evident from the text: the included studies were small, often exploratory/feasibility studies, with short interactions and limited reporting, which made aggregation and comparison difficult.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.2196/32473

Cites

33 of 33 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Figures

Figure 1 A virtual agent under development at the Behavioural Science Institute.
Figure 1 A virtual agent under development at the Behavioural Science Institute.CC BY · PubMed Central
Figure 2 Study flow.
Figure 2 Study flow.CC BY · PubMed Central
Figure 3 Agent by Ali et al [30].
Figure 3 Agent by Ali et al [30].CC BY · PubMed Central
Figure 4 Agent LISSA (Live Interactive Social Skills Assistance) by Razavi et al [31].
Figure 4 Agent LISSA (Live Interactive Social Skills Assistance) by Razavi et al [31].CC BY · PubMed Central
Figure 5 Agent Louise (left) and Charlotte (right) by Wargnier et al [24].
Figure 5 Agent Louise (left) and Charlotte (right) by Wargnier et al [24].CC BY · PubMed Central
Figure 6 Virtual caregiver by Tokunaga et al [32].
Figure 6 Virtual caregiver by Tokunaga et al [32].CC BY · PubMed Central
Figure 7 Agent by Tokunaga et al [32].
Figure 7 Agent by Tokunaga et al [32].CC BY · PubMed Central
Figure 8 Agent Mary by Tsiourti et al [33].
Figure 8 Agent Mary by Tsiourti et al [33].CC BY · PubMed Central
Figure 9 Agent by Jegundo et al [34].
Figure 9 Agent by Jegundo et al [34].CC BY · PubMed Central
Figure 10 Agent by Oliveira et al [35].
Figure 10 Agent by Oliveira et al [35].CC BY · PubMed Central

Verification

Claims the paper makes

8 Valid · 2 Not valid · 9 Not checked · 44 Own results and interpretations

33 more claims · 1 with their cited sources checked

Create a free account to see all 63 claims and every source verdict.

See all claims — free account
  • It may state two separate claims as one. 16
  • Probably not a substantial claim. 14

Create a free account to see these claims.

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

1 of 1

Citations

Cites

Show all 28 references

Research works printed but not linked: 6

  1. Buchan, J, 2019, Health Foundation, 1
  2. 2019, Proceedings of the 19th ACM International Conference on Intelligent Virtual Agents
  3. Razavi, SZ, 2019, arXiv (forthcoming)
  4. Parsons, TD, 2017, Annu Rev CyberTher Telemed, 15, 123
  5. Sauro, J, 2016, Quantifying the User Experience - Practical Statistics for User Research. 2nd edition
  6. Lund, AM, 2001, Usability Interface, 8, 3

Cited by

See all 23

Metadata

Authors
Boumans, R., van de Sande, Y., Thill, S., & Bosse, T.
Affiliations
Radboud University Nijmegen (NL)
Corresponding author
Boumans, Roel
Venue
JMIR Aging
Published
2022-04-25
Volume
5
Issue
2
Pages
e32473
ISSN
2561-7605 (ISSN-L)
OpenAlex
W4224943525
Cited by
23
References
28
Citations by year
2026: 10 · 2025: 3 · 2024: 5 · 2023: 5
FWCI
0.43
Type
journal article
Language
en
Open access
Licence
cc-by
Locations
  • JMIR Aging (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • Radboud Repository (Radboud University) (submittedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
  • Radboud Repository (Radboud University) (submittedVersion, other-oa)
Funders
ZonMw (104022002)
Topics
  • Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
  • Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
  • Health Sciences › Medicine › Psychiatry and Mental health › Dementia and Cognitive Impairment Research
Keywords
intelligent virtual agents, amnesia, dementia, Alzheimer's disease, mild cognitive impairment, older adults, speech recognition, chatbots, virtual assistants, usability, study quality

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.