Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 41 of the 41 references it cites were found in a registry or an index; 2 of the 39 sources its claims cite were checked for support.

Embodied Conversational Agent Appearance for Health Assessment of Older Adults: Explorative Study

Open access
ter Stal, Silke, Broekhuis, Marijke, van Velsen, Lex, Hermens, Hermie, Tabak, Monique · 2020 · JMIR Human Factors

Published version of a preprint

Abstract

BACKGROUND: Embodied conversational agents (ECAs) have great potential for health apps but are rarely investigated as part of such apps. To promote the uptake of health apps, we need to understand how the design of ECAs can influence the preferences, motivation, and behavior of users. OBJECTIVE: This is one of the first studies that investigates how the appearance of an ECA implemented within a health app affects users' likeliness of following agent advice, their perception of agent characteristics, and their feeling of rapport. In addition, we assessed usability and intention to use. METHODS: The ECA was implemented within a frailty assessment app in which three health questionnaires were translated into agent dialogues. In a within-subject experiment, questionnaire dialogues were randomly offered by a young female agent or an older male agent. Participants were asked to think aloud during interaction. Afterward, they rated the likeliness of following the agent's advice, agent characteristics, rapport, usability, and intention to use and participated in a semistructured interview. RESULTS: A total of 20 older adults (72.2 [SD 3.5] years) participated. The older male agent was perceived as more authoritative than the young female agent (P=.03), but no other differences were found. The app scored high on usability (median 6.1) and intention to use (median 6.0). Participants indicated they did not see an added value of the agent to the health app. CONCLUSIONS: Agent age and gender little influence users' impressions after short interaction but remain important at first glance to lower the threshold to interact with the agent. Thus, it is important to take the design of ECAs into account when implementing them into health apps.

Overview

CoChat Summary

## TL;DR

This within-subject lab study of 20 older adults tested whether a frailty-assessment app’s ECA appearance (young female vs older male) changed users’ impressions after short interaction. The older male agent was rated more authoritative, but otherwise agent appearance had little effect; usability and intention to use were high, though participants saw little added value from the agent.

## Key findings

  • A total of 20 older adults participated; their mean age was 72.2 years (SD 3.5).
  • The older male agent was perceived as more authoritative than the young female agent (P = .03, r = .344); there were no significant differences for likeliness of following advice, other agent characteristics, or rapport items.
  • The frailty assessment app scored high on usability (median 6.1, IQR 6.1–7.0) and intention to use (median 6.0, IQR 4.0–6.0) on a 7-point scale.
  • Participants generally said they did not see added value in the agent; many felt the app was not personal and that the text-based interaction limited the agent’s usefulness.

## Methods

  • Design: Within-subject lab experiment with counterbalanced order; each participant interacted with both agents, Sylvia (young female) and Egbert (older male), in random order.
  • Sample/data: Older adults aged 65+, Dutch-speaking, cognitively able to work with an ECA (MMSE ≥ 23); 21 started and 1 was excluded for lack of computer experience, leaving 20 analyzed.
  • Analysis: Post-interaction ratings were compared using Wilcoxon signed-rank tests for the crossover design; qualitative think-aloud audio and semistructured interviews were transcribed and thematically analyzed.

## Limitations

  • The paper says the app may not have been mature enough because the agent conveyed most information via text, which may have reduced attention to the agent and made it harder to form impressions.
  • The interaction time was likely too short to establish impressions of agent characteristics and rapport.
  • The study could not disentangle whether the authority difference was due to agent age or gender, because these factors were not independently controlled.
  • Evident from the text: the sample was small (n=20) and recruited from a Dutch eHealth panel and a physiotherapy practice, which limits generalizability.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.2196/19987

Cites

41 of 41 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Figures

Figure 1 Frailty assessment app: opening page introducing agents Sylvia and Egbert.
Figure 1 Frailty assessment app: opening page introducing agents Sylvia and Egbert.CC BY · PubMed Central
Figure 2 Dialog page with peer agent Sylvia.
Figure 2 Dialog page with peer agent Sylvia.CC BY · PubMed Central
Figure 3 Agents used during the experiment.
Figure 3 Agents used during the experiment.CC BY · PubMed Central
Figure 4 Study design including randomization process.
Figure 4 Study design including randomization process.CC BY · PubMed Central
Figure 5 Ratings of the likeliness of following advice and characteristics of the two agents (P<.05).
Figure 5 Ratings of the likeliness of following advice and characteristics of the two agents (P<.05).CC BY · PubMed Central
Figure 6 Ratings of the rapport scale items of the two agents.
Figure 6 Ratings of the rapport scale items of the two agents.CC BY · PubMed Central

Verification

Claims the paper makes

2 Valid · 0 Not valid · 20 Not checked · 31 Own results and interpretations

24 more claims

Create a free account to see all 53 claims and to verify the 2 references still open.

See all claims — free account
  • It may state two separate claims as one. 17
  • Probably not a substantial claim. 14
  • The quote only partly states this claim. 1

Create a free account to see these claims.

Citations

Cites

Show all 40 references

Research works printed but not linked: 1

  1. van Velsen, L, 2018, Stud Health Technol Inform, 247, 651

Cited by

See all 36

Metadata

Authors
ter Stal, S., Broekhuis, M., van Velsen, L., Hermens, H., & Tabak, M.
Affiliations
Roessingh Research and Development (NL)
Venue
JMIR Human Factors
Published
2020-09-04
Volume
7
Issue
3
Pages
e19987
ISSN
2292-9495 (ISSN-L)
OpenAlex
W3036831094
Cited by
36
References
40
Citations by year
2026: 3 · 2025: 9 · 2024: 2 · 2023: 9 · 2022: 5 · 2021: 8
FWCI
6.01
Type
journal article
Language
en
Open access
Licence
cc-by
Locations
  • JMIR Human Factors (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • University of Twente Research Information (submittedVersion, cc-by)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Funders
Eurostars (10824)
Topics
  • Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
  • Health Sciences › Medicine › Geriatrics and Gerontology › Technology Use by Older Adults
  • Physical Sciences › Computer Science › Human-Computer Interaction › Innovative Human-Technology Interaction
Keywords
embodied conversational agents, agent appearance, health apps, older adults, frailty assessment, perceived authority, rapport, usability, intention to use, user preferences

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Embodied Conversational Agent Appearance for Health Assessment of Older Adults: Explorative Study. https://app.cochat.ai/papers/10.2196/19987
The paper
ter Stal, S., Broekhuis, M., van Velsen, L., Hermens, H., & Tabak, M. (2020). Embodied Conversational Agent Appearance for Health Assessment of Older Adults: Explorative Study. JMIR Human Factors. https://doi.org/10.2196/19987

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.