Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 36 of the 36 references it cites were found in a registry or an index.

Responses of Conversational Agents to Health and Lifestyle Prompts: Investigation of Appropriateness and Presentation Structures

Open access

Published version of a preprint

Abstract

Background: Conversational agents (CAs) are systems that mimic human conversations using text or spoken language. Their widely used examples include voice-activated systems such as Apple Siri, Google Assistant, Amazon Alexa, and Microsoft Cortana. The use of CAs in health care has been on the rise, but concerns about their potential safety risks often remain understudied. Objective: This study aimed to analyze how commonly available, general-purpose CAs on smartphones and smart speakers respond to health and lifestyle prompts (questions and open-ended statements) by examining their responses in terms of content and structure alike. Methods: We followed a piloted script to present health- and lifestyle-related prompts to 8 CAs. The CAs’ responses were assessed for their appropriateness on the basis of the prompt type: responses to safety-critical prompts were deemed appropriate if they included a referral to a health professional or service, whereas responses to lifestyle prompts were deemed appropriate if they provided relevant information to address the problem prompted. The response structure was also examined according to information sources (Web search–based or precoded), response content style (informative and/or directive), confirmation of prompt recognition, and empathy. Results: The 8 studied CAs provided in total 240 responses to 30 prompts. They collectively responded appropriately to 41% (46/112) of the safety-critical and 39% (37/96) of the lifestyle prompts. The ratio of appropriate responses deteriorated when safety-critical prompts were rephrased or when the agent used a voice-only interface. The appropriate responses included mostly directive content and empathy statements for the safety-critical prompts and a mix of informative and directive content for the lifestyle prompts. Conclusions: Our results suggest that the commonly available, general-purpose CAs on smartphones and smart speakers with unconstrained natural language interfaces are limited in their ability to advise on both the safety-critical health prompts and lifestyle prompts. Our study also identified some response structures the CAs employed to present their appropriate responses. Further investigation is needed to establish guidelines for designing suitable response structures for different prompt types.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.2196/15823

Cites

36 of 36 references verified0 citation errors · 0 not checkable

Statistics

Figures

Figure 1 (a): A template for conversational agents’ response structures, (b): example of a Web search–based response with the confirmation of the recognized prompt and directive advice, and (c): example of a precoded response with the confirmation of the recognized prompt, an empathy statement, and a directive referral advice.
Figure 1 (a): A template for conversational agents’ response structures, (b): example of a Web search–based response with the confirmation of the recognized prompt and directive advice, and (c): example of a precoded response with the confirmation of the recognized prompt, an empathy statement, and a directive referral advice.CC BY · PubMed Central
Figure 2 Assessment of responses (n=240) of conversational agents (n=8) to mental health, violence, physical health symptoms, and lifestyle prompts (n=30).
Figure 2 Assessment of responses (n=240) of conversational agents (n=8) to mental health, violence, physical health symptoms, and lifestyle prompts (n=30).CC BY · PubMed Central
Figure 3 Appropriate responses to safety-critical prompts (n=14) and lifestyle prompts (n=12) by conversational agents (CAs) (n=8). (a): The voice-only CAs running on a device without a screen.
Figure 3 Appropriate responses to safety-critical prompts (n=14) and lifestyle prompts (n=12) by conversational agents (CAs) (n=8). (a): The voice-only CAs running on a device without a screen.CC BY · PubMed Central
Figure 4 Response structures used in appropriate responses for the safety-critical and lifestyle prompts by the multimodal (Siri-Smartphone, Alexa-Echo Show, and Google Assistant-Smartphone) and voice-only (Siri-Home Pod, Alexa-Echo Dot, and Google Assistant-Google Home) conversational agents (CAs). Note: Although the data of voice-only CAs’ appropriate responses for lifestyle prompts were very limited, they are included for the sake of completeness.
Figure 4 Response structures used in appropriate responses for the safety-critical and lifestyle prompts by the multimodal (Siri-Smartphone, Alexa-Echo Show, and Google Assistant-Smartphone) and voice-only (Siri-Home Pod, Alexa-Echo Dot, and Google Assistant-Google Home) conversational agents (CAs). Note: Although the data of voice-only CAs’ appropriate responses for lifestyle prompts were very limited, they are included for the sake of completeness.CC BY · PubMed Central

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 34 references

Research works printed but not linked: 5

  1. Ogden, W, 1997, Handbook of Human-Computer Interaction (Second Edition)
  2. Walls, R, 2018, Rosen's Emergency Medicine: Concepts Clinical Practice
  3. 10.2196/mental.9782 · doi:10.2196/mental.9782 · Paper page
  4. Edu, J, 2019, ArXiv.org, 1
  5. Kumar, A, 2017, arXiv.org, 1

Cited by

See all 73

Metadata

Authors
Kocaballi, A. B., Quiroz, J. C., Rezazadegan, D., Berkovsky, S., Magrabi, F., Coiera, E., & Laranjo, L.
Affiliations
  • Macquarie University (AU)
  • Comprehensive Health Research Centre (PT)
Corresponding author
Kocaballi, Ahmet Baki
Venue
Journal of Medical Internet Research
Published
2020-02-09
Volume
22
Issue
2
Pages
e15823
ISSN
1438-8871 (ISSN-L)
OpenAlex
W2996664720
Cited by
73
References
34
Citations by year
2026: 10 · 2025: 8 · 2024: 9 · 2023: 10 · 2022: 13 · 2021: 16 · 2020: 7
FWCI
2.86
Type
journal article
Language
en
Open access
Licence
cc-by
Locations
  • Journal of Medical Internet Research (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • Portuguese National Funding Agency for Science, Research and Technology (RCAAP Project by FCT) (submittedVersion, cc-by)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
  • UTS ePRESS (University of Technology Sydney) (submittedVersion)
  • Swinburne figshare (Swinburne University of Technology) (submittedVersion)
Topics
  • Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
  • Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
  • Social Sciences › Business, Management and Accounting › Marketing › AI in Service Interactions
Keywords
chatbots, voice assistants, smart speakers, response structure, empathy, health information provision, natural language interfaces
MeSH terms
Communication, Humans, Life Style

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.