Cited by 45Digital Mental Health InterventionsSocial Robot Interaction and HRIAI in Service Interactions

User Experiences of Well-Being Chatbots

Kettle, Liam, Lee, Yi-Ching·2024·Human Factors: The Journal of the Human Factors and Ergonomics Society

Abstract

Objective: The current paper conducted two parallel studies to explore user experiences of well-being conversational agents (CAs) and identify important features for engagement. Background: Students transitioning into university life take on greater responsibility, yet tend to sacrifice healthy behaviors to strive for academic and financial gain. Additionally, students faced an unprecedented pandemic, leading to remote courses and reduced access to healthcare services. One tool designed to improve healthcare accessibility is well-being CAs. CAs have addressed mental health support in the general population but have yet to address physical well-being support and accessibility to those in disadvantaged socio-economic backgrounds where healthcare access is further limited. Method: Study One comprised a thematic analysis of mental health applications featuring CAs from the public forum, Reddit. Study Two explored emerging usability themes of an SMS-based CA designed to improve accessibility to well-being services alongside a commercially available CA, Woebot. Results: Study One identified several themes, including accessibility and availability, communication style, and anthropomorphism as important features. Study Two identified themes such as user response modality, perceived CA role, question specificity, and conversation flow control as critical for user engagement. Conclusion: Various themes emerged from individuals’ experiences regarding CA features, functionality, and responses. The mixed experiences relevant to the communication and conversational styles between the CA and the user suggest varied motivations for using CAs for mental and physical well-being. Application: Practical recommendations to encourage continued use include providing dynamic response modalities, anthropomorphizing the chatbot, and calibrating expectations early.

Integrity signals

Registry

Crossref · 10.1177/00187208231162453

Cites

43 of 43 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Rule-based chatbot apps have more promising user engagement, with positive app store ratings and qualitative studies finding that users appreciate the human-like interaction and social support.

    “Rule-based chatbot apps have more promising user engagement, with positive app store ratings19,20 and qualitative studies finding that users appreciate the human-like interaction and social support19–23.”
  • Qualitative studies published so far include thematic analyses of user forum comments on both generative AI and rule-based DMHIs, student survey responses on companion-focused generative AI chatbots, and semi-structured interviews with hospital outpatients who were asked to try ChatGPT for mental health support.

    “Qualitative studies published so far include thematic analyses of user forum comments on both generative AI and rule-based DMHIs23, student survey responses on companion-focused generative AI chatbots48, and semi-structured interviews with hospital outpatients who were asked to try ChatGPT for mental health support49.”

Cites

Flagged first, then by citations

Cited by

Sorted by citations

Authors
Kettle, L., & Lee, Y.-C.
Affiliations
George Mason University (US)
Corresponding author
Kettle, Liam
Venue
Human Factors: The Journal of the Human Factors and Ergonomics Society
Published
2023-03-14
Volume
66
Issue
6
Pages
1703-1723
ISSN
  • 0018-7208 (ISSN-L)
  • 1547-8181
OpenAlex
W4324129961
Cited by
45
References
43
Citations by year
2026: 20 · 2025: 13 · 2024: 10 · 2023: 2
FWCI
11.62
Type
journal article
Language
en
Open access
closed
Locations
  • Human Factors The Journal of the Human Factors and Ergonomics Society (publishedVersion)
  • PubMed (publishedVersion)
Topics
  • Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
  • Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
  • Physical Sciences › Computer Science › Artificial Intelligence › AI in Service Interactions
Keywords
chatbots, user experience, mental health support, physical well-being, anthropomorphism, Woebot, user engagement, health care access, university students, COVID-19 pandemic, socioeconomic deprivation
MeSH terms
Adult, Communication, Female, Health Services Accessibility, Humans, Male, Students, Universities, Young Adult

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review