Cited by 404Digital Mental Health InterventionsMobile Health and mHealth ApplicationsSocial Robot Interaction and HRI

An Overview of Chatbot-Based Mobile Mental Health Apps: Insights From App Description and User Reviews

Open access
Haque, M D Romael, Rubya, Sabirat·2023·JMIR mHealth and uHealth

Published version of a preprint

Abstract

Background: Chatbots are an emerging technology that show potential for mental health care apps to enable effective and practical evidence-based therapies. As this technology is still relatively new, little is known about recently developed apps and their characteristics and effectiveness. Objective: In this study, we aimed to provide an overview of the commercially available popular mental health chatbots and how they are perceived by users. Methods: We conducted an exploratory observation of 10 apps that offer support and treatment for a variety of mental health concerns with a built-in chatbot feature and qualitatively analyzed 3621 consumer reviews from the Google Play Store and 2624 consumer reviews from the Apple App Store. Results: We found that although chatbots’ personalized, humanlike interactions were positively received by users, improper responses and assumptions about the personalities of users led to a loss of interest. As chatbots are always accessible and convenient, users can become overly attached to them and prefer them over interacting with friends and family. Furthermore, a chatbot may offer crisis care whenever the user needs it because of its 24/7 availability, but even recently developed chatbots lack the understanding of properly identifying a crisis. Chatbots considered in this study fostered a judgment-free environment and helped users feel more comfortable sharing sensitive information. Conclusions: Our findings suggest that chatbots have great potential to offer social and psychological support in situations where real-world human interaction, such as connecting to friends or family members or seeking professional support, is not preferred or possible to achieve. However, there are several restrictions and limitations that these chatbots must establish according to the level of service they offer. Too much reliance on technology can pose risks, such as isolation and insufficient assistance during times of crisis. Recommendations for customization and balanced persuasion to inform the design of effective chatbots for mental health support have been outlined based on the insights of our findings.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.2196/44838

Cites

79 of 79 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Rule-based chatbot apps have more promising user engagement, with positive app store ratings and qualitative studies finding that users appreciate the human-like interaction and social support.

    “Rule-based chatbot apps have more promising user engagement, with positive app store ratings19,20 and qualitative studies finding that users appreciate the human-like interaction and social support19–23.”
  • Meta-analyses indicate that the therapeutic effects of rule-based AI chatbots are small and not sustained over time, and users report frustration with responses that feel empty, generic, nonsensical, repetitive and constrained.

    “Meta-analyses indicate that the therapeutic effects are small and not sustained over time24, and users report frustration with responses that feel empty, generic20, nonsensical, repetitive and constrained19–22.”
  • Many of the themes we developed are not new, but rather echo well-established user appreciation of rule-based chatbots' always-available, non-judgmental listening ear and abilities to create a therapeutic alliance and reframe negative thoughts.

    “Many of the themes we developed are not new, but rather echo well-established user appreciation of rule-based chatbots’ always-available, non-judgmental listening ear and abilities to create a therapeutic alliance and reframe negative thoughts20,22.”

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 4

  1. [4]Winkler R Söllner M Unleashing the potential of chatbots in education: a state-of-the-art analysis Proceedings of the 78th Academy of Management Annual Meeting 2018 AOM '18 August 10-14, 2018 Chicago, IL, USA
  2. [6]Bhirud N Tataale S Randive S Nahar S A literature review on chatbots in healthcare domain Int J Sci Res 2019 07 8 7 225 31
  3. [62]Platzer E Opportunities of automated motive-based user review analysis in the context of mobile app acceptance Proceedings of the 22nd Central European Conference on Information and Intelligent Systems 2011 CECIIS '11 September 21-23, 2011 Varaždin, Croatia 309 16
  4. [67]Tan FT Vasa R Toward a social media usage policy Proceedings of the 22nd Australasian Conference on Information Systems 2011 ACIS '11 November 29-December 2, 2011 Sydney, Australia

Cited by

Sorted by citations

Authors
Haque, M. D. R., & Rubya, S.
Affiliations
Marquette University (US)
Venue
JMIR mHealth and uHealth
Published
2023-05-22
Volume
11
Pages
e44838
ISSN
2291-5222 (ISSN-L)
OpenAlex
W4366703942
Cited by
404
References
79
Citations by year
2026: 120 · 2025: 182 · 2024: 84 · 2023: 18
FWCI
104.28
Type
journal article
Language
en
Open access
Licence
cc-by
Locations
  • JMIR mhealth and uhealth (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Funders
Northwestern University
Topics
  • Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
  • Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
  • Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
Keywords
chatbots, mental health apps, consumer reviews, user perception, crisis care, social support, digital mental health, chatbot personality, technology dependence, isolation, persuasive design, App Store
MeSH terms
Emotions, Humans, Mental Health, Mobile Applications

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review