Cited by 101Digital Mental Health InterventionsMental Health Treatment and AccessSocial Robot Interaction and HRI

Preliminary Evaluation of the Engagement and Effectiveness of a Mental Health Chatbot

Open access
Daley, Kate, Hungerbuehler, Ines, Cavanagh, Kate, Claro, Heloísa Garcia, Swinton, Paul Alan, Kapps, Michael·2020·Frontiers in Digital Health

Abstract

Background: Mental health difficulties are highly prevalent, yet access to support is limited by barriers of stigma, cost, and availability. These issues are even more prevalent in low- and middle-income countries, and digital technology is one potential way to overcome these barriers. Digital mental health interventions are effective but often struggle with low engagement rates, particularly in the absence of human support. Chatbots could offer a scalable solution, simulating human support at a lower cost. Objective: To complete a preliminary evaluation of engagement and effectiveness of Vitalk, a mental health chatbot, at reducing anxiety, depression and stress. Methods: Real world data was analyzed from 3,629 Vitalk users who had completed the first phase of a Vitalk program (“less anxiety,” “less stress” or “better mood”). Programs were delivered through written conversation with a chatbot. Engagement was calculated from the number of responses sent to the chatbot divided by days in the program. Results: Users sent an average of 8.17 responses per day. For all three programs, target outcome scores reduced between baseline and follow up with large effect sizes for anxiety (Cohen's d = −0.85), depression (Cohen's d = −0.91) and stress (Cohen's d = −0.81). Increased engagement resulted in improved post-intervention values for anxiety and depression. Conclusion: This study highlights a chatbot's potential to reduce mental health symptoms in the general population within Brazil. While findings show promise, further research is required.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.3389/fdgth.2020.576361

Cites

34 of 34 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

1 of the 35 references couldn’t be matched to a known paper.

Research works printed but not linked: 1

  1. [19]Beck JS. Cognitive Behavior Therapy, Second Edition: Basics and Beyond. New York, NY: Guilford Press (2011). p. 391.

Cited by

Sorted by citations

Authors
Daley, K., Hungerbuehler, I., Cavanagh, K., Claro, H. G., Swinton, P. A., & Kapps, M.
Affiliations
  • University of Sussex (GB)
  • Universidade de São Paulo (BR)
  • Robert Gordon University (GB)
Corresponding author
Daley, Kate
Venue
Frontiers in Digital Health
Published
2020-11-30
Volume
2
Pages
576361-576361
ISSN
2673-253X (ISSN-L)
OpenAlex
W3110570584
Cited by
101
References
35
Citations by year
2026: 15 · 2025: 29 · 2024: 26 · 2023: 24 · 2022: 5 · 2021: 2
FWCI
6.99
Type
journal article
Language
en
Open access
Locations
  • Frontiers in Digital Health (publishedVersion, cc-by)
  • Europe PMC (PubMed Central) (publishedVersion, other-oa)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • Sussex Research Online (University of Sussex) (submittedVersion, cc-by)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
  • Figshare (submittedVersion, cc-by)
  • Open Access Institutional Repository at Robert Gordon University (Robert Gordon University) (submittedVersion, cc-by)
  • OSF Preprints (OSF Preprints) (submittedVersion)
Topics
  • Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
  • Social Sciences › Psychology › Social Psychology › Mental Health Treatment and Access
  • Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
Keywords
mental health chatbots, user engagement, anxiety, depression, stress, digital mental health interventions, low- and middle-income countries, Brazil

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review