A Multilingual Digital Mental Health and Well-Being Chatbot (ChatPal): Pre-Post Multicenter Intervention Study
Open accessThe DOI matches its Crossref record; 20 of the 20 references it cites were found in a registry or an index.
Abstract
Background: In recent years, advances in technology have led to an influx of mental health apps, in particular the development of mental health and well-being chatbots, which have already shown promise in terms of their efficacy, availability, and accessibility. The ChatPal chatbot was developed to promote positive mental well-being among citizens living in rural areas. ChatPal is a multilingual chatbot, available in English, Scottish Gaelic, Swedish, and Finnish, containing psychoeducational content and exercises such as mindfulness and breathing, mood logging, gratitude, and thought diaries. Objective: The primary objective of this study is to evaluate a multilingual mental health and well-being chatbot (ChatPal) to establish if it has an effect on mental well-being. Secondary objectives include investigating the characteristics of individuals that showed improvements in well-being along with those with worsening well-being and applying thematic analysis to user feedback. Methods: A pre-post intervention study was conducted where participants were recruited to use the intervention (ChatPal) for a 12-week period. Recruitment took place across 5 regions: Northern Ireland, Scotland, the Republic of Ireland, Sweden, and Finland. Outcome measures included the Short Warwick-Edinburgh Mental Well-Being Scale, the World Health Organization-Five Well-Being Index, and the Satisfaction with Life Scale, which were evaluated at baseline, midpoint, and end point. Written feedback was collected from participants and subjected to qualitative analysis to identify themes. Results: A total of 348 people were recruited to the study (n=254, 73% female; n=94, 27% male) aged between 18 and 73 (mean 30) years. The well-being scores of participants improved from baseline to midpoint and from baseline to end point; however, improvement in scores was not statistically significant on the Short Warwick-Edinburgh Mental Well-Being Scale (P=.42), the World Health Organization-Five Well-Being Index (P=.52), or the Satisfaction With Life Scale (P=.81). Individuals that had improved well-being scores (n=16) interacted more with the chatbot and were significantly younger compared to those whose well-being declined over the study (P=.03). Three themes were identified from user feedback, including “positive experiences,” “mixed or neutral experiences,” and “negative experiences.” Positive experiences included enjoying exercises provided by the chatbot, while most of the mixed, neutral, or negative experiences mentioned liking the chatbot overall, but there were some barriers, such as technical or performance errors, that needed to be overcome. Conclusions: Marginal improvements in mental well-being were seen in those who used ChatPal, albeit nonsignificant. We propose that the chatbot could be used along with other service offerings to complement different digital or face-to-face services, although further research should be carried out to confirm the effectiveness of this approach. Nonetheless, this paper highlights the need for blended service offerings in mental health care.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Using thematic analysis in psychology
Braun, V., & Clarke, V. (2006) · Qualitative Research in Psychology · doi:10.1191/1478088706qp063oa · Cited by 194,414
Flourish: A Visionary New Understanding of Happiness and Well-Being
(2011) · Choice Reviews Online · doi:10.5860/choice.48-7217 · Cited by 5,543 · cited 2×
“The overall design philosophy used in ChatPal is based on positive psychology, more specifically the PERMA/H model [23,24], which includes 6 core components: positive emotions, engagement, relationships, meaning, accomplishment, and health.”
The WHO-5 well-being index: A systematic review of the literature
Topp, C. W., Østergaard, S. D., Søndergaard, S., & Bech, P. (2015) · Psychotherapy and Psychosomatics · doi:10.1159/000376585 · Cited by 4,708
Fitzpatrick, K. K., Darcy, A., & Vierhile, M. (2017) · JMIR Mental Health · doi:10.2196/mental.7785 · Cited by 2,730 · cited 6×
“Researchers found that using a mental health chatbot contributed to higher engagement with the material and a higher increase in emotional awareness compared to using an informational book [4,16].”
InfluentialMental health literacy: Public knowledge and beliefs about mental disorders
Jorm, A. F. (2000) · British Journal of Psychiatry · doi:10.1192/bjp.177.5.396 · Cited by 2,114
Stewart-Brown, S., Tennant, A., Tennant, R., Platt, S., Parkinson, J., & Weich, S. (2009) · Health and Quality of Life Outcomes · doi:10.1186/1477-7525-7-15 · Cited by 1,251
Moltu, C., Stefansen, J., Svisdahl, M., & Veseth, M. (2012) · Disability and Rehabilitation · doi:10.3109/09638288.2012.656792 · Cited by 1,247
The consequences of the COVID-19 pandemic on mental health and implications for clinical practice
Fiorillo, A., & Gorwood, P. (2020) · European Psychiatry · doi:10.1192/j.eurpsy.2020.35 · Cited by 1,190 · cited 2×
“Although digital mental health tools have been in development for some time, the critical years of the COVID-19 pandemic have contributed to long-term challenges and changes in how services are delivered [8-11].”
Inkster, B., Sarda, S., & Subramanian, V. (2018) · doi:10.2196/preprints.12106 · Cited by 1,063
The impact of guidance on Internet-based mental health interventions — A systematic review
Baumeister, H., Reichler, L., Munzinger, M., & Lin, J. (2014) · Internet Interventions · doi:10.1016/j.invent.2014.08.003 · Cited by 1,037
Objective user engagement with mental health apps: systematic search and panel-based usage analysis
Baumel, A., Muench, F., Edan, S., & Kane, J. M. (2019) · Journal of Medical Internet Research · doi:10.2196/14567 · Cited by 965
Torous, J., Jän Myrick, K., Rauseo-Ricupero, N., & Firth, J. (2020) · JMIR Mental Health · doi:10.2196/18848 · Cited by 946 · cited 1×
“A recent paper by Torous et al [40] highlighted the future importance of accelerated use of digital mental health tools but also pointed out that there are barriers to overcome, such as training staff, high-quality evidence, and digital equity.”
Fulmer, R., Joerin, A., Gentile, B., Lakerink, L., & Rauws, M. (2018) · doi:10.2196/preprints.9782 · Cited by 715
Ng Fat, L., Scholes, S., Boniface, S., Mindell, J., & Stewart-Brown, S. (2017) · Quality of Life Research · doi:10.1007/s11136-016-1454-8 · Cited by 548 · cited 2×
“The SWEMWBS scores at baseline and throughout the 12-week period remained below the population norms for the United Kingdom [30].”
InfluentialMental health literacy measures evaluating knowledge, attitudes and help-seeking: a scoping review
Wei, Y., McGrath, P. J., Hayden, J., & Kutcher, S. (2015) · BMC Psychiatry · doi:10.1186/s12888-015-0681-9 · Cited by 500
Digital interventions for the treatment of depression: a meta-analytic review
Moshe, I., Terhorst, Y., Philippi, P., Domhardt, M., Cuijpers, P., Cristea, I., Pulkki-Råback, L., Baumeister, H., & Sander, L. B. (2021) · Psychological Bulletin · doi:10.1037/bul0000334 · Cited by 390 · cited 2×
“In order to meet the demand for mental health care and educate people about mental health, many research projects have focused on digital solutions, including artificial intelligence (AI)–based services [1,4-7].”
Ly, K. H., Ly, A.-M., & Andersson, G. (2017) · Internet Interventions · doi:10.1016/j.invent.2017.10.002 · Cited by 368
Reporting Mental Health Symptoms: Breaking Down Barriers to Care with Virtual Human Interviewers
Lucas, G. M., Rizzo, A., Gratch, J., Scherer, S., Stratou, G., Boberg, J., & Morency, L.-P. (2017) · Frontiers in Robotics and AI · doi:10.3389/frobt.2017.00051 · Cited by 308 · cited 1×
“Previous studies have shown patients disclose more sensitive information to a chatbot when compared to a human therapist [34] and that people sometimes engage more on a personal level with web-based therapists [16].”
Greer, S., Ramo, D., Chang, Y.-J., Fu, M., Moskowitz, J., & Haritatos, J. (2019) · JMIR mHealth and uHealth · doi:10.2196/15018 · Cited by 265 · cited 2×
“Previous studies [14,15] used chatbots with a decision tree structure and prewritten text, which is similar to the ChatPal chatbot.”
Mehta, A., Niles, A. N., Vargas, J. H., Marafon, T., Couto, D. D., & Gross, J. J. (2021) · Journal of Medical Internet Research · doi:10.2196/26771 · Cited by 143 · cited 2×
“The chatbot known as “Youper” was tested in the wild for acceptability and effectiveness with 4517 users [17].”
Cited by
Roles, Users, Benefits, and Limitations of Chatbots in Health Care: Rapid Review
Laymouna, M., Ma, Y., Lessard, D., Schuster, T., Engler, K., & Lebouché, B. (2024) · Journal of Medical Internet Research · doi:10.2196/56930 · Cited by 305
Roles, Users, Benefits, and Limitations of Chatbots in Health Care: Rapid Review (Preprint)
Laymouna, M., Ma, Y., Lessard, D., Schuster, T., Engler, K., & Lebouché, B. (2024) · doi:10.2196/preprints.56930 · Cited by 302
Hua, Y., Siddals, S., Ma, Z., Galatzer‐Levy, I., Xia, W., Hau, C., Na, H., Flathers, M., Linardon, J., Ayubcha, C., et al. (2025) · World Psychiatry · doi:10.1002/wps.21352 · Cited by 117
Kuhail, M. A., Al-Shamaileh, O., Farooq, S., Shahin, H., Abdelzaher, F., & Thomas, J. (2025) · Human Behavior and Emerging Technologies · doi:10.1155/hbe2/9942295 · Cited by 11
Metadata
- Authors
- Potts, C., Lindström, F., Bond, R., Mulvenna, M., Booth, F., Ennis, E., Parding, K., Kostenius, C., Broderick, T., Boyd, K., Vartiainen, A.-K., Nieminen, H., Burns, C., Bickerdike, A., Kuosmanen, L., Dhanapala, I., Vakaloudis, A., Cahill, B., MacInnes, M., Malcolm, M., & O'Neill, S.
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2023-07-06
- Volume
- 25
- Pages
- e43051
- ISSN
- 1438-8871 (ISSN-L)
- OpenAlex
- W4318710382
- Cited by
- 63
- References
- 20
- FWCI
- 14.92
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.