The DOI matches its Crossref record; 116 of the 116 references it cites were found in a registry or an index.
Artificially intelligent chatbots in digital mental health interventions: a review
Open accessAbstract
INTRODUCTION: Increasing demand for mental health services and the expanding capabilities of artificial intelligence (AI) in recent years has driven the development of digital mental health interventions (DMHIs). To date, AI-based chatbots have been integrated into DMHIs to support diagnostics and screening, symptom management and behavior change, and content delivery. AREAS COVERED: , serves as a case study for discussion of potential challenges and how these might be addressed, and demonstrates the promise of chatbots as effective, usable, and adoptable within DMHIs. Finally, we discuss ways in which future research can advance the field, addressing topics including perceptions of AI, the impact of individual differences, and implications for privacy and ethics. EXPERT OPINION: Our discussion concludes with a speculative viewpoint on the future of AI in DMHIs, including the use of chatbots, the evolution of AI, dynamic mental health systems, hyper-personalization, and human-like intervention delivery.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Relative to chatbots that do not express empathy, chatbots that express empathy lead to more favorable ratings of companionship, i.e., the activities done together are perceived as more enjoyable or exciting (Boucher et al. 2021; Leite et al. 2013), and better mood after experiencing social exclusion (De Gennaro, Krumhuber, and Lucas 2020).”
From AI Companions Reduce Loneliness (2024) · cites this paper as Boucher et al. 2021
In the citing paper
“However, the study of the applications of AI in mental healthcare remains in its infancy (6, 20).”
From Examining the role of AI technology in online mental healthcare: opportunities, challenges, and implications, a mixed-methods review (2024) · cites this paper as [6]
In the citing paper
“AI technology can help address these issues by supporting a versatile, scalable, and powerful approach that can analyze and respond to large amounts of data and adapt to individual healthcare needs (6, 17–23).”
From Examining the role of AI technology in online mental healthcare: opportunities, challenges, and implications, a mixed-methods review (2024) · cites this paper as [6]
In the citing paper
“Nevertheless, recent studies have shown promising results of AI applications including suicide risk assessment and risk prediction, identification of mental illness predictors, mental health monitoring, psychoeducation and psychotherapy delivery, therapist training, mental healthcare personalization, mental health triage and decision-making, and promoting treatment engagement (6, 17–23).”
From Examining the role of AI technology in online mental healthcare: opportunities, challenges, and implications, a mixed-methods review (2024) · cites this paper as [6]
In the citing paper
“However, because of the novelty of this technology, there are several unanswered questions and considerations such as limitations in the interpretation of language, biases in the interaction with patients from diverse backgrounds, and unanswered ethical, patient safety, and health policy considerations (6, 17–23).”
From Examining the role of AI technology in online mental healthcare: opportunities, challenges, and implications, a mixed-methods review (2024) · cites this paper as [6]
In the citing paper
“Moreover, despite the accessibility of online mental healthcare interventions, reduced therapist support or guidance in some online programs, have resulted in participants having low levels of engagement with their treatment and a high risk of dropping out (6).”
From Examining the role of AI technology in online mental healthcare: opportunities, challenges, and implications, a mixed-methods review (2024) · cites this paper as [6]
In the citing paper
“Additionally, the studies reporting on the use of ML algorithms found significant success in outcome prediction and feature detection to support online therapy delivery (6, 19, 28, 29, 31, 33, 83, 85, 86, 92–94).”
From Examining the role of AI technology in online mental healthcare: opportunities, challenges, and implications, a mixed-methods review (2024) · cites this paper as [6]
In the citing paper
“These reviews recognized the novelty of this technology and the scarcity of evidence but noted several potential benefits in terms of providing a low-resource intensity alternative for individuals experiencing less severe mental health symptoms (6, 17).”
From Examining the role of AI technology in online mental healthcare: opportunities, challenges, and implications, a mixed-methods review (2024) · cites this paper as [6]
In the citing paper
“For instance, two recent reviews by Boucher et al. (2021) and Abd-alrazaq et al. (2019), reported that chatbots had shown promising applications including care assistance, symptom screening and monitoring, and therapy delivery.”
From Examining the role of AI technology in online mental healthcare: opportunities, challenges, and implications, a mixed-methods review (2024) · cites this paper as [6]
In the citing paper
“This presents the interesting possibility of a potential therapeutic relationship between user and chatbot, which is something that self-guided eCBT has not been able to accomplish (6, 17–23, 74).”
From Examining the role of AI technology in online mental healthcare: opportunities, challenges, and implications, a mixed-methods review (2024) · cites this paper as [6]
In the citing paper
“The available literature supports the results obtained by this mixed-methods review, showing that AI-augmented interventions such as AI therapy chatbots can be promising, effective and accessible solutions for mental healthcare delivery (6, 17–23).”
From Examining the role of AI technology in online mental healthcare: opportunities, challenges, and implications, a mixed-methods review (2024) · cites this paper as [6]
In the citing paper
“As such, the relevant studies highlighted the importance of analyzing the large datasets produced by online mental healthcare interventions and the efficiency and accuracy of AI algorithms which in some cases were comparable to or better than human assessors (6, 19, 28, 29, 31, 33, 83, 85, 86, 92–94).”
From Examining the role of AI technology in online mental healthcare: opportunities, challenges, and implications, a mixed-methods review (2024) · cites this paper as [6]
In the citing paper
“Additionally, the scarcity of studies and low quality of evidence, including the lack of a control or adequate placebo group impacts the strength and reliability of the reported outcomes (6, 17, 18).”
From Examining the role of AI technology in online mental healthcare: opportunities, challenges, and implications, a mixed-methods review (2024) · cites this paper as [6]
In the citing paper
“Moreover, AI chatbots and language models have been inefficient at interpreting and responding to idioms, colloquialisms, slang, and metaphors.”
From Examining the role of AI technology in online mental healthcare: opportunities, challenges, and implications, a mixed-methods review (2024) · cites this paper as [6]
In the citing paper
“In a global survey of psychiatrists, around 83% of respondents felt that AI would not be able to match the level of empathetic care provided by a professional (6, 98).”
From Examining the role of AI technology in online mental healthcare: opportunities, challenges, and implications, a mixed-methods review (2024) · cites this paper as [6]
In the citing paper
“Moreover as mentioned by other reviews in the field, several of the available studies lack an appropriate comparator or control group which can directly impact the observed effect of the AI-augmented interventions and tools reported in the literature (6, 17–23, 52–54, 57, 58, 67, 72).”
From Examining the role of AI technology in online mental healthcare: opportunities, challenges, and implications, a mixed-methods review (2024) · cites this paper as [6]
In the citing paper
“At the same time, a growing body of research shows that interactions with chatbots can contribute to improving their users’ mental health and quality of life, especially if the specific needs of the user match with chatbot capabilities (22, 24, 27, 31, 34, 40, 49–56).”
From Waiting for a digital therapist: three challenges on the path to psychotherapy delivered by artificial intelligence (2023) · cites this paper as [22]
Citations
Cites
Merikangas, K. R., He, J.-P., Burstein, M., Swanson, S. A., Avenevoli, S., Cui, L., Benjet, C., Georgiades, K., & Swendsen, J. (2010) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1016/j.jaac.2010.05.017 · Cited by 6,278
ELIZA—a computer program for the study of natural language communication between man and machine
Weizenbaum, J. (1966) · Communications of the ACM · doi:10.1145/365153.365168 · Cited by 4,452
Gulliver, A., Griffiths, K. M., & Christensen, H. (2010) · BMC Psychiatry · doi:10.1186/1471-244x-10-113 · Cited by 3,292
Fitzpatrick, K. K., Darcy, A., & Vierhile, M. (2017) · JMIR Mental Health · doi:10.2196/mental.7785 · Cited by 2,730 · cited 5×
“studies, a common complaint from users is that interactions with chatbots become repetitive [61,85,98,102], which makes”
BackgroundInfluentialWang, P. S., Lane, M., Olfson, M., Pincus, H. A., Wells, K. B., & Kessler, R. C. (2005) · Archives of General Psychiatry · doi:10.1001/archpsyc.62.6.629 · Cited by 2,695
Czeisler, M. É., Lane, R. I., Petrosky, E., Wiley, J. F., Christensen, A., Njai, R., Weaver, M. D., Robbins, R., Facer-Childs, E. R., Barger, L. K., et al. (2020) · MMWR. Morbidity and Mortality Weekly Report · doi:10.15585/mmwr.mm6932a1 · Cited by 2,686
Eysenbach, G. (2005) · Journal of Medical Internet Research · doi:10.2196/jmir.7.1.e11 · Cited by 2,524
Prevalence of depression symptoms in US adults before and during the COVID-19 pandemic
Ettman, C. K., Abdalla, S. M., Cohen, G. H., Sampson, L., Vivier, P. M., & Galea, S. (2020) · JAMA Network Open · doi:10.1001/jamanetworkopen.2020.19686 · Cited by 2,138
Wang, P. S., Aguilar-Gaxiola, S., Alonso, J., Angermeyer, M. C., Borges, G., Bromet, E. J., Bruffaerts, R., de Girolamo, G., de Graaf, R., Gureje, O., et al. (2007) · The Lancet · doi:10.1016/s0140-6736(07)61414-7 · Cited by 1,655 · cited 1×
“Worldwide, it is estimated that 70% of people with mental illness receive no formal treatment [5].”
BackgroundComputer-based psychological treatments for depression: A systematic review and meta-analysis
Richards, D., & Richardson, T. (2012) · Clinical Psychology Review · doi:10.1016/j.cpr.2012.02.004 · Cited by 1,442
Research works printed but not linked: 19
- Nagata JM, 2021, Psychiatr Serv
- Ahmed A, 2021, Comput Meth Prog Bio, 1, 1
- Sana M, 2017, IJACSA, 8, 9
- Mirheidari B, 2018, Detecting early signs of dementia in conversation [dissertation]
- DeVault D, 2014, Proceedings of the 2014 international conference on Autonomous agents and multi-agent systems (AAMAS ‘14), 1061
- Divya S, 2018, WDJWD, 3, 1
- Sweeney C, 2021, ACM HEALTH, 2, 1
- 10.2196/12106 · DOI · Paper page
- 10.1007/s12668-016-0376-9 · DOI
- Cameron G, 2018, Proceedings of the 5th International Conference on Internet Science, INSCI 2018, 121
- Ghosh S, 2018, Stud Health Technol Inform, 252, 51
- 10.2196/mental.9782 · DOI · Paper page
- Radziwill NM, 2017, arXiv, 21
- Yu Z, Papangelis A, Rudnicky A. TickTock: anon-goal-oriented multimodal dialog system with engagement awareness. AAAI Spring symposium series. Pittsburg: PA; 2015.
- Kamita T, 2019, Mob Inf Syst
- Adamopoulou E, 2020, ML with Appl, 2, 100006
- Montemayor C, 2021, AI Soc, 1
- Fadhil A, 2019, ArXiv
- Lisetti C, 2013, ACM Trans Inf Syst, 4, 1
Cited by
Sorted by citations
Roles, Users, Benefits, and Limitations of Chatbots in Health Care: Rapid Review (Preprint)
Laymouna, M., Ma, Y., Lessard, D., Schuster, T., Engler, K., & Lebouché, B. (2024) · doi:10.2196/preprints.56930 · Cited by 302
Roles, Users, Benefits, and Limitations of Chatbots in Health Care: Rapid Review
Laymouna, M., Ma, Y., Lessard, D., Schuster, T., Engler, K., & Lebouché, B. (2024) · Journal of Medical Internet Research · doi:10.2196/56930 · Cited by 305
Artificial intelligence technologies and compassion in healthcare: A systematic scoping review
Morrow, E. M., Zidaru, T., Ross, F., Mason, C. L., Patel, K. D., Ream, M., & Stockley, R. (2023) · Frontiers in Psychology · doi:10.3389/fpsyg.2022.971044 · Cited by 308
To chat or bot to chat: Ethical issues with using chatbots in mental health
Coghlan, S., Leins, K., Sheldrick, S., Cheong, M., Gooding, P., & D'Alfonso, S. (2023) · DIGITAL HEALTH · doi:10.1177/20552076231183542 · Cited by 215
Khawaja, Z., & Bélisle-Pipon, J.-C. (2023) · Frontiers in Digital Health · doi:10.3389/fdgth.2023.1278186 · Cited by 214
Metadata
- Authors
- Boucher, E. M., Harake, N. R., Ward, H. E., Stoeckl, S. E., Vargas, J., Minkel, J., Parks, A. C., & Zilca, R.
- Affiliations
- Happify Health, New York, NY, USA
- Corresponding author
- Boucher, Eliane M.
- ORCID
- Venue
- Expert Review of Medical Devices
- Publisher
- Informa UK Limited
- Published
- 2021-12-03
- Volume
- 18
- Issue
- sup1
- Pages
- 37-49
- ISSN
- 1743-4440 (ISSN-L)
- 1745-2422
- OpenAlex
- W4200615999
- Semantic Scholar
- f6fcfe71f09ce04594c98361f88d4e955fb8a831
- Cited by
- 440
- References
- 116
- Citations by year
- 2026: 111 · 2025: 149 · 2024: 111 · 2023: 55 · 2022: 14
- FWCI
- 40.30
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Expert Review of Medical Devices (publishedVersion, cc-by-nc-nd)
- PubMed (publishedVersion)
- Funders
- Happify Health
- Topics
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
- Keywords
- chatbots, artificial intelligence, digital mental health interventions, mental health screening, symptom management, behavior change, artificial intelligence adoption, perceptions of AI, individual differences, privacy, ethics, hyper-personalization
- MeSH terms
- Artificial Intelligence, Humans, Mental Health
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review