AI-Based and Digital Mental Health Apps: Balancing Need and Risk
The DOI matches its Crossref record; 22 of the 22 references it cites were found in a registry or an index.
Abstract
Mental health and well-being are increasingly important topics in discussions on public health[1]. The COVID-19 pandemic further revealed critical gaps in existing mental health services as factors such as job losses and corresponding financial issues, prolonged physical illness and death, and physical isolation led to a sharp rise in mental health conditions[2]. As such, there is increasing interest in the viability and desirability of digital mental health applications. While these dedicated applications vary widely, from platforms that connect users with healthcare professionals to diagnostic tools to self-assessments, this article specifically explores the implications of digital mental health applications in the form of chatbots[3]. Chatbots can be text based or voice enabled and may be rule based (i.e., linguistics based) or based on machine learning (ML). They can utilize the power of conversational agents well-suited to task-oriented interactions, like Apple’s Siri, Amazon’s Alexa, or Google Assistant. But increasingly, chatbot developers are leveraging conversational artificial intelligence (AI), which is the suite of tools and techniques that allow a computer program to seemingly carry out a conversational experience with a person or a group.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Mental health and the COVID-19 pandemic
Pfefferbaum, B., & North, C. S. (2020) · New England Journal of Medicine · doi:10.1056/nejmp2008017 · Cited by 4,378 · cited 9×
“But even prior to the pandemic, the occurrence of mental health issues was on the rise in the United States [5] and elsewhere, most notably among young people [6], [7].”
BackgroundInfluentialHow mental health care should change as a consequence of the COVID-19 pandemic
Moreno, C., Wykes, T., Galderisi, S., Nordentoft, M., Crossley, N., Jones, N., Cannon, M., Correll, C. U., Byrne, L., Carr, S., et al. (2020) · The Lancet Psychiatry · doi:10.1016/s2215-0366(20)30307-2 · Cited by 1,840 · cited 2×
“Mental health crisis and limited access to services The COVID-19 pandemic brought into focus the immense need for mental health services around the world [2], [4].”
BackgroundTwenge, J. M., Cooper, A. B., Joiner, T. E., Duffy, M. E., & Binau, S. G. (2019) · Journal of Abnormal Psychology · doi:10.1037/abn0000410 · Cited by 1,469
Borghouts, J., Eikey, E., Mark, G., De Leon, C., Schueller, S. M., Schneider, M., Stadnick, N., Zheng, K., Mukamel, D., & Sorkin, D. H. (2021) · Journal of Medical Internet Research · doi:10.2196/24387 · Cited by 1,069
Barriers to mental health treatment: results from the National Comorbidity Survey Replication
Mojtabai, R., Olfson, M., Sampson, N. A., Jin, R., Druss, B., Wang, P. S., Wells, K. B., Pincus, H. A., & Kessler, R. C. (2011) · Psychological Medicine · doi:10.1017/s0033291710002291 · Cited by 951
Torous, J., Lipschitz, J., Ng, M., & Firth, J. (2020) · Journal of Affective Disorders · doi:10.1016/j.jad.2019.11.167 · Cited by 546
Abd-Alrazaq, A. A., Rababeh, A., Alajlani, M., Bewick, B. M., & Househ, M. (2020) · Journal of Medical Internet Research · doi:10.2196/16021 · Cited by 503 · cited 3×
“A 2020 systematic review of 12 studies found conflicting results [31].”
BackgroundInfluentialWorking Alliance in Online Therapy as Compared to Face-to-Face Therapy: Preliminary Results
Cook, J. E., & Doyle, C. (2002) · CyberPsychology & Behavior · doi:10.1089/109493102753770480 · Cited by 503 · cited 1×
“Efficacy of digital mental health apps “Online therapy” is not new [24].”
BackgroundRathbone, A. L., & Prescott, J. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.7740 · Cited by 497 · cited 1×
“This review and another conducted in 2017 [27] that examined applications and SMSs for both physical and mental health interventions were both optimistic but reserved in their conclusions, noting that applications have been shown to be effective in many circumstances, but research remains limited.”
BackgroundStandalone smartphone apps for mental health—a systematic review and meta-analysis
Weisel, K. K., Fuhrmann, L. M., Berking, M., Baumeister, H., Cuijpers, P., & Ebert, D. D. (2019) · npj Digital Medicine · doi:10.1038/s41746-019-0188-8 · Cited by 447 · cited 1×
“In a systematic review and meta-analysis of standalone applications for depression, anxiety, substance use, self-injury, and sleep problems conducted in 2019 [28], the only significant positive effects noted were for applications addressing depression, with some indications for efficacy in applications for smoking ces…”
BackgroundFlett, J. A. M., Hayne, H., Riordan, B. C., Thompson, L. M., & Conner, T. S. (2019) · Mindfulness · doi:10.1007/s12671-018-1050-9 · Cited by 338
Using science to sell apps: Evaluation of mental health app store quality claims
Larsen, M. E., Huckvale, K., Nicholas, J., Torous, J., Birrell, L., Li, E., & Reda, B. (2019) · npj Digital Medicine · doi:10.1038/s41746-019-0093-1 · Cited by 334 · cited 1×
“…optimistic about the use of digital mental health apps, with commercial entities, in particular, touting a range of benefits for self-help services [32], such as the convenience of on-demand access to resources [33], the ability to address a range of mental health concerns holistically using a…”
BackgroundMental health: there’s an app for that
Anthes, E. (2016) · Nature · doi:10.1038/532020a · Cited by 333
Mongelli, F., Georgakopoulos, P., & Pato, M. T. (2020) · Focus · doi:10.1176/appi.focus.20190028 · Cited by 331 · cited 1×
“Recipients of mental health services may also face discrimination, stigma, and dehumanization both in their communities and in the mental health system itself, especially if they belong to other marginalized groups, which may also contribute to the significant “treatment gap” [13], [14].”
BackgroundTowards a consensus around standards for smartphone apps and digital mental health
Torous, J., Andersson, G., Bertagnoli, A., Christensen, H., Cuijpers, P., Firth, J., Haim, A., Hsin, H., Hollis, C., Lewis, S., et al. (2019) · World Psychiatry · doi:10.1002/wps.20592 · Cited by 325
Wang, K., Varma, D. S., & Prosperi, M. (2018) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2018.10.006 · Cited by 308
State of the Field of Mental Health Apps
Neary, M., & Schueller, S. M. (2018) · Cognitive and Behavioral Practice · doi:10.1016/j.cbpra.2018.01.002 · Cited by 247 · cited 1×
“While these dedicated applications vary widely, from platforms that connect users with healthcare professionals to diagnostic tools to self-assessments, this article specifically explores the implications of digital mental health applications in the form of chatbots [3].”
BackgroundVan Ameringen, M., Turna, J., Khalesi, Z., Pullia, K., & Patterson, B. (2017) · Depression and Anxiety · doi:10.1002/da.22657 · Cited by 234 · cited 1×
“Previous literature in clinical medical research is sober in its claims about the prospect of pointing to “an app for that” [29] as a silver bullet solution for addressing mental health concerns.”
BackgroundEvidence-based apps? A review of mental health mobile applications in a psychotherapy context
Lui, J. H. L., Marcus, D. K., & Barry, C. T. (2017) · Professional Psychology Research and Practice · doi:10.1037/pro0000122 · Cited by 217 · cited 1×
“Evidence around the safety and efficacy of chatbots or AI conversational assistants for mental health is even more limited [30].”
BackgroundTorous, J. B., Chan, S. R., Gipson, S. Y.-M. T., Kim, J. W., Nguyen, T.-Q., Luo, J., & Wang, P. (2018) · Psychiatric Services · doi:10.1176/appi.ps.201700423 · Cited by 184 · cited 1×
“It is not enough to build frameworks for evaluation (though we obviously need those [35]), conduct systematic reviews and meta-analyses, or to engage users in clinical surveys, and commensurate focus group panels.”
BackgroundBarriers to treatment for older adults seeking psychological therapy
Wuthrich, V. M., & Frei, J. (2015) · International Psychogeriatrics · doi:10.1017/s1041610215000241 · Cited by 171 · cited 2×
“org/Your-Journey/Identity-and-Cultural-Dimensions/ People-with-Disabilities [63] V.”
BackgroundBuilding the mental health workforce capacity needed to treat adults with serious mental illnesses
Olfson, M. (2016) · Health Affairs · doi:10.1377/hlthaff.2015.1619 · Cited by 170 · cited 1×
“At this time of increased need, there have also been shortages of mental health professionals and services [15].”
Background
Cited by
Kanbach, D. K., Heiduk, L., Blueher, G., Schreiter, M., & Lahmann, A. (2024) · Review of Managerial Science · doi:10.1007/s11846-023-00696-z · Cited by 454
Khawaja, Z., & Bélisle-Pipon, J.-C. (2023) · Frontiers in Digital Health · doi:10.3389/fdgth.2023.1278186 · Cited by 214
Moylan, K., & Doherty, K. (2025) · Journal of Medical Internet Research · doi:10.2196/67114 · Cited by 46
Risks from Language Models for Automated Mental Healthcare: Ethics and Structure for Implementation
Grabb, D., Lamparth, M., & Vasan, N. (2024) · doi:10.1101/2024.04.07.24305462 · Cited by 40
Compassionate AI Design, Governance, and Use
Ciriello, R. F., Chen, A. Y., & Rubinsztein, Z. A. (2025) · IEEE Transactions on Technology and Society · doi:10.1109/tts.2025.3538125 · Cited by 19
Metadata
- Authors
- Hamdoun, S., Monteleone, R., Bookman, T., & Michael, K.
- Venue
- IEEE Technology and Society Magazine
- Published
- 2023-03
- Volume
- 42
- Issue
- 1
- Pages
- 25-36
- ISSN
- 0278-0097 (ISSN-L)
- 1937-416X
- OpenAlex
- W4323352096
- Cited by
- 103
- References
- 22
- FWCI
- 24.16
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.