Digital Mental Health Challenges and the Horizon Ahead for Solutions
Open accessThe DOI matches its Crossref record; 23 of the 23 references it cites were found in a registry or an index.
Abstract
The demand outstripping supply of mental health resources during the COVID-19 pandemic presents opportunities for digital technology tools to fill this new gap and, in the process, demonstrate capabilities to increase their effectiveness and efficiency. However, technology-enabled services have faced challenges in being sustainably implemented despite showing promising outcomes in efficacy trials since the early 2000s. The ongoing failure of these implementations has been addressed in reconceptualized models and frameworks, along with various efforts to branch out among disparate developers and clinical researchers to provide them with a key for furthering evaluative research. However, the limitations of traditional research methods in dealing with the complexities of mental health care warrant a diversified approach. The crux of the challenges of digital mental health implementation is the efficacy and evaluation of existing studies. Web-based interventions are increasingly used during the pandemic, allowing for affordable access to psychological therapies. However, a lagging infrastructure and skill base has limited the application of digital solutions in mental health care. Methodologies need to be converged owing to the rapid development of digital technologies that have outpaced the evaluation of rigorous digital mental health interventions and strategies to prevent mental illness. The functions and implications of human-computer interaction require a better understanding to overcome engagement barriers, especially with predictive technologies. Explainable artificial intelligence is being incorporated into digital mental health implementation to obtain positive and responsible outcomes. Investment in digital platforms and associated apps for real-time screening, tracking, and treatment offer the promise of cost-effectiveness in vulnerable populations. Although machine learning has been limited by study conduct and reporting methods, the increasing use of unstructured data has strengthened its potential. Early evidence suggests that the advantages outweigh the disadvantages of incrementing such technology. The limitations of an evidence-based approach require better integration of decision support tools to guide policymakers with digital mental health implementation. There is a complex range of issues with effectiveness, equity, access, and ethics (eg, privacy, confidentiality, fairness, transparency, reproducibility, and accountability), which warrant resolution. Evidence-informed policies, development of eminent digital products and services, and skills to use and maintain these solutions are required. Studies need to focus on developing digital platforms with explainable artificial intelligence–based apps to enhance resilience and guide the treatment decisions of mental health practitioners. Investments in digital mental health should ensure their safety and workability. End users should encourage the use of innovative methods to encourage developers to effectively evaluate their products and services and to render them a worthwhile investment. Technology-enabled services in a hybrid model of care are most likely to be effective (eg, specialists using these services among vulnerable, at-risk populations but not severe cases of mental ill health).
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Arrieta, A. B., Díaz-Rodríguez, N., Del Ser, J., Bennetot, A., Tabik, S., Barbado, A., García, S., Gil-López, S., Molina, D., Benjamins, R., et al. (2019) · arXiv · doi:10.48550/arxiv.1910.10045 · Cited by 11,321
Barredo Arrieta, A., Díaz-Rodríguez, N., Del Ser, J., Bennetot, A., Tabik, S., Barbado, A., Garcia, S., Gil-Lopez, S., Molina, D., Benjamins, R., et al. (2020) · Information Fusion · doi:10.1016/j.inffus.2019.12.012 · Cited by 10,423
Machine learning in mental health: a scoping review of methods and applications
Shatte, A. B. R., Hutchinson, D. M., & Teague, S. J. (2019) · Psychological Medicine · doi:10.1017/s0033291719000151 · Cited by 1,047 · cited 3×
“Machine learning algorithms can potentially add value to the identification and diagnosis of mental health conditions (eg, depression, suicidal ideation, and cognitive decline), positive mental health outcomes (eg, resilience, identity formation, and personal growth) [17], and the prediction of problems [20].”
BackgroundTorous, J., Jän Myrick, K., Rauseo-Ricupero, N., & Firth, J. (2020) · JMIR Mental Health · doi:10.2196/18848 · Cited by 946 · cited 3×
“Both VR and augmented reality systems have been recognized as very promising for future research [38], but their current scalability and accessibility inhibit their use in the COVID-19 pandemic [12].”
BackgroundPredicting suicide following self-harm: systematic review of risk factors and risk scales
Chan, M. K. Y., Bhatti, H., Meader, N., Stockton, S., Evans, J., O'Connor, R. C., Kapur, N., & Kendall, T. (2016) · British Journal of Psychiatry · doi:10.1192/bjp.bp.115.170050 · Cited by 501
Stress resilience during the coronavirus pandemic
Vinkers, C. H., van Amelsvoort, T., Bisson, J. I., Branchi, I., Cryan, J. F., Domschke, K., Howes, O. D., Manchia, M., Pinto, L., de Quervain, D., et al. (2020) · European Neuropsychopharmacology · doi:10.1016/j.euroneuro.2020.05.003 · Cited by 441 · cited 1×
“It is important for strategies to enhance resilience particularly considering the stress of the COVID-19 pandemic [67].”
BackgroundMohr, D. C., Lyon, A. R., Lattie, E. G., Reddy, M., & Schueller, S. M. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.7725 · Cited by 432
Goh, K. H., Wang, L., Yeow, A. Y. K., Poh, H., Li, K., Yeow, J. J. L., & Tan, G. Y. H. (2021) · Nature Communications · doi:10.1038/s41467-021-20910-4 · Cited by 415
D’Alfonso, S. (2020) · Current Opinion in Psychology · doi:10.1016/j.copsyc.2020.04.005 · Cited by 408
Freeman, D., Haselton, P., Freeman, J., Spanlang, B., Kishore, S., Albery, E., Denne, M., Brown, P., Slater, M., & Nickless, A. (2018) · The Lancet Psychiatry · doi:10.1016/s2215-0366(18)30226-8 · Cited by 377
Clinical text data in machine learning: systematic review
Spasic, I., & Nenadic, G. (2020) · JMIR Medical Informatics · doi:10.2196/17984 · Cited by 358
Mental health monitoring with multimodal sensing and machine learning: A survey
Garcia-Ceja, E., Riegler, M., Nordgreen, T., Jakobsen, P., Oedegaard, K. J., & Tørresen, J. (2018) · Pervasive and Mobile Computing · doi:10.1016/j.pmcj.2018.09.003 · Cited by 356 · cited 1×
“A challenge for machine learning is the advancement of methodologies that integrate with other systems and the clinical validation of these methodologies [22].”
MethodLysaght, T., Lim, H. Y., Xafis, V., & Ngiam, K. Y. (2019) · Asian Bioethics Review · doi:10.1007/s41649-019-00096-0 · Cited by 332
Combining structured and unstructured data for predictive models: a deep learning approach
Zhang, D., Yin, C., Zeng, J., Yuan, X., & Zhang, P. (2020) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-020-01297-6 · Cited by 269 · cited 1×
“Machine learning and deep learning have until recently only been fed structured data in medical informatics, neglecting invaluable information from unstructured clinical notes [52].”
BackgroundTorous, J., Wisniewski, H., Bird, B., Carpenter, E., David, G., Elejalde, E., Fulford, D., Guimond, S., Hays, R., Henson, P., et al. (2019) · Journal of Technology in Behavioral Science · doi:10.1007/s41347-019-00095-w · Cited by 202 · cited 2×
“Torous et al [66] supported the evolution of the therapeutic relationship among users with a freely shared platform code to encourage adaptation and improvement, especially in digital phenotyping.”
BackgroundTremain, H., McEnery, C., Fletcher, K., & Murray, G. (2020) · JMIR Mental Health · doi:10.2196/17204 · Cited by 193
Scholten, H., & Granic, I. (2019) · Journal of Medical Internet Research · doi:10.2196/11528 · Cited by 138 · cited 2×
“Scholten and Granic [10] noted that researchers are reconceptualizing the scientific framework, methodology, and implementation strategies for digital mental health implementation and highlighted significant technological challenges including engagement, retention, fidelity, lack of personalization, and cognitive load.”
BackgroundFonseka, T. M., Bhat, V., & Kennedy, S. H. (2019) · Australian & New Zealand Journal of Psychiatry · doi:10.1177/0004867419864428 · Cited by 126
Iorfino, F., Cross, S. P., Davenport, T., Carpenter, J. S., Scott, E., Shiran, S., & Hickie, I. B. (2019) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2019.00595 · Cited by 125
Patient Attitudes Toward Telepsychiatry During the COVID-19 Pandemic: A Nationwide, Multisite Survey
Guinart, D., Marcy, P., Hauser, M., Dwyer, M., & Kane, J. M. (2020) · JMIR Mental Health · doi:10.2196/24761 · Cited by 112
Haines-Delmont, A., Chahal, G., Bruen, A. J., Wall, A., Khan, C. T., Sadashiv, R., & Fearnley, D. (2020) · JMIR mhealth and uhealth · doi:10.2196/15901 · Cited by 87 · cited 1×
“The implementation of algorithm prediction systems in predicting the risk of suicide is currently limited to experimental and feasibility studies (with utility) without efficacy evaluation [16,56-58].”
MethodRoadmap to strengthen global mental health systems to tackle the impact of the COVID-19 pandemic
Maulik, P. K., Thornicroft, G., & Saxena, S. (2020) · International Journal of Mental Health Systems · doi:10.1186/s13033-020-00393-4 · Cited by 84 · cited 1×
“The current pandemic has exacerbated the demand for mental health services, providing an opportunity for the supply of digital technologies (eg, videoconferencing-based tele-mental health interventions) and data-driven innovation (eg, predictive technologies), which are emerging to complement traditional in-person and…”
BackgroundThe digital mental health revolution: Opportunities and risks.
Tal, A., & Torous, J. (2017) · Psychiatric Rehabilitation Journal · doi:10.1037/prj0000285 · Cited by 71 · cited 7×
“AI: artificial intelligence DTA: digital therapeutic alliance HCI: human-computer interaction IoT: Internet of Things VR: virtual reality XAI: explainable artificial intelligence Edited by J Torous; submitted 28.12.20; peer-reviewed by S D'Alfonso, P Tiffin, T Hull; comments to author 13.01.21; revised version receive…”
BackgroundInfluential
Cited by
Exploring the Ethical Challenges of Conversational AI in Mental Health Care: Scoping Review
Rahsepar Meadi, M., Sillekens, T., Metselaar, S., van Balkom, A., Bernstein, J., & Batelaan, N. (2025) · JMIR Mental Health · doi:10.2196/60432 · Cited by 211
An AI-based decision support system for predicting mental health disorders
Tutun, S., Johnson, M. E., Ahmed, A., Albizri, A., Irgil, S., Yesilkaya, I., Ucar, E. N., Sengun, T., & Harfouche, A. (2023) · Information Systems Frontiers · doi:10.1007/s10796-022-10282-5 · Cited by 177
“…calls for research on the use of cutting-edge technologies to develop decision support systems (DSSs) to help mental health professionals make evidence-based ethical treatment decisions and guide policymakers with digital mental health implementation (Balcombe & Leo, 2021 ; D’Alfonso, 2020).”
BackgroundAI Chatbots in Digital Mental Health
Balcombe, L. (2023) · Informatics · doi:10.3390/informatics10040082 · Cited by 174
Self-citationWhat Is the Current and Future Status of Digital Mental Health Interventions?
Baños, R. M., Herrero, R., & Vara, M. D. (2022) · The Spanish Journal of Psychology · doi:10.1017/sjp.2022.2 · Cited by 82
Ho, T. Q. A., Le, L. K.-D., Engel, L., Le, N., Melvin, G., Le, H. N. D., & Mihalopoulos, C. (2025) · European Child & Adolescent Psychiatry · doi:10.1007/s00787-024-02386-x · Cited by 38
Metadata
- Authors
- Balcombe, L., & De Leo, D.
- Venue
- JMIR Mental Health
- Publisher
- JMIR Publications Inc.
- Published
- 2021-03-29
- Volume
- 8
- Issue
- 3
- Pages
- e26811
- ISSN
- 2368-7959 (ISSN-L)
- OpenAlex
- W3135252150
- Cited by
- 173
- References
- 23
- FWCI
- 17.09
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.