Evaluation of the Use of Digital Mental Health Platforms and Interventions: Scoping Review
Open accessThe DOI matches its Crossref record; 41 of the 41 references it cites were found in a registry or an index.
Abstract
Background: The increasing use of digital mental health (DMH) platforms and digital mental health interventions (DMHIs) is hindered by uncertainty over effectiveness, quality and usability. There is a need to identify the types of available evidence in this domain. Aim: This study is a scoping review identifying evaluation of the (1) DMH platform/s used; and (2) DMHI/s applied on the DMH platform/s. Methods: The Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews (PRISMA-ScR) guided the review process. Empirical studies that focused on evaluation of the use and application of DMH platforms were included from journal articles (published 2012–2022). A literature search was conducted using four electronic databases (Scopus, ScienceDirect, Sage and ACM Digital Library) and two search engines (PubMed and Google Scholar). Results: A total of 6874 nonduplicate records were identified, of which 144 were analyzed and 22 met the inclusion criteria. The review included general/unspecified mental health and/or suicidality indications (n = 9, 40.9%), followed by depression (n = 5, 22.7%), psychosis (n = 3, 13.6%), anxiety and depression (n = 2, 9.1%), as well as anxiety, depression and suicidality (n = 1, 4.5%), loneliness (n = 1, 4.5%), and addiction (n = 1, 4.5%). There were 11 qualitative studies (50%), 8 quantitative studies (36.4%), and 3 mixed-methods studies (n = 3, 13.6%). The results contained 11 studies that evaluated the DMH platform/s and 11 studies that evaluated the DMHI/s. The studies focused on feasibility, usability, engagement, acceptability and effectiveness. There was a small amount of significant evidence (1 in each 11), notably the (cost-)effectiveness of a DMHI with significant long-term impact on anxiety and depression in adults. Conclusion: The empirical research demonstrates the feasibility of DMH platforms and DMHIs. To date, there is mostly heterogeneous, preliminary evidence for their effectiveness, quality and usability. However, a scalable DMHI reported effectiveness in treating adults’ anxiety and depression. The scope of effectiveness may be widened through targeted strategies, for example by engaging independent young people.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
PRISMA Extension for Scoping Reviews (PRISMA-ScR): Checklist and Explanation
Tricco, A. C., Lillie, E., Zarin, W., O'Brien, K. K., Colquhoun, H., Levac, D., Moher, D., Peters, M. D. J., Horsley, T., Weeks, L., et al. (2018) · Annals of Internal Medicine · doi:10.7326/m18-0850 · Cited by 43,565
Munn, Z., Peters, M. D. J., Stern, C., Tufanaru, C., McArthur, A., & Aromataris, E. (2018) · BMC Medical Research Methodology · doi:10.1186/s12874-018-0611-x · Cited by 11,385
Epidemiology of suicide and the psychiatric perspective
Bachmann, S. (2018) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph15071425 · Cited by 1,377 · cited 1×
“Psychiatric diseases contribute to 60–98% of suicides [21].”
BackgroundTorous, J., Bucci, S., Bell, I. H., Kessing, L. V., Faurholt‐Jepsen, M., Whelan, P., Carvalho, A. F., Keshavan, M., Linardon, J., & Firth, J. (2021) · World Psychiatry · doi:10.1002/wps.20883 · Cited by 1,199 · cited 7×
“There is a priority to establish evidence for use in servicing people with diagnosed mental disorders [5].”
BackgroundMethodResultInfluentialFirth, J., Torous, J., Nicholas, J., Carney, R., Pratap, A., Rosenbaum, S., & Sarris, J. (2017) · World Psychiatry · doi:10.1002/wps.20472 · Cited by 1,097 · cited 2×
“Meta-analyses of randomized controlled trials (RCTs), an experimental form of impact evaluation with a randomly selected sample and control group from the same population, noted potential efficacy for DMHIs for anxiety [23,24] and depression [25] in general populations.”
BackgroundMethodBorghouts, J., Eikey, E., Mark, G., De Leon, C., Schueller, S. M., Schneider, M., Stadnick, N., Zheng, K., Mukamel, D., & Sorkin, D. H. (2021) · Journal of Medical Internet Research · doi:10.2196/24387 · Cited by 1,069 · cited 4×
“A systematic review reported DMHIs have higher sustained engagement than self-guided digital tools [10].”
BackgroundMethodInfluentialTorous, J., Jän Myrick, K., Rauseo-Ricupero, N., & Firth, J. (2020) · JMIR Mental Health · doi:10.2196/18848 · Cited by 946 · cited 2×
“For example, digital mental health (DMH), which is a contemporary method of mental health care that is distinguished by the large-scale integration of telehealth [2], apps [3,4], and digital platforms [5] as well as the promise of big data, genomics and artificial intelligence (AI) [6].”
BackgroundMethodLattie, E. G., Adkins, E. C., Winquist, N., Stiles-Shields, C., Wafford, Q. E., & Graham, A. K. (2019) · Journal of Medical Internet Research · doi:10.2196/12869 · Cited by 843 · cited 1×
“Systematic reviews found a lack of clear and comprehensive evidence-base although there is a growing consensus that the most effective DMHIs are used for anxiety and depression particularly with college students [29] and young people [30].”
BackgroundTorous, J., Nicholas, J., Larsen, M. E., Firth, J., & Christensen, H. (2018) · Evidence Based Mental Health · doi:10.1136/eb-2018-102891 · Cited by 790
Firth, J., Torous, J., Nicholas, J., Carney, R., Rosenbaum, S., & Sarris, J. (2017) · Journal of Affective Disorders · doi:10.1016/j.jad.2017.04.046 · Cited by 675 · cited 2×
“It was suggested to focus studies on comparisons with face-to-face psychological care [23].”
BackgroundMethodInternet-Delivered Psychological Treatments
Andersson, G. (2016) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-021815-093006 · Cited by 595 · cited 2×
“The general lack of study followup in the domain has hindered the evaluation when considering there are more than 100 DMH programs for depressed and anxious adults [11,12].”
BackgroundDesigning and scaling up integrated youth mental health care
McGorry, P. D., Mei, C., Chanen, A., Hodges, C., Alvarez‐Jimenez, M., & Killackey, E. (2022) · World Psychiatry · doi:10.1002/wps.20938 · Cited by 546 · cited 2×
“For example, a previous review reported the DMH platform MOST is safe and effective [44].”
BackgroundResultLehtimaki, S., Martic, J., Wahl, B., Foster, K. T., & Schwalbe, N. (2021) · JMIR Mental Health · doi:10.2196/25847 · Cited by 488 · cited 2×
“Systematic reviews found a lack of clear and comprehensive evidence-base although there is a growing consensus that the most effective DMHIs are used for anxiety and depression particularly with college students [29] and young people [30].”
BackgroundMethodDigital interventions for the treatment of depression: a meta-analytic review
Moshe, I., Terhorst, Y., Philippi, P., Domhardt, M., Cuijpers, P., Cristea, I., Pulkki-Råback, L., Baumeister, H., & Sander, L. B. (2021) · Psychological Bulletin · doi:10.1037/bul0000334 · Cited by 390 · cited 2×
“This finding was endorsed by meta-analyses centered on anxiety [31] and depression [32].”
MethodTorous, J., & Roberts, L. W. (2017) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2017.0262 · Cited by 362 · cited 2×
“Although there is yet to be global eminence in the use of DMH platforms [46], it is established that there are a very large number of apps lacking in clinical testing [55,56].”
BackgroundStepped care treatment delivery for depression: a systematic review and meta-analysis
van Straten, A., Hill, J., Richards, D. A., & Cuijpers, P. (2015) · Psychological Medicine · doi:10.1017/s0033291714000701 · Cited by 288 · cited 1×
“The treatment intensity varies according to the individual’s treatment need and severity of their mental health [90].”
BackgroundTorok, M., Han, J., Baker, S., Werner-Seidler, A., Wong, I., Larsen, M. E., & Christensen, H. (2020) · The Lancet Digital Health · doi:10.1016/s2589-7500(19)30199-2 · Cited by 273
Digital Mental Health for Young People: A Scoping Review of Ethical Promises and Challenges
Wies, B., Landers, C., & Ienca, M. (2021) · Frontiers in Digital Health · doi:10.3389/fdgth.2021.697072 · Cited by 242 · cited 1×
“DMH platforms are a key technology for the purpose of assessment, support, prevention, and treatment in mental health [7].”
BackgroundOn the HORYZON: Moderated online social therapy for long-term recovery in first episode psychosis
Alvarez-Jimenez, M., Bendall, S., Lederman, R., Wadley, G., Chinnery, G., Vargas, S., Larkin, M., Killackey, E., McGorry, P. D., & Gleeson, J. F. (2013) · Schizophrenia Research · doi:10.1016/j.schres.2012.10.009 · Cited by 224 · cited 2×
“earlier pilot study established the acceptability, safety and initial clinical benefits of the Horyzons DMH platform for peer-to-peer social networking, individually tailored interactive psychosocial interventions, and expert interdisciplinary and peer-moderation [43].”
BackgroundMethodResponse to a relational agent by hospital patients with depressive symptoms
Bickmore, T. W., Mitchell, S. E., Jack, B. W., Paasche-Orlow, M. K., Pfeifer, L. M., & O’Donnell, J. (2010) · Interacting with Computers · doi:10.1016/j.intcom.2009.12.001 · Cited by 218
Internet-Based Cognitive-Behavioral Therapy for Depression: Current Progress and Future Directions
Webb, C. A., Rosso, I. M., & Rauch, S. L. (2017) · Harvard Review of Psychiatry · doi:10.1097/hrp.0000000000000139 · Cited by 217 · cited 1×
“For example, the field is constrained by issues of affordability [33], accessibility, relevance, reliability, a lack of personalization and human capacity [12], technical and ethical considerations [34] as well as privacy and security, efficacy, engagement, and clinical integration [5].”
BackgroundDelivering stepped care: an analysis of implementation in routine practice
Richards, D. A., Bower, P., Pagel, C., Weaver, A., Utley, M., Cape, J., Pilling, S., Lovell, K., Gilbody, S., Leibowitz, J., et al. (2012) · Implementation Science · doi:10.1186/1748-5908-7-3 · Cited by 183 · cited 1×
“Stepped model of care aims to provide and monitor the most effective yet resource conservative treatment [89].”
BackgroundTitov, N., Dear, B. F., Staples, L. G., Bennett-Levy, J., Klein, B., Rapee, R. M., Shann, C., Richards, D., Andersson, G., Ritterband, L., et al. (2015) · Psychiatric Services · doi:10.1176/appi.ps.201400477 · Cited by 181
Pauley, D., Cuijpers, P., Papola, D., Miguel, C., & Karyotaki, E. (2021) · Psychological Medicine · doi:10.1017/s0033291721001999 · Cited by 170 · cited 2×
“This finding was endorsed by meta-analyses centered on anxiety [31] and depression [32].”
MethodBergin, A. D., Vallejos, E. P., Davies, E. B., Daley, D., Ford, T., Harold, G., Hetrick, S., Kidner, M., Long, Y., Merry, S., et al. (2020) · npj Digital Medicine · doi:10.1038/s41746-020-00339-7 · Cited by 157
Richards, D., Enrique, A., Eilert, N., Franklin, M., Palacios, J., Duffy, D., Earley, C., Chapman, J., Jell, G., Sollesse, S., et al. (2020) · npj Digital Medicine · doi:10.1038/s41746-020-0293-8 · Cited by 154
Scholten, H., & Granic, I. (2019) · Journal of Medical Internet Research · doi:10.2196/11528 · Cited by 138 · cited 3×
“The general lack of study followup in the domain has hindered the evaluation when considering there are more than 100 DMH programs for depressed and anxious adults [11,12].”
BackgroundAlvarez‐Jimenez, M., Koval, P., Schmaal, L., Bendall, S., O'Sullivan, S., Cagliarini, D., D'Alfonso, S., Rice, S., Valentine, L., Penn, D. L., et al. (2021) · World Psychiatry · doi:10.1002/wps.20858 · Cited by 130
Iorfino, F., Cross, S. P., Davenport, T., Carpenter, J. S., Scott, E., Shiran, S., & Hickie, I. B. (2019) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2019.00595 · Cited by 125 · cited 2×
“For example, to assist practitioners to deliver quality, personalized and measurement-based care for young people’s overall health, mental health, everyday function, suicidal thoughts/behaviors and social connectedness [13].”
BackgroundRichards, D., Timulak, L., O'Brien, E., Hayes, C., Vigano, N., Sharry, J., & Doherty, G. (2015) · Behaviour Research and Therapy · doi:10.1016/j.brat.2015.10.005 · Cited by 109
Titov, N., Dear, B. F., Nielssen, O., Wootton, B., Kayrouz, R., Karin, E., Genest, B., Bennett-Levy, J., Purtell, C., Bezuidenhout, G., et al. (2020) · The Lancet Digital Health · doi:10.1016/s2589-7500(20)30224-7 · Cited by 108
Alvarez-Jimenez, M., Rice, S., D'Alfonso, S., Leicester, S., Bendall, S., Pryor, I., Russon, P., McEnery, C., Santesteban-Echarri, O., Da Costa, G., et al. (2020) · Journal of Medical Internet Research · doi:10.2196/17155 · Cited by 106 · cited 4×
“Integrated DMH platforms provide clinical integration of online services with a separate network of face-to-face mental health services [42].”
BackgroundMethodInfluentialKenter, R. M. F., van de Ven, P. M., Cuijpers, P., Koole, G., Niamat, S., Gerrits, R. S., Willems, M., & van Straten, A. (2015) · Internet Interventions · doi:10.1016/j.invent.2015.01.001 · Cited by 105 · cited 1×
“Blended model of care is where DMHIs (online treatments) are combined with traditional mental health care (routine therapies) [87].”
BackgroundBaumel, A., Tinkelman, A., Mathur, N., & Kane, J. M. (2018) · JMIR mHealth and uHealth · doi:10.2196/mhealth.9482 · Cited by 101
Nebeker, C., Bartlett Ellis, R. J., & Torous, J. (2020) · Translational Behavioral Medicine · doi:10.1093/tbm/ibz074 · Cited by 99
Designing m-Health interventions for precision mental health support
Bidargaddi, N., Schrader, G., Klasnja, P., Licinio, J., & Murphy, S. (2020) · Translational Psychiatry · doi:10.1038/s41398-020-00895-2 · Cited by 92
Digital mental health interventions for depression
Himle, J. A., Weaver, A., Zhang, A., & Xiang, X. (2022) · Cognitive and Behavioral Practice · doi:10.1016/j.cbpra.2020.12.009 · Cited by 65 · cited 1×
“There also needs to be better (cost-)effectiveness [38,39].”
BackgroundBoucher, E. M., McNaughton, E. C., Harake, N., Stafford, J. L., & Parks, A. C. (2021) · JMIR Mental Health · doi:10.2196/26617 · Cited by 61 · cited 1×
“One qualitative study on feasibility found Happify Health’s loneliness interventions may be effective in self-guided and guided approaches [60].”
BackgroundBell, I. H., Thompson, A., Valentine, L., Adams, S., Alvarez-Jimenez, M., & Nicholas, J. (2022) · JMIR Mental Health · doi:10.2196/30716 · Cited by 60 · cited 3×
“[4] included all these DMH technologies in their survey of young people’s and clinicians’ access to, use of and interest in various technologies and their applications.”
BackgroundMethodResultRomijn, G., Batelaan, N., Kok, R., Koning, J., van Balkom, A., Titov, N., & Riper, H. (2019) · Journal of Medical Internet Research · doi:10.2196/11706 · Cited by 52 · cited 2×
“Meta-analyses of randomized controlled trials (RCTs), an experimental form of impact evaluation with a randomly selected sample and control group from the same population, noted potential efficacy for DMHIs for anxiety [23,24] and depression [25] in general populations.”
BackgroundMethodSpadaro, B., Martin-Key, N. A., & Bahn, S. (2021) · Journal of Medical Internet Research · doi:10.2196/27507 · Cited by 45
Cited by
AI Chatbots in Digital Mental Health
Balcombe, L. (2023) · Informatics · doi:10.3390/informatics10040082 · Cited by 174
Self-citationMadrid‐Cagigal, A., Kealy, C., Potts, C., Mulvenna, M. D., Byrne, M., Barry, M. M., & Donohoe, G. (2025) · Early Intervention in Psychiatry · doi:10.1111/eip.70017 · Cited by 78
Johnson, E., Corrick, S., Isley, S., Vandermeer, B., Dolgoy, N., Bates, J., Godfrey, E., Soltys, C., Muir, C., Vohra, S., et al. (2024) · PLOS Digital Health · doi:10.1371/journal.pdig.0000435 · Cited by 24
Leveraging Digital Technology to Enhance Mind-Body Approaches in Cancer Treatment
Heudel, P., & Ubelmann, C. (2025) · JCO Clinical Cancer Informatics · doi:10.1200/cci-24-00293 · Cited by 2
Metadata
- Authors
- Balcombe, L., & De Leo, D.
- Venue
- International Journal of Environmental Research and Public Health
- Publisher
- MDPI AG
- Published
- 2022-12-26
- Volume
- 20
- Issue
- 1
- Pages
- 362
- ISSN
- 1660-4601 (ISSN-L)
- OpenAlex
- W4313260301
- Cited by
- 76
- References
- 41
- FWCI
- 11.50
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.