Evaluation of the Use of Digital Mental Health Platforms and Interventions: Scoping Review
Open accessThe DOI matches its Crossref record; 40 of the 40 references it cites were found in a registry or an index.
Abstract
Background: The increasing use of digital mental health (DMH) platforms and digital mental health interventions (DMHIs) is hindered by uncertainty over effectiveness, quality and usability. There is a need to identify the types of available evidence in this domain. Aim: This study is a scoping review identifying evaluation of the (1) DMH platform/s used; and (2) DMHI/s applied on the DMH platform/s. Methods: The Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews (PRISMA-ScR) guided the review process. Empirical studies that focused on evaluation of the use and application of DMH platforms were included from journal articles (published 2012–2022). A literature search was conducted using four electronic databases (Scopus, ScienceDirect, Sage and ACM Digital Library) and two search engines (PubMed and Google Scholar). Results: A total of 6874 nonduplicate records were identified, of which 144 were analyzed and 22 met the inclusion criteria. The review included general/unspecified mental health and/or suicidality indications (n = 9, 40.9%), followed by depression (n = 5, 22.7%), psychosis (n = 3, 13.6%), anxiety and depression (n = 2, 9.1%), as well as anxiety, depression and suicidality (n = 1, 4.5%), loneliness (n = 1, 4.5%), and addiction (n = 1, 4.5%). There were 11 qualitative studies (50%), 8 quantitative studies (36.4%), and 3 mixed-methods studies (n = 3, 13.6%). The results contained 11 studies that evaluated the DMH platform/s and 11 studies that evaluated the DMHI/s. The studies focused on feasibility, usability, engagement, acceptability and effectiveness. There was a small amount of significant evidence (1 in each 11), notably the (cost-)effectiveness of a DMHI with significant long-term impact on anxiety and depression in adults. Conclusion: The empirical research demonstrates the feasibility of DMH platforms and DMHIs. To date, there is mostly heterogeneous, preliminary evidence for their effectiveness, quality and usability. However, a scalable DMHI reported effectiveness in treating adults’ anxiety and depression. The scope of effectiveness may be widened through targeted strategies, for example by engaging independent young people.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
PRISMA Extension for Scoping Reviews (PRISMA-ScR): Checklist and Explanation
Tricco, A. C., Lillie, E., Zarin, W., O'Brien, K. K., Colquhoun, H., Levac, D., Moher, D., Peters, M. D. J., Horsley, T., Weeks, L., et al. (2018) · Annals of Internal Medicine · doi:10.7326/m18-0850 · Cited by 43,565
Munn, Z., Peters, M. D. J., Stern, C., Tufanaru, C., McArthur, A., & Aromataris, E. (2018) · BMC Medical Research Methodology · doi:10.1186/s12874-018-0611-x · Cited by 11,385
Epidemiology of suicide and the psychiatric perspective
Bachmann, S. (2018) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph15071425 · Cited by 1,377 · cited 1×
“Psychiatric diseases contribute to 60–98% of suicides [21].”
BackgroundTorous, J., Bucci, S., Bell, I. H., Kessing, L. V., Faurholt‐Jepsen, M., Whelan, P., Carvalho, A. F., Keshavan, M., Linardon, J., & Firth, J. (2021) · World Psychiatry · doi:10.1002/wps.20883 · Cited by 1,199 · cited 7×
“There is a priority to establish evidence for use in servicing people with diagnosed mental disorders [5].”
BackgroundMethodResultInfluentialFirth, J., Torous, J., Nicholas, J., Carney, R., Pratap, A., Rosenbaum, S., & Sarris, J. (2017) · World Psychiatry · doi:10.1002/wps.20472 · Cited by 1,097 · cited 2×
“Meta-analyses of randomized controlled trials (RCTs), an experimental form of impact evaluation with a randomly selected sample and control group from the same population, noted potential efficacy for DMHIs for anxiety [23,24] and depression [25] in general populations.”
BackgroundMethodBorghouts, J., Eikey, E., Mark, G., De Leon, C., Schueller, S. M., Schneider, M., Stadnick, N., Zheng, K., Mukamel, D., & Sorkin, D. H. (2021) · Journal of Medical Internet Research · doi:10.2196/24387 · Cited by 1,069 · cited 4×
“A systematic review reported DMHIs have higher sustained engagement than self-guided digital tools [10].”
BackgroundMethodInfluentialTorous, J., Jän Myrick, K., Rauseo-Ricupero, N., & Firth, J. (2020) · JMIR Mental Health · doi:10.2196/18848 · Cited by 946 · cited 2×
“For example, digital mental health (DMH), which is a contemporary method of mental health care that is distinguished by the large-scale integration of telehealth [2], apps [3,4], and digital platforms [5] as well as the promise of big data, genomics and artificial intelligence (AI) [6].”
BackgroundMethodLattie, E. G., Adkins, E. C., Winquist, N., Stiles-Shields, C., Wafford, Q. E., & Graham, A. K. (2019) · Journal of Medical Internet Research · doi:10.2196/12869 · Cited by 843 · cited 1×
“Systematic reviews found a lack of clear and comprehensive evidence-base although there is a growing consensus that the most effective DMHIs are used for anxiety and depression particularly with college students [29] and young people [30].”
BackgroundTorous, J., Nicholas, J., Larsen, M. E., Firth, J., & Christensen, H. (2018) · Evidence Based Mental Health · doi:10.1136/eb-2018-102891 · Cited by 790
Firth, J., Torous, J., Nicholas, J., Carney, R., Rosenbaum, S., & Sarris, J. (2017) · Journal of Affective Disorders · doi:10.1016/j.jad.2017.04.046 · Cited by 675 · cited 2×
“It was suggested to focus studies on comparisons with face-to-face psychological care [23].”
BackgroundMethod
Cited by
AI Chatbots in Digital Mental Health
Balcombe, L. (2023) · Informatics · doi:10.3390/informatics10040082 · Cited by 174
Self-citationMadrid‐Cagigal, A., Kealy, C., Potts, C., Mulvenna, M. D., Byrne, M., Barry, M. M., & Donohoe, G. (2025) · Early Intervention in Psychiatry · doi:10.1111/eip.70017 · Cited by 78
Johnson, E., Corrick, S., Isley, S., Vandermeer, B., Dolgoy, N., Bates, J., Godfrey, E., Soltys, C., Muir, C., Vohra, S., et al. (2024) · PLOS Digital Health · doi:10.1371/journal.pdig.0000435 · Cited by 24
Leveraging Digital Technology to Enhance Mind-Body Approaches in Cancer Treatment
Heudel, P., & Ubelmann, C. (2025) · JCO Clinical Cancer Informatics · doi:10.1200/cci-24-00293 · Cited by 2
Metadata
- Authors
- Balcombe, L., & De Leo, D.
- Venue
- International Journal of Environmental Research and Public Health
- Publisher
- MDPI AG
- Published
- 2022-12-26
- Volume
- 20
- Issue
- 1
- Pages
- 362
- ISSN
- 1660-4601 (ISSN-L)
- OpenAlex
- W4313260301
- Cited by
- 76
- References
- 40
- FWCI
- 11.50
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Evaluation of the Use of Digital Mental Health Platforms and Interventions: Scoping Review. https://app.cochat.ai/papers/10.3390/ijerph20010362
- The paper
- Balcombe, L., & De Leo, D. (2022). Evaluation of the Use of Digital Mental Health Platforms and Interventions: Scoping Review. International Journal of Environmental Research and Public Health. https://doi.org/10.3390/ijerph20010362
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.