Potential and Pitfalls of Mobile Mental Health Apps in Traditional Treatment: An Umbrella Review
Open accessThe DOI matches its Crossref record; 59 of the 59 references it cites were found in a registry or an index.
Abstract
While the rapid growth of mobile mental health applications has offered an avenue of support unbridled by physical distance, time, and cost, the digitalization of traditional interventions has also triggered doubts surrounding their effectiveness and safety. Given the need for a more comprehensive and up-to-date understanding of mobile mental health apps in traditional treatment, this umbrella review provides a holistic summary of their key potential and pitfalls. A total of 36 reviews published between 2014 and 2022—including systematic reviews, meta-analyses, scoping reviews, and literature reviews—were identified from the Cochrane library, Medline (via PubMed Central), and Scopus databases. The majority of results supported the key potential of apps in helping to (1) provide timely support, (2) ease the costs of mental healthcare, (3) combat stigma in help-seeking, and (4) enhance therapeutic outcomes. Our results also identified common themes of apps’ pitfalls (i.e., challenges faced by app users), including (1) user engagement issues, (2) safety issues in emergencies, (3) privacy and confidentiality breaches, and (4) the utilization of non-evidence-based approaches. We synthesize the potential and pitfalls of mental health apps provided by the reviews and outline critical avenues for future research.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“especially given that user engagement is associated with better treatment outcomes [15,53] and more cost-effective treatment [54,55].”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: the PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & for the PRISMA Group (2009) · BMJ · doi:10.1136/bmj.b2535 · Cited by 83,823
Preferred reporting items for systematic reviews and meta-analyses: the PRISMA Statement.
(2009) · PubMed Central · Cited by 44,859
Firth, J., Torous, J., Nicholas, J., Carney, R., Pratap, A., Rosenbaum, S., & Sarris, J. (2017) · World Psychiatry · doi:10.1002/wps.20472 · Cited by 1,097 · cited 2×
“’s [19] meta-analysis of 18 randomized controlled trials, smartphone interventions had a small-to-moderate effect in reducing depressive symptoms in an overall”
BackgroundMethodBorghouts, J., Eikey, E., Mark, G., De Leon, C., Schueller, S. M., Schneider, M., Stadnick, N., Zheng, K., Mukamel, D., & Sorkin, D. H. (2021) · Journal of Medical Internet Research · doi:10.2196/24387 · Cited by 1,069 · cited 2×
“First, eight reviews found that mental health app users were commonly concerned with their confidential information being shared with third parties or used for unauthorized purposes such as marketing [9,14,18,29,39,45,46,50].”
BackgroundMental Health Smartphone Apps: Review and Evidence-Based Recommendations for Future Developments
Bakker, D., Kazantzis, N., Rickwood, D., & Rickard, N. (2016) · JMIR Mental Health · doi:10.2196/mental.4984 · Cited by 886
Lattie, E. G., Adkins, E. C., Winquist, N., Stiles-Shields, C., Wafford, Q. E., & Graham, A. K. (2019) · Journal of Medical Internet Research · doi:10.2196/12869 · Cited by 843 · cited 2×
“Six reviews referred to high attrition rates and poor rates of sustained engagement prevalent among mental health apps [14,20,22,24,29,30].”
BackgroundTorous, J., Nicholas, J., Larsen, M. E., Firth, J., & Christensen, H. (2018) · Evidence Based Mental Health · doi:10.1136/eb-2018-102891 · Cited by 790
mHealth: A Mechanism to Deliver More Accessible, More Effective Mental Health Care
Price, M., Yuen, E. K., Goetter, E. M., Herbert, J. D., Forman, E. M., Acierno, R., & Ruggiero, K. J. (2014) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.1855 · Cited by 488 · cited 2×
“Specifically, help-seekers can overcome constraints of traditional clinical settings, such as long waitlists, restricted clinic hours, and living in regions with poor access to mental healthcare [3– 5, 7].”
BackgroundLehtimaki, S., Martic, J., Wahl, B., Foster, K. T., & Schwalbe, N. (2021) · JMIR Mental Health · doi:10.2196/25847 · Cited by 488 · cited 2×
“First, 10 reviews found limited evidence for the effectiveness of mental health apps in reducing symptoms of psychological distress (e.g., depression, anxiety, stress) and improving socioemotional competency [14,23,24,36,38,40,42,45,47,50].”
BackgroundMobile Apps for Bipolar Disorder: A Systematic Review of Features and Content Quality
Nicholas, J., Larsen, M. E., Proudfoot, J., & Christensen, H. (2015) · Journal of Medical Internet Research · doi:10.2196/jmir.4581 · Cited by 438 · cited 3×
“More specifically, only 22% of apps targeted at bipolar disorder and 29% of apps targeted at suicide or deliberate self-harm provided a clear privacy policy which informs users on how their data are used [21,26].”
E-Mental Health: A Rapid Review of the Literature
Lal, S., & Adair, C. E. (2014) · Psychiatric Services · doi:10.1176/appi.ps.201300009 · Cited by 417 · cited 4×
“In total, 16 out of 36 studies cited timely support as an advantage which mental health apps have provided, by transcending traditional help-seeking boundaries associated with waiting time and physical distance [9,12,15,25,29,33–36, 39, 40, 42, 44,”
BackgroundInfluentialLiverpool, S., Mota, C. P., Sales, C. M. D., Čuš, A., Carletto, S., Hancheva, C., Sousa, S., Cerón, S. C., Moreno-Peral, P., Pietrabissa, G., et al. (2020) · Journal of Medical Internet Research · doi:10.2196/16317 · Cited by 408
Garrido, S., Millington, C., Cheers, D., Boydell, K., Schubert, E., Meade, T., & Nguyen, Q. V. (2019) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2019.00759 · Cited by 400 · cited 3×
“Six reviews referred to high attrition rates and poor rates of sustained engagement prevalent among mental health apps [14,20,22,24,29,30].”
BackgroundA systematic assessment of smartphone tools for suicide prevention
Larsen, M. E., Nicholas, J., & Christensen, H. (2016) · PLoS ONE · doi:10.1371/journal.pone.0152285 · Cited by 289
Insights from user reviews to improve mental health apps
Alqahtani, F., & Orji, R. (2020) · Health Informatics Journal · doi:10.1177/1460458219896492 · Cited by 286 · cited 5×
“A second concern was the lack of clear privacy policies which explain the protection of users’ information, as highlighted by five reviews [21,26,32,46,49].”
BackgroundInfluentialKretzschmar, K., Tyroll, H., Pavarini, G., Manzini, A., Singh, I., & NeurOx Young People’s Advisory Group (2019) · Biomedical Informatics Insights · doi:10.1177/1178222619829083 · Cited by 270 · cited 4×
“Mobile mental health applications (i.e., apps) are virtual, smartphone-delivered platforms which provide self-directed or remotely facilitated mental health services in the areas of communication, self-monitoring, diagnosis, and treatment [1–3].”
BackgroundInfluentialDigital Mental Health for Young People: A Scoping Review of Ethical Promises and Challenges
Wies, B., Landers, C., & Ienca, M. (2021) · Frontiers in Digital Health · doi:10.3389/fdgth.2021.697072 · Cited by 242 · cited 8×
“…reviews, privacy and confidentiality breaches were consistently cited as a key concern among mental health app users, with these concerns falling into two categories: (1) third-party access to confidential information; and (2) lack of an explicit privacy policy [9,14,18,21,26,29,32,39,45,46,49,50].”
BackgroundInfluentialTorous, J., Chan, S. R., Yee-Marie Tan, S., Behrens, J., Mathew, I., Conrad, E. J., Hinton, L., Yellowlees, P., & Keshavan, M. (2014) · JMIR Mental Health · doi:10.2196/mental.4004 · Cited by 228
Anderson, J. K., Howarth, E., Vainre, M., Jones, P. B., & Humphrey, A. (2017) · Children and Youth Services Review · doi:10.1016/j.childyouth.2017.04.017 · Cited by 195
Tremain, H., McEnery, C., Fletcher, K., & Murray, G. (2020) · JMIR Mental Health · doi:10.2196/17204 · Cited by 193
Torous, J. B., Chan, S. R., Gipson, S. Y.-M. T., Kim, J. W., Nguyen, T.-Q., Luo, J., & Wang, P. (2018) · Psychiatric Services · doi:10.1176/appi.ps.201700423 · Cited by 184 · cited 2×
“Finally, with regard to individual differences in apps usage, future research should look into the role of individual differences—including demographic factors and individual needs and preferences—in modulating the effectiveness of mental health apps [61,62].”
BackgroundOyebode, O., Alqahtani, F., & Orji, R. (2020) · IEEE Access · doi:10.1109/access.2020.3002176 · Cited by 183
Eisenstadt, M., Liverpool, S., Infanti, E., Ciuvat, R. M., & Carlsson, C. (2021) · JMIR Mental Health · doi:10.2196/31170 · Cited by 182
Lau, N., O'Daffer, A., Colt, S., Yi-Frazier, J. P., Palermo, T. M., McCauley, E., & Rosenberg, A. R. (2020) · JMIR mhealth and uhealth · doi:10.2196/17798 · Cited by 174 · cited 1×
“Due to the present lack of such guidelines, standardized criteria for “approved-for-use” apps remain unclear to both app developers and clinicians alike [5,60].”
BackgroundTowards a Framework for Evaluating Mobile Mental Health Apps
Chan, S., Torous, J., Hinton, L., & Yellowlees, P. (2015) · Telemedicine and e-Health · doi:10.1089/tmj.2015.0002 · Cited by 163
Digital mental health apps and the therapeutic alliance: initial review
Henson, P., Wisniewski, H., Hollis, C., Keshavan, M., & Torous, J. (2019) · BJPsych Open · doi:10.1192/bjo.2018.86 · Cited by 152 · cited 3×
“In total, 16 out of 36 studies cited timely support as an advantage which mental health apps have provided, by transcending traditional help-seeking boundaries associated with waiting time and physical distance [9,12,15,25,29,33–36, 39, 40, 42, 44,”
BackgroundCarter, H., Araya, R., Anjur, K., Deng, D., & Naslund, J. A. (2021) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2020.12.016 · Cited by 138
Kaveladze, B. T., Wasil, A. R., Bunyi, J., Ramirez, V., & Schueller, S. M. (2021) · JMIR Human Factors · doi:10.2196/30766 · Cited by 129
Digital Mental Health Tools for Caregivers of Older Adults—A Scoping Review
Petrovic, M., & Gaggioli, A. (2020) · Frontiers in Public Health · doi:10.3389/fpubh.2020.00128 · Cited by 124
Youth Mental Health Interventions via Mobile Phones: A Scoping Review
Seko, Y., Kidd, S., Wiljer, D., & McKenzie, K. (2014) · Cyberpsychology, Behavior, and Social Networking · doi:10.1089/cyber.2014.0078 · Cited by 117
Chan, A. H. Y., & Honey, M. L. L. (2022) · Journal of Psychiatric and Mental Health Nursing · doi:10.1111/jpm.12744 · Cited by 112
Implementation of Cognitive Behavioral Therapy in e–Mental Health Apps: Literature Review
Denecke, K., Schmid, N., & Nüssli, S. (2022) · Journal of Medical Internet Research · doi:10.2196/27791 · Cited by 107
Effectiveness of digital mental health interventions for university students: An umbrella review
Harith, S., Backhaus, I., Mohbin, N., Ngo, H. T., & Khoo, S. (2022) · PeerJ · doi:10.7717/peerj.13111 · Cited by 105
The smart therapist: A look to the future of smartphones and mHealth technologies in psychotherapy.
Clough, B. A., & Casey, L. M. (2015) · Professional Psychology: Research and Practice · doi:10.1037/pro0000011 · Cited by 104
Leech, T., Dorstyn, D., Taylor, A., & Li, W. (2021) · Children and Youth Services Review · doi:10.1016/j.childyouth.2021.106073 · Cited by 100
Drissi, N., Ouhbi, S., Marques, G., de la Torre Díez, I., Ghogho, M., & Janati Idrissi, M. A. (2021) · Telemedicine and e-Health · doi:10.1089/tmj.2020.0287 · Cited by 95
Six, S. G., Byrne, K. A., Tibbett, T. P., & Pericot-Valverde, I. (2021) · JMIR Mental Health · doi:10.2196/32199 · Cited by 95 · cited 2×
“[28] Thach [48] Thach [49] Anxiety/Depression/Stress/Well-being”
BackgroundBolinski, F., Boumparis, N., Kleiboer, A., Cuijpers, P., Ebert, D. D., & Riper, H. (2020) · Internet Interventions · doi:10.1016/j.invent.2020.100321 · Cited by 87 · cited 1×
“In addition, three other reviews were excluded because they focused on outcomes other than mental health (i.e., academic performance [54]), the assessment of mobile mental health services [42], and the types of e-mental health systems and their degree of technological advancement [55].”
BackgroundMarshall, J. M., Dunstan, D. A., & Bartik, W. (2020) · Australian & New Zealand Journal of Psychiatry · doi:10.1177/0004867419876700 · Cited by 83
Smartphone Applications for Mental Health
Radovic, A., Vona, P. L., Santostefano, A. M., Ciaravino, S., Miller, E., & Stein, B. D. (2016) · Cyberpsychology, Behavior, and Social Networking · doi:10.1089/cyber.2015.0619 · Cited by 78 · cited 1×
“Considering that mental health apps are commonly designed and utilized to manage and relieve mild symptomatology [59], there is currently a lack of understanding regarding how these approaches may be applied to more severe symptoms.”
BackgroundVeterans Affairs and the Department of Defense mental health apps: A systematic literature review.
Gould, C. E., Kok, B. C., Ma, V. K., Zapata, A. M. L., Owen, J. E., & Kuhn, E. (2019) · Psychological Services · doi:10.1037/ser0000289 · Cited by 76
Simblett, S., Birch, J., Matcham, F., Yaguez, L., & Morris, R. (2017) · JMIR Mental Health · doi:10.2196/mental.5558 · Cited by 72
Digital mental health in China: a systematic review
Zhang, X., Lewis, S. W., Firth, J., Xu, C., & Bucci, S. (2021) · Psychological Medicine · doi:10.1017/s0033291721003731 · Cited by 71
Digital Overload among College Students: Implications for Mental Health App Use
Smith, A. C., Fowler, L. A., Graham, A. K., Jaworski, B. K., Firebaugh, M., Monterubio, G. E., Vázquez, M. M., DePietro, B., Sadeh‐Sharvit, S., Balantekin, K. N., et al. (2021) · Social Sciences · doi:10.3390/socsci10080279 · Cited by 66
Balcombe, L., & Leo, D. D. (2020) · JMIR Formative Research · doi:10.2196/22755 · Cited by 64
The Application of e-Mental Health in Response to COVID-19: Scoping Review and Bibliometric Analysis
Ellis, L. A., Meulenbroeks, I., Churruca, K., Pomare, C., Hatem, S., Harrison, R., Zurynski, Y., & Braithwaite, J. (2021) · JMIR Mental Health · doi:10.2196/32948 · Cited by 59
Research Trends on Mobile Mental Health Application for General Population: A Scoping Review
Hwang, W. J., Ha, J. S., & Kim, M. J. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph18052459 · Cited by 56
Hartanto, A., Lua, V. Y. Q., Quek, F. Y. X., Yong, J. C., & Ng, M. H. S. (2021) · Computers in Human Behavior Reports · doi:10.1016/j.chbr.2021.100135 · Cited by 56
Self-citationCohen, K. A., Stiles-Shields, C., Winquist, N., & Lattie, E. G. (2021) · The Journal of Behavioral Health Services & Research · doi:10.1007/s11414-020-09746-w · Cited by 51
Burger, F., Neerincx, M. A., & Brinkman, W.-P. (2020) · Journal of Medical Internet Research · doi:10.2196/12599 · Cited by 47
Putting Technology Into Youth Mental Health Practice: Young People’s Perspectives
Montague, A. E., Varcin, K. J., Simmons, M. B., & Parker, A. G. (2015) · Sage Open · doi:10.1177/2158244015581019 · Cited by 45 · cited 1×
“Considering that delayed treatment contributes to more severe and enduring mental health difficulties [4,8,56], the timely nature of mobile mental healthcare is especially helpful in situations when an in-the-moment experience of relief is needed and traditional support might not be as helpful by the time it becomes a…”
BackgroundHa, S. W., & Kim, J. (2020) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2020.1750792 · Cited by 37
Murphy, J., Khan, A., Sun, Q., Minas, H., Hatcher, S., Ng, C. H., Withers, M. H., Greenshaw, A. J., Michalak, E. E., Chakraborty, P. A., et al. (2021) · International Journal for Equity in Health · doi:10.1186/s12939-021-01484-5 · Cited by 34
Struthers, A., Charette, C., Bapuji, S. B., Winters, S., Ye, X., Metge, C., Kreindler, S., Raynard, M., Lemaire, J., Synyshyn, M., et al. (2015) · Canadian Journal of Community Mental Health · doi:10.7870/cjcmh-2015-006 · Cited by 27 · cited 5×
“…reviews, privacy and confidentiality breaches were consistently cited as a key concern among mental health app users, with these concerns falling into two categories: (1) third-party access to confidential information; and (2) lack of an explicit privacy policy [9,14,18,21,26,29,32,39,45,46,49,50].”
BackgroundInfluentialLua, V. Y. Q., Majeed, N. M., Hartanto, A., & Leung, A. K. ‐. (2022) · Social Psychology Quarterly · doi:10.1177/01902725221077075 · Cited by 23
Self-citationUser’s perception on mental health applications: a qualitative analysis of user reviews
Thach, K. S. (2018) · NAFOSTED Conference on Information and Computer Science (NICS) · doi:10.1109/nics.2018.8606901 · Cited by 22
Editorial: Computers and Games for Mental Health and Well-Being
Khazaal, Y., Favrod, J., Sort, A., Borgeat, F., & Bouchard, S. (2018) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2018.00141 · Cited by 21
Technology and Adolescent Mental Health
Moreno, M., & Radović, A. (2018) · Cambridge International Law Journal · doi:10.1007/978-3-319-69638-6 · Cited by 15
How E-Mental Health Services Benefit University Students with ADHD: A literature ReviewPreprint
Binhadyan, B., Davey, B., & Wickramasinghe, N. S. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1606.00876 · Cited by 5
Research works printed but not linked: 1
- Thach, K.S. A qualitative analysis of user reviews on mental health apps: Who used it? For what? And why? In Proceedings of the 2019 IEEE-RIVF International Conference on Computing and Communication Technologies (RIVF), Danang, Vietnam, 20–22 March 2019.
Cited by
Digital transformation of mental health services
Bond, R. R., Mulvenna, M. D., Potts, C., O’Neill, S., Ennis, E., & Torous, J. (2023) · npj Mental Health Research · doi:10.1038/s44184-023-00033-y · Cited by 199
Kasturiratna, K. T. A. S., Hartanto, A., Chen, C. H. Y., Tong, E. M. W., & Majeed, N. M. (2024) · Nature Human Behaviour · doi:10.1038/s41562-024-02011-6 · Cited by 119
Self-citationAyub, S., Jain, L., Parnia, S., Bachu, A. K., Farhan, R., Kumar, H., Sullivan, A., & Ahmed, S. (2023) · Journal of Clinical Medicine · doi:10.3390/jcm12093345 · Cited by 64
An umbrella review of effectiveness and efficacy trials for app-based health interventions
Chong, S. O. K., Pedron, S., Abdelmalak, N., Laxy, M., & Stephan, A. (2023) · npj Digital Medicine · doi:10.1038/s41746-023-00981-x · Cited by 57
Wrightson‐Hester, A., Anderson, G., Dunstan, J., McEvoy, P. M., Sutton, C., MYERS, B. J., Egan, S. J., Tai, S., Johnston-Hollitt, M., Chen, W., et al. (2023) · JMIR Human Factors · doi:10.2196/46849 · Cited by 50
Metadata
- Authors
- Koh, J., Tng, G. Y. Q., & Hartanto, A.
- Affiliations
- Millersville University (US)
- Singapore Management University (SG)
- Corresponding author
- Hartanto, Andree
- Venue
- Journal of Personalized Medicine
- Publisher
- MDPI AG
- Published
- 2022-08-25
- Volume
- 12
- Issue
- 9
- Pages
- 1376
- ISSN
- 2075-4426 (ISSN-L)
- PMC
- PMC9505389
- OpenAlex
- W4293217790
- Cited by
- 155
- References
- 58
- Citations by year
- 2026: 46 · 2025: 50 · 2024: 38 · 2023: 19 · 2022: 2
- FWCI
- 4.85
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Journal of Personalized Medicine (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Singapore Management University Institutional Knowledge (InK) (Singapore Management University) (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- Ministry of Education Academy Research Fund Tier 1 (20-C242-SMU-001, 21-SOSS-SMU-023)
- Lee Kong Chian Fund for Research Excellence (20-C242-SMU-001, 21-SOSS-SMU-023)
- Topics
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Health Sciences › Medicine › Psychiatry and Mental health › Mental Health Treatment and Access
- Keywords
- mental health apps, digital mental health interventions, application effectiveness, mobile application security, user engagement, privacy and confidentiality, stigma reduction, help-seeking
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.

