The DOI matches its Crossref record; 40 of the 40 references it cites were found in a registry or an index.
The Emerging Imperative for a Consensus Approach Toward the Rating and Clinical Recommendation of Mental Health Apps
Abstract
With over 10,000 mental health– and psychiatry-related smartphone apps available today and expanding, there is a need for reliable and valid evaluation of these digital tools. However, the updating and nonstatic nature of smartphone apps, expanding privacy concerns, varying degrees of usability, and evolving interoperability standards, among other factors, present serious challenges for app evaluation. In this article, we provide a narrative review of various schemes toward app evaluations, including commercial app store metrics, government initiatives, patient-centric approaches, point-based scoring, academic platforms, and expert review systems. We demonstrate that these different approaches toward app evaluation each offer unique benefits but often do not agree to each other and produce varied conclusions as to which apps are useful or not. Although there are no simple solutions, we briefly introduce a new initiative that aims to unify the current controversies in app elevation called CHART (Collaborative Health App Rating Teams), which will be further discussed in a second article in this series.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
An increasingly large number of apps claiming to support mental health needs are available for download via commercial marketplaces.
“an increasingly large number of apps claiming to support mental health needs are available for download via commercial marketplaces (Torous et al. 2018).”
From Evaluating the quality, safety, and functionality of commonly used smartphone apps for bipolar disorder mood and sleep self-management (2022) · cites this paper as Torous et al. 2018
There is no consensus approach to evaluating mHealth apps.
“Secondly, there is no consensus approach to evaluating mHeath apps (Torous et al. 2018).”
From Evaluating the quality, safety, and functionality of commonly used smartphone apps for bipolar disorder mood and sleep self-management (2022) · cites this paper as Torous et al. 2018
Citations
Cites
Mobile app rating scale: a new tool for assessing the quality of health mobile apps
Stoyanov, S. R., Hides, L., Kavanagh, D. J., Zelenko, O., Tjondronegoro, D., & Mani, M. (2015) · JMIR mHealth and uHealth · doi:10.2196/mhealth.3422 · Cited by 2,233
Health App Use Among US Mobile Phone Owners: A National Survey
Krebs, P., & Duncan, D. T. (2015) · JMIR mHealth and uHealth · doi:10.2196/mhealth.4924 · Cited by 1,274
Smartphones for smarter delivery of mental health programs: A systematic review
Donker, T., Petrie, K., Proudfoot, J., Clarke, J., Birch, M.-R., & Christensen, H. (2013) · Journal of Medical Internet Research · doi:10.2196/jmir.2791 · Cited by 1,136
Self-citationFirth, J., Torous, J., Nicholas, J., Carney, R., Pratap, A., Rosenbaum, S., & Sarris, J. (2017) · World Psychiatry · doi:10.1002/wps.20472 · Cited by 1,097
Self-citationDevelopment and validation of the user version of the Mobile application rating scale (uMARS)
Stoyanov, S. R., Hides, L., Kavanagh, D. J., & Wilson, H. (2016) · JMIR mhealth and uhealth · doi:10.2196/mhealth.5849 · Cited by 872
Firth, J., Torous, J., Nicholas, J., Carney, R., Rosenbaum, S., & Sarris, J. (2017) · Journal of Affective Disorders · doi:10.1016/j.jad.2017.04.046 · Cited by 675
Self-citationReview and evaluation of mindfulness-based iPhone apps
Mani, M., Kavanagh, D. J., Hides, L., & Stoyanov, S. R. (2015) · JMIR mHealth and uHealth · doi:10.2196/mhealth.4328 · Cited by 495
Mobile Apps for Bipolar Disorder: A Systematic Review of Features and Content Quality
Nicholas, J., Larsen, M. E., Proudfoot, J., & Christensen, H. (2015) · Journal of Medical Internet Research · doi:10.2196/jmir.4581 · Cited by 438
Self-citationHuckvale, K., Prieto, J. T., Tilney, M., Benghozi, P.-J., & Car, J. (2015) · BMC Medicine · doi:10.1186/s12916-015-0444-y · Cited by 376
Self-citationThe Use and Effectiveness of Mobile Apps for Depression: Results From a Fully Remote Clinical Trial
Arean, P. A., Hallgren, K. A., Jordan, J. T., Gazzaley, A., Atkins, D. C., Heagerty, P. J., & Anguera, J. A. (2016) · Journal of Medical Internet Research · doi:10.2196/jmir.6482 · Cited by 376
Torous, J., & Roberts, L. W. (2017) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2017.0262 · Cited by 362
Self-citationFirth, J., Cotter, J., Torous, J., Bucci, S., Firth, J. A., & Yung, A. R. (2016) · Schizophrenia Bulletin · doi:10.1093/schbul/sbv132 · Cited by 351
Self-citationA systematic assessment of smartphone tools for suicide prevention
Larsen, M. E., Nicholas, J., & Christensen, H. (2016) · PLoS ONE · doi:10.1371/journal.pone.0152285 · Cited by 289
Self-citationAncker, J. S., Witteman, H. O., Hafeez, B., Provencher, T., de Graaf, M. V., & Wei, E. (2015) · Journal of Medical Internet Research · doi:10.2196/jmir.4209 · Cited by 277
Usability of Commercially Available Mobile Applications for Diverse Patients
Sarkar, U., Gourley, G. I., Lyles, C. R., Tieu, L., Clarity, C., Newmark, L., Singh, K., & Bates, D. W. (2016) · Journal of General Internal Medicine · doi:10.1007/s11606-016-3771-6 · Cited by 257
Anxiety: There is an app for that. A systematic review of anxiety apps: SUCALA et al.
Sucala, M., Cuijpers, P., Muench, F., Cardoș, R., Soflau, R., Dobrean, A., Achimas-Cadariu, P., & David, D. (2017) · Depression and Anxiety · doi:10.1002/da.22654 · Cited by 232
Torous, J., Chan, S. R., Yee-Marie Tan, S., Behrens, J., Mathew, I., Conrad, E. J., Hinton, L., Yellowlees, P., & Keshavan, M. (2014) · JMIR Mental Health · doi:10.2196/mental.4004 · Cited by 228
Self-citationmHealth in the Wild: Using Novel Data to Examine the Reach, Use, and Impact of PTSD Coach
Owen, J. E., Jaworski, B. K., Kuhn, E., Makin-Byrd, K. N., Ramsey, K. M., & Hoffman, J. E. (2015) · JMIR Mental Health · doi:10.2196/mental.3935 · Cited by 216
Baumel, A., Faber, K., Mathur, N., Kane, J. M., & Muench, F. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.7270 · Cited by 206
Many Mobile Health Apps Target High-Need, High-Cost Populations, But Gaps Remain
Singh, K., Drouin, K., Newmark, L. P., Lee, J., Faxvaag, A., Rozenblum, R., Pabo, E. A., Landman, A., Klinger, E., & Bates, D. W. (2016) · Health Affairs · doi:10.1377/hlthaff.2016.0578 · Cited by 201
The digital placebo effect: mobile mental health meets clinical psychiatry
Torous, J., & Firth, J. (2016) · The Lancet Psychiatry · doi:10.1016/s2215-0366(15)00565-9 · Cited by 200
Self-citationDo We Still Have a Digital Divide in Mental Health? A Five-Year Survey Follow-up
Robotham, D., Satkunanathan, S., Doughty, L., & Wykes, T. (2016) · Journal of Medical Internet Research · doi:10.2196/jmir.6511 · Cited by 184
Self-citationGajecki, M., Berman, A. H., Sinadinovic, K., Rosendahl, I., & Andersson, C. (2014) · Addiction Science & Clinical Practice · doi:10.1186/1940-0640-9-11 · Cited by 179
Quantifying App Store Dynamics: Longitudinal Tracking of Mental Health Apps
Larsen, M. E., Nicholas, J., & Christensen, H. (2016) · JMIR mHealth and uHealth · doi:10.2196/mhealth.6020 · Cited by 177
Self-citationDigital Technology Use Among Individuals with Schizophrenia: Results of an Online Survey
Gay, K., Torous, J., Joseph, A., Pandya, A., & Duckworth, K. (2016) · JMIR Mental Health · doi:10.2196/mental.5379 · Cited by 161
Self-citationNicholas, J., Fogarty, A. S., Boydell, K., & Christensen, H. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.7273 · Cited by 158
Self-citationSingh, K., & Bates, D. W. (2021) · PubMed · doi:10.26099/g1ws-c172 · Cited by 136
How people with serious mental illness use smartphones, mobile apps, and social media.
Naslund, J. A., Aschbrenner, K. A., & Bartels, S. J. (2016) · Psychiatric Rehabilitation Journal · doi:10.1037/prj0000207 · Cited by 126
Privacy in the Digital World: Medical and Health Data Outside of HIPAA Protections
Glenn, T., & Monteith, S. (2014) · Current Psychiatry Reports · doi:10.1007/s11920-014-0494-4 · Cited by 122
Powell, A. C., Torous, J. B., Chan, S. R., Raynor, G., Shwarts, E., Shanahan, M. E., & Landman, A. (2016) · JMIR mhealth and uhealth · doi:10.2196/mhealth.5176 · Cited by 103
Self-citationRamirez, V., Johnson, E. M., Gonzalez, C., Ramírez, V. A., Rubino, B., & Rossetti, G. (2016) · JMIR mhealth and uhealth · doi:10.2196/mhealth.4928 · Cited by 100
Data Security and Privacy in Apps for Dementia: An Analysis of Existing Privacy Policies
Rosenfeld, L., Torous, J., & Vahia, I. V. (2017) · The American Journal of Geriatric Psychiatry · doi:10.1016/j.jagp.2017.04.009 · Cited by 100
Self-citationFree smoking cessation mobile apps available in Australia: a quality review and content analysis
Thornton, L. K., Quinn, C. A., Birrell, L., Guillaumier, A., Shaw, B., Forbes, E., Deady, M., & KAY‐LAMBKIN, F. J. (2017) · Australian and New Zealand Journal of Public Health · doi:10.1111/1753-6405.12688 · Cited by 93
Torous, J., Levin, M. E., Ahern, D. K., & Oser, M. L. (2017) · Cognitive and Behavioral Practice · doi:10.1016/j.cbpra.2016.05.007 · Cited by 73
Self-citationTorous, J. B., Chan, S. R., Yellowlees, P., & BOLAND, R. J. (2016) · The Journal of Clinical Psychiatry · doi:10.4088/jcp.15com10619 · Cited by 51
Self-citationLeigh, S., Ouyang, J., & Mimnagh, C. (2017) · Evidence Based Mental Health · doi:10.1136/eb-2017-102751 · Cited by 46
Characterizing Smartphone Engagement for Schizophrenia: Results of a Naturalist Mobile Health Study
Torous, J., Staples, P., Slaters, L., Adams, J., Sandoval, L., Onnela, J., & Keshavan, M. (2017) · Clinical Schizophrenia & Related Psychoses · doi:10.3371/csrp.jtps.071317 · Cited by 44
Self-citationWalsh, S., Golden, E., & Priebe, S. (2016) · BMJ Open · doi:10.1136/bmjopen-2015-008362 · Cited by 42
Torous, J. B., & Roux, S. (2017) · JMIR Mental Health · doi:10.2196/mental.7911 · Cited by 36
Self-citationSmartphones for Smarter Care? Self-Management in Schizophrenia
Sandoval, L. R., Torous, J. B., & Keshavan, M. S. (2017) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2017.16090990 · Cited by 23
Self-citation
Flagged first, then by citations
Research works printed but not linked: 2
- 2016, High-quality mHealth apps can be blended into care "High-Quality Mhealth Apps Can Be Blended Into Care", AMA Wire
- 2017, Mobile Fact Sheet, Pew Research Center: Internet, Science & Tech
Cited by
Sorted by citations
Torous, J., Jän Myrick, K., Rauseo-Ricupero, N., & Firth, J. (2020) · JMIR Mental Health · doi:10.2196/18848 · Cited by 946
Self-citationDigital interventions for the treatment of depression: a meta-analytic review
Moshe, I., Terhorst, Y., Philippi, P., Domhardt, M., Cuijpers, P., Cristea, I., Pulkki-Råback, L., Baumeister, H., & Sander, L. B. (2021) · Psychological Bulletin · doi:10.1037/bul0000334 · Cited by 390
Digital Mental Health for Young People: A Scoping Review of Ethical Promises and Challenges
Wies, B., Landers, C., & Ienca, M. (2021) · Frontiers in Digital Health · doi:10.3389/fdgth.2021.697072 · Cited by 242
Digital mental health: challenges and next steps
Smith, K., Blease, C. R., Faurholt‐Jepsen, M., Firth, J., Daele, T. V., Moreno, C., Carlbring, P., Ebner‐Priemer, U., Koutsouleris, N., Riper, H. M., et al. (2023) · BMJ Mental Health · doi:10.1136/bmjment-2023-300670 · Cited by 236
Self-citationBy the numbers: ratings and utilization of behavioral health mobile applications
Carlo, A. D., Hosseini Ghomi, R., Renn, B. N., & Areán, P. A. (2019) · npj Digital Medicine · doi:10.1038/s41746-019-0129-6 · Cited by 164
Wasil, A. R., Venturo-Conerly, K. E., Shingleton, R. M., & Weisz, J. R. (2019) · Behaviour Research and Therapy · doi:10.1016/j.brat.2019.103498 · Cited by 160
A Review of the Quality and Impact of Mobile Health Apps
Grundy, Q. (2021) · Annual Review of Public Health · doi:10.1146/annurev-publhealth-052020-103738 · Cited by 167
Unsworth, H., Dillon, B., Collinson, L., Powell, H., Salmon, M., Oladapo, T., Ayiku, L., Shield, G., Holden, J., Patel, N., et al. (2021) · Digital Health · doi:10.1177/20552076211018617 · Cited by 137
The Digital Psychiatrist: In Search of Evidence-Based Apps for Anxiety and Depression
Marshall, J. M., Dunstan, D. A., & Bartik, W. (2019) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2019.00831 · Cited by 107
Friis-Healy, E. A., Nagy, G. A., & Kollins, S. H. (2021) · JMIR Mental Health · doi:10.2196/25456 · Cited by 109
Philip, P., Dupuy, L., Auriacombe, M., Serre, F., de Sevin, É., Sauteraud, A., & Micoulaud‐Franchi, J. (2020) · npj Digital Medicine · doi:10.1038/s41746-019-0213-y · Cited by 105
Marshall, J. M., Dunstan, D. A., & Bartik, W. (2020) · JMIR Mental Health · doi:10.2196/16525 · Cited by 83
“Although definitions about what constitutes a health app varies, and this influences the estimates of how many health apps are available, a 2017 report calculated that there were approximately 318,000 health apps available for download [5], with 10,000 of these relating to mental health [6].”
BackgroundE-mental health: Promising advancements in policy, research, and practice
Lal, S. (2019) · Healthcare Management Forum · doi:10.1177/0840470418818583 · Cited by 83
Marshall, J. M., Dunstan, D. A., & Bartik, W. J. (2019) · Australian & New Zealand Journal of Psychiatry · doi:10.1177/0004867419876700 · Cited by 93
Connolly, S. L., Hogan, T. P., Shimada, S. L., & Miller, C. J. (2020) · Journal of Technology in Behavioral Science · doi:10.1007/s41347-020-00165-4 · Cited by 78
Hensher, M., Cooper, P., Dona, S. W. A., Angeles, M. R., Nguyen, D., Heynsbergh, N., Chatterton, M. L., & Peeters, A. (2021) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocab041 · Cited by 80
Digital Technologies in the Treatment of Anxiety: Recent Innovations and Future Directions
Firth, J., Torous, J., Carney, R., Newby, J., Cosco, T. D., Christensen, H., & Sarris, J. (2018) · Current Psychiatry Reports · doi:10.1007/s11920-018-0910-2 · Cited by 70
Self-citationHoffman, L., Benedetto, E., Huang, H. Y., Grossman, E., Kaluma, D., Mann, Z., & Torous, J. B. (2019) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2019.00094 · Cited by 69
Self-citationIntegrating digital phenotyping in clinical characterization of individuals with mood disorders
Brietzke, E. M., Hawken, E. R., Idzikowski, M. A., Pong, J., Kennedy, S. H., & Soares, C. N. (2019) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2019.07.009 · Cited by 74
Understanding Mental Health App Use Among Community College Students: Web-Based Survey Study
Borghouts, J. W., Eikey, E. V., Mark, G. J., Leon, C. D., Schueller, S. M., Schneider, M. L., Stadnick, N. A., Zheng, K., Mukamel, D. B., & Sorkin, D. H. (2021) · Journal of Medical Internet Research · doi:10.2196/27745 · Cited by 62
O'Brien, H. L., Morton, E., Kampen, A., Barnes, S. J., & Michalak, E. E. (2020) · BJPsych Open · doi:10.1192/bjo.2020.72 · Cited by 57
Understanding users’ perspectives on mobile apps for anxiety management
Balaskas, A., Schueller, S. M., Cox, A. L., & Doherty, G. J. (2022) · Frontiers in Digital Health · doi:10.3389/fdgth.2022.854263 · Cited by 56
Eis, S., Solà-Morales, O., Duarte‐Díaz, A., Vidal‐Alaball, J., Perestelo‐Pérez, L., Robles, N., & Carrión, C. (2022) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph19042186 · Cited by 43
Using apps for bipolar disorder – An online survey of healthcare provider perspectives and practices
Morton, E., Torous, J., Murray, G., & Michalak, E. E. (2021) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2021.02.047 · Cited by 36
Self-citationWebb, C. A., Swords, C. M., Lawrence, H. R., & Hilt, L. M. (2022) · Journal of Consulting and Clinical Psychology · doi:10.1037/ccp0000763 · Cited by 42
Assessment of Real-World Use of Behavioral Health Mobile Applications by a Novel Stickiness Metric
Carlo, A. D., Hosseini Ghomi, R., Renn, B. N., Strong, M. A., & Areán, P. A. (2020) · JAMA Network Open · doi:10.1001/jamanetworkopen.2020.11978 · Cited by 31
Toscos, T., Coupe, A., Flanagan, M., Drouin, M. A., Carpenter, M., Reining, L. E., Roebuck, A. E., & Mirro, M. J. (2019) · JMIR Mental Health · doi:10.2196/13230 · Cited by 32
Bowie-DaBreo, D., Sünram‐Lea, S. I., Sas, C., & Iles‐Smith, H. (2020) · JMIR Formative Research · doi:10.2196/14988 · Cited by 26
Smartphone psychology: New approaches towards safe and efficacious mobile mental health apps.
Marshall, J. M., Dunstan, D. A., & Bartik, W. (2020) · Professional Psychology: Research and Practice · doi:10.1037/pro0000278 · Cited by 25
Lincke, L., Ulbrich, L., Reis, O., Wandinger, E., Brähler, E., Dück, A., & Kölch, M. (2022) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2022.889555 · Cited by 24
Marshall, J. M., Dunstan, D. A., & Bartik, W. (2020) · JMIR Research Protocols · doi:10.2196/17159 · Cited by 24
Alon, N., Stern, A. D., & Torous, J. B. (2020) · JMIR mhealth and uhealth · doi:10.2196/20482 · Cited by 23
Self-citationDigital Health Literacy in Bipolar Disorder: International Web-Based Survey
Morton, E. E., Ho, K., Barnes, S. J., & Michalak, E. E. (2021) · JMIR Mental Health · doi:10.2196/29764 · Cited by 24
Hallenbeck, H. W., Jaworski, B. K., Wielgosz, J., Kuhn, E. R., Ramsey, K. M., Taylor, K. L., Juhasz, K. M., McGee-Vincent, P. A., Mackintosh, M., & Owen, J. E. (2022) · JMIR Mental Health · doi:10.2196/34744 · Cited by 25
Rickard, N. S., Kurt, P., & Meade, T. (2022) · Frontiers in Digital Health · doi:10.3389/fdgth.2022.1003181 · Cited by 25
Efficacy, Safety, and Evaluation Criteria of mHealth Interventions for Depression: Systematic Review
Duarte‐Díaz, A., Perestelo‐Pérez, L., Gelabert, E., Robles, N., Pérez-Navarro, A., Vidal‐Alaball, J., Solà-Morales, O., Sales-Masnou, A., & Carrión, C. (2023) · JMIR Mental Health · doi:10.2196/46877 · Cited by 27
Morton, E., Nicholas, J., Yang, L., Lapadat, L., Barnes, S. J., Provencher, M. D., Depp, C., Chan, M., Kulur, R., & Michalak, E. E. (2022) · International Journal of Bipolar Disorders · doi:10.1186/s40345-022-00256-6 · Cited by 20
“In practice, clinicians are encouraged to conduct a personalized assessment of the fit between a reviewed app and an individual’s needs/priorities (Torous et al. 2018).”
BackgroundRibaut, J., Dabbs, A. D., Dobbels, F., Teynor, A., Mess, E. V., Hoffmann, T., & Geest, S. D. (2023) · JMIR mhealth and uhealth · doi:10.2196/48625 · Cited by 23
Ethical implications of artificial intelligence in skin cancer diagnostics: use-case analyses
Shah, S. F. H., Arecco, D., Draper, H., Tiribelli, S., Harriss, E., & Matin, R. (2024) · British Journal of Dermatology · doi:10.1093/bjd/ljae434 · Cited by 19
Marshall, J. M., Dunstan, D. A., & Bartik, W. J. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.775775 · Cited by 19
AI-Enabled Mental Health Assessment and Intervention: Bridging Gaps in Access and Quality of Care.
Balasubramanian, S. (2023) · Power System Technology · doi:10.52783/pst.159 · Cited by 19
Sobowale, K., & Humphrey, D. K. (2025) · JMIR Formative Research · doi:10.2196/65605 · Cited by 15
Lu, W., Li, Y., Montayre, J., Li, M., Ho, K. Y., Li, J., & Yorke, J. (2025) · Healthcare · doi:10.3390/healthcare13030305 · Cited by 18
Tatar, O., Abdel‐Baki, A., Wittevrongel, A., Lecomte, T., Copeland, J., Lachance‐Touchette, P., Coronado‐Montoya, S., Côté, J., Crockford, D. N., Dubreucq, S., et al. (2022) · JMIR Research Protocols · doi:10.2196/40817 · Cited by 15
Federated Learning Framework for Mobile Sensing Apps in Mental Health
Suruliraj, B., & Orji, R. (2022) · SeGAH ... IEEE ... International Conference on Serious Games and Applications for Health/IEEE International Conference on Serious Games and Applications for Health · doi:10.1109/segah54908.2022.9978600 · Cited by 14
A systematic review of features and content quality of Arabic mental mHealth apps
Alnaghaimshi, N. I. S., Awadalla, M. S., Clark, S. R., & Baumert, M. (2024) · Frontiers in Digital Health · doi:10.3389/fdgth.2024.1472251 · Cited by 15
Mobile health applications for health-care delivery: trends, opportunities, and challenges
Goel, A., & Taneja, U. (2023) · Journal of Public Health · doi:10.1007/s10389-023-02165-z · Cited by 16
MoodSensing: A smartphone app for digital phenotyping and assessment of bipolar disorder
Hsu, J.-H., Wu, C., Lin, E. C., & Chen, P. S. (2024) · Psychiatry Research · doi:10.1016/j.psychres.2024.115790 · Cited by 14
A digital self‐report survey of mood for bipolar disorder
Gruichich, T. S., Gomez, J. C. D., Zayas‐Cabán, G., McInnis, M. G., & Cochran, A. L. (2021) · Bipolar Disorders · doi:10.1111/bdi.13058 · Cited by 11
Suicide Prevention Mobile Apps for Indian Users: An Overview
Sudarshan, S., & Mehrotra, S. (2021) · Cureus · doi:10.7759/cureus.16770 · Cited by 15
Telepsychology: Applications, advantages, and challenges
Yuchang, J. I. N., Zhang, Z., Zheng, P., & Junxiu, A. N. (2021) · Advances in Psychological Science · doi:10.3724/sp.j.1042.2022.00141 · Cited by 11
Tatar, O., Abdel‐Baki, A., Dyachenko, A., Bakouni, H., Bahremand, A., Tibbo, P. G., Crockford, D. N., Roy, M., Copeland, J., Fischer, B., et al. (2023) · Psychiatry Research · doi:10.1016/j.psychres.2023.115276 · Cited by 15
Castro, Ó., Salamanca-Sanabria, A., Alattas, A., Teepe, G. W., Leidenberger, K., Fleisch, E., Car, L. T., Müller‐Riemenschneider, F., & Kowatsch, T. (2024) · Archives of Public Health · doi:10.1186/s13690-024-01424-z · Cited by 11
The Monetization Strategies of Apps for Anxiety Management: an International Comparison
Powell, A. C., Yue, Z., Shan, C., & Torous, J. B. (2019) · Journal of Technology in Behavioral Science · doi:10.1007/s41347-019-00093-y · Cited by 9
Self-citationIntegration of Sensor-Based Technology in Mental Healthcare: A Systematic Scoping Review
Bosch, R., Noordzij, M. L., Westerhof, G. J., & Bohlmeijer, E. T. (2024) · Journal of Technology in Behavioral Science · doi:10.1007/s41347-024-00427-5 · Cited by 9
Camacho, E., & Torous, J. B. (2021) · Journal of Mental Health · doi:10.1080/09638237.2021.1922634 · Cited by 8
Self-citationHerpertz, J., Dwyer, B., Wagner, E. S., Mikkelson, J., Opel, N., & Torous, J. B. (2025) · Internet Interventions · doi:10.1016/j.invent.2025.100888 · Cited by 6
Self-citationDigital solutions for shaping mood and behavior among individuals with mood disorders
Victory, A. M., Letkiewicz, A. M., & Cochran, A. L. (2020) · Current Opinion in Systems Biology · doi:10.1016/j.coisb.2020.07.008 · Cited by 6
Ethical considerations of digital therapeutics for mental health
Landers, C., Wies, B., & Ienca, M. (2022) · Elsevier eBooks · doi:10.1016/b978-0-323-90045-4.00007-1 · Cited by 7
Kornfield, R., Lattie, E. G., Nicholas, J., Knapp, A. A., Mohr, D. C., & Reddy, M. C. (2023) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3610093 · Cited by 7
Jeannic, A. L., Turmaine, K., Gandré, C., Vinet, M.-A., Michel, M., & Chevreul, K. (2023) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph20126096 · Cited by 6
Alan, H. (2024) · Behaviour and Information Technology · doi:10.1080/0144929x.2024.2303626 · Cited by 8
E-attachment and Online Communication
Sitnik‐Warchulska, K., Izydorczyk, B., & Wajda, Z. (2022) · Routledge eBooks · doi:10.4324/9781003221043 · Cited by 4
Arabic Mental Health Apps: A Narrative Review of Therapeutic and Engagement Features
Harrasi, A. A., Al-Mahrouqi, T., Al‐Alawi, M., Lawati, A. A., Al-Fahdi, A., Alzaabi, A. A., & Sinawi, H. A. (2025) · Saudi Journal of Medicine and Medical Sciences · doi:10.4103/sjmms.sjmms_62_25 · Cited by 6
Chatsatrian, M., Kunde, K., Bosompem, J., Dieris-Hirche, J., Timmesfeld, N., Wirth, R., Juckel, G., Pape, M., Mai, A., Giehl, C., et al. (2025) · JMIR Human Factors · doi:10.2196/66271 · Cited by 4
Çalışır, Ö. M., & Can, N. (2021) · İnönü Üniversitesi Eğitim Fakültesi Dergisi · doi:10.17679/inuefd.952666 · Cited by 4
Morton, E. E., Kanani, S. S., Dee, N., Hu, R. X., & Michalak, E. E. (2025) · Journal of Participatory Medicine · doi:10.2196/59806 · Cited by 4
An Analysis of Privacy Language in the Scholarly Literature on Mental Health Apps
Ebben, M., & Murphy, J. S. (2020) · Advances in information security, privacy, and ethics book series · doi:10.4018/978-1-7998-3487-8.ch009 · Cited by 3
Digital Solution: Breaking the Barriers to Address Stigma of Mental Health
Karthi, M., Alsager, M., Metha, R., Fatima, N. N., & Al-Gindy, A. (2023) · IEEE EUROCON - International Conference on Computer as a Tool (EUROCON) · doi:10.1109/eurocon56442.2023.10198879 · Cited by 3
Areán, P. A., & Allred, R. (2022) · Elsevier eBooks · doi:10.1016/b978-0-323-90045-4.00011-3 · Cited by 3
Meinert, E., Milne‐Ives, M., Taylor, E., Inkster, B., Paik, A., Ananthakrishnan, A., Orr, M., Costelloe, C., & Shankar, R. (2026) · International Journal of Social Psychiatry · doi:10.1177/00207640251415507 · Cited by 3
E-mental health interventions for men: an urgent call for cohesive Australian policy and investment
Opozda, M. J., Drummond, M., Gupta, H., Petersen, J. M., & Smith, J. A. (2024) · Health Promotion International · doi:10.1093/heapro/daae033 · Cited by 2
Ferreira, D., Melo, D., Santo, A., Silva, P., Soares, S. C., & Silva, S. (2020) · Lecture notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering · doi:10.1007/978-3-030-49289-2_9 · Cited by 2
Schaefer, M. R., Iskander, J. M., Tams, S. T., & Butz, C. (2021) · Clinical Practice in Pediatric Psychology · doi:10.1037/cpp0000391 · Cited by 2
Digital interventions for mental health care
Naslund, J. A., & Babalola, D. (2025) · Elsevier eBooks · doi:10.1016/b978-0-443-15728-8.00023-9 · Cited by 1
Hood, C., Hunt, S., Metse, A. P., Hodder, R. K., Colyvas, K., Sheather‐Reid, R. B., Duerden, D., & Bowman, J. (2025) · Journal of Medical Internet Research · doi:10.2196/64746 · Cited by 1
Bolea-Alamanac, B. M., Hidalgo‐Mazzei, D., Geddes, J. R., Kas, M. J., Kuntsi, J., Matura, S., Ruf, A., Vieta, E., Auriacombe, M., Bauer, M., et al. (2026) · European Neuropsychopharmacology · doi:10.1016/j.euroneuro.2026.112883 · Cited by 1
Grabowska, W. A., Brinkhaus, B., Roll, S., Ortiz, M., Keil, T., Willich, S., Krist, L., & Witt, C. M. (2026) · BMJ Public Health · doi:10.1136/bmjph-2025-004323 · Cited by 1
Verbeke, K., Jain, C., Shpendi, A., & Borry, P. (2023) · Accountability in Research · doi:10.1080/08989621.2023.2281548 · Cited by 1
Cerrato, P. L., & Halamka, J. D. (2019) · Elsevier eBooks · doi:10.1016/b978-0-12-814923-2.00006-4 · Cited by 1
Yingta, N., Saadati, P., Abdelnour-Nocera, J., Brew, O., & Rehman, I. U. (2023) · Electronic workshops in computing · doi:10.14236/ewic/bcshci2023.30 · Cited by 2
Pimentel, C. V. D. M. B., Andrade, M. F., Coêlho, M. D. C., Pereira-Lancha, L. O., Tarifa, A. F. C., Ribeiro, J. P., Giovanini, G., & Ramos, A. F. (2025) · BMC Public Health · doi:10.1186/s12889-025-22102-x · Cited by 2
The Need to Develop Specialized Formularies of Apps and Web-Based Tools
Yellowlees, P. (2018) · Academic Psychiatry · doi:10.1007/s40596-018-0971-x · Cited by 1
Self-citationIssues with inclusion and interpretation; a cause for concern in mHealth reviews?
Firth, J., & Torous, J. B. (2018) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2018.12.010 · Cited by 1
Self-citationTo the editor: New approaches toward actionable mobile health evaluation
Torous, J. B., & Lagan, S. (2021) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocab107 · Cited by 1
Self-citationHensher, M., Cooper, P., Dona, S. W. A., Angeles, M. R., Nguyen, D., Heynsbergh, N., Chatterton, M. L., & Peeters, A. (2021) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocab106
Boin, A. C. (2021) · Digital Library of Theses and Dissertations (Universidade de São Paulo) · doi:10.11606/d.17.2021.tde-04102021-164001
An Analysis of Privacy Language in the Scholarly Literature on Mental Health Apps
Ebben, M., & Murphy, J. S. (2021) · IGI Global eBooks · doi:10.4018/978-1-7998-8954-0.ch012
Privacy Language in Scholarly Literature on Mental Health Apps: Systematic Review (Preprint)Preprint
Ebben, M., & Murphy, J. S. (2020) · doi:10.2196/preprints.19248
Jeannic, A. L., Turmaine, K., Gandré, C., Vinet, M.-A., Michel, M., & Chevreul, K. (2022) · doi:10.2196/preprints.44995
EFEKTIVITAS APLIKASI TUMBASIN.ID PADA MASA PANDEMI COVID-19 DI KOTA SEMARANG
Nafiah, Z., & Hartarini, Y. M. (2022) · EKOMA Jurnal Ekonomi Manajemen Akuntansi · doi:10.56799/ekoma.v2i1.878
Chapter 34. Psychotherapy and Cyberspace
Yellowlees, P., & Shore, J. H. (2022) · American Psychiatric Association Publishing eBooks · doi:10.1176/appi.books.9781615375233.gg34
Self-citationRaftopoulou, A.-V. K., & Dritsas, I. (2023) · Creative Education · doi:10.4236/ce.2023.1413171
Time-Series Signals of Affect and Neural Dynamics with Technology to Identify Depression Risk
Jamal, R., & Kullar, M. (2023) · Journal of Student Research · doi:10.47611/jsrhs.v12i4.5142 · Cited by 1
Accessibility and Inclusivity in Mental Health
Clara, L. D. (2024) · Advances in healthcare information systems and administration book series · doi:10.4018/979-8-3693-1463-0.ch001
Tatar, O., Bakouni, H., Abdel‐Baki, A., & Jutras‐Aswad, D. (2024) · Cannabis and Cannabinoid Research · doi:10.1089/can.2024.0094
Bridging the Gap: The Promise and Pitfalls of Mobile Health Apps for Depression Management
Noor, S. N. A. M., Ibrahim, U., Jamshed, S. Q., Ahmad, N., Jamil, A., Yahaya, R., & Lua, P. L. (2024) · Biomedical & Pharmacology Journal · doi:10.13005/bpj/3015
Prasad, C. G., Jotibannad, D. Y., & Srinivasan, J. (2025) · Bulletin of Integrative Psychiatry · doi:10.36219/bpi.2025.1.10
Lanigan, A. M., Callen, E. F., Filippi, M. K., Robertson, E. A., Clay, T. L., Nederveld, A., Fehnert, B., Chrones, L., Martin, M. L., McCue, M., et al. (2026) · JMIR Formative Research · doi:10.2196/71662
Abou‐Rahal, S., Tatar, O., Abdel‐Baki, A., Coronado‐Montoya, S., Côté, J., Crocker, C. E., Daneault, J.-G., Lachance‐Touchette, P., Ouellet‐Plamondon, C., Roy, M., et al. (2026) · Psychiatry Research · doi:10.1016/j.psychres.2026.117476
Metadata
- Authors
- Torous, J., Firth, J., Huckvale, K., Larsen, M. E., Cosco, T. D., Carney, R., Chan, S., Pratap, A., Yellowlees, P., Wykes, T., Keshavan, M., & Christensen, H.
- Affiliations
- Beth Israel Deaconess Medical Center (US)
- Western Sydney University (AU)
- Black Dog Institute (AU)
- Simon Fraser University (CA)
- University of Manchester (GB)
- University of California, San Francisco (US)
- University of California, Davis (US)
- Corresponding author
- Torous, John
- Chan, Steven
- Keshavan, Matcheri
- ORCID
- Venue
- Journal of Nervous & Mental Disease
- Published
- 2018-08
- Volume
- 206
- Issue
- 8
- Pages
- 662-666
- ISSN
- 0022-3018 (ISSN-L)
- 1539-736X
- OpenAlex
- W2884982858
- Cited by
- 101
- References
- 40
- Citations by year
- 2026: 5 · 2025: 11 · 2024: 10 · 2023: 13 · 2022: 15 · 2021: 20 · 2020: 13 · 2019: 11 · 2018: 3
- FWCI
- 14.82
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- The Journal of Nervous and Mental Disease (publishedVersion)
- PubMed (publishedVersion)
- Research Explorer (The University of Manchester) (publishedVersion)
- Research Portal (King's College London) (submittedVersion)
- Funders
- National Institute for Health and Care Research (NF-SI-0514-10028)
- National Institute of Mental Health (K23MH116130)
- Topics
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Health Sciences › Health Professions › Health Information Management › Health, Technology, Consumer Behavior
- Keywords
- mental health apps, mobile application, app evaluation, rating systems, charts, expert review, privacy concerns, interoperability, usability, digital mental health
- MeSH terms
- Consensus Statements as Topic, Delivery of Health Care, Humans, Mental Health, Telemedicine, Consensus, Mobile Applications
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
