A Hierarchical Framework for Evaluation and Informed Decision Making Regarding Smartphone Apps for Clinical Care
Open accessAbstract
With thousands of smartphone apps targeting mental health, it is difficult to ignore the rapidly expanding use of apps in the treatment of psychiatric disorders. Patients with psychiatric conditions are interested in mental health apps and have begun to use them. That does not mean that clinicians must support, endorse, or even adopt the use of apps, but they should be prepared to answer patients' questions about apps and facilitate shared decision making around app use. This column describes an evaluation framework designed by the American Psychiatric Association to guide informed decision making around the use of smartphone apps in clinical care.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Several exemplar frameworks exist that cover core principles for digital mental health treatment standards.
“Several exemplar frameworks exist that cover core principles for DMHT standards (52, 54, 55), which we elaborate on next.”
From Banbury forum consensus statement on the path forward for digital mental health treatment (2021) · cites this paper as [55]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Mobile Apps for Bipolar Disorder: A Systematic Review of Features and Content Quality
Nicholas, J., Larsen, M. E., Proudfoot, J., & Christensen, H. (2015) · Journal of Medical Internet Research · doi:10.2196/jmir.4581 · Cited by 438 · see citing works
Torous, J., & Roberts, L. W. (2017) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2017.0262 · Cited by 362 · see citing works
Self-citationUsability of Commercially Available Mobile Applications for Diverse Patients
Sarkar, U., Gourley, G. I., Lyles, C. R., Tieu, L., Clarity, C., Newmark, L., Singh, K., & Bates, D. W. (2016) · Journal of General Internal Medicine · doi:10.1007/s11606-016-3771-6 · Cited by 257 · see citing works
Many Mobile Health Apps Target High-Need, High-Cost Populations, But Gaps Remain
Singh, K., Drouin, K., Newmark, L. P., Lee, J., Faxvaag, A., Rozenblum, R., Pabo, E. A., Landman, A., Klinger, E., & Bates, D. W. (2016) · Health Affairs · doi:10.1377/hlthaff.2016.0578 · Cited by 201 · see citing works
Quantifying App Store Dynamics: Longitudinal Tracking of Mental Health Apps
Larsen, M. E., Nicholas, J., & Christensen, H. (2016) · JMIR mHealth and uHealth · doi:10.2196/mhealth.6020 · Cited by 177 · see citing works
Powell, A. C., Torous, J. B., Chan, S. R., Raynor, G., Shwarts, E., Shanahan, M. E., & Landman, A. (2016) · JMIR mhealth and uhealth · doi:10.2196/mhealth.5176 · Cited by 103 · see citing works
Self-citationData Security and Privacy in Apps for Dementia: An Analysis of Existing Privacy Policies
Rosenfeld, L., Torous, J., & Vahia, I. V. (2017) · The American Journal of Geriatric Psychiatry · doi:10.1016/j.jagp.2017.04.009 · Cited by 100 · see citing works
Self-citationTechnology in Mental Health: Creating New Knowledge and Inventing the Future of Services
Ben‐Zeev, D. (2016) · Psychiatric Services · doi:10.1176/appi.ps.201600520 · Cited by 27 · see citing works
Smartphones for Smarter Care? Self-Management in Schizophrenia
Sandoval, L. R., Torous, J. B., & Keshavan, M. S. (2017) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2017.16090990 · Cited by 23 · see citing works
Self-citationTorous, J. B., Powell, A. C., & Knable, M. B. (2016) · Psychiatric Annals · doi:10.3928/00485713-20160908-02 · Cited by 10 · see citing works
Self-citation
Flagged first, then by citations
Cited by
Sorted by citations
Objective user engagement with mental health apps: systematic search and panel-based usage analysis
Baumel, A., Muench, F., Edan, S., & Kane, J. M. (2019) · Journal of Medical Internet Research · doi:10.2196/14567 · Cited by 965 · see citing works
Torous, J., Nicholas, J., Larsen, M. E., Firth, J., & Christensen, H. (2018) · Evidence Based Mental Health · doi:10.1136/eb-2018-102891 · Cited by 790 · see citing works
Self-citationStade, E. C., Stirman, S. W., Ungar, L. H., Boland, C. L., Schwartz, H. A., Yaden, D. B., Sedoc, J., DeRubeis, R. J., Willer, R., & Eichstaedt, J. C. (2024) · npj Mental Health Research · doi:10.1038/s44184-024-00056-z · Cited by 391 · see citing works
“An evaluation approach for clinical LLMs that hierarchically prioritizes risk and safety, followed by feasibility, acceptability, and effectiveness, would be in line with existing recommendations for the evaluation of digital mental health smartphone apps 65 .”
MethodTowards a consensus around standards for smartphone apps and digital mental health
Torous, J., Andersson, G., Bertagnoli, A., Christensen, H., Cuijpers, P., Firth, J., Haim, A., Hsin, H., Hollis, C., Lewis, S., et al. (2019) · World Psychiatry · doi:10.1002/wps.20592 · Cited by 325 · see citing works
Self-citationHuckvale, K., Torous, J., & Larsen, M. E. (2019) · JAMA Network Open · doi:10.1001/jamanetworkopen.2019.2542 · Cited by 312 · see citing works
Self-citationUsing science to sell apps: Evaluation of mental health app store quality claims
Larsen, M. E., Huckvale, K., Nicholas, J., Torous, J., Birrell, L., Li, E., & Reda, B. (2019) · npj Digital Medicine · doi:10.1038/s41746-019-0093-1 · Cited by 334 · see citing works
Self-citationArtificial intelligence technologies and compassion in healthcare: A systematic scoping review
Morrow, E. M., Zidaru, T., Ross, F., Mason, C. L., Patel, K. D., Ream, M., & Stockley, R. (2023) · Frontiers in Psychology · doi:10.3389/fpsyg.2022.971044 · Cited by 255 · see citing works
Torous, J., Wisniewski, H., Liu, G., & Keshavan, M. (2018) · JMIR Mental Health · doi:10.2196/11715 · Cited by 201 · see citing works
Self-citationTorous, J., Larsen, M. E., Depp, C., Cosco, T. D., Barnett, I., Nock, M. K., & Firth, J. (2018) · Current Psychiatry Reports · doi:10.1007/s11920-018-0914-y · Cited by 207 · see citing works
Self-citationReviewing the data security and privacy policies of mobile apps for depression
O'Loughlin, K., Neary, M., Adkins, E. C., & Schueller, S. M. (2019) · Internet Interventions · doi:10.1016/j.invent.2018.12.001 · Cited by 179 · see citing works
Schueller, S. M., Neary, M., O'Loughlin, K., & Adkins, E. C. (2018) · Journal of Medical Internet Research · doi:10.2196/10141 · Cited by 167 · see citing works
Digital or Digitally Delivered Responses to Domestic and Intimate Partner Violence During COVID-19
Emezue, C. (2020) · JMIR Public Health and Surveillance · doi:10.2196/19831 · Cited by 199 · see citing works
Deriving a practical framework for the evaluation of health apps
Henson, P., David, G., Albright, K., & Torous, J. B. (2019) · The Lancet Digital Health · doi:10.1016/s2589-7500(19)30013-5 · Cited by 182 · see citing works
Self-citationDigital mental health apps and the therapeutic alliance: initial review
Henson, P., Wisniewski, H., Hollis, C., Keshavan, M., & Torous, J. (2019) · BJPsych Open · doi:10.1192/bjo.2018.86 · Cited by 152 · see citing works
Self-citationThe Role of Digital Navigators in Promoting Clinical Care and Technology Integration into Practice
Wisniewski, H., Gorrindo, T., Rauseo-Ricupero, N., Hilty, D. M., & Torous, J. B. (2020) · Digital Biomarkers · doi:10.1159/000510144 · Cited by 157 · see citing works
Self-citationMartinengo, L., van Galen, L. S., Lum, E., Kowalski, M., Subramaniam, M., & Car, J. (2019) · BMC Medicine · doi:10.1186/s12916-019-1461-z · Cited by 159 · see citing works
Potential and Pitfalls of Mobile Mental Health Apps in Traditional Treatment: An Umbrella Review
Koh, J., Tng, G. Y. Q., & Hartanto, A. (2022) · Journal of Personalized Medicine · doi:10.3390/jpm12091376 · Cited by 155 · see citing works
A Review of the Quality and Impact of Mobile Health Apps
Grundy, Q. (2021) · Annual Review of Public Health · doi:10.1146/annurev-publhealth-052020-103738 · Cited by 153 · see citing works
Digital navigators to implement smartphone and digital tools in care
Wisniewski, H., & Torous, J. B. (2020) · Acta Psychiatrica Scandinavica · doi:10.1111/acps.13149 · Cited by 144 · see citing works
Self-citationNicol, G., Wang, R., Graham, S., Dodd, S., & Garbutt, J. (2022) · JMIR Formative Research · doi:10.2196/40242 · Cited by 123 · see citing works
Blease, C., Locher, C., Leon-Carlyle, M., & Doraiswamy, M. (2020) · DIGITAL HEALTH · doi:10.1177/2055207620968355 · Cited by 121 · see citing works
Banbury forum consensus statement on the path forward for digital mental health treatment
Mohr, D. C., Azocar, F., Bertagnolli, A., Choudhury, T., Chrisp, P., Frank, R., Harbin, H., Histon, T., Kaysen, D., Nebeker, C., et al. (2021) · Psychiatric Services · doi:10.1176/appi.ps.202000561 · Cited by 115 · see citing works
Self-citationUnderstanding the quality, effectiveness and attributes of top-rated smartphone health apps
Wisniewski, H., Liu, G., Henson, P., Vaidyam, A., Hajratalli, N. K., Onnela, J.-P., & Torous, J. (2019) · Evidence Based Mental Health · doi:10.1136/ebmental-2018-300069 · Cited by 112 · see citing works
Self-citationNebeker, C., Bartlett Ellis, R. J., & Torous, J. (2020) · Translational Behavioral Medicine · doi:10.1093/tbm/ibz074 · Cited by 99 · see citing works
Self-citationSorkin, D. H., Janio, E. A., Eikey, E. V., Schneider, M., Davis, K., Schueller, S. M., Stadnick, N. A., Zheng, K., Neary, M., Safani, D., et al. (2021) · Journal of Medical Internet Research · doi:10.2196/26994 · Cited by 108 · see citing works
Boonstra, T. W., Nicholas, J., Wong, Q. J. J., Shaw, F., Townsend, S., & Christensen, H. M. (2018) · Journal of Medical Internet Research · doi:10.2196/10131 · Cited by 108 · see citing works
Philip, P., Dupuy, L., Auriacombe, M., Serre, F., de Sevin, É., Sauteraud, A., & Micoulaud‐Franchi, J. (2020) · npj Digital Medicine · doi:10.1038/s41746-019-0213-y · Cited by 105 · see citing works
Clinically Meaningful Use of Mental Health Apps and its Effects on Depression: Mixed Methods Study
Zhang, R., Nicholas, J., Knapp, A. A., Graham, A. K., Gray, E., Kwasny, M. J., Reddy, M., & Mohr, D. C. (2019) · Journal of Medical Internet Research · doi:10.2196/15644 · Cited by 91 · see citing works
AI-Based and Digital Mental Health Apps: Balancing Need and Risk
Hamdoun, S., Monteleone, R., Bookman, T., & Michael, K. (2023) · IEEE Technology and Society Magazine · doi:10.1109/mts.2023.3241309 · Cited by 104 · see citing works
Oversight of direct-to-consumer neurotechnologies
Wexler, A., & Reiner, P. B. (2019) · Science · doi:10.1126/science.aav0223 · Cited by 105 · see citing works
Towards the Design of Ethical Standards Related to Digital Mental Health and all Its Applications
Wykes, T., Lipschitz, J. M., & Schueller, S. M. (2019) · Current Treatment Options in Psychiatry · doi:10.1007/s40501-019-00180-0 · Cited by 84 · see citing works
Connolly, S. L., Hogan, T. P., Shimada, S. L., & Miller, C. J. (2020) · Journal of Technology in Behavioral Science · doi:10.1007/s41347-020-00165-4 · Cited by 78 · see citing works
Wiljer, D., Shi, J., Lo, B., Sanches, M., Hollenberg, E., Johnson, A., Abi-Jaoudé, A., Chaim, G., Cleverley, K., Henderson, J., et al. (2020) · Journal of Medical Internet Research · doi:10.2196/20790 · Cited by 78 · see citing works
Schultchen, D., Terhorst, Y., Holderied, T., Stach, M., Meßner, E.-M., Baumeister, H., & Sander, L. (2020) · International Journal of Behavioral Medicine · doi:10.1007/s12529-020-09944-y · Cited by 75 · see citing works
Hensher, M., Cooper, P., Dona, S. W. A., Angeles, M. R., Nguyen, D., Heynsbergh, N., Chatterton, M. L., & Peeters, A. (2021) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocab041 · Cited by 80 · see citing works
Rodriguez-Villa, E., & Torous, J. B. (2019) · BMC Medicine · doi:10.1186/s12916-019-1447-x · Cited by 71 · see citing works
Self-citationRamos, G., Hernandez-Ramos, R., Taylor, M. E., & Schueller, S. M. (2024) · Behavior Therapy · doi:10.1016/j.beth.2024.04.004 · Cited by 64 · see citing works
Smartphone, Social Media, and Mental Health App Use in an Acute Transdiagnostic Psychiatric Sample
Beard, C., Silverman, A. L., Forgeard, M., Wilmer, M. T., Torous, J., & Björgvinsson, T. (2019) · JMIR mHealth and uHealth · doi:10.2196/13364 · Cited by 58 · see citing works
Self-citationHong, R. H., Murphy, J., Michalak, E. E., Chakrabarty, T., Wang, Z., Parikh, S. V., Culpepper, L., Yatham, L. N., Lam, R. W. M., & Chen, J. (2021) · Neuropsychiatric Disease and Treatment · doi:10.2147/ndt.s283731 · Cited by 58 · see citing works
Lagan, S., Emerson, M. R., King, D. R., Matwin, S., Chan, S. R., Proctor, S., Tartaglia, J., Fortuna, K. L., Aquino, P. R., Walker, R., et al. (2021) · Psychiatric Services · doi:10.1176/appi.ps.202000663 · Cited by 57 · see citing works
Self-citationAndalibi, N., & Flood, M. K. (2021) · JMIR Mental Health · doi:10.2196/21819 · Cited by 55 · see citing works
mHealth for schizophrenia spectrum disorders management: A systematic review
Chivilgina, O., Wangmo, T., Elger, B. S., Heinrich, T. W., & Jotterand, F. (2020) · International Journal of Social Psychiatry · doi:10.1177/0020764020933287 · Cited by 55 · see citing works
Haque, M. R., & Rubya, S. (2022) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3555146 · Cited by 48 · see citing works
Lemon, C. A., Huckvale, K., Carswell, K., & Torous, J. B. (2020) · International Journal of Technology Assessment in Health Care · doi:10.1017/s0266462319003507 · Cited by 52 · see citing works
Self-citationJacob, C., Lindeque, J. P., Klein, A., Ivory, C. J., Heuss, S., & Peter, M. K. (2023) · JMIR Human Factors · doi:10.2196/45143 · Cited by 43 · see citing works
Privacy Issues in Smartphone Applications: An Analysis of Headache/Migraine Applications
Minen, M. T., Stieglitz, E. J., Sciortino, R. K., & Torous, J. B. (2018) · Headache The Journal of Head and Face Pain · doi:10.1111/head.13341 · Cited by 46 · see citing works
Self-citationRecent developments in the use of smartphone interventions for mental health
Mehrotra, S., & Tripathi, R. (2018) · Current Opinion in Psychiatry · doi:10.1097/yco.0000000000000439 · Cited by 45 · see citing works
Technology and Mental Health: State of the Art for Assessment and Treatment
Harvey, P. D., Depp, C. A., Rizzo, A., Strauss, G. P., Spelber, D., Carpenter, L. L., Kalin, N. H., Krystal, J. H., McDonald, W. M., Nemeroff, C. B., et al. (2022) · American Journal of Psychiatry · doi:10.1176/appi.ajp.21121254 · Cited by 46 · see citing works
Self-citationMobile Health App Database - A Repository for Quality Ratings of mHealth Apps
Stach, M., Kraft, R., Probst, T., Meßner, E.-M., Terhorst, Y., Baumeister, H., Schickler, M., Reichert, M., Sander, L., & Pryss, R. C. (2020) · Proceedings - IEEE Symposium on Computer-Based Medical Systems · doi:10.1109/cbms49503.2020.00087 · Cited by 45 · see citing works
Considering the therapeutic alliance in digital mental health interventions
Henson, P., Peck, P., & Torous, J. (2019) · Harvard Review of Psychiatry · doi:10.1097/hrp.0000000000000224 · Cited by 43 · see citing works
Self-citationEis, S., Solà-Morales, O., Duarte‐Díaz, A., Vidal‐Alaball, J., Perestelo‐Pérez, L., Robles, N., & Carrión, C. (2022) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph19042186 · Cited by 42 · see citing works
Therapy and E-therapy—Preparing Future Psychiatrists in the Era of Apps and Chatbots
Gratzer, D., & Goldbloom, D. S. (2020) · Academic Psychiatry · doi:10.1007/s40596-019-01170-3 · Cited by 40 · see citing works
Ortiz, A., Maslej, M. M., Husain, M. I., Daskalakis, Z. J., & Mulsant, B. H. (2021) · Journal of Affective Disorders · doi:10.1016/j.jad.2021.08.140 · Cited by 41 · see citing works
Using apps for bipolar disorder – An online survey of healthcare provider perspectives and practices
Morton, E., Torous, J., Murray, G., & Michalak, E. E. (2021) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2021.02.047 · Cited by 36 · see citing works
Self-citationKim, M., Patrick, K., Nebeker, C., Godino, J., Stein, S., Klasnja, P., Perski, O., Viglione, C., Coleman, A., & Hekler, E. B. (2024) · Journal of Medical Internet Research · doi:10.2196/49208 · Cited by 40 · see citing works
The technology specialist: a 21st century support role in clinical care
Noel, V. A., Carpenter-Song, E. A., Acquilano, S. C., Torous, J. B., & Drake, R. E. (2019) · npj Digital Medicine · doi:10.1038/s41746-019-0137-6 · Cited by 38 · see citing works
Self-citationWong, H. W., Lo, B., Shi, J., Hollenberg, E., Abi-Jaoudé, A., Johnson, A., Chaim, G., Cleverley, K., Henderson, J. L., LEVINSON, A. J., et al. (2021) · JMIR Mental Health · doi:10.2196/23447 · Cited by 38 · see citing works
Moon, S. J., Hwang, J., Hill, H. S., Kervin, R., Birtwell, K. B., Torous, J., McDougle, C. J., & Kim, J. W. (2020) · Archives of Disease in Childhood · doi:10.1136/archdischild-2019-318258 · Cited by 38 · see citing works
Self-citationHunkin, H., King, D. L., & Zajac, I. T. (2019) · Clinical Psychology Science and Practice · doi:10.1111/cpsp.12290 · Cited by 37 · see citing works
Smartphone apps for eating disorders: An overview of the marketplace and research trends
O'Leary, T., & Torous, J. B. (2022) · International Journal of Eating Disorders · doi:10.1002/eat.23690 · Cited by 36 · see citing works
Self-citationUser engagement in clinical trials of digital mental health interventions: a systematic review
Elkes, J., Cro, S., Batchelor, R., O’Connor, S., Yu, L., Bell, L., Harris, V., Sin, J., & Cornelius, V. R. (2024) · BMC Medical Research Methodology · doi:10.1186/s12874-024-02308-0 · Cited by 37 · see citing works
LaMonica, H. M., Roberts, A., Lee, G. Y., Davenport, T. A., & Hickie, I. B. (2021) · Journal of Medical Internet Research · doi:10.2196/26317 · Cited by 34 · see citing works
Real-World Technology Use Among People With Mental Illnesses: Qualitative Study
Carpenter-Song, E. A., Noel, V. A., Acquilano, S. C., & Drake, R. E. (2018) · JMIR Mental Health · doi:10.2196/10652 · Cited by 34 · see citing works
Lee, J., & Kim, J. (2019) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocz019 · Cited by 33 · see citing works
Self-citationEvaluating Generative AI Psychotherapy Chatbots Used by Youth: Cross-Sectional Study
Sobowale, K., Humphrey, D. K., & Zhao, S. Y. (2025) · JMIR Mental Health · doi:10.2196/79838 · Cited by 38 · see citing works
Carpenter-Song, E. A., Acquilano, S. C., Noel, V. A., Al‐Abdulmunem, M., Torous, J. B., & Drake, R. E. (2021) · Community Mental Health Journal · doi:10.1007/s10597-021-00798-6 · Cited by 32 · see citing works
Self-citationMatin, R., & Dinnes, J. (2021) · British Journal of Cancer · doi:10.1038/s41416-021-01302-3 · Cited by 30 · see citing works
Geirhos, A., Stephan, M., Wehrle, M., Mack, C., Meßner, E.-M., SCHMITT, A. J., Baumeister, H., Terhorst, Y., & Sander, L. (2022) · Scientific Reports · doi:10.1038/s41598-022-07544-2 · Cited by 28 · see citing works
Wearables for Neurologic Conditions
Minen, M. T., & Stieglitz, E. J. (2020) · Neurology Clinical Practice · doi:10.1212/cpj.0000000000000971 · Cited by 28 · see citing works
Assessing User Retention of a Mobile App: Survival Analysis
Lin, Y., Chen, S.-Y., Lin, P.-H., Tai, A., Pan, Y., Hsieh, C.-E., & Lin, S. (2020) · JMIR mhealth and uhealth · doi:10.2196/16309 · Cited by 28 · see citing works
Understanding Mental Health Apps for Youth: Focus Group Study With Latinx Youth
Agapie, E., Chang, K., Patrachari, S., Neary, M., & Schueller, S. M. (2022) · JMIR Formative Research · doi:10.2196/40726 · Cited by 27 · see citing works
User engagement in mobile apps for people with schizophrenia: A scoping review
de Almeida, R. S., & Marques, A. J. (2023) · Frontiers in Digital Health · doi:10.3389/fdgth.2022.1023592 · Cited by 29 · see citing works
Hartmann, R., Sander, C., Lorenz, N., Böttger, D., & Hegerl, U. (2019) · JMIR Mental Health · doi:10.2196/11671 · Cited by 28 · see citing works
Evans, K., Donelan, J. F., Rennick‐Egglestone, S., Cox, S., & Kuipers, Y. (2021) · Journal of Medical Internet Research · doi:10.2196/31831 · Cited by 30 · see citing works
Tong, H. L., Alnasser, A., Alshahrani, N. Z., Bawaked, R. A., AlAhmed, R. S., Alsukait, R. F., Rakić, S., Çetinkaya, V., Al-Hazzaa, H. M., & Alqahtani, S. A. (2024) · Journal of Medical Internet Research · doi:10.2196/53651 · Cited by 32 · see citing works
A process for reviewing mental health apps: Using the One Mind PsyberGuide Credibility Rating System
Neary, M., Bunyi, J., Palomares, K., Mohr, D. C., Powell, A. C., Ruzek, J. I., Williams, L. M., Wykes, T., & Schueller, S. M. (2021) · Digital Health · doi:10.1177/20552076211053690 · Cited by 26 · see citing works
Mobile Health Apps: Guidance for Evaluation and Implementation by Healthcare Workers
Mescher, T., Hacker, R. L., Martinez, L., Morris, C. D., Mishkind, M. C., & Garver‐Apgar, C. E. (2024) · Journal of Technology in Behavioral Science · doi:10.1007/s41347-024-00441-7 · Cited by 26 · see citing works
Melia, R., Monahan, L., Duggan, J., Bogue, J., O’Sullivan, M., Young, K. L., Chambers, D., & McInerney, S. J. (2021) · BMC Psychiatry · doi:10.1186/s12888-021-03426-5 · Cited by 25 · see citing works
Digital Health Literacy in Bipolar Disorder: International Web-Based Survey
Morton, E. E., Ho, K., Barnes, S. J., & Michalak, E. E. (2021) · JMIR Mental Health · doi:10.2196/29764 · Cited by 24 · see citing works
Digital Technology to Enhance Clinical Care of Early Psychosis
Bell, I. H., & Álvarez‐Jiménez, M. (2019) · Current Treatment Options in Psychiatry · doi:10.1007/s40501-019-00182-y · Cited by 23 · see citing works
mHealth in affective disorders: hype or hope? A focused narrative review
Hidalgo‐Mazzei, D., Llach, C.-D., & Vieta, E. (2020) · International Clinical Psychopharmacology · doi:10.1097/yic.0000000000000302 · Cited by 22 · see citing works
Ellis, R. J. B., Wright, J. A., Miller, L. M. S., Jake‐Schoffman, D. E., Hekler, E. B., Goldstein, C. M., Arigo, D., & Nebeker, C. (2021) · Journal of Medical Internet Research · doi:10.2196/25414 · Cited by 22 · see citing works
Rickard, N. S., Kurt, P., & Meade, T. (2022) · Frontiers in Digital Health · doi:10.3389/fdgth.2022.1003181 · Cited by 23 · see citing works
Digital mental health for postpartum women: perils, pitfalls, and promise
Feldman, N., & Perret, S. (2023) · npj Digital Medicine · doi:10.1038/s41746-023-00756-4 · Cited by 23 · see citing works
Gamified Mobile Applications for Improving Driving Behavior: A Systematic Mapping Study
El hafidy, A., Rachad, T., Idri, A., & Zellou, A. (2021) · Mobile Information Systems · doi:10.1155/2021/6677075 · Cited by 21 · see citing works
Review of Popularity and Quality Standards of Opioid-Related Smartphone Apps
Vilardaga, R., Fisher, T., Palenski, P. E., Kumaresan, V., Mannelli, P., Sweitzer, M. M., McClernon, F. J., Engelhard, M., Sabo, P. L., & Garrison, K. A. (2020) · Current Addiction Reports · doi:10.1007/s40429-020-00344-6 · Cited by 19 · see citing works
Digital Phenotyping for the Busy Psychiatrist: Clinical Implications and Relevance
Torous, J. B., Gershon, A., Hays, R., Onnela, J.-P. “., & Baker, J. T. (2019) · Psychiatric Annals · doi:10.3928/00485713-20190417-01 · Cited by 16 · see citing works
Self-citationClinician's Guide to Evaluating and Developing eHealth Interventions for Mental Health
Ondersma, S. J., & Walters, S. T. (2020) · Psychiatric Research and Clinical Practice · doi:10.1176/appi.prcp.2020.20190036 · Cited by 16 · see citing works
Don’t judge a book or health app by its cover: User ratings and downloads are not linked to quality
Hyzy, M., Bond, R., Mulvenna, M. D., Bai, L., Frey, A.-L., Carracedo, J. M., Daly, R., & Leigh, S. (2024) · PLoS ONE · doi:10.1371/journal.pone.0298977 · Cited by 16 · see citing works
Technology Evaluation and Assessment Criteria for Health Apps (TEACH-Apps): Pilot Study
Camacho, E., Hoffman, L., Lagan, S., Rodriguez-Villa, E., Rauseo-Ricupero, N., Wisniewski, H., Henson, P., & Torous, J. B. (2020) · Journal of Medical Internet Research · doi:10.2196/18346 · Cited by 16 · see citing works
Self-citationSobowale, K., & Humphrey, D. K. (2025) · JMIR Formative Research · doi:10.2196/65605 · Cited by 15 · see citing works
Guidelines to Establish an Equitable Mobile Health Ecosystem
Fortuna, K. L., Kadakia, A., Cosco, T. D., Rotondi, A. J., Nicholson, J., Mois, G., Myers, A. L., Hamilton, J., Brewer, L. C., Collins-Pisano, C., et al. (2022) · Psychiatric Services · doi:10.1176/appi.ps.202200011 · Cited by 14 · see citing works
Trusting the bot: Addressing the ethical challenges of consumer digital mental health therapy
Martinez‐Martin, N. (2020) · Developments in neuroethics and bioethics · doi:10.1016/bs.dnb.2020.03.003 · Cited by 14 · see citing works
Kemp, J., Chorney, J. M. L., Kassam, I., MacDonald, J., MacDonald, T., Wozney, L., & Strudwick, G. (2021) · Journal of Medical Internet Research · doi:10.2196/30491 · Cited by 14 · see citing works
Greenberger, H. M., & Pande, R. L. (2021) · American Journal of Health Promotion · doi:10.1177/0890117120983982d · Cited by 15 · see citing works
Minen, M. T., Gopal, A., Sahyoun, G., Stieglitz, E. J., & Torous, J. B. (2020) · Journal of Neuropsychiatry · doi:10.1176/appi.neuropsych.19120353 · Cited by 13 · see citing works
Self-citationDigital Health Around Clinical High Risk and First-Episode Psychosis
Henson, P., Wisniewski, H., Stromeyer, C., IV, & Torous, J. B. (2020) · Current Psychiatry Reports · doi:10.1007/s11920-020-01184-x · Cited by 12 · see citing works
Self-citationExpanding, improving, and understanding behaviour research and therapy through digital mental health
Cohen, Z. D., & Schueller, S. M. (2023) · Behaviour Research and Therapy · doi:10.1016/j.brat.2023.104358 · Cited by 10 · see citing works
Real-Time Monitoring: A Key Element in Personalized Health and Precision Health
Zulueta, J., Leow, A., & Ajilore, O. (2020) · FOCUS The Journal of Lifelong Learning in Psychiatry · doi:10.1176/appi.focus.20190042 · Cited by 11 · see citing works
Benefits and Limitations of Implementing Mental Health Apps Among the Working Population
Jones, N. M., Johnson, M., Sathappan, A. V., & Torous, J. B. (2021) · Psychiatric Annals · doi:10.3928/00485713-20210112-01 · Cited by 11 · see citing works
Self-citation
- Authors
- Torous, J. B., Chan, S. R., Gipson, S. Y.-M. T., Kim, J. W., Nguyen, T.-Q., Luo, J., & Wang, P.
- Affiliations
- University of California, Riverside (US)
- ORCID
- Venue
- Psychiatric Services
- Published
- 2018-05-01
- Volume
- 69
- Issue
- 5
- Pages
- 498-500
- ISSN
- 0022-1597 (ISSN-L)
- 1075-2730
- 1557-9700
- OpenAlex
- W2792686719
- Cited by
- 184
- References
- 10
- Citations by year
- 2026: 12 · 2025: 16 · 2024: 17 · 2023: 21 · 2022: 19 · 2021: 33 · 2020: 27 · 2019: 27 · 2018: 12
- FWCI
- 31.21
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Psychiatric Services (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Health Sciences › Health Professions › General Health Professions › Mental Health and Patient Involvement
- Keywords
- mobile application, mental health apps, mental illness, informed decision-making, shared decision-making, clinician guidance, digital mental health
- MeSH terms
- Smartphone, Mental Disorders, Decision Making, Evaluation Studies as Topic, Humans, Mental Health Services, Mobile Applications
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
