The DOI matches its Crossref record; 39 of the 40 references it cites were found in a registry or an index.
Digital Mental Health and COVID-19: Using Technology Today to Accelerate the Curve on Access and Quality Tomorrow
Open accessAbstract
As interest in and use of telehealth during the COVID-19 global pandemic increase, the potential of digital health to increase access and quality of mental health is becoming clear. Although the world today must “flatten the curve” of spread of the virus, we argue that now is the time to “accelerate and bend the curve” on digital health. Increased investments in digital health today will yield unprecedented access to high-quality mental health care. Focusing on personal experiences and projects from our diverse authorship team, we share selected examples of digital health innovations while acknowledging that no single piece can discuss all the impressive global efforts past and present. Exploring the success of telehealth during the present crisis and how technologies like apps can soon play a larger role, we discuss the need for workforce training, high-quality evidence, and digital equity among other factors critical for bending the curve further.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The implementation of telemental health across service systems is only likely to be beneficial if there are clear plans to prevent patients with limited access to technology from being at a disadvantage [279,280], whether by supporting them to engage with remote care or ensuring that equivalent care is available face-to-face.”
From Implementation of Telemental Health Services Before COVID-19: Rapid Umbrella Review of Systematic Reviews (2021) · cites this paper as [280]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The use of artificial intelligence (AI), which can emulate human intelligence and enhance clinical results, has grown in healthcare decision-making due to the digitalization effects and the COVID-19 pandemic.”
From Artificial Intelligence and Decision-Making in Healthcare: A Thematic Analysis of a Systematic Review of Reviews (2024) · cites this paper as [1]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Fully automated mental health smartphone apps show strong promise in increasing access to psychological support.”
From Digital Therapeutic Alliance With Fully Automated Mental Health Smartphone Apps: A Narrative Review (2022) · cites this paper as [15]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“In fact, there is a growing need for guided online therapy, particularly catering to populations in regions where access to treatment facilities for mental health care is limited [2,8].”
From Efficacy of a six-week-long therapist-guided online therapy versus self-help internet-based therapy for COVID-19–induced anxiety and depression: Open-label, pragmatic, randomized controlled trial (2021) · cites this paper as [8]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Data suggests the mental health field is now the largest user of telehealth [8]”
From Technology enabled clinical care (TECC): Protocol for a prospective longitudinal cohort study of smartphone-augmented mental health treatment (2021) · cites this paper as [8]
Experimental — accuracy not yet measured
1 more claim about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Firth, J., Siddiqi, N., Koyanagi, A., Siskind, D., Rosenbaum, S., Galletly, C., Allan, S., Caneo, C., Carney, R., Carvalho, A. F., et al. (2019) · The Lancet Psychiatry · doi:10.1016/s2215-0366(19)30132-4 · Cited by 1,531
Self-citationThe association between adolescent well-being and digital technology use
Orben, A., & Przybylski, A. K. (2019) · Nature Human Behaviour · doi:10.1038/s41562-018-0506-1 · Cited by 1,500 · cited 1×
“…periods of isolation/prolonged home time, due to the adverse psychological effects of reduced exercise [29] or prolonged sedentary behavior [30], and the ongoing debate about certain types of screen time and social media usage (with quality of online interactions mattering more than time) [31].”
BackgroundFirth, J., Torous, J., Nicholas, J., Carney, R., Pratap, A., Rosenbaum, S., & Sarris, J. (2017) · World Psychiatry · doi:10.1002/wps.20472 · Cited by 1,097 · cited 1×
“Although companies will boast about positive outcomes from randomized controlled trials [19], results from higher-quality studies with valid comparisons groups, proper statistical analysis, and low risk of bias do not tell the same story [18,20].”
BackgroundSelf-citationObjective user engagement with mental health apps: systematic search and panel-based usage analysis
Baumel, A., Muench, F., Edan, S., & Kane, J. M. (2019) · Journal of Medical Internet Research · doi:10.2196/14567 · Cited by 965 · cited 1×
“Picking from those different apps is challenging as many offer little protection of user data, make exaggerated claims, may be ineffective, and often are quickly abandoned because of usability issues [18,23,24].”
BackgroundThe COVID-19 pandemic: the ‘black swan’for mental health care and a turning point for e-health
Wind, T. R., Rijkeboer, M., Andersson, G., & Riper, H. (2020) · Internet Interventions · doi:10.1016/j.invent.2020.100317 · Cited by 782 · cited 1×
“Harnessing this surge in interest, enthusiasm, and acceptance has immediately been recognized as an opportunity for the field [1].”
BackgroundMental health outcomes in times of economic recession: a systematic literature review
Frasquilho, D., Matos, M. G., Salonna, F., Guerreiro, D., Storti, C. C., Gaspar, T., & Caldas-de-Almeida, J. M. (2015) · BMC Public Health · doi:10.1186/s12889-016-2720-y · Cited by 639 · cited 1×
“In times of economic recession, there is often high prevalence of mental health disorders, misuse of substances (or substance use disorder), and deaths from suicide [33].”
BackgroundTorous, J., Lipschitz, J., Ng, M., & Firth, J. (2020) · Journal of Affective Disorders · doi:10.1016/j.jad.2019.11.167 · Cited by 546 · cited 1×
“However, issues of real-world engagement with these programs [12] and high risk of bias in many studies [13] warrant caution in ensuring that plans for encouraging and maintaining meaningful engagement are in place before purchasing these programs or services.”
BackgroundSelf-citationStandalone smartphone apps for mental health—a systematic review and meta-analysis
Weisel, K. K., Fuhrmann, L. M., Berking, M., Baumeister, H., Cuijpers, P., & Ebert, D. D. (2019) · npj Digital Medicine · doi:10.1038/s41746-019-0188-8 · Cited by 447 · cited 5×
“Current evidence for apps for behavior change remains limited [17], and self-help for mental health remains equally limited [18].”
BackgroundMethodInfluentialGilbody, S., Littlewood, E., Hewitt, C., Brierley, G., Tharmanathan, P., Araya, R., Barkham, M., Bower, P., Cooper, C., Gask, L., et al. (2015) · BMJ · doi:10.1136/bmj.h5627 · Cited by 409 · cited 1×
“However, issues of real-world engagement with these programs [12] and high risk of bias in many studies [13] warrant caution in ensuring that plans for encouraging and maintaining meaningful engagement are in place before purchasing these programs or services.”
BackgroundMilne-Ives, M., Lam, C., De Cock, C., Van Velthoven, M. H., & Meinert, E. (2020) · JMIR mhealth and uhealth · doi:10.2196/17046 · Cited by 393 · cited 1×
“Current evidence for apps for behavior change remains limited [17], and self-help for mental health remains equally limited [18].”
BackgroundBirckhead, B., Khalil, C., Liu, X., Conovitz, S., Rizzo, A., Danovitch, I., Bullock, K., & Spiegel, B. (2019) · JMIR Mental Health · doi:10.2196/11973 · Cited by 372
Mohr, D. C., Weingardt, K. R., Reddy, M., & Schueller, S. M. (2017) · Psychiatric Services · doi:10.1176/appi.ps.201600541 · Cited by 365 · cited 2×
“and lack of attention here can lead to low uptake and support by both patients and staff [14,15].”
BackgroundSMITH, K. J., & VICTOR, C. (2019) · Ageing and Society · doi:10.1017/s0144686x18000132 · Cited by 337 · cited 1×
“…health may be particularly important during periods of isolation/prolonged home time, due to the adverse psychological effects of reduced exercise [29] or prolonged sedentary behavior [30], and the ongoing debate about certain types of screen time and social media usage (with quality of online…”
BackgroundUsing science to sell apps: Evaluation of mental health app store quality claims
Larsen, M. E., Huckvale, K., Nicholas, J., Torous, J., Birrell, L., Li, E., & Reda, B. (2019) · npj Digital Medicine · doi:10.1038/s41746-019-0093-1 · Cited by 334 · cited 1×
“Picking from those different apps is challenging as many offer little protection of user data, make exaggerated claims, may be ineffective, and often are quickly abandoned because of usability issues [18,23,24].”
BackgroundSelf-citationTelemedicine Training in Undergraduate Medical Education: Mixed-Methods Review
Waseh, S., & Dicker, A. P. (2019) · JMIR Medical Education · doi:10.2196/12515 · Cited by 291 · cited 1×
“Our personal experience in teaching psychiatry residents about mobile mental health in formal didactics has been positive, and there are already many examples of teaching telehealth [36,37].”
Lunde, P., Nilsson, B. B., Bergland, A., Kværner, K. J., & Bye, A. (2018) · Journal of Medical Internet Research · doi:10.2196/jmir.9751 · Cited by 214 · cited 1×
“Nonetheless, digital technologies and smartphone apps may also present a novel platform for the remote delivery of lifestyle interventions [32].”
BackgroundGraham, S. A., Lee, E. E., Jeste, D. V., Van Patten, R., Twamley, E. W., Nebeker, C., Yamada, Y., Kim, H.-C., & Depp, C. A. (2020) · Psychiatry Research · doi:10.1016/j.psychres.2019.112732 · Cited by 211 · cited 1×
“In this perspective piece, we draw largely from our team’s experience with digital health and recognize the impressive global innovation and research in this space that cannot be captured in any single piece [2-9].”
BackgroundTorous, J., Wisniewski, H., Bird, B., Carpenter, E., David, G., Elejalde, E., Fulford, D., Guimond, S., Hays, R., Henson, P., et al. (2019) · Journal of Technology in Behavioral Science · doi:10.1007/s41347-019-00095-w · Cited by 202 · cited 1×
“Our team is fortunate in that we have created our own app tool (freely available and open source) [22] that we often utilize in research and care, but we realize that different apps are often needed for different situations.”
BackgroundSelf-citationDeriving a practical framework for the evaluation of health apps
Henson, P., David, G., Albright, K., & Torous, J. (2019) · The Lancet Digital Health · doi:10.1016/s2589-7500(19)30013-5 · Cited by 182
Self-citationBy the numbers: ratings and utilization of behavioral health mobile applications
Carlo, A. D., Hosseini Ghomi, R., Renn, B. N., & Areán, P. A. (2019) · npj Digital Medicine · doi:10.1038/s41746-019-0129-6 · Cited by 164 · cited 1×
“Thus, relying on static lists of “top apps” or others’scoring systems for selecting apps is often unhelpful and even dangerous, given how out of date these recommendations are [26].”
BackgroundMatcham, F., Pietro, C. B. D. S., Bulgari, V., de Girolamo, G., Dobson, R., Eriksson, H., Folarin, A., Haro, J. M., Kerz, M., Lamers, F., et al. (2019) · BMC Psychiatry · doi:10.1186/s12888-019-2049-z · Cited by 154 · cited 1×
“In this perspective piece, we draw largely from our team’s experience with digital health and recognize the impressive global innovation and research in this space that cannot be captured in any single piece [2-9].”
BackgroundDigital navigators to implement smartphone and digital tools in care
Wisniewski, H., & Torous, J. B. (2020) · Acta Psychiatrica Scandinavica · doi:10.1111/acps.13149 · Cited by 152 · cited 2×
“Training new care team members around digital health, a role we have termed a digital navigator [38], offers opportunities to easily liaison between digital and classical care.”
BackgroundSelf-citationVancampfort, D., Stubbs, B., Firth, J., Damme, T. V., & Koyanagi, A. (2018) · International Journal of Behavioral Nutrition and Physical Activity · doi:10.1186/s12966-018-0708-y · Cited by 140 · cited 1×
“…during periods of isolation/prolonged home time, due to the adverse psychological effects of reduced exercise [29] or prolonged sedentary behavior [30], and the ongoing debate about certain types of screen time and social media usage (with quality of online interactions mattering more than time)…”
BackgroundSelf-citationHilty, D. M., Chan, S. R., Torous, J. B., Luo, J. S., & BOLAND, R. J. (2019) · JMIR mhealth and uhealth · doi:10.2196/12229 · Cited by 116 · cited 1×
“Frameworks for competencies already exist [34,35], and a few have already been implemented.”
BackgroundSelf-citationTelepsychiatry and Health Technologies: A Guide for Mental Health Professionals
(2018) · American Psychiatric Association Publishing eBooks · doi:10.1176/appi.books.9781615378906 · Cited by 102 · cited 1×
“It was made possible because of the strong and clear evidence base for the efficacy of telehealth and decades of high-quality research [11].”
BackgroundTorous, J., Firth, J., Huckvale, K., Larsen, M. E., Cosco, T. D., Carney, R., Chan, S., Pratap, A., Yellowlees, P., Wykes, T., et al. (2018) · Journal of Nervous & Mental Disease · doi:10.1097/nmd.0000000000000864 · Cited by 101 · cited 1×
“Thus, careful attention is warranted when recommending such apps to patients [25].”
BackgroundSelf-citationNebeker, C., Bartlett Ellis, R. J., & Torous, J. (2020) · Translational Behavioral Medicine · doi:10.1093/tbm/ibz074 · Cited by 99 · cited 1×
“A focus on equity and ethics will ensure digital health truly increases access to care [40].”
BackgroundSelf-citationHilty, D. M., Maheu, M. M., Drude, K. P., & Hertlein, K. M. (2018) · Academic Psychiatry · doi:10.1007/s40596-018-0992-5 · Cited by 98 · cited 1×
“Frameworks for competencies already exist [34,35], and a few have already been implemented.”
BackgroundMuke, S. S., Shrivastava, R. D., Mitchell, L., Khan, A., Murhar, V., Tugnawat, D., Shidhaye, R., Patel, V., & Naslund, J. A. (2019) · Asian Journal of Psychiatry · doi:10.1016/j.ajp.2019.09.006 · Cited by 98 · cited 1×
“In this perspective piece, we draw largely from our team’s experience with digital health and recognize the impressive global innovation and research in this space that cannot be captured in any single piece [2-9].”
BackgroundHOFFMAN, L., WISNIEWSKI, H., HAYS, R., HENSON, P., VAIDYAM, A., HENDEL, V., KESHAVAN, M., & TOROUS, J. (2020) · Journal of Psychiatric Practice · doi:10.1097/pra.0000000000000450 · Cited by 97 · cited 1×
“However, many people do not, and offering training and skills building is critical to ensure digital health actually offers help to those who need it the most [39].”
BackgroundSelf-citationLattie, E. G., Nicholas, J., Knapp, A. A., Skerl, J. J., Kaiser, S. M., & Mohr, D. C. (2019) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-019-00979-2 · Cited by 93 · cited 1×
“Workflow integration issues are also critical to consider when beginning to utilize these types of programs in care settings, and lack of attention here can lead to low uptake and support by both patients and staff [14,15].”
BackgroundTelepsychiatry in Graduate Medical Education: A Narrative Review
Sunderji, N., Crawford, A. S., & Jovanovic, M. C. (2014) · Academic Psychiatry · doi:10.1007/s40596-014-0176-x · Cited by 90 · cited 1×
“Our personal experience in teaching psychiatry residents about mobile mental health in formal didactics has been positive, and there are already many examples of teaching telehealth [36,37].”
BackgroundWisniewski, H., Henson, P., & Torous, J. B. (2019) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2019.00652 · Cited by 58 · cited 1×
“Our team in Boston uses mobile apps to better understand the unique lived experience of each patient [21] in both our research as well as our digital clinic.”
BackgroundSelf-citationSander, L., Gerhardinger, K., Bailey, E., Robinson, J., Lin, J., Cuijpers, P. J., & Mühlmann, C. (2019) · Journal of Affective Disorders · doi:10.1016/j.jad.2019.11.045 · Cited by 44 · cited 1×
“In this perspective piece, we draw largely from our team’s experience with digital health and recognize the impressive global innovation and research in this space that cannot be captured in any single piece [2-9].”
BackgroundDichotomies in the Development and Implementation of Digital Mental Health Tools
Torous, J. B., & Haim, A. (2018) · Psychiatric Services · doi:10.1176/appi.ps.201800193 · Cited by 42 · cited 1×
“Although companies will boast about positive outcomes from randomized controlled trials [19], results from higher-quality studies with valid comparisons groups, proper statistical analysis, and low risk of bias do not tell the same story [18,20].”
BackgroundSelf-citationA technology-assisted life of recovery from psychosis
Ben‐Zeev, D., Buck, B., Kopelovich, S. L., & Meller, S. (2019) · Schizophrenia · doi:10.1038/s41537-019-0083-y · Cited by 42 · cited 1×
“In this perspective piece, we draw largely from our team’s experience with digital health and recognize the impressive global innovation and research in this space that cannot be captured in any single piece [2-9].”
BackgroundLipschitz, J. M., Hogan, T. P., Bauer, M. S., & Mohr, D. C. (2019) · The Journal of Clinical Psychiatry · doi:10.4088/jcp.18com12659 · Cited by 40
Wong, Q. J. J., Werner‐Seidler, A., Torok, M. H., van Spijker, B. A. J., Calear, A. L., & Christensen, H. M. (2019) · JMIR Mental Health · doi:10.2196/11521 · Cited by 8
Evaluation of a temporal causal model for predicting the mood of clients in an online therapy
Becker, D., Bremer, V., Funk, B., Hoogendoorn, M., Rocha, A., & Riper, H. M. (2020) · Evidence-Based Mental Health · doi:10.1136/ebmental-2019-300135 · Cited by 2
Cited by
Effects of COVID-19 on College Students’ Mental Health in the United States: Interview Survey Study
Son, C., Hegde, S., Smith, A., Wang, X., & Sasangohar, F. (2020) · Journal of Medical Internet Research · doi:10.2196/21279 · Cited by 2,822
How mental health care should change as a consequence of the COVID-19 pandemic
Moreno, C., Wykes, T., Galderisi, S., Nordentoft, M., Crossley, N., Jones, N., Cannon, M., Correll, C. U., Byrne, L., Carr, S., et al. (2020) · The Lancet Psychiatry · doi:10.1016/s2215-0366(20)30307-2 · Cited by 1,840
Applications of digital technology in COVID-19 pandemic planning and response
Whitelaw, S., Mamas, M. A., Topol, E., & Van Spall, H. G. C. (2020) · The Lancet Digital Health · doi:10.1016/s2589-7500(20)30142-4 · Cited by 992
Crawford, A., & Serhal, E. (2020) · Journal of Medical Internet Research · doi:10.2196/19361 · Cited by 630
“In the current response to the COVID-19 pandemic, digital health has been rightly heralded as an innovative health solution that can ensure ongoing access to clinical care and allow public health measures that stem rapid viral transmission and spread [1,2].”
BackgroundGolinelli, D., Boetto, E., Carullo, G., Nuzzolese, A. G., Landini, M. P., & Fantini, M. P. (2020) · Journal of Medical Internet Research · doi:10.2196/22280 · Cited by 574
“…Health care providers Jin et al [23] Global Innovating Clients/patients, health care providers, health systems/resource managers Torous et al [24] Global Complementing Health care providers Wang et al [25] Global Complementing Health care providers Zheng et al [26] Global Supporting Health…”
Background
Metadata
- Authors
- Torous, J., Jän Myrick, K., Rauseo-Ricupero, N., & Firth, J.
- Affiliations
- Beth Israel Deaconess Medical Center (US)
- University of Manchester (GB)
- Corresponding author
- Torous, John
- Venue
- JMIR Mental Health
- Publisher
- JMIR Publications Inc.
- Published
- 2020-03-26
- Volume
- 7
- Issue
- 3
- Pages
- e18848
- ISSN
- 2368-7959 (ISSN-L)
- PMC
- PMC7101061
- OpenAlex
- W3013038708
- Cited by
- 946
- References
- 40
- Citations by year
- 2026: 120 · 2025: 121 · 2024: 92 · 2023: 107 · 2022: 168 · 2021: 213 · 2020: 125
- FWCI
- 138.50
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- JMIR Mental Health (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Research Explorer (The University of Manchester) (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- National Institute of Mental Health (K23MH116130)
- Topics
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Telemedicine and Telehealth Implementation
- Social Sciences › Psychology › Clinical Psychology › COVID-19 and Mental Health
- Keywords
- digital mental health, telemedicine, COVID-19 pandemic, access to mental health care, mental health care quality, digital health innovation, mental health apps, mental health workforce training, digital equity
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.