Digital health technology for use in patients with serious mental illness: a systematic review of the literature
Open accessThe DOI matches its Crossref record; 55 of the 55 references it cites were found in a registry or an index.
Abstract
BACKGROUND: As the capabilities and reach of technology have expanded, there is an accompanying proliferation of digital technologies developed for use in the care of patients with mental illness. The objective of this review was to systematically search published literature to identify currently available health technologies and their intended uses for patients with serious mental illness. MATERIALS AND METHODS: The Medline, Embase, and BIOSIS Previews electronic databases were searched to identify peer-reviewed English language articles that reported the use of digital, mobile, and other advanced technology in patients with schizophrenia/schizoaffective disorder, bipolar disorder, and major depressive disorder. Eligible studies were systematically reviewed based on Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. RESULTS: Eighteen studies that met the inclusion criteria were identified. Digital health technologies (DHTs) assessed in the selected studies included mobile applications (apps), digital medicine, digital personal health records, and an electronic pill container. Smartphone apps accounted for the largest share of DHTs. The intended uses of DHTs could be broadly classified as monitoring to gain a better understanding of illness, clinical assessment, and intervention. Overall, studies indicated high usability/feasibility and efficacy/effectiveness, with several reporting validity against established clinical scales. Users were generally engaged with the DHT, and mobile assessments were deemed helpful in monitoring disease symptoms. CONCLUSION: Rapidly proliferating digital technologies seem to be feasible for short-term use in patients with serious mental illness; nevertheless, long-term effectiveness data from naturalistic studies will help demonstrate their usefulness and facilitate their adoption and integration into the mental health-care system.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The findings of 6 recent systematic reviews of digital interventions for serious mental illnesses demonstrate that these are feasible and acceptable, with preliminary indications that these may be effective for symptoms and cognitive and social outcomes [24-29].”
From The therapeutic alliance in digital mental health interventions for serious mental illnesses: narrative review (2020) · cites this paper as [24]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gotzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · BMJ · doi:10.1136/bmj.b2700 · Cited by 17,648
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · Annals of Internal Medicine · doi:10.7326/0003-4819-151-4-200908180-00136 · Cited by 10,349
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · Italian Journal of Public Health · doi:10.2427/5768 · Cited by 3,374
Eysenbach, G., & CONSORT-EHEALTH Group (2011) · Journal of Medical Internet Research · doi:10.2196/jmir.1923 · Cited by 1,863 · cited 1×
“CONSORT-eHealth (Consolidated Standards of Reporting Trials of electronic and mHealth applications and online telehealth) is another tool recommended for use in reporting web-based and mHealth interventions.(51) Bakker et al provided evidence-based recommendations for developing smartphone apps for mental health.”
Andrews, G., Cuijpers, P., Craske, M. G., McEvoy, P., & Titov, N. (2010) · PLoS ONE · doi:10.1371/journal.pone.0013196 · Cited by 1,311
Whiteford, H. A., Ferrari, A. J., Degenhardt, L., Feigin, V., & Vos, T. (2015) · PLOS ONE · doi:10.1371/journal.pone.0116820 · Cited by 1,175
Smartphones for smarter delivery of mental health programs: A systematic review
Donker, T., Petrie, K., Proudfoot, J., Clarke, J., Birch, M.-R., & Christensen, H. (2013) · Journal of Medical Internet Research · doi:10.2196/jmir.2791 · Cited by 1,136 · cited 1×
“For example, Donker et al systematically reviewed studies of mental health apps for mobile devices, noting that there was insufficient scientific evidence to support their efficacy.(22) The usability of mental health apps was perceived to be moderate–high, but evidence for their sustained use was not considered adequa…”
Mental Health Smartphone Apps: Review and Evidence-Based Recommendations for Future Developments
Bakker, D., Kazantzis, N., Rickwood, D., & Rickard, N. (2016) · JMIR Mental Health · doi:10.2196/mental.4984 · Cited by 886
Hollis, C., Falconer, C. J., Martin, J. L., Whittington, C., Stockton, S., Glazebrook, C., & Davies, E. B. (2017) · Journal of Child Psychology and Psychiatry · doi:10.1111/jcpp.12663 · Cited by 846 · cited 1×
“In a systematic review and meta-analysis of digital health interventions for children and young people with mental health disorders, Hollis et al noted a clinical benefit, particularly for computerized CBT for depression and anxiety.(49) However, the authors did not find quality evidence to support the clinical benefi…”
mHealth for mental health: Integrating smartphone technology in behavioral healthcare.
Luxton, D. D., McCann, R. A., Bush, N. E., Mishkind, M. C., & Reger, G. M. (2011) · Professional Psychology: Research and Practice · doi:10.1037/a0024485 · Cited by 809 · cited 1×
“19–21 DHTs have created opportunities to develop a better understanding of MI and potentially improve the outcomes for patients with chronic mental health conditions in a variety of ways.”
Agarwal, S., LeFevre, A. E., Lee, J., L’Engle, K., Mehl, G., Sinha, C., & Labrique, A. (2016) · BMJ · doi:10.1136/bmj.i1174 · Cited by 639 · cited 1×
“The World Health Organization mHealth Technical Evidence Review Group recently developed a checklist of items for developing and reporting mHealth interventions.(50) CONSORT-eHealth (Consolidated Standards of Reporting Trials of electronic and mHealth applications and online telehealth) is another tool recommended for…”
Feasibility, Acceptability, and Preliminary Efficacy of a Smartphone Intervention for Schizophrenia
Ben-Zeev, D., Brenner, C. J., Begale, M., Duffecy, J., Mohr, D. C., & Mueser, K. T. (2014) · Schizophrenia Bulletin · doi:10.1093/schbul/sbu033 · Cited by 493
mHealth: A Mechanism to Deliver More Accessible, More Effective Mental Health Care
Price, M., Yuen, E. K., Goetter, E. M., Herbert, J. D., Forman, E. M., Acierno, R., & Ruggiero, K. J. (2014) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.1855 · Cited by 488
Cunningham, P. J. (2009) · Health Affairs · doi:10.1377/hlthaff.28.3.w490 · Cited by 420
Bidmon, S., & Terlutter, R. (2015) · Journal of Medical Internet Research · doi:10.2196/jmir.4127 · Cited by 389
Mental health: there’s an app for that
Anthes, E. (2016) · Nature · doi:10.1038/532020a · Cited by 333
CBT for depression: a pilot RCT comparing mobile phone vs. computer
Watts, S., Mackenzie, A., Thomas, C., Griskaitis, A., Mewton, L., Williams, A., & Andrews, G. (2013) · BMC Psychiatry · doi:10.1186/1471-244x-13-49 · Cited by 329
A Systematic Review of Cognitive Behavioral Therapy and Behavioral Activation Apps for Depression
Huguet, A., Rao, S., McGrath, P. J., Wozney, L., Wheaton, M., Conrod, J., & Rozario, S. (2016) · PLOS ONE · doi:10.1371/journal.pone.0154248 · Cited by 328 · cited 1×
“Huguet et al reviewed available CBT and behavioral activation apps for depression, and concluded that there was not enough evidence available to support their use.(23) Firth and Torous reviewed smartphone apps for schizophrenia.”
Ben-Zeev, D., Kaiser, S. M., Brenner, C. J., Begale, M., Duffecy, J., & Mohr, D. C. (2013) · Psychiatric Rehabilitation Journal · doi:10.1037/prj0000019 · Cited by 304
Access And Cost Barriers To Mental Health Care, By Insurance Status, 1999–2010
Rowan, K., McAlpine, D. D., & Blewett, L. A. (2013) · Health Affairs · doi:10.1377/hlthaff.2013.0133 · Cited by 277
The Effectiveness of Prompts to Promote Engagement With Digital Interventions: A Systematic Review
Alkhaldi, G., Hamilton, F. L., Lau, R., Webster, R., Michie, S., & Murray, E. (2016) · Journal of Medical Internet Research · doi:10.2196/jmir.4790 · Cited by 273 · cited 1×
“In a published systematic review, various means of prompts were shown to be helpful in promoting engagement with digital technologies, 45 thus suggesting that this might be a useful feature to incorporate into the functionality of a DHT.”
Ly, K. H., Trüschel, A., Jarl, L., Magnusson, S., Windahl, T., Johansson, R., Carlbring, P., & Andersson, G. (2014) · BMJ Open · doi:10.1136/bmjopen-2013-003440 · Cited by 269 · cited 5×
“Two studies demonstrated the efficacy of delivering psychotherapy via mobile apps.(28,30) However, a previously published systematic literature review found little evidence to support the efficacy of CBT apps,(23) although a computerized version was found to be effective for anxiety and depression.”
InfluentialSmartphone Apps for Schizophrenia: A Systematic Review
Firth, J., & Torous, J. (2015) · JMIR mHealth and uHealth · doi:10.2196/mhealth.4930 · Cited by 268 · cited 2×
“Although based on a small number of studies, the preliminary results indicated high rates of retention and adherence.(24) While demonstrating the usability of DHTs, these reviews have emphasized the urgent need for data demonstrating efficacy.”
Mobile Interventions for Severe Mental Illness: Design and Preliminary Data From Three Approaches
Depp, C. A., Mausbach, B., Granholm, E., Cardenas, V., Ben-Zeev, D., Patterson, T. L., Lebowitz, B. D., & Jeste, D. V. (2010) · Journal of Nervous & Mental Disease · doi:10.1097/nmd.0b013e3181f49ea3 · Cited by 265 · cited 1×
“Developing DHTs that can be used by people with SMI can be particularly challenging because of illness-related factors, such as cognitive impairments,(9) and thus requires specific design considerations.(10,11) Nevertheless, results of several surveys indicate that patients with SMI are receptive to the use of technol…”
Mobile technologies among people with serious mental illness: Opportunities for future services
Ben-Zeev, D., Davis, K. E., Kaiser, S., Krzsos, I., & Drake, R. E. (2013) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-012-0424-x · Cited by 249 · cited 1×
“12–15 There are several examples of DHTs that have been developed for and used in psychiatry, ranging from computerized cognitive behavior therapy (CBT) 16 to symptom-monitoring apps 17 to ingestible sensors.”
Marcano Belisario, J. S., Jamsek, J., Huckvale, K., O'Donoghue, J., Morrison, C. P., & Car, J. (2015) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.mr000042.pub2 · Cited by 211
Measurement of psychiatric treatment adherence
Sajatovic, M., Velligan, D. I., Weiden, P. J., Valenstein, M. M., & Ogedegbe, G. G. (2009) · Journal of Psychosomatic Research · doi:10.1016/j.jpsychores.2009.05.007 · Cited by 196
Using Smartphones to Monitor Bipolar Disorder Symptoms: A Pilot Study
Beiwinkel, T., Kindermann, S., Maier, A., Kerl, C., Moock, J., Barbian, G., & Rössler, W. (2016) · JMIR Mental Health · doi:10.2196/mental.4560 · Cited by 191
Palmier-Claus, J. E., Ainsworth, J., Machin, M., Barrowclough, C., Dunn, G., Barkus, E., Rogers, A., Wykes, T., Kapur, S., Buchan, I., et al. (2012) · BMC Psychiatry · doi:10.1186/1471-244x-12-172 · Cited by 189
Do We Still Have a Digital Divide in Mental Health? A Five-Year Survey Follow-up
Robotham, D., Satkunanathan, S., Doughty, L., & Wykes, T. (2016) · Journal of Medical Internet Research · doi:10.2196/jmir.6511 · Cited by 184
Design and evaluation guidelines for mental health technologies
Doherty, G., Coyle, D., & Matthews, M. (2010) · Interacting with Computers · doi:10.1016/j.intcom.2010.02.006 · Cited by 179
Cognitive impairment in bipolar disorder and schizophrenia: a systematic review
Vöhringer, P. A., Barroilhet, S. A., Amerio, A., Reale, M. L., Alvear, K., Vergne, D., & Ghaemi, S. N. (2013) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2013.00087 · Cited by 165
Tsanas, A., Saunders, K. E. A., Bilderbeck, A. C., Palmius, N., Osipov, M., Clifford, G. D., Goodwin, G. Μ., & De Vos, M. (2016) · Journal of Affective Disorders · doi:10.1016/j.jad.2016.06.065 · Cited by 162
Digital Technology Use Among Individuals with Schizophrenia: Results of an Online Survey
Gay, K., Torous, J., Joseph, A., Pandya, A., & Duckworth, K. (2016) · JMIR Mental Health · doi:10.2196/mental.5379 · Cited by 161
Palmier-Claus, J. E., Rogers, A., Ainsworth, J., Machin, M., Barrowclough, C., Laverty, L., Barkus, E., Kapur, S., Wykes, T., & Lewis, S. W. (2013) · BMC Psychiatry · doi:10.1186/1471-244x-13-34 · Cited by 159
Pepin, R., Segal, D. L., & Coolidge, F. L. (2009) · Aging & Mental Health · doi:10.1080/13607860902918231 · Cited by 158
Whiteford, H. A., Ferrari, A. J., Degenhardt, L., Feigin, V., & Vos, T. (2016) · Disease Control Priorities, Third Edition (Volume 4): Mental, Neurological, and Substance Use Disorders · doi:10.1596/978-1-4648-0426-7_ch2 · Cited by 137
Feasibility and validity of ecological momentary assessment in the investigation of suicide risk
Husky, M., Olié, E., Guillaume, S., Genty, C., Swendsen, J., & Courtet, P. (2014) · Psychiatry Research · doi:10.1016/j.psychres.2014.08.019 · Cited by 124 · cited 6×
“In five studies, mobile device apps were used to collect ecological momentary assessments (EMAs).(32,34,38,41,42) In three studies, smartphone apps were used for daily mood and symptom monitoring.”
InfluentialBen‐Zeev, D., McHugo, G. J., Xie, H., Dobbins, K., & Young, M. A. (2012) · Schizophrenia Bulletin · doi:10.1093/schbul/sbr171 · Cited by 123
Hidalgo-Mazzei, D., Mateu, A., Reinares, M., Murru, A., del Mar Bonnín, C., Varo, C., Valentí, M., Undurraga, J., Strejilevich, S., Sánchez-Moreno, J., et al. (2016) · Journal of Affective Disorders · doi:10.1016/j.jad.2016.04.042 · Cited by 121
Rotondi, A. J., Eack, S. M., Hanusa, B. H., Spring, M. B., & Haas, G. L. (2013) · Schizophrenia Bulletin · doi:10.1093/schbul/sbt194 · Cited by 111
Borzekowski, D. L. G., Leith, J. E., Medoff, D. R., Potts, W., Dixon, L. B., Balis, T. G., Hackman, A. L., & Himelhoch, S. S. (2009) · Psychiatric Services · doi:10.1176/ps.2009.60.9.1265 · Cited by 97
Evaluating the promise of health IT to enhance/expand the reach of mental health services
Clarke, G., & Yarborough, B. J. (2013) · General Hospital Psychiatry · doi:10.1016/j.genhosppsych.2013.03.013 · Cited by 88 · cited 1×
“19–21 DHTs have created opportunities to develop a better understanding of MI and potentially improve the outcomes for patients with chronic mental health conditions in a variety of ways.”
Velligan, D., Mintz, J., Maples, N., Xueying, L., Gajewski, S., Carr, H., & Sierra, C. (2013) · Schizophrenia Bulletin · doi:10.1093/schbul/sbs116 · Cited by 87
Huxley, C. J., Atherton, H., Watkins, J. A., & Griffiths, F. (2015) · British Journal of General Practice · doi:10.3399/bjgp15x687853 · Cited by 86
Kane, J. M., Perlis, R. H., DiCarlo, L. A., Au-Yeung, K., Duong, J., & Petrides, G. (2013) · The Journal of Clinical Psychiatry · doi:10.4088/jcp.12m08222 · Cited by 81 · cited 6×
“Of these, two reported the development of digital medicine systems to measure medication ingestion objectively and acquire physiological metrics.(18,36) In a 4-week observational study in patients with schizophrenia or bipolar disorder, positive detection accuracy with the DHFS was 94% when compared with directly obse…”
InfluentialMarcano Belisario, J. S., Huckvale, K., Saje, A., Porcnik, A., Morrison, C. P., & Car, J. (2014) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.mr000042 · Cited by 80
Faurholt‐Jepsen, M., Ritz, C., Frost, M. M., Mikkelsen, R. L., Christensen, E. M., Bardram, J. E., Vinberg, M., & Kessing, L. V. (2015) · Journal of Affective Disorders · doi:10.1016/j.jad.2015.06.026 · Cited by 78
Peters-Strickland, T., Pestreich, L., Hatch, A., Rohatagi, S., Baker, R. A., Docherty, J., Markovtsova, L., Raja, P., Weiden, P. J., & Walling, D. P. (2016) · Neuropsychiatric Disease and Treatment · doi:10.2147/ndt.s116029 · Cited by 72
Self-citationPredictors of Self-Stigma in Schizophrenia: New Insights Using Mobile Technologies
Ben‐Zeev, D., Frounfelker, R. L., Morris, S. B., & Corrigan, P. W. (2012) · Journal of Dual Diagnosis · doi:10.1080/15504263.2012.723311 · Cited by 69
Forchuk, C., Reiss, J. P., O’Regan, T., Ethridge, P., Donelle, L., & Rudnick, A. (2015) · BMC Psychiatry · doi:10.1186/s12888-015-0614-7 · Cited by 43
Depp, C. A., Moore, R. C., Dev, S. I., Mausbach, B. T., Eyler, L. T., & Granholm, E. L. (2016) · Journal of Affective Disorders · doi:10.1016/j.jad.2015.12.016 · Cited by 38
Objective identification and analysis of physiological and behavioral signs of schizophrenia
Osipov, M., Behzadi, Y., Kane, J. M., Petrides, G., & Clifford, G. D. (2015) · Journal of Mental Health · doi:10.3109/09638237.2015.1019048 · Cited by 37
Moore, R. C., Fazeli, P. L., Patterson, T. L., Depp, C. A., Moore, D. J., Granholm, E. L., Jeste, D. V., & Mausbach, B. T. (2015) · Schizophrenia Research · doi:10.1016/j.schres.2015.02.014 · Cited by 26
Borzekowski, D. L. G., Leith, J. E., Medoff, D. R., Potts, W., Dixon, L. B., Balis, T. G., Hackman, A. L., & Himelhoch, S. S. (2009) · Psychiatric Services · doi:10.1176/appi.ps.60.9.1265 · Cited by 23
Cited by
Borghouts, J., Eikey, E., Mark, G., De Leon, C., Schueller, S. M., Schneider, M., Stadnick, N., Zheng, K., Mukamel, D., & Sorkin, D. H. (2021) · Journal of Medical Internet Research · doi:10.2196/24387 · Cited by 1,069
“Finally, digital health interventions evolve rapidly [17,18], and the review was focused on the current state of DMHIs.”
BackgroundMobile Apps for Mental Health Issues: Meta-Review of Meta-Analyses
Lecomte, T., Potvin, S., Corbière, M., Guay, S., Samson, C., Cloutier, B., Francoeur, A., Pennou, A., & Khazaal, Y. (2020) · JMIR mHealth and uHealth · doi:10.2196/17458 · Cited by 336
“Most of these studies have been conducted in the last few years and assessed either the feasibility and acceptability of mental health apps and, in some cases, their efficacy for a broad spectrum of mental disorders, including depressive disorders, posttraumatic stress disorders, schizophrenia, bipolar disorders, or a…”
BackgroundTremain, H., McEnery, C., Fletcher, K., & Murray, G. (2020) · JMIR Mental Health · doi:10.2196/17204 · Cited by 193
Peyroteo, M., Ferreira, I. A., Elvas, L. B., Ferreira, J. C., & Lapão, L. V. (2021) · JMIR mHealth and uHealth · doi:10.2196/28285 · Cited by 190
Kowal, M., Conroy, E., Ramsbottom, N., Smithies, T., Toth, A., & Campbell, M. (2021) · JMIR Serious Games · doi:10.2196/26575 · Cited by 172
Metadata
- Authors
- Batra, S., Baker, R., Wang, T., Forma, F., DiBiasi, F., & Peters-Strickland, T.
- Affiliations
- Rutgers, The State University of New Jersey (US)
- Otsuka (United States) (US)
- Otsuka Pharmaceutical Development & Commercialization, Inc. (United States) (US)
- Health Economics and Outcomes Research (United Kingdom) (GB)
- Corresponding author
- Peters-Strickland, Timothy
- Venue
- Medical Devices: Evidence and Research
- Publisher
- Informa UK Limited
- Published
- 2017-10
- Volume
- Volume 10
- Pages
- 237-251
- ISSN
- 1179-1470 (ISSN-L)
- PMC
- PMC5633292
- OpenAlex
- W2762415581
- Cited by
- 169
- References
- 55
- Citations by year
- 2026: 9 · 2025: 23 · 2024: 18 · 2023: 18 · 2022: 37 · 2021: 26 · 2020: 15 · 2019: 13 · 2018: 10
- FWCI
- 1.20
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Medical Devices Evidence and Research (publishedVersion, cc-by-nc)
- Europe PMC (PubMed Central) (publishedVersion, cc-by-nc)
- PubMed Central (publishedVersion, cc-by-nc)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Dove Medical Press (Taylor and Francis Group) (submittedVersion, cc-by-nc)
- Funders
- Otsuka Pharmaceutical
- Otsuka Pharmaceutical Development and Commercialization
- Topics
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Mental Health Research Topics
- Keywords
- digital health technologies, severe mental illness, schizophrenia, schizoaffective disorder, bipolar disorder, major depressive disorder, mobile health apps, symptom monitoring, digital medicine
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.

