A Smartphone Intervention for People With Serious Mental Illness: Fully Remote Randomized Controlled Trial of CORE
Open accessThe DOI matches its Crossref record; 22 of the 22 references it cites were found in a registry or an index.
Abstract
Background: People with serious mental illness (SMI) have significant unmet mental health needs. Development and testing of digital interventions that can alleviate the suffering of people with SMI is a public health priority. Objective: The aim of this study is to conduct a fully remote randomized waitlist-controlled trial of CORE, a smartphone intervention that comprises daily exercises designed to promote reassessment of dysfunctional beliefs in multiple domains. Methods: Individuals were recruited via the web using Google and Facebook advertisements. Enrolled participants were randomized into either active intervention or waitlist control groups. Participants completed the Beck Depression Inventory-Second Edition (BDI-II), Generalized Anxiety Disorder-7 (GAD-7), Hamilton Program for Schizophrenia Voices, Green Paranoid Thought Scale, Recovery Assessment Scale (RAS), Rosenberg Self-Esteem Scale (RSES), Friendship Scale, and Sheehan Disability Scale (SDS) at baseline (T1), 30-day (T2), and 60-day (T3) assessment points. Participants in the active group used CORE from T1 to T2, and participants in the waitlist group used CORE from T2 to T3. Both groups completed usability and accessibility measures after they concluded their intervention periods. Results: Overall, 315 individuals from 45 states participated in this study. The sample comprised individuals with self-reported bipolar disorder (111/315, 35.2%), major depressive disorder (136/315, 43.2%), and schizophrenia or schizoaffective disorder (68/315, 21.6%) who displayed moderate to severe symptoms and disability levels at baseline. Participants rated CORE as highly usable and acceptable. Intent-to-treat analyses showed significant treatment×time interactions for the BDI-II (F1,313=13.38; P<.001), GAD-7 (F1,313=5.87; P=.01), RAS (F1,313=23.42; P<.001), RSES (F1,313=19.28; P<.001), and SDS (F1,313=10.73; P=.001). Large effects were observed for the BDI-II (d=0.58), RAS (d=0.61), and RSES (d=0.64); a moderate effect size was observed for the SDS (d=0.44), and a small effect size was observed for the GAD-7 (d=0.20). Similar changes in outcome measures were later observed in the waitlist control group participants following crossover after they received CORE (T2 to T3). Approximately 41.5% (64/154) of participants in the active group and 60.2% (97/161) of participants in the waitlist group were retained at T2, and 33.1% (51/154) of participants in the active group and 40.3% (65/161) of participants in the waitlist group were retained at T3. Conclusions: We successfully recruited, screened, randomized, treated, and assessed a geographically dispersed sample of participants with SMI entirely via the web, demonstrating that fully remote clinical trials are feasible in this population; however, study retention remains challenging. CORE showed promise as a usable, acceptable, and effective tool for reducing the severity of psychiatric symptoms and disability while improving recovery and self-esteem. Rapid adoption and real-world dissemination of evidence-based mobile health interventions such as CORE are needed if we are to shorten the science-to-service gap and address the significant unmet mental health needs of people with SMI during the COVID-19 pandemic and beyond. Trial Registration: ClinicalTrials.gov NCT04068467; https://clinicaltrials.gov/ct2/show/NCT04068467
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Intention-to-treat concept: A review
Gupta, S. (2011) · Perspectives in Clinical Research · doi:10.4103/2229-3485.83221 · Cited by 1,921
The Impact of Mental Illness Stigma on Seeking and Participating in Mental Health Care
Corrigan, P. W., Druss, B. G., & Perlick, D. A. (2014) · Psychological Science in the Public Interest · doi:10.1177/1529100614531398 · Cited by 1,642 · cited 1×
“People with SMI are often exposed to pervasive societal stigma about their conditions and therefore can be reluctant to openly seek services at a clinic if it risks them being labeled mentally ill [8,9].”
Barriers to mental health treatment: results from the National Comorbidity Survey Replication
Mojtabai, R., Olfson, M., Sampson, N. A., Jin, R., Druss, B., Wang, P. S., Wells, K. B., Pincus, H. A., & Kessler, R. C. (2011) · Psychological Medicine · doi:10.1017/s0033291710002291 · Cited by 951
Torous, J., Jän Myrick, K., Rauseo-Ricupero, N., & Firth, J. (2020) · JMIR Mental Health · doi:10.2196/18848 · Cited by 946 · cited 1×
“The global COVID-19 pandemic has led to major disruptions in the delivery of standard mental health services and has shed light on the vulnerabilities intrinsic to complete reliance on clinic-based treatment models [64,65].”
Feasibility, Acceptability, and Preliminary Efficacy of a Smartphone Intervention for Schizophrenia
Ben-Zeev, D., Brenner, C. J., Begale, M., Duffecy, J., Mohr, D. C., & Mueser, K. T. (2014) · Schizophrenia Bulletin · doi:10.1093/schbul/sbu033 · Cited by 493
Self-citationClinical trials: The challenge of recruitment and retention of participants
Gul, R. B., & Ali, P. A. (2010) · Journal of Clinical Nursing · doi:10.1111/j.1365-2702.2009.03041.x · Cited by 449 · cited 1×
“Recruitment of participants for clinical trials is the most salient cause of study delays and a major obstacle in expeditiously moving novel and potentially helpful interventions to real-world practice [20].”
Mobile Apps for Bipolar Disorder: A Systematic Review of Features and Content Quality
Nicholas, J., Larsen, M. E., Proudfoot, J., & Christensen, H. (2015) · Journal of Medical Internet Research · doi:10.2196/jmir.4581 · Cited by 438 · cited 2×
“Our findings align with an ample body of digital mental health research suggesting that mHealth smartphone apps can be of clinical value to people with SMI [17,55,56].”
Green, C. E. L., Freeman, D., Kuipers, E., Bebbington, P., Fowler, D., Dunn, G., & Garety, P. A. (2008) · Psychological Medicine · doi:10.1017/s0033291707001638 · Cited by 401
The Use and Effectiveness of Mobile Apps for Depression: Results From a Fully Remote Clinical Trial
Arean, P. A., Hallgren, K. A., Jordan, J. T., Gazzaley, A., Atkins, D. C., Heagerty, P. J., & Anguera, J. A. (2016) · Journal of Medical Internet Research · doi:10.2196/jmir.6482 · Cited by 376
Firth, J., Cotter, J., Torous, J., Bucci, S., Firth, J. A., & Yung, A. R. (2016) · Schizophrenia Bulletin · doi:10.1093/schbul/sbv132 · Cited by 351 · cited 1×
“People with SMI are not dramatically different from the general population in their use of mobile technologies [10,11].”
Strategies for Increasing Recruitment to Randomised Controlled Trials: Systematic Review
Caldwell, P. H. Y., Hamilton, S., Tan, A., & Craig, J. C. (2010) · PLoS Medicine · doi:10.1371/journal.pmed.1000368 · Cited by 307 · cited 1×
“Traditional participant recruitment strategies are dependent on collaborative partnerships with study sites and clinician referrals [21].”
Mobile technologies among people with serious mental illness: Opportunities for future services
Ben-Zeev, D., Davis, K. E., Kaiser, S., Krzsos, I., & Drake, R. E. (2013) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-012-0424-x · Cited by 249 · cited 1×
“People with SMI are not dramatically different from the general population in their use of mobile technologies [10,11].”
Bell, I. H., Lim, M. H., Rossell, S. L., & Thomas, N. (2017) · Psychiatric Services · doi:10.1176/appi.ps.201600523 · Cited by 189 · cited 1×
“Our findings align with an ample body of digital mental health research suggesting that mHealth smartphone apps can be of clinical value to people with SMI [17,55,56].”
Anguera, J. A., Jordan, J. T., Castaneda, D., Gazzaley, A., & Areán, P. A. (2016) · BMJ Innovations · doi:10.1136/bmjinnov-2015-000098 · Cited by 172 · cited 1×
“…condition does not require in-person contact with the research team (eg, no intervention control, waitlist control, or digital attention–control alternative), recruitment, treatment, and assessment of outcomes can all be conducted fully remotely and potentially on a single device [25-30].”
Moberg, C., Niles, A., & Beermann, D. (2019) · Journal of Medical Internet Research · doi:10.2196/12556 · Cited by 157 · cited 1×
“Recent studies have demonstrated the feasibility of conducting remote trials of digital health apps for common mental health problems, including stress, anxiety, and depression [27-29].”
Banbury forum consensus statement on the path forward for digital mental health treatment
Mohr, D. C., Azocar, F., Bertagnolli, A., Choudhury, T., Chrisp, P., Frank, R., Harbin, H., Histon, T., Kaysen, D., Nebeker, C., et al. (2021) · Psychiatric Services · doi:10.1176/appi.ps.202000561 · Cited by 115
Smith, T. E., Easter, A., Pollock, M., Pope, L. G., & Wisdom, J. P. (2013) · Psychiatric Services · doi:10.1176/appi.ps.201200394 · Cited by 82 · cited 1×
“Therefore, the participant samples used in standard clinical trials may be particularly unrepresentative of hard-to-reach populations, such as people with SMI, who are known to disengage from clinic-based services for extended periods [22,23].”
Quantifying self-reports of auditory verbal hallucinations in persons with psychosis.
Van Lieshout, R. J., & Goldberg, J. O. (2007) · Canadian Journal of Behavioural Science / Revue canadienne des sciences du comportement · doi:10.1037/cjbs2007006 · Cited by 72
Use of Smartphones, Computers and Social Media Among People with SMI: Opportunity for Intervention
Brunette, M. F., Achtyes, E., Pratt, S., Stilwell, K., Opperman, M., Guarino, S., & Kay-Lambkin, F. (2019) · Community Mental Health Journal · doi:10.1007/s10597-019-00431-7 · Cited by 67
Technology to assess and support self-management in serious mental illness
Depp, C. A., Moore, R. C., Perivoliotis, D., & Granholm, E. (2016) · Dialogues in Clinical Neuroscience · doi:10.31887/dcns.2016.18.2/cdepp · Cited by 48
A Survey of Online and Mobile Technology Use at Peer Support Agencies
Aschbrenner, K. A., Naslund, J. A., Grinley, T., Bienvenida, J. C. M., Bartels, S. J., & Brunette, M. (2018) · Psychiatric Quarterly · doi:10.1007/s11126-017-9561-4 · Cited by 26
Using Facebook to Reach People Who Experience Auditory Hallucinations
Crosier, B. S., Brian, R. M., & Ben-Zeev, D. (2016) · Journal of Medical Internet Research · doi:10.2196/jmir.5420 · Cited by 20
Self-citation
Cited by
Systematic review and meta-analysis of adverse events in clinical trials of mental health apps
Linardon, J., Fuller-Tyszkiewicz, M., Firth, J., Goldberg, S. B., Anderson, C., McClure, Z., & Torous, J. (2024) · npj Digital Medicine · doi:10.1038/s41746-024-01388-y · Cited by 44
Schouten, S. E., Kip, H., Dekkers, T., Deenik, J., Beerlage-de Jong, N., Ludden, G. D. S., & Kelders, S. M. (2022) · Design for Health · doi:10.1080/24735132.2022.2145814 · Cited by 37
Wang, M., Chen, H., Yang, F., Xu, X., & Li, J. (2023) · Journal of Affective Disorders · doi:10.1016/j.jad.2023.06.057 · Cited by 25
Metadata
- Authors
- Ben-Zeev, D., Chander, A., Tauscher, J., Buck, B., Nepal, S., Campbell, A., & Doron, G.
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2021-11-12
- Volume
- 23
- Issue
- 11
- Pages
- e29201
- ISSN
- 1438-8871 (ISSN-L)
- OpenAlex
- W3212398108
- Cited by
- 63
- References
- 22
- FWCI
- 6.18
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.