Feasibility, Acceptability, and Preliminary Efficacy of a Smartphone Intervention for Schizophrenia

Ben-Zeev, D.; Brenner, C. J.; Begale, M.; Duffecy, J.; Mohr, D. C.; Mueser, K. T.

doi:10.1093/schbul/sbu033

Cited by 493Digital Mental Health InterventionsSchizophrenia research and treatmentMobile Health and mHealth Applications

Feasibility, Acceptability, and Preliminary Efficacy of a Smartphone Intervention for Schizophrenia

Open access

Ben-Zeev, D., Brenner, C. J., Begale, M., Duffecy, J., Mohr, D. C., Mueser, K. T.·2014·Schizophrenia Bulletin

DOI 10.1093/schbul/sbu033PMC PMC4193714

Open this paper in CoChat — free account

Abstract

The FOCUS smartphone intervention was developed to provide automated real-time/real-place illness management support to individuals with schizophrenia. The system was specifically designed to be usable by people with psychotic disorders who may have cognitive impairment, psychotic symptoms, negative symptoms, and/or low reading levels. FOCUS offers users both prescheduled and on-demand resources to facilitate symptom management, mood regulation, medication adherence, social functioning, and improved sleep. In this study, 33 individuals with schizophrenia or schizoaffective disorder used FOCUS over a 1-month period in their own environments. Participants were able to learn how to use the intervention independently, and all but one participant completed the trial successfully and returned the smartphones intact. Completers used the system on 86.5% of days they had the device, an average of 5.2 times a day. Approximately 62% of use of the FOCUS intervention was initiated by the participants, and 38% of use was in response to automated prompts. Baseline levels of cognitive functioning, negative symptoms, persecutory ideation, and reading level were not related to participants' use of the intervention. Approximately 90% of participants rated the intervention as highly acceptable and usable. Paired samples t tests found significant reductions in psychotic symptoms, depression, and general psychopathology, after 1 month of FOCUS use. This study demonstrated the feasibility, acceptability, and preliminary efficacy of the FOCUS intervention for schizophrenia and introduces a new treatment model which has promise for extending the reach of evidence-based care beyond the confines of a physical clinic using widely available technologies.

Integrity signals

Registry

Crossref · 10.1093/schbul/sbu033

Cites

49 of 49 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Desktop- or laptop-based monitoring of panic disorder symptoms via daily or weekly electronic diaries is likely biased by memory effects because clients complete these diaries retrospectively rather than in real-time.
“when desktop PCs or laptops are used to monitor symptoms of PD to identify factors that cue panic attacks and avoidance, clients typically use daily or weekly electronic diary entries, which are likely biased by memory effects because clients must complete these diaries retrospectively and not in real-time [22–28].”
From Efficacy of a hybrid online training for panic symptoms and agoraphobia: study protocol for a randomized controlled trial. (2014) · cites this paper as [25]

A Theoretical Extension of the Technology Acceptance Model: Four Longitudinal Field Studies
Venkatesh, V., & Davis, F. D. (2000) · Management Science · doi:10.1287/mnsc.46.2.186.11926 · Cited by 23,066 · see citing works
The Positive and Negative Syndrome Scale (PANSS) for schizophrenia.
Kay, S. R., Fiszbein, A., & Opler, L. A. (1987) · Schizophrenia Bulletin · doi:10.1093/schbul/13.2.261 · Cited by 21,378 · see citing works
SUS: A 'Quick and Dirty' Usability Scale
(1996) · Usability Evaluation In Industry · doi:10.1201/9781498710411-35 · Cited by 8,989 · see citing works
Research confuses me: what is the difference between case-control and cohort studies in quantitative research?
Higgins, S. M. F., Macken, A. P., Cullen, W., Saunders, J., Dunne, C. P., & O’Gorman, C. S. (2013) · PubMed · doi:10.34961/9953 · Cited by 4,806 · see citing works
The Insomnia Severity Index: Psychometric Indicators to Detect Insomnia Cases and Evaluate Treatment Response
Morin, C. M., Belleville, G., Bélanger, L., & Ivers, H. (2011) · Sleep · doi:10.1093/sleep/34.5.601 · Cited by 4,620 · see citing works
Usability Evaluation In Industry
(1996) · CRC Press eBooks · doi:10.1201/9781498710411 · Cited by 4,400 · see citing works
Vulnerability: A new view of schizophrenia.
Zubin, J., & Spring, B. J. (1977) · Journal of Abnormal Psychology · doi:10.1037/0021-843x.86.2.103 · Cited by 1,999 · see citing works
Vulnerability: A new view of schizophrenia.
Zubin, J., & Spring, B. J. (1977) · Journal of Abnormal Psychology · doi:10.1037//0021-843x.86.2.103 · Cited by 1,941 · see citing works
The Brief Assessment of Cognition in Schizophrenia: reliability, sensitivity, and comparison with a standard neurocognitive battery
Keefe, R. (2004) · Schizophrenia Research · doi:10.1016/j.schres.2003.09.011 · Cited by 1,573 · see citing works
A cognitive model of the positive symptoms of psychosis
GARETY, P. A., KUIPERS, E., FOWLER, D., FREEMAN, D., & BEBBINGTON, P. E. (2001) · Psychological Medicine · doi:10.1017/s0033291701003312 · Cited by 1,546 · see citing works
Psychiatric Comorbidities and Schizophrenia
Buckley, P. F., Miller, B. J., Lehrer, D. S., & Castle, D. J. (2009) · Schizophrenia Bulletin · doi:10.1093/schbul/sbn135 · Cited by 1,121 · see citing works
A cognitive model of persecutory delusions
Freeman, D., Garety, P. A., Kuipers, E., Fowler, D., & Bebbington, P. E. (2002) · British Journal of Clinical Psychology · doi:10.1348/014466502760387461 · Cited by 888 · see citing works
Review: Suicide and schizophrenia: a systematic review of rates and risk factors
Hor, K., & Taylor, M. (2010) · Journal of Psychopharmacology · doi:10.1177/1359786810385490 · Cited by 853 · see citing works
mHealth for mental health: Integrating smartphone technology in behavioral healthcare.
Luxton, D. D., McCann, R. A., Bush, N. E., Mishkind, M. C., & Reger, G. M. (2011) · Professional Psychology: Research and Practice · doi:10.1037/a0024485 · Cited by 809 · see citing works
The 2009 schizophrenia PORT psychosocial treatment recommendations and summary statements
Dixon, L. B., Dickerson, F., Bellack, A. S., Bennett, M., Dickinson, D., Goldberg, R. W., Lehman, A., Tenhula, W. N., Calmes, C., Pasillas, R. M., et al. (2010) · Schizophrenia Bulletin · doi:10.1093/schbul/sbp115 · Cited by 774 · see citing works
The brief medication questionnaire: A tool for screening patient adherence and barriers to adherence
Svarstad, B. L., Chewning, B. A., Sleath, B. L., & Claesson, C. B. (1999) · Patient Education and Counseling · doi:10.1016/s0738-3991(98)00107-4 · Cited by 660 · see citing works
Prevalence and Risk Factors for Homelessness and Utilization of Mental Health Services Among 10,340 Patients With Serious Mental Illness in a Large Public Mental Health System
Folsom, D. P., Hawthorne, W. B., Lindamer, L. A., Gilmer, T., Bailey, A. L., Golshan, S., Garcia, P., Unützer, J., Hough, R. L., & Jeste, D. V. (2005) · American Journal of Psychiatry · doi:10.1176/appi.ajp.162.2.370 · Cited by 551 · see citing works
The Global Costs of Schizophrenia
Knapp, M. R. J., Mangalore, R., & Simon, J. (2004) · Schizophrenia Bulletin · doi:10.1093/oxfordjournals.schbul.a007078 · Cited by 537 · see citing works
Psychosocial Treatments for Schizophrenia
Mueser, K. T., Deavers, F. E., Penn, D. L., & Cassisi, J. E. (2013) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-050212-185620 · Cited by 406 · see citing works
Self-citation
Psychometric Evaluation of the Post-Study System Usability Questionnaire: The PSSUQ
Lewis, J. R. (1992) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/154193129203601617 · Cited by 395 · see citing works
The Illness Management and Recovery Program: Rationale, Development, and Preliminary Findings
Mueser, K. T. (2006) · Schizophrenia Bulletin · doi:10.1093/schbul/sbl022 · Cited by 334 · see citing works
Self-citation
Development and usability testing of FOCUS: A smartphone system for self-management of schizophrenia.
Ben‐Zeev, D., Kaiser, S. M., Brenner, C. J., Begale, M. J., Duffecy, J. L., & Mohr, D. C. (2013) · Psychiatric Rehabilitation Journal · doi:10.1037/prj0000019 · Cited by 306 · see citing works
Self-citation
Mobile Assessment and Treatment for Schizophrenia (MATS): A Pilot Trial of An Interactive Text-Messaging Intervention for Medication Adherence, Socialization, and Auditory Hallucinations
Granholm, E. L., Ben‐Zeev, D., Link, P. C., Bradshaw, K., & Holden, J. L. (2011) · Schizophrenia Bulletin · doi:10.1093/schbul/sbr155 · Cited by 300 · see citing works
Self-citation
Risks for Individuals With Schizophrenia Who Are Living in the Community
Brekke, J. S., Prindle, C., Bae, S., & Long, J. D. (2001) · Psychiatric Services · doi:10.1176/appi.ps.52.10.1358 · Cited by 299 · see citing works
Training skills in the psychiatrically disabled: learning coping and competence.
Liberman, R., Mueser, K. T., Wallace, C., Jacobs, H., Eckman, T., & Massel, H. K. (1986) · Schizophrenia bulletin · doi:10.1093/schbul/12.4.631 · Cited by 285 · see citing works
Self-citation
The cost of relapse and the predictors of relapse in the treatment of schizophrenia
Ascher‐Svanum, H., Zhu, B., Faries, D. E., Salkever, D. S., Slade, E. P., Peng, X., & Conley, R. R. (2010) · BMC Psychiatry · doi:10.1186/1471-244x-10-2 · Cited by 278 · see citing works
Mobile technologies among people with serious mental illness: Opportunities for future services
Ben-Zeev, D., Davis, K. E., Kaiser, S., Krzsos, I., & Drake, R. E. (2013) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-012-0424-x · Cited by 249 · see citing works
On the HORYZON: Moderated online social therapy for long-term recovery in first episode psychosis
Alvarez-Jimenez, M., Bendall, S., Lederman, R., Wadley, G., Chinnery, G., Vargas, S., Larkin, M., Killackey, E., McGorry, P. D., & Gleeson, J. F. (2013) · Schizophrenia Research · doi:10.1016/j.schres.2012.10.009 · Cited by 224 · see citing works
Maintaining reality: Relational agents for antipsychotic medication adherence
Bickmore, T. W., Puskar, K., Schlenk, E. A., Pfeifer, L. M., & Sereika, S. M. (2010) · Interacting with Computers · doi:10.1016/j.intcom.2010.02.001 · Cited by 213 · see citing works
Review and analysis of hospitalization costs associated with antipsychotic nonadherence in the treatment of schizophrenia in the United States
Sun, S. X., Liu, G. G., Christensen, D. B., & Fu, A. Z. (2007) · Current Medical Research and Opinion · doi:10.1185/030079907x226050 · Cited by 196 · see citing works
Studying and Treating Schizophrenia Using Virtual Reality: A New Paradigm
Freeman, D. H. (2007) · Schizophrenia Bulletin · doi:10.1093/schbul/sbn020 · Cited by 183 · see citing works
Unmet Need for Mental Health Care in Schizophrenia: An Overview of Literature and New Data From a First-Admission Study
Mojtabai, R., Fochtmann, L. J., Chang, S.-W., Kotov, R., Craig, T., & Bromet, E. J. (2009) · Schizophrenia Bulletin · doi:10.1093/schbul/sbp045 · Cited by 159 · see citing works
Web-based psychoeducational intervention for persons with schizophrenia and their supporters: one-year outcomes
Rotondi, A. J., Anderson, C. M., Haas, G. L., Eack, S. M., Spring, M. B., Ganguli, R., Newhill, C., & Rosenstock, J. (2010) · Psychiatric Services · doi:10.1176/ps.2010.61.11.1099 · Cited by 158 · see citing works
The implementation of the NICE guidelines for schizophrenia: Barriers to the implementation of psychological interventions and recommendations for the future
Berry, K., & Haddock, G. (2008) · Psychology and Psychotherapy Theory Research and Practice · doi:10.1348/147608308x329540 · Cited by 153 · see citing works
Designing websites for persons with cognitive deficits: Design and usability of a psychoeducational intervention for persons with severe mental illness.
Rotondi, A. J., Sinkule, J., Haas, G. L., Spring, M. B., Litschge, C. M., Newhill, C. E., Ganguli, R., & ANDERSON, C. M. (2007) · Psychological Services · doi:10.1037/1541-1559.4.3.202 · Cited by 148 · see citing works
Mobile Phone Technology: A New Paradigm for the Prevention, Treatment, and Research of the Non-sheltered “Street” Homeless?
Eyrich-Garg, K. (2010) · Journal of urban health · doi:10.1007/s11524-010-9456-2 · Cited by 131 · see citing works
The future is in our hands: The role of mobile phones in the prevention and management of mental disorders
Proudfoot, J. (2013) · Australian & New Zealand Journal of Psychiatry · doi:10.1177/0004867412471441 · Cited by 126 · see citing works
Implementing Evidence-Based Practices for People With Schizophrenia
Drake, R. E., Bond, G. R., & Essock, S. M. (2009) · Schizophrenia Bulletin · doi:10.1093/schbul/sbp041 · Cited by 119 · see citing works
Wide Range Achievement Test–Fourth Edition
Veizel, K., & Zibulsky, J. (2014) · Encyclopedia of Special Education · doi:10.1002/9781118660584.ese2537 · Cited by 116 · see citing works
A virtual reality-based vocational training system (VRVTS) for people with schizophrenia in vocational rehabilitation
Tsang, M. M. Y., & Man, D. W. K. (2013) · Schizophrenia Research · doi:10.1016/j.schres.2012.12.024 · Cited by 98 · see citing works
Web-based cognitive–behavioral therapy for auditory hallucinations in persons with psychosis: A pilot study
Gottlieb, J. D., Romeo, K. H., Penn, D. L., Mueser, K. T., & Chiko, B. P. (2013) · Schizophrenia Research · doi:10.1016/j.schres.2013.01.002 · Cited by 81 · see citing works
Self-citation
A proof of concept trial of an online psychoeducational program for relatives of both veterans and civilians living with schizophrenia.
Glynn, S. M., Randolph, E. T., Garrick, T., & Lui, A. (2010) · Psychiatric Rehabilitation Journal · doi:10.2975/33.4.2010.278.287 · Cited by 73 · see citing works
Effectiveness of the Information Technology-Aided Program of Relapse Prevention in Schizophrenia (ITAREPS)
Španiel, F., HRDLIČKA, J., Novák, T., Kožený, J., Höschl, C., Mohr, P., & Motlová, L. B. (2012) · Journal of Psychiatric Practice · doi:10.1097/01.pra.0000416017.45591.c1 · Cited by 71 · see citing works
New media use by patients who are homeless: the potential of mHealth to build connectivity
Post, L. A., Vaca, F. E., Doran, K. M., Luco, C., Naftilan, M., Dziura, J., Brandt, C., Bernstein, S., Jagminas, L., & D'Onofrio, G. (2013) · Journal of Medical Internet Research · doi:10.2196/jmir.2724 · Cited by 71 · see citing works
Mobile Technologies in the Study, Assessment, and Treatment of Schizophrenia
Ben‐Zeev, D. (2012) · Schizophrenia Bulletin · doi:10.1093/schbul/sbr179 · Cited by 71 · see citing works
Self-citation
Internet-Based Interventions for Psychosis
Álvarez-Jiménez, M., Gleeson, J. F., Bendall, S., Lederman, R., Wadley, G., Killackey, E., & McGorry, P. D. (2012) · Psychiatric Clinics of North America · doi:10.1016/j.psc.2012.06.011 · Cited by 67 · cited 1× · see citing works
“Clinical researchers have begun developing a number of other novel technologies to improve the accessibility and quality of care available to people with schizophrenia.(42,43) Several of these approaches include web-based self-paced cognitive behavioral interventions for auditory hallucinations,44 online peer support…”
Background
Simulated Job Interview Skill Training for People with Psychiatric Disability: Feasibility and Tolerability of Virtual Reality Training
Bell, M. D., & Weinstein, A. (2011) · Schizophrenia Bulletin · doi:10.1093/schbul/sbr061 · Cited by 60 · see citing works
Using Contemporary Technologies in the Assessment and Treatment of Serious Mental Illness
Ben‐Zeev, D., Drake, R. E., Corrigan, P. W., Rotondi, A. J., Nilsen, W., & Depp, C. A. (2012) · American Journal of Psychiatric Rehabilitation · doi:10.1080/15487768.2012.733295 · Cited by 45 · see citing works
Self-citation
Usability and User Experience
RusuCristian, RusuVirginica, RoncaglioloSilvana, et al. (2015) · International Journal of Information Technologies and Systems Approach · doi:10.5555/2799543.2799544 · Cited by 7 · see citing works

Flagged first, then by citations

Sorted by citations

Just-in-time adaptive interventions (JITAIs) in mobile health: key components and design principles for ongoing health behavior support
Nahum-Shani, I., Smith, S. N., Spring, B. J., Collins, L. M., Witkiewitz, K., Tewari, A., & Murphy, S. A. (2018) · Annals of Behavioral Medicine · doi:10.1007/s12160-016-9830-8 · Cited by 2,171 · see citing works
New Tools for New Research in Psychiatry: A Scalable and Customizable Platform to Empower Data Driven Smartphone Research
Torous, J., Kiang, M. V., Lorme, J., & Onnela, J.-P. (2016) · JMIR Mental Health · doi:10.2196/mental.5165 · Cited by 758 · see citing works
“A recent study of 33 patients with schizophrenia noted that patients found the experience of using a smartphone app to provide on-demand psychoeducation in response to self-reported data to be very positive [18].”
Background
Experience sampling methodology in mental health research: new insights and technical developments.
Myin‐Germeys, I., Kasanova, Z., Vaessen, T., Vachon, H., Kirtley, O., Viechtbauer, W., & Reininghaus, U. (2018) · World Psychiatry · doi:10.1002/wps.20513 · Cited by 709 · see citing works
Building health behavior models to guide the development of just-in-time adaptive interventions: a pragmatic framework
Nahum-Shani, I., Hekler, E. B., & Spruijt-Metz, D. (2015) · Health Psychology · doi:10.1037/hea0000306 · Cited by 568 · see citing works
The Use of Mobile Apps and SMS Messaging as Physical and Mental Health Interventions: Systematic Review
Rathbone, A. L., & Prescott, J. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.7740 · Cited by 497 · see citing works
Using Smartphones to Collect Behavioral Data in Psychological Science: Opportunities, Practical Considerations, and Challenges
Harari, G. M., Lane, N. D., Wang, R., Crosier, B. S., Campbell, A. T., & Gosling, S. D. (2016) · Perspectives on Psychological Science · doi:10.1177/1745691616650285 · Cited by 515 · see citing works
The digital revolution and its impact on mental health care
Bucci, S., Schwannauer, M., & Berry, N. (2019) · Psychology and Psychotherapy: Theory, Research and Practice · doi:10.1111/papt.12222 · Cited by 444 · see citing works
Next-generation psychiatric assessment: Using smartphone sensors to monitor behavior and mental health.
Ben-Zeev, D., Scherer, E. A., Wang, R., Xie, H., & Campbell, A. T. (2015) · Psychiatric Rehabilitation Journal · doi:10.1037/prj0000130 · Cited by 429 · see citing works
Self-citation
The Use and Effectiveness of Mobile Apps for Depression: Results From a Fully Remote Clinical Trial
Arean, P. A., Hallgren, K. A., Jordan, J. T., Gazzaley, A., Atkins, D. C., Heagerty, P. J., & Anguera, J. A. (2016) · Journal of Medical Internet Research · doi:10.2196/jmir.6482 · Cited by 376 · see citing works
Mental health: there’s an app for that
Anthes, E. (2016) · Nature · doi:10.1038/532020a · Cited by 333 · see citing works
Do mental health mobile apps work: evidence and recommendations for designing high-efficacy mental health mobile apps
Chandrashekar, P. (2018) · mHealth · doi:10.21037/mhealth.2018.03.02 · Cited by 359 · see citing works
Advances in understanding and treating persecutory delusions: a review
Freeman, D., & Garety, P. (2014) · Social Psychiatry and Psychiatric Epidemiology · doi:10.1007/s00127-014-0928-7 · Cited by 348 · see citing works
User engagement in mental health apps: A review of measurement, reporting, and validity
Ng, M. M., Firth, J., Minen, M., & Torous, J. (2019) · Psychiatric Services · doi:10.1176/appi.ps.201800519 · Cited by 293 · see citing works
Tracking Depression Dynamics in College Students Using Mobile Phone and Wearable Sensing
Wang, R., Wang, W., daSilva, A., Huckins, J. F., Kelley, W. M., Heatherton, T. F., & Campbell, A. T. (2018) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3191775 · Cited by 340 · see citing works
Emerging mHealth and eHealth interventions for serious mental illness: a review of the literature
Naslund, J. A., Marsch, L. A., McHugo, G. J., & Bartels, S. J. (2015) · Journal of Mental Health · doi:10.3109/09638237.2015.1019054 · Cited by 327 · see citing works
CrossCheck: toward passive sensing and detection of mental health changes in people with schizophrenia
Wang, R., Aung, M. S. H., Abdullah, S., Brian, R., Campbell, A. T., Choudhury, T., Hauser, M., Kane, J., Merrill, M., Scherer, E. A., et al. (2016) · Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing · doi:10.1145/2971648.2971740 · Cited by 257 · see citing works
Self-citation
Acceptability of Interventions Delivered Online and Through Mobile Phones for People Who Experience Severe Mental Health Problems: A Systematic Review
Berry, N., Lobban, F., Emsley, R., & Bucci, S. (2016) · Journal of Medical Internet Research · doi:10.2196/jmir.5250 · Cited by 230 · see citing works
Smartphone Apps for Schizophrenia: A Systematic Review
Firth, J., & Torous, J. (2015) · JMIR mHealth and uHealth · doi:10.2196/mhealth.4930 · Cited by 268 · see citing works
Barriers to and Facilitators of Engagement With Remote Measurement Technology for Managing Health: Systematic Review and Content Analysis of Findings
Simblett, S., Greer, B., Matcham, F., Curtis, H., Polhemus, A., Ferrão, J., Gamble, P., & Wykes, T. (2018) · Journal of Medical Internet Research · doi:10.2196/10480 · Cited by 270 · see citing works
Utilizing a Personal Smartphone Custom App to Assess the Patient Health Questionnaire-9 (PHQ-9) Depressive Symptoms in Patients With Major Depressive Disorder
Torous, J., Staples, P., Shanahan, M., Lin, C., Peck, P., Keshavan, M., & Onnela, J.-P. (2015) · JMIR Mental Health · doi:10.2196/mental.3889 · Cited by 258 · see citing works
Actissist: Proof-of-Concept Trial of a Theory-Driven Digital Intervention for Psychosis
Bucci, S., Barrowclough, C., Ainsworth, J., Machin, M., Morris, R., Berry, K., Emsley, R., Lewis, S., Edge, D., Buchan, I., et al. (2018) · Schizophrenia Bulletin · doi:10.1093/schbul/sby032 · Cited by 196 · see citing works
Efficacy of PRIME, a mobile app intervention designed to improve motivation in young people with schizophrenia
Schlosser, D. A., Campellone, T. R., Truong, B., Etter, K., Vergani, S., Komaiko, K., & Vinogradov, S. (2018) · Schizophrenia Bulletin · doi:10.1093/schbul/sby078 · Cited by 206 · see citing works
Patient Smartphone Ownership and Interest in Mobile Apps to Monitor Symptoms of Mental Health Conditions: A Survey in Four Geographically Distinct Psychiatric Clinics
Torous, J., Chan, S. R., Yee-Marie Tan, S., Behrens, J., Mathew, I., Conrad, E. J., Hinton, L., Yellowlees, P., & Keshavan, M. (2014) · JMIR Mental Health · doi:10.2196/mental.4004 · Cited by 228 · see citing works
Evidence-based apps? A review of mental health mobile applications in a psychotherapy context
Lui, J. H. L., Marcus, D. K., & Barry, C. T. (2017) · Professional Psychology Research and Practice · doi:10.1037/pro0000122 · Cited by 217 · see citing works
Augmenting psychoeducation with a mobile intervention for bipolar disorder: A randomized controlled trial
Depp, C. A., Ceglowski, J., Wang, V. C., Yaghouti, F., Mausbach, B. T., Thompson, W. K., & Granholm, E. L. (2015) · Journal of Affective Disorders · doi:10.1016/j.jad.2014.10.053 · Cited by 215 · see citing works
Do We Still Have a Digital Divide in Mental Health? A Five-Year Survey Follow-up
Robotham, D., Satkunanathan, S., Doughty, L., & Wykes, T. (2016) · Journal of Medical Internet Research · doi:10.2196/jmir.6511 · Cited by 184 · see citing works
Smartphone Apps for the Treatment of Mental Disorders: Systematic Review
Miralles, I., Granell, C., Díaz-Sanahuja, L., Van Woensel, W., Bretón-López, J., Mira, A., Castilla, D., & Casteleyn, S. (2020) · JMIR mHealth and uHealth · doi:10.2196/14897 · Cited by 188 · see citing works
Changing Mental Health and Positive Psychological Well-Being Using Ecological Momentary Interventions: A Systematic Review and Meta-analysis
Versluis, A., Verkuil, B., Spinhoven, P., van der Ploeg, M. M., & Brosschot, J. F. (2016) · Journal of Medical Internet Research · doi:10.2196/jmir.5642 · Cited by 186 · see citing works
Ecological momentary assessment and intervention in the treatment of psychotic disorders: a systematic review
Bell, I. H., Lim, M. H., Rossell, S. L., & Thomas, N. (2017) · Psychiatric Services · doi:10.1176/appi.ps.201600523 · Cited by 189 · see citing works
Digital health technology for use in patients with serious mental illness: a systematic review of the literature
Batra, S., Baker, R., Wang, T., Forma, F., DiBiasi, F., & Peters-Strickland, T. (2017) · Medical Devices: Evidence and Research · doi:10.2147/mder.s144158 · Cited by 169 · see citing works
Mobile Health (mHealth) Versus Clinic-Based Group Intervention for People With Serious Mental Illness: A Randomized Controlled Trial
Ben-Zeev, D., Brian, R. M., Jonathan, G., Razzano, L., Pashka, N., Carpenter-Song, E., Drake, R. E., & Scherer, E. A. (2018) · Psychiatric Services · doi:10.1176/appi.ps.201800063 · Cited by 173 · see citing works
Self-citation
Digital Technology Use Among Individuals with Schizophrenia: Results of an Online Survey
Gay, K., Torous, J., Joseph, A., Pandya, A., & Duckworth, K. (2016) · JMIR Mental Health · doi:10.2196/mental.5379 · Cited by 161 · see citing works
Use of Technology to Provide Mental Health Care for Racial and Ethnic Minorities: Evidence, Promise, and Challenges
Ramos, G., & Chavira, D. A. (2022) · Cognitive and Behavioral Practice · doi:10.1016/j.cbpra.2019.10.004 · Cited by 143 · see citing works
Feasibility of Popular m-Health Technologies for Activity Tracking Among Individuals with Serious Mental Illness
Naslund, J. A., Aschbrenner, K. A., Barre, L. K., & Bartels, S. J. (2015) · Telemedicine and e-Health · doi:10.1089/tmj.2014.0105 · Cited by 144 · see citing works
Factors affecting implementation of digital health interventions for people with psychosis or bipolar disorder, and their family and friends: a systematic review
Aref-Adib, G., McCloud, T., Ross, J., O'Hanlon, P., Appleton, V., Rowe, S., Murray, E., Johnson, S., & Lobban, F. (2019) · The Lancet Psychiatry · doi:10.1016/s2215-0366(18)30302-x · Cited by 118 · see citing works
mHealth Application Areas and Technology Combinations: A Comparison of Literature from High and Low/Middle Income Countries
Abaza, H., & Marschollek, M. (2017) · Methods of Information in Medicine · doi:10.3414/me17-05-0003 · Cited by 138 · see citing works
mHealth for Schizophrenia: Patient Engagement With a Mobile Phone Intervention Following Hospital Discharge
Ben-Zeev, D., Scherer, E. A., Gottlieb, J. D., Rotondi, A. J., Brunette, M. F., Achtyes, E. D., Mueser, K. T., Gingerich, S., Brenner, C. J., Begale, M., et al. (2016) · JMIR Mental Health · doi:10.2196/mental.6348 · Cited by 137 · see citing works
Self-citation
How people with serious mental illness use smartphones, mobile apps, and social media.
Naslund, J. A., Aschbrenner, K. A., & Bartels, S. J. (2016) · Psychiatric Rehabilitation Journal · doi:10.1037/prj0000207 · Cited by 126 · see citing works
Mobile technology-based interventions for adult users of alcohol: a systematic review of the literature
Fowler, L. A., Holt, S. L., & Joshi, D. (2016) · Addictive Behaviors · doi:10.1016/j.addbeh.2016.06.008 · Cited by 123 · see citing works
Feasibility of PRIME: A Cognitive Neuroscience-Informed Mobile App Intervention to Enhance Motivated Behavior and Improve Quality of Life in Recent Onset Schizophrenia
Schlosser, D., Campellone, T., Kim, D., Truong, B., Vergani, S., Ward, C., & Vinogradov, S. (2016) · JMIR Research Protocols · doi:10.2196/resprot.5450 · Cited by 103 · see citing works
Improving Adherence to Web-Based and Mobile Technologies for People With Psychosis: Systematic Review of New Potential Predictors of Adherence
Killikelly, C., He, Z., Reeder, C., & Wykes, T. (2017) · JMIR mHealth and uHealth · doi:10.2196/mhealth.7088 · Cited by 105 · see citing works
Mobile health (mHealth) for mental health in Asia: Objectives, strategies, and limitations
Brian, R. M., & Ben-Zeev, D. (2014) · Asian Journal of Psychiatry · doi:10.1016/j.ajp.2014.04.006 · Cited by 121 · see citing works
Self-citation
Barriers to and Facilitators of Engagement With mHealth Technology for Remote Measurement and Management of Depression: Qualitative Analysis
Simblett, S., Matcham, F., Siddi, S., Bulgari, V., Barattieri di San Pietro, C., Hortas López, J., Ferrão, J., Polhemus, A., Haro, J. M., de Girolamo, G., et al. (2019) · JMIR mHealth and uHealth · doi:10.2196/11325 · Cited by 120 · see citing works
Availability, readability, and content of privacy policies and terms of agreements of mental health apps
Robillard, J. M., Feng, T. L., Sporn, A. B., Lai, J.-A., Lo, C., Ta, M., & Nadler, R. (2019) · Internet Interventions · doi:10.1016/j.invent.2019.100243 · Cited by 111 · see citing works
Preliminary Effectiveness of a Smartphone App to Reduce Depressive Symptoms in the Workplace: Feasibility and Acceptability Study
Deady, M., Johnston, D., Milne, D., Glozier, N., Peters, D., Calvo, R., & Harvey, S. (2018) · JMIR mHealth and uHealth · doi:10.2196/11661 · Cited by 72 · see citing works
Is India ready for mental health apps (MHApps)? A quantitative-qualitative exploration of caregivers’ perspective on smartphone-based solutions for managing severe mental illnesses in low resource settings
Sinha Deb, K., Tuli, A., Sood, M., Chadda, R., Verma, R., Kumar, S., Ganesh, R., & Singh, P. (2018) · PLOS ONE · doi:10.1371/journal.pone.0203353 · Cited by 79 · see citing works
Evaluating Patient Usability of an Image-Based Mobile Health Platform for Postoperative Wound Monitoring
Gunter, R., Fernandes-Taylor, S., Mahnke, A., Awoyinka, L., Schroeder, C., Wiseman, J., Sullivan, S., Bennett, K., Greenberg, C., & Kent, K. C. (2016) · JMIR mHealth and uHealth · doi:10.2196/mhealth.6023 · Cited by 77 · see citing works
Development and Long-Term Acceptability of ExPRESS, a Mobile Phone App to Monitor Basic Symptoms and Early Signs of Psychosis Relapse
Eisner, E., Drake, R. J., Berry, N., Barrowclough, C., Emsley, R., Machin, M., & Bucci, S. (2019) · JMIR mHealth and uHealth · doi:10.2196/11568 · Cited by 73 · see citing works
Smartphone-Based Psychotherapeutic Micro-Interventions to Improve Mood in a Real-World Setting
Meinlschmidt, G., Lee, J.-H., Stalujanis, E., Belardi, A., Oh, M., Jung, E. K., Kim, H.-C., Alfano, J., Yoo, S.-S., & Tegethoff, M. (2016) · Frontiers in Psychology · doi:10.3389/fpsyg.2016.01112 · Cited by 68 · see citing works
Predicting engagement with an online psychosocial intervention for psychosis: Exploring individual- and intervention-level predictors
Arnold, C., Villagonzalo, K.-A., Meyer, D., Farhall, J., Foley, F., Kyrios, M., & Thomas, N. (2019) · Internet Interventions · doi:10.1016/j.invent.2019.100266 · Cited by 63 · see citing works
“Further, individuals with psychosis have unique challenges, such as cognitive impairment and positive and negative symptoms, potentially impacting engagement (Ben-Zeev et al., 2014; Granholm et al., 2012; Rotondi et al., 2010).”
Background
Optimizing Digital Integrated Care via Micro‐Randomized Trials
Walton, A., Nahum‐Shani, I., Crosby, L., Klasnja, P., & Murphy, S. (2018) · Clinical Pharmacology & Therapeutics · doi:10.1002/cpt.1079 · Cited by 66 · see citing works
Mobile Mindfulness Intervention on an Acute Psychiatric Unit: Feasibility and Acceptability Study
Mistler, L. A., Ben-Zeev, D., Carpenter-Song, E., Brunette, M. F., & Friedman, M. J. (2017) · JMIR Mental Health · doi:10.2196/mental.7717 · Cited by 60 · see citing works
Self-citation
Preliminary results from a randomized controlled study for an App-Based cognitive behavioral therapy program for depression and anxiety in cancer patients
Ham, K., Chin, S., Suh, Y. J., Rhee, M., Yu, E.-S., Lee, H. J., Kim, J.-H., Kim, S. W., Koh, S.-J., & Chung, K.-M. (2019) · Frontiers in Psychology · doi:10.3389/fpsyg.2019.01592 · Cited by 61 · see citing works
Capturing Rest-Activity Profiles in Schizophrenia Using Wearable and Mobile Technologies: Development, Implementation, Feasibility, and Acceptability of a Remote Monitoring Platform
Meyer, N., Kerz, M., Folarin, A., Joyce, D. W., Jackson, R., Karr, C., Dobson, R., & MacCabe, J. (2018) · JMIR mHealth and uHealth · doi:10.2196/mhealth.8292 · Cited by 58 · see citing works
Are we there yet?!—a literature review of recent digital technology advances for the treatment of early psychosis
Rus-Calafell, M., & Schneider, S. (2020) · mHealth · doi:10.21037/mhealth.2019.09.14 · Cited by 57 · see citing works
Video-based mobile health interventions for people with schizophrenia: Bringing the “pocket therapist” to life.
Ben-Zeev, D., Brian, R. M., Aschbrenner, K. A., Jonathan, G., & Steingard, S. (2018) · Psychiatric Rehabilitation Journal · doi:10.1037/prj0000197 · Cited by 50 · see citing works
Self-citation
Technology to assess and support self-management in serious mental illness
Depp, C. A., Moore, R. C., Perivoliotis, D., & Granholm, E. (2016) · Dialogues in Clinical Neuroscience · doi:10.31887/dcns.2016.18.2/cdepp · Cited by 48 · see citing works
Patients’ Experiences of Using Smartphone Apps to Support Self-Management and Improve Medication Adherence in Hypertension: Qualitative Study
McBride, C. M., Morrissey, E. C., & Molloy, G. J. (2020) · JMIR mHealth and uHealth · doi:10.2196/17470 · Cited by 49 · see citing works
EMOTEO: a smartphone application for monitoring and reducing aversive tension in borderline personality disorder patients, a pilot study
Prada, P., Zamberg, I., Bouillault, G., Jimenez, N., Zimmermann, J., Hasler, R., Aubry, J.-M., Nicastro, R., & Perroud, N. (2017) · Perspectives In Psychiatric Care · doi:10.1111/ppc.12178 · Cited by 47 · see citing works
Digital technology for health promotion: opportunities to address excess mortality in persons living with severe mental disorders
Naslund, J. A., & Aschbrenner, K. A. (2019) · Evidence Based Mental Health · doi:10.1136/ebmental-2018-300034 · Cited by 44 · see citing works
Fear of recurrence: Results of a randomized trial of relapse detection in schizophrenia
Gumley, A. I., MacBeth, A., Reilly, J. D., O'Grady, M., White, R. G., McLeod, H., Schwannauer, M., & Power, K. G. (2015) · British Journal of Clinical Psychology · doi:10.1111/bjc.12060 · Cited by 46 · see citing works
Using behavioral rhythms and multi-task learning to predict fine-grained symptoms of schizophrenia
Tseng, V. W.-S., Sano, A., Ben-Zeev, D., Brian, R., Campbell, A. T., Hauser, M., Kane, J. M., Scherer, E. A., Wang, R., Wang, W., et al. (2020) · Scientific Reports · doi:10.1038/s41598-020-71689-1 · Cited by 44 · see citing works
Self-citation
Life with FOCUS: A qualitative evaluation of the impact of a smartphone intervention on people with serious mental illness.
Jonathan, G., Carpenter-Song, E. A., Brian, R. M., & Ben-Zeev, D. (2019) · Psychiatric Rehabilitation Journal · doi:10.1037/prj0000337 · Cited by 45 · see citing works
Self-citation
Client perceptions of the mental health engagement network: a qualitative analysis of an electronic personal health record
Forchuk, C., Reiss, J. P., O’Regan, T., Ethridge, P., Donelle, L., & Rudnick, A. (2015) · BMC Psychiatry · doi:10.1186/s12888-015-0614-7 · Cited by 43 · see citing works
Off-hours use of a smartphone intervention to extend support for individuals with schizophrenia spectrum disorders recently discharged from a psychiatric hospital
Achtyes, E. D., Ben-Zeev, D., Luo, Z., Mayle, H., Burke, B., Rotondi, A. J., Gottlieb, J. D., Brunette, M. F., Mueser, K. T., Gingerich, S., et al. (2019) · Schizophrenia Research · doi:10.1016/j.schres.2018.11.026 · Cited by 35 · see citing works
Self-citation
A Smartphone App to Foster Power in the Everyday Management of Living With Schizophrenia: Qualitative Analysis of Young Adults’ Perspectives
Terp, M., Jørgensen, R., Laursen, B. S., Mainz, J., & Bjørnes, C. D. (2018) · JMIR Mental Health · doi:10.2196/10157 · Cited by 41 · see citing works
Engagement with online psychosocial interventions for psychosis: A review and synthesis of relevant factors
Arnold, C., Farhall, J., Villagonzalo, K.-A., Sharma, K., & Thomas, N. (2021) · Internet Interventions · doi:10.1016/j.invent.2021.100411 · Cited by 34 · see citing works
“The majority of studies examining the association between positive symptoms and engagement with online interventions have found no association (Ben-Zeev et al., 2014; Granholm et al., 2012; Kumar et al., 2018; Moitra et al., 2017; Niendam et al., 2018; So et al., 2013).”
BackgroundInfluential
Smartphone-based ecological momentary assessment and intervention in a blended coping-focused therapy for distressing voices: development and case illustration
Bell, I. H., Fielding-Smith, S. F., Hayward, M., Rossell, S. L., Lim, M. H., Farhall, J., & Thomas, N. (2018) · Internet Interventions · doi:10.1016/j.invent.2018.11.001 · Cited by 36 · see citing works
Mobile intervention for individuals with psychosis, dual disorders, and their common comorbidities: A literature review
Pennou, A., Lecomte, T., Potvin, S., & Khazaal, Y. (2019) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2019.00302 · Cited by 34 · see citing works
Feasibility and Acceptability of Using a Mobile Phone App for Characterizing Auditory Verbal Hallucinations in Adolescents With Early-Onset Psychosis: Exploratory Study
Smelror, R. E., Bless, J. J., Hugdahl, K., & Agartz, I. (2019) · JMIR Formative Research · doi:10.2196/13882 · Cited by 25 · see citing works
Using Smartphone Apps to Promote Psychiatric Rehabilitation in a Peer-Led Community Support Program: Pilot Study
Mueller, N. E., Panch, T., Macias, C., Cohen, B. M., Ongur, D., & Baker, J. T. (2018) · JMIR Mental Health · doi:10.2196/10092 · Cited by 26 · see citing works
The Youth-Mental Health Engagement Network: An Exploratory Pilot Study of a Smartphone and Computer-Based Personal Health Record for Youth Experiencing Depressive Symptoms
Forchuk, C., Reiss, J., Eichstedt, J., Singh, D., Collins, K., Rudnick, A., Walsh, J., Ethridge, P., Kutcher, S., & Fisman, S. (2016) · International Journal of Mental Health · doi:10.1080/00207411.2016.1204823 · Cited by 25 · see citing works
That Which Is Measured Improves”: An Integrative Review Of The Role Of Self-monitoring In Symptom Self-management And Behavior Change.
Chen, J. A., Fearey, E., & Smith, R. E. (2017) · Journal Of Behavior Therapy And Mental Health · doi:10.14302/issn.2474-9273.jbtm-16-1180 · Cited by 27 · see citing works
ULTEMAT: A mobile framework for smart ecological momentary assessments and interventions
van de Ven, P., O’Brien, H., Henriques, R., Klein, M., Msetfi, R., Nelson, J., Rocha, A., Ruwaard, J., O’Sullivan, D., & Riper, H. (2017) · Internet Interventions · doi:10.1016/j.invent.2017.07.001 · Cited by 26 · see citing works
Efficacy of a hybrid online training for panic symptoms and agoraphobia: study protocol for a randomized controlled trial.
Ebenfeld, L., Kleine Stegemann, S., Lehr, D., Ebert, D. D., Jazaieri, H., van Ballegooijen, W., Funk, B., Riper, H., & Berking, M. (2014) · Trials · doi:10.1186/1745-6215-15-427 · Cited by 20 · see citing works
“Moreover, when desktop PCs or laptops are used to monitor symptoms of PD to identify factors that cue panic attacks and avoidance, clients typically use daily or weekly electronic diary entries, which are likely biased by memory effects because clients must complete these diaries retrospectively and not in real-time […”
Background
Adherence to Behavioral Therapy for Migraine: Knowledge to Date, Mechanisms for Assessing Adherence, and Methods for Improving Adherence
Gewirtz, A., & Minen, M. (2019) · Current Pain and Headache Reports · doi:10.1007/s11916-019-0739-3 · Cited by 22 · see citing works
‘Validated, easy to use and free’: top three requests for mobile device applications (‘apps’) from mental health consumers and clinicians
Dragovic, M., Davison, S., Morgan, V. A., Chiu, V. W., Richards, N., Vatskalis, T., Atkinson, A., & Waters, F. (2020) · Advances in Mental Health · doi:10.1080/18387357.2018.1557014 · Cited by 20 · see citing works
Measuring Users’ Receptivity Toward an Integral Intervention Model Based on mHealth Solutions for Patients With Treatment-Resistant Schizophrenia (m-RESIST): A Qualitative Study
Huerta-Ramos, E., Escobar-Villegas, M. S., Rubinstein, K., Unoka, Z. S., Grasa, E., Hospedales, M., Jääskeläinen, E., Rubio-Abadal, E., Caspi, A., Bitter, I., et al. (2016) · JMIR mHealth and uHealth · doi:10.2196/mhealth.5716 · Cited by 20 · see citing works

Classification of schizoaffective disorder
Sprock, J. (1988) · Comprehensive Psychiatry · doi:10.1016/0010-440x(88)90038-7 · Cited by 15 · see citing works
A century of antivenom.
Radonić, E., Radoš, M., Kalember, P., Bajs-Janović, M., Folnegović-Smalc, V., & Henigsberg, N. (2011) · PubMed · Cited by 38 · see citing works
Psychopathology among Mentally Retarded Children and Adolescents
Matson, J. L., & Frame, C. L. (1985) · Medical Entomology and Zoology · Cited by 19 · see citing works
Comparison of cognitive performance in RDC-diagnosed schizoaffective and schizophrenic patients with the Luria-Nebraska neuropsychological battery
Miller, L. S., Swanson-Green, T., Moses, J. A., & Faustman, W. O. (1996) · Journal of Psychiatric Research · doi:10.1016/0022-3956(96)00013-1 · Cited by 22 · see citing works
Are schizophrenia and schizoaffective disorder neuropsychologically distinguishable?
Heinrichs, R. W., Ammari, N., Vaz, S. M., & Miles, A. A. (2007) · Schizophrenia Research · doi:10.1016/j.schres.2007.10.007 · Cited by 52 · see citing works

Authors: Ben-Zeev, D., Brenner, C. J., Begale, M., Duffecy, J., Mohr, D. C., & Mueser, K. T.
Affiliations: Thresholds (US)
Northwestern University (US)
Boston University (US)
ORCID: Brenner, C. J.
Begale, M.
Duffecy, J.
Mohr, D. C.
Mueser, K. T.
Venue: Schizophrenia Bulletin
Publisher: Oxford University Press (OUP)
Published: 2014-03-08
Volume: 40
Issue: 6
Pages: 1244-1253
ISSN: 0586-7614 (ISSN-L)
1745-1701
DOI: 10.1093/schbul/sbu033
PMC: PMC4193714
OpenAlex: W2121621539
Cited by: 493
References: 49
Citations by year: 2026: 17 · 2025: 33 · 2024: 33 · 2023: 31 · 2022: 33 · 2021: 45 · 2020: 49 · 2019: 50 · 2018: 66 · 2017: 43 · 2016: 48 · 2015: 29 · 2014: 15 · 2013: 1
FWCI: 69.66
Type: journal article
Language: en
Open access: green
www.ncbi.nlm.nih.gov
Locations: Schizophrenia Bulletin (publishedVersion)
Europe PMC (PubMed Central) (publishedVersion)
PubMed Central (publishedVersion)
PubMed (publishedVersion)
Funders: National Institute of Mental Health (P20MH090318, R34MH100195)
National Institute on Drug Abuse (P30DA029926)
Topics: Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
Health Sciences › Medicine › Psychiatry and Mental health › Schizophrenia research and treatment
Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
Keywords: schizophrenia, schizoaffective disorder
MeSH terms: Adult, Feasibility Studies, Humans, Male, Middle Aged, Pilot Projects, Psychotic Disorders, Schizophrenia, Treatment Outcome, Telemedicine, Disease Management, Cell Phone

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Feasibility, Acceptability, and Preliminary Efficacy of a Smartphone Intervention for Schizophrenia

Abstract

Integrity signals

Claims the paper makes

Claims other papers make about this one

Cites

Cited by

Related

Record

About these checks