Measuring Users’ Receptivity Toward an Integral Intervention Model Based on mHealth Solutions for Patients With Treatment-Resistant Schizophrenia (m-RESIST): A Qualitative Study
Open accessAbstract
BACKGROUND: Despite the theoretical potential of mHealth solutions in the treatment of patients with schizophrenia, there remains a lack of technological tools in clinical practice. OBJECTIVE: The aim of this study was to measure the receptivity of patients, informal carers, and clinicians to a European integral intervention model focused on patients with persistent positive symptoms: Mobile Therapeutic Attention for Patients with Treatment-Resistant Schizophrenia (m-RESIST). METHODS: Before defining the system requirements, a qualitative study of the needs of outpatients with treatment-resistant schizophrenia was carried out in Spain, Israel, and Hungary. We analyzed the opinions of patients, informal carers, and clinicians concerning the services originally intended to be part of the solution. A total of 9 focus groups (72 people) and 35 individual interviews were carried out in the 3 countries, using discourse analysis as the framework. RESULTS: A webpage and an online forum were perceived as suitable to get both reliable information on the disease and support. Data transmission by a smart watch (monitoring), Web-based visits, and instant messages (clinical treatment) were valued as ways to improve contact with clinicians. Alerts were appreciated as reminders of daily tasks and appointments. Avoiding stressful situations for outpatients, promoting an active role in the management of the disease, and maintaining human contact with clinicians were the main suggestions provided for improving the effectiveness of the solution. CONCLUSIONS: Positive receptivity toward m-RESIST services is related to its usefulness in meeting user needs, its capacity to empower them, and the possibility of maintaining human contact.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
People can access a mental health app if they are not able to speak to someone in person about their concerns.
“For example, people can access a mental health app if they are not able to speak to someone in person about their concerns [175].”
From Barriers to and facilitators of user engagement with digital mental health interventions: Systematic review (2021) · cites this paper as [175]
The Results (Suggestions for Improvement; page unavailable) say online visits could maintain contact when outpatients were unwilling or unable to visit clinicians. This supports remote contact as an alternative to an in-person visit, but the study concerns patients with treatment-resistant schizophrenia, not people generally, and does not specifically discuss being unable to speak in person about their concerns. (LLM, conf=0.84)
Experimental — accuracy not yet measuredIncreased locus of control (users feeling more ownership over their own health) is a facilitating factor in using DMHIs.
“A facilitating factor in using DMHIs was whether the use of the intervention increased locus of control, meaning that users felt more ownership over their own health [14,84,95,124,174,175].”
From Barriers to and facilitators of user engagement with digital mental health interventions: Systematic review (2021) · cites this paper as [175]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
The Positive and Negative Syndrome Scale (PANSS) for schizophrenia.
Kay, S. R., Fiszbein, A., & Opler, L. A. (1987) · Schizophrenia Bulletin · doi:10.1093/schbul/13.2.261 · Cited by 21,378 · see citing works
The size and burden of mental disorders and other disorders of the brain in Europe 2010
Wittchen, H. U., Jacobi, F., Rehm, J., Gustavsson, A., Svensson, M., Jönsson, B., Olesen, J., Allgulander, C., Alonso, J., Faravelli, C., et al. (2011) · European Neuropsychopharmacology · doi:10.1016/j.euroneuro.2011.07.018 · Cited by 3,754 · see citing works
The clinical global impressions scale: applying a research tool in clinical practice.
Busner, J., & Targum, S. D. (2007) · PubMed Central · Cited by 1,952 · see citing works
The economic cost of brain disorders in Europe
Olesen, J., Gustavsson, A., Svensson, M., Wittchen, H., & Jönsson, B. (2012) · European Journal of Neurology · doi:10.1111/j.1468-1331.2011.03590.x · Cited by 1,560 · see citing works
(2001) · PubMed Central · Cited by 1,197 · see citing works
Feasibility, Acceptability, and Preliminary Efficacy of a Smartphone Intervention for Schizophrenia
Ben-Zeev, D., Brenner, C. J., Begale, M., Duffecy, J., Mohr, D. C., & Mueser, K. T. (2014) · Schizophrenia Bulletin · doi:10.1093/schbul/sbu033 · Cited by 493 · see citing works
The social and economic burden of treatment-resistant schizophrenia: a systematic literature review
Kennedy, J. L., Altar, C. A., Taylor, D. L., Degtiar, I., & Hornberger, J. C. (2014) · International Clinical Psychopharmacology · doi:10.1097/yic.0b013e32836508e6 · Cited by 392 · see citing works
Alvarez-Jimenez, M., Alcazar-Corcoles, M. A., González-Blanch, C., Bendall, S., McGorry, P. D., & Gleeson, J. F. (2014) · Schizophrenia Research · doi:10.1016/j.schres.2014.03.021 · Cited by 351 · see citing works
Emerging mHealth and eHealth interventions for serious mental illness: a review of the literature
Naslund, J. A., Marsch, L. A., McHugo, G. J., & Bartels, S. J. (2015) · Journal of Mental Health · doi:10.3109/09638237.2015.1019054 · Cited by 327 · see citing works
Granholm, E. L., Ben‐Zeev, D., Link, P. C., Bradshaw, K., & Holden, J. L. (2011) · Schizophrenia Bulletin · doi:10.1093/schbul/sbr155 · Cited by 300 · see citing works
Schizophrenia--Time to Commit to Policy Change
Fleischhacker, W. W., Arango, C., Arteel, P., Barnes, T. R. E., Carpenter, W., Duckworth, K., Galderisi, S., Halpern, L., Knapp, M., Marder, S. R., et al. (2014) · Schizophrenia Bulletin · doi:10.1093/schbul/sbu006 · Cited by 214 · see citing works
Towards a Framework for Evaluating Mobile Mental Health Apps
Chan, S., Torous, J., Hinton, L., & Yellowlees, P. (2015) · Telemedicine and e-Health · doi:10.1089/tmj.2015.0002 · Cited by 163 · see citing works
Ainsworth, J. D., Palmier‐Claus, J. E., Machin, M., Barrowclough, C., Dunn, G., Rogers, A. E., Buchan, I. E., Barkus, E., Kapur, S., Wykes, T., et al. (2013) · Journal of Medical Internet Research · doi:10.2196/jmir.2328 · Cited by 159 · see citing works
Rotondi, A. J., Sinkule, J., Haas, G. L., Spring, M. B., Litschge, C. M., Newhill, C. E., Ganguli, R., & ANDERSON, C. M. (2007) · Psychological Services · doi:10.1037/1541-1559.4.3.202 · Cited by 148 · see citing works
Hansson, L. I., Björkman, T., & Svensson, B. (1995) · Acta Psychiatrica Scandinavica · doi:10.1111/j.1600-0447.1995.tb09584.x · Cited by 139 · see citing works
Hansson, L. I., Vinding, H. R., Mackeprang, T., Sourander, A., Werdelin, G., Bengtsson‐Tops, A., Bjarnason, Ó., Dybbro, J., Nilsson, L.-L., Sandlund, M., et al. (2001) · Acta Psychiatrica Scandinavica · doi:10.1034/j.1600-0447.2001.00083.x · Cited by 120 · see citing works
Clozapine Eligibility Among State Hospital Patients
Essock, S. M., Hargreaves, W. A., Dohm, F.-A., Goethe, J., Carver, L., & Hipshman, L. (1996) · Schizophrenia Bulletin · doi:10.1093/schbul/22.1.15 · Cited by 107 · see citing works
Rotondi, A. J., Eack, S. M., Hanusa, B. H., Spring, M. B., & Haas, G. L. (2013) · Schizophrenia Bulletin · doi:10.1093/schbul/sbt194 · Cited by 106 · see citing works
A comparison of needs of patients with schizophrenia in five European countries: the EPSILON Study
McCrone, P., Leese, M., Thornicroft, G., Schene, A. H., Knudsen, H. C., Vázquez‐Barquero, J. L., Tansella, M., Becker, T. M., & EPSILON Study Group (2001) · Acta Psychiatrica Scandinavica · doi:10.1034/j.1600-0447.2001.00207.x · Cited by 92 · see citing works
Met and Unmet Needs of Schizophrenia Patients in a Spanish Sample
Ochoa, S., Haro, J. M., Autonell, J., Pendas, A., Teba, F., Marquez, M., & the NEDES Group (2003) · Schizophrenia Bulletin · doi:10.1093/oxfordjournals.schbul.a006998 · Cited by 89 · see citing works
Self-citationvan der Krieke, L., Emerencia, A. C., Boonstra, N., Wunderink, L., de Jonge, P., & Sytema, S. (2013) · Journal of Medical Internet Research · doi:10.2196/jmir.2851 · Cited by 80 · see citing works
Mobile Technologies in the Study, Assessment, and Treatment of Schizophrenia
Ben‐Zeev, D. (2012) · Schizophrenia Bulletin · doi:10.1093/schbul/sbr179 · Cited by 71 · see citing works
Hamann, J., Kohl, S., McCabe, R., Bühner, M., Mendel, R., Albus, M., & Bernd, J. C. (2015) · Social Psychiatry and Psychiatric Epidemiology · doi:10.1007/s00127-015-1089-z · Cited by 70 · see citing works
Do needs, symptoms or disability of outpatients with schizophrenia influence family burden?
Ochoa, S., Vilaplana, M., Haro, J. M., Villalta‐Gil, V., Martínez, F., Negredo, M., Casacuberta, P., Paniego, E., Usall, J., Dolz, M., et al. (2008) · Social Psychiatry and Psychiatric Epidemiology · doi:10.1007/s00127-008-0337-x · Cited by 69 · see citing works
Self-citationTelemonitoring of Medication Adherence in Patients with Schizophrenia
Frangou, S., Sachpazidis, I., Stassinakis, A., & Sakas, G. (2005) · Telemedicine Journal and e-Health · doi:10.1089/tmj.2005.11.675 · Cited by 68 · see citing works
Välimäki, M., Athanasopoulou, C., Lahti, M., & Adams, C. E. (2016) · Journal of Medical Internet Research · doi:10.2196/jmir.5385 · Cited by 68 · see citing works
The evolving definition of treatment resistance.
Peuskens, J. (1999) · PubMed · Cited by 66 · see citing works
Effects of stringent criteria on eligibility for clozapine among public mental health clients
Juarez-Reyes, M. G., Shumway, M., Battle, C., Bacchetti, P., Hansen, M. S., & Hargreaves, W. A. (1995) · Psychiatric Services · doi:10.1176/ps.46.8.801 · Cited by 65 · see citing works
Archer, N., Keshavjee, K., Demers, C., & Lee, R. (2014) · Int. J. Medical Informatics · doi:10.1016/j.ijmedinf.2014.01.005 · Cited by 64 · see citing works
Needs and quality of life among patients with schizophrenia in five European centres
Becker, T. M., Leese, M., Krumm, S., Ruggeri, M., Vázquez‐Barquero, J. L., & EPSILON Study Group (2005) · Social Psychiatry and Psychiatric Epidemiology · doi:10.1007/s00127-005-0937-7 · Cited by 39 · see citing works
Daker‐White, G., & Rogers, A. E. (2013) · BMC Psychiatry · doi:10.1186/1471-244x-13-279 · Cited by 37 · see citing works
Elkis, H., & Meltzer, H. Y. (2007) · Brazilian Journal of Psychiatry · doi:10.1590/s1516-44462007000600002 · Cited by 33 · see citing works
Španiel, F., Novák, T., Motlová, L. B., Capkova, J., Slováková, A., Trančík, P., Matějka, M., & Höschl, C. (2015) · Journal of Psychiatric and Mental Health Nursing · doi:10.1111/jpm.12251 · Cited by 27 · see citing works
Lueboonthavatchai, P., & Lueboonthavatchai, O. (2006) · PubMed · Cited by 18 · see citing works
A Preliminary Study of Rehabilitation Needs of In-patients and Out-patients with Schizophrenia.
Gandotra, S., Paul, S. E., Daniel, M., Kumar, K., Raj, H. A., & Sujeetha, B. (2004) · PubMed Central · Cited by 14 · see citing works
Grover, S., Avasthi, A., Shah, S. H., Lakdawala, B. M., Chakraborty, K., Nebhinani, N., Kallivayalil, R., Dalal, P., Sinha, V., Khairkar, P. H., et al. (2015) · Indian Journal of Psychiatry · doi:10.4103/0019-5545.158185 · Cited by 13 · see citing works
Mulder, C. L., Ruud, T., Bähler, M., Kroon, H., & Priebe, S. (2013) · International Journal of Social Psychiatry · doi:10.1177/0020764013485941 · Cited by 12 · see citing works
Arvidsson, H. (2009) · International Journal of Social Psychiatry · doi:10.1177/0020764009106631 · Cited by 12 · see citing works
[Comparative study of the needs of patients with schizophrenia by gender].
Ochoa, S., Usall, J., Haro, J. M., Araya, S., Autonell, J., Busquets, E., & Gost, A. (2001) · PubMed · Cited by 11 · see citing works
Self-citationDescription and validation of a new scale for assessment of autonomy in patients with schizophrenia
Ma, M., & Rupchev, G. (2015) · S S Korsakov Journal of Neurology and Psychiatry · doi:10.17116/jnevro20151151153-57 · Cited by 3 · see citing works
Management of treatment resistant schizophrenia in medium secure care
Lopes, A. T., Gilluley, P. L., Veisi, M., Patel, S., Sukhwal, S., Dow, J., & Bendi, N. (2014) · Progress in Neurology and Psychiatry · doi:10.1002/pnp.349 · Cited by 2 · see citing works
Flagged first, then by citations
Research works printed but not linked: 1
- [34]Have PT Review Essay: Conversation Analysis Versus Other Approaches to Discourse Forum Qual Sozialforsch / Forum Qual Soc Res 2006 7 2
Cited by
Sorted by citations
Borghouts, J., Eikey, E., Mark, G., De Leon, C., Schueller, S. M., Schneider, M., Stadnick, N., Zheng, K., Mukamel, D., & Sorkin, D. H. (2021) · Journal of Medical Internet Research · doi:10.2196/24387 · Cited by 1,069 · see citing works
“Participants expressed a need to receive more structured use, for example, through app reminders or a human coach checking on them on a regular basis [49,50,113,122,133,137,139,148,150,163,175-182].”
BackgroundInfluentialSeppälä, J., De Vita, I., Jämsä, T., Miettunen, J., Isohanni, M., Rubinstein, K., Feldman, Y., Grasa, E., Corripio, I., Berdun, J., et al. (2019) · JMIR Mental Health · doi:10.2196/mental.9819 · Cited by 148 · see citing works
“m-RESIST is composed of three main parts: (1) a mobile phone connected to a smartwatch for patients and caregivers; (2) a Web-based dashboard for follow-up and monitoring by clinicians; and (3) a back-end system for managing data, interventions, and interactions between users [23].”
Self-citationEisner, E., Drake, R. J., Berry, N., Barrowclough, C., Emsley, R., Machin, M., & Bucci, S. (2019) · JMIR mHealth and uHealth · doi:10.2196/11568 · Cited by 73 · see citing works
“In contrast with clinicians’hypothetical views [39,60,61], most participants were happy with a clinician having automatic access to their responses.”
Eisner, E., Faulkner, S., Allan, S., Ball, H., Basilio, D. D., Nicholas, J., Priyam, A., Wilson, P. M., Zhang, X., & Bucci, S. (2025) · JMIR Mental Health · doi:10.2196/65246 · Cited by 65 · see citing works
“Data indicated that participants were most enthusiastic about passive sensing being used to track sleep [58,59,81,82,145] and activity patterns [58,59,81,82].”
Allan, S., Bradstreet, S., Mcleod, H., Farhall, J., Lambrou, M., Gleeson, J., Clark, A., EMPOWER Group, & Gumley, A. (2019) · Journal of Medical Internet Research · doi:10.2196/14366 · Cited by 44 · see citing works
“Furthermore, staff foreseeing digital interventions having an impact on staff roles and responsibilities is similar to previous qualitative research work conducted with mental health staff [29,51].”
BackgroundResultInfluentialmHealth for schizophrenia spectrum disorders management: A systematic review
Chivilgina, O., Wangmo, T., Elger, B. S., Heinrich, T. W., & Jotterand, F. (2020) · International Journal of Social Psychiatry · doi:10.1177/0020764020933287 · Cited by 55 · see citing works
Jonathan, G., Carpenter-Song, E. A., Brian, R. M., & Ben-Zeev, D. (2019) · Psychiatric Rehabilitation Journal · doi:10.1037/prj0000337 · Cited by 45 · see citing works
Berry, N., Machin, M., Ainsworth, J. D., Berry, K., Edge, D., Haddock, G., Lewis, S. W., Morris, R., & Bucci, S. (2020) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2020.602861 · Cited by 38 · see citing works
Gumley, A. I., Bradstreet, S., Ainsworth, J. D., Allan, S., Álvarez‐Jiménez, M., Birchwood, M. J., Briggs, A. H., Bucci, S., Cotton, S., Engel, L., et al. (2022) · Health Technology Assessment · doi:10.3310/hlze0479 · Cited by 37 · see citing works
Mobile Health Apps, Family Caregivers, and Care Planning: Scoping Review
Kelley, M. M., Powell, T. P., Camara, D. S., Shah, N., Norton, J. M., Deitelzweig, C., Vaidy, N., Hsiao, C., Wang, J., & Bierman, A. S. (2024) · Journal of Medical Internet Research · doi:10.2196/46108 · Cited by 29 · see citing works
Allan, S., McLeod, H. J., Bradstreet, S., Beedie, S. A., Moir, B., Gleeson, J., Farhall, J., Morton, E. E., & Gumley, A. I. (2019) · JMIR Research Protocols · doi:10.2196/15634 · Cited by 16 · see citing works
“Such an understanding has broader implications for the management of psychosis and can inform the development of digital interventions for people with similar mental health problems, building on learning from previous qualitative work [75-80].”
Wu, T., Xiao, X., Yan, S., Fang, Y., Wang, M., Zu, F., Zhang, Y., & Qian, R. (2023) · BMJ Open · doi:10.1136/bmjopen-2023-071984 · Cited by 14 · see citing works
“79 94 It is advised that a standard for data storage, usage and sharing be reached with transparent and relevant policies for the user during application.”
BackgroundAlonso-Solís, A., Rubinstein, K., Corripio, I., Jääskeläinen, E., Seppälä, A., Vella, V. A., Mendivelso, J. C., Caspi, A., Isohanni, M. K., Unoka, Z., et al. (2018) · BMJ Open · doi:10.1136/bmjopen-2017-021346 · Cited by 14 · see citing works
“The hypothetic positive acceptability of the solution in terms of usefulness, increase of patient’s empowerment and social contact promotion was shown.(10) The current study protocol corresponds to the second stage of the project, aimed at ensuring that the designed solution satisfies the needs of end-users.”
BackgroundSelf-citationLlaneza, D. H., Llaneza, A. J., & Kozlov, E. (2022) · Clinical Gerontologist · doi:10.1080/07317115.2022.2154728 · Cited by 11 · see citing works
“…mHealth engagement is a critical component for future app use, with recent studies demonstrating that facilitating social connectedness (Borghouts et al., 2021; Huerta-Ramos et al., 2016) and providing relevant content (Feng & Campbell, 2011) are helpful enhancements to increase mHealth engagement.”
BackgroundGrasa, E., Seppälä, J., Alonso-Solís, A., Haapea, M., Isohanni, M. K., Miettunen, J., Mendivelso, J. C., Almazán, C., Rubinstein, K., Caspi, A., et al. (2023) · JMIR Formative Research · doi:10.2196/46179 · Cited by 10 · see citing works
“Second, we designed an intervention acceptable and with potential usability for TRS, with capacity for innovation at 2 levels: (1) methodological, created from a model where the patients with TRS and their needs are at the center [47] and (2) technological, intervention based on sensors, app, and web-based platform th…”
MethodSelf-citationAlsaqqa, H. H., & Alwawi, A. A. (2023) · Frontiers in Public Health · doi:10.3389/fpubh.2023.1142443 · Cited by 6 · see citing works
Alonso-Solís, A., Ochoa, S., Grasa, E., Rubinstein, K., Caspi, A., Farkas, K., Unoka, Z., Usall, J., Huerta‐Ramos, E., Isohanni, M. K., et al. (2020) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph17207527 · Cited by 4 · see citing works
“As reported by our group, the use of forums, web information and greater availability of medical care were issues of concern regarding continuity of attention [28].”
BackgroundSelf-citationDriving User Engagement: A Mixed‐Method Marketing Approach for Digital Mental Health Intervention
Jena, R. K., Botella-Carrubí, D., & Móstoles, R. C. (2025) · Psychology and Marketing · doi:10.1002/mar.70060 · Cited by 1 · see citing works
Seppälä, J., Grasa, E., Alonso-Solís, A., Roldán, A., Haapea, M., Isohanni, M. K., Miettunen, J., Mendivelso, J. C., Almazán, C., Rubinstein, K., et al. (2025) · JMIR Human Factors · doi:10.2196/67659
“The positive acceptance of the m-RESIST solution was related to its usefulness in meeting user needs, its capacity to empower them, and its possibility of maintaining human contact [63].”
Self-citationGant, T., Taylor, K. M., Ward, T., Garety, P., & Hardy, A. (2026) · Internet Interventions · doi:10.1016/j.invent.2026.101013
- Authors
- Huerta-Ramos, E., Escobar-Villegas, M. S., Rubinstein, K., Unoka, Z. S., Grasa, E., Hospedales, M., Jääskeläinen, E., Rubio-Abadal, E., Caspi, A., Bitter, I., Berdun, J., Seppälä, J., Ochoa, S., Fazekas, K., M-RESIST Group, Corripio, I., & Usall, J.
- Affiliations
- Centro de Investigación Biomédica en Red de Salud Mental (ES)
- Sheba Medical Center (IL)
- Semmelweis University (HU)
- Hospital de Sant Pau (ES)
- TicSalut (ES)
- University of Oulu (FI)
- ORCID
- Venue
- JMIR mHealth and uHealth
- Publisher
- JMIR Publications Inc.
- Published
- 2016-09-28
- Volume
- 4
- Issue
- 3
- Pages
- e112
- ISSN
- 2291-5222 (ISSN-L)
- PMC
- PMC5062002
- OpenAlex
- W2525448552
- Cited by
- 20
- References
- 41
- Citations by year
- 2026: 1 · 2025: 3 · 2024: 1 · 2023: 3 · 2022: 2 · 2021: 1 · 2020: 3 · 2019: 2 · 2018: 4
- FWCI
- 3.73
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- JMIR mhealth and uhealth (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Semmelweis University Repository (Semmelweis University) (submittedVersion)
- Topics
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Telemedicine and Telehealth Implementation
- Keywords
- treatment-resistant schizophrenia, mobile health, patient receptivity, informal caregivers, clinicians, user needs, instant messaging, clinical alerts, patient empowerment, online support groups
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
