Strategies for mHealth Research: Lessons from 3 Mobile Intervention Studies
Open accessThe DOI matches its Crossref record; 22 of the 22 references it cites were found in a registry or an index.
Abstract
The capacity of Mobile Health (mHealth) technologies to propel healthcare forward is directly linked to the quality of mobile interventions developed through careful mHealth research. mHealth research entails several unique characteristics, including collaboration with technologists at all phases of a project, reliance on regional telecommunication infrastructure and commercial mobile service providers, and deployment and evaluation of interventions “in the wild”, with participants using mobile tools in uncontrolled environments. In the current paper, we summarize the lessons our multi-institutional/multi-disciplinary team has learned conducting a range of mHealth projects using mobile phones with diverse clinical populations. First, we describe three ongoing projects that we draw from to illustrate throughout the paper. We then provide an example for multidisciplinary teamwork and conceptual mHealth intervention development that we found to be particularly useful. Finally, we discuss mHealth research challenges (i.e. evolving technology, mobile phone selection, user characteristics, the deployment environment, and mHealth system “bugs and glitches”), and provide recommendations for identifying and resolving barriers, or preventing their occurrence altogether.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Defining empirically supported therapies.
Chambless, D. L., & Hollon, S. D. (1998) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.66.1.7 · Cited by 3,067 · cited 8×
“In our experience, skipping over a small field trial to help identify and resolve “bugs” will not save any time; the first few participants that enter the trial will encounter enough problems that they will effectively be field trial users rather than participants in an RCT.”
BackgroundInfluentialHeron, K. E., & Smyth, J. M. (2010) · British Journal of Health Psychology · doi:10.1348/135910709x466063 · Cited by 1,438
Mobile Health Technology Evaluation
Kumar, S., Nilsen, W. J., Abernethy, A., Atienza, A., Patrick, K., Pavel, M., Riley, W. T., Shar, A., Spring, B., Spruijt-Metz, D., et al. (2013) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2013.03.017 · Cited by 900
Self-citationA stage model of behavioral therapies research: getting started and moving on from stage I.
Rounsaville, B. J., Carroll, K. M., & Onken, L. S. (2001) · Clinical Psychology: Science and Practice · doi:10.1093/clipsy.8.2.133 · Cited by 846 · cited 8×
“In our experience, skipping over a small field trial to help identify and resolve “bugs” will not save any time; the first few participants that enter the trial will encounter enough problems that they will effectively be field trial users rather than participants in an RCT.”
BackgroundInfluentialA Stage Model of Behavioral Therapies Research: Getting Started and Moving on From Stage I
Rounsaville, B. J., Carroll, K. M., & Onken, L. S. (2001) · Clinical Psychology: Science and Practice · doi:10.1093/clipsy/8.2.133 · Cited by 846
mHealth for mental health: Integrating smartphone technology in behavioral healthcare.
Luxton, D. D., McCann, R. A., Bush, N. E., Mishkind, M. C., & Reger, G. M. (2011) · Professional Psychology: Research and Practice · doi:10.1037/a0024485 · Cited by 809 · cited 3×
“Smartphones can host health applications (apps) designed to be used by patients and providers for diagnostics, behavioral prompts, reminders, and continuous illness monitoring and self-management programs that extend well beyond the boundaries of a physical clinic (Ben-Zeev et al. 2012; Harrison et al. 2011; Luxton et…”
BackgroundHarnessing context sensing to develop a mobile intervention for depression
Burns, M. N., Begale, M., Duffecy, J., Gergle, D., Karr, C. J., Giangrande, E., & Mohr, D. C. (2011) · Journal of Medical Internet Research · doi:10.2196/jmir.1838 · Cited by 646 · cited 2×
“A pilot study conducted with participants with major depressive disorder provided support for the intervention model, and initial development and evaluation of the contextsensing system (Burns et al. 2011).”
MethodSelf-citationInternet-based self-help for depression: randomised controlled trial
Andersson, G., Bergström, J., Holländare, F., Carlbring, P., Kaldo, V., & Ekselius, L. (2005) · British Journal of Psychiatry · doi:10.1192/bjp.187.5.456 · Cited by 529 · cited 2×
“Work in mHealth ranges from interventions that take content from another medium and provide it in technological formats (e.g., websites that are essential self-help books delivered online, Carlbring et al. 2005; Andersson et al. 2005) to interventions that link principles of behavioral change to the use of technologic…”
BackgroundFeasibility, Acceptability, and Preliminary Efficacy of a Smartphone Intervention for Schizophrenia
Ben-Zeev, D., Brenner, C. J., Begale, M., Duffecy, J., Mohr, D. C., & Mueser, K. T. (2014) · Schizophrenia Bulletin · doi:10.1093/schbul/sbu033 · Cited by 493 · cited 2×
“The FOCUS system offers both system-prompted and on demand user-initiated interventions, including coping strategies for psychotic symptoms, social skills training, behavioral tailoring for medication adherence, mood regulation, guidance for sleep hygiene, and behavioral activation (Ben-Zeev et al., 2014).”
BackgroundSelf-citationLow vs. high-fidelity prototyping debate
Rudd, J., Stern, K., & Isensee, S. (1996) · Interactions · doi:10.1145/223500.223514 · Cited by 422 · cited 1×
“In these fields, low-fidelity prototyping (Rudd et al. 1996), A/B testing (Hekler et al. 2013), iterative design (Pagliari 2007), and agile development (Martin 2003) are used to more rapidly create and refine products prior to evaluation as these designs preference adaptability and generating data…”
Method
Cited by
Harnessing Smartphone-Based Digital Phenotyping to Enhance Behavioral and Mental Health
Onnela, J.-P., & Rauch, S. L. (2016) · Neuropsychopharmacology · doi:10.1038/npp.2016.7 · Cited by 726
Nahum-Shani, I., Hekler, E. B., & Spruijt-Metz, D. (2015) · Health Psychology · doi:10.1037/hea0000306 · Cited by 568
The impact of digital technology on psychological treatments and their dissemination
Fairburn, C. G., & Patel, V. (2017) · Behaviour Research and Therapy · doi:10.1016/j.brat.2016.08.012 · Cited by 448
Ben-Zeev, D., Scherer, E. A., Wang, R., Xie, H., & Campbell, A. T. (2015) · Psychiatric Rehabilitation Journal · doi:10.1037/prj0000130 · Cited by 429
Self-citationSystematic review of smartphone-based passive sensing for health and wellbeing
Cornet, V. P., & Holden, R. J. (2018) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2017.12.008 · Cited by 406
“A major general recommendation to address some of the above issues is for technology specialists (e.g., informaticists, computer scientists) to partner more e ff ectively with clinical experts to identify and address problems amenable to passive sensing [69,88,89].”
BackgroundA Systematic Review of Cognitive Behavioral Therapy and Behavioral Activation Apps for Depression
Huguet, A., Rao, S., McGrath, P. J., Wozney, L., Wheaton, M., Conrod, J., & Rozario, S. (2016) · PLOS ONE · doi:10.1371/journal.pone.0154248 · Cited by 328
Using text message reminders in health care services: A narrative literature review
Schwebel, F. J., & Larimer, M. E. (2018) · Internet Interventions · doi:10.1016/j.invent.2018.06.002 · Cited by 238
mHealth in the Wild: Using Novel Data to Examine the Reach, Use, and Impact of PTSD Coach
Owen, J. E., Jaworski, B. K., Kuhn, E., Makin-Byrd, K. N., Ramsey, K. M., & Hoffman, J. E. (2015) · JMIR Mental Health · doi:10.2196/mental.3935 · Cited by 216
“Mobile health (mHealth) refers to an interdisciplinary branch of eHealth, focused on utilizing mobile technologies for health improvement initiatives [2,3].”
Mohr, D. C., Schueller, S. M., Riley, W. T., Brown, C. H., Cuijpers, P., Duan, N., Kwasny, M. J., Stiles-Shields, C., & Cheung, K. (2015) · Journal of Medical Internet Research · doi:10.2196/jmir.4391 · Cited by 216
“User feedback is also commonly captured both through self-report surveys as well as through interviews with users at the end of treatment or at specified points during treatment [28].”
Self-citationRohani, D. A., Faurholt-Jepsen, M., Kessing, L. V., & Bardram, J. E. (2017) · doi:10.2196/preprints.9691 · Cited by 195
“Social included features such as call duration and number of conversations, which can be accessed on Android phones, contrary to iPhones [77].”
BackgroundMorrison, L. G., Hargood, C., Pejovic, V., Geraghty, A. W. A., Lloyd, S., Goodman, N., Michaelides, D. T., Weston, A., Musolesi, M., Weal, M. J., et al. (2017) · PLoS ONE · doi:10.1371/journal.pone.0169162 · Cited by 162
“Smartphones enable on-the-go delivery of intervention content via push notifications that can be delivered at convenient times for the user or when specific intervention content is needed [10,11].”
BackgroundBeyond the Randomized Controlled Trial: A Review of Alternatives in mHealth Clinical Trial Methods
Pham, Q., Wiljer, D., & Cafazzo, J. A. (2016) · JMIR mHealth and uHealth · doi:10.2196/mhealth.5720 · Cited by 162
“mHealth researchers have recognized a host of research implementation barriers, from the deployment environment, to app bugs and glitches, to user characteristics and eHealth literacy [37].”
BackgroundEvaluating the Impact of Physical Activity Apps and Wearables: Interdisciplinary Review
McCallum, C., Rooksby, J., & Gray, C. M. (2018) · JMIR mhealth and uhealth · doi:10.2196/mhealth.9054 · Cited by 126
“However, evaluating the impact of physical activity technologies can be challenging, because of the rapid rate at which they evolve [10-12].”
BackgroundSyrjala, K. L., Yi, J. C., Artherholt, S. B., Romano, J. M., Crouch, M.-L., Fiscalini, A. S., Hegel, M. T., Flowers, M. E. D., Martin, P. J., & Leisenring, W. M. (2018) · Journal of Cancer Survivorship · doi:10.1007/s11764-018-0693-9 · Cited by 76
“Therefore, particularly for younger adults, mobile applications and texting focused on shorter and more frequent interactions may be more effective [81].”
Korpershoek, Y. J. G., Hermsen, S., Schoonhoven, L., Schuurmans, M. J., & Trappenburg, J. C. A. (2020) · Journal of Medical Internet Research · doi:10.2196/15449 · Cited by 78
Dahne, J., Lejuez, C. W., Diaz, V. A., Player, M. S., Kustanowitz, J., Felton, J. W., & Carpenter, M. J. (2019) · Behavior Therapy · doi:10.1016/j.beth.2018.12.003 · Cited by 78
Smartphone-Based Psychotherapeutic Micro-Interventions to Improve Mood in a Real-World Setting
Meinlschmidt, G., Lee, J.-H., Stalujanis, E., Belardi, A., Oh, M., Jung, E. K., Kim, H.-C., Alfano, J., Yoo, S.-S., & Tegethoff, M. (2016) · Frontiers in Psychology · doi:10.3389/fpsyg.2016.01112 · Cited by 68
Kannisto, K. A., Korhonen, J., Adams, C. E., Koivunen, M. H., Vahlberg, T., & Välimäki, M. A. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.6417 · Cited by 69
“Patients’ illness-related issues [14,19] and perceived stigma were seen as barriers to participation in previous studies [36,37].”
BackgroundNeCamp, T., Sen, S., Frank, E., Walton, M. A., Ionides, E. L., Fang, Y., Tewari, A., & Wu, Z. (2020) · Journal of Medical Internet Research · doi:10.2196/15033 · Cited by 55
Mobile Health for First Nations Populations: Systematic Review
Hobson, G. R., Caffery, L. J., Neuhaus, M., & Langbecker, D. H. (2019) · JMIR mHealth and uHealth · doi:10.2196/14877 · Cited by 55
“158) [56], noting that they require realism, collaboration, and flexibility of research teams.”
BackgroundA Gamified Smartphone-Based Intervention for Depression: Randomized Controlled Pilot Trial
Lukas, C. A., Eskofier, B., & Berking, M. (2021) · JMIR Mental Health · doi:10.2196/16643 · Cited by 49
Mobile App Use by Primary Care Patients to Manage Their Depressive Symptoms: Qualitative Study
Pung, A., Fletcher, S. L., & Gunn, J. M. (2018) · Journal of Medical Internet Research · doi:10.2196/10035 · Cited by 42
Terp, M., Jørgensen, R., Laursen, B. S., Mainz, J., & Bjørnes, C. D. (2018) · JMIR Mental Health · doi:10.2196/10157 · Cited by 41
Brandt, L. R., Hidalgo, L., Diez-Canseco, F., Araya, R., Mohr, D. C., Menezes, P. R., & Miranda, J. J. (2019) · JMIR Mental Health · doi:10.2196/11701 · Cited by 32
“Although in-person interventions based on behavioral activation usually have a duration of 5 to 12 weekly sessions, with each session lasting approximately 45 min [69,70], interventions using technology need to deliver the core elements of the treatment by adapting them to the interface used and not as a mere copy of…”
MethodSelf-citationMOUKADDAM, N., TRUONG, A., CAO, J., SHAH, A., & SABHARWAL, A. (2019) · Journal of Psychiatric Practice · doi:10.1097/pra.0000000000000420 · Cited by 28
Lukas, C. A., Trevisi Fuentes, H., & Berking, M. (2019) · Internet Interventions · doi:10.1016/j.invent.2019.100250 · Cited by 27
Patient-centered Design Grounded in User and Clinical Realities: Towards Valid Digital Health
Cornet, V. P., Daley, C., Bolchini, D., Toscos, T., Mirro, M. J., & Holden, R. J. (2019) · Proceedings of the International Symposium on Human Factors and Ergonomics in Health Care · doi:10.1177/2327857919081023 · Cited by 25
“Although short, iterative design-andevaluation cycles are valued when focusing on usability (Gould & Lewis, 1985), they are not ideal for evaluating clinical outcomes (Ben-Zeev et al., 2014).”
BackgroundMethodBaek, J. H., Kim, J. H., Oh, S., Kim, J. Y., & Baik, S. (2018) · Psychiatry Investigation · doi:10.30773/pi.2018.08.10 · Cited by 12
Metadata
- Authors
- Ben-Zeev, D., Schueller, S. M., Begale, M., Duffecy, J., Kane, J. M., & Mohr, D. C.
- Venue
- Administration and Policy in Mental Health and Mental Health Services Research
- Published
- 2014-05-14
- Volume
- 42
- Issue
- 2
- Pages
- 157-167
- ISSN
- 0894-587X (ISSN-L)
- 1573-3289
- OpenAlex
- W1989475997
- Cited by
- 165
- References
- 22
- FWCI
- 23.81
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.