Strategies for mHealth Research: Lessons from 3 Mobile Intervention Studies
Open accessThe DOI matches its Crossref record; 22 of the 22 references it cites were found in a registry or an index.
Abstract
The capacity of Mobile Health (mHealth) technologies to propel healthcare forward is directly linked to the quality of mobile interventions developed through careful mHealth research. mHealth research entails several unique characteristics, including collaboration with technologists at all phases of a project, reliance on regional telecommunication infrastructure and commercial mobile service providers, and deployment and evaluation of interventions “in the wild”, with participants using mobile tools in uncontrolled environments. In the current paper, we summarize the lessons our multi-institutional/multi-disciplinary team has learned conducting a range of mHealth projects using mobile phones with diverse clinical populations. First, we describe three ongoing projects that we draw from to illustrate throughout the paper. We then provide an example for multidisciplinary teamwork and conceptual mHealth intervention development that we found to be particularly useful. Finally, we discuss mHealth research challenges (i.e. evolving technology, mobile phone selection, user characteristics, the deployment environment, and mHealth system “bugs and glitches”), and provide recommendations for identifying and resolving barriers, or preventing their occurrence altogether.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Defining empirically supported therapies.
Chambless, D. L., & Hollon, S. D. (1998) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.66.1.7 · Cited by 3,067 · cited 8×
“In our experience, skipping over a small field trial to help identify and resolve “bugs” will not save any time; the first few participants that enter the trial will encounter enough problems that they will effectively be field trial users rather than participants in an RCT.”
BackgroundInfluentialHeron, K. E., & Smyth, J. M. (2010) · British Journal of Health Psychology · doi:10.1348/135910709x466063 · Cited by 1,438
Mobile Health Technology Evaluation
Kumar, S., Nilsen, W. J., Abernethy, A., Atienza, A., Patrick, K., Pavel, M., Riley, W. T., Shar, A., Spring, B., Spruijt-Metz, D., et al. (2013) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2013.03.017 · Cited by 900
Self-citationA stage model of behavioral therapies research: getting started and moving on from stage I.
Rounsaville, B. J., Carroll, K. M., & Onken, L. S. (2001) · Clinical Psychology: Science and Practice · doi:10.1093/clipsy.8.2.133 · Cited by 846 · cited 8×
“In our experience, skipping over a small field trial to help identify and resolve “bugs” will not save any time; the first few participants that enter the trial will encounter enough problems that they will effectively be field trial users rather than participants in an RCT.”
BackgroundInfluentialA Stage Model of Behavioral Therapies Research: Getting Started and Moving on From Stage I
Rounsaville, B. J., Carroll, K. M., & Onken, L. S. (2001) · Clinical Psychology: Science and Practice · doi:10.1093/clipsy/8.2.133 · Cited by 846
mHealth for mental health: Integrating smartphone technology in behavioral healthcare.
Luxton, D. D., McCann, R. A., Bush, N. E., Mishkind, M. C., & Reger, G. M. (2011) · Professional Psychology: Research and Practice · doi:10.1037/a0024485 · Cited by 809 · cited 3×
“Smartphones can host health applications (apps) designed to be used by patients and providers for diagnostics, behavioral prompts, reminders, and continuous illness monitoring and self-management programs that extend well beyond the boundaries of a physical clinic (Ben-Zeev et al. 2012; Harrison et al. 2011; Luxton et…”
BackgroundHarnessing context sensing to develop a mobile intervention for depression
Burns, M. N., Begale, M., Duffecy, J., Gergle, D., Karr, C. J., Giangrande, E., & Mohr, D. C. (2011) · Journal of Medical Internet Research · doi:10.2196/jmir.1838 · Cited by 646 · cited 2×
“A pilot study conducted with participants with major depressive disorder provided support for the intervention model, and initial development and evaluation of the contextsensing system (Burns et al. 2011).”
MethodSelf-citationInternet-based self-help for depression: randomised controlled trial
Andersson, G., Bergström, J., Holländare, F., Carlbring, P., Kaldo, V., & Ekselius, L. (2005) · British Journal of Psychiatry · doi:10.1192/bjp.187.5.456 · Cited by 529 · cited 2×
“Work in mHealth ranges from interventions that take content from another medium and provide it in technological formats (e.g., websites that are essential self-help books delivered online, Carlbring et al. 2005; Andersson et al. 2005) to interventions that link principles of behavioral change to the use of technologic…”
BackgroundFeasibility, Acceptability, and Preliminary Efficacy of a Smartphone Intervention for Schizophrenia
Ben-Zeev, D., Brenner, C. J., Begale, M., Duffecy, J., Mohr, D. C., & Mueser, K. T. (2014) · Schizophrenia Bulletin · doi:10.1093/schbul/sbu033 · Cited by 493 · cited 2×
“The FOCUS system offers both system-prompted and on demand user-initiated interventions, including coping strategies for psychotic symptoms, social skills training, behavioral tailoring for medication adherence, mood regulation, guidance for sleep hygiene, and behavioral activation (Ben-Zeev et al., 2014).”
BackgroundSelf-citationLow vs. high-fidelity prototyping debate
Rudd, J., Stern, K., & Isensee, S. (1996) · Interactions · doi:10.1145/223500.223514 · Cited by 422 · cited 1×
“In these fields, low-fidelity prototyping (Rudd et al. 1996), A/B testing (Hekler et al. 2013), iterative design (Pagliari 2007), and agile development (Martin 2003) are used to more rapidly create and refine products prior to evaluation as these designs preference adaptability and generating data…”
MethodHow to evaluate technologies for health behavior change in HCI research
Klasnja, P., Consolvo, S., & Pratt, W. (2011) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1978942.1979396 · Cited by 414 · cited 1×
“Identifying these proximate goals, however, requires clinical experts to specify the specific behavior change strategies incorporated within their mHealth interventions (Klasnja et al. 2011).”
BackgroundTreatment of panic disorder: live therapy vs. self-help via the Internet
Carlbring, P., Nilsson-Ihrfelt, E., Waara, J., Kollenstam, C., Buhrman, M., Kaldo, V., Söderberg, M., Ekselius, L., & Andersson, G. (2005) · Behaviour Research and Therapy · doi:10.1016/j.brat.2004.10.002 · Cited by 372 · cited 1×
“…that take content from another medium and provide it in technological formats (e.g., websites that are essential self-help books delivered online, Carlbring et al., 2005; Andersson et al., 2005) to interventions that link principles of behavioral change to the use of technological features…”
BackgroundMind the theoretical gap: interpreting, using, and developing behavioral theory in HCI research
Hekler, E. B., Klasnja, P., Froehlich, J. E., & Buman, M. P. (2013) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2470654.2466452 · Cited by 328
The Multiphase Optimization Strategy for Engineering Effective Tobacco Use Interventions
Collins, L. M., Baker, T. B., Mermelstein, R. J., Piper, M. E., Jorenby, D. E., Smith, S. S., Christiansen, B. A., Schlam, T. R., Cook, J. W., & Fiore, M. C. (2011) · Annals of Behavioral Medicine · doi:10.1007/s12160-010-9253-x · Cited by 300
Design and Evaluation in eHealth: Challenges and Implications for an Interdisciplinary Field
Pagliari, C. (2007) · Journal of Medical Internet Research · doi:10.2196/jmir.9.2.e15 · Cited by 275
Mobile mental health: Review of the emerging field and proof of concept study
Harrison, V., Proudfoot, J., Wee, P. P., Parker, G., Pavlovic, D. H., & Manicavasagar, V. (2011) · Journal of Mental Health · doi:10.3109/09638237.2011.608746 · Cited by 267
Rapid, responsive, relevant (R3) research: a call for a rapid learning health research enterprise
Riley, W. T., Glasgow, R. E., Etheredge, L., & Abernethy, A. P. (2013) · Clinical and Translational Medicine · doi:10.1186/2001-1326-2-10 · Cited by 267 · cited 2×
“Riley and colleagues (2013) discuss the technological advances that occur during the standard time period required for a typical RCT to move from grant submission to publication (Riley et al. 2013).”
BackgroundMobile technologies among people with serious mental illness: Opportunities for future services
Ben-Zeev, D., Davis, K. E., Kaiser, S., Krzsos, I., & Drake, R. E. (2013) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-012-0424-x · Cited by 249 · cited 3×
“Although national statistics and results from other studies can be useful to describe overall trends, we have found that these statistics are oftentimes not applicable to many of the populations we work with (Ben-Zeev et al. 2013).”
BackgroundMethodResultEstablishing Guidelines for Executing and Reporting Internet Intervention Research
Proudfoot, J., Klein, B., Barak, A., Carlbring, P., Cuijpers, P., Lange, A., Ritterband, L., & Andersson, G. (2011) · Cognitive Behaviour Therapy · doi:10.1080/16506073.2011.573807 · Cited by 202
Aguilera, A., & Muñoz, R. F. (2011) · Professional Psychology: Research and Practice · doi:10.1037/a0025499 · Cited by 159
Realizing the Potential of Behavioral Intervention Technologies
Schueller, S. M., Muñoz, R. F., & Mohr, D. C. (2013) · Current Directions in Psychological Science · doi:10.1177/0963721413495872 · Cited by 152 · cited 3×
“This is not surprising, as technological features have the potential to significantly advance and alter the way research and practice are conducted (Marsch and Ben-Zeev 2012; Schueller et al. 2013).”
BackgroundMethodSelf-citationKaplan, R. M., & Stone, A. A. (2013) · Annual Review of Psychology · doi:10.1146/annurev-psych-113011-143736 · Cited by 144 · cited 2×
“More and more researchers from different health disciplines are interested in developing evidencebased mHealth interventions for a range of physical and mental health conditions (Heron and Smyth 2010; Kaplan and Stone 2013).”
Background
Cited by
Harnessing Smartphone-Based Digital Phenotyping to Enhance Behavioral and Mental Health
Onnela, J.-P., & Rauch, S. L. (2016) · Neuropsychopharmacology · doi:10.1038/npp.2016.7 · Cited by 726
Nahum-Shani, I., Hekler, E. B., & Spruijt-Metz, D. (2015) · Health Psychology · doi:10.1037/hea0000306 · Cited by 568
The impact of digital technology on psychological treatments and their dissemination
Fairburn, C. G., & Patel, V. (2017) · Behaviour Research and Therapy · doi:10.1016/j.brat.2016.08.012 · Cited by 448
Ben-Zeev, D., Scherer, E. A., Wang, R., Xie, H., & Campbell, A. T. (2015) · Psychiatric Rehabilitation Journal · doi:10.1037/prj0000130 · Cited by 429
Self-citationSystematic review of smartphone-based passive sensing for health and wellbeing
Cornet, V. P., & Holden, R. J. (2018) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2017.12.008 · Cited by 406
“A major general recommendation to address some of the above issues is for technology specialists (e.g., informaticists, computer scientists) to partner more e ff ectively with clinical experts to identify and address problems amenable to passive sensing [69,88,89].”
Background
Metadata
- Authors
- Ben-Zeev, D., Schueller, S. M., Begale, M., Duffecy, J., Kane, J. M., & Mohr, D. C.
- Venue
- Administration and Policy in Mental Health and Mental Health Services Research
- Published
- 2014-05-14
- Volume
- 42
- Issue
- 2
- Pages
- 157-167
- ISSN
- 0894-587X (ISSN-L)
- 1573-3289
- OpenAlex
- W1989475997
- Cited by
- 165
- References
- 22
- FWCI
- 23.81
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.