The DOI matches its Crossref record; 29 of the 30 references it cites were found in a registry or an index.
A Development and Evaluation Process for mHealth Interventions: Examples From New Zealand
Abstract
The authors established a process for the development and testing of mobile phone-based health interventions that has been implemented in several mHealth interventions developed in New Zealand. This process involves a series of steps: conceptualization, formative research to inform the development, pretesting content, pilot study, pragmatic randomized controlled trial, and further qualitative research to inform improvement or implementation. Several themes underlie the entire process, including the integrity of the underlying behavior change theory, allowing for improvements on the basis of participant feedback, and a focus on implementation from the start. The strengths of this process are the involvement of the target audience in the development stages and the use of rigorous research methods to determine effectiveness. The limitations include the time required and potentially a less formalized and randomized approach than some other processes. This article aims to describe the steps and themes in the mHealth development process, using the examples of a mobile phone video messaging smoking cessation intervention and a mobile phone multimedia messaging depression prevention intervention, to stimulate discussion on these and other potential methods.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Interventions were delivered in a variety of settings (e.g. inpatient, outpatient clinics and home-based settings) and targeted a wide range of conditions, such as mental health conditions [28, 30, 35, 40, 47], stroke [31, 36, 39], cancer [29, 32, 33, 37, 42] and other chronic illnesses [25, 34, 38].”
From Optimisation of complex health interventions prior to a randomised controlled trial: a scoping review of strategies used (2016) · cites this paper as [47]
In the citing paper
“and one study conducted in New Zealand introduced and applied new guidelines specifically for the development of mobile health interventions [47].”
From Optimisation of complex health interventions prior to a randomised controlled trial: a scoping review of strategies used (2016) · cites this paper as [47]
In the citing paper
“Optimisation strategies applying qualitative methods tended to explore acceptability and feasibility issues [26, 30, 32, 34, 39, 47, 48].”
From Optimisation of complex health interventions prior to a randomised controlled trial: a scoping review of strategies used (2016) · cites this paper as [47]
In the citing paper
“Several studies employed well-established qualitative methods including interviews or focus groups with providers and recipients or relevant stakeholders [26, 30, 32, 34, 39, 47, 48] and observations and consensus processes including researchers, patients and clinical experts [31].”
From Optimisation of complex health interventions prior to a randomised controlled trial: a scoping review of strategies used (2016) · cites this paper as [47]
In the citing paper
“The current literature provides some guidance on how to adapt mobile phone-based interventions (for use in countries wherein it was not specifically designed), acknowledging the essential role of the end user in this process [24,46,47].”
From Assessing the Cross-Cultural Adaptation and Translation of a Text-Based Mobile Smoking Cessation Program in Samoa (TXTTaofiTapaa): Pilot Study (2018) · cites this paper as [46]
In the citing paper
“The development of TextMATCH was guided by our previously developed mHealth Development and Evaluation framework [24]”
From Development of a Culturally Tailored Text Message Maternal Health Program: TextMATCH (2017) · cites this paper as [24]
Citations
Cites
(1985) · Medical Entomology and Zoology · Cited by 19,180
Pharmacological interventions for somatoform disorders in adults
Kleinstäuber, M., Witthöft, M., Steffanowski, A., van Marwijk, H., Hiller, W., & Lambert, M. J. (2014) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd010628.pub2 · Cited by 11,369
The New Zealand Medical Journal 1887-1987.
Rg, R. (1987) · PubMed · Cited by 3,673
Improving the reporting of pragmatic trials: An extension of the CONSORT statement
Zwarenstein, M., Treweek, S., Gagnier, J. J., Altman, D. G., Tunis, S., Haynes, B., Oxman, A. D., Moher, D., & groups, F. T. C. A. P. T. I. H. (. (2008) · BMJ · doi:10.1136/bmj.a2390 · Cited by 1,813
Behavior change interventions delivered by mobile telephone short message service
Fjeldsoe, B. S., Marshall, A. L., & Miller, Y. D. (2009) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2008.09.040 · Cited by 1,213 · cited 1×
“Four published reviews of the research concluded that there was evidence of significant effects in smoking cessation, behavior change outcomes, and healthcare processes (Cole-Lewis & Kershaw, 2010 ; Fjeldsoe, Marshall, & Miller, 2009 ; Krishna, Boren, & Balas, 2009 ; Whittaker et al, 2009 ).”
BackgroundText messaging as a tool for behavior change in disease prevention and management
Cole-Lewis, H., & Kershaw, T. (2010) · Epidemiologic Reviews · doi:10.1093/epirev/mxq004 · Cited by 1,190 · cited 2×
“Some researchers may argue that the comparison should include similar contact time (Cole-Lewis & Kershaw, 2010).”
BackgroundCollins, L. M., Murphy, S. A., & Strecher, V. (2007) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2007.01.022 · Cited by 1,082
Mobile phone-based interventions for smoking cessation
Whittaker, R., McRobbie, H., Bullen, C., Rodgers, A., & Gu, Y. (2016) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd006611.pub4 · Cited by 1,079
Self-citationHealthcare via Cell Phones: A Systematic Review
Krishna, S., Boren, S. A., & Balas, E. A. (2009) · Telemedicine and e-Health · doi:10.1089/tmj.2008.0099 · Cited by 882
Rodgers, A., Corbett, T., Bramley, D., Riddell, T., Wills, M., Lin, R.-B., & Jones, M. (2005) · Tobacco Control · doi:10.1136/tc.2005.011577 · Cited by 732
Free, C., Knight, R., Robertson, S., Whittaker, R., Edwards, P., Zhou, W., Rodgers, A., Cairns, J., Kenward, M. G., & Roberts, I. (2011) · The Lancet · doi:10.1016/s0140-6736(11)60701-0 · Cited by 728
Self-citationTheory-driven design strategies for technologies that support behavior change in everyday life
Consolvo, S., McDonald, D. W., & Landay, J. A. (2009) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/1518701.1518766 · Cited by 594
Mobile Therapy: Case Study Evaluations of a Cell Phone Application for Emotional Self-Awareness
Morris, M. E., Kathawala, Q., Leen, T. K., Gorenstein, E. E., Guilak, F., Labhard, M., & Deleeuw, W. (2010) · Journal of Medical Internet Research · doi:10.2196/jmir.1371 · Cited by 384
iPhone Apps for Smoking Cessation
Abroms, L. C., Padmanabhan, N., Thaweethai, L., & Phillips, T. (2011) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2010.10.032 · Cited by 365
Intervention Mapping: Protocol for Applying Health Psychology Theory to Prevention Programmes
Kok, G., Schaalma, H. P., Ruiter, R. A. C., van Empelen, P., & Brug, J. (2004) · Journal of Health Psychology · doi:10.1177/1359105304038379 · Cited by 362
A Randomized Placebo-Controlled Trial of a School-Based Depression Prevention Program
Merry, S., McDOWELL, H., Wild, C. J., Bir, J., & Cunliffe, R. (2004) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1097/00004583-200405000-00007 · Cited by 249
Self-citationSEXINFO: A Sexual Health Text Messaging Service for San Francisco Youth
Levine, D., McCright, J., Dobkin, L., Woodruff, A. J., & Klausner, J. D. (2008) · American Journal of Public Health · doi:10.2105/ajph.2007.110767 · Cited by 228
Whittaker, R., Dorey, E., Bramley, D. M., Bullen, C., Denny, S., Elley, C. R., Maddison, R., McRobbie, H. J., Parag, V., Rodgers, A., et al. (2011) · Journal of Medical Internet Research · doi:10.2196/jmir.1553 · Cited by 201
Self-citationMobile phone-based interventions for smoking cessation
Whittaker, R., Borland, R., Bullen, C., Lin, R. B., McRobbie, H., & Rodgers, A. (2009) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd006611.pub2 · Cited by 196
Self-citationTxt2stop: a pilot randomised controlled trial of mobile phone-based smoking cessation support
Free, C., Whittaker, R., Knight, R., Abramsky, T., Rodgers, A., & Roberts, I. G. (2009) · Tobacco Control · doi:10.1136/tc.2008.026146 · Cited by 181
Self-citationWhittaker, R., Maddison, R., McRobbie, H., Bullen, C., Denny, S., Dorey, E., Ellis-Pegler, M., van Rooyen, J., & Rodgers, A. (2008) · Journal of Medical Internet Research · doi:10.2196/jmir.1007 · Cited by 171
Self-citationWhittaker, R., Merry, S., Stasiak, K., McDowell, H., Doherty, I., Shepherd, M., Dorey, E., Parag, V., Ameratunga, S., & Rodgers, A. (2012) · Journal of Medical Internet Research · doi:10.2196/jmir.1857 · Cited by 161 · cited 1×
“4Described in Whittaker et al., 2012. case vignettes (n = 2; Bauer, Percevic, Okon, Meerman, & Kordy, 2003) and a proofof-concept study (n = 31) using text messaging in the treatment of bulimia nervosa (Shapiro et al., 2008); focus groups in evaluation of a sexual health text messaging service…”
BackgroundSelf-citationSmoking cessation using mobile phone text messaging is as effective in Maori as non-Maori.
Bramley, D. M., Riddell, T., Whittaker, R., Corbett, T., Lin, R., Wills, M., Jones, M., & Rodgers, A. (2005) · PubMed · Cited by 157
Self-citationUse of text messaging in the aftercare of patients with bulimia nervosa
Bauer, S., Percevic, R., Okon, E., Meermann, R., & Kordy, H. (2003) · European Eating Disorders Review · doi:10.1002/erv.521 · Cited by 148
Gold, J., Lim, M. S., Hellard, M. E., Hocking, J. S., & Keogh, L. (2010) · BMC Public Health · doi:10.1186/1471-2458-10-792 · Cited by 145
Grimes, A., Kantroo, V., & Grinter, R. E. (2010) · ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp) · doi:10.1145/1864349.1864370 · Cited by 141
Mobile therapy: Use of text‐messaging in the treatment of bulimia nervosa
Shapiro, J. R., Bauer, S., Andrews, E. M., Pisetsky, E. M., Bulik-Sullivan, B. K., Hamer, R. M., & Bulik, C. M. (2009) · International Journal of Eating Disorders · doi:10.1002/eat.20744 · Cited by 111
HEART: heart exercise and remote technologies: A randomized controlled trial study protocol
Maddison, R., Whittaker, R., Stewart, R., Kerr, A., Jiang, Y., Kira, G., Carter, K., & Dale, L. P. (2011) · BMC Cardiovascular Disorders · doi:10.1186/1471-2261-11-26 · Cited by 41
Self-citationInstitutos de Investigación Sanitaria
Miquel-Collell, C. (2011) · Enfermería Clínica · doi:10.1016/j.enfcli.2011.01.004 · Cited by 30
Research works printed but not linked: 4
- Adler R., 2009, Texting 4 health: A simple, powerful way to improve lives, 9
- Bramley D., 2005, New Zealand Medical Journal, 18, U1494
- Milne K., 2009, Evaluation of the first year of the Txt 2 Quit service: 17 June 2008–16 June 2009
- World Health Organization . ( 2011 ).mHealth: New horizons for health through mobile technologies. Global Observatory for eHealth Series(Vol. 3). Geneva, Switzerland: Author.
Cited by
Sorted by citations
Mummah, S. A., Robinson, T. N., King, A. C., Gardner, C. D., & Sutton, S. (2016) · Journal of Medical Internet Research · doi:10.2196/jmir.5927 · Cited by 388
Human-centered design for global health equity
Holeman, I., & Kane, D. (2020) · Information Technology for Development · doi:10.1080/02681102.2019.1667289 · Cited by 285
Ben‐Zeev, D., Kaiser, S. M., Brenner, C. J., Begale, M. J., Duffecy, J. L., & Mohr, D. C. (2013) · Psychiatric Rehabilitation Journal · doi:10.1037/prj0000019 · Cited by 306
Brown, W., Yen, P.-Y., Rojas, M., & Schnall, R. (2013) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2013.08.001 · Cited by 299
Maddison, R., Pfaeffli, L., Whittaker, R., Stewart, R., Kerr, A., Jiang, Y., Kira, G., Leung, W., Dalleck, L., Carter, K., et al. (2015) · European Journal of Preventive Cardiology · doi:10.1177/2047487314535076 · Cited by 268
Self-citation
Metadata
- Authors
- Whittaker, R., Merry, S., Dorey, E., & Maddison, R.
- Affiliations
- University of Auckland (NZ)
- Corresponding author
- Whittaker, Robyn
- Venue
- Journal of Health Communication
- Publisher
- Informa UK Limited
- Published
- 2012-05-02
- Volume
- 17
- Issue
- sup1
- Pages
- 11-21
- ISSN
- 1081-0730 (ISSN-L)
- 1087-0415
- OpenAlex
- W2123284020
- Cited by
- 263
- References
- 30
- Citations by year
- 2026: 6 · 2025: 12 · 2024: 18 · 2023: 9 · 2022: 19 · 2021: 23 · 2020: 21 · 2019: 22 · 2018: 32 · 2017: 27 · 2016: 20 · 2015: 28 · 2014: 15 · 2013: 8 · 2012: 3
- FWCI
- 30.68
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of Health Communication (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Smoking Behavior and Cessation
- Keywords
- mobile health intervention, formative research, pilot study, pragmatic randomized controlled trial, behaviour change theory, participant feedback, implementation, user participation, smoking cessation, depression prevention, video messaging, multimedia messaging
- MeSH terms
- Adolescent, Adult, Depression, Follow-Up Studies, Humans, New Zealand, Pilot Projects, Research Design, Video Recording, Program Evaluation, Randomized Controlled Trials as Topic, Smoking Cessation, Program Development, Focus Groups, Telemedicine, Multimedia, Qualitative Research, Cell Phone, Young Adult, Health Communication
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review