A user-centered model for designing consumer mobile health (mHealth) applications (apps)
Open accessAbstract
Background Mobile technologies are a useful platform for the delivery of health behavior interventions. Yet little work has been done to create a rigorous and standardized process for the design of mobile health (mHealth) apps. This project sought to explore the use of the Information Systems Research (ISR) framework as guide for the design of mHealth apps.Methods Our work was guided by the ISR framework which is comprised of 3 cycles: Relevance, Rigor and Design. In the Relevance cycle, we conducted 5 focus groups with 33 targeted end-users. In the Rigor cycle, we performed a review to identify technology-based interventions for meeting the health prevention needs of our target population. In the Design Cycle, we employed usability evaluation methods to iteratively develop and refine mock-ups for a mHealth app.Results Through an iterative process, we identified barriers and facilitators to the use of mHealth technology for HIV prevention for high-risk MSM, developed 'use cases' and identified relevant functional content and features for inclusion in a design document to guide future app development. Findings from our work support the use of the ISR framework as a guide for designing future mHealth apps.Discussion Results from this work provide detailed descriptions of the user-centered design and system development and have heuristic value for those venturing into the area of technology-based intervention work. Findings from this study support the use of the ISR framework as a guide for future mHealth app development.Conclusion Use of the ISR framework is a potentially useful approach for the design of a mobile app that incorporates end-users' design preferences.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Few frameworks allow for a holistic approach to mHealth app design in developing and under-resourced contexts.
“Currently, few frameworks allow for this holistic approach to mHealth app design in developing and under-resourced contexts. While frameworks are available for the design of mHealth apps [9, 14, 15], few are formulated for a developing context.”
From A user-centred design framework for mHealth (2020) · cites this paper as [9]
The Objective and Discussion > Guidelines for Future Mobile App Development (pages not provided) describe a holistic mHealth design approach as relatively novel, supporting the general point that such approaches are limited. The paper does not assess how many frameworks are suited to developing or under-resourced contexts; its app-development example concerns HIV prevention for high-risk men who have sex with men. (LLM, conf=0.84)
Experimental — accuracy not yet measuredmHealth apps are particularly effective when created through user-centered design (UCD).
“and are particularly effective when created through user-centered design (UCD) [19-22].”
From Co-Designing the MOSAIC mHealth App With Breast Cancer Survivors: User-Centered Design Approach (2024) · cites this paper as [21]
The Discussion (‘Inclusion of End-Users in App Design’; page not provided) says that starting with users’ needs is critical to developing effective mHealth tools. It reports improved prototype usability through iterative user-centered design, but does not establish that UCD-created apps are particularly effective at achieving health outcomes. (LLM, conf=0.86)
Experimental — accuracy not yet measuredAs UCD sessions progress, UX designers bring simple prototype sketches to the team of users and content experts for continued evaluation, refinement, and further iteration.
“As the sessions progress, the UX designers bring simple prototype sketches to the team of users and content experts for continued evaluation, refinement, and further iteration [19,21,24].”
From Co-Designing the MOSAIC mHealth App With Breast Cancer Survivors: User-Centered Design Approach (2024) · cites this paper as [21]
The Methods sections on the Develop/Build and Evaluate cycles describe low-fidelity mock-ups that were tested by end users and usability experts, revised, and tested again. But the paper says participants made the initial sketches and the study team created mock-ups after the design sessions; it does not describe UX designers bringing sketches to a team of users and content experts as sessions progress. Page numbers were not available in our copy. (LLM, conf=0.84)
Experimental — accuracy not yet measuredThe ISR framework uses iterative, user-centred design processes to create artefacts, usually technological.
“The framework uses iterative, user-centred design processes to create artefacts, usually technological [9].”
From A user-centred design framework for mHealth (2020) · cites this paper as [9]
The design approach described in the paper addresses the cost and time concerns associated with the application of the ISR framework highlighted by Schnall et al. [9].
“Given the above considerations, we believe that the design approach described in this paper addresses the cost and time concerns associated with the application of the ISR framework highlighted by Schnall et al. [9].”
From A user-centred design framework for mHealth (2020) · cites this paper as [9]
mHealth implementation without end-user engagement might constrain desired outcomes, leading to unmet health objectives and possible adverse results.
“mHealth implementation without end-user engagement, might constrain the desired outcomes, leading to unmet health objectives and possible adverse results [3, 9].”
From A user-centred design framework for mHealth (2020) · cites this paper as [9]
Engagement with end-users could enable more appropriate mHealth app design.
“thus engagement with end-users could enable more appropriate app design [7–9].”
From A user-centred design framework for mHealth (2020) · cites this paper as [9]
A study attributed the failure of technology to its lack of regard for user requirements and experience.
“A study attributed the failure of technology to its lack of regard for user requirements and experience [24].”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Perceived usefulness, perceived ease of use, and user acceptance of information technology
Davis, F. D. (1989) · MIS Quarterly · doi:10.2307/249008 · Cited by 68,483 · see citing works
Qualitative research. Introducing focus groups.
Kitzinger, J. (1995) · BMJ · doi:10.1136/bmj.311.7000.299 · Cited by 6,939 · see citing works
Heuristic evaluation of user interfaces
Nielsen, J., & Molich, R. (1990) · Proceedings of the SIGCHI conference on Human factors in computing systems Empowering people - CHI '90 · doi:10.1145/97243.97281 · Cited by 3,533 · see citing works
Nielsen, J. (1994) · Conference companion on Human factors in computing systems - CHI '94 · doi:10.1145/259963.260531 · Cited by 2,759 · see citing works
Nielsen, J. (1995) · Conference companion on Human factors in computing systems - CHI '95 · doi:10.1145/223355.223730 · Cited by 2,620 · see citing works
IBM computer usability satisfaction questionnaires: Psychometric evaluation and instructions for use
Lewis, J. R. (1995) · International Journal of Human-Computer Interaction · doi:10.1080/10447319509526110 · Cited by 2,429 · see citing works
Nielsen, J. (1994) · Cited by 1,778 · see citing works
(2007) · Journal of the Association for Information Systems · Cited by 1,638 · see citing works
Telemonitoring in patients with heart failure
Chaudhry, S. I., Mattera, J. A., Curtis, J. P., Spertus, J. A., Herrin, J., Lin, Z., Phillips, C. O., Hodshon, B. V., Cooper, L. S., & Krumholz, H. M. (2010) · New England Journal of Medicine · doi:10.1056/nejmoa1010029 · Cited by 1,232 · see citing works
(2003) · CRC Press eBooks · doi:10.1201/9780367804787 · Cited by 1,227 · see citing works
Cooperstock, J. R. (2009) · Wiley eBooks · doi:10.1002/9780470050118.ecse524 · Cited by 1,084 · see citing works
Methods to support human-centred design
MAGUIRE, M. (2001) · International Journal of Human-Computer Studies · doi:10.1006/ijhc.2001.0503 · Cited by 1,057 · see citing works
Beyond the five-user assumption: benefits of increased sample sizes in usability testing
Faulkner, L. (2003) · Behavior Research Methods, Instruments, & Computers · doi:10.3758/bf03195514 · Cited by 1,053 · see citing works
Mobile Health Technology Evaluation
Kumar, S., Nilsen, W. J., Abernethy, A., Atienza, A., Patrick, K., Pavel, M., Riley, W. T., Shar, A., Spring, B., Spruijt-Metz, D., et al. (2013) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2013.03.017 · Cited by 900 · see citing works
Design of an mHealth app for the self-management of adolescent type 1 diabetes: a pilot study
Cafazzo, J. A., Casselman, M., Hamming, N., Katzman, D. K., & Palmert, M. R. (2012) · Journal of Medical Internet Research · doi:10.2196/jmir.2058 · Cited by 676 · see citing works
Mapping mHealth research: a decade of evolution
Fiordelli, M., Diviani, N., & Schulz, P. J. (2013) · Journal of Medical Internet Research · doi:10.2196/jmir.2430 · Cited by 570 · see citing works
Human-Computer Interaction (3rd Edition)
Dix, A. J., Finlay, J., Abowd, G. D., & Beale, R. (2003) · Prentice-Hall, Inc eBooks · Cited by 497 · see citing works
<i>mHealth Consumer Apps</i> : The Case for User-Centered Design
McCurdie, T., Taneva, S., Casselman, M., Yeung, M., McDaniel, C., Ho, W., & Cafazzo, J. (2012) · Biomedical Instrumentation & Technology · doi:10.2345/0899-8205-46.s2.49 · Cited by 478 · see citing works
What It Will Take To Achieve The As-Yet-Unfulfilled Promises Of Health Information Technology
Kellermann, A. L., & Jones, S. S. (2013) · Health Affairs · doi:10.1377/hlthaff.2012.0693 · Cited by 448 · see citing works
Ben‐Zeev, D., Kaiser, S. M., Brenner, C. J., Begale, M. J., Duffecy, J. L., & Mohr, D. C. (2013) · Psychiatric Rehabilitation Journal · doi:10.1037/prj0000019 · Cited by 306 · see citing works
Brown, W., Yen, P.-Y., Rojas, M., & Schnall, R. (2013) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2013.08.001 · Cited by 299 · see citing works
Self-citationAdvancing the science of mHealth
Nilsen, W., Kumar, S., Shar, A., Varoquiers, C., Wiley, T., Riley, W. T., Pavel, M., & Atienza, A. A. (2012) · Journal of Health Communication · doi:10.1080/10810730.2012.677394 · Cited by 226 · see citing works
eHealth Interventions for HIV Prevention in High-Risk Men Who Have Sex With Men: A Systematic Review
Schnall, R., Travers, J. L., Rojas, M., & Carballo‐Diéguez, A. (2014) · Journal of Medical Internet Research · doi:10.2196/jmir.3393 · Cited by 172 · see citing works
Self-citationCatalyzing social support for breast cancer patients
Skeels, M. M., Unruh, K. T., Powell, C., & Pratt, W. (2010) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/1753326.1753353 · Cited by 163 · see citing works
Nundy, S., Dick, J. J., Chou, C.-H., Nocon, R. S., Chin, M. H., & Peek, M. E. (2014) · Health Affairs · doi:10.1377/hlthaff.2013.0589 · Cited by 144 · see citing works
Kinzie, M. B. (2002) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m0822 · Cited by 136 · see citing works
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Bice, K. C., & Lewis, C. (1989) · Cited by 103 · see citing works
Schnall, R., Mosley, J. P., Iribarren, S. J., Bakken, S., Carballo-Diéguez, A., & Brown III, W. (2015) · JMIR mHealth and uHealth · doi:10.2196/mhealth.4882 · Cited by 89 · see citing works
Self-citationCassimatis, M., & Kavanagh, D. J. (2012) · Journal of Telemedicine and Telecare · doi:10.1258/jtt.2012.gth105 · Cited by 73 · see citing works
Sheehan, B., Lee, Y., Rodríguez, M. C., Tiase, V. L., & Schnall, R. (2012) · Applied Clinical Informatics · doi:10.4338/aci-2012-06-ra-0021 · Cited by 73 · see citing works
Self-citationAliabadi, N., Carballo‐Diéguez, A., Henry, S. B., Rojas, M., Brown, W., Carry, M., Mosley, J. P., Gelaude, D., & Schnall, R. (2015) · AIDS Education and Prevention · doi:10.1521/aeap.2015.27.6.522 · Cited by 64 · see citing works
Self-citationCurioso, W. H., Quistberg, D. A., Cabello, R. L., Gozzer, E., Garcia, P. J., Holmes, K. K., & Kurth, A. (2009) · PubMed Central · Cited by 50 · see citing works
Gordon, P. C., Camhi, E., Hesse, R., Odlum, M. L., Schnall, R., Rodriguez, M., Valdez, E., & Henry, S. B. (2012) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2012.06.004 · Cited by 45 · see citing works
Self-citationDevelopment and evaluation of nursing user interface screens using multiple methods
Hyun, S., Johnson, S. B., Stetson, P. D., & Henry, S. B. (2009) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2009.05.005 · Cited by 41 · see citing works
Heuristic evaluation of eNote: an electronic notes system.
Bright, T. J., Bakken, S. R., & Johnson, S. B. (2006) · PubMed · Cited by 24 · see citing works
Self-citationSchnall, R., Cimino, J. J., & Henry, S. B. (2012) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2012.05.002 · Cited by 22 · see citing works
Self-citationKaufman, N., & Patnoe-Woodley, P. D. (2011) · Journal of Diabetes Science and Technology · doi:10.1177/193229681100500335 · Cited by 19 · see citing works
Information needs of case managers caring for persons living with HIV
Schnall, R., Cimino, J. J., Currie, L. M., et al. (2011) · Journal of the American Medical Informatics Association · doi:10.1136/jamia.2010.006668 · Cited by 16 · see citing works
Self-citation
Flagged first, then by citations
Research works printed but not linked: 1
- [6]Kumar S Nilsen WJ Abernethy A Mobile health technology evaluation: the mHealth evidence workshop Am J Prev Med 2013 45 2 228 36 doi: 10.1016/j.amepre.2013.03.017 23867031 PMC3803146 · DOI · Paper page
Cited by
Sorted by citations
Methods of usability testing in the development of eHealth applications: A scoping review
Maramba, I., Chatterjee, A., & Newman, C. (2019) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2019.03.018 · Cited by 602 · see citing works
Unraveling the meaning of patient engagement: A concept analysis
Higgins, T., Larson, E., & Schnall, R. (2017) · Patient Education and Counseling · doi:10.1016/j.pec.2016.09.002 · Cited by 317 · see citing works
Self-citationArtificial intelligence in diabetes management: Advancements, opportunities, and challenges
Guan, Z., Li, H., Liu, R., Cai, C., Liu, Y., Li, J., Wang, X., Huang, S., Wu, L., Liu, D., et al. (2023) · Cell Reports Medicine · doi:10.1016/j.xcrm.2023.101213 · Cited by 287 · see citing works
Simblett, S., Greer, B., Matcham, F., Curtis, H., Polhemus, A., Ferrão, J., Gamble, P., & Wykes, T. (2018) · Journal of Medical Internet Research · doi:10.2196/10480 · Cited by 270 · see citing works
Criteria for assessing the quality of mHealth apps: a systematic review
Nouri, R., R Niakan Kalhori, S., Ghazisaeedi, M., Marchand, G., & Yasini, M. (2018) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocy050 · Cited by 231 · see citing works
A user-centred design framework for mHealth
Farao, J., Malila, B., Conrad, N., Mutsvangwa, T., Rangaka, M. X., & Douglas, T. S. (2020) · PLoS ONE · doi:10.1371/journal.pone.0237910 · Cited by 203 · see citing works
“…interventions is to promote healthy behaviours and facilitate a strengthening of health service delivery, prioritising patient and physician insights and needs becomes integral to the success of the intervention [6], thus engagement with end-users could enable more appropriate app design [7–9].”
BackgroundMethodInfluentialLau, N., O'Daffer, A., Colt, S., Yi-Frazier, J. P., Palermo, T. M., McCauley, E., & Rosenberg, A. R. (2020) · JMIR mhealth and uhealth · doi:10.2196/17798 · Cited by 174 · see citing works
Liew, M. S., Zhang, J., See, J., & Ong, Y. L. (2019) · JMIR mHealth and uHealth · doi:10.2196/12160 · Cited by 179 · see citing works
eHealth for improving quality of life in breast cancer patients: A systematic review
Triberti, S., Savioni, L., Sebri, V., & Pravettoni, G. (2019) · Cancer Treatment Reviews · doi:10.1016/j.ctrv.2019.01.003 · Cited by 184 · see citing works
User-Centered App Adaptation of a Low-Intensity E-Mental Health Intervention for Syrian Refugees
Burchert, S., Alkneme, M. S., Bird, M., Carswell, K., Cuijpers, P., Hansen, P., Heim, E., Harper Shehadeh, M., Sijbrandij, M., van't Hof, E., et al. (2019) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2018.00663 · Cited by 160 · see citing works
“Currently, only a few examples of systematic usability testing as an approach to optimizing the design, user engagement and relevance of mobile mental health programs exist (35–37).”
BackgroundMoore, G., Wilding, H., Gray, K., & Castle, D. (2019) · Journal of Participatory Medicine · doi:10.2196/11474 · Cited by 95 · see citing works
Korpershoek, Y. J. G., Hermsen, S., Schoonhoven, L., Schuurmans, M. J., & Trappenburg, J. C. A. (2020) · Journal of Medical Internet Research · doi:10.2196/15449 · Cited by 78 · see citing works
Zaidi, S., Kazi, A. M., Riaz, A., Ali, A., Najmi, R., Jabeen, R., Khudadad, U., & Sayani, S. (2020) · Journal of Medical Internet Research · doi:10.2196/18414 · Cited by 55 · see citing works
Creating an mHealth App for Colorectal Cancer Screening: User-Centered Design Approach
Griffin, L., Lee, D., Jaisle, A., Carek, P., George, T., Laber, E., Lok, B., Modave, F., Paskett, E., & Krieger, J. (2019) · JMIR Human Factors · doi:10.2196/12700 · Cited by 57 · see citing works
Smartphone apps for menstrual pain and symptom management: a scoping review
Trépanier, L. C. M., Lamoureux, É., Bjornson, S. E., Mackie, C., Alberts, N. M., & Gagnon, M. M. (2023) · Internet Interventions · doi:10.1016/j.invent.2023.100605 · Cited by 50 · see citing works
Sustainable Development for Mobile Health Apps Using the Human-Centered Design Process
An, Q., Kelley, M. M., Hanners, A., & Yen, P.-Y. (2023) · JMIR Formative Research · doi:10.2196/45694 · Cited by 52 · see citing works
Liu, Y.-C., Chen, C.-H., Lin, Y.-S., Chen, H.-Y., Irianti, D., Jen, T.-N., Yeh, J.-Y., & Chiu, S. Y.-H. (2020) · JMIR mHealth and uHealth · doi:10.2196/20317 · Cited by 41 · see citing works
“We developed our voice-added design based on a user-centered design model [30] through research, ideation, and implementation steps.”
Jackson, D. N., Sehgal, N., & Baur, C. (2022) · JMIR Formative Research · doi:10.2196/26764 · Cited by 28 · see citing works
Designing Disease-Specific mHealth Apps for Clinical Value
Keshavjee, K., Johnston-Jewell, D., Lee, B., & Kyba, R. (2022) · Smart and Pervasive Healthcare · doi:10.5772/intechopen.99945 · Cited by 6 · see citing works
Co-Designing the MOSAIC mHealth App With Breast Cancer Survivors: User-Centered Design Approach
Nuseibeh, B. Z., Johns, S. A., Shih, P. C., Lewis, G. F., Gowan, T. M., & Jordan, E. J. (2024) · JMIR Formative Research · doi:10.2196/59426 · Cited by 5 · see citing works
A Systematic Review of Usefulness Design Goals of Occupational mHealth Apps for Healthcare Workers.
Yingta, N., Nocera, J. A., Rehman, I. U., & Brew, O. (2021) · Electronic Workshops in Computing · doi:10.14236/ewic/hci2021.22 · Cited by 4 · see citing works
- Authors
- Schnall, R., Rojas, M., Bakken, S., Brown, W., Carballo-Dieguez, A., Carry, M., Gelaude, D., Mosley, J. P., & Travers, J.
- Affiliations
- Columbia University (US)
- Centers for Disease Control and Prevention (US)
- Corresponding author
- Schnall, Rebecca
- ORCID
- Venue
- Journal of Biomedical Informatics
- Publisher
- Elsevier BV
- Published
- 2016-04
- Volume
- 60
- Pages
- 243-251
- ISSN
- 1532-0464 (ISSN-L)
- PMC
- PMC4837063
- OpenAlex
- W2300935853
- Cited by
- 583
- References
- 39
- Citations by year
- 2026: 49 · 2025: 56 · 2024: 54 · 2023: 65 · 2022: 69 · 2021: 91 · 2020: 76 · 2019: 50 · 2018: 47 · 2017: 20 · 2016: 5 · 2015: 1
- FWCI
- 75.64
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Licence
- Locations
- Journal of Biomedical Informatics (publishedVersion)
- PubMed (publishedVersion)
- PubMed Central (acceptedVersion)
- Funders
- Columbia University School of Nursing
- Centers for Disease Control and Prevention
- Topics
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Keywords
- mobile health apps, user-centered design, HIV prevention, men who have sex with men, health behavior interventions, usability evaluation, mock-ups, barriers and facilitators, technology-based interventions, end-user involvement
- MeSH terms
- Adult, Algorithms, Communicable Disease Control, Humans, Information Systems, Male, Medical Informatics, Software Design, User-Computer Interface, HIV Infections, Focus Groups, Telemedicine, Homosexuality, Male, Cell Phone, Young Adult, Mobile Applications
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review