Untold Stories in User-Centered Design of Mobile Health: Practical Challenges and Strategies Learned From the Design and Evaluation of an App for Older Adults With Heart Failure
Open accessThe DOI matches its Crossref record; 25 of the 25 references it cites were found in a registry or an index.
Abstract
Background: User-centered design (UCD) is a powerful framework for creating useful, easy-to-use, and satisfying mobile health (mHealth) apps. However, the literature seldom reports the practical challenges of implementing UCD, particularly in the field of mHealth. Objective: This study aims to characterize the practical challenges encountered and propose strategies when implementing UCD for mHealth. Methods: Our multidisciplinary team implemented a UCD process to design and evaluate a mobile app for older adults with heart failure. During and after this process, we documented the challenges the team encountered and the strategies they used or considered using to address those challenges. Results: We identified 12 challenges, 3 about UCD as a whole and 9 across the UCD stages of formative research, design, and evaluation. Challenges included the timing of stakeholder involvement, overcoming designers’ assumptions, adapting methods to end users, and managing heterogeneity among stakeholders. To address these challenges, practical recommendations are provided to UCD researchers and practitioners. Conclusions: UCD is a gold standard approach that is increasingly adopted for mHealth projects. Although UCD methods are well-described and easily accessible, practical challenges and strategies for implementing them are underreported. To improve the implementation of UCD for mHealth, we must tell and learn from these traditionally untold stories.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research
(1988) · Advances in Psychology · doi:10.1016/s0166-4115(08)62386-9 · Cited by 15,003
The critical incident technique.
Flanagan, J. C. (1954) · Psychological Bulletin · doi:10.1037/h0061470 · Cited by 8,191 · cited 1×
“These interviews used the critical incident technique, a method that asks participants to recall and describe a specific event or scenario and uses probes to better understand the participants’ thoughts and actions during the event or scenario [48,49].”
MethodAn Empirical Evaluation of the System Usability Scale
Bangor, A., Kortum, P. T., & Miller, J. T. (2008) · International Journal of Human–Computer Interaction · doi:10.1080/10447310802205776 · Cited by 5,181 · cited 1×
“For example, most standardized usability scales have technical or difficult words [86]; thus, many studies edit these measures, for example, by changing the “cumbersome” in the SUS to “awkward” [88].”
BackgroundA mathematical model of the finding of usability problems
Nielsen, J., & Landauer, T. K. (1993) · Proceedings of the SIGCHI conference on Human factors in computing systems - CHI '93 · doi:10.1145/169059.169166 · Cited by 1,961
Roger, V. L. (2013) · Circulation Research · doi:10.1161/circresaha.113.300268 · Cited by 1,728 · cited 1×
“On the basis of previous literature, we knew that these patients had unmet needs and required additional support to monitor and manage symptoms and various related behaviors, including medication use, dietary and fluid restriction, and physical activity [35-37].”
BackgroundRoutledge International Handbook of Participatory Design
(2012) · doi:10.4324/9780203108543 · Cited by 1,606
Handbook of Research on Educational Communications and Technology
(2014) · doi:10.1007/978-1-4614-3185-5 · Cited by 1,475
The impact of mHealth interventions: systematic review of systematic reviews
Marcolino, M. S., Oliveira, J. A. Q., D'Agostino, M., Ribeiro, A. L., Alkmim, M. B. M., & Novillo-Ortiz, D. (2018) · JMIR mHealth and uHealth · doi:10.2196/mhealth.8873 · Cited by 1,163 · cited 1×
“Increasingly, UCD has been recommended and adopted in mHealth projects to great success [7], with many examples of mHealth for people living with HIV [5,8], chronic conditions [9-11], or mental illness [6,12,13].”
BackgroundUser involvement: A review of the benefits and challenges
Kujala, S. (2003) · Behaviour & Information Technology · doi:10.1080/01449290301782 · Cited by 943 · cited 4×
“Other strategies to mitigate incorrect assumptions include conducting more frequent testing or including stakeholders on design teams to challenge assumptions during the design process [50,71].”
BackgroundInfluentialMethods of usability testing in the development of eHealth applications: A scoping review
Maramba, I., Chatterjee, A., & Newman, C. (2019) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2019.03.018 · Cited by 602 · cited 1×
“analysis), and reduce workload (eg, use of automated usability data collection or analysis) [90].”
BackgroundA user-centered model for designing consumer mobile health (mHealth) applications (apps)
Schnall, R., Rojas, M., Bakken, S., Brown, W., Carballo-Dieguez, A., Carry, M., Gelaude, D., Mosley, J. P., & Travers, J. (2016) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2016.02.002 · Cited by 583
Mapping mHealth research: a decade of evolution
Fiordelli, M., Diviani, N., & Schulz, P. J. (2013) · Journal of Medical Internet Research · doi:10.2196/jmir.2430 · Cited by 570 · cited 2×
“…the one hand, there is sometimes a mismatch between the use of UCD methods (eg, rapid prototyping, user testing) and emerging technologies (eg, sensors) and, on the other hand, traditions (eg, clinical trials) and technological conservatism that characterize much of the health care sector [27-29].”
BackgroundmHealth Consumer Apps : The Case for User-Centered Design
McCurdie, T., Taneva, S., Casselman, M., Yeung, M., McDaniel, C., Ho, W., & Cafazzo, J. (2012) · Biomedical Instrumentation & Technology · doi:10.2345/0899-8205-46.s2.49 · Cited by 478
Iterative user-interface design
Nielsen, J. (1993) · Computer · doi:10.1109/2.241424 · Cited by 444
Systematic review of smartphone-based passive sensing for health and wellbeing
Cornet, V. P., & Holden, R. J. (2018) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2017.12.008 · Cited by 406 · cited 2×
“…the one hand, there is sometimes a mismatch between the use of UCD methods (eg, rapid prototyping, user testing) and emerging technologies (eg, sensors) and, on the other hand, traditions (eg, clinical trials) and technological conservatism that characterize much of the health care sector [27-29].”
BackgroundSelf-citationLainscak, M., Blue, L., Clark, A. L., Dahlström, U., Dickstein, K., Ekman, I., McDonagh, T., McMurray, J. J., Ryder, M., Stewart, S., et al. (2011) · European Journal of Heart Failure · doi:10.1093/eurjhf/hfq219 · Cited by 405
mHealth 2.0: Experiences, Possibilities, and Perspectives
Becker, S., Miron-Shatz, T., Schumacher, N., Krocza, J., Diamantidis, C., & Albrecht, U.-V. (2014) · JMIR mHealth and uHealth · doi:10.2196/mhealth.3328 · Cited by 354
Design and Evaluation in eHealth: Challenges and Implications for an Interdisciplinary Field
Pagliari, C. (2007) · Journal of Medical Internet Research · doi:10.2196/jmir.9.2.e15 · Cited by 275
Designing eHealth that Matters via a Multidisciplinary Requirements Development Approach
Van Velsen, L., Wentzel, J., & Van Gemert-Pijnen, J. E. (2013) · JMIR Research Protocols · doi:10.2196/resprot.2547 · Cited by 262 · cited 2×
“In general, end users tend to have more conventional preferences than designers [26].”
BackgroundMedication Adherence Apps: Review and Content Analysis
Ahmed, I., Ahmad, N. S., Ali, S., Ali, S., George, A., Saleem Danish, H., Uppal, E., Soo, J., Mobasheri, M. H., King, D., et al. (2018) · JMIR mHealth and uHealth · doi:10.2196/mhealth.6432 · Cited by 221 · cited 1×
“In mHealth projects, patients may be unaware of or reluctant to suggest all the technological possibilities granted by smartphones [29], such as push notifications [84] or smartphone sensors [27].”
BackgroundSeven lessons for interdisciplinary research on interactive digital health interventions
Blandford, A., Gibbs, J., Newhouse, N., Perski, O., Singh, A., & Murray, E. (2018) · DIGITAL HEALTH · doi:10.1177/2055207618770325 · Cited by 209 · cited 1×
“Multidisciplinary collaboration is often encouraged in UCD [6,65,66], including partnerships between designers and clinicians [67,68].”
BackgroundKlersy, C., Boriani, G., De Silvestri, A., Mairesse, G. H., Braunschweig, F., Scotti, V., Balduini, A., Cowie, M. R., Leyva, F., & for the Health Economics Committee of the European Heart Rhythm Association (2016) · European Journal of Heart Failure · doi:10.1002/ejhf.470 · Cited by 120 · cited 1×
“Many patients with heart failure have CIEDs for the delivery of timely cardiac therapy and the capturing of data that can predict decompensation and other events leading to hospitalization and other downstream outcomes [38,39].”
BackgroundVilardaga, R., Rizo, J., Zeng, E., Kientz, J. A., Ries, R., Otis, C., & Hernandez, K. (2018) · JMIR Serious Games · doi:10.2196/games.8881 · Cited by 90 · cited 1×
“Increasingly, UCD has been recommended and adopted in mHealth projects to great success [7], with many examples of mHealth for people living with HIV [5,8], chronic conditions [9-11], or mental illness [6,12,13].”
BackgroundToscos, T., Drouin, M., Pater, J., Flanagan, M., Pfafman, R., & Mirro, M. J. (2019) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocz058 · Cited by 38
Self-citationPatient-centered Design Grounded in User and Clinical Realities: Towards Valid Digital Health
Cornet, V. P., Daley, C., Bolchini, D., Toscos, T., Mirro, M. J., & Holden, R. J. (2019) · Proceedings of the International Symposium on Human Factors and Ergonomics in Health Care · doi:10.1177/2327857919081023 · Cited by 25 · cited 3×
“As mHealth technologies become more pervasive, navigating practical UCD challenges is essential for the development of “safe, sound, and desirable” [30] mHealth solutions that improve health outcomes while involving stakeholders in the design process [31,32].”
BackgroundMethodSelf-citation
Cited by
(2021) · doi:10.2196/29512 · Cited by 91
Optimizing mobile app design for older adults: systematic review of age-friendly design
Amouzadeh, E., Dianat, I., Faradmal, J., & Babamiri, M. (2025) · Aging Clinical and Experimental Research · doi:10.1007/s40520-025-03157-7 · Cited by 55
Stara, V., Vera, B., Bolliger, D., Rossi, L., Felici, E., Di Rosa, M., de Jong, M., & Paolini, S. (2020) · JMIR mHealth and uHealth · doi:10.2196/25891 · Cited by 36
Tarricone, R., Petracca, F., Svae, L., Cucciniello, M., & Ciani, O. (2024) · eBioMedicine · doi:10.1016/j.ebiom.2024.105091 · Cited by 26
“124 No other variable demonstrated a differential impact on app effectiveness, including diabetes type, except for study design: pilot and feasibility RCTs exhibited a more favourable pooled effect than full-scale studies, con-fi rming that larger trials are often associated with smaller, yet closer…”
Background
Metadata
- Authors
- Cornet, V. P., Toscos, T., Bolchini, D., Rohani Ghahari, R., Ahmed, R., Daley, C., Mirro, M. J., & Holden, R. J.
- Venue
- JMIR mHealth and uHealth
- Publisher
- JMIR Publications Inc.
- Published
- 2020-07-21
- Volume
- 8
- Issue
- 7
- Pages
- e17703
- ISSN
- 2291-5222 (ISSN-L)
- OpenAlex
- W3045088856
- Cited by
- 96
- References
- 25
- FWCI
- 12.95
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.