Lack of Adoption of a Mobile App to Support Patient Self-Management of Diabetes and Hypertension in a Federally Qualified Health Center: Interview Analysis of Staff and Patients in a Failed Randomized Trial
Open accessAbstract
BACKGROUND: Thousands of mobile health (mHealth) apps have been developed to support patients' management of their health, but the effectiveness of many of the apps remains unclear. While mHealth apps appear to hold promise for improving the self-management of chronic conditions across populations, failure to balance the system demands of the app with the needs, interests, or resources of the end users can undermine consumers' adoption of these technologies. OBJECTIVE: The original aim of this study was to evaluate the effectiveness of a commercial mHealth app in improving clinical outcomes for adult patients in a Federally Qualified Health Center (FQHC) with uncontrolled diabetes and/or hypertension. Patients entered clinical data into the app, which also supported messaging between patients and providers. After a 4-month period of vigorous recruitment, the trial was suspended due to low enrollment and inconsistent use of the app by enrolled patients. The project aim was changed to understanding why the trial was unsuccessful. METHODS: We used the user-task-context (eUTC) usability framework to develop a set of interview questions for patients and staff who were involved in the trial. All interviews were done by phone and lasted 20 to 30 minutes. Interviews were not recorded. RESULTS: There was a poor fit between the app, end users, and recruitment and treatment approaches in our setting. Usability testing might have revealed this prior to launch but was not an option. There was not sufficient time during routine care for clinical staff to familiarize patients with the app or to check clinical data and messages, which are unreimbursed activities. Some patients did not use the app appropriately. The lack of integration with the electronic health record (EHR) was cited as a problem for both patients and staff who also said the app was just one more thing to attend to. CONCLUSIONS: This brief trial underscores the pitfalls in the utilization of mHealth apps. Effective use of mHealth tools requires a good fit between the app, the users' electronic health (eHealth) literacy, the treatment approach, staff time, and reimbursement for services. The last 3 are contextual factors of the setting that affected the adoption of the app and context is an important factor in implementation science. We recommend that researchers address contextual factors in the trial and adoption of mHealth technologies.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Researchers evaluated a range of measures that aligned with their target chronic condition, such as blood glucose, weight, symptoms, patient-reported outcomes, diary entries, and steps.
“Researchers evaluated a range of measures that aligned with their target chronic condition, such as blood glucose [56,60,61,64,73], weight [56,73,74], symptoms [66,68,69], patient-reported outcomes [38,46,52,65,71], diary entries [47,66], and steps [51].”
From A Library of Analytic Indicators to Evaluate Effective Engagement with Consumer mHealth Apps for Chronic Conditions: Scoping Review (2019) · cites this paper as [73]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Damschroder, L. J., Aron, D. C., Keith, R. E., Kirsh, S. R., Alexander, J. A., & Lowery, J. C. (2009) · Implementation Science · doi:10.1186/1748-5908-4-50 · Cited by 14,496 · see citing works
eHEALS: The eHealth Literacy Scale
Norman, C. D., & Skinner, H. A. (2006) · Journal of Medical Internet Research · doi:10.2196/jmir.8.4.e27 · Cited by 2,680 · see citing works
eHealth Literacy: Essential Skills for Consumer Health in a Networked World.
Norman, C. D., & Skinner, H. A. (2006) · Journal of Medical Internet Research · doi:10.2196/jmir.8.2.e9 · Cited by 2,643 · see citing works
Free, C., Phillips, G., Galli, L., Watson, L., Felix, L., Edwards, P., Patel, V., & Haines, A. (2013) · PLoS Medicine · doi:10.1371/journal.pmed.1001362 · Cited by 1,766 · see citing works
Can Mobile Phone Apps Influence People’s Health Behavior Change? An Evidence Review
Zhao, J., Freeman, B., & Li, M. (2016) · Journal of Medical Internet Research · doi:10.2196/jmir.5692 · Cited by 618 · see citing works
Usability of Commercially Available Mobile Applications for Diverse Patients
Sarkar, U., Gourley, G. I., Lyles, C. R., Tieu, L., Clarity, C., Newmark, L., Singh, K., & Bates, D. W. (2016) · Journal of General Internal Medicine · doi:10.1007/s11606-016-3771-6 · Cited by 257 · see citing works
Kayser, L., Kushniruk, A. W., Osborne, R. H., Nørgaard, O., & Turner, P. A. (2015) · JMIR Human Factors · doi:10.2196/humanfactors.3696 · Cited by 163 · see citing works
Hsu, W. C., Lau, K. H. K., Huang, R., Ghiloni, S., Le, H., Gilroy, S., Abrahamson, M., & Moore, J. (2016) · Diabetes Technology & Therapeutics · doi:10.1089/dia.2015.0160 · Cited by 135 · see citing works
Bauer, A. M., Thielke, S. M., Katon, W. J., Unützer, J., & Areán, P. A. (2014) · Preventive Medicine · doi:10.1016/j.ypmed.2014.06.017 · Cited by 113 · see citing works
Assessing mHealth: Opportunities and Barriers to Patient Engagement
Martin, T. R. (2012) · Journal of Health Care for the Poor and Underserved · doi:10.1353/hpu.2012.0087 · Cited by 110 · see citing works
The Chronic Care Model and Technological Research and Innovation: A Scoping Review at the Crossroads
Gammon, D., Berntsen, G., Koricho, A. T., Sygna, K., & Ruland, C. M. (2015) · Journal of Medical Internet Research · doi:10.2196/jmir.3547 · Cited by 55 · see citing works
Clinical management apps: creating partnerships between providers and patients.
Silow‐Carroll, S., & Smith, B. M. (2013) · PubMed · Cited by 33 · see citing works
The Consumer Health Information System Adoption Model
Monkman, H., & Kushniruk, A. W. (2015) · Studies in health technology and informatics · doi:10.3233/978-1-61499-574-6-26 · Cited by 30 · see citing works
A Framework for User Involvement and Context in the Design and Development of Safe e-Health Systems
Kushniruk, A. W., & Paul, T. (2012) · Studies in health technology and informatics · doi:10.3233/978-1-61499-101-4-353 · Cited by 26 · see citing works
Flagged first, then by citations
Research works printed but not linked: 1
- [16]Pawson R Tilley N Realistic Evaluation 1997 Thousand Oaks, CA Sage Publications
Cited by
Sorted by citations
New technologies, new disparities: The intersection of electronic health and digital health literacy
Smith, B., & Magnani, J. W. (2019) · International Journal of Cardiology · doi:10.1016/j.ijcard.2019.05.066 · Cited by 446 · see citing works
Pham, Q., Graham, G., Carrion, C., Morita, P. P., Seto, E., Stinson, J. N., & Cafazzo, J. A. (2019) · JMIR mHealth and uHealth · doi:10.2196/11941 · Cited by 131 · see citing works
Boels, A. M., Vos, R. C., Dijkhorst-Oei, L.-T., & Rutten, G. E. H. M. (2019) · BMJ Open Diabetes Research & Care · doi:10.1136/bmjdrc-2019-000981 · Cited by 50 · see citing works
Turner, R. M., Ma, Q., Lorig, K., Greenberg, J., & DeVries, A. R. (2018) · Journal of Medical Internet Research · doi:10.2196/jmir.9225 · Cited by 39 · see citing works
- Authors
- Thies, K., Anderson, D., & Cramer, B.
- Affiliations
- Community Health Center (US)
- Western Michigan University (US)
- Corresponding author
- Thies, Kathleen
- Venue
- JMIR Human Factors
- Publisher
- JMIR Publications Inc.
- Published
- 2017-10-03
- Volume
- 4
- Issue
- 4
- Pages
- e24
- ISSN
- 2292-9495 (ISSN-L)
- PMC
- PMC5645643
- OpenAlex
- W2763828059
- Cited by
- 118
- References
- 14
- Citations by year
- 2026: 1 · 2025: 17 · 2024: 12 · 2023: 20 · 2022: 23 · 2021: 12 · 2020: 13 · 2019: 9 · 2018: 10 · 2017: 1
- FWCI
- 14.63
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- JMIR Human Factors (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Topics
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Health Sciences › Health Professions › Health Information Management › Health, Technology, Consumer Behavior
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Keywords
- mobile health apps, diabetes self-management, hypertension self-management, app adoption, federally qualified health centers, usability, electronic health record integration, reimbursement, digital health literacy, implementation barriers, chronic disease management
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review