Cited by 27Mobile Health and mHealth ApplicationsUsability and User Interface DesignTelemedicine and Telehealth Implementation

Designing a Framework for Remote Cancer Care Through Community Co-design: Participatory Development Study

Open access
Aronoff-Spencer, Eliah, McComsey, Melanie, Chih, Ming-Yuan, Hubenko, Alexandra, Baker, Corey, Kim, John, Ahern, David K, Gibbons, Michael Christopher +5 more·2022·Journal of Medical Internet Research

Published version of a preprint

Abstract

Background: Recent shifts to telemedicine and remote patient monitoring demonstrate the potential for new technology to transform health systems; yet, methods to design for inclusion and resilience are lacking. Objective: The aim of this study is to design and implement a participatory framework to produce effective health care solutions through co-design with diverse stakeholders. Methods: We developed a design framework to cocreate solutions to locally prioritized health and communication problems focused on cancer care. The framework is premised on the framing and discovery of problems through community engagement and lead-user innovation with the hypothesis that diversity and inclusion in the co-design process generate more innovative and resilient solutions. Discovery, design, and development were implemented through structured phases with design studios at various locations in urban and rural Kentucky, including Appalachia, each building from prior work. In the final design studio, working prototypes were developed and tested. Outputs were assessed using the System Usability Scale as well as semistructured user feedback. Results: We co-designed, developed, and tested a mobile app (myPath) and service model for distress surveillance and cancer care coordination following the LAUNCH (Linking and Amplifying User-Centered Networks through Connected Health) framework. The problem of awareness, navigation, and communication through cancer care was selected by the community after framing areas for opportunity based on significant geographic disparities in cancer and health burden resource and broadband access. The codeveloped digital myPath app showed the highest perceived combined usability (mean 81.9, SD 15.2) compared with the current gold standard of distress management for patients with cancer, the paper-based National Comprehensive Cancer Network Distress Thermometer (mean 74.2, SD 15.8). Testing of the System Usability Scale subscales showed that the myPath app had significantly better usability than the paper Distress Thermometer (t63=2.611; P=.01), whereas learnability did not differ between the instruments (t63=–0.311; P=.76). Notable differences by patient and provider scoring and feedback were found. Conclusions: Participatory problem definition and community-based co-design, design-with methods, may produce more acceptable and effective solutions than traditional design-for approaches.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.2196/29492

Cites

3 of 3 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Aronoff-Spencer et al [43] described a human-centered participatory design approach that engaged patients, caregivers, and community stakeholders to support rural patients experiencing distress during cancer treatment.

    “Aronoff-Spencer et al [43] also described a human-centered participatory design approach that engaged patients, caregivers, and community stakeholders to support rural patients experiencing distress during cancer treatment.”

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 35

  1. [1]Bashshur RL Doarn CR Frenk JM Kvedar JC Shannon GW Woolliscroft JO Beyond the COVID pandemic, telemedicine, and health care Telemed J E Health 2020 11 26 11 1310 3 10.1089/tmj.2020.0328 32809913 32809913 · DOI
  2. [2]Butler SM After COVID-19: thinking differently about running the health care system JAMA 2020 06 23 323 24 2450 1 10.1001/jama.2020.8484 32573658 2767311 32573658 · DOI
  3. [4]Slomski A Telehealth success spurs a call for greater post-COVID-19 license portability JAMA 2020 09 15 324 11 1021 2 10.1001/jama.2020.9142 32930757 2770620 32930757 · DOI
  4. [5]Hirko K Kerver JM Ford S Szafranski C Beckett J Kitchen C Wendling AL Telehealth in response to the COVID-19 pandemic: implications for rural health disparities J Am Med Inform Assoc 2020 11 01 27 11 1816 8 10.1093/jamia/ocaa156 32589735 5863253 32589735 PMC7337797 · DOI
  5. [6]Sharpless NE COVID-19 and cancer Science 2020 06 19 368 6497 1290 10.1126/science.abd3377 32554570 368/6497/1290 32554570 · DOI
  6. [8]Wheelock A Bechtel C Leff B Human-centered design and trust in medicine JAMA 2020 12 15 324 23 2369 70 10.1001/jama.2020.21080 33320236 2774062 33320236 · DOI
  7. [9]von Hippel E Democratizing innovation: the evolving phenomenon of user innovation Int J Innov Sci 2009 03 1 1 29 40 10.1260/175722209787951224 · DOI · Paper page
  8. [11]Hesse BW Ahern D Ellison M Aronoff-Spencer E Vanderpool RC Onyeije K Gibbons MC Mullett TW Chih M-Y Attencio V Patterson G Boten J Hartshorn C Bartolome B Gorscak K McComsey M Hubenko A Huang B Baker C Norman D Barn-raising on the digital frontier: the L.A.U.N.C.H. collaborative J Appalachian Health 2020 2 1 6 20 PMC9138843 35769536
  9. [12]McComsey M Ahern DK Vanderpool RC Mullett TW Chih M-Y Johnson M Ellison M Onyeije K Hesse BW Aronoff-Spencer E Experiencing cancer in Appalachian Kentucky J Appalachian Health 2020 2 3 74 116 10.13023/jah.0203.09 PMC9138750 35770205 · DOI
  10. [13]Wilson RJ Ryerson AB Singh SD King JB Cancer incidence in Appalachia, 2004–2011 Cancer Epidemiol Biomarkers Prev 2016 01 27 25 2 250 8 10.1158/1055-9965.epi-15-0946 26819264 PMC6317710 · DOI
  11. [14]Rodriguez S Vanderford NL Huang B Vanderpool RC A social-ecological review of cancer disparities in Kentucky South Med J 2018 04 111 4 213 9 10.14423/SMJ.0000000000000794 29719033 SMJ50522 29719033 PMC5935122 · DOI
  12. [15]Laeeq Khan M Welser HT Cisneros C Manatong G Idris IK Digital inequality in the Appalachian Ohio: understanding how demographics, internet access, and skills can shape vital information use (VIU) Telematics Informatics 2020 07 50 101380 10.1016/j.tele.2020.101380 · DOI
  13. [16]Valdez RS Gibbons MC Siegel ER Kukafka R Brennan PF Designing consumer health IT to enhance usability among different racial and ethnic groups within the United States Health Technol 2012 7 13 2 4 225 33 10.1007/s12553-012-0031-6 · DOI
  14. [17]Eller R Uneven Ground: Appalachia Since 1945 2008 Lexington, Kentucky University Press of Kentucky
  15. [18]Samaras GM Horst RL A systems engineering perspective on the human-centered design of health information systems J Biomed Inform 2005 02 38 1 61 74 10.1016/j.jbi.2004.11.013 15694886 S1532-0464(04)00166-2 15694886 · DOI
  16. [19]Norman DA Stappers PJ DesignX: complex sociotechnical systems She Ji J Design Econ Innov 2015 1 2 83 106 10.1016/j.sheji.2016.01.002 · DOI
  17. [21]Participatory Design Principles and Practices 2017 Boca Raton, Florida CRC Press
  18. [22]Carroll J Making Use: Scenario-Based Design of Human-Computer Interactions 2000 Cambridge MIT Press
  19. [23]Holtzblatt K Wendell JB Wood S Rapid Contextual Design: A How-to Guide to Key Techniques for User-Centered Design 2004 Burlington, Massachusetts, United States Morgan Kaufmann
  20. [24]Signorelli GR Lehocki F Mora Fernández M O'Neill G O'Connor D Brennan L Monteiro-Guerra F Rivero-Rodriguez A Hors-Fraile S Munoz-Penas J Bonjorn Dalmau M Mota J Oliveira RB Mrinakova B Putekova S Muro N Zambrana F Garcia-Gomez JM A research roadmap: connected health as an enabler of cancer patient support J Med Internet Res 2019 10 29 21 10 e14360 10.2196/14360 31663861 v21i10e14360 31663861 PMC6914240 · DOI
  21. [25]Alfano CM Mayer DK Beckjord E Ahern DK Galioto M Sheldon LK Klesges LM Aronoff-Spencer E Hesse BW Mending disconnects in cancer care: setting an agenda for research, practice, and policy JCO Clin Cancer Inform 2020 06 4 539 46 10.1200/CCI.20.00046 32543897 32543897 PMC7328120 · DOI
  22. [26]de Moor JS Mariotto AB Parry C Alfano CM Padgett L Kent EE Forsythe L Scoppa S Hachey M Rowland JH Cancer survivors in the United States: prevalence across the survivorship trajectory and implications for care Cancer Epidemiol Biomarkers Prev 2013 04 22 4 561 70 10.1158/1055-9965.EPI-12-1356 23535024 1055-9965.EPI-12-1356 23535024 PMC3654837 · DOI · Paper page
  23. [27]Alfano CM Smith T de Moor JS Glasgow RE Khoury MJ Hawkins NA Stein KD Rechis R Parry C Leach CR Padgett L Rowland JH An action plan for translating cancer survivorship research into care J Natl Cancer Inst 2014 9 22 106 11 dju287 10.1093/jnci/dju287 25249551 dju287 25249551 PMC4184343 · DOI
  24. [28]Howell D Mayer DK Fielding R Eicher M Verdonck-de Leeuw IM Johansen C Soto-Perez-de-Celis E Foster C Chan R Alfano CM Hudson SV Jefford M Lam WW Loerzel V Pravettoni G Rammant E Schapira L Stein KD Koczwara B Global Partners for Self-Management in Cancer Management of cancer and health after the clinic visit: a call to action for self-management in cancer care J Natl Cancer Inst 2021 05 04 113 5 523 31 10.1093/jnci/djaa083 32525530 5856108 32525530 PMC8096367 · DOI
  25. [29]Hung P Deng S Zahnd WE Adams SA Olatosi B Crouch EL Eberth JM Geographic disparities in residential proximity to colorectal and cervical cancer care providers Cancer 2020 03 01 126 5 1068 76 10.1002/cncr.32594 10.1002/cncr.32594 31702829 31702829 · DOI
  26. [30]Ambroggi M Biasini C Del Giovane C Fornari F Cavanna L Distance as a barrier to cancer diagnosis and treatment: review of the literature Oncologist 2015 12 20 12 1378 85 10.1634/theoncologist.2015-0110 10.1634/theoncologist.2015-0110 26512045 theoncologist.2015-0110 26512045 PMC4679078 · DOI
  27. [31]Max-Onakpoya e Madamori O Grant F Vanderpool R Chih M-Y Ahern DK Aronoll-Spencer E Baker CE Augmenting cloud connectivity with opportunistic networks for rural remote patient monitoring Proceedings of the International Conference on Computing, Networking and Communications (ICNC) 2020 International Conference on Computing, Networking and Communications (ICNC) Feb 17-20, 2020 Big Island, HI, USA 10.1109/icnc47757.2020.9049733 · DOI
  28. [32]Roberts ET Mehrotra A Assessment of disparities in digital access among medicare beneficiaries and implications for telemedicine JAMA Intern Med 2020 10 01 180 10 1386 9 10.1001/jamainternmed.2020.2666 32744601 2768771 32744601 PMC7400206 · DOI
  29. [34]Pirl WF Jacobsen PB Deshields TL Opportunities for improving psychosocial care for cancer survivors J Clin Oncol 2013 06 01 31 16 1920 1 10.1200/JCO.2012.48.0566 23610106 JCO.2012.48.0566 23610106 · DOI
  30. [35]Cutillo A O'Hea E Person S Lessard D Harralson T Boudreaux E The Distress Thermometer: cutoff points and clinical use Oncol Nurs Forum 2017 05 01 44 3 329 36 10.1188/17.ONF.329-336 29493167 29493167 PMC5839660 · DOI
  31. [37]Jacobsen P Norton WE The role of implementation science in improving distress assessment and management in oncology: a commentary on "Screening for psychosocial distress among patients with cancer: implications for clinical practice, healthcare policy, and dissemination to enhance cancer survivorship" Transl Behav Med 2019 03 01 9 2 292 5 10.1093/tbm/ibz022 30870569 5380675 30870569 PMC6610164 · DOI
  32. [39]Canfora G Cimitile A Garcia F Piattini M Visaggio CA Evaluating performances of pair designing in industry J Syst Softw 2007 8 80 8 1317 27 10.1016/j.jss.2006.11.004 · DOI
  33. [40]Brooke J SUS: a 'quick and dirty' usability scale Usability Evaluation In Industry 1996 Boca Raton, Florida CRC Press
  34. [41]Sauro J Lewis JR Quantifying the User Experience Practical Statistics for User Research 2016 Amsterdam, Netherlands Elsevier Science
  35. [42]Šidák Z Rectangular confidence regions for the means of multivariate normal distributions J Am Stat Assoc 1967 06 62 318 626 33 10.1080/01621459.1967.10482935 · DOI

Cited by

Sorted by citations

  • User-Centered Design for Digital Patient-Navigation Tools in Oncology: Scoping Review

    Kheirinejad, S., White, B. M., Kheirkhah Rahimabad, P., Zink, J. A., Hashtarkhani, S., Kumsa, F. A., Rashid, R., Chinthala, L., Brett, C. L., Davis, R. L., et al. (2026) · JMIR Human Factors · doi:10.2196/87686

    “Aronoff-Spencer et al [43] also described a human-centered participatory design approach that engaged patients, caregivers, and community stakeholders to support rural patients experiencing distress during cancer treatment.”

Authors
Aronoff-Spencer, E., McComsey, M., Chih, M.-Y., Hubenko, A., Baker, C., Kim, J., Ahern, D. K., Gibbons, M. C., Cafazzo, J. A., Nyakairu, P., Vanderpool, R. C., Mullett, T. W., & Hesse, B. W.
Affiliations
  • University of California San Diego (US)
  • University of Kentucky (US)
  • Brigham and Women's Hospital (US)
  • University Health Network (CA)
  • National Cancer Institute (US)
Corresponding author
Mullett, Timothy W
Venue
Journal of Medical Internet Research
Published
2022-04-12
Volume
24
Issue
4
Pages
e29492
ISSN
1438-8871 (ISSN-L)
OpenAlex
W3209002171
Cited by
27
References
3
Citations by year
2026: 9 · 2025: 7 · 2024: 6 · 2023: 3 · 2022: 2
FWCI
3.09
Type
journal article
Language
en
Open access
Licence
other-oa
Locations
  • Journal of Medical Internet Research (publishedVersion, other-oa)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
Funders
  • Amgen
  • University of Kentucky (P30 CA177558)
  • University of California, San Diego
  • National Cancer Institute (P30CA177558)
Topics
  • Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
  • Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
  • Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Telemedicine and Telehealth Implementation
Keywords
cancer care coordination, community co-design, participatory design, mobile health apps, health disparities, Appalachia, rural health, usability, telemedicine, remote patient monitoring
MeSH terms
Delivery of Health Care, Humans, Kentucky, Neoplasms, Rural Population, Telemedicine, Mobile Applications

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review