Development and usability testing of the e‐EXCELS tool to guide cancer survivorship follow‐up care
Open accessAbstract
Objective: The aim of this study is to describe a user‐centered (e.g., cancer survivors and clinicians) development process of an eHealth tool designed to facilitate self‐management of cancer survivorship follow‐up care. Methods: Guided by Cognitive‐Social Health Information Processing (C‐SHIP) model and informed by core self‐management skills, we engaged in a user‐centered design process. In phase I, we conducted in‐depth interviews with survivors of breast (n = 33), prostate (n = 4), and colorectal (n = 6) cancers, and (n = 9) primary care providers to develop content and design of the web tool. Phase II utilized iterative user testing interviews (n = 9) to test the web‐based tool prototype. Data from both phases were independently coded using a template/content analytic approach. Results: The top 5 functions identified in phase I for the web‐based platform included: (a) educational materials to learn and prepare for health encounters (80%); (b) questions for health providers (74%); (c) ability to track contact information of providers (67%); (d) provide general information (64%); and, (e) support information (62%). Users of the prototype reported patient burden, tool fatigue, introduction timing of the tool, relevance, and security/privacy as concerns in phase II. Conclusions: This study demonstrates the value of using a theoretically informed and user‐centered design process to develop relevant and patient‐centered eHealth resources to support cancer survivorship. A larger study is needed to establish the efficacy of this eHealth tool as an intervention to improve adherence to follow‐up care guidelines.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
This finding aligns with previous research and emphasizes the importance of building flexibility into digital programs targeting cancer survivors, in terms of tailoring and frequency/timing of use, to ensure uptake.
“This finding aligns with previous research [66,72,76,77] and emphasizes the importance of building flexibility into digital programs targeting cancer survivors, not only in terms of tailoring but also in terms of frequency and timing of use, to ensure its uptake by target users.”
From Development and Evaluation of the Usefulness, Usability, and Feasibility of iNNOV Breast Cancer: Mixed Methods Study (2022) · cites this paper as [66]
The Results and Discussion (page unavailable) report that survivors wanted a tailored, interactive tool and describe self-directed use; Phase II usability testing also identified timing in the survivorship trajectory as a concern. The paper does not specifically establish that flexibility in the frequency and timing of use is needed to ensure uptake. (LLM, conf=0.82)
Experimental — accuracy not yet measuredSurvivors valued access to ubiquitous evidence-based self-care information organized according to the cancer continuum, considering it could help them better manage and cope with their condition and problems.
“Similar to previous research [64-66], survivors valued having access to ubiquitous evidence-based self-care information that was organized in accordance with the cancer continuum, considering that it could help them better manage and cope with their condition and problems.”
From Development and Evaluation of the Usefulness, Usability, and Feasibility of iNNOV Breast Cancer: Mixed Methods Study (2022) · cites this paper as [66]
The Results (Phase I Feedback; page unavailable) say survivors focused on educational materials about symptoms and self-care, and the Discussion says they wanted targeted, credible information to prepare for health encounters. The paper does not report that survivors specifically valued ubiquitous access or information organized across the cancer continuum; its tool focuses on long-term survivorship follow-up. (LLM, conf=0.86)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Cancer treatment and survivorship statistics, 2016
Miller, K. D., Siegel, R. L., Lin, C. C., Mariotto, A. B., Kramer, J. L., Rowland, J. H., Stein, K. D., Alteri, R., & Jemal, A. (2016) · CA: A Cancer Journal for Clinicians · doi:10.3322/caac.21349 · Cited by 6,066 · see citing works
Self-management education: History, definition, outcomes, and mechanisms
Lorig, K. R., & Holman, H. R. (2003) · Annals of Behavioral Medicine · doi:10.1207/s15324796abm2601_01 · Cited by 4,094 · see citing works
Qualitative Data Analysis for Health Services Research: Developing Taxonomy, Themes, and Theory
Bradley, E. H., Curry, L. A., & Devers, K. J. (2007) · Health Services Research · doi:10.1111/j.1475-6773.2006.00684.x · Cited by 3,437 · see citing works
Self-management approaches for people with chronic conditions: a review
Barlow, J., Wright, C., Sheasby, J., Turner, A., & Hainsworth, J. (2002) · Patient Education and Counseling · doi:10.1016/s0738-3991(02)00032-0 · Cited by 2,800 · see citing works
The Usability Engineering Lifecycle
NIELSEN, J. (1993) · Usability Engineering · doi:10.1016/b978-0-08-052029-2.50007-3 · Cited by 2,657 · see citing works
Hamine, S., Gerth-Guyette, E., Faulx, D., Green, B. B., & Ginsburg, A. S. (2015) · Journal of Medical Internet Research · doi:10.2196/jmir.3951 · Cited by 1,149 · see citing works
Bluethmann, S. M., Mariotto, A. B., & Rowland, J. H. (2016) · Cancer Epidemiology, Biomarkers & Prevention · doi:10.1158/1055-9965.epi-16-0133 · Cited by 1,146 · see citing works
Runowicz, C. D., Leach, C. R., Henry, N. L., Henry, K. S., Mackey, H. T., Cowens-Alvarado, R. L., Cannady, R. S., Pratt-Chapman, M. L., Edge, S. B., Jacobs, L. A., et al. (2016) · Journal of Clinical Oncology · doi:10.1200/jco.2015.64.3809 · Cited by 1,071 · see citing works
Self-management: Enabling and empowering patients living with cancer as a chronic illness
McCorkle, R., Ercolano, E., Lazenby, M., Schulman-Green, D., Schilling, L. S., Lorig, K., & Wagner, E. H. (2011) · CA: A Cancer Journal for Clinicians · doi:10.3322/caac.20093 · Cited by 950 · see citing works
Runowicz, C. D., Leach, C. R., Henry, N. L., Henry, K. S., Mackey, H. T., Cowens‐Alvarado, R. L., Cannady, R. S., Pratt‐Chapman, M. L., Edge, S. B., Jacobs, L. A., et al. (2016) · CA: A Cancer Journal for Clinicians · doi:10.3322/caac.21319 · Cited by 728 · see citing works
Interactive Health Communication Applications for people with chronic disease
Murray, E., Burns, J., See Tai, S., Lai, R., & Nazareth, I. (2005) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd004274.pub4 · Cited by 722 · see citing works
American Cancer Society Colorectal Cancer Survivorship Care Guidelines
El‐Shami, K., Oeffinger, K. C., Erb, N. L., Willis, A., Bretsch, J. K., Pratt‐Chapman, M. L., Cannady, R., Wong, S. L., Rose, J., Barbour, A., et al. (2015) · CA A Cancer Journal for Clinicians · doi:10.3322/caac.21286 · Cited by 467 · see citing works
American Cancer Society prostate cancer survivorship care guidelines
Skolarus, T. A., Wolf, A. M. D., Erb, N. L., Brooks, D. D., Rivers, B. M., Underwood, W., Salner, A., Zeléfsky, M. J., Aragon‐Ching, J. B., Slovin, S. F., et al. (2014) · CA A Cancer Journal for Clinicians · doi:10.3322/caac.21234 · Cited by 398 · see citing works
Troublesome Symptoms in Cancer Survivors: Fatigue, Insomnia, Neuropathy, and Pain
Pachman, D. R., Barton, D. L., Swetz, K. M., & Loprinzi, C. L. (2012) · Journal of Clinical Oncology · doi:10.1200/jco.2012.41.7238 · Cited by 282 · see citing works
Roberts, A., Fisher, A., Smith, L., Heinrich, M., & POTTS, H. W. W. (2017) · Journal of Cancer Survivorship · doi:10.1007/s11764-017-0632-1 · Cited by 270 · see citing works
Nekhlyudov, L., O'malley, D. M., & Hudson, S. V. (2017) · The Lancet Oncology · doi:10.1016/s1470-2045(16)30570-8 · Cited by 249 · see citing works
Self-citationvan den Berg, S. W., Gielissen, M. F. M., Custers, J. A. E., van der Graaf, W. T. A., Ottevanger, P. B., & Prins, J. B. (2015) · Journal of Clinical Oncology · doi:10.1200/jco.2013.54.9386 · Cited by 201 · see citing works
Silva, E. H., Lawler, S., & Langbecker, D. (2019) · Journal of Cancer Survivorship · doi:10.1007/s11764-018-0730-8 · Cited by 198 · see citing works
Seiler, A., Klaas, V., Tröster, G., & Fagundes, C. P. (2017) · Psycho-Oncology · doi:10.1002/pon.4489 · Cited by 176 · see citing works
A systematic review of types and efficacy of online interventions for cancer patients.
McAlpine, H., Joubert, L., Martin-Sanchez, F., Merolli, M., & Drummond, K. J. (2015) · Patient Education and Counseling · doi:10.1016/j.pec.2014.11.002 · Cited by 160 · see citing works
Agboola, S. O., Ju, W., Elfiky, A., Kvedar, J. C., & Jethwani, K. (2015) · Journal of Medical Internet Research · doi:10.2196/jmir.4009 · Cited by 132 · see citing works
Self-management interventions for cancer survivors: a systematic review
Boland, L., Bennett, K., & Connolly, D. (2017) · Supportive Care in Cancer · doi:10.1007/s00520-017-3999-7 · Cited by 123 · see citing works
Alfano, C., Mayer, D., Bhatia, S., Maher, J., Scott, J. M., Nekhlyudov, L., Merrill, J. K., & Henderson, T. (2019) · Ca · doi:10.3322/caac.21558 · Cited by 106 · see citing works
Venderbos, L. D. F., van den Bergh, R. C. N., Roobol, M. J., Schröder, F. H., Essink‐Bot, M., Bangma, C. H., Steyerberg, E. W., & Korfage, I. J. (2014) · Psycho-Oncology · doi:10.1002/pon.3657 · Cited by 75 · see citing works
Diefenbach, M. A., & Butz, B. P. (2004) · Journal of Medical Internet Research · doi:10.2196/jmir.6.1.e3 · Cited by 73 · see citing works
Brown‐Johnson, C. G., Berrean, B., & Cataldo, J. K. (2015) · Patient Education and Counseling · doi:10.1016/j.pec.2014.12.006 · Cited by 66 · see citing works
Covolo, L., Ceretti, E., Moneda, M., Castaldi, S., & Gelatti, U. (2017) · Patient Education and Counseling · doi:10.1016/j.pec.2017.07.032 · Cited by 65 · see citing works
McDermott, M. S., & While, A. (2013) · Patient Education and Counseling · doi:10.1016/j.pec.2013.02.014 · Cited by 60 · see citing works
Coffey, L., Mooney, O., Dunne, S. K., Sharp, L., Timmons, A., Desmond, D. M., O’Sullivan, E. M., Timon, C. V. I., Gooberman‐Hill, R., & Gallagher, P. (2016) · Journal of Cancer Survivorship · doi:10.1007/s11764-016-0546-3 · Cited by 46 · see citing works
Castelnuovo, G., Zoppis, I. F., Santoro, E., Ceccarini, M., Pietrabissa, G., Manzoni, G. M., Corti, S. P., Borrello, M., Giusti, E. M., Cattivelli, R., et al. (2015) · Frontiers in Psychology · doi:10.3389/fpsyg.2015.00407 · Cited by 44 · see citing works
Kumar, D., Hemmige, V., Kallen, M. A., Giordano, T. P., & Arya, M. (2019) · Cureus · doi:10.7759/cureus.4104 · Cited by 43 · see citing works
Miller, S. M., & Diefenbach, M. A. (1998) · Cited by 40 · see citing works
Self-citationeHealth system interoperability
Weber-Jahnke, J. H., Peyton, L., & Topaloglou, T. (2011) · Information Systems Frontiers · doi:10.1007/s10796-011-9319-8 · Cited by 39 · see citing works
Requirements for and Barriers towards Interoperable eHealth Technology in Primary Care
Nijeweme-d'Hollosy, W. O., van Velsen, L., Huygens, M., & Hermens, H. (2015) · IEEE Internet Computing · doi:10.1109/mic.2015.53 · Cited by 35 · see citing works
Miller, S. M., Hudson, S. V., Hui, S. A., Diefenbach, M. A., Fleisher, L. G., Raivitch, S., Belton, T. D., Roy, G., Njoku, A. U., Scarpato, J., et al. (2015) · Journal of Cancer Survivorship · doi:10.1007/s11764-015-0431-5 · Cited by 27 · see citing works
Self-citationHudson, S. V., O’Malley, D. M., & Miller, S. M. (2015) · Patient Related Outcome Measures · doi:10.2147/prom.s49588 · Cited by 17 · see citing works
Self-citationDavis, S. N., O’Malley, D. M., Bator, A., Ohman‐Strickland, P., Clemow, L., Ferrante, J. M., Crabtree, B. F., Miller, S. M., Findley, P. A., & Hudson, S. V. (2019) · BMC Cancer · doi:10.1186/s12885-019-5531-6 · Cited by 11 · see citing works
Self-citationDavid S., A. S. K. (1998) · Psychology Press eBooks · doi:10.4324/9781410602770-19 · Cited by 8 · see citing works
Flagged first, then by citations
Research works printed but not linked: 1
- [21]Neilsen J Usability Engineering. 1993 New York: Academic Press.
Cited by
Sorted by citations
Mendes-Santos, C., Nunes, F., Weiderpass, E., Santana, R., & Andersson, G. (2022) · JMIR Cancer · doi:10.2196/33550 · Cited by 19 · see citing works
“This finding aligns with previous research [66,72,76,77] and emphasizes the importance of building flexibility into digital programs targeting cancer survivors, not only in terms of tailoring but also in terms of frequency and timing of use, to ensure its uptake by target users.”
BackgroundResultUser-Centered Design for Digital Patient-Navigation Tools in Oncology: Scoping Review
Kheirinejad, S., White, B. M., Kheirkhah Rahimabad, P., Zink, J. A., Hashtarkhani, S., Kumsa, F. A., Rashid, R., Chinthala, L., Brett, C. L., Davis, R. L., et al. (2026) · JMIR Human Factors · doi:10.2196/87686
“For example, O’Malley et al [29] developed and tested the e-EXCELS eHealth tool for cancer survivorship follow-up care.”
- Authors
- O'Malley, D. M., Davis, S. N., Devine, K. A., Sullivan, B., Bator, A., Clemow, L., Ferrante, J. M., Findley, P. A., Miller, S. M., & Hudson, S. V.
- Affiliations
- Rutgers Biomedical and Health Sciences Rutgers, The State University of New Jersey New Brunswick New Jersey
- Rutgers, The State University of New Jersey (US)
- Fox Chase Cancer Center (US)
- ORCID
- Venue
- Psycho-Oncology
- Publisher
- Wiley
- Published
- 2019-10-18
- Volume
- 29
- Issue
- 1
- Pages
- 123-131
- ISSN
- 1057-9249 (ISSN-L)
- 1099-1611
- PMC
- PMC7279518
- OpenAlex
- W2981245158
- Cited by
- 25
- References
- 38
- Citations by year
- 2026: 2 · 2025: 3 · 2024: 3 · 2023: 5 · 2022: 3 · 2021: 5 · 2020: 4
- FWCI
- 1.25
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- Psycho-Oncology (publishedVersion)
- PubMed (publishedVersion)
- PubMed Central (acceptedVersion)
- Rutgers University Community Repository (Rutgers University) (submittedVersion)
- Funders
- National Cancer Institute (CA 1766838, P30 CA072720)
- Topics
- Health Sciences › Medicine › Oncology › Cancer survivorship and care
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Health Sciences › Health Professions › General Health Professions › Health Literacy and Information Accessibility
- Keywords
- cancer survivorship, follow-up care, eHealth tools, self-management, user-centered design, breast cancer survivors, prostate cancer survivors, colorectal cancer survivors, primary care providers, usability testing, patient-centered care, health information needs
- MeSH terms
- Cancer Survivors, Self-Management, Survivorship, Aftercare, Female, Humans, Male, Middle Aged, Neoplasms, User-Computer Interface, Telemedicine, Patient Preference
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review