PreprintCited by 1Usability and User Interface DesignMobile Health and mHealth ApplicationsInnovative Human-Technology Interaction

USER-CENTERED DESIGN AND USABILITY EVALUATION OF A CANCER PREVENTION WEB APPLICATION: AN ITERATIVE APPROACH IN GERMANY

Open access
Carrera, Pricivel, Elias, Odile, Zhang, Ruidong, Norajitra, Tobias, Goncalves, Angela, Maier-Hein, Klaus·2025·medRxiv

Abstract

Objectives: Limited public awareness of cancer risk factors necessitates effective dissemination of cancer prevention information. Digital technologies offer an opportunity to address this gap, yet there is scant information on tools for communicating cancer prevention evidence. This article describes the user-centered design, development and usability evaluation of a web application for personalized cancer prevention tailored to the German population. Materials and Methods: Prototypes of the web-app were developed through early and continuous formative evaluations. These prototypes integrated validated cancer risk prediction models and recommendations using an evidence-based risk communication approach. In a graphical user interface (GUI) test usability was assessed using the system usability scale (SUS), deriving scores for overall usability, usefulness, and learnability. Qualitative data on user experience (UX) and user interface (UI) issues were also collected through think-aloud protocols, interviews, and questionnaires. Findings: The GUI test showed a SUS score of 69.7/100 and a usefulness score of 75.8, indicating acceptable usability, while the learnability score was 48.4. Eight categories of UX/UI problems were identified, including one severe and three moderate issues related to data input, user guidance and risk visualization. Qualitative feedback highlighted strengths in navigation, information presentation, and interactive features such as the risk simulation tool. Discussion: The iterative development and early user testing yielded valuable feedback, identifying key usability concerns during prototyping. The usability score was within an acceptable range, and the usefulness score was above average. However, the lower learnability score indicated potential challenges in user understanding and satisfaction. Identified usability issues highlight areas for improvement while positive feedback supports the design choices, particularly the use of visual aids, numerical data, and personalized feedback to improve risk comprehension and motivate behavior change. Conclusion: The NCPC cancer prevention web application represents a significant step towards effective digital health promotion in Germany. Addressing identified usability concerns through continued iterative refinement and user involvement is crucial for enhancing the tool’s effectiveness. The integration of evidence-based risk communication strategies shows promise in improving risk comprehension and motivating behavior change among users.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1101/2025.04.29.25326679

Cites

1 of 1 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • An iterative development process of a cancer prevention web application by Carrera et al [45] and the prevention-focused web application described by Anders et al [32] incorporated repeated cycles of feedback that shaped tutorials and interactive features.

    “Similarly, an iterative development process of a cancer prevention web application by Carrera et al [45] and the prevention-focused web application described by Anders et al [32] incorporated repeated cycles of feedback that shaped tutorials and interactive features, supporting its potential to enhance risk understanding and healthy behavior.”

    From User-Centered Design for Digital Patient-Navigation Tools in Oncology: Scoping Review (2026) · cites this paper as [45]

    Split into 2 atoms — 0 confirmed, 2 partially supported, 0 disputed, 0 misattributed, 0 unverifiable. Expand the claim to see per-atom verdicts.

    Experimental — accuracy not yet measured
  • The iterative development of the prevention web applications supports their potential to enhance risk understanding and healthy behavior.

    “Similarly, an iterative development process of a cancer prevention web application by Carrera et al [45] and the prevention-focused web application described by Anders et al [32] incorporated repeated cycles of feedback that shaped tutorials and interactive features, supporting its potential to enhance risk understanding and healthy behavior.”

    From User-Centered Design for Digital Patient-Navigation Tools in Oncology: Scoping Review (2026) · cites this paper as [45]

    The Iterative development section describes repeated formative evaluations whose feedback refined the cancer-prevention app’s content, functionality, and risk visualizations. The Conclusion says its risk-communication features show promise for improving risk comprehension and motivating behavior change. However, the Discussion describes tutorials as a user recommendation, not a feature already shaped or incorporated through those cycles. (LLM, conf=0.84)

    Experimental — accuracy not yet measured

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 32

  1. GBD 2019 Cancer Risk Factors Collaborators. The global burden of cancer attributable to risk factors, 2010-2019: a systematic analysis for the Global Burden of Disease Study 2019. Lancet. 2022; 400: 563-591. DOI: 10.1016/S0140-6736(22)01438-6. · DOI
  2. Carrera PM, Calderazzo S. Knowledge of cancer risk factors and risk-reduction in high income countries. Prev Med. 2023. DOI: 10.1016/j.ypmed.2023.107583. · DOI
  3. Cullen R, Heitkemper E, Backonja U, Bekemeier B, Kong HK. Designing an infographic webtool for public health [published online ahead of print, 2023 Jun 24]. J Am Med Inform Assoc. 2023;ocad105. DOI:10.1093/jamia/ocad105 ISO 9241-11:2018(en) Ergonomics of human-system interaction. Available at: https://www.iso.org/obp/ui/#iso:std:iso:9241:-11:ed-2:v1:en. [Accessed on 13 April 2022]. · DOI
  4. Baumann M, Braun A, Helbig U, Nettekoven G, Will U. Das Nationale Krebspräventionszentrum. Onkologe. 2022. 28:62-68. DOI: 10.1007/s00761-021-01068- 6. · DOI
  5. Carr PR, Weigl K, Edelmann D, Jansen L, Chang-Claude J, Brenner H, et al. Estimation of absolute risk of colorectal cancer based on healthy lifestyle, genetic risk, and colonoscopy status in a population-based study. Gastroenterology. 2020 Jul;159(1):129-138.e9. DOI: 10.1053/j.gastro.2020.03.016. · DOI
  6. Aleksandrova K, Reichmann R, Kaaks R, Jenab M, Bueno-de-Mesquita HB, Dahm CC, et al. Development and validation of a lifestyle-based model for colorectal cancer risk prediction: the LiFeCRC score. BMC Med. 2021 Jan 4;19(1):1. DOI: 10.1186/s12916- 02001826-0. · DOI
  7. Jaspers MW. A comparison of usability methods for testing interactive health technologies: methodological aspects and empirical evidence. Int J Med Inform. 2009;78(5):340-353. DOI: 10.1016/j.ijmedinf.2008.10.002. · DOI · Paper page
  8. Snyder LE, Phan DF, Williams KC, et al. Comprehension, utility, and preferences of prostate cancer survivors for visual timelines of patient-reported outcomes co-designed for limited graph literacy: meters and emojis over comics. J Am Med Inform Assoc. 2022;29(11):1838-1846. DOI:10.1093/jamia/ocac148. · DOI
  9. Reis F, Sá-Moura B, Guardado D, et al. Development of a Healthy Lifestyle Assessment Toolkit for the General Public. Front Med (Lausanne). 2019;6:134. Published 2019 Jun 27. DOI:10.3389/fmed.2019.00134. · DOI
  10. Smit AK, Keogh LA, Hersch J, et al. Public preferences for communicating personal genomic risk information: a focus group study. Health Expect. 2016;19(6):1203-1214. DOI: 10.1111/hex.12406. · DOI
  11. Gorski Findling MT, Werth PM, Musicus AA, Bragg MA, Graham DJ, Elbel B, et al. Comparing five front-of-pack nutrition labels' influence on consumers' perceptions and purchase intentions. Prev Med. 2018 Jan;106:114-121. DOI: 10.1016/j.ypmed.2017.10.022. · DOI
  12. Lundeberg PJ, Graham DJ, Mohr GS. Comparison of two front-of-package nutrition labeling schemes, and their explanation, on consumers' perception of product healthfulness and food choice. Appetite. 2018 Jun 1;125:548-556. DOI: 10.1016/j.appet.2018.02.027. · DOI
  13. Kong N, Heer J, Agrawala M. Perceptual guidelines for creating rectangular treemaps. IEEE Trans Vis Comput Graph. 2010;16(6):990-998. doi:10.1109/TVCG.2010.186 · DOI
  14. Kong N, Heer J, Agrawala M. Perceptual guidelines for creating rectangular treemaps. IEEE Trans Vis Comput Graph. 2010;16(6):990-998. DOI:10.1109/TVCG.2010.186 · DOI
  15. Snyder LE, Phan DF, Williams KC, et al. Comprehension, utility, and preferences of prostate cancer survivors for visual timelines of patient-reported outcomes co-designed for limited graph literacy: meters and emojis over comics. J Am Med Inform Assoc. 2022;29(11):1838-1846. DOI:10.1093/jamia/ocac148 · DOI
  16. Barnes AJ, Hanoch Y, Miron-Shatz T, Ozanne EM. Tailoring risk communication to improve comprehension: Do patient preferences help or hurt?. Health Psychol. 2016;35(9):1007-1016. DOI:10.1037/hea0000367 · DOI
  17. Banerjee I, Nguyen B, Garousi V, Memon A. Graphical user interface (GUI) testing: Systematic mapping and repository. Inf Software Tech. 2013. 55(10): 1679-1694. DOI: 10.1016/j.infsof.2013.03.004 · DOI
  18. Turner CW, Lewis JR, Nielsen J. Determining usability test sample size. International Encyclopedia of Ergonomics and Human Factors, 2006, Second Edition, Volume 3.
  19. Haftenberger M, Mensink GB, Vogt S, et al. Changes in Waist Circumference among German Adults over Time -Compiling Results of Seven Prospective Cohort Studies. Obes Facts. 2016;9(5):332-343. DOI:10.1159/000446964. · DOI
  20. Brooke, J. SUS-A quick and dirty usability scale. Usability Eval. Ind. 1996;189:4-7.
  21. Bangor A, Kortum PT, Miller JT. An empirical evaluation of the system usability scale. Int J Hum Comput Interact. 2008;24:574-594.
  22. Lewis JR, Sauro J. The Factor Structure of the System Usability Scale. In: Kurosu, M. (eds) Human Centered Design. HCD 2009. Lecture Notes in Computer Science, vol 5619. Springer, Berlin, Heidelberg. DOI: 10.1007/978-3-642-02806-9_12. · DOI · Paper page
  23. Hajesmaeel-Gohari S, Khordastan F, Fatehi F, Samzadeh H, Bahaadinbeigy K. The most used questionnaires for evaluating satisfaction, usability, acceptance, and quality outcomes of mobile health. BMC Med Inform Decis Mak. 2022;22(1):22. DOI: 10.1186/s12911-022-01764-2. · DOI
  24. Santos KDS, Ribeiro MC, Queiroga DEU, Silva IAPD, Ferreira SMS. The use of multiple triangulations as a validation strategy in a qualitative study. O uso de triangulação múltipla como estratégia de validação em um estudo qualitativo. Cien Saude Colet. 2020;25(2):655-664. DOI:10.1590/1413-81232020252.12302018 · DOI
  25. Mair JL, Castro O, Salamanca-Sanabria A, et al. Exploring the potential of mobile health interventions to address behavioural risk factors for the prevention of non-communicable diseases in Asian populations: a qualitative study. BMC Public Health. 2023;23(1):753. DOI: 10.1186/s12889-023-15598-8. · DOI
  26. Lewis JR, Sauro J. Item benchmarks for the system usability scale. Journal of User Experience. 2018; 13(3):158-167.
  27. Kortum P, Peres SC. Evaluation of Home Health Care Devices: Remote Usability Assessment. JMIR Human Factors. 2015;2(1):e10. DOI: 10.2196/humanfactors.4570. · DOI
  28. Adams C, Walpola R, Schembri AM, Harrison R. The ultimate question? Evaluating the use of Net Promoter Score in healthcare: A systematic review. Health Expect. 2022;25(5):2328-2339. DOI:10.1111/hex.13577. · DOI
  29. Oakley-Girvan I, Yunis R, Fonda SJ, et al. Usability evaluation of mobile phone technologies for capturing cancer patient-reported outcomes and physical functions. Digit Health. 2023;9:20552076231186515. DOI:10.1177/20552076231186515. · DOI
  30. Oakley-Girvan I, Yunis R, Fonda SJ, et al. Usability evaluation of mobile phone technologies for capturing cancer patient-reported outcomes and physical functions. Digit Health. 2023;9:20552076231186515. DOI:10.1177/20552076231186515. · DOI
  31. Adams C, Walpola R, Schembri AM, Harrison R. The ultimate question? Evaluating the use of Net Promoter Score in healthcare: A systematic review. Health Expect. 2022;25(5):2328-2339. DOI:10.1111/hex.13577. · DOI
  32. Zhang R, Carrera P, Elias O, Norajitra T, Goncalves A, Maier-Hein K. Cancer risk reduction by dietary guideline adherence: a prioritization approach with a web app. Proceedings. 2023; 91(1):130. DOI:10.3390/proceedings2023091130. · DOI

Cited by

Sorted by citations

  • User-Centered Design for Digital Patient-Navigation Tools in Oncology: Scoping Review

    Kheirinejad, S., White, B. M., Kheirkhah Rahimabad, P., Zink, J. A., Hashtarkhani, S., Kumsa, F. A., Rashid, R., Chinthala, L., Brett, C. L., Davis, R. L., et al. (2026) · JMIR Human Factors · doi:10.2196/87686

    “Similarly, an iterative development process of a cancer prevention web application by Carrera et al [45] and the prevention-focused web application described by Anders et al [32] incorporated repeated cycles of feedback that shaped tutorials and interactive features, supporting its potential to…”

Authors
Carrera, P., Elias, O., Zhang, R., Norajitra, T., Goncalves, A., & Maier-Hein, K.
Affiliations
  • Cochrane (GB)
  • German Cancer Research Center (DE)
Corresponding author
Carrera, Pricivel
Venue
medRxiv
Publisher
openRxiv
Published
2025-04-30
OpenAlex
W4410016867
Cited by
1
References
1
Citations by year
2026: 1
Type
posted content
Language
en
Open access
Locations
medRxiv (acceptedVersion, cc-by-nc)
Funders
  • Deutsches Krebsforschungszentrum
  • North Carolina Pork Council
  • Deutsche Krebshilfe
Topics
  • Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
  • Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
  • Physical Sciences › Computer Science › Human-Computer Interaction › Innovative Human-Technology Interaction
Keywords
cancer prevention, web application, usability evaluation, user-centered design, cancer risk prediction, digital health promotion, user experience, learnability, risk visualization, behavior change

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review