CoChat

Development and Evaluation of the Usefulness, Usability, and Feasibility of iNNOV Breast Cancer: Mixed Methods Study

Open access

Published version of a preprint

The DOI matches its Crossref record; 73 of the 74 references it cites were found in a registry or an index; 49 of the 81 sources its claims cite were checked for support.

Abstract

Background: Despite the efficacy of psychosocial interventions in minimizing psychosocial morbidity in breast cancer survivors (BCSs), intervention delivery across survivorship is limited by physical, organizational, and attitudinal barriers, which contribute to a mental health care treatment gap in cancer settings. Objective: The aim of this study is to develop iNNOV Breast Cancer (iNNOVBC), a guided, internet-delivered, individually tailored, acceptance and commitment therapy–influenced cognitive behavioral intervention program aiming to treat mild to moderate anxiety and depression in BCSs as well as to improve fatigue, insomnia, sexual dysfunction, and health-related quality of life in this group. This study also aims to evaluate the usefulness, usability, and preliminary feasibility of iNNOVBC. Methods: iNNOVBC was developed using a user-centered design approach involving its primary and secondary end users, that is, BCSs (11/24, 46%) and mental health professionals (13/24, 54%). We used mixed methods, namely in-depth semistructured interviews, laboratory-based usability tests, short-term field trials, and surveys, to assess iNNOVBC’s usefulness, usability, and preliminary feasibility among these target users. Descriptive statistics were used to characterize the study sample, evaluate performance data, and assess survey responses. Qualitative data were recorded, transcribed verbatim, and thematically analyzed. Results: Overall, participants considered iNNOVBC highly useful, with most participants reporting on the pertinence of its scope, the digital format, the relevant content, and the appropriate features. However, various usability issues were identified, and participants suggested that the program should be refined by simplifying navigation paths, using a more dynamic color scheme, including more icons and images, displaying information in different formats and versions, and developing smartphone and tablet versions. In addition, participants suggested that tables should be converted into plain textboxes and data visualization dashboards should be included to facilitate the tracking of progress. The possibility of using iNNOVBC in a flexible manner, tailoring it according to BCSs’ changing needs and along the cancer care continuum, was another suggestion that was identified. Conclusions: The study results suggest that iNNOVBC is considered useful by both BCSs and mental health professionals, configuring a promising point-of-need solution to bridge the psychological supportive care gap experienced by BCSs across the survivorship trajectory. We believe that our results may be applicable to other similar programs. However, to fulfill their full supportive role, such programs should be comprehensive, highly usable, and tailorable and must adopt a flexible yet integrated structure capable of evolving in accordance with survivors’ changing needs and the cancer continuum. © Cristina Mendes-Santos, Francisco Nunes, Elisabete Weiderpass, Rui Santana, Gerhard Andersson. Originally published in JMIR Cancer (https://cancer.jmir.org), 15.02.2022. This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Cancer, is properly cited. The complete bibliographic information, a link to the original publication on https://cancer.jmir.org/, as well as this copyright and license information must be included.

Overview

CoChat Summary

TL;DR

iNNOV Breast Cancer (iNNOVBC) is a guided, internet-delivered, individually tailored ACT-influenced CBT program for breast cancer survivors, developed and assessed with mixed methods. Participants found it highly useful, but usability problems and practical barriers suggest it needs refinement before broader implementation.

Key findings

  • The study involved 24 participants: 11 breast cancer survivors (BCSs, 46%) and 13 mental health professionals (MHPs, 54%); among BCSs, the median age was 48 years, and among MHPs, the median age was 35 years.
  • Usefulness was rated highly: in the field trial, modules were rated 5/5 stars by BCSs, and all survivors who rated modules (8/8, 100%) said they would recommend them to a friend or family member in the same situation.
  • Usability scores were below average: the median System Usability Scale score was 65 (IQR 35) for BCSs and 47.5 (IQR 25) for MHPs; usability test issues were mainly inefficient interaction (12/43, 28%), ineffective information presentation (9/43, 21%), and cognitive overload (7/43, 16%).
  • Feasibility was viewed as promising but challenging: participants said the program could fit into care, but BCSs worried about “finding the time to fit the program into the day-to-day life,” and MHPs raised interoperability, practical, and attitudinal concerns.

Methods

  • Mixed-methods user-centered design study combining in-depth semistructured interviews, laboratory-based usability tests, short-term field trials, and surveys to evaluate usefulness, usability, and preliminary feasibility.
  • Nonprobabilistic purposive sample recruited in Porto, Portugal: 24 participants total (11 BCSs and 13 MHPs); BCSs had completed primary adjuvant treatment except hormonal therapy, and MHPs were registered psychologists or psychiatrists.
  • Quantitative data were summarized with descriptive statistics; qualitative interview and written-comment data were transcribed verbatim and analyzed thematically.

Limitations

  • The paper states limitations of a small sample size and minimal diversity in educational level and experience using digital mental health programs.
  • The authors also note that BCS participants were younger than the general Portuguese BCS population and were not screened for mild to moderate anxiety or depression, which may have limited generalizability; this is stated in the paper.
  • Evident from the text: data collection ended after 13 of 15 MHPs and 11 of 16 BCSs completed the protocol, so not all who agreed participated through completion.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.2196/33550

Cites

73 of 73 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Figures

Figure 1 The landing page of the iNNOV Breast Cancer program.
Figure 1 The landing page of the iNNOV Breast Cancer program.CC BY · PubMed Central
Figure 2 The introductory and 10 treatment modules of the iNNOV Breast Cancer program.
Figure 2 The introductory and 10 treatment modules of the iNNOV Breast Cancer program.CC BY · PubMed Central
Figure 3 Study design. BCS: breast cancer survivor; iNNOVBC: iNNOV Breast Cancer; MHP: mental health professional.
Figure 3 Study design. BCS: breast cancer survivor; iNNOVBC: iNNOV Breast Cancer; MHP: mental health professional.CC BY · PubMed Central

Verification

Claims the paper makes

28 Valid · 1 Not valid · 7 Not checked · 81 Own results and interpretations

27 more claims · 5 with their cited sources checked

Create a free account to see all 117 claims and to verify the 4 references still open.

See all claims — free account
  • Probably not a substantial claim. 41
  • It may state two separate claims as one. 65
  • The quote only partly states this claim. 1

Create a free account to see these claims.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Show all 73 references

Research works printed but not linked: 2

  1. Kim, AR, 2015, Stud Health Technol Inform, 216, 142
  2. Short, CE, 2015, Eur Health Psychol, 17, 32

Cited by

Metadata

Authors
Mendes-Santos, C., Nunes, F., Weiderpass, E., Santana, R., & Andersson, G.
Affiliations
  • Linköping University (SE)
  • Fraunhofer Portugal Research (PT)
  • Centre international de recherche sur le cancer (FR)
  • Comprehensive Health Research Centre (PT)
Corresponding author
Mendes-Santos, Cristina
Venue
JMIR Cancer
Published
2022-02-15
Volume
8
Issue
1
Pages
e33550
ISSN
2369-1999 (ISSN-L)
OpenAlex
W4205179018
Cited by
19
References
74
Citations by year
2026: 4 · 2025: 6 · 2024: 6 · 2023: 2 · 2022: 1
FWCI
1.57
Type
journal article
Language
en
Open access
Licence
cc-by
Locations
  • JMIR Cancer (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • Portuguese National Funding Agency for Science, Research and Technology (RCAAP Project by FCT) (submittedVersion, cc-by)
  • DiVA (Linkoping University) (submittedVersion, other-oa)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
  • Fraunhofer-Publica (Fraunhofer-Gesellschaft) (submittedVersion)
Funders
  • World Health Organization
  • Centre International de Recherche sur le Cancer
  • European Commission (2020 ‘)
  • Linköpings Universitet
  • Karolinska Institutet
  • Erasmus+
Topics
  • Health Sciences › Medicine › Oncology › Cancer survivorship and care
  • Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
  • Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
Keywords
breast cancer survivors, online intervention, acceptance and commitment therapy, cognitive behavioral therapy, anxiety, depression, fatigue, insomnia, sexual dysfunction, health-related quality of life, usability evaluation, user-centered design, mental health treatment gap, psychosocial interventions, intervention development, feasibility, mental health professionals

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-11, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-11 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.