Cited by 33AI in cancer detectionRadiomics and Machine Learning in Medical ImagingBreast Cancer Treatment Studies

BioFusionNet: Deep learning-based survival risk stratification in ER+ breast cancer through multifeature and multimodal data fusion

Open access
Mondol, Raktim Kumar, Millar, Ewan K. A., Sowmya, Arcot, Meijering, Erik·2024·IEEE Journal of Biomedical and Health Informatics

Abstract

Breast cancer is a significant health concern affecting millions of women worldwide. Accurate survival risk stratification plays a crucial role in guiding personalised treatment decisions and improving patient outcomes. Here we present BioFusionNet, a deep learning framework that fuses image-derived features with genetic and clinical data to obtain a holistic profile and achieve survival risk stratification of ER+ breast cancer patients. We employ multiple self-supervised feature extractors (DINO and MoCoV3) pretrained on histopathological patches to capture detailed image features. These features are then fused by a variational autoencoder and fed to a self-attention network generating patient-level features. A co-dual-cross-attention mechanism combines the histopathological features with genetic data, enabling the model to capture the interplay between them. Additionally, clinical data is incorporated using a feed-forward network, further enhancing predictive performance and achieving comprehensive multimodal feature integration. Furthermore, we introduce a weighted Cox loss function, specifically designed to handle imbalanced survival data, which is a common challenge. Our model achieves a mean concordance index of 0.77 and a time-dependent area under the curve of 0.84, outperforming state-of-the-art methods. It predicts risk (high versus low) with prognostic significance for overall survival in univariate analysis (HR=2.99, 95% CI: 1.88-4.78, p 0.005), and maintains independent significance in multivariate analysis incorporating standard clinicopathological variables (HR=2.91, 95% CI: 1.80-4.68, p 0.005).

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1109/jbhi.2024.3418341

Cites

63 of 63 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 1

  1. M. I. Jaber, L. Beziaeva, C. W. Szeto, and S. C. Benz, "Deep learning-based risk stratification for HER2-negative breast cancer patients," bioRxiv, p. 10.1101/2021.05.26.445720, 2021. · DOI

Cited by

Sorted by citations

Authors
Mondol, R. K., Millar, E. K. A., Sowmya, A., & Meijering, E.
Affiliations
  • UNSW Sydney (AU)
  • St George Hospital (AU)
Venue
IEEE Journal of Biomedical and Health Informatics
Published
2024-09
Volume
28
Issue
9
Pages
5290-5302
ISSN
  • 2168-2194 (ISSN-L)
  • 2168-2208
OpenAlex
W4391947857
Cited by
29
References
63
Citations by year
2026: 10 · 2025: 17 · 2024: 2
FWCI
4.30
Type
journal article
Language
en
Open access
Locations
  • IEEE Journal of Biomedical and Health Informatics (publishedVersion)
  • PubMed (publishedVersion)
  • arXiv (Cornell University) (submittedVersion, cc-by)
  • arXiv (Cornell University) (cc-by)
Funders
  • National Computational Infrastructure
  • Australian Government
  • University of New South Wales
  • National Cancer Institute
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › AI in cancer detection
  • Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › Radiomics and Machine Learning in Medical Imaging
  • Life Sciences › Biochemistry, Genetics and Molecular Biology › Cancer Research › Breast Cancer Treatment Studies
Keywords
estrogen receptor-positive breast cancer, survival risk stratification, multimodal fusion, genetic data integration, clinical data integration, self-supervised feature extraction, DINO, variational autoencoder, cross-attention, overall survival prediction, prognostic model
MeSH terms
Deep Learning, Breast Neoplasms, Female, Humans, Image Interpretation, Computer-Assisted, Survival Analysis, Risk Assessment

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review