Cited by 960AI in cancer detectionRadiomics and Machine Learning in Medical ImagingDomain Adaptation and Few-Shot Learning

Dual-stream Multiple Instance Learning Network for Whole Slide Image Classification with Self-supervised Contrastive Learning

Open access
Li, Bin, Li, Yin, Eliceiri, Kevin W.·2021·2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)

Abstract

We address the challenging problem of whole slide image (WSI) classification. WSIs have very high resolutions and usually lack localized annotations. WSI classification can be cast as a multiple instance learning (MIL) problem when only slide-level labels are available. We propose a MIL-based method for WSI classification and tumor detection that does not require localized annotations. Our method has three major components. First, we introduce a novel MIL aggregator that models the relations of the instances in a dual-stream architecture with trainable distance measurement. Second, since WSIs can produce large or unbalanced bags that hinder the training of MIL models, we propose to use self-supervised contrastive learning to extract good representations for MIL and alleviate the issue of prohibitive memory cost for large bags. Third, we adopt a pyramidal fusion mechanism for multiscale WSI features, and further improve the accuracy of classification and localization. Our model is evaluated on two representative WSI datasets. The classification accuracy of our model compares favorably to fully-supervised methods, with less than 2% accuracy gap across datasets. Our results also outperform all previous MIL-based methods. Additional benchmark results on standard MIL datasets further demonstrate the superior performance of our MIL aggregator on general MIL problems.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1109/cvpr46437.2021.01409

Cites

59 of 59 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Whole-slide representation models can be pretrained to distill pathology-specific knowledge from large WSI collections, simplifying clinical endpoint prediction with their off-the-shelf application.

    “Instead of training an additional model on top of patch embeddings from scratch34,73–80, these whole-slide representation models can be pretrained to distill pathology-specific knowledge from large WSI collections, simplifying clinical endpoint prediction with their off-the-shelf application.”

    From A multimodal whole-slide foundation model for pathology (2025) · cites this paper as [75]

    The Method (page not specified) describes self-supervised pretraining on patches extracted from WSIs, with the resulting feature extractor used for downstream classification. It does not describe pretraining a whole-slide representation model for off-the-shelf clinical endpoint prediction; the method also trains a MIL aggregator for slide classification. (LLM, conf=0.88)

    Experimental — accuracy not yet measured
  • The remaining studies explored multiple other tasks and many focused on classification of malignant disorders such as breast cancer, skin cancer, and lung cancer.

    “The remaining studies explored multiple other tasks and many focused on classification of malignant disorders such as breast cancer56,61,88, skin cancer89, and lung cancer59.”

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

1 of the 60 references couldn’t be matched to a known paper.

Cited by

Sorted by citations

Authors
Li, B., Li, Y., & Eliceiri, K. W.
Affiliations
University of Wisconsin–Madison (US)
Corresponding author
  • Li, Yin
  • Eliceiri, Kevin W.
Venue
2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
Publisher
IEEE
Published
2021-06
Volume
2021
Pages
14313-14323
ISSN
1063-6919 (ISSN-L)
OpenAlex
W3176719058
Cited by
957
References
60
Citations by year
2026: 204 · 2025: 247 · 2024: 241 · 2023: 171 · 2022: 82 · 2021: 12
FWCI
58.33
Type
conference paper
Language
en
Open access
Locations
  • IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings (publishedVersion)
  • PubMed (publishedVersion)
  • PubMed Central (acceptedVersion)
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Funders
  • Semiconductor Research Corporation
  • Wisconsin Alumni Research Foundation
  • National Institutes of Health
  • National Institute of General Medical Sciences (P41GM135019)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › AI in cancer detection
  • Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › Radiomics and Machine Learning in Medical Imaging
  • Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
Keywords
whole slide image classification, multiple instance learning, self-supervised contrastive learning, two-stream network, tumor detection, multi-scale features

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review