Cited by 95AI in cancer detectionRadiomics and Machine Learning in Medical ImagingImage Retrieval and Classification Techniques

Cross-scale multi-instance learning for pathological image diagnosis

Open access
Deng, Ruining, Cui, Can, Remedios, Lucas W., Bao, Shunxing, Womick, R. Michael, Chiron, Sophie, Li, Jia, Roland, Joseph T. +7 more·2024·Medical Image Analysis

Abstract

Analyzing high resolution whole slide images (WSIs) with regard to information across multiple scales poses a significant challenge in digital pathology. Multi-instance learning (MIL) is a common solution for working with high resolution images by classifying bags of objects (i.e. sets of smaller image patches). However, such processing is typically performed at a single scale (e.g., 20× magnification) of WSIs, disregarding the vital inter-scale information that is key to diagnoses by human pathologists. In this study, we propose a novel cross-scale MIL algorithm to explicitly aggregate inter-scale relationships into a single MIL network for pathological image diagnosis. The contribution of this paper is three-fold: (1) A novel cross-scale MIL (CS-MIL) algorithm that integrates the multi-scale information and the inter-scale relationships is proposed; (2) A toy dataset with scale-specific morphological features is created and released to examine and visualize differential cross-scale attention; (3) Superior performance on both in-house and public datasets is demonstrated by our simple cross-scale MIL strategy. The official implementation is publicly available at https://github.com/hrlblab/CS-MIL.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1016/j.media.2024.103124

Cites

35 of 35 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • In integrating multi-scale histopathology images, methods like cross-scale attention mechanisms and multiple instance learning have been effective.

    “In other cases, such as integrating multi-scale histopathology images, methods like cross-scale attention mechanisms and multiple instance learning (MIL) have been effective [174].”

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

6 of the 41 references couldn’t be matched to a known paper.

Research works printed but not linked: 6

  1. Barbano CA, Perlo D, Tartaglione E, Fiandrotti A, Bertero L, Cassoni P, Grangetto M, 2021a. Unitopatho, a labeled histopathological dataset for colorectal polyps classification and adenoma dysplasia grading, in: 2021 IEEE International Conference on Image Processing (ICIP), IEEE. pp. 76– 80.
  2. Hashimoto N, Fukushima D, Koga R, Takagi Y, Ko K, Kohno K, Nakaguro M, Nakamura S, Hontani H, Takeuchi I, 2020b. Multi-scale domain-adversarial multiple-instance cnn for cancer subtype classification with unannotated histopathological images, in: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp. 3852– 3861.
  3. Ilse M, Tomczak J, Welling M, 2018. Attention-based deep multiple instance learning, in: International conference on machine learning, PMLR. pp. 2127– 2136.
  4. Schirris Y, Gavves E, Nederlof I, Horlings HM, Teuwen J, 2021. Deepsmile: Self-supervised heterogeneity-aware multiple instance learning for dna damage response defect classification directly from h&e whole-slide images. arXiv preprint arXiv:2107.09405. · arXiv
  5. Wang S, Zhu Y, Yu L, Chen H, Lin H, Wan X, Fan X, Heng PA, 2019. Rmdl: Recalibrated multi-instance deep learning for whole slide gastric image classification. Medical image analysis 58, 101549. 31499320
  6. Xiong C, Chen H, Sung J, King I, 2023. Diagnose like a pathologist: Transformer-enabled hierarchical attention-guided multiple instance learning for whole slide image classification. arXiv preprint arXiv:2301.08125 · arXiv

Cited by

Sorted by citations

Authors
Deng, R., Cui, C., Remedios, L. W., Bao, S., Womick, R. M., Chiron, S., Li, J., Roland, J. T., Lau, K. S., Liu, Q., Wilson, K. T., Wang, Y., Coburn, L. A., Landman, B. A., & Huo, Y.
Affiliations
  • Vanderbilt University (US)
  • University of North Carolina at Chapel Hill (US)
  • Vanderbilt University Medical Center (US)
  • VA Tennessee Valley Healthcare System (US)
Corresponding author
Huo, Yuankai
Venue
Medical Image Analysis
Publisher
Elsevier BV
Published
2024-05
Volume
94
Pages
103124
ISSN
1361-8415 (ISSN-L)
OpenAlex
W4392190141
Cited by
95
References
41
Citations by year
2026: 34 · 2025: 44 · 2024: 15 · 2023: 2
FWCI
13.72
Type
journal article
Language
en
Open access
Locations
  • Medical Image Analysis (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • PubMed Central (acceptedVersion)
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Funders
  • NIH (R01DK135597)
  • U.S. Department of Veterans Affairs (I01CX002171, I01BX004366)
  • National Science Foundation (1452485)
  • Leona M and Harry B Helmsley Charitable Trust (G-1903-03793)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › AI in cancer detection
  • Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › Radiomics and Machine Learning in Medical Imaging
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Image Retrieval and Classification Techniques
Keywords
whole slide images, digital pathology, multiscale image analysis, cross-scale attention
MeSH terms
Algorithms, Diagnostic Imaging, Humans

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review