Cited by 27AI in cancer detectionCutaneous Melanoma Detection and ManagementNonmelanoma Skin Cancer Studies

Detection and subtyping of basal cell carcinoma in whole-slide histopathology using weakly-supervised learning

Open access
Geijs, Daan J., Dooper, Stephan, Aswolinskiy, Witali, Hillen, Lisa M., Amir, Avital L., Litjens, Geert·2024·Medical Image Analysis

Abstract

The frequency of basal cell carcinoma (BCC) cases is putting an increasing strain on dermatopathologists. BCC is the most common type of skin cancer, and its incidence is increasing rapidly worldwide. AI can play a significant role in reducing the time and effort required for BCC diagnostics and thus improve the overall efficiency of the process. To train such an AI system in a fully-supervised fashion however, would require a large amount of pixel-level annotation by already strained dermatopathologists. Therefore, in this study, our primary objective was to develop a weakly-supervised for the identification of basal cell carcinoma (BCC) and the stratification of BCC into low-risk and high-risk categories within histopathology whole-slide images (WSI). We compared Clustering-constrained Attention Multiple instance learning (CLAM) with StreamingCLAM and hypothesized that the latter would be the superior approach. A total of 5147 images were used to train and validate the models, which were subsequently tested on an internal set of 949 images and an external set of 183 images. The labels for training were automatically extracted from free-text pathology reports using a rule-based approach. All data has been made available through the COBRA dataset. The results showed that both the CLAM and StreamingCLAM models achieved high performance for the detection of BCC, with an area under the ROC curve (AUC) of 0.994 and 0.997, respectively, on the internal test set and 0.983 and 0.993 on the external dataset. Furthermore, the models performed well on risk stratification, with AUC values of 0.912 and 0.931, respectively, on the internal set, and 0.851 and 0.883 on the external set. In every single metric the StreamingCLAM model outperformed the CLAM model or is on par. The performance of both models was comparable to that of two pathologists who scored 240 BCC positive slides. Additionally, in the public test set, StreamingCLAM demonstrated a comparable AUC of 0.958, markedly superior to CLAM's 0.803. This difference was statistically significant and emphasized the strength and better adaptability of the StreamingCLAM approach.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1016/j.media.2023.103063

Cites

16 of 16 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • The Radboud University Medical Center cohort includes 949 cases from the test split of the COBRA dataset of patients who underwent skin biopsy.

    “The Radboud University Medical Center cohort includes 949 cases from the test split of the COBRA41 dataset of patients who underwent skin biopsy.”

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Cited by

Sorted by citations

Authors
Geijs, D. J., Dooper, S., Aswolinskiy, W., Hillen, L. M., Amir, A. L., & Litjens, G.
Affiliations
  • Radboud University Medical Center (NL)
  • Maastricht University Medical Centre (NL)
Corresponding author
Geijs, Daan J.
Venue
Medical Image Analysis
Publisher
Elsevier BV
Published
2024-04
Volume
93
Pages
103063
ISSN
1361-8415 (ISSN-L)
OpenAlex
W4389839624
Cited by
27
References
16
Citations by year
2026: 10 · 2025: 14 · 2024: 3
FWCI
2.54
Type
journal article
Language
en
Open access
Locations
  • Medical Image Analysis (publishedVersion, cc-by-sa)
  • PubMed (publishedVersion)
  • Research Publications (Maastricht University) (publishedVersion, cc-by)
  • Radboud Repository (Radboud University) (submittedVersion, cc-by-sa)
  • Radboud Repository (Radboud University) (submittedVersion)
Funders
  • Nederlandse Organisatie voor Wetenschappelijk Onderzoek
  • HORIZON EUROPE European Research Council (101041730)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › AI in cancer detection
  • Health Sciences › Medicine › Oncology › Cutaneous Melanoma Detection and Management
  • Health Sciences › Medicine › Epidemiology › Nonmelanoma Skin Cancer Studies
Keywords
basal cell carcinoma, whole slide images, weakly supervised learning, clams, multiple instance learning, attention mechanism, risk stratification, skin cancer detection, dermatopathology
MeSH terms
Supervised Machine Learning, Basal Cell Carcinoma, Humans, Skin Neoplasms, Area Under Curve

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review