Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 43 of the 43 references it cites were found in a registry or an index.

A deep learning model based on whole slide images to predict disease-free survival in cutaneous melanoma patients

Open access

Abstract

The application of deep learning on whole-slide histological images (WSIs) can reveal insights for clinical and basic tumor science investigations. Finding quantitative imaging biomarkers from WSIs directly for the prediction of disease-free survival (DFS) in stage I–III melanoma patients is crucial to optimize patient management. In this study, we designed a deep learning-based model with the aim of learning prognostic biomarkers from WSIs to predict 1-year DFS in cutaneous melanoma patients. First, WSIs referred to a cohort of 43 patients (31 DF cases, 12 non-DF cases) from the Clinical Proteomic Tumor Analysis Consortium Cutaneous Melanoma (CPTAC-CM) public database were firstly annotated by our expert pathologists and then automatically split into crops, which were later employed to train and validate the proposed model using a fivefold cross-validation scheme for 5 rounds. Then, the model was further validated on WSIs related to an independent test, i.e. a validation cohort of 11 melanoma patients (8 DF cases, 3 non-DF cases), whose data were collected from Istituto Tumori ‘Giovanni Paolo II’ in Bari, Italy. The quantitative imaging biomarkers extracted by the proposed model showed prognostic power, achieving a median AUC value of 69.5% and a median accuracy of 72.7% on the public cohort of patients. These results remained comparable on the validation cohort of patients with an AUC value of 66.7% and an accuracy value of 72.7%, respectively. This work is contributing to the recently undertaken investigation on how treat features extracted from raw WSIs to fulfil prognostic tasks involving melanoma patients. The promising results make this study as a valuable basis for future research investigation on wider cohorts of patients referred to our Institute.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1038/s41598-022-24315-1

Cites

43 of 43 references verified0 citation errors · 0 not checkable

Statistics

Figures

Figure 1 Boxplots of the performances of the 1-year disease-free survival predictive models in terms of percentage AUC, accuracy, sensitivity, specificity, F1-score and G-mean. The results are evaluated by implementing a fivefold cross validation scheme for five rounds on the CPTAC-CM public dataset.
Figure 1 Boxplots of the performances of the 1-year disease-free survival predictive models in terms of percentage AUC, accuracy, sensitivity, specificity, F1-score and G-mean. The results are evaluated by implementing a fivefold cross validation scheme for five rounds on the CPTAC-CM public dataset.CC BY · PubMed Central
Figure 2 ROC Curve related to the DeepSVM model on the validation cohort. The dotted line represents the random guess.
Figure 2 ROC Curve related to the DeepSVM model on the validation cohort. The dotted line represents the random guess.CC BY · PubMed Central
Figure 3 Workflow of the proposed approach. Image pre-processing was firstly performed: WSIs were annotated by expert pathologists; the identified Region of Interests (ROIs), one per WSI, were tessellated into tiles of 224 × 224 pixels; cell detection was performed and only tiles with high cell density were retained and then divided into low-dimensional crops, which were finally colour-normalized. Data-analysis was then performed: crops were taken in input by three pre-trained CNNs. Each CNN extracted thousands of imaging features, later undergoing to a feature selection process; the selected features were employed to build a SVM classifier, which expressed a decision (DF or non-DF) firstly at crop level and then at slide level through the implementation of a vote score thresholding. In correspondence of the three CNNs, three models, called ResSVM, DenseSVM and InceptionSVM were defined. An ensemble model, named DeepSVM, was designed by combining the classification scores of the three models. A model, named Clinical, which took in input clinical data and used a SVM classifier to give in output classification scores at WSI level, was defined. A soft-voting procedure was implemented to combine the classification scores of DeepSVM and Clinical at WSI level and then at patient level. The final model was called DeepSVM + Clinical. Predictive performances were assessed by standard evaluation metrics.
Figure 3 Workflow of the proposed approach. Image pre-processing was firstly performed: WSIs were annotated by expert pathologists; the identified Region of Interests (ROIs), one per WSI, were tessellated into tiles of 224 × 224 pixels; cell detection was performed and only tiles with high cell density were retained and then divided into low-dimensional crops, which were finally colour-normalized. Data-analysis was then performed: crops were taken in input by three pre-trained CNNs. Each CNN extracted thousands of imaging features, later undergoing to a feature selection process; the selected features were employed to build a SVM classifier, which expressed a decision (DF or non-DF) firstly at crop level and then at slide level through the implementation of a vote score thresholding. In correspondence of the three CNNs, three models, called ResSVM, DenseSVM and InceptionSVM were defined. An ensemble model, named DeepSVM, was designed by combining the classification scores of the three models. A model, named Clinical, which took in input clinical data and used a SVM classifier to give in output classification scores at WSI level, was defined. A soft-voting procedure was implemented to combine the classification scores of DeepSVM and Clinical at WSI level and then at patient level. The final model was called DeepSVM + Clinical. Predictive performances were assessed by standard evaluation metrics.CC BY · PubMed Central

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 43 references

Research works printed but not linked: 3

  1. Farahani, N., Parwani, A. V. & Pantanowitz, L. Whole slide imaging in pathology: Advantages, limitations and emerging perspectives. Pathol. Lab Med. Int. 7, 23–33 (2015).
  2. Macenko M., Niethammer M, Marron J.S. et al. A method for normalizing histology slides for quantitative analysis 3 Statistics and Operations Research, 4 Lineberger Comprehensive Cancer Center, 5 Renaissance Computing Institute, 6 Pathology and Laboratory Medicine, 7 Dermatology University of Nor. IEEE Int Symp Biomed Imaging 1107–1110 (2009).
  3. Akosa, J. S. Predictive accuracy: A misleading performance measure for highly imbalanced data. SAS Glob. Forum 942, 1–12 (2017).

Cited by

See all 33

Metadata

Authors
Comes, M. C., Fucci, L., Mele, F., Bove, S., Cristofaro, C., De Risi, I., Fanizzi, A., Milella, M., Strippoli, S., Zito, A., Guida, M., & Massafra, R.
Affiliations
Istituto Tumori Bari (IT)
Corresponding author
  • Bove, Samantha
  • Fanizzi, Annarita
Venue
Scientific Reports
Published
2022-11-27
Volume
12
Issue
1
Pages
20366-20366
ISSN
2045-2322 (ISSN-L)
OpenAlex
W4310273766
Cited by
33
References
43
Citations by year
2026: 7 · 2025: 9 · 2024: 10 · 2023: 6 · 2022: 1
FWCI
2.14
Type
journal article
Language
en
Open access
Licence
Locations
  • Scientific Reports (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Funders
Ministero della Salute (RC2022)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › AI in cancer detection
  • Health Sciences › Medicine › Oncology › Cutaneous Melanoma Detection and Management
  • Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › Radiomics and Machine Learning in Medical Imaging
Keywords
cutaneous melanoma, disease-free survival, whole slide images, prognostic factors, quantitative imaging biomarkers, deep learning, histopathology, survival prediction
MeSH terms
Deep Learning, Melanoma, Cutaneous Malignant, Cutaneous Malignant Melanoma, Humans, Melanoma, Skin Neoplasms, Disease-Free Survival, Proteomics

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: A deep learning model based on whole slide images to predict disease-free survival in cutaneous melanoma patients. https://app.cochat.ai/papers/10.1038/s41598-022-24315-1
The paper
Comes, M. C., Fucci, L., Mele, F., Bove, S., Cristofaro, C., De Risi, I., Fanizzi, A., Milella, M., Strippoli, S., Zito, A., Guida, M., & Massafra, R. (2022). A deep learning model based on whole slide images to predict disease-free survival in cutaneous melanoma patients. Scientific Reports. https://doi.org/10.1038/s41598-022-24315-1

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.