Interpretable classification from skin Cancer histology slides using deep learning: A retrospective multicenter study
Open accessAbstract
For diagnosing melanoma, hematoxylin and eosin (H&E) stained tissue slides remains the gold standard. These images contain quantitative information in different magnifications. In the present study, we investigated whether deep convolutional neural networks can extract structural features of complex tissues directly from these massive size images in a patched way. In order to face the challenge arise from morphological diversity in histopathological slides, we built a multicenter database of 2241 digital whole-slide images from 1321 patients from 2008 to 2018. We trained both ResNet50 and Vgg19 using over 9.95 million patches by transferring learning, and test performance with two kinds of critical classifications: malignant melanomas versus benign nevi in separate and mixed magnification; and distinguish among nevi in maximum magnification. The CNNs achieves superior performance across both tasks, demonstrating an AI capable of classifying skin cancer in the analysis from histopathological images. For making the classifications reasonable, the visualization of CNN representations is furthermore used to identify cells between melanoma and nevi. Regions of interest (ROI) are also located which are significantly helpful, giving pathologists more support of correctly diagnosis.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The multicentric study created heat maps to explain important image regions, increasing physician confidence in AI models for clinical decisions.
“Additionally, the work also created heat maps to explain the important regions in the images thus increasing the confidence of physicians in the AI models for clinical decisions.”
From Revolutionizing dermatopathology using AI in skin diagnostics: scoping review (2026) · cites this paper as [30]
Section 4.3 (p. 5) says the study generated heat maps showing which image regions mattered to the CNN, and the Introduction (p. 2) says locating these regions could help doctors with diagnosis. The paper does not report that the heat maps increased physicians’ confidence in AI models for clinical decisions. (LLM, conf=0.87)
Experimental — accuracy not yet measuredMulticenter validations demonstrate increased clinician confidence and a reduction in false positives.
“Multicenter validations demonstrate increased clinician confidence and a reduction in false positives (30, 37, 38).”
From Revolutionizing dermatopathology using AI in skin diagnostics: scoping review (2026) · cites this paper as [30]
The Dataset section (p. 2) describes a multicenter image collection, and the mixed-magnification results (p. 3) report higher specificity for ResNet50 than Vgg19, consistent with fewer model false positives in that comparison. The paper does not report measuring clinician confidence or demonstrating a reduction in clinicians’ false positives. (LLM, conf=0.83)
Experimental — accuracy not yet measuredA multicentric study using a ResNet50-based model produced an F1 score of 0.93, sensitivity of 0.92, specificity of 0.97, and AUC of 0.99 for melanoma detection.
“They used a ResNet50-based model, the model produced F1 score of 0.93, sensitivity of 0.92; specificity of 0.97; and the AUC was 0.99 for the detection of melanoma.”
From Revolutionizing dermatopathology using AI in skin diagnostics: scoping review (2026) · cites this paper as [30]
Xie et al. conducted multicenter studies using ResNet50 and obtained F1 0.93, sensitivity 0.92, specificity 0.97, and AUC 0.99 for melanoma identification.
“Extending further from this, Xie et al. (30) conducted multicenter studies using the ResNet50 model and obtained an F1 score of 0.93, a sensitivity of 0.92, a specificity of 0.97, and an AUC of 0.99 for the identification of melanoma.”
From Revolutionizing dermatopathology using AI in skin diagnostics: scoping review (2026) · cites this paper as [30]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474 · see citing works
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 74,248 · see citing works
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805 · see citing works
Densely Connected Convolutional Networks
Huang, G., Liu, Z., Van Der Maaten, L., & Weinberger, K. Q. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.243 · Cited by 48,566 · see citing works
Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization
Selvaraju, R. R., Cogswell, M., Das, A., Vedantam, R., Parikh, D., & Batra, D. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.74 · Cited by 24,513 · see citing works
Identifying Medical Diagnoses and Treatable Diseases by Image-Based Deep Learning
Kermany, D. S., Goldbaum, M., Cai, W., Valentim, C. C. S., Liang, H., Baxter, S. L., McKeown, A., Yang, G., Wu, X., Yan, F., et al. (2018) · Cell · doi:10.1016/j.cell.2018.02.010 · Cited by 4,842 · see citing works
Inverting Visual Representations with Convolutional Networks
Dosovitskiy, A., & Brox, T. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.522 · Cited by 631 · see citing works
Interpreting CNN Knowledge via an Explanatory Graph
Zhang, Q., Cao, R., Shi, F., Wu, Y. N., & Zhu, S. C. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11819 · Cited by 219 · see citing works
Assessing microscope image focus quality with deep learning
Yang, S., Berndl, M., Ando, D. M., Barch, M., Narayanaswamy, A., Christiansen, E. M., Hoyer, S., Roat, C., Hung, J., Rueden, C., et al. (2018) · BMC Bioinformatics · doi:10.1186/s12859-018-2087-4 · Cited by 152 · see citing works
Epidemiology, Risk Factors, Prevention, and Early Detection of Melanoma
Azoury, S. C., & Lange, J. R. (2014) · Surgical Clinics of North America · doi:10.1016/j.suc.2014.07.013 · Cited by 124 · see citing works
Examining CNN Representations With Respect to Dataset Bias
Zhang, Q., Wang, W., & Zhu, S. C. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11833 · Cited by 95 · see citing works
MacCormick, I. J. C., Williams, B. M., Zheng, Y., Li, K., Al‐Bander, B., Czanner, S., Cheeseman, R., Willoughby, C. E., Brown, E. N., Spaeth, G. L., et al. (2019) · PLoS ONE · doi:10.1371/journal.pone.0209409 · Cited by 74 · see citing works
Visually interpretable deep network for diagnosis of breast masses on mammograms
Kim, S. T., Lee, J.-H., Lee, H., & Ro, Y. M. (2018) · Physics in Medicine and Biology · doi:10.1088/1361-6560/aaef0a · Cited by 29 · see citing works
Srivastava, A., Kulkarni, C., Huang, K., Parwani, A. V., Mallick, P., & Machiraju, R. (2018) · Biomedical Informatics Insights · doi:10.1177/1178222618807481 · Cited by 13 · see citing works
Flagged first, then by citations
Research works printed but not linked: 4
- [2][2]. World Cancer Report 2014. World Health Organization. 2014: Chapter 5.14. ISBN 9283204298. -
- [7][7]. Krizhevsky, Alex, Ilya Sutskever, et al. ImageNet Classification with Deep Convolutional Neural Networks, 2012. NIPS. -
- [10][10]. Zeiler, Matthew D., and Rob Fergus. Visualizing and Understanding Convolutional Networks, 2014. ECCV. -
- [19][19]. Simonyan, K., Zisserman, A., 2015. Very deep convolutional networks forlarge-scale image recognition, in: International Conference on LearningRepresentations (ICLR 2015). -
Cited by
Sorted by citations
Goyal, M., Knackstedt, T., Yan, S., & Hassanpour, S. (2020) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2020.104065 · Cited by 461 · see citing works
Machine Learning and Its Application in Skin Cancer
Das, K., Cockerell, C. J., Patil, A. D., Pietkiewicz, P., Giulini, M., Grabbe, S., & Goldust, M. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph182413409 · Cited by 163 · see citing works
Imbalanced Breast Cancer Classification Using Transfer Learning
Singh, R., Ahmed, T., Kumar, A., Singh, A. K., Pandey, A. K., & Singh, S. K. (2020) · IEEE Transactions on Computational Biology and Bioinformatics · doi:10.1109/tcbb.2020.2980831 · Cited by 139 · see citing works
Computational pathology: A survey review and the way forward
Hosseini, M. S., Bejnordi, B. E., Trinh, V. Q., Chan, L., Hasan, D., Li, X., Yang, S. C., Kim, T., Zhang, H., Wu, T., et al. (2024) · Journal of Pathology Informatics · doi:10.1016/j.jpi.2023.100357 · Cited by 124 · see citing works
Explainable deep learning in healthcare: A methodological survey from an attribution view
Jin, D., Sergeeva, E., Weng, W., Chauhan, G., & Szolovits, P. (2022) · WIREs Mechanisms of Disease · doi:10.1002/wsbm.1548 · Cited by 89 · see citing works
Utilizing Knowledge Distillation in Deep Learning for Classification of Chest X-Ray Abnormalities
Ho, T. K. K., & Gwak, J. (2020) · IEEE Access · doi:10.1109/access.2020.3020802 · Cited by 72 · see citing works
Convolutional Neural Network Based Desktop Applications to Classify Dermatological Diseases
Göçeri, E. (2020) · IEEE International Conference on Image Processing, Applications and Systems (IPAS) · doi:10.1109/ipas50080.2020.9334956 · Cited by 55 · see citing works
Artificial Intelligence for Dermatopathology: Current Trends and the Road Ahead
Chen, S. B., & Novoa, R. A. (2022) · Seminars in Diagnostic Pathology · doi:10.1053/j.semdp.2022.01.003 · Cited by 37 · see citing works
PathML: A unified framework for whole-slide image analysis with deep learningPreprint
Berman, A. G., Orchard, W. R., Gehrung, M., & Markowetz, F. M. (2021) · medRxiv · doi:10.1101/2021.07.07.21260138 · Cited by 24 · see citing works
SkNet: A Convolutional Neural Networks Based Classification Approach for Skin Cancer Classes
Jeny, A. A., Sakib, A. N., Junayed, M. S., Lima, K. A., Ahmed, I., & Islam, M. B. (2020) · International Conference on Computer and Information Technology (ICCIT) · doi:10.1109/iccit51783.2020.9392716 · Cited by 21 · see citing works
Artificial intelligence in Dermatopathology
Jartarkar, S. R., Cockerell, C. J., Patil, A., Kassir, M., Babaei, M., Weidenthaler‐Barth, B., Grabbe, S., & Goldust, M. (2023) · Journal of Cosmetic Dermatology · doi:10.1111/jocd.15565 · Cited by 17 · see citing works
Breast cancer prediction by ensemble meta-feature space generator based on deep neural network
Taheri, M., & Omranpour, H. (2023) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2023.105382 · Cited by 13 · see citing works
Wu, H., Chen, H., Wang, X., Yu, L., Yu, Z., Shi, Z., Xu, J., Dong, B., & Zhu, S. (2022) · Frontiers in Oncology · doi:10.3389/fonc.2021.810909 · Cited by 10 · see citing works
Multiple Interpretations Improve Deep Learning Transparency for Prostate Lesion Detection
Gulum, M. A., Trombley, C. M., & Kantardzic, M. M. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-71055-2_11 · Cited by 9 · see citing works
A Bio-Inspired Method For Breast Histopathology Image Classification Using Transfer Learning
Mani, R. K. C., Kamalakannan, J., Rangaiah, Y. P., & Anand, S. (2023) · Journal of Artificial Intelligence and Technology · doi:10.37965/jait.2023.0246 · Cited by 6 · see citing works
Machine learning to detect melanoma exploiting nuclei morphology and Spatial organization
Veronesi, G., Curti, N., Gardini, A., Querzoli, G., Castellani, G., & Dika, E. (2025) · Scientific Reports · doi:10.1038/s41598-025-02913-z · Cited by 6 · see citing works
Effects of annotation granularity in deep learning models for histopathological images
Shi, J., Gao, Z., Zhang, H., Puttapirat, P., Wang, C., Zhang, X., & Li, C. (2019) · IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm47256.2019.8983158 · Cited by 4 · see citing works
Deep Learning Based Decision Support for Medicine -- A Case Study on Skin Cancer DiagnosisPreprint
Lucieri, A., Dengel, A. R., & Ahmed, S. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.05112 · Cited by 4 · see citing works
Guerra-Rosas, E., López-Ávila, L. F., Garza-Flores, E., Vidales-Basurto, C. A., & Álvarez-Borrego, J. (2023) · Applied Sciences · doi:10.3390/app132011425 · Cited by 3 · see citing works
Melanoma Skin Cancer Detection and Classification using Deep Learning
Vattikuti, L., Chintala, S. V., Dola, S. K., Sai, V. P., Amarnadh, D., & Tummalapalli, S. (2023) · International Journal for Research in Applied Science and Engineering Technology · doi:10.22214/ijraset.2023.55896 · Cited by 2 · see citing works
Transformer-Based Skin Carcinoma Classification using Histopathology Images via Incremental Learning
Imran, M., Akram, M. U., & Salam, A. A. (2024) · International Conference on Pattern Recognition Systems (ICPRS) · doi:10.1109/icprs62101.2024.10677812 · Cited by 2 · see citing works
Revolutionizing dermatopathology using AI in skin diagnostics: scoping review
Rammal, R., Mohy U Din, A., & Alam, T. (2026) · Frontiers in Medicine · doi:10.3389/fmed.2026.1614681 · Cited by 1 · see citing works
“Extending further from this, Xie et al. (30) conducted multicenter studies using the ResNet50 model and obtained an F1 score of 0.93, a sensitivity of 0.92, a specificity of 0.97, and an AUC of 0.99 for the identification of melanoma.”
InfluentialLu, C. Y., Koyuncu, C., Janowczyk, A. R., Griffith, C. C., Chute, D. J., Lewis, J. S., & Madabhushi, A. (2021) · Springer eBooks · doi:10.1007/978-3-030-69859-1_6
ERNet : Enhanced ResNet for classification of breast histopathological images
Kamalakannan, J., & K, C. M. R. (2024) · ELCVIA Electronic Letters on Computer Vision and Image Analysis · doi:10.5565/rev/elcvia.1614
- Authors
- Xie, P., Zuo, K., Zhang, Y., Li, F., Yin, M., & Lu, K.
- Affiliations
- National University of Defense Technology (CN)
- Xiangya Hospital Central South University (CN)
- Yale University (US)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2019
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1904.06156
- OpenAlex
- W2938004941
- Cited by
- 23
- References
- 14
- Citations by year
- 2026: 1 · 2025: 1 · 2024: 3 · 2023: 4 · 2022: 3 · 2021: 5 · 2020: 5 · 2019: 1
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- National Cancer Institute
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › AI in cancer detection
- Health Sciences › Medicine › Oncology › Cutaneous Melanoma Detection and Management
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Digital Imaging for Blood Diseases
- Keywords
- melanoma classification, whole slide images, H&E staining, convolutional neural networks, transfer learning, ResNet50, VGG19, patch-based feature extraction, explainable AI, digital pathology
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review