Pathologist-level classification of histopathological melanoma images with deep neural networks
Open accessAbstract
BACKGROUND: The diagnosis of most cancers is made by a board-certified pathologist based on a tissue biopsy under the microscope. Recent research reveals a high discordance between individual pathologists. For melanoma, the literature reports 25-26% of discordance for classifying a benign nevus versus malignant melanoma. Deep learning was successfully implemented to enhance the precision of lung and breast cancer diagnoses. The aim of this study is to illustrate the potential of deep learning to assist human assessment for a histopathologic melanoma diagnosis. METHODS: Six hundred ninety-five lesions were classified by an expert histopathologist in accordance with current guidelines (350 nevi and 345 melanomas). Only the haematoxylin and eosin stained (H&E) slides of these lesions were digitalised using a slide scanner and then randomly cropped. Five hundred ninety-five of the resulting images were used for the training of a convolutional neural network (CNN). The additional 100 H&E image sections were used to test the results of the CNN in comparison with the original class labels. FINDINGS: The total discordance with the histopathologist was 18% for melanoma (95% confidence interval [CI]: 7.4-28.6%), 20% for nevi (95% CI: 8.9-31.1%) and 19% for the full set of images (95% CI: 11.3-26.7%). INTERPRETATION: Even in the worst case, the discordance of the CNN was about the same compared with the discordance between human pathologists as reported in the literature. Despite the vastly reduced amount of data, time necessary for diagnosis and cost compared with the pathologist, our CNN archived on-par performance. Conclusively, CNNs indicate to be a valuable tool to assist human melanoma diagnoses.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The Hekler et al. algorithm can only assess whether a lesion is more likely to be a nevus or melanoma, unlike pathologists who consider a wide range of differential diagnoses.
“the algorithm’s binary classification approach; unlike pathologists, who must consider a wide range of differential diagnoses, the model can only assess whether a lesion is more likely to be a nevus or melanoma.”
From Artificial Intelligence in Dermatopathology: An Update and Review of the Current Literature (2026) · cites this paper as [14]
Deep learning models can match or exceed human-level performance under certain conditions in distinguishing benign nevi from malignant melanoma.
“While the results suggest that deep learning models can match or exceed human-level performance under certain conditions”
From Artificial Intelligence in Dermatopathology: An Update and Review of the Current Literature (2026) · cites this paper as [14]
ResNet50 is a commonly used CNN model in classification of cutaneous lesions, including melanoma, achieving high diagnostic accuracy.
“One of the most commonly used is ResNet50, a CNN model well known for its success in image classification and used in classification of many cutaneous lesions, including melanoma classification, achieving a high diagnostic accuracy [14,18].”
From Artificial Intelligence in Dermatopathology: An Update and Review of the Current Literature (2026) · cites this paper as [14]
Hekler et al.'s ResNet50 CNN model had an overall disagreement with pathologists of 18% for melanoma cases and 20% for nevi.
“The overall disagreement with the pathologist was 18% for melanoma cases and 20% for nevi.”
From Artificial Intelligence in Dermatopathology: An Update and Review of the Current Literature (2026) · cites this paper as [14]
Hekler et al. found DNNs gave 100% sensitivity and 98.9% specificity for nodular basal cell carcinoma, 98.8% sensitivity and 100% specificity in dermal nevi, and 100% sensitivity and specificity in seborrheic keratosis.
“The DNN gave excellent results with 100% sensitivity and 98.9% specificity for nodular basal cell carcinoma. It also yielded a high sensitivity of 98.8% and a specificity of 100% in dermal nevi and sensitivity and specificity of 100% in seborrheic keratosis.”
From Revolutionizing dermatopathology using AI in skin diagnostics: scoping review (2026) · cites this paper as [29]
Hekler et al. showed DNNs achieved sensitivity and specificity of 100% and 98.9%, respectively, for nodular basal cell carcinoma, and similarly high sensitivity and specificity for dermal nevi and seborrheic keratosis.
“Also, Hekler et al. (29) showed that DNNs achieved sensitivity and specificity of 100 and 98.9%, respectively, for nodular basal cell carcinoma, and similarly high sensitivity and specificity for dermal nevi and seborrheic keratosis, thus proving their capability to increase diagnostic reliability.”
From Revolutionizing dermatopathology using AI in skin diagnostics: scoping review (2026) · cites this paper as [29]
DNNs have the capability to increase diagnostic reliability.
“Also, Hekler et al. (29) showed that DNNs achieved sensitivity and specificity of 100 and 98.9%, respectively, for nodular basal cell carcinoma, and similarly high sensitivity and specificity for dermal nevi and seborrheic keratosis, thus proving their capability to increase diagnostic reliability.”
From Revolutionizing dermatopathology using AI in skin diagnostics: scoping review (2026) · cites this paper as [29]
Hekler et al. found that CNNs classifying 695 melanocytic neoplasms into nevus or melanoma demonstrated superior diagnostic accuracy compared to an expert dermatopathologist.
“Hekler et al. [15] compared the performance of CNNs in classifying 695 melanocytic neoplasms into nevus or melanoma to that of an expert dermatopathologist, and the AI system demonstrated superior diagnostic accuracy.”
From Artificial Intelligence in the Histopathological Assessment of Non-Neoplastic Skin Disorders: A Narrative Review with Future Perspectives (2025) · cites this paper as [15]
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474 · see citing works
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380 · see citing works
Dermatologist-level classification of skin cancer with deep neural networks
Esteva, A., Kuprel, B., Novoa, R. A., Ko, J., Swetter, S. M., Blau, H. M., & Thrun, S. (2017) · Nature · doi:10.1038/nature21056 · Cited by 14,362 · see citing works
Ehteshami Bejnordi, B., Veta, M., Johannes van Diest, P., van Ginneken, B., Karssemeijer, N., Litjens, G., van der Laak, J. A. W. M., and the CAMELYON16 Consortium, Hermsen, M., Manson, Q. F., et al. (2017) · JAMA · doi:10.1001/jama.2017.14585 · Cited by 3,293 · see citing works
Haenssle, H. A., Fink, C., Schneiderbauer, R., Toberer, F., Buhl, T., Blum, A., Kalloo, A., Hassen, A. B. H., Thomas, L., Enk, A., et al. (2018) · Annals of Oncology · doi:10.1093/annonc/mdy166 · Cited by 1,571 · see citing works
Self-citationImage analysis and machine learning in digital pathology: challenges and opportunities
Madabhushi, A., & Lee, G. (2016) · Medical Image Analysis · doi:10.1016/j.media.2016.06.037 · Cited by 1,093 · see citing works
Yu, K.-H., Zhang, C., Berry, G. J., Altman, R. B., Ré, C., Rubin, D. L., & Snyder, M. (2016) · Nature Communications · doi:10.1038/ncomms12474 · Cited by 972 · see citing works
Brinker, T. J., Hekler, A., Enk, A. H., Klode, J., Hauschild, A., Berking, C., Schilling, B., Haferkamp, S., Schadendorf, D., Holland-Letz, T., et al. (2019) · European Journal of Cancer · doi:10.1016/j.ejca.2019.04.001 · Cited by 605 · see citing works
Self-citationSkin Cancer Classification Using Convolutional Neural Networks: Systematic Review
Brinker, T. J., Hekler, A., Utikal, J. S., Grabe, N., Schadendorf, D., Klode, J., Berking, C., Steeb, T., Enk, A. H., & Kalle, C. V. (2018) · Journal of Medical Internet Research · doi:10.2196/11936 · Cited by 504 · see citing works
Self-citationElmore, J. G., Barnhill, R. L., Elder, D. E., Longton, G., PEPE, M. S., Reisch, L. M., Carney, P. A., Titus, L. J., Nelson, H. D., Onega, T., et al. (2017) · BMJ · doi:10.1136/bmj.j2813 · Cited by 449 · see citing works
Liu, Y., Kohlberger, T., Norouzi, M., Dahl, G. E., Smith, J. L., Mohtashamian, A., Olson, N. H., Peng, L. H., Hipp, J., & Stumpe, M. C. (2018) · Archives of Pathology & Laboratory Medicine · doi:10.5858/arpa.2018-0147-oa · Cited by 402 · see citing works
Marchetti, M. A., Codella, N., Dusza, S. W., Gutman, D. A., Helba, B., Kalloo, A., Mishra, N. K., Carrera, C., Celebi, M. E., DeFazio, J., et al. (2017) · Journal of the American Academy of Dermatology · doi:10.1016/j.jaad.2017.08.016 · Cited by 329 · see citing works
Brinker, T. J., Hekler, A., Enk, A. H., Klode, J., Hauschild, A., Berking, C., Schilling, B., Haferkamp, S., Schadendorf, D., Fröhling, S., et al. (2019) · European Journal of Cancer · doi:10.1016/j.ejca.2019.02.005 · Cited by 304 · see citing works
Self-citationCorona, R., Mele, A., Amini, M., Rosa, G. D., Coppola, G., Piccardi, P., Fucci, M., Pasquini, P., & Faraggiana, T. (1996) · Journal of Clinical Oncology · doi:10.1200/jco.1996.14.4.1218 · Cited by 267 · see citing works
Brinker, T. J., Hekler, A., Hauschild, A., Berking, C., Schilling, B., Enk, A. H., Haferkamp, S., Karoglan, A., von Kalle, C., Weichenthal, M., et al. (2019) · European Journal of Cancer · doi:10.1016/j.ejca.2018.12.016 · Cited by 157 · see citing works
Self-citationLodha, S., Saggar, S., Celebi, J. T., & Silvers, D. N. (2008) · Journal of Cutaneous Pathology · doi:10.1111/j.1600-0560.2007.00970.x · Cited by 156 · see citing works
Not Just Digital Pathology, Intelligent Digital Pathology
Ács, B., & Rimm, D. L. (2018) · JAMA Oncology · doi:10.1001/jamaoncol.2017.5449 · Cited by 44 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
AI in Medical Imaging Informatics: Current Challenges and Future Directions
Panayides, A. S., Amini, A., Filipovic, N. D., Sharma, A., Tsaftaris, S. A., Young, A., Foran, D., Do, N., Golemati, S., Kurc, T., et al. (2020) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2020.2991043 · Cited by 713 · see citing works
Hekler, A., Utikal, J. S., Enk, A. H., Solass, W., Schmitt, M., Klode, J., Schadendorf, D., Sondermann, W., Franklin, C., Bestvater, F., et al. (2019) · European Journal of Cancer · doi:10.1016/j.ejca.2019.06.012 · Cited by 285 · see citing works
Haggenmüller, S., Maron, R. C., Hekler, A., Utikal, J. S., Barata, C., Barnhill, R. L., Beltraminelli, H., Berking, C., Betz-Stablein, B., Blum, A., et al. (2021) · European Journal of Cancer · doi:10.1016/j.ejca.2021.06.049 · Cited by 267 · see citing works
The Integration of Artificial Intelligence into Clinical Practice
Karalis, V. D. (2024) · Applied Biosciences · doi:10.3390/applbiosci3010002 · Cited by 255 · see citing works
Maron, R. C., Weichenthal, M., Utikal, J. S., Hekler, A., Berking, C., Hauschild, A., Enk, A. H., Haferkamp, S., Klode, J., Schadendorf, D., et al. (2019) · European Journal of Cancer · doi:10.1016/j.ejca.2019.06.013 · Cited by 219 · see citing works
Self-citationSkin disease diagnosis with deep learning: a review
Li, H., Pan, Y., Zhao, J., & Zhang, L. (2021) · Neurocomputing · doi:10.1016/j.neucom.2021.08.096 · Cited by 178 · see citing works
Pre-trained multimodal large language model enhances dermatological diagnosis using SkinGPT-4
Zhou, J., He, X., Sun, L., Xu, J., Chen, X., Chu, Y., Zhou, L., Liao, X., Zhang, B., Afvari, S., et al. (2024) · Nature Communications · doi:10.1038/s41467-024-50043-3 · Cited by 189 · see citing works
Höhn, J., Krieghoff-Henning, E., Jutzi, T. B., von Kalle, C., Utikal, J. S., Meier, F., Gellrich, F. F., Hobelsberger, S., Hauschild, A., Schlager, J. G., et al. (2021) · European Journal of Cancer · doi:10.1016/j.ejca.2021.02.032 · Cited by 106 · see citing works
Self-citationArtificial intelligence in dermatopathology: diagnosis, education, and research
Wells, A., Patel, S., Lee, J. B., & Motaparthi, K. (2021) · Journal of Cutaneous Pathology · doi:10.1111/cup.13954 · Cited by 95 · see citing works
Brinker, T. J., Schmitt, M., Krieghoff-Henning, E. I., Barnhill, R., Beltraminelli, H., Braun, S. A., Carr, R., Fernandez-Figueras, M.-T., Ferrara, G., Fraitag, S., et al. (2022) · Journal of the American Academy of Dermatology · doi:10.1016/j.jaad.2021.02.009 · Cited by 70 · see citing works
Self-citationZhao, Z., Wu, C.-M., Zhang, S., He, F., Liu, F., Wang, B., Huang, Y., Shi, W., Jian, D., Xie, H., et al. (2021) · JMIR Medical Informatics · doi:10.2196/23415 · Cited by 58 · see citing works
“Generally, the data sources for the interpretation of machine learning varies from digital medical records [35,36], histopathological pictures [37], and clinical photos [38-41] to dermoscopic images [42-50].”
BackgroundArtificial Intelligence in Dermatopathology: New Insights and Perspectives
Cazzato, G., Colagrande, A., Cimmino, A., Arezzo, F., Loizzi, V., Caporusso, C., Marangio, M., Foti, C., Romita, P., Lospalluti, L., et al. (2021) · Dermatopathology · doi:10.3390/dermatopathology8030044 · Cited by 37 · see citing works
Artificial Intelligence for Dermatopathology: Current Trends and the Road Ahead
Chen, S. B., & Novoa, R. A. (2022) · Seminars in Diagnostic Pathology · doi:10.1053/j.semdp.2022.01.003 · Cited by 37 · see citing works
Cazzato, G., Massaro, A., Colagrande, A., Lettini, T., Cicco, S., Parente, P., Nacchiero, E., Lospalluti, L., Cascardi, E., Giudice, G., et al. (2022) · Diagnostics · doi:10.3390/diagnostics12081972 · Cited by 34 · see citing works
Comes, M. C., Fucci, L., Mele, F., Bove, S., Cristofaro, C., De Risi, I., Fanizzi, A., Milella, M., Strippoli, S., Zito, A., et al. (2022) · Scientific Reports · doi:10.1038/s41598-022-24315-1 · Cited by 33 · see citing works
Doeleman, T., Hondelink, L. M., Vermeer, M. H., van Dijk, M. R., & Schrader, A. M. R. (2023) · Seminars in Cancer Biology · doi:10.1016/j.semcancer.2023.06.004 · Cited by 26 · see citing works
Artificial intelligence in dermatopathology: Updates, strengths, and challenges
Cazzato, G., & Rongioletti, F. (2024) · Clinics in Dermatology · doi:10.1016/j.clindermatol.2024.06.010 · Cited by 24 · see citing works
Artificial intelligence in dermatopathology: A systematic review
Lalmalani, R. M., Lim, C. X. Y., & Oh, C. C. (2025) · Clinical and Experimental Dermatology · doi:10.1093/ced/llae361 · Cited by 19 · see citing works
Artificial intelligence: its role in dermatopathology
Jartarkar, S. R. (2022) · Indian Journal of Dermatology Venereology and Leprology · doi:10.25259/ijdvl_725_2021 · Cited by 18 · see citing works
Artificial intelligence in Dermatopathology
Jartarkar, S. R., Cockerell, C. J., Patil, A., Kassir, M., Babaei, M., Weidenthaler‐Barth, B., Grabbe, S., & Goldust, M. (2023) · Journal of Cosmetic Dermatology · doi:10.1111/jocd.15565 · Cited by 17 · see citing works
Computer-Aided Assessment of Melanocytic Lesions by Means of a Mitosis Algorithm
Sturm, B., Creytens, D., Smits, J., Ooms, A. H. A. G., Eijken, E., Kurpershoek, E., Küsters-Vandevelde, H. V. N., Wauters, C., Blokx, W. A. M., & van der Laak, J. A. W. M. (2022) · Diagnostics · doi:10.3390/diagnostics12020436 · Cited by 13 · see citing works
Della Mura, M., Sorino, J., Colagrande, A., Daruish, M., Ingravallo, G., Massaro, A., Cazzato, G., Lupo, C., Casatta, N., Ribatti, D., et al. (2025) · Medical Sciences · doi:10.3390/medsci13020070 · Cited by 6 · see citing works
“For example, Hekler et al. [15] compared the performance of CNNs in classifying 695 melanocytic neoplasms into nevus or melanoma to that of an expert dermatopathologist, and the AI system demonstrated superior diagnostic accuracy.”
Bao, Y., Zhang, J., Zhang, Q., Chang, J., Lu, D., & Fu, Y. (2021) · Frontiers in Medicine · doi:10.3389/fmed.2021.696305 · Cited by 5 · see citing works
Di Salvo, F., Doerrich, S., & Ledig, C. (2024) · arXiv · doi:10.48550/arxiv.2406.17536 · Cited by 3 · see citing works
“As such the medical imaging community has witnessed a substantial rise of deep learning based decision-support systems, leading to significant advancements in fields such as radiology [28], dermatology [19], and pathology [9], often improving human-performances.”
BackgroundArtificial Intelligence in Dermatopathology: An Update and Review of the Current Literature
Abu-Dayeh, A., Cazzato, G., & Giubellino, A. (2026) · Diagnostics · doi:10.3390/diagnostics16111702 · Cited by 1 · see citing works
“One of the most commonly used is ResNet50, a CNN model well known for its success in image classification and used in classification of many cutaneous lesions, including melanoma classification, achieving a high diagnostic accuracy [14,18].”
Revolutionizing dermatopathology using AI in skin diagnostics: scoping review
Rammal, R., Mohy U Din, A., & Alam, T. (2026) · Frontiers in Medicine · doi:10.3389/fmed.2026.1614681 · Cited by 1 · see citing works
“The study showed that, in 94% of the cases, the Spitz lesions were misdiagnosed as conventional melanocytic lesions thus highlighting the importance of large high quality and diverse datasets for training CNNs. Hekler et al. (29) aimed to determine the ability of DNNs in the classification of dermoscopy images of diff…”
Influential
- Authors
- Hekler, A., Utikal, J. S., Enk, A. H., Berking, C., Klode, J., Schadendorf, D., Jansen, P., Franklin, C., Holland-Letz, T., Krahl, D., von Kalle, C., Fröhling, S., & Brinker, T. J.
- Affiliations
- German Cancer Research Center (DE)
- University Hospital Heidelberg (DE)
- LMU Klinikum (DE)
- Essen University Hospital (DE)
- University Hospital Cologne (DE)
- Corresponding author
- Brinker, Titus Josef
- ORCID
- Venue
- European Journal of Cancer
- Publisher
- Elsevier BV
- Published
- 2019-07
- Volume
- 115
- Pages
- 79-83
- ISSN
- 0959-8049 (ISSN-L)
- OpenAlex
- W2945626616
- Cited by
- 231
- References
- 17
- Citations by year
- 2026: 12 · 2025: 19 · 2024: 30 · 2023: 36 · 2022: 54 · 2021: 41 · 2020: 24 · 2019: 14
- FWCI
- 15.40
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- European Journal of Cancer (publishedVersion, cc-by-nc-nd)
- PubMed (publishedVersion)
- Kölner Universitäts PublikationsServer (Universität zu Köln) (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › AI in cancer detection
- Health Sciences › Medicine › Oncology › Cutaneous Melanoma Detection and Management
- Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › Radiomics and Machine Learning in Medical Imaging
- Keywords
- melanoma, histopathology, convolutional neural networks, computer-aided diagnosis, benign nevi, H&E staining, slide scanning, melanoma classification
- MeSH terms
- Pathologists, Deep Learning, Biopsy, Diagnosis, Computer-Assisted, Humans, Image Interpretation, Computer-Assisted, Melanoma, Microscopy, Nevus, Predictive Value of Tests, Skin Neoplasms, Reproducibility of Results, Observer Variation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review