The DOI matches its Crossref record; 34 of the 34 references it cites were found in a registry or an index.
Deep learning ensembles for melanoma recognition in dermoscopy images
Open accessAbstract
Melanoma is the deadliest form of skin cancer. While curable with early detection, only highly trained specialists are capable of accurately recognizing the disease. As expertise is in limited supply, automated systems capable of identifying disease could save lives, reduce unnecessary biopsies, and reduce costs. Toward this goal, we propose a system that combines recent developments in deep learning with established machine learning approaches, creating ensembles of methods that are capable of segmenting skin lesions, as well as analyzing the detected area and surrounding tissue for melanoma detection. The system is evaluated using the largest publicly available benchmark dataset of dermoscopic images, containing 900 training and 379 testing images. New state-of-the-art performance levels are demonstrated, leading to an improvement in the area under receiver operating characteristic curve of 7.5% (0.843 versus 0.783), in average precision of 4% (0.649 versus 0.624), and in specificity measured at the clinically relevant 95% sensitivity operating point 2.9 times higher than the previous state of the art (36.8% specificity compared to 12.5%). Compared to the average of eight expert dermatologists on a subset of 100 test images, the proposed system produces a higher accuracy (76% versus 70.5%), and specificity (62% versus 59%) evaluated at an equivalent sensitivity (82%).
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
U-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404
Fully convolutional networks for semantic segmentation
Long, J., Shelhamer, E., & Darrell, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298965 · Cited by 38,834
FaceNet: A unified embedding for face recognition and clustering
Schroff, F., Kalenichenko, D., & Philbin, J. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298682 · Cited by 15,267
Fully convolutional networks for semantic segmentation
Shelhamer, E., Long, J., & Darrell, T. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2572683 · Cited by 11,898
Caffe: Convolutional Architecture for Fast Feature Embedding
Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., & Darrell, T. (2014) · Proceedings of the 22nd ACM international conference on Multimedia · doi:10.1145/2647868.2654889 · Cited by 11,077
DeepFace: Closing the Gap to Human-Level Performance in Face Verification
Taigman, Y., Yang, M., Ranzato, M., & Wolf, L. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.220 · Cited by 6,542
Parkhi, O. M., Vedaldi, A., & Zisserman, A. (2015) · Procedings of the British Machine Vision Conference 2015 · doi:10.5244/c.29.41 · Cited by 5,479
Codella, N. C. F., Gutman, D., Celebi, M. E., Helba, B., Marchetti, M. A., Dusza, S. W., Kalloo, A., Liopyris, K., Mishra, N., Kittler, H., et al. (2018) · 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018) · doi:10.1109/isbi.2018.8363547 · Cited by 2,620
Self-citationDiagnostic accuracy of dermoscopy
Kittler, H., Pehamberger, H., Wolff, K., & Binder, M. (2002) · The Lancet Oncology · doi:10.1016/s1470-2045(02)00679-4 · Cited by 1,349
Cited by
Codella, N. C. F., Gutman, D., Celebi, M. E., Helba, B., Marchetti, M. A., Dusza, S. W., Kalloo, A., Liopyris, K., Mishra, N., Kittler, H., et al. (2018) · 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018) · doi:10.1109/isbi.2018.8363547 · Cited by 2,620
Self-citationAutomated detection of COVID-19 cases using deep neural networks with X-ray images
Ozturk, T., Talo, M., Yildirim, E. A., Baloglu, U. B., Yildirim, O., & Rajendra Acharya, U. (2020) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2020.103792 · Cited by 2,594
Liu, X., Faes, L., Kale, A. U., Wagner, S. K., Fu, D. J., Bruynseels, A., Mahendiran, T., Moraes, G., Shamdas, M., Kern, C., et al. (2019) · The Lancet Digital Health · doi:10.1016/s2589-7500(19)30123-2 · Cited by 1,883
A comprehensive review on ensemble deep learning: Opportunities and challenges
Mohammed, A., & Kora, R. (2023) · Journal of King Saud University - Computer and Information Sciences · doi:10.1016/j.jksuci.2023.01.014 · Cited by 1,127
Codella, N., Rotemberg, V., Tschandl, P., Celebi, M. E., Dusza, S., Gutman, D., Helba, B., Kalloo, A., Liopyris, K., Marchetti, M., et al. (2019) · arXiv · doi:10.48550/arxiv.1902.03368 · Cited by 984
Self-citationHan, S. S., Kim, M. S., Lim, W., Park, G. H., Park, I., & Chang, S. E. (2018) · Journal of Investigative Dermatology · doi:10.1016/j.jid.2018.01.028 · Cited by 713
Automatic skin lesion segmentation using deep fully convolutional networks with jaccard distance.
Yuan, Y., Chao, M., & Lo, Y.-C. (2017) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2017.2695227 · Cited by 687
Skin Lesion Analysis towards Melanoma Detection Using Deep Learning Network
Li, Y., & Shen, L. (2018) · Sensors · doi:10.3390/s18020556 · Cited by 634
A review of the application of deep learning in medical image classification and segmentation
Cai, L., Gao, J., & Zhao, D. (2020) · Annals of Translational Medicine · doi:10.21037/atm.2020.02.44 · Cited by 587
Tschandl, P., Codella, N., Akay, B. N., Argenziano, G., Braun, R. P., Cabo, H., Gutman, D., Halpern, A., Helba, B., Hofmann-Wellenhof, R., et al. (2019) · The Lancet Oncology · doi:10.1016/s1470-2045(19)30333-x · Cited by 555
Self-citationGoyal, M., Knackstedt, T., Yan, S., & Hassanpour, S. (2020) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2020.104065 · Cited by 428
Classification of skin lesions using transfer learning and augmentation with Alex-net
Hosny, K. M., Kassem, M. A., & Foaud, M. M. (2019) · PLOS ONE · doi:10.1371/journal.pone.0217293 · Cited by 373
A Survey on ensemble learning under the era of deep learning
Yang, Y., Lv, H., & Chen, N. (2023) · Artificial Intelligence Review · doi:10.1007/s10462-022-10283-5 · Cited by 369
Thakkar, A., & Lohiya, R. (2021) · Archives of Computational Methods in Engineering · doi:10.1007/s11831-020-09496-0 · Cited by 366
Skin Lesion Classification from Dermoscopic Images Using Deep Learning Techniques
Romero-Lopez, A., Giro-i-Nieto, X., Burdick, J., & Marques, O. (2017) · Biomedical Engineering · doi:10.2316/p.2017.852-053 · Cited by 355
Ensemble deep learning in bioinformatics
Cao, Y., Geddes, T. A., Yang, J. Y. H., & Yang, P. (2020) · Nature Machine Intelligence · doi:10.1038/s42256-020-0217-y · Cited by 354
Freeman, K., Geppert, J., Stinton, C., Todkill, D., Johnson, S., Clarke, A., & Taylor-Phillips, S. (2021) · BMJ · doi:10.1136/bmj.n1872 · Cited by 338
Marchetti, M. A., Codella, N. C. F., Dusza, S. W., Gutman, D. A., Helba, B., Kalloo, A., Mishra, N., Carrera, C., Celebi, M. E., DeFazio, J. L., et al. (2018) · Journal of the American Academy of Dermatology · doi:10.1016/j.jaad.2017.08.016 · Cited by 330
Self-citationHan, S. S., Park, G. H., Lim, W., Kim, M. S., Na, J. I., Park, I., & Chang, S. E. (2018) · PLoS ONE · doi:10.1371/journal.pone.0191493 · Cited by 305
Semi-Supervised Medical Image Classification With Relation-Driven Self-Ensembling Model
Liu, Q., Yu, L., Luo, L., Dou, Q., & Heng, P. A. (2020) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2020.2995518 · Cited by 295
Skin Cancer Classification using Deep Learning and Transfer Learning
Hosny, K. M., Kassem, M. A., & Foaud, M. M. (2018) · 2018 9th Cairo International Biomedical Engineering Conference (CIBEC) · doi:10.1109/cibec.2018.8641762 · Cited by 273
Kassem, M. A., Hosny, K. M., Damaševičius, R., & Eltoukhy, M. M. (2021) · Diagnostics · doi:10.3390/diagnostics11081390 · Cited by 270
Skin cancer detection from dermoscopic images using deep learning and fuzzy k‐means clustering
Nawaz, M., Mehmood, Z., Nazir, T., Naqvi, R. A., Rehman, A., Iqbal, M., & Saba, T. (2022) · Microscopy Research and Technique · doi:10.1002/jemt.23908 · Cited by 261
Pacheco, A. G. C., & Krohling, R. A. (2021) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2021.3062002 · Cited by 257
Artificial Intelligence in Dermatology: A Primer
Young, A. T., Xiong, M., Pfau, J., Keiser, M. J., & Wei, M. L. (2020) · Journal of Investigative Dermatology · doi:10.1016/j.jid.2020.02.026 · Cited by 249
Machine learning and deep learning algorithms for skin cancer classification from dermoscopic images
Bechelli, S., & Delhommelle, J. (2022) · Bioengineering · doi:10.3390/bioengineering9030097 · Cited by 181
Skin disease diagnosis with deep learning: a review
Li, H., Pan, Y., Zhao, J., & Zhang, L. (2021) · Neurocomputing · doi:10.1016/j.neucom.2021.08.096 · Cited by 178
Accuracy of Computer-Aided Diagnosis of Melanoma: A Meta-analysis
Dick, V., Sinz, C., Mittlböck, M., Kittler, H., & Tschandl, P. (2019) · JAMA Dermatology · doi:10.1001/jamadermatol.2019.1375 · Cited by 125
Malik, H., Farooq, M. S., Khelifi, A., Abid, A., Nasir Qureshi, J., & Hussain, M. (2020) · IEEE Access · doi:10.1109/access.2020.3004766 · Cited by 104
Bibi, S., Khan, M. A., Shah, J. H., Damaševičius, R., Alasiry, A., Marzougui, M., Alhaisoni, M., & Masood, A. (2023) · Diagnostics · doi:10.3390/diagnostics13193063 · Cited by 88
“To identify malignant lesions, Codella et al. [32] studied and presented mostly used deep neural networks, such as deep residual networks and deep convolutional neural network models.”
BackgroundBackground selection schema on deep learning-based classification of dermatological disease
Zhou, J., Wu, Z., Jiang, Z., Huang, K., Guo, K., & Zhao, S. (2022) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2022.105966 · Cited by 53
Codella, N. C. F., Lin, C.-C., Halpern, A., Hind, M., Feris, R., & Smith, J. R. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-02628-8_11 · Cited by 52
Self-citationJahanifar, M., Tajeddin, N. Z., Koohbanani, N. A., Gooya, A., & Rajpoot, N. (2018) · arXiv · doi:10.48550/arxiv.1809.10243 · Cited by 21
Govindu, S., Devi, O. R., Sitharam, M., Koreddi, V., Kumar, M. K., & Sunitha, M. (2026) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2025.108929 · Cited by 7
Multimodal deep learning ensemble framework for skin cancer detection
Saeed, M. A., Afify, Y. M., Badr, N. L., & Helal, N. A. (2025) · Scientific Reports · doi:10.1038/s41598-025-30534-z · Cited by 7
Metadata
- Authors
- Codella, N. C. F., Nguyen, Q.-B., Pankanti, S., Gutman, D. A., Helba, B., Halpern, A. C., & Smith, J. R.
- Venue
- IBM Journal of Research and Development
- Publisher
- IBM
- Published
- 2017-07-01
- Volume
- 61
- Issue
- 4/5
- Pages
- 5:1-5:15
- ISSN
- 0018-8646 (ISSN-L)
- OpenAlex
- W2536054366
- Cited by
- 644
- References
- 34
- FWCI
- 22.83
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.