The DOI matches its Crossref record; 28 of the 28 references it cites were found in a registry or an index.
Skin lesion classification with ensembles of deep convolutional neural networks
Open accessAbstract
Skin cancer is a major public health problem with over 123,000 newly diagnosed cases worldwide in every year. Melanoma is the deadliest form of skin cancer, responsible for over 9000 deaths in the United States each year. Thus, reliable automatic melanoma screening systems would provide a great help for clinicians to detect the malignant skin lesions as early as possible. In the last five years, the efficiency of deep learning-based methods increased dramatically and their performances seem to outperform conventional image processing methods in classification tasks. However, this type of machine learning-based approaches have a main drawback, namely they require thousands of labeled images per classes for their training. In this paper, we investigate how we can create an ensemble of deep convolutional neural networks to improve further their individual accuracies in the task of classifying dermoscopy images into the three classes melanoma, nevus, and seborrheic keratosis when we have no opportunity to train them on adequate number of annotated images. To achieve high classification accuracy, we fuse the outputs of the classification layers of four different deep neural network architectures. More specifically, we propose the aggregation of robust convolutional neural networks (CNNs) into one framework, where the final classification is achieved based on the weighted output of the member CNNs. For aggregation, we consider different fusion-based methods and select the best performing one for this problem. Our experimental results also prove that the creation of an ensemble of different neural networks is a meaningful approach, since each of the applied fusion strategies outperforms the individual networks regarding classification accuracy. The average area under the receiver operating characteristic curve has been found to be 0.891 for the 3-class classification task. For an objective evaluation of our approach, we have tested its performance on the official test database of the IEEE International Symposium on Biomedical Imaging (ISBI) 2017 challenge on Skin Lesion Analysis Towards Melanoma Detection dedicated to skin cancer recognition.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
Dermatologist-level classification of skin cancer with deep neural networks
Esteva, A., Kuprel, B., Novoa, R. A., Ko, J., Swetter, S. M., Blau, H. M., & Thrun, S. (2017) · Nature · doi:10.1038/nature21056 · Cited by 14,362
SEER Cancer Statistics Review, 1975-2003
Ries, L. A. G., Harkins, D., Krapcho, M. F., Mariotto, A. B., Miller, B., Feuer, E. J., Clegg, L. X., Eisner, M. P., Horner, M., Howlader, N., et al. (2006) · Digital Archive @ GSU · Cited by 11,775
Ensemble methods in machine learning
Dietterich, T. G. (2000) · Lecture Notes in Computer Science · doi:10.1007/3-540-45014-9_1 · Cited by 8,408
Kittler, J., Hatef, M., Duin, R. P. W., & Matas, J. (1998) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.667881 · Cited by 5,290
2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
(2015) · doi:10.1109/cvpr31182.2015 · Cited by 3,737
Codella, N. C. F., Gutman, D., Celebi, M. E., Helba, B., Marchetti, M. A., Dusza, S. W., Kalloo, A., Liopyris, K., Mishra, N., Kittler, H., et al. (2018) · 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018) · doi:10.1109/isbi.2018.8363547 · Cited by 2,620
MatConvNet: Convolutional Neural Networks for MATLAB
Vedaldi, A., & Lenc, K. (2015) · Proceedings of the 23rd ACM international conference on Multimedia · doi:10.1145/2733373.2807412 · Cited by 2,444
Going Deeper with Convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2014) · arXiv · doi:10.48550/arxiv.1409.4842 · Cited by 1,461
Automated Melanoma Recognition in Dermoscopy Images via Very Deep Residual Networks
Yu, L., Chen, H., Dou, Q., Qin, J., & Heng, P.-A. (2017) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2016.2642839 · Cited by 1,140
PH2 - A dermoscopic image database for research and benchmarking
Mendonca, T., Ferreira, P. M., Marques, J. S., Marcal, A. R. S., & Rozeira, J. (2013) · 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc.2013.6610779 · Cited by 1,009
Nachbar, F., Stolz, W., Merkle, T., Cognetta, A. B., Vogt, T., Landthaler, M., Bilek, P., Braun-Falco, O., & Plewig, G. (1994) · Journal of the American Academy of Dermatology · doi:10.1016/s0190-9622(94)70061-3 · Cited by 882
A methodological approach to the classification of dermoscopy images
Celebi, M. E., Kingravi, H. A., Uddin, B., Iyatomi, H., Aslandogan, Y. A., Stoecker, W. V., & Moss, R. H. (2007) · Computerized Medical Imaging and Graphics · doi:10.1016/j.compmedimag.2007.01.003 · Cited by 693
MatConvNet - Convolutional Neural Networks for MATLAB
Vedaldi, A., & Lenc, K. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1412.4564 · Cited by 578
Methods For Combining Experts' Probability Assessments
Jacobs, R. A. (1995) · Neural Computation · doi:10.1162/neco.1995.7.5.867 · Cited by 372
Simulated annealing: a proof of convergence
Granville, V., Krivanek, M., & Rasson, J.-P. (1994) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.295910 · Cited by 368
Border detection in dermoscopy images using statistical region merging
Emre Celebi, M., Kingravi, H. A., Iyatomi, H., Alp Aslandogan, Y., Stoecker, W. V., Moss, R. H., Malters, J. M., Grichnik, J. M., Marghoob, A. A., Rabinovitz, H. S., et al. (2008) · Skin Research and Technology · doi:10.1111/j.1600-0846.2008.00301.x · Cited by 366
Conn, A. R., Gould, N. I. M., & Toint, P. L. (1997) · Mathematics of Computation · doi:10.1090/s0025-5718-97-00777-1 · Cited by 353
Classification of malignant melanoma and benign skin lesions: implementation of automatic ABCD rule
Kasmi, R., & Mokrani, K. (2016) · IET Image Processing · doi:10.1049/iet-ipr.2015.0385 · Cited by 262
Melanoma recognition framework based on expert definition of ABCD for dermoscopic images
Abbas, Q., Celebi, M. E., Fondón, I., & Ahmad, W. (2012) · Skin Research and Technology · doi:10.1111/j.1600-0846.2012.00614.x · Cited by 70
Biologically inspired skin lesion segmentation using a geodesic active contour technique
Kasmi, R., Mokrani, K., Rader, R. K., Cole, J. G., & Stoecker, W. V. (2015) · Skin Research and Technology · doi:10.1111/srt.12252 · Cited by 46
Studies of Secondary Melanoma on C57BL/6J Mouse Liver Using 1H NMR Metabolomics
Feng, J., Isern, N., Burton, S., & Hu, J. Z. (2013) · Metabolites · doi:10.3390/metabo3041011 · Cited by 45
Computational Personality Analysis: Introduction, Practical Applications and Novel Directions
Neuman, Y. (2016) · CERN Document Server (European Organization for Nuclear Research) · Cited by 28
Measuring regularity of network patterns by grid approximations using the LLL algorithm
Hajdú, A., Harangi, B., Besenczi, R., Lazar, I., Emri, G., Hajdu, L., & Tijdeman, R. (2016) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr.2016.7899853 · Cited by 7
Self-citation
Cited by
Classification of Skin Disease Using Deep Learning Neural Networks with MobileNet V2 and LSTM
Srinivasu, P. N., SivaSai, J. G., Ijaz, M. F., Bhoi, A. K., Kim, W., & Kang, J. J. (2021) · Sensors · doi:10.3390/s21082852 · Cited by 759
Diabetes Prediction Using Ensembling of Different Machine Learning Classifiers
Hasan, M. K., Alam, M. A., Das, D., Hossain, E., & Hasan, M. (2020) · IEEE Access · doi:10.1109/access.2020.2989857 · Cited by 604
Detection of Skin Cancer Based on Skin Lesion Images Using Deep Learning
Gouda, W., Sama, N. U., Al-Waakid, G., Humayun, M., & Jhanjhi, N. Z. (2022) · Healthcare · doi:10.3390/healthcare10071183 · Cited by 393
Iqbal, I., Younus, M., Walayat, K., Kakar, M. U., & Ma, J. (2021) · Computerized Medical Imaging and Graphics · doi:10.1016/j.compmedimag.2020.101843 · Cited by 323
Skin Lesion Classification Using Convolutional Neural Network With Novel Regularizer
Albahar, M. A. (2019) · IEEE Access · doi:10.1109/access.2019.2906241 · Cited by 293
Metadata
- Authors
- Harangi, B.
- Venue
- Journal of Biomedical Informatics
- Publisher
- Elsevier BV
- Published
- 2018-10
- Volume
- 86
- Pages
- 25-32
- ISSN
- 1532-0464 (ISSN-L)
- OpenAlex
- W2612806369
- Cited by
- 439
- References
- 28
- FWCI
- 11.04
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.