The DOI matches its Crossref record; 58 of the 58 references it cites were found in a registry or an index.
Attention Residual Learning for Skin Lesion Classification
Abstract
Automated skin lesion classification in dermoscopy images is an essential way to improve the diagnostic performance and reduce melanoma deaths. Although deep convolutional neural networks (DCNNs) have made dramatic breakthroughs in many image classification tasks, accurate classification of skin lesions remains challenging due to the insufficiency of training data, inter-class similarity, intra-class variation, and the lack of the ability to focus on semantically meaningful lesion parts. To address these issues, we propose an attention residual learning convolutional neural network (ARL-CNN) model for skin lesion classification in dermoscopy images, which is composed of multiple ARL blocks, a global average pooling layer, and a classification layer. Each ARL block jointly uses the residual learning and a novel attention learning mechanisms to improve its ability for discriminative representation. Instead of using extra learnable layers, the proposed attention learning mechanism aims to exploit the intrinsic self-attention ability of DCNNs, i.e., using the feature maps learned by a high layer to generate the attention map for a low layer. We evaluated our ARL-CNN model on the ISIC-skin 2017 dataset. Our results indicate that the proposed ARL-CNN model can adaptively focus on the discriminative parts of skin lesions, and thus achieve the state-of-the-art performance in skin lesion classification.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333 · cited 2×
“It is difficult for DCNNs to achieve the same success on skin lesion classification, which usually has only thousands of data, as they have done in the ImageNet Challenge [13], which has tens of millions of data.”
Densely Connected Convolutional Networks
Huang, G., Liu, Z., Van Der Maaten, L., & Weinberger, K. Q. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.243 · Cited by 48,566
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
Fully convolutional networks for semantic segmentation
Long, J., Shelhamer, E., & Darrell, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298965 · Cited by 38,834
Squeeze-and-Excitation Networks
Hu, J., Shen, L., & Sun, G. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00745 · Cited by 35,667
(2014) · Cited by 33,419
Focal Loss for Dense Object Detection
Lin, T.-Y., Goyal, P., Girshick, R., He, K., & Dollar, P. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.324 · Cited by 30,581
He, K., Gkioxari, G., Dollar, P., & Girshick, R. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.322 · Cited by 29,137
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S., & Szegedy, C. (2015) · arXiv · doi:10.48550/arxiv.1502.03167 · Cited by 27,818
Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization
Selvaraju, R. R., Cogswell, M., Das, A., Vedantam, R., Parikh, D., & Batra, D. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.74 · Cited by 24,513
Chen, L.-C., Papandreou, G., Kokkinos, I., Murphy, K., & Yuille, A. L. (2016) · arXiv · doi:10.48550/arxiv.1606.00915 · Cited by 22,392
Chen, L.-C., Papandreou, G., Kokkinos, I., Murphy, K., & Yuille, A. L. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2699184 · Cited by 22,392
Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation
Chen, L.-C., Zhu, Y., Papandreou, G., Schroff, F., & Adam, H. (2018) · arXiv · doi:10.48550/arxiv.1802.02611 · Cited by 20,063
Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation
Chen, L.-C., Zhu, Y., Papandreou, G., Schroff, F., & Adam, H. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01234-2_49 · Cited by 20,054
Siegel, R. L., Miller, K. D., & Jemal, A. (2016) · CA: A Cancer Journal for Clinicians · doi:10.3322/caac.21332 · Cited by 16,003
(2010) · International Conference on Machine Learning · Cited by 13,995
Squeeze-and-Excitation Networks
Hu, J., Shen, L., Albanie, S., Sun, G., & Wu, E. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2913372 · Cited by 12,157
Learning Deep Features for Discriminative Localization
Zhou, B., Khosla, A., Lapedriza, A., Oliva, A., & Torralba, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.319 · Cited by 11,428
Show, Attend and Tell: Neural Image Caption Generation with Visual Attention
Xu, K., Ba, J., Kiros, R., Cho, K., Courville, A., Salakhutdinov, R., Zemel, R., & Bengio, Y. (2015) · arXiv · doi:10.48550/arxiv.1502.03044 · Cited by 8,248
Shin, H.-C., Roth, H. R., Gao, M., Lu, L., Xu, Z., Nogues, I., Yao, J., Mollura, D., & Summers, R. M. (2016) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2016.2528162 · Cited by 5,759
Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotations
Krishna, R., Zhu, Y., Groth, O., Johnson, J., Hata, K., Kravitz, J., Chen, S., Kalantidis, Y., Li, L.-J., Shamma, D. A., et al. (2017) · International Journal of Computer Vision · doi:10.1007/s11263-016-0981-7 · Cited by 5,107
Residual Attention Network for Image Classification
Wang, F., Jiang, M., Qian, C., Yang, S., Li, C., Zhang, H., Wang, X., & Tang, X. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.683 · Cited by 4,073
Learning and Transferring Mid-level Image Representations Using Convolutional Neural Networks
Oquab, M., Bottou, L., Laptev, I., & Sivic, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.222 · Cited by 3,150 · cited 1×
“To apply deep learning techniques directly to skin lesion classification, a straightforward solution is to collect more training data and fine-tune a powerful pre-trained DCNN [9]–[12].”
MethodUnderstanding deep learning requires rethinking generalization
Zhang, C., Bengio, S., Hardt, M., Recht, B., & Vinyals, O. (2016) · arXiv · doi:10.48550/arxiv.1611.03530 · Cited by 2,838 · cited 1×
“ResNet50 model could rely on its data fitting ability to easily remember those examples during the training process [47].”
MethodCodella, N. C. F., Gutman, D., Celebi, M. E., Helba, B., Marchetti, M. A., Dusza, S. W., Kalloo, A., Liopyris, K., Mishra, N., Kittler, H., et al. (2018) · 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018) · doi:10.1109/isbi.2018.8363547 · Cited by 2,620
SCA-CNN: Spatial and Channel-Wise Attention in Convolutional Networks for Image Captioning
Chen, L., Zhang, H., Xiao, J., Nie, L., Shao, J., Liu, W., & Chua, T.-S. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.667 · Cited by 1,992
Incidence Estimate of Nonmelanoma Skin Cancer (Keratinocyte Carcinomas) in the US Population, 2012
Rogers, H. W., Weinstock, M. A., Feldman, S. R., & Coldiron, B. M. (2015) · JAMA Dermatology · doi:10.1001/jamadermatol.2015.1187 · Cited by 1,815
Convolutional neural networks at constrained time cost
He, K., & Sun, J. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7299173 · Cited by 1,558
Diagnostic accuracy of dermoscopy
Kittler, H., Pehamberger, H., Wolff, K., & Binder, M. (2002) · The Lancet Oncology · doi:10.1016/s1470-2045(02)00679-4 · Cited by 1,349
Srivastava, R. K., Greff, K., & Schmidhuber, J. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1507.06228 · Cited by 1,246
Automated Melanoma Recognition in Dermoscopy Images via Very Deep Residual Networks
Yu, L., Chen, H., Dou, Q., Qin, J., & Heng, P.-A. (2017) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2016.2642839 · Cited by 1,140
Hierarchical Question-Image Co-Attention for Visual Question Answering
Lu, J., Yang, J., Batra, D., & Parikh, D. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1606.00061 · Cited by 1,129
A methodological approach to the classification of dermoscopy images
Celebi, M. E., Kingravi, H. A., Uddin, B., Iyatomi, H., Aslandogan, Y. A., Stoecker, W. V., & Moss, R. H. (2007) · Computerized Medical Imaging and Graphics · doi:10.1016/j.compmedimag.2007.01.003 · Cited by 693
Automated melanoma recognition
Ganster, H., Pinz, P., Rohrer, R., Wildling, E., Binder, M., & Kittler, H. (2001) · IEEE Transactions on Medical Imaging · doi:10.1109/42.918473 · Cited by 631
Visual Translation Embedding Network for Visual Relation Detection
Zhang, H., Kyaw, Z., Chang, S.-F., & Chua, T.-S. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.331 · Cited by 586
Xie, Y., Xia, Y., Zhang, J., Song, Y., Feng, D., Fulham, M., & Cai, W. (2019) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2018.2876510 · Cited by 496
Self-citationTwo Systems for the Detection of Melanomas in Dermoscopy Images Using Texture and Color Features
Barata, C., Ruela, M., Francisco, M., Mendonca, T., & Marques, J. S. (2014) · IEEE Systems Journal · doi:10.1109/jsyst.2013.2271540 · Cited by 453
Fine-Tuning Convolutional Neural Networks for Biomedical Image Analysis: Actively and Incrementally
Zhou, Z., Shin, J., Zhang, L., Gurudu, S., Gotway, M., & Liang, J. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.506 · Cited by 415
Deep Learning, Sparse Coding, and SVM for Melanoma Recognition in Dermoscopy Images
Codella, N., Cai, J., Abedini, M., Garnavi, R., Halpern, A., & Smith, J. R. (2015) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-24888-2_15 · Cited by 379
Hierarchical Question-Image Co-Attention for Visual Question Answering
Lu, J. (2024) · TIB Data Manager · doi:10.57702/uhdmfu1r · Cited by 357
Melanoma Classification on Dermoscopy Images Using a Neural Network Ensemble Model
Xie, F., Fan, H., Li, Y., Jiang, Z., Meng, R., & Bovik, A. (2017) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2016.2633551 · Cited by 327
Improving Dermoscopy Image Classification Using Color Constancy
Fidalgo Barata, A., Celebi, E., & Marques, J. (2014) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2014.2336473 · Cited by 214
Erratum: Corrigendum: Dermatologist-level classification of skin cancer with deep neural networks
Esteva, A., Kuprel, B., Novoa, R. A., Ko, J., Swetter, S. M., Blau, H. M., & Thrun, S. (2017) · Nature · doi:10.1038/nature22985 · Cited by 213
Image Classification of Melanoma, Nevus and Seborrheic Keratosis by Deep Neural Network EnsemblePreprint
Matsunaga, K., Hamada, A., Minagawa, A., & Koga, H. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.03108 · Cited by 183
Automatic Skin Lesion Analysis using Large-scale Dermoscopy Images and Deep Residual Networks
Bi, L., Kim, J., Ahn, E., & Feng, D. D. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.04197 · Cited by 164
Ge, Z., Demyanov, S., Chakravorty, R., Bowling, A., & Garnavi, R. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-66179-7_29 · Cited by 145
A Novel Multi-task Deep Learning Model for Skin Lesion Segmentation and ClassificationPreprint
Yang, X., Zeng, Z., Yeo, S. Y., Tan, C., Tey, H. L., & Su, Y. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.01025 · Cited by 123
RECOD Titans at ISIC Challenge 2017Preprint
Menegola, A., Tavares, J., Fornaciali, M. S., Li, L. T., Avila, S., & Junior, E. A. D. V. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.04819 · Cited by 123
Four challenges in medical image analysis from an industrial perspective
Weese, J., & Lorenz, C. D. (2016) · Medical Image Analysis · doi:10.1016/j.media.2016.06.023 · Cited by 118
Zhang, J., Xia, Y., Xie, Y., FULHAM, M. J., & Feng, D. D. (2017) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2017.2775662 · Cited by 116
Self-citationLarge Margin Local Estimate With Applications to Medical Image Classification
Song, Y., Cai, W., Huang, H., Zhou, Y., Feng, D. D., Wang, Y., Fulham, M. J., & Chen, M. (2015) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2015.2393954 · Cited by 87 · cited 1×
“Second, the accuracy of skin lesion classification suffers from the inter-class similarity and intra-class variation [7], [30].”
BackgroundGonzález-Díaz, I. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.01976 · Cited by 65
Skin Lesion Classification in Dermoscopy Images Using Synergic Deep Learning
Zhang, J., Xie, Y., Wu, Q., & Xia, Y. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-00934-2_2 · Cited by 53
Self-citationSkin Lesion Classification Using Deep Multi-scale Convolutional Neural NetworksPreprint
DeVries, T., & Ramachandram, D. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.01402 · Cited by 48
Cited by
A Mutual Bootstrapping Model for Automated Skin Lesion Segmentation and Classification
Xie, Y., Zhang, J., Xia, Y., & Shen, C. (2020) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2020.2972964 · Cited by 399
Self-citationA New Intelligent Bearing Fault Diagnosis Method Using SDP Representation and SE-CNN
Wang, H., Xu, J., Yan, R., & Gao, R. X. (2020) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2019.2956332 · Cited by 353
Attention Gate ResU-Net for Automatic MRI Brain Tumor Segmentation
Zhang, J., Jiang, Z., Dong, J., Hou, Y., & Liu, B. (2020) · IEEE Access · doi:10.1109/access.2020.2983075 · Cited by 335
Self-citationTransfer learning using a multi-scale and multi-network ensemble for skin lesion classification
Mahbod, A., Schaefer, G., Wang, C., Dorffner, G., Ecker, R., & Ellinger, I. (2020) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2020.105475 · Cited by 312
Semi-Supervised Medical Image Classification With Relation-Driven Self-Ensembling Model
Liu, Q., Yu, L., Luo, L., Dou, Q., & Heng, P. A. (2020) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2020.2995518 · Cited by 295
Metadata
- Authors
- Zhang, J., Xie, Y., Xia, Y., & Shen, C.
- Venue
- IEEE Transactions on Medical Imaging
- Published
- 2019-09
- Volume
- 38
- Issue
- 9
- Pages
- 2092-2103
- ISSN
- 0278-0062 (ISSN-L)
- 1558-254X
- OpenAlex
- W2914959431
- Cited by
- 568
- References
- 58
- FWCI
- 24.76
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.