The DOI matches its Crossref record; 59 of the 59 references it cites were found in a registry or an index.
A Mutual Bootstrapping Model for Automated Skin Lesion Segmentation and Classification
Open accessAbstract
Automated skin lesion segmentation and classification are two most essential and related tasks in the computer-aided diagnosis of skin cancer. Despite their prevalence, deep learning models are usually designed for only one task, ignoring the potential benefits in jointly performing both tasks. In this paper, we propose the mutual bootstrapping deep convolutional neural networks (MB-DCNN) model for simultaneous skin lesion segmentation and classification. This model consists of a coarse segmentation network (coarse-SN), a mask-guided classification network (mask-CN), and an enhanced segmentation network (enhanced-SN). On one hand, the coarse-SN generates coarse lesion masks that provide a prior bootstrapping for mask-CN to help it locate and classify skin lesions accurately. On the other hand, the lesion localization maps produced by mask-CN are then fed into enhanced-SN, aiming to transfer the localization information learned by mask-CN to enhanced-SN for accurate lesion segmentation. In this way, both segmentation and classification networks mutually transfer knowledge between each other and facilitate each other in a bootstrapping way. Meanwhile, we also design a novel rank loss and jointly use it with the Dice loss in segmentation networks to address the issues caused by class imbalance and hard-easy pixel imbalance. We evaluate the proposed MB-DCNN model on the ISIC-2017 and PH2 datasets, and achieve a Jaccard index of 80.4% and 89.4% in skin lesion segmentation and an average AUC of 93.8% and 97.7% in skin lesion classification, which are superior to the performance of representative state-of-the-art skin lesion segmentation and classification methods. Our results suggest that it is possible to boost the performance of skin lesion segmentation and classification simultaneously via training a unified model to perform both tasks in a mutual bootstrapping way.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
U-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Microsoft COCO: Common Objects in Context
Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., & Zitnick, C. L. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10602-1_48 · Cited by 45,460
Focal Loss for Dense Object Detection
Lin, T.-Y., Goyal, P., Girshick, R., He, K., & Dollar, P. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.324 · Cited by 30,581
Xception: Deep Learning with Depthwise Separable Convolutions
Chollet, F. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.195 · Cited by 20,380
Siegel, R. L., Miller, K. D., & Jemal, A. (2019) · CA: A Cancer Journal for Clinicians · doi:10.3322/caac.21551 · Cited by 20,160 · cited 1×
“S KIN cancer is one of the most common malignancies to affect the elderly worldwide [1], [2].”
BackgroundEncoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation
Chen, L.-C., Zhu, Y., Papandreou, G., Schroff, F., & Adam, H. (2018) · arXiv · doi:10.48550/arxiv.1802.02611 · Cited by 20,063
Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation
Chen, L.-C., Zhu, Y., Papandreou, G., Schroff, F., & Adam, H. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01234-2_49 · Cited by 20,054
The pascal visual object classes (VOC) challenge
Everingham, M., Van Gool, L., Williams, C. K. I., Winn, J., & Zisserman, A. (2010) · International Journal of Computer Vision · doi:10.1007/s11263-009-0275-4 · Cited by 19,599 · cited 1×
“We employ the state-of-the-art semantic segmentation network Deeplabv3 + with the modified aligned Xception as its encoder [42], which was pre-trained on the MS-COCO [43] and PASCAL VOC 2012 datasets [44], as the backbone of coarse-SN.”
MethodV-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation
Milletari, F., Navab, N., & Ahmadi, S.-A. (2016) · 2016 Fourth International Conference on 3D Vision (3DV) · doi:10.1109/3dv.2016.79 · Cited by 11,931
Learning Deep Features for Discriminative Localization
Zhou, B., Khosla, A., Lapedriza, A., Oliva, A., & Torralba, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.319 · Cited by 11,428
Final Version of 2009 AJCC Melanoma Staging and Classification
Balch, C. M., Gershenwald, J. E., Soong, S.-J., Thompson, J. F., Atkins, M. B., Byrd, D. R., Buzaid, A. C., Cochran, A. J., Coit, D. G., Ding, S., et al. (2009) · Journal of Clinical Oncology · doi:10.1200/jco.2009.23.4799 · Cited by 4,602
Codella, N. C. F., Gutman, D., Celebi, M. E., Helba, B., Marchetti, M. A., Dusza, S. W., Kalloo, A., Liopyris, K., Mishra, N., Kittler, H., et al. (2018) · 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018) · doi:10.1109/isbi.2018.8363547 · Cited by 2,620
Yu, F., Koltun, V., & Funkhouser, T. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.75 · Cited by 1,804
Diagnostic accuracy of dermoscopy
Kittler, H., Pehamberger, H., Wolff, K., & Binder, M. (2002) · The Lancet Oncology · doi:10.1016/s1470-2045(02)00679-4 · Cited by 1,349
PH2 - A dermoscopic image database for research and benchmarking
Mendonca, T., Ferreira, P. M., Marques, J. S., Marcal, A. R. S., & Rozeira, J. (2013) · 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc.2013.6610779 · Cited by 1,009
Wei, Y., Feng, J., Liang, X., Cheng, M.-M., Zhao, Y., & Yan, S. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.687 · Cited by 863
Seed, Expand and Constrain: Three Principles for Weakly-Supervised Image Segmentation
Kolesnikov, A., & Lampert, C. H. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46493-0_42 · Cited by 719
Automatic skin lesion segmentation using deep fully convolutional networks with jaccard distance.
Yuan, Y., Chao, M., & Lo, Y.-C. (2017) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2017.2695227 · Cited by 687
Automated melanoma recognition
Ganster, H., Pinz, P., Rohrer, R., Wildling, E., Binder, M., & Kittler, H. (2001) · IEEE Transactions on Medical Imaging · doi:10.1109/42.918473 · Cited by 631
Wei, Y., Xiao, H., Shi, H., Jie, Z., Feng, J., & Huang, T. S. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00759 · Cited by 627
Attention Residual Learning for Skin Lesion Classification
Zhang, J., Xie, Y., Xia, Y., & Shen, C. (2019) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2019.2893944 · Cited by 568
Self-citationXie, Y., Xia, Y., Zhang, J., Song, Y., Feng, D., Fulham, M., & Cai, W. (2019) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2018.2876510 · Cited by 496
Self-citationMedical image classification using synergic deep learning
Zhang, J., Xie, Y., Wu, Q., & Xia, Y. (2019) · Medical Image Analysis · doi:10.1016/j.media.2019.02.010 · Cited by 397
Self-citationDermoscopic Image Segmentation via Multistage Fully Convolutional Networks
Bi, L., Kim, J., Ahn, E., Kumar, A., Fulham, M., & Feng, D. (2017) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2017.2712771 · Cited by 338
Melanoma Classification on Dermoscopy Images Using a Neural Network Ensemble Model
Xie, F., Fan, H., Li, Y., Jiang, Z., Meng, R., & Bovik, A. (2017) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2016.2633551 · Cited by 327
Collaborative Learning of Semi-Supervised Segmentation and Classification for Medical Images
Zhou, Y., He, X., Huang, L., Liu, L., Zhu, F., Cui, S., & Shao, L. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00218 · Cited by 285
Melanoma Recognition in Dermoscopy Images via Aggregated Deep Convolutional Features
Yu, Z., Jiang, X., Zhou, F., Qin, J., Ni, D., Chen, S., Lei, B., & Wang, T. (2019) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2018.2866166 · Cited by 247
Improving Dermoscopy Image Classification Using Color Constancy
Fidalgo Barata, A., Celebi, E., & Marques, J. (2014) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2014.2336473 · Cited by 214
Semi-supervised adversarial model for benign–malignant lung nodule classification on chest CT
Xie, Y., Zhang, J., & Xia, Y. (2019) · Medical Image Analysis · doi:10.1016/j.media.2019.07.004 · Cited by 200
Self-citationImproving Dermoscopic Image Segmentation With Enhanced Convolutional-Deconvolutional Networks
Yuan, Y., & Lo, Y.-C. (2019) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2017.2787487 · Cited by 194
Hagerty, J. R., Stanley, R. J., Almubarak, H. A., Lama, N., Kasmi, R., Guo, P., Drugge, R. J., Rabinovitz, H. S., Oliviero, M., & Stoecker, W. V. (2019) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2019.2891049 · Cited by 192
Image Classification of Melanoma, Nevus and Seborrheic Keratosis by Deep Neural Network EnsemblePreprint
Matsunaga, K., Hamada, A., Minagawa, A., & Koga, H. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.03108 · Cited by 183
Skin Lesion Classification Using CNNs With Patch-Based Attention and Diagnosis-Guided Loss Weighting
Gessert, N., Sentker, T., Madesta, F., Schmitz, R., Kniep, H., Baltruschat, I., Werner, R., & Schlaefer, A. (2020) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2019.2915839 · Cited by 180
González-Díaz, I. (2018) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2018.2806962 · Cited by 170
Dense Deconvolutional Network for Skin Lesion Segmentation
Li, H., He, X., Zhou, F., Yu, Z., Ni, D., Chen, S., Wang, T., & Lei, B. (2019) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2018.2859898 · Cited by 169
Automatic Skin Lesion Analysis using Large-scale Dermoscopy Images and Deep Residual Networks
Bi, L., Kim, J., Ahn, E., & Feng, D. D. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.04197 · Cited by 164
Saliency-Based Lesion Segmentation Via Background Detection in Dermoscopic Images
Ahn, E., Kim, J., Bi, L., Kumar, A., Li, C., Fulham, M., & Feng, D. D. (2017) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2017.2653179 · Cited by 161
Decoupled Deep Neural Network for Semi-supervised Semantic Segmentation
Hong, S., Noh, H., & Han, B. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1506.04924 · Cited by 159
Ge, Z., Demyanov, S., Chakravorty, R., Bowling, A., & Garnavi, R. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-66179-7_29 · Cited by 145
Star Shape Prior in Fully Convolutional Networks for Skin Lesion Segmentation
Mirikharaji, Z., & Hamarneh, G. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-00937-3_84 · Cited by 144
Four-Class Classification of Skin Lesions With Task Decomposition Strategy
Shimizu, K., Iyatomi, H., Celebi, M. E., Norton, K., & Tanaka, M. (2014) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2014.2348323 · Cited by 138
High-Level Intuitive Features (HLIFs) for Intuitive Skin Lesion Description
Amelard, R., Glaister, J., Wong, A. M., & Clausi, D. A. (2014) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2014.2365518 · Cited by 135
A Novel Multi-task Deep Learning Model for Skin Lesion Segmentation and ClassificationPreprint
Yang, X., Zeng, Z., Yeo, S. Y., Tan, C., Tey, H. L., & Su, Y. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.01025 · Cited by 123
RECOD Titans at ISIC Challenge 2017Preprint
Menegola, A., Tavares, J., Fornaciali, M. S., Li, L. T., Avila, S., & Junior, E. A. D. V. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.04819 · Cited by 123
Jia, H., Xia, Y., Song, Y., Zhang, D., Huang, H., Zhang, Y., & Cai, W. (2019) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2019.2928056 · Cited by 119
Self-citationSáez, A., Sánchez‐Monedero, J., Gutiérrez, P. A., & Hervás‐Martínez, C. (2015) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2015.2506270 · Cited by 87
Simpler, Faster, More Accurate Melanocytic Lesion Segmentation Through MEDS
Peruch, F., Bogo, F., Bonazza, M., Cappelleri, V.-M., & Peserico, E. (2013) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2013.2283803 · Cited by 83
Melanoma Recognition via Visual Attention
Yan, Y., Kawahara, J., & Hamarneh, G. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-20351-1_62 · Cited by 74
Bootstrapping the Performance of Webly Supervised Semantic Segmentation
Shen, T., Lin, G., Shen, C., & Reid, I. D. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00148 · Cited by 73
Self-citationDevelopment of a clinically oriented system for melanoma diagnosis
Barata, C., Celebi, M. E., & Marques, J. S. (2017) · Pattern Recognition · doi:10.1016/j.patcog.2017.04.023 · Cited by 68
González-Díaz, I. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.01976 · Cited by 65
A multi-task framework with feature passing module for skin lesion classification and segmentation
Chen, S., Wang, Z., Shi, J., Liu, B., & Yu, N. (2018) · IEEE International Symposium on Biomedical Imaging (ISBI) · doi:10.1109/isbi.2018.8363769 · Cited by 55
Skin Lesion Classification in Dermoscopy Images Using Synergic Deep Learning
Zhang, J., Xie, Y., Wu, Q., & Xia, Y. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-00934-2_2 · Cited by 53
Self-citationMelanoma detection algorithm based on feature fusion
Barata, C., Celebi, M. E., & Marques, J. S. (2015) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc.2015.7318937 · Cited by 46
Automatic Skin Lesion Segmentation on Dermoscopic Images by the Means of Superpixel Merging
Patiño, D., Avendaño, J., & Branch, J. W. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-00937-3_83 · Cited by 46
Skin Lesion Analysis By Multi-Target Deep Neural Networks
Yang, X., Li, H., Wang, L., Yeo, S. Y., Su, Y., & Zeng, Z. (2018) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc.2018.8512488 · Cited by 21
Research works printed but not linked: 5
- mendonça, 2013, PH2—A dermoscopic image database for research and benchmarking, Proc 35th Annu Int Conf IEEE Eng Med Biol Soc (EMBC), 5437
- 10.1088/1757-899X/561/1/012107 · doi:10.1088/1757-899x/561/1/012107
- yang, 2017, A novel multi-task deep learning model for skin lesion segmentation and classification, arXiv 1703 01025
- 10.1109/ISBI.2018.8363547 · DOI · Paper page
- 10.1007/978-3-030-00934-2_3 · DOI
Cited by
Explainable artificial intelligence (XAI) in deep learning-based medical image analysis
van der Velden, B. H. M., Kuijf, H. J., Gilhuijs, K. G. A., & Viergever, M. A. (2022) · Medical Image Analysis · doi:10.1016/j.media.2022.102470 · Cited by 1,328
FAT-Net: Feature adaptive transformers for automated skin lesion segmentation
Wu, H., Chen, S., Chen, G., Wang, W., Lei, B., & Wen, Z. (2022) · Medical Image Analysis · doi:10.1016/j.media.2021.102327 · Cited by 590
Analysis of the ISIC image datasets: Usage, benchmarks and recommendations
Cassidy, B., Kendrick, C., Brodzicki, A., Jaworek-Korjakowska, J., & Yap, M. H. (2022) · Medical Image Analysis · doi:10.1016/j.media.2021.102305 · Cited by 307
Khan, M. A., Sharif, M., Akram, T., Damaševičius, R., & Maskeliūnas, R. (2021) · Diagnostics · doi:10.3390/diagnostics11050811 · Cited by 281
Nazir, S., Dickson, D. M., & Akram, M. U. (2023) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2023.106668 · Cited by 283
“Similarly, the use of frameworks combining the automated segmentation and classification could for example, can use the segmentation results to guide the classification process [214].”
Method
Metadata
- Authors
- Xie, Y., Zhang, J., Xia, Y., & Shen, C.
- Venue
- IEEE Transactions on Medical Imaging
- Published
- 2020-07
- Volume
- 39
- Issue
- 7
- Pages
- 2482-2493
- ISSN
- 0278-0062 (ISSN-L)
- 1558-254X
- OpenAlex
- W3006349040
- Cited by
- 399
- References
- 59
- FWCI
- 17.80
- Type
- journal article
- Language
- en
- Open access
- green
- Licence
- Funders
- National Natural Science Foundation of China (61771397)
- Science and Technology Innovation Committee of Shenzhen Municipality, China (JCYJ20180306171334997)
- Innovation Foundation for Doctor Dissertation of Northwestern Polytechnical University
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.