FusionM4Net: a multi-stage multi-modal learning algorithm for multi-label skin lesion classification
Abstract
Skin disease is one of the most common diseases in the world. Deep learning-based methods have achieved excellent skin lesion recognition performance, most of which are based on only dermoscopy images. In recent works that use multi-modality data (patient's meta-data, clinical images, and dermoscopy images), the methods adopt a one-stage fusion approach and only optimize the information fusion at the feature level. These methods do not use information fusion at the decision level and thus cannot fully use the data of all modalities. This work proposes a novel two-stage multi-modal learning algorithm (FusionM4Net) for multi-label skin diseases classification. At the first stage, we construct a FusionNet, which exploits and integrates the representation of clinical and dermoscopy images at the feature level, and then uses a Fusion Scheme 1 to conduct the information fusion at the decision level. At the second stage, to further incorporate the patient's meta-data, we propose a Fusion Scheme 2, which integrates the multi-label predictive information from the first stage and patient's meta-data information to train an SVM cluster. The final diagnosis is formed by the fusion of the predictions from the first and second stages. Our algorithm was evaluated on the seven-point checklist dataset, a well-established multi-modality multi-label skin disease dataset. Without using the patient's meta-data, the proposed FusionM4Net's first stage (FusionM4Net-FS) achieved an average accuracy of 75.7% for multi-classification tasks and 74.9% for diagnostic tasks, which is more accurate than other state-of-the-art methods. By further fusing the patient's meta-data at FusionM4Net's second stage (FusionM4Net-SS), the entire FusionM4Net finally boosts the average accuracy to 77.0% and the diagnostic accuracy to 78.5%, which indicates its robust and excellent classification performance on the label-imbalanced dataset. The corresponding code is available at: https://github.com/pixixiaonaogou/MLSDR.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Patient metadata provides complementary information that can support skin lesion classification when combined with image features.
“These studies suggest that patient metadata provides complementary information that can support skin lesion classification when combined with image features.”
From Interpretable multimodal fusion for skin lesion classification using dermoscopic images and patient metadata (2026) · cites this paper as [26]
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474 · see citing works
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946 · see citing works
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 74,248 · see citing works
Scikit-learn: Machine Learning in Python
Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., Blondel, M., Müller, A., Nothman, J., Louppe, G., et al. (2012) · arXiv · doi:10.48550/arxiv.1201.0490 · Cited by 71,016 · see citing works
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333 · see citing works
Rethinking the Inception Architecture for Computer Vision
Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., & Wojna, Z. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.308 · Cited by 32,138 · see citing works
PyTorch: An Imperative Style, High-Performance Deep Learning Library
Paszke, A., Gross, S., Massa, F., Lerer, A., Bradbury, J., Chanan, G., Killeen, T., Lin, Z., Gimelshein, N., Antiga, L., et al. (2019) · arXiv · doi:10.48550/arxiv.1912.01703 · Cited by 31,473 · see citing works
Harris, C. R., Millman, K. J., van der Walt, S. J., Gommers, R., Virtanen, P., Cournapeau, D., Wieser, E., Taylor, J., Berg, S., Smith, N. J., et al. (2020) · Nature · doi:10.1038/s41586-020-2649-2 · Cited by 23,826 · see citing works
Proceedings of IEEE Conference on Computer Vision and Pattern Recognition
(1993) · doi:10.1109/cvpr.1993 · Cited by 17,989 · see citing works
Harris, C., Millman, K., van der Walt, S., Gommers, R., Virtanen, P., Cournapeau, D., Wieser, E., Taylor, J., Berg, S., Smith, N., et al. (2020) · RePEc: Research Papers in Economics · Cited by 17,844 · see citing works
Final Version of 2009 AJCC Melanoma Staging and Classification
Balch, C. M., Gershenwald, J. E., Soong, S.-J., Thompson, J. F., Atkins, M. B., Byrd, D. R., Buzaid, A. C., Cochran, A. J., Coit, D. G., Ding, S., et al. (2009) · Journal of Clinical Oncology · doi:10.1200/jco.2009.23.4799 · Cited by 4,592 · see citing works
Tschandl, P., Rosendahl, C., & Kittler, H. (2018) · Scientific Data · doi:10.1038/sdata.2018.161 · Cited by 3,628 · see citing works
(2011) · Cited by 2,752 · see citing works
Albumentations: fast and flexible image augmentations
Buslaev, A., Iglovikov, V. I., Khvedchenya, E., Parinov, A., Druzhinin, M., & Kalinin, A. A. (2020) · Information · doi:10.3390/info11020125 · Cited by 2,714 · see citing works
Codella, N. C. F., Gutman, D., Celebi, M. E., Helba, B., Marchetti, M. A., Dusza, S. W., Kalloo, A., Liopyris, K., Mishra, N., Kittler, H., et al. (2018) · 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018) · doi:10.1109/isbi.2018.8363547 · Cited by 2,620 · see citing works
Multi-Label Image Recognition With Graph Convolutional Networks
Chen, Z.-M., Wei, X.-S., Wang, P., & Guo, Y. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00532 · Cited by 1,339 · see citing works
Automated Melanoma Recognition in Dermoscopy Images via Very Deep Residual Networks
Yu, L., Chen, H., Dou, Q., Qin, J., & Heng, P.-A. (2017) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2016.2642839 · Cited by 1,140 · see citing works
Deep multimodal learning: a survey on recent advances and trends
Ramachandram, D., & Taylor, G. W. (2017) · IEEE Signal Processing Magazine · doi:10.1109/msp.2017.2738401 · Cited by 1,139 · see citing works
Huang, S.-C., Pareek, A., Seyyedi, S., Banerjee, I., & Lungren, M. P. (2020) · npj Digital Medicine · doi:10.1038/s41746-020-00341-z · Cited by 934 · see citing works
Epiluminescence Microscopy for the Diagnosis of Doubtful Melanocytic Skin Lesions
Argenziano, G., Fabbrocini, G., Carli, P., GIORGI, V. D., Sammarco, E., & Delfino, M. (1998) · Archives of Dermatology · doi:10.1001/archderm.134.12.1563 · Cited by 898 · see citing works
A deep learning system for differential diagnosis of skin diseases
Liu, Y., Jain, A., Eng, C., Way, D. H., Lee, K., Bui, P., Kanada, K., de Oliveira Marinho, G., Gallegos, J., Gabriele, S., et al. (2020) · Nature Medicine · doi:10.1038/s41591-020-0842-3 · Cited by 853 · see citing works
Seven-point checklist and skin lesion classification using multitask multimodal neural nets
Kawahara, J., Daneshvar, S., Argenziano, G., & Hamarneh, G. (2019) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2018.2824327 · Cited by 584 · see citing works
Attention Residual Learning for Skin Lesion Classification
Zhang, J., Xie, Y., Xia, Y., & Shen, C. (2019) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2019.2893944 · Cited by 573 · see citing works
Skin lesion classification with ensembles of deep convolutional neural networks
Harangi, B. (2018) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2018.08.006 · Cited by 451 · see citing works
Skin cancer and new treatment perspectives: A review
Simões, M. F., Sousa, J., & Pais, A. A. C. C. (2014) · Cancer Letters · doi:10.1016/j.canlet.2014.11.001 · Cited by 412 · see citing works
Dermoscopy of pigmented skin lesions
Braun, R. P., Rabinovitz, H. S., Oliviero, M., Kopf, A. W., & Saurat, J. ‐. (2004) · Journal of the American Academy of Dermatology · doi:10.1016/j.jaad.2001.11.001 · Cited by 401 · see citing works
Deep features to classify skin lesions
Kawahara, J., BenTaieb, A., & Hamarneh, G. (2016) · IEEE International Symposium on Biomedical Imaging (ISBI) · doi:10.1109/isbi.2016.7493528 · Cited by 356 · see citing works
Multimodal skin lesion classification using deep learning
Yap, J., Yolland, W., & Tschandl, P. (2018) · Experimental Dermatology · doi:10.1111/exd.13777 · Cited by 326 · see citing works
BCN20000: Dermoscopic Lesions in the Wild
Combalia, M., Codella, N., Rotemberg, V. M., Helba, B., Vilaplana, V., Reiter, O., Carrera, C., Barreiro, A., Halpern, A. C., Puig, S., et al. (2019) · LA Referencia (Red Federada de Repositorios Institucionales de Publicaciones Científicas) · doi:10.48550/arxiv.1908.02288 · Cited by 285 · see citing works
Pacheco, A. G. C., & Krohling, R. A. (2021) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2021.3062002 · Cited by 268 · see citing works
Melanoma Recognition in Dermoscopy Images via Aggregated Deep Convolutional Features
Yu, Z., Jiang, X., Zhou, F., Qin, J., Ni, D., Chen, S., Lei, B., & Wang, T. (2018) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2018.2866166 · Cited by 249 · see citing works
Integrative data analysis of multi-platform cancer data with a multimodal deep learning approach
Liang, M., Li, Z., Chen, T., & Zeng, J. (2015) · IEEE/ACM Transactions on Computational Biology and Bioinformatics · doi:10.1109/tcbb.2014.2377729 · Cited by 231 · see citing works
Knowledge transfer for melanoma screening with deep learning
Menegola, A., Fornaciali, M., Pires, R., Bittencourt, F. V., Avila, S., & Junior, E. A. D. V. (2017) · IEEE International Symposium on Biomedical Imaging (ISBI) · doi:10.1109/isbi.2017.7950523 · Cited by 218 · see citing works
Unpaired Multi-Modal Segmentation via Knowledge Distillation
Dou, Q., Liu, Q., Heng, P., & Glocker, B. (2020) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2019.2963882 · Cited by 216 · see citing works
Improving Dermoscopy Image Classification Using Color Constancy
Barata, A. F., Celebi, M. E., & Marques, J. S. (2014) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2014.2336473 · Cited by 212 · see citing works
Efficient skin lesion segmentation using separable-Unet with stochastic weight averaging
Tang, P., Liang, Q., Yan, X., Xiang, S., Sun, W., Zhang, D., & Coppola, G. (2019) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2019.07.005 · Cited by 190 · see citing works
Self-citationSeven-point checklist of dermoscopy revisited
Argenziano, G., Catricalà, C., Ardigò, M., Buccini, P., Simone, P. D., Eibenschutz, L., Ferrari, A., Mariani, G., Silipo, V., Sperduti, I., et al. (2010) · British Journal of Dermatology · doi:10.1111/j.1365-2133.2010.10194.x · Cited by 169 · see citing works
Sharable and Individual Multi-View Metric Learning
Hu, J., Lu, J., & Tan, Y. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2749576 · Cited by 168 · see citing works
Ge, Z., Demyanov, S., Chakravorty, R., Bowling, A., & Garnavi, R. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-66179-7_29 · Cited by 145 · see citing works
Tang, P., Liang, Q., Yan, X., Xiang, S., & Zhang, D. (2020) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2020.2977013 · Cited by 137 · see citing works
Self-citationImage Classification of Melanoma, Nevus and Seborrheic Keratosis by Deep Neural Network EnsemblePreprint
Matsunaga, K., Hamada, A., Minagawa, A., & Koga, H. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.03108 · Cited by 133 · see citing works
Qiu, S., Chang, G. H., Panagia, M., Gopal, D. M., Au, R., & Kolachalama, V. B. (2018) · Alzheimer's & Dementia: Diagnosis, Assessment & Disease Monitoring · doi:10.1016/j.dadm.2018.08.013 · Cited by 110 · see citing works
Bi, L., Feng, D. D., FULHAM, M. J., & Kim, J. (2020) · Pattern Recognition · doi:10.1016/j.patcog.2020.107502 · Cited by 109 · see citing works
Fusing Metadata and Dermoscopy Images for Skin Disease Diagnosis
Li, W., Zhuang, J., Wang, R., Zhang, J., & Zheng, W. (2020) · IEEE International Symposium on Biomedical Imaging (ISBI) · doi:10.1109/isbi45749.2020.9098645 · Cited by 85 · see citing works
Model-Based Classification Methods of Global Patterns in Dermoscopic Images
Sáez, A., Serrano, C., & Acha, B. (2014) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2014.2305769 · Cited by 74 · see citing works
Zhang, H., Zuelsdorf, C., Penneys, D. S., Fan, S., Kofsky, J., & Song, B. (2018) · Scientific Data · doi:10.1038/sdata.2018.290 · Cited by 68 · see citing works
European Handbook of Dermatological Treatments
D’Erme, A. M., Dessinioti, C., Lotti, T., & Katsambas, A. (2015) · Springer eBooks · doi:10.1007/978-3-662-45139-7 · Cited by 63 · see citing works
Liao, X., Qian, Y., Chen, Y., Xiong, X., Wang, Q., & Heng, P. (2020) · Computerized Medical Imaging and Graphics · doi:10.1016/j.compmedimag.2020.101785 · Cited by 49 · see citing works
Sun, B., Li, L., Wu, X., Zuo, T., Chen, Y., Zhou, G., He, J. Y. D., & Zhu, X. (2015) · Journal on Multimodal User Interfaces · doi:10.1007/s12193-015-0203-6 · Cited by 46 · see citing works
Hierarchical Multimodal Metric Learning for Multimodal Classification
Zhang, H., Patel, V. M., & Chellappa, R. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.312 · Cited by 41 · see citing works
Analysis of the contour structural irregularity of skin lesions using wavelet decomposition
Ma, L., & Staunton, R. C. (2012) · Pattern Recognition · doi:10.1016/j.patcog.2012.07.001 · Cited by 35 · see citing works
Dermoscopy of Pigmented Skin Lesions
Дума, С. (2015) · Springer eBooks · doi:10.1007/978-3-662-45139-7_116 · Cited by 11 · see citing works
Flagged first, then by citations
3 of the 55 references couldn’t be matched to a known paper.
Cited by
Sorted by citations
Current advances and future perspectives of image fusion: A comprehensive review
Karim, S., Tong, G., Li, J., Qadir, A., Farooq, U., & Yu, Y. (2022) · Information Fusion · doi:10.1016/j.inffus.2022.09.019 · Cited by 284 · see citing works
Li, Y., El Habib Daho, M., Conze, P.-H., Zeghlache, R., Le Boité, H., Tadayoni, R., Cochener, B., Lamard, M., & Quellec, G. (2024) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2024.108635 · Cited by 274 · see citing works
A survey, review, and future trends of skin lesion segmentation and classification
Hasan, M. K., Ahamad, M. A., Yap, C. H., & Yang, G. (2023) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2023.106624 · Cited by 157 · see citing works
Zhang, S., Zhang, J., Tian, B., Lukasiewicz, T., & Xu, Z. (2022) · Medical Image Analysis · doi:10.1016/j.media.2022.102656 · Cited by 145 · see citing works
Wang, Y., Wang, Y., Cai, J., Lee, T. K., Miao, C., & Wang, Z. J. (2022) · Medical Image Analysis · doi:10.1016/j.media.2022.102693 · Cited by 140 · see citing works
Schouten, D., Nicoletti, G., Dille, B., Chia, C., Vendittelli, P., Schuurmans, M., Litjens, G., & Khalili, N. (2025) · Medical Image Analysis · doi:10.1016/j.media.2025.103621 · Cited by 108 · see citing works
Zhang, Y., Luo, L., Dou, Q., & Heng, P. (2023) · Medical Image Analysis · doi:10.1016/j.media.2023.102772 · Cited by 87 · see citing works
Ömeroğlu, A. N., Mohammed, H. M. A., Oral, E. A., & Aydın, S. (2023) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2023.105897 · Cited by 85 · see citing works
Multi-feature Fusion Deep Network for Skin Disease Diagnosis
Gairola, A. K., Kumar, V., Sahoo, A. K., Diwakar, M., Singh, P., & Garg, D. (2024) · Multimedia Tools and Applications · doi:10.1007/s11042-024-18958-7 · Cited by 61 · see citing works
TFormer: A throughout fusion transformer for multi-modal skin lesion diagnosis
Zhang, Y., Xie, F., & Chen, J. (2023) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2023.106712 · Cited by 61 · see citing works
Alhudhaif, A., Almaslukh, B., Aseeri, A. O., Güler, O., & Polat, K. (2023) · Chaos Solitons & Fractals · doi:10.1016/j.chaos.2023.113409 · Cited by 61 · see citing works
Vachmanus, S., Noraset, T., Piyanonpong, W., Rattananukrom, T., & Tuarob, S. (2023) · IEEE Access · doi:10.1109/access.2023.3345225 · Cited by 53 · see citing works
Liu, X., Liu, Q., Zhang, Y., Wang, M., & Tang, J. (2022) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2022.106467 · Cited by 48 · see citing works
Yue, G., Wei, P., Zhou, T., Jiang, Q., Yan, W., & Wang, T. (2022) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2022.3204646 · Cited by 46 · see citing works
Optimal Skin Cancer Detection Model Using Transfer Learning and Dynamic-Opposite Hunger Games Search
Dahou, A., Aseeri, A. O., Mabrouk, A., Ibrahim, R. A., Al‐Betar, M. A., & Elaziz, M. A. (2023) · Diagnostics · doi:10.3390/diagnostics13091579 · Cited by 47 · see citing works
Yan, P., Gong, W., Li, M., Zhang, J., Li, X., Jiang, Y., Luo, H., & Zhou, H. (2024) · Information Fusion · doi:10.1016/j.inffus.2024.102592 · Cited by 42 · see citing works
Early Detection of Multiclass Skin Lesions Using Transfer Learning-Based IncepX-Ensemble Model
Chatterjee, S., Gil, J., & Byun, Y.-C. (2024) · IEEE Access · doi:10.1109/access.2024.3432904 · Cited by 39 · see citing works
Enhancing Skin Diseases Classification Through Dual Ensemble Learning and Pre-trained CNNs
Gannour, O. E., Hamida, S., Lamalem, Y., Cherradi, B., Saleh, S., & Raihani, A. (2023) · International Journal of Advanced Computer Science and Applications · doi:10.14569/ijacsa.2023.0140647 · Cited by 35 · see citing works
Utilizing multimodal artificial intelligence to advance cardiovascular diseases
Yang, X.-Y., Li, Y., Wang, J., Jia, Y., Zhang, Y., & Chen, M. (2025) · Precision Clinical Medicine · doi:10.1093/pcmedi/pbaf016 · Cited by 39 · see citing works
Deeply Supervised Skin Lesions Diagnosis With Stage and Branch Attention
Dai, W., Liu, R., Wu, T., Wang, M., Yin, J., & Liu, J. (2023) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2023.3308697 · Cited by 31 · see citing works
Sathvika, V. S. S. B. T., Anmisha, N., Thanmayi, V., Suchetha, M., Dhas, D. E., Sehastrajit, S., & Aakur, S. N. (2024) · IEEE Access · doi:10.1109/access.2024.3387533 · Cited by 29 · see citing works
Multi-scale feature fusion and class weight loss for skin lesion classification
Hu, Z., Mei, W., Chen, H., & Hou, W. Z. (2024) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2024.108594 · Cited by 29 · see citing works
Skin lesion classification based on two-modal images using a multi-scale fully-shared fusion network
Yang, Y., Xie, F., Zhang, H., Wang, J., Liu, J., Zhang, Y., & Ding, H. (2022) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2022.107315 · Cited by 30 · see citing works
Novel Mixed Domain Hand-Crafted Features for Skin Disease Recognition Using Multiheaded CNN
Kumar, A., Vishwakarma, A., Bajaj, V., & Mishra, S. C. (2024) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2024.3370772 · Cited by 29 · see citing works
Foltz, E. A., Witkowski, A., Becker, A. L., Latour, E., Lim, J. Y., Hamilton, A., & Ludzik, J. (2024) · Cancers · doi:10.3390/cancers16030629 · Cited by 28 · see citing works
Zhang, J., Shen, D., Chen, D., Ming, D., Ren, D., & Diao, Z. (2024) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2024.109089 · Cited by 27 · see citing works
Xu, J., Gao, Y., Liu, W., Huang, K., Zhao, S., Lü, L., Wang, X., Hua, X.-S., Wang, Y., & Chen, X. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-16437-8_60 · Cited by 24 · see citing works
Self-supervised multi-modality learning for multi-label skin lesion classification
Wang, H., Ahn, E., Bi, L., & Kim, J. (2025) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2025.108729 · Cited by 25 · see citing works
Zuo, L., Wang, Z., & Wang, Y. (2025) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2025.103091 · Cited by 23 · see citing works
Viriyasaranon, T., Woo, S., & Choi, J.-H. (2023) · IEEE journal of biomedical and health informatics · doi:10.1109/jbhi.2023.3237596 · Cited by 15 · see citing works
Xu, J., Huang, K., Zhong, L., Gao, Y., Sun, K., Liu, W., Zhou, Y., Guo, W., Guo, Y. C., Zou, Y., et al. (2024) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2024.3441012 · Cited by 20 · see citing works
MSMA: A multi-stage and multi-attention algorithm for the classification of multimodal skin lesions
Shu, C., Yu, L., Tian, S., & Shi, X. (2024) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2024.106180 · Cited by 19 · see citing works
RvXmBlendNet: A Multi-architecture Hybrid Model for Improved Skin Cancer Detection
Prity, F. S., Hasan, A. J., Anik, M. M. H., Hossain, R., Hossain, M. M., Bhuiyan, S. H., Islam, M. A., & Lavlu, M. T. H. (2024) · Human-Centric Intelligent Systems · doi:10.1007/s44230-024-00083-1 · Cited by 21 · see citing works
Multimodal Wearable Biosensing Meets Multidomain AI: A Pathway to Decentralized Healthcare
Liu, C., Fan, H., Kim, M., Zhou, T., Yang, P., Zhao, L., Wang, Y., Che, Z., Liu, C., Li, B., et al. (2026) · Advanced Science · doi:10.1002/advs.202522900 · Cited by 20 · see citing works
Xiao, C., Zhu, A., Xia, C., Qiu, Z., Liu, Y., Zhao, C., Ren, W., Wang, L., Dong, L., Wang, T., et al. (2024) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2024.3450682 · Cited by 15 · see citing works
Gradient modulated contrastive distillation of low-rank multi-modal knowledge for disease diagnosis
Xing, X., Chen, Z., Hou, Y., & Yuan, Y. (2023) · Medical Image Analysis · doi:10.1016/j.media.2023.102874 · Cited by 14 · see citing works
Liu, Z., Zhang, Y., Wang, K., Xie, F., & Liu, J. (2025) · British Journal of Dermatology · doi:10.1093/bjd/ljaf212 · Cited by 14 · see citing works
Multimodal dual-stage feature refinement for robust skin lesion classification
Khurshid, M., Singh, R., & Vatsa, M. (2025) · Scientific Reports · doi:10.1038/s41598-025-14839-7 · Cited by 13 · see citing works
Li, F., Li, M., Zuo, E., Chen, C., Chen, C., & Lv, X. (2024) · Pattern Recognition · doi:10.1016/j.patcog.2024.110742 · Cited by 12 · see citing works
Wei, Y., & Ji, L. (2024) · Multimedia Tools and Applications · doi:10.1007/s11042-023-18027-5 · Cited by 12 · see citing works
A hard segmentation network guided by soft segmentation for tumor segmentation on PET/CT images
Tong, G., & Jiang, H. (2023) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2023.104918 · Cited by 11 · see citing works
A Novel Perspective for Multi-Modal Multi-Label Skin Lesion Classification
Zhang, Y., Xie, Y., Hu, W., Avery, J., Hull, M. L., & Carneiro, G. (2025) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv61041.2025.00350 · Cited by 12 · see citing works
Wang, J., Zhang, Y., Xie, F., & Liu, J. (2025) · Journal of Investigative Dermatology · doi:10.1016/j.jid.2025.03.034 · Cited by 10 · see citing works
Zhang, Y., Hu, Y., Li, K., Pan, X., Mo, X., & Zhang, H. (2024) · Digital Health · doi:10.1177/20552076241257087 · Cited by 9 · see citing works
Ain, Q. U., Al-Sahaf, H., Xue, B., & Zhang, M. (2024) · IEEE Computational Intelligence Magazine · doi:10.1109/mci.2024.3401342 · Cited by 9 · see citing works
Mohammed, H. M. A., Ömeroğlu, A. N., Oral, E. A., & Ozbek, I. Y. (2024) · Computers & Electrical Engineering · doi:10.1016/j.compeleceng.2024.109966 · Cited by 9 · see citing works
Consistent representation via contrastive learning for skin lesion diagnosis
Wang, Z., Zhang, L., Shu, X., Wang, Y., & Feng, Y. (2023) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2023.107826 · Cited by 8 · see citing works
Cross-Modal Consistency for Single-Modal MR Image Segmentation
Xu, W., Li, C., Bian, Y., Meng, Q., Zhu, W., Shi, F., Chen, X., Shao, C., & Xiang, D. (2024) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2024.3380058 · Cited by 8 · see citing works
A trustworthy and explainable deep learning framework for skin lesion detection in smart dermatology
Eita, M. A., & Rizk, H. (2025) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2025.111594 · Cited by 7 · see citing works
CG-TRAN: A novel multi-label retinal disease classification model with partially known pathologies
Yang, J., Ning, Z., Xiao, X., Zhong, R., Xia, C., & Ding, Y. (2025) · Expert Systems with Applications · doi:10.1016/j.eswa.2025.129784 · Cited by 7 · see citing works
Zhang, Y., Xu, G., Zhao, M. Y., Wang, H., Shi, F., & Chen, S. (2025) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2025.3541170 · Cited by 6 · see citing works
Kumar, V., Shanthi, D. L., Babu, T. R., Kumar, N., Godi, R. K., & Dr Arun, G. (2025) · Egyptian Informatics Journal · doi:10.1016/j.eij.2025.100706 · Cited by 6 · see citing works
Split Learning of Multi-Modal Medical Image Classification
Ghosh, B., Wang, Y., Fu, H.-Z., Wei, Q.-S., Liu, Y., & Goh, R. S. (2024) · Conference on Algebraic Informatics · doi:10.1109/cai59869.2024.00235 · Cited by 2 · see citing works
Ziegler, J., Dobsch, P., Rozema, M., Zuber-Jerger, I., Weigand, K., Reuther, S., Müller, M., & Kandulski, A. (2024) · Gastrointestinal Endoscopy · doi:10.1016/j.gie.2024.09.001 · Cited by 6 · see citing works
Unpaired Dual-Modal Image Complementation Learning for Single-Modal Medical Image Segmentation
Xiang, D., Peng, T., Bian, Y., Chen, L., Zeng, J., Shi, F., Zhu, W., & Chen, X. (2024) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2024.3467216 · Cited by 6 · see citing works
Class-Agnostic Feature-Learning-Based Deep-Learning Model for Robust Melanoma Prediction
Chu, Y., Lee, S., Oh, B. H., & Yang, S. (2025) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2025.3535536 · Cited by 6 · see citing works
Wang, Y., Haq, N. F., Cai, J., Kalia, S., Lui, H., Wang, Z. J., & Lee, T. K. (2022) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2022.103893 · Cited by 6 · see citing works
Revisiting the Shape-Bias of Deep Learning for Dermoscopic Skin Lesion Classification
Lucieri, A., Schmeisser, F., Balada, C., Siddiqui, S. A., Dengel, A. R., & Ahmed, S. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-12053-4_4 · Cited by 6 · see citing works
Knowledge distillation via teacher-modeled sample relationships for skin cancer diagnosis
Liu, P., Wenhua, Q., & Tang, S. (2025) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2025.112452 · Cited by 5 · see citing works
Li, C., Liu, J., & Tang, J. (2024) · Mathematical Biosciences & Engineering · doi:10.3934/mbe.2024090 · Cited by 5 · see citing works
Unpaired multi-modal tumor segmentation with structure adaptation
Zhou, P., Chen, H., Li, Y., & Peng, Y. (2022) · Applied Intelligence · doi:10.1007/s10489-022-03610-4 · Cited by 5 · see citing works
Zhou, J., Li, X., Ma, Y., Ze-jiu, W., Xie, Z., Zhang, Y., & Wei, Y. (2023) · Mathematical Biosciences & Engineering · doi:10.3934/mbe.2023237 · Cited by 5 · see citing works
Bai, B., & Miyata, K. (2025) · IEEE Access · doi:10.1109/access.2025.3609221 · Cited by 4 · see citing works
Stepwise self-knowledge distillation for skin lesion image classification
Zheng, J., Xie, K., Zhang, D., Lv, Z., & Yu, X. (2025) · Scientific Reports · doi:10.1038/s41598-025-10717-4 · Cited by 5 · see citing works
MLDF-Net: Metadata Based Multi-level Dynamic Fusion Network
Li, F., Zuo, E., Chen, C., Chen, C., Ma, M., Wang, Y., Lv, X., & Li, M. (2023) · Lecture notes in computer science · doi:10.1007/978-981-99-8429-9_37 · Cited by 4 · see citing works
Ain, Q. U., Al-Sahaf, H., Xue, B., & Zhang, M. (2024) · Genetic and Evolutionary Computation Conference (GECCO) · doi:10.1145/3638529.3654071 · Cited by 4 · see citing works
Uncertainty-Guided Coarse-to-Fine Tumor Segmentation with Anatomy-Aware Post-Processing
Isler, I., Mohaisen, A., Lisle, C. R., Turgut, D., & Bağcı, U. (2025) · International Conference on Artificial Intelligence, Computer, Data Sciences and Applications (ACDSA) · doi:10.1109/acdsa65407.2025.11166003 · Cited by 6 · see citing works
Qin, H., Deng, Z., Shu, L., Yin, Y., Li, J., Zhou, L., Zeng, H., & Liang, Q. (2023) · Electronics · doi:10.3390/electronics12173732 · Cited by 4 · see citing works
Anand, S., Sheeba, A., & Tharshini, M. K. M. (2024) · Multimedia Tools and Applications · doi:10.1007/s11042-023-17908-z · Cited by 4 · see citing works
Msfusenet: a multi-stage information fusion network for multi-modal skin lesion diagnosis
Xiao, Y., Yu, L., Tian, S., Yu, S., Zhang, D., Kang, X., Wu, W., & Rui, L. (2025) · Multimedia Systems · doi:10.1007/s00530-025-01788-4 · Cited by 3 · see citing works
A New Genetic Programming Representation for Feature Learning in Skin Cancer Detection
Ain, Q. U., Al-Sahaf, H., Xue, B., & Zhang, M. (2023) · Genetic and Evolutionary Computation Conference Companion (GECCO Companion) · doi:10.1145/3583133.3590550 · Cited by 3 · see citing works
A Progressive Implicit Neural Fusion Network for Multispectral Image Pansharpening
Yao, F., Zhang, L., Zhang, Y., Guo, X., Xie, G., Liu, C., & Xiang, S. (2024) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2024.3443400 · Cited by 3 · see citing works
Self-citationEbrahimi, S. H. S., Majidzadeh, K., & Gharehchopogh, F. S. (2024) · Evolving Systems · doi:10.1007/s12530-024-09618-0 · Cited by 3 · see citing works
Sami, S. M., Hasan, M. M., Nasrabadi, N. M., & Rao, R. (2025) · IEEE Transactions on Aerospace and Electronic Systems · doi:10.1109/taes.2025.3550474 · Cited by 2 · see citing works
Multitree GP-Based Feature Learning for Multimodal Medical Image Classification
Wu, Z., Xue, B., & Zhang, M. (2025) · IEEE Congress on Evolutionary Computation (CEC) · doi:10.1109/cec65147.2025.11043090 · Cited by 2 · see citing works
Shen, Y. (2025) · IEEE Access · doi:10.1109/access.2025.3587298 · Cited by 3 · see citing works
Yuan, J., Chen, X., Yang, C. L., Chen, J., Han, P., Zhang, Y., & Zhang, Y. (2025) · Patient Preference and Adherence · doi:10.2147/ppa.s526623 · Cited by 2 · see citing works
Zhao, C., Xiao, C., Jin, F., Zhu, A., Xiang, Z., Liu, Y., Guo, L., Wang, T., & Lei, B. (2025) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2025.112025 · Cited by 2 · see citing works
Rajpoot, A. S., Dixit, R., & Shukla, A. (2025) · International Journal of Imaging Systems and Technology · doi:10.1002/ima.70219 · Cited by 2 · see citing works
Multilevel Causality Learning for Multi-label Gastric Atrophy Diagnosis
Cui, X., Jiang, S., Baolin, S., Li, Y., Cao, Y., Li, Z., Lv, C., Liu, Z., Cui, L., & Li, S. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72384-1_64 · Cited by 2 · see citing works
Wang, X., Zhang, J., Teng, X., Aik, K. W., Natividad, L. R., Cheng, C., Wong, A. P. C., Keng, Y. J. F., Koh, A. S.-M., & Huang, W. (2024) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2024.3523476 · Cited by 2 · see citing works
MMFNet: A Multi-modal and Multi-attention Fusion Network for Multi-task Skin Disease Classification
Zhu, X., Qian, P., Wang, C., Liu, L., Gao, M., Cai, W., & Ng, E. Y. K. (2024) · IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm62325.2024.10822724 · Cited by 3 · see citing works
Li, R., Jiang, C., & Chen, N. (2025) · International Conference on Computer Vision and Image Processing (CVIP) · doi:10.1117/12.3057963 · Cited by 2 · see citing works
Li, T., Li, B., Jia, Y., Duan, L., Sun, P., Li, X., Yang, X., & Cai, H. (2025) · Intelligent Medicine · doi:10.1016/j.imed.2024.10.002 · Cited by 2 · see citing works
A Review of Metadata and Deep Learning Strategies for Skin Lesion Classification
Pérez, A. G., Jofré, P. I. R., Vidaurre, S., Navarrete‐Dechent, C., & Mery, D. (2025) · Journal of Investigative Dermatology · doi:10.1016/j.jid.2025.06.1593 · Cited by 2 · see citing works
Skin Disease Diagnostic techniques using deep learning
Kumari, B., Jatain, A., & Arora, Y. (2022) · International Conference on Information Management & Machine Intelligence (ICIMMI) · doi:10.1145/3590837.3590917 · Cited by 2 · see citing works
Transfer Learning-Based Encoder-Decoder Model for Skin Lesion Segmentation
Appati, J. K., Boante, L. M., Owusu, E., & Gah, S. K. (2023) · Communications in computer and information science · doi:10.1007/978-3-031-43838-7_9 · Cited by 2 · see citing works
Balanced Supervised Contrastive Learning for Skin Lesion Classification
Yan, L., & Li, K. (2023) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/smc53992.2023.10393927 · Cited by 1 · see citing works
Two-Stage Dynamic Fusion Framework for Multimodal Classification Tasks
Ge, S., & Chen, Y. H. (2025) · INFORMS journal on computing · doi:10.1287/ijoc.2023.0448 · Cited by 1 · see citing works
Duan, L., Li, T., Li, B., Li, X., Fu, D., Yang, X., Cao, K., & Cai, H. (2025) · Intelligent Medicine · doi:10.1016/j.imed.2025.08.004 · Cited by 2 · see citing works
Fan, L., Ou, Y., Zheng, C., & Gong, X. (2026) · Expert systems with applications · doi:10.1016/j.eswa.2026.131590 · Cited by 1 · see citing works
DFFENet: Dual-Branch Frequency Domain Feature Enhancement Network for Skin Lesion Classification
Yu, F., Yuan, J., Jin, Y., Liu, L., & Jiang, M. (2026) · Image and Vision Computing · doi:10.1016/j.imavis.2026.105972 · Cited by 1 · see citing works
Li, J. J., Diao, H., Yu, Q., Zhou, F., Zheng, X., Zheng, Y., Meng, Y., & Dong, S. (2026) · Information Fusion · doi:10.1016/j.inffus.2026.104502 · Cited by 1 · see citing works
Beyond Correlation: Causal Intervention for Multi-Label Medical Image Diagnosis
Xie, J., Zhao, Y., Chen, X., Meng, Y., Zhao, H., Alam, U., Li, X., & Zheng, Y. (2026) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2026.3698052 · Cited by 1 · see citing works
Exploring Genetic Programming Models in Computer-Aided Diagnosis of Skin Cancer Images
Ain, Q. U., Al-Sahaf, H., Xue, B., & Zhang, M. (2024) · IEEE Congress on Evolutionary Computation (CEC) · doi:10.1109/cec60901.2024.10612105 · Cited by 1 · see citing works
Enhancing multimodal medical image classification through cross-graph modal contrastive learning
Ding, J.-E., Hsu, C.-C., Chu, C., Wang, S., & Liu, F. (2025) · Expert Systems with Applications · doi:10.1016/j.eswa.2025.130566 · Cited by 1 · see citing works
Sonuç, E., Saihood, Q., Yargı Baydilli, Y., & Özcan, E. (2026) · Frontiers in Medicine · doi:10.3389/fmed.2026.1871689
Multi-Stage Classification Scheme to Optimize Medical Treatments
Gishyan, K. (2023) · Mathematical Problems of Computer Science · doi:10.51408/1963-0108
Improving Melanoma Classification Using Transfer Learning Based Wavelet Features
Sahoo, S. R., Dash, R., & Mohapatra, R. K. (2025) · Communications in computer and information science · doi:10.1007/978-3-031-81339-9_6
(2025) · Journal on Electronic and Automation Engineering · doi:10.46632/jeae/4/2/13
- Authors
- Tang, P., Yan, X., Nan, Y., Xiang, S., Krammer, S., & Lasser, T.
- Affiliations
- Technical University of Munich (DE)
- Wuhan University (CN)
- LMU Klinikum (DE)
- Corresponding author
- Tang, Peng
- Venue
- Medical Image Analysis
- Publisher
- Elsevier BV
- Published
- 2022-02
- Volume
- 76
- Pages
- 102307
- ISSN
- 1361-8415 (ISSN-L)
- OpenAlex
- W3215150387
- Semantic Scholar
- 9bab4cf354505a691237550507918821d7656002
- Cited by
- 131
- References
- 55
- Citations by year
- 2026: 30 · 2025: 39 · 2024: 31 · 2023: 20 · 2022: 11
- FWCI
- 5.68
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- Locations
- Medical Image Analysis (publishedVersion)
- PubMed (publishedVersion)
- Funders
- Bundesministerium für Gesundheit (2520DAT920)
- China Scholarship Council
- Topics
- Health Sciences › Medicine › Oncology › Cutaneous Melanoma Detection and Management
- Physical Sciences › Computer Science › Artificial Intelligence › AI in cancer detection
- Health Sciences › Health Professions › Health Information Management › Artificial Intelligence in Healthcare
- Keywords
- skin lesion classification, multi-label classification, multimodal learning, dermoscopic images, decision fusion, feature-level fusion, two-stage fusion, label imbalance, dermatological diagnosis
- MeSH terms
- Algorithms, Humans, Skin Diseases
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
