The DOI matches its Crossref record; 52 of the 55 references it cites were found in a registry or an index.
FusionM4Net: A multi-stage multi-modal learning algorithm for multi-label skin lesion classification
Abstract
Skin disease is one of the most common diseases in the world. Deep learning-based methods have achieved excellent skin lesion recognition performance, most of which are based on only dermoscopy images. In recent works that use multi-modality data (patient's meta-data, clinical images, and dermoscopy images), the methods adopt a one-stage fusion approach and only optimize the information fusion at the feature level. These methods do not use information fusion at the decision level and thus cannot fully use the data of all modalities. This work proposes a novel two-stage multi-modal learning algorithm (FusionM4Net) for multi-label skin diseases classification. At the first stage, we construct a FusionNet, which exploits and integrates the representation of clinical and dermoscopy images at the feature level, and then uses a Fusion Scheme 1 to conduct the information fusion at the decision level. At the second stage, to further incorporate the patient's meta-data, we propose a Fusion Scheme 2, which integrates the multi-label predictive information from the first stage and patient's meta-data information to train an SVM cluster. The final diagnosis is formed by the fusion of the predictions from the first and second stages. Our algorithm was evaluated on the seven-point checklist dataset, a well-established multi-modality multi-label skin disease dataset. Without using the patient's meta-data, the proposed FusionM4Net's first stage (FusionM4Net-FS) achieved an average accuracy of 75.7% for multi-classification tasks and 74.9% for diagnostic tasks, which is more accurate than other state-of-the-art methods. By further fusing the patient's meta-data at FusionM4Net's second stage (FusionM4Net-SS), the entire FusionM4Net finally boosts the average accuracy to 77.0% and the diagnostic accuracy to 78.5%, which indicates its robust and excellent classification performance on the label-imbalanced dataset. The corresponding code is available at: https://github.com/pixixiaonaogou/MLSDR.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“These studies suggest that patient metadata provides complementary information that can support skin lesion classification when combined with image features.”
From Interpretable multimodal fusion for skin lesion classification using dermoscopic images and patient metadata (2026) · cites this paper as [26]
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Scikit-learn: Machine Learning in Python
Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., Blondel, M., Müller, A., Nothman, J., Louppe, G., et al. (2012) · arXiv · doi:10.48550/arxiv.1201.0490 · Cited by 71,016
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Rethinking the Inception Architecture for Computer Vision
Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., & Wojna, Z. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.308 · Cited by 32,138
PyTorch: An Imperative Style, High-Performance Deep Learning Library
Paszke, A., Gross, S., Massa, F., Lerer, A., Bradbury, J., Chanan, G., Killeen, T., Lin, Z., Gimelshein, N., Antiga, L., et al. (2019) · arXiv · doi:10.48550/arxiv.1912.01703 · Cited by 31,473
Harris, C. R., Millman, K. J., van der Walt, S. J., Gommers, R., Virtanen, P., Cournapeau, D., Wieser, E., Taylor, J., Berg, S., Smith, N. J., et al. (2020) · Nature · doi:10.1038/s41586-020-2649-2 · Cited by 23,826
Proceedings of IEEE Conference on Computer Vision and Pattern Recognition
(1993) · doi:10.1109/cvpr.1993 · Cited by 17,989
Harris, C., Millman, K., van der Walt, S., Gommers, R., Virtanen, P., Cournapeau, D., Wieser, E., Taylor, J., Berg, S., Smith, N., et al. (2020) · RePEc: Research Papers in Economics · Cited by 17,844
Research works printed but not linked: 1
- Qiu, 2018, Fusion of deep learning models of MRI scans, Assess. Dis. Monit., 10, 737
Cited by
Sorted by citations
Items 101–131 of 131
Huang, J., Chen, Z.-M., Zhang, G., Ge, Y., & Chen, H. (2025) · Displays · doi:10.1016/j.displa.2025.103183
Indepth Integration of Multi-granularity Features from Dual-modal for Disease Classification
Wu, Y., Zhang, X., Wu, W., Jiang, H., An, C., & Zhang, J. (2025) · Lecture notes in computer science · doi:10.1007/978-3-032-04965-0_25
DermClinical: Clinical-oriented dataset and evaluation for computer-aided dermatological diagnosis
Liu, Z., Hu, Z., Xiong, R., Zhang, S., & Jiang, T. (2025) · Neurocomputing · doi:10.1016/j.neucom.2025.131811
Li, F., Li, M., Hu, C., Zuo, E., Lv, X., Ma, M., Chen, C., & Chen, C. (2025) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn64981.2025.11229282
Mixture-of-experts-based hierarchical dynamic multimodal fusion network for dermatological diagnosis
Hu, C., Li, F., Li, M., Zuo, E., Lv, X., Bao, S., Rao, C., Xie, X., Chen, C., & Chen, C. (2026) · Neurocomputing · doi:10.1016/j.neucom.2025.132585
Zheng, Y., Xu, J., Hua, Q., Jia, X., Hou, X., Yao, Y., Wei, Z., Zhang, Y., Wu, F., Guo, W., et al. (2026) · Medical Image Analysis · doi:10.1016/j.media.2026.103957
Skin Deep Advanced Model for Accurate Skin Disease Diagnosis
Devi, K., Hemasree, R., Akshaya, A. V., Jennifer, S. S., & Subramani, K. (2025) · International Conference on Networks and Soft Computing (ICNSoC) · doi:10.1109/icnsoc66817.2025.00066
Mg-Mcc: Metadata-Guided Skin Lesion Classification Via Multimodal Consistency Constraints
Zhang, S., Xin, J., Shen, Q., Huang, Z., Liu, X., & Wang, Z. (2025) · IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm66473.2025.11356175
Multi-hypergraph learning for enhanced diagnosis of retinal diseases
Meng, K., Liu, Z., Qu, J., Wang, S., Liang, Y., Li, J., Xie, Y., Zhao, X., Dong, L., Zhang, G., et al. (2026) · Expert Systems with Applications · doi:10.1016/j.eswa.2026.131481
Wang, Z., & Li, Z. (2026) · Lecture notes in computer science · doi:10.1007/978-981-95-6957-1_5
Choi, S.-Y., & Lee, K. (2025) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw69036.2025.00238
He, X., Wang, Y., Wang, Y., Xie, D. H., Yuan, Y., He, R., & Huang, K. (2026) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2026.110019
Actinic keratosis staging in multimodal image data
Slian, A., Korecka, K., Polańska, A., & Czajkowska, J. (2026) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2026.109364
MSDFNET: An Aggregation Perception-Based Multi-Modal Skin Lesion Classification Network
Wang, X., Yang, M., Feng, Y., Wu, Z., & Chen, S. (2026) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp55912.2026.11463118
Sun, T., Jiang, Y., Jin, Y., Guo, H., & Zhang, Z. (2026) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv61042.2026.00520
CDMFuse: A Multi-modal Fusion Framework for Skin Lesion Classification
Dong, X., Yu, L., Tian, S., Yang, Q., Zhang, D., & Yu, S. (2026) · Communications in computer and information science · doi:10.1007/978-981-95-7299-1_10
Yang, J., Ning, Z. H., & Xiao, X. (2026) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2026.110789
Wu, X., Lan, Y., Han, L., & Wang, P. Y. (2026) · Tomography · doi:10.3390/tomography12070093
Wang, Y., Wang, F., & Wang, Y. (2026) · International Journal of Imaging Systems and Technology · doi:10.1002/ima.70401
Almjally, A., Aziz, M., Najam, S., Menshawi, A. M., Altaf, M. M., Aljulayfi, A. F., & Jalal, A. (2026) · Diagnostics · doi:10.3390/diagnostics16152351 · Cited by 1
Chen, H., Sun, J., & Zhang, J. (2026) · Research Square · doi:10.21203/rs.3.rs-10207287/v1
PyMIF-Net: Pyramid Mutual Information Fusion Network for multimodal skin lesion classification
Li, C., Xu, H., Chen, H., Wu, Z., Chen, Z., Hu, Y., Chen, Y., Xu, X., & Zhu, X. (2026) · Pattern Recognition · doi:10.1016/j.patcog.2026.114613
Çetinel, G., Gül, S., & Kara, R. Ö. (2026) · Diagnostics · doi:10.3390/diagnostics16162543
CARE-Former: Cross-modal attentive reasoning and evidence transformer for skin lesion diagnosis
Fan, W., Zhang, Y., & Fu, K. (2026) · Information Sciences · doi:10.1016/j.ins.2026.124079
Robust dermatological image analysis via multitask learning on heterogeneous datasets
Gallo, I., Gatti, M., Sgroi, L., & Corchs, S. (2026) · Intelligence-Based Medicine · doi:10.1016/j.ibmed.2026.100474
Li, J., Yu, Q., Zhou, F., Zhang, D., Huang, B., Zhao, Y., Fan, D.-P., Fu, H., Zheng, Y., & Meng, Y. (2026) · Medical Image Analysis · doi:10.1016/j.media.2026.104331
Multi-disease Diagnosis in Retinal Images via Patch-Level Reasoning and Selective Aggregation
Xie, J., Zhao, Y., Meng, Y., Zhang, H., Alam, U., & Zheng, Y. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-38098-2_47
Sun, W., Yin, E. R., Chen, Y., Li, T., Shang, L., Yin, J., & Wang, H. (2026) · Journal of Biophotonics · doi:10.1002/jbio.70370
Enhancing Multi-Label retinal Disease diagnosis via Multi-Expert graph neural active learning
Ning, Z., & Yang, J. (2026) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2026.111609
Zhang, Y.-L. (2026) · 2026 8th International Conference on Artificial Intelligence Technologies and Applications (ICAITA) · doi:10.1109/icaita71179.2026.11737004
Explainable Multimodal Deep Learning for Skin Lesion Diagnosis Using Hybrid Adam–GWO
Aly, M., & Alotaibi, N. M. (2026) · Bioengineering · doi:10.3390/bioengineering13111252
Metadata
- Authors
- Tang, P., Yan, X., Nan, Y., Xiang, S., Krammer, S., & Lasser, T.
- Affiliations
- Technical University of Munich (DE)
- Wuhan University (CN)
- LMU Klinikum (DE)
- Corresponding author
- Tang, Peng
- Venue
- Medical Image Analysis
- Publisher
- Elsevier BV
- Published
- 2022-02
- Volume
- 76
- Pages
- 102307
- ISSN
- 1361-8415 (ISSN-L)
- OpenAlex
- W3215150387
- Semantic Scholar
- 9bab4cf354505a691237550507918821d7656002
- Cited by
- 131
- References
- 55
- Citations by year
- 2026: 30 · 2025: 39 · 2024: 31 · 2023: 20 · 2022: 11
- FWCI
- 5.68
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- Locations
- Medical Image Analysis (publishedVersion)
- PubMed (publishedVersion)
- Funders
- Bundesministerium für Gesundheit (2520DAT920)
- China Scholarship Council
- Topics
- Health Sciences › Medicine › Oncology › Cutaneous Melanoma Detection and Management
- Physical Sciences › Computer Science › Artificial Intelligence › AI in cancer detection
- Health Sciences › Health Professions › Health Information Management › Artificial Intelligence in Healthcare
- Keywords
- skin lesion classification, multi-label classification, multimodal learning, dermoscopic images, decision fusion, feature-level fusion, two-stage fusion, label imbalance, dermatological diagnosis
- MeSH terms
- Algorithms, Humans, Skin Diseases
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
