Cascaded multi-modal mixing transformers for Alzheimer’s disease classification with incomplete data
Open accessAbstract
Accurate medical classification requires a large number of multi-modal data, and in many cases, different feature types. Previous studies have shown promising results when using multi-modal data, outperforming single-modality models when classifying diseases such as Alzheimer's Disease (AD). However, those models are usually not flexible enough to handle missing modalities. Currently, the most common workaround is discarding samples with missing modalities which leads to considerable data under-utilisation. Adding to the fact that labelled medical images are already scarce, the performance of data-driven methods like deep learning can be severely hampered. Therefore, a multi-modal method that can handle missing data in various clinical settings is highly desirable. In this paper, we present Multi-Modal Mixing Transformer (3MT), a disease classification transformer that not only leverages multi-modal data but also handles missing data scenarios. In this work, we test 3MT for AD and Cognitively normal (CN) classification and mild cognitive impairment (MCI) conversion prediction to progressive MCI (pMCI) or stable MCI (sMCI) using clinical and neuroimaging data. The model uses a novel Cascaded Modality Transformers architecture with cross-attention to incorporate multi-modal information for more informed predictions. We propose a novel modality dropout mechanism to ensure an unprecedented level of modality independence and robustness to handle missing data scenarios. The result is a versatile network that enables the mixing of arbitrary numbers of modalities with different feature types and also ensures full data utilization in missing data scenarios. The model is trained and evaluated on the Alzheimer's Disease Neuroimaging Initiative (ADNI) dataset with the state-of-the-art performance and further evaluated with The Australian Imaging Biomarker & Lifestyle Flagship Study of Ageing (AIBL) dataset with missing data.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474 · see citing works
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404 · see citing works
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946 · see citing works
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 74,248 · see citing works
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562 · see citing works
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 48,293 · see citing works
Microsoft COCO: Common Objects in Context
Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., & Zitnick, C. L. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10602-1_48 · Cited by 45,460 · see citing works
McKhann, G., Drachman, D., Folstein, M., Katzman, R., Price, D., & Stadlan, E. M. (1984) · Neurology · doi:10.1212/wnl.34.7.939 · Cited by 27,915 · see citing works
Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation
Cho, K., van Merrienboer, B., Gulcehre, C., Bahdanau, D., Bougares, F., Schwenk, H., & Bengio, Y. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1179 · Cited by 25,545 · see citing works
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372 · see citing works
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., Gelly, S., et al. (2020) · arXiv · doi:10.48550/arxiv.2010.11929 · Cited by 21,793 · see citing works
McKhann, G. M., Knopman, D. S., Chertkow, H., Hyman, B. T., Jack, C. R., Kawas, C. H., Klunk, W. E., Koroshetz, W. J., Manly, J. J., Mayeux, R., et al. (2011) · Alzheimer's & Dementia · doi:10.1016/j.jalz.2011.03.005 · Cited by 18,657 · see citing works
End-to-End Object Detection with Transformers
Carion, N., Massa, F., Synnaeve, G., Usunier, N., Kirillov, A., & Zagoruyko, S. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58452-8_13 · Cited by 18,285 · see citing works
Proceedings of IEEE Conference on Computer Vision and Pattern Recognition
(1993) · doi:10.1109/cvpr.1993 · Cited by 17,989 · see citing works
Advances in Neural Information Processing Systems 29
Teymur, O., Zygalakis, K., & Calderhead, B. (2016) · Cited by 13,881 · see citing works
Kaugeranna, R., Kaugeranna, E., & Aion, (. S. 4. 6. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.giscience.2023.43 · Cited by 13,695 · see citing works
The Alzheimer’s disease neuroimaging initiative (ADNI): MRI methods
Jack, C. R., Bernstein, M. A., Fox, N. C., Thompson, P., Alexander, G., Harvey, D., Borowski, B., Britson, P. J., L. Whitwell, J., Ward, C., et al. (2008) · Journal of Magnetic Resonance Imaging · doi:10.1002/jmri.21049 · Cited by 4,347 · see citing works
TransUNet: Transformers Make Strong Encoders for Medical Image Segmentation
Chen, J., Lu, Y., Yu, Q., Luo, X., Adeli, E., Wang, Y., Lu, L., Yuille, A. L., & Zhou, Y. (2021) · arXiv · doi:10.48550/arxiv.2102.04306 · Cited by 4,206 · see citing works
Rethinking Semantic Segmentation from a Sequence-to-Sequence Perspective with Transformers
Zheng, S., Lu, J., Zhao, H., Zhu, X., Luo, Z., Wang, Y., Fu, Y., Feng, J., Xiang, T., Torr, P. H. S., et al. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00681 · Cited by 4,008 · see citing works
Self-citationUNETR: Transformers for 3D Medical Image Segmentation
Hatamizadeh, A., Tang, Y., Nath, V., Yang, D., Myronenko, A., Landman, B., Roth, H. R., & Xu, D. (2022) · 2022 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv51458.2022.00181 · Cited by 3,586 · see citing works
Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translation
Cho, K., van Merrienboer, B., Gulcehre, C., Bahdanau, D., Bougares, F., Schwenk, H., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1406.1078 · Cited by 3,317 · see citing works
2019 Alzheimer’s disease facts and figures.
Alzheimer's Association (2019) · Alzheimer's & Dementia · doi:10.1016/j.jalz.2019.01.010 · Cited by 2,461 · see citing works
Medical Transformer: Gated Axial-Attention for Medical Image Segmentation
Valanarasu, J. M. J., Oza, P., Hacihaliloglu, I., & Patel, V. M. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-87193-2_4 · Cited by 1,566 · see citing works
Automatic classification of MR scans in Alzheimer’s disease.
Kloppel, S., Stonnington, C. M., Chu, C., Draganski, B., Scahill, R. I., Rohrer, J. D., Fox, N. C., Jack, C. R., Ashburner, J., & Frackowiak, R. S. J. (2008) · Brain · doi:10.1093/brain/awm319 · Cited by 1,170 · see citing works
Beach, T. G., Monsell, S. E., Phillips, L. E., & Kukull, W. (2012) · Journal of Neuropathology & Experimental Neurology · doi:10.1097/nen.0b013e31824b211b · Cited by 1,103 · see citing works
Blood-based biomarkers for Alzheimer's disease: towards clinical implementation
Teunissen, C. E., Verberk, I. M. W., Thijssen, E. H., Vermunt, L., Hansson, O., Zetterberg, H., van der Flier, W. M., Mielke, M. M., & del Campo, M. (2022) · The Lancet Neurology · doi:10.1016/s1474-4422(21)00361-6 · Cited by 1,045 · see citing works
Ellis, K. A., Bush, A. I., Darby, D., Fazio, D. D., Foster, J. K., Hudson, P. J., Lautenschlager, N. T., Lenzo, N. P., Martins, R. N., Maruff, P. T., et al. (2009) · International Psychogeriatrics · doi:10.1017/s1041610209009405 · Cited by 970 · see citing works
Association of Amyloid and Tau With Cognition in Preclinical Alzheimer Disease: A Longitudinal Study
Hanseeuw, B. J., Betensky, R. A., Jacobs, H. I. L., Schultz, A. P., Sepulcre, J., Becker, J. A., Cosio, D. M. O., Farrell, M., Quiroz, Y. T., Mormino, E. C., et al. (2019) · JAMA Neurology · doi:10.1001/jamaneurol.2019.1424 · Cited by 865 · see citing works
Wen, J., Thibeau-Sutre, E., Diaz-Melo, M., Samper-González, J., Routier, A., Bottani, S., Dormont, D., Durrleman, S., Burgos, N., & Colliot, O. (2020) · Medical Image Analysis · doi:10.1016/j.media.2020.101694 · Cited by 809 · see citing works
Axial-DeepLab: Stand-Alone Axial-Attention for Panoptic Segmentation
Wang, H., Zhu, Y., Green, B., Adam, H., Yuille, A., & Chen, L.-C. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58548-8_7 · Cited by 809 · see citing works
PET of Brain Amyloid and Tau in Mild Cognitive Impairment
Small, G. W., Kepe, V., Ercoli, L. M., Siddarth, P., Bookheimer, S. Y., Miller, K. J., Lavretsky, H., Burggren, A. C., Cole, G. M., Vinters, H. V., et al. (2006) · New England Journal of Medicine · doi:10.1056/nejmoa054625 · Cited by 731 · see citing works
A comparison between voxel-based cortical thickness and voxel-based morphometry in normal aging
Hutton, C., Draganski, B., Ashburner, J., & Weiskopf, N. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2009.06.043 · Cited by 566 · see citing works
Tau biomarkers in Alzheimer's disease: towards implementation in clinical practice and trials
Ossenkoppele, R., van der Kant, R., & Hansson, O. (2022) · The Lancet Neurology · doi:10.1016/s1474-4422(22)00168-5 · Cited by 557 · see citing works
Lian, C., Liu, M., Zhang, J., & Shen, D. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2889096 · Cited by 544 · see citing works
Identifying and validating biomarkers for Alzheimer's disease
Humpel, C. (2011) · Trends in Biotechnology · doi:10.1016/j.tibtech.2010.09.007 · Cited by 484 · see citing works
Qiu, S., Joshi, P. S., Miller, M. I., Xue, C., Zhou, X., Karjadi, C., Chang, G. H., Joshi, A. S., Dwyer, B., Zhu, S., et al. (2020) · Brain · doi:10.1093/brain/awaa137 · Cited by 472 · see citing works
Deep learning to detect Alzheimer's disease from neuroimaging: A systematic literature review
Ghahnavieh, A. E., Luo, S., & Chiong, R. (2019) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2019.105242 · Cited by 439 · see citing works
Perceiver: General Perception with Iterative Attention
Jaegle, A., Gimeno, F., Brock, A., Zisserman, A., Vinyals, O., & Carreira, J. (2021) · arXiv · doi:10.48550/arxiv.2103.03206 · Cited by 414 · see citing works
Lin, W.-M., Tong, T., Gao, Q., Guo, D., Du, X., Yang, Y., Guo, G., Xiao, M., Du, M., Qu, X., et al. (2018) · Frontiers in Neuroscience · doi:10.3389/fnins.2018.00777 · Cited by 391 · see citing works
Lebedev, A. V., Westman, E., van Westen, G. J. P., Kramberger, M. G., Lundervold, A. J., Aarsland, D., Soininen, H. S., Kłoszewska, I., Mecocci, P., Tsolaki, M., et al. (2014) · NeuroImage Clinical · doi:10.1016/j.nicl.2014.08.023 · Cited by 305 · see citing works
Zhang, Y., Dong, Z., Phillips, P., Wang, S., Ji, G., Yang, J., & Yuan, T. (2015) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2015.00066 · Cited by 279 · see citing works
Characterization of Novel CSF Tau and ptau Biomarkers for Alzheimer’s Disease
Meredith Jr., J. E., Sankaranarayanan, S., Guss, V., Lanzetti, A. J., Berisha, F., Neely, R. J., Slemmon, J. R., Portelius, E., Zetterberg, H., Blennow, K., et al. (2013) · PLoS ONE · doi:10.1371/journal.pone.0076523 · Cited by 209 · see citing works
An efficient 3D deep convolutional network for Alzheimer's disease diagnosis using MR images
Bäckström, K., Nazari, M., Gu, I. Y., & Jakola, A. S. (2018) · IEEE International Symposium on Biomedical Imaging (ISBI) · doi:10.1109/isbi.2018.8363543 · Cited by 143 · see citing works
Qiu, S., Chang, G. H., Panagia, M., Gopal, D. M., Au, R., & Kolachalama, V. B. (2018) · Alzheimer's & Dementia: Diagnosis, Assessment & Disease Monitoring · doi:10.1016/j.dadm.2018.08.013 · Cited by 110 · see citing works
Detecting Neurodegenerative Disease from MRI: A Brief Review on a Deep Learning Perspective
Noor, M. B. T., Zenia, N. Z., Kaiser, M. S., Mahmud, M., & Mamun, S. A. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-37078-7_12 · Cited by 101 · see citing works
Pan, Y., Liu, M.-X., Lian, C., Xia, Y., & Shen, D. (2020) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2020.2983085 · Cited by 87 · see citing works
Deep Residual Nets for Improved Alzheimer's Diagnosis
Valliani, A. A.-A., & Soni, A. B. (2017) · ACM International Conference on Bioinformatics, Computational Biology, and Health Informatics (ACM-BCB) · doi:10.1145/3107411.3108224 · Cited by 74 · see citing works
Addformer: Alzheimer’s Disease Detection from Structural Mri Using Fusion Transformer
Kushol, R., Masoumzadeh, A., Dong, H., Kalra, S., & Yang, Y. (2022) · IEEE International Symposium on Biomedical Imaging (ISBI) · doi:10.1109/isbi52829.2022.9761421 · Cited by 74 · see citing works
MRI-based Alzheimer’s disease prediction via distilling the knowledge in multi-modal data
Guan, H., Wang, C., & Tao, D. (2021) · NeuroImage · doi:10.1016/j.neuroimage.2021.118586 · Cited by 55 · see citing works
Trans-ResNet: Integrating Transformers and CNNs for Alzheimer’s disease classification
Li, C., Cui, Y. J., Luo, N., Liu, Y., Bourgeat, P., Fripp, J., & Jiang, T. (2022) · IEEE International Symposium on Biomedical Imaging (ISBI) · doi:10.1109/isbi52829.2022.9761549 · Cited by 55 · see citing works
Servick, K. (2019) · Science · doi:10.1126/science.aax4236 · Cited by 32 · see citing works
MRI Field Strength Predicts Alzheimer’s Disease: a Case Example of Bias in the ADNI Data Set
Thibeau–Sutre, E., Couvy‐Duchesne, B., Dormont, D., Colliot, O., & Burgos, N. (2022) · IEEE International Symposium on Biomedical Imaging (ISBI) · doi:10.1109/isbi52829.2022.9761504 · Cited by 9 · see citing works
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805
Flagged first, then by citations
2 of the 58 references couldn’t be matched to a known paper.
Cited by
Sorted by citations
Li, Y., El Habib Daho, M., Conze, P.-H., Zeghlache, R., Le Boité, H., Tadayoni, R., Cochener, B., Lamard, M., & Quellec, G. (2024) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2024.108635 · Cited by 274 · see citing works
Schouten, D., Nicoletti, G., Dille, B., Chia, C., Vendittelli, P., Schuurmans, M., Litjens, G., & Khalili, N. (2025) · Medical Image Analysis · doi:10.1016/j.media.2025.103621 · Cited by 108 · see citing works
Simon, B. D., Ozyoruk, K. B., Gelikman, D. G., Harmon, S. A., & Türkbey, B. (2024) · Diagnostic and Interventional Radiology · doi:10.4274/dir.2024.242631 · Cited by 73 · see citing works
Multi-scale multimodal deep learning framework for Alzheimer's disease diagnosis
Abdel-Aziz, M. H., Wang, T., Anwaar, W., & Elazab, A. (2024) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2024.109438 · Cited by 71 · see citing works
Comprehensive review of Transformer‐based models in neuroscience, neurology, and psychiatry
Cong, S., Wang, H., Zhou, Y., Wang, Z., Yao, X., & Yang, C. (2024) · Brain‐X · doi:10.1002/brx2.57 · Cited by 70 · see citing works
Transformer’s Role in Brain MRI: A Scoping Review
Hayat, M., & Aramvith, S. (2024) · IEEE Access · doi:10.1109/access.2024.3434714 · Cited by 44 · see citing works
Multimodal mixing convolutional neural network and transformer for Alzheimer’s disease recognition
Chen, J., Wang, Y., Zeb, A., Suzauddola, M., & Wen, Y. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2024.125321 · Cited by 43 · see citing works
Transformers in health: a systematic review on architectures for longitudinal data analysis
Siebra, C., Kurpicz-Briki, M., & Wac, K. (2024) · Artificial Intelligence Review · doi:10.1007/s10462-023-10677-z · Cited by 35 · see citing works
He, M., Zhu, L., & Bai, L. (2024) · Neurocomputing · doi:10.1016/j.neucom.2024.127680 · Cited by 35 · see citing works
Mubonanyikuzo, V., Yan, H., Komolafe, T. E., Zhou, L., Wu, T., & Wang, N. (2024) · Journal of Medical Internet Research · doi:10.2196/62647 · Cited by 35 · see citing works
Tang, C., Xi, M., Sun, J., Wang, S., & Zhang, Y. (2024) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2024.108259 · Cited by 30 · see citing works
Kwak, M. G., Mao, L., Zheng, Z., Su, Y., Lure, F. Y. M., Li, J., & Initiative, A. D. N. (2025) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2025.3556290 · Cited by 31 · see citing works
Comprehensive Systematic Computation on Alzheimer's Disease Classification
Upadhyay, P., Tomar, P., & Yadav, S. P. (2024) · Archives of Computational Methods in Engineering · doi:10.1007/s11831-024-10120-8 · Cited by 27 · see citing works
A Modality-Flexible Framework for Alzheimer's Disease Diagnosis Following Clinical Routine
Zhang, Y., Sun, K., Liu, Y., Xie, F., Guo, Q., & Shen, D. G. (2024) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2024.3472011 · Cited by 23 · see citing works
Weighted Multi-Modal Contrastive Learning Based Hybrid Network for Alzheimer’s Disease Diagnosis
Yu, R., Peng, C., Zhu, J., Chen, M., & Zhang, R. (2025) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2025.3549730 · Cited by 23 · see citing works
Upadhyay, P., Tomar, P., & Yadav, S. P. (2024) · Computers & Electrical Engineering · doi:10.1016/j.compeleceng.2024.109796 · Cited by 21 · see citing works
Yoonesi, S., Azar, R. A., Bafrani, M. A., Yaghmayee, S., Shahavand, H., Mirmazloumi, M., Limoudehi, N. M., Rahmani, M., Hasany, S., Idjadi, F. Z., et al. (2025) · BioMedical Engineering OnLine · doi:10.1186/s12938-025-01396-3 · Cited by 21 · see citing works
Alorf, A. A. (2025) · Mathematics · doi:10.3390/math13101548 · Cited by 20 · see citing works
NeuroNet-AD: A Multimodal Deep Learning Framework for Multiclass Alzheimer’s Disease Diagnosis
Rahman, S., Rahman, M. M., Bhatt, S., Sundararajan, R., & Faezipour, M. (2025) · Bioengineering · doi:10.3390/bioengineering12101107 · Cited by 23 · see citing works
MARIA: A multimodal transformer model for incomplete healthcare data
Caruso, C. M., Soda, P., & Guarrasi, V. (2025) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2025.110843 · Cited by 23 · see citing works
Toward Robust Early Detection of Alzheimer’s Disease via an Integrated Multimodal Learning Approach
Chen, Y., Zhu, S., Fang, Z., Liu, C., Zou, B., Qiu, L., Wang, Y., Chang, S., Jia, F., Qin, F., et al. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10888363 · Cited by 19 · see citing works
Nasrallah, F. A., Bellapart, J., Walsham, J., Jacobson, E., To, X. V., Manzanero, S., Brown, N. J., Meyer, J., Stuart, J., Evans, T., et al. (2023) · BMJ Open · doi:10.1136/bmjopen-2022-067740 · Cited by 18 · see citing works
Self-citationMultiple Inputs and Mixed Data for Alzheimer’s Disease Classification Based on 3D Vision Transformer
Castro-Silva, J. A., Garcı́a, M. N. M., & Peluffo-Ordóñez, D. H. (2024) · Mathematics · doi:10.3390/math12172720 · Cited by 18 · see citing works
Zhu, X., Sun, S., Lin, L., Wu, Y., & Ma, X. (2024) · Reviews in the Neurosciences · doi:10.1515/revneuro-2024-0088 · Cited by 17 · see citing works
Afifi, I., Elgendy, M. A., Abdelfatah, M., & El–Sappagh, S. (2025) · Brain Informatics · doi:10.1186/s40708-025-00286-7 · Cited by 15 · see citing works
Li, Y., Daho, M. E. H., Conze, P.-H., Zeghlache, R., Boité, H. L., Bonnin, S., Cosette, D., Magazzeni, S., Laÿ, B., Guilcher, A. L., et al. (2023) · Diagnostics · doi:10.3390/diagnostics13172770 · Cited by 14 · see citing works
Peng, W., Ma, Y., Li, C., Dai, W., Fu, X., Liu, L., Liu, L., & Liu, J. (2024) · Neural Networks · doi:10.1016/j.neunet.2024.107020 · Cited by 14 · see citing works
Self-citationA comprehensive survey of imputation methods in medical missing data analysis
Benhamza, K., Benselim, R., Naidja, H., & Séridi, H. (2025) · Applied Intelligence · doi:10.1007/s10489-025-06602-2 · Cited by 13 · see citing works
Revolutionizing Alzheimer's Disease Prediction using InceptionV3 in Deep Learning
Jansi, R., Gowtham, N., Ramachandran, S., & Praneeth, V. S. (2023) · International Conference on Electronics, Communication and Aerospace Technology (ICECA) · doi:10.1109/iceca58529.2023.10395534 · Cited by 12 · see citing works
FRAMM: Fair ranking with missing modalities for clinical trial site selection
Theodorou, B., Glass, L. M., Xiao, C., & Sun, J. (2024) · Patterns · doi:10.1016/j.patter.2024.100944 · Cited by 12 · see citing works
Xiong, W., Wang, T., Chen, X., Zhang, Y., Zhang, W., Feng, Q., & Huang, M. (2025) · Pattern Recognition · doi:10.1016/j.patcog.2025.111597 · Cited by 12 · see citing works
Menon, P. A., & Gunasundari, D. R. (2024) · Journal of Internet Services and Information Security · doi:10.58346/jisis.2024.i4.029 · Cited by 10 · see citing works
Chen, C., Zhao, Y., Cai, L., Jiang, H., Teng, Y., Zhang, Y., Zhang, S., Zheng, J., Zhao, F., Huang, Z., et al. (2025) · npj Precision Oncology · doi:10.1038/s41698-025-00811-1 · Cited by 9 · see citing works
Self-citationSathyabhama, B., & Kannan, M. (2025) · Neural Computing and Applications · doi:10.1007/s00521-025-10994-0 · Cited by 8 · see citing works
Unified Multi-modal Learning for Any Modality Combinations in Alzheimer's Disease Diagnosis
Feng, Y., Gao, B., Deng, S., Qiu, A.-Q., & Qin, J. (2024) · International Conference on Medical Image Computing and Computer-Assisted Intervention · doi:10.1007/978-3-031-72384-1_46 · Cited by 8 · see citing works
MMIST-ccRCC: A Real World Medical Dataset for the Development of Multi-Modal Systems
Mota, T., Verdelho, M. R., Araújo, D. J., Bissoto, A. E., Santiago, C., & Barata, C. (2024) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw63382.2024.00246 · Cited by 7 · see citing works
Zhang, Q., Sheng, J., Zhou, R., Zhang, Q., Wang, B., & Zhang, R. (2025) · Scientific Reports · doi:10.1038/s41598-025-03270-7 · Cited by 6 · see citing works
Guo, H., Yang, Z., Zhang, G., Lv, L., & Zhao, X. (2025) · Frontiers in Neurology · doi:10.3389/fneur.2025.1641548 · Cited by 6 · see citing works
Mou, F. S., Ahmed, T., Huda, M. N., & Nandi, A. K. (2026) · Artificial Intelligence Review · doi:10.1007/s10462-025-11484-4 · Cited by 6 · see citing works
Duan, Y., Pang, P. C., He, P., Wang, R., Sun, Y., Liu, C., Zhang, X., Yuan, X.-R., Song, P., Lam, C., et al. (2024) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2024.3445952 · Cited by 6 · see citing works
CoNeS: Conditional neural fields with shift modulation for multi-sequence MRI translation
Chen, Y., Staring, M., Neve, O. M., Romeijn, S. R., Hensen, E. F., Verbist, B. M., Wolterink, J. M., & Tao, Q. (2024) · The Journal of Machine Learning for Biomedical Imaging · doi:10.59275/j.melba.2024-d61g · Cited by 6 · see citing works
Li, Y., Tang, J., Ding, W., Luo, J., Ahmad, N., & Kumar, R. (2024) · Computers, materials & continua/Computers, materials & continua (Print) · doi:10.32604/cmc.2023.046872 · Cited by 5 · see citing works
Alzheimer’s disease classification using hippocampus and improved DenseNet
Liu, B. (2023) · International Conference on Image Processing, Computer Vision and Machine Learning (ICICML) · doi:10.1109/icicml60161.2023.10424926 · Cited by 5 · see citing works
Comparative Evaluation of Transfer Learning Models on Dementia Prediction
Jha, S., Mahajan, A. D., Thenraj, P. G., Karuppasamy, S., & Lakshminarayanan, S. (2022) · International Conference on Electronics, Communication and Aerospace Technology (ICECA) · doi:10.1109/iceca55336.2022.10009570 · Cited by 5 · see citing works
Lashkary, M., Bansal, K., Jain, S., Shukla, P. K., Tekchandani, H., & Dhaka, V. S. (2025) · Procedia Computer Science · doi:10.1016/j.procs.2025.04.278 · Cited by 4 · see citing works
AlzFormer: Video-based space-time attention model for early diagnosis of Alzheimer’s disease
Akan, T., Akan, S., Alp, S., Ledbetter, C. R., & Bhuiyan, M. A. N. (2025) · Neuroscience · doi:10.1016/j.neuroscience.2025.08.062 · Cited by 4 · see citing works
MSFAN: A Multi-scale Feature Attention Network for Alzheimer’s Disease Diagnosis
Zhang, X., Wu, J., Zhang, Y., Li, Y., Liu, J., Liang, Q., & Cui, X. (2024) · IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm62325.2024.10821998 · Cited by 3 · see citing works
Pafitis, M., Constantinou, M., & Christodoulou, C. C. (2024) · IEEE Access · doi:10.1109/access.2024.3487114 · Cited by 2 · see citing works
Xie, X., Huang, L.-Y., Liu, D., Cheng, G., Hu, F., Zhou, J. H., Zhang, J., Han, G., Geng, J.-W., Liu, X.-C., et al. (2024) · American Journal of Geriatric Psychiatry · doi:10.1016/j.jagp.2024.10.016 · Cited by 2 · see citing works
Julaiha, N., & Vasudevan, B. (2025) · Evolutionary Systematics · doi:10.1007/s12530-025-09748-z · Cited by 2 · see citing works
An integrated multi-modal and multi-task learning method for Alzheimer’s disease diagnosis
Song, Y., & Xu, L. (2025) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2025.108811 · Cited by 2 · see citing works
Liu, Y., Xu, Y., Liu, J., Yao, L., Luo, H., & Wang, H. (2025) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2025.109073 · Cited by 2 · see citing works
A survey of multimodal fusion for Alzheimer’s disease prediction: A new taxonomy and trends
Guan, Y., Wang, W., Chen, J., Yang, P., Xu, J., & Qi, J. (2025) · Information Fusion · doi:10.1016/j.inffus.2025.104098 · Cited by 3 · see citing works
Edge-Aware Dual-Branch CNN Architecture for Alzheimer’s Disease Diagnosis
Li, M., Ang, M. C., Albadr, M. A. A., Chaw, J. K., Liu, J., Ng, K. W., & Hong, W. (2026) · Journal of Imaging Informatics in Medicine · doi:10.1007/s10278-025-01836-5 · Cited by 2 · see citing works
Xu, S., Tang, C.-Y., Shi, L., Chen, J., Jia, J., & Qi, J. (2026) · Neurocomputing · doi:10.1016/j.neucom.2026.133697 · Cited by 1 · see citing works
Liu, C., Que, Y., Wong, W. K., Liu, Y., & Luo, X. (2026) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2026.3689332 · Cited by 2 · see citing works
Maaram, K. K., & Chandre, S. (2024) · SN Computer Science · doi:10.1007/s42979-024-03486-w · Cited by 2 · see citing works
Detecting and Diagnosing Alzheimer's Disease: A Transformer-Based Survey (DAD-T)
Selvam, P., Gunasundari, C., Tamilselvi, M., Haneef, P., Suresh, T., & Jini, R. (2024) · International Conference on Mobile Networks and Wireless Communications (ICMNWC) · doi:10.1109/icmnwc63764.2024.10872191 · Cited by 2 · see citing works
Guarnier, G., Reinelt, J. D., Molloy, E. N., Mihai, P. G., Einaliyan, P., Valk, S. L., Modestino, A. E., Ugolini, M., Mueller, K., Wu, Q., et al. (2024) · medRxiv · doi:10.1101/2024.09.23.24314186 · Cited by 2 · see citing works
Alzheimer’s Disease Detection using Transfer Learning
Nehar, A., Bellaouar, S., Benyoub, N., & Aissa, B. (2024) · International Conference on Telecommunications and Intelligent Systems (ICTIS) · doi:10.1109/ictis62692.2024.10894504 · Cited by 1 · see citing works
Maaram, K. K., & Chandre, S. (2025) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2025.107980 · Cited by 1 · see citing works
Jeong, A.-Y., Heo, D.-W., & Suk, H. (2025) · Medical Image Analysis · doi:10.1016/j.media.2025.103914 · Cited by 1 · see citing works
Not Only Grey Matter: OmniBrain for Robust Multimodal Classification of Alzheimer's Disease
Sharshar, A., Ashraf, Y., Bakr, T., Hassan, S., Elgendy, H., Yaqub, M. K., & Guizani, M. (2025) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw69036.2025.00140 · Cited by 2 · see citing works
Islam, M. S., Rahman, M. M. S., & Mahmud, M. (2026) · Lecture notes in computer science · doi:10.1007/978-981-95-9575-4_22 · Cited by 1 · see citing works
Liang, S., Sun, H., Sun, F., Hongjian, W., & Du, W. (2024) · Journal of Intelligent & Fuzzy Systems · doi:10.3233/jifs-236542 · Cited by 1 · see citing works
RetractedЛю, Б., Xiang, H., & Fang, L. (2024) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn60899.2024.10651171 · Cited by 1 · see citing works
Salunkhe, S. P., & Suryawanshi, N. A. (2025) · Research on Biomedical Engineering · doi:10.1007/s42600-024-00394-z · Cited by 1 · see citing works
Saleh, H., McCann, M., Breslin, J. G., & El–Sappagh, S. (2025) · Journal of Advances in Information Technology · doi:10.12720/jait.16.6.854-868 · Cited by 1 · see citing works
kherchouche, A., Ahmed, O. B., Guillevin, C., Julian, A., & Fernández-Maloigne, C. (2023) · doi:10.36227/techrxiv.23633904 · Cited by 1 · see citing works
kherchouche, A., Ahmed, O. B., Guillevin, C., Julian, A., & Fernández-Maloigne, C. (2023) · doi:10.36227/techrxiv.23633904.v1
Sathyabhama, B., & Kannan, M. (2023) · International Conference on Smart Structures and Systems (ICSSS) · doi:10.1109/icsss58085.2023.10407694
A Comprehensive Survey on Classification and Prediction Techniques for Alzheimer’s Disease
Maga Vigna, C., Devi, M. K. K., & Vaira Suganthi, G. (2025) · Recent Research Reviews Journal · doi:10.36548/rrrj.2025.1.005
AD-LDB: A Modality-Incomplete Learning Model for Alzheimer's Disease Diagnosis
Zhao, X., & Wang, J. (2025) · International Conference on Computer Engineering and Application (ICCEA) · doi:10.1109/iccea65460.2025.11103238
Mehmood, W., Sajjad, A., Akmal, M., & Kainat, F. (2025) · IEEE Access · doi:10.1109/access.2025.3601623
Deep Learning Approach for Detection and Classification of Alzheimer’s Disease
Bankar, A. S., Bansod, S. S., Mohod, A. P., & Turuk, M. (2025) · Algorithms for intelligent systems · doi:10.1007/978-981-96-4539-8_28
Multimodal Medical Image Fusion With UNet ‐Based Multi‐Scale Transformer Networks
Fu, Q., Zhou, J., Du, J., Lin, K., Zhong, B., Tang, H., & Chen, Y.-T. (2025) · International Journal of Imaging Systems and Technology · doi:10.1002/ima.70193
Lu, W., Xu, H., Wei, Y., Ye, Z., & Lu, L. (2025) · Lecture notes in computer science · doi:10.1007/978-3-032-04927-8_46
Emerging Trends in Alzheimer’s Disease Classification: Modalities and Methods
Rathod, P., & Degadwala, S. (2025) · Algorithms for intelligent systems · doi:10.1007/978-981-96-5265-5_1
AD-MAE: Contrastive Learning and Masked Autoencoder for Early Alzheimer’s disease classification
Zeng, A., Li, J. C., & Pan, D. (2025) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn64981.2025.11228435
Brain Region-Centered MultiModal Hypergraph Fusion for MCI Conversion Prediction
Dong, Z., Liu, H., Ge, X., Zhang, H., Li, Z., Chen, Y., & Li, W. (2026) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2026.3715131
Kuang, L., & Lim, K. M. (2025) · International Conference on Computer Vision and Data Mining (ICCVDM) · doi:10.1109/iccvdm66874.2025.11290036
Saxer, F., Jansen, G., Bierma-Zeinstra, S. M. A., Holzhauer, B., Demanse, D., Melnick, J., Greetham, D. V., Rall, T., Mesenbrink, P. G., & Schieker, M. (2025) · Osteoarthritis and Cartilage · doi:10.1016/j.joca.2025.12.021
Tabular Data-Enhanced Multi-modal Alignment and Synthesis for Alzheimer’s Disease Diagnosis
Zhou, W., Liu, Y., Zhang, Y., Sun, K., Li, F., Zhao, S., Wang, Y., & Shen, D. G. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-09569-5_36
Yu, M., Yan, Y., Yan, T., Xi, Z., Zeng, J., Huang, T., Xu, M., & Ding, M. (2026) · Expert Systems with Applications · doi:10.1016/j.eswa.2026.131440
Zhang, Q., Yue, Y., Zhang, D., Zhao, K., Wang, A., Xue, B., Liu, Y., & Zong, F. (2026) · Lecture notes in computer science · doi:10.1007/978-981-95-7072-0_38
Madhavi, K. R., Gottimukkala, V. R. R., Pandiri, L., Sriram, H. K., Malempati, M., & Adusupalli, B. (2025) · IEEE Global Conference on Wireless Computing and Networking (GCWCN) · doi:10.1109/gcwcn66157.2025.11448429
Nandamuri, S. K., & Ambethkumar, V. D. (2025) · International Conference on Smart Electronics and Communication (ICOSEC) · doi:10.1109/icosec67334.2025.11459733
Kiani, I., Hajiasadi, E., Torkamani, Z. T., Bagherzadeh, Y., Abbasifar, P., Zare, A. K., Moqadam, A. H. M., Mohammadzadeh, S., Kakadiya, J., Khosravi, B., et al. (2026) · European Journal of Radiology Artificial Intelligence · doi:10.1016/j.ejrai.2026.100094
Dinesh, G., Padmanaban, K., S, R. S., & Lakshmi, T. R. V. (2026) · International Journal of Neuroscience · doi:10.1080/00207454.2026.2683880
Enhanced Hybrid AI-Based Framework for Improving the Detection and Diagnosis of Alzheimer’s Disease
Das, T., Nayak, C. K., & Pattnayak, P. (2026) · Biomedical & Pharmacology Journal · doi:10.13005/bpj/3409
A Multimodal Approach for Alzheimer’s Disease Prediction Using Vision Transformer and CNN Models
Suruthi, S., Usha, P., Satheeskumar, R., Mohana Priya, M., Parthasarathy, S., & Lithika, V. (2026) · International Conference on Innovations in Communication, Geoscience and Robotics (ICICGR) · doi:10.1109/icicgr68236.2026.11599997
Yang, G., Du, Y., Hu, X., Shi, W., Yang, M., & Wang, S. (2026) · Medical Image Analysis · doi:10.1016/j.media.2026.104222
Periyasamy, T. S., Sekar, N., & Lakshmanan, H. (2026) · Journal of Alzheimer s Disease · doi:10.1177/13872877261471812
Alsubaie, M. G., Luo, S., Shaukat, K., & Zhang, W. (2026) · Journal of Imaging Informatics in Medicine · doi:10.1007/s10278-026-02152-2
Ramisetty, S., Angayarkanni, N., Rajkumar, R., Anitha, R., & Srinivas, V. (2026) · International Conference on Distributed Computing and Electrical Circuits and Electronics (ICDCECE) · doi:10.1109/icdcece68961.2026.11645699
Yuen, P. T.-Y., Hui, C. C.-Y., Ngan, O. M. Y., Saberi, D., Lau, K. K., & Chan, E. (2026) · doi:10.2196/preprints.109364
Abu-Alsaad, H. A., Alzubaydi, N. M. H., & Mutashar, H. Q. (2026) · Big Data and Cognitive Computing · doi:10.3390/bdcc10100326
Wang, W., Shi, Y., Cheng, J., & Liu, Y. (2026) · Neural Networks · doi:10.1016/j.neunet.2026.109760
Liu, J., Zhang, G., Wen, J., & Fang, M. (2026) · Machine Learning and Knowledge Extraction · doi:10.3390/make8110345
Challapalli, S. S. A., Bhattarai, K. M., Kamangar, F. A., & Initiative, F. T. A. D. N. (2026) · Journal of Imaging Informatics in Medicine · doi:10.1007/s10278-026-02442-9
- Authors
- Liu, L., Liu, S., Zhang, L., To, X. V., Nasrallah, F., & Chandra, S. S.
- Affiliations
- The University of Queensland (AU)
- Corresponding author
- Liu, Linfeng
- Venue
- NeuroImage
- Publisher
- Elsevier BV
- Published
- 2023-08
- Volume
- 277
- Pages
- 120267
- ISSN
- 1053-8119 (ISSN-L)
- OpenAlex
- W4383315874
- Cited by
- 101
- References
- 58
- Citations by year
- 2026: 23 · 2025: 38 · 2024: 32 · 2023: 7 · 2022: 1
- FWCI
- 20.27
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- NeuroImage (publishedVersion, cc-by-nc-nd)
- PubMed (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- arXiv (Cornell University)
- Funders
- U.S. Department of Defense (U01 AG024904, W81XWH, W81XWH-12-2-, W81XWH-12, AG024904)
- Alzheimer's Association (U01 AG024904, W81XWH-12-2-0012)
- Bristol-Myers Squibb (U01 AG024904, AG024904, W81XWH-12-2-0012)
- Eli Lilly and Company (U01 AG024904, AG024904, W81XWH-12-2-0012)
- Pfizer (AG024904, W81XWH-12-2-0012, U01 AG024904)
- Biogen (W81XWH-12-2-0012, U01 AG024904, AG024904)
- University of Southern California (W81XWH-12-2-0012, U01 AG024904)
- F. Hoffmann-La Roche (W81XWH-12-2-0012, AG024904, U01 AG024904)
- Meso Scale Diagnostics (U01 AG024904, AG024904, W81XWH-12-2-0012)
- Alzheimer's Disease Neuroimaging Initiative (W81XWH-12-2–0012, U01AG024904, AG024904, W81XWH-12-2-)
- BioClinica (U01 AG024904, W81XWH-12-2-0012, AG024904)
- Novartis Pharmaceuticals Corporation (W81XWH-12-2-0012, U01 AG024904, AG024904)
- Northern California Institute for Research and Education (U01 AG024904, W81XWH-12-2-0012)
- Queensland Government (2014000857)
- Eisai (W81XWH-12-2-0012, U01 AG024904, AG024904)
- Servier (AG024904, W81XWH-12-2-0012, U01 AG024904)
- H. Lundbeck A/S (U01 AG024904, AG024904, W81XWH-12-2-0012)
- Motor Accident Insurance Commission (2014000857, AG024904)
- National Institutes of Health (5u01ag024904-10, W81XWH, W81XWH-12-2-0012)
- Genentech (W81XWH-12-2-0012, AG024904, U01 AG024904)
- Canadian Institutes of Health Research (U01 AG024904, W81XWH-12-2-0012)
- National Institute on Aging (U01-AG-024904)
- Topics
- Health Sciences › Medicine › Psychiatry and Mental health › Dementia and Cognitive Impairment Research
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning in Healthcare
- Keywords
- Alzheimer's disease classification, multimodal fusion, missing data, modality dropout, cross-attention, neuroimaging data, clinical data, ADNI, AIBL
- MeSH terms
- Alzheimer Disease, Australia, Humans, Magnetic Resonance Imaging, Biomarkers, Neuroimaging, Cognitive Dysfunction
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
