Multimodal attention-based deep learning for Alzheimer’s disease diagnosis
Open accessThe DOI matches its Crossref record; 34 of the 34 references it cites were found in a registry or an index.
Abstract
Objective: Alzheimer’s disease (AD) is the most common neurodegenerative disorder with one of the most complex pathogeneses, making effective and clinically actionable decision support difficult. The objective of this study was to develop a novel multimodal deep learning framework to aid medical professionals in AD diagnosis. Materials and Methods: We present a Multimodal Alzheimer’s Disease Diagnosis framework (MADDi) to accurately detect the presence of AD and mild cognitive impairment (MCI) from imaging, genetic, and clinical data. MADDi is novel in that we use cross-modal attention, which captures interactions between modalities—a method not previously explored in this domain. We perform multi-class classification, a challenging task considering the strong similarities between MCI and AD. We compare with previous state-of-the-art models, evaluate the importance of attention, and examine the contribution of each modality to the model’s performance. Results: MADDi classifies MCI, AD, and controls with 96.88% accuracy on a held-out test set. When examining the contribution of different attention schemes, we found that the combination of cross-modal attention with self-attention performed the best, and no attention layers in the model performed the worst, with a 7.9% difference in F1-scores. Discussion: Our experiments underlined the importance of structured clinical data to help machine learning models contextualize and interpret the remaining modalities. Extensive ablation studies showed that any multimodal mixture of input features without access to structured clinical information suffered marked performance losses. Conclusion: This study demonstrates the merit of combining multiple input modalities via cross-modal attention to deliver highly accurate AD diagnostic decision support.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source doesn’t support the claim as written.
In the citing paper
“such as Golovanevsky et al. (2022), who reported a 27.2 percentage point (from 0.583 to 0.855) accuracy increase over unimodal”
From Navigating the landscape of multimodal AI in medicine: A scoping review on technical challenges and clinical applications (2025) · cites this paper as Golovanevsky et al. (2022)
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“| Golovanevsky et al. [89] | imaging, genetic, and clinical data | Gene-based | GEO | 0.9688 (ACC) |”
From A Comprehensive Review on Synergy of Multi-Modal Data and AI Technologies in Medical Diagnosis (2024) · cites this paper as [89]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The MADDi cross-modal attention network exemplifies this paradigm by linking structural MRI, genome-wide SNP profiles, and longitudinal clinical data. Its attention maps demonstrate that hippocampal thinning amplifies the effect of inflammation-related SNP clusters on memory decline, suggesting an immune-mediated feedback mechanism266.”
From Artificial intelligence-driven multi-omics approaches in Alzheimer's disease: Progress, challenges, and future directions (2025) · cites this paper as [266]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404 · cited 2×
“We compute the dot products of the query with all keys, divide each by the square root of d k , and apply a Softmax function, which converts a vector of numbers into a vector of probabilities, to obtain the weights on the values: Following the success of the Transformer [26], we use the multi-head attention module, wh…”
MethodExploiting Generative AI to Scale up Intelligent Tutoring Systems
Jakubův, J., Chvalovský, K., Goertzel, Z., Kaliszyk, C., Olšák, M., Piotrowski, B., Schulz, S., Suda, M., & Urban, J. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.itp.2023.19 · Cited by 76,658
Dermatologist-level classification of skin cancer with deep neural networks
Esteva, A., Kuprel, B., Novoa, R. A., Ko, J., Swetter, S. M., Blau, H. M., & Thrun, S. (2017) · Nature · doi:10.1038/nature21056 · Cited by 14,362
2013 Alzheimer's disease facts and figures
Alzheimer's Association, Thies, W., & Bleiler, L. (2013) · Alzheimer's & Dementia · doi:10.1016/j.jalz.2013.02.003 · Cited by 3,328
(2011) · Cited by 2,752
LXMERT: Learning Cross-Modality Encoder Representations from Transformers
Tan, H., & Bansal, M. (2019) · Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · doi:10.18653/v1/d19-1514 · Cited by 2,319 · cited 4×
“Cross-modal attention: In each bi-directional cross-modal attention layer [22], there are two unidirectional cross-modal attention sub-layers: one from modality 1 to modality 2 and one from modality 2 to modality 1.”
BackgroundMethodInfluentialAPI design for machine learning software: experiences from the scikit-learn project
Buitinck, L., Louppe, G., Blondel, M., Pedregosa, F., Mueller, A., Grisel, O., Niculae, V., Prettenhofer, P., Gramfort, A., Grobler, J., et al. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1309.0238 · Cited by 1,871
Mueller, S. G., Weiner, M. W., Thal, L. J., Petersen, R. C., Jack, C. R., Jagust, W., Trojanowski, J. Q., Toga, A. W., & Beckett, L. (2005) · Alzheimer's & Dementia · doi:10.1016/j.jalz.2005.06.003 · Cited by 1,233 · cited 2×
“Many successful studies were conducted using the ADNI dataset [5].”
BackgroundMethodPetersen, R. C. (2016) · Continuum · doi:10.1212/con.0000000000000313 · Cited by 909
Multimodal deep learning for biomedical data fusion: a review
Stahlschmidt, S. R., Ulfenborg, B., & Synnergren, J. (2022) · Briefings in Bioinformatics · doi:10.1093/bib/bbab569 · Cited by 766 · cited 1×
“Even with DL’s advantage, single-modality input is often insufficient to support clinical decision-making [16].”
Background
Cited by
A Comprehensive Review on Synergy of Multi-Modal Data and AI Technologies in Medical Diagnosis
Xu, X., Li, J., Zhu, Z., Zhao, L., Wang, H., Song, C., Chen, Y., Zhao, Q., Yang, J., & Pei, Y. (2024) · Bioengineering · doi:10.3390/bioengineering11030219 · Cited by 242
Multi-modality approaches for medical support systems: A systematic review of the last decade
Salvi, M., Loh, H. W., Seoni, S., Barua, P. D., García, S., Molinari, F., & Acharya, U. R. (2024) · Information Fusion · doi:10.1016/j.inffus.2023.102134 · Cited by 144
“In recent years, there has been a prevalence of DL use and more sophisticated data fusion techniques like graph neural network [29], cross-modal attention [36], and dynamic fusion strategy [61].”
BackgroundSchouten, D., Nicoletti, G., Dille, B., Chia, C., Vendittelli, P., Schuurmans, M., Litjens, G., & Khalili, N. (2025) · Medical Image Analysis · doi:10.1016/j.media.2025.103621 · Cited by 162
Teoh, J. R., Dong, J., Zuo, X., Lai, K. W., Hasikin, K. B., & Wu, X. (2024) · PeerJ Computer Science · doi:10.7717/peerj-cs.2298 · Cited by 139
Ren, F., Wei, J., Chen, Q., Hu, M., Yu, L., Mi, J., Zhou, X., Qin, D., Wu, J., & Wu, A. (2025) · Acta Pharmaceutica Sinica B · doi:10.1016/j.apsb.2025.07.030 · Cited by 97
A transformer-based unified multimodal framework for Alzheimer's disease assessment
Yu, Q., Ma, Q., Da, L., Li, J., Wang, M., Xu, A., Li, Z., & Li, W. (2024) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2024.108979 · Cited by 111
Nazir, A., Hussain, A. B., Singh, M., & Assad, A. (2024) · Multimedia Tools and Applications · doi:10.1007/s11042-024-19694-8 · Cited by 113
Toumaj, S., Heidari, A., Shahhosseini, R., & Navimipour, N. J. (2024) · Artificial Intelligence Review · doi:10.1007/s10462-024-11041-5 · Cited by 83
Multimodal risk prediction with physiological signals, medical images and clinical notes
Wang, Y., Yin, C., & Zhang, P. (2024) · Heliyon · doi:10.1016/j.heliyon.2024.e26772 · Cited by 66
“Golovanevsky et al. [20] incorporated clinical test scores, genetic information (SNPs), and MRI scan images for Alzheimer’s disease diagnosis.”
BackgroundTang, C., Wei, M., Sun, J., Wang, S., & Zhang, Y. (2023) · Journal of King Saud University - Computer and Information Sciences · doi:10.1016/j.jksuci.2023.101618 · Cited by 54
Sun, K., Xue, S., Sun, F., Sun, H., Luo, Y., Wang, L., Wang, S., Guo, N., Liu, L., Zhao, T., et al. (2025) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2025.103265 · Cited by 86
A Comprehensive Review of Multimodal Deep Learning for Enhanced Medical Diagnostics
Al‐Zoghby, A. M., Ebada, A. I., Saleh, A. S., Abdelhay, M., & Awad, W. A. (2025) · Computers, materials & continua/Computers, materials & continua (Print) · doi:10.32604/cmc.2025.065571 · Cited by 87
Multimodal mixing convolutional neural network and transformer for Alzheimer’s disease recognition
Chen, J., Wang, Y., Zeb, A., Suzauddola, M., & Wen, Y. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2024.125321 · Cited by 51
Ardic, N., & Dinc, R. (2025) · Health Informatics Journal · doi:10.1177/14604582251366141 · Cited by 32
“15 The working mechanism of MMAI models is based on the ability to combine data from various modalities, such as text, image, video, and audio.”
The Application of Artificial Intelligence in Alzheimer's Research
Zhao, Q., Xu, H., Li, J., Akhtar, F., & Qiao, L. (2023) · Tsinghua Science & Technology · doi:10.26599/tst.2023.9010037 · Cited by 42
A review on the new age methodologies for early detection of Alzheimer's and Parkinson's disease
Ghosh, N., Sinha, K., & Sil, P. C. (2024) · Basic & Clinical Pharmacology & Toxicology · doi:10.1111/bcpt.14003 · Cited by 31
Tang, C., Xi, M., Sun, J., Wang, S., & Zhang, Y. (2024) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2024.108259 · Cited by 36
“It includes feature fusion-based methods [16,30,31,52], image fusion-based methods [35, 37], data generation-based methods [26,53], and cross-modal inter-action-based methods [43,45].”
Classification of Alzheimer disease using DenseNet-201 based on deep transfer learning technique
Zia-ur-Rehman, Awang, M. K., Rashid, J., Ali, G., Hamid, M., Mahmoud, S. F., Saleh, D. I., & Ahmad, H. I. (2024) · PLoS ONE · doi:10.1371/journal.pone.0304995 · Cited by 50
Chaitanuwong, P., Singhanetr, P., Chainakul, M., Arjkongharn, N., Ruamviboonsuk, P., & Grzybowski, A. E. (2023) · Neurology and Therapy · doi:10.1007/s40120-023-00526-0 · Cited by 35
“MRI-based DL [79, 80, 84, 86], PET-based DL [91] and computing models [99] can differentiate between MCI associated with AD and normal controls, with accuracies ranging from 71.4% to 99.6% and an AUC ranging from 62.45% to 62.59%.”
BackgroundInfluentialPoor, F. F., Dodge, H. H., & Mahoor, M. H. (2024) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2024.109199 · Cited by 38
Battineni, G., Chintalapudi, N., & Amenta, F. (2024) · JMIR Aging · doi:10.2196/59370 · Cited by 31
“The K-fold has been used in most studies with varying values of K including 3 [74], 5 [61,72,75], 10 [52,53,55-60,62-64,69,71,72], 15 [54], and 100 [67], indicating that the total partitioning of data varies depending on the level of validation.”
Multimodal Contrastive Learning and Tabular Attention for Automated Alzheimer’s Disease Prediction
Huang, W. (2023) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw60793.2023.00261 · Cited by 53
“In the realm of multimodal data analysis, several studies have focused on the ADNI dataset, including [21], which introduces a cross-modal attention-based solution.”
BackgroundDai, Y., Zou, B., Zhu, C., Li, Y., Chen, Z., Ji, Z., Kui, X., & Zhang, W. (2023) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2023.107396 · Cited by 27
Weighted Multi-Modal Contrastive Learning Based Hybrid Network for Alzheimer’s Disease Diagnosis
Yu, R., Peng, C., Zhu, J., Chen, M., & Zhang, R. (2025) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2025.3549730 · Cited by 29
“Golovanevsky et al. [17] proposed a cross-modal attention mechanism to capture the interactions from imaging, genetic and clinical data.”
Chen, D., & Zhang, R. (2023) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2023.3291503 · Cited by 33
Deep joint learning diagnosis of Alzheimer’s disease based on multimodal feature fusion
Wang, J., Wen, S., Liu, W., Meng, X., & Jiao, Z. (2024) · BioData Mining · doi:10.1186/s13040-024-00395-9 · Cited by 26
“Despite advances in extensive research and clinical practice, less than 50% of AD patients are accurately diagnosed via clinical symptoms alone [6].”
Integrating language into medical visual recognition and reasoning: A survey
Lu, Y., & Wang, A. (2025) · Medical Image Analysis · doi:10.1016/j.media.2025.103514 · Cited by 48
NeuroNet-AD: A Multimodal Deep Learning Framework for Multiclass Alzheimer’s Disease Diagnosis
Rahman, S., Rahman, M. M., Bhatt, S., Sundararajan, R., & Faezipour, M. (2025) · Bioengineering · doi:10.3390/bioengineering12101107 · Cited by 25
“Golovanevsky et al. (2022) [42] presented an attention-based multimodal Alzheimer’s disease diagnosis (MADDi) model to detect AD and MCI through the integration of imaging, genetic, and clinical data and achieved an accuracy of 96.88% on the ADNI dataset.”
InfluentialPrinciples of artificial intelligence in radiooncology
Huang, Y., Gomaa, A., Höfler, D., Schubert, P., Gaipl, U. S., Frey, B., Fietkau, R., Bert, C., & Putz, F. (2024) · Strahlentherapie und Onkologie · doi:10.1007/s00066-024-02272-0 · Cited by 22
Liang, H., Luo, H., Sang, Z., Jia, M., Jiang, X., Wang, Z., Yao, X., & Cong, S. (2024) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2024.3439713 · Cited by 27
“Artificial neural networks have been employed to tackle the problem of efficiently learning low-dimensional representations from high-dimensional omics data [12], [13], [14] (e.g., autoen-coder [15], [16], variational autoencoder [17], generative adversarial networks (GAN) [18], [19], and graph…”
MethodRahman, J. U., Hanif, M. I., Rehman, O. U., Haider, U., Qaisar, S. M., & Pławiak, P. (2025) · Scientific Reports · doi:10.1038/s41598-025-93560-x · Cited by 21
“The mechanism has recently been used to detect AD from MRI modalities because MRI scans provide highly detailed and spatially complex information about the brain 13–15 .”
Multimodal deep learning-based diagnostic model for BPPV
Lu, H., Mao, Y., Li, J., & Zhu, L. (2024) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-024-02438-x · Cited by 22
“Cross-atten-tion, on the other hand, demonstrates a superior ability to interactively fuse multimodal feature information in visual language models [31], with its promising performance in medical diagnoses such as Alzheimer’s disease and other illnesses [8].”
BackgroundArtificial General Intelligence for the Detection of Neurodegenerative Disorders
Qadri, Y. A., Ahmad, K., & Kim, S. W. (2024) · Sensors · doi:10.3390/s24206658 · Cited by 22
“A multi-modal attention-based system for the detection of AD was proposed in [67].”
BackgroundPredicting cognitive decline: Deep-learning reveals subtle brain changes in pre-MCI stage
Yue, L., Pan, Y., Li, W., Mao, J., Hong, B. Y., Gu, Z., Liu, M., Shen, D. G., & Xiao, S. (2025) · The Journal of Prevention of Alzheimer s Disease · doi:10.1016/j.tjpad.2025.100079 · Cited by 23
“Moreover, these algorithms can also be used to predict which individuals are at greater risk of developing MCI [ 9 , 10 ] or progressing from MCI to dementia [ 11–13 ].”
Peng, W., Ma, Y., Li, C., Dai, W., Fu, X., Liu, L., Liu, L., & Liu, J. (2024) · Neural Networks · doi:10.1016/j.neunet.2024.107020 · Cited by 14
FlexCare: Leveraging Cross-Task Synergy for Flexible Multimodal Healthcare Prediction
Xu, M., Zhu, Z., Li, Y., Zheng, S., Zhao, Y., He, K., & Zhao, Y. (2024) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3637528.3671974 · Cited by 26
Fan, F., Song, H., Jiang, J. C., He, H., Sun, D. B., Xu, Z., Peng, S., Zhang, R., Li, T., Cao, J., et al. (2024) · iScience · doi:10.1016/j.isci.2024.110945 · Cited by 14
A deep learning model to predict glioma recurrence using integrated genomic and clinical data
Patricoski, J., Nagpal, S., Singh, R., Warner, J. L., & Uzun, E. D. G. (2025) · Communications Medicine · doi:10.1038/s43856-025-01083-3 · Cited by 15
“The model was tested on two independent patient datasets and outperformed traditional prediction methods indicating its potential to enhance care and treatment planning for patients with glioma.”
Self-citationThiery, O., Rizkallah, M., Bailly, C., Bodet‐Milin, C., Itti, E., Casasnovas, O., Gouill, S. L., Carlier, T., & Mateus, D. (2024) · Computerized Medical Imaging and Graphics · doi:10.1016/j.compmedimag.2024.102481 · Cited by 11
Lee, G.-B., Jeong, Y.-J., Kang, D., Yun, H.-J., & Yoon, M. (2024) · PLoS ONE · doi:10.1371/journal.pone.0315809 · Cited by 10
Affect and Personality Aided Modeling of Transcribed Speech for Depression Severity Estimation
Gönç, K., & Dibeklioğlu, H. (2025) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2025.3560476 · Cited by 9
“Pair-wise cross-attention in both directions, often termed bidirectional cross-attention, captures dependencies between feature sets, as seen in works fusing visual, auditory, and text data for applications like affect recognition and diagnosis [44], [45], [46], [47], [48], [49].”
Enhancing the reliability of Alzheimer's disease prediction in MRI images
Islam, J., Furqon, E. N., Farady, I., Alex, J. S. R., Shih, C., Kuo, C.-C., & Lin, C. (2025) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2025.111111 · Cited by 12
Sangnark, S., Rattanachaisit, P., Patcharatrakul, T., & Vateekul, P. (2024) · IEEE Access · doi:10.1109/access.2024.3409077 · Cited by 8
Advancing Forex prediction through multimodal text-driven model and attention mechanisms
Dakalbab, F. M., Kumar, A., Talib, M. W. A., & Nasir, Q. (2025) · Intelligent Systems with Applications · doi:10.1016/j.iswa.2025.200518 · Cited by 8
Cross‐Dataset Evaluation of Dementia Longitudinal Progression Prediction Models
Zhang, C., An, L., Wulan, N., Nguyen, K., Orbán, C., Chen, P., Chen, C., Zhou, J. H., Liu, K., Yeo, B. T. T., et al. (2025) · Human Brain Mapping · doi:10.1002/hbm.70280 · Cited by 12
TGFN-SD: A text-guided multimodal fusion network for swine disease diagnosis
Yang, G., Li, Q., Zhao, C., Wang, C., Yan, H., Meng, R., Liu, Y., & Yu, L. (2025) · Artificial Intelligence in Agriculture · doi:10.1016/j.aiia.2025.03.002 · Cited by 16
Yoon, H., Ahn, J. H., Kim, B. Y., Lee, H., Jo, W.-Y., Yoon, S., Park, H., & Lee, H. (2025) · International Journal of Surgery · doi:10.1097/js9.0000000000003143 · Cited by 12
Mostaghimi, H., Cohen, D. A., Okhravi, H. R., Niknejad, B., & Audette, M. A. (2025) · Archives of Gerontology and Geriatrics Plus · doi:10.1016/j.aggp.2025.100207 · Cited by 7
Multimodal attention-based deep learning for automatic modulation classification
Han, J., Yu, Z., & Yang, J. K. (2022) · Frontiers in Energy Research · doi:10.3389/fenrg.2022.1041862 · Cited by 11
“There are four common likelihood functions: maximum likelihood (ML) (Wen and Mendel, 2000), average likelihood ratio test (ALRT) (Huan and Polydoros, 1995; Hong and Ho, 2003), generalized likelihood ratio test (GLRT) (Panagiotou et al., 2000) and hybrid likelihood ratio test (HLRT) (Hong et al., 2001). Due to the high…”
BackgroundMethodInfluentialKumar, S., Yu, S., Michelson, A. P., Kannampallil, T., & Payne, P. (2024) · JAMIA Open · doi:10.1093/jamiaopen/ooae087 · Cited by 12
Sarma, M., & Chatterjee, S. (2024) · Diagnostics · doi:10.3390/diagnostics14232640 · Cited by 11
“[15].”
Alzheimer’s disease classification based on multimodal consistent distribution and trusted fusion
Kui, X., Dai, Y., Zou, B., Zhu, C., Li, Y., Ji, Z., Chen, L., & López, M. B. (2025) · Neural Networks · doi:10.1016/j.neunet.2025.108245 · Cited by 11
Raza, W. H., Shah, A. B., Wen, Y., Shen, Y., Lemus, J. D. L., Schiess, M. C., Ellmore, T. M., Hu, R., & Fu, X. (2025) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc58623.2025.11254303 · Cited by 9
“While DL and end-to-end models have improved automated feature learning, they still struggle with integrating diverse data modalities, such as MRI and clinical features, due to their differing scales and information content [13], [14], [15].”
Zhou, W., Wang, Y., Yz, W., Li, X., Liu, H., Wang, H., Zhang, Z., & Huang, H. (2026) · Digital Health · doi:10.1177/20552076251412649 · Cited by 13
“In the fi eld of AD diagnosis, studies 63,69,71,73,74,94,96,101,110,117,119,122,128,129,133,137,146,147 adopted comprehensive approaches that combined multiple data sources and fusion strategies.”
InfluentialMultimodal Classification of Cognitive States in Alzheimer's Disease
Hemant, M. S., Jagadabhi, S. R., Vidapu, B., & Srinivasa, K. G. (2023) · IEEE Region 10 Conference (TENCON) · doi:10.1109/tencon58879.2023.10322497 · Cited by 6
“[6] The best results were obtained when using all three modalities together, as measured by various evaluation metrics.”
BackgroundMethodInfluentialMostafaei, S. H., Tanha, J., & Sharafkhaneh, A. (2025) · Applied Intelligence · doi:10.1007/s10489-025-06484-4 · Cited by 6
Udayakumar, P., & Subhashini, R. (2025) · Results in Engineering · doi:10.1016/j.rineng.2025.105200 · Cited by 11
Wang, D., Shi, Y., Pang, J., Zhu, X., Meng, L., & Ming, D. (2026) · npj Parkinson s Disease · doi:10.1038/s41531-026-01258-2 · Cited by 7
Improved Alzheimer’s Disease Detection with Dynamic Attention Guided Multi-modal Fusion
Basu, A., Raha, S., Gupta, A., & Das, S. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-78195-7_29 · Cited by 5
Locally similar multi-hop fusion GNNs with data augmentation for early Alzheimer’s detection
Li, G., Zhang, Y., Song, X., Yang, P., Dong, L., Huang, Y., Xiao, X., Wang, T., Wang, S., & Lei, B. (2025) · Expert Systems with Applications · doi:10.1016/j.eswa.2025.128333 · Cited by 7
Application of Computer Vision and Deep Learning Neural Network in Multi-Modal Information Fusion
Wu, Q., Xie, Q., & Xia, D. (2024) · International Conference on Data Science and Network Security (ICDSNS) · doi:10.1109/icdsns62112.2024.10691099 · Cited by 5
“Because artificial neurons possess self-organization, self-replication, and distributed storage functions in multiple modalities, they can well complete complex tasks, including mapping and connections from linear to high-dimensional patterns [13-14].”
BackgroundEarly Diagnosis of Alzheimer’s Disease Based on Multimodal Hypergraph Attention Network
Li, Y., Yang, B., Pan, D., Zeng, A., Wu, L., & Yang, Y. (2023) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme55011.2023.00041 · Cited by 8
“We follow the author’s settings and use MRI and morphological modality in the method of MADDi.”
MethodInfluentialNeffati, S., Filali, A., Mekki, K., & Bouzrara, K. (2025) · Technologies · doi:10.3390/technologies13060258 · Cited by 4
Multimodal graph fusion-based GCN for Alzheimer’s disease diagnosis using fMRI and T1-weighted MRI
Wang, G., Li, T., Sun, Q., Peng, H., Ren, T., Fu, Y., Yao, Z., & Hu, B. (2026) · Neural Networks · doi:10.1016/j.neunet.2026.108748 · Cited by 7
Wang, Y., & Lam, H. (2025) · Information Fusion · doi:10.1016/j.inffus.2025.103170 · Cited by 4
Alhassan, A. M., & Altmami, N. I. (2025) · Ain Shams Engineering Journal · doi:10.1016/j.asej.2025.103610 · Cited by 4
Integrating Genetic Information for Early Alzheimer’s Diagnosis through MRI Interpretation
Lee, S., Lee, J.-Y., Lee, M., Choi, J.-T., Kang, K., & Kim, Y. (2023) · IEEE-EMBS International Conference on Biomedical and Health Informatics (BHI ...) · doi:10.1109/bhi58575.2023.10313442 · Cited by 5
“Golovanevsky et al. [10] connected to genetic, MRI, and clinical data using cross-modal attention.”
BackgroundMNA-net: Multimodal Neuroimaging Attention-Based Architecture for Cognitive Decline Prediction
Vo, J., Sharif, N., & Hassan, G. M. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-74561-4_8 · Cited by 5
Multimodal Event Classification for Social Media Based on Text-Image-Caption Assisted Alignment
Wang, Y. (2024) · IEEE Access · doi:10.1109/access.2024.3496001 · Cited by 5
The future of Alzheimer’s disease risk prediction: a systematic review
Nazir, S. (2025) · Neurological Sciences · doi:10.1007/s10072-025-08167-x · Cited by 6
Yang, S., Lan, Q., Zhang, L., Zhang, K., Tang, G., Huang, H., Liang, P. Y., Miao, J., Zhang, B., Tan, R., et al. (2025) · Neural Networks · doi:10.1016/j.neunet.2025.107209 · Cited by 4
Wu, K., Wang, H., Feng, F., Liu, T., & Sun, Y. (2025) · Neural Networks · doi:10.1016/j.neunet.2025.107203 · Cited by 6
Explainable AI predicting Alzheimer’s disease with latent multimodal deep neural networks
Chen, X., Thompson, J. A., Yao, Z., Cappelleri, J. C., Amponsah, J. K., Mukherjee, R., & Hu, J. (2025) · Journal of Biopharmaceutical Statistics · doi:10.1080/10543406.2025.2511194 · Cited by 4
A hybrid attention-based deep learning framework for precise early diagnosis of Alzheimer’s disease
Akindele, R. G., Cen, S., Yu, M., Aribilola, I., Xinrang, T., & Liu, Y. (2025) · Discover Applied Sciences · doi:10.1007/s42452-025-07492-2 · Cited by 5
“A method was proposed by [40] for detecting Alzheimer's disease and moderate cognitive impairment using imaging, genetic, and clinical data.”
Omran, S. P., Raji, M. A., Sharifi, F., & Malek, Z. (2025) · InfoScience Trends · doi:10.61882/ist.202502.08.03 · Cited by 6
Yin, L., Ye, C., Liu, T., Wu, J., & Yan, T. (2025) · Lecture notes in computer science · doi:10.1007/978-3-032-05182-0_62 · Cited by 3
Hu, T., Mousavirad, S. J., Afsharizadeh, M., & O’Nils, M. (2026) · International Journal of Computational Intelligence Systems · doi:10.1007/s44196-025-01115-9 · Cited by 8
“A particularly strong example is the work by Golovanevsky et al. (2022) [92], which combined MRI, genotyping data (e.g., APOE status), and various cognitive assessments within a cross-modal attention network for AD classification.”
Anandarao, S., Devarakonda, N., Kamarajugadda, R., & Sekhar, K. R. (2026) · Knowledge-Based Systems · doi:10.1016/j.knosys.2026.116058 · Cited by 3
MVKTrans: Multi-View Knowledge Transfer for Robust Multiomics Classification
Cong, S., Sang, Z., Liu, H., Luo, H., Wang, X., Liang, H., Hao, J., & Yao, X. (2024) · IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm62325.2024.10822642 · Cited by 5
“Recent strategies are developed to harness omics correlation in either intermediate or late fusion stages, demonstrating superior efficacy compared to simple concatenation [13], [17], [18].”
Comprehensive Review of Multimodal Techniques for Neurodegenerative Disease Diagnosis
Alouani, Z., Beriich, M., Saleh, S., Ouhmida, A., Cherradi, B., & Bouattane, O. (2025) · International Conference on Innovative Research in Applied Science, Engineering and Technology (IRASET) · doi:10.1109/iraset64571.2025.11008353 · Cited by 3
“A novel multimodal deep learning framework for AD diagnosis has been proposed in paper [55] by combining imaging, genetic, and clinical data.”
Zedda, L., Loddo, A., & Ruberto, C. D. (2025) · Neurocomputing · doi:10.1016/j.neucom.2025.131192 · Cited by 5
AI-enabled decision support: The convergence of technology and decision science
Browne, D. S., Chu, L., Burton, M., & Liao, J. M. (2025) · Healthcare · doi:10.1016/j.hjdsi.2025.100757 · Cited by 3
Baktash, A. Q., Sarbaz, Y., Meshgini, S., & Afrouzian, R. (2025) · IEEE Access · doi:10.1109/access.2025.3588801 · Cited by 2
“Golovanevsky et al. [14] attempted to study the influence of combining two types of attention mechanisms.”
Modi, D., & Mahajan, S. (2025) · International Journal of Computational and Experimental Science and Engineering · doi:10.22399/ijcesen.3672 · Cited by 2
Deep association analysis framework with multi-modal attention fusion for brain imaging genetics
Wang, S.-Q., Jiao, C.-N., Gao, Y.-L., Cui, X., Wang, Y., & Liu, J. (2025) · Medical Image Analysis · doi:10.1016/j.media.2025.103827 · Cited by 7
A survey of multimodal fusion for Alzheimer’s disease prediction: A new taxonomy and trends
Guan, Y., Wang, W., Chen, J., Yang, P., Xu, J., & Qi, J. (2025) · Information Fusion · doi:10.1016/j.inffus.2025.104098 · Cited by 6
MMFN : A novel multi-view multimodal fusion network for pediatric intestinal obstruction recognition
Yuan, J., Zhao, J., Wang, R., Zhao, L., Wu, F., & Kang, Q. (2026) · Information Fusion · doi:10.1016/j.inffus.2026.104223 · Cited by 2
Chaieb, M., Ameur, N. B., Ghazouani, H., & Jaghdam, I. H. (2026) · Expert Systems with Applications · doi:10.1016/j.eswa.2026.133541 · Cited by 4
Deenadayalan, T., & Shantharajah, S. P. (2026) · Frontiers in Aging Neuroscience · doi:10.3389/fnagi.2026.1835340 · Cited by 3
Dai, Y., Zou, B., Kui, X., Li, Q., Zhao, W., Liu, J., & López, M. B. (2024) · IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm62325.2024.10822481 · Cited by 3
“…0.9620 0.9520 0.9506 0.9504 CLIP ViT-B/16 [4] 0.9606 0.9683 0.9586 0.9506 0.9542 BERT-Base-cased [23] 0.9588 0.9651 0.9561 0.9506 0.9524 MADDi [24] 0.9320 0.9179 0.8988 0.9505 0.9239 PANIC [25] 0.7204 0.7722 0.7092 0.6535 0.6663 the proposed method 0.9660 0.9715 0.9630 0.9588 0.9606 [19]…”
InfluentialBasu, A., Gupta, A., Das, S., & Shamsolmoali, P. (2025) · Procedia Computer Science · doi:10.1016/j.procs.2025.07.130 · Cited by 2
Chen, W., Xu, S., Peng, Y., Zhang, H., Zhang, J., Zheng, H., Yan, H., & Chen, Z. (2025) · Frontiers in Neurology · doi:10.3389/fneur.2025.1630838 · Cited by 1
Park, S., Lee, D. A., Kim, J., Kim, D., Nam, Y., Park, B., Kim, N., Lee, S., Hong, C. H., Son, S. J., et al. (2025) · Neural Networks · doi:10.1016/j.neunet.2025.107971 · Cited by 5
Li, T., Li, K., Zhao, Z., Sun, Q., Zhang, X., Yao, Z., Zhou, J., & Hu, B. (2025) · Neural Networks · doi:10.1016/j.neunet.2025.108151 · Cited by 2
Patient Diagnosis Alzheimer’s Disease with Multi-Stage Features Fusion Network and Structural MRI
Nguyen, T. M. T., & Bui, N. (2025) · Journal of Dementia and Alzheimer's Disease · doi:10.3390/jdad2040035 · Cited by 1
“Alzheimer’s disease (AD), a neurodegenerative disorder with an unclear pathological etiology, remains challenging to diagnose definitively through noninvasive clinical methods [7–9].”
Dino, H. I., & Hassan, M. M. (2025) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2025.106399 · Cited by 3
Husien, I. M., Ahmed, M., Özbaltan, M., & Sarfraz, M. (2025) · Al-Iraqia Journal of Scientific Engineering Research · doi:10.58564/ijser.4.3.2025.322 · Cited by 1
Liu, Y., Liu, W., Hui, T., Que, T., Feng, D., Liu, X., Xiang, Y., Zhang, W., He, L., & Xing, L. (2026) · Physica Scripta · doi:10.1088/1402-4896/ae41eb · Cited by 1
Not Only Grey Matter: OmniBrain for Robust Multimodal Classification of Alzheimer's Disease
Sharshar, A., Ashraf, Y., Bakr, T., Hassan, S., Elgendy, H., Yaqub, M. K., & Guizani, M. (2025) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw69036.2025.00140 · Cited by 7
“9% accuracy on ADNI without offering interpretability tools [14].”
Effective distance-based multi-modality feature selection for Alzheimer’s disease identification
Wang, M., Ye, T., Ma, C., Li, X., Liu, M., & Zhang, D. (2026) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2026.110582 · Cited by 1
Metadata
- Authors
- Golovanevsky, M., Eickhoff, C., & Singh, R.
- Affiliations
- Brown University (US)
- Corresponding author
- Eickhoff, Carsten
- Venue
- Journal of the American Medical Informatics Association
- Publisher
- Oxford University Press (OUP)
- Published
- 2022-09-23
- Volume
- 29
- Issue
- 12
- Pages
- 2014-2022
- ISSN
- 1067-5027 (ISSN-L)
- 1527-974X
- PMC
- PMC9667156
- OpenAlex
- W4283205155
- Cited by
- 165
- References
- 32
- Citations by year
- 2026: 50 · 2025: 67 · 2024: 34 · 2023: 13 · 2022: 1
- FWCI
- 18.65
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Licence
- academic.oup.com/journals/pages/open_access/funder_policies/chorus/standard_publication_model (vor)
- Locations
- Journal of the American Medical Informatics Association (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- National Institute of General Medical Sciences (T32GM128596)
- Topics
- Health Sciences › Medicine › Psychiatry and Mental health › Dementia and Cognitive Impairment Research
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning in Healthcare
- Health Sciences › Health Professions › Health Information Management › Artificial Intelligence in Healthcare
- Keywords
- Alzheimer's disease diagnosis, mild cognitive impairment, cross-modal attention, multimodal deep learning, self-attention, structured clinical data, genetic data, neuroimaging, decision support, multi-class classification
- MeSH terms
- Machine Learning, Deep Learning, Alzheimer Disease, Humans, Magnetic Resonance Imaging, Cognitive Dysfunction
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.