Explainable Deep-Learning-Based Diagnosis of Alzheimer’s Disease Using Multimodal Input Fusion of PET and MRI Images
Open accessThe DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.
Abstract
Purpose: Alzheimer’s disease (AD) is a progressive, incurable human brain illness that impairs reasoning and retention as well as recall. Detecting AD in its preliminary stages before clinical manifestations is crucial for timely treatment. Magnetic Resonance Imaging (MRI) provides valuable insights into brain abnormalities by measuring the decrease in brain volume expressly in the mesial temporal cortex and other regions of the brain, while Positron Emission Tomography (PET) measures the decrease of glucose concentration in the temporoparietal association cortex. When these data are combined, the performance of AD diagnostic methods could be improved. However, these data are heterogeneous and there is a need for an effective model that will harness the information from both data for the accurate prediction of AD. Methods: To this end, we present a novel heuristic early feature fusion framework that performs the concatenation of PET and MRI images, while a modified Resnet18 deep learning architecture is trained simultaneously on the two datasets. The innovative 3-in-channel approach is used to learn the most descriptive features of fused PET and MRI images for effective binary classification of AD. Results: The experimental results show that the proposed model achieved a classification accuracy of 73.90% on the ADNI database. Then, we provide an Explainable Artificial Intelligence (XAI) model, allowing us to explain the results. Conclusion: Our proposed model could learn latent representations of multimodal data even in the presence of heterogeneity data; hence, the proposed model partially solved the issue with the heterogeneity of the MRI and PET data.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Azam, M. A., Khan, K. B., Salahuddin, S., Rehman, E., Khan, S. A., Khan, M. A., Kadry, S., & Gandomi, A. H. (2022) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2022.105253 · Cited by 449 · cited 1×
“The idea of multimodal data fusion for medical diagnostics is not new [37, 38].”
BackgroundJeremic, D., Jiménez-Díaz, L., & Navarro-López, J. D. (2021) · Ageing Research Reviews · doi:10.1016/j.arr.2021.101496 · Cited by 306
Neuroimaging biomarkers for Alzheimer’s disease.
Márquez, F., & Yassa, M. A. (2019) · Molecular Neurodegeneration · doi:10.1186/s13024-019-0325-5 · Cited by 289 · cited 1×
“By evaluating the brain images captured from PET and MRI, volumetric consolidation in parts of the brain atrophy can be used as an essential biomarker for AD [11, 12].”
MethodAn effective multimodal image fusion method using MRI and PET for Alzheimer’s disease diagnosis
Song, J., Zheng, J., Li, P., Lu, X., Zhu, G., & Shen, P. (2021) · Frontiers in Digital Health · doi:10.3389/fdgth.2021.637386 · Cited by 178
Multi-Modal Neuroimaging Feature Fusion for Diagnosis of Alzheimer’s Disease
Zhang, T., & Shi, M. (2020) · Journal of Neuroscience Methods · doi:10.1016/j.jneumeth.2020.108795 · Cited by 91 · cited 1×
“Irrelevant information was suppressed [43].”
Peet, B. T., Spina, S., Mundada, N., & La Joie, R. (2021) · Neurotherapeutics · doi:10.1007/s13311-021-01101-x · Cited by 74
Predictive classification of Alzheimer’s disease using brain imaging and genetic data
Sheng, J., Xin, Y., Zhang, Q., Wang, L., Yang, Z., & Yin, J. (2022) · Scientific Reports · doi:10.1038/s41598-022-06444-9 · Cited by 50
Cited by
Li, Y., El Habib Daho, M., Conze, P.-H., Zeghlache, R., Le Boité, H., Tadayoni, R., Cochener, B., Lamard, M., & Quellec, G. (2024) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2024.108635 · Cited by 274
Odusami, M., Maskeliūnas, R., & Damaševičius, R. (2023) · Journal of Personalized Medicine · doi:10.3390/jpm13101496 · Cited by 42
“PET imaging with 18F-fluorodeoxyglucose (FDGPET) imaging can capture brain metabolism characteristics to aid in the detection of lesions for AD classification [10].”
BackgroundMethodSelf-citationA Review of Multimodal Fusion–Based Deep Learning for Alzheimer’s Disease
Zhang, R., Sheng, J., Zhang, Q., Wang, J., & Wang, B. (2025) · Neuroscience · doi:10.1016/j.neuroscience.2025.04.035 · Cited by 32
Metadata
- Authors
- Odusami, M., Maskeliūnas, R., Damaševičius, R., & Misra, S.
- Venue
- Journal of Medical and Biological Engineering
- Published
- 2023-06
- Volume
- 43
- Issue
- 3
- Pages
- 291-302
- ISSN
- 1609-0985 (ISSN-L)
- 2199-4757
- OpenAlex
- W4381435789
- Cited by
- 120
- References
- 7
- FWCI
- 21.47
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Explainable Deep-Learning-Based Diagnosis of Alzheimer’s Disease Using Multimodal Input Fusion of PET and MRI Images. https://app.cochat.ai/papers/10.1007/s40846-023-00801-3
- The paper
- Odusami, M., Maskeliūnas, R., Damaševičius, R., & Misra, S. (2023). Explainable Deep-Learning-Based Diagnosis of Alzheimer’s Disease Using Multimodal Input Fusion of PET and MRI Images. Journal of Medical and Biological Engineering. https://doi.org/10.1007/s40846-023-00801-3
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.