Automated detection of Alzheimer’s disease: a multi-modal approach with 3D MRI and amyloid PET
Open accessThe DOI matches its Crossref record; 14 of the 14 references it cites were found in a registry or an index.
Abstract
Recent advances in deep learning and imaging technologies have revolutionized automated medical image analysis, especially in diagnosing Alzheimer’s disease through neuroimaging. Despite the availability of various imaging modalities for the same patient, the development of multi-modal models leveraging these modalities remains underexplored. This paper addresses this gap by proposing and evaluating classification models using 2D and 3D MRI images and amyloid PET scans in uni-modal and multi-modal frameworks. Our findings demonstrate that models using volumetric data learn more effective representations than those using only 2D images. Furthermore, integrating multiple modalities enhances model performance over single-modality approaches significantly. We achieved state-of-the-art performance on the OASIS-3 cohort. Additionally, explainability analyses with Grad-CAM indicate that our model focuses on crucial AD-related regions for its predictions, underscoring its potential to aid in understanding the disease’s causes.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization
Selvaraju, R. R., Cogswell, M., Das, A., Vedantam, R., Parikh, D., & Batra, D. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.74 · Cited by 24,513
Discrimination between Alzheimer dementia and controls by automated analysis of multicenter FDG PET
Herholz, K., Salmon, E., Perani, D., Baron, J.-C., Holthoff, V., Frölich, L., Schönknecht, P., Ito, K., Mielke, R., & Kalbe, E. (2002) · NeuroImage · doi:10.1006/nimg.2002.1208 · Cited by 832 · cited 1×
“Apart from the Middle Temporal Gyrus, Precentral Gyrus, and Precuneus, the Frontal Gyrus (encompassing the superior, middle, and inferior triangular parts) was markedly significant in AD detection 50–52 .”
BackgroundLaMontagne, P. J., Benzinger, T. L., Morris, J. C., Keefe, S., Hornbeck, R., Xiong, C., Grant, E., Hassenstab, J., Moulder, K., Vlassenko, A. G., et al. (2019) · medRxiv · doi:10.1101/2019.12.13.19014902 · Cited by 779 · cited 2×
“In this study, we employed the OASIS-3 dataset 10 , the most recent iteration of the OASIS series, increasingly recognized as a benchmark for diverse research goals within the scientific community 30–33 .”
MethodPatterns of temporal lobe atrophy in semantic dementia and Alzheimer's disease
Chan, D., Fox, N. C., Scahill, R. I., Crum, W. R., Whitwell, J. L., Leschziner, G., Rossor, A. M., Stevens, J. M., Cipolotti, L., & Rossor, M. N. (2001) · Annals of Neurology · doi:10.1002/ana.92 · Cited by 749 · cited 1×
“This observation aligns with established research indicating Temporal Lobe atrophy as a critical predictor of AD 35–37 and other dementia forms 37,38 , particularly emphasizing the significance of the Medial Temporal Lobe 39–44 .”
ResultRate of medial temporal lobe atrophy in typical aging and Alzheimer's disease
Jack, C. R., Petersen, R. C., Xu, Y., O'Brien, P. C., Smith, G. E., Ivnik, R. J., Tangalos, E. G., & Kokmen, E. (1998) · Neurology · doi:10.1212/wnl.51.4.993 · Cited by 666
Chételat, G., Arbizu, J., Barthel, H., Garibotto, V., Law, I., Morbelli, S., van de Giessen, E., Agosta, F., Barkhof, F., Brooks, D. J., et al. (2020) · The Lancet Neurology · doi:10.1016/s1474-4422(20)30314-8 · Cited by 526
Multimodal deep learning for Alzheimer's disease dementia assessment
Qiu, S., Miller, M. I., Joshi, P. S., Lee, J. C., Xue, C., Ni, Y., Wang, Y., De Anda-Duran, I., Hwang, P. H., Cramer, J. A., et al. (2022) · Nature Communications · doi:10.1038/s41467-022-31037-5 · Cited by 420
Convit, A., de Asis, J., de Leon, M. J., Tarshish, C. Y., De Santi, S., & Rusinek, H. (2000) · Neurobiology of Aging · doi:10.1016/s0197-4580(99)00107-4 · Cited by 359 · cited 1×
“This observation aligns with established research indicating Temporal Lobe atrophy as a critical predictor of AD 35–37 and other dementia forms 37,38 , particularly emphasizing the significance of the Medial Temporal Lobe 39–44 .”
ResultRapidly progressing atrophy of medial temporal lobe in Alzheimer's disease
Jobst, K. A., Smith, A. D., Szatmari, M., Esiri, M. M., Jaskowski, A., Hindley, N., McDonald, B., & Molyneux, A. J. (1994) · The Lancet · doi:10.1016/s0140-6736(94)92028-1 · Cited by 215
Decline of cerebral glucose metabolism in frontotemporal dementia: a longitudinal 18F-FDG-PET-study
Diehl-Schmid, J., Grimmer, T., Drzezga, A., Bornschein, S., Riemenschneider, M., Förstl, H., Schwaiger, M., & Kurz, A. (2007) · Neurobiology of Aging · doi:10.1016/j.neurobiolaging.2005.11.002 · Cited by 199
Cited by
Onciul, R., Tataru, C.-I., Dumitru, A. V., Crivoi, C., Serban, M., Covache-Busuioc, R.-A., Radoi, M. P., & Toader, C. (2025) · Journal of Clinical Medicine · doi:10.3390/jcm14020550 · Cited by 113
“By automating the identification of subtle structural changes that are often missed during manual review, AI enables clinicians to diagnose Alzheimer’s disease earlier, offering opportunities for timely therapeutic interventions and improved patient outcomes [151].”
Raza, M. L., Hassan, S. T., Jamil, S., Hyder, N., Batool, K., Walji, S., & Abbas, M. K. (2025) · Frontiers in Neuroinformatics · doi:10.3389/fninf.2025.1557177 · Cited by 74
A Review of Multimodal Fusion–Based Deep Learning for Alzheimer’s Disease
Zhang, R., Sheng, J., Zhang, Q., Wang, J., & Wang, B. (2025) · Neuroscience · doi:10.1016/j.neuroscience.2025.04.035 · Cited by 32
Metadata
- Authors
- Castellano, G., Esposito, A., Lella, E., Montanaro, G., & Vessio, G.
- Venue
- Scientific Reports
- Published
- 2024-03-03
- Volume
- 14
- Issue
- 1
- Pages
- 5210-5210
- ISSN
- 2045-2322 (ISSN-L)
- OpenAlex
- W4392342608
- Cited by
- 115
- References
- 14
- FWCI
- 30.96
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Automated detection of Alzheimer’s disease: a multi-modal approach with 3D MRI and amyloid PET. https://app.cochat.ai/papers/10.1038/s41598-024-56001-9
- The paper
- Castellano, G., Esposito, A., Lella, E., Montanaro, G., & Vessio, G. (2024). Automated detection of Alzheimer’s disease: a multi-modal approach with 3D MRI and amyloid PET. Scientific Reports. https://doi.org/10.1038/s41598-024-56001-9
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.