The DOI matches its Crossref record; 52 of the 53 references it cites were found in a registry or an index; 12 of the 20 sources its claims cite were checked for support.
Multimodal deep learning for Alzheimer's disease dementia assessment
Open accessAbstract
Worldwide, there are nearly 10 million new cases of dementia annually, of which Alzheimer's disease (AD) is the most common. New measures are needed to improve the diagnosis of individuals with cognitive impairment due to various etiologies. Here, we report a deep learning framework that accomplishes multiple diagnostic steps in successive fashion to identify persons with normal cognition (NC), mild cognitive impairment (MCI), AD, and non-AD dementias (nADD). We demonstrate a range of models capable of accepting flexible combinations of routinely collected clinical information, including demographics, medical history, neuropsychological testing, neuroimaging, and functional assessments. We then show that these frameworks compare favorably with the diagnostic accuracy of practicing neurologists and neuroradiologists. Lastly, we apply interpretability methods in computer vision to show that disease-specific patterns detected by our models track distinct patterns of degenerative changes throughout the brain and correspond closely with the presence of neuropathological lesions on autopsy. Our work demonstrates methodologies for validating computational predictions with established standards of medical diagnosis.
Overview
CoChat Summary
TL;DR
This paper develops and validates a staged deep learning framework to classify normal cognition, mild cognitive impairment, Alzheimer’s disease, and non-AD dementias from MRI and routinely collected clinical data. Across 8 cohorts (n = 8916), the fusion model performed best overall and was benchmarked against clinicians, neuropathology, and interpretability analyses.
Key findings
- The study included 8916 participants across 8 cohorts: 4550 NC, 2412 MCI, 1606 AD, and 348 with other dementias.
- The fusion model achieved strong discrimination for the staged tasks, including COGNC AUC 0.945 in NACC and 0.959 in OASIS; COGDE AUC 0.971 in both NACC and OASIS; and lower performance for the harder ADD task with AUC 0.773 in both NACC and OASIS.
- In expert benchmarking, the fusion model’s overall 4-way accuracy was 0.558 (95% CI 0.482–0.634), reaching the level of neurologists (0.565, 95% CI 0.529–0.601); the MRI-only model improved over neuroradiologists on the ADD task (0.692 vs 0.566 accuracy).
- Interpretability analyses linked model signals to known disease biology: SHAP-highlighted regions included the hippocampus, amygdala, and temporal lobes, and neuropathology validation found significant associations between DEMO scores and A, B, and C neuropathologic scores, with F(3,51)=3.665, p=1.813e-2 for A, F(3,102)=11.528, p=1.432e-6 for B, and F(3,103)=4.924, p=3.088e-3 for C.
Methods
- Multicohort retrospective development/validation study using deidentified MRI and clinical data from 8 cohorts; models were trained on NACC with 5-fold cross-validation and externally tested on other datasets, with some analyses restricted to NACC and OASIS because non-imaging data were available there.
- The authors built three model types: an MRI-only CNN, a non-imaging machine-learning model (best performing: CatBoost), and a fusion model combining CNN-derived scores with clinical variables; the framework was staged as COG (NC/MCI/dementia) followed by ADD (AD vs nADD).
- Main analyses included AUC/AP performance evaluation, t-SNE and mutual information checks for confounding, SHAP for interpretability, neuropathologic validation in 110 participants with autopsy data, and head-to-head clinician comparisons with neurologists and neuroradiologists.
Limitations
- The paper states that in mixed dementia, the model defaults to AD when AD is present, so it does not perform multi-label classification for co-occurring dementias.
- The cohorts had no confirmed atypical AD cases, and the authors note that MCI is a broad category that was not subdivided into amnestic vs non-amnestic forms.
- Evident from the text: the non-imaging and fusion models were limited to NACC and OASIS because of missing non-imaging features in other cohorts, which may limit generalizability to settings with different data availability.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures






Verification
Claims the paper makes
6 Valid · 2 Not valid · 3 Not checked · 97 Own results and interpretations
Every source the paper cites for this claim was checked and supports it.
In the paper
“we have previously reported interpretable deep learning approaches capable of distinguishing participants with age-appropriate normal cognition (NC) from those with AD using magnetic resonance imaging (MRI) scans, age, sex, and mini-mental state examination (MMSE)17.”
§ Multimodal deep learning for Alzheimer’s disease dementia assessment > Introduction
What the sources say
- Supportedcites [17] Qiu, S. et al. Development and validation of an interpretable deep learning framework for Alzheimer’s disease classification. Brain 143, 1920–1933 (2020). source
The Methods describe participants classified as having normal cognition or Alzheimer’s disease. The Results describe a fusion deep-learning model using MRI, age, gender and MMSE to classify disease status, while the Discussion describes how the model can associate MRI changes with regional neuropathology, supporting its interpretability. (LLM, conf=0.93)
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Neuropathologic evaluations are considered to be the gold standard for confirming the presence and severity of neurodegenerative diseases50.”
§ Multimodal deep learning for Alzheimer’s disease dementia assessment > Methods > Neuropathologic validation
What the sources say
- Partly supportedcites [50] Besser, L. M. et al. The revised national Alzheimer’s coordinating center’s neuropathology form-available data and new analyses. J. Neuropathol. Exp. Neurol. 77, 717–726 (2018). sourceExperimental — accuracy not yet measured
The Abstract calls neuropathologic evaluation the gold standard for determining the presence and severity of aging-related neurodegenerative diseases. The citing sentence omits “aging-related,” extending the statement beyond the scope specified in the source. (LLM, conf=0.85)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“Previously, we developed and externally validated an interpretable deep learning approach to classify AD using multimodal inputs of MRI and clinical variables17.”
§ Multimodal deep learning for Alzheimer’s disease dementia assessment > Discussion
What the sources say
- Supportedcites [17] Qiu, S. et al. Development and validation of an interpretable deep learning framework for Alzheimer’s disease classification. Brain 143, 1920–1933 (2020). source
The Results describe a fusion model that combines MRI-derived imaging features with clinical variables (age, gender and MMSE) to classify Alzheimer’s disease. The Introduction identifies AIBL, FHS and NACC as external test datasets, and the Discussion describes the model’s interpretable disease-risk colour maps. (LLM, conf=0.94)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Importantly, however, the addition of MRI-derived DEMO and ALZ scores improved 4-way classification performance across all combinations of non-imaging variables (Figs. S4 and S5).”
§ Multimodal deep learning for Alzheimer’s disease dementia assessment > Results > Deep learning model performance
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Relative to the fusion model, we observed moderate performance reductions across classifications in our MRI-only model.”
§ Multimodal deep learning for Alzheimer’s disease dementia assessment > Results > Deep learning model performance
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
52 more claims
Create a free account to see all 108 claims and to verify the 2 references still open.
- It may state two separate claims as one. 28
- Probably not a substantial claim. 26
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Overall, AI’s integration into various facets of AD research holds promise for advancing our understanding of the disease. 614–618”
From Recent advances in Alzheimer's disease: Mechanisms, clinical trials and new drug development strategies. (2024) · cites this paper as [618]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“AI is currently making preliminary explorations in various aspects of AD, from detection and diagnosis to understanding disease mechanisms, biomarker discovery, clinical trial design, drug discovery, and prognosis prediction.”
From Recent advances in Alzheimer's disease: Mechanisms, clinical trials and new drug development strategies. (2024) · cites this paper as [618]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“A few studies have attempted to discern neuroimaging signatures unique to AD by contrasting them with other dementia types31–40.”
From AI-based differential diagnosis of dementia etiologies on multimodal data (2024) · cites this paper as [39]
The cited source says what the claim attributes to it.
In the citing paper
“Recently, we proposed a computational approach to stratify individuals based on cognitive status and discern likely AD cases from non-AD dementia types by incorporating imaging with non-imaging data such as demographics, medical histories and neuropsychological assessments39.”
From AI-based differential diagnosis of dementia etiologies on multimodal data (2024) · cites this paper as [39]
Statistics recomputed
Every reported test result, recomputed from its test statistic and degrees of freedom. A result shows as not adding up only once an independent check has confirmed it.
- ConsistentF(3, 51) = 3.665reported p = .01813 · recomputed p = .018
“F(3, 51) = 3.665, p = 1.813e-2”
- ConsistentF(3, 102) = 11.528reported p = .000001432 · recomputed p < .001
“F(3, 102) = 11.528, p = 1.432e-6”
- ConsistentF(3, 103) = 4.924reported p = .003088 · recomputed p = .003
“F(3, 103) = 4.924, p = 3.088e-3”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Self-check results appear here once an independent check has confirmed them.
Citations
Cites
McKhann, G. M., Knopman, D. S., Chertkow, H., Hyman, B. T., Jack, C. R., Kawas, C. H., Klunk, W. E., Koroshetz, W. J., Manly, J. J., Mayeux, R., et al. (2011) · Alzheimer's & Dementia · doi:10.1016/j.jalz.2011.03.005 · Cited by 18,657
Neuropathological stageing of Alzheimer-related changes.
Braak, H., & Braak, E. (1991) · Acta Neuropathologica · doi:10.1007/bf00308809 · Cited by 16,123
17. A Value for n-Person Games
Shapley, L. S. (1953) · Contributions to the Theory of Games (AM-28), Volume II · doi:10.1515/9781400881970-018 · Cited by 6,950
The Alzheimer’s disease neuroimaging initiative (ADNI): MRI methods
Jack, C. R., Bernstein, M. A., Fox, N. C., Thompson, P., Alexander, G., Harvey, D., Borowski, B., Britson, P. J., L. Whitwell, J., Ward, C., et al. (2008) · Journal of Magnetic Resonance Imaging · doi:10.1002/jmri.21049 · Cited by 4,347
Phases of Aβ-deposition in the human brain and its relevance for the development of AD
Thal, D. R., Rüb, U., Orantes, M., & Braak, H. (2002) · Neurology · doi:10.1212/wnl.58.12.1791 · Cited by 3,490
Braak, H., Alafuzoff, I., Arzberger, T., Kretzschmar, H., & Del Tredici, K. (2006) · Acta Neuropathologica · doi:10.1007/s00401-006-0127-z · Cited by 3,172
Hyman, B. T., Phelps, C. H., Beach, T. G., Bigio, E. H., Cairns, N. J., Carrillo, M. C., Dickson, D. W., Duyckaerts, C., Frosch, M. P., Masliah, E., et al. (2012) · Alzheimer's & Dementia · doi:10.1016/j.jalz.2011.10.007 · Cited by 3,092
The antibody aducanumab reduces Aβ plaques in Alzheimer’s disease
Sevigny, J., Chiao, P., Bussière, T., Weinreb, P. H., Williams, L., Maier, M., Dunstan, R., Salloway, S., Chen, T., Ling, Y., et al. (2016) · Nature · doi:10.1038/nature19323 · Cited by 3,059
Montine, T. J., Phelps, C. H., Beach, T. G., Bigio, E. H., Cairns, N. J., Dickson, D. W., Duyckaerts, C., Frosch, M. P., Masliah, E., Mirra, S. S., et al. (2012) · Acta Neuropathologica · doi:10.1007/s00401-011-0910-3 · Cited by 2,894
Alzheimer's Disease Neuroimaging Initiative (ADNI)
Petersen, R. C., Aisen, P. S., Beckett, L. A., Donohue, M. C., Gamst, A. C., Harvey, D. J., Jack, C. R., Jagust, W. J., Shaw, L. M., Toga, A. W., et al. (2010) · Neurology · doi:10.1212/wnl.0b013e3181cb3e25 · Cited by 2,572
Research works printed but not linked: 3
- Lundberg, S. M. & Lee, S.-I. A Unified Approach to Interpreting Model Predictions: in Proceedings of the 31st International Conference on Neural Information Processing Systems. 4768–4777 (2017).
- Weiner, M. & Khachaturian, Z. The use of MRI and PET for clinical diagnosis of dementia and investigation of cognitive impairment: a consensus report. Alzheimer’s Assoc. Chic., IL 1, 1–15 (2005).
- Shrikumar, A., Greenside, P. & Kundaje, A. Learning important features through propagating activation differences: in. Int. Conf. Mach. Learn. 70, 3145–3153 (2017).
Cited by
Zhang, J., Zhang, Y., Wang, J., Xia, Y., Zhang, J., & Chen, L. (2024) · Signal Transduction and Targeted Therapy · doi:10.1038/s41392-024-01911-3 · Cited by 1,138
Li, Y., El Habib Daho, M., Conze, P.-H., Zeghlache, R., Le Boité, H., Tadayoni, R., Cochener, B., Lamard, M., & Quellec, G. (2024) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2024.108635 · Cited by 274
The use of neuroimaging techniques in the early and differential diagnosis of dementia
Chouliaras, L., & O’Brien, J. T. (2023) · Molecular Psychiatry · doi:10.1038/s41380-023-02215-8 · Cited by 221
AI-based differential diagnosis of dementia etiologies on multimodal data
Xue, C., Kowshik, S. S., Lteif, D., Puducheri, S., Jasodanand, V. H., Zhou, O. T., Walia, A. S., Guney, O. B., Zhang, J. D., Poésy, S., et al. (2024) · Nature Medicine · doi:10.1038/s41591-024-03118-z · Cited by 182
Self-citationAn explainable machine learning approach for Alzheimer’s disease classification
Alatrany, A. S., Khan, W., Hussain, A., Kolivand, H., & Al-Jumeily, D. (2024) · Scientific Reports · doi:10.1038/s41598-024-51985-w · Cited by 172
Metadata
- Authors
- Qiu, S., Miller, M. I., Joshi, P. S., Lee, J. C., Xue, C., Ni, Y., Wang, Y., De Anda-Duran, I., Hwang, P. H., Cramer, J. A., Dwyer, B. C., Hao, H., Kaku, M. C., Kedar, S., Lee, P. H., Mian, A. Z., Murman, D. L., O’Shea, S., Paul, A. B., Saint-Hilaire, M.-H., Alton Sartor, E., Saxena, A. R., Shih, L. C., Small, J. E., Smith, M. J., Swaminathan, A., Takahashi, C. E., Taraschenko, O., You, H., Yuan, J., Zhou, Y., Zhu, S., Alosco, M. L., Mez, J., Stein, T. D., Poston, K. L., Au, R., & Kolachalama, V. B.
- Affiliations
- Boston University (US)
- University of Nebraska Medical Center (US)
- Chinese Academy of Medical Sciences & Peking Union Medical College (CN)
- Emory University (US)
- Lahey Hospital and Medical Center (US)
- Stanford University (US)
- Corresponding author
- Kolachalama, Vijaya B.
- ORCID
- Qiu, Shangran
- Miller, Matthew I.
- Joshi, Prajakta S.
- Wang, Yuwei
- De Anda-Duran, Ileana
- Hwang, Phillip H.
- Cramer, Justin A.
- Dwyer, Brigid C.
- Hao, Honglin
- Kaku, Michelle C.
- Kedar, Sachin
- Mian, Asim Z.
- Murman, Daniel L.
- O’Shea, Sarah
- Saxena, Aneeta R.
- Shih, Ludy C.
- Small, Juan E.
- Swaminathan, Arun
- Takahashi, Courtney E.
- Taraschenko, Olga
- You, Hui
- Yuan, Jing
- Zhou, Yan
- Zhu, Shuhan
- Alosco, Michael L.
- Mez, Jesse
- Stein, Thor D.
- Poston, Kathleen L.
- Au, Rhoda
- Kolachalama, Vijaya B.
- Venue
- Nature Communications
- Published
- 2022-06-20
- Volume
- 13
- Issue
- 1
- Pages
- 3404-3404
- ISSN
- 2041-1723 (ISSN-L)
- PMC
- PMC9209452
- OpenAlex
- W4283156058
- Cited by
- 420
- References
- 53
- Citations by year
- 2026: 126 · 2025: 125 · 2024: 111 · 2023: 52 · 2022: 6
- FWCI
- 47.92
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/4.0 (tdm)
- creativecommons.org/licenses/by/4.0 (vor)
- Locations
- Nature Communications (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- Michael J. Fox Foundation for Parkinson's Research
- American Heart Association (20SFRN35460031)
- Alzheimer's Drug Discovery Foundation
- Demensförbundet
- Lewy Body Dementia Association
- Karen Toffler Charitable Trust
- National Institutes of Health (1r21ca253498-01, 1r56ag062109-01)
- National Institute on Aging (R56-AG062109, R01AG054076, R01AG033040, RF1AG062109, R01AG016495, RF1AG072654, P30AG013846, U19AG065156, U19AG068753, R01AG072654, P30AG066515, P30AG066546)
- National Heart, Lung, and Blood Institute (R01HL159620)
- National Cancer Institute (R21‐CA253498)
- National Institute of Neurological Disorders and Stroke (K23NS075097, R01NS115114)
- Topics
- Health Sciences › Medicine › Psychiatry and Mental health › Dementia and Cognitive Impairment Research
- Health Sciences › Health Professions › Health Information Management › Artificial Intelligence in Healthcare
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning in Healthcare
- Keywords
- Alzheimer's disease, dementia diagnosis, mild cognitive impairment, multimodal deep learning, neuroimaging, neuropsychological assessment, clinical data integration, interpretability, autopsy neuropathology, cognitive impairment classification, diagnostic accuracy
- MeSH terms
- Deep Learning, Alzheimer Disease, Humans, Disease Progression, Neuroimaging, Cognitive Dysfunction
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Multimodal deep learning for Alzheimer's disease dementia assessment. https://app.cochat.ai/papers/10.1038/s41467-022-31037-5
- The paper
- Qiu, S., Miller, M. I., Joshi, P. S., Lee, J. C., Xue, C., Ni, Y., Wang, Y., De Anda-Duran, I., Hwang, P. H., Cramer, J. A., Dwyer, B. C., Hao, H., Kaku, M. C., Kedar, S., Lee, P. H., Mian, A. Z., Murman, D. L., O’Shea, S., Paul, A. B., . . . Kolachalama, V. B. (2022). Multimodal deep learning for Alzheimer's disease dementia assessment. Nature Communications. https://doi.org/10.1038/s41467-022-31037-5
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.