Multimodal Inductive Transfer Learning for Detection of Alzheimer’s Dementia and its Severity
Open accessThe DOI matches its Crossref record; 14 of the 14 references it cites were found in a registry or an index.
Abstract
Alzheimer's disease is estimated to affect around 50 million people worldwide and is rising rapidly, with a global economic burden of nearly a trillion dollars. This calls for scalable, cost-effective, and robust methods for detection of Alzheimer's dementia (AD). We present a novel architecture that leverages acoustic, cognitive, and linguistic features to form a multimodal ensemble system. It uses specialized artificial neural networks with temporal characteristics to detect AD and its severity, which is reflected through Mini-Mental State Exam (MMSE) scores. We first evaluate it on the ADReSS challenge dataset, which is a subject-independent and balanced dataset matched for age and gender to mitigate biases, and is available through DementiaBank. Our system achieves state-of-the-art test accuracy, precision, recall, and F1-score of 83.3% each for AD classification, and state-of-the-art test root mean squared error (RMSE) of 4.60 for MMSE score regression. To the best of our knowledge, the system further achieves state-of-the-art AD classification accuracy of 88.0% when evaluated on the full benchmark DementiaBank Pitt database. Our work highlights the applicability and transferability of spontaneous speech to produce a robust inductive transfer learning model, and demonstrates generalizability through a task-agnostic feature-space. The source code is available at https://github.com/wazeerzulfikar/alzheimers-dementia
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Mini‐Mental State Examination: A Comprehensive Review
Tombaugh, T. N., & McIntyre, N. J. (1992) · Journal of the American Geriatrics Society · doi:10.1111/j.1532-5415.1992.tb01992.x · Cited by 5,152
2016 Alzheimer's disease facts and figures
Alzheimer's Association (2016) · Alzheimer's & Dementia · doi:10.1016/j.jalz.2016.03.001 · Cited by 5,069
The global prevalence of dementia: a systematic review and metaanalysis.
Prince, M., Bryce, R., Albanese, E., Wimo, A., Ribeiro, W., & Ferri, C. P. (2013) · Alzheimer's & Dementia · doi:10.1016/j.jalz.2012.11.007 · Cited by 4,941
Caregiving as a Risk Factor for Mortality: The Caregiver Health Effects Study
Schulz, R., & Beach, S. R. (1999) · JAMA · doi:10.1001/jama.282.23.2215 · Cited by 3,340
Opensmile: the munich versatile and fast open-source audio feature extractor
Eyben, F., Wöllmer, M., & Schuller, B. (2010) · Proceedings of the 18th ACM international conference on Multimedia · doi:10.1145/1873951.1874246 · Cited by 2,642
Linguistic Features Identify Alzheimer’s Disease in Narrative Speech
Fraser, K. C., Meltzer, J. A., & Rudzicz, F. (2015) · Journal of Alzheimer's Disease · doi:10.3233/jad-150520 · Cited by 797
The Natural History of Alzheimer's Disease: Description of Study Cohort and Accuracy of Diagnosis
Becker, J. T. (1994) · Archives of Neurology · doi:10.1001/archneur.1994.00540180063015 · Cited by 576
Alzheimer and frontotemporal pathology in subsets of primary progressive aphasia
Mesulam, M., Wicklund, A., Johnson, N., Rogalski, E., Léger, G. C., Rademaker, A., Weintraub, S., & Bigio, E. H. (2008) · Annals of Neurology · doi:10.1002/ana.21388 · Cited by 513
Toth, L., Hoffmann, I., Gosztolya, G., Vincze, V., Szatloczki, G., Banreti, Z., Pakaski, M., & Kalman, J. (2018) · Current Alzheimer Research · doi:10.2174/1567205014666171121114930 · Cited by 290
Alzheimer’s Dementia Recognition Through Spontaneous Speech: The ADReSS Challenge
Luz, S., Haider, F., Fuente, S. D. L., Fromm, D., & MacWhinney, B. (2020) · Interspeech 2020 · doi:10.21437/interspeech.2020-2571 · Cited by 274
Cited by
Speech based detection of Alzheimer's disease: a survey of AI techniques, datasets and challenges
Ding, K., Chetty, M., Noori Hoshyar, A., Bhattacharya, T., & Klein, B. (2024) · Artificial Intelligence Review · doi:10.1007/s10462-024-10961-6 · Cited by 82
Martinc, M., Haider, F., Pollak, S., & Luz, S. (2021) · Frontiers in Aging Neuroscience · doi:10.3389/fnagi.2021.642647 · Cited by 55
Lukic, S., Fan, Z., García, A. M., Welch, A. E., Ratnasiri, B. M., Wilson, S. M., Henry, M. L., Vonk, J., Deleon, J., Miller, B. L., et al. (2024) · Cortex · doi:10.1016/j.cortex.2023.12.013 · Cited by 19
Metadata
- Authors
- Sarawgi, U., Zulfikar, W., Soliman, N., & Maes, P.
- Venue
- Interspeech 2020
- Publisher
- ISCA
- Published
- 2020-10-25
- Pages
- 2212-2216
- ISSN
- 2308-457X (ISSN-L)
- OpenAlex
- W3082727480
- Cited by
- 67
- References
- 14
- FWCI
- 16.08
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Multimodal Inductive Transfer Learning for Detection of Alzheimer’s Dementia and its Severity. https://app.cochat.ai/papers/10.21437/interspeech.2020-3137
- The paper
- Sarawgi, U., Zulfikar, W., Soliman, N., & Maes, P. (2020). Multimodal Inductive Transfer Learning for Detection of Alzheimer’s Dementia and its Severity. Interspeech 2020. https://doi.org/10.21437/interspeech.2020-3137
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.