Combining Multimodal Behavioral Data of Gait, Speech, and Drawing for Classification of Alzheimer’s Disease and Mild Cognitive Impairment
Open accessThe DOI matches its Crossref record; 21 of the 21 references it cites were found in a registry or an index.
Abstract
Background: Gait, speech, and drawing behaviors have been shown to be sensitive to the diagnosis of Alzheimer’s disease (AD) and mild cognitive impairment (MCI). However, previous studies focused on only analyzing individual behavioral modalities, although these studies suggested that each of these modalities may capture different profiles of cognitive impairments associated with AD. Objective: We aimed to investigate if combining behavioral data of gait, speech, and drawing can improve classification performance compared with the use of individual modality and if each of these behavioral data can be associated with different cognitive and clinical measures for the diagnosis of AD and MCI. Methods: Behavioral data of gait, speech, and drawing were acquired from 118 AD, MCI, and cognitively normal (CN) participants. Results: Combining all three behavioral modalities achieved 93.0% accuracy for classifying AD, MCI, and CN, and only 81.9% when using the best individual behavioral modality. Each of these behavioral modalities was statistically significantly associated with different cognitive and clinical measures for diagnosing AD and MCI. Conclusion: Our findings indicate that these behaviors provide different and complementary information about cognitive impairments such that classification of AD and MCI is superior to using either in isolation.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
1 retracted
Dementia prevention, intervention, and care: 2020 report of the Lancet Commission
Livingston, G., Huntley, J., Sommerlad, A., Ames, D., Ballard, C., Banerjee, S., Brayne, C., Burns, A., Cohen-Mansfield, J., Cooper, C., et al. (2020) · The Lancet · doi:10.1016/s0140-6736(20)30367-6 · Cited by 10,430
RetractedBreiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
Dementia prevention, intervention, and care
Livingston, G., Sommerlad, A., Orgeta, V., Costafreda, S. G., Huntley, J., Ames, D., Ballard, C., Banerjee, S., Burns, A., Cohen-Mansfield, J., et al. (2017) · The Lancet · doi:10.1016/s0140-6736(17)31363-6 · Cited by 6,072
Alzheimer's Disease Neuroimaging Initiative (ADNI)
Petersen, R. C., Aisen, P. S., Beckett, L. A., Donohue, M. C., Gamst, A. C., Harvey, D. J., Jack, C. R., Jagust, W. J., Shaw, L. M., Toga, A. W., et al. (2010) · Neurology · doi:10.1212/wnl.0b013e3181cb3e25 · Cited by 2,572
A Simple Generalisation of the Area Under the ROC Curve for Multiple Class Classification Problems
Hand, D. J., & Till, R. J. (2001) · Machine Learning · doi:10.1023/a:1010920819831 · Cited by 2,276 · cited 1×
“Athree-classAuROCwas computedasdefinedbyHandandTill[55].”
2018 Alzheimer's disease facts and figures
Alzheimer's Association (2018) · Alzheimer's & Dementia · doi:10.1016/j.jalz.2018.02.001 · Cited by 1,912
A/T/N: An unbiased descriptive classification scheme for Alzheimer disease biomarkers
Jack, C. R., Bennett, D. A., Blennow, K., Carrillo, M. C., Feldman, H. H., Frisoni, G. B., Hampel, H., Jagust, W. J., Johnson, K. A., Knopman, D. S., et al. (2016) · Neurology · doi:10.1212/wnl.0000000000002923 · Cited by 1,864
Jack, C. R., Lowe, V. J., Senjem, M. L., Weigand, S. D., Kemp, B. J., Shiung, M. M., Knopman, D. S., Boeve, B. F., Klunk, W. E., Mathis, C. A., et al. (2008) · Brain · doi:10.1093/brain/awm336 · Cited by 958 · cited 1×
“Many studies on biomarkers such as structural MRI, functional imaging, and cerebrospinal fluid have shown that their combinations enhance the classification accuracy of detecting AD or MCI [60, 61].”
Linguistic Features Identify Alzheimer’s Disease in Narrative Speech
Fraser, K. C., Meltzer, J. A., & Rudzicz, F. (2015) · Journal of Alzheimer's Disease · doi:10.3233/jad-150520 · Cited by 797 · cited 3×
“The trends in their changes were consistent with those reported in previous studies on AD or MCI (for gait [7, 8, 27, 33, 42], for speech [19, 31, 43–47], for drawing [22–25]).”
Alzheimer’s Disease – Why We Need Early Diagnosis
Rasmussen, J., & Langerman, H. (2019) · Degenerative Neurological and Neuromuscular Disease · doi:10.2147/dnnd.s228939 · Cited by 501
Automatic speech analysis for the assessment of patients with predementia and Alzheimer's disease
König, A., Satt, A., Sorin, A., Hoory, R., Toledo‐Ronen, O., Derreumaux, A., Manera, V., Verhey, F., Aalten, P., Robert, P. H., et al. (2015) · Alzheimer's & Dementia: Diagnosis, Assessment & Disease Monitoring · doi:10.1016/j.dadm.2014.11.012 · Cited by 380 · cited 4×
“The trends in their changes were consistent with those reported in previous studies on AD or MCI (for gait [7, 8, 27, 33, 42], for speech [19, 31, 43–47], for drawing [22–25]).”
InfluentialConnected speech as a marker of disease progression in autopsy-proven Alzheimer’s disease
Ahmed, S., Haigh, A.-M. F., de Jager, C. A., & Garrard, P. (2013) · Brain · doi:10.1093/brain/awt269 · Cited by 362
Connected Speech in Neurodegenerative Language Disorders: A Review
Boschi, V., Catricalà, E., Consonni, M., Chesi, C., Moro, A., & Cappa, S. F. (2017) · Frontiers in Psychology · doi:10.3389/fpsyg.2017.00269 · Cited by 362
Innovative diagnostic tools for early detection of Alzheimer's disease
Laske, C., Sohrabi, H. R., Frost, S. M., López-de-Ipiña, K., Garrard, P., Buscema, M., Dauwels, J., Soekadar, S. R., Mueller, S., Linnemann, C., et al. (2015) · Alzheimer's & Dementia · doi:10.1016/j.jalz.2014.06.004 · Cited by 316
Toth, L., Hoffmann, I., Gosztolya, G., Vincze, V., Szatloczki, G., Banreti, Z., Pakaski, M., & Kalman, J. (2018) · Current Alzheimer Research · doi:10.2174/1567205014666171121114930 · Cited by 290
Szatloczki, G., Hoffmann, I., Vincze, V., Kalman, J., & Pakaski, M. (2015) · Frontiers in Aging Neuroscience · doi:10.3389/fnagi.2015.00195 · Cited by 249
Linguistic markers predict onset of Alzheimer's disease
Eyigoz, E., Mathur, S., Santamaria, M., Cecchi, G., & Naylor, M. (2020) · EClinicalMedicine · doi:10.1016/j.eclinm.2020.100583 · Cited by 206
Unobtrusive assessment of activity patterns associated with mild cognitive impairment
Hayes, T. L., Abendroth, F., Adami, A., Pavel, M., Zitzelberger, T. A., & Kaye, J. A. (2008) · Alzheimer's & Dementia · doi:10.1016/j.jalz.2008.07.004 · Cited by 187
A systematic literature review of automatic Alzheimer’s disease detection from speech and language
Petti, U., Baker, S., & Korhonen, A. (2020) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocaa174 · Cited by 168 · cited 1×
“Another clinical implication of this study is that our findings might help computerized detection of AD without specialists by improving the performance of computerized screening methods proposed in previous studies [13, 23, 27, 30, 64, 65].”
Editorial: Alzheimer's Dementia Recognition through Spontaneous Speech
Luz, S., Haider, F., de la Fuente Garcia, S., Fromm, D., & MacWhinney, B. (2021) · Frontiers in Computer Science · doi:10.3389/fcomp.2021.780169 · Cited by 104
Cited by
Predicting dementia from spontaneous speech using large language models
Agbavor, F., & Liang, H. (2022) · PLOS Digital Health · doi:10.1371/journal.pdig.0000168 · Cited by 147
“Leveraging AI with the growing development of largescale, multi-modal data such as neuroimaging, speech and language, behavioral biomarkers, and patient information on electronic medical records, will help alleviate the data problem and allow for more accurate, efficient, and early diagnosis [33].”
BackgroundSpeech based detection of Alzheimer's disease: a survey of AI techniques, datasets and challenges
Ding, K., Chetty, M., Noori Hoshyar, A., Bhattacharya, T., & Klein, B. (2024) · Artificial Intelligence Review · doi:10.1007/s10462-024-10961-6 · Cited by 82
Alzheimer's disease digital biomarkers multidimensional landscape and AI model scoping review
Qi, W., Zhu, X., Wang, B., Shi, Y., Dong, C., Shen, S., Li, J., Zhang, K., He, Y., Zhao, M., et al. (2025) · npj Digital Medicine · doi:10.1038/s41746-025-01640-z · Cited by 78
“…studies 27,57,74,77 – 79 , 7 from eye movement biomarker studies 39,40,80,81,83,85,87 , 1 from ICT device-based digital testing 96 , 2 from multi-type biomarker research 111,114 , 1 from Biofeedback research 120 , 1 from home activity bio-marker research 115 , and 1 from other research 122 .”
InfluentialAgbavor, F., & Liang, H. (2022) · Brain Sciences · doi:10.3390/brainsci13010028 · Cited by 47
Artificial intelligence for dementia prevention
Newby, D., Orgeta, V., Marshall, C. R., Lourida, I., Albertyn, C. P., Tamburin, S., Raymont, V., Veldsman, M., Koychev, I., Bauermeister, S., et al. (2023) · Alzheimer's & Dementia · doi:10.1002/alz.13463 · Cited by 42
Metadata
- Authors
- Yamada, Y., Shinkawa, K., Kobayashi, M., Caggiano, V., Nemoto, M., Nemoto, K., & Arai, T.
- Venue
- Journal of Alzheimer's Disease
- Publisher
- SAGE Publications
- Published
- 2021-10-26
- Volume
- 84
- Issue
- 1
- Pages
- 315-327
- ISSN
- 1387-2877 (ISSN-L)
- 1875-8908
- OpenAlex
- W3200538644
- Cited by
- 56
- References
- 21
- FWCI
- 4.92
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.