Multilingual word embeddings for the assessment of narrative speech in mild cognitive impairment
Open accessThe DOI matches its Crossref record; 22 of the 22 references it cites were found in a registry or an index.
Abstract
We analyze the information content of narrative speech samples from individuals with mild cognitive impairment (MCI), in both English and Swedish, using a combination of supervised and unsupervised learning techniques. We extract information units using topic models trained on word embeddings in monolingual and multilingual spaces, and find that the multilingual approach leads to significantly better classification accuracies than training on the target language alone. In many cases, we find that augmenting the topic model training corpus with additional clinical data from a different language is more effective than training on additional monolingual data from healthy controls. Ultimately we are able to distinguish MCI speakers from healthy older adults with accuracies of up to 63% (English) and 72% (Swedish) on the basis of information content alone. We also compare our method against previous results measuring information content in Alzheimer’s disease, and report an improvement over other topic-modeling approaches. Furthermore, our results support the hypothesis that subtle differences in language can be detected in narrative speech, even at the very early stages of cognitive decline, when scores on screening tools such as the Mini-Mental State Exam are still in the “normal” range.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Enriching Word Vectors with Subword Information
Bojanowski, P., Grave, E., Joulin, A., & Mikolov, T. (2017) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00051 · Cited by 9,645 · cited 8×
“Fraser et al. (2016) employed a similar approach to extract information units from Cookie Theft narratives from participants with AD.”
MethodResultInfluentialThe global prevalence of dementia: a systematic review and metaanalysis.
Prince, M., Bryce, R., Albanese, E., Wimo, A., Ribeiro, W., & Ferri, C. P. (2013) · Alzheimer's & Dementia · doi:10.1016/j.jalz.2012.11.007 · Cited by 4,941 · cited 1×
“Dementia is a progressive cognitive impairment due to neurodegenerative disease, affecting more people each year as the average lifespan increases (Prince et al., 2013).”
BackgroundLinguistic Features Identify Alzheimer’s Disease in Narrative Speech
Fraser, K. C., Meltzer, J. A., & Rudzicz, F. (2015) · Journal of Alzheimer's Disease · doi:10.3233/jad-150520 · Cited by 797
Self-citationSnowdon, D. A. (1996) · JAMA · doi:10.1001/jama.1996.03530310034029 · Cited by 696 · cited 1×
“As a result, subtle changes in language have been observed years or even decades before dementia is diagnosed (Snowdon et al., 1996; Garrard et al., 2004; Cuetos et al., 2007; Clark et al., 2009; Le et al., 2011; Ahmed et al., 2013a).”
BackgroundThe Natural History of Alzheimer's Disease: Description of Study Cohort and Accuracy of Diagnosis
Becker, J. T. (1994) · Archives of Neurology · doi:10.1001/archneur.1994.00540180063015 · Cited by 576
Automatic speech analysis for the assessment of patients with predementia and Alzheimer's disease
König, A., Satt, A., Sorin, A., Hoory, R., Toledo‐Ronen, O., Derreumaux, A., Manera, V., Verhey, F., Aalten, P., Robert, P. H., et al. (2015) · Alzheimer's & Dementia: Diagnosis, Assessment & Disease Monitoring · doi:10.1016/j.dadm.2014.11.012 · Cited by 380
Connected speech as a marker of disease progression in autopsy-proven Alzheimer’s disease
Ahmed, S., Haigh, A.-M. F., de Jager, C. A., & Garrard, P. (2013) · Brain · doi:10.1093/brain/awt269 · Cited by 362 · cited 9×
“Ahmed et al. (2013b) analyzed Cookie Theft narratives from 18 English-speaking participants in the early stages of AD and 18 matched controls. They extracted the same 23 information units as Croisile et al. (1996), as well as measures of idea density (i.e. the number of information units per word in the narrative) and…”
BackgroundInfluentialGoldberg, T. E., Harvey, P. D., Wesnes, K. A., Snyder, P. J., & Schneider, L. S. (2015) · Alzheimer's & Dementia: Diagnosis, Assessment & Disease Monitoring · doi:10.1016/j.dadm.2014.11.003 · Cited by 343
Reisberg, B., & Gauthier, S. (2007) · International Psychogeriatrics · doi:10.1017/s1041610207006412 · Cited by 338 · cited 1×
“In many cases, before the impairment is severe enough to be classified as dementia, an individual may experience a phase of subjective cognitive impairment (SCI; characterized by an individual’s subjective experience of cognitive decline, but with no measurable deficit observed on standardized tests), or mild cognitiv…”
BackgroundLongitudinal Verbal Fluency in Normal Aging, Preclinical, and Prevalent Alzheimer’s Disease
Clark, L. J., Gatz, M., Zheng, L., Chen, Y.-L., McCleary, C., & Mack, W. J. (2009) · American Journal of Alzheimer's Disease & Other Dementias® · doi:10.1177/1533317509345154 · Cited by 318 · cited 1×
“As a result, subtle changes in language have been observed years or even decades before dementia is diagnosed (Snowdon et al., 1996; Garrard et al., 2004; Cuetos et al., 2007; Clark et al., 2009; Le et al., 2011; Ahmed et al., 2013a).”
BackgroundInnovative diagnostic tools for early detection of Alzheimer's disease
Laske, C., Sohrabi, H. R., Frost, S. M., López-de-Ipiña, K., Garrard, P., Buscema, M., Dauwels, J., Soekadar, S. R., Mueller, S., Linnemann, C., et al. (2015) · Alzheimer's & Dementia · doi:10.1016/j.jalz.2014.06.004 · Cited by 316
Forbes-McKay, K. E., & Venneri, A. (2005) · Neurological Sciences · doi:10.1007/s10072-005-0467-9 · Cited by 261
Szatloczki, G., Hoffmann, I., Vincze, V., Kalman, J., & Pakaski, M. (2015) · Frontiers in Aging Neuroscience · doi:10.3389/fnagi.2015.00195 · Cited by 249 · cited 1×
“However, recent work has suggested that analysis of speech and language may lead to the discovery of sensitive and non-invasive behavioural biomarkers of dementia and MCI (Szatloczki et al., 2015; Laske et al., 2015; Alberdi et al., 2016; Alm, 2016).”
BackgroundPredicting mild cognitive impairment from spontaneous spoken utterances
Asgari, M., Kaye, J., & Dodge, H. (2017) · Alzheimer's & Dementia: Translational Research & Clinical Interventions · doi:10.1016/j.trci.2017.01.006 · Cited by 185
Aided diagnosis of dementia type through computer-based analysis of spontaneous speech
Jarrold, W., Peintner, B., Wilkins, D., Vergryi, D., Richey, C., Gorno-Tempini, M. L., & Ogar, J. (2014) · Proceedings of the Workshop on Computational Linguistics and Clinical Psychology: From Linguistic Signal to Clinical Reality · doi:10.3115/v1/w14-3204 · Cited by 178
Predicting probable Alzheimer's disease using linguistic deficits and biomarkers
Orimaye, S. O., Wong, J. S.-M., Golden, K. J., Wong, C. P., & Soyiri, I. N. (2017) · BMC Bioinformatics · doi:10.1186/s12859-016-1456-0 · Cited by 158
Orimaye, S. O., Wong, J. S.-M., & Golden, K. J. (2014) · Proceedings of the Workshop on Computational Linguistics and Clinical Psychology: From Linguistic Signal to Clinical Reality · doi:10.3115/v1/w14-3210 · Cited by 116 · cited 2×
“…individuals with cognitive impairment (for example, Thomas et al., 2005; Roark et al., 2011; Jarrold et al., 2014; Rentoumi et al., 2014; Garrard et al., 2014; Orimaye et al., 2014; Prud’hommeaux and Roark, 2015; K€onig et al., 2015; Fraser et al., 2016; Asgari et al., 2017; Masrani et al., 2017).”
BackgroundInfluentialThomas, C., Keselj, V., Cercone, N., Rockwood, K., & Asp, E. (2006) · IEEE International Conference Mechatronics and Automation, 2005 · doi:10.1109/icma.2005.1626789 · Cited by 110
Linguistic changes in verbal expression: A preclinical marker of Alzheimer's disease
CUETOS, F., ARANGO-LASPRILLA, J. C., URIBE, C., VALENCIA, C., & LOPERA, F. (2007) · Journal of the International Neuropsychological Society · doi:10.1017/s1355617707070609 · Cited by 102
Machine learning approaches to diagnosis and laterality effects in semantic dementia discourse
Garrard, P., Rentoumi, V., Gesierich, B., Miller, B., & Gorno-Tempini, M. L. (2014) · Cortex · doi:10.1016/j.cortex.2013.05.008 · Cited by 87 · cited 1×
“…subjective experience of cognitive decline, but with no measurable deficit observed on standardized tests), or mild cognitive impairment (MCI; characterized by a mild but clinically observable deficit in at least one cognitive domain) (Gauthier et al., 2006; Reisberg and Gauthier, 2008).”
BackgroundPakhomov, S. V. S., Smith, G. E., Chacon, D., Feliciano, Y., Graff-Radford, N., Caselli, R., & Knopman, D. S. (2010) · Cognitive and Behavioral Neurology · doi:10.1097/wnn.0b013e3181c5dde3 · Cited by 64 · cited 1×
“One approach to scoring information content was developed by Prud’hommeaux and Roark (2015), and involves selecting a picture description from the control group to act as the “source narrative”, and then using a graph-based alignment algorithm to determine how well each other narrative in the corpus recalls the story…”
BackgroundVector-space topic models for detecting Alzheimer's disease
Yancheva, M., & Rudzicz, F. (2016) · Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p16-1221 · Cited by 57
Cited by
Speech- and language-based classification of Alzheimer's disease: a systematic review
Vigo, I., Coelho, L., & Reis, S. (2022) · Bioengineering · doi:10.3390/bioengineering9010027 · Cited by 83
An automatic Alzheimer’s disease classifier based on spontaneous spoken English
Bertini, F., Allevi, D., Lutero, G., Calzà, L., & Montesi, D. (2022) · Computer Speech & Language · doi:10.1016/j.csl.2021.101298 · Cited by 66
Lindsay, H., Tröger, J., & König, A. (2021) · Frontiers in Aging Neuroscience · doi:10.3389/fnagi.2021.642033 · Cited by 64
“This has been shown to be effective at identifying AD patients in previous literature (Dessouky et al., 2014; Rudzicz et al., 2014; Satt et al., 2014; Fraser et al., 2018; Panyavaraporn and Paramate, 2018; de la Fuente Garcia et al., 2020; Meghanani and Ramakrishnan, 2021).”
BackgroundMethodResultInfluentialde la Fuente Garcia, S., Ritchie, C. W., & Luz, S. (2020) · Journal of Alzheimer's Disease · doi:10.3233/jad-200888 · Cited by 5
“Exceptionally, two of these studies work with written rather than spoken language [87, 88].”
BackgroundMethodInfluential
Metadata
- Authors
- Fraser, K. C., Lundholm Fors, K., & Kokkinakis, D.
- Venue
- Computer Speech & Language
- Publisher
- Elsevier BV
- Published
- 2019-01
- Volume
- 53
- Pages
- 121-139
- ISSN
- 0885-2308 (ISSN-L)
- OpenAlex
- W2886542723
- Cited by
- 51
- References
- 22
- FWCI
- 4.51
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.