Identifying mild cognitive impairment and mild Alzheimer’s disease based on spontaneous speech using ASR and linguistic features
Abstract
Alzheimer’s disease (AD) is a neurodegenerative disorder that develops for years before clinical manifestation, while mild cognitive impairment is clinically considered as a prodromal stage of AD. For both types of neurodegenerative disorders, early diagnosis is crucial for the timely treatment and to decelerate progression. Unfortunately, the current diagnostic solutions are time-consuming. Here, we seek to exploit the observation that these illnesses frequently disturb the mental and linguistic functions, which might be detected from the spontaneous speech produced by the patient. First, we present an automatic speech recognition based procedure for the extraction of a special set of acoustic features. Second, we present a linguistic feature set that is extracted from the transcripts of the same speech signals. The usefulness of the two feature sets is evaluated via machine learning experiments, where our goal is not only to differentiate between the patients and the healthy control group, but also to tell apart Alzheimer’s patients from those with mild cognitive impairment. Our results show that based on only the acoustic features, we are able to separate the various groups with accuracy scores between 74–82%. We attained similar accuracy scores when using only the linguistic features. With the combination of the two types of features, the accuracy scores rise to between 80–86%, and the corresponding F1 values also fall between 78–86%. We hope that with the full automation…
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Out of 51 reviewed papers, only seven did three-way or four-way classification.
“Out of 51 reviewed papers, only seven did attempt three-way [50, 62–64] or four-way [12, 65, 66] classification.”
From Artificial Intelligence, Speech, and Language Processing Approaches to Monitoring Alzheimer’s Disease: A Systematic Review (2020) · cites this paper as [63]
Seven reviewed papers are concerned with three or four disease stages.
“Outside of those, seven papers are concerned with three or four disease stages [12, 50, 62–66], two explore longitudinal cognitive changes (although still through binary classification) [67, 68], and one describes discourse patterns [69].”
From Artificial Intelligence, Speech, and Language Processing Approaches to Monitoring Alzheimer’s Disease: A Systematic Review (2020) · cites this paper as [63]
Egas López et al. reported 56% and Gosztolya et al. 66.7% for 3-way classification in balanced datasets.
“Other studies attempting 3-way classification experiments in balanced datasets are Egas López et al. [62], 56% and Gosztolya et al. [63] with 66.7%.”
From Artificial Intelligence, Speech, and Language Processing Approaches to Monitoring Alzheimer’s Disease: A Systematic Review (2020) · cites this paper as [63]
Off-the-shelf ASR tools are not readily prepared for dementia research, and therefore some reviewed studies developed their own custom ASR systems.
“It is becoming increasingly obvious that off-the-shelf ASR tools are not readily prepared for dementia research, and therefore some reviewed studies developed their own custom ASR systems [44, 63].”
From Artificial Intelligence, Speech, and Language Processing Approaches to Monitoring Alzheimer’s Disease: A Systematic Review (2020) · cites this paper as [63]
The main strategies used to address class imbalance are subsampling, stratified CV, and careful choice of evaluation methods including the UAR metric and ROC curve analysis.
“In the studies that seek to address class imbalance in their datasets, the main strategies used are subsampling [11, 60], use of statistical methods such as stratified CV [74], and careful choice of evaluation methods including use of the UAR metric [63] and ROC curve analysis [97].”
From Artificial Intelligence, Speech, and Language Processing Approaches to Monitoring Alzheimer’s Disease: A Systematic Review (2020) · cites this paper as [63]
The citation lists haven’t been fetched yet
References 96 · Cited by 196
- Authors
- Gosztolya, G., Vincze, V., Tóth, L., Pákáski, M., Kálmán, J., & Hoffmann, I.
- Affiliations
- MTA-SZTE Research Group on Artificial Intelligence (HU)
- University of Szeged (HU)
- Corresponding author
- Gosztolya, Gábor
- Venue
- Computer Speech & Language
- Publisher
- Elsevier BV
- Published
- 2019-01
- Volume
- 53
- Pages
- 181-197
- ISSN
- 0885-2308 (ISSN-L)
- OpenAlex
- W2887590219
- Cited by
- 196
- References
- 96
- Citations by year
- 2026: 17 · 2025: 21 · 2024: 23 · 2023: 37 · 2022: 30 · 2021: 35 · 2020: 24 · 2019: 8
- FWCI
- 13.17
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Computer Speech & Language (publishedVersion)
- SZTE Publicatio Repozitórium (University of Szeged) (acceptedVersion)
- Topics
- Health Sciences › Medicine › Psychiatry and Mental health › Dementia and Cognitive Impairment Research
- Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
- Health Sciences › Health Professions › Health Information Management › Artificial Intelligence in Healthcare
- Keywords
- mild cognitive impairment, Alzheimer's disease, spontaneous speech, speech recognition, acoustic features, linguistic features, early diagnosis, automated screening, neurodegenerative diseases, feature fusion
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review