Detecting Alzheimer’s Disease Using Interactional and Acoustic Features from Spontaneous Speech
The DOI matches its Crossref record; 26 of the 26 references it cites were found in a registry or an index.
Abstract
Alzheimer's Disease (AD) is a form of Dementia that manifests in cognitive decline including memory, language, and changes in behavior.Speech data has proven valuable for inferring cognitive status, used in many health assessment tasks, and can be easily elicited in natural settings.Much work focuses on analysis using linguistic features; here, we focus on non-linguistic features and their use in distinguishing AD patients from similar-age Non-AD patients with other health conditions in the Carolinas Conversation Collection (CCC) dataset.We used two types of features: patterns of interaction including pausing behaviour and floor control, and acoustic features including pitch, amplitude, energy, and cepstral coefficients.Fusion of the two kinds of features, combined with feature selection, obtains very promising classification results: classification accuracy of 90% using standard models such as support vector machines and logistic regression.We also obtain promising results using interactional features alone (87% accuracy), which can be easily extracted from natural conversations in daily life and thus have the potential for future implementation as a noninvasive method for AD diagnosis and monitoring.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“For example, support vector machines have demonstrated particular efficacy in identifying imaging biomarkers associated with frontotemporal dementia.75”
From Review of Artificial Intelligence for Clinical Use in Alzheimer's Disease and Related Dementias (2026) · cites this paper as [75]
Citations
Cites
Scikit-learn: Machine Learning in Python
Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., Blondel, M., Müller, A., Nothman, J., Louppe, G., et al. (2012) · arXiv · doi:10.48550/arxiv.1201.0490 · Cited by 71,016 · cited 1×
“We used the recursive feature elimination (RFE) method, an iterative process that removes a specific number of features, and examines the effect on classification accuracy [26].”
MethodSagi, O., & Rokach, L. (2018) · WIREs Data Mining and Knowledge Discovery · doi:10.1002/widm.1249 · Cited by 3,103 · cited 1×
“The prediction scores of each classifier are then combined using a standard soft voting ensemble method [29]: soft voting computes the average probability for each class over each component classifier and eventually bases the final prediction on maximum average probability.”
MethodCurrent understanding of Alzheimer’s disease diagnosis and treatment
Weller, J., & Budson, A. (2018) · F1000Research · doi:10.12688/f1000research.14506.1 · Cited by 1,083 · cited 1×
“Currently, standard AD diagnosis methods include clinical assessments complemented with family history, neuropsychological tests (including the Mini-Mental State Examination (MMSE) [4] and many others), self-report questionnaires, MRI [5] and Positron Emission Tomography (PET) [6].”
MethodLinguistic Features Identify Alzheimer’s Disease in Narrative Speech
Fraser, K. C., Meltzer, J. A., & Rudzicz, F. (2015) · Journal of Alzheimer's Disease · doi:10.3233/jad-150520 · Cited by 797 · cited 1×
“Linguistic variables are used to describe the quantitative and qualitative aspects of language production, for example via the decline in lexical-semantic abilities, word comprehension, verbal fluency, and syntactic processing for particular kinds of tasks such as picture description [7, 8].”
MethodConnected Speech in Neurodegenerative Language Disorders: A Review
Boschi, V., Catricalà, E., Consonni, M., Chesi, C., Moro, A., & Cappa, S. F. (2017) · Frontiers in Psychology · doi:10.3389/fpsyg.2017.00269 · Cited by 362 · cited 1×
“Linguistic variables are used to describe the quantitative and qualitative aspects of language production, for example via the decline in lexical-semantic abilities, word comprehension, verbal fluency, and syntactic processing for particular kinds of tasks such as picture description [7, 8].”
MethodGarcía, S. D. L. F., Ritchie, C. W., & Luz, S. F. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.06047 · Cited by 265 · cited 1×
“This use of interaction cues has the potential to be more versatile in AD prediction and monitoring in more daily life settings than individual language tasks [20, 21].”
BackgroundForbes-McKay, K. E., & Venneri, A. (2005) · Neurological Sciences · doi:10.1007/s10072-005-0467-9 · Cited by 261 · cited 1×
“The most prominent associations with AD are disparity in language production, speech comprehension, impaired reasoning, and memory functions, resulting in reduced vocabulary, verbal fluency, and difficulty performing daily tasks related to semantic information [3].”
BackgroundBeltrami, D., Gagliardi, G., Rossini Favretti, R., Ghidoni, E., Tamburini, F., & Calzà, L. (2018) · Frontiers in Aging Neuroscience · doi:10.3389/fnagi.2018.00369 · Cited by 175 · cited 2×
“Standardized phonation time (SPT) and transformed phonation rate (TPR) also show significant differences between the two groups, con-firming findings in the literature [12].”
BackgroundSpeech in Alzheimer's Disease: Can Temporal and Acoustic Parameters Discriminate Dementia?
Meilán, J. J. G., Martínez-Sánchez, F., Carro, J., López, D. E., Millian-Morell, L., & Arana, J. M. (2014) · Dementia and Geriatric Cognitive Disorders · doi:10.1159/000356726 · Cited by 152 · cited 1×
“…feature was LogHNR, known to be important in acoustic analysis for the diagnosis of pathological voices; loudness, raw fundamental frequency, variation in jitter, intensity, and LogHNR all positively correlate with AD and have been reported as useful features in literature for Dementia [31, 9].”
BackgroundElsey, C., Drew, P., Jones, D., Blackburn, D. J., Wakefield, S., Harkness, K., Venneri, A., & Reuber, M. (2015) · Patient Education and Counseling · doi:10.1016/j.pec.2015.05.021 · Cited by 129 · cited 1×
“Conversation Analysis (CA) studies show that dialogue with dementia has characteristic features that would be missed if analyzing only individual speech [15, 16], but these studies are generally qualitative and/or small-scale.”
BackgroundFinding a balance: The Carolinas Conversation Collection
Pope, C., & Davis, B. H. (2011) · Corpus Linguistics and Linguistic Theory · doi:10.1515/cllt.2011.007 · Cited by 110 · cited 1×
“Dataset The Carolinas Conversation Collection (CCC) [30] consists of audios and transcripts of conversations between health care professionals and patients with chronic diseases including AD.”
BackgroundDementia detection using automatic analysis of conversations
Mirheidari, B., Blackburn, D., Walker, T., Reuber, M., & Christensen, H. (2019) · Computer Speech & Language · doi:10.1016/j.csl.2018.07.006 · Cited by 82 · cited 2×
“However, work so far either looks only at interaction rather than combining it with other modalities (e.g. [ 17]) or relies on particular interactional settings such as interviews with chosen topics or question types (e.g. [ 18]).”
BackgroundAlzheimer’s Dementia Recognition From Spontaneous Speech Using Disfluency and Interactional Features
Nasreen, S., Rohanian, M., Hough, J., & Purver, M. (2021) · Frontiers in Computer Science · doi:10.3389/fcomp.2021.640669 · Cited by 56 · cited 1×
“The annotation protocol for these interactional features is described in [23] for AD classifi-cation: 31 features in total are extracted based on this protocol from audio and transcript data as shown in Table 1.”
MethodSelf-citationDetecting Alzheimer’s Disease Using Gated Convolutional Neural Network from Audio Data
Warnita, T., Inoue, N., & Shinoda, K. (2018) · Interspeech 2018 · doi:10.21437/interspeech.2018-1713 · Cited by 48
Identification of digital voice biomarkers for cognitive health
Lin, H., Karjadi, C., Ang, T. F. A., Prajakta, J., McManus, C., Alhanai, T. W., Glass, J., & Au, R. (2020) · Exploration of Medicine · doi:10.37349/emed.2020.00028 · Cited by 39 · cited 3×
“AD-related changes can also affect acoustic features of speech, suggesting that speech analysis could provide measures of early disease progression [9].”
BackgroundMethodInvestigating the Effect of Audio Duration on Dementia Detection Using Acoustic Features
Weiner, J., Angrick, M., Umesh, S., & Schultz, T. (2018) · Interspeech (USB) · doi:10.21437/interspeech.2018-57 · Cited by 31 · cited 1×
“Several studies have used language-independent acoustic features only, achieving comparable accuracy to linguistic approaches [10, 11]; AD patients can show patterns of frequent hesitation, longer pauses, lower articulation and speech rates, and lower floor control ratio [12].”
Backgroundde la Fuente Garcia, S., Ritchie, C. W., & Luz, S. (2019) · BMJ Open · doi:10.1136/bmjopen-2018-026254 · Cited by 25 · cited 1×
“Garcia et al. [19] develop a protocol based on dialogue conversations to investigate early behavioral signs of AD.”
BackgroundIdentification of Dementia Using Audio BiomarkersPreprint
Chakraborty, R., Pandharipande, M. A., Bhat, C. G., & Kopparapu, S. K. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.12788 · Cited by 21 · cited 1×
“Several studies have used language-independent acoustic features only, achieving comparable accuracy to linguistic approaches [10, 11]; AD patients can show patterns of frequent hesitation, longer pauses, lower articulation and speech rates, and lower floor control ratio [12].”
BackgroundAlzheimer's Dementia Detection from Audio and Text ModalitiesPreprint
Campbell, E. L., Docío-Fernández, L., Jiménez-Raboso, J., & Mateo, C. G. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2008.04617 · Cited by 19 · cited 1×
“Some work has taken a multimodal approach to AD classification: Campbell et al. [14] examined two fusion strategies with linguistic features and acoustic features, achieving 75% accuracy.”
BackgroundThe question‐answer adjacency pair in dementia discourse
Suárez, A. V. (2017) · International Journal of Applied Linguistics · doi:10.1111/ijal.12185 · Cited by 14 · cited 1×
“Conversation Analysis (CA) studies show that dialogue with dementia has characteristic features that would be missed if analyzing only individual speech [15, 16], but these studies are generally qualitative and/or small-scale.”
BackgroundPredicting Alzheimer’s Disease
Straiton, J. (2019) · BioTechniques · doi:10.2144/btn-2019-0114 · Cited by 9
Addlesee, A., Eshghi, A., & Konstas, I. (2019) · arXiv · doi:10.48550/arxiv.1909.06644 · Cited by 7 · cited 1×
“This use of interaction cues has the potential to be more versatile in AD prediction and monitoring in more daily life settings than individual language tasks [20, 21].”
Backgroundde la Fuente Garcia, S., Ritchie, C. W., & Luz, S. (2020) · Journal of Alzheimer's Disease · doi:10.3233/jad-200888 · Cited by 5 · cited 1×
“This use of interaction cues has the potential to be more versatile in AD prediction and monitoring in more daily life settings than individual language tasks [20, 21].”
BackgroundEarly and Late Fusion of Classifiers for the MediaEval Medico Task.
Taschwer, M., Primus, M. J., Schoeffmann, K., & Marques, O. (2018) · MediaEval · Cited by 4
A Relevance-theoretic Approach to Turn Silence
Wang, C. (2019) · International Conference on Contemporary Education, Social Sciences and Humanities (ICCESSH) · doi:10.2991/iccessh-19.2019.241 · Cited by 4 · cited 1×
“Attributable silence (AS) duration is also positively correlated with AD, showing that AD patients exhibit more silences in response to questions; this fits with the findings of CA studies in the literature that this form of silence serves as a dispreferred response in communication [22, 32].”
ResultUsing text and acoustic features to diagnose Mild Cognitive Impairment and Alzheimer’s diseasePreprint
Liu, N., & Luo, K. (2020) · Research Square · doi:10.21203/rs.3.rs-92702/v1 · Cited by 1 · cited 1×
“Other acoustic features including prosodic, energy-based, spectral, and spectral aspects (jitter, shimmer, harmonics-to-noise ratio, Mel-frequency cepstral coefficients (MFCCs) can also correlate with AD [13].”
Background
Cited by
Ouyang, X., Shuai, X., Li, Y., Pan, L., Zhang, X., Fu, H., Cheng, S., Wang, X., Cao, S., Xin, J., et al. (2024) · ACM Annual International Conference on Mobile Computing and Networking (MobiCom) · doi:10.1145/3636534.3649370 · Cited by 86
“First, existing work is focused on a particular type of digital biomarker, such as motor function [17, 29], speech features [35, 44], or driving habits [12], which lacks generalizability to subjects with various demographic and medical characteristics.”
BackgroundMultimodal fusion for alzheimer’s disease recognition
Ying, Y., Yang, T., & Zhou, H. (2022) · Applied Intelligence · doi:10.1007/s10489-022-04255-z · Cited by 68
“While in AD recognition, designing AD-specific characteristics such as disfluencies, pause time are more reasonable [18–20].”
BackgroundNoninvasive automatic detection of Alzheimer's disease from spontaneous speech: a review
Qi, X., Zhou, Q., Dong, J., & Bao, W. (2023) · Frontiers in Aging Neuroscience · doi:10.3389/fnagi.2023.1224723 · Cited by 59
“…features include pauses (Yuan et al., 2020; Rohanian et al., 2021; Zhu et al., 2021), disfluency (Sarawgi et al., 2020; Qiao et al., 2021; Rohanian et al., 2021), interactional features (Nasreen et al., 2021a), cognition features (Sarawgi et al., 2020), ADR features (Martinc et al., 2021).”
BackgroundHuang, G., Li, R., Bai, Q., & Alty, J. (2023) · Health Information Science and Systems · doi:10.1007/s13755-023-00231-0 · Cited by 46
Voice biomarkers as indicators of cognitive changes in middle and later adulthood
Mahon, E., & Lachman, M. E. (2022) · Neurobiology of Aging · doi:10.1016/j.neurobiolaging.2022.06.010 · Cited by 42
Metadata
- Authors
- Nasreen, S., Hough, J., & Purver, M.
- Affiliations
- Queen Mary University of London (GB)
- Venue
- Interspeech 2021
- Publisher
- ISCA
- Published
- 2021-08-30
- Pages
- 1962-1966
- ISSN
- 2308-457X (ISSN-L)
- OpenAlex
- W3197699225
- Cited by
- 22
- References
- 26
- Citations by year
- 2026: 2 · 2025: 3 · 2024: 7 · 2023: 3 · 2022: 7
- FWCI
- 9.24
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- Interspeech (USB) (publishedVersion)
- Cronfa (Swansea University) (submittedVersion)
- Queen Mary Research Online (Queen Mary University of London) (submittedVersion)
- Funders
- European Commission (HORIZON2020, 825153, 769661)
- Engineering and Physical Sciences Research Council (EP/S033564/1)
- Topics
- Health Sciences › Medicine › Psychiatry and Mental health › Dementia and Cognitive Impairment Research
- Physical Sciences › Computer Science › Artificial Intelligence › Emotion and Mood Recognition
- Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
- Keywords
- Alzheimer's disease detection, dementia, spontaneous speech, interactional features, acoustic features, floor control, pitch, cepstral coefficients, feature fusion, feature selection, speech-based diagnosis
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.