Identifying and Avoiding Confusion in Dialogue with People with Alzheimer's Disease
Open accessThe DOI matches its Crossref record; 65 of the 66 references it cites were found in a registry or an index.
Abstract
Alzheimer's disease (AD) is an increasingly prevalent cognitive disorder in which memory, language, and executive function deteriorate, usually in that order. There is a growing need to support individuals with AD and other forms of dementia in their daily lives, and our goal is to do so through speech-based interaction. Given that 33% of conversations with people with middle-stage AD involve a breakdown in communication, it is vital that automated dialogue systems be able to identify those breakdowns and, if possible, avoid them. In this article, we discuss several linguistic features that are verbal indicators of confusion in AD (including vocabulary richness, parse tree structures, and acoustic cues) and apply several machine learning algorithms to identify dialogue-relevant confusion from speech with up to 82% accuracy. We also learn dialogue strategies to avoid confusion in the first place, which is accomplished using a partially observable Markov decision process and which obtains accuracies (up to 96.1%) that are significantly higher than several baselines. This work represents a major step towards automated dialogue systems for individuals with dementia.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures













Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“In [108], ML algorithms have been applied to identify dialog-related confusion from speech with individuals with Alzheimer's disease; accuracies above 80% were obtained and learn policies implemented to avoid conversation breakdowns.”
From Conversational Affective Social Robots for Ageing and Dementia Support (2022) · cites this paper as [108]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Some recent work has used reinforcement learning to learn policies that can at least limit those instances [5].”
From A Conversational Robot for Older Adults with Alzheimer's Disease (2020) · cites this paper as [5]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Several linguistic features were extracted as verbal indicators of confusion (e.g., vocabulary richness, parse tree structures, and acoustic cues).”
From Conversational Affective Social Robots for Ageing and Dementia Support (2022) · cites this paper as [108]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Folstein, M. F., Folstein, S. E., & McHugh, P. R. (1975) · Journal of Psychiatric Research · doi:10.1016/0022-3956(75)90026-6 · Cited by 88,282 · cited 1×
“…provides a unified and validated scale for measuring the severity of dementia on a scale of 0 (greatest cognitive decline) to 30 (no cognitive decline), based on a series of questions in five areas: orientation, registration, attention, memory, and language (Folstein, Folstein, and McHugh 1975).”
BackgroundSMOTE synthetic minority over-sampling technique
Chawla, N. V., Bowyer, K. W., Hall, L. O., & Kegelmeyer, W. P. (2002) · Journal of Artificial Intelligence Research · doi:10.1613/jair.953 · Cited by 32,865 · cited 1×
“In this experiment, we generate synthetic data points using the synthetic minority oversampling technique (SMOTE), which under-samples the majority class and over-samples the minority class by creating synthetic minority class examples (Chawla et al. 2002).”
MethodWordNet: a lexical database for English
Miller, G. A. (1995) · Communications of the ACM · doi:10.1145/219717.219748 · Cited by 14,015
The Preference for Self-Correction in the Organization of Repair in Conversation
Schegloff, E. A., Jefferson, G., & Sacks, H. (1977) · Language · doi:10.2307/413107 · Cited by 5,150 · cited 1×
“The trouble source-repair (TSR) model describes difficulties in communication in any dyads, including how repairs are initiated and carried out (Schegloff, Jefferson, and Sacks 1977).”
MethodRecognizing contextual polarity in phrase-level sentiment analysis
Wilson, T., Wiebe, J., & Hoffmann, P. (2005) · Proceedings of the conference on Human Language Technology and Empirical Methods in Natural Language Processing - HLT '05 · doi:10.3115/1220575.1220619 · Cited by 3,345 · cited 1×
“We also compute objectivity measures using the MPQA Subjectivity Lexicon (Wilson, Wiebe, and Hoffmann 2005), which categorizes words by their subjectivity (strong or weak) and their prior, out-of-context, polarity (positive, negative, both, or neutral).”
MethodThe assessment of aphasia and related disorders
Goodglass, H., & Kaplan, E. (1972) · Medical Entomology and Zoology · Cited by 3,258
Accurate unlexicalized parsing
Klein, D., & Manning, C. D. (2003) · Proceedings of the 41st Annual Meeting on Association for Computational Linguistics - ACL '03 · doi:10.3115/1075096.1075150 · Cited by 3,008 · cited 1×
“Lu’s Syntactic Complexity Analyzer was initially designed to measure the syntactic complexity of second-language writing and, in turn, uses the Stanford parser (Klein and Manning 2003).”
MethodFeature-rich part-of-speech tagging with a cyclic dependency network
Toutanova, K., Klein, D., Manning, C. D., & Singer, Y. (2003) · Proceedings of the 2003 Conference of the North American Chapter of the Association for Computational Linguistics on Human Language Technology - NAACL '03 · doi:10.3115/1073445.1073478 · Cited by 2,844 · cited 2×
“We include various part-of-speech (POS) features, such as the proportion of nouns, verbs, light verbs, adjectives, adverbs, prepositional words, demonstratives, functional words generally, and the noun-to-verb ratio, obtained using the Stanford POS tagger (Toutanova et al. 2003).”
MethodBrysbaert, M., & New, B. (2009) · Behavior Research Methods · doi:10.3758/brm.41.4.977 · Cited by 2,821
SWITCHBOARD: telephone speech corpus for research and development
Godfrey, J. J., Holliman, E. C., & McDaniel, J. (1992) · [Proceedings] ICASSP-92: 1992 IEEE International Conference on Acoustics, Speech, and Signal Processing · doi:10.1109/icassp.1992.225858 · Cited by 2,134 · cited 1×
“To estimate statistical deviations from typical language, we also compute the average log probability of each word in each utterance given two trigram models with Good-Turing smoothing, from the Brown and Switchboard (Godfrey, Holliman, and McDaniel 1992) corpora, respectively.”
Method
Research works printed but not linked: 2
- Choi, J. and K.E. Kim. 2011. Inverse reinforcement learning in partially observable environments. Journal of Machine Learning Research, 12:691–730.
- 10.1353/lan.1977.0041 · doi:10.1353/lan.1977.0041 · Paper page
Cited by
Artificial intelligence and the implementation challenge
Shaw, J., Rudzicz, F., Jamieson, T., & Goldfarb, A. (2019) · Journal of Medical Internet Research · doi:10.2196/13659 · Cited by 389
“…ML can dynamically adapt survey questions to more quickly identify possible diseases [17], dynamically avoid potential communication breakdowns during speech conversation in the assessment of dementia [18], and even recommend treatments directly when using structured institutional data [19].”
BackgroundSelf-citationLinguistic features and automatic classifiers for identifying mild cognitive impairment and dementia
Calzà, L., Gagliardi, G., Rossini Favretti, R., & Tamburini, F. (2021) · Computer Speech & Language · doi:10.1016/j.csl.2020.101113 · Cited by 89
Conversational Affective Social Robots for Ageing and Dementia Support
Lima, M. R., Wairagkar, M., Gupta, M., Rodriguez y Baena, F., Barnaghi, P., Sharp, D. J., & Vaidyanathan, R. (2022) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2021.3115228 · Cited by 75
“In [108], ML algorithms have been applied to identify dialog-related confusion from speech with individuals with Alzheimer’s disease; accuracies above 80% were obtained and learn policies implemented to avoid conversation breakdowns.”
BackgroundA Conversational Robot for Older Adults with Alzheimer's Disease
Pou-Prom, C., Raimondo, S., & Rudzicz, F. (2020) · ACM Transactions on Human-Robot Interaction · doi:10.1145/3380785 · Cited by 59
“Some recent work has used reinforcement learning to learn policies that can at least limit those instances [5].”
BackgroundSelf-citationKobayashi, M., Kosugi, A., Takagi, H., Nemoto, M., Nemoto, K., Arai, T., & Yamada, Y. (2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-29390-1_4 · Cited by 45
“Rudzicz et al. [39] and Chinaei et al. [40] built a computational model that aimed to exploit linguistic and acoustic features to detect a breakdown in conversations.”
Metadata
- Authors
- Chinaei, H., Currie, L. C., Danks, A., Lin, H., Mehta, T., & Rudzicz, F.
- Affiliations
- University of Toronto (CA)
- Venue
- Computational Linguistics
- Publisher
- MIT Press
- Published
- 2017-06
- Volume
- 43
- Issue
- 2
- Pages
- 377-406
- ISSN
- 0891-2017 (ISSN-L)
- 1530-9312
- OpenAlex
- W2602799059
- Semantic Scholar
- 247fff8f5d3281a20f11d28df3c592bc4fa1e553
- Cited by
- 30
- References
- 66
- Citations by year
- 2026: 2 · 2025: 3 · 2024: 2 · 2023: 1 · 2022: 2 · 2021: 4 · 2020: 8 · 2019: 7 · 2018: 1
- FWCI
- 2.61
- Type
- journal article
- Language
- en
- Open access
- diamond
- doi.org
- Licence
- cc-by-nc-nd
- Locations
- Computational Linguistics (publishedVersion, cc-by-nc-nd)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- Funders
- University of Pittsburgh
- Carnegie Mellon University
- AGE-WELL
- Alzheimer Society
- National Institutes of Health (AG005133, AG005133 and AG003705)
- Natural Sciences and Engineering Research Council of Canada (RGPIN 435874)
- National Institute on Deafness and Other Communication Disorders (DC008524, R01DC008524)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Health Sciences › Medicine › Psychiatry and Mental health › Dementia and Cognitive Impairment Research
- Social Sciences › Arts and Humanities › Language and Linguistics › Language, Discourse, Communication Strategies
- Keywords
- Alzheimer's disease, dementia, communication breakdown, confusion detection, speech-based interaction, dialogue strategies, lexical diversity, acoustic cues, partially observable Markov decision processes, conversational support
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Identifying and Avoiding Confusion in Dialogue with People with Alzheimer's Disease. https://app.cochat.ai/papers/10.1162/coli_a_00290
- The paper
- Chinaei, H., Currie, L. C., Danks, A., Lin, H., Mehta, T., & Rudzicz, F. (2017). Identifying and Avoiding Confusion in Dialogue with People with Alzheimer's Disease. Computational Linguistics. https://doi.org/10.1162/coli_a_00290
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.