Computational Cognitive Assessment: Investigating the Use of an Intelligent Virtual Agent for the Detection of Early Signs of Dementia
The DOI matches its Crossref record; 23 of the 25 references it cites were found in a registry or an index.
Abstract
The ageing population has caused a marked increased in the number of people with cognitive decline linked with dementia. Thus, current diagnostic services are overstretched, and there is an urgent need for automating parts of the assessment process. In previous work, we demonstrated how a stratification tool built around an Intelligent Virtual Agent (IVA) eliciting a conversation by asking memory-probing questions, was able to accurately distinguish between people with a neuro-degenerative disorder (ND) and a functional memory disorder (FMD). In this paper, we extend the number of diagnostic classes to include healthy elderly controls (HCs) as well as people with mild cognitive impairment (MCI). We also investigate whether the IVA may be used for administering more standard cognitive tests, like the verbal fluency tests. A four-way classifier trained on an extended feature set achieved 48% accuracy, which improved to 62% by using just the 22 most significant features (ROC-AUC: 82%).
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Scikit-learn: Machine Learning in Python
Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., Blondel, M., Müller, A., Nothman, J., Louppe, G., et al. (2012) · arXiv · doi:10.48550/arxiv.1201.0490 · Cited by 71,016
Kaldi Speech Recognition Toolkit
Povey, D. (2024) · Infoscience (Ecole Polytechnique Fédérale de Lausanne) · doi:10.57702/jb3fvbn9 · Cited by 4,609
Probabilistic Linear Discriminant Analysis for Inferences About Identity
Prince, S. J. D., & Elder, J. H. (2007) · 2007 IEEE 11th International Conference on Computer Vision · doi:10.1109/iccv.2007.4409052 · Cited by 977
Diagnostic utility of abbreviated fluency measures in Alzheimer disease and vascular dementia
Canning, S. J. D., Leach, L., Stuss, D., Ngo, L., & Black, S. E. (2004) · Neurology · doi:10.1212/wnl.62.4.556 · Cited by 328
Rus-Calafell, M., Gutiérrez-Maldonado, J., & Ribas-Sabaté, J. (2014) · Journal of Behavior Therapy and Experimental Psychiatry · doi:10.1016/j.jbtep.2013.09.002 · Cited by 170
Avatar therapy for persecutory auditory hallucinations: What is it and how does it work?
Leff, J., Williams, G., Huckvale, M., Arbuthnot, M., & Leff, A. P. (2014) · Psychosis · doi:10.1080/17522439.2013.773457 · Cited by 148
Jones, D., Drew, P., Elsey, C., Blackburn, D., Wakefield, S., Harkness, K., & Reuber, M. (2016) · Aging & Mental Health · doi:10.1080/13607863.2015.1021753 · Cited by 146
Self-citationRelating Therapy for distressing auditory hallucinations: A pilot randomized controlled trial
Hayward, M., Jones, A.-M., Bogen-Johnston, L., Thomas, N., & Strauss, C. (2017) · Schizophrenia Research · doi:10.1016/j.schres.2016.11.019 · Cited by 128 · cited 1×
“Applications include use by people with mental health problems [5, 6, 7, 8], mild cognitive impairment (MCI) [9], Alzheimer's Disease (AD) [10, 11], and the healthy elderly [12].”
BackgroundDetecting Dementia Through Interactive Computer Avatars
Tanaka, H., Adachi, H., Ukita, N., Ikeda, M., Kazui, H., Kudo, T., & Nakamura, S. (2017) · IEEE Journal of Translational Engineering in Health and Medicine · doi:10.1109/jtehm.2017.2752152 · Cited by 127 · cited 1×
“designed an IVA with spoken dialogue for detecting the early signs of dementia [14].”
BackgroundForbes‐McKay, K., Ellis, A. W., Shanks, M. F., & Venneri, A. (2005) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2005.01.008 · Cited by 120
Self-citationElsey, C., Drew, P., Jones, D., Blackburn, D., Wakefield, S., Harkness, K., Venneri, A., & Reuber, M. (2015) · Patient Education and Counseling · doi:10.1016/j.pec.2015.05.021 · Cited by 114
Self-citationDetecting Signs of Dementia Using Word Vector Representations
Mirheidari, B., Blackburn, D., Walker, T., Venneri, A., Reuber, M., & Christensen, H. (2018) · Interspeech 2018 · doi:10.21437/interspeech.2018-1764 · Cited by 63
Self-citationPakhomov, S. V. S., & Hemmy, L. S. (2014) · Cortex · doi:10.1016/j.cortex.2013.05.009 · Cited by 61
Toward the Automation of Diagnostic Conversation Analysis in Patients with Memory Complaints
Mirheidari, B., Blackburn, D., Harkness, K., Walker, T., Venneri, A., Reuber, M., & Christensen, H. (2017) · Journal of Alzheimer’s Disease · doi:10.3233/jad-160507 · Cited by 54 · cited 3×
“Table 4 lists the names of the features with a brief description (for more details, please refer to [3, 4, 20, 22]).”
BackgroundMethodResultSelf-citationPakhomov, S., Eberly, L. E., & Knopman, D. S. (2016) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2016.05.031 · Cited by 47
Active ageing with avatars: a virtual exercise class for older adults
Cyarto, E. V., Batchelor, F., Baker, S., & Dow, B. (2016) · Proceedings of the 28th Australian Conference on Computer-Human Interaction - OzCHI '16 · doi:10.1145/3010915.3010944 · Cited by 31
An Avatar-Based System for Identifying Individuals Likely to Develop Dementia
Mirheidari, B., Blackburn, D., Harkness, K., Walker, T., Venneri, A., Reuber, M., & Christensen, H. (2017) · Interspeech 2017 · doi:10.21437/interspeech.2017-690 · Cited by 30
Self-citationNatural Interaction between Avatars and Persons with Alzheimer’s Disease
Carrasco, E., Epelde, G., Moreno, A., Ortiz, A., Garcia, I., Buiza, C., Urdaneta, E., Etxaniz, A., González, M. F., & Arruti, A. (2008) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-70540-6_5 · Cited by 27
Diagnosing People with Dementia Using Automatic Conversation Analysis
Mirheidari, B., Blackburn, D., Reuber, M., Walker, T., & Christensen, H. (2016) · Interspeech 2016 · doi:10.21437/interspeech.2016-857 · Cited by 25
Self-citationAvatars in Assistive Homes for the Elderly
Morandell, M. M., Hochgatterer, A., Fagel, S., & Wassertheurer, S. (2008) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-89350-9_27 · Cited by 23
Automatic Behavior Analysis During a Clinical Interview with a Virtual Human.
Rizzo, A., Lucas, G., Gratch, J. S., Stratou, G., Morency, L., Chavez, K., Shilling, R. D., & Scherer, S. J. (2016) · PubMed · Cited by 19
Avatar therapy: an audio-visual dialogue system for treating auditory hallucinations
Huckvale, M. A., Leff, J., & Williams, G. (2013) · Interspeech (USB) · doi:10.21437/interspeech.2013-107 · Cited by 14
Integrating 3D Facial Model with Person-Centered Care Support System for People with Dementia
Nakatani, S., Saiki, S., & Nakamura, M. (2017) · Advances in intelligent systems and computing · doi:10.1007/978-3-319-73888-8_34 · Cited by 4
Research works printed but not linked: 1
- tran, 2016, A virtual agent for enhancing performance and engagement of older people with dementia in serious games, Workshop Artificial Compagnon-Affect-Interaction 2016
Cited by
Gupta, N. S., & Kumar, P. (2023) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2023.107051 · Cited by 198
Conversational Affective Social Robots for Ageing and Dementia Support
Lima, M. R., Wairagkar, M., Gupta, M., Rodriguez y Baena, F., Barnaghi, P., Sharp, D. J., & Vaidyanathan, R. (2022) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2021.3115228 · Cited by 75
Connected Speech-Based Cognitive Assessment in Chinese and English
Luz, S. F., García, S. D. L. F., Haider, F., Fromm, D., MacWhinney, B., Lanzi, A. M., Chang, Y., Chou, C.-J., & Liu, Y. (2024) · Interspeech (USB) · doi:10.21437/interspeech.2024-1807 · Cited by 54
Smart conversational agents for the detection of neuropsychiatric disorders: A systematic review
Pacheco-Lorenzo, M. R., Valladares-Rodríguez, S. M., Anido-Rifón, L. E., & Fernández-Iglesias, M. J. (2021) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2020.103632 · Cited by 40
Fully automated cognitive screening tool based on assessment of speech and language
O'Malley, R. P. D., Mirheidari, B., Harkness, K., Reuber, M., Venneri, A., Walker, T., Christensen, H., & Blackburn, D. (2021) · Journal of Neurology, Neurosurgery & Psychiatry · doi:10.1136/jnnp-2019-322517 · Cited by 41
Self-citation
Metadata
- Authors
- Mirheidari, B., Blackburn, D., OrMalley, R., Walker, T., Venneri, A., Reuber, M., & Christensen, H.
- Affiliations
- University of Sheffield (GB)
- Royal Hallamshire Hospital (GB)
- ORCID
- Venue
- ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)
- Publisher
- IEEE
- Published
- 2019-05
- Pages
- 2732-2736
- ISSN
- 1520-6149 (ISSN-L)
- OpenAlex
- W2935868772
- Cited by
- 34
- References
- 25
- Citations by year
- 2025: 4 · 2024: 2 · 2023: 8 · 2022: 6 · 2021: 3 · 2020: 11
- FWCI
- 14.52
- Type
- conference paper
- Language
- en
- Open access
- closed
- Licence
- Locations
- IEEE International Conference on Acoustics Speech and Signal Processing (publishedVersion)
- Topics
- Health Sciences › Medicine › Psychiatry and Mental health › Dementia and Cognitive Impairment Research
- Health Sciences › Health Professions › Health Information Management › Artificial Intelligence in Healthcare
- Physical Sciences › Computer Science › Artificial Intelligence › Emotion and Mood Recognition
- Keywords
- dementia detection, cognitive assessment, mild cognitive impairment, verbal fluency test, neurodegenerative diseases, automated diagnosis, feature selection
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.