Computational Cognitive Assessment: Investigating the Use of an Intelligent Virtual Agent for the Detection of Early Signs of Dementia
The DOI matches its Crossref record; 23 of the 25 references it cites were found in a registry or an index.
Abstract
The ageing population has caused a marked increased in the number of people with cognitive decline linked with dementia. Thus, current diagnostic services are overstretched, and there is an urgent need for automating parts of the assessment process. In previous work, we demonstrated how a stratification tool built around an Intelligent Virtual Agent (IVA) eliciting a conversation by asking memory-probing questions, was able to accurately distinguish between people with a neuro-degenerative disorder (ND) and a functional memory disorder (FMD). In this paper, we extend the number of diagnostic classes to include healthy elderly controls (HCs) as well as people with mild cognitive impairment (MCI). We also investigate whether the IVA may be used for administering more standard cognitive tests, like the verbal fluency tests. A four-way classifier trained on an extended feature set achieved 48% accuracy, which improved to 62% by using just the 22 most significant features (ROC-AUC: 82%).
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Scikit-learn: Machine Learning in Python
Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., Blondel, M., Müller, A., Nothman, J., Louppe, G., et al. (2012) · arXiv · doi:10.48550/arxiv.1201.0490 · Cited by 71,016
Kaldi Speech Recognition Toolkit
Povey, D. (2024) · Infoscience (Ecole Polytechnique Fédérale de Lausanne) · doi:10.57702/jb3fvbn9 · Cited by 4,609
Probabilistic Linear Discriminant Analysis for Inferences About Identity
Prince, S. J. D., & Elder, J. H. (2007) · 2007 IEEE 11th International Conference on Computer Vision · doi:10.1109/iccv.2007.4409052 · Cited by 977
Diagnostic utility of abbreviated fluency measures in Alzheimer disease and vascular dementia
Canning, S. J. D., Leach, L., Stuss, D., Ngo, L., & Black, S. E. (2004) · Neurology · doi:10.1212/wnl.62.4.556 · Cited by 328
Rus-Calafell, M., Gutiérrez-Maldonado, J., & Ribas-Sabaté, J. (2014) · Journal of Behavior Therapy and Experimental Psychiatry · doi:10.1016/j.jbtep.2013.09.002 · Cited by 170
Avatar therapy for persecutory auditory hallucinations: What is it and how does it work?
Leff, J., Williams, G., Huckvale, M., Arbuthnot, M., & Leff, A. P. (2014) · Psychosis · doi:10.1080/17522439.2013.773457 · Cited by 148
Jones, D., Drew, P., Elsey, C., Blackburn, D., Wakefield, S., Harkness, K., & Reuber, M. (2016) · Aging & Mental Health · doi:10.1080/13607863.2015.1021753 · Cited by 146
Self-citationRelating Therapy for distressing auditory hallucinations: A pilot randomized controlled trial
Hayward, M., Jones, A.-M., Bogen-Johnston, L., Thomas, N., & Strauss, C. (2017) · Schizophrenia Research · doi:10.1016/j.schres.2016.11.019 · Cited by 128 · cited 1×
“Applications include use by people with mental health problems [5, 6, 7, 8], mild cognitive impairment (MCI) [9], Alzheimer's Disease (AD) [10, 11], and the healthy elderly [12].”
BackgroundDetecting Dementia Through Interactive Computer Avatars
Tanaka, H., Adachi, H., Ukita, N., Ikeda, M., Kazui, H., Kudo, T., & Nakamura, S. (2017) · IEEE Journal of Translational Engineering in Health and Medicine · doi:10.1109/jtehm.2017.2752152 · Cited by 127 · cited 1×
“designed an IVA with spoken dialogue for detecting the early signs of dementia [14].”
BackgroundElsey, C., Drew, P., Jones, D., Blackburn, D., Wakefield, S., Harkness, K., Venneri, A., & Reuber, M. (2015) · Patient Education and Counseling · doi:10.1016/j.pec.2015.05.021 · Cited by 114
Self-citation
Research works printed but not linked: 1
- tran, 2016, A virtual agent for enhancing performance and engagement of older people with dementia in serious games, Workshop Artificial Compagnon-Affect-Interaction 2016
Cited by
Gupta, N. S., & Kumar, P. (2023) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2023.107051 · Cited by 198
Conversational Affective Social Robots for Ageing and Dementia Support
Lima, M. R., Wairagkar, M., Gupta, M., Rodriguez y Baena, F., Barnaghi, P., Sharp, D. J., & Vaidyanathan, R. (2022) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2021.3115228 · Cited by 75
Connected Speech-Based Cognitive Assessment in Chinese and English
Luz, S. F., García, S. D. L. F., Haider, F., Fromm, D., MacWhinney, B., Lanzi, A. M., Chang, Y., Chou, C.-J., & Liu, Y. (2024) · Interspeech (USB) · doi:10.21437/interspeech.2024-1807 · Cited by 54
Smart conversational agents for the detection of neuropsychiatric disorders: A systematic review
Pacheco-Lorenzo, M. R., Valladares-Rodríguez, S. M., Anido-Rifón, L. E., & Fernández-Iglesias, M. J. (2021) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2020.103632 · Cited by 40
Fully automated cognitive screening tool based on assessment of speech and language
O'Malley, R. P. D., Mirheidari, B., Harkness, K., Reuber, M., Venneri, A., Walker, T., Christensen, H., & Blackburn, D. (2021) · Journal of Neurology, Neurosurgery & Psychiatry · doi:10.1136/jnnp-2019-322517 · Cited by 41
Self-citation
Metadata
- Authors
- Mirheidari, B., Blackburn, D., OrMalley, R., Walker, T., Venneri, A., Reuber, M., & Christensen, H.
- Affiliations
- University of Sheffield (GB)
- Royal Hallamshire Hospital (GB)
- ORCID
- Venue
- ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)
- Publisher
- IEEE
- Published
- 2019-05
- Pages
- 2732-2736
- ISSN
- 1520-6149 (ISSN-L)
- OpenAlex
- W2935868772
- Cited by
- 34
- References
- 25
- Citations by year
- 2025: 4 · 2024: 2 · 2023: 8 · 2022: 6 · 2021: 3 · 2020: 11
- FWCI
- 14.52
- Type
- conference paper
- Language
- en
- Open access
- closed
- Licence
- Locations
- IEEE International Conference on Acoustics Speech and Signal Processing (publishedVersion)
- Topics
- Health Sciences › Medicine › Psychiatry and Mental health › Dementia and Cognitive Impairment Research
- Health Sciences › Health Professions › Health Information Management › Artificial Intelligence in Healthcare
- Physical Sciences › Computer Science › Artificial Intelligence › Emotion and Mood Recognition
- Keywords
- dementia detection, cognitive assessment, mild cognitive impairment, verbal fluency test, neurodegenerative diseases, automated diagnosis, feature selection
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Computational Cognitive Assessment: Investigating the Use of an Intelligent Virtual Agent for the Detection of Early Signs of Dementia. https://app.cochat.ai/papers/10.1109/icassp.2019.8682423
- The paper
- Mirheidari, B., Blackburn, D., OrMalley, R., Walker, T., Venneri, A., Reuber, M., & Christensen, H. (2019). Computational Cognitive Assessment: Investigating the Use of an Intelligent Virtual Agent for the Detection of Early Signs of Dementia. ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). https://doi.org/10.1109/icassp.2019.8682423
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.