Developing an intelligent virtual agent to stratify people with cognitive complaints: A comparison of human–patient and intelligent virtual agent–patient interaction
The DOI matches its Crossref record; 13 of the 14 references it cites were found in a registry or an index, and 1 are not checked yet.
Abstract
Previous work on interactions in the memory clinic has shown that conversation analysis can be used to differentiate neurodegenerative dementia from functional memory disorder. Based on this work, a screening system was developed that uses a computerised ‘talking head’ (intelligent virtual agent) and a combination of automatic speech recognition and conversation analysis-informed programming. This system can reliably differentiate patients with functional memory disorder from those with neurodegenerative dementia by analysing the way they respond to questions from either a human doctor or the intelligent virtual agent. However, much of this computerised analysis has relied on simplistic, nonlinguistic phonetic features such as the length of pauses between talk by the two parties. To gain confidence in automation of the stratification procedure, this paper investigates whether the patients’ responses to questions asked by the intelligent virtual agent are qualitatively similar to those given in response to a doctor. All the participants in this study have a clear functional memory disorder or neurodegenerative dementia diagnosis. Analyses of patients’ responses to the intelligent virtual agent showed similar, diagnostically relevant sequential features to those found in responses to doctors’ questions. However, since the intelligent virtual agent’s questions are invariant, its use results in more consistent responses across people – regardless of diagnosis – which facilitates automatic speech recognition and makes it easier for a machine to learn patterns. Our analysis also shows why doctors do not always ask the same question in the exact same way to different patients. This sensitivity and adaptation to nuances of conversation may be interactionally helpful; for instance, altering a question may make it easier for patients to understand. While we demonstrate that some of what is said in such interactions is bound to be constructed collaboratively between doctor and patient, doctors could consider ensuring that certain, particularly important and/or relevant questions are asked in as invariant a form as possible to be better able to identify diagnostically relevant differences in patients’ responses.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Some could only speak prerecorded lines (e.g., Walker et al. 2020), or perform a very basic script (e.g., Licoppe and Rollet 2020), or some mixture of both (e.g., Sahin et al. 2017; Relieu et al. 2020).”
From AI in situated action: a scoping review of ethnomethodological and conversation analytic studies (2025) · cites this paper as Walker et al. 2020
The cited source says what the claim attributes to it.
In the citing paper
“For example, in medical diagnosis Walker et al. (2020) show how a degree of 'rigidity' in the technological implementation of a survey-taking robot is useful, even if it may seem less human-like, since consistency in question design and performance might elicit more comparable and analytically useful answers to diagnostic questions.”
From AI in situated action: a scoping review of ethnomethodological and conversation analytic studies (2025) · cites this paper as Walker et al. 2020
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Sequence Organization in Interaction: A Primer in Conversation Analysis
Schegloff, E. A. (2007) · Cambridge University Press eBooks · doi:10.1017/cbo9780511791208 · Cited by 4,684
Garfinkel and Ethnomethodology
Spickard, J., Heritage, J., & Garfinkel, H. (1987) · Sociological Analysis · doi:10.2307/3711210 · Cited by 1,603
Conversation Analysis: An Introduction
Sidnell, J. (2010) · Cited by 1,174
Communication in Medical Care: Interaction between Primary Care Physicians and Patients
(2006) · Cambridge University Press eBooks · doi:10.1017/cbo9780511607172 · Cited by 831
The Handbook of Conversation Analysis
(2012) · doi:10.1002/9781118325001 · Cited by 551
Reducing Patients’ Unmet Concerns in Primary Care: the Difference One Word Can Make
Heritage, J., Robinson, J. D., Elliott, M. N., Beckett, M., & Wilkes, M. (2007) · Journal of General Internal Medicine · doi:10.1007/s11606-007-0279-0 · Cited by 433
Stivers, T. (2005) · Health Communication · doi:10.1207/s15327027hc1801_3 · Cited by 269 · cited 1×
“…technique in investigating the crucial role of communication in medical history-taking and medicine prescribing (eg., Heritage & Maynard, 2006, Stivers, 2005a, 2005b), and has shown the importance of analysing the fine details of talk -- that is, the actual words used, the grammatical forms,…”
BackgroundNon-antibiotic treatment recommendations: delivery formats and implications for parent resistance
Stivers, T. (2005) · Social Science & Medicine · doi:10.1016/j.socscimed.2004.06.040 · Cited by 178 · cited 1×
“…technique in investigating the crucial role of communication in medical history-taking and medicine prescribing (e.g. Heritage & Maynard, 2006, Stivers, 2005a, 2005b), and has shown the importance of analysing the fine details of talk – that is, the actual words used, the grammatical forms,…”
Jones, D., Drew, P., Elsey, C., Blackburn, D. J., Wakefield, S., Harkness, K., & Reuber, M. (2015) · Aging & Mental Health · doi:10.1080/13607863.2015.1021753 · Cited by 146 · cited 6×
“The IVA asked the participants a set of 12 recorded (ie., not computer voice synthesised) questions, developed based on the findings of Jones et al. (2015) and Elsey et al. (2015).”
BackgroundMethodInfluentialSelf-citationElsey, C., Drew, P., Jones, D., Blackburn, D. J., Wakefield, S., Harkness, K., Venneri, A., & Reuber, M. (2015) · Patient Education and Counseling · doi:10.1016/j.pec.2015.05.021 · Cited by 129 · cited 9×
“The IVA asked the participants a set of 12 recorded (ie., not computer voice synthesised) questions, developed based on the findings of Jones et al. (2015) and Elsey et al. (2015).”
BackgroundMethodResultInfluentialSelf-citation
Cited by
Bias in Automatic Speech Recognition: The Case of African American Language
Martin, J. L., & Wright, K. E. (2023) · Applied Linguistics · doi:10.1093/applin/amac066 · Cited by 65
Clinical signs in functional cognitive disorders: A systematic review and diagnostic meta-analysis
Cabreira, V., Frostholm, L., McWhirter, L., Stone, J., & Carson, A. (2023) · Journal of Psychosomatic Research · doi:10.1016/j.jpsychores.2023.111447 · Cited by 43
Jonell, P., Moëll, B., Håkansson, K., Henter, G. E., Kucherenko, T., Mikheeva, O., Hagman, G., Holleman, J., Kivipelto, M., Kjellström, H., et al. (2021) · Frontiers in Computer Science · doi:10.3389/fcomp.2021.642633 · Cited by 33
“In a series of studies the team has used a mix of automatically generated acoustic and lexical features with manually acquired conversational analysis inspired features to predict AD (Mirheidari et al., 2019; Walker et al., 2020).”
Cabreira, V., Alty, J., Antic, S., Araújo, R., Aybek, S., Ball, H. A., Baslet, G., Bhome, R., Coebergh, J., Dubois, B., et al. (2025) · European Journal of Neurology · doi:10.1111/ene.16318 · Cited by 24
“Namely, further positive diagnostic signs and diagnostic decision tools to support clinicians in differentiating FCD from other causes of cognitive impairment are needed to enable earlier diagnosis and increase specificity [48, 51].”
Intelligent agent-assisted organizational memory in knowledge management systems
Alstete, J. W., & Meyer, J. P. (2020) · VINE Journal of Information and Knowledge Management Systems · doi:10.1108/vjikms-05-2019-0063 · Cited by 26
Metadata
- Authors
- Walker, T., Christensen, H., Mirheidari, B., Swainston, T., Rutten, C., Mayer, I., Blackburn, D., & Reuber, M.
- Affiliations
- University of Sheffield (GB)
- Royal Hallamshire Hospital (GB)
- Corresponding author
- Walker, Traci
- Venue
- Dementia
- Publisher
- SAGE Publications
- Published
- 2018-09-14
- Volume
- 19
- Issue
- 4
- Pages
- 1173-1188
- ISSN
- 1471-3012 (ISSN-L)
- 1741-2684
- OpenAlex
- W2890820976
- Cited by
- 18
- References
- 13
- Citations by year
- 2026: 3 · 2025: 3 · 2024: 3 · 2023: 4 · 2022: 2 · 2021: 1 · 2020: 1 · 2019: 1
- FWCI
- 0.42
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
- Locations
- Dementia (publishedVersion)
- PubMed (publishedVersion)
- White Rose Research Online (University of Leeds, The University of Sheffield, University of York) (acceptedVersion)
- Funders
- NIHR Research for Patient Benefit (PB-PG- 0211- 24079)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Health Sciences › Medicine › Psychiatry and Mental health › Dementia and Cognitive Impairment Research
- Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
- Keywords
- memory clinics, dementia screening, neurodegenerative dementia, conversation analysis, doctor-patient interaction, speech recognition, patient stratification
- MeSH terms
- Aged, Dementia, Female, Humans, Linguistics, Male, Man-Machine Systems, Memory Disorders, Middle Aged, User-Computer Interface, Decision Support Systems, Clinical
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Developing an intelligent virtual agent to stratify people with cognitive complaints: A comparison of human–patient and intelligent virtual agent–patient interaction. https://app.cochat.ai/papers/10.1177/1471301218795238
- The paper
- Walker, T., Christensen, H., Mirheidari, B., Swainston, T., Rutten, C., Mayer, I., Blackburn, D., & Reuber, M. (2020). Developing an intelligent virtual agent to stratify people with cognitive complaints: A comparison of human–patient and intelligent virtual agent–patient interaction. Dementia. https://doi.org/10.1177/1471301218795238
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.