The DOI matches its Crossref record; 65 of the 65 references it cites were found in a registry or an index.
Detecting Dementia Through Interactive Computer Avatars
Open accessAbstract
This paper proposes a new approach to automatically detect dementia. Even though some works have detected dementia from speech and language attributes, most have applied detection using picture descriptions, narratives, and cognitive tasks. In this paper, we propose a new computer avatar with spoken dialog functionalities that produces spoken queries based on the mini-mental state examination, the Wechsler memory scale-revised, and other related neuropsychological questions. We recorded the interactive data of spoken dialogues from 29 participants (14 dementia and 15 healthy controls) and extracted various audiovisual features. We tried to predict dementia using audiovisual features and two machine learning algorithms (support vector machines and logistic regression). Here, we show that the support vector machines outperformed logistic regression, and by using the extracted features they classified the participants into two groups with 0.93 detection performance, as measured by the areas under the receiver operating characteristic curve. We also newly identified some contributing features, e.g., gap before speaking, the variations of fundamental frequency, voice quality, and the ratio of smiling. We concluded that our system has the potential to detect dementia through spoken dialog systems and that the system can assist health care workers. In addition, these findings could help medical personnel detect signs of dementia.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Third, it opens the door to voice or speech analysis, whereas features of the patient’s utterances can be passively monitored to derive health states [28-31].”
From Voice-Based Conversational Agents for the Prevention and Management of Chronic and Mental Health Conditions: Systematic Literature Review (2021) · cites this paper as [31]
In the citing paper
“Only four studies (2%), actually bring this into practice by experimenting with multi-modal human-robot interaction [94], infrastructure-free [77], or telephone-based [96, 97] approaches.”
From Artificial Intelligence, Speech, and Language Processing Approaches to Monitoring Alzheimer’s Disease: A Systematic Review (2020) · cites this paper as [94]
In the citing paper
“Another four studies take into account feasibility for clinical screening within their system design, for example, collecting data directly with a computerized decision support system [60], through human-robot interaction [94], a computer-supported screening tool [77], or simulating telephone-based data [96].”
From Artificial Intelligence, Speech, and Language Processing Approaches to Monitoring Alzheimer’s Disease: A Systematic Review (2020) · cites this paper as [94]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Folstein, M. F., Folstein, S. E., & McHugh, P. R. (1975) · Journal of Psychiatric Research · doi:10.1016/0022-3956(75)90026-6 · Cited by 88,282
Hirono, N., Mori, E., Ikejiri, Y., Imamura, T., Shimomura, T., Hashimoto, M., Yamashita, H., & Ikeda, M. (1997) · PubMed · Cited by 21,012
Self-citationKok, J. S., Berg, I. J., & Scherder, E. J. A. (2013) · Dementia and Geriatric Cognitive Disorders Extra · doi:10.1159/000353441 · Cited by 20,589
Older Adults' Reasons for Using Technology while Aging in Place
Peek, S. T. M., Luijkx, K. G., Rijnaard, M. D., Nieboer, M. E., van der Voort, C. S., Aarts, S., van Hoof, J., Vrijhoef, H. J., & Wouters, E. (2015) · Gerontology · doi:10.1159/000430949 · Cited by 19,852
Sensitivity and False Alarm Rate of a Fall Sensor in Long-Term Fall Detection in the Elderly
Kangas, M., Korpelainen, R., Vikman, I., Nyberg, L., & Jämsä, T. J. (2014) · Gerontology · doi:10.1159/000362720 · Cited by 19,007
McKhann, G. M., Knopman, D. S., Chertkow, H., Hyman, B. T., Jack, C. R., Kawas, C. H., Klunk, W. E., Koroshetz, W. J., Manly, J. J., Mayeux, R., et al. (2011) · Alzheimer's & Dementia · doi:10.1016/j.jalz.2011.03.005 · Cited by 18,657
Basic principles of ROC analysis
Metz, C. E. (1978) · Seminars in Nuclear Medicine · doi:10.1016/s0001-2998(78)80014-2 · Cited by 6,122
Coding facial expressions with Gabor wavelets
Lyons, M. J., Akamatsu, S., Kamachi, M., & Gyoba, J. (2002) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/afgr.1998.670949 · Cited by 2,214
Assessment of clinical competence using an objective structured clinical examination (OSCE)
HARDEN, R. M., & GLEESON, F. A. (1979) · Medical Education · doi:10.1111/j.1365-2923.1979.tb00918.x · Cited by 1,509
Using uh and um in spontaneous speaking
Clark, H. (2002) · Cognition · doi:10.1016/s0010-0277(02)00017-3 · Cited by 1,235
Social signal processing: Survey of an emerging domain
Vinciarelli, A., Pantic, M., & Bourlard, H. (2009) · Image and Vision Computing · doi:10.1016/j.imavis.2008.11.007 · Cited by 842
Crawford, J. R., & Garthwaite, P. H. (2002) · Neuropsychologia · doi:10.1016/s0028-3932(01)00224-x · Cited by 829
Linguistic Features Identify Alzheimer’s Disease in Narrative Speech
Fraser, K. C., Meltzer, J. A., & Rudzicz, F. (2015) · Journal of Alzheimer's Disease · doi:10.3233/jad-150520 · Cited by 797
Scherer, K. R., Schuller, B., & Elkins, A. (2017) · Cambridge University Press eBooks · doi:10.1017/9781316676202 · Cited by 768
The quantitative analysis of agrammatic production: Procedure and data
Saffran, E. M., Berndt, R. S., & Schwartz, M. F. (1989) · Brain and Language · doi:10.1016/0093-934x(89)90030-8 · Cited by 708
Relationship Between Education and Dementia: An Updated Systematic Review
Sharp, E. S., & Gatz, M. (2011) · Alzheimer Disease & Associated Disorders · doi:10.1097/wad.0b013e318211c83c · Cited by 591
Pauses, gaps and overlaps in conversations
Heldner, M., & Edlund, J. (2010) · Journal of Phonetics · doi:10.1016/j.wocn.2010.08.002 · Cited by 575
Language performance in Alzheimer's disease and mild cognitive impairment: A comparative review
Taler, V., & Phillips, N. A. (2008) · Journal of Clinical and Experimental Neuropsychology · doi:10.1080/13803390701550128 · Cited by 529
Detecting depression from facial actions and vocal prosody
Cohn, J. F., Kruez, T. S., Matthews, I., Yang, Y., Nguyen, M. H., Padilla, M. T., Zhou, F., & De la Torre, F. (2009) · 2009 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops · doi:10.1109/acii.2009.5349358 · Cited by 494
Automatic speech analysis for the assessment of patients with predementia and Alzheimer's disease
König, A., Satt, A., Sorin, A., Hoory, R., Toledo‐Ronen, O., Derreumaux, A., Manera, V., Verhey, F., Aalten, P., Robert, P. H., et al. (2015) · Alzheimer's & Dementia: Diagnosis, Assessment & Disease Monitoring · doi:10.1016/j.dadm.2014.11.012 · Cited by 380
Face alignment through subspace constrained mean-shifts
Saragih, J., Lucey, S., & Cohn, J. F. (2009) · IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2009.5459377 · Cited by 373
Spoken Language Derived Measures for Detecting Mild Cognitive Impairment
Roark, B., Mitchell, M., Hosom, J.-P., Hollingshead, K., & Kaye, J. (2011) · IEEE Transactions on Audio, Speech, and Language Processing · doi:10.1109/tasl.2011.2112351 · Cited by 355
Innovative diagnostic tools for early detection of Alzheimer's disease
Laske, C., Sohrabi, H. R., Frost, S. M., López-de-Ipiña, K., Garrard, P., Buscema, M., Dauwels, J., Soekadar, S. R., Mueller, S., Linnemann, C., et al. (2015) · Alzheimer's & Dementia · doi:10.1016/j.jalz.2014.06.004 · Cited by 316
Pedagogical Agent Design: The Impact of Agent Realism, Gender, Ethnicity, and Instructional Role
Baylor, A. L., & Kim, Y. A. (2004) · Lecture notes in computer science · doi:10.1007/978-3-540-30139-4_56 · Cited by 245
Bucks, R. S., Singh, S., Cuerden, J. M., & Wilcock, G. K. (2000) · Aphasiology · doi:10.1080/026870300401603 · Cited by 233
Aided diagnosis of dementia type through computer-based analysis of spontaneous speech
Jarrold, W., Peintner, B., Wilkins, D., Vergryi, D., Richey, C., Gorno-Tempini, M. L., & Ogar, J. (2014) · Proceedings of the Workshop on Computational Linguistics and Clinical Psychology: From Linguistic Signal to Clinical Reality · doi:10.3115/v1/w14-3204 · Cited by 178
Impaired recognition of negative facial emotions in patients with frontotemporal dementia
Fernandez‐Duque, D., & Black, S. E. (2005) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2005.01.005 · Cited by 174
Speech in Alzheimer's Disease: Can Temporal and Acoustic Parameters Discriminate Dementia?
Meilán, J. J. G., Martínez‐Sánchez, F., Carro, J., López, D. E., Millian-Morell, L., & Martínez, J. M. A. (2014) · Dementia and Geriatric Cognitive Disorders · doi:10.1159/000356726 · Cited by 165
Automated Analysis and Prediction of Job Interview Performance
Naim, I., Tanveer, M. I., Gildea, D., & Hoque, M. E. (2016) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2016.2614299 · Cited by 162
Shimokawa, A., Yatomi, N., Anamizu, S., Torii, S., Isono, H., Sugai, Y., & Kohno, M. (2001) · Brain and Cognition · doi:10.1006/brcg.2001.1318 · Cited by 140
SantaCruz, K. S., & Swagerty, D. L. (2001) · PubMed · Cited by 126
Automatically detecting pain using facial actions
Lucey, P., Cohn, J. F., Lucey, S., Matthews, I., Sridharan, S., & Prkachin, K. M. (2009) · International Conference on Affective Computing and Intelligent Interaction and workshops · doi:10.1109/acii.2009.5349321 · Cited by 126
Unobtrusive Monitoring of Computer Interactions to Detect Cognitive Status in Elders
Jimison, H. B., Misha Pavel, C., McKanna, J. A., & Pavel, J. (2004) · IEEE Transactions on Information Technology in Biomedicine · doi:10.1109/titb.2004.835539 · Cited by 117
Do picture‐naming tests provide a valid assessment of lexical retrieval in conversation in aphasia?
Herbert, R., Hickin, J., Howard, D., Osborne, F., & Best, W. (2008) · Aphasiology · doi:10.1080/02687030701262613 · Cited by 116
Orimaye, S. O., Wong, J. S.-M., & Golden, K. J. (2014) · Proceedings of the Workshop on Computational Linguistics and Clinical Psychology: From Linguistic Signal to Clinical Reality · doi:10.3115/v1/w14-3210 · Cited by 116
Hess, U., Adams, R. B., Simard, A., Stevenson, M. T., & Kleck, R. E. (2012) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2012.05.018 · Cited by 105
Syntactic complexity measures for detecting mild cognitive impairment
Brian Roark, A., Mitchell, M., & Hollingshead, K. (2007) · Workshop on Biomedical Language Processing (BioNLP) · doi:10.3115/1572392.1572394 · Cited by 97
Emotional Prosody Perception and Production in Dementia of the Alzheimer’s Type
Horley, K., Reid, A., & Burnham, D. K. (2010) · Journal of Speech Language and Hearing Research · doi:10.1044/1092-4388(2010/09-0030 · Cited by 92
Spontaneous speech in aphasia: A correlational study
Vermeulen, J., Bastiaanse, R., & Wageningen, B. V. (1989) · Brain and Language · doi:10.1016/0093-934x(89)90064-3 · Cited by 85
Glottal characteristics of female speakers
Stevens, K. N., & Hanson, H. M. (1995) · Cited by 83
Simple and choice reaction time in dementia: Clinical implications
Pirozzolo, F. J., Christensen, K. J., Ogle, K. M., Hansch, E. C., & Thompson, W. G. (1981) · Neurobiology of Aging · doi:10.1016/0197-4580(81)90008-7 · Cited by 79
Does Education Level Determine the Course of Cognitive Decline?
Leibovici, D., Ritchie, K. A., Ledésert, B., & Touchon, J. (1996) · Age and Ageing · doi:10.1093/ageing/25.5.392 · Cited by 76
Fully automated neuropsychological assessment for detecting mild cognitive impairment
Lehr, M., Prud’hommeaux, E. T., Izhak Shafran, J., & Brian Roark, A. (2012) · Interspeech (USB) · doi:10.21437/interspeech.2012-306 · Cited by 73
Rachel: Design of an emotionally targeted interactive agent for children with autism
Mower, E., Black, M. P., Flores, E., Williams, M. E., & Narayanan, S. S. (2011) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme.2011.6011990 · Cited by 72
Acted vs. natural frustration and delight: Many people smile in natural frustration
Hoque, M. E., & Picard, R. W. (2011) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/fg.2011.5771425 · Cited by 70
Asplund, K., Norberg, A., Adolfsson, R., & Waxman, H. (1991) · International Journal of Geriatric Psychiatry · doi:10.1002/gps.930060809 · Cited by 70
Mutual gaze in Alzheimer's disease, frontotemporal and semantic dementia couples
Sturm, V. E., McCarthy, M. E., Yun, I., Madan, A., Yuan, J. W., Holley, S. R., Ascher, E. A., Boxer, A. L., Miller, B. L., & LEVENSON, R. W. (2010) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nsq055 · Cited by 62
Speech Recognition in Alzheimer’s Disease and in its Assessment
Zhou, L., Fraser, K. C., & Rudzicz, F. (2016) · Interspeech 2016 · doi:10.21437/interspeech.2016-1228 · Cited by 62
Measures of lexical diversity in aphasia
Wright, H. H., Wagovich, S. A., & Newhoff, M. (2003) · Aphasiology · doi:10.1080/02687030344000166 · Cited by 59
Vocabulary Size in Speech May Be an Early Indicator of Cognitive Impairment
Aramaki, E., Shikata, S., Miyabe, M., & Kinoshita, A. (2016) · PLoS ONE · doi:10.1371/journal.pone.0155195 · Cited by 57
Automated Social Skills Trainer
Tanaka, H., Sakti, S., Neubig, G., Toda, T., Negoro, H., Iwasaka, H., & Nakamura, S. (2015) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/2678025.2701368 · Cited by 51
Self-citationListener agent for elderly people with dementia
Sakai, Y., Nonaka, Y., Yasuda, K., & Nakano, Y. I. (2012) · Proceedings of the seventh annual ACM/IEEE international conference on Human-Robot Interaction · doi:10.1145/2157689.2157754 · Cited by 47
Small Talk and Conversational Storytelling In Embodied Conversational Interface Agents
Bickmore, T., & Cassell, J. (1999) · Cited by 43
Turn-Taking for Human-Robot Interaction
Chao, C., & Thomaz, A. L. (2010) · SMARTech Repository (Georgia Institute of Technology) · Cited by 32
Kato, S., Endo, H., Homma, A., Sakuma, T., & Watanabe, K. (2013) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc.2013.6610873 · Cited by 27
Cost-Effective Recognition and Diagnosis of Dementia
Geldmacher, D. (2002) · Seminars in Neurology · doi:10.1055/s-2002-33049 · Cited by 26
Glottal characteristics of female speakers.
Hanson, H. M. (1995) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 18
Tanaka, H., Adachi, H., Ukita, N., Kudo, T., & Nakamura, S. (2016) · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · doi:10.1145/2993148.2993193 · Cited by 17
Self-citationAutomated Analysis and Prediction of Job Interview PerformancePreprint
Naim, I., Tanveer, M. I., Gildea, D., et al. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1504.03425 · Cited by 16
Using physiology and language cues for modeling verbal response latencies of children with ASD
Chaspari, T., Bone, D., Gibson, J., Lee, C.-C., & Narayanan, S. S. (2013) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2013.6638349 · Cited by 13
Trovato, G., Do, M., Kuramochi, M., Zecca, M., Terlemez, Ö., Asfour, T., & Takanishi, A. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-11973-1_35 · Cited by 9
Autism and the use of fillers: differences between 'um' and 'uh'.
Lunsford, R., Heeman, P. A., Black, L. M., & van Santen, J. P. H. (2010) · Cited by 8
Initial response time measurement in eye movement for dementia screening test
Endo, T., Ukita, N., Tanaka, H., Hagita, N., Nakamura, S., Adachi, H., Ikeda, M., Kazui, H., & Kudo, T. (2017) · Machine Vision Applications · doi:10.23919/mva.2017.7986851 · Cited by 7
Self-citationSmile and Laughter Detection for Elderly People-Robot Interaction
Yang, F., Sehili, M. A., Barras, C., & Devillers, L. Y. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-25554-5_69 · Cited by 5
Tanaka, H., Yoshino, K., Sugiyama, K., Nakamura, S., & Kondo, M. (2016) · International Conference on Speech Database and Assessments · doi:10.1109/icsda.2016.7918991 · Cited by 5
Self-citation
Research works printed but not linked: 5
- bishop, 2006, Pattern recognition, Machine Learning, 128, 1
- 2000, Diagnostic and statistical manual, 4th edn, text revision (DSM-IVTR), Amer Psych Assoc
- kaplan, 2001, Boston Naming Test
- paeschke, 2000, Prosodic characteristics of emotional speech: Measurements of fundamental frequency movements, Proc Speech and Emotion ISCA Tutorial and Research Workshop (ITRW), 75
- wechsler, 1997, WAIS-III Administration and Scoring Manual Wechsler Adult Intelligence Scale
Cited by
Sorted by citations
An overview of the features of chatbots in mental health: A scoping review
Abd-alrazaq, A. A., Alajlani, M., Alalwan, A. A., Bewick, B. M., Gardner, P., & Househ, M. (2019) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2019.103978 · Cited by 605
Applications of machine learning to diagnosis and treatment of neurodegenerative diseases
Myszczynska, M. A., Ojamies, P. N., Lacoste, A. M. B., Neil, D., Saffari, A., Mead, R., Hautbergue, G. M., Holbrook, J. D., & Ferraiuolo, L. (2020) · Nature Reviews Neurology · doi:10.1038/s41582-020-0377-8 · Cited by 595
Survey of conversational agents in health
Montenegro, J. L. Z., da Costa, C. A., & da Rosa Righi, R. (2019) · Expert Systems with Applications · doi:10.1016/j.eswa.2019.03.054 · Cited by 322
García, S. D. L. F., Ritchie, C. W., & Luz, S. F. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.06047 · Cited by 265
Technical metrics used to evaluate health care chatbots: scoping review
Abd-Alrazaq, A., Safi, Z., Alajlani, M., Warren, J., Househ, M., & Denecke, K. (2020) · Journal of Medical Internet Research · doi:10.2196/18301 · Cited by 150
Metadata
- Authors
- Tanaka, H., Adachi, H., Ukita, N., Ikeda, M., Kazui, H., Kudo, T., & Nakamura, S.
- Affiliations
- Nara Institute of Science and Technology (JP)
- The University of Osaka (JP)
- Toyota Technological Institute (JP)
- Corresponding author
- Tanaka, Hiroki
- ORCID
- Venue
- IEEE Journal of Translational Engineering in Health and Medicine
- Published
- 2017
- Volume
- 5
- Pages
- 1-11
- ISSN
- 2168-2372 (ISSN-L)
- PMC
- PMC5630006
- OpenAlex
- W2755232679
- Cited by
- 127
- References
- 64
- Citations by year
- 2026: 10 · 2025: 8 · 2024: 9 · 2023: 19 · 2022: 18 · 2021: 19 · 2020: 18 · 2019: 18 · 2018: 6 · 2017: 2
- FWCI
- 9.89
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- IEEE Journal of Translational Engineering in Health and Medicine (publishedVersion)
- Europe PMC (PubMed Central) (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- JSPS KAKENHI (JP17H06101, JP16K16172)
- Yanmar Innovation Lab. 2112
- Topics
- Health Sciences › Medicine › Psychiatry and Mental health › Dementia and Cognitive Impairment Research
- Physical Sciences › Computer Science › Artificial Intelligence › Emotion and Mood Recognition
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Keywords
- dementia detection, spoken dialogue systems, audio-visual features, fundamental frequency, voice quality, smiling, Mini-Mental State Examination, Wechsler Memory Scale-Revised, neuropsychological assessment, support vector machine, logistic regression, speech analysis
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
