The DOI matches its Crossref record; 65 of the 65 references it cites were found in a registry or an index.
Detecting Dementia Through Interactive Computer Avatars
Open accessAbstract
This paper proposes a new approach to automatically detect dementia. Even though some works have detected dementia from speech and language attributes, most have applied detection using picture descriptions, narratives, and cognitive tasks. In this paper, we propose a new computer avatar with spoken dialog functionalities that produces spoken queries based on the mini-mental state examination, the Wechsler memory scale-revised, and other related neuropsychological questions. We recorded the interactive data of spoken dialogues from 29 participants (14 dementia and 15 healthy controls) and extracted various audiovisual features. We tried to predict dementia using audiovisual features and two machine learning algorithms (support vector machines and logistic regression). Here, we show that the support vector machines outperformed logistic regression, and by using the extracted features they classified the participants into two groups with 0.93 detection performance, as measured by the areas under the receiver operating characteristic curve. We also newly identified some contributing features, e.g., gap before speaking, the variations of fundamental frequency, voice quality, and the ratio of smiling. We concluded that our system has the potential to detect dementia through spoken dialog systems and that the system can assist health care workers. In addition, these findings could help medical personnel detect signs of dementia.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Third, it opens the door to voice or speech analysis, whereas features of the patient’s utterances can be passively monitored to derive health states [28-31].”
From Voice-Based Conversational Agents for the Prevention and Management of Chronic and Mental Health Conditions: Systematic Literature Review (2021) · cites this paper as [31]
In the citing paper
“Only four studies (2%), actually bring this into practice by experimenting with multi-modal human-robot interaction [94], infrastructure-free [77], or telephone-based [96, 97] approaches.”
From Artificial Intelligence, Speech, and Language Processing Approaches to Monitoring Alzheimer’s Disease: A Systematic Review (2020) · cites this paper as [94]
In the citing paper
“Another four studies take into account feasibility for clinical screening within their system design, for example, collecting data directly with a computerized decision support system [60], through human-robot interaction [94], a computer-supported screening tool [77], or simulating telephone-based data [96].”
From Artificial Intelligence, Speech, and Language Processing Approaches to Monitoring Alzheimer’s Disease: A Systematic Review (2020) · cites this paper as [94]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Folstein, M. F., Folstein, S. E., & McHugh, P. R. (1975) · Journal of Psychiatric Research · doi:10.1016/0022-3956(75)90026-6 · Cited by 88,282
Hirono, N., Mori, E., Ikejiri, Y., Imamura, T., Shimomura, T., Hashimoto, M., Yamashita, H., & Ikeda, M. (1997) · PubMed · Cited by 21,012
Self-citationKok, J. S., Berg, I. J., & Scherder, E. J. A. (2013) · Dementia and Geriatric Cognitive Disorders Extra · doi:10.1159/000353441 · Cited by 20,589
Older Adults' Reasons for Using Technology while Aging in Place
Peek, S. T. M., Luijkx, K. G., Rijnaard, M. D., Nieboer, M. E., van der Voort, C. S., Aarts, S., van Hoof, J., Vrijhoef, H. J., & Wouters, E. (2015) · Gerontology · doi:10.1159/000430949 · Cited by 19,852
Sensitivity and False Alarm Rate of a Fall Sensor in Long-Term Fall Detection in the Elderly
Kangas, M., Korpelainen, R., Vikman, I., Nyberg, L., & Jämsä, T. J. (2014) · Gerontology · doi:10.1159/000362720 · Cited by 19,007
McKhann, G. M., Knopman, D. S., Chertkow, H., Hyman, B. T., Jack, C. R., Kawas, C. H., Klunk, W. E., Koroshetz, W. J., Manly, J. J., Mayeux, R., et al. (2011) · Alzheimer's & Dementia · doi:10.1016/j.jalz.2011.03.005 · Cited by 18,657
Basic principles of ROC analysis
Metz, C. E. (1978) · Seminars in Nuclear Medicine · doi:10.1016/s0001-2998(78)80014-2 · Cited by 6,122
Coding facial expressions with Gabor wavelets
Lyons, M. J., Akamatsu, S., Kamachi, M., & Gyoba, J. (2002) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/afgr.1998.670949 · Cited by 2,214
Assessment of clinical competence using an objective structured clinical examination (OSCE)
HARDEN, R. M., & GLEESON, F. A. (1979) · Medical Education · doi:10.1111/j.1365-2923.1979.tb00918.x · Cited by 1,509
Using uh and um in spontaneous speaking
Clark, H. (2002) · Cognition · doi:10.1016/s0010-0277(02)00017-3 · Cited by 1,235
Research works printed but not linked: 5
- bishop, 2006, Pattern recognition, Machine Learning, 128, 1
- 2000, Diagnostic and statistical manual, 4th edn, text revision (DSM-IVTR), Amer Psych Assoc
- kaplan, 2001, Boston Naming Test
- paeschke, 2000, Prosodic characteristics of emotional speech: Measurements of fundamental frequency movements, Proc Speech and Emotion ISCA Tutorial and Research Workshop (ITRW), 75
- wechsler, 1997, WAIS-III Administration and Scoring Manual Wechsler Adult Intelligence Scale
Cited by
Sorted by citations
Items 101–127 of 127
Intelligent System of Squat Analysis Exercise to Prevent Back Injuries
Rosero-Montalvo, P. D., Dibujes, A., Vásquez-Ayala, C., Umaquinga-Criollo, A. C., Michilena-Calderón, J., Suárez-Zambrano, L. E., Flores, S., & Jaramillo, D. (2018) · Advances in intelligent systems and computing · doi:10.1007/978-3-030-02828-2_15 · Cited by 1
A Biomechanical Model Implementation for Upper-Limbs Rehabilitation Monitoring Using IMUs
García-de-Villa, S., Jiménez-Martín, A., & Domínguez, J. J. G. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-17935-9_32 · Cited by 1
Performance Evaluation of Text-Oriented Artificial Chat Operation System (TACOS)
Tokunaga, S., Tamura, K., & Otake, M. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-49907-5_7 · Cited by 1
Conversational Analysis Agents for Depression Detection: A Systematic Review
Olowolayemo, A., Tanni, M. G., Emon, I. A., Ahhmed, U., Dzahier, ‘. M., Safin, M. R., & Nisha, N. Z. (2023) · Journal of Integrated and Advanced Engineering (JIAE) · doi:10.51662/jiae.v3i1.85 · Cited by 1
Avatar Based Technology Use in Dementia: A Review (Preprint)Preprint
Sarker, J., Holden, R., Boustani, M., & Bateman, D. (2018) · doi:10.2196/preprints.12565 · Cited by 1
Tokunaga, S., Sekiguchi, T., Miura, K. W., Sugimoto, H., Abe, M., Tamura, K., Kishimoto, T., Kudo, T., & Otake, M. (2023) · doi:10.2196/preprints.47229 · Cited by 1
Self-citationMultimodal Analytics for early Diagnosis of Alzheimer's Disease
Guruge, C. J. P. (2020) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3379336.3381508
A Conversational Model for the Reminiscence Therapy of Patients with Early Stage of Alzheimer.
Morales-de-Jesús, V. M., & García, M. J. S. (2020)
Johannah, J. J., R, S. S. R., & Tamilarasi, S. (2021) · International Journal of Advanced Research in Science Communication and Technology · doi:10.48175/ijarsct-1013
Leveraging Technology in Detection of Alzheimer’s Disease: A Systematic Review (Preprint)Preprint
Kruse, C. S., Larson, B., Wilkinson, R., Samson, R., & Castillo, T. (2019) · doi:10.2196/preprints.13389
Yoshii, K., Kimura, D., Kosugi, A., Shinkawa, K., Takase, T., Kobayashi, M., Yamada, Y., Nemoto, M., Watanabe, R., Ota, M., et al. (2022) · doi:10.2196/preprints.42792
Seok, S., Choi, S., Kim, K., Choi, J., Sung, J. E., & Lim, Y. (2022) · doi:10.2196/preprints.44471
Retracted: MedNet: A Segmentation Algorithm for Effective Lung cancer Diagnosis
Divya, M., & Sathya, S. (2023) · International Conference on Smart Systems and Inventive Technology (ICSSIT) · doi:10.1109/icssit55814.2023.10061117
RetractedDeep discourse analysis for early prediction of multi-type dementia
Alkenani, A. H. (2023) · Queensland University of Technology · doi:10.5204/thesis.eprints.240368
Yamanaka, A., Sato, I., Matsumoto, S., & Fujino, Y. (2023) · Lecture notes in networks and systems · doi:10.1007/978-981-99-3091-3_28
Imre, N. (2023) · SZTE Repository of Dissertations (University of Szeged) · doi:10.14232/phd.11496
การวเคราะหคณลกษณะของเสยงเพอทำนายคะแนนแอตเทนชนในแบบประเมนโมคา
ตรีมงคลโชค, ว. (2022) · doi:10.58837/chula.the.2022.781
A survey of mild cognitive impairment diagnosis methods
Mandave, D. D., & Patil, L. V. (2023) · AIP conference proceedings · doi:10.1063/5.0175623
Kuroda, T., Ono, K., Murakami, K., Onishi, M., Shoji, D., Kosuge, S., Ishida, A., Hieda, S., Yamaguchi, S., Takahashi, M., et al. (2024) · Research Square · doi:10.21203/rs.3.rs-4070199/v1
Analysis of Facial Cues for Cognitive Decline Detection Using In-the-Wild Data
Alzahrani, F., Maddock, S., & Christensen, H. (2025) · Applied Sciences · doi:10.3390/app15116267
Improve Realistic Audio-Visual Avatars for Various Applications
Saleh, K. T., & Karim, A. A. (2025) · Lecture notes in networks and systems · doi:10.1007/978-981-96-4319-6_54
AI-powered assessments for mild cognitive impairment detection: A comprehensive review
Vinesh, T., Lavanya, M. S., Arun, V., Juremi, J., Tapkire, M. D., Shashikala, B. M., & Fatin, A. M. S. (2026) · AIP conference proceedings · doi:10.1063/5.0331506
Multimodal Deep Learning with MRI and Clinical Biomarkers for Explainable Alzheimer's Classification
Verma, V., Patel, K., Prakash, J., & Srivastava, A. (2026) · IEEE International Conference on Computing, Power and Communication Technologies (IC2PCT) · doi:10.1109/ic2pct68894.2026.11584454
Voice, Speech, and Large Language Models in Neurology: From Acoustic Biomarkers to Conversational AI
Shelly, S. (2026) · Computation · doi:10.3390/computation14070160
Technology and decent work in elderly care: a case study
Bregoli, I., Codini, A. P., & Bonera, M. (2026) · Journal of Services Marketing · doi:10.1108/jsm-01-2026-0050
Ding, R., Chawk, A., Eskandari, M., Hu, Z., & Deghat, M. (2026) · Applied Sciences · doi:10.3390/app162010143
Metadata
- Authors
- Tanaka, H., Adachi, H., Ukita, N., Ikeda, M., Kazui, H., Kudo, T., & Nakamura, S.
- Affiliations
- Nara Institute of Science and Technology (JP)
- The University of Osaka (JP)
- Toyota Technological Institute (JP)
- Corresponding author
- Tanaka, Hiroki
- ORCID
- Venue
- IEEE Journal of Translational Engineering in Health and Medicine
- Published
- 2017
- Volume
- 5
- Pages
- 1-11
- ISSN
- 2168-2372 (ISSN-L)
- PMC
- PMC5630006
- OpenAlex
- W2755232679
- Cited by
- 127
- References
- 64
- Citations by year
- 2026: 10 · 2025: 8 · 2024: 9 · 2023: 19 · 2022: 18 · 2021: 19 · 2020: 18 · 2019: 18 · 2018: 6 · 2017: 2
- FWCI
- 9.89
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- IEEE Journal of Translational Engineering in Health and Medicine (publishedVersion)
- Europe PMC (PubMed Central) (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- JSPS KAKENHI (JP17H06101, JP16K16172)
- Yanmar Innovation Lab. 2112
- Topics
- Health Sciences › Medicine › Psychiatry and Mental health › Dementia and Cognitive Impairment Research
- Physical Sciences › Computer Science › Artificial Intelligence › Emotion and Mood Recognition
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Keywords
- dementia detection, spoken dialogue systems, audio-visual features, fundamental frequency, voice quality, smiling, Mini-Mental State Examination, Wechsler Memory Scale-Revised, neuropsychological assessment, support vector machine, logistic regression, speech analysis
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
