Dialogue Systems and Conversational Agents for Patients with Dementia: The Human–Robot Interaction
Open accessAbstract
This study aimed to identify and describe the fundamental characteristics of spoken dialogue systems, and their role in supporting human–robot interaction and enabling the communication between socially assistive robots and patients with dementia. First, this work provides an overview of spoken dialogue systems by considering the underlying technologies, approaches, methods, and general issues. Then, the analysis focuses on studies, systems, and approaches that have investigated the role of dialogue systems and conversational agents in the interaction with elderly people with dementia by presenting the results of a literature review. While the overview of spoken dialogue systems relies on existing surveys and reviews, a research was conducted to identify existing works in the literature that have investigated the role of conversational agents and dialogue systems in the elderly and people with cognitive impairments. Inclusion criteria were as follows: (1) use of conversational agents, dialogue systems, or language processing tools for people with cognitive impairments; (2) age ≥60 years; (3) diagnosis of dementia according to National Institute on Aging-Alzheimer's Association (NIAAA) criteria; (4) presence of tests or experiments with qualitative or quantitative results. Initially 125 studies published between 2000 and 2017 were identified, of which 12 met the inclusion criteria. The review identifies the issues and challenges that are reported when conversational agents and speech-based interfaces have been used for interacting with people with cognitive impairments. In addition, the review led to the identification of studies that have investigated speech processing and natural language processing capabilities to assess the cognitive status of people with dementia.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The text we found for this paper looks like another document, so the self-check wasn’t run.
Cites
Diagnostic and Statistical Manual of Mental Disorders
American Psychiatric Association (2013) · doi:10.1176/appi.books.9780890425596 · Cited by 116,369 · see citing works
McKhann, G. M., Knopman, D. S., Chertkow, H., Hyman, B. T., Jack, C. R., Kawas, C. H., Klunk, W. E., Koroshetz, W. J., Manly, J. J., Mayeux, R., et al. (2011) · Alzheimer's & Dementia · doi:10.1016/j.jalz.2011.03.005 · Cited by 18,657 · see citing works
ELIZA—a computer program for the study of natural language communication between man and machine
Weizenbaum, J. (1966) · Communications of the ACM · doi:10.1145/365153.365168 · Cited by 4,452 · see citing works
A survey of socially interactive robots
Fong, T., Nourbakhsh, I., & Dautenhahn, K. (2003) · Robotics and Autonomous Systems · doi:10.1016/s0921-8890(02)00372-x · Cited by 3,162 · cited 1× · see citing works
“Spoken dialogue is generally considered as the most natural way for social human-robot interaction [2].”
Advances in natural language processing
Hirschberg, J., & Manning, C. D. (2015) · Science · doi:10.1126/science.aaa8685 · Cited by 1,712 · see citing works
FRAME SEMANTICS AND THE NATURE OF LANGUAGE*
Fillmore, C. J. (1976) · Annals of the New York Academy of Sciences · doi:10.1111/j.1749-6632.1976.tb25467.x · Cited by 1,346 · see citing works
POMDP-Based Statistical Spoken Dialog Systems: A Review
Young, S. J., Gašić, M., Thomson, B., & Williams, J. D. (2013) · Proceedings of the IEEE · doi:10.1109/jproc.2012.2225812 · Cited by 898 · see citing works
Spoken dialogue technology: enabling the conversational user interface
McTear, M. F. (2002) · ACM Computing Surveys · doi:10.1145/505282.505285 · Cited by 571
McTear, M. (2002) · Springer eBooks · doi:10.1007/978-0-85729-414-2 · Cited by 569 · see citing works
Gorin, A. L., Riccardi, G., & Wright, J. H. (1997) · Speech Communication · doi:10.1016/s0167-6393(97)00040-x · Cited by 510 · see citing works
The Application of Hidden Markov Models in Speech Recognition
Gales, M., & Young, S. J. (2008) · Foundations and Trends® in Signal Processing · doi:10.1561/2000000004 · Cited by 497 · see citing works
Automatic Speech Recognition: A Deep Learning Approach
Yu, D., & Li Juan, D. E. N. G. (2014) · Signals and communication technology · doi:10.1007/978-1-4471-5779-3 · Cited by 475 · see citing works
Information state and dialogue management in the TRINDI dialogue move engine toolkit
Larsson, S., & Traum, D. R. (2000) · Natural Language Engineering · doi:10.1017/s1351324900002539 · Cited by 466 · see citing works
Machine Learning Paradigms for Speech Recognition: An Overview
Deng, L., & Li, X. (2013) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/tasl.2013.2244083 · Cited by 459 · see citing works
A review of verbal and non-verbal human–robot interactive communication
Mavridis, N. (2015) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2014.09.031 · Cited by 453 · see citing works
JUPlTER: a telephone-based conversational interface for weather information
Zue, V. W., Seneff, S., Glass, J. R., Polifroni, J. H., Pao, C., Hazen, T. J., & Hetherington, L. (2000) · IEEE Transactions on Speech and Audio Processing · doi:10.1109/89.817460 · Cited by 437 · see citing works
Spoken Language Derived Measures for Detecting Mild Cognitive Impairment
Roark, B., Mitchell, M., Hosom, J.-P., Hollingshead, K., & Kaye, J. (2011) · IEEE Transactions on Audio, Speech, and Language Processing · doi:10.1109/tasl.2011.2112351 · Cited by 355 · see citing works
The Information State Approach to Dialogue Management
Traum, D. R., & Larsson, S. (2003) · Text, speech and language technology · doi:10.1007/978-94-010-0019-2_15 · Cited by 344 · see citing works
Wallace, R. S. (2007) · Springer eBooks · doi:10.1007/978-1-4020-6710-5_13 · Cited by 335 · see citing works
Colby, K. M., Weber, S., & Hilf, F. D. (1971) · Artificial Intelligence · doi:10.1016/0004-3702(71)90002-6 · Cited by 299 · see citing works
Conversational interfaces: advances and challenges
Zue, V. W., & Glass, J. (2000) · Proceedings of the IEEE · doi:10.1109/5.880078 · Cited by 247 · see citing works
Young, V., & Mihailidis, A. (2010) · Assistive Technology · doi:10.1080/10400435.2010.483646 · Cited by 149 · see citing works
Quality of Telephone-Based Spoken Dialogue Systems
Möller, S. (2005) · Kluwer Academic Publishers eBooks · doi:10.1007/b100796 · Cited by 124 · see citing works
Virtual Agents as Daily Assistants for Elderly or Cognitively Impaired People
Yaghoubzadeh, R., Kramer, M., Pitsch, K., & Kopp, S. (2013) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-40415-3_7 · Cited by 98 · see citing works
Proceedings of the SIGDIAL 2011 Conference
Moore, J. D., Traum, D. R., Chai, J. Y., & Passonneau, R. J. (2011) · Cited by 73 · see citing works
Autoregressive Models for Statistical Parametric Speech Synthesis
Shannon, M., Zen, H., & Byrne, B. (2012) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/tasl.2012.2227740 · Cited by 61 · see citing works
Listener agent for elderly people with dementia
Sakai, Y., Nonaka, Y., Yasuda, K., & Nakano, Y. I. (2012) · Proceedings of the seventh annual ACM/IEEE international conference on Human-Robot Interaction · doi:10.1145/2157689.2157754 · Cited by 47 · see citing works
Granata, C., Chétouani, M., Tapus, A., Bidaud, P., & Dupourqué, V. (2010) · IEEE RO-MAN · doi:10.1109/roman.2010.5598698 · Cited by 47 · see citing works
From Chatbots to Dialog Systems
Klüwer, T. (2011) · IGI Global eBooks · doi:10.4018/978-1-60960-617-6.ch001 · Cited by 41 · see citing works
Dialogue Act Annotation with the ISO 24617-2 Standard
Bunt, H., Petukhova, V., Traum, D. R., et al. (2016) · Springer eBooks · doi:10.1007/978-3-319-42816-1_6 · Cited by 36 · see citing works
Rieser, V., Lemon, O., & Keizer, S. (2014) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/tasl.2014.2315271 · Cited by 35 · see citing works
Review of spoken dialogue systems
López-Cózar, R., Callejas, Z., Griol, D., & Quesada, J. F. (2014) · Loquens · doi:10.3989/loquens.2014.012 · Cited by 30 · see citing works
Toward a memory assistant companion for the individuals with mild memory impairment
Huang, H.-H., Matsushita, H., Kawagoe, K., Sakai, Y., Nonaka, Y., Nakano, Y., & Yasuda, K. (2012) · 2012 IEEE 11th International Conference on Cognitive Informatics and Cognitive Computing · doi:10.1109/icci-cc.2012.6311164 · Cited by 19 · see citing works
NADIA: A Simplified Approach Towards the Development of Natural Dialogue Systems
Berg, M. M. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-19581-0_12 · Cited by 16 · see citing works
Bruno, B., Mastrogiovanni, F., & Sgorbissa, A. (2013) · IEEE RO-MAN · doi:10.1109/roman.2013.6628406 · Cited by 16 · see citing works
Building a Hybrid: Chatterbot – Dialog System
Dingli, A., & Scerri, D. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-40585-3_19 · Cited by 12 · see citing works
Mariani, J., Rosset, S., Garnier-Rizet, M., et al. (2013) · Springer eBooks · doi:10.1007/978-1-4614-8280-2 · Cited by 11 · see citing works
Towards Assessing the Communication Responsiveness of People with Dementia
Nonaka, Y., Sakai, Y., Yasuda, K., & Nakano, Y. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-33197-8_57 · Cited by 10 · see citing works
Natural Language Understanding
Roukos, S. (2007) · Springer handbooks · doi:10.1007/978-3-540-49127-9_31 · Cited by 9 · see citing works
Zue, V. W., & Seneff, S. (2007) · Springer handbooks · doi:10.1007/978-3-540-49127-9_35 · Cited by 6 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
The Effectiveness of Artificial Intelligence Conversational Agents in Health Care: Systematic Review
Milne-Ives, M., de Cock, C., Lim, E., Shehadeh, M. H., de Pennington, N., Mole, G., Normando, E., & Meinert, E. (2020) · Journal of Medical Internet Research · doi:10.2196/20346 · Cited by 626 · see citing works
Does the Digital Therapeutic Alliance Exist? Integrative Review
Malouin-Lachance, A., Capolupo, J., Laplante, C., & Hudon, A. (2025) · JMIR Mental Health · doi:10.2196/69294 · Cited by 103 · see citing works
de Cock, C., Milne-Ives, M., van Velthoven, M. H., Alturkistani, A., Lam, C., & Meinert, E. (2020) · JMIR Research Protocols · doi:10.2196/16934 · Cited by 62 · see citing works
Kobayashi, M., Kosugi, A., Takagi, H., Nemoto, M., Nemoto, K., Arai, T., & Yamada, Y. (2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-29390-1_4 · Cited by 45 · see citing works
- Authors
- Russo, A., D'Onofrio, G., Gangemi, A., Giuliani, F., Mongiovi, M., Ricciardi, F., Greco, F., Cavallo, F., Dario, P., Sancarlo, D., Presutti, V., & Greco, A.
- Affiliations
- National Research Council (IT)
- Complex Structure of Geriatrics, Department of Medical Sciences, IRCCS “Casa Sollievo della Sofferenza,” San Giovanni Rotondo, Italy.
- Semantic Technology Laboratory (STLab), Institute for Cognitive Sciences and Technology (ISTC)—National Research Council (CNR), Rome, Italy.
- Casa Sollievo della Sofferenza (IT)
- Scuola Superiore Sant'Anna (IT)
- ORCID
- Venue
- Rejuvenation Research
- Publisher
- SAGE Publications
- Published
- 2019-04
- Volume
- 22
- Issue
- 2
- Pages
- 109-120
- ISSN
- 1094-5458 (ISSN-L)
- 1549-1684
- 1557-8577
- OpenAlex
- W2883096944
- Cited by
- 47
- References
- 41
- Citations by year
- 2026: 3 · 2025: 6 · 2024: 8 · 2023: 10 · 2022: 4 · 2021: 7 · 2020: 4 · 2019: 5
- FWCI
- 2.25
- Type
- journal article
- Language
- en
- Open access
- green
- hdl.handle.net
- Licence
- Locations
- Rejuvenation Research (publishedVersion)
- PubMed (publishedVersion)
- Archivio istituzionale della ricerca (Alma Mater Studiorum Università di Bologna) (submittedVersion)
- Florence Research (University of Florence) (submittedVersion)
- CINECA IRIS Institutional Research Information System (Sant'Anna School of Advanced Studies) (submittedVersion, public-domain)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
- Health Sciences › Medicine › Psychiatry and Mental health › Dementia and Cognitive Impairment Research
- Keywords
- spoken dialogue systems, chatbots, human-robot interaction, dementia, socially assistive robots, older adults, cognitive impairment, speech interfaces, natural language processing, speech processing, cognitive status assessment
- MeSH terms
- Automation, Communication, Dementia, Female, Humans, Interpersonal Relations, Male, Robotics, Speech Recognition Software
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
