Autonomous Robotic Dialogue System with Reinforcement Learning for Elderlies with Dementia
The DOI matches its Crossref record; 12 of the 13 references it cites were found in a registry or an index.
Abstract
The growing number of people living with dementia puts a heavy load on elderly care nurses. The use of humanoid robots as communication partners can help alleviate this load with the goal to assist seniors in maintaining their cognitive skills through conversation. In this paper we present an autonomous robotic dialogue system with the humanoid robot Bonoid that is capable of learning a conversation strategy from interactions with humans. The system was tested and evaluated with first results showing natural and engaging interactions with seniors, and the robotic system acquiring a conversation strategy through the use of reinforcement learning.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Using a reinforcement learning approach, the adaptive robotic system would trigger one of three actions: 1) short response (simple agreement, encouragement); 2) long response (question); or 3) topic change (a statement introducing a new topic), being able to maintain interactions with end users for 20 min.”
From Conversational Affective Social Robots for Ageing and Dementia Support (2022) · cites this paper as [98]
In the citing paper
“Magyar et al. [98] have further proposed an autonomous dialog system integrated with Telenoid that triggers the next spoken action (including conversation topic) by estimating the senior's emotion and motivation based on nonverbal cues, through the use of external sensors to extract emotional features (e.g., facial emotion).”
From Conversational Affective Social Robots for Ageing and Dementia Support (2022) · cites this paper as [98]
Citations
Cites
Watkins, C. J. C. H., & Dayan, P. (1992) · Machine Learning · doi:10.1007/bf00992698 · Cited by 9,083
A survey of socially interactive robots
Fong, T., Nourbakhsh, I., & Dautenhahn, K. (2003) · Robotics and Autonomous Systems · doi:10.1016/s0921-8890(02)00372-x · Cited by 3,162 · cited 1×
“To this end the robot should observe the interacting human partner and model his or her state [6] [7], since people have been shown to respond to the listener’s expected state [8].”
BackgroundReinforcement learning in robotics: A survey
Kober, J., Bagnell, J. A., & Peters, J. (2013) · The International Journal of Robotics Research · doi:10.1177/0278364913495721 · Cited by 3,160 · cited 1×
“This adaptation was done through reinforcement learning, an actively used method in robot development [5].”
MethodInfluence of social network on occurrence of dementia: a community-based longitudinal study
Fratiglioni, L., Wang, H.-X., Ericsson, K., Maytan, M., & Winblad, B. (2000) · The Lancet · doi:10.1016/s0140-6736(00)02113-9 · Cited by 1,361 · cited 1×
“showed that decreased communication time can lead to the promotion of dementia [2], sustaining communication is therefore one of the goals in elderly care, albeit one that is hard to meet due to nursing shortage.”
BackgroundAn iterative design methodology for user-friendly natural language office information applications
Kelley, J. F. (1984) · ACM Transactions on Information Systems · doi:10.1145/357417.357420 · Cited by 702 · cited 1×
“In research, the Wizard of Oz methodology [12] is often used to avoid the complexity of implementing a fully autonomous robotic system.”
MethodPatterson, C. (2018) · Cited by 311
Use of social commitment robots in the care of elderly people with dementia: A literature review
Mordoch, E., Osterreicher, A., Guse, L., Roger, K., & Thompson, G. (2013) · Maturitas · doi:10.1016/j.maturitas.2012.10.015 · Cited by 270 · cited 1×
“Many autonomous dialogue systems have been developed, some even targeted to solve the lack of communication time of seniors [9].”
BackgroundExploring the Natural Reaction of Young and Aged Person with Telenoid in a Real World
Ogawa, K., ATR Intelligent Robotics and Communication Laboratory, 2.-2.-2. H., Nishio, S., Koda, K., Balistreri, G., Watanabe, T., Ishiguro, H., Graduate School of Engineering Science, O. U., & Dipartimento di Ingegneria Informatica, U. D. S. D. P. (2011) · Journal of Advanced Computational Intelligence and Intelligent Informatics · doi:10.20965/jaciii.2011.p0592 · Cited by 104 · cited 1×
“people with dementia [3] [4].”
Self-citationDo You Feel What I Feel? Social Aspects of Emotions in Twitter Conversations
Kim, S., Bak, J., & Oh, A. H. (2021) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v6i1.14310 · Cited by 88 · cited 1×
“To this end the robot should observe the interacting human partner and model his or her state [6] [7], since people have been shown to respond to the listener’s expected state [8].”
BackgroundDesign issues for vision-based computer interaction systems
Kjeldsen, R., & Hartman, J. (2001) · Proceedings of the 2001 workshop on Perceptive user interfaces · doi:10.1145/971478.971511 · Cited by 47 · cited 1×
“To this end the robot should observe the interacting human partner and model his or her state [6] [7], since people have been shown to respond to the listener’s expected state [8].”
Background
Research works printed but not linked: 2
- kuwamura, 2016, Automatic dialogue based on nonverbal information and estimation of mutual emotional and mental states, SIG-SLUD, b5, 13
- magyar, 2018, Using social robots as cognitive stimulation therapy coaches in an elderly care facility, Active & healthy aging novel robotic solutions and internet of things
Cited by
Application Scenarios for Artificial Intelligence in Nursing Care: Rapid Review
Seibert, K., Domhoff, D., Bruch, D., Schulte-Althoff, M., Fürstenau, D., Biessmann, F., & Wolf-Ostermann, K. (2021) · Journal of Medical Internet Research · doi:10.2196/26522 · Cited by 314
Conversational Affective Social Robots for Ageing and Dementia Support
Lima, M. R., Wairagkar, M., Gupta, M., Rodriguez y Baena, F., Barnaghi, P., Sharp, D. J., & Vaidyanathan, R. (2022) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2021.3115228 · Cited by 75
Survey on dialogue systems including slavic languages
Wołk, K., Wołk, A., Wnuk, D. C., Grześ, T., & Skubis, I. (2021) · Neurocomputing · doi:10.1016/j.neucom.2021.11.076 · Cited by 26
Yamazaki, R., Kase, H., Nishio, S., & Ishiguro, H. (2020) · Journal of Robotics and Mechatronics · doi:10.20965/jrm.2020.p0032 · Cited by 13
Self-citationReinforcement Learning for assistance of Alzheimer's disease patients
Taleb, W. B., Snoun, A., Bouchrika, T., & Jemai, O. (2022) · International Conference on Control, Decision and Information Technologies (CoDIT) · doi:10.1109/codit55151.2022.9804114 · Cited by 10
A simulated experiment to explore robotic dialogue strategies for people with dementia
Yuan, F., Sadovnik, A., Zhang, R., Casenhiser, D. M., Paek, E. J., & Zhao, X. (2022) · Journal of Rehabilitation and Assistive Technologies Engineering · doi:10.1177/20556683221105768 · Cited by 7
“In another study [23] of using RL to learn a conversation strategy for autonomous robotic dialogue system for people with dementia, the authors designed state space as the robot’s internal motivation (closely associated with user’s motivation) and previously selected action.”
BackgroundExploring Social Robots for Healthy Older Adults: Aging With Companionship
Tschida, J., Michael, K., & McDaniel, T. L. (2025) · IEEE Transactions on Technology and Society · doi:10.1109/tts.2024.3521341 · Cited by 6
“Many researchers emphasize the need to enhance verbal features in social robots [33], [34].”
Social Robotics to Address Isolation and Depression Among the Aging During and After COVID-19
Miller, J., & McDaniel, T. L. (2021) · Communications in computer and information science · doi:10.1007/978-3-030-78642-7_22 · Cited by 5
Socially Assistive Robots for Storytelling and Other Activities to Support Aging in Place
Miller, J., & McDaniel, T. L. (2021) · Springer eBooks · doi:10.1007/978-3-030-70716-3_6 · Cited by 5
Yuan, F., Zhang, R., Bilal, D., & Zhao, X. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-90525-5_37 · Cited by 8
Adaptive Robot Discourse for Language Acquisition in Adulthood
Cumbal, R. (2022) · ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.1109/hri53351.2022.9889517 · Cited by 5
“For this purpose, adaptive dialogue systems have been proposed based on Reinforcement Learning frameworks [10] or Partially Observable Markov Decision Process (POMDP) [11].”
MethodTakahashi, T., Higashimura, S., Ninomiya, T., Fujimura, S., Sugimoto, N., Horai, T., Abe, T., Kitamura, A., Matsumoto, M., Nakagami, G., et al. (2025) · Cureus · doi:10.7759/cureus.77635 · Cited by 1
Adaptive humanoid robot behaviour in a serious game scenario through reinforcement learning
Zedda, E., Manca, M., Paternò, F., & Santoro, C. (2025) · Behaviour and Information Technology · doi:10.1080/0144929x.2025.2456068 · Cited by 1
User identification and prioritization control of service robot teleoperation
Chivarov, N., Chikurtev, D., Pleva, M., Ondáš, S., & Liao, Y. (2020) · IEEE International Conference on Cognitive Infocommunications · doi:10.1109/coginfocom50765.2020.9237871 · Cited by 1
“companions [2], rescue teams [3], inspection or monitoring of processes or premises in industrial businesses, offices or at home, support for - elderly [4], disabled, blind and others the field of service following cognitive info-communications approaches [5].”
BackgroundSocially Assistive Robot to Treat/Assist Alzheimers Patients
Sudha, V., Priyanka, R., Mary, N. R., Chandushree, S., Likith, D., & RaviTeja, M. H. (2026) · International Conference on Visual Analytics and Data Visualization (ICVADV) · doi:10.1109/icvadv67766.2026.11470403
Metadata
- Authors
- Magyar, J., Kobayashi, M., Nishio, S., Sincak, P., & Ishiguro, H.
- Affiliations
- Advanced Telecommunications Research Institute International (JP)
- Technical University of Košice (SK)
- Venue
- 2019 IEEE International Conference on Systems, Man and Cybernetics (SMC)
- Publisher
- IEEE
- Published
- 2019-10
- Pages
- 3416-3421
- ISSN
- 1062-922X (ISSN-L)
- OpenAlex
- W2990580045
- Cited by
- 15
- References
- 13
- Citations by year
- 2026: 1 · 2025: 3 · 2022: 3 · 2021: 6 · 2020: 2
- FWCI
- 4.55
- Type
- conference paper
- Language
- en
- Open access
- closed
- Licence
- Locations
- Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics (publishedVersion)
- Topics
- Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Social Sciences › Business, Management and Accounting › Marketing › AI in Service Interactions
- Keywords
- humanoid robots, dementia, elderly care, reinforcement learning, conversational strategies, human-robot interaction, cognitive stimulation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.