An Integrated Approach to Human-Robot-Smart Environment Interaction Interface for Ambient Assisted Living
The DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Abstract
This paper presents a novel approach to integrating humans and assistive robots into ECHONET-based smart home environments through a multi-modal user interface, toward mitigating nursing care problems in aging societies. We envision a socially assistive humanoid robot companion as a smart care home interface that will support independent living of the disabled and elderly. Especially, we improve and personalize human-robot interaction by endowing the robot with human-like social skills (i.e. natural language processing, user emotion estimation, etc.). Moreover, universAAL, which is an open platform for Ambient Assisted Living (AAL) solution, is employed to connect various components, devices, and services in the proposed software framework. The ECHONET-based smart home environment, iHouse, with the extended AAL solution provides an efficient way to improve the quality of life of smart home residents. We have confirmed that a humanoid robot companion can gain access to the iHouse network and provide user-requested data and services through verbal and nonverbal interaction with the support of various effective techniques of computational intelligence.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Human–Robot Interaction: A Survey
Goodrich, M. A., & Schultz, A. C. (2008) · Foundations and Trends® in Human–Computer Interaction · doi:10.1561/1100000005 · Cited by 1,541 · cited 1×
“Therefore, toward the use of elder-care robots in smart homes, we aim to enhance the robot’s interaction performance, leading to more intuitive, natural ways of human-robot-smart environment interaction for elderly people [5].”
BackgroundHuman-Robot Interaction: A Survey
Goodrich, M. A., & Schultz, A. C. (2007) · now publishers, Inc. eBooks · doi:10.1561/9781601980939 · Cited by 1,095
Human–Robot Interaction: Status and Challenges
Sheridan, T. B. (2016) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720816644364 · Cited by 786
Dupuis, K., & Pichora-Fuller, M. K. (2011) · Canadian acoustics · Cited by 90
Paving the way for culturally competent robots: A position paper
Bruno, B., Chong, N. Y., Kamide, H., Kanoria, S., Lee, J., Lim, Y., Pandey, A. K., Papadopoulos, C., Papadopoulos, I., Pecora, F., et al. (2017) · IEEE RO-MAN · doi:10.1109/roman.2017.8172357 · Cited by 79 · cited 2×
“This work is to provide an integrated software framework for an ongoing Horizon 2020 EU-Japan project “Culture-Aware Robots and Environmental Sensor Systems for Elderly Support” (CARESSES) [6], which is intended to pave the way toward incorporating the use of care robots and smart environments into the future of socie…”
MethodSelf-citationPEIS Ecology: integrating robots into smart environments
Broxvall, M., Gritti, M., Saffiotti, A., Seo, B.-S., & Cho, Y.-J. (2006) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/robot.2006.1641186 · Cited by 67 · cited 1×
“Along the lines, robot-smart environment interaction is attracting considerable interest due to the rapidly expanding the Internet of Things (IoT) [3], [4].”
BackgroundEchonet: A Home Network Standard
Matsumoto, S. (2010) · IEEE Pervasive Computing · doi:10.1109/mprv.2010.57 · Cited by 36 · cited 1×
“ECHONET [8], which has became a de jure home network standard certified by ICE and ISO, stands for Energy Conservation and Homecare Network.”
MethodIntelligent Interaction for Human-Friendly Service Robot in Smart House Environment
Bien, Z., Lee, H.-E., Do, J., Kim, Y.-H., Park, K., & Yang, S.-E. (2008) · International Journal of Computational Intelligence Systems · doi:10.2991/ijcis.2008.1.1.6 · Cited by 29
Integrating robots into the Internet of Things
Turcu, C. E., Turcu, C., & Găitan, V. G. (2012) · Cited by 15
Integrating a Humanoid Robot into ECHONET-Based Smart Home Environments
Bui, H.-D., Pham, V. C., Lim, Y., Tan, Y., & Chong, N. Y. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-70022-9_31 · Cited by 13 · cited 1×
“ROBOT-SMART ENVIRONMENT INTERACTION [7] A.”
Self-citation
Research works printed but not linked: 1
- lundqvist, 1998, The karolinska directed emotional faces (kdef), CD ROM from Department of Clinical Neuroscience Psychology Section
Cited by
Cicirelli, G., Marani, R., Petitti, A., Milella, A., & D’Orazio, T. (2021) · Sensors · doi:10.3390/s21103549 · Cited by 218
Brunete, A., Gambao, E., Hernando, M., & Cedazo, R. (2021) · Sensors · doi:10.3390/s21062212 · Cited by 65
“The interaction between a smart environment, assistive robots, and the user gains special importance when it assists people with reduced mobility, limited cognitive capacity, or chronic illnesses that create dependency [2].”
BackgroundMiura, C., Chen, S., Saiki, S., Nakamura, M., & Yasuda, K. (2022) · Sensors · doi:10.3390/s22103829 · Cited by 81
Modelling Multimodal Dialogues for Social Robots Using Communicative Acts
Fernández-Rodicio, E., Castro-González, Á., Alonso-Martín, F., Maroto-Gómez, M., & Salichs, M. Á. (2020) · Sensors · doi:10.3390/s20123440 · Cited by 37
Influence of AI: Robotics in Healthcare
Ness, S., Xuan, T. R., & Oguntibeju, O. O. (2024) · Asian Journal of Research in Computer Science · doi:10.9734/ajrcos/2024/v17i5451 · Cited by 38
Socially Assistive Robots in Smart Environments to Attend Elderly People—A Survey
Cruces, A., Jerez, A., Bandera, J. P., & Bandera, A. J. (2024) · Applied Sciences · doi:10.3390/app14125287 · Cited by 37
Shen, Z., Elibol, A., & Chong, N. Y. (2021) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2021.103874 · Cited by 29
Self-citationInternet of robotic things for independent living: Critical analysis and future directions
Sandhu, M. M., Silvera‐Tawil, D., Borges, P., Zhang, Q., & Kusý, B. (2024) · Internet of Things · doi:10.1016/j.iot.2024.101120 · Cited by 31
A systematic literature review on intelligent user interfaces
Gonçalves, T. G., Kolski, C., de Oliveira, K. M., Travassos, G. H., & Strugeon, E. G.-L. (2019) · doi:10.1145/3366551.3370344 · Cited by 14
“) of this research we have noted that many of the proposed solutions such as Ambient Intelligence, Cyber-physical system, interactive system, smart health, smart home, and smart environment are developed to healthcare application domain (e.g. [1] [3] [8] [21].”
BackgroundConversational Interfaces in IoT Ecosystems: Where We Are, What Is Still Missing
Gallo, S., Paternò, F., & Malizia, A. (2023) · International Conference on Mobile and Ubiquitous Multimedia (MUM) · doi:10.1145/3626705.3627775 · Cited by 21
“Among the papers in the smart home domain, five of them [2, 13, 28, 56, 60] are specifically designed to provide support for older adults or people with disabilities.”
BackgroundMethodInfluentialBui, H.-D., & Chong, N. Y. (2019) · IEEE International Conference on Robotics and Biomimetics (ROBIO) · doi:10.1109/robio49542.2019.8961810 · Cited by 11
Self-citationHelping People Through Space and Time: Assistance as a Perspective on Human-Robot Interaction
Newman, B. A., Aronson, R. M., Kitani, K., & Admoni, H. (2022) · Frontiers in Robotics and AI · doi:10.3389/frobt.2021.720319 · Cited by 17
“Robots can use speech to change the content of the conversation (Gamborino and Fu, 2018) or to answer a question about the surrounding environment (Bui and Chong, 2018).”
BackgroundAn oneM2M Interworking Proxy Entity for ECHONET Lite Protocol
Pham, V. C., Lim, Y., & Tan, Y. (2019) · IEEE Global Conference on Consumer Electronics (GCCE) · doi:10.1109/gcce46687.2019.9015534 · Cited by 8
“The proposed solution proposed a common platform which allows service providers to interact with ECHONET Lite based smart homes for health care applications [6], [7].”
BackgroundJung, H. W., Park, J. Y., Holoubek, T., Kim, W. J., & Park, J. (2025) · International Journal of Social Robotics · doi:10.1007/s12369-025-01323-5 · Cited by 15
“Through these integrative systems, robots and ser - vice providers can more effectively monitor health-related factors and achieve rich interactions through multimodal environmental interactions [ 55 – 57].”
Prospects of Robots in Assisted Living Environment
Mahmood, S., Ampadu, K. O., Αντωνόπουλος, Κ., Panagiotou, C., Pertuz, S. A., Podlubne, A., Antonopoulos, C., Κεραμίδας, Γ., Hübner, M., Goehringer, D., et al. (2021) · Electronics · doi:10.3390/electronics10172062 · Cited by 9
“Another challenge programmers face is personalizing the velocity to suit different elderly walking instances in care homes [20].”
BackgroundGaleas, J., Tudela, A., Pons, Ó., Bandera, J. P., Bandera, A. J., & Bustos, P. (2025) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2025.104437 · Cited by 6
Colantonio, S., Jovanovic, M., Zdravevski, E., Lameski, P., Tellioğlu, H., Kampel, M., & Flórez‐Revuelta, F. (2022) · International Conference on PErvasive Technologies Related to Assistive Environments (PETRA) · doi:10.1145/3529190.3534753 · Cited by 7
“Reliability [24, 32, 33, 41-49], Accessibility [39, 50-59] and Usability [18, 20, 21, 23, 25, 28, 51, 60-62] are considered in 10 or more papers each (Figure 3 (b)).”
Improvement of the Sensor Capability of the NAO Robot by the Integration of a Laser Rangefinder
Bonaiuto, V., & Zanela, A. (2022) · Applied System Innovation · doi:10.3390/asi5060105 · Cited by 3
Key Practices for Welfare Robots provision: Assessment Framework and Participation
Yasuoka, M., Homma, K., Akutsu, Y., & Matsumoto, Y. (2021) · IEEE Workshop on Advanced Robotics and its Social Impacts (ARSO) · doi:10.1109/arso51874.2021.9542845 · Cited by 2
Robotics and AI in Healthcare: A Systematic Review
AlShamsi, S., Alsuwaidi, L., & Shaalan, K. F. (2022) · Studies in computational intelligence · doi:10.1007/978-3-031-14748-7_18 · Cited by 3
Robot Social Emotional Development through Memory Retrieval
Bui, H.-D., Dang, T. L. Q., & Chong, N. Y. (2019) · International Conference on Robot Intelligence Technology and Applications (RiTA) · doi:10.1109/ritapp.2019.8932912 · Cited by 2
“This work makes a contribution to the ongoing Horizon 2020 EU-Japan project “Culture-Aware Robots and Environmental Sensor Systems for Elderly Support” (CARESSES) [11], [12], which aims to pave the way toward integrating the use of care robots and smart environments [13], [14] into the”
BackgroundSelf-citationSensors and Features for Assisted Living Technologies
Uddin, M. Z. (2022) · Springer eBooks · doi:10.1007/978-3-031-11534-9_2 · Cited by 1
Contrasting Affiliation and Reference Cues for Conversational Agents in Smart Environments
Reig, S., Fong, T., Carter, E. J., Steinfeld, A. M., & Forlizzi, J. (2024) · IEEE RO-MAN · doi:10.1109/ro-man60168.2024.10731173 · Cited by 1
“At the same time, there is a growing body of work emphasizing the need to study how the user experience of interacting with a connected “smart” environment should take form [5]–[7].”
BackgroundSocially Assistive Technologies for Older Adults in Their Residential Environment
Nobre, B. L. P., & Vergara, L. G. L. (2025) · Global perspectives on health geography · doi:10.1007/978-3-031-88463-4_10
Tan, W., Zhang, A., & Xie, G. (2026) · IEEE International Conference on Electronic Technology, Communication and Information (ICETCI) · doi:10.1109/icetci68937.2026.11610829
“The deployment of intelligent service robots in domestic environments has gained significant momentum in ambient assisted living, healthcare monitoring, and smart home management [1,2] .”
Metadata
- Authors
- Bui, H.-D., & Chong, N. Y.
- Affiliations
- Japan Advanced Institute of Science and Technology (JP)
- ORCID
- Chong, Nak Young
- Venue
- 2018 IEEE Workshop on Advanced Robotics and its Social Impacts (ARSO)
- Publisher
- IEEE
- Published
- 2018-09
- Pages
- 32-37
- OpenAlex
- W2912188041
- Cited by
- 25
- References
- 11
- Citations by year
- 2026: 1 · 2025: 3 · 2024: 4 · 2023: 1 · 2022: 6 · 2021: 5 · 2020: 1 · 2019: 4
- FWCI
- 4.48
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- IEEE Workshop on Advanced Robotics and its Social Impacts (ARSO) (publishedVersion)
- Topics
- Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
- Physical Sciences › Engineering › Control and Systems Engineering › Robotics and Automated Systems
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Keywords
- ambient assisted living, human-robot interaction, socially assistive robots, home automation, multimodal interfaces, emotion recognition, natural language processing, elderly care, independent living, aging society, nursing care
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.