Augmented Robotics Dialog System for Enhancing Human-Robot Interaction
Open accessThe DOI matches its Crossref record; 53 of the 57 references it cites were found in a registry or an index.
Abstract
Augmented reality, augmented television and second screen are cutting edge technologies that provide end users extra and enhanced information related to certain events in real time. This enriched information helps users better understand such events, at the same time providing a more satisfactory experience. In the present paper, we apply this main idea to human–robot interaction (HRI), to how users and robots interchange information. The ultimate goal of this paper is to improve the quality of HRI, developing a new dialog manager system that incorporates enriched information from the semantic web. This work presents the augmented robotic dialog system (ARDS), which uses natural language understanding mechanisms to provide two features: (i) a non-grammar multimodal input (verbal and/or written) text; and (ii) a contextualization of the information conveyed in the interaction. This contextualization is achieved by information enrichment techniques that link the extracted information from the dialog with extra information about the world available in semantic knowledge bases. This enriched or contextualized information (information enrichment, semantic enhancement or contextualized information are used interchangeably in the rest of this paper) offers many possibilities in terms of HRI. For instance, it can enhance the robot’s pro-activeness during a human–robot dialog (the enriched information can be used to propose new topics during the dialog, while ensuring a coherent interaction). Another possibility is to display additional multimedia content related to the enriched information on a visual device. This paper describes the ARDS and shows a proof of concept of its applications.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures











Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“From the related works, just three of them (Pealtson et al. [16], Alonso et al. [10] and Lison et al. [9]) consider the use of different communication channels. The rest of the works are designed for verbal communication exclusively.”
From Modelling Multimodal Dialogues for Social Robots Using Communicative Acts (2020) · cites this paper as [10]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ROS: an open-source Robot Operating System
Quigley, M. (2009) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · Cited by 8,729
Knowledge vault: a web-scale approach to probabilistic knowledge fusion
Dong, X., Gabrilovich, E., Heitz, G., Horn, W., Lao, N., Murphy, K., Strohmann, T., Sun, S., & Zhang, W. (2014) · Proceedings of the 20th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/2623330.2623623 · Cited by 1,533 · cited 1×
“In contrast to Knowledge Graph, which needs human intervention to increase the knowledge base, Knowledge Vault is automatically created as explained in [69].”
BackgroundSemantic Sentiment Analysis of Twitter
Saif, H., He, Y., & Alani, H. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-35176-1_32 · Cited by 521
Strategies for Natural Language Processing
(2014) · Psychology Press eBooks · doi:10.4324/9781315802671 · Cited by 517
Morris, C. (1946) · George Braziller eBooks · doi:10.1037/14607-000 · Cited by 463
User-level sentiment analysis incorporating social networks
Tan, C., Lee, L., Tang, J., Jiang, L., Zhou, M., & Li, P. (2011) · Proceedings of the 17th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/2020408.2020614 · Cited by 419
Socially Assistive Robots in Elderly Care: A Mixed-Method Systematic Literature Review
Kachouie, R., Sedighadeli, S., Khosla, R., & Chu, M.-T. (2014) · International Journal of Human–Computer Interaction · doi:10.1080/10447318.2013.873278 · Cited by 409
Exploiting social relations for sentiment analysis in microblogging
Hu, X., Tang, L., Tang, J., & Liu, H. (2013) · Proceedings of the sixth ACM international conference on Web search and data mining · doi:10.1145/2433396.2433465 · Cited by 384
Modelling, Design and Robust Control of a Remotely Operated Underwater Vehicle
García-Valdovinos, L. G., Salgado-Jiménez, T., Bandala-Sánchez, M., Nava-Balanzar, L., Hernández-Alvarado, R., & Cruz-Ledesma, J. A. (2014) · International Journal of Advanced Robotic Systems · doi:10.5772/56810 · Cited by 375
Knowledge base completion via search-based question answering
West, R., Gabrilovich, E., Murphy, K., Sun, S., Gupta, R., & Lin, D. (2014) · Proceedings of the 23rd international conference on World wide web · doi:10.1145/2566486.2568032 · Cited by 305 · cited 1×
“All of this extra information is obtained from knowledge databases, which relate an entity to information from the real world, as described in [65,66], and have been integrated into the ARDS.”
Background
Research works printed but not linked: 3
- Gorostiza, J., Barber, R., Khamis, A., Malfaz, M., Pacheco, R., Rivas, R., Corrales, A., Delgado, E., and Salichs, M. (2006, January 6–8). Multimodal Human-Robot Interaction Framework for a Personal Robot. Hatfield, UK. · DOI · Paper page
- Alonso-Martin, F., Castro-González, A., Gorostiza, J.F., and Salichs, M.A. (2013). Social Robotics, Springer International Publishing.
- Bellegarda, J.R. (2014). Natural Interaction with Robots, Knowbots and Smartphones, Springer.
Cited by
A Survey on Dialogue Management in Human-robot Interaction
Reimann, M. M., Kunneman, F., Oertel, C., & Hindriks, K. V. (2024) · ACM Transactions on Human-Robot Interaction · doi:10.1145/3648605 · Cited by 63
“[41] presents such a system, where multiple slots can be illed at a time, for action requests for the robot Maggie.”
InfluentialPollmann, K., Loh, W., Fronemann, N., & Ziegler, D. (2023) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2023.122376 · Cited by 48
Intention Understanding in Human–Robot Interaction Based on Visual-NLP Semantics
Li, Z., Mu, Y., Sun, Z., Song, S., Su, J., & Zhang, J. (2021) · Frontiers in Neurorobotics · doi:10.3389/fnbot.2020.610139 · Cited by 45
“With the development of neural networks, some researchers tried to tackle the problem of natural language comprehension as a classification problem and connect the natural language representations of objects with objects in images (Matuszek et al., 2014; Alonso-Martín et al., 2015), although it turned out that classif…”
BackgroundAyanoğlu, H., & Sequeira, J. S. (2019) · Human-computer interaction series · doi:10.1007/978-3-319-96722-6_3 · Cited by 41
SeleCon: Scalable IoT Device Selection and Control Using Hand Gestures
Alanwar, A., Alzantot, M., Ho, B.-J., Martin, P. D., & Srivastava, M. B. (2017) · IEEE/ACM International Conference on Internet-of-Things Design and Implementation (IoTDI) · doi:10.1145/3054977.3054981 · Cited by 40
“Dierent forms of interaction have been proposed, such as speech recognition [10], face recognition [29], gaze/eye tracking [31], and hand gesture tracking [15].”
Background
Metadata
- Authors
- Alonso-Martín, F., Castro-González, A., Luengo, F., & Salichs, M.
- Affiliations
- Robotics Lab, Universidad Carlos III de Madrid, Av. de la Universidad 30, Leganés, Madrid 28911, Spain
- Universidad Carlos III de Madrid (ES)
- Venue
- Sensors
- Publisher
- MDPI AG
- Published
- 2015-07-03
- Volume
- 15
- Issue
- 7
- Pages
- 15799-15829
- ISSN
- 1424-8220 (ISSN-L)
- PMC
- PMC4541855
- OpenAlex
- W1500703277
- Cited by
- 27
- References
- 57
- Citations by year
- 2026: 2 · 2024: 3 · 2023: 1 · 2022: 1 · 2021: 1 · 2020: 6 · 2019: 3 · 2018: 3 · 2017: 4 · 2016: 2 · 2015: 1
- FWCI
- 3.26
- Type
- journal article
- Language
- en
- Open access
- gold
- dx.doi.org
- Licence
- Locations
- Sensors (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- LA Referencia (Red Federada de Repositorios Institucionales de Publicaciones Científicas) (publishedVersion, cc-by-nc-nd)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- e-Archivo (Carlos III University of Madrid) (submittedVersion, cc-by-nc-nd)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
- Social Sciences › Business, Management and Accounting › Marketing › AI in Service Interactions
- Keywords
- human-robot interaction, dialogue manager, augmented reality, semantic web, information enrichment, contextualization, natural language understanding, multimodal input, knowledge base, second screen
- MeSH terms
- Cybernetics, Humans, Natural Language Processing, Robotics, Speech, User-Computer Interface
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Augmented Robotics Dialog System for Enhancing Human-Robot Interaction. https://app.cochat.ai/papers/10.3390/s150715799
- The paper
- Alonso-Martín, F., Castro-González, A., Luengo, F., & Salichs, M. (2015). Augmented Robotics Dialog System for Enhancing Human-Robot Interaction. Sensors. https://doi.org/10.3390/s150715799
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.