Behavioural Responses to Robot Conversational Failures
The DOI matches its Crossref record; 14 of the 14 references it cites were found in a registry or an index.
Abstract
Humans and robots will increasingly collaborate in domestic environments which will cause users to encounter more failures in interactions. Robots should be able to infer conversational failures by detecting human users' behavioural and social signals. In this paper, we study and analyse these behavioural cues in response to robot conversational failures. Using a guided task corpus, where robot embodiment and time pressure are manipulated, we ask human annotators to estimate whether user affective states differ during various types of robot failures. We also train a random forest classifier to detect whether a robot failure has occurred and compare results to human annotator benchmarks. Our findings show that human-like robots augment users' reactions to failures, as shown in users' visual attention, in comparison to non-human-like smart-speaker embodiments. The results further suggest that speech behaviours are utilised more in responses to failures when non-human-like designs are present. This is particularly important to robot failure detection mechanisms that may need to consider the robot's physical design in its failure detection model.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Scikit-learn: Machine Learning in Python
(2011) · Journal of Machine Learning Research · doi:10.5555/1953048.2078195 · Cited by 8,539
Clark, H. H., & Brennan, S. E. (1991) · Perspectives on socially shared cognition. · doi:10.1037/10096-006 · Cited by 4,555
Social robots for education: a review.
Belpaeme, T., Kennedy, J., Ramachandran, A., Scassellati, B., & Tanaka, F. (2018) · Science Robotics · doi:10.1126/scirobotics.aat5954 · Cited by 1,558
Social signal processing: Survey of an emerging domain
Vinciarelli, A., Pantic, M., & Bourlard, H. (2009) · Image and Vision Computing · doi:10.1016/j.imavis.2008.11.007 · Cited by 842
Relational agents: a model and implementation of building user trust
Bickmore, T., & Cassell, J. (2001) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/365024.365304 · Cited by 479
Overtrust of robots in emergency evacuation scenarios
Robinette, P., Li, W., Allen, R., Howard, A. M., & Wagner, A. R. (2016) · 2016 11th ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.1109/hri.2016.7451740 · Cited by 468 · cited 1×
“The robot produces an incorrect instruction by asking the user to pick a non-existing object [11, 32, 38, 40].”
BackgroundHonig, S., & Oron-Gilad, T. (2018) · Frontiers in Psychology · doi:10.3389/fpsyg.2018.00861 · Cited by 338 · cited 3×
“The failures were informed by taxonomies of failures in previous studies in HRI [21], and represented typical robot malfunctions that have been reported in human-robot interactions.”
BackgroundInfluentialThe effect of presence on human-robot interaction
Bainbridge, W. A., Hart, J., Kim, E. S., & Scassellati, B. (2008) · RO-MAN 2008 - The 17th IEEE International Symposium on Robot and Human Interactive Communication · doi:10.1109/roman.2008.4600749 · Cited by 300 · cited 1×
“With regards to robot embodiment, research has shown that robots with a physical embodiment are typically preferred over their tele-present or virtually embodied counterparts [4, 5, 22, 24, 28, 36, 37, 48, 52].”
BackgroundTo err is robot: how humans assess and act toward an erroneous social robot
Mirnig, N., Stollnberger, G., Miksch, M., Stadler, S., Giuliani, M., & Tscheligi, M. (2017) · Frontiers in Robotics and AI · doi:10.3389/frobt.2017.00021 · Cited by 244 · cited 3×
“The robot produces an incorrect instruction by asking the user to pick a non-existing object [11, 32, 38, 40].”
BackgroundGiuliani, M., Mirnig, N., Stollnberger, G., Stadler, S., Buchner, R., & Tscheligi, M. (2015) · Frontiers in Psychology · doi:10.3389/fpsyg.2015.00931 · Cited by 100 · cited 2×
“For example, Giuliani et al. [18] categorised failures into technical failures (caused by technical shortcomings) and social norm violations (usage of inappropriate social signals and deviations from the social script).”
Background
Cited by
A Taxonomy of Social Errors in Human-Robot Interaction
Tian, L., & Oviatt, S. (2021) · ACM Transactions on Human-Robot Interaction · doi:10.1145/3439720 · Cited by 133
Understanding User Perceptions of Proactive Smart Speakers
Wei, J., Dingler, T., & Kostakos, V. (2021) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3494965 · Cited by 33
“Researchers and developers have the freedom to design various types of conversations with different genders [41], emotions [37] and physical appearance [33].”
BackgroundGrounding behaviours with conversational interfaces: effects of embodiment and failures
Kontogiorgos, D., Pereira, A., & Gustafson, J. (2021) · Journal on Multimodal User Interfaces · doi:10.1007/s12193-021-00366-y · Cited by 14
Self-citation
Metadata
- Authors
- Kontogiorgos, D., Pereira, A., Sahindal, B., van Waveren, S., & Gustafson, J.
- Venue
- Proceedings of the 2020 ACM/IEEE International Conference on Human-Robot Interaction
- Publisher
- ACM
- Published
- 2020-03-09
- Pages
- 53-62
- OpenAlex
- W3009763971
- Cited by
- 42
- References
- 14
- FWCI
- 7.72
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Behavioural Responses to Robot Conversational Failures. https://app.cochat.ai/papers/10.1145/3319502.3374782
- The paper
- Kontogiorgos, D., Pereira, A., Sahindal, B., van Waveren, S., & Gustafson, J. (2020). Behavioural Responses to Robot Conversational Failures. Proceedings of the 2020 ACM/IEEE International Conference on Human-Robot Interaction. https://doi.org/10.1145/3319502.3374782
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.