Identifying the addressee in human-human-robot interactions based on head pose and speech
The DOI matches its Crossref record.
Abstract
In this work we investigate the power of acoustic and visual cues, and their combination, to identify the addressee in a human-human-robot interaction. Based on eighteen audio-visual recordings of two human beings and a (simulated) robot we discriminate the interaction of the two humans from the interaction of one human with the robot. The paper compares the result of three approaches. The first approach uses purely acoustic cues to find the addressees. Low level, feature based cues as well as higher-level cues are examined. In the second approach we test whether the human's head pose is a suitable cue. Our results show that visually estimated head pose is a more reliable cue for the identification of the addressee in the human-human-robot interaction. In the third approach we combine the acoustic and visual cues which results in significant improvements.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cited by
A review of verbal and non-verbal human–robot interactive communication
Mavridis, N. (2015) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2014.09.031 · Cited by 453
Automatic nonverbal analysis of social interaction in small groups: A review
Gatica-Perez, D. (2009) · Image and Vision Computing · doi:10.1016/j.imavis.2009.01.004 · Cited by 309
Turn-taking in conversational systems and human-robot interaction: a review
Skantze, G. (2021) · Computer Speech & Language · doi:10.1016/j.csl.2020.101178 · Cited by 298
Turn-taking, feedback and joint attention in situated human-robot interaction
Skantze, G., Hjalmarsson, A., & Oertel, C. (2014) · Speech Communication · doi:10.1016/j.specom.2014.05.005 · Cited by 101
Attention-based addressee selection for service and social robots to interact with multiple persons
Li, L., Xu, Q., & Tan, Y. K. (2012) · Proceedings of the Workshop at SIGGRAPH Asia · doi:10.1145/2425296.2425319 · Cited by 20
Metadata
- Authors
- Katzenmaier, M., Stiefelhagen, R., & Schultz, T.
- Venue
- Proceedings of the 6th international conference on Multimodal interfaces
- Publisher
- ACM
- Published
- 2004-10-13
- Pages
- 144-151
- OpenAlex
- W2144155486
- Cited by
- 122
- References
- 0
- FWCI
- 13.72
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Identifying the addressee in human-human-robot interactions based on head pose and speech. https://app.cochat.ai/papers/10.1145/1027933.1027959
- The paper
- Katzenmaier, M., Stiefelhagen, R., & Schultz, T. (2004). Identifying the addressee in human-human-robot interactions based on head pose and speech. Proceedings of the 6th international conference on Multimodal interfaces. https://doi.org/10.1145/1027933.1027959
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.