The DOI matches its Crossref record; 30 of the 30 references it cites were found in a registry or an index.
Robot deictics: how gesture and context shape referential communication
Abstract
As robots collaborate with humans in increasingly diverse environments, they will need to effectively refer to objects of joint interest and adapt their references to various physical, environmental, and task conditions. Humans use a broad range of deictic gestures-gestures that direct attention to collocated objects, persons, or spaces-that include pointing, touching, and exhibiting to help their listeners understand their references. These gestures offer varying levels of support under different conditions, making some gestures more or less suitable for different settings. While these gestures offer a rich space for designing communicative behaviors for robots, a better understanding of how different deictic gestures affect communication under different conditions is critical for achieving effective human-robot interaction. In this paper, we seek to build such an understanding by implementing six deictic gestures on a humanlike robot and evaluating their communicative effectiveness in six diverse settings that represent physical, environmental, and task conditions under which robots are expected to employ deictic communication. Our results show that gestures which come into physical contact with the object offer the highest overall communicative accuracy and that specific settings benefit from the use of particular types of gestures. Our results highlight the rich design space for deictic gestures and inform how robots might adapt their gestures to the specific physical, environmental, and task conditions.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“All of these systems are based on rules and/or procedural generation, which limits the degree of naturalness, fluidity, and variability that can be achieved in the resulting animations, and makes it difficult to match the gesture quality produced by contemporary generative models for co-speech gestures as described above.”
From Incorporating Spatial Awareness in Data-Driven Gesture Generation for Virtual Agents (2024) · cites this paper as [25]
Citations
Cites
1 retracted
RETRACTED: Communicative gestures facilitate problem solving for both communicators and recipients
Lozano, S. C., & Tversky, B. (2006) · Journal of Memory and Language · doi:10.1016/j.jml.2005.09.002 · Cited by 44
RetractedHand and mind: what gestures reveal about thought
(1993) · Choice Reviews Online · doi:10.5860/choice.30-2492 · Cited by 5,094
Gesture Visible Action as Utterance
Kendon, A. (2004) · Cambridge University Press eBooks · doi:10.1017/cbo9780511807572 · Cited by 3,891
Pointing: Where Language, Culture, and Cognition Meet
(2003) · Psychology Press eBooks · doi:10.4324/9781410607744 · Cited by 695
The role of gesture in communication and thinking
Goldin-Meadow, S. (1999) · Trends in Cognitive Sciences · doi:10.1016/s1364-6613(99)01397-2 · Cited by 692
Vogel, D., & Balakrishnan, R. (2004) · Proceedings of the 17th annual ACM symposium on User interface software and technology · doi:10.1145/1029632.1029656 · Cited by 660
Towards a Descriptive Framework for Spatial Deixis
Fillmore, C. J. (1982) · Medical Entomology and Zoology · Cited by 655
Effects of nonverbal communication on efficiency and robustness in human-robot teamwork
Breazeal, C., Kidd, C. D., Thomaz, A. L., Hoffman, G., & Berlin, M. (2005) · 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems · doi:10.1109/iros.2005.1545011 · Cited by 557
A comparative analysis of animals' understanding of the human pointing gesture
Miklósi, Á., & Soproni, K. (2006) · Animal Cognition · doi:10.1007/s10071-005-0008-1 · Cited by 421
Enabling Effective Human–Robot Interaction Using Perspective-Taking in Robots
Trafton, J. G., Cassimatis, N. L., Bugajska, M. D., Brock, D. P., Mintz, F. E., & Schultz, A. C. (2005) · IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans · doi:10.1109/tsmca.2005.850592 · Cited by 309
Research works printed but not linked: 4
- 10.1037/0022-0663.89.1.183 · doi:10.1037/0022-0663.89.1.183 · Paper page
- S. Harrison . The creation and implementation of a gesture code for factory communication . In Proc. GESPIN 2011 , 2011 . S. Harrison. The creation and implementation of a gesture code for factory communication. In Proc. GESPIN 2011, 2011.
- 10.5555/2447556.2447665 · doi:10.5555/2447556.2447665
- 10.2307/1128700 · doi:10.2307/1128700 · Paper page
Cited by
What’s the Point: Semantic Segmentation with Point Supervision
Bearman, A., Russakovsky, O., Ferrari, V., & Fei-Fei, L. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46478-7_34 · Cited by 887
Social Eye Gaze in Human-Robot Interaction: A Review
Admoni, H., & Scassellati, B. (2017) · Journal of Human-Robot Interaction · doi:10.5898/jhri.6.1.admoni · Cited by 588
A Survey of Nonverbal Signaling Methods for Non-Humanoid Robots
Cha, E., Kim, Y., Fong, T., & Matarić, M. J. (2018) · now publishers, Inc. eBooks · doi:10.1561/2300000057 · Cited by 129
Human-swarm interaction using spatial gestures
Nagi, J., Giusti, A., Gambardella, L. M., & Di Caro, G. A. (2014) · 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems · doi:10.1109/iros.2014.6943101 · Cited by 90
What's the Point: Semantic Segmentation with Point SupervisionPreprint
Bearman, A., Russakovsky, O., Ferrari, V., & Fei-Fei, L. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1506.02106 · Cited by 75
Metadata
- Authors
- Sauppé, A., & Mutlu, B.
- Affiliations
- University of Wisconsin–Madison (US)
- Venue
- Proceedings of the 2014 ACM/IEEE international conference on Human-robot interaction
- Publisher
- ACM
- Published
- 2014-03-03
- Pages
- 342-349
- OpenAlex
- W2036765125
- Cited by
- 93
- References
- 30
- Citations by year
- 2026: 11 · 2025: 2 · 2024: 6 · 2023: 6 · 2022: 7 · 2021: 14 · 2020: 9 · 2019: 6 · 2018: 7 · 2017: 4 · 2016: 7 · 2015: 10 · 2014: 4
- FWCI
- 16.36
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- ACM/IEEE International Conference on Human-Robot Interaction (HRI) (publishedVersion)
- Funders
- National Science Foundation
- University of Wisconsin-Madison
- National Institutes of Health
- Topics
- Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
- Physical Sciences › Engineering › Control and Systems Engineering › Robot Manipulation and Learning
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Keywords
- pointing gestures, human-robot interaction, robot communication, pointing, humanoid robots, gesture design, environmental factors, task conditions
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Robot deictics: how gesture and context shape referential communication. https://app.cochat.ai/papers/10.1145/2559636.2559657
- The paper
- Sauppé, A., & Mutlu, B. (2014). Robot deictics: how gesture and context shape referential communication. Proceedings of the 2014 ACM/IEEE international conference on Human-robot interaction. https://doi.org/10.1145/2559636.2559657
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.