Nonverbal signaling for non-humanoid robots during human-robot collaboration
The DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.
Abstract
Non-humanoid robots are becoming increasingly utilized for collaborative tasks across many domains, including industrial and service settings. Collaborative tasks between the human and robot rely on each collaborator's ability to effectively convey their mental state while accurately estimating and interpreting their partner's knowledge, intent, and actions. My research focuses on nonverbal communication signals that a non-humanoid robot can utilize during human-robot collaboration. We focus on motion, light and sound as they are commonly used communication channels across many domains and are available on most robot platforms. As a first step towards this goal, I present a completed study exploring how to use a simple multimodal light and sound signal to request help during a collaborative task. We then discuss future work to generate and utilize more complex signals to convey a variety of statuses to improve collaboration.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Cha et al. (2016) evaluated a robot which utilized both light and sound of varying levels of urgency to request help from bystanders when it experienced difficulty. Results indicated that participants interpreted light and sound signals differently: sound alerted the user that the robot needed help and the light indicated the level of urgency of the help request.”
From Understanding and Resolving Failures in Human-Robot Interaction: Literature Review and Model Development (2018) · cites this paper as Cha et al., 2016
Citations
Cites
Psychological Research on Joint Action
Knoblich, G., Butterfill, S., & Sebanz, N. (2011) · Psychology of Learning and Motivation · doi:10.1016/b978-0-12-385527-5.00003-6 · Cited by 540 · cited 2×
“Humans are able to effectlive utilize both verbal and nonverbal cues to signal information, such as their knowledge, goals, and intent, to achieve a high degree of coordination [1], [2].”
BackgroundTheory and evaluation of human robot interactions
Scholtz, J. (2003) · 36th Annual Hawaii International Conference on System Sciences, 2003. Proceedings of the · doi:10.1109/hicss.2003.1174284 · Cited by 433 · cited 1×
“Most robots can operate in various modes with different degrees of autonomy and supervision [8].”
BackgroundCost-Based Anticipatory Action Selection for Human–Robot Fluency
Hoffman, G., & Breazeal, C. (2007) · IEEE Transactions on Robotics · doi:10.1109/tro.2007.907483 · Cited by 177 · cited 1×
“requesting help are often distracting and obtrusive, lowering efficiency and annoying collaborators [5].”
BackgroundJudging the urgency of non-verbal auditory alarms: a case study
Arrabito, G. R., Mondor, T. A., & Kent, K. J. (2004) · Ergonomics · doi:10.1080/0014013042000193282 · Cited by 45 · cited 1×
“Moreover, we also saw that the higher urgency a signal was, the more attention-grabbing and annoying it was [7].”
BackgroundFischer, K., Soto, B., Pantofaru, C., & Takayama, L. (2014) · The 23rd IEEE International Symposium on Robot and Human Interactive Communication · doi:10.1109/roman.2014.6926383 · Cited by 42
Exploring minimal nonverbal interruption in HRI
Saulnier, P., Sharlin, E., & Greenberg, S. (2011) · IEEE RO-MAN · doi:10.1109/roman.2011.6005257 · Cited by 38
To help or not to help a service robot
Hüttenrauch, H., & Eklundh, K. S. (2004) · IEEE RO-MAN · doi:10.1109/roman.2003.1251875 · Cited by 24 · cited 2×
“Asking for help can be broken down into three phases: 1) get the responder’s attention, 2) alert the responder that help is needed, and 3) put forth the request [3], [4], [6].”
Background
Cited by
Honig, S., & Oron-Gilad, T. (2018) · Frontiers in Psychology · doi:10.3389/fpsyg.2018.00861 · Cited by 338
“Cha et al. (2016) evaluated a robot which utilized both light and sound of varying levels of urgency to request help from bystanders when it experienced difficulty.”
BackgroundNonverbal Sound in Human-Robot Interaction: A Systematic Review
Zhang, B. J., & Fitter, N. T. (2023) · ACM Transactions on Human-Robot Interaction · doi:10.1145/3583743 · Cited by 67
“[22] Nonverbal signaling for non-humanoid robots during human-robot collaboration Functional robot sound”
BackgroundHuman-Robot Teaming: Concepts and Components for Design
Ma, L. M., Fong, T., Micire, M. J., Kim, Y. K., & Feigh, K. M. (2017) · Springer proceedings in advanced robotics · doi:10.1007/978-3-319-67361-5_42 · Cited by 73
“Language is highly extensive and conveys a high level of detail, however, whether language is specific or general is dependent on task, domain and other factors [5].”
BackgroundInfluentialSelf-citationCharisi, V., Gómez, E., Mier, G., Merino, L., & Gómez, R. (2020) · Frontiers in Robotics and AI · doi:10.3389/frobt.2020.00015 · Cited by 50
“The design of all behaviors was based on previous literature from the field of HRI, design and psychology and were based on minimalistic principles (Saulnier et al., 2011; Cha et al., 2016).”
MethodTransparent Robot Behavior Using Augmented Reality in Close Human-Robot Interaction
Bolano, G., Juelg, C., Roennau, A., & Dillmann, R. (2019) · IEEE RO-MAN · doi:10.1109/ro-man46459.2019.8956296 · Cited by 40
“The work from Cha et al. explored the use of nonverbal communication signals that a robot could use in a human-robot collaboration [12].”
BackgroundTransparent Robot Behavior by Adding Intuitive Visual and Acoustic Feedback to Motion Replanning
Bolano, G., Roennau, A., & Dillmann, R. (2018) · IEEE RO-MAN · doi:10.1109/roman.2018.8525671 · Cited by 32
Metrics for Human-Robot Team Design: A Teamwork Perspective on Evaluation of Human-Robot Teams
Ma, L. M., IJtsma, M., Feigh, K. M., & Pritchett, A. R. (2022) · ACM Transactions on Human-Robot Interaction · doi:10.1145/3522581 · Cited by 34
“Indeed, human-robot teams face many shortcomings if teamwork is not addressed explicitly during design [8], similar to CSE studies in which automation was not used as intended because of di culties in the interaction [15, 28, 36, 43].”
BackgroundMixed Reality as Communication Medium for Human-Robot Collaboration
Macciò, S., Carfì, A., & Mastrogiovanni, F. (2022) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra46639.2022.9812233 · Cited by 26
Cao, H.-L., Scholz, C., Winter, J. D., Makrini, I. E., & Vanderborght, B. (2023) · International Journal of Social Robotics · doi:10.1007/s12369-023-01018-9 · Cited by 27
“Using light and/or sound modalities can provide extra information for people to understand the robot behaviors and havecertainpositiveeffectsonhuman-robotcollaboration[2, 8, 33, 34].”
BackgroundInteraction Needs and Opportunities for Failing Robots
Morales, C. G., Carter, E. J., Tan, X. Z., & Steinfeld, A. M. (2019) · Designing Interactive Systems Conference · doi:10.1145/3322276.3322345 · Cited by 24
“Sound is particularly useful for signalling problems, and lighting cues can convey levels of urgency [4].”
BackgroundBack-off: Evaluation of Robot Motion Strategies to Facilitate Human-Robot Spatial Interaction
Reinhardt, J., Prasch, L., & Bengler, K. J. (2021) · ACM Transactions on Human-Robot Interaction · doi:10.1145/3418303 · Cited by 25
“An investigation of attention and awareness processes is a common prerequisite in the design of human-robot interaction (HRI) scenarios [7].”
BackgroundInfluentialSomebody help me, please?!” Interaction Design Framework for Needy Mobile Service Robots
Backhaus, N., Rosen, P. H., Scheidig, A., Groß, H., & Wischniewski, S. (2018) · IEEE Workshop on Advanced Robotics and its Social Impacts (ARSO) · doi:10.1109/arso.2018.8625721 · Cited by 25
“Next, human attention recognition is important [18].”
BackgroundAn Approach to Elicit Human-Understandable Robot Expressions to Support Human-Robot Interaction
Leusmann, J., Villa, S., Liang, T., Wang, C., Schmidt, A., & Mayer, S. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713085 · Cited by 19
“Non-humanoid robots are able to express emotions [37], the will to collaborate [15], and can be used to support interaction between humans [36, 63] using gestures.”
EnviRobots: How Human–Robot Interaction Can Facilitate Sustainable Behavior
Scheutz, C., Law, T., & Scheutz, M. J. (2021) · Sustainability · doi:10.3390/su132112283 · Cited by 16
“While natural language can make a direct social connection with people, lights [52], movement [53], and non-verbal noise [54] on robots have also been used to successfully convey various “emotions” and messages to humans.”
BackgroundBeyond R2D2: Designing Multimodal Interaction Behavior for Robot-specific Morphology
Karreman, D. E., Ludden, G., & Evers, V. (2019) · ACM Transactions on Human-Robot Interaction · doi:10.1145/3331144 · Cited by 12
“For example, Embgen et al. [23], Bretan, Hoffman, and Weinberg [10], and Cha, Matarić, and Fong [13] already proposed to use abstracted robot-specific behavior consisting of body movement and displaying colored lights, to show a robot’s emotion and intentions.”
BackgroundDei, C., Falerni, M. M., Cilsal, T., Redaelli, D. F., Nicora, M. L., Chiappini, M., Storm, F. A., & Malosio, M. (2024) · Journal on Multimodal User Interfaces · doi:10.1007/s12193-024-00444-x · Cited by 9
Modelling and evaluating failures in human-robot teaming using simulation
Ma, L. M., IJtsma, M., Feigh, K. M., Paladugu, A., & Pritchett, A. R. (2018) · IEEE Aerospace Conference (AERO) · doi:10.1109/aero.2018.8396581 · Cited by 6
A communication paradigm for human-robot interaction during robot failure scenarios
Brooks, D. J., Curtin, D. J., Kuczynski, J. T., Rodriguez, J. J., Steinfeld, A. M., & Yanco, H. A. (2020) · Elsevier eBooks · doi:10.1016/b978-0-12-820543-3.00014-6 · Cited by 6
“For example, Cha et al. [4] summarized the process of asking for help as having three phases: 1) getting someone’s attention, 2) indicating to the person that help is needed, and 3) conveying the request for help.”
Mart, L., Zaffir, M. A. B. M., Honji, S., & Wada, T. (2025) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2025.3550702 · Cited by 5
Exploring the taxonomie and associative link between emotion and function for robot sound design
Jeong, E., Kwon, G. H., & So, J. (2017) · International Conference on Ubiquitous Robots and Ambient Intelligence · doi:10.1109/urai.2017.7992692 · Cited by 4
“Previous studies have examined the effect of robot motor sound [2], nonverbal signals [3], nonlinguistic expression [4], and musical utterance [5-6].”
BackgroundEffect of Presenting Stiffness of Robot Hand to Human on Human-Robot Handovers
Yamamoto, J., Tahara, K., & Wada, T. (2024) · IEEE International Conference on Robotics and Biomimetics (ROBIO) · doi:10.1109/robio64047.2024.10907341 · Cited by 4
“Physical Human-Robot Collaborations have attracted attention, such as collaborative robots [1], [2], [3], [4], [5], [6], [7], [8], [9], [10], [11], rehabilitation robots [12], teleoperated robots [13], supernumerary robotic limbs [14], [15].”
Influence of Personality Traits on Helping Behaviour in Human-Robot Interaction
Westhoven, M., & Tegtmeier, P. (2021) · IEEE Workshop on Advanced Robotics and its Social Impacts (ARSO) · doi:10.1109/arso51874.2021.9542832 · Cited by 2
Guajo, J., Alzate-Anzola, C., Castaño-Londoño, L., & Márquez-Viloria, D. (2022) · TecnoLógicas · doi:10.22430/22565337.2170 · Cited by 2
“This use arises from the sensations of comfort generated in humans in the interaction with this type of robot [2].”
BackgroundMartín, A. S., Hagenow, M., Shah, J., Kildal, J., & Lazkano, E. (2025) · IEEE RO-MAN · doi:10.1109/ro-man63969.2025.11217753 · Cited by 1
“Robots are appreciated for their efficiency, reliability, and capacity to provide consistent support in collaborative environments [24], [25].”
Design and Evaluation of a Spherical Robot with Emotion-Like Feedback during Human-Robot Training
Onchi, E., & Lee, S. H. (2019) · Transactions of Japan Society of Kansei Engineering · doi:10.5057/jjske.tjske-d-19-00036 · Cited by 1
Back-off: Evaluation of Robot Motion Strategies to Facilitate Human-Robot Spatial InteractionPreprint
Reinhardt, J., Prasch, L., & Bengler, K. J. (2020) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/8pvqy · Cited by 1
Munteanu-Calen, A. (2023) · reposiTUm (TU Wien) · doi:10.34726/hss.2023.107249 · Cited by 1
Guajo, J., Alzate-Anzola, C., Betancur, D., Castaño-Londoño, L., & Márquez-Viloria, D. (2021) · Communications in computer and information science · doi:10.1007/978-3-030-86702-7_38
Back-off: Evaluation of Robot Motion Strategies to Facilitate Human-Robot Spatial InteractionPreprint
Reinhardt, J., Prasch, L., & Bengler, K. J. (2020) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/ws2ez
Robot Housekeeper Cart: Empowering Housekeeping Work through Etiquette-Based Interactions in Hotels
Jiang, N., Wang, B., & Liu, X. (2026) · ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.1145/3776734.3794607
Metadata
- Authors
- Cha, E., Mataric, M., & Fong, T.
- Affiliations
- University of Southern California (US)
- Ames Research Center (US)
- Venue
- 2016 11th ACM/IEEE International Conference on Human-Robot Interaction (HRI)
- Publisher
- IEEE
- Published
- 2016-03
- Pages
- 601-602
- OpenAlex
- W4252789170
- Cited by
- 29
- References
- 7
- Citations by year
- 2026: 1 · 2025: 3 · 2024: 2 · 2023: 2 · 2022: 3 · 2021: 4 · 2020: 4 · 2019: 4 · 2018: 4 · 2017: 2
- FWCI
- 5.62
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- ACM/IEEE International Conference on Human-Robot Interaction (HRI) (publishedVersion)
- Funders
- National Aeronautics and Space Administration
- Topics
- Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
- Physical Sciences › Engineering › Control and Systems Engineering › Robot Manipulation and Learning
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Keywords
- nonverbal communication, non-humanoid robots, human-robot collaboration, multimodal signals, light signals, acoustic signals, robot motion, help requests, collaborative tasks
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.