Review of Semantic-Free Utterances in Social Human–Robot Interaction
The DOI matches its Crossref record; 8 of the 8 references it cites were found in a registry or an index.
Abstract
As a young and emerging field in social human–robot interaction (HRI), semantic-free utterances (SFUs) research has been receiving attention over the last decade. SFUs are an auditory interaction means for machines that allow emotion and intent expression, which are composed of vocalizations and sounds without semantic content or language dependence. Currently, SFUs are most commonly utilized in animation movies (e.g., R2-D2, WALL-E, Despicable Me), cartoons (e.g., “Teletubbies,” “Morph,” “La Linea”), and computer games (e.g., The Sims) and hold significant potential for applications in HRI. SFUs are categorized under four general types: Gibberish Speech (GS), Non-Linguistic Utterances (NLUs), Musical Utterances (MU), and Paralinguistic Utterances (PU). By introducing the concept of SFUs and bringing multiple sets of studies in social HRI that have never been analyzed jointly before, this article addresses the need for a comprehensive study of the existing literature for SFUs. It outlines the current grand challenges, open questions, and provides guidelines for future researchers considering to utilize SFU in social HRI.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Measuring emotion: The self-assessment manikin and the semantic differential
Bradley, M. M., & Lang, P. J. (1994) · Journal of Behavior Therapy and Experimental Psychiatry · doi:10.1016/0005-7916(94)90063-9 · Cited by 9,538 · cited 1×
“At the end of the clips, the robot uttered its emotion to the child in an affective GS and the child had to rate the recognized emotion on valence and arousal dimensions using SAM measurement tool (Bradley & Lang, 1994).”
MethodPicard, R. W. (1997) · MIT Press · doi:10.7551/mitpress/1140.001.0001 · Cited by 7,382
Constants across cultures in the face and emotion.
Ekman, P., & Friesen, W. V. (1971) · Journal of Personality and Social Psychology · doi:10.1037/h0030377 · Cited by 5,509 · cited 2×
“…when categories are used (in forced choice measurements), subjects are asked to select one of the emotion labels (usually the “basic emotions”; Ekman & Friesen, 1971; but this varies depending on the application intentions of the robots in question) that best matches their interpretation of…”
BackgroundVocal communication of emotion: A review of research paradigms
Scherer, K. (2003) · Speech Communication · doi:10.1016/s0167-6393(02)00084-5 · Cited by 2,044
Anthropomorphism and the social robot
Duffy, B. R. (2003) · Robotics and Autonomous Systems · doi:10.1016/s0921-8890(02)00374-3 · Cited by 1,447 · cited 1×
“With their inherent understanding of situational context and natural tendency to anthropomorphize inanimate objects such as robots (Duffy, 2003), users (particularly children) are able to look past imperfections and gaps in the behavior of robots, which is a useful trait when designing HRI.”
BackgroundSpeech perception without traditional speech cues
Remez, R. E., Rubin, P. E., Pisoni, D. B., & Carrell, T. D. (1981) · Science · doi:10.1126/science.7233191 · Cited by 800
Building autonomous sensitive artificial listeners
Schroder, M., Bevacqua, E., Cowie, R., Eyben, F., Gunes, H., Heylen, D., ter Maat, M., McKeown, G., Pammi, S., Pantic, M., et al. (2012) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2011.34 · Cited by 185
Using prosodic clues to decide when to produce back-channel utterances
Ward, N. (1996) · 4th International Conference on Spoken Language Processing (ICSLP 1996) · doi:10.21437/icslp.1996-439 · Cited by 62 · cited 1×
“The specific types of PUs in these studies involve back-channel signals (Ward, 1996), pause fillers, and affect bursts (Scherer, 1994).”
Background
Cited by
Voice in Human–Agent Interaction: A Survey
Seaborn, K., Miyake, N. P., Pennefather, P., & Otake-Matsuura, M. (2022) · ACM Computing Surveys · doi:10.1145/3386867 · Cited by 249
“…detection and conveyance strategies from a technical angle: algorithms and hardware that “perceive” various aspects of human communication [22, 144], such as affect [36, 59, 111]), non-semantic vocalizations [192], non-verbal cues [52], including laughter [31], and other expressive qualities [64].”
BackgroundHuman Robot Engagement and Acceptability in Residential Aged Care
Khosla, R., Nguyen, K., & Chu, M.-T. (2017) · International Journal of Human–Computer Interaction · doi:10.1080/10447318.2016.1275435 · Cited by 124
A Systematic Review of Ten Years of Research on Human Interaction with Social Robots
Lambert, A., Norouzi, N., Bruder, G., & Welch, G. (2020) · International Journal of Human–Computer Interaction · doi:10.1080/10447318.2020.1801172 · Cited by 89
“Robotic dance Bharatharaj et al. (2015) 1995 to 2015 ~ 41 Bio-inspired therapeutic pet robots Yilmazyildiz et al. (2016) 2001 to 2014 32 Social robots and semantic-free utterances Charisi et al. (2016) 2000 to 2015 135 Child-robot interaction Crumpton and Bethel (2016) 1939 to 2015”
BackgroundWhy doesn't it work?: voice-driven interfaces and young children's communication repair strategies
Cheng, Y., Yen, K., Chen, Y., Chen, S., & Hiniker, A. (2018) · Proceedings of the 17th ACM Conference on Interaction Design and Children · doi:10.1145/3202185.3202749 · Cited by 69
“And work with adults has shown that detecting and recovering from breakdowns in communication remains a key challenge for human-robot interaction and other voice-based scenarios in HCI [32].”
Background
Metadata
- Authors
- Yilmazyildiz, S., Read, R., Belpeame, T., & Verhelst, W.
- Venue
- International Journal of Human-Computer Interaction
- Publisher
- Informa UK Limited
- Published
- 2015-10-19
- Volume
- 32
- Issue
- 1
- Pages
- 63-85
- ISSN
- 1044-7318 (ISSN-L)
- 1532-7590
- OpenAlex
- W2227407841
- Cited by
- 91
- References
- 8
- FWCI
- 7.82
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Review of Semantic-Free Utterances in Social Human–Robot Interaction. https://app.cochat.ai/papers/10.1080/10447318.2015.1093856
- The paper
- Yilmazyildiz, S., Read, R., Belpeame, T., & Verhelst, W. (2016). Review of Semantic-Free Utterances in Social Human–Robot Interaction. International Journal of Human-Computer Interaction. https://doi.org/10.1080/10447318.2015.1093856
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.