Exploring Turn-taking Cues in Multi-party Human-robot Discussions about Objects
The DOI matches its Crossref record; 3 of the 3 references it cites were found in a registry or an index.
Abstract
In this paper, we present a dialog system that was exhibited at the Swedish National Museum of Science and Technology. Two visitors at a time could play a collaborative card sorting game together with the robot head Furhat, where the three players discuss the solution together. The cards are shown on a touch table between the players, thus constituting a target for joint attention. We describe how the system was implemented in order to manage turn-taking and attention to users and objects in the shared physical space. We also discuss how multi-modal redundancy (from speech, card movements and head pose) is exploited to maintain meaningful discussions, given that the system has to process conversational speech from both children and adults in a noisy environment. Finally, we present an analysis of 373 interactions, where we investigate the robustness of the system, to what extent the system's attention can shape the users' turn-taking behaviour, and how the system can produce multi-modal turn-taking signals (filled pauses, facial gestures, breath and gaze) to deal with processing delays in the system.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Koiso, H., Horiuchi, Y., Tutiya, S., Ichikawa, A., & Den, Y. (1998) · Language and Speech · doi:10.1177/002383099804100404 · Cited by 272
Turn-taking cues in task-oriented dialogue
Gravano, A., & Hirschberg, J. (2011) · Computer Speech & Language · doi:10.1016/j.csl.2010.10.003 · Cited by 254
Turn-taking, feedback and joint attention in situated human-robot interaction
Skantze, G., Hjalmarsson, A., & Oertel, C. (2014) · Speech Communication · doi:10.1016/j.specom.2014.05.005 · Cited by 101
Self-citation
Research works printed but not linked: 22
- Al Moubayed , S. , Skantze , G. , & Beskow , J. ( 2013 ). The Furhat Back-Projected Humanoid Head - Lip reading, Gaze and Multiparty Interaction . International Journal of Humanoid Robotics, 10(1). Al Moubayed, S., Skantze, G., & Beskow, J. (2013). The Furhat Back-Projected Humanoid Head - Lip reading, Gaze and Multiparty Interaction. International Journal of Humanoid Robotics, 10(1).
- Al Moubayed , S. , Beskow , J. , Bollepalli , B. , HussenAbdelaziz , A. , Johansson , M. , Koutsombogera , M. , Lopes , J. , Novikova , J. , Oertel , C. , Skantze , G. , Stefanov , K. , & Varol , G. ( 2014 ). Tutoring Robots: Multiparty multimodal social dialogue with an embodied tutor . In Proceedings of eNTERFACE2013 . Springer. Al Moubayed, S., Beskow, J., Bollepalli, B., HussenAbdelaziz, A., Johansson, M., Koutsombogera, M., Lopes, J., Novikova, J., Oertel, C., Skantze, G., Stefanov, K., & Varol, G. (2014). Tutoring Robots: Multiparty multimodal social dialogue with an embodied tutor. In Proceedings of eNTERFACE2013. Springer.
- 10.1353/lan.1974.0010 · DOI · Paper page
- 10.1037/h0033031 · DOI · Paper page
- 10.1016/j.csl.2012.05.004 · DOI
- 10.1016/0001-6918(67)90005-4 · DOI · Paper page
- 10.1145/2663204.2663271 · DOI
- 10.1145/2070719.2070725 · DOI · Paper page
- 10.1145/365024.365119 · DOI · Paper page
- 10.1145/1027933.1027959 · DOI
- 10.1145/506443.506634 · doi:10.1145/506443.506634
- 10.1109/TSMCB.2008.927274 · DOI
- 10.1145/1891903.1891910 · DOI · Paper page
- Skantze , G. , Al Moubayed , S. , Gustafson , J. , Beskow , J. , & Granström , B. ( 2012 ). Furhat at Robotville: A Robot Head Harvesting the Thoughts of the Public through Multi-party Dialogue . In Proceedings of IVA-RCVA . Santa Cruz, CA. Skantze, G., Al Moubayed, S., Gustafson, J., Beskow, J., & Granström, B. (2012). Furhat at Robotville: A Robot Head Harvesting the Thoughts of the Public through Multi-party Dialogue. In Proceedings of IVA-RCVA. Santa Cruz, CA.
- 10.1007/978-3-319-02675-6_35 · DOI
- 10.1075/pc.3.2.02vel · DOI · Paper page
- 10.1007/BF01115461 · DOI
- Kawahara , T. , Iwatate , T. , & Takanashi , K. ( 2012 ). Prediction of Turn-Taking by Combining Prosodic and Eye-Gaze Information in Poster Conversations .. In Interspeech 2012. Kawahara, T., Iwatate, T., & Takanashi, K. (2012). Prediction of Turn-Taking by Combining Prosodic and Eye-Gaze Information in Poster Conversations.. In Interspeech 2012.
- Clark , H. H. ( 2005 ). Coordinating with each other in a material world. Discourse studies, 7(4--5), 507--525 . Clark, H. H. (2005). Coordinating with each other in a material world. Discourse studies, 7(4--5), 507--525.
- 10.1145/2388676.2388698 · DOI
- 10.1016/0167-6423(87)90035-9 · DOI · Paper page
- 10.18653/v1/W15-4642 · DOI
Cited by
Turn-taking in conversational systems and human-robot interaction: a review
Skantze, G. (2021) · Computer Speech & Language · doi:10.1016/j.csl.2020.101178 · Cited by 298
Self-citationRobots in Groups and Teams: A Literature Review
Sebo, S., Stoll, B., Scassellati, B., & Jung, M. F. (2020) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3415247 · Cited by 158
“Robots can also use gaze in tandem with other cues, such as smiles and speech pauses, to influence turn-taking between human group members and signal upcoming conversational turns for the robot [160, 161].”
BackgroundMethodInfluentialVulnerable robots positively shape human conversational dynamics in a human–robot team
Traeger, M. L., Strohkorb Sebo, S., Jung, M., Scassellati, B., & Christakis, N. A. (2020) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1910402117 · Cited by 140
“Furthermore, in settings with many human participants, robots can guide interactions between humans by adjusting their speech, focus, and actions (9, 22 – 25).”
Progressivity for voice interface design
Fischer, J. E., Reeves, S., Porcheron, M., & Sikveland, R. O. (2019) · Proceedings of the 1st International Conference on Conversational User Interfaces · doi:10.1145/3342775.3342788 · Cited by 88
Mirages. On Anthropomorphism in Dialogue Systems
Abercrombie, G., Curry, A., Dinkar, T., Rieser, V., & Talat, Z. (2023) · Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2023.emnlp-main.290 · Cited by 83
“Research has therefore sought to integrate dis-fluencies into text-to-speech (TTS) systems, where they have proven to be a useful strategy for buying time (Skantze et al., 2015), i.e. to allow the system to determine the next step.”
Background
Metadata
- Authors
- Skantze, G., Johansson, M., & Beskow, J.
- Venue
- Proceedings of the 2015 ACM on International Conference on Multimodal Interaction
- Publisher
- ACM
- Published
- 2015-11-09
- Pages
- 67-74
- OpenAlex
- W2293392332
- Cited by
- 75
- References
- 3
- FWCI
- 3.22
- Type
- conference paper
- Language
- en
- Open access
- closed
- Funders
- Swedish research council (2011-6237)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Exploring Turn-taking Cues in Multi-party Human-robot Discussions about Objects. https://app.cochat.ai/papers/10.1145/2818346.2820749
- The paper
- Skantze, G., Johansson, M., & Beskow, J. (2015). Exploring Turn-taking Cues in Multi-party Human-robot Discussions about Objects. Proceedings of the 2015 ACM on International Conference on Multimodal Interaction. https://doi.org/10.1145/2818346.2820749
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.