Timing in Multimodal Turn-Taking Interactions: Control and Analysis Using Timed Petri Nets
Open accessThe DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.
Abstract
Turn-taking interactions with humans are multimodal and reciprocal in nature. In addition, the timing of actions is of great importance, as it influences both social and task strategies. To enable the precise control and analysis of timed discrete events for a robot, we develop a system for multimodal collaboration based on a timed Petri net (TPN) representation. We also argue for action interruptions in reciprocal interaction and describe its implementation within our system. Using the system, our autonomously operating humanoid robot Simon collaborates with humans through both speech and physical action to solve the Towers of Hanoi, during which the human and the robot take turns manipulating objects in a shared physical workspace. We hypothesize that action interruptions have a positive impact on turn-taking and evaluate this in the Towers of Hanoi domain through two experimental methods. One is a between-groups user study with 16 participants. The other is a simulation experiment using 200 simulated users of varying speed, initiative, compliance, and correctness. In these experiments, action interruptions are either present or absent in the system. Our collective results show that action interruptions lead to increased task efficiency through increased user initiative, improved interaction balance, and higher sense of fluency. In arriving at these results, we demonstrate how these evaluation methods can be highly complementary in the analysis of interaction dynamics.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Overlapping talk and the organization of turn-taking for conversation
SCHEGLOFF, E. A. (2000) · Language in Society · doi:10.1017/s0047404500001019 · Cited by 1,163
Why are some problems hard? Evidence from Tower of Hanoi
Kotovsky, K., Hayes, J. R., & Simon, H. A. (1985) · Cognitive Psychology · doi:10.1016/0010-0285(85)90009-x · Cited by 722
The power of a nod and a glance: envelope vs. emotional feedback in animated conversational agents
Cassell, J., & Thorisson, K. R. (1999) · Applied Artificial Intelligence · doi:10.1080/088395199117360 · Cited by 383
Collaboration in Human-Robot Teams
Hoffman, G., & Breazeal, C. (2004) · AIAA 1st Intelligent Systems Technical Conference · doi:10.2514/6.2004-6434 · Cited by 208
Cited by
Evaluating Fluency in Human–Robot Collaboration
Hoffman, G. (2019) · IEEE Transactions on Human-Machine Systems · doi:10.1109/thms.2019.2904558 · Cited by 454
Breazeal, C., Dautenhahn, K., & Kanda, T. (2016) · Springer Handbooks · doi:10.1007/978-3-319-32552-1_72 · Cited by 370
Seo, S. H., Griffin, K., Young, J. E., Bunt, A., Prentice, S., & Loureiro-Rodríguez, V. (2018) · International Journal of Social Robotics · doi:10.1007/s12369-017-0441-8 · Cited by 64
Challenges in Building Highly Interactive Dialogue Systems
Ward, N. G., & DeVault, D. (2016) · AI Magazine · doi:10.1609/aimag.v37i4.2687 · Cited by 46
“This is true not only for speech, but also for multimodal behaviors involving speech, animation, and action (Nijholt et al. 2008; Chao and Thomaz 2012; Huang and Mutlu 2014; Bailly et al. 2015; Ward and Abu 2016).”
BackgroundModelling Multimodal Dialogues for Social Robots Using Communicative Acts
Fernández-Rodicio, E., Castro-González, Á., Alonso-Martín, F., Maroto-Gómez, M., & Salichs, M. Á. (2020) · Sensors · doi:10.3390/s20123440 · Cited by 37
“Timing is also a critical factor [8] during any dialogue because the response to an utterance can lose its meaning if it is not delivered in time.”
Background
Metadata
- Authors
- Chao, C., & Thomaz, A.
- Venue
- Journal of Human-Robot Interaction
- Publisher
- Journal of Human-Robot Interaction
- Published
- 2012-08-01
- Pages
- 4-25
- ISSN
- 2163-0364 (ISSN-L)
- OpenAlex
- W2112645526
- Cited by
- 70
- References
- 4
- FWCI
- 8.91
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Timing in Multimodal Turn-Taking Interactions: Control and Analysis Using Timed Petri Nets. https://app.cochat.ai/papers/10.5898/jhri.1.1.chao
- The paper
- Chao, C., & Thomaz, A. (2012). Timing in Multimodal Turn-Taking Interactions: Control and Analysis Using Timed Petri Nets. Journal of Human-Robot Interaction. https://doi.org/10.5898/jhri.1.1.chao
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.