Study on Text-based and Voice-based Dialogue Interfaces for Human-Computer Interactions in a Blocks World
The DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.
Abstract
We conducted a small scale user study to understand user experiences with two different forms of dialogue interfaces - text-based and voice-based - to interact with a virtual agent in a Blocks World environment while perform tower building tasks. The participants also had the option of using deictic gestures in addition to the speech modality. We identify common types of errors/issues that led to communication failures and share our observations about how users reacted to these issues. We also present survey data that reflects users' evaluations of the dialogue interfaces and their interactions with the virtual agent.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“In the gaming domain, studies employed either computer speakers [35, 78], mobile devices [14]or robots [22] in their SDS designs.”
From System and User Strategies to Repair Conversational Breakdowns of Spoken Dialogue Systems: A Scoping Review (2024) · cites this paper as [35]
In the citing paper
“A few studies used embodied SDSs, employing animated systems [14, 78], avatars [35, 57, 72], and robots [22], mainly in the gaming domain, with one study each in the personal assistant and customer service domains.”
From System and User Strategies to Repair Conversational Breakdowns of Spoken Dialogue Systems: A Scoping Review (2024) · cites this paper as [35]
In the citing paper
“Roles of SDSs were primarily as facilitators (N=32), with only three studies [22, 35, 78], examining SDSs as peers, all within the gaming domain.”
From System and User Strategies to Repair Conversational Breakdowns of Spoken Dialogue Systems: A Scoping Review (2024) · cites this paper as [35]
In the citing paper
“This study revealed that attempts of many participants to amend errors by repeating phrases more slowly or with clearer enunciations often resulted in higher rates of error recognition by the SDS.”
From System and User Strategies to Repair Conversational Breakdowns of Spoken Dialogue Systems: A Scoping Review (2024) · cites this paper as [35]
In the citing paper
“Recent studies, particularly those produced in the past five years, have shown increased interest in exploring modulation strategies across various domains and settings, primarily through the analysis of lab-collected corpora (e.g. [35, 46, 53]).”
From System and User Strategies to Repair Conversational Breakdowns of Spoken Dialogue Systems: A Scoping Review (2024) · cites this paper as [35]
1 more claim about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Anaphora and coreference resolution: A review
Sukthanker, R., Poria, S., Cambria, E., & Thirunavukarasu, R. (2020) · Information Fusion · doi:10.1016/j.inffus.2020.01.010 · Cited by 194
Proceedings of the 6th SIGdial Workshop on Discourse and Dialogue
(2005) · doi:10.18653/v1/2005.sigdial-1 · Cited by 169
Learning Interpretable Spatial Operations in a Rich 3D Blocks World
Bisk, Y., Shih, K. J., Choi, Y., & Marcu, D. (2018) · AAAI Publications (The Association for the Advancement of Artificial Intelligence (AAAI)) · doi:10.1609/aaai.v32i1.12026 · Cited by 63
SMILEE: Symmetric Multi-modal Interactions with Language-gesture Enabled (AI) Embodiment
Kim, S., Salter, D. A., DeLuccia, L., Son, K., Amer, M. R., & Tamrakar, A. (2018) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n18-5018 · Cited by 7
Self-citation
Research works printed but not linked: 3
- Rolf Carlson , Jens Edlund , Mattias Heldner , Anna Hjalmarsson , David House , and Gabriel Skantze . 2006 . Towards human-like behaviour in spoken dialog systems . Proceedings of Swedish Language Technology Conference (SLTC 2006) (2006). Rolf Carlson, Jens Edlund, Mattias Heldner, Anna Hjalmarsson, David House, and Gabriel Skantze. 2006. Towards human-like behaviour in spoken dialog systems. Proceedings of Swedish Language Technology Conference (SLTC 2006) (2006).
- Robyn Kozierok , Lynette Hirschman , John Aberdeen , Cheryl Clar , Christopher Garay , Bradley Goodman , Tonia Korves , and Matthew Peterson . 2018. DARPA Communicating With Computers: Program Goals and Hallmarks. (03 2018 ). Robyn Kozierok, Lynette Hirschman, John Aberdeen, Cheryl Clar, Christopher Garay, Bradley Goodman, Tonia Korves, and Matthew Peterson. 2018. DARPA Communicating With Computers: Program Goals and Hallmarks. (03 2018).
- Gabriel Skantze . 2003 . Exploring human error handling strategies: Implications for spoken dialogue systems . In ISCA Tutorial and Research Workshop on Error Handling in Spoken Dialogue Systems. Gabriel Skantze. 2003. Exploring human error handling strategies: Implications for spoken dialogue systems. In ISCA Tutorial and Research Workshop on Error Handling in Spoken Dialogue Systems.
Cited by
Alghamdi, E., Halvey, M., & Nicol, E. (2024) · ACM Conversational User Interfaces 2024 · doi:10.1145/3640794.3665558 · Cited by 36
Tang, H., Zhang, C., & Li, Q. (2024) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2024.2405784 · Cited by 36
“Computer-based interactions are becoming increasingly ubiquitous in our daily lives, whether we are using mobile devices, wearables, VR devices (Hwang et al., 2023; Kim et al., 2020).”
Conversational AI over Military Scenarios Using Intent Detection and Response Generation
Chuang, H.-M., & Cheng, D.-W. (2022) · Applied Sciences · doi:10.3390/app12052494 · Cited by 15
Kim, S., Garlapati, A., Lubin, J., Tamrakar, A., & Divakaran, A. (2021) · International Conference on Affective Computing and Intelligent Interaction Workshops and Demos (ACIIW) · doi:10.1109/aciiw52867.2021.9666238 · Cited by 1
Self-citation
Metadata
- Authors
- Kim, S., Salter, D., DeLuccia, L., & Tamrakar, A.
- Affiliations
- SRI International (US)
- Venue
- Proceedings of the 8th International Conference on Human-Agent Interaction
- Publisher
- ACM
- Published
- 2020-11-10
- Pages
- 227-229
- OpenAlex
- W3096719515
- Cited by
- 4
- References
- 4
- Citations by year
- 2024: 2 · 2022: 1 · 2021: 1
- FWCI
- 0.19
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- International Conference on Human-Agent Interaction (HAI) (publishedVersion)
- Funders
- DARPA (W911NF-15-C-9244)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
- Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
- Keywords
- dialogue interface, text-based interfaces, speech interfaces, human-computer interaction, virtual agents, blocks world, pointing gestures, speech modality, communication breakdown, user experience, user evaluation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Study on Text-based and Voice-based Dialogue Interfaces for Human-Computer Interactions in a Blocks World. https://app.cochat.ai/papers/10.1145/3406499.3418754
- The paper
- Kim, S., Salter, D., DeLuccia, L., & Tamrakar, A. (2020). Study on Text-based and Voice-based Dialogue Interfaces for Human-Computer Interactions in a Blocks World. Proceedings of the 8th International Conference on Human-Agent Interaction. https://doi.org/10.1145/3406499.3418754
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.