“I Didn’t Catch That, But I’ll Try My Best”: Anticipatory Error Handling in a Voice Controlled Game
The DOI matches its Crossref record; 53 of the 53 references it cites were found in a registry or an index.
Abstract
Advances in speech recognition, language processing and natural interaction have led to an increased industrial and academic interest. While the robustness and usability of such systems are steadily increasing, speech-based systems are still susceptible to recognition errors. This makes intelligent error handling of utmost importance for the success of those systems. In this work, we integrated anticipatory error handling for a voice-controlled video game where the game would perform a locally optimized action in respect to goal completion and obstacle avoidance, when a command is not recognized. We evaluated the user experience of our approach versus traditional, repetition-based error handling (). Our results indicate that implementing anticipatory error handling can improve the usability of a system, if it follows the intention of the user. Otherwise, it impairs the user experience, even when deciding for technically optimal decisions.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“A few studies used embodied SDSs, employing animated systems [14, 78], avatars [35, 57, 72], and robots [22], mainly in the gaming domain, with one study each in the personal assistant and customer service domains.”
From System and User Strategies to Repair Conversational Breakdowns of Spoken Dialogue Systems: A Scoping Review (2024) · cites this paper as [78]
In the citing paper
“Roles of SDSs were primarily as facilitators (N=32), with only three studies [22, 35, 78], examining SDSs as peers, all within the gaming domain.”
From System and User Strategies to Repair Conversational Breakdowns of Spoken Dialogue Systems: A Scoping Review (2024) · cites this paper as [78]
In the citing paper
“In the gaming domain, studies employed either computer speakers [35, 78], mobile devices [14]or robots [22] in their SDS designs.”
From System and User Strategies to Repair Conversational Breakdowns of Spoken Dialogue Systems: A Scoping Review (2024) · cites this paper as [78]
In the citing paper
“This strategy is named differently in the reviewed studies, though they refer to the same concept and mechanism of repair methods such as 'ignore' [22], 'task-related question' [67], and 'anticipatory error handling' [78].”
From System and User Strategies to Repair Conversational Breakdowns of Spoken Dialogue Systems: A Scoping Review (2024) · cites this paper as [78]
Citations
Cites
Statistical Power Analysis for the Behavioral Sciences
Cohen, J. (2013) · doi:10.4324/9780203771587 · Cited by 25,373
Listen, attend and spell: A neural network for large vocabulary conversational speech recognition
Chan, W., Jaitly, N., Le, Q., & Vinyals, O. (2016) · 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2016.7472621 · Cited by 2,226
Luger, E., & Sellen, A. (2016) · Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858288 · Cited by 1,176
Voice Interfaces in Everyday Life
Porcheron, M., Fischer, J. E., Reeves, S., & Sharples, S. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3174214 · Cited by 717 · cited 2×
“In their early days, VUIs were designed for handling few specialized tasks [55], but due to the advancements in the technology, they now can have a broad range of capabilities in performing various functions in different settings.”
BackgroundLee, K. M., Peng, W., Jin, S.-A., & Yan, C. (2006) · Journal of Communication · doi:10.1111/j.1460-2466.2006.00318.x · Cited by 605
What Makes a Good Conversation?: Challenges in Designing Truly Conversational Agents
Clark, L., Pantidi, N., Cooney, O., Doyle, P., Garaialde, D., Edwards, J., Spillane, B., Gilmartin, E., Murad, C., Munteanu, C., et al. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300705 · Cited by 461 · cited 2×
“Apart from technical development, interaction research tackled multitudes of novel voice interfaces, investigating how people use these devices and how they respond to different kinds of speech from computers [5, 9, 23, 41].”
BackgroundJumping NLP Curves: A Review of Natural Language Processing Research
Cambria, E., & White, B. (2014) · Cited by 455
"What can i help you with?": infrequent users' experiences of intelligent personal assistants
Cowan, B. R., Pantidi, N., Coyle, D., Morrissey, K., Clarke, P., Al-Shehri, S., Earley, D., & Bandeira, N. (2017) · Proceedings of the 19th International Conference on Human-Computer Interaction with Mobile Devices and Services · doi:10.1145/3098279.3098539 · Cited by 351
Understanding the Long-Term Use of Smart Speaker Assistants
Bentley, F., Luvogt, C., Silverman, M., Wirasinghe, R., White, B., & Lottridge, D. (2018) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3264901 · Cited by 316
Prototyping an intelligent agent through Wizard of Oz
Maulsby, D., Greenberg, S., & Mander, R. (1993) · Proceedings of the SIGCHI conference on Human factors in computing systems - CHI '93 · doi:10.1145/169059.169215 · Cited by 307
Research works printed but not linked: 18
- Matthew P Aylett , Per Ola Kristensson , Steve Whittaker , and Yolanda Vazquez-Alvarez . 2014. None of a CHInd: relationship counselling for HCI and speech technology . In CHI’14 Extended Abstracts on Human Factors in Computing Systems . ACM , New York, NY, USA , 749–760. Matthew P Aylett, Per Ola Kristensson, Steve Whittaker, and Yolanda Vazquez-Alvarez. 2014. None of a CHInd: relationship counselling for HCI and speech technology. In CHI’14 Extended Abstracts on Human Factors in Computing Systems. ACM, New York, NY, USA, 749–760.
- 10.1145/3264901 · DOI · Paper page
- Dan Bohus and Alexander I Rudnicky . 2008. Sorry , I Didn’t Catch That!In Recent trends in discourse and dialogue . Springer , New York, NY, USA , 123–154. Dan Bohus and Alexander I Rudnicky. 2008. Sorry, I Didn’t Catch That!In Recent trends in discourse and dialogue. Springer, New York, NY, USA, 123–154.
- Richard A Bolt . 1980 . “ Put-that-there” Voice and gesture at the graphics interface . In Proceedings of the 7th annual conference on Computer graphics and interactive techniques. Association for Computing Machinery , New York, NY, USA, 262–270. Richard A Bolt. 1980. “Put-that-there” Voice and gesture at the graphics interface. In Proceedings of the 7th annual conference on Computer graphics and interactive techniques. Association for Computing Machinery, New York, NY, USA, 262–270.
- Cynthia Breazeal . 2003. Toward sociable robots. Robotics and autonomous systems 42, 3-4 ( 2003 ), 167–175. Cynthia Breazeal. 2003. Toward sociable robots. Robotics and autonomous systems 42, 3-4 (2003), 167–175.
- 10.5555/2817912.2817913 · doi:10.5555/2817912.2817913
- John Brooke 1996. SUS-A quick and dirty usability scale. Usability evaluation in industry 189, 194 ( 1996 ), 4–7. John Brooke 1996. SUS-A quick and dirty usability scale. Usability evaluation in industry 189, 194 (1996), 4–7.
- Crytek. 2013 . Ryse: Son of Rome. Game [XBox One]. Microsoft Studios , Redmond, Washington, U.S. Crytek. 2013. Ryse: Son of Rome. Game [XBox One]. Microsoft Studios, Redmond, Washington, U.S.
- Mihaly Csikszentmihalyi . 1990 . Flow: The psychology of optimal experience. Vol. 1990 . Harper & Row , New York, NY, USA . Mihaly Csikszentmihalyi. 1990. Flow: The psychology of optimal experience. Vol. 1990. Harper & Row, New York, NY, USA.
- EA Sports . 2013. Fifa 14. Game [XBox One]. Microsoft Studios , Redwood City , California, U.S. EA Sports. 2013. Fifa 14. Game [XBox One]. Microsoft Studios, Redwood City, California, U.S.
- Electronic Arts . 2012. Mass Effect 3. Game [XBox 360]. Electronic Arts , Redwood City , California, U.S. Electronic Arts. 2012. Mass Effect 3. Game [XBox 360]. Electronic Arts, Redwood City, California, U.S.
- He He , Jordan Boyd-Graber , Kevin Kwok , and Hal Daumé III. 2016 . Opponent modeling in deep reinforcement learning . In International conference on machine learning. PMLR, PMLR , New York, New York, USA , 1804–1813. He He, Jordan Boyd-Graber, Kevin Kwok, and Hal Daumé III. 2016. Opponent modeling in deep reinforcement learning. In International conference on machine learning. PMLR, PMLR, New York, New York, USA, 1804–1813.
- Juliana Miehle , Daniel Ostler , Nadine Gerstenlauer , and Wolfgang Minker . 2017. The next step: intelligent digital assistance for clinical operating rooms. Innovative surgical sciences 2, 3 ( 2017 ), 159–161. Juliana Miehle, Daniel Ostler, Nadine Gerstenlauer, and Wolfgang Minker. 2017. The next step: intelligent digital assistance for clinical operating rooms. Innovative surgical sciences 2, 3 (2017), 159–161.
- Moyen Mohammad Mustaquim . 2013. Automatic speech recognition-an approach for designing inclusive games. Multimedia tools and applications 66, 1 ( 2013 ), 131–146. Moyen Mohammad Mustaquim. 2013. Automatic speech recognition-an approach for designing inclusive games. Multimedia tools and applications 66, 1 (2013), 131–146.
- Cathy Pearl . 2016. Designing voice user interfaces: principles of conversational experiences . ” O’Reilly Media , Inc.”, Sebastopol, California . Cathy Pearl. 2016. Designing voice user interfaces: principles of conversational experiences. ” O’Reilly Media, Inc.”, Sebastopol, California.
- Richard M Ryan , C Scott Rigby , and Andrew Przybylski . 2006. The motivational pull of video games: A self-determination theory approach. Motivation and emotion 30, 4 ( 2006 ), 344–360. Richard M Ryan, C Scott Rigby, and Andrew Przybylski. 2006. The motivational pull of video games: A self-determination theory approach. Motivation and emotion 30, 4 (2006), 344–360.
- Amir Shevat . 2017. Designing bots: Creating conversational experiences . ” O’Reilly Media , Inc.”, Sebastopol, California . Amir Shevat. 2017. Designing bots: Creating conversational experiences. ” O’Reilly Media, Inc.”, Sebastopol, California.
- Turn 10 Studios . 2013. Forza Motorsport 5. Game [XBox One]. Microsoft Studios , Redmond, Washington, U.S. Turn 10 Studios. 2013. Forza Motorsport 5. Game [XBox One]. Microsoft Studios, Redmond, Washington, U.S.
Cited by
“As an AI language model, I cannot”: Investigating LLM Denials of User Requests
Wester, J., Schrills, T., Pohl, H., & van Berkel, N. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642135 · Cited by 100
Alghamdi, E., Halvey, M., & Nicol, E. (2024) · ACM Conversational User Interfaces 2024 · doi:10.1145/3640794.3665558 · Cited by 36
Zargham, N., Alexandrovsky, D., Erich, J., Wenig, N., & Malaka, R. (2022) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3491101.3519843 · Cited by 35
Self-citationLet’s Talk Games: An Expert Exploration of Speech Interaction with NPCs
Zargham, N., Friehs, M. A., Tonini, L., Alexandrovsky, D., Ruthven, E. G., Nacke, L. E., & Malaka, R. (2024) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2024.2338666 · Cited by 29
Self-citationBubbleu: Exploring Augmented Reality Game Design with Uncertain AI-based Interaction
Kim, M., Lee, K., Balan, R. K., & Lee, Y. (2023) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581270 · Cited by 17
Metadata
- Authors
- Zargham, N., Pfau, J., Schnackenberg, T., & Malaka, R.
- Affiliations
- University of Bremen (DE)
- Venue
- CHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2022-04-27
- Pages
- 1-13
- OpenAlex
- W4224988227
- Cited by
- 20
- References
- 51
- Citations by year
- 2026: 2 · 2025: 5 · 2024: 8 · 2023: 4 · 2022: 1
- FWCI
- 2.49
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- CHI Conference on Human Factors in Computing Systems (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
- Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
- Keywords
- speech recognition errors, speech-based interaction, user experience, usability, goal achievement, obstacle avoidance, user intention
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: “I Didn’t Catch That, But I’ll Try My Best”: Anticipatory Error Handling in a Voice Controlled Game. https://app.cochat.ai/papers/10.1145/3491102.3502115
- The paper
- Zargham, N., Pfau, J., Schnackenberg, T., & Malaka, R. (2022). “I Didn’t Catch That, But I’ll Try My Best”: Anticipatory Error Handling in a Voice Controlled Game. CHI Conference on Human Factors in Computing Systems. https://doi.org/10.1145/3491102.3502115
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.