CoChat

“I Didn’t Catch That, But I’ll Try My Best”: Anticipatory Error Handling in a Voice Controlled Game

Zargham, Nima, Pfau, Johannes, Schnackenberg, Tobias, Malaka, Rainer · 2022 · CHI Conference on Human Factors in Computing Systems

The DOI matches its Crossref record; 53 of the 53 references it cites were found in a registry or an index.

Abstract

Advances in speech recognition, language processing and natural interaction have led to an increased industrial and academic interest. While the robustness and usability of such systems are steadily increasing, speech-based systems are still susceptible to recognition errors. This makes intelligent error handling of utmost importance for the success of those systems. In this work, we integrated anticipatory error handling for a voice-controlled video game where the game would perform a locally optimized action in respect to goal completion and obstacle avoidance, when a command is not recognized. We evaluated the user experience of our approach versus traditional, repetition-based error handling (). Our results indicate that implementing anticipatory error handling can improve the usability of a system, if it follows the intention of the user. Otherwise, it impairs the user experience, even when deciding for technically optimal decisions.

Overview

Integrity signals

Registry

Crossref · 10.1145/3491102.3502115

Cites

53 of 53 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Show all 53 references

Research works printed but not linked: 18

  1. Matthew P Aylett , Per Ola Kristensson , Steve Whittaker , and Yolanda Vazquez-Alvarez . 2014. None of a CHInd: relationship counselling for HCI and speech technology . In CHI’14 Extended Abstracts on Human Factors in Computing Systems . ACM , New York, NY, USA , 749–760. Matthew P Aylett, Per Ola Kristensson, Steve Whittaker, and Yolanda Vazquez-Alvarez. 2014. None of a CHInd: relationship counselling for HCI and speech technology. In CHI’14 Extended Abstracts on Human Factors in Computing Systems. ACM, New York, NY, USA, 749–760.
  2. 10.1145/3264901 · DOI · Paper page
  3. Dan Bohus and Alexander I Rudnicky . 2008. Sorry , I Didn’t Catch That!In Recent trends in discourse and dialogue . Springer , New York, NY, USA , 123–154. Dan Bohus and Alexander I Rudnicky. 2008. Sorry, I Didn’t Catch That!In Recent trends in discourse and dialogue. Springer, New York, NY, USA, 123–154.
  4. Richard A Bolt . 1980 . “ Put-that-there” Voice and gesture at the graphics interface . In Proceedings of the 7th annual conference on Computer graphics and interactive techniques. Association for Computing Machinery , New York, NY, USA, 262–270. Richard A Bolt. 1980. “Put-that-there” Voice and gesture at the graphics interface. In Proceedings of the 7th annual conference on Computer graphics and interactive techniques. Association for Computing Machinery, New York, NY, USA, 262–270.
  5. Cynthia Breazeal . 2003. Toward sociable robots. Robotics and autonomous systems 42, 3-4 ( 2003 ), 167–175. Cynthia Breazeal. 2003. Toward sociable robots. Robotics and autonomous systems 42, 3-4 (2003), 167–175.
  6. 10.5555/2817912.2817913 · doi:10.5555/2817912.2817913
  7. John Brooke 1996. SUS-A quick and dirty usability scale. Usability evaluation in industry 189, 194 ( 1996 ), 4–7. John Brooke 1996. SUS-A quick and dirty usability scale. Usability evaluation in industry 189, 194 (1996), 4–7.
  8. Crytek. 2013 . Ryse: Son of Rome. Game [XBox One]. Microsoft Studios , Redmond, Washington, U.S. Crytek. 2013. Ryse: Son of Rome. Game [XBox One]. Microsoft Studios, Redmond, Washington, U.S.
  9. Mihaly Csikszentmihalyi . 1990 . Flow: The psychology of optimal experience. Vol. 1990 . Harper & Row , New York, NY, USA . Mihaly Csikszentmihalyi. 1990. Flow: The psychology of optimal experience. Vol. 1990. Harper & Row, New York, NY, USA.
  10. EA Sports . 2013. Fifa 14. Game [XBox One]. Microsoft Studios , Redwood City , California, U.S. EA Sports. 2013. Fifa 14. Game [XBox One]. Microsoft Studios, Redwood City, California, U.S.
  11. Electronic Arts . 2012. Mass Effect 3. Game [XBox 360]. Electronic Arts , Redwood City , California, U.S. Electronic Arts. 2012. Mass Effect 3. Game [XBox 360]. Electronic Arts, Redwood City, California, U.S.
  12. He He , Jordan Boyd-Graber , Kevin Kwok , and Hal Daumé III. 2016 . Opponent modeling in deep reinforcement learning . In International conference on machine learning. PMLR, PMLR , New York, New York, USA , 1804–1813. He He, Jordan Boyd-Graber, Kevin Kwok, and Hal Daumé III. 2016. Opponent modeling in deep reinforcement learning. In International conference on machine learning. PMLR, PMLR, New York, New York, USA, 1804–1813.
  13. Juliana Miehle , Daniel Ostler , Nadine Gerstenlauer , and Wolfgang Minker . 2017. The next step: intelligent digital assistance for clinical operating rooms. Innovative surgical sciences 2, 3 ( 2017 ), 159–161. Juliana Miehle, Daniel Ostler, Nadine Gerstenlauer, and Wolfgang Minker. 2017. The next step: intelligent digital assistance for clinical operating rooms. Innovative surgical sciences 2, 3 (2017), 159–161.
  14. Moyen Mohammad Mustaquim . 2013. Automatic speech recognition-an approach for designing inclusive games. Multimedia tools and applications 66, 1 ( 2013 ), 131–146. Moyen Mohammad Mustaquim. 2013. Automatic speech recognition-an approach for designing inclusive games. Multimedia tools and applications 66, 1 (2013), 131–146.
  15. Cathy Pearl . 2016. Designing voice user interfaces: principles of conversational experiences . ” O’Reilly Media , Inc.”, Sebastopol, California . Cathy Pearl. 2016. Designing voice user interfaces: principles of conversational experiences. ” O’Reilly Media, Inc.”, Sebastopol, California.
  16. Richard M Ryan , C Scott Rigby , and Andrew Przybylski . 2006. The motivational pull of video games: A self-determination theory approach. Motivation and emotion 30, 4 ( 2006 ), 344–360. Richard M Ryan, C Scott Rigby, and Andrew Przybylski. 2006. The motivational pull of video games: A self-determination theory approach. Motivation and emotion 30, 4 (2006), 344–360.
  17. Amir Shevat . 2017. Designing bots: Creating conversational experiences . ” O’Reilly Media , Inc.”, Sebastopol, California . Amir Shevat. 2017. Designing bots: Creating conversational experiences. ” O’Reilly Media, Inc.”, Sebastopol, California.
  18. Turn 10 Studios . 2013. Forza Motorsport 5. Game [XBox One]. Microsoft Studios , Redmond, Washington, U.S. Turn 10 Studios. 2013. Forza Motorsport 5. Game [XBox One]. Microsoft Studios, Redmond, Washington, U.S.

Cited by

See all 26

Metadata

Authors
Zargham, N., Pfau, J., Schnackenberg, T., & Malaka, R.
Affiliations
University of Bremen (DE)
Venue
CHI Conference on Human Factors in Computing Systems
Publisher
ACM
Published
2022-04-27
Pages
1-13
OpenAlex
W4224988227
Cited by
20
References
51
Citations by year
2026: 2 · 2025: 5 · 2024: 8 · 2023: 4 · 2022: 1
FWCI
2.49
Type
conference paper
Language
en
Open access
closed
Locations
CHI Conference on Human Factors in Computing Systems (publishedVersion)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
  • Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
  • Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
Keywords
speech recognition errors, speech-based interaction, user experience, usability, goal achievement, obstacle avoidance, user intention

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: “I Didn’t Catch That, But I’ll Try My Best”: Anticipatory Error Handling in a Voice Controlled Game. https://app.cochat.ai/papers/10.1145/3491102.3502115
The paper
Zargham, N., Pfau, J., Schnackenberg, T., & Malaka, R. (2022). “I Didn’t Catch That, But I’ll Try My Best”: Anticipatory Error Handling in a Voice Controlled Game. CHI Conference on Human Factors in Computing Systems. https://doi.org/10.1145/3491102.3502115

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.