"Why did this voice agent not understand me?": error recovery strategy for in-vehicle voice user interface
The DOI matches its Crossref record, with a small difference in title or year; 7 of the 7 references it cites were found in a registry or an index.
Abstract
We aimed at investigating the effects of error recovery strategy that could enable the drivers to recover from the non-understanding error when interacting with the in-vehicle voice user interface (VUI). An experiment using a driving simulator was conducted with forty-seven participants who performed driving tasks with the VUI. One of three different error recovery strategies (ask repeat, re-prompt, and you can say) was suggested to recover from the non-understanding errors. A subjective questionnaire and semi-structured interviews were used to collect the participants' workload, perceived reasons for errors, and preference. Results showed participants felt that 'you can say' was more difficult than the 're-prompt' condition. However, preferences of 'ask repeat' and 'you can say' were significantly higher than 're-prompt' because the perceived reason for the non-understanding was 'input error' when the system used the 're-prompt' method. These findings provide insights into the design of the VUI in the context of driving.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“In contrast, userrepair strategies research aims to comprehend how users interact with and repair conversational breakdowns in SDSs across various domains and contexts, often highlighting adaptations in communication style to improve interactions [34, 45, 53, 54].”
From System and User Strategies to Repair Conversational Breakdowns of Spoken Dialogue Systems: A Scoping Review (2024) · cites this paper as [34]
In the citing paper
“Similarly, the automotive domain was uniquely paired with in-vehicle VUIs in simulated environments [2, 34], and field settings [75].”
From System and User Strategies to Repair Conversational Breakdowns of Spoken Dialogue Systems: A Scoping Review (2024) · cites this paper as [34]
Citations
Cites
Lee, J. D., McGehee, D. V., Brown, T. L., & Reyes, M. L. (2002) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/0018720024497844 · Cited by 570
Patterns for How Users Overcome Obstacles in Voice User Interfaces
Myers, C., Furqan, A., Nebolsky, J., Caro, K., & Zhu, J. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3173580 · Cited by 213 · cited 2×
“In addition, the authors analyzed the recorded participants’ script of VUI tasks and coded one or more tactic strategies that participants used for error recovery among seven types (Table 3) [1,8].”
BackgroundMethodStrayer, D. L., Turrill, J., Coleman, J. R., Ortiz, E., & Cooper, J. M. (2014) · AAA Foundation for Traffic Safety. · Cited by 85
Complexity of In-Vehicle Controllers and Their Effect on Task Performance
Lee, S. C., & Ji, Y. G. (2018) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2018.1428263 · Cited by 22
Self-citationComplexity Overloaded in Smart Car
(2016) · doi:10.1145/3004323.3004332 · Cited by 9
Self-citationLee, D., Sah, Y. J., & Lee, S. (2019) · International Journal of Human–Computer Interaction · doi:10.1080/10447318.2018.1561069 · Cited by 9
Self-citation
Research works printed but not linked: 3
- Bohus Dan, 2005, 6th SIGdial Workshop on Discourse and Dialogue. http://www.iscaspeech.org/archive
- Goldberg Julie, 2003, The Impact of Response Wording in Error Correction Subdialogs. In ISCA Tutorial and Research Workshop on Error Handling in Spoken Dialogue Systems. http://www.isca-speech.org/archive
- Services Amazon Web, 2019, Retrieved
Cited by
Effects of Non-Driving-Related Task Attributes on Takeover Quality in Automated Vehicles
Lee, S. C., Yoon, S. H., & Ji, Y. G. (2020) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2020.1815361 · Cited by 89
Self-citationJansen, P., Colley, M., & Rukzio, E. (2022) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3534617 · Cited by 54
“Wearable Eye-Tracker: Gaze [32, 185, 382], Glance [407], Blink [32], Pupil [32], Movement [87, 182, 281] Smartwatch Acceleration [185], Smart Ring Gesture [118] Forearm: EMG [205],”
BackgroundBilius, L.-B., & Vatavu, R.-D. (2020) · Journal of Intelligent Transportation Systems · doi:10.1080/15472450.2020.1846127 · Cited by 42
Alghamdi, E., Halvey, M., & Nicol, E. (2024) · ACM Conversational User Interfaces 2024 · doi:10.1145/3640794.3665558 · Cited by 36
Pan, L., Yu, C., Li, J., Huang, T. Y., Bi, X., & Shi, Y. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3517459 · Cited by 22
A Synopsis of Input Modalities for In-Vehicle Infotainment and Consumption of Interactive Media
Bilius, L.-B., & Vatavu, R.-D. (2020) · ACM International Conference on Interactive Media Experiences · doi:10.1145/3391614.3399400 · Cited by 17
Bilius, L.-B., Vatavu, R.-D., & Marquardt, N. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-85616-8_11 · Cited by 11
“Furthermore, voice input inside the vehicle has been addressed in terms of design guidelines [31, 55] and technical aspects of speech recognition [2, 53].”
MethodGenie vs. Jarvis: Characteristics and Design Considerations of In-Vehicle Intelligent Agents
(2021) · doi:10.1145/3473682.3479720 · Cited by 10
“IVAs can support driving and non-driving related tasks [3, 8], provide information and assist tasks to reduce drivers’ cognitive demand [9], offer feedback to mitigate the influence of drivers’ affective status on driving safety [4, 14], and promote overall driving experiences [10, 11].”
BackgroundSelf-citationUnderstanding Task Differences to Leverage the Usability and Adoption of Voice Assistants (VAs)
Motta, I., & Quaresma, M. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-78227-6_35 · Cited by 10
“Try, Try, Try Again:” Sequence Analysis of User Interaction Data with a Voice User Interface
Myers, C. M., Laris Pardo, L. F., Acosta-Ruiz, A., Canossa, A., & Zhu, J. (2021) · CUI 2021 - 3rd Conference on Conversational User Interfaces · doi:10.1145/3469595.3469613 · Cited by 10
“These studies test various ways to improve the usability of VUIs through prompt and menu designs for discoverability of commands [13, 17, 31, 42], adaptive user models to adjust the system to users’ predicted needs [23, 43], recovery and repair strategies [30]; to name a few.”
BackgroundMotta, I., & Quaresma, M. (2023) · ACM Conference on Conversational User Interfaces (CUI) · doi:10.1145/3571884.3604304 · Cited by 11
“To Go or Not To Go? That is the Question”: When In-Vehicle Agents Argue with Each Other
(2021) · doi:10.1145/3473682.3481876 · Cited by 7
Self-citationVeloCity: Using Voice Assistants for Cyclists to Provide Traffic Reports
Savino, G.-L., Braga, J. M., & Schöning, J. (2021) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3474085.3475509 · Cited by 8
“[20] suggest using a simple "Can you repeat that please?" error handling method as participants in their study Poster Session 4 MM ’21, October 20–24, 2021, Virtual Event, China”
MethodCha, M. C., & Ji, Y. G. (2023) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2023.2250606 · Cited by 9
The Unit and Size of Information Supporting Auditory Feedback for Voice User Interface
Cha, M. C., Kim, H. C., & Ji, Y. G. (2023) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2023.2179214 · Cited by 6
“…natural language processing technologies, and some studies have been conducted to improve the usability by developing VUI command methods (such as “ Barge-in ” and “ out-of-turn ” ) and error recovery methods (Kim et al., 2019; Mane et al., 1996; Perugini et al., 2007; Yankelovich et al., 1995).”
BackgroundUsers' error recovery strategies in the interaction with voice assistants (VAs)
Motta, I., & Quaresma, M. (2022) · Lecture Notes in Networks and Systems · doi:10.1007/978-3-030-74614-8_82 · Cited by 4
What Do You Want for In-Vehicle Agents? One Fits All vs. Multiple Specialized Agents
(2022) · doi:10.1145/3544999.3550153 · Cited by 3
Self-citationMotta, I., & Quaresma, M. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-05412-9_34 · Cited by 6
Meck, A.-M., Draxler, C., & Vogt, T. (2024) · International Journal of Human–Computer Interaction · doi:10.1080/10447318.2023.2266791 · Cited by 3
“Sensitivity to different error sources as well as tailored error handling strategies were also found by Kim et al. (2019) in an in-car context.”
VOICON: Geometric Motion-Based Visual Feedback in Voice User Interface
Oh, J., Kim, N. S., Yan, Y., & Lee, S. (2024) · Designing Interactive Systems Conference · doi:10.1145/3643834.3660741 · Cited by 4
Self-citationResearch on Error Handling Techniques for Speech Interaction
Ma, R., Zou, X., Tao, P., & Tu, Y. (2023) · International Conference on Computer Systems (ICCS) · doi:10.1109/iccs59700.2023.10335595
Voice-Based Virtual Agents in Mobility: Navigation and Non-navigation Assistance
Bodard, J., Lang, J., & Uzan, G. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-30798-9_9
Effect of Speech Entrainment in Human-Computer Conversation: A Review
Phukon, M., & Shrivastava, A. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-53827-8_4 · Cited by 1
Motta, I., & Quaresma, M. (2023) · Arcos Design · doi:10.12957/arcosdesign.2023.71086
Metadata
- Authors
- Kim, J., Jeong, M., & Lee, S. C.
- Affiliations
- Yonsei University, Seoul, Korea
- Yonsei University (KR)
- Virginia Tech (US)
- ORCID
- Lee, Seul Chan
- Venue
- Proceedings of the 11th International Conference on Automotive User Interfaces and Interactive Vehicular Applications: Adjunct Proceedings
- Publisher
- ACM
- Published
- 2019-09-21
- Pages
- 146-150
- OpenAlex
- W2973739245
- Cited by
- 29
- References
- 7
- Citations by year
- 2026: 1 · 2025: 2 · 2024: 4 · 2023: 6 · 2022: 5 · 2021: 8 · 2020: 3
- FWCI
- 1.53
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI) (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Social Sciences › Human Factors and Ergonomics › Human-Automation Interaction and Safety
- Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
- Keywords
- driver workload, speech recognition errors, driver-vehicle interaction, user preferences, driving simulator
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.