My Bad! Repairing Intelligent Voice Assistant Errors Improves Interaction
The DOI matches its Crossref record; 61 of the 61 references it cites were found in a registry or an index.
Abstract
One key technique people use in conversation and collaboration is conversational repair. Self-repair is the recognition and attempted correction of one's own mistakes. We investigate how the self-repair of errors by intelligent voice assistants affects user interaction. In a controlled human-participant study (N =101), participants asked Amazon Alexa to perform four tasks, and we manipulated whether Alexa would "make a mistake'' understanding the participant (for example, playing heavy metal in response to a request for relaxing music) and whether Alexa would perform a correction (for example, stating, "You don't seem pleased. Did I get that wrong?'') We measured the impact of self-repair on the participant's perception of the interaction in four conditions: correction (mistakes made and repair performed), undercorrection (mistakes made, no repair performed), overcorrection (no mistakes made, but repair performed), and control (no mistakes made, and no repair performed). Subsequently, we conducted free-response interviews with each participant about their interactions. This study finds that self-repair greatly improves people's assessment of an intelligent voice assistant if a mistake has been made, but can degrade assessment if no correction is needed. However, we find that the positive impact of self-repair in the wake of an error outweighs the negative impact of overcorrection. In addition, participants who recently experienced an error saw increased value in self-repair as a feature, regardless of whether they experienced a repair themselves.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Certain domains are aligned with particular platform types, indicating specialised applications e.g. the smart home assistance domain was associated with devices such as Amazon Alexa [6, 17, 19, 33, 46, 60], the INSPIRE system [74], and devices not specified [38].”
From System and User Strategies to Repair Conversational Breakdowns of Spoken Dialogue Systems: A Scoping Review (2024) · cites this paper as [19]
In the citing paper
“A study by Cuadra et al. [16] found that when voice assistants make mistakes, voice assistant self-repair greatly improves people's assessment of an intelligent voice assistant, but it can have the opposite impact if no correction is needed.”
From A Mixed-Methods Approach to Understanding User Trust after Voice Assistant Failures (2023) · cites this paper as [16]
In the citing paper
“which has been shown to improve users' assessment of VAs [16].”
From Situated Understanding of Errors in Older Adults' Interactions with Voice Assistants: A Month-Long, In-Home Study (2026) · cites this paper as [16]
In the citing paper
“However, excessive correction can degrade user perceptions [16].”
From Situated Understanding of Errors in Older Adults' Interactions with Voice Assistants: A Month-Long, In-Home Study (2026) · cites this paper as [16]
Citations
Cites
Using thematic analysis in psychology
Braun, V., & Clarke, V. (2006) · Qualitative Research in Psychology · doi:10.1191/1478088706qp063oa · Cited by 194,414
Qualitative Data Analysis: A Methods Sourcebook
Miles, M. B., Huberman, A. M., & Saldaña, J. (1988) · Cited by 20,701
A very brief measure of the Big-Five personality domains
Gosling, S. D., Rentfrow, P. J., & Swann, W. B. (2003) · Journal of Research in Personality · doi:10.1016/s0092-6566(03)00046-1 · Cited by 8,307
The Preference for Self-Correction in the Organization of Repair in Conversation
Schegloff, E. A., Jefferson, G., & Sacks, H. (1977) · Language · doi:10.2307/413107 · Cited by 5,150
Ekman, P. (1976) · Medical Entomology and Zoology · Cited by 4,345
Lucey, P., Cohn, J. F., Kanade, T., Saragih, J., Ambadar, Z., & Matthews, I. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops · doi:10.1109/cvprw.2010.5543262 · Cited by 4,303 · cited 1×
“…technology via visual cues can be fore-shadowed by the widespread availability of emotional expression image databases such as Ekman’s Pictures of Facial Affect [21], the Belfast database [19], the Extended Cohn-Kanade Dataset [37], or the Affectiva-MIT Facial Expression Dataset [38].”
BackgroundThe Repertoire of Nonverbal Behavior: Categories, Origins, Usage, and Coding
EKMAN, P., & FRIESEN, W. V. (1969) · Semiotica · doi:10.1515/semi.1969.1.1.49 · Cited by 3,316
Embodied Conversational Agents
(2000) · The MIT Press eBooks · doi:10.7551/mitpress/2697.001.0001 · Cited by 1,799
Clark, H. H., & Schaefer, E. F. (1989) · Cognitive Science · doi:10.1207/s15516709cog1302_7 · Cited by 1,699
Finding usability problems through heuristic evaluation
Nielsen, J. (1992) · Proceedings of the SIGCHI conference on Human factors in computing systems - CHI '92 · doi:10.1145/142750.142834 · Cited by 1,060
Schegloff, E. (2000) · Applied Linguistics · doi:10.1093/applin/21.2.205 · Cited by 615
Nass, C., Steuer, J., & Tauber, E. R. (1994) · Conference companion on Human factors in computing systems - CHI '94 · doi:10.1145/259963.260288 · Cited by 579
Impro: Improvisation and the Theatre
Pertalion, A., & Johnstone, K. (1984) · Theatre Journal · doi:10.2307/3206983 · Cited by 418
Intersubjectivity: Towards a Dialogical Analysis
GILLESPIE, A., & CORNISH, F. (2010) · Journal for the Theory of Social Behaviour · doi:10.1111/j.1468-5914.2009.00419.x · Cited by 416
To err is human(-like): effects of robot gesture on perceived anthropomorphism and likability
Salem, M., Eyssel, F., Rohlfing, K., Kopp, S., & Joublin, F. (2013) · International Journal of Social Robotics · doi:10.1007/s12369-013-0196-9 · Cited by 407
Footing in human-robot conversations: how robots might shape participant roles using gaze cues
Mutlu, B., Shiwa, T., Kanda, T., Ishiguro, H., & Hagita, N. (2009) · Proceedings of the 4th ACM/IEEE international conference on Human robot interaction · doi:10.1145/1514095.1514109 · Cited by 392
How to build robots that make friends and influence people
Breazeal, C., & Scassellati, B. (2003) · Proceedings 1999 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human and Environment Friendly Robots with High Intelligence and Emotional Quotients (Cat. No.99CH36289) · doi:10.1109/iros.1999.812787 · Cited by 386
Miner, A. S., Milstein, A., Schueller, S., Hegde, R., Mangurian, C., & Linos, E. (2016) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2016.0400 · Cited by 368
Empathy in Virtual Agents and Robots: A Survey
Paiva, A., Leite, I., Boukricha, H., & Wachsmuth, I. (2017) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/2912150 · Cited by 361
A Storytelling Robot: Modeling and Evaluation of Human-like Gaze Behavior
Mutlu, B., Forlizzi, J., & Hodgins, J. (2006) · 2006 6th IEEE-RAS International Conference on Humanoid Robots · doi:10.1109/ichr.2006.321322 · Cited by 348
An empirical study of machine learning techniques for affect recognition in human–robot interaction
Rani, P., Liu, C., Sarkar, N., & Vanman, E. (2006) · Pattern Analysis and Applications · doi:10.1007/s10044-006-0025-y · Cited by 313 · cited 1×
“Breazeal and Rani for instance, provide good recaps of the work in the HRI community on affect recognition [10, 54].”
BackgroundTo err is robot: how humans assess and act toward an erroneous social robot
Mirnig, N., Stollnberger, G., Miksch, M., Stadler, S., Giuliani, M., & Tscheligi, M. (2017) · Frontiers in Robotics and AI · doi:10.3389/frobt.2017.00021 · Cited by 244 · cited 2×
“Mirnig, et al. studied people who got instructions from a Nao robot on a Lego building tasks; participants liked the faulty robot significantly better than the robot that interacted flawlessly, even though the faulty robot degraded their own performance [42].”
BackgroundMcDuff, D., el Kaliouby, R., Senechal, T., Amr, M., Cohn, J. F., & Picard, R. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition Workshops · doi:10.1109/cvprw.2013.130 · Cited by 234
Resilient Chatbots: Repair Strategy Preferences for Conversational Breakdowns
Ashktorab, Z., Jain, M., Liao, Q. V., & Weisz, J. D. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300484 · Cited by 224 · cited 1×
“Additionally, Ashktorab et al., who explored different repair strategies in chatbots, discuss repair as a collaborative action with costs (e.g., too much turn-taking or loss of naturalness), calling for further empirical research in the area [5].”
BackgroundConversational gaze aversion for humanlike robots
Andrist, S., Tan, X. Z., Gleicher, M., & Mutlu, B. (2014) · Proceedings of the 2014 ACM/IEEE international conference on Human-robot interaction · doi:10.1145/2559636.2559666 · Cited by 206
Conversational gaze mechanisms for humanlike robots
Mutlu, B., Kanda, T., Forlizzi, J., Hodgins, J., & Ishiguro, H. (2012) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/2070719.2070725 · Cited by 196
Sebo, S. S., Traeger, M. L., Jung, M. F., & Scassellati, B. M. (2018) · ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.1145/3171221.3171275 · Cited by 190
Social determinants of facial displays
Chovil, N. (1991) · Journal of Nonverbal Behavior · doi:10.1007/bf01672216 · Cited by 186
Xiao, Z., Zhou, M. X., Liao, Q. V., Mark, G., Chi, C., Chen, W., & Yang, H. (2020) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3381804 · Cited by 185
Correcting robot mistakes in real time using EEG signals
Salazar-Gomez, A. F., DelPreto, J., Gil, S., Guenther, F. H., & Rus, D. (2017) · 2017 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2017.7989777 · Cited by 182
Using gaze patterns to predict task intent in collaboration
Huang, C.-M., Andrist, S., Sauppé, A., & Mutlu, B. (2015) · Frontiers in Psychology · doi:10.3389/fpsyg.2015.01049 · Cited by 167
Spoken Dialogue Technology: Toward the Conversational User Interface
McTear, M., & Raman, T. V. (2004) · Cited by 167
I'd blush if I could : closing gender divides in digital skills through education
(2019) · Singapore Management University Institutional Knowledge (InK) (Singapore Management University) · Cited by 158
A new emotion database: considerations, sources and scope
Douglas‐Cowie, E., Cowie, R., & Schroeder, N. V. (2000) · Cited by 156
Predicting hyperarticulate speech during human-computer error resolution
Oviatt, S., MacEachern, M., & Levow, G.-A. (1998) · Speech Communication · doi:10.1016/s0167-6393(98)00005-3 · Cited by 144
Vulnerable robots positively shape human conversational dynamics in a human–robot team
Traeger, M. L., Strohkorb Sebo, S., Jung, M., Scassellati, B., & Christakis, N. A. (2020) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1910402117 · Cited by 140 · cited 2×
“…people in groups with a robot making vulnerable statements converse substantially more with each other, distribute their conversation somewhat more equally, and perceive their groups more positively compared to control groups with a robot that either makes neutral statements or no statements [66].”
BackgroundCorti, K., & Gillespie, A. (2016) · Computers in Human Behavior · doi:10.1016/j.chb.2015.12.039 · Cited by 118
A Psychological Model of Grounding and Repair in Dialog
Cahn, J. E., & Brennan, S. E. (1999) · Cited by 113
The effect of head-nod recognition in human-robot conversation,
Sidner, C. L., Lee, C., Morency, L.-P., & Forlines, C. (2006) · Proceedings of the 1st ACM SIGCHI/SIGART conference on Human-robot interaction · doi:10.1145/1121241.1121291 · Cited by 107 · cited 1×
“Sidner et al. found that participants who knew their robots recognized conversational head nods would nod more [63].”
BackgroundEngaging robots: easing complex human-robot teamwork using backchanneling
Jung, M. F., Lee, J. J., DePalma, N., Ađalgeirsson, S. Ö., HINDS, P. J., & Breazeal, C. (2013) · ACM Conference on Computer Supported Cooperative Work (CSCW) · doi:10.1145/2441776.2441954 · Cited by 97
Bousmalis, K., Méhu, M., & Pantić, M. (2012) · Image and Vision Computing · doi:10.1016/j.imavis.2012.07.003 · Cited by 93
Characterizing and recognizing spoken corrections in human-computer dialogue
Levow, G. (1998) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.3115/980845.980969 · Cited by 84
Rudzicz, F., Wang, R., Begum, M., & Mihailidis, A. (2015) · ACM Transactions on Accessible Computing · doi:10.1145/2744206 · Cited by 83
Supporting Workplace Detachment and Reattachment with Conversational Intelligence
Williams, A. C., Kaur, H., Mark, G., Thompson, A. L., Iqbal, S. T., & Teevan, J. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3173662 · Cited by 79
Predicting automatic speech recognition performance using prosodic cues
Litman, D. J., Hirschberg, J., & Swerts, M. G. J. (2000) · OLAC - Open Language Archives Community · Cited by 78
Errare humanum est: Erroneous robots in human-robot interaction
Ragni, M., Rudenko, A., Kuhnert, B., & Arras, K. O. (2016) · 2016 25th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN) · doi:10.1109/roman.2016.7745164 · Cited by 70 · cited 2×
“Ragni, et al. found that people collaborating with robots on a memorization task were more likely to report positive emotions with an erroneous robot than the perfect one [53].”
BackgroundGaze and Attention Management for Embodied Conversational Agents
Pejsa, T., Andrist, S., Gleicher, M., & Mutlu, B. (2015) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/2724731 · Cited by 61
A conversation robot using head gesture recognition as para-linguistic information
Fujie, S., Ejiri, Y., Nakajima, K., Matsusaka, Y., & Kobayashi, T. (2005) · IEEE RO-MAN · doi:10.1109/roman.2004.1374748 · Cited by 61
Speech dialogue with facial displays: multimodal human-computer conversation
Nagao, K., & Takeuchi, A. (1994) · Proceedings of the 32nd annual meeting on Association for Computational Linguistics - · doi:10.3115/981732.981747 · Cited by 59
Studies in Conversational UX Design
Moore, R. J., Szymanski, M. H., Arar, R., Ren, G., & Publishing, S. I. (2018) · Human-computer interaction series · doi:10.1007/978-3-319-95579-7 · Cited by 58
Impro: Improvisation and the Theatre
Johnstone, K., & Wardle, I. (2012) · Routledge eBooks · doi:10.4324/9780203446294 · Cited by 55
Safety First: Conversational Agents for Health Care
Bickmore, T., Trinh, H., Asadi, R., & Olafsson, S. (2018) · Human–Computer Interaction Series · doi:10.1007/978-3-319-95579-7_3 · Cited by 50 · cited 2×
“[6].”
A comparative study of speech in the call center: natural language call routing vs. touch-tone menus
Suhm, B., Bers, J., McCarthy, D., Freeman, B., Getty, D., Godfrey, K., & Peterson, P. (2002) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/503376.503427 · Cited by 42
Conversational UX Design: An Introduction
Moore, R. J., & Arar, R. (2018) · Human-computer interaction series · doi:10.1007/978-3-319-95579-7_1 · Cited by 40
Xiao, Z., Zhou, M. X., Liao, Q. V., Mark, G. J., Chi, C., Chen, W., & Yang, H. (2019) · Cambridge University Engineering Department Publications Database · doi:10.48550/arxiv.1905.10700 · Cited by 38
The Repertoire of Robot Behavior: Designing Social Behaviors to Support Human-Robot Joint Activity
Huang, C.-M., & Mutlu, B. (2013) · Journal of Human-Robot Interaction · doi:10.5898/jhri.2.2.huang · Cited by 35
Boitet, C., & Whitelock, P. (1998) · Cited by 31
Communicating Dominance in a Nonanthropomorphic Robot Using Locomotion
Li, J. J., Cuadra, A., Mok, B. K.-J., Reeves, B. B., Kaye, J., & Ju, W. G. (2019) · ACM Transactions on Human-Robot Interaction · doi:10.1145/3310357 · Cited by 24
Self-citationSimulation-based dialogue design for speech-controlled telephone services
Bretan, I., Ereback, A.-L., MacDermid, C., & Wærn, A. (1995) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/223355.223472 · Cited by 11
Recovering from Dialogue Failures Using Multiple Agents in Wealth Management Advice
Candello, H. C. D. S. P., & Pinhanez, C. S. (2018) · Human-computer interaction series · doi:10.1007/978-3-319-95579-7_7 · Cited by 11
Lubis, N., Sakti, S., Yoshino, K., & Nakamura, S. (2018) · Transactions of the Japanese Society for Artificial Intelligence · doi:10.1527/tjsai.dsh-d · Cited by 3
Research works printed but not linked: 11
- Susan E Brennan et almbox. 2005. How conversation is shaped by visual and spoken evidence. Approaches to studying world-situated language use: Bridging the language-as-product and language-as-action traditions (2005), 95--129.
- 10.5555/371552.371555 · doi:10.5555/371552.371555
- The Economist. 2017. Terry Winograd: Where Humans still Beat Computers. The Economist (Jan 2017).
- Yuan Fan and Qiuchen Wang. 2013. Robot. US Patent App. 29/431,926.
- Petra Gieselmann. 2006. Comparing error-handling strategies in human-human and human-robot dialogues. In Proc. 8th Conf. Nat. Language Process.(KONVENS). Konstanz, Germany. 24--31.
- 10.5555/974305.974334 · doi:10.5555/974305.974334
- Harvey Sacks, Emanuel A Schegloff, and Gail Jefferson. 1978. A simplest systematics for the publisher of turn taking for conversation. In Studies in the publisher of conversational interaction. Elsevier, 7--55.
- Emanuel A Schegloff. 1997 a. Practices and actions: Boundary cases of other-initiated repair. Discourse processes, Vol. 23, 3 (1997), 499--545.
- Emanuel A Schegloff. 1997 b. Third turn repair. AMSTERDAM STUDIES IN THE THEORY AND HISTORY OF LINGUISTIC SCIENCE SERIES 4 (1997), 31--40.
- 10.1353/lan.1977.0041 · doi:10.1353/lan.1977.0041 · Paper page
- Bo Zhang, Qingsheng Cai, Jianfeng Mao, Eric Chang, and Baining Guo. 2001. Spoken dialogue management as planning and acting under uncertainty. In Seventh European conference on speech communication and technology.
Cited by
State-of-the-Art Human-Computer-Interaction in Metaverse
Lv, Z. (2023) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2023.2248833 · Cited by 115
“The effects of smart voice assistants ’ ability to fix their own mistakes on the user experience were investigated by Cuadra et al. (2021).”
A Taxonomy for Human-LLM Interaction Modes: An Initial Exploration
Gao, J., Gebreegziabher, S. A., Choo, K. T. W., Li, T. J.-J., Perrault, S. T., & Malone, T. W. (2024) · Extended Abstracts of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613905.3650786 · Cited by 57
User Interaction Patterns and Breakdowns in Conversing with LLM-Powered Voice Assistants
Mahmood, A., Wang, J., Yao, B., Wang, D., & Huang, C.-M. (2025) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2024.103406 · Cited by 51
“As an AI language model, I cannot”: Investigating LLM Denials of User Requests
Wester, J., Schrills, T., Pohl, H., & van Berkel, N. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642135 · Cited by 100
“Their results suggest that participants perceived self-repairing VAs more positively [9].”
Do, H. J., Kong, H.-K., Tetali, P., Lee, J., & Bailey, B. P. (2023) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3579532 · Cited by 32
“found that repairs made users feel successful and less frustrated [20].”
Background
Metadata
- Authors
- Cuadra, A., Li, S., Lee, H., Cho, J., & Ju, W.
- Affiliations
- Cornell Tech (US)
- Tongji University (CN)
- Cornell University (US)
- Venue
- Proceedings of the ACM on Human-Computer Interaction
- Published
- 2021-04-13
- Volume
- 5
- Issue
- CSCW1
- Pages
- 1-24
- ISSN
- 2573-0142 (ISSN-L)
- OpenAlex
- W3159016082
- Cited by
- 52
- References
- 60
- Citations by year
- 2026: 11 · 2025: 10 · 2024: 15 · 2023: 13 · 2022: 3
- FWCI
- 2.74
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Proceedings of the ACM on Human-Computer Interaction (publishedVersion)
- Funders
- Mozilla Foundation
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Social Sciences › Business, Management and Accounting › Marketing › AI in Service Interactions
- Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
- Keywords
- voice assistants, conversational repair, self-healing, error correction, overcorrection, undercorrection, Amazon Alexa, voice user interface design
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.