The DOI matches its Crossref record; 74 of the 74 references it cites were found in a registry or an index; 28 of the 158 sources its claims cite were checked for support.
System and User Strategies to Repair Conversational Breakdowns of Spoken Dialogue Systems: A Scoping Review
Open accessAbstract
Spoken Dialogue Systems (SDSs) are critical in facilitating natural and efficient human-machine interaction through speech. SDSs frequently encounter challenges in managing complex dialogues, resulting in communication breakdowns, which include misunderstandings— where the system misunderstands user input— and non-understandings— where the system fails to interpret the input at all. Strategies to repair these breakdowns have been investigated across multiple disciplines; despite this interest, the findings from these studies are inconsistent and hinder comparative analysis due to the use of diverse methodologies and terminologies. To address this gap, this scoping review systematically examines SDS and user repair strategies within a broad spectrum of literature. Based on 36 papers out of 818 found, we provide two comprehensive frameworks: one categorising SDS system-repair strategies into six distinct categories and the other user-repair strategies into five categories. Our analysis reveals a disparity in the literature’s focus on repair strategies, highlighting, in particular, the lack of research on less explored strategies, such as Information and Disclosure repair strategies, providing potential avenues for future research directions in this area.
Overview
CoChat Summary
TL;DR
This scoping review synthesizes 36 papers, selected from 818 found, on repair strategies for conversational breakdowns in spoken dialogue systems (SDSs). It proposes frameworks categorizing system-repair strategies into six categories and user-repair strategies into five categories, while highlighting uneven research coverage and terminology inconsistencies.
Key findings
- From 36 included papers, system-repair strategies are categorized into six types: confirmation, information, social, solve, ask, and disclosure; user-repair strategies into five: clarification, information adjustment, modulation, system-centric, and user adaptation.
- Most system-repair studies focused on confirmation, asking, and social strategies; only N=3 studies focused on information repair strategies, and there was a complete absence of studies investigating disclosure as a repair strategy.
- For user-repair, clarification and information strategies were more common, while modulation, system-centric, and user adaptation strategies were notably under-explored; clarification strategies such as repetition and reformulation were the most widely employed, but repetition and modulation were often least successful and could negatively impact SDS recognition.
- Methodologically, the majority of studies were mixed-method (N=16), followed by qualitative (N=10) and quantitative (N=10); field-collected corpora (N=11) and lab-collected corpora (N=10) were common, as were between-subject (N=10) and within-subject (N=10) experiments. Sample sizes ranged from 5 to 850 participants; English was the most prevalent language (N=16) and the United States the most common location (N=16).
Methods
- Scoping review following PRISMA-ScR and Arksey & O’Malley’s framework; searched ACM Digital Library, IEEE Xplore, Scopus, and Web of Science up to August 2023, yielding 818 papers, reduced to 505 after duplicate removal, then 128 after title/abstract screening, 17 eligible from database search, plus 19 from backward/forward chaining, for 36 included papers.
- Inclusion criteria: user studies examining strategies to repair or mitigate breakdowns in SDSs; voice-based interactions primarily; at least one user and one SDS; original peer-reviewed journal or full-length conference papers. Exclusion criteria included non-English publications, multimodal interactions where voice was not primary, purely technical error-handling studies, and dissertations/review articles/conference abstracts.
- Data were charted and strategies categorized by function and objective, adapting existing frameworks where applicable; studies were classified as qualitative, quantitative, or mixed-method.
Limitations
- The authors state that reliance on predefined frameworks may not fully account for the multifaceted nature of repair strategies; categorization was subjective and compounded by terminology inconsistencies; combined repair strategies blurred category distinctions; and the review was limited to four databases, predefined search terms, and inclusion criteria.
- The authors also state that the review aimed to map strategies rather than evaluate their effectiveness on user experience or SDS performance.
- Evident from the text: many field-collected corpora were pre-2009 and telephone-based; studies were predominantly Western and English-language; most examined single-session, single-language, disembodied SDS interactions, limiting generalizability to current and culturally diverse SDS contexts.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
22 Valid · 6 Not valid · 54 Not checked · 73 Own results and interpretations
The cited sources that could be checked couldn’t confirm or dispute this claim.
In the paper
“Centred on the main dialogue actor in the breakdown-repairing process, research in repair strategies has been broadly divided into two areas: investigations into system-repair strategies and studies on user-repair strategies [10, 16].”
What the sources say
- Not checked — no full text of the sourcecites [10] [10] Marie-Luce Bourguet. 2006. Towards a taxonomy of error-handling strategies in recognition-based multi-modal human-computer interfaces. Signal Processing 86, 12 (2006), 3625-3643. - source
- Could not verifycites [16] [16] Leigh Clark, Philip Doyle, Diego Garaialde, Emer Gilmartin, Stephan Schlögl, Jens Edlund, Matthew Aylett, João Cabral, Cosmin Munteanu, Justin Edwards, et al. 2019. The state of speech in HCI: Trends, themes and challenges. Interacting with computers 31, 4 (2019), 349-371. Essam Alghamdi, Martin Halvey, and Emma Nicol - sourceExperimental — accuracy not yet measured
Section 5.1 (pp. 9–10) divides the speech-HCI papers reviewed into usability/theory-based research and system-experience research, not categories of repair strategies. Searches for repair strategies and breakdown repair found no passage in our copy addressing the claimed system-repair versus user-repair division. (LLM, conf=0.72)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Research shows the effectiveness of system-repair strategies is stronger when combined with other strategies as a multiple-repair strategy [37, 77].”
What the sources say
- Partly supportedcites [37] [37] Esther S Kox, José H Kerstholt, Tom F Hueting, and Peter W de Vries. 2021. Trust repair in human-agent teams: the effectiveness of explanations and expressing regret. Autonomous agents and multi-agent systems 35, 2 (2021), 30. - sourceExperimental — accuracy not yet measured
The Results (§3.2 Trust) and Discussion (§4) report stronger trust recovery when the agent combined an explanation with an expression of regret than when it expressed regret alone. The paper tested those specific apology components in a human–agent team; it does not establish that system-repair strategies generally become more effective whenever they are combined with other strategies. (LLM, conf=0.81)
- Not checked — no full text of the sourcecites [77] [77] Sihan Yuan, Birgit Brüggemeier, Stefan Hillmann, and Thilo Michael. 2020. User preference and categories for error responses in conversational user interfaces. In Proceedings of the 2nd Conference on Conversational User Interfaces . 1-8. - source
boostedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“Four studies we reviewed investigated user-repair strategies specifically focused on lexical adjustments (when users modify vocabulary), semantic adjustments (when users alter the meaning of the original statement) and syntactic adjustments (when users restructure sentences; e.g. [30, 46]).”
What the sources say
- Not checked — no full text of the sourcecites [30] [30] Mohit Jain, Ramachandra Kota, Pratyush Kumar, and Shwetak N Patel. 2018. Convey: Exploring the use of a context view for chatbots. In Proceedings of the 2018 chi conference on human factors in computing systems . 1-6. - source
- Supportedcites [46] [46] Lina Mavrina, Jessica Szczuka, Clara Strathmann, Lisa Michelle Bohnenkamp, Nicole Krämer, and Stefan Kopp. 2022. 'Alexa, You're Really Stupid': A Longitudinal Field Study on Communication Breakdowns Between Family Members and a Voice Assistant. Frontiers in Computer Science 4 (2022), 791704. - source
Section 3.3.2 says the study investigated users’ repair strategies, and the Discussion (section 5; page unavailable) describes users varying the semantic, syntactical, and lexical content of their utterances. This supports citing the paper as an example of a study of those adjustments; the count of four reviewed studies belongs to the citing authors’ review, not to this source. (LLM, conf=0.91)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Recent studies, particularly those produced in the past five years, have shown increased interest in exploring modulation strategies across various domains and settings, primarily through the analysis of lab-collected corpora (e.g. [35, 46, 53]).”
What the sources say
- Not checked — no full text of the sourcecites [35] [35] Sujeong Kim, David Salter, Luke DeLuccia, and Amir Tamrakar. 2020. Study on text-based and voice-based dialogue interfaces for human-computer interactions in a blocks world. In Proceedings of the 8th International Conference on HumanAgent Interaction . 227-229. - source
- Partly supportedcites [46] [46] Lina Mavrina, Jessica Szczuka, Clara Strathmann, Lisa Michelle Bohnenkamp, Nicole Krämer, and Stefan Kopp. 2022. 'Alexa, You're Really Stupid': A Longitudinal Field Study on Communication Breakdowns Between Family Members and a Voice Assistant. Frontiers in Computer Science 4 (2022), 791704. - sourceExperimental — accuracy not yet measured
Section 3.3.2 studies users’ repair strategies, so this 2022 paper is an example of recent research on how people modify their speech after communication breakdowns. But the Introduction and section 3.1 describe a five-week study of families using Alexa at home, with conversations retrieved from Alexa logs—not a lab-collected corpus. The paper does not establish the claimed broader increase in research interest across domains. (LLM, conf=0.86)
- Not checked — no full text of the sourcecites [53] [53] Chelsea Myers, Anushay Furqan, Jessica Nebolsky, Karina Caro, and Jichen Zhu. 2018. Patterns for how users overcome obstacles in voice user interfaces. In Proceedings of the 2018 CHI conference on human factors in computing systems . 1-7. - source
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“These studies found that in correction and non-correction dialogue acts, the prosodic elements of user utterances typically shift towards hyper-articulated speech patterns.”
What the sources say
- Not checked — no full text of the sourcecites [35] [35] Sujeong Kim, David Salter, Luke DeLuccia, and Amir Tamrakar. 2020. Study on text-based and voice-based dialogue interfaces for human-computer interactions in a blocks world. In Proceedings of the 8th International Conference on HumanAgent Interaction . 227-229. - source
- Partly supportedcites [46] [46] Lina Mavrina, Jessica Szczuka, Clara Strathmann, Lisa Michelle Bohnenkamp, Nicole Krämer, and Stefan Kopp. 2022. 'Alexa, You're Really Stupid': A Longitudinal Field Study on Communication Breakdowns Between Family Members and a Voice Assistant. Frontiers in Computer Science 4 (2022), 791704. - sourceExperimental — accuracy not yet measured
Section 2.2 reports that earlier studies observed hyperarticulation or prosodic changes as common user strategies, especially after speech-recognition errors. It does not establish that utterances typically shift toward hyper-articulated speech in both correction and non-correction dialogue acts. In this paper’s own data, changes in articulation were the least-used repair-strategy group (Section 3.3.2). Page numbers are unavailable in our copy. (LLM, conf=0.88)
- Not checked — no full text of the sourcecites [53] [53] Chelsea Myers, Anushay Furqan, Jessica Nebolsky, Karina Caro, and Jichen Zhu. 2018. Patterns for how users overcome obstacles in voice user interfaces. In Proceedings of the 2018 CHI conference on human factors in computing systems . 1-7. - source
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
65 more claims · 1 with their cited sources checked
Create a free account to see all 155 claims and every source verdict.
- It may state two separate claims as one. 48
- The quote only partly states this claim. 2
- Probably not a substantial claim. 53
- Borderline: one of the tests for a substantial claim is unclear. 2
Citations
Cites
Scoping studies: towards a methodological framework
Arksey, H., & O'Malley, L. (2005) · International Journal of Social Research Methodology · doi:10.1080/1364557032000119616 · Cited by 36,742
Munn, Z., Peters, M. D. J., Stern, C., Tufanaru, C., McArthur, A., & Aromataris, E. (2018) · BMC Medical Research Methodology · doi:10.1186/s12874-018-0611-x · Cited by 11,385
Nass, C., Steuer, J., & Tauber, E. R. (1994) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/191666.191703 · Cited by 2,148 · cited 1×
“Grounded in the Computers Are Social Actors (CASA) paradigm, these strategies embody a range of human-like qualities through various responses, including apologies and compensatory strategies [55].”
Daudt, H. M., van Mossel, C., & Scott, S. J. (2013) · BMC Medical Research Methodology · doi:10.1186/1471-2288-13-48 · Cited by 1,891
Luger, E., & Sellen, A. (2016) · Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858288 · Cited by 1,176
Understanding scoping reviews: Definition, purpose, and process
Peterson, J., Pearce, P. F., Ferguson, L. A., & Langford, C. A. (2017) · Journal of the American Association of Nurse Practitioners · doi:10.1002/2327-6924.12380 · Cited by 740
Voice Interfaces in Everyday Life
Porcheron, M., Fischer, J. E., Reeves, S., & Sharples, S. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3174214 · Cited by 717 · cited 7×
“Importantly, the selection of user-repair strategies is not random but is significantly influenced by the system’s repair strategies [43, 50, 60, 61].”
BackgroundInfluentialHarnessing the power of llms in practice: a survey on chatGPT and beyond
Yang, J., Jin, H., Tang, R., Han, X., Feng, Q., Jiang, H., Zhong, S., Yin, B., & Hu, X. (2024) · ACM Transactions on Knowledge Discovery from Data · doi:10.1145/3649506 · Cited by 644
Nass, C., Steuer, J., & Tauber, E. R. (1994) · Conference companion on Human factors in computing systems - CHI '94 · doi:10.1145/259963.260288 · Cited by 579
Relational agents: a model and implementation of building user trust
Bickmore, T., & Cassell, J. (2001) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/365024.365304 · Cited by 479
Research works printed but not linked: 6
- Dennis Benner, Edona Elshan, Sofia Schöbel, and Andreas Janson. 2021. What do you mean? A review on recovery strategies to overcome conversational breakdowns of conversational agents. In International Conference on Information Systems (ICIS). 1–17.
- Stephen Choularton and Robert Dale. 2004. User responses to speech recognition errors: consistency of behaviour across domains. In Proceedings of SST, Vol. 4.
- Lea Kisser and Ingo Siegert. 2022. Erroneous reactions of voice assistants" in the wild"–first analyses. Elektronische Sprachsignalverarbeitung (2022), 113–120.
- 10.1080/10447318.2023.2266791 · DOI · Paper page
- Gabriel Skantze. 2003. Exploring human error handling strategies: Implications for spoken dialogue systems. In ISCA Tutorial and Research Workshop on Error Handling in Spoken Dialogue Systems.
- Lionel Sujay Vailshery. 2021. Number of digital voice assistants in use worldwide 2019-2024. Statista Research Departement.[Online]. Available: https://www. statista. com/statistics/973815/worldwide-digital-voice-assistant-in-use (2021).
Cited by
The Art of Talking Machines: A Comprehensive Literature Review of Conversational User Interfaces
Namvarpour, M. (., & Razi, A. (2025) · Proceedings of the 7th ACM Conference on Conversational User Interfaces · doi:10.1145/3719160.3736621 · Cited by 19
Gnewuch, U., & Reinkemeier, F. (2026) · MIS Quarterly · doi:10.25300/misq/2025/18742 · Cited by 5
Lan, L., Cai, Y., Chu, Y., Tang, W., Chen, Y., & Liu, P. (2025) · International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI) · doi:10.1145/3744333.3747832 · Cited by 2
To Apologize or Not to Apologize? Trust Repair After Automated Vehicles’ Mistakes
Cai, Y., Chu, Y., Xu, Z., & Liu, P. (2025) · Transportation Research Record Journal of the Transportation Research Board · doi:10.1177/03611981251355535 · Cited by 6
Kim, E.-J., & Koo, Y. (2026) · Behaviour and Information Technology · doi:10.1080/0144929x.2026.2630372 · Cited by 1
Metadata
- Authors
- Alghamdi, E., Halvey, M., & Nicol, E.
- Affiliations
- University of Strathclyde (GB)
- Venue
- ACM Conversational User Interfaces 2024
- Publisher
- ACM
- Published
- 2024-07-08
- Pages
- 1-13
- OpenAlex
- W4400396839
- Semantic Scholar
- 432682853a953b862ba3cefde8a854e145e611f7
- Cited by
- 36
- References
- 59
- Citations by year
- 2026: 27 · 2025: 8 · 2024: 1
- FWCI
- 10.61
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- ACM Conference on Conversational User Interfaces (CUI) (publishedVersion, cc-by)
- Strathprints: The University of Strathclyde institutional repository (University of Strathclyde) (submittedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Social Sciences › Business, Management and Accounting › Marketing › AI in Service Interactions
- Social Sciences › Arts and Humanities › Language and Linguistics › Language, Discourse, Communication Strategies
- Keywords
- spoken dialogue systems, conversational breakdown, repair strategies, misunderstanding, non-understanding, human-machine interaction, dialogue management
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-09-30, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-09-30 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: System and User Strategies to Repair Conversational Breakdowns of Spoken Dialogue Systems: A Scoping Review. https://app.cochat.ai/papers/10.1145/3640794.3665558
- The paper
- Alghamdi, E., Halvey, M., & Nicol, E. (2024). System and User Strategies to Repair Conversational Breakdowns of Spoken Dialogue Systems: A Scoping Review. ACM Conversational User Interfaces 2024. https://doi.org/10.1145/3640794.3665558
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.