Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 32 of the 32 references it cites were found in a registry or an index.

User Preference and Categories for Error Responses in Conversational User Interfaces

Open access
Yuan, Sihan, Brüggemeier, Birgit, Hillmann, Stefan, Michael, Thilo · 2020 · Proceedings of the 2nd Conference on Conversational User Interfaces

Abstract

Error messages are frequent in interactions with Conversational User Interfaces (CUI). Smart speakers respond to about every third user request with an error message. Errors can heavily affect user experience (UX) in interaction with CUI. However, there is limited research on how error responses should be formulated. In this paper, we present a system to study how people classify different categories (acknowledgement of user sentiment, acknowledgement of error and apology) of error messages, and evaluate peoples' preference of error responses with clear categories. The results indicate that if an error response has only one element (i.e. neutral acknowledgement of error, apology or sentiment), responses that acknowledge errors neutrally are preferred by participants. Moreover, we find that when interviewed, participants like error messages to include an apology, an explanation of what went wrong, and a suggestion how to fix the problem in addition to a neutral acknowledgement of an error. Our study has two main contributions: (1) our results inform about the design of error messages and (2) we present a framework for error response categorization and validation.

Overview

Integrity signals

Registry

Crossref · 10.1145/3405755.3406126

Cites

32 of 32 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

1 more claim about this paper

Create a free account to see every claim other papers make about this one.

See all claims — free account

Citations

Cites

Show all 32 references

Research works printed but not linked: 8

  1. Philip R Doyle , Justin Edwards , Odile Dumbleton , Leigh Clark , and Benjiamin R . Cowan . 2019 . Mapping Perceptions of Humanness in Speech-Based Intelligent Personal Assistant Interaction . arXiv preprint arXiv:1907.11585, 2019. (2019). Philip R Doyle, Justin Edwards, Odile Dumbleton, Leigh Clark, and Benjiamin R. Cowan. 2019. Mapping Perceptions of Humanness in Speech-Based Intelligent Personal Assistant Interaction. arXiv preprint arXiv:1907.11585, 2019. (2019). · arXiv
  2. Eric Enge . 2018 . RATING THE SMARTS OF THE DIGITAL PERSONAL ASSISTANTS IN 2018. https://www.perficientdigital.com/insights/our-research/digital-personal-assistants-study{#}Smartest Eric Enge. 2018. RATING THE SMARTS OF THE DIGITAL PERSONAL ASSISTANTS IN 2018. https://www.perficientdigital.com/insights/our-research/digital-personal-assistants-study{#}Smartest
  3. Sture Holm . 1979 . Board of the Foundation of the Scandinavian Journal of Statistics A Simple Sequentially Rejective Multiple Test Procedure A Simple Sequentially Rejective Multiple Test Procedure. Source : Scandinavian Journal of Statistics Scand J Statist 6 , 6 (1979), 65 -- 70 . Sture Holm. 1979. Board of the Foundation of the Scandinavian Journal of Statistics A Simple Sequentially Rejective Multiple Test Procedure A Simple Sequentially Rejective Multiple Test Procedure. Source: Scandinavian Journal of Statistics Scand J Statist 6, 6 (1979), 65--70.
  4. Market Research Engine . 2020. Chatbot Market By Platform Analysis (Web-based , Mobile, Stand-alone) ; By Enterprise size Analysis (Small Enterprises, Medium Enterprises, Large Enterprises) and By Regional Analysis - Global Forecast by 2018 - 2024 | Marketresearch ., 140 pages. https://www.marketresearchengine.com/chatbot-market-report Market Research Engine. 2020. Chatbot Market By Platform Analysis (Web-based, Mobile, Stand-alone); By Enterprise size Analysis (Small Enterprises, Medium Enterprises, Large Enterprises) and By Regional Analysis - Global Forecast by 2018 - 2024 | Marketresearch., 140 pages. https://www.marketresearchengine.com/chatbot-market-report
  5. Marketsandmarkets. 2018. Smart Manufacturing Market Size , Growth, Trend and Forecast to 2023 . https://www.marketsandmarkets.com/Market-Reports/smart-speaker-market-44984088.htmlhttps://www.marketsandmarkets.com/Market-Reports/smart-manufacturing-market-105448439.html Marketsandmarkets. 2018. Smart Manufacturing Market Size, Growth, Trend and Forecast to 2023. https://www.marketsandmarkets.com/Market-Reports/smart-speaker-market-44984088.htmlhttps://www.marketsandmarkets.com/Market-Reports/smart-manufacturing-market-105448439.html
  6. Marshall McLuhan and Quentin Fiore . 1967 . The medium is the message . New York 123 (1967), 126 -- 128 . Marshall McLuhan and Quentin Fiore. 1967. The medium is the message. New York 123 (1967), 126--128.
  7. C Pearl . 2016. Designing voice user interfaces: principles of conversational experiences . O'Reilly Media, Inc. C Pearl. 2016. Designing voice user interfaces: principles of conversational experiences. O'Reilly Media, Inc.
  8. 10.5555/2467342.2467523 · doi:10.5555/2467342.2467523

Cited by

See all 16

Metadata

Authors
Yuan, S., Brüggemeier, B., Hillmann, S., & Michael, T.
Affiliations
  • Fraunhofer Institute for Integrated Circuits (DE)
  • Technische Universität Berlin (DE)
Venue
Proceedings of the 2nd Conference on Conversational User Interfaces
Publisher
ACM
Published
2020-07-22
Pages
1-8
OpenAlex
W3043404834
Cited by
16
References
32
Citations by year
2026: 1 · 2025: 2 · 2024: 2 · 2023: 1 · 2022: 3 · 2021: 6 · 2020: 1
FWCI
1.05
Type
conference paper
Language
en
Open access
Locations
  • ACM Conference on Conversational User Interfaces (CUI) (publishedVersion)
  • Publikationsdatenbank der Fraunhofer-Gesellschaft (Fraunhofer-Gesellschaft) (submittedVersion, other-oa)
  • Fraunhofer-Publica (Fraunhofer-Gesellschaft) (submittedVersion)
Funders
  • German Federal Ministry for Economic Affairs and Energy (01MK20011A)
  • Federal Ministry of Education and Research (16SV8151)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
  • Social Sciences › Business, Management and Accounting › Marketing › AI in Service Interactions
  • Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
Keywords
error messages, conversational interfaces, smart speakers, user preferences, apology, user sentiment, user experience, voice assistants

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: User Preference and Categories for Error Responses in Conversational User Interfaces. https://app.cochat.ai/papers/10.1145/3405755.3406126
The paper
Yuan, S., Brüggemeier, B., Hillmann, S., & Michael, T. (2020). User Preference and Categories for Error Responses in Conversational User Interfaces. Proceedings of the 2nd Conference on Conversational User Interfaces. https://doi.org/10.1145/3405755.3406126

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.