The Impact of User Characteristics and Preferences on Performance with an Unfamiliar Voice User Interface
The DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.
Abstract
Voice User Interfaces (VUIs) are increasing in popularity. However, their invisible nature with no or limited visuals makes it difficult for users to interact with unfamiliar VUIs. We analyze the impact of user characteristics and preferences on how users interact with a VUI-based calendar, DiscoverCal. While recent VUI studies analyze user behavior through self-reported data, we extend this research by analyzing both VUI usage data and self-reported data to observe correlations between both data types. Results from our user study (n=50) led to four key findings: 1) programming experience did not have a wide-spread impact on performance metrics while 2) assimilation bias did, 3) participants with more technical confidence exhibited a trial-and-error approach, and 4) desiring more guidance from our VUI correlated with performance metrics that indicate cautious users.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Luger, E., & Sellen, A. (2016) · Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858288 · Cited by 1,176 · cited 8×
“Key Finding #1: Programming experience did not have a wide-spread impact on performance metrics Luger and Sellen [17] found that participants more technically knowledgeable were self-reported as beingmore patient with errors and willing to say more utterances to accomplish a task with voice-only and visual VUIs.”
BackgroundInfluential"What can i help you with?": infrequent users' experiences of intelligent personal assistants
Cowan, B. R., Pantidi, N., Coyle, D., Morrissey, K., Clarke, P., Al-Shehri, S., Earley, D., & Bandeira, N. (2017) · Proceedings of the 19th International Conference on Human-Computer Interaction with Mobile Devices and Services · doi:10.1145/3098279.3098539 · Cited by 351
Patterns for How Users Overcome Obstacles in Voice User Interfaces
Myers, C., Furqan, A., Nebolsky, J., Caro, K., & Zhu, J. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3173580 · Cited by 213 · cited 10×
“Finally, a recent VUI study found that participants using an unfamiliar VUI were not relying on the menu provided and instead were “guessing” intents and utterances [19].”
BackgroundMethodInfluentialSelf-citationCorbett, E., & Weber, A. (2016) · Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services · doi:10.1145/2935334.2935386 · Cited by 148 · cited 6×
“found that assimilation bias prejudiced participants with their previous VUI experience and lead to users over- or underestimating the sophistication of a new VUI [4].”
BackgroundResultInfluentialSearching by Talking: Analysis of Voice Queries on Mobile Web Search
Guy, I. (2016) · Proceedings of the 39th International ACM SIGIR conference on Research and Development in Information Retrieval · doi:10.1145/2911451.2911525 · Cited by 140 · cited 1×
“These studies categorize how users react to errors [10, 12, 19], make search requests [9], and ask for recommendations [11] based on participant usage data.”
BackgroundPyae, A., & Joelsson, T. N. (2018) · Proceedings of the 20th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct · doi:10.1145/3236112.3236130 · Cited by 99
Empirically Evaluating an Adaptable Spoken Dialogue System
Litman, D. J., & Pan, S. (1999) · CISM International Centre for Mechanical Sciences · doi:10.1007/978-3-7091-2490-1_6 · Cited by 67
Factors Affecting Seniors' Perceptions of Voice-enabled User Interfaces
Ziman, R., & Walsh, G. (2018) · Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3170427.3188575 · Cited by 46
Assessing the Utility of the System Usability Scale for Evaluating Voice-based User Interfaces
Ghosh, D., Foong, P. S., Zhang, S., & Zhao, S. (2018) · Proceedings of the Sixth International Symposium of Chinese CHI · doi:10.1145/3202667.3204844 · Cited by 36 · cited 1×
“For comparison, Siri received a mean score of 54.167 ± 15.715 and Alexa a 84.792 ± 9.26 in a recent study [8].”
BackgroundInfluential
Cited by
The Who in XAI: How AI Background Shapes Perceptions of AI Explanations
Ehsan, U., Passi, S., Liao, Q. V., Chan, L., Lee, I.-H., Muller, M., & Riedl, M. O. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642474 · Cited by 123
Wei, J., Tag, B., Trippas, J. R., Dingler, T., & Kostakos, V. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3517432 · Cited by 46
What's The Talk on VUI Guidelines? A Meta-Analysis of Guidelines for Voice User Interface Design
Murad, C., Candello, H., & Munteanu, C. (2023) · Proceedings of the 5th International Conference on Conversational User Interfaces · doi:10.1145/3571884.3597129 · Cited by 36
Wang, J., Yang, S., & Xu, Z. (2023) · Frontiers in Psychology · doi:10.3389/fpsyg.2023.1119355 · Cited by 12
“Try, Try, Try Again:” Sequence Analysis of User Interaction Data with a Voice User Interface
Myers, C. M., Laris Pardo, L. F., Acosta-Ruiz, A., Canossa, A., & Zhu, J. (2021) · CUI 2021 - 3rd Conference on Conversational User Interfaces · doi:10.1145/3469595.3469613 · Cited by 10
Self-citation
Metadata
- Authors
- Myers, C. M., Furqan, A., & Zhu, J.
- Venue
- Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2019-05-02
- Pages
- 1-9
- OpenAlex
- W2942177402
- Cited by
- 58
- References
- 9
- FWCI
- 6.58
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: The Impact of User Characteristics and Preferences on Performance with an Unfamiliar Voice User Interface. https://app.cochat.ai/papers/10.1145/3290605.3300277
- The paper
- Myers, C. M., Furqan, A., & Zhu, J. (2019). The Impact of User Characteristics and Preferences on Performance with an Unfamiliar Voice User Interface. Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. https://doi.org/10.1145/3290605.3300277
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.