The DOI matches its Crossref record; 92 of the 92 references it cites were found in a registry or an index.
What's The Talk on VUI Guidelines? A Meta-Analysis of Guidelines for Voice User Interface Design
Abstract
Over the past decade, voice user interface (VUI) design has been steadily growing, along with a growing VUI presence in consumer markets. However, there is currently a lack of widely-established guidelines for VUI design. While many sets of VUI guidelines have been proposed, they tend to be developed independently of each other, leading to a lack of consensus on appropriate guidelines for VUI design. This can hinder the wider adoption of practical VUI guidelines. To address this gap, we performed a large-scale meta-analysis of 336 VUI design guidelines that have been proposed in academic literature. Using thematic analysis, we present a unified and synthesized set of 14 guidelines, representing the most universally proposed principles of VUI design as captured by the 336 VUI guidelines identified in academic literature. We hope that this synthesized set can address several of the challenges to the adoption of VUI guidelines in design practice.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Using thematic analysis in psychology
Braun, V., & Clarke, V. (2006) · Qualitative Research in Psychology · doi:10.1191/1478088706qp063oa · Cited by 194,414
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000100 · Cited by 28,164
ELIZA—a computer program for the study of natural language communication between man and machine
Weizenbaum, J. (1966) · Communications of the ACM · doi:10.1145/365153.365168 · Cited by 4,452
The PRISMA 2020 statement: An updated guideline for reporting systematic reviews
Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., Akl, E. A., Brennan, S. E., et al. (2021) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2021.03.001 · Cited by 4,265
Enhancing the explanatory power of usability heuristics
Nielsen, J. (1994) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/191666.191729 · Cited by 1,439
Luger, E., & Sellen, A. (2016) · Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858288 · Cited by 1,176
Systematic reviews and meta-analysis: Understanding the best evidence in primary healthcare
Ganeshkumar, P., & Gopalakrishnan, S. (2013) · Journal of Family Medicine and Primary Care · doi:10.4103/2249-4863.109934 · Cited by 743
What Makes a Good Conversation?: Challenges in Designing Truly Conversational Agents
Clark, L., Pantidi, N., Cooney, O., Doyle, P., Garaialde, D., Edwards, J., Spillane, B., Gilmartin, E., Murad, C., Munteanu, C., et al. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300705 · Cited by 461
Self-citationHeuristic evaluation for games: usability principles for video game design
Pinelle, D., Wong, N., & Stach, T. (2008) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1357054.1357282 · Cited by 418
Vimalkumar, M., Sharma, S. K., Singh, J. B., & Dwivedi, Y. K. (2021) · Computers in Human Behavior · doi:10.1016/j.chb.2021.106763 · Cited by 402 · cited 2×
“Our findings also suggest that certain topics may not be currently addressed adequately enough in VUI guidelines that may require more focus as VUI design matures, such as making VUIs accessible and diverse [10, 18, 22, 25, 42, 74, 103], and maintaining user privacy [7, 32, 43, 58, 64, 95].”
Background
Research works printed but not linked: 9
- M. Allison and L. M. Kendrick. 2013. Towards an expressive embodied conversational agent utilizing multi-ethnicity to augment solution focused therapy. In FLAIRS 2013 - Proceedings of the 26th International Florida Artificial Intelligence Research Society Conference. 332–337. www.scopus.com
- 10.1093/idpl · doi:10.1093/idpl
- M. Anabuki, H. Kakuta, H. Yamamoto, and H. Tamura. 2000. Welbo: An embodied conversational agent living in mixed reality space. In Conference on Human Factors in Computing Systems - Proceedings. 10–11. www.scopus.com
- 10.1093/iwc · doi:10.1093/iwc
- Aki Halonen Sami Hyrynsalmi Kai K. Kimppa Timo Knuutila Jouni Smed and Harri Hakonen. 2012. Towards Usability Heuristics for Games Utilizing Speech Recognition. In 4TH ASIAN CONFERENCE ON IN℡LIGENT GAMES AND SIMULATION - 4TH ASIAN SIMULATION TECHNOLOGY CONFERENCE Inaba M and Hosoi K and Thawonmas R and Nakamura A and Uemura M (Ed.). 51–55.
- 10.1145/3170427.3188548 · DOI · Paper page
- Donald Norman. 1988. The Design of Everyday Things. Doubled Currency (1988).
- Cathy Pearl. 2016. Designing Voice User Interfaces: Principles of Conversational Experiences (1st ed.). O’Reilly Media, Inc.
- Kathryn Whitenton. 2016. Voice Interaction UX: Brave New World...Same Old Story. https://www.nngroup.com/articles/voice-interaction-ux/
Cited by
The Value-Sensitive Conversational Agent Co-Design Framework
Sadek, M., Calvo, R. A., & Mougenot, C. (2024) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2024.2426737 · Cited by 32
“…& Mittelstadt, 2019), their over-formalisation of AI ethics (Ali et al., 2023), the over-saturation of principles for AI (Jobin et al., 2019) and CAs (Murad et al., 2023) making selection difficult, and their ineffectiveness at supporting value-related considerations (Palmer & Schwan, 2024).”
Alghamdi, E., Halvey, M., & Nicol, E. (2024) · ACM Conversational User Interfaces 2024 · doi:10.1145/3640794.3665558 · Cited by 36
Beyond Functionality: Co-Designing Voice User Interfaces for Older Adults' Well-being
Hu, X., Desai, S., Lundy, M., & Chin, J. (2025) · ACM Conference on Conversational User Interfaces (CUI) · doi:10.1145/3719160.3736613 · Cited by 18
Abhari, S., McMurray, J., Randhawa, T., Noon, G. B., Hanjahanja-Phiri, T., McNeil, H., Manning, F., Debergue, P., Teague, J., & Morita, P. P. (2024) · JMIR Aging · doi:10.2196/58196 · Cited by 11
“Thematic analysis is a widely recognized method in both scoping and systematic reviews and has been applied in numerous studies to provide a deeper understanding of qualitative data [23-26].”
MethodTsui, K. M., Baggett, R., & Chiang, C. (2025) · Applied Sciences · doi:10.3390/app15020891 · Cited by 7
Metadata
- Authors
- Murad, C., Candello, H., & Munteanu, C.
- Affiliations
- University of Toronto (CA)
- IBM Research - Brazil (BR)
- University of Waterloo (CA)
- Venue
- Proceedings of the 5th International Conference on Conversational User Interfaces
- Publisher
- ACM
- Published
- 2023-07-19
- Pages
- 1-16
- OpenAlex
- W4384520711
- Semantic Scholar
- 68fce8bd8595bb2eb8567fd87e0207124a0c21ee
- Cited by
- 36
- References
- 89
- Citations by year
- 2026: 15 · 2025: 14 · 2024: 7
- FWCI
- 0.95
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- ACM Conference on Conversational User Interfaces (CUI) (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Physical Sciences › Computer Science › Human-Computer Interaction › Innovative Human-Technology Interaction
- Keywords
- voice user interface design, design guidelines, voice assistants, human-computer interaction design
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: What's The Talk on VUI Guidelines? A Meta-Analysis of Guidelines for Voice User Interface Design. https://app.cochat.ai/papers/10.1145/3571884.3597129
- The paper
- Murad, C., Candello, H., & Munteanu, C. (2023). What's The Talk on VUI Guidelines? A Meta-Analysis of Guidelines for Voice User Interface Design. Proceedings of the 5th International Conference on Conversational User Interfaces. https://doi.org/10.1145/3571884.3597129
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.