What's The Talk on VUI Guidelines? A Meta-Analysis of Guidelines for Voice User Interface Design
The DOI matches its Crossref record; 92 of the 92 references it cites were found in a registry or an index.
Abstract
Over the past decade, voice user interface (VUI) design has been steadily growing, along with a growing VUI presence in consumer markets. However, there is currently a lack of widely-established guidelines for VUI design. While many sets of VUI guidelines have been proposed, they tend to be developed independently of each other, leading to a lack of consensus on appropriate guidelines for VUI design. This can hinder the wider adoption of practical VUI guidelines. To address this gap, we performed a large-scale meta-analysis of 336 VUI design guidelines that have been proposed in academic literature. Using thematic analysis, we present a unified and synthesized set of 14 guidelines, representing the most universally proposed principles of VUI design as captured by the 336 VUI guidelines identified in academic literature. We hope that this synthesized set can address several of the challenges to the adoption of VUI guidelines in design practice.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Using thematic analysis in psychology
Braun, V., & Clarke, V. (2006) · Qualitative Research in Psychology · doi:10.1191/1478088706qp063oa · Cited by 194,414
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000100 · Cited by 28,164
ELIZA—a computer program for the study of natural language communication between man and machine
Weizenbaum, J. (1966) · Communications of the ACM · doi:10.1145/365153.365168 · Cited by 4,452
The PRISMA 2020 statement: An updated guideline for reporting systematic reviews
Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., Akl, E. A., Brennan, S. E., et al. (2021) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2021.03.001 · Cited by 4,265
Enhancing the explanatory power of usability heuristics
Nielsen, J. (1994) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/191666.191729 · Cited by 1,439
Luger, E., & Sellen, A. (2016) · Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858288 · Cited by 1,176 · cited 9×
“have more human-like conversational abilities than they currently have [11, 26, 62, 65] not moving much farther from the capabilities of decades-old prototypes such as ELIZA [97].”
BackgroundInfluentialSystematic reviews and meta-analysis: Understanding the best evidence in primary healthcare
Ganeshkumar, P., & Gopalakrishnan, S. (2013) · Journal of Family Medicine and Primary Care · doi:10.4103/2249-4863.109934 · Cited by 743 · cited 1×
“In many fields, meta-analytic synthesis has been used to develop universal guidelines that help with the consistent application of domain-specific principles by a wide range of practitioners [41].”
BackgroundWhat Makes a Good Conversation?: Challenges in Designing Truly Conversational Agents
Clark, L., Pantidi, N., Cooney, O., Doyle, P., Garaialde, D., Edwards, J., Spillane, B., Gilmartin, E., Murad, C., Munteanu, C., et al. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300705 · Cited by 461 · cited 1×
“While research on the design of Voice User Interfaces (VUIs) has increased greatly in the last decade, recent research suggests that commercial VUIs still suffer from usability issues that can deter adoption [24, 26, 62, 66, 72].”
BackgroundSelf-citationHeuristic evaluation for games: usability principles for video game design
Pinelle, D., Wong, N., & Stach, T. (2008) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1357054.1357282 · Cited by 418
Vimalkumar, M., Sharma, S. K., Singh, J. B., & Dwivedi, Y. K. (2021) · Computers in Human Behavior · doi:10.1016/j.chb.2021.106763 · Cited by 402 · cited 2×
“Our findings also suggest that certain topics may not be currently addressed adequately enough in VUI guidelines that may require more focus as VUI design matures, such as making VUIs accessible and diverse [10, 18, 22, 25, 42, 74, 103], and maintaining user privacy [7, 32, 43, 58, 64, 95].”
Background
Research works printed but not linked: 9
- M. Allison and L. M. Kendrick. 2013. Towards an expressive embodied conversational agent utilizing multi-ethnicity to augment solution focused therapy. In FLAIRS 2013 - Proceedings of the 26th International Florida Artificial Intelligence Research Society Conference. 332–337. www.scopus.com
- 10.1093/idpl · doi:10.1093/idpl
- M. Anabuki, H. Kakuta, H. Yamamoto, and H. Tamura. 2000. Welbo: An embodied conversational agent living in mixed reality space. In Conference on Human Factors in Computing Systems - Proceedings. 10–11. www.scopus.com
- 10.1093/iwc · doi:10.1093/iwc
- Aki Halonen Sami Hyrynsalmi Kai K. Kimppa Timo Knuutila Jouni Smed and Harri Hakonen. 2012. Towards Usability Heuristics for Games Utilizing Speech Recognition. In 4TH ASIAN CONFERENCE ON IN℡LIGENT GAMES AND SIMULATION - 4TH ASIAN SIMULATION TECHNOLOGY CONFERENCE Inaba M and Hosoi K and Thawonmas R and Nakamura A and Uemura M (Ed.). 51–55.
- 10.1145/3170427.3188548 · DOI · Paper page
- Donald Norman. 1988. The Design of Everyday Things. Doubled Currency (1988).
- Cathy Pearl. 2016. Designing Voice User Interfaces: Principles of Conversational Experiences (1st ed.). O’Reilly Media, Inc.
- Kathryn Whitenton. 2016. Voice Interaction UX: Brave New World...Same Old Story. https://www.nngroup.com/articles/voice-interaction-ux/
Cited by
The Value-Sensitive Conversational Agent Co-Design Framework
Sadek, M., Calvo, R. A., & Mougenot, C. (2024) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2024.2426737 · Cited by 32
“…& Mittelstadt, 2019), their over-formalisation of AI ethics (Ali et al., 2023), the over-saturation of principles for AI (Jobin et al., 2019) and CAs (Murad et al., 2023) making selection difficult, and their ineffectiveness at supporting value-related considerations (Palmer & Schwan, 2024).”
Alghamdi, E., Halvey, M., & Nicol, E. (2024) · ACM Conversational User Interfaces 2024 · doi:10.1145/3640794.3665558 · Cited by 36
Beyond Functionality: Co-Designing Voice User Interfaces for Older Adults' Well-being
Hu, X., Desai, S., Lundy, M., & Chin, J. (2025) · ACM Conference on Conversational User Interfaces (CUI) · doi:10.1145/3719160.3736613 · Cited by 23
Abhari, S., McMurray, J., Randhawa, T., Noon, G. B., Hanjahanja-Phiri, T., McNeil, H., Manning, F., Debergue, P., Teague, J., & Morita, P. P. (2024) · JMIR Aging · doi:10.2196/58196 · Cited by 11
“Thematic analysis is a widely recognized method in both scoping and systematic reviews and has been applied in numerous studies to provide a deeper understanding of qualitative data [23-26].”
MethodTsui, K. M., Baggett, R., & Chiang, C. (2025) · Applied Sciences · doi:10.3390/app15020891 · Cited by 7
Voice Assistants' Accountability through Explanatory Dialogues
Alizadeh, F., Tolmie, P., Lee, M., Wintersberger, P., Pins, D., & Stevens, G. (2024) · ACM Conference on Conversational User Interfaces (CUI) · doi:10.1145/3640794.3665557 · Cited by 6
Understanding the Multimodal Voice Assistant as an Informal and Social Care Support Tool in the UK
Czech, E., Soubutts, E., Craddock, I. J., & O’Kane, A. A. (2025) · ACM Conference on Conversational User Interfaces (CUI) · doi:10.1145/3719160.3736605 · Cited by 4
Liang, C., Liu, Y., Mott, M. E., & Guo, A. (2025) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3749484 · Cited by 10
Iñiguez-Carrillo, A. L., Aréchiga, D., Romero, M. Á. R., & Espíndola-Barajas, A. G. (2024) · ACM Conference on Computer Supported Cooperative Work (CSCW) · doi:10.1145/3678884.3681905 · Cited by 2
“To facilitate an intuitive and efficient interaction the “Guidelines for Voice User Interface Design” [12] were followed to ensure an optimal and accessible user experience.”
Conversational Voice Interfaces: Translating Research Into Actionable Design
Murad, C., Munteanu, C., & Penn, G. (2024) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3613905.3636277 · Cited by 1
Self-citationConversational Web Browsing: Where Do Existing DesignGuidelines Fall Short?
Piro, L., Verma, H., & Matera, M. (2025) · Biannual Conference of the Italian SIGCHI Chapter (CHItaly) · doi:10.1145/3750069.3750161 · Cited by 2
Zhou, C., & Zhao, H. (2025) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2025.2508306 · Cited by 1
VocalVis: Bridging voice-based control and 3D surface visualization
Hombeck, J., Voigt, H., Nuhić, J., Meuschke, M., & Lawonn, K. (2026) · Computers & Graphics · doi:10.1016/j.cag.2026.104632 · Cited by 2
Spatial Referencing for Large Language Models in Automotive Navigation Tasks
Huynh, K., Dillmann, J., & Mayer, S. (2025) · International Conference on Mobile and Ubiquitous Multimedia (MUM) · doi:10.1145/3771882.3771917 · Cited by 3
On Creating Conversational Speech Interfaces
Panteliadou, E., Graf, R., Dippel, M., & Hitz, M. (2026) · Communications in computer and information science · doi:10.1007/978-3-032-16448-3_34
The sound of fairness: An integrative framework for embedding fairness into voice interaction design
Bahadornia, S. M. M., Fisler, J., & Matt, C. (2025) · Computers in Human Behavior Reports · doi:10.1016/j.chbr.2025.100915
Review of Heuristics and Usability and UX Scales for Speech-Based Technologies
Gómez, L. K., Luna-García, H., & Collazos, C. A. (2026) · Communications in computer and information science · doi:10.1007/978-3-032-31223-5_17
Piro, L., Candello, H. C. D. S. P., Matera, M., & Murad, C. (2026) · ACM Conference on Conversational User Interfaces (CUI) · doi:10.1145/3816046.3816323
Self-citationConversational Voice Interfaces: Translating Research Into Actionable Design
(2025) · doi:10.1145/3706599.3716395
Self-citationEthics-in-practice in UX Design: an Empirical Study of an AI-Based Conversational Support Tool
Wei, X., & Beretta, E. (2026) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3805689.3812474
Mahapasuthanon, P., Zheng, H., Singh, N. M., Currie, L., Motti, V. G., & Wiese, E. (2025) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/10711813251369354 · Cited by 1
“Research on both HRI and conversational user interfaces have become increasingly popular (Murad et al., 2023).”
A Framework for Interactive Machine Learning and Enhanced Conversational Systems
Conn, P., Robinson, J. Y., Abisla, R., Cattiau, J., Batra, S., & Phan, M. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-29653-5_13
Metadata
- Authors
- Murad, C., Candello, H., & Munteanu, C.
- Affiliations
- University of Toronto (CA)
- IBM Research - Brazil (BR)
- University of Waterloo (CA)
- Venue
- Proceedings of the 5th International Conference on Conversational User Interfaces
- Publisher
- ACM
- Published
- 2023-07-19
- Pages
- 1-16
- OpenAlex
- W4384520711
- Semantic Scholar
- 68fce8bd8595bb2eb8567fd87e0207124a0c21ee
- Cited by
- 36
- References
- 89
- Citations by year
- 2026: 15 · 2025: 14 · 2024: 7
- FWCI
- 0.95
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- ACM Conference on Conversational User Interfaces (CUI) (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Physical Sciences › Computer Science › Human-Computer Interaction › Innovative Human-Technology Interaction
- Keywords
- voice user interface design, design guidelines, voice assistants, human-computer interaction design
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.