Keep it Short: A Comparison of Voice Assistants’ Response Behavior
Open accessThe DOI matches its Crossref record; 12 of the 12 references it cites were found in a registry or an index.
Abstract
Voice assistants (VAs) are present in homes, smartphones, and cars. They allow users to perform tasks without graphical or tactile user interfaces, as they are designed for natural language interaction. However, we found that currently, VAs are emulating human behavior by responding in complete sentences, limiting the design options, and preventing VAs from meeting their full potential as a utilitarian tool. We implemented a VA that handles requests in three response styles: two differing short keyword-based response styles and a full-sentence baseline. In a user study, 72 participants interacted with our VA by issuing eight requests. Results show that the short responses were perceived similarly useful and likable while being perceived as more efficient, especially for commands, and sometimes better to comprehend than the baseline. To achieve widespread adoption, we argue that VAs should be customizable and adapt to users instead of always responding in full sentences.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Machines and Mindlessness: Social Responses to Computers
Nass, C., & Moon, Y. (2000) · Journal of Social Issues · doi:10.1111/0022-4537.00153 · Cited by 4,022 · cited 1×
“Nass and colleagues conducted a series of experiments to investigate social aspects in human-computer interaction [29, 30].”
BackgroundBeyond the Turk: Alternative platforms for crowdsourcing behavioral research
Peer, E., Brandimarte, L., Samat, S., & Acquisti, A. (2017) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2017.01.006 · Cited by 2,957 · cited 1×
“As others have shown, the Prolifc participant pool is equally reliable but more diverse than MTurk [33], which is often used in scientifc work and has been shown to generalize well to a broad population [18].”
BackgroundNass, C., Steuer, J., & Tauber, E. R. (1994) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/191666.191703 · Cited by 2,148 · cited 1×
“Triggers of such a behavior can be language or speech output, computer responses based on multiple prior inputs, or computers flling roles that humans usually fll [31].”
Luger, E., & Sellen, A. (2016) · Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858288 · Cited by 1,176 · cited 3×
“Emulating human behavior in a VA raises the users expectations, as it implies human capabilities [27].”
BackgroundInfluentialFranke, T., Attig, C., & Wessel, D. (2019) · International Journal of Human–Computer Interaction · doi:10.1080/10447318.2018.1456150 · Cited by 828 · cited 2×
“Finally, we used the Afnity for Technology Interaction (ATI) questionnaire [12] to assess participants’ tendency to engage in interaction with technologies.”
MethodVoice Interfaces in Everyday Life
Porcheron, M., Fischer, J. E., Reeves, S., & Sharples, S. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3174214 · Cited by 717 · cited 1×
“Besides works that analyze the general usage of VAs [1, 34] great amount of research is currently focused on the impact of the per-sonifcation of VAs.”
BackgroundWhat Makes a Good Conversation?: Challenges in Designing Truly Conversational Agents
Clark, L., Pantidi, N., Cooney, O., Doyle, P., Garaialde, D., Edwards, J., Spillane, B., Gilmartin, E., Murad, C., Munteanu, C., et al. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300705 · Cited by 461 · cited 2×
“This was also analyzed by Clark et al. [7] by identifying what makes a good conversation between humans and how a human-agent conversation should look like.”
BackgroundMethod"What can i help you with?": infrequent users' experiences of intelligent personal assistants
Cowan, B. R., Pantidi, N., Coyle, D., Morrissey, K., Clarke, P., Al-Shehri, S., Earley, D., & Bandeira, N. (2017) · Proceedings of the 19th International Conference on Human-Computer Interaction with Mobile Devices and Services · doi:10.1145/3098279.3098539 · Cited by 351
Mapping Perceptions of Humanness in Intelligent Personal Assistant Interaction
Doyle, P. R., Edwards, J., Dumbleton, O., Clark, L., & Cowan, B. R. (2019) · Proceedings of the 21st International Conference on Human-Computer Interaction with Mobile Devices and Services · doi:10.1145/3338286.3340116 · Cited by 100 · cited 1×
“However, when analyzing the expectations and perceptions of users, researchers found voice interfaces to be "more formal, fact based, impersonal and less authentic" [9] than human conversational partners.”
BackgroundEmpathy Is All You Need: How a Conversational Agent Should Respond to Verbal Abuse
Chin, H., Molefi, L. W., & Yi, M. Y. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376461 · Cited by 96
Cited by
Zargham, N., Reicherts, L., Bonfert, M., Voelkel, S. T., Schoening, J., Malaka, R., & Rogers, Y. (2022) · Proceedings of the 4th Conference on Conversational User Interfaces · doi:10.1145/3543829.3543834 · Cited by 84
User Interaction Patterns and Breakdowns in Conversing with LLM-Powered Voice Assistants
Mahmood, A., Wang, J., Yao, B., Wang, D., & Huang, C.-M. (2025) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2024.103406 · Cited by 51
Chan, S., Li, J., Yao, B., Mahmood, A., Huang, C.-M., Jimison, H., Mynatt, E. D., & Wang, D. (2023) · arXiv · doi:10.48550/arxiv.2310.05853 · Cited by 16
Wei, C. Z., Kim, Y.-H., & Kuzminykh, A. (2023) · Proceedings of the 5th International Conference on Conversational User Interfaces · doi:10.1145/3571884.3597139 · Cited by 14
“Perception of Agent’s Humanness Human-likeness human-like, natural, artificial, machine-like 20 [2][6][7][10][13][16][25][30][39][41][42][56][58][63][69] [70][77][85][86][94]”
BackgroundInfluentialVoice Assistant-Based Cognitive Behavioral Therapy for Test Anxiety in Students
Striegl, J., Loitsch, C., & Weber, G. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-35602-5_28 · Cited by 2
Metadata
- Authors
- Haas, G., Rietzler, M., Jones, M., & Rukzio, E.
- Venue
- CHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2022-04-29
- Pages
- 1-12
- OpenAlex
- W4225002609
- Cited by
- 38
- References
- 12
- FWCI
- 4.34
- Type
- conference paper
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Keep it Short: A Comparison of Voice Assistants’ Response Behavior. https://app.cochat.ai/papers/10.1145/3491102.3517684
- The paper
- Haas, G., Rietzler, M., Jones, M., & Rukzio, E. (2022). Keep it Short: A Comparison of Voice Assistants’ Response Behavior. CHI Conference on Human Factors in Computing Systems. https://doi.org/10.1145/3491102.3517684
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.