"Hey Alexa, What's Up?": A Mixed-Methods Studies of In-Home Conversational Agent Usage
The DOI matches its Crossref record; 27 of the 27 references it cites were found in a registry or an index.
Abstract
In-home, place-based, conversational agents have exploded in popularity over the past three years. In particular, Amazon's conversational agent, Alexa, now dominates the market and is in millions of homes. This paper presents two complementary studies investigating the experience of households living with a conversational agent over an extended period of time. First, we gathered the history logs of 75 Alexa participants and quantitatively analyzed over 278,000 commands. Second, we performed seven in-home, contextual interviews of Alexa owners focusing on how their household interacts with Alexa. Our findings give the first glimpse of how households integrate Alexa into their lives. We found interesting behaviors around purchasing and acclimating to Alexa, in the number and physical placement of devices, and in daily use patterns. Participants also uniformly described interactions between children and Alexa. We conclude with suggestions for future improvement for intelligent conversational agents.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The addition of conversational agents such as Alexa and wearable “smart” devices make it more challenging to disengage, and in one study, the bedroom was one of the most common places for placement of a conversational agent.236”
From Digital Ecosystems, Children, and Adolescents: Technical Report (2026) · cites this paper as [236]
In the citing paper
“there are also a number of concerns including deception, infantilization, and privacy [63,70].”
From "Phantom Friend" or "Just a Box with Information": Personification and Ontological Categorization of Smart Speaker-based Voice Assistants by Older Adults (2019) · cites this paper as [63]
In the citing paper
“Previous studies have explored that users of VUIs frequently use some basic functionalities (e.g., asking weather information, small talk, etc.) repeatedly while ignoring others [5,56].”
From “A Painless Way to Learn:” Designing an Interactive Storytelling Voice User Interface to Engage Older Adults in Informal Health Information Learning (2023) · cites this paper as [56]
Citations
Cites
On Estimation of a Probability Density Function and Mode
Parzen, E. (1962) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177704472 · Cited by 10,585
Participatory Design: Principles and Practices
(2017) · CRC Press eBooks · doi:10.1201/9780203744338 · Cited by 1,500
Charting past, present, and future research in ubiquitous computing
Abowd, G. D., & Mynatt, E. D. (2000) · ACM Transactions on Computer-Human Interaction · doi:10.1145/344949.344988 · Cited by 1,460
Trust In and Adoption of Online Recommendation Agents
University of British Columbia, C., Benbasat, I., Wang, W., & University of British Columbia, C. (2005) · Journal of the Association for Information Systems · doi:10.17705/1jais.00065 · Cited by 841
Embodiment in conversational interfaces: Rea
Cassell, J., Bickmore, T., Billinghurst, M., Campbell, L., Chang, K., Vilhjálmsson, H., & Yan, H. (1999) · Proceedings of the SIGCHI conference on Human factors in computing systems the CHI is the limit - CHI '99 · doi:10.1145/302979.303150 · Cited by 566 · cited 2×
“Other research on conversational agents in the lab and in the real world showed that these agents need to display both interactional and propositional aspects of conversation, and must support both task-oriented and social dialogue [7].”
BackgroundUser experience over time: an initial framework
Karapanos, E., Zimmerman, J., Forlizzi, J., & Martens, J.-B. (2009) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1518701.1518814 · Cited by 561 · cited 1×
“Many feel that Alexa and related devices have the potential to become an important part of many households [14,21].”
BackgroundSelf-citationAt Home with Ubiquitous Computing: Seven Challenges
Edwards, W. K., & Grinter, R. E. (2001) · Cited by 535
Survey on Chatbot Design Techniques in Speech Conversation Systems
A., S., & John, D. (2015) · International Journal of Advanced Computer Science and Applications · doi:10.14569/ijacsa.2015.060712 · Cited by 479 · cited 1×
“Therefore, they must be designed with particular strategies in mind [1,15].”
Background"Alexa is my new BFF": Social Roles, User Satisfaction, and Personification of the Amazon Echo
Purington, A., Taft, J. G., Sannon, S., Bazarova, N. N., & Taylor, S. H. (2017) · Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems · doi:10.1145/3027063.3053246 · Cited by 476 · cited 1×
“These activities were inspired by the generative activities used in participatory design [33].”
MethodA Conversational Agent as Museum Guide – Design and Evaluation of a Real-World Application
Kopp, S., Gesellensetter, L., Krämer, N. C., & Wachsmuth, I. (2005) · Lecture Notes in Computer Science · doi:10.1007/11550617_28 · Cited by 393 · cited 2×
“Meyer and Rakotonirainy summarized the main challenges for a successful intelligent home as: home installation, system management, novel applications, user experience, and privacy [22].”
Background
Research works printed but not linked: 6
- Bayan Abu Shawar and Eric Atwell . 2007 . Chatbots: are they really useful ? LDV Forum. Retrieved September 17, 2017 from https://www.researchgate.net/profile/Eric_Atwell/pub li cation/220046725_Chatbots_Are_they_Really_Useful / links/00b7d518ab7329add2000000/Chatbots-Arethey- Really-Useful.pdf Bayan Abu Shawar and Eric Atwell. 2007. Chatbots: are they really useful? LDV Forum. Retrieved September 17, 2017 from https://www.researchgate.net/profile/Eric_Atwell/pub li cation/220046725_Chatbots_Are_they_Really_Useful / links/00b7d518ab7329add2000000/Chatbots-Arethey- Really-Useful.pdf
- 10.5555/1018411.1018912 · doi:10.5555/1018411.1018912
- 10.1007/11550617_28 · DOI · Paper page
- Sven Meyer and Andry Rakontonirainy . 2003 . A survey of research on context-aware homes . Proceedings of the Australasian information security workshop conference on ACSW frontiers 2003 - Volume 21 , Australian Computer Society, 90. Retrieved September 13, 2017 from http://dl.acm.org/citation.cfm?id=828005 Sven Meyer and Andry Rakontonirainy. 2003. A survey of research on context-aware homes. Proceedings of the Australasian information security workshop conference on ACSW frontiers 2003 - Volume 21, Australian Computer Society, 90. Retrieved September 13, 2017 from http://dl.acm.org/citation.cfm?id=828005
- Gerard Oleksik , David Frohlich , Lorna M. Brown , and Abigail Sellen . 2008. Sonic interventions. Proceeding of the twenty-sixth annual CHI conference on Human factors in computing systems CHI '08 , ACM Press , 1419. Gerard Oleksik, David Frohlich, Lorna M. Brown, and Abigail Sellen. 2008. Sonic interventions. Proceeding of the twenty-sixth annual CHI conference on Human factors in computing systems CHI '08, ACM Press, 1419.
- David Powers , Richard Leibbrandt , Martin Luerssen , Trent Lewis , and Mike Lawson . 2008 . PETA. Proceedings of the 1st ACM international conference on PErvasive Technologies Related to Assistive Environments - PETRA '08 , ACM Press, 1. David Powers, Richard Leibbrandt, Martin Luerssen, Trent Lewis, and Mike Lawson. 2008. PETA. Proceedings of the 1st ACM international conference on PErvasive Technologies Related to Assistive Environments - PETRA '08, ACM Press, 1.
Cited by
Systematic Review: Trust-Building Factors and Implications for Conversational Agent Design
Rheu, M., Shin, J. Y., Peng, W., & Huh-Yoo, J. (2021) · International Journal of Human–Computer Interaction · doi:10.1080/10447318.2020.1807710 · Cited by 360
Communication Breakdowns Between Families and Alexa
Beneteau, E., Richards, O. K., Zhang, M., Kientz, J. A., Yip, J., & Hiniker, A. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300473 · Cited by 313
“In recent years, the field of HCI has begun to examine human communication with conversational agents, such as Siri, and with digital home assistants, such as the Amazon Echo [10,23,34,37].”
BackgroundPradhan, A., Findlater, L., & Lazar, A. (2019) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3359316 · Cited by 223
Kim, S., & Choudhury, A. (2021) · Computers in Human Behavior · doi:10.1016/j.chb.2021.106914 · Cited by 200
“First, the lack of a detailed understanding of how these technologies are used due to their novelty has led to investigating general patterns of using voice assistants in everyday contexts through a quantitative analysis of voice command data (Sciuto et al., 2018).”
BackgroundXu, Y., Wang, D., Collins, P., Lee, H., & Warschauer, M. (2021) · Computers & Education · doi:10.1016/j.compedu.2020.104059 · Cited by 175
“” ; Lovato, Piper, & Wartella, 2019) or commanded CAs to perform small tasks (e.g., “ Hey Alexa, play a Christmas song ” ; Sciuto, Saini, Forlizzi, & Hong, 2018).”
Ramadan, Z., F. Farah, M., & El Essrawi, L. (2021) · Psychology & Marketing · doi:10.1002/mar.21441 · Cited by 158
"Alexa is a Toy": Exploring Older Adults' Reasons for Using, Limiting, and Abandoning Echo
Trajkova, M., & Martin-Hammond, A. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376760 · Cited by 154
“Prior work has identified a need to better support exploration and discovery in IVAs [30,39,43].”
BackgroundInfluentialEffects of voice assistant recommendations on consumer behavior
Flavián, C., Akdim, K., & Casaló, L. V. (2023) · Psychology & Marketing · doi:10.1002/mar.21765 · Cited by 138
Parenting with Alexa: Exploring the Introduction of Smart Speakers on Family Dynamics
Beneteau, E., Boone, A., Wu, Y., Kientz, J. A., Yip, J., & Hiniker, A. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376344 · Cited by 140
He Is Just Like Me: A Study of the Long-Term Use of Smart Speakers by Parents and Children
Garg, R., & Sengupta, S. (2020) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3381002 · Cited by 138
Hey Google, Do Unicorns Exist?: Conversational Agents as a Path to Answers to Children's Questions
Lovato, S. B., Piper, A. M., & Wartella, E. A. (2019) · Proceedings of the 18th ACM International Conference on Interaction Design and Children · doi:10.1145/3311927.3323150 · Cited by 136
“Other studies on smart speaker use [35,36,39] only consider children tangentially, if at all.”
BackgroundSottoVoce: An Ultrasound Imaging-Based Silent Speech Interaction Using Deep Neural Networks
Kimura, N., Kono, M., & Rekimoto, J. (2019) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300376 · Cited by 158
“The effect of this agent on people has been researched extensively, and the results show that it is an effective agent for satisfying or influencing our lives [36, 45, 50].”
BackgroundCarolus, A., Augustin, Y., Markus, A., & Wienrich, C. (2023) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2022.100114 · Cited by 128
Re-Embodiment and Co-Embodiment: Exploration of social presence for robots and conversational agents
Luria, M., Reig, S., Tan, X. Z., Steinfeld, A., Forlizzi, J., & Zimmerman, J. (2019) · Proceedings of the 2019 on Designing Interactive Systems Conference · doi:10.1145/3322276.3322340 · Cited by 119
Self-citationDruga, S., & Ko, A. J. (2021) · Interaction Design and Children · doi:10.1145/3459990.3460712 · Cited by 108
“This approach has strong precedence in recent work on computing education with children, such as children’s computer programming in low-vision populations [70], supporting children as data scientists through Scratch programming [15], children’s development of spatial reasoning through programming [27], and the family…”
BackgroundCambre, J., & Kulkarni, C. (2019) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3359325 · Cited by 119
“Voice assistants currently take a largely “one size fits all” approach in which each instance of a given device takes on the same voice by default; indeed, the same voice is often used across devices powered by the same company’s assistant software (e.g. Alexa-enabled or Google Assistant-enabled devices).”
BackgroundInfluentialDesign Lessons From AI’s Two Grand Goals: Human Emulation and Useful Applications
Shneiderman, B. (2020) · IEEE Transactions on Technology and Society · doi:10.1109/tts.2020.2992669 · Cited by 114
“This success may suggest other opportunities [32], [53], but these devices are typically simple cylinders, but no human forms.”
BackgroundXu, Y., Aubele, J., Vigil, V., Bustamante, A. S., Kim, Y.-S., & Warschauer, M. (2022) · Child Development · doi:10.1111/cdev.13708 · Cited by 113
“Due to these products’ growing prevalence, the developmental consequences of children interacting with speech-based agents have spurred much research interest (e.g., Garg & Sengupta, 2020; Sciuto et al., 2018; Yuan et al., 2019).”
BackgroundPrivacy Norms for Smart Home Personal Assistants
Abdi, N., Zhan, X., Ramokapane, K. M., & Such, J. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445122 · Cited by 106
“SPAs are much more than just smart speakers: they have a complex architecture involving many diferent stakeholders [20, 25, 62].”
BackgroundUX Research on Conversational Human-AI Interaction: A Literature Review of the ACM Digital Library
Zheng, Q., Tang, Y., Liu, Y., Liu, W., & Huang, Y. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3501855 · Cited by 100
Cao, D., Sun, Y., Goh, E., Wang, R., & Kuiavska, K. (2021) · International Journal of Hospitality Management · doi:10.1016/j.ijhm.2021.103124 · Cited by 117
Voice assistants and older people: some open issues
Sayago, S., Neves, B. B., & Cowan, B. R. (2019) · Proceedings of the 1st International Conference on Conversational User Interfaces · doi:10.1145/3342775.3342803 · Cited by 97
McStay, A., & Rosner, G. (2021) · Big Data & Society · doi:10.1177/2053951721994877 · Cited by 90
“…is a reasonable assertion given human–computer interface research on Amazon’s Alexa that finds ‘young children are highly influenced by the spoken nature of conversational agents, respond to the agents at a very young age, and imbue the agent with human-like qualities’ (Sciuto et al., 2018: 866).”
BackgroundOnce a Kind Friend is Now a Thing: Understanding How Conversational Agents at Home are Forgotten
Cho, M., Lee, S.-S., & Lee, K.-P. (2019) · Proceedings of the 2019 on Designing Interactive Systems Conference · doi:10.1145/3322276.3322332 · Cited by 90
Exploring young children's engagement in joint reading with a conversational agent
Xu, Y., & Warschauer, M. (2020) · Proceedings of the Interaction Design and Children Conference · doi:10.1145/3392063.3394417 · Cited by 74
What Are You Talking To?: Understanding Children's Perceptions of Conversational Agents
Xu, Y., & Warschauer, M. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376416 · Cited by 71
“These three sessions mirrored the common interaction experiences a child typically would have with CAs in their everyday lives [11, 46].”
BackgroundConversational Affective Social Robots for Ageing and Dementia Support
Lima, M. R., Wairagkar, M., Gupta, M., Rodriguez y Baena, F., Barnaghi, P., Sharp, D. J., & Vaidyanathan, R. (2022) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2021.3115228 · Cited by 75
Eyecam: Revealing Relations between Humans and Sensing Devices through an Anthropomorphic Webcam
Teyssier, M., Koelle, M., Strohmeier, P., Fruchard, B., & Steimle, J. (2021) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445491 · Cited by 84
“They allow for object detection and recognition [55], natural interactions using speech [83], hand or body gestures [103], and for creating interactive rooms [40, 108], surfaces [100, 107] to furniture [92] and garments [34].”
BackgroundCha, N., Kim, A., Park, C. Y., Kang, S., Park, M., Lee, J.-G., Lee, S., & Lee, U. (2020) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3411810 · Cited by 74
“Conversational management can leverage prior studies on identifying conversation breakdowns and devising repair strategies in diverse domestic settings [8, 48], or analyzing conversational log data to understand interaction patterns for context adaptation and personalization [9, 54].”
BackgroundThe Last Decade of HCI Research on Children and Voice-based Conversational Agents
Garg, R., Cui, H., Seligson, S., Zhang, B., Porcheron, M., Clark, L., Cowan, B. R., & Beneteau, E. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3502016 · Cited by 70
Voice Assistants and Artificial Intelligence in Education
Terzopoulos, G., & Satratzemi, M. (2019) · Proceedings of the 9th Balkan Conference on Informatics · doi:10.1145/3351556.3351588 · Cited by 70
Garg, R., & Sengupta, S. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376631 · Cited by 68
Social Boundaries for Personal Agents in the Interpersonal Space of the Home
Luria, M., Zheng, R., Huffman, B., Huang, S., Zimmerman, J., & Forlizzi, J. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376311 · Cited by 66
Self-citationUser Experience with Smart Voice Assistants: The Accent Perspective
Pal, D., Arpnikanondt, C., Funilkul, S., & Varadarajan, V. (2019) · 2019 10th International Conference on Computing, Communication and Networking Technologies (ICCCNT) · doi:10.1109/icccnt45670.2019.8944754 · Cited by 60
“The current evaluation of the VA’s focus on three main aspects: the usage experiences [3-5], performance expectations [7-8], and the privacy concerns [9-10].”
BackgroundCha, I., Kim, S. I., Hong, H., Yoo, H., & Lim, Y.-K. (2021) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445116 · Cited by 86
“, voice interface, graphic interface) to articulate their emotions [43, 61, 62, 66].”
BackgroundFesterling, J., & Siraj, I. (2022) · Integrative Psychological and Behavioral Science · doi:10.1007/s12124-021-09668-y · Cited by 64
“…Assistants (DVAs) like Amazon’s ‘Alexa’, Apple’s ‘Siri’, or Google’s ‘Google Assistant’ (Ammari et al., 2019; Beirl et al., 2019; Porcheron et al., 2018; Sciuto et al., 2018; Voit et al., 2020; Yuan et al., 2019; Beneteau et al., 2019; Festerling & Siraj, 2020; Gao et al., 2018; Garg &…”
Mixed-Method Long-Term Robot Usage: Older Adults' Lived Experience of Social Robots
Ostrowski, A. K., Breazeal, C., & Park, H. W. (2022) · ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.1109/hri53351.2022.9889488 · Cited by 86
“Scuito et al. [5] and Garg & Sengupta [8] also incorporate qualitative interview methods into their quantitative analysis of usage logs to provide deeper perspectives on participants’ usage of these devices, and the same trend should be further adopted for HRI investigations.”
BackgroundMethodResultInfluentialVirtual Home Assistant Use and Perceptions of Usefulness by Older Adults and Support Person Dyads
F. Corbett, C., M. Combs, E., J. Wright, P., L. Owens, O., Stringfellow, I., Nguyen, T., & Van Son, C. R. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph18031113 · Cited by 56
Choi, D., Kwak, D., Cho, M., & Lee, S. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376569 · Cited by 54
Shin, J. Y., Rheu, M., Huh, J., & Peng, W. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3479585 · Cited by 71
“those under 10 years old, use the systems with lower thresholds, such as a voice-based user interface, more frequently and effectively [11, 12, 115].”
BackgroundExperiential Qualities of Whispering with Voice Assistants
Parviainen, E., & Søndergaard, M. L. J. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376187 · Cited by 52
“Research has shown that the use of voice assistants is often initiated with excitement and exploration, after which the limitations slowly come across and a few use cases turn into routines [48].”
BackgroundInfluentialHsu, W.-C., & Lee, M.-H. (2023) · Journal of Global Information Management · doi:10.4018/jgim.318661 · Cited by 62
“Previous studies have reported that people use VAs mainly to seek information and make purchases, and for entertainment purposes (e.g., listening to music) (McLean & Osei-Frimpong, 2019; Purington et al., 2017; Rzepka, 2019; Sciuto et al., 2018).”
BackgroundUnderstanding Motivators, Constraints, and Practices of Sharing Internet of Things
Garg, R., & Moreno, C. (2019) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3328915 · Cited by 61
It Takes a Village: Integrating an Adaptive Chatbot into an Online Gaming Community
Seering, J., Luria, M., Ye, C., Kaufman, G., & Hammer, J. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376708 · Cited by 49
“Prior work has shown that users often push social boundaries in their first interactions as a way of learning about the agent’s personality and functionalities [7, 29].”
BackgroundResultResisting Racism in Tech Design: Centering the Experiences of Black Youth
Rankin, Y. A., & Henderson, K. K. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3449291 · Cited by 50
“, "Alexa, what color is the crayon?") [66].”
BackgroundMethodResultInfluentialThe Role of Conversational Grounding in Supporting Symbiosis Between People and Digital Assistants
Cho, J., & Rader, E. (2020) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3392838 · Cited by 49
“Moreover, users had trouble knowing what their digital assistant was supposed to be capable of doing [31], and found it di cult to discover features through trial and error that they were not already familiar with [50].”
BackgroundInfluentialChubb, J., Missaoui, S., Concannon, S. J., Maloney, L., & Walker, J. A. (2021) · International Journal of Child-Computer Interaction · doi:10.1016/j.ijcci.2021.100403 · Cited by 72
Festerling, J., & Siraj, I. (2020) · Human Development · doi:10.1159/000508499 · Cited by 60
Lee, S., Kim, S., & Lee, S. (2019) · Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290607.3312796 · Cited by 45
“Sciuto et al. [14] conducted a qualitative analysis of interviews to find the interaction pattern of how households integrate Alexa into their daily lives.”
BackgroundWei, J., Tag, B., Trippas, J. R., Dingler, T., & Kostakos, V. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3517432 · Cited by 46
“Another possibility is that after experiencing some recognition errors, some participants only gave answers that they considered were more easily recognized [9, 63] to avoid errors beforehand, but such behaviors may not be refected in our short-term study.”
BackgroundOranç, C., & Ruggeri, A. (2021) · Human Behavior and Emerging Technologies · doi:10.1002/hbe2.270 · Cited by 52
“…observed that preschoolers often ask such questions to VAs at home, and they attributed this tendency to young children's developing theory of mind skills, or more generally, to their difficulty in understanding what one can and cannot know and answer (Lovato & Piper, 2019; Sciuto et al., 2018).”
BackgroundBalaji, D., He, L., Giani, S., Bosse, T., Wiers, R., & de Bruijn, G.-J. (2022) · Sexual Health · doi:10.1071/sh22016 · Cited by 44
The Evolution of Marketing in the Context of Voice Commerce: A Managerial Perspective
Mari, A., Mandelli, A., & Algesheimer, R. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-50341-3_32 · Cited by 62
Personal Information Disclosure via Voice Assistants: The Personalization–Privacy Paradox
Pal, D., Arpnikanondt, C., & Razzaque, M. A. (2020) · SN Computer Science · doi:10.1007/s42979-020-00287-9 · Cited by 61
Garg, R., & Sengupta, S. (2019) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3359165 · Cited by 43
Investigating User Expectations on the Roles of Family-shared AI Speakers
Park, S., & Lim, Y.-K. (2020) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376450 · Cited by 54
“Recent studies on user experiences and their perceptions about IPAs revealed that the presence of other people can impact users’ interaction styles [8, 19, 28].”
BackgroundInfluentialMetaphors in Voice User Interfaces: A Slippery Fish
Desai, S., & Twidale, M. (2023) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3609326 · Cited by 42
“Instead, the question is if the VUI adds to the joy of life [ 93 , 142 , 162 ].”
BackgroundInfluentialHealthcare Voice AI Assistants: Factors Influencing Trust and Intention to Use
Zhan, X., Abdi, N., Seymour, W., & Such, J. (2024) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3637339 · Cited by 46
“Popular because of the hands-free, convenient experience they offer, voice assistants are mainly used to play music, search for information, and control smart IoT devices in the home [10, 47, 160].”
BackgroundGenie in the Bottle: Anthropomorphized Perceptions of Conversational Agents
Kuzminykh, A., Sun, J., Govindaraju, N., Avery, J., & Lank, E. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376665 · Cited by 41
Cambre, J., Reig, S., Kravitz, Q., & Kulkarni, C. E. (2020) · Designing Interactive Systems Conference · doi:10.1145/3357236.3395479 · Cited by 45
“For example, analysis of log data suggest that households use assistants most often for a relatively small set of tasks: entertainment (e.g., playing music, telling a joke), hands-free support (e.g., setting a timer), and controlling IoT devices [2,47].”
MethodDesigning Home Automation Routines Using an LLM-Based Chatbot
Giudici, M., Padalino, L., Paolino, G., Paratici, I., Pascu, A. I., & Garzotto, F. (2024) · Designs · doi:10.3390/designs8030043 · Cited by 40
Sezgin, E., Noritz, G., Elek, A., Conkol, K., Rust, S., Bailey, M., Strouse, R., Chandawarkar, A., von Sadovszky, V., Lin, S., et al. (2020) · Journal of Medical Internet Research · doi:10.2196/14202 · Cited by 40
Firefox Voice: An Open and Extensible Voice Assistant Built Upon the Web
Cambre, J., Williams, A. C., Razi, A., Bicking, I., Wallin, A., Tsai, J., Kulkarni, C., & Kaye, J. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445409 · Cited by 39
Automation, wellbeing and Digital Voice Assistants: Older people and Google devices
Duque, M., Pink, S., Strengers, Y., Martin, R., & Nicholls, L. (2021) · Convergence The International Journal of Research into New Media Technologies · doi:10.1177/13548565211038537 · Cited by 41
“DVAs and their algorithms have been extensively researched to understand how they affect interactions between their users (Sciuto et al., 2018), perpetuate gendered and racial stereotypes (Noble, 2018; Phan, 2019; Strengers and Kennedy, 2020) or facilitate new socio-technical experiences or…”
BackgroundMethodResultInfluentialLipLearner: Customizable Silent Speech Interactions on Mobile Devices
Su, Z., Fang, S., & Rekimoto, J. (2023) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581465 · Cited by 47
He, T., Jazizadeh, F., & Arpan, L. M. (2021) · Building Research & Information · doi:10.1080/09613218.2021.2012119 · Cited by 52
“For instance, previous research indicates that the command frequency in user interactions with SHAs was associated with the ownership period and the number of smart home devices a user has (Sciuto et al., 2018).”
ResultDesai, S., & Chin, J. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581507 · Cited by 38
“[98] placed smart speakers in users’ homes and found that users tried to learn music and language using”
BackgroundBigBlueBot: teaching strategies for successful human-agent interactions
Weisz, J. D., Jain, M., Joshi, N. N., Johnson, J., & Lange, I. (2019) · Proceedings of the 24th International Conference on Intelligent User Interfaces · doi:10.1145/3301275.3302290 · Cited by 38
“In other studies of conversational systems, people expressed apprehension toward future use due to uncertainties of the chatbot’s capabilities and issues with intent classification [18, 22, 25, 34].”
BackgroundLee, S., Lee, M., & Lee, S. (2022) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2022.2080155 · Cited by 49
“However, in previous studies, the design direction of AI was often limited to a smart home environment (Cook et al., 2003; Luria et al., 2020; Porcheron et al., 2018; Sciuto et al., 2018), then interactions in public spaces or society have been less explored.”
BackgroundResultEmbracing Companion Technologies
Niess, J., & Woźniak, P. W. (2020) · Nordic Conference on Human-Computer Interaction · doi:10.1145/3419249.3420134 · Cited by 44
"All in the Same Boat": Tradeoffs of Voice Assistant Ownership for Mixed-Visual-Ability Families
Storer, K. M., Judge, T. K., & Branham, S. M. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376225 · Cited by 35
Voice Agents Supporting High-Quality Social Play
Pantoja, L. S., Diederich, K., Crawford, L., & Hourcade, J. P. (2019) · Proceedings of the 18th ACM International Conference on Interaction Design and Children · doi:10.1145/3311927.3323151 · Cited by 35
DAPIE: Interactive Step-by-Step Explanatory Dialogues to Answer Children’s Why and How Questions
Lee, Y., Kim, T. S., Kim, S., Yun, Y., & Kim, J. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581369 · Cited by 35
“For example, CAs’ speech recognition frequently misinterprets or fails to understand children’s speech [38] which leads to breakdowns in conversation [74].”
BackgroundA Systematic Review of Ethical Concerns with Voice Assistants
Seymour, W., Zhan, X., Coté, M., & Such, J. M. (2023) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1145/3600211.3604679 · Cited by 68
“This was frequently frustrating for children [87, 122], and was made worse when they tried unsuccessfully to seek help [39], or found that the VA could not correctly pronounce their name [122].”
BackgroundInfluentialLima, M. R. D., Su, T., Jouaiti, M., Wairagkar, M., Malhotra, P., Soreq, E., Barnaghi, P. M., & Vaidyanathan, R. (2023) · IEEE Internet of Things Journal · doi:10.1109/jiot.2023.3290833 · Cited by 47
“Qualitative studies have revealed initial insights into user experience with voice technology, patterns of daily use, and why interest is oftentimes lost after the novelty effect [31], [32], [33].”
BackgroundExploring the Design Space of User-System Communication for Smart-home Routine Assistants
Chiang, Y.-S., Chang, R.-C., Chuang, Y.-L., Chou, S.-Y., Lee, H.-P., Lin, I.-J., Chen, J.-H. J., & Chang, Y.-J. (2020) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376501 · Cited by 40
“The home appliances in the scenarios included a television (TV), an air conditioner (AC), a light, and a fan, which are popular devices for smart homes to control [57, 60].”
BackgroundCho, E., Motalebi, N., Sundar, S. S., & Abdullah, S. (2022) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3555164 · Cited by 50
“, reluctance to rely on Alexa for important reminders) [64], as opposed to children, who are more prone to personify and emotionally associate with smart speakers [24, 73].”
BackgroundMajor, D., Huang, D. Y., Chetty, M., & Feamster, N. (2021) · ACM Transactions on Internet Technology · doi:10.1145/3446389 · Cited by 52
“Past work has also found that interactions with VUIs were integrated with activities or conversations involving the entire household, including children [6, 7].”
BackgroundThe Effect of Audiences on the User Experience with Conversational Interfaces in Physical Spaces
Candello, H., Pinhanez, C., Pichiliani, M., Cavalin, P., Figueiredo, F., Vasconcelos, M., & Do Carmo, H. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300320 · Cited by 33
Ortega, A. G., Bourgeois, J., & Kortuem, G. (2023) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581164 · Cited by 44
“Thus, speech records allow for a detailed picture of voice assistant users and their routine activities [11, 47, 54].”
BackgroundLong-Term Value of Social Robots through the Eyes of Expert Users
Dereshev, D., Kirk, D., Matsumura, K., & Maeda, T. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300896 · Cited by 31
“A 2018 study of Alexa users (75 logs analysed + 7 household interviews, all post-acceptance) [52] revealed that after the initial "novelty" stage, there was a stable continuous pattern of use, with multiple devices in a variety of rooms, integrated into everyday routines.”
Background‘It’s not a romantic relationship’: Stories of Adoption and Abandonment of Smart Speakers at Home
Voit, A., Niess, J., Eckerth, C., Ernst, M., Weingärtner, H., & Woźniak, P. W. (2020) · International Conference on Mobile and Ubiquitous Multimedia (MUM) · doi:10.1145/3428361.3428469 · Cited by 40
“This confirms the results by Sciuto et al. [46] who analyzed history logs of smart speaker users and found that their users bought additional smart home products that are compatible to their smart speaker system to be able to use more of the functionality spectrum of their smart speakers.”
InfluentialWienrich, C., Carolus, A., Markus, A., Augustin, Y., Pfister, J., & Hotho, A. (2023) · Computers · doi:10.3390/computers12040077 · Cited by 39
Differences in Interactions with a Conversational Agent
Oh, Y. H., Chung, K., & Ju, D. Y. (2020) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph17093189 · Cited by 28
“Their usage pattern was consistent with previous studies: checking the weather in the morning [11,22,24] and setting alarms before sleep [11].”
BackgroundResultInfluentialChin, J., Desai, S., Lin, S. (.-H., & Mejia, S. (2024) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3637365 · Cited by 27
ParaGlassMenu: Towards Social-Friendly Subtle Interactions in Conversations
Cai, R., Janaka, N. N. P. K., Zhao, S., & Sun, M. (2023) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581065 · Cited by 35
Voice Commerce: Understanding Shopping-Related Voice Assistants and their Effect on Brands
Mari, A. (2019) · Zurich Open Repository and Archive (University of Zurich) · doi:10.5167/uzh-197725 · Cited by 53
Understanding the Needs and Challenges of Using Conversational Agents for Deaf Older Adults
Blair, J., & Abdullah, S. (2019) · Companion Publication of the 2019 Conference on Computer Supported Cooperative Work and Social Computing · doi:10.1145/3311957.3359487 · Cited by 23
“Participants primarily used phone-based CAs for tasks shown in prior work to be common across general users [3, 16], such as web searches, GPS, weather, reminders, games, and calendar events.”
BackgroundMethodDesai, S., Lundy, M., & Chin, J. (2023) · Proceedings of the 5th International Conference on Conversational User Interfaces · doi:10.1145/3571884.3597141 · Cited by 25
“Users mainly use VUIs for asking information, playing games, home automation, and small talk [5, 56].”
BackgroundRobotic Futures: Learning about Personally-Owned Agents through Performance
Luria, M., Choi, J. O., Karp, R. G., Zimmerman, J., & Forlizzi, J. (2020) · Designing Interactive Systems Conference · doi:10.1145/3357236.3395488 · Cited by 32
“Since then, much research has looked into how people interact with conversational agents, how they are perceived, and how they influence people’s lives [52, 48, 18].”
BackgroundSelf-citationMeasuring Alexa Skill Privacy Practices across Three Years
Edu, J., Ferrer, X., Such, J. M., & Suárez‐Tangil, G. (2022) · International World Wide Web Conference (WWW) · doi:10.1145/3485447.3512289 · Cited by 35
Karkera, Y., Tandukar, B., Chandra, S., & Martin-Hammond, A. M. (2023) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581561 · Cited by 32
Wenzel, K., Devireddy, N., Davison, C., & Kaufman, G. F. (2023) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581357 · Cited by 51
“The prompts were selected based on prominent VA user habits, as reported by a 2019 Adobe survey of over 1,000 users [2] and system logs of voice assistant users’ commands [87].”
MethodSadek, M., Calvo, R. A., & Mougenot, C. (2023) · ACM Conference on Conversational User Interfaces (CUI) · doi:10.1145/3571884.3597143 · Cited by 37
“In terms of users, interview studies have looked at which CA use cases are seen as useful or enjoyable , what people value in conversations [14], how CAs are used in homes [46], and people’s preferences for error responses [60].”
BackgroundBeyond data transactions: a framework for meaningfully informed data donation
Ortega, A. G., Bourgeois, J., Toussaint, W., & Kortuem, G. (2023) · AI & Society · doi:10.1007/s00146-023-01755-5 · Cited by 39
“Users of voice assistants integrate these devices into various tasks and activities throughout the day, including managing smart appliances, getting ready for bed, and cooking (Bentley et al. 2018; Sciuto et al. 2018).”
Blair, J., & Abdullah, S. (2020) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3432194 · Cited by 35
“Users typically show a high-use period of excitement when first introduced to the device, which typically levels out as users learn the device’s limits and they become part of daily routines [37].”
BackgroundKlein, A. M., Deutschländer, J., Kölln, K., Rauschenberger, M., & Escalona, M. J. (2023) · Journal of Software Evolution and Process · doi:10.1002/smr.2618 · Cited by 29
“19 Although they are integrated into every-day life (e.g., Mobile via smartphones and At home via smart speakers), challenges such as data security and privacy concerns, 20 voice command recognition, 4,21 context-sensitivity, 9,22 and human-like conversation 5 remain difficult.”
‘ShishuShurokkha’: A Transformative Justice Approach for Combating Child Sexual Abuse in Bangladesh
Sultana, S., Pritha, S. T., Tasnim, R., Das, A., Akter, R., Hasan, S., Alam, S. M. R., Kabir, M. A., & Ahmed, S. I. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3517543 · Cited by 32
Confidant: A Privacy Controller for Social Robots
Tang, B., Sullivan, D., Çağıltay, B., Chandrasekaran, V., Fawaz, K., & Mutlu, B. (2022) · ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.1109/hri53351.2022.9889540 · Cited by 38
Vitro: Designing a Voice Assistant for the Scientific Lab Workplace
Cambre, J., Liu, Y., Taylor, R. E., & Kulkarni, C. E. (2019) · Designing Interactive Systems Conference · doi:10.1145/3322276.3322298 · Cited by 30
“These systems promise boundless convenience, particularly within “hands-busy, eyes-busy” situations [48]: with a simple voice command, users can, in theory, control home lighting systems, check the weather, buy goods, and so on [47, 45, 26].”
Background
Metadata
- Authors
- Sciuto, A., Saini, A., Forlizzi, J., & Hong, J. I.
- Affiliations
- Carnegie Mellon University (US)
- Venue
- Proceedings of the 2018 Designing Interactive Systems Conference
- Publisher
- ACM
- Published
- 2018-06-08
- Pages
- 857-868
- OpenAlex
- W2808135558
- Cited by
- 327
- References
- 27
- Citations by year
- 2026: 15 · 2025: 31 · 2024: 33 · 2023: 42 · 2022: 45 · 2021: 54 · 2020: 66 · 2019: 40 · 2018: 1
- FWCI
- 16.37
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- Designing Interactive Systems Conference (publishedVersion)
- Topics
- Social Sciences › Business, Management and Accounting › Marketing › AI in Service Interactions
- Physical Sciences › Computer Science › Human-Computer Interaction › Innovative Human-Technology Interaction
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Keywords
- Amazon Alexa, chatbots, household technology use, device placement
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.