Music, Search, and IoT: How People (Really) Use Voice Assistants
The DOI matches its Crossref record; 62 of the 62 references it cites were found in a registry or an index.
Abstract
Voice has become a widespread and commercially viable interaction mechanism with the introduction of voice assistants (VAs), such as Amazon’s Alexa, Apple’s Siri, Google Assistant, and Microsoft’s Cortana. Despite their prevalence, we do not have a detailed understanding of how these technologies are used in domestic spaces. To understand how people use VAs, we conducted interviews with 19 users, and analyzed the log files of 82 Amazon Alexa devices, totaling 193,665 commands, and 88 Google Home Devices, totaling 65,499 commands. In our analysis, we identified music, search, and IoT usage as the command categories most used by VA users. We explored how VAs are used in the home, investigated the role of VAs as scaffolding for Internet of Things device control, and characterized emergent issues of privacy for VA users. We conclude with implications for the design of VAs and for future research studies of VAs.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Research ston VA use suggests that older adults' VA use resembles general use by all populations [1] such as listening to music, searching for general and health information, engaging in casual conversations, checking the date, time, or weather, and setting reminders [10,11,23,25,32].”
From Studying Exploration & Long-Term Use of Voice Assistants by Older Adults (2023) · cites this paper as [1]
In the citing paper
“Past research reports that older adults use voice assistants for checking the date, time, or weather; playing music; and searching for general information [11,23,32], similar to how younger adults use voice assistants [1].”
From Studying Exploration & Long-Term Use of Voice Assistants by Older Adults (2023) · cites this paper as [1]
Citations
Cites
Term-weighting approaches in automatic text retrieval
Salton, G., & Buckley, C. (1988) · Information Processing & Management · doi:10.1016/0306-4573(88)90021-0 · Cited by 9,740
Privacy in Context: Technology, Policy, and the Integrity of Social Life
Nissenbaum, H. (2009) · doi:10.1515/9780804772891 · Cited by 2,129 · cited 1×
“Relatedly, the theory of privacy as contextual inquiry stipulates that privacy needs change according to the social context [42].”
BackgroundLuger, E., & Sellen, A. (2016) · Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858288 · Cited by 1,176
Unpacking "privacy" for a networked world
Palen, L., & Dourish, P. (2003) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/642611.642635 · Cited by 965
Voice Interfaces in Everyday Life
Porcheron, M., Fischer, J. E., Reeves, S., & Sharples, S. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3174214 · Cited by 717 · cited 2×
“[47] conducted a month-long study analyzing the use of Amazon Alexa logs and an audio recorder.”
BackgroundCan computer personalities be human personalities?
Nass, C., Moon, Y., Fogg, B. J., Reeves, B., & Dryer, D. C. (1995) · International Journal of Human-Computer Studies · doi:10.1006/ijhc.1995.1042 · Cited by 615
An architecture for privacy-sensitive ubiquitous computing
Hong, J. I., & Landay, J. A. (2004) · Proceedings of the 2nd international conference on Mobile systems, applications, and services · doi:10.1145/990064.990087 · Cited by 598
Spoken dialogue technology: enabling the conversational user interface
McTear, M. F. (2002) · ACM Computing Surveys · doi:10.1145/505282.505285 · Cited by 571
Lau, J., Zimmerman, B., & Schaub, F. (2018) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3274371 · Cited by 568
McTear, M. F. (2004) · Springer eBooks · doi:10.1007/978-0-85729-414-2 · Cited by 566
Making by making strange: Defamiliarization and the design of domestic technologies
Bell, G., Blythe, M., & Sengers, P. (2005) · ACM Transactions on Computer-Human Interaction · doi:10.1145/1067860.1067862 · Cited by 479
"Alexa is my new BFF": Social Roles, User Satisfaction, and Personification of the Amazon Echo
Purington, A., Taft, J. G., Sannon, S., Bazarova, N. N., & Taylor, S. H. (2017) · Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems · doi:10.1145/3027063.3053246 · Cited by 476
Home automation in the wild: challenges and opportunities
Brush, A. J. B., Lee, B., Mahajan, R., Agarwal, S., Saroiu, S., & Dixon, C. (2011) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1978942.1979249 · Cited by 468
Yesterday’s tomorrows: notes on ubiquitous computing’s dominant vision
Bell, G., & Dourish, P. (2007) · Personal and Ubiquitous Computing · doi:10.1007/s00779-006-0071-x · Cited by 463
Privacy in Context: Technology, Policy, and the Integrity of Social Life
Han, S. (2011) · Journal of Information Policy · doi:10.5325/jinfopoli.1.2011.0149 · Cited by 462
Pradhan, A., Mehta, K., & Findlater, L. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3174033 · Cited by 448
Designing a home of the future
Intille, S. S. (2002) · IEEE Pervasive Computing · doi:10.1109/mprv.2002.1012340 · Cited by 374
Domestic Routines and Design for the Home
Crabtree, A., & Rodden, T. (2004) · Computer Supported Cooperative Work (CSCW) · doi:10.1023/b:cosu.0000045712.26840.a4 · Cited by 310
Brooks, R. A. (2002) · Proceedings Second International Conference on Cognitive Technology Humanizing the Information Age · doi:10.1109/ct.1997.617707 · Cited by 243
Kientz, J. A., Patel, S. N., Jones, B., Price, E., Mynatt, E. D., & Abowd, G. D. (2008) · CHI '08 Extended Abstracts on Human Factors in Computing Systems · doi:10.1145/1358628.1358911 · Cited by 221
Toys that Listen: A Study of Parents, Children, and Internet-Connected Toys
McReynolds, E., Hubbard, S., Lau, T., Saraf, A., Cakmak, M., & Roesner, F. (2017) · Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3025453.3025735 · Cited by 221
The Internet of Things Has a Gateway Problem
Zachariah, T., Klugman, N., Campbell, B., Adkins, J., Jackson, N., & Dutta, P. (2015) · Proceedings of the 16th International Workshop on Mobile Computing Systems and Applications · doi:10.1145/2699343.2699344 · Cited by 219
Exploring Privacy Concerns about Personal Sensing
Klasnja, P., Consolvo, S., Choudhury, T., Beckwith, R., & Hightower, J. (2009) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-01516-8_13 · Cited by 172
Mennicken, S., & Huang, E. M. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-31205-2_10 · Cited by 169
Ammari, T., Kumar, P., Lampe, C., & Schoenebeck, S. (2015) · Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems · doi:10.1145/2702123.2702325 · Cited by 165
Self-citationWho's viewed you?: the impact of feedback in a mobile location-sharing application
Tsai, J. Y., Kelley, P., Drielsma, P., Cranor, L. F., Hong, J., & Sadeh, N. (2009) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1518701.1519005 · Cited by 163
Self-citationUnderstanding User Satisfaction with Intelligent Assistants
Kiseleva, J., Williams, K., Jiang, J., Hassan Awadallah, A., Crook, A. C., Zitouni, I., & Anastasakos, T. (2016) · Proceedings of the 2016 ACM on Conference on Human Information Interaction and Retrieval · doi:10.1145/2854946.2854961 · Cited by 150
Your Voice Assistant is Mine: How to Abuse Speakers to Steal Information and Control Your Phone
Diao, W., Liu, X., Zhou, Z., & Zhang, K. (2014) · Proceedings of the 4th ACM Workshop on Security and Privacy in Smartphones & Mobile Devices · doi:10.1145/2666620.2666623 · Cited by 146
Managing Expectations: Technology Tensions among Parents and Teens
Blackwell, L., Gardiner, E., & Schoenebeck, S. (2016) · Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work & Social Computing · doi:10.1145/2818048.2819928 · Cited by 141
Shechtman, N., & Horowitz, L. M. (2003) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/642611.642661 · Cited by 139
Designing Technology for Domestic Spaces: A Kitchen Manifesto
Bell, G., & Kaye, J. (2002) · Gastronomica The Journal of Food and Culture · doi:10.1525/gfc.2002.2.2.46 · Cited by 137
Self-citation(2017) · doi:10.1145/2998181.2998298 · Cited by 131
Making the home network at home: Digital housekeeping
Tolmie, P., Crabtree, A., Rodden, T. A., Greenhalgh, C., & Benford, S. (2007) · Springer eBooks · doi:10.1007/978-1-84800-031-5_18 · Cited by 127
Long-term effects of ubiquitous surveillance in the home
Oulasvirta, A., Pihlajamaa, A., Perkiö, J., Ray, D., Vähäkangas, T., Hasu, T., Vainio, N., & Myllymäki, P. (2012) · Proceedings of the 2012 ACM Conference on Ubiquitous Computing · doi:10.1145/2370216.2370224 · Cited by 124
"Siri, is this you?": Understanding young children's interactions with voice input systems
Lovato, S., & Piper, A. M. (2015) · Proceedings of the 14th International Conference on Interaction Design and Children · doi:10.1145/2771839.2771910 · Cited by 118 · cited 2×
“We found existing research characterizing use of voice assistants at scale was based on self-reported surveys [28, 49], content analysis of user reviews online [49, 50], and interviews [30] 1 .”
BackgroundMethodMore than meets the eye: transforming the user experience of home network management
Poole, E. S., Chetty, M., Grinter, R. E., & Edwards, W. K. (2008) · Proceedings of the 7th ACM conference on Designing interactive systems · doi:10.1145/1394445.1394494 · Cited by 104
Bentley, F. R., Daskalova, N., & White, B. (2017) · Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems · doi:10.1145/3027063.3053335 · Cited by 91 · cited 1×
“[8] has shown that using samples of participants from Mechanical Turk can be reliable in understanding technology use when compared to large-scale professional market research surveys or the analysis of usage logs held by large corporations.”
Self-citationA large scale study of text-messaging use
Battestini, A., Setlur, V., & Sohn, T. (2010) · Proceedings of the 12th international conference on Human computer interaction with mobile devices and services · doi:10.1145/1851600.1851638 · Cited by 90
An informed view on consent for UbiComp
Luger, E., & Rodden, T. (2013) · Proceedings of the 2013 ACM international joint conference on Pervasive and ubiquitous computing · doi:10.1145/2493432.2493446 · Cited by 85
"Okay, One More Episode": An Ethnography of Parenting in the Digital Age
Mazmanian, M., & Lanette, S. (2017) · Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing · doi:10.1145/2998181.2998218 · Cited by 78
Numbers Have Qualities Too: Experiences with Ethno‐Mining
Anderson, K., Nafus, D., Rattenbury, T., et al. (2009) · Ethnographic Praxis in Industry Conference Proceedings · doi:10.1111/j.1559-8918.2009.tb00133.x · Cited by 76
The home needs an operating system (and an app store)
Dixon, C., Mahajan, R., Agarwal, S., et al. (2010) · doi:10.1145/1868447.1868465 · Cited by 72
Why doesn't it work?: voice-driven interfaces and young children's communication repair strategies
Cheng, Y., Yen, K., Chen, Y., Chen, S., & Hiniker, A. (2018) · Proceedings of the 17th ACM Conference on Interaction Design and Children · doi:10.1145/3202185.3202749 · Cited by 69
User Modeling for a Personal Assistant
Guha, R. V., Gupta, V., Raghunathan, V., et al. (2015) · ACM International Conference on Web Search and Data Mining (WSDM) · doi:10.1145/2684822.2685309 · Cited by 64
Digital plumbing: the mundane work of deploying UbiComp in the home
Tolmie, P., Crabtree, A., Rennick‐Egglestone, S., Humble, J., Greenhalgh, C., & Rodden, T. A. (2009) · Personal and Ubiquitous Computing · doi:10.1007/s00779-009-0260-5 · Cited by 59
A Day in the Life of Things in the Home
Crabtree, A., & Tolmie, P. (2016) · ACM Conference on Computer Supported Cooperative Work (CSCW) · doi:10.1145/2818048.2819954 · Cited by 57
Conversational agent use in a café
Porcheron, M. (2016) · Nottingham ePrints (University of Nottingham) · doi:10.17639/nott.61 · Cited by 56
Can People Self-Report Security Accurately? Agreement Between Self-Report and Behavioral Measures
Wash, R., Rader, E. J., & Fennell, C. (2017) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3025453.3025911 · Cited by 55
Voice Activated Personal Assistant: Acceptability of Use in the Public Space
Moorthy, A. E., & Vu, K. L. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-07863-2_32 · Cited by 53
Rode, J. A., Toye, E. F., & Blackwell, A. F. (2005) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/1056808.1057015 · Cited by 52
Volokhin, S., & Agichtein, E. (2018) · Conference on Human Information Interaction and Retrieval · doi:10.1145/3176349.3176885 · Cited by 50
From in the wild to in vivo: Video Analysis of Mobile Device Use
McMillan, D., McGregor, M., & Brown, B. A. T. (2015) · International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI) · doi:10.1145/2785830.2785883 · Cited by 34
Improving consent in large scale mobile HCI through personalised representations of data
Morrison, A., McMillan, D., & Chalmers, M. (2014) · Nordic Conference on Human-Computer Interaction · doi:10.1145/2639189.2639239 · Cited by 33
Moore, J., Kortuem, G., Smith, A., et al. (2016) · doi:10.1145/2962735.2962747 · Cited by 33
Embeddedness and sequentiality in social media
Reeves, S., & Brown, B. A. T. (2016) · ACM Conference on Computer Supported Cooperative Work (CSCW) · doi:10.1145/2818048.2820008 · Cited by 31
Managing Uncertainty in Time Expressions for Virtual Assistants
Rong, X., Fourney, A., Brewer, R. N., Morris, M. R., & Bennett, P. N. (2017) · Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3025453.3025674 · Cited by 30
The Composition and Use of Modern Mobile Phonebooks
Bentley, F. R., & Chen, Y. (2015) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/2702123.2702182 · Cited by 25
Self-citationPhase Coherence in Conceptual Spaces for Conversational Agents
Vassallo, G., Pilato, G., Augello, A., & Gaglio, S. (2010) · Semantic Computing · doi:10.1002/9780470588222.ch18 · Cited by 23
Panel: Voice Assistants, UX Design and Research
Kaye, J. '., Fischer, J., Hong, J., Bentley, F. R., Munteanu, C., Hiniker, A., Tsai, J. Y., & Ammari, T. (2018) · Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3170427.3186323 · Cited by 19
Self-citationManaging the Internet of Things
Romano, B. (2017) · doi:10.1145/3017680.3022452 · Cited by 10
Moazzami, M.-M., Mashima, D., Herberg, U., et al. (2016) · doi:10.1145/2968219.2968345 · Cited by 3
Research works printed but not linked: 5
- Anne-jorunn Berg. 1995. A gendered socio-technical construction: The smart house . In Information Technology and Society: A Reader, Nick Heap (Ed.). Sage, London . Anne-jorunn Berg. 1995. A gendered socio-technical construction: The smart house. In Information Technology and Society: A Reader, Nick Heap (Ed.). Sage, London.
- 10.5555/794204.795308 · doi:10.5555/794204.795308
- Bin Liu , Mads Schaarup Andersen , Florian Schaub , Hazim Almuhimedi , S. A. Zhang , Norman Sadeh , Alessandro Acquisti , and Yuvraj Agarwal . 2016 . Follow my recommendations: A personalized privacy assistant for mobile app permissions . In Proceeding of the Symposium on Usable Privacy and Security. https://www.usenix.org/system/files/conference/soups2016/soups2016-paper-liu.pdf. Bin Liu, Mads Schaarup Andersen, Florian Schaub, Hazim Almuhimedi, S. A. Zhang, Norman Sadeh, Alessandro Acquisti, and Yuvraj Agarwal. 2016. Follow my recommendations: A personalized privacy assistant for mobile app permissions. In Proceeding of the Symposium on Usable Privacy and Security. https://www.usenix.org/system/files/conference/soups2016/soups2016-paper-liu.pdf.
- Pardis Naeini , Sruti Bhagavatula , Hana Habib , Martin Degeling , Lujo Bauer , Lorrie Cranor , and Norman Sadeh . 2017 . Privacy Expectations and Preferences in an IoT World . In Proceedings of the 13th Symposium on Usable Privacy and Security (SOUPS’17) . Santa Clara, CA, 399–412. https://www.usenix.org/conference/soups 2017/technical-sessions/presentation/naeini. Pardis Naeini, Sruti Bhagavatula, Hana Habib, Martin Degeling, Lujo Bauer, Lorrie Cranor, and Norman Sadeh. 2017. Privacy Expectations and Preferences in an IoT World. In Proceedings of the 13th Symposium on Usable Privacy and Security (SOUPS’17). Santa Clara, CA, 399–412. https://www.usenix.org/conference/soups2017/technical-sessions/presentation/naeini.
- Juan Ramos . 2003 . Using tf-idf to determine word relevance in document queries . In Proceedings of the 1st Instructional Conference on Machine Learning , Vol. 242 . 133--142. Juan Ramos. 2003. Using tf-idf to determine word relevance in document queries. In Proceedings of the 1st Instructional Conference on Machine Learning, Vol. 242. 133--142.
Cited by
Federated-Learning-Based Anomaly Detection for IoT Security Attacks
Mothukuri, V., Khare, P., Parizi, R. M., Pouriyeh, S., Dehghantanha, A., & Srivastava, G. (2022) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3077803 · Cited by 722
Building a Stronger CASA: Extending the Computers Are Social Actors Paradigm
Gambino, A., Fox, J., & Ratan, R. (2020) · Human-Machine Communication · doi:10.30658/hmc.1.5 · Cited by 626
“Additionally, it has become more common for people to have repeated, ongoing interactions with media agents, such as Amazon’s Alexa, to fulfill utilitarian as well as social needs (Ammari et al., 2019; McLean & Osei-Frimpong, 2019).”
BackgroundUse of Intelligent Voice Assistants by Older Adults with Low Technology Use
Pradhan, A., Lazar, A., & Findlater, L. (2020) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3373759 · Cited by 285
Kim, S., & Choudhury, A. (2021) · Computers in Human Behavior · doi:10.1016/j.chb.2021.106914 · Cited by 200
Bérubé, C., Schachner, T., Keller, R., Fleisch, E., v Wangenheim, F., Barata, F., & Kowatsch, T. (2021) · Journal of Medical Internet Research · doi:10.2196/25933 · Cited by 133
Metadata
- Authors
- Ammari, T., Kaye, J., Tsai, J. Y., & Bentley, F.
- Affiliations
- University of Michigan (US)
- Mozilla Foundation (US)
- Mozilla, Mountain View CA
- Verizon (United States) (US)
- Venue
- ACM Transactions on Computer-Human Interaction
- Published
- 2019-04-26
- Volume
- 26
- Issue
- 3
- Pages
- 1-28
- ISSN
- 1073-0516 (ISSN-L)
- 1557-7325
- OpenAlex
- W2943686508
- Semantic Scholar
- 93c2a3abbd7169f50539eb1eb1fc5a845a955b8e
- Cited by
- 356
- References
- 62
- Citations by year
- 2026: 25 · 2025: 35 · 2024: 57 · 2023: 68 · 2022: 68 · 2021: 63 · 2020: 35 · 2019: 5
- FWCI
- 19.49
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- ACM Transactions on Computer-Human Interaction (publishedVersion)
- Rutgers University Community Repository (Rutgers University) (submittedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Social Sciences › Business, Management and Accounting › Marketing › AI in Service Interactions
- Physical Sciences › Computer Science › Human-Computer Interaction › Innovative Human-Technology Interaction
- Keywords
- voice assistants, voice search, music playback, Internet of Things, home automation, Amazon Alexa, Google Home, user commands, privacy
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.