The DOI matches its Crossref record; 69 of the 69 references it cites were found in a registry or an index.
Understanding User Perceptions of Proactive Smart Speakers
Abstract
Voice assistants, such as Amazon's Alexa and Google Home, increasingly find their way into consumer homes. Their functionality, however, is currently limited to being passive answer machines rather than proactively engaging users in conversations. Speakers' proactivity would open up a range of important application scenarios, including health services, such as checking in on patient states and triggering medication reminders. It remains unclear how passive speakers should implement proactivity. To better understand user perceptions, we ran a 3-week field study with 13 participants where we modified the off-the-shelf Google Home to become proactive. During the study, our speaker proactively triggered conversations that were essentially Experience Sampling probes allowing us to identify when to engage users. Applying machine-learning, we are able to predict user responsiveness with a 71.6% accuracy and find predictive features. We also identify self-reported factors, such as boredom and mood, that are significantly correlated with users' perceived availability. Our prototype and findings inform the design of proactive speakers that verbally engage users at opportune moments and contribute to the design of proactive application scenarios and voice-based experience sampling studies.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“However, existing commercial chatbot frameworks, such as Dialogflow[32] and Amazon Alexa [6], predominantly only support building rule-based and scripted chatbots [69, 106].”
From Leveraging Large Language Models to Power Chatbots for Collecting User Self-Reported Data (2024) · cites this paper as [106]
Citations
Cites
XGBoost: A Scalable Tree Boosting System
Chen, T., & Guestrin, C. (2016) · Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2939672.2939785 · Cited by 54,569 · cited 1×
“XGBoost is a gradient boosting regression tree algorithm, which is efficient and has a low computation cost [10].”
MethodMultiple Resources and Mental Workload
Wickens, C. D. (2008) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872008x288394 · Cited by 2,164
The Aware Home: A Living Laboratory for Ubiquitous Computing Research
Kidd, C. D., Orr, R., Abowd, G. D., Atkeson, C. G., Essa, I. A., MacIntyre, B., Mynatt, E., Starner, T. E., & Newstetter, W. (1999) · Lecture Notes in Computer Science · doi:10.1007/10705432_17 · Cited by 1,035
Dillman, D. A., Phelps, G., Tortora, R., Swift, K., Kohrell, J., Berck, J., & Messer, B. L. (2009) · Social Science Research · doi:10.1016/j.ssresearch.2008.03.007 · Cited by 850 · cited 1×
“In order to shorten the question-asking time, we did not include the label of each Likert scale point [16].”
BackgroundVoice Interfaces in Everyday Life
Porcheron, M., Fischer, J. E., Reeves, S., & Sharples, S. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3174214 · Cited by 717 · cited 2×
“Multi-turn conversations with smart speakers can be more error-prone and can cause user confusion when interaction errors occur [57].”
BackgroundLau, J., Zimmerman, B., & Schaub, F. (2018) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3274371 · Cited by 568
Designing robots for long-term social interaction
Gockley, R., Bruce, A., Forlizzi, J., Michalowski, M., Mundell, A., Rosenthal, S., Sellner, B., Simmons, R., Snipes, K., Schultz, A. C., et al. (2005) · 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems · doi:10.1109/iros.2005.1545303 · Cited by 407 · cited 1×
“A greeting or utterance, which is learned from human-to-human conversations, has been used to initiate human-robot conversations [21].”
MethodUsing context-aware computing to reduce the perceived burden of interruptions from mobile devices
Ho, J., & Intille, S. S. (2005) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1054972.1055100 · Cited by 367 · cited 1×
“[23] reported that the mobile messages delivered at physical activity transitions were better received, such as sitting to walking and standing to sitting.”
BackgroundAn in-situ study of mobile phone notifications
Pielot, M., Church, K., & de Oliveira, R. (2014) · Proceedings of the 16th international conference on Human-computer interaction with mobile devices & services · doi:10.1145/2628363.2628364 · Cited by 345 · cited 2×
“It is reported that a person may receive on average more than 60 notifications from smartphones per day [53].”
BackgroundThe Personalization of Conversational Agents in Health Care: Systematic Review
Kocaballi, A. B., Berkovsky, S., Quiroz, J. C., Laranjo, L., Tong, H. L., Rezazadegan, D., Briatore, A., & Coiera, E. (2019) · Journal of Medical Internet Research · doi:10.2196/15360 · Cited by 332 · cited 1×
“…factor that determines user experience with proactive speakers, further studies can explore two directions for conversation starters: (1) context-aware utterances [45] or personalized utterances [31], and (2) compare the Earcon starter with the utterance starter that both require user consent.”
Background
Research works printed but not linked: 2
- Alexander Meschtscherjakov , Astrid Weiss , and Thomas Scherndl . 2009 . Utilizing emoticons on mobile devices within ESM studies to measure emotions in the field . Proc. MME in conjunction with MobileHCI 9 (2009), 3361--3366. Alexander Meschtscherjakov, Astrid Weiss, and Thomas Scherndl. 2009. Utilizing emoticons on mobile devices within ESM studies to measure emotions in the field. Proc. MME in conjunction with MobileHCI 9 (2009), 3361--3366.
- Chenyang Zhang and Yingli Tian . 2012 . RGB-D camera-based daily living activity recognition . Journal of computer vision and image processing 2 , 4 (2012), 12 . Chenyang Zhang and Yingli Tian. 2012. RGB-D camera-based daily living activity recognition. Journal of computer vision and image processing 2, 4 (2012), 12.
Cited by
Leveraging Large Language Models to Power Chatbots for Collecting User Self-Reported Data
Wei, J., Kim, S., Jung, H., & Kim, Y.-H. (2024) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3637364 · Cited by 84
“Lastly, we hope future research can investigate the user perceptions of LLM-driven chatbots, or even voice-based ones like smart speakers [96].”
BackgroundSelf-citationZargham, N., Reicherts, L., Bonfert, M., Voelkel, S. T., Schoening, J., Malaka, R., & Rogers, Y. (2022) · Proceedings of the 4th Conference on Conversational User Interfaces · doi:10.1145/3543829.3543834 · Cited by 84
“Previous studies have explored opportune moments for VA interventions in homes [7, 16, 19, 43], cars [17, 18, 33–36], and other settings [20].”
BackgroundPolite or Direct? Conversation Design of a Smart Display for Older Adults Based on Politeness Theory
Hu, Y., Qu, Y., Maus, A., & Mutlu, B. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3517525 · Cited by 60
“On the other hand, recent work has proposed the need for proactive behavior in voice interaction design and for conversational systems to play a more active role in engaging users [4, 6, 38].”
BackgroundProactive behavior in voice assistants: A systematic review and conceptual model
Bérubé, C., Nißen, M., Vinay, R., Geiger, A., Budig, T., Bhandari, A., Benito, C. R. P., Ibarcena, N., Pistolese, O., Li, P., et al. (2024) · Computers in Human Behavior Reports · doi:10.1016/j.chbr.2024.100411 · Cited by 58
Oh, J., Kim, W., Kim, S., Im, H., & Lee, S. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642193 · Cited by 38
Metadata
- Authors
- Wei, J., Dingler, T., & Kostakos, V.
- Affiliations
- The University of Melbourne (AU)
- Venue
- Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
- Published
- 2021-12-27
- Volume
- 5
- Issue
- 4
- Pages
- 1-28
- ISSN
- 2474-9567 (ISSN-L)
- OpenAlex
- W4200018492
- Cited by
- 33
- References
- 69
- Citations by year
- 2026: 6 · 2025: 5 · 2024: 13 · 2023: 3 · 2022: 6
- FWCI
- 3.37
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies (publishedVersion)
- Funders
- Australian Research Council (DP190102627)
- National Health and Medical Research Council (1170937, 2004316)
- AUSMURI (13203896)
- Topics
- Physical Sciences › Computer Science › Human-Computer Interaction › Innovative Human-Technology Interaction
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Social Sciences › Business, Management and Accounting › Marketing › AI in Service Interactions
- Keywords
- smart speakers, ecological momentary assessment, user mood, perceived availability, medication reminders, health monitoring, chatbots, voice user interface design
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.