Voice Interfaces in Everyday Life
Open accessThe DOI matches its Crossref record; 41 of the 42 references it cites were found in a registry or an index.
Abstract
Voice User Interfaces (VUIs) are becoming ubiquitously available, being embedded both into everyday mobility via smartphones, and into the life of the home via 'assistant' devices. Yet, exactly how users of such devices practically thread that use into their everyday social interactions remains underexplored. By collecting and studying audio data from month-long deployments of the Amazon Echo in participants' homes-informed by ethnomethodology and conversation analysis-our study documents the methodical practices of VUI users, and how that use is accomplished in the complex social life of the home. Data we present shows how the device is made accountable to and embedded into conversational settings like family dinners where various simultaneous activities are being achieved. We discuss how the VUI is finely coordinated with the sequential organisation of talk. Finally, we locate implications for the accountability of VUI interaction, request and response design, and raise conceptual challenges to the notion of designing 'conversational' interfaces.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Whereas, we found that the challenges our participants experienced were more elementary.”
From Exploring How Older Adults Use a Smart Speaker–Based Voice Assistant in Their First Interactions: Qualitative Study (2021) · cites this paper as [16]
In the citing paper
“Needing to adhere to structured and ordered commands is at odds with natural conversation, a finding that aligns with past work on limitations in the conversational abilities of voice assistants [59].”
From Use of Intelligent Voice Assistants by Older Adults with Low Technology Use (2020) · cites this paper as [59]
In the citing paper
“Another issue that surfaced particularly with memory support features was related to ways that requests (i.e., what command the user gives to the voice assistant) and responses (what, how the voice assistant responds back to the user) have been programmed for the voice assistant-a common issue with conversation design and VUIs [59].”
From Use of Intelligent Voice Assistants by Older Adults with Low Technology Use (2020) · cites this paper as [59]
In the citing paper
“Similar to previous findings, issues due to device timing out [61,83] errors due to speech recognition/mistranscription, and lack of conversational nature [59] and the need to remember specific keywords [61] is challenging for older adults.”
From Use of Intelligent Voice Assistants by Older Adults with Low Technology Use (2020) · cites this paper as [59]
In the citing paper
“System-repair strategies research explores how SDSs can be designed to effectively manage conversations, including mechanisms for grounding, interruptions, and corrections, and assesses their impact on user experience and SDS efficiency [17, 60].”
From System and User Strategies to Repair Conversational Breakdowns of Spoken Dialogue Systems: A Scoping Review (2024) · cites this paper as [60]
16 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
A simplest systematics for the organization of turn-taking for conversation
Sacks, H., Schegloff, E. A., & Jefferson, G. (1974) · Language · doi:10.2307/412243 · Cited by 11,350
Levinson, S. C. (1983) · doi:10.1017/cbo9780511813313 · Cited by 5,137
Sequence Organization in Interaction: A Primer in Conversation Analysis
Schegloff, E. A. (2007) · Cambridge University Press eBooks · doi:10.1017/cbo9780511791208 · Cited by 4,684
Alone together: why we expect more from technology and less from each other
(2011) · Choice Reviews Online · doi:10.5860/choice.48-7239 · Cited by 4,624
Busfield, J., & Garfinkel, H. (1968) · The British Journal of Sociology · doi:10.2307/588840 · Cited by 3,813 · cited 5×
“Our study draws on the traditions of Ethnomethodology and Conversation Analysis (EMCA) [8,32], as is common in HCI literature (e.”
BackgroundMethodInfluentialLicklider, J. C. R. (1960) · IRE Transactions on Human Factors in Electronics · doi:10.1109/thfe2.1960.4503259 · Cited by 1,938 · cited 1×
“Of course, machines that can be spoken to via ‘natural talk’ have a considerable heritage in both science fiction (e.g. HAL 9000 from 2001: A Space Odyssey ) and research (cf. [16]).”
BackgroundUniversals and cultural variation in turn-taking in conversation
Stivers, T., Enfield, N. J., Brown, P., Englert, C., Hayashi, M., Heinemann, T., Hoymann, G., Rossano, F., de Ruiter, J. P., Yoon, K.-E., et al. (2009) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0903616106 · Cited by 1,533 · cited 1×
“Further, a preference for minimising overlap in talk [36] also seems to be in operation as the request is made.”
BackgroundLuger, E., & Sellen, A. (2016) · Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858288 · Cited by 1,176 · cited 3×
“Luger and Sellen [17], through interviews, problematise the limited functionality of existing commercially-available VUIs, stipulating that a “gulf” exists between expectant and actual capabilities of the systems.”
BackgroundInfluentialGoodwin, C., & Heritage, J. (1990) · Annual Review of Anthropology · doi:10.1146/annurev.an.19.100190.001435 · Cited by 1,002
Analyzing Single Episodes of Interaction: An Exercise in Conversation Analysis
Schegloff, E. A. (1987) · Social Psychology Quarterly · doi:10.2307/2786745 · Cited by 841
McTear, M., Callejas, Z., & Griol, D. (2016) · doi:10.1007/978-3-319-32967-3 · Cited by 594 · cited 1×
“Researchers’ adoption of such technologies as “ conversational interfaces” [20] (our emphasis) resonates in many ways with the advertised user experience of such devices: specifically as technologies that it is possible to ‘have a conversation’ with and ‘just ask’ questions of.”
BackgroundSpoken dialogue technology: enabling the conversational user interface
McTear, M. F. (2002) · ACM Computing Surveys · doi:10.1145/505282.505285 · Cited by 571
McTear, M. F. (2004) · Springer eBooks · doi:10.1007/978-0-85729-414-2 · Cited by 566 · cited 1×
“For example, early on McTear defined spoken dialogue systems as “computer systems with which humans interact on a turn-by-turn basis” [19].”
Background(2014) · doi:10.5555/2615731.2617415 · Cited by 553
JUPlTER: a telephone-based conversational interface for weather information
Zue, V., Seneff, S., Glass, J. R., Polifroni, J., Pao, C., Hazen, T. J., & Hetherington, L. (2000) · IEEE Transactions on Speech and Audio Processing · doi:10.1109/89.817460 · Cited by 436 · cited 1×
“Early systems focused on specific sets of tasks such as providing users with weather information through a telephone call [42], however over time they have taken on increasingly complicated forms and functions including the”
BackgroundA Conversational Agent as Museum Guide – Design and Evaluation of a Real-World Application
Kopp, S., Gesellensetter, L., Krämer, N. C., & Wachsmuth, I. (2005) · Lecture Notes in Computer Science · doi:10.1007/11550617_28 · Cited by 393 · cited 1×
“We note that many of these ideas have been realised already, with various systems created to help in domains such as healthcare decisions making [5], guiding visitors in museums [14], and companions for the elderly [40].”
BackgroundOn "Technomethodology": Foundational Relationships Between Ethnomethodology and System Design
Dourish, P., & Button, G. (1998) · Human-Computer Interaction · doi:10.1207/s15327051hci1304_2 · Cited by 307 · cited 3×
“Additionally, there is a link between considering the accountability request design and the reflections on “observable-reportable abstractions” by Dourish and Button [6], which offer “a means for users to rationalise the activity of the system and therefore to organise their behaviour around it, as interaction proceed…”
BackgroundInfluentialComputational Sociolinguistics: A Survey
Nguyen, D., Doğruöz, A. S., Rosé, C. P., & de Jong, F. (2016) · Computational Linguistics · doi:10.1162/coli_a_00258 · Cited by 222 · cited 1×
“Despite the wealth of enabling research in computational linguistics such as natural language processing, dialogue systems, and computational sociolinguistics [21], research that empirically examines the social and interactional issues of VUIs in everyday use is lacking.”
BackgroundPizza, S., Brown, B., McMillan, D., & Lampinen, A. (2016) · Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858522 · Cited by 173 · cited 1×
“As we describe next, in response to this problem, we developed a device to deploy alongside the Echo to record interactions with the Echo automatically, in the spirit of Pizza et al. [25].”
MethodDesigning Relational Agents as Long Term Social Companions for Older Adults
Vardoulakis, L. P., Ring, L., Barry, B., Sidner, C. L., & Bickmore, T. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-33197-8_30 · Cited by 166
(1990) · Elsevier eBooks · doi:10.1016/c2009-0-21641-2 · Cited by 148
(2017) · doi:10.1145/2998181.2998298 · Cited by 131 · cited 5×
“This again demonstrates practices of reformulating, or rephrasing requests as a feature of voice interaction [12,27].”
BackgroundInfluentialSelf-citationOn the naturalness of touchless: Putting the “interaction” back into NUI
O'hara, K., Harper, R., Mentis, H., Sellen, A., & Taylor, A. (2013) · ACM Transactions on Computer-Human Interaction · doi:10.1145/2442106.2442111 · Cited by 126
(1995) · Medical Entomology and Zoology · Cited by 116
Supporting ethnographic studies of ubiquitous computing in the wild
Crabtree, A., Benford, S., Greenhalgh, C., Tennent, P., Chalmers, M., & Brown, B. (2006) · Proceedings of the 6th conference on Designing Interactive systems · doi:10.1145/1142405.1142417 · Cited by 110 · cited 1×
“In this way, we situate our work within a tradition established in part due to the growth of Ubicomp but becoming widely applicable in HCI too; this approach seeks to understand how interaction occurs and becomes embedded within lived experience [38], and further how these qualities can be exploited for design [4].”
BackgroundWhy That Nao?: How Humans Adapt to a Conventional Humanoid Robot in Taking Turns-at-Talk
Pelikan, H. R. M., & Broth, M. (2016) · Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858478 · Cited by 92 · cited 2×
“[24]), to examine the various ways in which the Echo was implicated in talk.”
BackgroundJiang, J., Jeng, W., & He, D. (2013) · Proceedings of the 36th international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/2484028.2484092 · Cited by 84 · cited 1×
“This again demonstrates practices of reformulating, or rephrasing requests as a feature of voice interaction [12,27].”
BackgroundDeploying research technology in the home
Tolmie, P., & Crabtree, A. (2008) · ACM Conference on Computer Supported Cooperative Work (CSCW) · doi:10.1145/1460563.1460662 · Cited by 65 · cited 2×
“Our work is in the tradition of HCI and CSCW research that deploys technology to study the situated and emergent lived experience in the home [37].”
BackgroundConversational agent use in a café
Porcheron, M. (2016) · Nottingham ePrints (University of Nottingham) · doi:10.17639/nott.61 · Cited by 56
Self-citationMore to Meetings: Challenges in Using Speech-Based Technology to Support Meetings
McGregor, M., & Tang, J. C. (2017) · Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing · doi:10.1145/2998181.2998335 · Cited by 53 · cited 1×
“In this way, we are continuing recent work emerging in CSCW that has begun to examine VUIs in collaborative action [26], for social settings such as meetings [18], and socialising with friends in a café [27].”
BackgroundTalking with Conversational Agents in Collaborative Action
Porcheron, M., Fischer, J. E., McGregor, M., Brown, B., Luger, E., Candello, H., & O'Hara, K. (2017) · Companion of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing · doi:10.1145/3022198.3022666 · Cited by 45
Self-citationVirtual Butlers and Real People: Styles and Practices in Long-Term Use of a Companion
Payr, S. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-37346-6_11 · Cited by 34 · cited 2×
“interfaces (or VUIs), conversational agents, or intelligent or virtual personal assistants, are described as embodying the idea of a virtual butler [23] that helps you ‘get things done’.”
Background"Are you watching this film or what?": interruption and the juggling of cohorts
Tolmie, P., Crabtree, A., Rodden, T., & Benford, S. (2008) · Proceedings of the 2008 ACM conference on Computer supported cooperative work · doi:10.1145/1460563.1460605 · Cited by 31 · cited 2×
“Rather, we see here how homes are inherently multi-activity settings in which devices get recruited into and are regulated through the ongoing cooperative and collocated activities that take place in the home [29,31,38].”
BackgroundEmbeddedness and sequentiality in social media
Reeves, S., & Brown, B. A. T. (2016) · ACM Conference on Computer Supported Cooperative Work (CSCW) · doi:10.1145/2818048.2820008 · Cited by 31 · cited 1×
“Inspired by a similar line of approach to Reeves and Brown [28], we look at the family’s interactions in two interconnected ways.”
MethodSelf-citationMedia Multitasking at Home: A Video Observation Study of Concurrent TV and Mobile Device Usage
Rigby, J. M., Brumby, D. P., Gould, S. J. J., & Cox, A. L. (2017) · Proceedings of the 2017 ACM International Conference on Interactive Experiences for TV and Online Video · doi:10.1145/3077548.3077560 · Cited by 28
The Tyranny of the Everyday in Mobile Video Messaging
Rintel, S., Harper, R. H. R., & O'Hara, K. P. (2016) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858042 · Cited by 20
InCA: A Mobile Conversational Agent
Kadous, M. W., & Sammut, C. (2004) · Lecture notes in computer science · doi:10.1007/978-3-540-28633-2_68 · Cited by 19 · cited 1×
“Recent systems designed for use in the home use an internet connection for speech processing and information retrieval, first explored in portable agents on mobile devices [13].”
BackgroundConfiguring Attention in the Multiscreen Living Room
Rooksby, J., Smith, T. E., Morrison, A., Rost, M., & Chalmers, M. (2015) · Springer eBooks · doi:10.1007/978-3-319-20499-4_13 · Cited by 19 · cited 2×
“[31] set up video cameras to capture television watching and the use of mobile devices.”
BackgroundGilbert, N., Wooffitt, R., & Fraser, N. (1990) · Elsevier eBooks · doi:10.1016/b978-0-08-050264-9.50016-6 · Cited by 17 · cited 2×
“[9] argue that the findings from conversation analysis can indeed be employed in the design of human-computer interactions.”
BackgroundInforming CSCW system requirements
Bannon, L. J., Bowers, J. S., Carstensen, P. H., Hughes, J. A., Kuutti, K., Pycock, J., Rodden, T. A., Schmidt, K., Shapiro, D., Sharrock, W., et al. (1994) · Cited by 15
Applying Sociology: Conversation Analysis in the Study of Human-(Simulated) Computer Interaction1
Wooffitt, R. (1994) · Bulletin of Sociological Methodology/Bulletin de Méthodologie Sociologique · doi:10.1177/075910639404300103 · Cited by 6
Research works printed but not linked: 9
- J. Maxwell Atkinson and John Heritage. 1984. Transcript Notation. In Structures of Social Action: Studies in Conversation Analysis. Cambridge University Press, ix--xvi.
- 10.5555/581100 · doi:10.5555/581100
- Hasan Shahid Ferdous, Frank Vetere, Hilary Davis, Bernd Ploderer, and Kenton OHara. 2016. Technologies At Mealtime: Collocated Interactions In The Family Home. In CHI '16 Workshop on Proxemic Mobile Collocated Interactions.
- 10.4324/9781003320609-8 · DOI · Paper page
- Christian Heath Jon Hindmarsh and Paul Luff. 2010. Video in Qualitative Research. SAGE.
- 10.5555/2965050 · doi:10.5555/2965050
- 10.5555/2554494.2554509 · doi:10.5555/2554494.2554509
- Harvey Sacks. 1992. Harvey Sacks: Lectures on Conversation. Basil Publishing, Oxford.
- 10.5555/1972496 · doi:10.5555/1972496
Cited by
Guidelines for Human-AI Interaction
Amershi, S., Weld, D., Vorvoreanu, M., Fourney, A., Nushi, B., Collisson, P., Suh, J., Iqbal, S., Bennett, P. N., Inkpen, K., et al. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300233 · Cited by 2,439
“This scenario has also had a recent resurgence of interest given advances in natural language processing and embedded devices driving the proliferation of conversational agents [26, 29, 35].”
BackgroundLau, J., Zimmerman, B., & Schaub, F. (2018) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3274371 · Cited by 568
“…allow participants to reflect on their interaction with the speaker, including potentially unspoken thoughts and considerations, rather than introducing an additional recorder to capture audio before and after an interaction [43] or asking participants to give us their smart speakers’ audio logs.”
BackgroundWhat Makes a Good Conversation?: Challenges in Designing Truly Conversational Agents
Clark, L., Pantidi, N., Cooney, O., Doyle, P., Garaialde, D., Edwards, J., Spillane, B., Gilmartin, E., Murad, C., Munteanu, C., et al. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300705 · Cited by 461
“Speaking to agents currently falls short of conversational dialogue [37, 39, 42], ar X iv :1 90 1.”
BackgroundResultInfluentialMusic, Search, and IoT: How People (Really) Use Voice Assistants
Ammari, T., Kaye, J., Tsai, J. Y., & Bentley, F. (2019) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3311956 · Cited by 356
“[47] conducted a month-long study analyzing the use of Amazon Alexa logs and an audio recorder.”
BackgroundCommunication Breakdowns Between Families and Alexa
Beneteau, E., Richards, O. K., Zhang, M., Kientz, J. A., Yip, J., & Hiniker, A. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300473 · Cited by 313
“True conversational capabilities have not yet been fully realized [33,34], and we want to better understand how human - technology “conversations” can be improved.”
BackgroundMethodInfluential
Metadata
- Authors
- Porcheron, M., Fischer, J. E., Reeves, S., & Sharples, S.
- Affiliations
- University of Nottingham (GB)
- Venue
- Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2018-04-21
- Pages
- 1-12
- OpenAlex
- W2787712888
- Semantic Scholar
- 4ace92c22a895d5e23e58de8d738df8e500d8d79
- Cited by
- 717
- References
- 42
- Citations by year
- 2026: 57 · 2025: 100 · 2024: 58 · 2023: 93 · 2022: 87 · 2021: 117 · 2020: 103 · 2019: 85 · 2018: 17
- FWCI
- 799.64
- Type
- conference paper
- Language
- en
- Open access
- Locations
- CHI Conference on Human Factors in Computing Systems (publishedVersion)
- Nottingham ePrints (University of Nottingham) (acceptedVersion)
- Repository@Nottingham (University of Nottingham) (submittedVersion, cc-by)
- Funders
- EPSRC (EP/G037574/1 EP/G065802/1 EP/N014243/1 EP/M02315X/1 EP/K025848/1)
- Topics
- Social Sciences › Arts and Humanities › Language and Linguistics › Language, Discourse, Communication Strategies
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Physical Sciences › Computer Science › Human-Computer Interaction › Innovative Human-Technology Interaction
- Keywords
- voice user interface, Amazon Echo, smart speakers, family dinner, multimodal interaction, ethnomethodology, conversation analysis
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.