"Like Having a Really Bad PA": The Gulf between User Expectation and Experience of Conversational Agents
The DOI matches its Crossref record; 49 of the 51 references it cites were found in a registry or an index.
Abstract
The past four years have seen the rise of conversational agents (CAs) in everyday life. Apple, Microsoft, Amazon, Google and Facebook have all embedded proprietary CAs within their software and, increasingly, conversation is becoming a key mode of human-computer interaction. Whilst we have long been familiar with the notion of computers that speak, the investigative concern within HCI has been upon multimodality rather than dialogue alone, and there is no sense of how such interfaces are used in everyday life. This paper reports the findings of interviews with 14 users of CAs in an effort to understand the current interactional factors affecting everyday use. We find user expectations dramatically out of step with the operation of the systems, particularly in terms of known machine intelligence, system capability and goals. Using Norman's 'gulfs of execution and evaluation' [30] we consider the implications of these findings for the design of future systems.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Whereas, we found that the challenges our participants experienced were more elementary.”
From Exploring How Older Adults Use a Smart Speaker–Based Voice Assistant in Their First Interactions: Qualitative Study (2021) · cites this paper as [32]
In the citing paper
“In addition, it could be more important for novice users to have an appropriate mental model and understand the system rather than an efficient user experience [32].”
From Exploring How Older Adults Use a Smart Speaker–Based Voice Assistant in Their First Interactions: Qualitative Study (2021) · cites this paper as [32]
In the citing paper
“human-AI mixed-initiative presents a generally valuable and underexplored interface paradigm.”
From Mixed-Initiative Creative Interfaces (2017) · cites this paper as [20]
In the citing paper
“Not only do these breakdowns significantly diminish user satisfaction and damage trust, they also decrease the likelihood of continued use [18, 44].”
From System and User Strategies to Repair Conversational Breakdowns of Spoken Dialogue Systems: A Scoping Review (2024) · cites this paper as [44]
In the citing paper
“This is because when voice assistants fail, such as by incorrectly answering a question, it derails user trust [27, 35].”
From A Mixed-Methods Approach to Understanding User Trust after Voice Assistant Failures (2023) · cites this paper as [35]
17 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
How Many Interviews Are Enough?: An Experiment with Data Saturation and Variability
Guest, G., Bunce, A., & Johnson, L. (2006) · Field Methods · doi:10.1177/1525822x05279903 · Cited by 20,808
(2010) · Sociology for Pharmacists · doi:10.4324/9780203381175_chapter_9 · Cited by 14,152
Norman, D. (2016) · Vahlen eBooks · doi:10.15358/9783800648108 · Cited by 6,374
Thematic networks: an analytic tool for qualitative research
Attride-Stirling, J. (2001) · Qualitative Research · doi:10.1177/146879410100100307 · Cited by 5,506 · cited 2×
“The thematic network is a ‘web-like coding structure’ [2; 385] that allows for a rich understanding of the conceptual interplay occurring within the narrative.”
Background(1997) · Choice Reviews Online · doi:10.5860/choice.34-3702 · Cited by 4,887
ELIZA—a computer program for the study of natural language communication between man and machine
Weizenbaum, J. (1966) · Communications of the ACM · doi:10.1145/365153.365168 · Cited by 4,452
ELIZA — a computer program for the study of natural language communication between man and machine
Weizenbaum, J. (1983) · Communications of the ACM · doi:10.1145/357980.357991 · Cited by 2,738
Licklider, J. C. R. (1960) · IRE Transactions on Human Factors in Electronics · doi:10.1109/thfe2.1960.4503259 · Cited by 1,938 · cited 1×
“When considering human-machine dialogue from an HCI perspective, some of the earliest work can be traced back to vision statements and position papers such as JCR Licklider (1960), ‘Man-machine symbiosis’ [25] and the early work of Richard Bolt [4].”
MethodEmbodied Conversational Agents
(2000) · The MIT Press eBooks · doi:10.7551/mitpress/2697.001.0001 · Cited by 1,799
Interaction Ritual: Essays on Face-to-face Behaviour
Goffman, E. (1972) · Medical Entomology and Zoology · Cited by 1,449
“Put-that-there”: Voice and gesture at the graphics interface
Bolt, R. A. (1980) · Proceedings of the 7th annual conference on Computer graphics and interactive techniques - SIGGRAPH '80 · doi:10.1145/800250.807503 · Cited by 1,445
Establishing and maintaining long-term human-computer relationships
Bickmore, T. W., & Picard, R. W. (2005) · ACM Transactions on Computer-Human Interaction · doi:10.1145/1067860.1067867 · Cited by 1,333
Computer power and human reason
Kuipers, B., McCarthy, J., & Weizenbaum, J. (1976) · ACM SIGART Bulletin · doi:10.1145/1045264.1045265 · Cited by 1,051
Walliman, N. (2006) · SAGE Publications Ltd eBooks · doi:10.4135/9781849209939 · Cited by 770
Computer Power and Human Reason: From Judgement to Calculation.
Crowther, J. F., & Weizenbaum, J. (1977) · Contemporary Sociology · doi:10.2307/2062802 · Cited by 722
The art of human-computer interface design
Spring, M. B. (1991) · Computer Standards & Interfaces · doi:10.1016/0920-5489(91)90073-9 · Cited by 709
Kurniawan, S. H. (2003) · ACM SIGCHI Bulletin - a supplement to interactions · doi:10.1145/967199.967218 · Cited by 525
On the Pragmatics of Communication
Beilharz, P., & Habermas, J. (2000) · Contemporary Sociology · doi:10.2307/2655274 · Cited by 455
A Conversational Agent as Museum Guide – Design and Evaluation of a Real-World Application
Kopp, S., Gesellensetter, L., Krämer, N. C., & Wachsmuth, I. (2005) · Lecture Notes in Computer Science · doi:10.1007/11550617_28 · Cited by 393
“It doesn’t matter what you are!” Explaining social effects of agents and avatars
von der Pütten, A. M., Krämer, N. C., Gratch, J., & Kang, S.-H. (2010) · Computers in Human Behavior · doi:10.1016/j.chb.2010.06.012 · Cited by 389 · cited 2×
“When considering human-machine dialogue from an HCI perspective, some of the earliest work can be traced back to vision statements and position papers such as JCR Licklider (1960), ‘Man-machine symbiosis’ [25] and the early work of Richard Bolt [4].”
BackgroundMethodHuman Conversation as a System Framework: Designing Embodied Conversational Agents
Cassell, J., Bickmore, T., Campbell, L., Vilhjálmsson, H., & Yan, H. (2000) · Embodied Conversational Agents · doi:10.7551/mitpress/2697.003.0004 · Cited by 342
Embodied conversational agents: representation and intelligence in user interfaces
Cassell, J. (2001) · AI Magazine · doi:10.1609/aimag.v22i4.1593 · Cited by 269
Designing mediation for context-aware applications
Dey, A. K., & Mankoff, J. (2005) · ACM Transactions on Computer-Human Interaction · doi:10.1145/1057237.1057241 · Cited by 140
Shechtman, N., & Horowitz, L. M. (2003) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/642611.642661 · Cited by 139
Close Engagements with Artificial Companions: Key social, psychological, ethical and design issues
(2010) · Natural Language Processing · doi:10.1075/nlp.8 · Cited by 130 · cited 2×
“In order to distinguish such terms more clearly, Wilks (2010) suggests a series of differentiating characteristics.”
BackgroundOn the naturalness of touchless: Putting the “interaction” back into NUI
O'hara, K., Harper, R., Mentis, H., Sellen, A., & Taylor, A. (2013) · ACM Transactions on Computer-Human Interaction · doi:10.1145/2442106.2442111 · Cited by 126
Self-citationLearning by Communicating in Natural Language With Conversational Agents
Graesser, A. C., Li, H., & Forsyth, C. (2014) · Current Directions in Psychological Science · doi:10.1177/0963721414540680 · Cited by 118 · cited 1×
“Transcripts were coded on an ongoing basis and new participants were sought until theoretical saturation was reached [17].”
BackgroundComputer Power and Human Reason: from Judgement to Calculation
Michie, D. (1976) · International Journal of Man-Machine Studies · doi:10.1016/s0020-7373(76)80035-1 · Cited by 106
Texture: human expression in the age of communications overload
(2011) · Choice Reviews Online · doi:10.5860/choice.48-4910 · Cited by 101
Dawson, J. W. (2002) · Bulletin of Symbolic Logic · doi:10.2307/2687743 · Cited by 64 · cited 1×
“Indeed, our fascination with computers that converse can be traced back as far as 1964 when, seeking to create the illusion of human interaction, Joseph Weizenbaum of MIT created Eliza [10], a computer program that responded on the basis of data gleaned only from human respondents’ typed input.”
BackgroundMake it so: learning from sci-fi interfaces
Shedroff, N., & Noessel, C. (2012) · Proceedings of the International Working Conference on Advanced Visual Interfaces · doi:10.1145/2254556.2254561 · Cited by 64
Anthropomorphism: from Eliza to Terminator 2
Don, A., Brennan, S., Laurel, B., & Shneiderman, B. (1992) · Proceedings of the SIGCHI conference on Human factors in computing systems - CHI '92 · doi:10.1145/142750.142760 · Cited by 55
Maglio, P. P., & Campbell, C. S. (2003) · Communications of the ACM · doi:10.1145/636772.636797 · Cited by 55
Virtual Butlers and Real People: Styles and Practices in Long-Term Use of a Companion
Payr, S. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-37346-6_11 · Cited by 34
Issues in Spoken Dialogue Systems: Experiences with the Dutch Arise System
Sturm, J., den Os, E., & Boves, L. (2000) · Cited by 27
Phase Coherence in Conceptual Spaces for Conversational Agents
Vassallo, G., Pilato, G., Augello, A., & Gaglio, S. (2010) · Semantic Computing · doi:10.1002/9780470588222.ch18 · Cited by 23 · cited 1×
“Moreover, they will have the potential to enhance both the system usability and user experience [43].”
BackgroundProviding Computer Game Characters with Conversational Abilities
Gustafson, J., Boye, J., Fredriksson, M., Johanneson, L., & Königsmann, J. (2005) · Lecture notes in computer science · doi:10.1007/11550617_4 · Cited by 22 · cited 1×
“Similar developments have been seen within a range of spheres such as gaming [19], mixed reality environments [14], tourism [29], train timetabling [41] and agents to support learning [23; 14].”
BackgroundSpoken dialogue systems: Challenges, and opportunities for research
Williams, J. D. (2009) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru.2009.5372951 · Cited by 19
Moore, M. (1995) · Bulletin of the Atomic Scientists · doi:10.1080/00963402.1995.11658035 · Cited by 18
Pulman, S., Boye, J., Cavazza, M., Smith, C., & de la Cámara, R. S. (2010) · Cited by 16
Design and evaluation of a conversational agent for the touristic domain
Niculescu, A. I., Yeo, K. H., D’Haro, L. F., Kim, S., Jiang, R., & Banchs, R. E. (2014) · Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC) · doi:10.1109/apsipa.2014.7041744 · Cited by 16
Framing the Invisible – The Social Background of Trust
Heuwinkel, K. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-37346-6_3 · Cited by 14
Agent-based museum and tour guides: applying the state of the art
Richards, D. (2012) · Australasian Conference On Interactive Entertainment · doi:10.1145/2336727.2336742 · Cited by 13
Using a Conversational Agent for Promoting Collaborative Language Learning
Tegos, S. D., Demetriadis, S., & Tsiatsos, Τ. (2012) · International Conference on Intelligent Networking and Collaborative Systems (INCoS) · doi:10.1109/incos.2012.105 · Cited by 13 · cited 1×
“Whilst CA research exists, it tends towards either technical papers related to architecture [37], CAs studied in experimental settings, or systems created for specific contexts, such as guiding users around a space [24], delivering information [41], or for the support of language learning [40].”
BackgroundIs a Companion a Distinctive Kind of Relationship with a Machine
Wilks, Y. A. (2010) · Cited by 13
Social Situated Agents in Virtual, Real and Mixed Reality Environments
Dragone, M., Holz, T., Duffy, B. R., & O’Hare, G. M. P. (2005) · Lecture notes in computer science · doi:10.1007/11550617_15 · Cited by 12 · cited 1×
“Similar developments have been seen within a range of spheres such as gaming [19], mixed reality environments [14], tourism [29], train timetabling [41] and agents to support learning [23; 14].”
BackgroundBayesian Inverse Reinforcement Learning for Modeling Conversational Agents in a Virtual Environment
Rojas-Barahona, L. M., & Cerisara, C. (2014) · Lecture notes in computer science · doi:10.1007/978-3-642-54906-9_41 · Cited by 9
Ask&Answer: An Educational Game Where It Pays to Endear Your Capricious Virtual Companion
Iurgel, I., & Ziegler, M. (2005) · Lecture notes in computer science · doi:10.1007/11550617_2 · Cited by 8
Conversationalists and confidants
Boden, M. A. (2010) · Natural language processing · doi:10.1075/nlp.8.10bod · Cited by 5
Research works printed but not linked: 14
- Boden Margaret A, 2007, Proceedings of Artificial Companions in Society: Perspectives on the Present and Future. Oxford Internet Institute.
- Davis Martin, Engines of Logic: Mathematicians and the Origin of the Computer
- Glass James R., 1999, Challenges for Spoken Dialogue Systems. In the proceedings of IEEE Workshop on Automatic Speech Recognition and Understanding. (ASRU), CO, USA
- 10.5555/1941863 · doi:10.5555/1941863
- Heuwinkel Kerstin, Your Virtual Butler: The Making-of. Robert Trappl (ed)
- Robnett Licklider Joseph Carl, 1960, HFE-1,(March
- Moore Roger, Spoken Language Processing: Where do we go from Here? In Your Virtual Butler: The Making-of. Robert Trappl (ed)
- Payr Sabine, Your Virtual Butler: The Making-of. Robert Trappl (ed)
- Preece Jenny, 2015, Interaction Design: Beyond Huma- Computer Interaction
- Pulman Stephen, Proceedings of the 2010 Workshop on Companionable Dialogue Systems. Assoc. for Computational Linguistics
- Trappl Robert, From Jeeves Jeannie to Siri, and Then? In Your Virtual Butler: The Making-of. Robert Trappl (ed)
- Vassallo Giorgio, Semantic Computing. Sheu, Yu, Ramamoorthy, Joshi & Zadeh.(eds)
- 10.5555/1870559.1870562 · doi:10.5555/1870559.1870562
- Wilks Yorick, 2010, Amsterdam: John Benjamins.
Cited by
Guidelines for Human-AI Interaction
Amershi, S., Weld, D., Vorvoreanu, M., Fourney, A., Nushi, B., Collisson, P., Suh, J., Iqbal, S., Bennett, P. N., Inkpen, K., et al. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300233 · Cited by 2,439
AI-based chatbots in customer service and their effects on user compliance
Adam, M., Wessel, M., & Benlian, A. (2021) · Electronic Markets · doi:10.1007/s12525-020-00414-7 · Cited by 1,195
“CAs may, for instance, provide unsuitable responses to the user requests, leading to a gap between the user ’ s expectation and the system ’ s performance (Luger and Sellen 2016; Orlowski 2017).”
BackgroundRapp, A., Curti, L., & Boldi, A. (2021) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2021.102630 · Cited by 643
Voice Interfaces in Everyday Life
Porcheron, M., Fischer, J. E., Reeves, S., & Sharples, S. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3174214 · Cited by 717
“Luger and Sellen [17], through interviews, problematise the limited functionality of existing commercially-available VUIs, stipulating that a “gulf” exists between expectant and actual capabilities of the systems.”
BackgroundInfluentialChen, Y., Jensen, S., Albert, L. J., Gupta, S., & Lee, T. (2023) · Information Systems Frontiers · doi:10.1007/s10796-022-10291-4 · Cited by 685
“As one type of AI technology, conversational agents (Luger & Sellen, 2016) such as chatbots (Schlesinger et al., 2018; Stieglitz et al., 2021), have been leveraged to assist student life in education (Goel & Polepeddi, 2016; Hwang & Chang, 2021; Kerly et al., 2007; Kerry et al., 2009; Okonkwo &…”
Background
Metadata
- Authors
- Luger, E., & Sellen, A.
- Affiliations
- Microsoft Research (United Kingdom) (GB)
- Venue
- Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2016-05-07
- Pages
- 5286-5297
- OpenAlex
- W2405187948
- Semantic Scholar
- 814e62bb4f0ec6facd640fbd3e3fcbd189716d20
- Cited by
- 1,176
- References
- 51
- Citations by year
- 2026: 164 · 2025: 175 · 2024: 119 · 2023: 116 · 2022: 107 · 2021: 148 · 2020: 141 · 2019: 126 · 2018: 54 · 2017: 25 · 2016: 1
- FWCI
- 37.00
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- CHI Conference on Human Factors in Computing Systems (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Social Sciences › Business, Management and Accounting › Marketing › AI in Service Interactions
- Physical Sciences › Computer Science › Human-Computer Interaction › Innovative Human-Technology Interaction
- Keywords
- chatbots, voice assistants, everyday use, user expectations, human-computer interaction, multimodality, system capabilities, interface design
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.