What Makes a Good Conversation? Challenges in Designing Truly Conversational Agents
Open accessThe DOI matches its OpenAlex record; 21 of the 21 references it cites were found in a registry or an index.
Abstract
Conversational agents promise conversational interaction but fail to deliver. Efforts often emulate functional rules from human speech, without considering key characteristics that conversation must encapsulate. Given its potential in supporting long-term human-agent relationships, it is paramount that HCI focuses efforts on delivering this promise. We aim to understand what people value in conversation and how this should manifest in agents. Findings from a series of semi-structured interviews show people make a clear dichotomy between social and functional roles of conversation, emphasising the long-term dynamics of bond and trust along with the importance of context and relationship stage in the types of conversations they have. People fundamentally questioned the need for bond and common ground in agent communication, shifting to more utilitarian definitions of conversational qualities. Drawing on these findings we discuss key challenges for conversational agent design, most notably the need to redefine the design parameters for conversational agent interaction.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Using thematic analysis in psychology
Braun, V., & Clarke, V. (2006) · Qualitative Research in Psychology · doi:10.1191/1478088706qp063oa · Cited by 194,414
A simplest systematics for the organization of turn-taking for conversation
Sacks, H., Schegloff, E. A., & Jefferson, G. (1974) · Language · doi:10.2307/412243 · Cited by 11,350
Emotion and sociable humanoid robots
Breazeal, C. (2003) · International Journal of Human-Computer Studies · doi:10.1016/s1071-5819(03)00018-1 · Cited by 1,279
Luger, E., & Sellen, A. (2016) · Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858288 · Cited by 1,176 · cited 5×
“hat conversational agents can and should be capable of performing. These expectations support the notion that an agent is a basic dialogue partner [8] lacking in humanlike conversational capabilities [20, 35, 42]. Our participants personally expressed no desire to build bonds with conversational agents (although they…”
BackgroundResultInfluentialVoice Interfaces in Everyday Life
Porcheron, M., Fischer, J. E., Reeves, S., & Sharples, S. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3174214 · Cited by 717 · cited 11×
“Speaking to agents currently falls short of conversational dialogue [37, 39, 42], ar X iv :1 90 1.”
BackgroundResultInfluentialMcTear, M., Callejas, Z., & Griol, D. (2016) · doi:10.1007/978-3-319-32967-3 · Cited by 594
Socially assistive robotics [Grand Challenges of Robotics]
Tapus, A., Mataric, M., & Scassellati, B. (2007) · IEEE Robotics & Automation Magazine · doi:10.1109/mra.2007.339605 · Cited by 547
Relational agents: a model and implementation of building user trust
Bickmore, T., & Cassell, J. (2001) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/365024.365304 · Cited by 479
"Alexa is my new BFF": Social Roles, User Satisfaction, and Personification of the Amazon Echo
Purington, A., Taft, J. G., Sannon, S., Bazarova, N. N., & Taylor, S. H. (2017) · Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems · doi:10.1145/3027063.3053246 · Cited by 476
"What can i help you with?": infrequent users' experiences of intelligent personal assistants
Cowan, B. R., Pantidi, N., Coyle, D., Morrissey, K., Clarke, P., Al-Shehri, S., Earley, D., & Bandeira, N. (2017) · Proceedings of the 19th International Conference on Human-Computer Interaction with Mobile Devices and Services · doi:10.1145/3098279.3098539 · Cited by 351
Self-citationSocial Dialongue with Embodied Conversational Agents
Bickmore, T., & Cassell, J. (2005) · Text, Speech and Language Technology · doi:10.1007/1-4020-3933-6_2 · Cited by 324
Interaction Ritual: Essays in Face-to-Face Behavior
Goffman, E., & Best, J. (2017) · doi:10.4324/9780203788387 · Cited by 324
Understanding the Long-Term Use of Smart Speaker Assistants
Bentley, F., Luvogt, C., Silverman, M., Wirasinghe, R., White, B., & Lottridge, D. (2018) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3264901 · Cited by 316
Privacy Concerns for Use of Voice Activated Personal Assistant in the Public Space
Easwara Moorthy, A., & Vu, K.-P. L. (2015) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2014.986642 · Cited by 250
Looije, R., Neerincx, M. A., & Cnossen, F. (2010) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2009.08.007 · Cited by 243 · cited 1×
“The accommodation of social conversations is proposed as a critical factor in developing trust in a social agent [34].”
BackgroundResponse to a relational agent by hospital patients with depressive symptoms
Bickmore, T. W., Mitchell, S. E., Jack, B. W., Paasche-Orlow, M. K., Pfeifer, L. M., & O’Donnell, J. (2010) · Interacting with Computers · doi:10.1016/j.intcom.2009.12.001 · Cited by 218 · cited 1×
“A number of these agents have been developed for contexts including health [6, 7], elderly care [5, 55], education [50], customer service [3] and workplace [29] contexts.”
BackgroundA conversational robot in an elderly care center: an ethnographic study
Sabelli, A. M., Kanda, T., & Hagita, N. (2011) · Proceedings of the 6th international conference on Human-robot interaction · doi:10.1145/1957656.1957669 · Cited by 187 · cited 2×
“as important to long term rapport building and use [53]. The accommodation of social conversations is proposed as a critical factor in developing trust in a social agent [34]. Work by Sabelli et al. [47] found that people were open to speaking about personal matters with a conversational robot, using it as an emotiona…”
BackgroundAbdolrahmani, A., Kuber, R., & Branham, S. M. (2018) · Proceedings of the 20th International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/3234695.3236344 · Cited by 172 · cited 1×
“discuss conversationally with agents may differ markedly in private and public settings. Current users are unlikely to engage with IPAs in public [20, 35], noting social embarrassment and awkwardness [1, 20]. Users have fewer concerns divulging private information when using VUIs in private compared to social spaces […”
BackgroundDesigning Relational Agents as Long Term Social Companions for Older Adults
Vardoulakis, L. P., Ring, L., Barry, B., Sidner, C. L., & Bickmore, T. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-33197-8_30 · Cited by 166
Acceptance and usability of a relational agent interface by urban older adults
Bickmore, T. W., Caruso, L., & Clough-Gorr, K. (2005) · CHI '05 Extended Abstracts on Human Factors in Computing Systems · doi:10.1145/1056808.1056879 · Cited by 142 · cited 1×
“A number of these agents have been developed for contexts including health [6, 7], elderly care [5, 55], education [50], customer service [3] and workplace [29] contexts.”
BackgroundSocial talk: making conversation with people and machine
Gilmartin, E., Collery, M., Su, K., Huang, Y., Elias, C., Cowan, B. R., & Campbell, N. (2017) · Proceedings of the 1st ACM SIGCHI International Workshop on Investigating Social Interactions with Artificial Agents · doi:10.1145/3139491.3139494 · Cited by 17 · cited 2×
“Emulating the structures and rules that govern human conversation [27] help generate conversation-like abilities, but they do not guarantee that the important subjective characteristics of conversation are preserved.”
BackgroundSelf-citation
Cited by
My Chatbot Companion - a Study of Human-Chatbot Relationships
Skjuve, M., Følstad, A., Fostervold, K. I., & Brandtzaeg, P. B. (2021) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2021.102601 · Cited by 797
Rapp, A., Curti, L., & Boldi, A. (2021) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2021.102630 · Cited by 643
Systematic Review: Trust-Building Factors and Implications for Conversational Agent Design
Rheu, M., Shin, J. Y., Peng, W., & Huh-Yoo, J. (2021) · International Journal of Human–Computer Interaction · doi:10.1080/10447318.2020.1807710 · Cited by 360
"I Hear You, I Feel You": Encouraging Deep Self-disclosure through a Chatbot
Lee, Y.-C., Yamashita, N., Huang, Y., & Fu, W. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376175 · Cited by 339
A longitudinal study of human–chatbot relationships
Skjuve, M., Følstad, A., Fostervold, K. I., & Brandtzaeg, P. B. (2022) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2022.102903 · Cited by 253
Metadata
- Authors
- Clark, L., Pantidi, N., Cooney, O., Doyle, P. R., Garaialde, D., Edwards, J., Spillane, B., Murad, C., Munteanu, C., Wade, V., & Cowan, B. R.
- Venue
- Cork Open Research Archive (University College Cork, Ireland)
- Publisher
- arXiv
- Published
- 2019
- arXiv
- 1901.06525
- OpenAlex
- W2913681502
- Cited by
- 128
- References
- 21
- FWCI
- 45.26
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.