The Role of Conversational Grounding in Supporting Symbiosis Between People and Digital Assistants
The DOI matches its Crossref record; 57 of the 57 references it cites were found in a registry or an index.
Abstract
In "smart speaker'' digital assistant systems such as Google Home, there is no visual user interface, so people must learn about the system's capabilities and limitations by experimenting with different questions and commands. However, many new users give up quickly and limit their use to a few simple tasks. This is a problem for both the user and the system. Users who stop trying out new things cannot learn about new features and functionality, and the system receives less data upon which to base future improvements. Symbiosis---a mutually beneficial relationship---between AI systems like digital assistants and people is an important aspect of developing systems that are partners to humans and not just tools. In order to better understand requirements for symbiosis, we investigated the relationship between the types of digital assistant responses and users' subsequent questions, focusing on identifying interactions that were discouraging to users when speaking with a digital assistant. We conducted a user study with 20 participants who completed a series of information seeking tasks using the Google Home, and analyzed transcripts using a method based on applied conversation analysis. We found that the most common response from the Google Home, a version of "Sorry, I'm not sure how to help'', provided no feedback for participants to build on when forming their next question. However, responses that provided somewhat strange but tangentially related answers were actually more helpful for conversational grounding, which extended the interaction. We discuss the connection between grounding and symbiosis, and present recommendations for requirements for forming partnerships with digital assistants.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“In particular, the error handling is tricky to design as conversation breakdowns can be common and even unexpected in the wild [20, 79, 108].”
From Leveraging Large Language Models to Power Chatbots for Collecting User Self-Reported Data (2024) · cites this paper as [20]
In the citing paper
“Current conversational interfaces such as Google Assistant and Amazon Alexa shows certain abilities in maintaining contexts [71]; however, most of them are still criticized for not detecting contextual details [14, 20].”
From Leveraging Large Language Models to Power Chatbots for Collecting User Self-Reported Data (2024) · cites this paper as [20]
Citations
Cites
The Coding Manual for Qualitative Researchers
Saldana, J. (2025) · SAGE Publications Ltd eBooks · doi:10.4135/9781036235611 · Cited by 17,944
The Coding Manual for Qualitative Researchers
Lungu, M. (2022) · American Journal of Qualitative Research · doi:10.29333/ajqr/12085 · Cited by 10,826
(1993) · Cited by 9,879
Clark, H. H., & Brennan, S. E. (1991) · Perspectives on socially shared cognition. · doi:10.1037/10096-006 · Cited by 4,555
The Usability Engineering Lifecycle
NIELSEN, J. (1993) · Usability Engineering · doi:10.1016/b978-0-08-052029-2.50007-3 · Cited by 2,657
Guidelines for Human-AI Interaction
Amershi, S., Weld, D., Vorvoreanu, M., Fourney, A., Nushi, B., Collisson, P., Suh, J., Iqbal, S., Bennett, P. N., Inkpen, K., et al. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300233 · Cited by 2,439
(2006) · Cited by 2,256
Licklider, J. C. R. (1960) · IRE Transactions on Human Factors in Electronics · doi:10.1109/thfe2.1960.4503259 · Cited by 1,938
Clark, H. H., & Schaefer, E. F. (1989) · Cognitive Science · doi:10.1207/s15516709cog1302_7 · Cited by 1,699
Principles of mixed-initiative user interfaces
Horvitz, E. (1999) · Proceedings of the SIGCHI conference on Human factors in computing systems the CHI is the limit - CHI '99 · doi:10.1145/302979.303030 · Cited by 1,490
Information seeking in electronic environments
(1996) · Choice Reviews Online · doi:10.5860/choice.33-3366 · Cited by 1,487
ten Have, P. (2007) · SAGE Publications Ltd eBooks · doi:10.4135/9781849208895 · Cited by 1,453
Luger, E., & Sellen, A. (2016) · Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858288 · Cited by 1,176
Risk communication: a mental models approach
(2002) · Choice Reviews Online · doi:10.5860/choice.39-6394 · Cited by 969
Information Seeking in Electronic Environments
Marchionini, G. (1995) · doi:10.1017/cbo9780511626388 · Cited by 833
Risk Communication: A Mental Models Approach
Johnson, B. B. (2002) · Risk Analysis · doi:10.1111/0272-4332.00071 · Cited by 824
Voice Interfaces in Everyday Life
Porcheron, M., Fischer, J. E., Reeves, S., & Sharples, S. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3174214 · Cited by 717 · cited 4×
“…their question by adding, removing, or changing the order of words [4, 25]; they repeat the question verbatim or with small modi cations to vocabulary or grammar [41, 46]; and they attempt to identify what might be causing the problem so that they can try again with a new approach [41, 45].”
BackgroundInfluentialStaying open to interpretation: engaging multiple meanings in design and evaluation
Sengers, P., & Gaver, B. (2006) · Proceedings of the 6th conference on Designing Interactive systems · doi:10.1145/1142405.1142422 · Cited by 620
McTear, M., Callejas, Z., & Griol, D. (2016) · doi:10.1007/978-3-319-32967-3 · Cited by 594
Stephanidis, C., Salvendy, G., Antona, M., Chen, J. Y. C., Dong, J., Duffy, V. G., Fang, X., Fidopiastis, C., Fragomeni, G., Fu, L. P., et al. (2019) · International Journal of Human–Computer Interaction · doi:10.1080/10447318.2019.1619259 · Cited by 524
Using Recurrent Neural Networks for Slot Filling in Spoken Language Understanding
Mesnil, G., Dauphin, Y., Yao, K., Bengio, Y., Deng, L., Hakkani-Tur, D., He, X., Heck, L., Tur, G., Yu, D., et al. (2015) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2014.2383614 · Cited by 461
Perspective-Taking in Communication: Representations of Others' Knowledge in Reference
Krauss, R. M., & Fussell, S. R. (1991) · Social Cognition · doi:10.1521/soco.1991.9.1.2 · Cited by 393
Music, Search, and IoT: How People (Really) Use Voice Assistants
Ammari, T., Kaye, J., Tsai, J. Y., & Bentley, F. (2019) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3311956 · Cited by 356
"Hey Alexa, What's Up?": A Mixed-Methods Studies of In-Home Conversational Agent Usage
Sciuto, A., Saini, A., Forlizzi, J., & Hong, J. I. (2018) · Proceedings of the 2018 Designing Interactive Systems Conference · doi:10.1145/3196709.3196772 · Cited by 327
Understanding the Long-Term Use of Smart Speaker Assistants
Bentley, F., Luvogt, C., Silverman, M., Wirasinghe, R., White, B., & Lottridge, D. (2018) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3264901 · Cited by 316
Communication Breakdowns Between Families and Alexa
Beneteau, E., Richards, O. K., Zhang, M., Kientz, J. A., Yip, J., & Hiniker, A. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300473 · Cited by 313 · cited 5×
“While remarkable progress has been made in voice user interfaces [35], most of the burden of recovering from communication breakdowns still rests on the people using them [3, 4].”
BackgroundMethodInfluentialLópez, G., Quesada, L., & Guerrero, L. A. (2018) · Advances in Intelligent Systems and Computing · doi:10.1007/978-3-319-60366-7_23 · Cited by 277
Kocielnik, R., Amershi, S., & Bennett, P. N. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300641 · Cited by 277
Chatbots, Humbots, and the Quest for Artificial General Intelligence
Grudin, J., & Jacques, R. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300439 · Cited by 275
Fussell, S. R., & Krauss, R. M. (1989) · Journal of Experimental Social Psychology · doi:10.1016/0022-1031(89)90019-x · Cited by 256
Resilient Chatbots: Repair Strategy Preferences for Conversational Breakdowns
Ashktorab, Z., Jain, M., Liao, Q. V., & Weisz, J. D. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300484 · Cited by 224 · cited 2×
“But these conversation processes are automatic for people who are speaking with one another, and this means that they come into play when speaking with a digital assistant, too [3, 46].”
BackgroundPatterns for How Users Overcome Obstacles in Voice User Interfaces
Myers, C., Furqan, A., Nebolsky, J., Caro, K., & Zhu, J. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3173580 · Cited by 213
Conversation with and through computers
Brennan, S. E. (1991) · User Modeling and User-Adapted Interaction · doi:10.1007/bf00158952 · Cited by 158
From Tool to Partner: The Evolution of Human-Computer Interaction
Grudin, J. T. (2017) · Synthesis lectures on human-centered informatics · doi:10.1007/978-3-031-02218-0 · Cited by 157
Co-performance: Conceptualizing the Role of Artificial Agency in the Design of Everyday Life
Kuijer, L., & Giaccardi, E. (2018) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3173699 · Cited by 145
Exploring human error recovery strategies: Implications for spoken dialogue systems
Skantze, G. (2005) · Speech Communication · doi:10.1016/j.specom.2004.11.005 · Cited by 137
(2017) · doi:10.1145/2998181.2998298 · Cited by 131
Downey, L. L., & Laskowski, S. J. (1997) · doi:10.6028/nist.sp.500-237 · Cited by 115
How do users respond to voice input errors? lexical and phonetic query reformulation in voice search
Jiang, J., Jeng, W., & He, D. (2013) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/2484028.2484092 · Cited by 110
Sorry, I Didn’t Catch That! An Investigation of Non-understanding Errors and Recovery Strategies
Bohus, D., & Rudnicky, A. I. (2018) · doi:10.1184/r1/6609683 · Cited by 109
Once a Kind Friend is Now a Thing: Understanding How Conversational Agents at Home are Forgotten
Cho, M., Lee, S.-S., & Lee, K.-P. (2019) · Proceedings of the 2019 on Designing Interactive Systems Conference · doi:10.1145/3322276.3322332 · Cited by 90
Progressivity for voice interface design
Fischer, J. E., Reeves, S., Porcheron, M., & Sikveland, R. O. (2019) · Proceedings of the 1st International Conference on Conversational User Interfaces · doi:10.1145/3342775.3342788 · Cited by 88
From Tool to Partner: The Evolution of Human-Computer Interaction
Grudin, J. T. (2016) · Synthesis lectures on human-centered informatics · doi:10.2200/s00745ed1v01y201612hci035 · Cited by 87
Is Spoken Language All-or-Nothing? Implications for Future Speech-Based Human-Machine Interaction
Moore, R. K. (2017) · Lecture Notes in Electrical Engineering · doi:10.1007/978-981-10-2585-3_22 · Cited by 66
Towards Taxonomy of Errors in Chat-oriented Dialogue Systems
Higashinaka, R., Funakoshi, K., Araki, M., Tsukahara, H., Kobayashi, Y., & Mizukami, M. (2015) · Proceedings of the 16th Annual Meeting of the Special Interest Group on Discourse and Dialogue · doi:10.18653/v1/w15-4611 · Cited by 66
Understanding Motivators, Constraints, and Practices of Sharing Internet of Things
Garg, R., & Moreno, C. (2019) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3328915 · Cited by 59
Deep Learning for Dialogue Systems
Chen, Y.-N., Çelikyılmaz, A., & Hakkani-Tür, D. Z. (2017) · doi:10.18653/v1/p17-5004 · Cited by 55
Garg, R., & Sengupta, S. (2019) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3359165 · Cited by 47
Miscommunication Detection and Recovery in Situated Human–Robot Dialogue
Marge, M., & Rudnicky, A. I. (2019) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/3237189 · Cited by 34
Degrees of grounding based on evidence of understanding
Roque, A., & Traum, D. R. (2008) · Annual Meeting of the Special Interest Group on Discourse and Dialogue · doi:10.3115/1622064.1622073 · Cited by 29
Automatic Detection of Miscommunication in Spoken Dialogue Systems
Meena, R., Lopes, J., Skantze, G., & Gustafson, J. (2015) · Annual Meeting of the Special Interest Group on Discourse and Dialogue · doi:10.18653/v1/w15-4647 · Cited by 28
Clift, R., Drew, P., & Hutchby, I. (2022) · Handbook of pragmatics online/Handbook of pragmatics · doi:10.1075/hop.m2.con4 · Cited by 25
Gilbert, N., Wooffitt, R., & Fraser, N. (1990) · Elsevier eBooks · doi:10.1016/b978-0-08-050264-9.50016-6 · Cited by 17
Artificial Intelligence Accelerates Human Learning
Nagao, K. (2019) · Springer eBooks · doi:10.1007/978-981-13-6175-3 · Cited by 16
IRE Transactions on Human Factors in Electronics
(1960) · IRE transactions on human factors in electronics · doi:10.1109/thfe2.1960.4503255 · Cited by 12
ScratchThat: Supporting Command-Agnostic Speech Repair in Voice-Driven Assistants
Wu, J., Ahuja, K., Li, R., Chen, V., & Bigham, J. P. (2019) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3328934 · Cited by 7
Research works printed but not linked: 6
- Susan E Brennan . 1998. The grounding problem in conversations with and through computers. Social and cognitive approaches to interpersonal communication ( 1998 ), 201--225. Susan E Brennan. 1998. The grounding problem in conversations with and through computers. Social and cognitive approaches to interpersonal communication (1998), 201--225.
- Herbert H. Clark . 1996. Using Language . Cambridge University Press . https://doi.org/10.1017/CBO97805116 2053 9 10.1017/CBO9780511620539 Herbert H. Clark. 1996. Using Language .Cambridge University Press. https://doi.org/10.1017/CBO9780511620539 · doi:10.1017/cbo97805116
- Herbert H Clark and Susan E Brennan. 1991. Grounding in Communication. (1991) 127--149. https://doi.org/10.1037/10096-006 · DOI · Paper page
- Michael McTear . 2008 . Handling Miscommunication: Why Bother? In Recent trends in Discourse and Dialogue, Dybkjær L . and Minker W. (Eds.). Text, Speech and Language Technology, Vol. 39 . Springer , Dordrecht, 101--122. https://doi.org/10.1007/978--1--4020--6821--8_5 10.1007/978--1--4020--6821--8_5 Michael McTear. 2008. Handling Miscommunication: Why Bother? In Recent trends in Discourse and Dialogue, Dybkjær L. and Minker W. (Eds.). Text, Speech and Language Technology, Vol. 39. Springer, Dordrecht, 101--122. https://doi.org/10.1007/978--1--4020--6821--8_5 · doi:10.1007/978--1--4020--6821--8_5
- Michael McTear . 2018. Conversational Modelling for Chatbots: Current Approaches and Future Directions . In Studientexte zur Sprachkommunikation: Elektronische Sprachsignalverarbeitung 2018 , André Berton, Udo Haiber , and Wolfgang Minker (Eds.). TUDpress, Dresden , 175--185. Michael McTear. 2018. Conversational Modelling for Chatbots: Current Approaches and Future Directions. In Studientexte zur Sprachkommunikation: Elektronische Sprachsignalverarbeitung 2018, André Berton, Udo Haiber, and Wolfgang Minker (Eds.). TUDpress, Dresden, 175--185.
- 10.5555/1622064.1622073 · doi:10.5555/1622064.1622073
Cited by
Harrington, C. N., Garg, R., Woodward, A., & Williams, D. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3501995 · Cited by 98
“the unintentional errors introduced in their speech while ‘performing’ the language in real and concrete situations [22] as well as the affordance of technology itself [21].”
BackgroundMulti-Modal Repairs of Conversational Breakdowns in Task-Oriented Dialogs
Li, T. J.-J., Chen, J., Xia, H., Mitchell, T. M., & Myers, B. A. (2020) · Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology · doi:10.1145/3379337.3415820 · Cited by 98
Seymour, W., & Van Kleek, M. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3479515 · Cited by 94
Feuston, J. L., & Brubaker, J. R. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3479856 · Cited by 147
Leveraging Large Language Models to Power Chatbots for Collecting User Self-Reported Data
Wei, J., Kim, S., Jung, H., & Kim, Y.-H. (2024) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3637364 · Cited by 84
“In particular, the error handling is tricky to design as conversation breakdowns can be common and even unexpected in the wild [16, 74, 98].”
Background
Metadata
- Authors
- Cho, J., & Rader, E.
- Affiliations
- University of Colorado Boulder (US)
- Michigan State University (US)
- Venue
- Proceedings of the ACM on Human-Computer Interaction
- Published
- 2020-05-28
- Volume
- 4
- Issue
- CSCW1
- Pages
- 1-28
- ISSN
- 2573-0142 (ISSN-L)
- OpenAlex
- W3030250000
- Cited by
- 49
- References
- 57
- Citations by year
- 2026: 3 · 2025: 8 · 2024: 9 · 2023: 5 · 2022: 13 · 2021: 8 · 2020: 2
- FWCI
- 2.75
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Proceedings of the ACM on Human-Computer Interaction (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Social Sciences › Business, Management and Accounting › Marketing › AI in Service Interactions
- Physical Sciences › Computer Science › Human-Computer Interaction › Innovative Human-Technology Interaction
- Keywords
- conversational grounding, virtual assistants, smart speakers, human-AI symbiosis, information seeking, Google Home, applied conversation analysis
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.