UX Research on Conversational Human-AI Interaction: A Literature Review of the ACM Digital Library
Open accessThe DOI matches its Crossref record; 48 of the 48 references it cites were found in a registry or an index.
Abstract
Early conversational agents (CAs) focused on dyadic human-AI interaction between humans and the CAs, followed by the increasing popularity of polyadic human-AI interaction, in which CAs are designed to mediate human-human interactions. CAs for polyadic interactions are unique because they encompass hybrid social interactions, i.e., human-CA, human-to-human, and human-to-group behaviors. However, research on polyadic CAs is scattered across different fields, making it challenging to identify, compare, and accumulate existing knowledge. To promote the future design of CA systems, we conducted a literature review of ACM publications and identified a set of works that conducted UX (user experience) research. We qualitatively synthesized the effects of polyadic CAs into four aspects of human-human interactions, i.e., communication, engagement, connection, and relationship maintenance. Through a mixed-method analysis of the selected polyadic and dyadic CA studies, we developed a suite of evaluation measurements on the effects. Our findings show that designing with social boundaries, such as privacy, disclosure, and identification, is crucial for ethical polyadic CAs. Future research should also advance usability testing methods and trust-building guidelines for conversational AI.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Using thematic analysis in psychology
Braun, V., & Clarke, V. (2006) · Qualitative Research in Psychology · doi:10.1191/1478088706qp063oa · Cited by 194,414
The ripple effect: emotional contagion and its influence on group behavior
Barsade, S. G. (2002) · Administrative Science Quarterly · doi:10.2307/3094912 · Cited by 3,361
Enhancing the Effectiveness of Work Groups and Teams
Kozlowski, S. W. J., & Ilgen, D. R. (2006) · Psychological Science in the Public Interest · doi:10.1111/j.1529-1006.2006.00030.x · Cited by 2,623
Guidelines for Human-AI Interaction
Amershi, S., Weld, D., Vorvoreanu, M., Fourney, A., Nushi, B., Collisson, P., Suh, J., Iqbal, S., Bennett, P. N., Inkpen, K., et al. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300233 · Cited by 2,439 · cited 2×
“, "the system language and behaviors do not reinforce undesirable and unfair stereotypes and biases given their social and cultural context") [6].”
BackgroundMethodNass, C., Steuer, J., & Tauber, E. R. (1994) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/191666.191703 · Cited by 2,148 · cited 1×
“as Social Actors paradigm [120], CAs are considered as "social actors".”
Conversational agents in healthcare: a systematic review
Laranjo, L., Dunn, A. G., Tong, H. L., Kocaballi, A. B., Chen, J., Bashir, R., Surian, D., Gallego, B., Magrabi, F., Lau, A. Y. S., et al. (2018) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocy072 · Cited by 1,388 · cited 6×
“reviews [44, 88, 139, 165] and was developed through several iterations and refnement by the research team, in line with prior HCI work.”
BackgroundInfluentialMcDonald, N., Schoenebeck, S., & Forte, A. (2019) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3359174 · Cited by 1,206
AI-based chatbots in customer service and their effects on user compliance
Adam, M., Wessel, M., & Benlian, A. (2021) · Electronic Markets · doi:10.1007/s12525-020-00414-7 · Cited by 1,195 · cited 1×
“Most of the existing empirical studies focus on designing dyadic CAs [2, 42, 91, 148, 158], without addressing the unique design challenges of polyadic CAs.”
BackgroundChatbots: History, technology, and applications
Adamopoulou, E., & Moussiades, L. (2020) · Machine Learning with Applications · doi:10.1016/j.mlwa.2020.100006 · Cited by 1,090 · cited 1×
“As promising Artifcial intelligence (AI) technologies, conversational agents are defned as "software that accepts natural language as input and generates natural language as output, engaging in a conversation with the user" [57]; chatbots, meanwhile, are computer programs designed to simulate conversation with human u…”
BackgroundMcTear, M., Callejas, Z., & Griol, D. (2016) · doi:10.1007/978-3-319-32967-3 · Cited by 594
Cited by
A multifaceted vision of the human-AI collaboration: a comprehensive review
Puerta-Beldarrain, M., Gómez-Carmona, O., Sánchez-Corcuera, R., Casado-Mansilla, D., López-de-Ipiña, D., & Chen, L. (2025) · IEEE Access · doi:10.1109/access.2025.3536095 · Cited by 73
“Those efforts aim to support the iterative design, development, and dissemination processes of learning systems oriented toward conversational AI agents [330] or to define a human-centered thinking approach to applying IML methods [82].”
IntroBot: Exploring the Use of Chatbot-assisted Familiarization in Online Collaborative Groups
Shin, D., Kim, S., Shang, R., Lee, J., & Hsieh, G. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3580930 · Cited by 37
“The idea of using polyadic chatbot has also been explored for relationship-building among strangers [84].”
BackgroundInfluentialTang, Y., Zhang, N., Ciancia, M., & Wang, Z. (2024) · Companion Publication of the 2024 Conference on Computer-Supported Cooperative Work and Social Computing · doi:10.1145/3678884.3681890 · Cited by 31
Self-citationWei, C. Z., Kim, Y.-H., & Kuzminykh, A. (2023) · Proceedings of the 5th International Conference on Conversational User Interfaces · doi:10.1145/3571884.3597139 · Cited by 14
“In accordance with accepted practices, we defined the scope of our literature review by considering two factors: (1) time—specifically publications from 2010 to 2022—and (2) source—using the ACMDigital Library [60, 79, 93].”
MethodSun, J., Zhang, Z., Wang, M., Li, N., Lu, Z., Xiang, Y., Zhang, L., Zhang, Y., Wang, Q., & Fan, M. (2025) · Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713810 · Cited by 12
Metadata
- Authors
- Zheng, Q., Tang, Y., Liu, Y., Liu, W., & Huang, Y.
- Venue
- CHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2022-04-29
- Pages
- 1-24
- OpenAlex
- W4225115595
- Cited by
- 100
- References
- 48
- FWCI
- 38.00
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: UX Research on Conversational Human-AI Interaction: A Literature Review of the ACM Digital Library. https://app.cochat.ai/papers/10.1145/3491102.3501855
- The paper
- Zheng, Q., Tang, Y., Liu, Y., Liu, W., & Huang, Y. (2022). UX Research on Conversational Human-AI Interaction: A Literature Review of the ACM Digital Library. CHI Conference on Human Factors in Computing Systems. https://doi.org/10.1145/3491102.3501855
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.