To Err is AI: Imperfect Interventions and Repair in a Conversational Agent Facilitating Group Chat Discussions
Open accessThe DOI matches its Crossref record; 76 of the 76 references it cites were found in a registry or an index.
Abstract
Conversational agents (CAs) can analyze online conversations using natural language techniques and effectively facilitate group discussions by sending supervisory messages. However, if a CA makes imperfect interventions, users may stop trusting the CA and discontinue using it. In this study, we demonstrate how inaccurate interventions of a CA and a conversational repair strategy can influence user acceptance of the CA, members' participation in the discussion, perceived discussion experience between the members, and group performance. We built a CA that encourages the participation of members with low contributions in an online chat discussion in which a small group (3-6 members) performs a decision-making task. Two types of errors can occur when detecting under-contributing members: 1) false-positive (FP) errors happen when the CA falsely identifies a member as under-contributing and 2) false-negative (FN) errors occur when the CA misses detecting an under-contributing member. We designed a conversational repair strategy that gives users a chance to contest the detection results and the agent sends a correctional message if an error is detected. Through an online study with 175 participants, we found that participants who received FN error messages reported higher acceptance of the CA and better discussion experience, but participated less compared to those who received FP error messages. The conversational repair strategy moderated the effect of errors such as improving the perceived discussion experience of participants who received FP error messages. Based on our findings, we offer design implications for which model should be selected by practitioners between high precision (i.e., fewer FP errors) and high recall (i.e., fewer FN errors) models depending on the desired effects. When frequent FP errors are expected, we suggest using the conversational repair strategy to improve the perceived discussion experience.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“For example, our findings are similar to Do et al. [16], which found that people who interacted with a conversational assistant that made factual errors were less likely to continue participating in group discussions.”
From The AI Double Standard: Humans Judge All AIs for the Actions of One (2025) · cites this paper as [16]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Mixed-Effects Models in Sand S-PLUS
Pinheiro, J. C., & Bates, D. M. (2000) · Statistics and Computing · doi:10.1007/978-1-4419-0318-1 · Cited by 11,187
A very brief measure of the Big-Five personality domains
Gosling, S. D., Rentfrow, P. J., & Swann, W. B. (2003) · Journal of Research in Personality · doi:10.1016/s0092-6566(03)00046-1 · Cited by 8,307
The Preference for Self-Correction in the Organization of Repair in Conversation
Schegloff, E. A., Jefferson, G., & Sacks, H. (1977) · Language · doi:10.2307/413107 · Cited by 5,150
Algorithm aversion: People erroneously avoid algorithms after seeing them err.
Dietvorst, B. J., Simmons, J. P., & Massey, C. (2015) · Journal of Experimental Psychology: General · doi:10.1037/xge0000033 · Cited by 3,232 · cited 2×
“However, Dietvorst et al. argued that a system acknowledging mistakes can make errors stand out and people may lose trust and likability in algorithmic decisions (i.e., algorithmic aversion) [24].”
BackgroundMany Hands Make Light the Work: The Causes and Consequences of Social Loafing
Latané, B., Williams, K., & Harkins, S. (1979) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.37.6.822 · Cited by 2,216
Nass, C., Steuer, J., & Tauber, E. R. (1994) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/191666.191703 · Cited by 2,148 · cited 2×
“This perspective supports the Computers Are Social Actors (CASA) paradigm [65] where people respond in the same manner regardless of whether they are interacting with a human facilitator or a computer.”
Dietvorst, B. J., Simmons, J. P., & Massey, C. (2018) · Management Science · doi:10.1287/mnsc.2016.2643 · Cited by 1,230
Araujo, T. (2018) · Computers in Human Behavior · doi:10.1016/j.chb.2018.03.051 · Cited by 1,156
Nowak, K. L., & Biocca, F. (2003) · Presence: Teleoperators and Virtual Environments · doi:10.1162/105474603322761289 · Cited by 1,141
Power to the People: The Role of Humans in Interactive Machine Learning
Amershi, S., Cakmak, M., Knox, W. B., & Kulesza, T. (2014) · AI Magazine · doi:10.1609/aimag.v35i4.2513 · Cited by 1,084
Reliability in content analysis: some common misconceptions and recommendations.
Krippendorff, K. (2004) · Human Communication Research · doi:10.1093/hcr/30.3.411 · Cited by 1,027 · cited 1×
“86 for informativeness, indicating reliable agreement [49].”
Best practice guidance for linear mixed-effects models in psychological science
Meteyard, L., & Davies, R. A. I. (2020) · Journal of Memory and Language · doi:10.1016/j.jml.2020.104092 · Cited by 698
Online panels in social science research: Expanding sampling methods beyond Mechanical Turk
Chandler, J., Rosenzweig, C., Moss, A. J., Robinson, J., & Litman, L. (2019) · Behavior Research Methods · doi:10.3758/s13428-019-01273-7 · Cited by 668 · cited 1×
“We filtered out participants who did not pass English proficiency tests [16] or made erroneous inputs in the pre-task survey.”
MethodSchegloff, E. (2000) · Applied Linguistics · doi:10.1093/applin/21.2.205 · Cited by 615
Issues in Outcomes Research: An Overview of Randomization Techniques for Clinical Trials
Kang, M., Ragan, B. G., & Park, J.-H. (2008) · Journal of Athletic Training · doi:10.4085/1062-6050-43.2.215 · Cited by 555 · cited 1×
“…in a group) and extroversion personality [36] (i.e., the proportion of extroverted members in a group) were balanced across conditions using covariate adaptive randomization [44] when assigning participants to groups because those two features were known to influence group behavior [27, 68].”
Methodvan Dijk, H., van Engen, M. L., & van Knippenberg, D. (2012) · Organizational Behavior and Human Decision Processes · doi:10.1016/j.obhdp.2012.06.003 · Cited by 514
Facilitator's Guide to Participatory Decision-Making
Kaner, S., & Lind, L. (1996) · Cited by 499
Using Social Psychology to Motivate Contributions to Online Communities
Ling, K., Beenen, G., Ludford, P., Wang, X., Chang, K., Li, X., Cosley, D., Frankowski, D., Terveen, L., Rashid, A. M., et al. (2005) · Journal of Computer-Mediated Communication · doi:10.1111/j.1083-6101.2005.tb00273.x · Cited by 493
Hierarchical Linear Modeling: Guide and Applications
Garson, G. (2013) · Sage eBooks · doi:10.4135/9781483384450 · Cited by 438
2003 Midwest Research to Practice Conference in Adult, Continuing, and Community Education
Wright, U. T. (2003) · Cited by 380
Janssen, J., Erkens, G., Kanselaar, G., & Jaspers, J. (2007) · Computers & Education · doi:10.1016/j.compedu.2006.01.004 · Cited by 352
A Review of User Interface Design for Interactive Machine Learning
Dudley, J. J., & Kristensson, P. O. (2018) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/3185517 · Cited by 343
Kocielnik, R., Amershi, S., & Bennett, P. N. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300641 · Cited by 277
What makes a good team player? Personality and team effectiveness.
Driskell, J. E., Goodwin, G. F., Salas, E., & O'Shea, P. G. (2006) · Group Dynamics: Theory, Research, and Practice · doi:10.1037/1089-2699.10.4.249 · Cited by 260
Designing social presence of social actors in human computer interaction
Lee, K. M., & Nass, C. (2003) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/642611.642662 · Cited by 257
Chatbot advertising effectiveness: When does the message get through?
Van den Broeck, E., Zarouali, B., & Poels, K. (2019) · Computers in Human Behavior · doi:10.1016/j.chb.2019.04.009 · Cited by 257
Resilient Chatbots: Repair Strategy Preferences for Conversational Breakdowns
Ashktorab, Z., Jain, M., Liao, Q. V., & Weisz, J. D. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300484 · Cited by 224 · cited 5×
“While self-repair has been preferred for human communication [77], a CA may not repair in the same way as humans do for two main reasons [6]: 1) a user may be unfamiliar with the technology to choose an effective way to repair, and 2) a CA may not recognize that an error occurred due to technical limitation.”
BackgroundMethodInfluentialAubé, C., & Rousseau, V. (2005) · Group Dynamics: Theory, Research, and Practice · doi:10.1037/1089-2699.9.3.189 · Cited by 220
Patterns for How Users Overcome Obstacles in Voice User Interfaces
Myers, C., Furqan, A., Nebolsky, J., Caro, K., & Zhu, J. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3173580 · Cited by 213 · cited 1×
“Our findings about FP errors can generalize to the effects of common CA errors such as unfamiliar intents and NLP-related errors [64].”
BackgroundXiao, Z., Zhou, M. X., Liao, Q. V., Mark, G., Chi, C., Chen, W., & Yang, H. (2020) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3381804 · Cited by 185
I'm Sorry, Dave, I'm Afraid I Can't Do That: Chatbot Perception and Expectations
Zamora, J. (2017) · Proceedings of the 5th International Conference on Human Agent Interaction · doi:10.1145/3125739.3125766 · Cited by 164
Human computation tasks with global constraints
Zhang, H., Law, E., Miller, R., Gajos, K., Parkes, D., & Horvitz, E. (2012) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2207676.2207708 · Cited by 160
Schippers, M. C. (2013) · Academy of Management Learning and Education · doi:10.5465/amle.2012.0191 · Cited by 146
How Do Students Participate in Synchronous and Asynchronous Online Discussions?
Davidson-Shivers, G. V., Muilenburg, L. Y., & Tanner, E. J. (2001) · Journal of Educational Computing Research · doi:10.2190/6dch-ben3-v7cf-qk47 · Cited by 139
Prototyping dynamics: sharing multiple designs improves exploration, group rapport, and results
Dow, S., Fortuna, J., Schwartz, D., Altringer, B., Schwartz, D., & Klemmer, S. (2011) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1978942.1979359 · Cited by 138
Kim, S., Eun, J., Oh, C., Suh, B., & Lee, J. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376785 · Cited by 133
Self-citationUnderstanding Chatbot-mediated Task Management
Toxtli, C., Monroy-Hernández, A., & Cranshaw, J. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3173632 · Cited by 127 · cited 3×
“A CA is perceived as a member of a group rather than a tool [8, 45, 87], and creates a sense of social presence by adopting human-like characteristics [1, 54, 67, 82].”
BackgroundMethodFace Value? Exploring the Effects of Embodiment for a Group Facilitation Agent
Shamekhi, A., Liao, Q. V., Wang, D., Bellamy, R. K. E., & Erickson, T. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3173965 · Cited by 124
Flash Organizations: Crowdsourcing Complex Work by Structuring Crowds As Organizations
Valentine, M. A., Retelny, D., To, A., Rahmati, N., Doshi, T., & Bernstein, M. S. (2017) · Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3025453.3025811 · Cited by 123
Making Sense of Group Chat through Collaborative Tagging and Summarization
Zhang, A. X., & Cranshaw, J. (2018) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3274465 · Cited by 123
Visualizing real-time language-based feedback on teamwork behavior in computer-mediated groups
Leshed, G., Perez, D., Hancock, J. T., Cosley, D., Birnholtz, J. P., Lee, S., McLeod, P. L., & Gay, G. K. (2009) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/1518701.1518784 · Cited by 107
Structuring Interactions for Large-Scale Synchronous Peer Learning
Coetzee, D., Lim, S., Fox, A., Hartmann, B., & Hearst, M. A. (2015) · ACM Conference on Computer Supported Cooperative Work (CSCW) · doi:10.1145/2675133.2675251 · Cited by 107
Calendar.help: Designing a Workflow-Based Scheduling Agent with Humans in the Loop
Cranshaw, J., Elwany, E., Newman, T., Kocielnik, R., Yu, B., Soni, S., Teevan, J., & Monroy-Hernández, A. (2017) · Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3025453.3025780 · Cited by 106 · cited 1×
“CAs have also been successfully deployed to facilitate team collaboration such as scheduling meetings [19], summarizing chat history [97], structuring the discussion [46], or checking in with users whether their tasks are completed [87].”
MethodBotivist: Calling Volunteers to Action using Online Bots
Savage, S., Monroy-Hernandez, A., & Höllerer, T. (2016) · Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work & Social Computing · doi:10.1145/2818048.2819985 · Cited by 100
Engel, D., Woolley, A. W., Aggarwal, I., Chabris, C. F., Takahashi, M., Nemoto, K., Kaiser, C., Kim, Y. J., & Malone, T. W. (2015) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/2702123.2702259 · Cited by 92
Improving Crowd Innovation with Expert Facilitation
Chan, J., Dang, S., & Dow, S. P. (2016) · Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work & Social Computing · doi:10.1145/2818048.2820023 · Cited by 86
Tegos, S., Demetriadis, S., & Tsiatsos, T. (2014) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-013-0007-3 · Cited by 85
Improving teamwork using real-time language feedback
Tausczik, Y. R., & Pennebaker, J. W. (2013) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2470654.2470720 · Cited by 85
Kim, S., Eun, J., Seering, J., & Lee, J. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3449161 · Cited by 84
Self-citationTalk amongst yourselves: inviting users to participate in online conversations
Harper, F. M., Frankowski, D., Drenner, S., Ren, Y., Kiesler, S. B., Terveen, L., Kraut, R. E., & Riedl, J. (2007) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/1216295.1216313 · Cited by 82
The Social Roles of Bots: Evaluating Impact of Bots on Discussions in Online Communities
Seering, J., Flores, J. P., Savage, S., & Hammer, J. (2018) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3274426 · Cited by 77
Enhancing Scientific Reasoning and Discussion with Conversational Agents
Dyke, G., Adamson, D., Howley, I., & Rose, C. P. (2013) · IEEE Transactions on Learning Technologies · doi:10.1109/tlt.2013.25 · Cited by 72
Acceptability of Speech and Silent Speech Input Methods in Private and Public
Pandey, L., Hasan, K., & Arif, A. S. (2021) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445430 · Cited by 65
Your time zone or mine?: a study of globally time zone-shifted collaboration
Tang, J. C., Zhao, C., Cao, X., & Inkpen, K. (2011) · Proceedings of the ACM 2011 conference on Computer supported cooperative work · doi:10.1145/1958824.1958860 · Cited by 62 · cited 1×
“These eligibility criteria were selected based on prior studies to mitigate differences in time zones [84], proficiency of the language [37], and technology readiness among group members.”
MethodAttitudes Surrounding an Imperfect AI Autograder
Hsu, S., Li, T. W., Zhang, Z., Fowler, M., Zilles, C., & Karahalios, K. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445424 · Cited by 61
Wang, D., Wang, H., Yu, M., Ashktorab, Z., & Tan, M. (2022) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3512941 · Cited by 56
My Bad! Repairing Intelligent Voice Assistant Errors Improves Interaction
Cuadra, A., Li, S., Lee, H., Cho, J., & Ju, W. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3449101 · Cited by 52 · cited 3×
“found that repairs made users feel successful and less frustrated [20].”
BackgroundOvert or subtle? Supporting group conversations with automatically targeted directives
Schiavo, G., Cappelletti, A., Mencarini, E., Stock, O., & Zancanaro, M. (2014) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/2557500.2557507 · Cited by 50
SolutionChat: Real-time Moderator Support for Chat-based Structured Discussion
Lee, S.-C., Song, J., Ko, E.-Y., Park, S., Kim, J., & Kim, J. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376609 · Cited by 49 · cited 1×
“Another method that has been explored is technology to assist human facilitators such as recommending facilitation messages [15, 55].”
MethodMy Team Will Go On: Differentiating High and Low Viability Teams through Team Interaction
Cao, H., Yang, V., Chen, V., Lee, Y. J., Stone, L., Diarrassouba, N. J., Whiting, M. E., & Bernstein, M. S. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3432929 · Cited by 49
Team Dating: A Self-Organized Team Formation Strategy for Collaborative Crowdsourcing
Lykourentzou, I., Wang, S., Kraut, R. E., & Dow, S. P. (2016) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/2851581.2892421 · Cited by 46
Assessing Collaborative Problem Solving with Simulation Based Tasks
Hao, J., Liu, L., von Davier, A. A., & Kyllonen, P. C. (2015) · Computer-supported collaborative learning/The Computer-Supported Collaborative Learning Conference · doi:10.22318/cscl2015.297 · Cited by 42
Chatbot Acceptance: A Latent Profile Analysis on Individuals' Trust in Conversational Agents
Müller, L., Mattke, J., Maier, C., Weitzel, T., & Graser, H. (2019) · Proceedings of the 2019 on Computers and People Research Conference · doi:10.1145/3322385.3322392 · Cited by 42
Working Together Apart: Collaboration over the Internet
Olson, J. S., & Olson, G. M. (2014) · Synthesis lectures on human-centered informatics · doi:10.1007/978-3-031-02203-6 · Cited by 37
Towards a Better Understanding of Social Acceptability
Uhde, A., & Hassenzahl, M. (2021) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3411763.3451649 · Cited by 36
Collaborative Dynamic Queries: Supporting Distributed Small Group Decision-making
Hong, S. (., Suh, M. (., Henry Riche, N., Lee, J., Kim, J., & Zachry, M. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3173640 · Cited by 32
Self-citationThe relationship between recall and precision
BucklandMichael, & GeyFredric (1994) · Journal of the American Society for Information Science and Technology · doi:10.5555/184656.180369 · Cited by 26
Analyzing the Effectiveness of an Extensible Virtual Moderator
Bagmar, A., Hogan, K., Shalaby, D., & Purtilo, J. M. (2022) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3492837 · Cited by 23
Analyzing the quality of information solicited from targeted strangers on social media
Nichols, J. W., Zhou, M. X., Yang, H., Kang, J.-H., & Sun, X. H. (2013) · ACM Conference on Computer Supported Cooperative Work (CSCW) · doi:10.1145/2441776.2441886 · Cited by 19
Wang, X., Wen, M., & Rosé, C. P. (2017) · Computer-supported collaborative learning/The Computer-Supported Collaborative Learning Conference · doi:10.22318/cscl2017.7 · Cited by 17
Using a Conversational Agent to Facilitate Non-native Speaker's Active Participation in Conversation
Guo, Z., & Inoue, T. (2019) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3290607.3313075 · Cited by 17
Escaping the Echo Chamber: Ideologically and Geographically Diverse Discussions about Politics
Cambre, J., Klemmer, S., & Kulkarni, C. E. (2017) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3027063.3053265 · Cited by 13
Structuring Online Dyads: Explanations Improve Creativity, Chats Lead to Convergence
Ahmed, F., Chandra, N. R., Fuge, M., & Dow, S. P. (2019) · Creativity and Cognition · doi:10.1145/3325480.3325486 · Cited by 11
Crowdsourcing the Evaluation of Design Concepts With Empathic Priming
Pang, M. A., & Seepersad, C. C. (2016) · ASME International Design Engineering Technical Conferences and Computers and Information in Engineering Conference (IDETC/CIE) · doi:10.1115/detc2016-59417 · Cited by 10
(1994) · doi:10.1002/(sici)1097-4571(199401)45:1<39::aid-asi5>3.0.co;2-q
Research works printed but not linked: 19
- Martin Adam, Michael Wessel, and Alexander Benlian. 2020. AI-based chatbots in customer service and their effects on user compliance. Electronic Markets (2020), 1-19.
- Saul Albert and Jan P de Ruiter. 2018. Repair: the interface between interaction and cognition. Topics in cognitive science 10, 2 (2018), 279-313.
- Dennis Benner, Edona Elshan, Sofia Schöbel, and Andreas Janson. 2021. What do you mean? a review on recovery strategies to overcome conversational breakdowns of conversational agents. In International Conference on Information Systems (ICIS).
- Anthony D Bergstrom. 2011. Social mirrors: visualization as conversation feedback. Ph.D. Dissertation. University of Illinois at Urbana-Champaign.
- Virginia Braun and Victoria Clarke. 2006. Using thematic analysis in psychology. Qualitative research in psychology 3, 2 (2006), 77-101.
- The Concord Consortium. 2017. Teaching Teamwork. Retrieved Jan 22, 2021 from https://learn.concord.org/resources/ 565/teaching-teamwork-adder
- Fred D Davis. 1989. Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS quarterly (1989), 319-340.
- Gerardine DeSanctis and R Brent Gallupe. 1987. A foundation for the study of group decision support systems. Management science 33, 5 (1987), 589-609.
- James Fishkin, Nikhil Garg, Lodewijk Gelauff, Ashish Goel, Kamesh Munagala, Sukolsak Sakshuwong, Alice Siu, and Sravya Yandamuri. 2018. Deliberative democracy with the Online Deliberation platform. In The 7th AAAI Conference on Human Computation and Crowdsourcing (HCOMP 2019). HCOMP.
- Asbjørn Følstad and Cameron Taylor. 2019. Conversational repair in chatbots for customer service: the effect of expressing uncertainty and suggesting alternatives. In International Workshop on Chatbot Research and Design. Springer, 201-214.
- Taemie Kim, Agnes Chang, Lindsey Holland, and Alex Sandy Pentland. 2008. Meeting mediator: enhancing group collaborationusing sociometric feedback. In Proceedings of the 2008 ACM conference on Computer supported cooperative work. 457-466.
- Ben Lafreniere, Tanya R. Jonker, Stephanie Santosa, Mark Parent, Michael Glueck, Tovi Grossman, Hrvoje Benko, and Daniel Wigdor. 2021. False Positives vs. False Negatives: The Effects of Recovery Time and Cognitive Costs on Input Error Preference. In The 34th Annual ACM Symposium on User Interface Software and Technology. 54-68.
- J Richard Landis and Gary G Koch. 1977. The measurement of observer agreement for categorical data. biometrics (1977), 159-174.
- Christopher H Morrell. 1998. Likelihood ratio testing of variance components in the linear mixed-effects model using restricted maximum likelihood. Biometrics (1998), 1560-1568.
- Sherry L Piezon and William D Ferree. 2007. Perceptions of social loafing in online learning groups. In 23 rd Annual Conference on Distance Teaching & Learning, http://www. uwex. edu.
- Rachel Quednau. 2016. Top Strong Citizen Discussions this Week. Retrieved Jan 22, 2021 from https://www.strongtowns. org/journal/2016/4/13/top-strong-citizens-discussions?rq=slack
- Sandhya Saisubramanian, Shannon C Roberts, and Shlomo Zilberstein. 2021. Understanding User Attitudes Towards Negative Side Effects of AI Systems. In Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems. 1-6.
- James A Shepperd. 1993. Productivity loss in performance groups: A motivation analysis. Psychological bulletin 113, 1 (1993), 67.
- Sam R Wilson, William C Barley, Luisa Ruge-Jones, and Marshall Scott Poole. 2020. Tacking Amid Tensions: Using Oscillation to Enable Creativity in Diverse Teams. The Journal of Applied Behavioral Science (2020), 0021886320960245.
Cited by
“As an AI language model, I cannot”: Investigating LLM Denials of User Requests
Wester, J., Schrills, T., Pohl, H., & van Berkel, N. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642135 · Cited by 36
Cai, Z., Park, S., Nixon, N., & Doroudi, S. (2024) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3613905.3650868 · Cited by 56
Are We On Track? AI-Assisted Active and Passive Goal Reflection During Meetings
Chen, X., Tankelevitch, L., Vanukuru, R., Scott, A. E., Panda, P., & Rintel, S. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3714052 · Cited by 52
Fok, R., Lipka, N., Sun, T., & Siu, A. F. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3641969 · Cited by 37
Rayan, J. A., Kanetkar, D., Gong, Y., Yang, Y., Palani, S., Xia, H., & Dow, S. P. (2024) · Creativity and Cognition · doi:10.1145/3635636.3656184 · Cited by 37
Metadata
- Authors
- Do, H. J., Kong, H.-K., Tetali, P., Lee, J., & Bailey, B. P.
- Affiliations
- University of Illinois Urbana-Champaign (US)
- Seattle University (US)
- University of Washington (US)
- Venue
- Proceedings of the ACM on Human-Computer Interaction
- Published
- 2023-04-14
- Volume
- 7
- Issue
- CSCW1
- Pages
- 1-23
- ISSN
- 2573-0142 (ISSN-L)
- OpenAlex
- W4366003147
- Cited by
- 32
- References
- 74
- Citations by year
- 2026: 12 · 2025: 12 · 2024: 8
- FWCI
- 9.47
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Proceedings of the ACM on Human-Computer Interaction (publishedVersion)
- Topics
- Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
- Social Sciences › Business, Management and Accounting › Marketing › AI in Service Interactions
- Physical Sciences › Computer Science › Human-Computer Interaction › Innovative Human-Technology Interaction
- Keywords
- chatbots, conversational repair, false positives, false negative errors, user acceptance, group participation, decision-making groups, precision-recall trade-off, trust in AI
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.