Moderator Chatbot for Deliberative Discussion: Effects of Discussion Structure and Discussant Facilitation
The DOI matches its Crossref record; 18 of the 18 references it cites were found in a registry or an index.
Abstract
Online chat functions as a discussion channel for diverse social issues. However, deliberative discussion and consensus-reaching can be difficult in online chats in part because of the lack of structure. To explore the feasibility of a conversational agent that enables deliberative discussion, we designed and developed DebateBot, a chatbot that structures discussion and encourages reticent participants to contribute. We conducted a 2 (discussion structure: unstructured vs. structured) × 2 (discussant facilitation: unfacilitated vs. facilitated) between-subjects experiment (N = 64, 12 groups). Our findings are as follows: (1) Structured discussion positively affects discussion quality by generating diverse opinions within a group and resulting in a high level of perceived deliberative quality. (2) Facilitation drives a high level of opinion alignment between group consensus and independent individual opinions, resulting in authentic consensus reaching. Facilitation also drives more even contribution and a higher level of task cohesion and communication fairness. Our results suggest that a chatbot agent could partially substitute for a human moderator in deliberative discussions.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Social Influence: Compliance and Conformity
Cialdini, R. B., & Goldstein, N. J. (2004) · Annual Review of Psychology · doi:10.1146/annurev.psych.55.090902.142015 · Cited by 6,077 · cited 1×
“This concept is based on the idea of social conformity, where participants may agree with a majority opinion even when they may actually have different thoughts on a given matter [12].”
BackgroundSocial loafing: a meta-analytic review and theoretical integration.
Karau, S. J., & Williams, K. D. (1993) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.65.4.681 · Cited by 2,196
Licklider, J. C. R. (1960) · IRE Transactions on Human Factors in Electronics · doi:10.1109/thfe2.1960.4503259 · Cited by 1,938
Awad, E., Dsouza, S., Kim, R., Schulz, J., Henrich, J., Shariff, A., Bonnefon, J.-F., & Rahwan, I. (2018) · Nature · doi:10.1038/s41586-018-0637-6 · Cited by 1,859 · cited 2×
“Participants discussed two ethical dilemmas: the moral machine dilemma of self-driving cars [3] and the self-aware AI dilemma [71].”
BackgroundHearing the Other Side: Deliberative versus Participatory Democracy
Mutz, D. C. (2006) · doi:10.1017/cbo9780511617201 · Cited by 1,687
Rise of Machine Agency: A Framework for Studying the Psychology of Human–AI Interaction (HAII)
Sundar, S. S. (2020) · Journal of Computer-Mediated Communication · doi:10.1093/jcmc/zmz026 · Cited by 871
Society-in-the-loop: programming the algorithmic social contract
Rahwan, I. (2018) · Ethics and Information Technology · doi:10.1007/s10676-017-9430-8 · Cited by 553
"I Hear You, I Feel You": Encouraging Deep Self-disclosure through a Chatbot
Lee, Y.-C., Yamashita, N., Huang, Y., & Fu, W. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376175 · Cited by 339 · cited 1×
“The effectiveness of dyadic chatbots has mainly been assessed by manipulating message-level variables such as conversational style [42], empathic responses [33], typeface [8], and self-disclosure [48].”
BackgroundDoing Synchronous Online Focus Groups With Young People: Methodological Reflections
Fox, F. E., Morris, M., & Rumsey, N. (2007) · Qualitative Health Research · doi:10.1177/1049732306298754 · Cited by 248 · cited 2×
“In situations where a moderator might have been able to manage a heated conversation, the absence of such a moderator can intensify the natural drawbacks of unstructured, unthreaded discussions [23, 41].”
BackgroundJakesch, M., French, M., Ma, X., Hancock, J. T., & Naaman, M. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300469 · Cited by 190
Understanding Chatbot-mediated Task Management
Toxtli, C., Monroy-Hernández, A., & Cranshaw, J. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3173632 · Cited by 127 · cited 1×
“They can arrange group schedules [15], manage tasks [76], and help collaborative information-seeking [2].”
BackgroundMobilizing the Trump Train: Understanding Collective Action in a Political Trolling Community
Flores-Saviaga, C., Keegan, B., & Savage, S. (2018) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v12i1.15024 · Cited by 111
Calendar.help: Designing a Workflow-Based Scheduling Agent with Humans in the Loop
Cranshaw, J., Elwany, E., Newman, T., Kocielnik, R., Yu, B., Soni, S., Teevan, J., & Monroy-Hernández, A. (2017) · Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3025453.3025780 · Cited by 106 · cited 1×
“They can arrange group schedules [15], manage tasks [76], and help collaborative information-seeking [2].”
BackgroundBeyond Dyadic Interactions: Considering Chatbots as Community Members
Seering, J., Luria, M., Kaufman, G., & Hammer, J. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300680 · Cited by 97 · cited 3×
“Extending previous research [41, 66, 68, 69], the current study suggests that a chabot agent has the potential to play the role of moderator and facilitator in the discussion by encouraging positive group dynamics.”
BackgroundMethodSelf-citationKowatsch, T., Nißen, M. K., Shih, C.-H. I., Rüegger, D., Volland, D., Filler, A., Künzler, F., Barata, F., Hung, S., Büchter, D., et al. (2017) · ETH Zurich · doi:10.3929/ethz-b-000218776 · Cited by 74
A critical comparison of offline focus groups, online focus groups, and e-Delphi
(2009) · International Journal of Market Research · doi:10.2501/s1470785309200608 · Cited by 63 · cited 1×
“This operationalization is based on a previous work that measured the breadth of the discussion based on the number of substantive words and arguments [6].”
MethodSolutionChat: Real-time Moderator Support for Chat-based Structured Discussion
Lee, S.-C., Song, J., Ko, E.-Y., Park, S., Kim, J., & Kim, J. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376609 · Cited by 49 · cited 4×
“Previous studies have developed systems to enable reasoned argumentation [18, 52, 64] and a balanced and valid perspective [40, 45] and to help human moderation [47].”
BackgroundInfluentialCicero: Multi-Turn, Contextual Argumentation for Accurate Crowdsourcing
Chen, Q., Bragg, J., Chilton, L. B., & Weld, D. S. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300761 · Cited by 41
Cited by
Enhancing AI-Assisted Group Decision Making through LLM-Powered Devil's Advocate
Chiang, C.-W., Lu, Z., Li, Z., & Yin, M. (2024) · Proceedings of the 29th International Conference on Intelligent User Interfaces · doi:10.1145/3640543.3645199 · Cited by 142
Zheng, C., Wu, Y., Shi, C., Ma, S., Luo, J., & Ma, X. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581131 · Cited by 48
IntroBot: Exploring the Use of Chatbot-assisted Familiarization in Online Collaborative Groups
Shin, D., Kim, S., Shang, R., Lee, J., & Hsieh, G. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3580930 · Cited by 37
Self-citationDo, H. J., Kong, H.-K., Tetali, P., Lee, J., & Bailey, B. P. (2023) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3579532 · Cited by 32
Self-citationKuo, T.-S., Chen, Q. Z., Zhang, A. X., Hsieh, J., Zhu, H., & Holstein, K. (2025) · Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713865 · Cited by 12
Metadata
- Authors
- Kim, S., Eun, J., Seering, J., & Lee, J.
- Venue
- Proceedings of the ACM on Human-Computer Interaction
- Published
- 2021-04-13
- Volume
- 5
- Issue
- CSCW1
- Pages
- 1-26
- ISSN
- 2573-0142 (ISSN-L)
- OpenAlex
- W3159769162
- Cited by
- 84
- References
- 18
- FWCI
- 9.68
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.