Towards Human-AI Deliberation: Design and Evaluation of LLM-Empowered Deliberative AI for AI-Assisted Decision-Making
The DOI matches its Crossref record; 139 of the 139 references it cites were found in a registry or an index; 9 of the 117 sources its claims cite were checked for support.
Abstract
Traditional AI-assisted decision-making systems often provide fixed recommendations that users must either accept or reject entirely, limiting meaningful interaction - especially in cases of disagreement. To address this, we introduce Human-AI Deliberation, an approach inspired by human deliberation theories that enables dimension-level opinion elicitation, iterative decision updates, and structured discussions between humans and AI. At the core of this approach is Deliberative AI, an assistant powered by large language models (LLMs) that facilitates flexible, conversational interactions and precise information exchange with domain-specific models. Through a mixed-methods user study, we found that Deliberative AI outperforms traditional explainable AI (XAI) systems by fostering appropriate human reliance and improving task performance. By analyzing participant perceptions, user experience, and open-ended feedback, we highlight key findings, discuss potential concerns, and explore the broader applicability of this approach for future AI-assisted decision-making systems.
Overview
CoChat Summary
TL;DR
The paper proposes Human-AI Deliberation, an LLM-empowered Deliberative AI that integrates domain-specific models with LLMs to support dimension-level opinion elicitation, iterative updates, and structured human-AI discussion in AI-assisted decision-making. In an exploratory graduate-admissions study, Deliberative AI improved decision accuracy and reduced over-reliance compared with traditional XAI, though it lowered trust and satisfaction.
Key findings
- Decision accuracy was significantly higher in Deliberative AI (M=0.598, SD=0.169) than in XAI (M=0.524, SD=0.16, p<0.05).
- Deliberative AI showed lower agreement fraction (M=0.57, SD=0.24 vs. M=0.68, SD=0.27, p<0.05) and lower switch fraction (M=0.23, SD=0.35 vs. M=0.51, SD=0.41, p<0.001) than XAI; over-reliance was lower (M=0.47, SD=0.31 vs. M=0.65, SD=0.33, p<0.001), while under-reliance did not differ significantly (M=0.32, SD=0.28 vs. M=0.29, SD=0.30).
- Deliberative AI participants reported lower trust than XAI participants (M=4.47, SD=1.68 vs. M=5.52, SD=1.27, p<0.01); no significant differences were found for helpfulness, understanding, mental demand, effort, or complexity, but satisfaction was significantly lower in Deliberative AI than in Human Alone. XAI participants reported higher confidence than Human Alone (M=6, SD=1.10 vs. M=5.59, SD=1.12, p<0.05) despite XAI final accuracy being lower than Human Alone.
- Qualitatively, 43/48 Deliberative AI participants felt deliberation helped them make more informed decisions; 21/48 identified AI limitations, 15/48 reflected on and corrected their own mistakes, and 18/48 gained new knowledge. For AI updates, 25/48 said updates improved user experience, but 11/48 felt the AI updated too frequently and 13/48 were uncertain why or how the AI was updating.
Methods
- Between-subjects mixed-methods study on Prolific: 174 recruited, 153 valid responses (Deliberative AI: 48, XAI: 51, Human Alone: 54). Participants had US graduate-admission experience and completed four main graduate-admission cases plus a tutorial.
- The task used a synthesized dataset of 100 applicant profiles; a domain-specific linear regression classifier achieved 80% accuracy on a 30% test set. Study cases were selected from the test set and intentionally chosen to be ambiguous/conflict-prone, with human and AI individual performance between 50% and 60%.
- Quantitative analysis used non-parametric tests (Mann-Whitney U; Kruskal-Wallis with Bonferroni correction); qualitative analysis used inductive thematic analysis of open-ended feedback and conversation logs. Pilot work included 30 participants and 226 deliberative statements; the Intention Analyzer reached 96% accuracy, and the Argument Evaluator showed Cohen’s κ=0.78 agreement with human scores.
Limitations
- Stated: the college admissions task does not fully capture real-world admissions; SOP and recommendation-letter strength are reduced to scale values; participants were not actual admissions committee members; most had master’s rather than PhD admissions experience, so findings may not generalize to PhD admissions.
- Stated: graduate admissions is subjective and lacks definitive ground truth; dataset labels came from a professional admissions committee, and accuracy plus over/under-reliance were used as objective metrics “to some extent.” The study used only four main tasks due to pilot fatigue, and the selected cases were intentionally ambiguous with low independent human/AI accuracy (50–60%), leaving less-ambiguous cases unaddressed.
- Evident/mentioned: the AI opinion-update mechanism was not disclosed to participants, and some doubted its transparency or reliability; the LLM was GPT-3.5 and the domain model was a linear regression classifier, limiting claims about other models or tasks; the authors describe the study as exploratory rather than an effectiveness test for graduate admissions.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
3 Valid · 3 Not valid · 51 Not checked · 137 Own results and interpretations
At least one cited source doesn’t support this claim or points to a different paper, and none confirmed it — see the verdicts below.
In the paper
“However, unlike in [16], where cognitive effort significantly increased under-reliance (i.e., humans under high cognitive effort may blindly ignore AI's suggestions), our findings reveal no such adverse effect.”
What the sources say
- Disputedcites [16] [16] Zana Buçinca, Maja Barbara Malaya, and Krzysztof Z Gajos. 2021. To trust or to think: cognitive forcing functions can reduce overreliance on AI in AI-assisted decision-making. Proceedings of the ACM on Human-Computer Interaction 5, CSCW1 (2021), 1-21. - sourceExperimental — accuracy not yet measured
Our copy of Buçinca et al. (2021) reports the opposite of what the citing sentence attributes to it: in Section 4.1 (Objective measures), participants in the cognitive forcing conditions 'overrelied less' and 'there were no significant differences between categories for human errors' (both for overall performance and for carb source detection, where CFF participants 'overrelied significantly less'). The Discussion (Sec. 6) likewise states that cognitive forcing functions 'reduced overreliance on AI compared to the simple explainable AI approaches', with the trade-off being reduced perceived usability/trust/preference, not increased disregard of correct AI suggestions. Nowhere does our copy report that cognitive effort significantly increased under-reliance; the adverse effect the citing paper contrasts against is not this paper's finding. (LLM, conf=0.78)
Checked by a reasoning model — may be wrong.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Disputed
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Second, instead of full consensus or complete divergence, human and AI decision rationales often exhibit partial alignment [113, 128].”
What the sources say
- Supportedcites [113] [113] Venkatesh Sivaraman, Leigh A Bukowski, Joel Levin, Jeremy M Kahn, and Adam Perer. 2023. Ignore, trust, or negotiate: understanding clinician acceptance of AI-based treatment recommendations in health care. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems . 1-18. - source
Section 5.2.2 (Negotiate) states that 'the most common behavior pattern we observed was of participants selectively adopting aspects of the recommendation', arriving at 'an intermediate solution', and Fig. 6 contrasts this with the Ignore All / Accept All extremes — i.e. neither full consensus nor complete divergence. Section 5.2 (Patterns of Interaction) reinforces this quantitatively: actions 'did not perfectly align with the AI either' (only 6 of 36 discordant-with-attending decisions showed full concordance with the AI), and Section 6.1 describes 'negotiated partial forms of reliance'. The one qualification is that our copy frames the alignment in terms of clinicians' treatment decisions and their think-aloud reasoning in a single ICU sepsis task, not 'rationales' as such across human–AI decisions generally; the citing sentence generalizes slightly beyond that setting. (LLM, conf=0.82)
- Partly supportedcites [128] [128] Xinru Wang and Ming Yin. 2023. Watch Out for Updates: Understanding the Effects of Model Explanation Updates in AI-Assisted Decision Making. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems . 1-19. - sourceExperimental — accuracy not yet measured
Our copy treats human-AI alignment as a matter of degree rather than all-or-nothing: the Introduction (Sec. 1) writes that 'the more its explanations align with the human rationale, the more accurate users perceive the model to be', and Sec. 5.4 acknowledges that agreement fraction 'may reflect the natural agreement between people's independent decisions and the AI recommendations to some extent' — i.e. partial, not total, convergence. However, the paper never states that human and AI decision rationales 'often exhibit partial alignment rather than full consensus or complete divergence'; the rationale-alignment point it does make is explicitly credited to prior work ([63]), and the study's own similarity manipulations (Sec. 4.2.2, feature agreement scores 1.0/0.5/0.07) concern the old vs. updated AI explanations, not human vs. AI rationales. The 'decisions' rather than 'rationales' framing and the absent frequency claim ('often') are the parts not supported by this source. (LLM, conf=0.65)
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“First, a battery of empirical studies found that people rarely trigger analytical thinking when directly presented with AI's suggestions [11, 15, 105].”
What the sources say
- Not checked yetcites [11] [11] Astrid Bertrand, Rafik Belloum, James R Eagan, and Winston Maxwell. 2022. How Cognitive Biases Affect XAI-assisted Decision-making: A Systematic Review. In Proceedings of the 2022 AAAI/ACM Conference on AI, Ethics, and Society . 78-91. - source
Checked before — its earlier verdict is held back until a new check runs.
- Supportedcites [15] [15] Zana Buçinca, Phoebe Lin, Krzysztof Z Gajos, and Elena L Glassman. 2020. Proxy tasks and subjective measures can be misleading in evaluating explainable AI systems. In Proceedings of the 25th international conference on intelligent user interfaces . 454-464. - source
The Discussion (p. 9) states outright that in actual decision-making situations people often choose not to engage in effortful analytical thinking, and that in the paper's own actual-task condition participants 'could complete the task even without engaging with the explanations' and 'chose to over-rely on the AI's recommendation, just to avoid cognitive effort'. The Introduction (p. 1) makes the same point — people favor heuristics over analytical thinking — and Section 2.1 (p. 2) reports that engagement with a system's recommendation required a cognitive forcing strategy (Green & Chen), i.e. it does not happen spontaneously when the AI's suggestion is simply shown. Together these cover the claim's substance, including its AI-suggestion specificity; the only hedge ('we suspect') attaches to the mechanism behind the over-reliance, not to the reluctance to think analytically itself. (LLM, conf=0.85)
- Supportedcites [105] [105] Charvi Rastogi, Yunfeng Zhang, Dennis Wei, Kush R Varshney, Amit Dhurandhar, and Richard Tomsett. 2022. Deciding fast and slow: The role of cognitive biases in ai-assisted decision-making. Proceedings of the ACM on Human-Computer Interaction 6, CSCW1 (2022), 1-22. - source
Section 4 (Anchoring Bias) states that in AI-assisted decision-making 'the human decision-maker is irrationally anchored to the AI-generated decision' and that 'after being anchored, humans tend to adjust insufficiently because adjustments are effortful and tend to stop once a plausible estimate is reached'; the Introduction adds that anchoring 'manifests through blind reliance on the anchor... which limits the exploration of alternative hypotheses'. The paper's own Experiment 1 (Sec. 4.1) reports that 'the likelihood of disagreement for unmodified trials is low (close to 0.1)', i.e. participants almost always accepted the presented AI prediction, and Sec. 5.3 reports agreement percentages of ~84-88% in the collaborative conditions. Related Work (Sec. 2) likewise relays that users 'display over-reliance on AI due to blind trust in automation' and 'do not calibrate their reliance on AI based on its accuracy'. Together these carry the claim's content — people seldom engage the effortful, analytical adjustment once an AI suggestion is in front of them — so the paraphrase is supported; the only wording difference is that the paper speaks of anchoring/insufficient adjustment and heuristic thinking rather than 'triggering analytical thinking'. (LLM, conf=0.82)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Not checked yet
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“However, existing research has found that when people are provided with a recommendation and passively look at it, they often lack analytical thinking, leading to over-reliance or under-reliance on AI systems [15, 42, 64, 79].”
What the sources say
- Partly supportedcites [15] [15] Zana Buçinca, Phoebe Lin, Krzysztof Z Gajos, and Elena L Glassman. 2020. Proxy tasks and subjective measures can be misleading in evaluating explainable AI systems. In Proceedings of the 25th international conference on intelligent user interfaces . 454-464. - sourceExperimental — accuracy not yet measured
Our copy supports most of the paraphrase: the Discussion (p. 9) states that 'in actual decision-making situations, people often choose not to engage in effortful analytical thinking, even in high-stakes situations like medical diagnosis', and the Introduction (p. 1) that people 'favor less demanding forms of cognition, i.e., heuristics over analytical thinking' when their cognitive focus is elsewhere rather than on the AI (the passive-viewing situation the proxy/actual-task contrast describes). The over-reliance half is also there: the Discussion (p. 9) infers participants 'chose to over-rely on the AI's recommendation, just to avoid cognitive effort of examining those explanations'. However, the paired 'under-reliance' is not attributed to a lack of analytical thinking in this paper — the front matter (p. 1) presents it as the opposite end of the trust spectrum ('they might exhibit self-reliance and ignore the system's correct recommendations'), a trust-calibration problem rather than a consequence of disengagement, and the paper's own under-reliance-type result (participants ignoring incorrect AI recommendations, Discussion p. 9) is tied to explanation type, not to effort avoidance. Also note the paper hedges its causal link ('we suspect'), while the citing sentence reports it as a finding of existing research, and credits the analytical-thinking evidence to other works ([24, 25, 31]). (LLM, conf=0.72)
- Partly supportedcites [42] [42] Krzysztof Z Gajos and Lena Mamykina. 2022. Do People Engage Cognitively with AI? Impact of AI Assistance on Incidental Learning. In 27th International Conference on Intelligent User Interfaces . 794-806. - sourceExperimental — accuracy not yet measured
Gajos & Mamykina (2022) supports the over-reliance half of the claim: the Introduction (p. 1) states that previous studies showed a human tendency to over-rely on AI-generated recommendations, 'which suggests that people may be processing information provided by AI superficially rather than engaging with it deeply and critically,' and the Related Work (p. 2) reports 'converging evidence that people overrely on the AI-generated recommendations'; the Discussion (p. 11) adds 'compelling evidence ... that people do not carefully process the AI-generated information when given a decision recommendation and an explanation.' However, no passage in our copy attributes under-reliance to this line of work — the paper discusses only over-reliance (and interventions that reduce it). Also, the source frames the superficial-processing account as a suggestion/hypothesis rather than an established finding, whereas the citing sentence states it as what research 'has found.' (LLM, conf=0.78)
- Not checked yetcites [64] [64] Harmanpreet Kaur, Harsha Nori, Samuel Jenkins, Rich Caruana, Hanna Wallach, and Jennifer Wortman Vaughan. 2020. Interpreting interpretability: understanding data scientists' use of interpretability tools for machine learning. In Proceedings of the 2020 CHI conference on human factors in computing systems . 1-14. - source
- Partly supportedcites [79] [79] QVera Liao and Kush R Varshney. 2021. Human-Centered Explainable AI (XAI): From Algorithms to User Experiences. arXiv preprint arXiv:2110.10790 (2021). - sourceExperimental — accuracy not yet measured
Section 4 (p. 10) of our copy supports the cognitive core of the claim: via dual-process theories, 'people are more likely to engage in System 1 thinking' rather than attending to every bit of explanations, and people resort to System 1 when they 'lack either the ability or motivation ... to perform analytical thinking'. The reliance consequences are present but hedged and framed as possibilities/risks rather than established findings — 'It is possible that people superficially associate the ability to provide explanations directly with competence, and therefore form unwarranted trust and confidence' (p. 10) and 'the risk of mistrust and misuse of AI' (p. 10), with 'appropriate reliance' discussed only as a desideratum (p. 8). The citing sentence therefore states as a settled finding what this source presents as an emerging awareness, and the source's account concerns processing of AI explanations/recommendations in XAI contexts specifically. (LLM, conf=0.75)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources that could be checked couldn’t confirm or dispute this claim.
In the paper
“Despite this, engaging users with strong subjective perspectives remains challenging [80].”
What the sources say
- Could not verifycites [80] [80] Hanmeng Liu, Ruoxi Ning, Zhiyang Teng, Jian Liu, Qiji Zhou, and Yue Zhang. 2023. Evaluating the logical reasoning ability of chatgpt and gpt-4. arXiv preprint arXiv:2304.03439 (2023). - sourceExperimental — accuracy not yet measured
Our copy of Liu et al. (2023) is confined to logical-reasoning evaluation on NLI and multi-choice reading-comprehension benchmarks (Sec. 2 Evaluation Settings; Secs. 3.1–3.2 results; Sec. 4.1 error analysis, 4.2 in-context learning, 4.3 chain-of-thought), and its stated limitations concern out-of-distribution datasets and instruction-following, not user engagement or subjective perspectives. Searched for 'subjective perspective / stance / opinion / user engagement / interactivity' and for conversational/empathetic limitations: no passage in our copy addresses engaging users holding strong subjective viewpoints. Nothing contrary is said either, so the claim is simply outside this source's scope. (LLM, conf=0.72)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Could not verify
73 more claims
Create a free account to see all 194 claims and to verify the 103 references still open.
- It may state two separate claims as one. 68
- Probably not a substantial claim. 75
Citations
Cites
Three Approaches to Qualitative Content Analysis
Hsieh, H.-F., & Shannon, S. E. (2005) · Qualitative Health Research · doi:10.1177/1049732305276687 · Cited by 44,601 · cited 2×
“For qualitative analysis, two authors independently coded participants’ open-ended feedback and conversation logs using an inductive thematic analysis approach [61].”
Statistical power analyses using G∗Power 3.1: tests for correlation and regression analyses
Faul, F., Erdfelder, E., Buchner, A., & Lang, A.-G. (2009) · Behavior Research Methods · doi:10.3758/brm.41.4.1149 · Cited by 37,615 · cited 1×
“Helpfulness “I think the AI model’s assistance is helpful/useful for me to make good decisions.”
Decision making with the analytic hierarchy process
Saaty, T. L. (2008) · International Journal of Services Sciences · doi:10.1504/ijssci.2008.017590 · Cited by 10,301 · cited 1×
“Finally, based on theories and practices in human de-liberation, we introduce the design considerations and structure of Deliberative AI , the core AI component of our framework.”
Trust in Automation: Designing for Appropriate Reliance
Lee, J. D., & See, K. A. (2004) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/hfes.46.1.50_30392 · Cited by 6,605 · cited 1×
“Both over-reliance, where individuals trust AI excessively [78, 104], and under-trust, where individuals fail to utilize AI when necessary [78], can lead to adverse outcomes.”
Explanation in artificial intelligence: Insights from the social sciences
Miller, T. (2019) · Artificial Intelligence · doi:10.1016/j.artint.2018.07.007 · Cited by 5,302
Survey of Hallucination in Natural Language Generation
Ji, Z., Lee, N., Frieske, R., Yu, T., Su, D., Xu, Y., Ishii, E., Bang, Y. J., Madotto, A., & Fung, P. (2023) · ACM Computing Surveys · doi:10.1145/3571730 · Cited by 5,025
Humans and automation: Use, misuse, disuse, abuse
Parasuraman, R., & Riley, V. (1997) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872097778543886 · Cited by 4,554 · cited 2×
“Both over-reliance, where individuals trust AI excessively [78, 104], and under-trust, where individuals fail to utilize AI when necessary [78], can lead to adverse outcomes.”
NASA-Task Load Index (NASA-TLX); 20 Years Later
Hart, S. G. (2006) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/154193120605000909 · Cited by 4,297 · cited 1×
“Meanwhile, as deliberation requires extra efforts, we evaluated participants’ self-reported Mental Demand [17, 46, 56, 71], Effort [56], Complexity [17], and Satisfaction [17, 46] via 7-point Likert scale.”
Models of Bounded Rationality: Empirically Grounded Economic Reason
Simon, H. A. (1997) · The MIT Press eBooks · doi:10.7551/mitpress/4711.001.0001 · Cited by 4,205
Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks
Lewis, P., Perez, E., Piktus, A., Petroni, F., Karpukhin, V., Goyal, N., Küttler, H., Lewis, M., Yih, W.-T., Rocktäschel, T., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.11401 · Cited by 3,101 · cited 1×
“” (P33)”
Construction and Evaluation of a User Experience Questionnaire
Laugwitz, B., Held, T., & Schrepp, M. (2008) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-89350-9_6 · Cited by 2,114 · cited 1×
“””
Causability and explainability of artificial intelligence in medicine
Holzinger, A., Langs, G., Denk, H., Zatloukal, K., & Müller, H. (2019) · WIREs Data Mining and Knowledge Discovery · doi:10.1002/widm.1312 · Cited by 1,885 · cited 2×
“” Similarly, P17 (Female, 60) inquired, “ Could you explain why you see an engineering major and Asian origin as negatives?”
Proceedings for the Annual Meeting of the Cognitive Science Society
Dziemianko, M., Clarke, A. D. F., & Keller, F. (2013) · Cited by 1,726
Amazon Scraps Secret AI Recruiting Tool that Showed Bias against Women *
Dastin, J. (2022) · Ethics of Data and Analytics · doi:10.1201/9781003278290-44 · Cited by 1,165
On making the right choice: the deliberation-without-attention effect.
Dijksterhuis, A., Bos, M. W., Nordgren, L. F., & van Baaren, R. B. (2006) · Science · doi:10.1126/science.1121629 · Cited by 1,159 · cited 1×
“Research underscores that deliberative decisions tend to be wiser and more effective owing to their foundation in thorough information and thoughtful analysis [30, 74].”
Buçinca, Z., Malaya, M. B., & Gajos, K. Z. (2021) · arXiv · doi:10.48550/arxiv.2102.09692 · Cited by 1,124
GALTON, F. (1907) · Nature · doi:10.1038/075450a0 · Cited by 1,080 · cited 1×
“We propose the following formula to update the AI’s opinions ( ˆ 𝑂 𝐴𝐼 ) on an attribute based on these factors, inspired by result aggregation in crowd intelligence [44, 89]:”
The accuracy, fairness, and limits of predicting recidivism
Dressel, J., & Farid, H. (2018) · Science Advances · doi:10.1126/sciadv.aao5580 · Cited by 1,071 · cited 2×
“With remarkable technological advancements, AI has been increasingly used to support people in making decisions in various domains, including criminal justice [32, 35], admissions [25, 140], financial investment [53], and medical diagnosis [21, 79], among others.”
Vision-Language Models for Vision Tasks: A Survey
Zhang, J., Huang, J., Jin, S., & Lu, S. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3369699 · Cited by 1,051 · cited 1×
“We need future studies to truly explore whether and why Deliberative AI yields improvement in real-world college admission decision-making.”
Deliberative Democratic Theory and Empirical Political Science
Thompson, D. F. (2008) · Annual Review of Political Science · doi:10.1146/annurev.polisci.11.081306.070555 · Cited by 987 · cited 4×
“Deliberation proves effective in facilitating various human decision-making tasks, including deliberative politics [13, 54, 123], clinical diagnosis [62, 108, 111], criminal justice [29, 126], and more.”
InfluentialQuestioning the AI: Informing Design Practices for Explainable AI User Experiences
Liao, Q. V., Gruen, D., & Miller, S. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376590 · Cited by 925 · cited 1×
“Then, we introduce its overall architecture proposed in accordance with these considerations.”
Zhang, Y., Liao, Q. V., & Bellamy, R. K. E. (2020) · Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency · doi:10.1145/3351095.3372852 · Cited by 895
Consumer credit-risk models via machine-learning algorithms
Khandani, A. E., Kim, A. J., & Lo, A. W. (2010) · Journal of Banking & Finance · doi:10.1016/j.jbankfin.2010.06.001 · Cited by 864
Weight of Evidence: a framework for the appraisal of the quality and relevance of evidence
Gough, D. (2007) · Research Papers in Education · doi:10.1080/02671520701296189 · Cited by 830 · cited 3×
“Moreover, deliberation allows participants to refine their viewpoints through informed discussions about opinion discrepancies [50, 51, 106].”
Does the Whole Exceed its Parts? The Effect of AI Explanations on Complementary Team Performance
Bansal, G., Wu, T., Zhou, J., Fok, R., Nushi, B., Kamar, E., Ribeiro, M. T., & Weld, D. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445717 · Cited by 757
Does the Whole Exceed its Parts? The Effect of AI Explanations on Complementary Team Performance
Bansal, G., Wu, T., Zhou, J., Fok, R., Nushi, B., Kamar, E., Ribeiro, M. T., & Weld, D. S. (2020) · arXiv · doi:10.48550/arxiv.2006.14779 · Cited by 754
Manipulating and Measuring Model Interpretability
Poursabzi-Sangdeh, F., Goldstein, D. G., Hofman, J. M., Wortman Vaughan, J. W., & Wallach, H. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445315 · Cited by 728
Measuring Political Deliberation: A Discourse Quality Index
Steenbergen, M. R., Bächtiger, A., Spörndli, M., & Steiner, J. (2003) · Comparative European Politics · doi:10.1057/palgrave.cep.6110002 · Cited by 719 · cited 3×
“In this paper, based on guidelines and theories in human deliberation [3, 4, 119] and decision-making [2, 10, 134], we introduce a novel framework, Human-AI Deliberation for AI-assisted decision-making (Figure 1 (b)).”
Manipulating and Measuring Model Interpretability
Poursabzi-Sangdeh, F., Goldstein, D. G., Hofman, J. M., Vaughan, J. W., & Wallach, H. (2018) · arXiv · doi:10.48550/arxiv.1802.07810 · Cited by 711
Simon, H. A. (1990) · Utility and Probability · doi:10.1007/978-1-349-20568-4_5 · Cited by 705
'It's Reducing a Human Being to a Percentage': Perceptions of Justice in Algorithmic Decisions
Binns, R., Van Kleek, M., Veale, M., Lyngs, U., Zhao, J., & Shadbolt, N. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3173951 · Cited by 691
Receiving other people’s advice: Influence and benefit
Yaniv, I. (2004) · Organizational Behavior and Human Decision Processes · doi:10.1016/j.obhdp.2003.08.002 · Cited by 652
Democratic reason: politics, collective intelligence, and the rule of the many
(2013) · Choice Reviews Online · doi:10.5860/choice.51-0525 · Cited by 637
Sourcebook for Political Communication Research: Methods, Measures, and Analytical Techniques
Bucy, E. P., & Holbert, R. L. (2010) · Routledge eBooks · doi:10.4324/9780203938669 · Cited by 601
Cai, C. J., Winter, S., Steiner, D., Wilcox, L., & Terry, M. (2019) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3359206 · Cited by 594 · cited 3×
“With remarkable technological advancements, AI has been increasingly used to support people in making decisions in various domains, including criminal justice [32, 35], admissions [25, 140], financial investment [53], and medical diagnosis [21, 79], among others.”
Dilsizian, S. E., & Siegel, E. L. (2014) · Current Cardiology Reports · doi:10.1007/s11886-013-0441-8 · Cited by 579 · cited 1×
“Artificial Intelligence (AI) is increasingly used in decision-making across various domains [28, 31, 68, 93, 95, 144].”
Kaur, H., Nori, H., Jenkins, S., Caruana, R., Wallach, H., & Wortman Vaughan, J. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376219 · Cited by 564 · cited 1×
“Additionally, we demonstrate its potential to improve decision accuracy and promote appropriate human reliance on AI.”
Jury decision making: 45 years of empirical research on deliberating groups.
Devine, D. J., Clayton, L. D., Dunford, B. B., Seying, R., & Pryce, J. (2001) · Psychology Public Policy and Law · doi:10.1037//1076-8971.7.3.622 · Cited by 523 · cited 4×
“Deliberation proves effective in facilitating various human decision-making tasks, including deliberative politics [13, 54, 123], clinical diagnosis [62, 108, 111], criminal justice [29, 126], and more.”
InfluentialDemocracy When the People Are Thinking
Fishkin, J. S. (2018) · Oxford Scholarship Online · doi:10.1093/oso/9780198820291.001.0001 · Cited by 489
How Deliberation Affects Policy Opinions
BARABAS, J. (2004) · American Political Science Review · doi:10.1017/s0003055404041425 · Cited by 487
Beyond Accuracy: The Role of Mental Models in Human-AI Team Performance
Bansal, G., Nushi, B., Kamar, E., Lasecki, W. S., Weld, D. S., & Horvitz, E. (2019) · Proceedings of the AAAI Conference on Human Computation and Crowdsourcing · doi:10.1609/hcomp.v7i1.5285 · Cited by 466 · cited 1×
“Additionally, we demonstrate its potential to improve decision accuracy and promote appropriate human reliance on AI.”
Logic and human reasoning: An assessment of the deduction paradigm.
Evans, J. S. B. T. (2002) · Psychological Bulletin · doi:10.1037//0033-2909.128.6.978 · Cited by 431 · cited 1×
“However, AI’s data-centric approach clashes with human decision-making, which integrates personal understanding and experiences [47], logic [38], heuristics [33], and creativity [114, 115].”
How Can Decision Making Be Improved?
Milkman, K. L., Chugh, D., & Bazerman, M. H. (2009) · Perspectives on Psychological Science · doi:10.1111/j.1745-6924.2009.01142.x · Cited by 425 · cited 5×
“It has the potential benefits of cultivating critical thinking, mitigating biases, and raising awareness of differences between multiple parties [58, 76, 97].”
InfluentialWeight of Evidence: A Review of Concept and Methods
Weed, D. L. (2005) · Risk Analysis · doi:10.1111/j.1539-6924.2005.00699.x · Cited by 417 · cited 1×
“In this paper, based on guidelines and theories in human deliberation [3, 4, 119] and decision-making [2, 10, 134], we introduce a novel framework, Human-AI Deliberation for AI-assisted decision-making (Figure 1 (b)).”
Human-Centered Tools for Coping with Imperfect Algorithms During Medical Decision-Making
Cai, C. J., Reif, E., Hegde, N., Hipp, J., Kim, B., Smilkov, D., Wattenberg, M., Viegas, F., Corrado, G. S., Stumpe, M. C., et al. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300234 · Cited by 405 · cited 1×
“We measured participants’ perceived Helpful-ness [16, 20, 77], Trustworthiness [17, 46], and Understanding [131] through 7-point Likert scale (1: Strongly disagree; 7: Strongly agree.”
The Principles and Limits of Algorithm-in-the-Loop Decision Making
Green, B., & Chen, Y. (2019) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3359152 · Cited by 392 · cited 2×
“With remarkable technological advancements, AI has been increasingly used to support people in making decisions in various domains, including criminal justice [32, 35], admissions [25, 140], financial investment [53], and medical diagnosis [21, 79], among others.”
van Eemeren, F. H., Henkemans, A. F. S., van Eemeren, F. H., Grootendorst, R., & Henkemans, A. F. S. (2002) · Routledge eBooks · doi:10.4324/9781410602442 · Cited by 354
Constructive Conflicts: From Escalation to Resolution
Mullis, J. S., & Kriesberg, L. (1999) · Contemporary Sociology · doi:10.2307/2655345 · Cited by 331
Wang, X., & Yin, M. (2021) · 26th International Conference on Intelligent User Interfaces · doi:10.1145/3397481.3450650 · Cited by 320
Self-citationDiscussion of shared and unshared information in decision-making groups.
Larson, J. R., Foster-Fishman, P. G., & Keys, C. B. (1994) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.67.3.446 · Cited by 319 · cited 4×
“We propose to have humans and AI deliberate their opinions at the detailed Dimension level (i.e., to what extent a dimension supports or opposes the final decision) rather than merely talking about accepting/rejecting one’s overall decision.”
InfluentialProxy tasks and subjective measures can be misleading in evaluating explainable AI systems
Buçinca, Z., Lin, P., Gajos, K. Z., & Glassman, E. L. (2020) · Proceedings of the 25th International Conference on Intelligent User Interfaces · doi:10.1145/3377325.3377498 · Cited by 307 · cited 3×
“””
Public Participation for 21st Century Democracy
(2015) · Wiley eBooks · doi:10.1002/9781119154815 · Cited by 298
Explaining Decision-Making Algorithms through UI: Strategies to Help Non-Expert Stakeholders
Cheng, H.-F., Wang, R., Zhang, Z., O'Connell, F., Gray, T., Harper, F. M., & Zhu, H. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300789 · Cited by 292
Explaining models: an empirical study of how explanations impact fairness judgment
Dodge, J., Liao, Q. V., Zhang, Y., Bellamy, R. K. E., & Dugan, C. (2019) · Proceedings of the 24th International Conference on Intelligent User Interfaces · doi:10.1145/3301275.3302310 · Cited by 286
Updates in Human-AI Teams: Understanding and Addressing the Performance/Compatibility Tradeoff
Bansal, G., Nushi, B., Kamar, E., Weld, D. S., Lasecki, W. S., & Horvitz, E. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33012429 · Cited by 284 · cited 1×
“Some researchers aim to leverage the complementary aspects of human and AI intelligence by training AI to complement human knowledge [7, 135].”
Expert Political Judgment: How Good Is It? How Can We Know?
Tetlock, P. E. (2018) · Princeton University Press eBooks · doi:10.1515/9781400888818 · Cited by 277 · cited 1×
“These explanations could facilitate the collaborative synthesis of human and AI intelligence, allowing them to combine insights into different features for final decisions.”
Noor, M., Brown, R., Gonzalez, R., Manzi, J., & Lewis, C. A. (2008) · Personality and Social Psychology Bulletin · doi:10.1177/0146167208315555 · Cited by 266
Ethics of Data and Analytics: Concepts and Cases
Martin, K. (2022) · Auerbach Publications eBooks · doi:10.1201/9781003278290 · Cited by 246
Human-level play in the game of Diplomacy by combining language models with strategic reasoning
Meta Fundamental AI Research Diplomacy Team (FAIR)†, Bakhtin, A., Brown, N., Dinan, E., Farina, G., Flaherty, C., Fried, D., Goff, A., Gray, J., Hu, H., et al. (2022) · Science · doi:10.1126/science.ade9097 · Cited by 241
Baumann, D. J., Fluke, J. D., Dalgleish, L., & Kern, H. (2013) · From Evidence to Outcomes in Child Welfare · doi:10.1093/acprof:oso/9780199973729.003.0002 · Cited by 227 · cited 3×
“Overall, the architecture of Deliberative AI (illustrated in Figure 3) comprises three layers: Communication layer, Control layer, and Knowledge layer.”
Three Challenges for AI-Assisted Decision-Making
Steyvers, M., & Kumar, A. (2024) · Perspectives on Psychological Science · doi:10.1177/17456916231181102 · Cited by 217
Deciding Fast and Slow: The Role of Cognitive Biases in AI-assisted Decision-making
Rastogi, C., Zhang, Y., Wei, D., Varshney, K. R., Dhurandhar, A., & Tomsett, R. (2022) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3512930 · Cited by 216
Appropriate Reliance on AI Advice: Conceptualization and the Effect of Explanations
Schemmer, M., Kuehl, N., Benz, C., Bartos, A., & Satzger, G. (2023) · Proceedings of the 28th International Conference on Intelligent User Interfaces · doi:10.1145/3581641.3584066 · Cited by 208 · cited 1×
“Research in AI-assisted decision-making encompasses various objectives, such as team performance, decision fairness, efficacy, efficiency, understanding of AI, trust, reliance on AI, and subjective experience [6, 16, 17, 25, 26, 35, 43, 57, 67, 83, 90, 90, 91, 112, 130, 131, 138, 141].”
Pretrial publicity, judicial remedies, and jury bias.
Kramer, G. P., Kerr, N. L., & Carroll, J. S. (1990) · Law and Human Behavior · doi:10.1007/bf01044220 · Cited by 202 · cited 2×
“AI contributes its knowledge to humans by providing recommendations with AI explanations serving as a means of representing its detailed reasoning [72].”
Mapping and Measuring Deliberation: Towards a New Deliberative Quality
Bächtiger, A., & Parkinson, J. (2019) · doi:10.1093/oso/9780199672196.001.0001 · Cited by 201
Deliberative Politics in Action: Analyzing Parliamentary Discourse
Steiner, J., Bächtiger, A., Spörndli, M., & Steenbergen, M. R. (2005) · Cambridge University Press eBooks · doi:10.1017/cbo9780511491153 · Cited by 191
Preference Learning and Ranking by Pairwise Comparison
Fürnkranz, J., & Hüllermeier, E. (2010) · Springer eBooks · doi:10.1007/978-3-642-14125-6_4 · Cited by 182 · cited 1×
“Although we require participants to have at least a master’s degree and graduate application experience, there is still a considerable gap in expertise.”
Miller, T. (2023) · 2023 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3593013.3594001 · Cited by 172
'It's Reducing a Human Being to a Percentage'; Perceptions of Justice in Algorithmic Decisions
(2018) · doi:10.31235/osf.io/9wqxr · Cited by 161
Human-AI Collaboration via Conditional Delegation: A Case Study of Content Moderation
Lai, V., Carton, S., Bhatnagar, R., Liao, Q. V., Zhang, Y., & Tan, C. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3501999 · Cited by 145
Ma, S., Lei, Y., Wang, X., Zheng, C., Shi, C., Yin, M., & Ma, X. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581058 · Cited by 143
Self-citationXie, Y., Chen, M., Kao, D., Gao, G., & Chen, X. '. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376807 · Cited by 141
Sivaraman, V., Bukowski, L. A., Levin, J., Kahn, J. M., & Perer, A. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581075 · Cited by 141 · cited 1×
“For example, as shown in Figure 1 (a), when the human decision-maker’s prediction is inconsistent with the AI model’s recommendation and the human only partially agrees with the AI’s reasoning (e.g., explanation), existing AI-assisted decision-making interfaces do not support any communication…”
A Human-AI Collaborative Approach for Clinical Decision Making on Rehabilitation Assessment
Lee, M. H., Siewiorek, D. P., Smailagic, A., Bernardino, A., & Bermúdez i Badia, S. B. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445472 · Cited by 137
How Cognitive Biases Affect XAI-assisted Decision-making: A Systematic Review
Bertrand, A., Belloum, R., Eagan, J. R., & Maxwell, W. (2022) · Proceedings of the 2022 AAAI/ACM Conference on AI, Ethics, and Society · doi:10.1145/3514094.3534164 · Cited by 129
Do People Engage Cognitively with AI? Impact of AI Assistance on Incidental Learning
Gajos, K. Z., & Mamykina, L. (2022) · 27th International Conference on Intelligent User Interfaces · doi:10.1145/3490099.3511138 · Cited by 127
Explaining machine learning models with interactive natural language conversations using TalkToModel
Slack, D., Krishna, S., Lakkaraju, H., & Singh, S. (2023) · Nature Machine Intelligence · doi:10.1038/s42256-023-00692-8 · Cited by 125
A Design Methodology for Trust Cue Calibration in Cognitive Agents
de Visser, E. J., Cohen, M. S., Freedy, A., & Parasuraman, R. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-07458-0_24 · Cited by 121 · cited 1×
“””
Human-Centered Explainable AI (XAI): From Algorithms to User Experiences
Liao, Q. V., & Varshney, K. R. (2021) · arXiv · doi:10.48550/arxiv.2110.10790 · Cited by 120 · cited 5×
“We now delve into our key findings and discuss design implications and critical limitations.”
InfluentialConcluding Comments on Empirical Approaches to Deliberative Politics
Habermas, J. (2005) · Acta Politica · doi:10.1057/palgrave.ap.5500119 · Cited by 118 · cited 4×
“Deliberation proves effective in facilitating various human decision-making tasks, including deliberative politics [13, 54, 123], clinical diagnosis [62, 108, 111], criminal justice [29, 126], and more.”
InfluentialWilder, B., Horvitz, E., & Kamar, E. (2020) · Proceedings of the Twenty-Ninth International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2020/212 · Cited by 118
Liu, H., Lai, V., & Tan, C. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3479552 · Cited by 111
Danry, V., Pataranutaporn, P., Mao, Y., & Maes, P. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3580672 · Cited by 110
Knowing About Knowing: An Illusion of Human Competence Can Hinder Appropriate Reliance on AI Systems
He, G., Kuiper, L., & Gadiraju, U. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581025 · Cited by 107
Explainable Active Learning (XAL): Toward AI Explanations as Interfaces for Machine Teachers
Ghai, B., Liao, Q. V., Zhang, Y., Bellamy, R., & Mueller, K. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3432934 · Cited by 106
Improving business process decision making based on past experience
Ghattas, J., Soffer, P., & Peleg, M. (2014) · Decision Support Systems · doi:10.1016/j.dss.2013.10.009 · Cited by 101 · cited 2×
“However, AI’s data-centric approach clashes with human decision-making, which integrates personal understanding and experiences [47], logic [38], heuristics [33], and creativity [114, 115].”
Evaluating the logical reasoning ability of chatgpt and GPT-4
Liu, H., Ning, R., Teng, Z., Liu, J., Zhou, Q., & Zhang, Y. (2023) · arXiv · doi:10.48550/arxiv.2304.03439 · Cited by 100 · cited 1×
“Most importantly, future designs should prioritize transparency in the AI updating mechanism to help users fully comprehend the principles governing AI updates and effectively manage their expectations.”
COGAM: Measuring and Moderating Cognitive Load in Machine Learning Model Explanations
Abdul, A., von der Weth, C., Kankanhalli, M., & Lim, B. Y. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376615 · Cited by 96
A meta-analysis of confidence and judgment accuracy in clinical decision making.
Miller, D. J., Spengler, E. S., & Spengler, P. M. (2015) · Journal of Counseling Psychology · doi:10.1037/cou0000105 · Cited by 92 · cited 1×
“We measured participants’ Decision Confidence [98].”
Lord, C., & Tamvaki, D. (2012) · European Political Science Review · doi:10.1017/s1755773911000300 · Cited by 91 · cited 2×
“Deliberation is beneficial for enhancing decision-making by integrating diverse perspectives, improving the quality of solutions by considering various viewpoints, fostering critical thinking, and increasing the likelihood of reaching informed and well-thought-out conclusions [52].”
van Eemeren, F. H., & Henkemans, A. F. S. (2016) · Routledge eBooks · doi:10.4324/9781315401140 · Cited by 90
Digital Juries: A Civics-Oriented Approach to Platform Governance
Fan, J., & Zhang, A. X. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376293 · Cited by 89 · cited 1×
“Recent studies on online deliberation have showcased its ability to enhance the accuracy of crowd-working tasks [24, 34], improve perceptions of procedural justice [40], and facilitate consensus-building among participants [80, 111, 126, 137].”
Ethical case deliberation and decision making
Gracia, D. (2003) · Medicine, Health Care and Philosophy · doi:10.1023/a:1025969701538 · Cited by 86 · cited 3×
“This is especially concerning in high-stakes domains like medicine and criminal justice, leading to ethical and legal complexities [12, 21, 79].”
DISCUSSION PROCEDURES AND DECISION-MAKING PERFORMANCE.: A Test of a Functional Perspective
HIROKAWA, R. Y. (1985) · Human Communication Research · doi:10.1111/j.1468-2958.1985.tb00073.x · Cited by 86
A Theory of Evidence for Evidence-Based Policy
Cartwright, N. D., & Stegenga, J. (2011) · British Academy eBooks · doi:10.5871/bacad/9780197264843.003.0011 · Cited by 85 · cited 1×
“Finally, based on theories and practices in human de-liberation, we introduce the design considerations and structure of Deliberative AI , the core AI component of our framework.”
Measuring Publicity's Effect: Reconciling Empirical Research and Normative Theory
Chambers, S. (2005) · Acta Politica · doi:10.1057/palgrave.ap.5500104 · Cited by 83
Deliberation and disagreement: Problem solving, prediction, and positive dissensus
Landemore, H., & Page, S. E. (2015) · Politics, Philosophy & Economics · doi:10.1177/1470594x14544284 · Cited by 82
MicroTalk: Using Argumentation to Improve Crowdsourcing Accuracy
Drapeau, R., Chilton, L., Bragg, J., & Weld, D. (2016) · Proceedings of the AAAI Conference on Human Computation and Crowdsourcing · doi:10.1609/hcomp.v4i1.13270 · Cited by 79 · cited 1×
“Research in AI-assisted decision-making encompasses various objectives, such as team performance, decision fairness, efficacy, efficiency, understanding of AI, trust, reliance on AI, and subjective experience [6, 16, 17, 25, 26, 35, 43, 57, 67, 83, 90, 90, 91, 112, 130, 131, 138, 141].”
Towards a Science of Human-AI Decision Making: A Survey of Empirical Studies
Lai, V., Chen, C., Liao, Q. V., Smith-Renner, A., & Tan, C. (2021) · arXiv · doi:10.48550/arxiv.2112.11471 · Cited by 75 · cited 6×
“…decision-making systems, AI consistently provides a fixed recommendation regardless of human thoughts and humans can only accept or reject AI’s recommendation as a whole [72], with limited support for resolving conflicts or engaging in a meaningful exchange of ideas with the AI system [100].”
InfluentialZhang, A., Walker, O., Nguyen, K., Dai, J., Chen, A., & Lee, M. K. (2023) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3579601 · Cited by 72
GRADE: Machine‐Learning Support for Graduate Admissions
Waters, A., & Miikkulainen, R. (2014) · AI Magazine · doi:10.1609/aimag.v35i1.2504 · Cited by 68 · cited 1×
“First, this task is widely used in AI-assisted decision-making research [25, 36, 140, 142], with real-world universities employing AI algorithms for decision consistency and workload reduction [103, 133].”
Weather Forecasting by Humans—Heuristics and Decision Making
Doswell, C. A. (2004) · Weather and Forecasting · doi:10.1175/waf-821.1 · Cited by 66 · cited 1×
“Most importantly, future designs should prioritize transparency in the AI updating mechanism to help users fully comprehend the principles governing AI updates and effectively manage their expectations.”
Negotiation and honesty in artificial intelligence methods for the board game of Diplomacy
Kramár, J., Eccles, T., Gemp, I., Tacchetti, A., McKee, K. R., Malinowski, M., Graepel, T., & Bachrach, Y. (2022) · Nature Communications · doi:10.1038/s41467-022-34473-5 · Cited by 66
A Slow Algorithm Improves Users' Assessments of the Algorithm's Accuracy
Park, J. S., Barber, R., Kirlik, A., & Karahalios, K. (2019) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3359204 · Cited by 65 · cited 1×
“The origin of group deliberation can be traced back to public deliberation or deliberative democracy, where citizens convene to discuss policies with potential implications for their lives [116].”
Crowdsourcing Perceptions of Fair Predictors for Machine Learning: A Recidivism Case Study
van Berkel, N., Goncalves, J., Hettiachchi, D., Wijenayake, S., Kelly, R. M., & Kostakos, V. (2019) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3359130 · Cited by 60
Gene-edited babies: What went wrong and what could go wrong
Wang, H., & Yang, H. (2019) · PLoS Biology · doi:10.1371/journal.pbio.3000224 · Cited by 57
Chiang, C.-W., Lu, Z., Li, Z., & Yin, M. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581015 · Cited by 56
Self-citationMa, S., Wang, X., Lei, Y., Shi, C., Yin, M., & Ma, X. (2024) · arXiv · doi:10.48550/arxiv.2403.09552 · Cited by 56
Self-citationMa, S., Zhou, T., Nie, F., & Ma, X. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3517482 · Cited by 51
Self-citationSolutionChat: Real-time Moderator Support for Chat-based Structured Discussion
Lee, S.-C., Song, J., Ko, E.-Y., Park, S., Kim, J., & Kim, J. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376609 · Cited by 49
Zheng, C., Wu, Y., Shi, C., Ma, S., Luo, J., & Ma, X. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581131 · Cited by 48
Self-citationThe Wisdom of Crowds: Methods of Human Judgement Aggregation
Lyon, A., & Pacuit, E. (2013) · Springer eBooks · doi:10.1007/978-1-4614-8806-4_47 · Cited by 47 · cited 1×
“” (P33)”
Understanding Expert Disagreement in Medical Data Analysis through Structured Adjudication
Schaekermann, M., Beaton, G., Habib, M., Lim, A., Larson, K., & Law, E. (2019) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3359178 · Cited by 47 · cited 4×
“Deliberation proves effective in facilitating various human decision-making tasks, including deliberative politics [13, 54, 123], clinical diagnosis [62, 108, 111], criminal justice [29, 126], and more.”
InfluentialENERGY SOURCES AND REQUIREMENTS OF THE EXERCISING HORSE
Harris, P. A. (1997) · Annual Review of Nutrition · doi:10.1146/annurev.nutr.17.1.185 · Cited by 46
Shared Interest: Measuring Human-AI Alignment to Identify Recurring Patterns in Model Behavior
Boggust, A., Hoover, B., Satyanarayan, A., & Strobelt, H. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3501965 · Cited by 45
From Human Explanation to Model Interpretability: A Framework Based on Weight of Evidence
Alvarez-Melis, D., Kaur, H., Daumé, H., Wallach, H., & Vaughan, J. W. (2021) · Proceedings of the AAAI Conference on Human Computation and Crowdsourcing · doi:10.1609/hcomp.v9i1.18938 · Cited by 44
Cicero: Multi-Turn, Contextual Argumentation for Accurate Crowdsourcing
Chen, Q., Bragg, J., Chilton, L. B., & Weld, D. S. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300761 · Cited by 41
Self-citationGhosh, S., Liao, Q. V., Ramamurthy, K. N., Navrátil, J., Sattigeri, P., Varshney, K. R., & Zhang, Y. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.01410 · Cited by 39
Wang, X., & Yin, M. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581366 · Cited by 38
Self-citationWojcieszak, M. E., Baek, Y. M., & Carpini, M. X. D. (2010) · International Journal of Public Opinion Research · doi:10.1093/ijpor/edp050 · Cited by 37 · cited 1×
“It encourages engagement from multiple stakeholders, thereby facilitating cooperation and communication among decision-makers [136].”
Fairness requires deliberation: the primacy of economic over social considerations
Hochman, G., Ayal, S., & Ariely, D. (2015) · Frontiers in Psychology · doi:10.3389/fpsyg.2015.00747 · Cited by 36 · cited 2×
“AI contributes its knowledge to humans by providing recommendations with AI explanations serving as a means of representing its detailed reasoning [72].”
How Moral Case Deliberation Supports Good Clinical Decision Making
(2019) · AMA Journal of Ethics · doi:10.1001/amajethics.2019.913 · Cited by 33
Ma, S., Zhang, C., Wang, X., Ma, X., & Yin, M. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2403.01791 · Cited by 33
Self-citationAI-Moderated Decision-Making: Capturing and Balancing Anchoring Bias in Sequential Decision Tasks
Echterhoff, J. M., Yarmand, M., & McAuley, J. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3517443 · Cited by 30
Bächtiger, A., Gerber, M., & Fournier-Tombs, É. (2022) · Oxford University Press eBooks · doi:10.1093/oso/9780192848925.003.0006 · Cited by 30
Ma, S., Wei, Z., Tian, F., Fan, X., Zhang, J., Shen, X., Lin, Z., Huang, J., Měch, R., Samaras, D., et al. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300701 · Cited by 24
Self-citationPreisz, A. (2019) · Journal of Paediatrics and Child Health · doi:10.1111/jpc.14447 · Cited by 23 · cited 3×
“…used in democracy and political settings [13, 54, 123], its idea can be applied to other decision-making tasks such as clinical diagnosis [62, 108, 111], criminal justice [29, 126], etc. Building upon the WoE decision-making approach, we propose Human-AI Deliberation , a framework to…”
Crowdsourcing and Evaluating Concept-driven Explanations of Machine Learning Models
Mishra, S., & Rzeszotarski, J. M. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3449213 · Cited by 21 · cited 1×
“First, AI thought elicitation demands a good balance between human information needs and interpretability [1, 101].”
RetroLens: A Human-AI Collaborative System for Multi-step Retrosynthetic Route Planning
Shi, C., Hu, Y., Wang, S., Ma, S., Zheng, C., Ma, X., & Luo, Q. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581469 · Cited by 19
Self-citationThree Challenges for AI-Assisted Decision-Making
Steyvers, M., & Kumar, A. (2022) · doi:10.31234/osf.io/gctv6 · Cited by 15
TalkToModel: Explaining Machine Learning Models with Interactive Natural Language ConversationsPreprint
Slack, D., Krishna, S., Lakkaraju, H., et al. (2022) · Research Square · doi:10.21203/rs.3.rs-2129845/v1 · Cited by 12
Cicero: Multi-Turn, Contextual Argumentation for Accurate Crowdsourcing
Chen, Q. Z., Bragg, J., Chilton, L. B., & Weld, D. S. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1810.10733 · Cited by 11
Self-citationImplicit Detection of Motor Impairment in Parkinson's Disease from Everyday Smartphone Interactions
Gao, J., Tian, F., Fan, J., Wang, D., Fan, X., Zhu, Y., Ma, S., Huang, J., & Wang, H. (2018) · Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3170427.3188502 · Cited by 9 · cited 2×
“However, AI’s real-world applications are not infallible, still far from 100% accuracy [45, 91, 113].”
Self-citationFrom Human Explanation to Model Interpretability: A Framework Based on Weight of EvidencePreprint
Alvarez-Melis, D., Kaur, H., Daumé, H., Wallach, H., & Vaughan, J. W. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2104.13299 · Cited by 8
The Blackwell Guide to Social and Political Philosophy
(2002) · Blackwell Publishing Ltd eBooks · doi:10.1111/b.9780631221272.2002.00009.x · Cited by 4
Methods for Analyzing and Measuring Group Deliberation
(2010) · Sourcebook for Political Communication Research · doi:10.4324/9780203938669-29 · Cited by 3
(2014) · Medical Entomology and Zoology
Is the Most Accurate AI the Best Teammate? Optimizing AI for Teamwork
Bansal, G., Nushi, B., Kamar, E., Horvitz, E., & Weld, D. S. (2020) · arXiv · doi:10.48550/arxiv.2004.13102 · cited 1×
“Additionally, we demonstrate its potential to improve decision accuracy and promote appropriate human reliance on AI.”
Wilder, B., Horvitz, E., & Kamar, E. (2020) · arXiv · doi:10.48550/arxiv.2005.00582 · cited 1×
“Some researchers aim to leverage the complementary aspects of human and AI intelligence by training AI to complement human knowledge [7, 135].”
Research works printed but not linked: 8
- [4] André Bächtiger, Susumu Shikano, Seraina Pedrini, and Mirjam Ryser. 2009. Measuring deliberation 2.0: standards, discourse types, and sequenzialization. In ECPR General Conference . Potsdam, 5-12. -
- [62] Daniel Kahneman. 2011. Thinking, fast and slow . Macmillan. -
- [82] Scott M Lundberg and Su-In Lee. 2017. A unified approach to interpreting model predictions. Advances in neural information processing systems 30 (2017). -
- [83] Fred C Lunenburg. 2010. The decision making process.. In National Forum of Educational Administration & Supervision Journal , Vol. 27. -
- [86] Shuai Ma, Mingfei Sun, and Xiaojuan Ma. 2022. Modeling Adaptive Expression of Robot Learning Engagement and Exploring its Effects on Human Teachers. ACM Transactions on Computer-Human Interaction (2022). -
- [118] Philip E Tetlock. 2017. Expert political judgment. In Expert Political Judgment . Princeton University Press. -
- [131] Jason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma, Fei Xia, Ed Chi, Quoc V Le, Denny Zhou, et al. 2022. Chain-of-thought prompting elicits reasoning in large language models. Advances in neural information processing systems 35 (2022), 24824-24837. -
- [138] Jieqiong Zhao, Yixuan Wang, Michelle V Mancenido, Erin K Chiou, and Ross Maciejewski. 2023. Evaluating the impact of uncertainty visualization on model reliance. IEEE Transactions on Visualization and Computer Graphics (2023). -
Cited by
Xiao, X., Chen, P., Qi, B., Zhao, H., Liang, J., Tong, J., & Wang, H. (2025) · Reliability Engineering & System Safety · doi:10.1016/j.ress.2025.111585 · Cited by 39
AI-overdependence and human cognitive decline: Hazards, evidence, and mitigation strategies
Noorbehbahani, F., & Oyibo, K. (2026) · Computers in Human Behavior Reports · doi:10.1016/j.chbr.2026.101102 · Cited by 12
LLMs in the SOC: An Empirical Study of Human-AI Collaboration in Security Operations Centres
Singh, R., Tariq, S., Jalalvand, F., Chhetri, M. B., Nepal, ., Paris, C., & Lochner, M. (2026) · IEEE Symposium on Security and Privacy (S&P) · doi:10.1109/sp63933.2026.00111 · Cited by 69
“Meanwhile, iterative reasoning and hypothesis testing interactions resemble the deliberative partner model [34], ExtendAI role [33] and align with Cooperative Intelligence [30].”
Raees, M., Khan, V.-J., Lykourentzou, I., & Papangelis, K. (2026) · Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3791467 · Cited by 5
“Partial explanations align with a larger body of research on deliberation that encourages users to reflect on their decisions [40, 96].”
InfluentialDong, A., Li, P., Chen, Y., Gibson, S., Zhao, L., & He, M. (2026) · Sustainability · doi:10.3390/su18115313 · Cited by 9
Metadata
- Authors
- Ma, S., Chen, Q., Wang, X., Zheng, C., Peng, Z., Yin, M., & Ma, X.
- Affiliations
- Hong Kong University of Science and Technology (HK)
- Purdue University West Lafayette (US)
- Sun Yat-sen University (CN)
- Venue
- Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2025-04-25
- Pages
- 1-23
- OpenAlex
- W4409736269
- Semantic Scholar
- 9eaf282a505a1d61318d4d90d7044da360ffb72f
- Cited by
- 48
- References
- 119
- Citations by year
- 2026: 42 · 2025: 6
- FWCI
- 45.52
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- CHI Conference on Human Factors in Computing Systems (publishedVersion)
- Rare & Special e-Zone (The Hong Kong University of Science and Technology) (submittedVersion)
- Funders
- Research Grants Council of the Hong Kong Special Administrative Region under General Research Fund (GRF) (16207923)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Social Sciences › Human Factors and Ergonomics › Human-Automation Interaction and Safety
- Keywords
- AI-assisted decision-making, large language models, human-AI interaction, explainable AI, conversational AI assistant, user experience
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-11-14, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-11-14 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (qwen3.8-omni-flash).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.