Dealing with Uncertainty: Understanding the Impact of Prognostic Versus Diagnostic Tasks on Trust and Reliance in Human-AI Decision Making
Open accessThe DOI matches its Crossref record; 151 of the 151 references it cites were found in a registry or an index; 37 of the 76 sources its claims cite were checked for support.
Abstract
While existing literature has explored and revealed several insights pertaining to the role of human factors (e.g., prior experience, domain knowledge) and attributes of AI systems (e.g., accuracy, trustworthiness), there is a limited understanding around how the important task characteristics of complexity and uncertainty shape human decision-making and human-AI team performance. In this work, we aim to address this research and empirical gap by systematically exploring how task complexity and uncertainty influence human-AI decision-making. Task complexity refers to the load of information associated with a task, while task uncertainty refers to the level of unpredictability associated with the outcome of a task. We conducted a between-subjects user study (N = 258) in the context of a trip-planning task to investigate the impact of task complexity and uncertainty on human trust and reliance on AI systems. Our results revealed that task complexity and uncertainty have a significant impact on user reliance on AI systems. When presented with complex and uncertain tasks, users tended to rely more on AI systems while demonstrating lower levels of appropriate reliance compared to tasks that were less complex and uncertain. In contrast, we found that user trust in the AI systems was not influenced by task complexity and uncertainty. Our findings can help inform the future design of empirical studies exploring human-AI decision-making. Insights from this work can inform the design of AI systems and interventions that are better aligned with the challenges posed by complex and uncertain tasks. Finally, the lens of diagnostic versus prognostic tasks can inspire the operationalization of uncertainty in human-AI decision-making studies.
Overview
CoChat Summary
TL;DR
This CHI 2024 study examines how task complexity and task uncertainty (diagnostic vs. prognostic) shape trust and reliance in human-AI decision-making using a trip-planning task. Across 258 participants, higher complexity and uncertainty increased reliance on AI but did not significantly change subjective trust.
Key findings
- Task complexity significantly affected reliance: Switch Fraction rose from 0.18 ± 0.32 (low) to 0.26 ± 0.30 (medium) to 0.34 ± 0.36 (high), adjusted p = .003; Accuracy fell from 0.79 ± 0.22 (low) to 0.58 ± 0.27 (medium) and 0.61 ± 0.29 (high), p < .001.
- Appropriate reliance declined with complexity: Accuracy-wid was 0.61 ± 0.40 (low), 0.40 ± 0.37 (medium), and 0.50 ± 0.35 (high), p = .001; RAIR increased from 0.22 ± 0.41 (low) to 0.33 ± 0.41 (medium) and 0.43 ± 0.45 (high), p = .001.
- Task uncertainty significantly affected reliance: prognostic tasks showed higher Switch Fraction (0.31 ± 0.34 vs. 0.22 ± 0.32, p = .02) and RAIR (0.38 ± 0.44 vs. 0.27 ± 0.42, p = .02), but lower Accuracy (0.60 ± 0.24 vs. 0.72 ± 0.30, p < .001) and Accuracy-wid (0.45 ± 0.33 vs. 0.56 ± 0.43, p = .04) than diagnostic tasks.
- Trust in the AI system was not significantly influenced by task complexity or uncertainty; hypotheses H1b and H2b were rejected. A significant interaction on Accuracy-wid was found, with a turning point where appropriate reliance increased in high-complexity prognostic tasks, rejecting H3.
Methods
- Between-subjects 3 × 2 factorial user study with six conditions: task complexity (low, medium, high) × task uncertainty (diagnostic, prognostic). Participants completed three trip-planning tasks with an imperfect AI system fixed at 66.7% accuracy.
- Final sample: 258 participants from Prolific after excluding 27 of 285 who failed attention checks or a quiz; inclusion required native English speakers, ≥95% approval rate, and ≥100 completed studies. Average completion time was about 25 minutes.
- Complexity was manipulated by number of constraints (4 low, 8 medium, 12 high); uncertainty was manipulated via diagnostic vs. prognostic scenarios (present trip with exact values vs. trip two weeks later with ranges/probabilities). Reliance metrics included Agreement Fraction, Switch Fraction, Accuracy with Disagreement, RAIR, and RSR; trust was measured with the Trust in Automation questionnaire. Analyses used Kruskal-Wallis with Dunn post-hoc and Bonferroni correction, plus ANCOVA/ANOVA.
Limitations
- Stated: findings are not universally applicable to all decision-making tasks; other operationalizations of task uncertainty were not explored; traffic features were assumed unrelated and equally weighted; traffic conditions were included in both diagnostic and prognostic scenarios even though real-world traffic is predominantly prognostic.
- Stated: cognitive biases may affect results, including familiarity bias, availability heuristic, confirmation bias, overconfidence bias, and self-interest bias.
- Evident from the text: the study uses a single trip-planning domain, a fixed AI accuracy of 66.7%, artificial routes, and a Prolific sample of native English speakers, which may limit generalizability beyond this task and population.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
16 Valid · 2 Not valid · 14 Not checked · 91 Own results and interpretations
At least one cited source doesn’t support this claim or points to a different paper, and none confirmed it — see the verdicts below.
In the paper
“On the other hand, when individuals are faced with tasks that have lower uncertainty, such as annotation and classifcation task [4, 77, 117], they tend to rely less on the AI advice and rely more on their expertise and judgment.”
What the sources say
- Not checked — no full text of the sourcecites [4] [4] Ahmed Alqaraawi, Martin Schuessler, Philipp Weiß, Enrico Costanza, and Nadia Berthouze. 2020. Evaluating Saliency Map Explanations for Convolutional Neural Networks: A User Study. In Proceedings of the 25th International Conference on Intelligent User Interfaces (Cagliari, Italy) (IUI '20) . Association for Computing Machinery, New York, NY, USA, 275-285. https://doi.org/10.1145/3377325.3377519 - source
- Disputedcites [77] [77] Ariel Levy, Monica Agrawal, Arvind Satyanarayan, and David Sontag. 2021. Assessing the Impact of Automated Suggestions on Decision Making: Domain Experts Mediate Model Errors but Take Less Initiative. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI '21) . Association for Computing Machinery, New York, NY, USA, Article 72, 13 pages. https://doi.org/10.1145/3411764.3445522 - sourceExperimental — accuracy not yet measured
The Introduction reports that clinicians given fully pre-populated annotations exercised less agency, not more: they were more hesitant to correct spans and less likely to add annotations. The Discussion likewise says pre-populated suggestions caused a loss of agency and cautions that the findings may not extend to simpler classification tasks. The paper does not characterize its annotation task as lower-uncertainty. (LLM, conf=0.84)
Checked by a reasoning model — may be wrong.
- Not checked — no full text of the sourcecites [117] [117] Alison Smith-Renner, Ron Fan, Melissa Birchfeld, Tongshuang Wu, Jordan BoydGraber, Daniel S. Weld, and Leah Findlater. 2020. No Explainability without Accountability: An Empirical Study of Explanations and Feedback in Interactive ML. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI '20) . Association for Computing Machinery, New York, NY, USA, 1-13. https://doi.org/10.1145/3313831.3376624 - source
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“there is a limited understanding around how the important task characteristics of complexity and uncertainty shape human decision-making and human-AI team performance.”
- Also stated in: § 1 INTRODUCTION AND BACKGROUND · plain
“However, limited task characteristics have been systematically explored and their impact on human reliance on AI systems is not yet fully understood [68, 109].”
What the sources say
- Partly supportedcites [68] [68] Vivian Lai, Chacha Chen, Alison Smith-Renner, Q. Vera Liao, and Chenhao Tan. 2023. Towards a Science of Human-AI Decision Making: An Overview of Design Space in Empirical Human-Subject Studies. In Proceedings of the 2023 ACM Conference on Fairness, Accountability, and Transparency (Chicago, IL, USA) (FAccT '23) . Association for Computing Machinery, New York, NY, USA, 1369-1385. https://doi.org/10.1145/3593013.3594087 - sourceExperimental — accuracy not yet measured
The Task characteristics section says task properties may affect reliance on AI and that studies often fail to justify task choices or establish how findings generalize. But it does not identify task complexity and task uncertainty as the two characteristics whose effects on human decision-making and human-AI team performance are poorly understood. Its discussion of uncertainty in Model predictions concerns AI prediction estimates, not task uncertainty. (LLM, conf=0.84)
- Not checked — no full text of the sourcecites [109] [109] Sara Salimzadeh, Gaole He, and Ujwal Gadiraju. 2023. A Missing Piece in the Puzzle: Considering the Role of Task Complexity in Human-AI Decision Making. In Proceedings of the 31st ACM Conference on User Modeling, Adaptation and Personalization (Limassol, Cyprus) (UMAP '23) . Association for Computing Machinery, New York, NY, USA, 215-227. https://doi.org/10.1145/3565472. 3592959 - source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § 1 INTRODUCTION AND BACKGROUND · plain
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Prior work has highlighted that appropriate trust and reliance play a critical role in achieving complementary human-AI team performance [58, 90, 139, 141].”
What the sources say
- Not checked — no full text of the sourcecites [58] [58] Alon Jacovi, Ana Marasović, Tim Miller, and Yoav Goldberg. 2021. Formalizing Trust in Artifcial Intelligence: Prerequisites, Causes and Goals of Human Trust in AI. In Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency (Virtual Event, Canada) (FAccT '21) . Association for Computing Machinery, New York, NY, USA, 624-635. https://doi.org/10.1145/3442188. 3445923 - source
- Not checked — no full text of the sourcecites [90] [90] David Miller, Mishel Johns, Brian Mok, Nikhil Gowda, David Sirkin, Key Lee, and Wendy Ju. 2016. Behavioral Measurement of Trust in Automation: The Trust Fall. Proceedings of the Human Factors and Ergonomics Society Annual Meeting 60, 1 (2016), 1849-1853. https://doi.org/10.1177/1541931213601422 arXiv:https://doi.org/10.1177/1541931213601422 - source
- Partly supportedcites [139] [139] Kun Yu, Shlomo Berkovsky, Ronnie Taib, Jianlong Zhou, and Fang Chen. 2019. Do I Trust My Machine Teammate? An Investigation from Perception to Decision. In Proceedings of the 24th International Conference on Intelligent User Interfaces (Marina del Ray, California) (IUI '19) . Association for Computing Machinery, New York, NY, USA, 460-468. https://doi.org/10.1145/3301275.3302277 - sourceExperimental — accuracy not yet measured
The Introduction calls trust a critical factor in human–machine decisions and performance, and Related Work says appropriate trust benefits collaboration. Results §4.2 links trust to reliance on machine recommendations. The paper does not establish that appropriate trust and reliance achieve *complementary* team performance, as distinct from affecting collaboration and decisions; page numbers are unavailable in our copy. (LLM, conf=0.83)
- Not checked — no full text of the sourcecites [141] [141] Qiaoning Zhang, Matthew L Lee, and Scott Carter. 2022. You Complete Me: Human-AI Teams and Complementary Expertise. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (New Orleans, LA, USA) (CHI '22) . Association for Computing Machinery, New York, NY, USA, Article 114, 28 pages. https://doi.org/10.1145/3491102.3517791 - source
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“Furthermore, the level of trust and reliance on AI may difer across various domains and applications due to the attributes associated with decision tasks [42, 127].”
What the sources say
- Not checked — no full text of the sourcecites [42] [42] Ella Glikson and Anita Williams Woolley. 2020. Human trust in artifcial intelligence: Review of empirical research. Academy of Management Annals 14, 2 (2020), 627-660. - source
- Supportedcites [127] [127] Michael Veale, Max Van Kleek, and Reuben Binns. 2018. Fairness and Accountability Design Needs for Algorithmic Support in High-Stakes Public Sector Decision-Making. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI '18) . Association for Computing Machinery, New York, NY, USA, 1-14. https://doi.org/10.1145/3173574.3174014 - source
The discussion on p. 9 says that whether people trust and rely on decision-support systems is highly contextual. It also identifies differences in tasks, stakes, and contexts as factors that may mediate how algorithms are perceived, supporting the claim's qualified wording. (LLM, conf=0.93)
hedgedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“This design choice is guided by prior neuroscience research by Miller [91], suggesting that human cognitive capacity for processing information is limited to around seven ( ± two) chunks of information at a time.”
What the sources say
- Partly supportedcites [91] [91] George A. Miller. 1956. The Magical Number Seven, Plus or Minus Two: Some Limits on Our Capacity for Processing Information. The Psychological Review 63, 2 (March 1956), 81-97. http://www.musanim.com/miller1956/ - sourceExperimental — accuracy not yet measured
In the immediate-memory discussion (pp. 91–93), Miller describes a span of about seven items, with the number of chunks—not bits of information—limiting immediate memory. The cited sentence extends that specific finding to human cognitive processing generally; Miller explicitly distinguishes immediate memory from other processing limits. (LLM, conf=0.88)
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
59 more claims · 4 with their cited sources checked
Create a free account to see all 123 claims and to verify the 4 references still open.
- Probably not a substantial claim. 40
- It may state two separate claims as one. 28
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Timely feedback and task-oriented support appear to strengthen students' functional evaluations of conversational AI (Ng et al., 2024; Salimzadeh et al., 2024).”
From The effects of responsiveness, perceived warmth, and anthropomorphism on university students' use of conversational AI for learning support: a chain mediation analysis based on S-O-R framework (2026) · cites this paper as Salimzadeh et al., 2024
Citations
Cites
The magical number seven, plus or minus two: Some limits on our capacity for processing information.
Miller, G. A. (1956) · Psychological Review · doi:10.1037/h0043158 · Cited by 17,812 · cited 2×
“This design choice is guided by prior neuroscience research by Miller [91], suggesting that human cognitive capacity for processing information is limited to around seven ( ± two) chunks of information at a time.”
Kruger, J., & Dunning, D. (1999) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.77.6.1121 · Cited by 7,731
Trust in Automation: Designing for Appropriate Reliance
Lee, J. D., & See, K. A. (2004) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/hfes.46.1.50_30392 · Cited by 6,605 · cited 6×
“Although there may not be a correlation between trust and reliance on AI systems [63, 71, 90, 114], prior work suggests a higher likelihood of individuals placing greater trust in AI systems for more complex tasks [53, 71].”
BackgroundResultInfluentialTowards A Rigorous Science of Interpretable Machine Learning
Doshi-Velez, F., & Kim, B. (2017) · arXiv · doi:10.48550/arxiv.1702.08608 · Cited by 3,121
Human trust in artificial intelligence: Review of empirical research
Glikson, E., & Woolley, A. W. (2020) · Academy of Management Annals · doi:10.5465/annals.2018.0057 · Cited by 2,921 · cited 3×
“Furthermore, the level of trust and reliance on AI may differ across various domains and applications due to the attributes associated with decision tasks [42, 127].”
Trust in Automation: Integrating Empirical Evidence on Factors That Influence Trust
Hoff, K. A., & Bashir, M. (2015) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720814547570 · Cited by 2,817
Foundations for an Empirically Determined Scale of Trust in Automated Systems
Jian, J.-Y., Bisantz, A. M., & Drury, C. G. (2000) · International Journal of Cognitive Ergonomics · doi:10.1207/s15327566ijce0401_04 · Cited by 1,799
Task complexity: Definition of the construct
Wood, R. E. (1986) · Organizational Behavior and Human Decision Processes · doi:10.1016/0749-5978(86)90044-0 · Cited by 1,393 · cited 2×
“Task complexity pertains to the characteristics of a task that contribute to an increased load of information [133], and it is distinct from task difficulty [100], which relates to an individual’s perception of the task-based on their capabilities and previous experience [133].”
Lee, M. K. (2018) · Big Data & Society · doi:10.1177/2053951718756684 · Cited by 1,338 · cited 3×
“We also considered traffic conditions in both diagnostic and prognostic scenarios, although, in the real world, traffic conditions can change over time and at the time of decision-making, making them predominantly prognostic.”
BackgroundResultBuçinca, Z., Malaya, M. B., & Gajos, K. Z. (2021) · arXiv · doi:10.48550/arxiv.2102.09692 · Cited by 1,124
Power to the People: The Role of Humans in Interactive Machine Learning
Amershi, S., Cakmak, M., Knox, W. B., & Kulesza, T. (2014) · AI Magazine · doi:10.1609/aimag.v35i4.2513 · Cited by 1,084 · cited 1×
“In recent years, the use of AI technologies has evolved to encompass more collaborative approaches that involve both humans and AI systems working together [5, 21, 22, 73, 129].”
Adjusted P-Values for Simultaneous Inference
Wright, S. P. (1992) · Biometrics · doi:10.2307/2532694 · Cited by 1,026 · cited 1×
“If the adjusted p-value for an individual hypothesis is less than the significance level (0.05), then the null hypothesis is rejected, indicating a statistically significant result [135].”
InfluentialMeasuring Numeracy without a Math Test: Development of the Subjective Numeracy Scale
Fagerlin, A., Zikmund-Fisher, B. J., Ubel, P. A., Jankovic, A., Derry, H. A., & Smith, D. M. (2007) · Medical Decision Making · doi:10.1177/0272989x07304449 · Cited by 960 · cited 1×
“To measure numeracy skills, we employed the Subjective Numeracy Scale [38], which is a self-report measure of perceived ability to perform various mathematical tasks and preference for the use of numerical information.”
MethodZhang, Y., Liao, Q. V., & Bellamy, R. K. E. (2020) · Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency · doi:10.1145/3351095.3372852 · Cited by 895 · cited 3×
“With the emergence of human-AI decision-making as a prominent paradigm across various domains, numerous investigations have been dedicated to understanding the factors that can impact trust and reliance on AI systems [84, 138, 142].”
BackgroundMethodFranke, T., Attig, C., & Wessel, D. (2019) · International Journal of Human–Computer Interaction · doi:10.1080/10447318.2018.1456150 · Cited by 828 · cited 1×
“Additionally, we administered the Affinity for Technology Interaction Scale (ATI) [41] to determine participants’ level of comfort and familiarity with technology [120].”
MethodA systematic review of algorithm aversion in augmented decision making
Burton, J. W., Stein, M., & Jensen, T. B. (2020) · Journal of Behavioral Decision Making · doi:10.1002/bdm.2155 · Cited by 814 · cited 1×
“Additionally, it may also stem from the limited trust [18, 19] surrounding AI systems, coupled with concerns about potential biases or errors in algorithms [77, 120], particularly when human lives or ethical considerations are at stake due to possible failures of AI systems [68, 74, 104].”
BackgroundDoes the Whole Exceed its Parts? The Effect of AI Explanations on Complementary Team Performance
Bansal, G., Wu, T., Zhou, J., Fok, R., Nushi, B., Kamar, E., Ribeiro, M. T., & Weld, D. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445717 · Cited by 757 · cited 3×
“In addition to these measures of reliance, we also evaluated participants’ decision-making accuracy, demonstrating the human-AI team performance [11, 108].”
BackgroundDoes the Whole Exceed its Parts? The Effect of AI Explanations on Complementary Team Performance
Bansal, G., Wu, T., Zhou, J., Fok, R., Nushi, B., Kamar, E., Ribeiro, M. T., & Weld, D. S. (2020) · arXiv · doi:10.48550/arxiv.2006.14779 · Cited by 754
Manipulating and Measuring Model Interpretability
Poursabzi-Sangdeh, F., Goldstein, D. G., Hofman, J. M., Wortman Vaughan, J. W., & Wallach, H. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445315 · Cited by 728 · cited 6×
“Similarly, in a study by Poursabzi-Sangdeh et al. [105], participants were presented with varying numbers of features to predict apartment selling prices.”
InfluentialManipulating and Measuring Model Interpretability
Poursabzi-Sangdeh, F., Goldstein, D. G., Hofman, J. M., Vaughan, J. W., & Wallach, H. (2018) · arXiv · doi:10.48550/arxiv.1802.07810 · Cited by 711
Beede, E., Baylor, E., Hersch, F., Iurchenko, A., Wilcox, L., Ruamviboonsuk, P., & Vardoulakis, L. M. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376718 · Cited by 614 · cited 1×
“…wide range of studies, researchers have consistently found that reliance on AI systems is influenced by various factors including human-related aspects [37, 51, 81, 101, 120], attributes of the AI systems [43, 79, 106, 107], and characteristics of the decision-making tasks [9, 12, 16, 46, 126].”
BackgroundCai, C. J., Winter, S., Steiner, D., Wilcox, L., & Terry, M. (2019) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3359206 · Cited by 594
Nauta, M., Trienes, J., Pathak, S., Nguyen, E., Peters, M., Schmitt, Y., Schlötterer, J., van Keulen, M., & Seifert, C. (2023) · ACM Computing Surveys · doi:10.1145/3583558 · Cited by 590 · cited 1×
“Some prior works have also provided a taxonomy of task types existing in the literature [1, 92].”
BackgroundFormalizing Trust in Artificial Intelligence: Prerequisites, Causes and Goals of Human Trust in AI
Jacovi, A., Marasović, A., Miller, T., & Goldberg, Y. (2021) · Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3442188.3445923 · Cited by 545 · cited 3×
“Prior work has highlighted that appropriate trust and reliance play a critical role in achieving complementary human-AI team performance [58, 90, 139, 141].”
BackgroundMethodUnderstanding the Effect of Accuracy on Trust in Machine Learning Models
Yin, M., Wortman Vaughan, J., & Wallach, H. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300509 · Cited by 527 · cited 3×
“With the emergence of human-AI decision-making as a prominent paradigm across various domains, numerous investigations have been dedicated to understanding the factors that can impact trust and reliance on AI systems [84, 138, 142].”
BackgroundMethodTowards Faithfully Interpretable NLP Systems: How Should We Define and Evaluate Faithfulness?
Jacovi, A., & Goldberg, Y. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.386 · Cited by 503 · cited 1×
“Moreover, as task complexity increases, the verifability [40] and plausibility [57, 60] of AI advice tend to decrease.”
BackgroundVeale, M., Van Kleek, M., & Binns, R. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3174014 · Cited by 490 · cited 2×
“Furthermore, the level of trust and reliance on AI may differ across various domains and applications due to the attributes associated with decision tasks [42, 127].”
BackgroundTHE MEASUREMENT OF TRUST AND ITS RELATIONSHIP TO SELF-DISCLOSURE
WHEELESS, L. R., & GROTZ, J. (1977) · Human Communication Research · doi:10.1111/j.1468-2958.1977.tb00523.x · Cited by 474 · cited 1×
“Trust in AI systems, namely perceived trustworthiness, can be evaluated through different methodologies, including subjective self-reported measures [26, 59, 63, 132] and relatively objective trust-related behavioral measures [51, 128, 138, 142], such as agreement and compliance.”
Beyond Accuracy: The Role of Mental Models in Human-AI Team Performance
Bansal, G., Nushi, B., Kamar, E., Lasecki, W. S., Weld, D. S., & Horvitz, E. (2019) · Proceedings of the AAAI Conference on Human Computation and Crowdsourcing · doi:10.1609/hcomp.v7i1.5285 · Cited by 466 · cited 7×
“…wide range of studies, researchers have consistently found that reliance on AI systems is influenced by various factors including human-related aspects [37, 51, 81, 101, 120], attributes of the AI systems [43, 79, 106, 107], and characteristics of the decision-making tasks [9, 12, 16, 46, 126].”
InfluentialTask complexity: A review and conceptualization framework
Liu, P., & Li, Z. (2012) · International Journal of Industrial Ergonomics · doi:10.1016/j.ergon.2012.09.001 · Cited by 438 · cited 2×
“The degree of task complexity is deemed one of the primary indicators for determining the success of Human-AI teams [3, 9, 23, 83].”
A., S., & R., S. (2023) · Decision Analytics Journal · doi:10.1016/j.dajour.2023.100230 · Cited by 432
Human-Centered Tools for Coping with Imperfect Algorithms During Medical Decision-Making
Cai, C. J., Reif, E., Hegde, N., Hipp, J., Kim, B., Smilkov, D., Wattenberg, M., Viegas, F., Corrado, G. S., Stumpe, M. C., et al. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300234 · Cited by 405 · cited 2×
“These mechanisms include providing interpretable explanations for AI advice [21, 72, 123], using cognitive forcing functions[17, 47, 99], and incorporating feedback loops to enhance the interaction between humans and AI systems [10, 11, 139].”
Explanations Can Reduce Overreliance on AI Systems During Decision-Making
Vasconcelos, H., Jörke, M., Grunde-McLaughlin, M., Gerstenberg, T., Bernstein, M. S., & Krishna, R. (2023) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3579605 · Cited by 402
The Principles and Limits of Algorithm-in-the-Loop Decision Making
Green, B., & Chen, Y. (2019) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3359152 · Cited by 392 · cited 2×
“For example, in high-stake scenarios such as in the medical [39, 61, 67, 97], legal [6, 81, 86, 131], and financial [27, 36, 43, 45, 46] domains, individuals tend to exhibit a preference for human decision-makers over AI systems.”
Lai, V., & Tan, C. (2019) · Proceedings of the Conference on Fairness, Accountability, and Transparency · doi:10.1145/3287560.3287590 · Cited by 377 · cited 2×
“In addition, the attributes of AI systems can enhance decision-making outcomes [68], which include aspects such as predictions generated by AI [66, 76, 99], information about AI predictions or AI systems themselves [13, 70, 118, 136], and interventions that impact cognitive processes [65, 99, 105].”
BackgroundHuman-AI Collaboration in Data Science: Exploring Data Scientists' Perceptions of Automated AI
Wang, D., Weisz, J. D., Muller, M., Ram, P., Geyer, W., Dugan, C., Tausczik, Y., Samulowitz, H., & Gray, A. (2019) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3359313 · Cited by 342 · cited 1×
“In recent years, the use of AI technologies has evolved to encompass more collaborative approaches that involve both humans and AI systems working together [5, 21, 22, 73, 129].”
BackgroundWang, X., & Yin, M. (2021) · 26th International Conference on Intelligent User Interfaces · doi:10.1145/3397481.3450650 · Cited by 320 · cited 3×
“For example, in high-stake scenarios such as in the medical [39, 61, 67, 97], legal [6, 81, 86, 131], and financial [27, 36, 43, 45, 46] domains, individuals tend to exhibit a preference for human decision-makers over AI systems.”
BackgroundTheoretical Considerations and Development of a Questionnaire to Measure Trust in Automation
Körber, M. (2019) · Advances in Intelligent Systems and Computing · doi:10.1007/978-3-319-96074-6_2 · Cited by 317 · cited 7×
“Although there may not be a correlation between trust and reliance on AI systems [63, 71, 90, 114], prior work suggests a higher likelihood of individuals placing greater trust in AI systems for more complex tasks [53, 71].”
BackgroundMethodResultInfluentialIslam, M. R., Ahmed, M. U., Barua, S., & Begum, S. (2022) · Applied Sciences · doi:10.3390/app12031353 · Cited by 311 · cited 1×
“Such factors can be broadly classified into three primary categories: human-related factors [35, 95, 96], attributes of the AI systems [94, 98], and characteristics of the decision-making tasks [16, 56, 126].”
BackgroundProxy tasks and subjective measures can be misleading in evaluating explainable AI systems
Buçinca, Z., Lin, P., Gajos, K. Z., & Glassman, E. L. (2020) · Proceedings of the 25th International Conference on Intelligent User Interfaces · doi:10.1145/3377325.3377498 · Cited by 307 · cited 3×
“Such factors can be broadly classified into three primary categories: human-related factors [35, 95, 96], attributes of the AI systems [94, 98], and characteristics of the decision-making tasks [16, 56, 126].”
BackgroundResultExplaining Decision-Making Algorithms through UI: Strategies to Help Non-Expert Stakeholders
Cheng, H.-F., Wang, R., Zhang, Z., O'Connell, F., Gray, T., Harper, F. M., & Zhu, H. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300789 · Cited by 292 · cited 1×
“We also considered traffic conditions in both diagnostic and prognostic scenarios, although, in the real world, traffic conditions can change over time and at the time of decision-making, making them predominantly prognostic.”
BackgroundExplaining models: an empirical study of how explanations impact fairness judgment
Dodge, J., Liao, Q. V., Zhang, Y., Bellamy, R. K. E., & Dugan, C. (2019) · Proceedings of the 24th International Conference on Intelligent User Interfaces · doi:10.1145/3301275.3302310 · Cited by 286
Updates in Human-AI Teams: Understanding and Addressing the Performance/Compatibility Tradeoff
Bansal, G., Nushi, B., Kamar, E., Weld, D. S., Lasecki, W. S., & Horvitz, E. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33012429 · Cited by 284 · cited 1×
“We also considered traffic conditions in both diagnostic and prognostic scenarios, although, in the real world, traffic conditions can change over time and at the time of decision-making, making them predominantly prognostic.”
BackgroundTowards Human-Centered Explainable AI: A Survey of User Studies for Model Explanations
Rong, Y., Leemann, T., Nguyen, T.-T., Fiedler, L., Qian, P., Unhelkar, V., Seidel, T., Kasneci, G., & Kasneci, E. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3331846 · Cited by 278 · cited 1×
“In addition to these measures of reliance, we also evaluated participants’ decision-making accuracy, demonstrating the human-AI team performance [11, 108].”
Trunk, A., Birkel, H., & Hartmann, E. (2020) · Business Research · doi:10.1007/s40685-020-00133-x · Cited by 252 · cited 1×
“Recent studies have explored variables that contribute to the fairness [31, 76, 124, 130] and trustworthiness [34, 48, 80, 139] of AI systems, as well as the impact of assigning different decision-making roles to humans and AI on the reliance on such systems [52, 103, 122, 144].”
BackgroundLo Piano, S. (2020) · Humanities and Social Sciences Communications · doi:10.1057/s41599-020-0501-9 · Cited by 229 · cited 2×
“This preference could be motivated by ethical and legal concerns [68, 74, 104], as well as a desire for individual agency and accountability [54, 70, 81, 117].”
BackgroundHow to Evaluate Trust in AI-Assisted Decision Making? A Survey of Empirical Methodologies
Vereschak, O., Bailly, G., & Caramiaux, B. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3476068 · Cited by 229
Tell me more?: the effects of mental model soundness on personalizing an intelligent agent
Kulesza, T., Stumpf, S., Burnett, M., & Kwan, I. (2012) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2207676.2207678 · Cited by 225 · cited 1×
“In addition, the attributes of AI systems can enhance decision-making outcomes [68], which include aspects such as predictions generated by AI [66, 76, 99], information about AI predictions or AI systems themselves [13, 70, 118, 136], and interventions that impact cognitive processes [65, 99, 105].”
BackgroundLee, M. K., Jain, A., Cha, H. J., Ojha, S., & Kusbit, D. (2019) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3359284 · Cited by 223
A Case for Humans-in-the-Loop: Decisions in the Presence of Erroneous Algorithmic Scores
De-Arteaga, M., Fogliato, R., & Chouldechova, A. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376638 · Cited by 221 · cited 5×
“With the presence of uncertainty in a task, individuals may lack sufficient capability to verify the correctness of AI advice and therefore rely more heavily on the AI systems [29], leading to reduced appropriate reliance on AI systems.”
BackgroundInfluentialThe effects of example-based explanations in a machine learning interface
Cai, C. J., Jongejan, J., & Holbrook, J. (2019) · Proceedings of the 24th International Conference on Intelligent User Interfaces · doi:10.1145/3301275.3302289 · Cited by 220 · cited 1×
“According to Lai et al. [69], tasks can also be differentiated based on whether they are emulating human intelligence, like object recognition [20], or based on discovered patterns in data such as recidivism prediction [86].”
BackgroundWang, R., Harper, F. M., & Zhu, H. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376813 · Cited by 211 · cited 1×
“Recent studies have explored variables that contribute to the fairness [31, 76, 124, 130] and trustworthiness [34, 48, 80, 139] of AI systems, as well as the impact of assigning different decision-making roles to humans and AI on the reliance on such systems [52, 103, 122, 144].”
BackgroundSchramowski, P., Stammer, W., Teso, S., Brugger, A., Herbert, F., Shao, X., Luigs, H.-G., Mahlein, A.-K., & Kersting, K. (2020) · Nature Machine Intelligence · doi:10.1038/s42256-020-0212-3 · Cited by 207 · cited 1×
“The subjective trust in the AI system was assessed using the Trust in Automation questionnaire (TiA) [63], which is a commonly employed and validated tool for measuring trust [78, 116, 120].”
MethodLai, V., Chen, C., Smith-Renner, A., Liao, Q. V., & Tan, C. (2023) · 2023 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3593013.3594087 · Cited by 204 · cited 10×
“For instance, cognitive [35, 68, 96] or meta-cognitive biases [51] have the potential to influence how individuals comprehend and appraise the outcomes generated by AI systems which in turn can affect their reliance on AI.”
BackgroundResultInfluentialHow do visual explanations foster end users' appropriate trust in machine learning?
Yang, F., Huang, Z., Scholtz, J., & Arendt, D. L. (2020) · Proceedings of the 25th International Conference on Intelligent User Interfaces · doi:10.1145/3377325.3377480 · Cited by 200 · cited 2×
“Prior work has also been dedicated to developing and evaluating interfaces [15, 30, 87, 89] and visualizations [43, 49, 134, 137, 140] aimed at improving human-AI collaboration.”
BackgroundMethodRapid Trust Calibration through Interpretable and Uncertainty-Aware AI
Tomsett, R., Preece, A., Braines, D., Cerutti, F., Chakraborty, S., Srivastava, M., Pearson, G., & Kaplan, L. (2020) · Patterns · doi:10.1016/j.patter.2020.100049 · Cited by 186 · cited 1×
“Previous research has also demonstrated the influence of uncertainty on trust formation in AI systems [121].”
Modeling Strategic Behavior in Human-Automation Interaction: Why an "Aid" Can (and Should) Go Unused
Kirlik, A. (1993) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/001872089303500203 · Cited by 177 · cited 1×
“Prior studies have shown that individuals may not necessarily increase their reliance on AI systems even if they trust them [62, 63, 90].”
Comparing Automatic and Human Evaluation of Local Explanations for Text Classification
Nguyen, D. (2018) · Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers) · doi:10.18653/v1/n18-1097 · Cited by 173
Evaluating saliency map explanations for convolutional neural networks: a user study
Alqaraawi, A., Schuessler, M., Weiß, P., Costanza, E., & Berthouze, N. (2020) · Proceedings of the 25th International Conference on Intelligent User Interfaces · doi:10.1145/3377325.3377519 · Cited by 163 · cited 1×
“We also considered traffic conditions in both diagnostic and prognostic scenarios, although, in the real world, traffic conditions can change over time and at the time of decision-making, making them predominantly prognostic.”
BackgroundLet Me Explain: Impact of Personal and Impersonal Explanations on Trust in Recommender Systems
Kunkel, J., Donkers, T., Michael, L., Barbu, C.-M., & Ziegler, J. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300717 · Cited by 156 · cited 5×
“To this end, researchers and practitioners have explored the use of explanation methods [66, 94, 126], interventions such as tutorials [25, 84] and cognitive forcing functions [17] to foster appropriate reliance on AI systems with varying degrees of success.”
BackgroundInfluentialHilb, M. (2020) · Journal of Management and Governance · doi:10.1007/s10997-020-09519-9 · Cited by 148 · cited 1×
“Recent studies have explored variables that contribute to the fairness [31, 76, 124, 130] and trustworthiness [34, 48, 80, 139] of AI systems, as well as the impact of assigning different decision-making roles to humans and AI on the reliance on such systems [52, 103, 122, 144].”
BackgroundI Think I Get Your Point, AI! The Illusion of Explanatory Depth in Explainable AI
Chromik, M., Eiband, M., Buchner, F., Krüger, A., & Butz, A. (2021) · 26th International Conference on Intelligent User Interfaces · doi:10.1145/3397481.3450644 · Cited by 144 · cited 2×
“Tasks that involve inherent uncertainty are often those where humans tend to rely on AI systems for advice, such as loan approval [27, 34, 124], recidivism prediction [31, 47, 86], house price estimation [2, 13, 25], and student admission [13, 24].”
It's complicated: the relationship between user trust, model accuracy and explanations in AI
Papenmeier, A., Kern, D., Englebienne, G., & Seifert, C. (2022) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3495013 · Cited by 144 · cited 2×
“Such factors can be broadly classified into three primary categories: human-related factors [35, 95, 96], attributes of the AI systems [94, 98], and characteristics of the decision-making tasks [16, 56, 126].”
BackgroundKawakami, A., Sivaraman, V., Cheng, H.-F., Stapleton, L., Cheng, Y., Qing, D., Perer, A., Wu, Z. S., Zhu, H., & Holstein, K. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3517439 · Cited by 143
A Human-AI Collaborative Approach for Clinical Decision Making on Rehabilitation Assessment
Lee, M. H., Siewiorek, D. P., Smailagic, A., Bernardino, A., & Bermúdez i Badia, S. B. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445472 · Cited by 137 · cited 2×
“This preference could be motivated by ethical and legal concerns [68, 74, 104], as well as a desire for individual agency and accountability [54, 70, 81, 117].”
BackgroundVisual, textual or hybrid: the effect of user expertise on different explanations
Szymanski, M., Millecamp, M., & Verbert, K. (2021) · 26th International Conference on Intelligent User Interfaces · doi:10.1145/3397481.3450662 · Cited by 131 · cited 1×
“Human factors such as prior experience [110, 119], cognitive biases [85, 102], and AI literacy [25], which can shape individuals’ perceptions and interactions with AI systems.”
BackgroundHuman Reliance on Machine Learning Models When Performance Feedback is Limited: Heuristics and Risks
Lu, Z., & Yin, M. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445562 · Cited by 131 · cited 2×
“To this end, researchers and practitioners have explored the use of explanation methods [66, 94, 126], interventions such as tutorials [25, 84] and cognitive forcing functions [17] to foster appropriate reliance on AI systems with varying degrees of success.”
BackgroundPanigutti, C., Beretta, A., Giannotti, F., & Pedreschi, D. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3502104 · Cited by 126
"Why is 'Chicago' deceptive?" Towards Building Model-Driven Tutorials for Humans
Lai, V., Liu, H., & Tan, C. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376873 · Cited by 123 · cited 2×
“Given the increasing complexity and uncertainty of tasks, it becomes crucial to develop strategies that can help users evaluate the reliability and verifiability of AI advice in these scenarios.”
BackgroundI can do better than your AI: expertise and explanations
Schaffer, J., O'Donovan, J., Michaelis, J., Raglin, A., & Höllerer, T. (2019) · Proceedings of the 24th International Conference on Intelligent User Interfaces · doi:10.1145/3301275.3302308 · Cited by 119 · cited 2×
“Human factors such as prior experience [110, 119], cognitive biases [85, 102], and AI literacy [25], which can shape individuals’ perceptions and interactions with AI systems.”
BackgroundDrozdal, J., Weisz, J., Wang, D., Dass, G., Yao, B., Zhao, C., Muller, M., Ju, L., & Su, H. (2020) · Proceedings of the 25th International Conference on Intelligent User Interfaces · doi:10.1145/3377325.3377501 · Cited by 119
Nourani, M., King, J., & Ragan, E. (2020) · Proceedings of the AAAI Conference on Human Computation and Crowdsourcing · doi:10.1609/hcomp.v8i1.7469 · Cited by 116 · cited 2×
“Such factors can be broadly classified into three primary categories: human-related factors [35, 95, 96], attributes of the AI systems [94, 98], and characteristics of the decision-making tasks [16, 56, 126].”
BackgroundHuman Decision Making with Machine Assistance: An Experiment on Bailing and Jailing
Grgić-Hlača, N., Engel, C., & Gummadi, K. P. (2019) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3359280 · Cited by 113 · cited 1×
“We also considered traffic conditions in both diagnostic and prognostic scenarios, although, in the real world, traffic conditions can change over time and at the time of decision-making, making them predominantly prognostic.”
BackgroundSmith-Renner, A., Fan, R., Birchfield, M., Wu, T., Boyd-Graber, J., Weld, D. S., & Findlater, L. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376624 · Cited by 112 · cited 2×
“We also considered traffic conditions in both diagnostic and prognostic scenarios, although, in the real world, traffic conditions can change over time and at the time of decision-making, making them predominantly prognostic.”
BackgroundThe limits of human predictions of recidivism
Lin, Z. “., Jung, J., Goel, S., & Skeem, J. (2020) · Science Advances · doi:10.1126/sciadv.aaz0652 · Cited by 112
Human Evaluation of Models Built for Interpretability
Lage, I., Chen, E., He, J., Narayanan, M., Kim, B., Gershman, S. J., & Doshi-Velez, F. (2019) · Proceedings of the AAAI Conference on Human Computation and Crowdsourcing · doi:10.1609/hcomp.v7i1.5280 · Cited by 110 · cited 1×
“For example, in high-stake scenarios such as in the medical [39, 61, 67, 97], legal [6, 81, 86, 131], and financial [27, 36, 43, 45, 46] domains, individuals tend to exhibit a preference for human decision-makers over AI systems.”
Anchoring Bias Affects Mental Model Formation and User Reliance in Explainable AI Systems
Nourani, M., Roy, C., Block, J. E., Honeycutt, D. R., Rahman, T., Ragan, E., & Gogate, V. (2021) · 26th International Conference on Intelligent User Interfaces · doi:10.1145/3397481.3450639 · Cited by 107 · cited 2×
“Such factors can be broadly classified into three primary categories: human-related factors [35, 95, 96], attributes of the AI systems [94, 98], and characteristics of the decision-making tasks [16, 56, 126].”
BackgroundKnowing About Knowing: An Illusion of Human Competence Can Hinder Appropriate Reliance on AI Systems
He, G., Kuiper, L., & Gadiraju, U. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581025 · Cited by 107 · cited 6×
“…wide range of studies, researchers have consistently found that reliance on AI systems is influenced by various factors including human-related aspects [37, 51, 81, 101, 120], attributes of the AI systems [43, 79, 106, 107], and characteristics of the decision-making tasks [9, 12, 16, 46, 126].”
BackgroundMethodInfluentialSelf-citationAnik, A. I., & Bunt, A. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445736 · Cited by 103 · cited 3×
“For example, in high-stake scenarios such as in the medical [39, 61, 67, 97], legal [6, 81, 86, 131], and financial [27, 36, 43, 45, 46] domains, individuals tend to exhibit a preference for human decision-makers over AI systems.”
BackgroundBell, A., Solano-Kamaiko, I., Nov, O., & Stoyanovich, J. (2022) · 2022 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3531146.3533090 · Cited by 103 · cited 2×
“In addition, the attributes of AI systems can enhance decision-making outcomes [68], which include aspects such as predictions generated by AI [66, 76, 99], information about AI predictions or AI systems themselves [13, 70, 118, 136], and interventions that impact cognitive processes [65, 99, 105].”
Background“Who goes first? Influences of human-AI workflow on decision making in clinical imaging,”
Fogliato, R., Chappidi, S., Lungren, M., Fisher, P., Wilson, D., Fitzke, M., Parkinson, M., Horvitz, E., Inkpen, K., & Nushi, B. (2022) · 2022 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3531146.3533193 · Cited by 103 · cited 1×
“For example, in high-stake scenarios such as in the medical [39, 61, 67, 97], legal [6, 81, 86, 131], and financial [27, 36, 43, 45, 46] domains, individuals tend to exhibit a preference for human decision-makers over AI systems.”
BackgroundNourani, M., Kabir, S., Mohseni, S., & Ragan, E. D. (2019) · Proceedings of the AAAI Conference on Human Computation and Crowdsourcing · doi:10.1609/hcomp.v7i1.5284 · Cited by 100 · cited 2×
“To this end, researchers and practitioners have explored the use of explanation methods [66, 94, 126], interventions such as tutorials [25, 84] and cognitive forcing functions [17] to foster appropriate reliance on AI systems with varying degrees of success.”
BackgroundCOGAM: Measuring and Moderating Cognitive Load in Machine Learning Model Explanations
Abdul, A., von der Weth, C., Kankanhalli, M., & Lim, B. Y. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376615 · Cited by 96 · cited 2×
“For instance, various explanation methods have been explored to enhance the interpretability and transparency of AI algorithms, allowing humans to better understand AI advice [2, 50, 66].”
BackgroundMethodViCE: visual counterfactual explanations for machine learning models
Gomez, O., Holter, S., Yuan, J., & Bertini, E. (2020) · Proceedings of the 25th International Conference on Intelligent User Interfaces · doi:10.1145/3377325.3377536 · Cited by 91 · cited 4×
“Prior work has also been dedicated to developing and evaluating interfaces [15, 30, 87, 89] and visualizations [43, 49, 134, 137, 140] aimed at improving human-AI collaboration.”
BackgroundMethodInfluentialTask complexity moderates group synergy
Almaatouq, A., Alsobay, M., Yin, M., & Watts, D. J. (2021) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2101062118 · Cited by 87 · cited 2×
“The degree of task complexity is deemed one of the primary indicators for determining the success of Human-AI teams [3, 9, 23, 83].”
Exploring and Promoting Diagnostic Transparency and Explainability in Online Symptom Checkers
Tsai, C.-H., You, Y., Gui, X., Kou, Y., & Carroll, J. M. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445101 · Cited by 86 · cited 1×
“We also considered traffic conditions in both diagnostic and prognostic scenarios, although, in the real world, traffic conditions can change over time and at the time of decision-making, making them predominantly prognostic.”
BackgroundA Checklist to Combat Cognitive Biases in Crowdsourcing
Draws, T., Rieger, A., Inel, O., Gadiraju, U., & Tintarev, N. (2021) · Proceedings of the AAAI Conference on Human Computation and Crowdsourcing · doi:10.1609/hcomp.v9i1.18939 · Cited by 86 · cited 1×
“According to the checklist of cognitive biases provided by Draws et al. [33], it is important to acknowledge that humans are prone to cognitive biases.”
Self-citationYou Complete Me: Human-AI Teams and Complementary Expertise
Zhang, Q., Lee, M. L., & Carter, S. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3517791 · Cited by 85 · cited 2×
“Prior work has highlighted that appropriate trust and reliance play a critical role in achieving complementary human-AI team performance [58, 90, 139, 141].”
BackgroundMethodEffect of Information Presentation on Fairness Perceptions of Machine Learning Predictors
van Berkel, N., Goncalves, J., Russo, D., Hosio, S., & Skov, M. B. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445365 · Cited by 84 · cited 2×
“Recent studies have explored variables that contribute to the fairness [31, 76, 124, 130] and trustworthiness [34, 48, 80, 139] of AI systems, as well as the impact of assigning different decision-making roles to humans and AI on the reliance on such systems [52, 103, 122, 144].”
BackgroundMerritt, S. M., Lee, D., Unnerstall, J. L., & Huber, K. (2015) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720814561675 · Cited by 83 · cited 1×
“We leveraged a set of objective metrics to quantify participants’ reliance on the AI system (cf. Table 2) [58, 88, 90, 113, 139, 141].”
MethodFok, R., & Weld, D. S. (2024) · AI Magazine · doi:10.1002/aaai.12182 · Cited by 81
No Risk No Trust: Investigating Perceived Risk in Highly Automated Driving
Li, M., Holthausen, B. E., Stuck, R. E., & Walker, B. N. (2019) · Proceedings of the 11th International Conference on Automotive User Interfaces and Interactive Vehicular Applications · doi:10.1145/3342197.3344525 · Cited by 80 · cited 1×
“The subjective trust in the AI system was assessed using the Trust in Automation questionnaire (TiA) [63], which is a commonly employed and validated tool for measuring trust [78, 116, 120].”
MethodHow Do We Assess the Trustworthiness of AI? Introducing the Trustworthiness Assessment Model (TrAM)
Schlicker, N., Baum, K., Uhde, A., Sterz, S., Hirsch, M. C., & Langer, M. (2022) · doi:10.31234/osf.io/qhwvx · Cited by 79
How do we assess the trustworthiness of AI? Introducing the trustworthiness assessment model (TrAM)
Schlicker, N., Baum, K., Uhde, A., Sterz, S., Hirsch, M. C., & Langer, M. (2025) · Computers in Human Behavior · doi:10.1016/j.chb.2025.108671 · Cited by 76
Levy, A., Agrawal, M., Satyanarayan, A., & Sontag, D. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445522 · Cited by 73 · cited 2×
“We also considered traffic conditions in both diagnostic and prognostic scenarios, although, in the real world, traffic conditions can change over time and at the time of decision-making, making them predominantly prognostic.”
BackgroundHoneycutt, D., Nourani, M., & Ragan, E. (2020) · Proceedings of the AAAI Conference on Human Computation and Crowdsourcing · doi:10.1609/hcomp.v8i1.7464 · Cited by 72 · cited 1×
“This preference could be motivated by ethical and legal concerns [68, 74, 104], as well as a desire for individual agency and accountability [54, 70, 81, 117].”
Behavioral Measurement of Trust in Automation: The Trust Fall
Miller, D., Johns, M., Mok, B., Gowda, N., Sirkin, D., Lee, K., & Ju, W. (2016) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/1541931213601422 · Cited by 71 · cited 7×
“Although there may not be a correlation between trust and reliance on AI systems [63, 71, 90, 114], prior work suggests a higher likelihood of individuals placing greater trust in AI systems for more complex tasks [53, 71].”
BackgroundMethodResultInfluentialDo I trust my machine teammate?: an investigation from perception to decision
Yu, K., Berkovsky, S., Taib, R., Zhou, J., & Chen, F. (2019) · Proceedings of the 24th International Conference on Intelligent User Interfaces · doi:10.1145/3301275.3302277 · Cited by 71 · cited 4×
“Prior work has highlighted that appropriate trust and reliance play a critical role in achieving complementary human-AI team performance [58, 90, 139, 141].”
BackgroundMethodInfluentialTheoretical considerations and development of a questionnaire to measure trust in automation
Körber, M. (2018) · doi:10.31234/osf.io/nfc45 · Cited by 71
Human Perceptions on Moral Responsibility of AI: A Case Study in AI-Assisted Bail Decision-Making
Lima, G., Grgić-Hlača, N., & Cha, M. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445260 · Cited by 70 · cited 3×
“…wide range of studies, researchers have consistently found that reliance on AI systems is influenced by various factors including human-related aspects [37, 51, 81, 101, 120], attributes of the AI systems [43, 79, 106, 107], and characteristics of the decision-making tasks [9, 12, 16, 46, 126].”
BackgroundGreen, B., & Chen, Y. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3479562 · Cited by 69 · cited 3×
“…wide range of studies, researchers have consistently found that reliance on AI systems is influenced by various factors including human-related aspects [37, 51, 81, 101, 120], attributes of the AI systems [43, 79, 106, 107], and characteristics of the decision-making tasks [9, 12, 16, 46, 126].”
Second Chance for a First Impression? Trust Development in Intelligent System Interaction
Tolmeijer, S., Gadiraju, U., Ghantasala, R., Gupta, A., & Bernstein, A. (2021) · Proceedings of the 29th ACM Conference on User Modeling, Adaptation and Personalization · doi:10.1145/3450613.3456817 · Cited by 67 · cited 7×
“…wide range of studies, researchers have consistently found that reliance on AI systems is influenced by various factors including human-related aspects [37, 51, 81, 101, 120], attributes of the AI systems [43, 79, 106, 107], and characteristics of the decision-making tasks [9, 12, 16, 46, 126].”
InfluentialSelf-citationA Slow Algorithm Improves Users' Assessments of the Algorithm's Accuracy
Park, J. S., Barber, R., Kirlik, A., & Karahalios, K. (2019) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3359204 · Cited by 65 · cited 3×
“In addition, the attributes of AI systems can enhance decision-making outcomes [68], which include aspects such as predictions generated by AI [66, 76, 99], information about AI predictions or AI systems themselves [13, 70, 118, 136], and interventions that impact cognitive processes [65, 99, 105].”
The Effect of Culture on Trust in Automation: Reliability and Workload
Chien, S.-Y., Lewis, M., Sycara, K., Liu, J.-S., & Kumru, A. (2018) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/3230736 · Cited by 58 · cited 1×
“Trust in AI systems, namely perceived trustworthiness, can be evaluated through different methodologies, including subjective self-reported measures [26, 59, 63, 132] and relatively objective trust-related behavioral measures [51, 128, 138, 142], such as agreement and compliance.”
MethodLee, M. H., Siewiorek, D. P., Smailagic, A., Bernardino, A., & Bermúdez i Badia, S. (2020) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3415227 · Cited by 57 · cited 1×
“These mechanisms include providing interpretable explanations for AI advice [21, 72, 123], using cognitive forcing functions[17, 47, 99], and incorporating feedback loops to enhance the interaction between humans and AI systems [10, 11, 139].”
Visualizing Uncertainty and Alternatives in Event Sequence Predictions
Guo, S., Du, F., Malik, S., Koh, E., Kim, S., Liu, Z., Kim, D., Zha, H., & Cao, N. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300803 · Cited by 56 · cited 1×
“Prior work has also been dedicated to developing and evaluating interfaces [15, 30, 87, 89] and visualizations [43, 49, 134, 137, 140] aimed at improving human-AI collaboration.”
Banovic, N., Yang, Z., Ramesh, A., & Liu, A. (2023) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3579460 · Cited by 55 · cited 3×
“Even if a system is trustworthy, it does not automatically ensure accurate perceived trustworthiness [8, 113].”
BackgroundFok, R., & Weld, D. S. (2023) · arXiv · doi:10.48550/arxiv.2305.07722 · Cited by 54
Leveraging rationales to improve human task performance
Das, D., & Chernova, S. (2020) · Proceedings of the 25th International Conference on Intelligent User Interfaces · doi:10.1145/3377325.3377512 · Cited by 52 · cited 1×
“Additionally, prior work has demonstrated that individuals tend to rely more heavily on AI systems when confronted with more complex tasks [28] due to the challenges associated with analyzing large volumes of information [23].”
Liao, M., Sundar, S. S., & B. Walther, J. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3501936 · Cited by 52 · cited 1×
“Recent studies have explored variables that contribute to the fairness [31, 76, 124, 130] and trustworthiness [34, 48, 80, 139] of AI systems, as well as the impact of assigning different decision-making roles to humans and AI on the reliance on such systems [52, 103, 122, 144].”
BackgroundWhat's in a User? Towards Personalising Transparency for Music Recommender Interfaces
Millecamp, M., Htun, N. N., Conati, C., & Verbert, K. (2020) · Proceedings of the 28th ACM Conference on User Modeling, Adaptation and Personalization · doi:10.1145/3340631.3394844 · Cited by 50 · cited 2×
“Prior work has also been dedicated to developing and evaluating interfaces [15, 30, 87, 89] and visualizations [43, 49, 134, 137, 140] aimed at improving human-AI collaboration.”
Impact of Algorithmic Decision Making on Human Behavior: Evidence from Ultimatum Bargaining
Erlei, A., Nekdem, F., Meub, L., Anand, A., & Gadiraju, U. (2020) · Proceedings of the AAAI Conference on Human Computation and Crowdsourcing · doi:10.1609/hcomp.v8i1.7462 · Cited by 48 · cited 2×
“…wide range of studies, researchers have consistently found that reliance on AI systems is influenced by various factors including human-related aspects [37, 51, 81, 101, 120], attributes of the AI systems [43, 79, 106, 107], and characteristics of the decision-making tasks [9, 12, 16, 46, 126].”
Self-citationZheng, C., Wu, Y., Shi, C., Ma, S., Luo, J., & Ma, X. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581131 · Cited by 48 · cited 1×
“Recent studies have explored variables that contribute to the fairness [31, 76, 124, 130] and trustworthiness [34, 48, 80, 139] of AI systems, as well as the impact of assigning different decision-making roles to humans and AI on the reliance on such systems [52, 103, 122, 144].”
BackgroundAI-Assisted Human Labeling: Batching for Efficiency without Overreliance
Ashktorab, Z., Desmond, M., Andres, J., Muller, M., Joshi, N. N., Brachman, M., Sharma, A., Brimijoin, K., Pan, Q., Wolf, C. T., et al. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3449163 · Cited by 45
Shared Interest: Measuring Human-AI Alignment to Identify Recurring Patterns in Model Behavior
Boggust, A., Hoover, B., Satyanarayan, A., & Strobelt, H. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3501965 · Cited by 45 · cited 1×
“Although a few studies have included multiple tasks with varying attributes [6, 14, 131], a systematic and empirical understanding of task features is notably absent from existing literature [68, 109].”
BackgroundChan, S. H., Song, Q., & Yao, L. J. (2015) · Computers in Human Behavior · doi:10.1016/j.chb.2015.04.059 · Cited by 43 · cited 6×
“Additionally, prior work has demonstrated that individuals tend to rely more heavily on AI systems when confronted with more complex tasks [28] due to the challenges associated with analyzing large volumes of information [23].”
InfluentialCorporate Management in the Age of AIPreprint
Petrin, M. (2019) · Social Science Research Network · doi:10.2139/ssrn.3346722 · Cited by 43 · cited 1×
“Recent studies have explored variables that contribute to the fairness [31, 76, 124, 130] and trustworthiness [34, 48, 80, 139] of AI systems, as well as the impact of assigning different decision-making roles to humans and AI on the reliance on such systems [52, 103, 122, 144].”
Building Trust in Interactive Machine Learning via User Contributed Interpretable Rules
Guo, L., Daly, E. M., Alkan, O., Mattetti, M., Cornec, O., & Knijnenburg, B. (2022) · 27th International Conference on Intelligent User Interfaces · doi:10.1145/3490099.3511111 · Cited by 43 · cited 1×
“Recent studies have explored variables that contribute to the fairness [31, 76, 124, 130] and trustworthiness [34, 48, 80, 139] of AI systems, as well as the impact of assigning different decision-making roles to humans and AI on the reliance on such systems [52, 103, 122, 144].”
BackgroundChiang, C.-W., & Yin, M. (2022) · 27th International Conference on Intelligent User Interfaces · doi:10.1145/3490099.3511121 · Cited by 42
A Missing Piece in the Puzzle: Considering the Role of Task Complexity in Human-AI Decision Making
Salimzadeh, S., He, G., & Gadiraju, U. (2023) · Proceedings of the 31st ACM Conference on User Modeling, Adaptation and Personalization · doi:10.1145/3565472.3592959 · Cited by 42 · cited 7×
“These limitations have the potential to undermine the credibility and generalizability of research findings, hindering our progress in developing effective strategies for human-AI decision-making [68, 109].”
BackgroundInfluentialSelf-citationWhat You See Is What You Get? The Impact of Representation Criteria on Human Bias in Hiring
Peng, A., Nushi, B., Kıcıman, E., Inkpen, K., Suri, S., & Kamar, E. (2019) · Proceedings of the AAAI Conference on Human Computation and Crowdsourcing · doi:10.1609/hcomp.v7i1.5281 · Cited by 41
Wu, T., Weld, D. S., & Heer, J. (2019) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3319616 · Cited by 39 · cited 2×
“In addition, the attributes of AI systems can enhance decision-making outcomes [68], which include aspects such as predictions generated by AI [66, 76, 99], information about AI predictions or AI systems themselves [13, 70, 118, 136], and interventions that impact cognitive processes [65, 99, 105].”
BackgroundTrust Mediating Reliability–Reliance Relationship in Supervisory Control of Human–Swarm Interactions
Hussein, A., Elsawah, S., & Abbass, H. A. (2020) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720819879273 · Cited by 39 · cited 1×
“While trust is an essential factor in determining the level of reliance on AI systems [55, 63, 71, 111], it is not always a guarantee.”
Increasing the Speed and Accuracy of Data Labeling Through an AI Assisted Interface
Desmond, M., Muller, M., Ashktorab, Z., Dugan, C., Duesterwald, E., Brimijoin, K., Finegan-Dollak, C., Brachman, M., Sharma, A., Joshi, N. N., et al. (2021) · 26th International Conference on Intelligent User Interfaces · doi:10.1145/3397481.3450698 · Cited by 39 · cited 1×
“Prior work has also been dedicated to developing and evaluating interfaces [15, 30, 87, 89] and visualizations [43, 49, 134, 137, 140] aimed at improving human-AI collaboration.”
Implications of Human-Computer Interaction Research
van Berkel, N., & Hornbæk, K. (2023) · interactions · doi:10.1145/3600103 · Cited by 38 · cited 1×
“In this study, we explored how task complexity ( RQ1 ) and task uncertainty ( RQ2 ) and their interaction ( RQ3 ) inform user trust and appropriate reliance on AI systems.”
BackgroundLee, M. H., Siewiorek, D. P., Smailagic, A., Bernardino, A., & Bermúdez i Badia, S. (2020) · Proceedings of the ACM Conference on Health, Inference, and Learning · doi:10.1145/3368555.3384452 · Cited by 35 · cited 1×
“In recent years, the use of AI technologies has evolved to encompass more collaborative approaches that involve both humans and AI systems working together [5, 21, 22, 73, 129].”
BackgroundWright, A. P., Shaikh, O., Park, H., Epperson, W., Ahmed, M., Pinel, S., Chau, D. H., & Yang, D. (2021) · Proc. ACM Hum. Comput. Interact. · doi:10.1145/3449280 · Cited by 35
Understanding the Role of Explanation Modality in AI-assisted Decision-making
Robbemond, V., Inel, O., & Gadiraju, U. (2022) · Proceedings of the 30th ACM Conference on User Modeling, Adaptation and Personalization · doi:10.1145/3503252.3531311 · Cited by 34 · cited 1×
“…wide range of studies, researchers have consistently found that reliance on AI systems is influenced by various factors including human-related aspects [37, 51, 81, 101, 120], attributes of the AI systems [43, 79, 106, 107], and characteristics of the decision-making tasks [9, 12, 16, 46, 126].”
BackgroundSelf-citationErlei, A., Das, R., Meub, L., Anand, A., & Gadiraju, U. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3517734 · Cited by 33 · cited 1×
“For example, in high-stake scenarios such as in the medical [39, 61, 67, 97], legal [6, 81, 86, 131], and financial [27, 36, 43, 45, 46] domains, individuals tend to exhibit a preference for human decision-makers over AI systems.”
BackgroundSelf-citationShould I Follow AI-based Advice? Measuring Appropriate Reliance in Human-AI Decision-Making
Schemmer, M., Hemmer, P., Kühl, N., Benz, C., & Satzger, G. (2022) · arXiv · doi:10.48550/arxiv.2204.06916 · Cited by 33
Méndez, G. G., Galárraga, L. A., & Chiluiza, K. (2021) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445718 · Cited by 31
AI-Moderated Decision-Making: Capturing and Balancing Anchoring Bias in Sequential Decision Tasks
Echterhoff, J. M., Yarmand, M., & McAuley, J. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3517443 · Cited by 30 · cited 2×
“Such factors can be broadly classified into three primary categories: human-related factors [35, 95, 96], attributes of the AI systems [94, 98], and characteristics of the decision-making tasks [16, 56, 126].”
BackgroundThe effect of individual and task characteristics on decision aid reliance
Parkes, A. (2017) · Behaviour & Information Technology · doi:10.1080/0144929x.2016.1209242 · Cited by 26 · cited 3×
“This is further backed by [100] indicating that the complexity of a task can elevate its perceived difculty, potentially resulting in greater reliance on AI systems.”
BackgroundResultZehrung, R., Singhal, A., Correll, M., & Battle, L. (2021) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445195 · Cited by 26 · cited 2×
“Prior work has also been dedicated to developing and evaluating interfaces [15, 30, 87, 89] and visualizations [43, 49, 134, 137, 140] aimed at improving human-AI collaboration.”
BackgroundMethodThe challenges of providing explanations of AI systems when they do not behave like users expect
Riveiro, M., & Thill, S. (2022) · ACM Conference on User Modeling, Adaptation and Personalization (UMAP) · doi:10.1145/3503252.3531306 · Cited by 26 · cited 1×
“…wide range of studies, researchers have consistently found that reliance on AI systems is influenced by various factors including human-related aspects [37, 51, 81, 101, 120], attributes of the AI systems [43, 79, 106, 107], and characteristics of the decision-making tasks [9, 12, 16, 46, 126].”
BackgroundDo I Look Like a Criminal? Examining how Race Presentation Impacts Human Judgement of Recidivism
Mallari, K., Inkpen, K., Johns, P., Tan, S., Ramesh, D., & Kamar, E. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376257 · Cited by 24 · cited 3×
“Tasks that involve inherent uncertainty are often those where humans tend to rely on AI systems for advice, such as loan approval [27, 34, 124], recidivism prediction [31, 47, 86], house price estimation [2, 13, 25], and student admission [13, 24].”
Not Just a Preference: Reducing Biased Decision-making on Dating Websites
Ma, Z., & Gajos, K. Z. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3517587 · Cited by 19 · cited 2×
“Human factors such as prior experience [110, 119], cognitive biases [85, 102], and AI literacy [25], which can shape individuals’ perceptions and interactions with AI systems.”
BackgroundQ-Chef: The impact of surprise-eliciting systems on food-related decision-making
Grace, K. S., Finch, E., Gulbransen-Diaz, N., & Henderson, H. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3501862 · Cited by 19
Can Computers Outperform Humans in Detecting User Zone-Outs? Implications for Intelligent Interfaces
Bosch, N., & D’Mello, S. K. (2022) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3481889 · Cited by 18 · cited 1×
“Prior work has also been dedicated to developing and evaluating interfaces [15, 30, 87, 89] and visualizations [43, 49, 134, 137, 140] aimed at improving human-AI collaboration.”
MethodTrust and Reliance in XAI -- Distinguishing Between Attitudinal and Behavioral Measures
Scharowski, N., Perrig, S. A. C., von Felten, N., & Brühlmann, F. (2022) · arXiv · doi:10.48550/arxiv.2203.12318 · Cited by 18
Using Explanations as Energy-Saving Frames: A User-Centric Recommender Study
Starke, A. D., Willemsen, M. C., & Snijders, C. C. P. (2021) · ACM Conference on User Modeling, Adaptation and Personalization (UMAP) · doi:10.1145/3450614.3464477 · Cited by 16 · cited 1×
“In addition, the attributes of AI systems can enhance decision-making outcomes [68], which include aspects such as predictions generated by AI [66, 76, 99], information about AI predictions or AI systems themselves [13, 70, 118, 136], and interventions that impact cognitive processes [65, 99, 105].”
BackgroundProceedings of the 28th ACM Conference on User Modeling, Adaptation and Personalization
Tsvi Kuflik, I. T., & Tsvi Kuflik, I. T. (2020) · doi:10.1145/3340631 · Cited by 16
Understanding the Effects of Explanation Types and User Motivations on Recommender System Use
Li, Q., Chu, S. L., Rao, N., & Nourani, M. (2020) · Proceedings of the AAAI Conference on Human Computation and Crowdsourcing · doi:10.1609/hcomp.v8i1.7466 · Cited by 14 · cited 1×
“…wide range of studies, researchers have consistently found that reliance on AI systems is influenced by various factors including human-related aspects [37, 51, 81, 101, 120], attributes of the AI systems [43, 79, 106, 107], and characteristics of the decision-making tasks [9, 12, 16, 46, 126].”
BackgroundIs Overreliance on AI Provoked by Study Design?
Zhang, Z. T., Tong, S., Liu, Y., & Butz, A. M. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-42286-7_3 · Cited by 11
27th International Conference on Intelligent User Interfaces
(2022) · doi:10.1145/3490099 · Cited by 10
Relationship between Device Performance, Trust and User Behaviour in a Care-taking Scenario
Partovi, A., Zukerman, I., Zhan, K., Hamacher, N., & Hohwy, J. (2019) · ACM Conference on User Modeling, Adaptation and Personalization (UMAP) · doi:10.1145/3320435.3320440 · Cited by 6 · cited 1×
“…wide range of studies, researchers have consistently found that reliance on AI systems is influenced by various factors including human-related aspects [37, 51, 81, 101, 120], attributes of the AI systems [43, 79, 106, 107], and characteristics of the decision-making tasks [9, 12, 16, 46, 126].”
Why is plausibility surprisingly problematic as an XAI criterion?
Jin, W., Li, X., & Hamarneh, G. (2023) · arXiv · doi:10.48550/arxiv.2303.17707 · Cited by 4
AI Reliance and Decision Quality: Fundamentals, Interdependence, and the Effects of Interventions
Schoeffer, J., Jakubik, J., Voessing, M., et al. (2023) · arXiv · doi:10.48550/arxiv.2304.08804
Research works printed but not linked: 5
- [18] Jason Burton, Mari-Klara Stein, and Tina Blegind Jensen. 2019. A systematic review of algorithm aversion in augmented decision making. Journal of Behavioral Decision Making (2019). https://api.semanticscholar.org/CorpusID:210439660 -
- [50] Gaole He and Ujwal Gadiraju. 2022. Walking on Eggshells: Using Analogies to Promote Appropriate Reliance in Human-AI Decision Making. In Proceedings of the Workshop on Trust and Reliance on AI-Human Teams at the ACM Conference on Human Factors in Computing Systems (CHI'22) . -
- 10.18653/v1 · DOI
- 10.18653/v1 · DOI
- [107] Vincent Robbemond, Oana Inel, and Ujwal Gadiraju. 2022. Understanding the Role of Explanation Modality in AI-Assisted Decision-Making. In Proceedings of the 30th ACM Conference on User Modeling, Adaptation and Personalization (Barcelona, Spain) (UMAP '22) . Association for Computing Machinery, New York, NY, USA, 223-233. https://doi.org/10.1145/3503252.3531311 Analysis & Machine Intelligence 01 (nov 5555), 1-20. https://doi.org/10. 1109/TPAMI.2023.3331846 - · DOI · Paper page
Cited by
Kim, S. S. Y., Vaughan, J. W., Liao, Q. V., Lombrozo, T., & Russakovsky, O. (2025) · Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3714020 · Cited by 58
“…128, 129] and (un)certainty [6, 14, 17, 41, 132], explanations of outputs [6, 14, 17, 40, 41, 69, 132], and onboarding materials [18, 68] impact user reliance, as well as the roles played by human intuition [20], task complexity [101, 102], and other human, AI, and context-related factors [63].”
Is Conversational XAI All You Need? Human-AI Decision Making With a Conversational XAI Assistant
He, G., Aishwarya, N., & Gadiraju, U. (2025) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3708359.3712133 · Cited by 115
“Others have explored the role of task factors such as task complexity and uncertainty in shaping trust and reliance in human-AI decision-making [98, 100].”
Self-citationEnhancing AI-Human Collaborative Decision-Making in Industry 4.0 Management Practices
Alam, S., & Khan, M. F. (2024) · IEEE Access · doi:10.1109/access.2024.3449415 · Cited by 49
“One of the key challenges lies in the development of an approach that, while deploying the computational power of AI, still respects and captures human judgment [21], especially in management [22].”
BackgroundUnderstanding Choice Independence and Error Types in Human-AI Collaboration
Erlei, A., Sharma, A., & Gadiraju, U. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3641946 · Cited by 38
“People fail to adequately judge their own performance level in relation to the task’s difculty, complexity [92], or uncertainty [93], and therefore do not implement efective delegation rules.”
BackgroundSelf-citationHe, G., Demartini, G., & Gadiraju, U. (2025) · Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713218 · Cited by 23
“In our study, all tasks are executed in a simulation setup, which has been a popular method for orchestrating meaningful human-centered AI studies [16, 86].”
Self-citation
Metadata
- Authors
- Salimzadeh, S., He, G., & Gadiraju, U.
- Affiliations
- Delft University of Technology (NL)
- Venue
- Proceedings of the CHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2024-05-11
- Pages
- 1-17
- OpenAlex
- W4396832356
- Semantic Scholar
- 360a8fa00bad3d0c054d7c38ccfa1ff910e5059c
- Cited by
- 41
- References
- 147
- Citations by year
- 2026: 12 · 2025: 26 · 2024: 3
- FWCI
- 27.54
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- CHI Conference on Human Factors in Computing Systems (publishedVersion, cc-by)
- Research Repository (Delft University of Technology) (submittedVersion, cc-by)
- Topics
- Social Sciences › Human Factors and Ergonomics › Human-Automation Interaction and Safety
- Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
- Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
- Keywords
- human-AI decision-making, task complexity, task uncertainty, trust in AI, AI reliance, diagnostic tasks, trip planning, AI system design
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.