The DOI matches its Crossref record; 68 of the 68 references it cites were found in a registry or an index.
Are Explanations Helpful? A Comparative Study of the Effects of Explanations in AI-Assisted Decision-Making
Open accessAbstract
This paper contributes to the growing literature in empirical evaluation of explainable AI (XAI) methods by presenting a comparison on the effects of a set of established XAI methods in AI-assisted decision making. Specifically, based on our review of previous literature, we highlight three desirable properties that ideal AI explanations should satisfy—improve people’s understanding of the AI model, help people recognize the model uncertainty, and support people’s calibrated trust in the model. Through randomized controlled experiments, we evaluate whether four types of common model-agnostic explainable AI methods satisfy these properties on two types of decision making tasks where people perceive themselves as having different levels of domain expertise in (i.e., recidivism prediction and forest cover prediction). Our results show that the effects of AI explanations are largely different on decision making tasks where people have varying levels of domain expertise in, and many AI explanations do not satisfy any of the desirable properties for tasks that people have little domain expertise in. Further, for decision making tasks that people are more knowledgeable, feature contribution explanation is shown to satisfy more desiderata of AI explanations, while the explanation that is considered to resemble how human explain decisions (i.e., counterfactual explanation) does not seem to improve calibrated trust. We conclude by discussing the implications of our study for improving the design of XAI methods to better support human decision making.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“However, the previous research discusses the issues of these feature-based explanations on overtrust in AI [29, 37, 64].”
From Understanding the Effect of Counterfactual Explanations on Trust and Reliance on AI for Human-AI Collaborative Clinical Decision Making (2023) · cites this paper as [64]
In the citing paper
“Overall, our findings indicate user's overreliance on 'wrong' AI outputs, which follows the previous studies that describe salient feature explanations increases user's overreliance on the AI model [6, 64].”
From Understanding the Effect of Counterfactual Explanations on Trust and Reliance on AI for Human-AI Collaborative Clinical Decision Making (2023) · cites this paper as [64]
In the citing paper
“Other works that utilize AI/ML models focused on tasks that do not require domain experts, such as judges or clinicians [5, 38, 64].”
From Understanding the Effect of Counterfactual Explanations on Trust and Reliance on AI for Human-AI Collaborative Clinical Decision Making (2023) · cites this paper as [64]
In the citing paper
“Wang and Yin [64] conducted the randomized experiment using four types of common model-agnostic explainable AI methods and discussed the effect of AI explanations could be largely different where people have varying levels of domain expertise.”
From Understanding the Effect of Counterfactual Explanations on Trust and Reliance on AI for Human-AI Collaborative Clinical Decision Making (2023) · cites this paper as [64]
In the citing paper
“However, across many domains, empirical studies of explanations have produced mixed results [4,11,49,53,58,68,82,87], with some suggesting that explanations increase decisionmakers' tendency to rely on AI predictions even when the AI system is wrong [4,68,82,87]-a phenomenon often referred to as overreliance [10,78].”
From Understanding the Role of Human Intuition on Reliance in Human-AI Decision-Making with Explanations (2023) · cites this paper as [82]
16 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
UCI Machine Learning Repository
Asuncion, A. (2007) · Medical Entomology and Zoology · Cited by 25,411
A Unified Approach to Interpreting Model Predictions
Lundberg, S., & Lee, S.-I. (2017) · arXiv · doi:10.48550/arxiv.1705.07874 · Cited by 23,707 · cited 4×
“For example, sophisticated techniques such as LIME [60] and SHAP [48] have been used to illustrate how much each feature contributes to a model’s final prediction.”
MethodInfluential"Why Should I Trust You?": Explaining the Predictions of Any Classifier
Ribeiro, M. T., Singh, S., & Guestrin, C. (2016) · Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2939672.2939778 · Cited by 17,555 · cited 5×
“For example, sophisticated techniques such as LIME [60] and SHAP [48] have been used to illustrate how much each feature contributes to a model’s nal prediction.”
MethodInfluential(2011) · Cited by 14,317
Distilling the Knowledge in a Neural Network
Hinton, G., Vinyals, O., & Dean, J. (2015) · arXiv · doi:10.48550/arxiv.1503.02531 · Cited by 14,204
Gauriat, C.-M., Pencolé, Y., Ribot, P., & Brouillet, G. (2024) · HAL (Le Centre pour la Communication Scientifique Directe) · doi:10.4230/oasics.dx.2024.27 · Cited by 12,586
Show, Attend and Tell: Neural Image Caption Generation with Visual Attention
Xu, K., Ba, J., Kiros, R., Cho, K., Courville, A., Salakhutdinov, R., Zemel, R., & Bengio, Y. (2015) · arXiv · doi:10.48550/arxiv.1502.03044 · Cited by 8,248 · cited 1×
“…interpretable models such as generalized additive models and decision sets [15, 34, 43, 66], as well as visualizing what deep neural network has learned in its intermediate layers and how its predictions are affected by different part of the inputs (e.g., through saliency map) [37, 61, 68].”
BackgroundPeeking Inside the Black-Box: A Survey on Explainable Artificial Intelligence (XAI)
Adadi, A., & Berrada, M. (2018) · IEEE Access · doi:10.1109/access.2018.2870052 · Cited by 6,294 · cited 1×
“havior of the entire AI model is categorized as global explanations, while methods that provide reasons for specic model predictions are categorized as local explanations [2, 24, 26].”
MethodLipton, Z. C. (2018) · Queue · doi:10.1145/3236386.3241340 · Cited by 5,427 · cited 1×
“Typical methods include ask people to rank the input data features based on their inuence to overall predictions [18, 33], to indicate the direction of change in the model’s prediction when a feature’s value is altered [16, 18, 29], to simulate the model’s predictions [16, 24, 40, 47, 59], to answer “what-if” question…”
MethodDeep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Maps
Simonyan, K., Vedaldi, A., & Zisserman, A. (2013) · arXiv · doi:10.48550/arxiv.1312.6034 · Cited by 5,370 · cited 1×
“…interpretable models such as generalized additive models and decision sets [15, 34, 43, 66], as well as visualizing what deep neural network has learned in its intermediate layers and how its predictions are affected by different part of the inputs (e.g., through saliency map) [37, 61, 68].”
Background
Research works printed but not linked: 7
- Dennis Collaris Leo M Vink and Jarke J van Wijk. 2018. Instance-level explanations for fraud detection: A case study. arXiv preprint arXiv:1806.07129(2018). Dennis Collaris Leo M Vink and Jarke J van Wijk. 2018. Instance-level explanations for fraud detection: A case study. arXiv preprint arXiv:1806.07129(2018). · arXiv
- 10.2139/ssrn.3465622 · DOI · Paper page
- Isaac Lage Emily Chen Jeffrey He Menaka Narayanan Been Kim Sam Gershman and Finale Doshi-Velez. 2019. An evaluation of the human-interpretability of explanation. arXiv preprint arXiv:1902.00006(2019). Isaac Lage Emily Chen Jeffrey He Menaka Narayanan Been Kim Sam Gershman and Finale Doshi-Velez. 2019. An evaluation of the human-interpretability of explanation. arXiv preprint arXiv:1902.00006(2019). · arXiv
- Jeff Larson , Surya Mattu , Lauren Kirchner , and Julia Angwin . 2016. How we analyzed the COMPAS recidivism algorithm. ProPublica (5 2016) 9, 1 ( 2016 ). Jeff Larson, Surya Mattu, Lauren Kirchner, and Julia Angwin. 2016. How we analyzed the COMPAS recidivism algorithm. ProPublica (5 2016) 9, 1 (2016).
- Maranda McBride and Shona Morgan . 2010. Trust calibration for automated decision aids . Institute for Homeland Security Solutions.[Online] . Available: https://www. ihssnc. org/portals/0/Documents/VIMSDocuments/McBride_Research_Brief. pdf(2010). Maranda McBride and Shona Morgan. 2010. Trust calibration for automated decision aids. Institute for Homeland Security Solutions.[Online]. Available: https://www. ihssnc. org/portals/0/Documents/VIMSDocuments/McBride_Research_Brief. pdf(2010).
- Forough Poursabzi-Sangdeh Daniel G Goldstein Jake M Hofman Jennifer Wortman Vaughan and Hanna Wallach. 2018. Manipulating and measuring model interpretability. arXiv preprint arXiv:1802.07810(2018). Forough Poursabzi-Sangdeh Daniel G Goldstein Jake M Hofman Jennifer Wortman Vaughan and Hanna Wallach. 2018. Manipulating and measuring model interpretability. arXiv preprint arXiv:1802.07810(2018). · arXiv
- Jennifer Wortman Vaughan and Hanna Wallach . 2020. A Human-Centered Agenda for Intelligible Machine Learning. Machines We Trust: Getting Along with Artificial Intelligence ( 2020 ). Jennifer Wortman Vaughan and Hanna Wallach. 2020. A Human-Centered Agenda for Intelligible Machine Learning. Machines We Trust: Getting Along with Artificial Intelligence (2020).
Cited by
Items 201–300 of 331
Towards Uncertainty Aware Task Delegation and Human-AI Collaborative Decision-Making
Lee, M. H., & Tok, M. Z. Y. (2025) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3715275.3732155 · Cited by 8
Szymczyk, N., Szczuka, J. M., Krämer, N. C., & Wischnewski, M. (2025) · Mensch und Computer (MuC) · doi:10.1145/3743049.3743072 · Cited by 6
Understanding User Needs and Attitudes for Privacy Protection Tools in Online Visual Content Sharing
Chiang, C.-W., Tian, H. Y., & Yin, M. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3757695 · Cited by 5
Self-citationAccountability and managerial advice-taking: comparing human and algorithmic advisers
Kotzian, P., Bauch, K. A., & Weißenberger, B. E. (2025) · Management Decision · doi:10.1108/md-07-2024-1618 · Cited by 10
A Phenotypic Learning Classifier System for Problems with Continuous Features
Liu, Y., Cui, Y. J., Cheng, W., Browne, W. N., Xue, B., Zhu, C., Zhang, Y., Sheng, M., & Zeng, L. (2024) · Genetic and Evolutionary Computation Conference (GECCO) · doi:10.1145/3638529.3654007 · Cited by 4
“Furthermore, adjusting an LCS model through human intervention for performance control is more intuitive, aligning well with human cognitive processes [28].”
Yokota, T., & Nakao, Y. (2022) · ACM Conference on User Modeling, Adaptation and Personalization (UMAP) · doi:10.1145/3511047.3538033 · Cited by 8
“[27] further investigated the effect of explanation styles through combinations of texts and images on perceived fairness.”
BackgroundSeamful AI for Creative Software Engineering: Use in Software Development Workflows
Inman, S., Murillo, A., D’Angelo, S., Brown, A., & Green, C. (2025) · IEEE Software · doi:10.1109/ms.2025.3534085 · Cited by 7
“Prior research 15 found that domain expertise moderated the effectiveness of an AI seam (AI explanations).”
Rethinking the judicial duty to state reasons in the age of automation?
Hendrickx, V. (2025) · Cambridge Forum on AI Law and Governance · doi:10.1017/cfl.2025.11 · Cited by 8
Ensemble machine learning for predicting the urban expansion in Lucknow, India
Khan, D., Khan, N., Abouleish, M. Y., Kanga, S., Singh, S. K., & Meraj, G. (2025) · Environmental Earth Sciences · doi:10.1007/s12665-025-12559-9 · Cited by 4
“Explainable Artificial Intelligence (XAI) addresses this gap by exposing the causal leverage of predictor variables (Wang and Yin 2021; Asghari et al. 2021; Lundberg 2017).”
Faas, C., Kerstan, S., Uth, R., Langer, M., & Feit, A. M. (2026) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3742413.3789100 · Cited by 14
“AI systems are increasingly used to automate or support decision-making in a variety of domains, such as education [71], fnance [e.g., 3, 5, 19, 90], healthcare [e.g., 5, 16, 17, 41], or law [e.g., 38, 43, 55, 56, 85] (see Lai et al. [46] for an overview).”
In Defense of Post Hoc Explanations in Medical AI
Hatherley, J. J., Munch, L. A., & Bjerring, J. C. (2026) · The Hastings Center Report · doi:10.1002/hast.4971 · Cited by 14
“In one influential study, for example, Wang and Yin (2021) found that post-hoc explanations improved users’ ability to predict how the outputs of a model may change in response to changes in input data).”
Explainable AI: Bridging Transparency and Trust in AI
Oyenuga, M. O., & OLADELE, T. O. (2026) · Advances in computational intelligence and robotics book series · doi:10.4018/406019 · Cited by 3
Understanding the Effects of AI-Assisted Critical Thinking on Human-AI Decision Making
Tian, H. Y., Amin, H., & Yin, M. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3790785 · Cited by 14
Self-citationHuman-AI Teaming: Following the IMOI Framework
Kleanthous, S. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-60611-3_27 · Cited by 6
Antar, A. D., Molaei, S., Chen, Y.-Y., Lee, M. L., & Banović, N. (2024) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/3654777.3676323 · Cited by 11
Hinrichs, M., Bui, T. B. D., & Schneegaß, S. (2024) · International Conference on Mobile and Ubiquitous Multimedia (MUM) · doi:10.1145/3701571.3701585 · Cited by 5
How informative is your XAI? Assessing the quality of explanations through information power
Matarese, M., Rea, F., Rohlfing, K. J., & Sciutti, A. (2025) · Frontiers in Computer Science · doi:10.3389/fcomp.2024.1412341 · Cited by 5
Adjust for Trust: Mitigating Trust-Induced Inappropriate Reliance on AI Assistance
Srinivasan, T., & Thomason, J. (2026) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3742413.3789136 · Cited by 18
Hu, Z. F., Mauro, N., Petrone, G., & Ardissono, L. (2023) · ACM Conference on User Modeling, Adaptation and Personalization (UMAP) · doi:10.1145/3565472.3592962 · Cited by 4
Human-Centered Evaluation of Explanations in AI-Assisted Decision-Making
Wang, X. (2024) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3640544.3645239 · Cited by 4
“In my thesis, I start with an empirical exploration of the effects of AI explanations on human DMs’ understanding and appropriate usage of AI assistance [15, 16], as well as on the fairness level of human decisions [13].”
BackgroundSelf-citationAnik, A. I., & Bunt, A. (2024) · IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC) · doi:10.1109/vl/hcc60511.2024.00024 · Cited by 5
“Others are global explanations that focus on the overall system [28], by describing how the model works (e.g., feature importance [33], [34], feature contribution [35], [36], [37], [38], and demographic-based [39], [40] explanations).”
BackgroundBarile, F., Najafian, S., Draws, T., Inel, O., Rieger, A., Hada, R., & Tintarev, N. (2021) · Zurich Open Repository and Archive (University of Zurich) · doi:10.5167/uzh-264732 · Cited by 3
Schmude, T., Koesten, L. M., Möller, T. B., & Tschiatschek, S. (2026) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2026.2650562 · Cited by 4
Validation of an acute kidney injury prediction model as a clinical decision support system
Yun, G., Yi, J., Han, S., Seong, J., Menadjiev, E., Han, H., Choi, J., Kim, J. H., & Kim, S. (2025) · Kidney Research and Clinical Practice · doi:10.23876/j.krcp.24.163 · Cited by 5
“Conversely, those with less expertise might struggle to extract meaningful insights from AI explanations [21].”
Evaluating the Impact of AI-Generated Visual Explanations on Decision-Making for Image Matching
Wazzan, A., Wright, M., MacNeil, S., & Souvenir, R. (2025) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3708359.3712121 · Cited by 4
Judging Phishing Under Uncertainty: How Do Users Handle Inaccurate Automated Advice?
Saka, T., Vakali, K., Jenkins, A. D. G., Kökciyan, N., & Vaniea, K. E. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3714267 · Cited by 3
“Wang et al. [90] examined AI-assisted decision-making systems and identified three key properties that effective explanations should satisfy: improving understanding of the AI model, recognizing model uncertainty, and fostering calibrated trust.”
What Lies Beneath? Exploring the Impact of Underlying AI Model Updates in AI-Infused Systems
Mohanty, V., Lim, J., & Luther, K. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713751 · Cited by 9
“This makes comprehensive testing both impractical and costly, leading to silent updates or minimal communication or approximation about changes and capabilities, which leaves users unaware of significant model modifications.”
Molaei, S., Robert, L., & Banović, N. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3757437 · Cited by 2
“The quiz first required them to specify whether the event was categorized as a “crash”, “near-crash”, or neither (i.e., a baseline event).”
Gong, Y., Liu, Y., Shang, L., Wei, N., & Wang, D. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3757577 · Cited by 6
An Empirical Examination of the Evaluative AI Framework
Kornowicz, J. (2025) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2025.2581260 · Cited by 3
“%) with models used in similar studies: Bu¸cinca et al. (2021) and Zhang et al. (2020) also report 75% accuracy, Wang and Yin (2021) 69%, Bansal et al. (2021) 75–87%, Liu et al. (2021) 56–84%, and Lai and Tan (2019) 87%.”
Rahman, J. S., Delaforce, A., Bradford, D., Li, J., Magrabi, F., Cook, D., & Brankovic, A. (2026) · JMIR Human Factors · doi:10.2196/81460 · Cited by 3
“To support trust calibration of AI-driven CDS tools, explainable AI (XAI) methods have been designed to provide transparency by not only presenting the predictions but also revealing the underlying rationales that drive those predictions [27,30-33].”
How explanations from XAI-based decision support affect human task performance: a meta-analysis
Haag, F. (2026) · Journal of Decision System · doi:10.1080/12460125.2026.2616693 · Cited by 8
Korosec-Serfaty, M., Léger, P., Parent‐Rocheleau, X., & Sénécal, S. (2026) · Information Systems Frontiers · doi:10.1007/s10796-025-10691-2 · Cited by 4
Pang, R. Y., Feng, K. J. K., Feng, S., Li, C., Shi, W., Tsvetkov, Y., Heer, J., & Reinecke, K. (2026) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3742413.3789091 · Cited by 40
Hein, I., Ullrich, D., & Diefenbach, S. (2026) · Computers in Human Behavior Reports · doi:10.1016/j.chbr.2026.101025 · Cited by 2
Reinhard, P., Li, M. M., Peters, C., & Leimeister, J. M. (2026) · Information Systems Frontiers · doi:10.1007/s10796-026-10716-4 · Cited by 11
“Error Detection A few researchers studied the effectiveness of XAI in terms of recognizing incorrect AI advice (e.g., Wang & Yin, 2021; Naiseh et al., 2023).”
InfluentialVisual Explanation for Advertising Creative Workflow
Sawada, S., Suzuki, T., Yamaguchi, K., & Toyoda, M. (2024) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3613905.3651123 · Cited by 5
Task Delegation from AI to Humans: The Impact of AI Transparency on Human Performance
Wang, Y., Jiang, Y., Tang, J., & Zhou, X. (2024) · Lecture notes in business information processing · doi:10.1007/978-3-031-60324-2_24 · Cited by 5
Hoang, M.-T. O., van Berkel, N., Skov, M. B., & Merritt, T. R. (2024) · International Symposium on Trustworthy Autonomous Systems (TAS) · doi:10.1145/3686038.3686069 · Cited by 4
(De)Noise: Moderating the Inconsistency Between Human Decision-Makers
Grgić-Hlača, N., Ali, J., Gummadi, K. P., & Vaughan, J. W. (2024) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3686987 · Cited by 4
Human-Centered Explainable AI (XAI): From Algorithms to User Experiences
Liao, Q. V., & Varshney, K. R. (2026) · Cambridge University Press eBooks · doi:10.1017/9781108872225.011 · Cited by 472
Sovrano, F., & Vitali, F. (2023) · Communications in computer and information science · doi:10.1007/978-3-031-44064-9_2 · Cited by 6
Qu, J., Arguello, J., & Wang, Y. (2023) · Conference on Human Information Interaction and Retrieval · doi:10.1145/3576840.3578315 · Cited by 3
“, the distinction between tree species in predicting forest coverage [31]).”
BackgroundResultTowards Understanding Human-AI Reliance Patterns Through Explanation Styles
Casolin, E. R., & Salim, F. D. (2024) · ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp) · doi:10.1145/3675094.3678996 · Cited by 2
Marwala, T. (2024) · Springer eBooks · doi:10.1007/978-981-97-9251-1_5 · Cited by 4
Enhancing Explainability in Medical AI: Developing Human-Centered Participatory Design Cards
Zhang, T., & He, X. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-76827-9_10 · Cited by 4
Discrimination Exposed? On the Reliability of Explanations for Discrimination Detection
Skirzyński, J., Danks, D. J., & Ustun, B. (2025) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3715275.3732167 · Cited by 7
Biasing Rule-Based Explanations Towards User Preferences
Mahya, P., & Fürnkranz, J. (2025) · Information · doi:10.3390/info16070535 · Cited by 2
Predicting Satisfaction of Counterfactual Explanations from Human Ratings of Explanatory Qualities
Domnich, M., Veski, R. M., Välja, J., Tulver, K., & Vicente, R. (2025) · Communications in computer and information science · doi:10.1007/978-3-032-08317-3_10 · Cited by 3
Domain Experience and Expertise in Explainable AI Applications: A Bearing Fault Diagnosis Case Study
Zhao, Z., Castelle, M., & Turkay, Ç. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3757583 · Cited by 3
Augmenting Human Cognition Through Generative AI
Rogers, Y., Reicherts, L., Zhang, Z. T., & Hassib, M. (2026) · Springer eBooks · doi:10.1007/978-3-031-61050-9_10-1 · Cited by 1
ChatGPT as a Catalyst for AI Literacy and Attitude Shifts in Diverse Educational Contexts
Grassini, S., Dietrich, L. K., & Cipriani, E. (2026) · Springer eBooks · doi:10.1007/978-981-95-4871-2_11 · Cited by 1
Anik, A. I., & Bunt, A. (2026) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3742413.3789087 · Cited by 2
“The increased trust and judgment of system fairness for detailed explanations over summary versions raises important considerations regarding the potential for overreliance [9, 99, 101, 128, 133].”
Chang, M., Srinivasan, A., & Palani, S. (2026) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3742413.3789077 · Cited by 5
Yoon, H., Jeon, G., Nam, C. S., & Lee, S. (2026) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2026.2630099 · Cited by 1
“The effectiveness of such explanations in improving understanding varies depending on the user’s domain knowledge (X. Wang & Yin, 2021).”
Human–AI collaboration: the dual role of explanation on human closeness and threat
Wang, J., Zhuang, X., & Santoso, H. B. (2026) · Behaviour and Information Technology · doi:10.1080/0144929x.2026.2633771 · Cited by 2
“Some studies indicate that counterfactual explanations are very similar to human-decision making processes and help to enhance users’ understanding of AI (Wang and Yin 2021).”
Introducing Social Explainable AI
Rohlfing, K. J., & Lim, B. Y. (2026) · Springer eBooks · doi:10.1007/978-981-96-5290-7_1 · Cited by 3
Trust Me on This: A User Study of Trustworthiness for RAG Responses
Łajewska, W., & Balog, K. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-21300-6_44 · Cited by 1
XAgen: An Explainability Tool for Identifying and Correcting Failures in Multi-Agent Workflows
Wang, X., Yin, M., Koh, E., & Dogan, M. D. (2026) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3772363.3798531 · Cited by 4
Self-citationRaees, M., & Papagelis, K. (2026) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3772363.3798834 · Cited by 1
“Uncertainty or confidence of the AI system can influence how users evaluate AI decisions, which can also affect the users’ motivation to engage with it [9, 37].”
A Review of Taxonomies of Explainable AI (XAI) Evaluation
Speith, T. (2026) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3805689.3806537 · Cited by 3
“Evaluator: Human-Based 28 [17, 28, 51, 67, 69, 77–79, 81, 89, 104, 134, 143–145, 148, 156, 157, 159, 163, 165, 184, 185, 187, 189, 192, 194, 200] Evaluator: Human-Indep.”
Lindvall, M. (2021) · Linköping studies in science and technology. Dissertations · doi:10.3384/diss.diva-176117 · Cited by 1
Ethical discussion on the identity of digital humans in the metaverse era
Bang, E.-C., & Byun, S.-Y. (2022) · International Conference on Robot Ethics and Standards (ICRES) · doi:10.13180/icres.2022.18-19.07.010 · Cited by 1
de Santana, V. F., Quigley, L. T., Coates, J., & Graves, M. (2024) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3613905.3637130 · Cited by 1
“Human-AI partnership for decision making is being used in multiple contexts such as recidivism [23, 25, 52], finance [24], healthcare [33], education [34], job promotion [2], environment [42], combination of multiple AI outcomes [13], and interactive explanations and visualizations for…”
BackgroundKrämer, N. C., Wischnewski, M., & Müller, E. (2023) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/h32ze · Cited by 4
Laoh, E., & Liu, T. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4950302 · Cited by 1
Ibidunmoye, A. F., Eneano, G. A., Ikeakaonwu, O. M., Kolawole, L. O., Omigbodun, F. T., Olawale, R. A., & Chuwa, C. C. (2026) · Research Square · doi:10.21203/rs.3.rs-8605675/v1 · Cited by 3
The Effect of Explainable AI-based Decision Support on Human Task Performance: A Meta-Analysis
Haag, F. (2025) · arXiv · doi:10.48550/arxiv.2504.13858 · Cited by 1
Mohamed, A. S., Fritz, C., Saber, A. M., Ma, Y., Kaur, R., Al-Darwbi, M., Friedrich, D., & Kundur, D. (2026) · arXiv · doi:10.48550/arxiv.2609.00171
“Experts often rely on tacit knowledge gained through experience, which allows them to process complex information more efficiently [180].”
Moral Dilemmas with an Option to Delegateevidence from an Online Experiment in ChinaPreprint
Gao, Y., Blayac, T., & Willinger, M. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4611281
Optimal Neighborhood Contexts in Explainable AI: An Explanandum-Based Evaluation
Pawar, U., O’Shea, D., O’Reilly, R., Costello, M., & Beder, C. (2024) · IEEE Open Journal of the Computer Society · doi:10.1109/ojcs.2024.3389781 · Cited by 1
Can Interpretability Layouts Influence Human Perception of Offensive Sentences?
dos Santos, T. F., Osman, N., & Schorlemmer, M. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-70074-3_3
“Wang et al. [35] conduct an investigation that compares different XAI meth-ods in AI-assisted decision-making.”
BackgroundKaraoğlu, S., Katoh, M., Majumdar, T., Beaird, E., Hafızoğlu, F. M., & Sen, S. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-70074-3_1
Confides: A Visual Analytics Solution for Automated Speech Recognition Analysis and Exploration
Ha, S., Lim, C., Crouser, R. J., & Ottley, A. (2024) · Visualization · doi:10.1109/vis55277.2024.00062
“Wang et al. [29] explored various explanation methods for recidivism prediction and forest cover prediction tasks.”
Masciotra, V., & Boudrias, J. (2024) · Ad machina l avenir de l humain au travail · doi:10.1522/radm.no8.1840
Enhancing Investment Forecasting through the Second-Level Thinking Concept
Zhao, D., Wang, C., & Shen, Z. (2024) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/smc54092.2024.10831024
How Do ML Students Explain Their Models and What Can We Learn from This?
Franke, U. (2025) · Lecture notes in business information processing · doi:10.1007/978-3-031-85849-9_28
Delegating moral dilemmas in autonomous vehicles evidence from an online experiment in China
Gao, Y., Blayac, T., & Willinger, M. (2025) · Transport Policy · doi:10.1016/j.tranpol.2025.04.017
Adversarial Anomaly Explanation
Angiulli, F., Fassetti, F., Nisticò, S., & Palopoli, L. (2025) · Information Systems Frontiers · doi:10.1007/s10796-025-10605-2
“We notice that this also makes the explanation more easily interpretable by the final user (Wang & Yin, 2021), which is one of the goals that we are pursuing here.”
AI in Financial Decision-Making
Gupta, A., Goswami, M. P., Tak, P., & Tiwari, V. (2025) · Algorithms for intelligent systems · doi:10.1007/978-981-97-8868-2_22
Influence of Language Warmth on User Adoption of Agent Recommendations for Multi-arm Bandits
Karaoğlu, S., Katoh, M., Majumdar, T., Beaird, E., Hafızoğlu, F. M., & Sen, S. (2025) · Lecture notes in computer science · doi:10.1007/978-3-031-93930-3_11
Al-Ansari, N., Al‐Thani, D., & Bahameish, M. (2026) · Computers in Human Behavior Reports · doi:10.1016/j.chbr.2026.101083 · Cited by 2
Rahman, J. S., Delaforce, A., Bradford, D., Li, J., Magrabi, F., Cook, D., & Brankovic, A. (2025) · doi:10.2196/preprints.81460
Toda, K., Nishi, T., & Liu, Z. (2025) · IFIP advances in information and communication technology · doi:10.1007/978-3-032-03534-9_20
The Impact of Concept Explanations and Interventions on Human-Machine Collaboration
Furby, J., Cunnington, D., Braines, D., & Preece, A. D. (2025) · Communications in computer and information science · doi:10.1007/978-3-032-08317-3_12
“If the model and human task labels are the same for a large proportion of samples we can argue the human participants trust the model [29, 16].”
Onari, M. A., Baer, G. T., Zhang, C., Grau, I., Nobile, M. S., & Zhang, Y. (2025) · Communications in computer and information science · doi:10.1007/978-3-032-08317-3_15 · Cited by 2
Assessing and Quantifying Perceived Trust in Interpretable Clinical Decision Support
Onari, M. A., Grau, I., Zhang, C., Nobile, M. S., & Zhang, Y. (2025) · Communications in computer and information science · doi:10.1007/978-3-032-08327-2_10 · Cited by 1
Liebherr, M., Babiker, A., Alshakhsi, S. A. A., Al‐Thani, D., Montag, C., & Ali, R. (2025) · Advances in Human-Computer Interaction · doi:10.1155/ahci/5590506
“Contrary to this, in XAI, numerous AI explanations fail to meet the desired criteria for tasks in which individuals possess limited domain knowledge [39].”
АНАЛИЗ МЕТОДОВ ОЦЕНКИ ВАЖНОСТИ ПРЕДИКТОРОВ НЕБЛАГОПРИЯТНЫХ СОБЫТИЙ В КАРДИОХИРУРГИИ
Potapenko, B., Shakhgeldyan, K. J., & Geltser, B. I. (2025) · Высшая школа: научные исследования · doi:10.15622/rcai.2025.013
Kölmel, L., Becker, M., Schwall, F., Hild, J., Birnstill, P., Deml, B., & Beyerer, J. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5893623
Prioritization and Filtering using an Adaptive Model for Early Decision-Making in Workflow Systems
Ahuja, A., Gupta, M., & Gumber, N. (2025) · International Conference on Cyber Resilience (ICCR) · doi:10.1109/iccr67387.2025.11292410
Sawada, S., & Toyoda, M. (2025) · International Symposium on Visual Information Communication and Interaction (VINCI) · doi:10.1145/3769534.3769602
Behzad, T., Gurney, N., Wang, N., & Pynadath, D. V. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-13187-4_8 · Cited by 1
Kahr, P. K., & Bernstein, A. (2026) · doi:10.1145/3780045.3780056 · Cited by 3
Accuracy is not all you need! The Reasons to Require AI Explainability
Buijsman, S. (2026) · Minds and Machines · doi:10.1007/s11023-026-09768-x · Cited by 2
“…AI suggests it doesn’t: when participants are shown feature importance scores along with AI outputs, or counterfactuals, their reliance on the system and overall performance shows little to no improvement (Hase & Bansal, 2020; Nagendran et al., 2023; Van Der Waa et al., 2021; Wang & Yin, 2021).”
Passing the Buck to AI: How Individuals’ Decision-Making Patterns Affect Reliance on AI
Mei, K. X., Pang, R. Y., Lyford, A., Wang, L. L., & Reinecke, K. (2026) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3786326 · Cited by 7
“Despite their extensive capabilities, current conversational AI tools supported by large language models (LLMs) have been found to generate inaccurate and biased information in various domains including politics, law, and medicine [8, 22, 32, 54, 57, 64].”
How vulnerability explanations help software practitioners confirm and fix code vulnerabilities
Debeyan, F. A., Hall, T., Madeyski, L., & Winter, E. (2026) · Information and Software Technology · doi:10.1016/j.infsof.2026.108086
Shank, D. B., Canfield, C., & Subramanian, H. V. (2024) · OSF Preprints (OSF Preprints)
Explaining at the Speed of Sight: Attention-Aware XAI for OODA-Inspired AI Design
Wright, D., & Menon, V. (2025) · IEEE International Conference on Cognitive Machine Intelligence (CogMI) · doi:10.1109/cogmi67134.2025.00032
Degachi, S., Niforatos, E., & Kortuem, G. (2026) · Behaviour and Information Technology · doi:10.1080/0144929x.2026.2638907 · Cited by 1
“Recent work shows that even the mere presence of many explanation types can increase blind, inappropriate, trust in, and overreliance on, AI tools (Bansal et al. 2021; Pafla, Larson, and Hancock 2024; Si et al. 2024; X. Wang and Yin 2021; Zhang, Vera Liao, and Bellamy 2020).”
Metadata
- Authors
- Wang, X., & Yin, M.
- Affiliations
- Purdue University West Lafayette (US)
- ORCID
- Venue
- 26th International Conference on Intelligent User Interfaces
- Publisher
- ACM
- Published
- 2021-04-14
- Pages
- 318-328
- OpenAlex
- W3156106752
- Semantic Scholar
- c79ba865574cb9635dbca135cec99ee56125778c
- Cited by
- 320
- References
- 66
- Citations by year
- 2026: 63 · 2025: 76 · 2024: 82 · 2023: 56 · 2022: 34 · 2021: 9
- FWCI
- 20.90
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- ACM International Conference on Intelligent User Interfaces (IUI) (publishedVersion, cc-by)
- Funders
- National Science Foundation (1850335)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Social Sciences › Human Factors and Ergonomics › Human-Automation Interaction and Safety
- Keywords
- explainable AI, AI-assisted decision-making, model-agnostic explanation, counterfactual explanations, model uncertainty, domain knowledge, recidivism prediction, human-AI interaction
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.