Visual, textual or hybrid: the effect of user expertise on different explanations
Open accessThe DOI matches its Crossref record; 36 of the 36 references it cites were found in a registry or an index.
Abstract
As the use of AI algorithms keeps rising continuously, so does the need for their transparency and accountability. However, literature often adopts a one-size-fits-all approach for developing explanations when in practice, the type of explanations needed depends on the type of end-user. This research will look at user expertise as a variable to see how different levels of expertise influence the understanding of explanations. The first iteration consists of developing two common types of explanations (visual and textual explanations) that explain predictions made by a general class of predictive model learners. These explanations are then evaluated by users of different expertise backgrounds to compare the understanding and ease-of-use of each type of explanation with respect to the different expertise groups. Results show strong differences between experts and lay users when using visual and textual explanations, as well as lay users having a preference for visual explanations which they perform significantly worse with. To solve this problem, the second iteration of this research focuses on the shortcomings of the first two explanations and tries to minimize the difference in understanding between both expertise groups. This is done through the means of developing and testing a candidate solution in the form of hybrid explanations, which essentially combine both visual and textual explanations. This hybrid form of explanations shows a significant improvement in terms of correct understanding (for lay users in particular) when compared to visual explanations, whilst not compromising on ease-of-use at the same time.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Szymanski et al. (2021) showed that while end-users prefer visual over textual explanations, they performed significantly worse with the former”
From Exploring the effects of human-centered AI explanations on trust and reliance (2023) · cites this paper as Szymanski et al., 2021
In the citing paper
“Some user groups are more vulnerable to these harms than others, such as AI novices [60], people working in cognitively constrained settings [52], and even those with certain personality traits [17].”
From Designing for Responsible Trust in AI Systems: A Communication Perspective (2022) · cites this paper as [60]
In the citing paper
“For example, abundant empirical evidence suggests that even technically sound AI explanations can result in harmful over-trust and over-reliance [3, 11, 28, 60, 70].”
From Designing for Responsible Trust in AI Systems: A Communication Perspective (2022) · cites this paper as [60]
In the citing paper
“The phenomenon of XAI features leading to over-trust [3, 11, 28, 60, 70] can be attributed to an ' explainability heuristic ' [10, 36] that superficially associates being explainable with being capable, without deliberating on the actual content of the explanation.”
From Designing for Responsible Trust in AI Systems: A Communication Perspective (2022) · cites this paper as [60]
In the citing paper
“For example, recent studies have repeatedly found that XAI features bring less benefit, or even harms (leading to over-trust), to certain user groups such as AI novices or users working in cognitively constrained settings [17, 52, 60].”
From Designing for Responsible Trust in AI Systems: A Communication Perspective (2022) · cites this paper as [60]
Citations
Cites
Arrieta, A. B., Díaz-Rodríguez, N., Del Ser, J., Bennetot, A., Tabik, S., Barbado, A., García, S., Gil-López, S., Molina, D., Benjamins, R., et al. (2019) · arXiv · doi:10.48550/arxiv.1910.10045 · Cited by 11,321
Barredo Arrieta, A., Díaz-Rodríguez, N., Del Ser, J., Bennetot, A., Tabik, S., Barbado, A., Garcia, S., Gil-Lopez, S., Molina, D., Benjamins, R., et al. (2020) · Information Fusion · doi:10.1016/j.inffus.2019.12.012 · Cited by 10,423
Peeking Inside the Black-Box: A Survey on Explainable Artificial Intelligence (XAI)
Adadi, A., & Berrada, M. (2018) · IEEE Access · doi:10.1109/access.2018.2870052 · Cited by 6,294
Explanation in Artificial Intelligence: Insights from the Social Sciences
Miller, T. (2017) · arXiv · doi:10.48550/arxiv.1706.07269 · Cited by 5,338
Explanation in artificial intelligence: Insights from the social sciences
Miller, T. (2019) · Artificial Intelligence · doi:10.1016/j.artint.2018.07.007 · Cited by 5,302
An Empirical Evaluation of the System Usability Scale
Bangor, A., Kortum, P. T., & Miller, J. T. (2008) · International Journal of Human–Computer Interaction · doi:10.1080/10447310802205776 · Cited by 5,181 · cited 1×
“23, by which we can conclude that the system has no major usability flaws [5].”
BackgroundA Survey on Explainable Artificial Intelligence (XAI): Toward Medical XAI
Tjoa, E., & Guan, C. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.3027314 · Cited by 2,524
Explaining collaborative filtering recommendations
Herlocker, J. L., Konstan, J. A., & Riedl, J. (2000) · Proceedings of the 2000 ACM conference on Computer supported cooperative work · doi:10.1145/358916.358995 · Cited by 1,731 · cited 1×
“more complex explanations [16], but in the more general XAI field little work has been done so far to compare the utility of different explanations methods with actual end-users [1, 11].”
BackgroundA Universal Model of Diagnostic Reasoning
Croskerry, P. (2009) · Academic Medicine · doi:10.1097/acm.0b013e3181ace703 · Cited by 1,016 · cited 2×
“” This deductive type of reasoning relates to the slower, analytical and high effort System II thinking [10, 36].”
BackgroundMethodDesigning Theory-Driven User-Centric Explainable AI
Wang, D., Yang, Q., Abdul, A., & Lim, B. Y. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300831 · Cited by 906
Research works printed but not linked: 6
- Leilani H Gilpin , David Bau , Ben Z Yuan , Ayesha Bajwa , Michael Specter , and Lalana Kagal . 2018. Explaining explanations: An overview of interpretability of machine learning. In 2018 IEEE DSAA . IEEE , 80–89. Leilani H Gilpin, David Bau, Ben Z Yuan, Ayesha Bajwa, Michael Specter, and Lalana Kagal. 2018. Explaining explanations: An overview of interpretability of machine learning. In 2018 IEEE DSAA. IEEE, 80–89.
- Peter Goos and Bradley Jones. 2011. Optimal Design of Experiments: A Case-Study Approach. https://doi.org/10.1002/9781119974017 · DOI · Paper page
- David Gunning . 2017. Explainable artificial intelligence (xai) . Defense Advanced Research Projects Agency (DARPA) , nd Web 2 ( 2017 ), 2. David Gunning. 2017. Explainable artificial intelligence (xai). Defense Advanced Research Projects Agency (DARPA), nd Web 2 (2017), 2.
- Josua Krause Adam Perer and Kenney Ng. 2016. Interacting with Predictions: Visual Inspection of Black-box Machine Learning Models. 5686-5697. https://doi.org/10.1145/2858036.2858529 · DOI · Paper page
- Mireia Ribera Turró and Agata Lapedriza . 2019 . Can we do better explanations? A proposal of User-Centered Explainable AI . In IUI Workshops. Mireia Ribera Turró and Agata Lapedriza. 2019. Can we do better explanations? A proposal of User-Centered Explainable AI. In IUI Workshops.
- Aaron Springer and Steve Whittaker . 2019 . Making Transparency Clear. In Algorithmic Transparency for Emerging Technologies Workshop. 5. Aaron Springer and Steve Whittaker. 2019. Making Transparency Clear. In Algorithmic Transparency for Emerging Technologies Workshop. 5.
Cited by
Human-Centered Explainable AI (XAI): From Algorithms to User Experiences
Liao, Q. V., & Varshney, K. R. (2026) · Cambridge University Press eBooks · doi:10.1017/9781108872225.011 · Cited by 483
Towards Human-Centered Explainable AI: A Survey of User Studies for Model Explanations
Rong, Y., Leemann, T., Nguyen, T.-T., Fiedler, L., Qian, P., Unhelkar, V., Seidel, T., Kasneci, G., & Kasneci, E. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3331846 · Cited by 278
Haque, A. B., Islam, A. K. M. N., & Mikalef, P. (2023) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2022.122120 · Cited by 240
“…recommendations, drawing tools, and other different types of sports-related systems need explanations in a hybrid format to increase understandability (Cramer et al., 2008; Ehsan et al., 2019; Kouki et al., 2019; Ngo et al., 2020; Oh et al., 2018; Schmidt et al., 2020; Szymanski et al., 2021).”
BackgroundInfluentialAI Transparency in the Age of LLMs: A Human-Centered Research Roadmap
Liao, Q. V., & Wortman Vaughan, J. (2024) · Harvard Data Science Review · doi:10.1162/99608f92.8036d03b · Cited by 210
Position: Towards Bidirectional Human-AI Alignment
Shen, H., Knearem, T., Ghosh, R., Alkiek, K., Krishna, K., Yachuan, L., Petridis, S., Peng, Y.-H., Qiwei, L., Si, C., et al. (2025) · neural information processing systems · doi:10.52202/085713-4186 · Cited by 211
Lai, V., Chen, C., Smith-Renner, A., Liao, Q. V., & Tan, C. (2023) · 2023 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3593013.3594087 · Cited by 204
“…21, 23, 29, 30, 32, 36, 38, 41, 43–45, 47, 60–63, 70, 72–75, 79, 81–83, 86, 91, 94, 101, 105, 106, 110, 112], within [9, 35, 45, 46, 66–68, 87, 94, 98, 106, 108], mixed methods [2, 12, 24, 61, 72, 99], qualitative [5], quantitative [18, 29, 30, 36, 38, 44, 60, 63, 75, 79, 80, 82, 105, 112], pilot…”
Designing for Responsible Trust in AI Systems: A Communication Perspective
Liao, Q. V., & Sundar, S. S. (2022) · 2022 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3531146.3533182 · Cited by 165
Nannini, L., Balayn, A., & Smith, A. L. (2023) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3593013.3594074 · Cited by 138
How Cognitive Biases Affect XAI-assisted Decision-making: A Systematic Review
Bertrand, A., Belloum, R., Eagan, J. R., & Maxwell, W. (2022) · Proceedings of the 2022 AAAI/ACM Conference on AI, Ethics, and Society · doi:10.1145/3514094.3534164 · Cited by 129
The Impact of Imperfect XAI on Human-AI Decision-Making
Morrison, K., Spitzer, P., Turri, V., Feng, M., Kühl, N., & Perer, A. (2024) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3641022 · Cited by 60
Human-Centered Explainable AI (XAI): From Algorithms to User Experiences
Liao, Q. V., & Varshney, K. R. (2021) · arXiv · doi:10.48550/arxiv.2110.10790 · Cited by 120
“) can be leveraged to aid attention and understanding of XAI [89, 94].”
BackgroundIs Conversational XAI All You Need? Human-AI Decision Making With a Conversational XAI Assistant
He, G., Aishwarya, N., & Gadiraju, U. (2025) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3708359.3712133 · Cited by 115
Kim, D., Song, Y., Kim, S., Lee, S., Wu, Y., Shin, J., & Lee, D. (2023) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2023.122343 · Cited by 111
Seamful XAI: Operationalizing Seamful Design in Explainable AI
Ehsan, U., Liao, Q. V., Passi, S., Riedl, M. O., & Daumé, H. (2024) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3637396 · Cited by 105
Bove, C., Aigrain, J., Lesot, M.-J., Tijus, C., & Detyniecki, M. (2022) · 27th International Conference on Intelligent User Interfaces · doi:10.1145/3490099.3511139 · Cited by 67
Subramanian, H. V., Canfield, C., & Shank, D. B. (2024) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2024.102780 · Cited by 84
An objective metric for Explainable AI: How and why to estimate the degree of explainability
Sovrano, F., & Vitali, F. (2023) · Knowledge-Based Systems · doi:10.1016/j.knosys.2023.110866 · Cited by 79
Explaining Recommendations in E-Learning: Effects on Adolescents' Trust
Ooge, J., Kato, S., & Verbert, K. (2022) · 27th International Conference on Intelligent User Interfaces · doi:10.1145/3490099.3511140 · Cited by 51
Self-citationTowards a Science of Human-AI Decision Making: A Survey of Empirical Studies
Lai, V., Chen, C., Liao, Q. V., Smith-Renner, A., & Tan, C. (2021) · arXiv · doi:10.48550/arxiv.2112.11471 · Cited by 75
Bhattacharya, A., Ooge, J., Stiglic, G., & Verbert, K. (2023) · Proceedings of the 28th International Conference on Intelligent User Interfaces · doi:10.1145/3581641.3584075 · Cited by 40
Self-citationBertrand, A., Viard, T., Belloum, R., Eagan, J. R., & Maxwell, W. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581314 · Cited by 71
Visualization for Recommendation Explainability: A Survey and New Perspectives
Chatti, M. A., Guesmi, M., & Muslim, A. (2024) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/3672276 · Cited by 70
Toward involving end-users in interactive human-in-the-loop AI fairness
Nakao, Y., Stumpf, S., Ahmed, S., Naseer, A., & Strappelli, L. (2022) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/3514258 · Cited by 69
Better Together? An Evaluation of AI-Supported Code Translation
Weisz, J. D., Muller, M., Ross, S. I., Martinez, F., Houde, S., Agarwal, M., Talamadupula, K., & Richards, J. T. (2022) · 27th International Conference on Intelligent User Interfaces · doi:10.1145/3490099.3511157 · Cited by 69
Kim, T., Kim, H., Lee, H. Y., Goh, H., Abdigapporov, S., Jeong, M., Cho, H., Han, K., Noh, Y., Lee, S.-J., et al. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3517701 · Cited by 63
Bertrand, A., Eagan, J., & Maxwell, W. (2023) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3593013.3594053 · Cited by 61
Ha, T., & Kim, S. (2023) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2023.2285640 · Cited by 59
Exploring the effects of human-centered AI explanations on trust and reliance
Scharowski, N., Perrig, S. A. C., Svab, M., Opwis, K., & Brühlmann, F. (2023) · Frontiers in Computer Science · doi:10.3389/fcomp.2023.1151150 · Cited by 57
User Characteristics in Explainable AI: The Rabbit Hole of Personalization?
Nimmo, R., Constantinides, M., Zhou, K., Quercia, D., & Stumpf, S. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642352 · Cited by 60
Understanding the Role of Explanation Modality in AI-assisted Decision-making
Robbemond, V., Inel, O., & Gadiraju, U. (2022) · Proceedings of the 30th ACM Conference on User Modeling, Adaptation and Personalization · doi:10.1145/3503252.3531311 · Cited by 34
Chatti, M. A., Guesmi, M., Vorgerd, L., Ngo, T., Joarder, S., Ain, Q. U., & Muslim, A. (2022) · ACM Conference on User Modeling, Adaptation and Personalization (UMAP) · doi:10.1145/3503252.3531304 · Cited by 55
Nourani, M., Roy, C., Block, J. E., Honeycutt, D. R., Rahman, T., Ragan, E. D., & Gogate, V. (2022) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/3531066 · Cited by 48
Contextualizing User Perceptions about Biases for Human-Centered Explainable Artificial Intelligence
Yuan, C. W., Bi, N., Lin, Y.-F., & Tseng, Y. (2023) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3580945 · Cited by 47
Boudanga, Z., Benhadou, S., & Medromi, H. (2023) · F1000Research · doi:10.12688/f1000research.138867.1 · Cited by 44
A Missing Piece in the Puzzle: Considering the Role of Task Complexity in Human-AI Decision Making
Salimzadeh, S., He, G., & Gadiraju, U. (2023) · Proceedings of the 31st ACM Conference on User Modeling, Adaptation and Personalization · doi:10.1145/3565472.3592959 · Cited by 42
“complicated and diverse visuals of task features are presented [90].”
BackgroundSalimzadeh, S., He, G., & Gadiraju, U. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3641905 · Cited by 41
“Human factors such as prior experience [110, 119], cognitive biases [85, 102], and AI literacy [25], which can shape individuals’ perceptions and interactions with AI systems.”
BackgroundIntelligent systems in healthcare: A systematic survey of explainable user interfaces
Cálem, J., Moreira, C., & Jorge, J. A. (2024) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2024.108908 · Cited by 40
How Do HCI Researchers Study Cognitive Biases? A Scoping Review
Boonprakong, N., Tag, B., Gonçalves, J., & Dingler, T. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713450 · Cited by 40
Knowing (Not) to Know: Explainable Artificial Intelligence and Human Metacognition
von Zahn, M., Liebich, L., Jussupow, E., Hinz, O. F., & Bauer, K. (2025) · Information Systems Research · doi:10.1287/isre.2024.1431 · Cited by 38
Exploring the Role of Local and Global Explanations in Recommender Systems
Radensky, M., Downey, D., Lo, K., Popović, Z., & Weld, D. S. (2022) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3491101.3519795 · Cited by 39
Guesmi, M., Chatti, M. A., Joarder, S., Ain, Q. U., Alatrash, R., Siepmann, C., & Vahidi, T. (2023) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2023.2262797 · Cited by 37
Explaining User Models with Different Levels of Detail for Transparent Recommendation: A User Study
Guesmi, M., Chatti, M. A., Vorgerd, L., Ngo, T., Joarder, S., Ain, Q. U., & Muslim, A. (2022) · ACM Conference on User Modeling, Adaptation and Personalization (UMAP) · doi:10.1145/3511047.3537685 · Cited by 36
Feldhus, N., Hennig, L., Nasert, M. D., Ebert, C., Schwarzenberg, R., & Mller, S. (2023) · doi:10.18653/v1/2023.nlrse-1.4 · Cited by 36
Okolo, C. T., Agarwal, D., Dell, N. L., & Vashistha, A. (2024) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3637348 · Cited by 36
Decoding AI’s Nudge: A Unified Framework to Predict Human Behavior in AI-Assisted Decision Making
Li, Z., Lu, Z., & Yin, M. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i9.28872 · Cited by 34
Guesmi, M., Chatti, M. A., Joarder, S., Ain, Q. U., Siepmann, C., Ghanbarzadeh, H., & Alatrash, R. (2023) · Information · doi:10.3390/info14070401 · Cited by 33
de Jong, S., Paananen, V., Tag, B., & van Berkel, N. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3710946 · Cited by 32
Schrills, T., & Franke, T. (2023) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/3588594 · Cited by 32
On the Impact of Explanations on Understanding of Algorithmic Decision-Making
Schmude, T., Koesten, L. M., Möller, T. B., & Tschiatschek, S. (2023) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3593013.3594054 · Cited by 31
Meaningful human control and variable autonomy in human-robot teams for firefighting
Verhagen, R., Neerincx, M. A., & Tielman, M. L. (2024) · Frontiers in Robotics and AI · doi:10.3389/frobt.2024.1323980 · Cited by 30
Explainable Interface for Human-Autonomy Teaming: A SurveyPreprint
Kong, X., Xing, Y., Tsourdos, A., Wang, Z., Guo, W., Perrusquía, A., & Wikander, A. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2405.02583 · Cited by 30
Why do explanations fail? A typology and discussion on failures in XAIPreprint
Bove, C., Laugel, T., Lesot, M., Tijus, C., & Detyniecki, M. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2405.13474 · Cited by 30
VanNostrand, P. M., Hofmann, D. M., Ma, L., & Rundensteiner, E. A. (2024) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3630106.3658997 · Cited by 26
Ma, S. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2410.21183 · Cited by 25
Designing and Evaluating Explanations for a Predictive Health Dashboard: A User-Centred Case Study
Szymanski, M., Abeele, V. V., & Verbert, K. (2024) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3613905.3637140 · Cited by 24
Self-citationFenomena Chatbot AI Sebagai Teman Curhat: Implikasi Pada Hubungan Antarpribadi di Era Digital
Yoseppin, G., Dewi, P. A. M. N., & Purba, Y. K. (2025) · Calathu Jurnal Ilmu Komunikasi · doi:10.37715/calathu.v7i1.5376 · Cited by 21
Information that matters: Exploring information needs of people affected by algorithmic decisions
Schmude, T., Koesten, L. M., Möller, T. B., & Tschiatschek, S. (2024) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2024.103380 · Cited by 20
Ferguson, S. A., Aoyagui, P. A., Rizvi, R., Kim, Y., & Kuzminykh, A. (2024) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3687056 · Cited by 21
Exploring the means to measure explainability: Metrics, heuristics and questionnaires
Deters, H., Droste, J., Obaidi, M., & Schneider, K. A. (2025) · Information and Software Technology · doi:10.1016/j.infsof.2025.107682 · Cited by 19
The Amplifying Effect of Explainability in AI-assisted Decision-making in Groups
Duarte, R. D. B., Abreu, M. C., Campos, J., & Paiva, A. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713534 · Cited by 19
Bianchi, M., Santis, A. D., Tocchetti, A., & Brambilla, M. (2024) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2024/411 · Cited by 18
A Co-design Study for Multi-stakeholder Job Recommender System Explanations
Schellingerhout, R., Barile, F., & Tintarev, N. (2023) · Communications in computer and information science · doi:10.1007/978-3-031-44067-0_30 · Cited by 18
Imperfections of XAI: Phenomena Influencing AI-Assisted Decision-Making
Spitzer, P., Morrison, K., Turri, V., Feng, M., Perer, A., & Kühl, N. (2025) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/3750052 · Cited by 17
Holstein, J., Böcking, L., Spitzer, P., Kühl, N., Vössing, M., & Satzger, G. (2025) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3762813 · Cited by 17
Lay User Involvement in Developing Human-centric Responsible AI Systems: When and How?
Vincenzi, B., Stumpf, S., Taylor, A. S., & Nakao, Y. (2024) · ACM Journal on Responsible Computing · doi:10.1145/3652592 · Cited by 17
Underspecified Human Decision Experiments Considered Harmful
Hullman, J. R., Kale, A. M., & Hartline, J. D. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3714063 · Cited by 16
Dai, J., Zhang, C., Aliakseyeu, D., Peeters, S., & IJsselsteijn, W. A. (2023) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581263 · Cited by 16
Peters, U., & Carman, M. (2023) · IEEE Intelligent Systems · doi:10.1109/mis.2023.3320433 · Cited by 15
Rebholz, T. R., Koop, A., & Hütter, M. (2024) · Technology Mind and Behavior · doi:10.1037/tmb0000136 · Cited by 15
Transferring Domain Knowledge with (X)AI-Based Learning Systems
Spitzer, P., Kühl, N., Goutier, M., Kaschura, M., & Satzger, G. (2024) · TUbilio (Technical University of Darmstadt) · doi:10.48550/arxiv.2406.01329 · Cited by 15
Feedback, Control, or Explanations? Supporting Teachers With Steerable Distractor-Generating AI
Szymanski, M., Ooge, J., Croon, R. D., Abeele, V. V., & Verbert, K. (2024) · International Conference on Learning Analytics and Knowledge (LAK) · doi:10.1145/3636555.3636933 · Cited by 14
Self-citationUnderstanding the Effects of AI-Assisted Critical Thinking on Human-AI Decision Making
Tian, H. Y., Amin, H., & Yin, M. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3790785 · Cited by 14
Deters, H., Droste, J., & Schneider, K. A. (2023) · International Conference on Evaluation and Assessment in Software Engineering (EASE) · doi:10.1145/3593434.3593444 · Cited by 14
Workshop on Understanding and Mitigating Cognitive Biases in Human-AI Collaboration
Boonprakong, N., He, G., Gadiraju, U., van Berkel, N., Wang, D., Chen, S., Liu, J., Tag, B., Gonçalves, J., & Dingler, T. (2023) · ACM Conference on Computer Supported Cooperative Work (CSCW) · doi:10.1145/3584931.3611284 · Cited by 13
Cartocci, G., Veyrié, A., Cavagnetto, N., Hurter, C., Degas, A., Ferreira, A., Ahmed, M. U., Begum, S., Barua, S., Inguscio, B. M. S., et al. (2026) · Brain Informatics · doi:10.1186/s40708-025-00287-6 · Cited by 13
Assessing Explainability in Reinforcement Learning
Zelvelder, A. E., Westberg, M., & Främling, K. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-82017-6_14 · Cited by 13
On the Influence of Cognitive Styles on Users' Understanding of ExplanationsPreprint
Riefle, L., Hemmer, P., Benz, C., Vössing, M., & Pries, J. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2210.02123 · Cited by 13
Brachman, M., Pan, Q., Do, H. J., Dugan, C., Chaudhary, A., Johnson, J. M., Rai, P., Chakraborti, T., Gschwind, T., Laredo, J. A., et al. (2023) · Proceedings of the 28th International Conference on Intelligent User Interfaces · doi:10.1145/3581641.3584088 · Cited by 11
“Mental model accuracy can also be affected by a variety of contextual factors, like type of explanation, expertise [107, 117, 129], personal characteristics [86, 93], and order of seeing system strengths and weaknesses [92].”
BackgroundPractising Appropriate Trust in Human-Centred AI Design
Degachi, C., Mehrotra, S., Yurrita, M., Niforatos, E., & Tielman, M. L. (2024) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3613905.3650825 · Cited by 10
OpenHEXAI: An Open-Source Framework for Human-Centered Evaluation of Explainable Machine LearningPreprint
Ma, J., Lai, V., Zhang, Y., Chen, C., Hamilton, P., Ljubenkov, D., Lakkaraju, H., & Tan, C. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2403.05565 · Cited by 10
Explainable AI for Daily Scenarios from End-Users’ Perspective: Non-Use, Concerns, and Ideal Design
Wang, L., Anyi, C. L., Xu, K., Liu, Y., Arriaga, R. I., & Goel, A. K. (2025) · Designing Interactive Systems Conference · doi:10.1145/3715336.3735796 · Cited by 11
Xu, Y., Chen, Z., & Dong, M. (2025) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2025.103629 · Cited by 9
Explanation User Interfaces: A Systematic Literature Review
Cappuccio, E., Esposito, A., Greco, F., Desolda, G., Lanzilotti, R., & Rinzivillo, S. (2026) · ACM Computing Surveys · doi:10.1145/3834765 · Cited by 9
Co-Designing with Users the Explanations for a Proactive Auto-Response Messaging Agent
Jain, P., Farzan, R., & Lee, A. J. (2023) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3604248 · Cited by 10
Designing and Personalising Hybrid Multi-Modal Health Explanations for Lay Users
Szymanski, M., Conati, C., Abeele, V. V., & Verbert, K. (2023) · Lirias (KU Leuven) · Cited by 9
Self-citationPEAK: Explainable Privacy Assistant through Automated Knowledge ExtractionPreprint
Aycı, G., Özgür, A., Şensoy, M., & Yolum, P. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2301.02079 · Cited by 9
Please Take Over: Xai, Delegation of Authority, and Domain KnowledgePreprint
Bauer, K., von Zahn, M., & Hinz, O. F. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4512594 · Cited by 10
Mehrotra, S., Gadiraju, U., Bittner, E. A. C., van Delden, F., Jonker, C. M., & Tielman, M. L. (2025) · ACM Conference on User Modeling, Adaptation and Personalization (UMAP) · doi:10.1145/3699682.3728343 · Cited by 8
The Role of Explainability In AI-Driven Financial Decision Making
Ioannou, A., Tavalaei, M. M., Vatn, D. M. K., & Mikalef, P. (2026) · Information Systems Frontiers · doi:10.1007/s10796-026-10727-1 · Cited by 8
Where Are We and Where Can We Go on the Road to Reliance-Aware Explainable User Interfaces?
Filho, J. C. D. S., Belloum, R., & de Oliveira, K. M. (2024) · IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC) · doi:10.1109/vl/hcc60511.2024.00038 · Cited by 8
The Role of Initial Acceptance Attitudes Toward AI Decisions in Algorithmic Recourse
Tominaga, T., Yamashita, N., & Kurashima, T. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713573 · Cited by 8
Exploring the Effect of Explanation Content and Format on User Comprehension and Trust in Healthcare
Rago, A., Pálfi, B., Sukpanichnant, P., Vivek, K., Nabli, H., Kostopoulou, O., Kinross, J. K., & Toni, F. (2025) · Frontiers in artificial intelligence and applications · doi:10.3233/faia251479 · Cited by 8
Predicting the need for XAI from high-granularity interaction data
de Santana, V. F., Fucs, A., Segura, V., de Moraes, D. B., & Cerqueira, R. (2023) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2023.103029 · Cited by 8
Bertrand, A. (2024) · theses.fr (ABES) · doi:10.70675/216d3647z78bcz4c68z9ba9z2d0a029cf1b4 · Cited by 8
Chen, Y., Verbert, K., Gerling, K., Abeele, M.-E. V., & Abeele, V. V. (2025) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3708359.3712139 · Cited by 7
Self-citationBorchers, M., Soroko, D., Tavanapour, N., & Bittner, E. A. C. (2024) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3686971 · Cited by 7
TELL-ME: Toward Personalized Explanations of Large Language Models
Jeck, J., Leiser, F., Hüsges, A., & Sunyaev, A. (2025) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3706599.3719982 · Cited by 8
Explain it like I'm me: User Characteristics in XAI Decision-Making
Khadar, M., Timma, A., Ludden, L., & Kaur, H. (2025) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3715275.3732116 · Cited by 7
Meske, C., Brenne, J., Ünal, E., Ölçer, S., & Doğangün, A. (2026) · Behaviour and Information Technology · doi:10.2139/ssrn.6211215 · Cited by 7
Schrills, T., Gruner, M., Peuscher, H., & Franke, T. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-35748-0_23 · Cited by 7
Metadata
- Authors
- Szymanski, M., Millecamp, M., & Verbert, K.
- Affiliations
- KU Leuven (BE)
- Venue
- 26th International Conference on Intelligent User Interfaces
- Publisher
- ACM
- Published
- 2021-04-14
- Pages
- 109-119
- OpenAlex
- W3155920732
- Cited by
- 131
- References
- 33
- Citations by year
- 2026: 24 · 2025: 34 · 2024: 26 · 2023: 30 · 2022: 15 · 2021: 2
- FWCI
- 8.42
- Type
- conference paper
- Language
- en
- Open access
- green
- lirias.kuleuven.be
- Locations
- ACM International Conference on Intelligent User Interfaces (IUI) (publishedVersion)
- Lirias (submittedVersion, other-oa)
- Funders
- Research Foundation Flanders (FWO) (G0A3319N)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Physical Sciences › Computer Science › Computer Graphics and Computer-Aided Design › Data Visualization and Analytics
- Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
- Keywords
- explainable AI, user expertise, visual explanations, textual explanations, model interpretability, non-expert users, expert users, ease of use, transparency and accountability
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.