Explainable Active Learning (XAL): Toward AI Explanations as Interfaces for Machine Teachers
The DOI matches its Crossref record; 97 of the 97 references it cites were found in a registry or an index.
Abstract
The wide adoption of Machine Learning (ML) technologies has created a growing demand for people who can train ML models. Some advocated the term "machine teacher'' to refer to the role of people who inject domain knowledge into ML models. This "teaching'' perspective emphasizes supporting the productivity and mental wellbeing of machine teachers through efficient learning algorithms and thoughtful design of human-AI interfaces. One promising learning paradigm is Active Learning (AL), by which the model intelligently selects instances to query a machine teacher for labels, so that the labeling workload could be largely reduced. However, in current AL settings, the human-AI interface remains minimal and opaque. A dearth of empirical studies further hinders us from developing teacher-friendly interfaces for AL algorithms. In this work, we begin considering AI explanations as a core element of the human-AI interface for teaching machines. When a human student learns, it is a common pattern to present one's own reasoning and solicit feedback from the teacher. When a ML model learns and still makes mistakes, the teacher ought to be able to understand the reasoning underlying its mistakes. When the model matures, the teacher should be able to recognize its progress in order to trust and feel confident about their teaching outcome. Toward this vision, we propose a novel paradigm of explainable active learning (XAL), by introducing techniques from the surging field of explainable AI (XAI) into an AL setting. We conducted an empirical study comparing the model learning outcomes, feedback content and experience with XAL, to that of traditional AL and coactive learning (providing the model's prediction without explanation). Our study shows benefits of AI explanation as interfaces for machine teaching--supporting trust calibration and enabling rich forms of teaching feedback, and potential drawbacks--anchoring effect with the model judgment and additional cognitive workload. Our study also reveals important individual factors that mediate a machine teacher's reception to AI explanations, including task knowledge, AI experience and Need for Cognition. By reflecting on the results, we suggest future directions and design implications for XAL, and more broadly, machine teaching through AI explanations.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The authors suggest two types of human intuition useful for detecting model errors-intuition about feature relevance and intuition about feature mechanism (e.g., weight), which align with prior findings about how experts critique model explanations in interactive ML settings [33,75].”
From Understanding the Role of Human Intuition on Reliance in Human-AI Decision-Making with Explanations (2023) · cites this paper as [33]
In the citing paper
“Some user groups are more vulnerable to these harms than others, such as AI novices [60], people working in cognitively constrained settings [52], and even those with certain personality traits [17].”
From Designing for Responsible Trust in AI Systems: A Communication Perspective (2022) · cites this paper as [17]
In the citing paper
“For example, recent studies have repeatedly found that XAI features bring less benefit, or even harms (leading to over-trust), to certain user groups such as AI novices or users working in cognitively constrained settings [17, 52, 60].”
From Designing for Responsible Trust in AI Systems: A Communication Perspective (2022) · cites this paper as [17]
In the citing paper
“This task is suitable for our study since it requires little domain expertise and imposes relatively limited risks, and thus is amenable for non-expert participants [39].”
From Who Should I Trust: AI or Myself? Leveraging Human and AI Correctness Likelihood to Promote Appropriate Trust in AI-Assisted Decision-Making (2023) · cites this paper as [39]
Citations
Cites
A Unified Approach to Interpreting Model Predictions
Lundberg, S., & Lee, S.-I. (2017) · arXiv · doi:10.48550/arxiv.1705.07874 · Cited by 23,707 · cited 3×
“[62, 72]) is a cluster of XAI techniques that explain how the model arrived at a particular decision.”
BackgroundMethod"Why Should I Trust You?": Explaining the Predictions of Any Classifier
Ribeiro, M. T., Singh, S., & Guestrin, C. (2016) · Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2939672.2939778 · Cited by 17,555
Developing and validating trust measures for e-commerce: an integrative typology
McKnight, D. H., Choudhury, V., & Kacmar, C. (2002) · Information Systems Research · doi:10.1287/isre.13.3.334.81 · Cited by 5,550 · cited 3×
“Trust in technologies is frequently measured based on McKnight’s framework on Trust [63, 64], which considers the dimensions of capability, benevolence, integrity for trust belief, and multiple actionbased items (e.”
MethodInfluentialLipton, Z. C. (2018) · Queue · doi:10.1145/3236386.3241340 · Cited by 5,427 · cited 3×
“The first two categories, model and outcome explanations, are also referred as global and local explanations [6, 59, 66].”
BackgroundCacioppo, J. T., & Petty, R. E. (1982) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.42.1.116 · Cited by 5,359 · cited 2×
“We also explore the effect of Need for cognition [12], defined as an individual’s tendency to engage in thinking or complex cognitive activities.”
BackgroundMethod(2009) · Minds at UW (University of Wisconsin) · Cited by 4,791
Towards A Rigorous Science of Interpretable Machine Learning
Doshi-Velez, F., & Kim, B. (2017) · arXiv · doi:10.48550/arxiv.1702.08608 · Cited by 3,121 · cited 4×
“While Machine Learning technologies are increasingly used in a wide variety of domains ranging from critical systems to everyday consumer products, currently only a small group of people with formal training possess the skills to develop these technologies.”
BackgroundMethodInfluentialIBM computer usability satisfaction questionnaires: Psychometric evaluation and instructions for use
Lewis, J. R. (1995) · International Journal of Human-Computer Interaction · doi:10.1080/10447319509526110 · Cited by 2,429 · cited 2×
“Satisfaction of the annotation experience, by five items adapted from After-Scenario Questionnaire [54] and User Engagement Scale [68] (e.”
MethodAnchors: High-Precision Model-Agnostic Explanations
Ribeiro, M. T., Singh, S., & Guestrin, C. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11491 · Cited by 2,162 · cited 1×
“Other design choices for local explanations include presenting similar examples with the same known outcome [9, 37], and rules that the model believes to guarantee the prediction [73] (e.”
BackgroundMachine Learning Interpretability: A Survey on Methods and Metrics
Carvalho, D. V., Pereira, E. M., & Cardoso, J. S. (2019) · Electronics · doi:10.3390/electronics8080832 · Cited by 1,842 · cited 3×
“Common goals of AI explanations, as reflected in much of the XAI literature, are to support a complete and sound understanding of the model [16, 48], and to foster trust in the AI [19, 69].”
Background
Research works printed but not linked: 13
- David A. Anisi . 2003. Optimal Motion Control of a Ground Vehicle. Master's thesis . Royal Institute of Technology (KTH) , Stockholm, Sweden . David A. Anisi. 2003. Optimal Motion Control of a Ground Vehicle. Master's thesis. Royal Institute of Technology (KTH), Stockholm, Sweden.
- Vijay Arya , Rachel KE Bellamy , Pin-Yu Chen, Amit Dhurandhar, Michael Hind, Samuel C Hoffman, Stephanie Houde, Q Vera Liao, Ronny Luss, Aleksandra Mojsilović, et almbox. 2019 . One Explanation Does Not Fit All: A Toolkit and Taxonomy of AI Explainability Techniques . arXiv preprint arXiv:1909.03012 (2019). Vijay Arya, Rachel KE Bellamy, Pin-Yu Chen, Amit Dhurandhar, Michael Hind, Samuel C Hoffman, Stephanie Houde, Q Vera Liao, Ronny Luss, Aleksandra Mojsilović, et almbox. 2019. One Explanation Does Not Fit All: A Toolkit and Taxonomy of AI Explainability Techniques. arXiv preprint arXiv:1909.03012 (2019). · arXiv
- 10.1037/0022-3514.45.4.805 · doi:10.1037/0022-3514.45.4.805 · Paper page
- Tathagata Chakraborti , Sarath Sreedharan , and Subbarao Kambhampati . 2020. The Emerging Landscape of Explainable AI Planning and Decision Making. arXiv preprint arXiv:2002.11697 ( 2020 ). Tathagata Chakraborti, Sarath Sreedharan, and Subbarao Kambhampati. 2020. The Emerging Landscape of Explainable AI Planning and Decision Making. arXiv preprint arXiv:2002.11697 (2020). · arXiv
- Sophie Chou , William Li , and Ramesh Sridharan . 2014 . Democratizing data science . In Proceedings of the KDD 2014 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining , New York, NY, USA. Citeseer, 24--27. Sophie Chou, William Li, and Ramesh Sridharan. 2014. Democratizing data science. In Proceedings of the KDD 2014 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, New York, NY, USA. Citeseer, 24--27.
- Karthik S Gurumoorthy , Amit Dhurandhar , and Guillermo Cecchi . 2017 . Protodash: Fast interpretable prototype selection. arXiv preprint arXiv:1707.01212 (2017). Karthik S Gurumoorthy, Amit Dhurandhar, and Guillermo Cecchi. 2017. Protodash: Fast interpretable prototype selection. arXiv preprint arXiv:1707.01212 (2017). · arXiv
- 10.1037/0022-3514.63.2.308 · doi:10.1037/0022-3514.63.2.308 · Paper page
- David D Lewis and William A Gale . 1994 b. A sequential algorithm for training text classifiers . In SIGIR?94 . Springer , 3--12. David D Lewis and William A Gale. 1994 b. A sequential algorithm for training text classifiers. In SIGIR?94. Springer, 3--12.
- 10.5555/1613715.1613855 · doi:10.5555/1613715.1613855
- 10.5555/2831071.2831072 · doi:10.5555/2831071.2831072
- Patrice Y Simard , Saleema Amershi , David M Chickering , Alicia Edelman Pelton , Soroush Ghorashi, Christopher Meek, Gonzalo Ramos, Jina Suh, Johan Verwey, Mo Wang, et almbox. 2017 . Machine teaching: A new paradigm for building machine learning systems. arXiv preprint arXiv:1707.06742 (2017). Patrice Y Simard, Saleema Amershi, David M Chickering, Alicia Edelman Pelton, Soroush Ghorashi, Christopher Meek, Gonzalo Ramos, Jina Suh, Johan Verwey, Mo Wang, et almbox. 2017. Machine teaching: A new paradigm for building machine learning systems. arXiv preprint arXiv:1707.06742 (2017). · arXiv
- Simone Stumpf , Adrian Bussone , and Dympna O?sullivan. 2016 . Explanations considered harmful? user interactions with machine learning systems . In Proceedings of the ACM SIGCHI Conference on Human Factors in Computing Systems (CHI) . Simone Stumpf, Adrian Bussone, and Dympna O?sullivan. 2016. Explanations considered harmful? user interactions with machine learning systems. In Proceedings of the ACM SIGCHI Conference on Human Factors in Computing Systems (CHI) .
- Richard Tomsett , Dave Braines , Dan Harborne , Alun Preece , and Supriyo Chakraborty . 2018. Interpretable to whom? A role-based model for analyzing interpretable machine learning systems. arXiv preprint arXiv:1806.07552 ( 2018 ). Richard Tomsett, Dave Braines, Dan Harborne, Alun Preece, and Supriyo Chakraborty. 2018. Interpretable to whom? A role-based model for analyzing interpretable machine learning systems. arXiv preprint arXiv:1806.07552 (2018). · arXiv
Cited by
Buçinca, Z., Malaya, M. B., & Gajos, K. Z. (2021) · arXiv · doi:10.48550/arxiv.2102.09692 · Cited by 1,124
“Because prior work suggested that people with high Need for Cognition (NFC, a stable personality trait that captures one’s motivation to engage in effortful mental activities) tend to benefit more from complex user interface features [12, 22, 24], we did so by disaggregating our results by NFC level.”
BackgroundExpanding Explainability: Towards Social Transparency in AI systems
Ehsan, U., Liao, Q. V., Muller, M., Riedl, M. O., & Weisz, J. D. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445188 · Cited by 538
Self-citationHuman-Centered Explainable AI (XAI): From Algorithms to User Experiences
Liao, Q. V., & Varshney, K. R. (2026) · Cambridge University Press eBooks · doi:10.1017/9781108872225.011 · Cited by 480
Self-citationSurvey on Explainable AI: From Approaches, Limitations and Applications Aspects
Yang, W., Wei, Y., Wei, H., Chen, Y., Huang, G., Li, X., Li, R., Yao, N., Wang, X., Gu, X., et al. (2023) · Human-Centric Intelligent Systems · doi:10.1007/s44230-023-00038-y · Cited by 240
How to Evaluate Trust in AI-Assisted Decision Making? A Survey of Empirical Methodologies
Vereschak, O., Bailly, G., & Caramiaux, B. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3476068 · Cited by 229
Lai, V., Chen, C., Smith-Renner, A., Liao, Q. V., & Tan, C. (2023) · 2023 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3593013.3594087 · Cited by 204
Self-citationA Survey on Active Learning: State-of-the-Art, Practical Challenges and Research Directions
Tharwat, A., & Schenck, W. (2023) · Mathematics · doi:10.3390/math11040820 · Cited by 175
“Recently, a new paradigm of explainable active learning (XAL) has been introduced, which is a hybrid of explainable AI (XAI) and active learning [170].”
BackgroundMehrotra, S., Degachi, C., Vereschak, O., Jonker, C. M., & Tielman, M. L. (2024) · ACM Journal on Responsible Computing · doi:10.1145/3696449 · Cited by 256
Designing for Responsible Trust in AI Systems: A Communication Perspective
Liao, Q. V., & Sundar, S. S. (2022) · 2022 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3531146.3533182 · Cited by 165
Self-citationWischnewski, M., Krämer, N., & Müller, E. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581197 · Cited by 146
Understanding the Role of Human Intuition on Reliance in Human-AI Decision-Making with Explanations
Chen, V., Liao, Q. V., Wortman Vaughan, J., & Bansal, G. (2023) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3610219 · Cited by 220
Self-citationHuman-AI Collaboration via Conditional Delegation: A Case Study of Content Moderation
Lai, V., Carton, S., Bhatnagar, R., Liao, Q. V., Zhang, Y., & Tan, C. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3501999 · Cited by 145
Self-citationMa, S., Lei, Y., Wang, X., Zheng, C., Shi, C., Yin, M., & Ma, X. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581058 · Cited by 143
Human-centered evaluation of explainable AI applications: a systematic review
Kim, J., Maathuis, H., & Sent, D. (2024) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2024.1456486 · Cited by 130
Co-design of human-centered, explainable AI for clinical decision support
Panigutti, C., Beretta, A., Fadda, D., Giannotti, F., Pedreschi, D., Perotti, A., & Rinzivillo, S. (2023) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/3587271 · Cited by 127
Do People Engage Cognitively with AI? Impact of AI Assistance on Incidental Learning
Gajos, K. Z., & Mamykina, L. (2022) · 27th International Conference on Intelligent User Interfaces · doi:10.1145/3490099.3511138 · Cited by 127
Liu, H., Lai, V., & Tan, C. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3479552 · Cited by 111
Operationalizing Human-Centered Perspectives in Explainable AI
Ehsan, U., Wintersberger, P., Liao, Q. V., Mara, M., Streit, M., Wachter, S., Riener, A., & Riedl, M. O. (2021) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3411763.3441342 · Cited by 174
Self-citationShirzad, M., Shaban, M., Mohammadzadeh, V., Rahdar, A., Fathi‐karkan, S., Hoseini, Z. S., Najafi, M., Kharaba, Z. J., & Aboudzadeh, M. A. (2025) · BioNanoScience · doi:10.1007/s12668-025-01980-w · Cited by 118
Human-AI Collaboration for UX Evaluation: Effects of Explanation and Synchronization
Fan, M., Yang, X., Yu, T., Liao, Q. V., & Zhao, J. (2022) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3512943 · Cited by 81
Self-citationFok, R., & Weld, D. S. (2024) · AI Magazine · doi:10.1002/aaai.12182 · Cited by 81
Honeycutt, D. R., Nourani, M., & Ragan, E. D. (2020) · Proceedings of the AAAI Conference on Human Computation and Crowdsourcing · doi:10.1609/hcomp.v8i1.7464 · Cited by 106
The Review of Studies on Explainable Artificial Intelligence in Educational Research
Türkmen, G. (2024) · Journal of Educational Computing Research · doi:10.1177/07356331241310915 · Cited by 97
“Additionally, the interpretability of XAI systems ensures ethical AI practices, protecting student interests and promoting responsible AI use (Ghai et al., 2021).”
Explainability pitfalls: beyond dark patterns in explainable AI
Ehsan, U., & Riedl, M. O. (2024) · Patterns · doi:10.1016/j.patter.2024.100971 · Cited by 72
Bertrand, A., Viard, T., Belloum, R., Eagan, J. R., & Maxwell, W. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581314 · Cited by 71
Selective Explanations: Leveraging Human Input to Align Explainable AI
Lai, V. W.-M., Zhang, Y., Chen, C., Liao, Q. V., & Tan, C. (2023) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3610206 · Cited by 93
Self-citationThe Roles of Artificial Intelligence in Teaching Anatomy: A Systematic Review
Joseph, T. S., Gowrie, S., Montalbano, M. J., Bandelow, S., Clunes, M. T., Dumont, A. S., Iwanaga, J., Tubbs, R. S., & Loukas, M. (2025) · Clinical Anatomy · doi:10.1002/ca.24272 · Cited by 72
Li, Y., Song, Y., Sun, Y., & Zeng, M. (2024) · Technology in Society · doi:10.1016/j.techsoc.2024.102518 · Cited by 70
Facilitating Knowledge Sharing from Domain Experts to Data Scientists for Building NLP Models
Park, S., Wang, A. Y., Kawas, B., Liao, Q. V., Piorkowski, D., & Danilevsky, M. (2021) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3397481.3450637 · Cited by 88
Self-citationMaking AI Explainable in the Global South: A Systematic Review
Okolo, C. T., Dell, N. L., & Vashistha, A. (2022) · ACM SIGCAS/SIGCHI Conference on Computing and Sustainable Societies (COMPASS) · doi:10.1145/3530190.3534802 · Cited by 81
Bridging the Gap: A Survey on Integrating (Human) Feedback for Natural Language Generation
Fernandes, P., Madaan, A., Liu, E., Farinhas, A., Martins, P. H., Bertsch, A., de Souza, J. G. C., Zhou, S., Wu, T., Neubig, G., et al. (2023) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00626 · Cited by 133
“Type of feedback: Existing datasets generally use rankings or scores, but future work may investigate the value of more detailed feedback, which humans usually prefer to provide (Stumpf et al., 2007; Amershi et al., 2014; Ghai et al., 2021).”
Leveraging explanations in interactive machine learning: An overview
Teso, S., Alkan, Ö., Stammer, W., & Daly, E. (2023) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2023.1066049 · Cited by 106
A survey of explainable knowledge tracing
Bai, Y., Zhao, J., Wei, T., Cai, Q., & He, L. (2024) · Applied Intelligence · doi:10.1007/s10489-024-05509-8 · Cited by 75
Fok, R., & Weld, D. S. (2023) · arXiv · doi:10.48550/arxiv.2305.07722 · Cited by 54
Al-Ansari, N., Al‐Thani, D., & Al-Mansoori, R. S. (2024) · Human Behavior and Emerging Technologies · doi:10.1155/2024/4628855 · Cited by 68
Explanation-Based Human Debugging of NLP Models: A Survey
Lertvittayakumjorn, P., & Toni, F. (2021) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00440 · Cited by 91
“, 2018), debugging outside the NLP domain (Ghai et al., 2021; Popordanoska et al., 2020), and works centered on revealing but not fixing bugs (Ribeiro et al.”
BackgroundMa, S., Chen, Q., Wang, X., Zheng, C., Peng, Z., Yin, M., & Ma, X. (2025) · Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713423 · Cited by 48
Few-shot learning for defect detection in manufacturing
Zajec, P., Rožanec, J. M., Theodoropoulos, S., Fontul, M., Koehorst, E., Fortuna, B., & Mladenić, D. (2024) · International Journal of Production Research · doi:10.1080/00207543.2024.2316279 · Cited by 62
“E .g. Ghai et al. (2021) leveraged local explanations to help annotators annotate unlabelled data instances, and Ciravegna et al. (2023) studied how rule-based (domain or explainable artificial intelligence) knowledge can be converted into logic constraints and their violation checked to guide…”
Lee, M., Jeon, J., & Lee, H.-C. (2021) · Journal of Intelligent Manufacturing · doi:10.1007/s10845-021-01758-3 · Cited by 53
Li, J., Yang, Y., Liao, Q. V., Zhang, J., & Lee, Y. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713336 · Cited by 89
Self-citationAdversarial Attacks in Explainable Machine Learning: A Survey of Threats Against Models and Humans
Vadillo, J., Santana, R., & Lozano, J. A. (2024) · Wiley Interdisciplinary Reviews Data Mining and Knowledge Discovery · doi:10.1002/widm.1567 · Cited by 59
Wang, X., & Yin, M. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581366 · Cited by 38
Vision-based personal thermal comfort prediction based on half-body thermal distribution
Baek, J., Park, D. Y., Park, H., Le, D. M., & Chang, S. (2022) · Building and Environment · doi:10.1016/j.buildenv.2022.109877 · Cited by 37
Ansari, S. R., & Qamari, I. N. (2025) · Discover Education · doi:10.1007/s44217-025-00865-0 · Cited by 40
Lu, J., Yan, Y., Huang, K., Yin, M., & Zhang, F. (2024) · Group Decision and Negotiation · doi:10.1007/s10726-024-09912-x · Cited by 44
XAI-KG: Knowledge Graph to Support XAI and Decision-Making in Manufacturing
Rožanec, J. M., Zajec, P., Kenda, K., Novalija, I., Fortuna, B., & Mladenić, D. (2021) · Lecture notes in business information processing · doi:10.1007/978-3-030-79022-6_14 · Cited by 29
Sykes, A. L., Silva, G. S., Holtkamp, D., Mauch, B. W., Osemeke, O., Linhares, D. C. L., & Machado, G. (2021) · Transboundary and Emerging Diseases · doi:10.1111/tbed.14369 · Cited by 30
Akmal, M. (2022) · IEEE Sensors Journal · doi:10.1109/jsen.2022.3223338 · Cited by 23
Show or suppress? Managing input uncertainty in machine learning model explanations
Wang, D., Zhang, W., & Lim, B. Y. (2021) · Artificial Intelligence · doi:10.1016/j.artint.2021.103456 · Cited by 35
A Rationale-Centric Framework for Human-in-the-loop Machine Learning
Lu, J., Yang, L., Namee, B. M., & Zhang, Y. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.481 · Cited by 48
Self-citationSenseMate: An Accessible and Beginner-Friendly Human-AI Platform for Qualitative Data Analysis
Overney, C., Saldías-Fuentes, B., Dimitrakopoulou, D., & Roy, D. K. (2024) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3640543.3645194 · Cited by 46
Fluent: An AI Augmented Writing Tool for People who Stutter
Ghai, B., & Mueller, K. D. (2021) · International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) · doi:10.1145/3441852.3471211 · Cited by 21
Self-citationHerde, M., Huseljic, D., Sick, B., & Calma, A. (2021) · IEEE Access · doi:10.1109/access.2021.3135514 · Cited by 33
Explainability Pitfalls: Beyond Dark Patterns in Explainable AI
Ehsan, U., & Riedl, M. O. (2021) · arXiv · doi:10.48550/arxiv.2109.12480 · Cited by 99
Question-Driven Design Process for Explainable AI User Experiences
Liao, Q. V., Pribić, M., Han, J., Miller, S., & Sow, D. (2021) · arXiv · doi:10.48550/arxiv.2104.03483 · Cited by 18
Self-citationThe Who in Explainable AI: How AI Background Shapes Perceptions of AI ExplanationsPreprint
Ehsan, U., Passi, S., Liao, Q. V., Chan, L., Lee, I.-H., Muller, M. J., & Riedl, M. O. (2021) · arXiv (Cornell University) · Cited by 38
Self-citationGöbel, K., Niessen, C., Seufert, S., & Schmid, U. (2022) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2022.919534 · Cited by 18
“In contrast, people with high conscientiousness and a high need for cognition may not be convinced by the rather simple explanations we have given, feel more uncertain, and want to check the appropriateness of the explanation on their own (cf. Gajos and Chauncey, 2017; Ghai et al., 2021).”
BackgroundHuman Centricity in the Relationship Between Explainability and Trust in AI
Atf, Z., & Lewis, P. R. (2023) · IEEE Technology and Society Magazine · doi:10.1109/mts.2023.3340238 · Cited by 25
Ghozatlou, O., Datcu, M. P., Focșa, A., Conde, M. H., & Ullo, S. L. (2024) · IEEE Geoscience and Remote Sensing Magazine · doi:10.1109/mgrs.2024.3403423 · Cited by 18
Exploring the means to measure explainability: Metrics, heuristics and questionnaires
Deters, H., Droste, J., Obaidi, M., & Schneider, K. A. (2025) · Information and Software Technology · doi:10.1016/j.infsof.2025.107682 · Cited by 19
Cross-Domain Few-Shot Micro-Expression Recognition Incorporating Action Units
Dai, Y. Q., & Feng, L. (2021) · IEEE Access · doi:10.1109/access.2021.3120542 · Cited by 14
Human in the loop active learning for time-series electrical measurement data
Sobot, T., Stanković, V., & Stanković, L. (2024) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2024.108589 · Cited by 14
Perspectives on incorporating expert feedback into model updates
Chen, V., Bhatt, U., Heidari, H., Weller, A., & Talwalkar, A. (2023) · Patterns · doi:10.1016/j.patter.2023.100780 · Cited by 20
Sullivan, V., & Weger, K. (2025) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/10711813251369473 · Cited by 14
“However, other research suggests that excessive transparency may negatively impact user perceptions by causing cognitive overload, confusing, and distrust (Abdul et al., 2020; Ghai et al., 2021; Walmsley, 2021).”
Seven challenges for harmonizing explainability requirementsPreprint
Chen, J., & Storchan, V. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2108.05390 · Cited by 13
XAI in Automated Fact-Checking? The Benefits Are Modest and There's No One-Explanation-Fits-All
Lim, G., & Perrault, S. T. (2023) · Australian Conference on Computer-Human Interaction (OzCHI) · doi:10.1145/3638380.3638388 · Cited by 13
Exploring the impact of explainable AI and cognitive capabilities on users’ decisions
Cau, F. M., & Spano, L. D. (2025) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-025-09438-0 · Cited by 20
Zajec, P., Rožanec, J. M., Trajkova, E., Novalija, I., Kenda, K., Fortuna, B., & Mladenić, D. (2021) · Information · doi:10.3390/info12110473 · Cited by 11
Coalesce: An Accessible Mixed-Initiative System for Designing Community-Centric Questionnaires
Overney, C., Kessler, D. T., Fulay, S. P., Jasim, M., & Roy, D. K. (2025) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3708359.3712118 · Cited by 14
The Influence of Curiosity Traits and On-Demand Explanations in AI-Assisted Decision-Making
Cau, F. M., & Spano, L. D. (2025) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3708359.3712165 · Cited by 15
User Driven Model Adjustment via Boolean Rule Explanations
Daly, E., Mattetti, M., Alkan, Ö., & Nair, R. S. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i7.16737 · Cited by 10
Trustworthy AI Explanations as an Interface in Medical Diagnostic Systems
Kaur, D., Uslu, S., & Durresi, A. (2022) · Lecture notes in networks and systems · doi:10.1007/978-3-031-14314-4_12 · Cited by 13
He, J., Cheng, H., Wang, Y., & Zheng, Z. (2025) · Information Systems Research · doi:10.1287/isre.2024.1154 · Cited by 14
Matarese, M., Cocchella, F., Rea, F., & Sciutti, A. (2023) · IEEE RO-MAN · doi:10.1109/ro-man57019.2023.10309636 · Cited by 12
Designing Human-Centric AI Mental Health Chatbots: A Case Study of Two Apps
Lee, K. S., Yeung, J., Kurniawati, A., & Chou, D. T. (2025) · Lecture notes in networks and systems · doi:10.1007/978-981-96-1747-0_36 · Cited by 9
Li, Q., Yin, X., Shao, T., Li, X., & Wang, Q. (2023) · Soft Computing · doi:10.1007/s00500-023-08223-8 · Cited by 7
RetractedDecker, T. W., Gross, R., Koebler, A., Lebacher, M., Schnitzer, R., & Weber, S. H. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-35891-3_13 · Cited by 18
Füßl, A., & Nissen, V. (2025) · Requirements Engineering · doi:10.1007/s00766-025-00437-6 · Cited by 8
Moll, M., & Dorsch, J. (2025) · Human-Intelligent Systems Integration · doi:10.1007/s42454-025-00084-w · Cited by 6
“Studies show that presenting confidence scores too early can introduce anchoring effects, biasing users toward over-reliance—even when they have relevant expertise (Ghai et al. 2021;Maetal.2023).”
Casteleiro, M. A., Maroto, N., Wroe, C., Torrado, C. S., Henson, C., Diz, J. D., Fernandez-Prieto, M. J., Furmston, T., Fernandez, D. M., Kulshrestha, M., et al. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-91100-3_14 · Cited by 7
Human Expectations and Perceptions of Learning in Machine Teaching
Mishra, S., & Rzeszotarski, J. M. (2023) · ACM Conference on User Modeling, Adaptation and Personalization (UMAP) · doi:10.1145/3565472.3595612 · Cited by 8
Takeda, N., Legaspi, R., Nishimura, Y., Ikeda, K., Plötz, T., & Chernova, S. (2024) · IEEE International Conference on Big Data Analytics (ICBDA) · doi:10.1109/icbda61153.2024.10607364 · Cited by 7
ALEX: Active Learning based Enhancement of a Classification Model's EXplainability
Mondal, I., & Ganguly, D. (2020) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3340531.3417456 · Cited by 6
Thomas, I., Oh, S. Y., & Szafir, D. A. (2024) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3640543.3645207 · Cited by 8
Active Learning for Detecting Hardware Sensors-Based Side-Channel Attack on Smartphone
Abbas, S., Alsubai, S., Ojo, S., Sampedro, G. A., Almadhor, A. S., Hejaili, A. A., & Bouazzi, I. R. (2024) · Arabian Journal for Science and Engineering · doi:10.1007/s13369-024-09046-x · Cited by 5
Holistic Pedagogical Model for Table Tennis: Integrating Regulations, Multimedia, and Sportsmanship
Safari, I., Supriyadi, T., & Susilawati, D. (2025) · International journal of human movement and sports sciences · doi:10.13189/saj.2025.130318 · Cited by 7
An Explanation User Interface for a Knowledge Graph-Based XAI Approach to Process Analysis
Füßl, A., Nissen, V., & Heringklee, S. H. (2024) · Lecture notes in business information processing · doi:10.1007/978-3-031-61003-5_7 · Cited by 5
Pichandi, K. V., Senthil, P., Prabakar, D., & Uma, S. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2024.125338 · Cited by 6
Shim, J., & Kang, S. (2025) · Expert Systems with Applications · doi:10.1016/j.eswa.2025.128443 · Cited by 4
Automated Trustworthiness Oracle Generation for Machine Learning Text Classifiers
Tung, L. N., Cho, S. B., Du, X., Neelofar, N., Terragni, V., Ruberto, S., & Aleti, A. (2025) · Proceedings of the ACM on software engineering. · doi:10.1145/3729376 · Cited by 8
Artificial Intelligence Accelerators
Mishra, A., Yadav, P., & Kim, S. (2023) · Springer eBooks · doi:10.1007/978-3-031-22170-5_1 · Cited by 4
VIVA: Visual Exploration and Analysis of Videos with Interactive Annotation
Ruangrotsakun, A., Oh, D., Nguyen, T.-V. T., Lee, K., Ser, M., Hiew, A., Ngo, R., Shureih, Z., Khanna, R., & Kahng, M. (2023) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3581754.3584160 · Cited by 4
Alharbi, R., Cheong, A. D., Herskovitz, J., Brewer, R. N., & Schoenebeck, S. (2025) · Proceedings of the 27th International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/3663547.3746376 · Cited by 3
Umamaheswari, U., Mamidi, P. L., Nimma, D., Venkateswarlu, D., Ansari, M. S. A., & Ponni Valavan, M. (2024) · IEEE International Conference on Green Industrial Electronics and Sustainable Technologies (GIEST) · doi:10.1109/giest62955.2024.10960251 · Cited by 4
Wu, H., Li, B., Tian, L., Dong, C., & Liao, W. (2025) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2025.111009 · Cited by 2
The Enterprising and Elusive Prospects of Human-AI Collaboration
Gadiraju, U., & Balayn, A. (2025) · Springer eBooks · doi:10.1007/978-3-032-01940-0_7 · Cited by 5
An Empirical Examination of the Evaluative AI Framework
Kornowicz, J. (2025) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2025.2581260 · Cited by 3
DALEK: combining deep active learning and explanations methods for fake news detection on COVID-19
Comito, C., Guarascio, M., Liguori, A., & Pisani, F. S. (2026) · Neural Computing and Applications · doi:10.1007/s00521-025-11830-1 · Cited by 2
Papakostas, C. (2026) · Discover Education · doi:10.1007/s44217-026-01469-y · Cited by 2
Araujo, T. (2026) · AI & Society · doi:10.1007/s00146-026-03279-0 · Cited by 3
Metadata
- Authors
- Ghai, B., Liao, Q. V., Zhang, Y., Bellamy, R., & Mueller, K.
- Affiliations
- Stony Brook University (US)
- IBM (United States) (US)
- Venue
- Proceedings of the ACM on Human-Computer Interaction
- Published
- 2021-01-05
- Volume
- 4
- Issue
- CSCW3
- Pages
- 1-28
- ISSN
- 2573-0142 (ISSN-L)
- OpenAlex
- W3120532656
- Cited by
- 106
- References
- 95
- Citations by year
- 2026: 12 · 2025: 24 · 2024: 21 · 2023: 25 · 2022: 9 · 2021: 15
- FWCI
- 6.19
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Proceedings of the ACM on Human-Computer Interaction (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Algorithms
- Physical Sciences › Computer Science › Artificial Intelligence › Intelligent Tutoring Systems and Adaptive Learning
- Keywords
- explainable AI, machine teaching, human-AI interface, AI explanations, active learning (machine learning), trust calibration, teacher feedback, anchoring effect, mental workload, need for cognition, AI experience, task knowledge, human-in-the-loop learning
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.