Explainable Active Learning (XAL): Toward AI Explanations as Interfaces for Machine Teachers
The DOI matches its Crossref record; 97 of the 97 references it cites were found in a registry or an index.
Abstract
The wide adoption of Machine Learning (ML) technologies has created a growing demand for people who can train ML models. Some advocated the term "machine teacher'' to refer to the role of people who inject domain knowledge into ML models. This "teaching'' perspective emphasizes supporting the productivity and mental wellbeing of machine teachers through efficient learning algorithms and thoughtful design of human-AI interfaces. One promising learning paradigm is Active Learning (AL), by which the model intelligently selects instances to query a machine teacher for labels, so that the labeling workload could be largely reduced. However, in current AL settings, the human-AI interface remains minimal and opaque. A dearth of empirical studies further hinders us from developing teacher-friendly interfaces for AL algorithms. In this work, we begin considering AI explanations as a core element of the human-AI interface for teaching machines. When a human student learns, it is a common pattern to present one's own reasoning and solicit feedback from the teacher. When a ML model learns and still makes mistakes, the teacher ought to be able to understand the reasoning underlying its mistakes. When the model matures, the teacher should be able to recognize its progress in order to trust and feel confident about their teaching outcome. Toward this vision, we propose a novel paradigm of explainable active learning (XAL), by introducing techniques from the surging field of explainable AI (XAI) into an AL setting. We conducted an empirical study comparing the model learning outcomes, feedback content and experience with XAL, to that of traditional AL and coactive learning (providing the model's prediction without explanation). Our study shows benefits of AI explanation as interfaces for machine teaching--supporting trust calibration and enabling rich forms of teaching feedback, and potential drawbacks--anchoring effect with the model judgment and additional cognitive workload. Our study also reveals important individual factors that mediate a machine teacher's reception to AI explanations, including task knowledge, AI experience and Need for Cognition. By reflecting on the results, we suggest future directions and design implications for XAL, and more broadly, machine teaching through AI explanations.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The authors suggest two types of human intuition useful for detecting model errors-intuition about feature relevance and intuition about feature mechanism (e.g., weight), which align with prior findings about how experts critique model explanations in interactive ML settings [33,75].”
From Understanding the Role of Human Intuition on Reliance in Human-AI Decision-Making with Explanations (2023) · cites this paper as [33]
In the citing paper
“Some user groups are more vulnerable to these harms than others, such as AI novices [60], people working in cognitively constrained settings [52], and even those with certain personality traits [17].”
From Designing for Responsible Trust in AI Systems: A Communication Perspective (2022) · cites this paper as [17]
In the citing paper
“For example, recent studies have repeatedly found that XAI features bring less benefit, or even harms (leading to over-trust), to certain user groups such as AI novices or users working in cognitively constrained settings [17, 52, 60].”
From Designing for Responsible Trust in AI Systems: A Communication Perspective (2022) · cites this paper as [17]
In the citing paper
“This task is suitable for our study since it requires little domain expertise and imposes relatively limited risks, and thus is amenable for non-expert participants [39].”
From Who Should I Trust: AI or Myself? Leveraging Human and AI Correctness Likelihood to Promote Appropriate Trust in AI-Assisted Decision-Making (2023) · cites this paper as [39]
Citations
Cites
A Unified Approach to Interpreting Model Predictions
Lundberg, S., & Lee, S.-I. (2017) · arXiv · doi:10.48550/arxiv.1705.07874 · Cited by 23,707 · cited 3×
“[62, 72]) is a cluster of XAI techniques that explain how the model arrived at a particular decision.”
BackgroundMethod"Why Should I Trust You?": Explaining the Predictions of Any Classifier
Ribeiro, M. T., Singh, S., & Guestrin, C. (2016) · Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2939672.2939778 · Cited by 17,555
Developing and validating trust measures for e-commerce: an integrative typology
McKnight, D. H., Choudhury, V., & Kacmar, C. (2002) · Information Systems Research · doi:10.1287/isre.13.3.334.81 · Cited by 5,550 · cited 3×
“Trust in technologies is frequently measured based on McKnight’s framework on Trust [63, 64], which considers the dimensions of capability, benevolence, integrity for trust belief, and multiple actionbased items (e.”
MethodInfluentialLipton, Z. C. (2018) · Queue · doi:10.1145/3236386.3241340 · Cited by 5,427 · cited 3×
“The first two categories, model and outcome explanations, are also referred as global and local explanations [6, 59, 66].”
BackgroundCacioppo, J. T., & Petty, R. E. (1982) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.42.1.116 · Cited by 5,359 · cited 2×
“We also explore the effect of Need for cognition [12], defined as an individual’s tendency to engage in thinking or complex cognitive activities.”
BackgroundMethod(2009) · Minds at UW (University of Wisconsin) · Cited by 4,791
Towards A Rigorous Science of Interpretable Machine Learning
Doshi-Velez, F., & Kim, B. (2017) · arXiv · doi:10.48550/arxiv.1702.08608 · Cited by 3,121 · cited 4×
“While Machine Learning technologies are increasingly used in a wide variety of domains ranging from critical systems to everyday consumer products, currently only a small group of people with formal training possess the skills to develop these technologies.”
BackgroundMethodInfluentialIBM computer usability satisfaction questionnaires: Psychometric evaluation and instructions for use
Lewis, J. R. (1995) · International Journal of Human-Computer Interaction · doi:10.1080/10447319509526110 · Cited by 2,429 · cited 2×
“Satisfaction of the annotation experience, by five items adapted from After-Scenario Questionnaire [54] and User Engagement Scale [68] (e.”
MethodAnchors: High-Precision Model-Agnostic Explanations
Ribeiro, M. T., Singh, S., & Guestrin, C. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11491 · Cited by 2,162 · cited 1×
“Other design choices for local explanations include presenting similar examples with the same known outcome [9, 37], and rules that the model believes to guarantee the prediction [73] (e.”
BackgroundMachine Learning Interpretability: A Survey on Methods and Metrics
Carvalho, D. V., Pereira, E. M., & Cardoso, J. S. (2019) · Electronics · doi:10.3390/electronics8080832 · Cited by 1,842 · cited 3×
“Common goals of AI explanations, as reflected in much of the XAI literature, are to support a complete and sound understanding of the model [16, 48], and to foster trust in the AI [19, 69].”
Background
Research works printed but not linked: 13
- David A. Anisi . 2003. Optimal Motion Control of a Ground Vehicle. Master's thesis . Royal Institute of Technology (KTH) , Stockholm, Sweden . David A. Anisi. 2003. Optimal Motion Control of a Ground Vehicle. Master's thesis. Royal Institute of Technology (KTH), Stockholm, Sweden.
- Vijay Arya , Rachel KE Bellamy , Pin-Yu Chen, Amit Dhurandhar, Michael Hind, Samuel C Hoffman, Stephanie Houde, Q Vera Liao, Ronny Luss, Aleksandra Mojsilović, et almbox. 2019 . One Explanation Does Not Fit All: A Toolkit and Taxonomy of AI Explainability Techniques . arXiv preprint arXiv:1909.03012 (2019). Vijay Arya, Rachel KE Bellamy, Pin-Yu Chen, Amit Dhurandhar, Michael Hind, Samuel C Hoffman, Stephanie Houde, Q Vera Liao, Ronny Luss, Aleksandra Mojsilović, et almbox. 2019. One Explanation Does Not Fit All: A Toolkit and Taxonomy of AI Explainability Techniques. arXiv preprint arXiv:1909.03012 (2019). · arXiv
- 10.1037/0022-3514.45.4.805 · doi:10.1037/0022-3514.45.4.805 · Paper page
- Tathagata Chakraborti , Sarath Sreedharan , and Subbarao Kambhampati . 2020. The Emerging Landscape of Explainable AI Planning and Decision Making. arXiv preprint arXiv:2002.11697 ( 2020 ). Tathagata Chakraborti, Sarath Sreedharan, and Subbarao Kambhampati. 2020. The Emerging Landscape of Explainable AI Planning and Decision Making. arXiv preprint arXiv:2002.11697 (2020). · arXiv
- Sophie Chou , William Li , and Ramesh Sridharan . 2014 . Democratizing data science . In Proceedings of the KDD 2014 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining , New York, NY, USA. Citeseer, 24--27. Sophie Chou, William Li, and Ramesh Sridharan. 2014. Democratizing data science. In Proceedings of the KDD 2014 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, New York, NY, USA. Citeseer, 24--27.
- Karthik S Gurumoorthy , Amit Dhurandhar , and Guillermo Cecchi . 2017 . Protodash: Fast interpretable prototype selection. arXiv preprint arXiv:1707.01212 (2017). Karthik S Gurumoorthy, Amit Dhurandhar, and Guillermo Cecchi. 2017. Protodash: Fast interpretable prototype selection. arXiv preprint arXiv:1707.01212 (2017). · arXiv
- 10.1037/0022-3514.63.2.308 · doi:10.1037/0022-3514.63.2.308 · Paper page
- David D Lewis and William A Gale . 1994 b. A sequential algorithm for training text classifiers . In SIGIR?94 . Springer , 3--12. David D Lewis and William A Gale. 1994 b. A sequential algorithm for training text classifiers. In SIGIR?94. Springer, 3--12.
- 10.5555/1613715.1613855 · doi:10.5555/1613715.1613855
- 10.5555/2831071.2831072 · doi:10.5555/2831071.2831072
- Patrice Y Simard , Saleema Amershi , David M Chickering , Alicia Edelman Pelton , Soroush Ghorashi, Christopher Meek, Gonzalo Ramos, Jina Suh, Johan Verwey, Mo Wang, et almbox. 2017 . Machine teaching: A new paradigm for building machine learning systems. arXiv preprint arXiv:1707.06742 (2017). Patrice Y Simard, Saleema Amershi, David M Chickering, Alicia Edelman Pelton, Soroush Ghorashi, Christopher Meek, Gonzalo Ramos, Jina Suh, Johan Verwey, Mo Wang, et almbox. 2017. Machine teaching: A new paradigm for building machine learning systems. arXiv preprint arXiv:1707.06742 (2017). · arXiv
- Simone Stumpf , Adrian Bussone , and Dympna O?sullivan. 2016 . Explanations considered harmful? user interactions with machine learning systems . In Proceedings of the ACM SIGCHI Conference on Human Factors in Computing Systems (CHI) . Simone Stumpf, Adrian Bussone, and Dympna O?sullivan. 2016. Explanations considered harmful? user interactions with machine learning systems. In Proceedings of the ACM SIGCHI Conference on Human Factors in Computing Systems (CHI) .
- Richard Tomsett , Dave Braines , Dan Harborne , Alun Preece , and Supriyo Chakraborty . 2018. Interpretable to whom? A role-based model for analyzing interpretable machine learning systems. arXiv preprint arXiv:1806.07552 ( 2018 ). Richard Tomsett, Dave Braines, Dan Harborne, Alun Preece, and Supriyo Chakraborty. 2018. Interpretable to whom? A role-based model for analyzing interpretable machine learning systems. arXiv preprint arXiv:1806.07552 (2018). · arXiv
Cited by
Items 101–135 of 135
Speeding Things Up. Can Explainability Improve Human Learning?
Mannmeusel, J., Rothfelder, M., & Khoshrou, S. (2023) · Communications in computer and information science · doi:10.1007/978-3-031-44064-9_4 · Cited by 2
Schöne, M., Jaster, B., Bültemeier, J., Kösters, J., Holst, C., & Kohlhase, M. (2025) · IEEE Symposium on Trustworthy, Explainable and Responsible Computational Intelligence (CITREx) · doi:10.1109/citrex64975.2025.10974940 · Cited by 2
LIFEDATA - A Framework for Traceable Active Learning Projects
Stieler, F., Elia, M., Weigell, B., Bauer, B., Kienle, P., Roth, A., Müllegger, G., Nann, M., & Dopfer, S. (2023) · 2023 IEEE 31st International Requirements Engineering Conference Workshops (REW) · doi:10.1109/rew57809.2023.00088 · Cited by 2
Molladavoudi, S., & Yung, W. (2023) · AStA Wirtschafts- und Sozialstatistisches Archiv · doi:10.1007/s11943-023-00331-z · Cited by 4
“Therefore, explainable active learning Ghai et al. (2021); Fadel and Trottier (2023) can be an essential application of the explainable ML models to support the creation and validation of quality labeled data by providing the human subject-matter experts the feature importance and contributions in…”
Explainable Artificial Intelligence (XAI) with Applications
Chen, T. (2024) · SpringerBriefs in applied sciences and technology · doi:10.1007/978-3-031-54935-9_2 · Cited by 3
Haghbin, M., Jalón, M. L., Díaz-Rodríguez, N., & Chiachío, J. (2025) · Open Research Europe · doi:10.12688/openreseurope.20195.1 · Cited by 2
Active Learning++: Incorporating Annotator's Rationale using Local Model ExplanationPreprint
Ghai, B., Liao, Q. V., Zhang, Y., & Mueller, K. D. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2009.04568 · Cited by 2
Self-citationBiasing Rule-Based Explanations Towards User Preferences
Mahya, P., & Fürnkranz, J. (2025) · Information · doi:10.3390/info16070535 · Cited by 2
Visual Quality Control via eXplainable AI and the Case of Human in the AI Loop
Emmanouilidis, C., & Rica, E. (2023) · Lecture notes in mechanical engineering · doi:10.1007/978-3-031-25448-2_24 · Cited by 1
Enhancing Surrogate Decision Trees for Reinforcement Learning with Feature Importance Matrices
Lavender, B., & Sen, S. (2025) · Lecture notes in computer science · doi:10.1007/978-3-032-01399-6_1 · Cited by 1
Chen, J. (2025) · Advances in Economics and Management Research · doi:10.56028/aemr.15.1.45.2025 · Cited by 1
Source camera attribution using a rule-based explainable convolutional neural network
Nayerifard, T., Amintoosi, H., & Bafghi, A. G. (2026) · Scientific Reports · doi:10.1038/s41598-026-40387-9 · Cited by 5
Raees, M., & Papagelis, K. (2026) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3772363.3798834 · Cited by 1
UntrustVul: Automated Untrustworthy Alert Identification in Vulnerability Detection Models
Tung, L. N., Du, X., Neelofar, N., & Aleti, A. (2026) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2026.3693636 · Cited by 1
Machine Learned KPI Goal Preferences for Explainable AI based Production Sequencing
Felix, R. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-46781-3_8 · Cited by 1
Active Learning for Image Classification: A Comprehensive Analysis in Agriculture
Flores, C. A., Valenzuela, A. I., & Verschae, R. (2024) · Lecture notes in networks and systems · doi:10.1007/978-981-97-5441-0_49 · Cited by 1
Kage, P., & Andreadis, P. (2021) · Edinburgh Research Explorer (University of Edinburgh) · doi:10.48550/arxiv.2107.01657 · Cited by 3
Bertrand, A. (2024) · theses.fr (ABES) · doi:10.70675/216d3647z78bcz4c68z9ba9z2d0a029cf1b4 · Cited by 8
Accountable Error Characterization
Misra, A., Liu, Z., & Mahmud, J. (2021) · Workshop on Trustworthy Natural Language Processing (TrustNLP) · doi:10.18653/v1/2021.trustnlp-1.4 · Cited by 1
Model-Agnostic Visual Explanations via Approximate Bilinear Models
Joukovsky, B., Sammani, F., & Deligiannis, N. (2023) · Proceedings - International Conference on Image Processing · doi:10.1109/icip49359.2023.10222440
Explainable Interactive Machine Learning Using Prototypical Part Networks for Medical Image Analysis
Parise, A., & Namee, B. M. (2024) · Frontiers in artificial intelligence and applications · doi:10.3233/faia240214
Explainable deep learning models for smart meter data
Thurakit, P., & Stanković, V. (2023) · Asia-Pacific Power and Energy Engineering Conference (APPEEC) · doi:10.1109/appeec57400.2023.10562025
Füßl, A., & Nissen, V. (2025) · Forum Dienstleistungsmanagement · doi:10.1007/978-3-658-48325-8_13 · Cited by 1
Lu, M. (2025) · Applied and Computational Engineering · doi:10.54254/2755-2721/2025.ld25048
Explainable AI Principles of Building Industry 4.0
Sanjana, N., Immanual, R., Kirthika, K. M., & Sangeetha, S. (2025) · Information systems engineering and management · doi:10.1007/978-3-031-94637-0_2
Active and Incremental Deep learning with class imbalanced data
Aggarwal, U. (2022) · theses.fr (ABES) · doi:10.70675/e6d51380zef20z4bd7z85eez594673d44967 · Cited by 1
Vereschak, O. (2022) · theses.fr (ABES) · doi:10.70675/7ecd53bfza7ccz4edfz8f1azdb8052ba1233 · Cited by 2
Wondimu, N. (2023) · theses.fr (ABES) · doi:10.70675/62992609z895bz4aa6z8f4fzd298df4375fc
Trust Without Understanding: A Case Study of Industrial Computer Vision in Protein Processing
Joyce, E. C., & Nabrzyski, J. (2026) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3772363.3798671
From Expectation to Evaluation: Expectation Cues Systematically Bias LLM and Human Judgment
Sun, Y., Dillion, D., Gray, K. J., Lyu, M., Zhang, Z., & Li, F. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3790492 · Cited by 2
Füßl, A., & Nissen, V. (2026) · Contributions to management science · doi:10.1007/978-3-032-17384-3_13
The Consensus Trap: Dissecting Subjectivity and the “Ground Truth” Illusion in Data Annotation
Munir, S., Mah, B., Kalsi, K., Kapania, S., Posada, J., Law, E., Wang, D., & Ahmed, S. I. (2026) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3805689.3806510 · Cited by 5
Fiebrink, R., Gillies, M. F. P., & Ramos, G. (2026) · Cambridge University Press eBooks · doi:10.1017/9781108872225.010
Costa, G. N., Paola, A. D., Drago, S., Ferraro, P., & Re, G. L. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-40774-0_14
Kontogiorgos, D., Gustafson, J., & Shah, J. (2026) · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · doi:10.1145/3776574.3831198
Metadata
- Authors
- Ghai, B., Liao, Q. V., Zhang, Y., Bellamy, R., & Mueller, K.
- Affiliations
- Stony Brook University (US)
- IBM (United States) (US)
- Venue
- Proceedings of the ACM on Human-Computer Interaction
- Published
- 2021-01-05
- Volume
- 4
- Issue
- CSCW3
- Pages
- 1-28
- ISSN
- 2573-0142 (ISSN-L)
- OpenAlex
- W3120532656
- Cited by
- 106
- References
- 95
- Citations by year
- 2026: 12 · 2025: 24 · 2024: 21 · 2023: 25 · 2022: 9 · 2021: 15
- FWCI
- 6.19
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Proceedings of the ACM on Human-Computer Interaction (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Algorithms
- Physical Sciences › Computer Science › Artificial Intelligence › Intelligent Tutoring Systems and Adaptive Learning
- Keywords
- explainable AI, machine teaching, human-AI interface, AI explanations, active learning (machine learning), trust calibration, teacher feedback, anchoring effect, mental workload, need for cognition, AI experience, task knowledge, human-in-the-loop learning
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.