The DOI matches its DataCite record; 44 of the 46 references it cites were found in a registry or an index; none of the 35 sources its claims cite is checked for support yet.
One Explanation Does Not Fit All: A Toolkit and Taxonomy of AI Explainability Techniques
Open accessAbstract
As artificial intelligence and machine learning algorithms make further inroads into society, calls are increasing from multiple stakeholders for these algorithms to explain their outputs. At the same time, these stakeholders, whether they be affected citizens, government regulators, domain experts, or system developers, present different requirements for explanations. Toward addressing these needs, we introduce AI Explainability 360 (http://aix360.mybluemix.net/), an open-source software toolkit featuring eight diverse and state-of-the-art explainability methods and two evaluation metrics. Equally important, we provide a taxonomy to help entities requiring explanations to navigate the space of explanation methods, not only those in the toolkit but also in the broader literature on explainability. For data scientists and other users of the toolkit, we have implemented an extensible software architecture that organizes methods according to their place in the AI modeling pipeline. We also discuss enhancements to bring research innovations closer to consumers of explanations, ranging from simplified, more accessible versions of algorithms, to tutorials and an interactive web demo to introduce AI explainability to different audiences and application domains. Together, our toolkit and taxonomy can help identify gaps where more explainability methods are needed and provide a platform to incorporate them as they are developed.
Overview
AI snapshot
Written from the paper’s full text.
TL;DR
The paper introduces AI Explainability 360 (AIX360), an open-source toolkit with eight explainability algorithms and two evaluation metrics, plus a taxonomy to help different explanation consumers choose methods. It describes algorithmic enhancements, educational materials, and comparisons showing BRCG-light trades accuracy for reduced computation.
Key findings
- AIX360 contains eight explainability algorithms—BRCG, GLRM, ProtoDash, ProfWeight, TED, CEM, CEM-MAF, and DIP-VAE—and two metrics, Faithfulness and Monotonicity.
- The proposed taxonomy organizes explanations by static/interactive, data/model, local/global, direct/post-hoc, and other distinctions; Table 1 indicates AIX360 uniquely covers data explanations, directly interpretable methods, local post-hoc, global post-hoc, persona-specific explanations, and metrics among the compared toolkits.
- BRCG-light replaces integer programming with beam search; on 15 datasets, it is worse on average than BRCG-IP but better than BRS, AM, and BCD, and beam width B=5 gives better results than smaller widths on most datasets, particularly larger ones.
- The TED employee-retention synthetic dataset has 10,000 entries, 8 features, 25 rules, and a feature space of over 80 million possibilities; the toolkit also includes a FICO-based web demo, five tutorials, and 13 Jupyter notebooks.
Methods
- Design: proposes a taxonomy decision tree and implements an extensible Python class hierarchy organized by the AI modeling pipeline, including data explainers, directly interpretable explainers, local post-hoc explainers, and global post-hoc explainers.
- Data or sample: BRCG-light is evaluated on the same 15 datasets as [17]; the TED use case uses a synthetic employee-retention dataset with 10,000 entries; the web demo uses the FICO Explainable Machine Learning Challenge dataset, and tutorials cover credit approval, healthcare cost prediction, dermoscopic images, NHANES data, and employee retention.
- Main analysis: descriptive toolkit comparison in Table 1 and accuracy-complexity trade-off curves for BRCG-light versus BRCG-IP, BRS, AM, and BCD; no formal user study is reported in the text.
Limitations
- The paper states the taxonomy is “by no means” claimed to be perfect or complete, and the toolkit lacks methods in three taxonomy categories marked with “?”: interactive, static → data → distributions, and static → model → global → post-hoc → visualize.
- The paper states BRCG-light is inferior to BRCG-IP on average, and that if beam search fails to find a negative-objective solution, it cannot certify that none exists, unlike integer programming run to completion.
- The paper states explanations are difficult to quantitatively evaluate, human evaluation is the gold standard, and the two included metrics are proxies and not novel; evident from the text, the toolkit and taxonomy are evaluated mainly through descriptive comparison and trade-off curves rather than user studies.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
34 Own interpretation · 22 No basis given · 20 Not checked yet · 13 Own result
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“we introduce AI Explainability 360 1 , an open-source software toolkit featuring eight diverse and state-of-the-art explainability methods and two evaluation metrics.”
- Also stated in: § 1 INTRODUCTION · p. 2 · plain
“The current version of the toolkit contains eight explainability algorithms:”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § 1 INTRODUCTION · p. 2 · plain
None of the sources cited for this claim have been checked yet.
In the paper
“two evaluation metrics”
- Also stated in: § 1 INTRODUCTION · p. 2 · plain
“The toolkit also includes two metrics from the explainability literature: Faithfulness [12] and Monotonicity [41].”
What the sources say
- Not checked yetcites [12] [12] D. Alvarez Melis and T. Jaakkola. Towards robust interpretability with selfexplaining neural networks. In S. Bengio, H. Wallach, H. Larochelle, K. Grauman, N. Cesa-Bianchi, and R. Garnett, editors, Advances in Neural Information Processing Systems 31 , pages 7775-7784. 2018. -
- Not checked yetcites [41] [41] R. Luss, P.-Y. Chen, A. Dhurandhar, P. Sattigeri, K. Shanmugam, and C.-C. Tu. Generating contrastive explanations with monotonic attribute functions. 2019. -
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § 1 INTRODUCTION · p. 2 · plain
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“It is the most comprehensive explainability toolkit across different ways of explaining (see Table 1 and Section 5).”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“we have implemented an extensible software architecture that organizes methods according to their place in the AI modeling pipeline.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“we introduce AI Explainability 360 1 , an open-source software toolkit featuring eight diverse and state-of-the-art explainability methods and two evaluation metrics.”
- Also stated in: § One Explanation Does Not Fit All: A Toolkit and Taxonomy of AI Explainability Techniques · p. 1 · plain
“We have released the toolkit into the open source community under the name AI Explainability 360 (AIX360).”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § One Explanation Does Not Fit All: A Toolkit and Taxonomy of AI Explainability Techniques · p. 1 · plain
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“resulting in a feature space of over 80 million possibilities.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In particular, a beam search width of 5 (the default in AIX360) gives better results than smaller widths on most datasets.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“In the AIX360 toolkit we add another layer of interpretability by also discerning features that are important in more easily interpreting the output.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“the AIX360 toolkit provides two quantitative metrics that serve as proxies of how 'good' a particular feature-based local explanation is likely to be.”
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“In AIX360, we have made the above suggestion a reality by equipping GLRM models with the ability to visualize the GAM part of the model.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Probably not a substantial claim. 54
- It may state two separate claims as one. 20
- The quote only partly states this claim. 2
In the paper
“Again, we do not claim that this is a complete listing, although most of the methods reviewed by Guidotti et al. [25] are included.”
What the sources say
- Not checked yetcites [25] [25] R. Guidotti, A. Monreale, S. Ruggieri, F. Turini, F. Giannotti, and D. Pedreschi. A survey of methods for explaining black box models. ACM computing surveys (CSUR) , 51(5):93, 2018. -
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“These educational materials include a general guidance for the key concepts of explainability, a web demo that illustrates the usage of different explainability methods, and multiple tutorials.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“The decision tree leaves indicate the methods currently available through the toolkit along with the modalities they can work with.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“AIX360 focuses on static explanations, like much of the literature to date.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“The web demo was created based on the FICO Explainable Machine Learning Challenge dataset [22], a real-world scenario where a machine learning system is used to support decisions on loan applications by predicting the repayment risk of the applicants.”
What the sources say
- Not checked yetcites [22] [22] FICO. FICO Explainable Machine Learning Challenge. https://community.fico. com/s/explainable-machine-learning-challenge, 2018. Last accessed 2019-08. -
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“These comparisons show that BRCG-light occupies an intermediate position, inferior to BRCG-IP as may be expected, but superior to the earlier methods.”
hedgedcorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“AIX360 contains such a dataset for employee retention with 10,000 entries, created by an available python script that can be modified by changing the distribution of features, changing the rules, or the size of the dataset.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“AIX360 was developed with the goal of providing accessible resources on explainability to non-technical stakeholders.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“We created 25 rules, motivated by common retention scenarios, such as not getting a promotion in a while, not being paid competitively, receiving a disappointing evaluation, being a new employee in organizations with inherently high attrition, not having a salary that is consistent with positive evaluations, mid-career crisis, etc.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. The quote only partly states this claim.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The leaves in the decision tree are labeled with algorithms in the AIX360 toolkit or a question mark ('?') if the category is not represented in the current toolkit.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“In AIX360, we have replaced the integer programming components with a heuristic beam search algorithm and have modified the problem formulation accordingly.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In the current implementation of this use case, we further vary the application of these rules depending on various positions and organizations.”
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“The modules implementing GLRM follow [59] plus the enhancement of Section 4.3 below while the module implementing BRCG-light is novel.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In addition to the above base classes, AIX360 includes dataset classes to facilitate loading and processing of commonly used datasets so that users can easily experiment with the implemented algorithms.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“We created 25 rules, motivated by common retention scenarios, such as not getting a promotion in a while, not being paid competitively, receiving a disappointing evaluation, being a new employee in organizations with inherently high attrition, not having a salary that is consistent with positive evaluations, mid-career crisis, etc.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“The proposed taxonomy based on questions about what is explained (e.g., data or model), how it is explained (e.g., direct/post-hoc, static/interactive) and at what level (i.e. local/global).”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“These are indicated in Figure 1 by '?' in three cases: interactive, static → data → distributions, and static → model → global → post-hoc → visualize.”
plainn = 3- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“We have also provided a simple yet comprehensive taxonomy that structures the explainability space and serves multiple purposes, including guiding practitioners, revealing algorithmic gaps to researchers, and informing design choices related to explainability software (e.g., class hierarchy) for data scientists and developers.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“The AIX360 toolkit currently includes five tutorials in the form of Jupyter notebooks that show data scientists and other developers how to use different explanation methods across several application domains.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Preliminary work in this direction was initiated in AIX360 by defining a class for Keras-based classifiers that is utilized by CEMExplainer and CEMMAFImageExplainer.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Some of the algorithms were enhanced from their published versions for AIX360 to make them more usable and their outputs easier to consume.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The toolkit also contains two explainability metrics, a credit approval demonstration, five elaborate tutorials covering different real-world use cases, and 13 Jupyter notebooks, making it accessible to practitioners and non-experts.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Overall, the comparisons show that BRCG-light provides trade-offs that are worse on average than BRCG-IP, as may be expected given the dramatic reduction in computation, but better than the other methods.”
hedgedcorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“AIX360 also targets industry-specific users with the tutorials and web demo in Section 4.6.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“The AIX360 toolkit solicits contributions related to explainable AI to enable it to grow.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Since there is no single approach to explainable AI that always works best, we require organizing principles for the space of possibilities and tools that bridge the gap from research to practice.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper may give no reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Equally important, we provide a taxonomy to help entities requiring explanations to navigate the space of explanation methods, not only those in the toolkit but also in the broader literature on explainability.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“different people in different settings may require different kinds of explanations.”
- Also stated in: § ABSTRACT · p. 1 · plain
“these stakeholders, whether they be affected citizens, government regulators, domain experts, or system developers, present different requirements for explanations.”
plainconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
- Also stated in: § ABSTRACT · p. 1 · plain
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“We show that the taxonomy in Figure 1 allows different consumers to navigate the space of explanations and find the right algorithm or class of algorithms appropriate for their task.”
boosteddirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper may give no reason why it holds.
None of the sources cited for this claim have been checked yet.
In the paper
“Knowledge distillation-type approaches [13, 14, 31], which learn a simpler model based on a complex model's predictions, would be considered as global interpretations that are learned using a post-hoc surrogate model.”
What the sources say
- Not checked yetcites [13] [13] L. J. Ba and R. Caurana. Do deep nets really need to be deep? CoRR , abs/1312.6184, 2013. -
- Not checked yetcites [14] [14] C. Buciluˇ a, R. Caruana, and A. Niculescu-Mizil. Model compression. In Proceedings of the 12th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining , 2006. -
- Not checked yetcites [31] [31] G. Hinton, O. Vinyals, and J. Dean. Distilling the knowledge in a neural network. In https://arxiv.org/abs/1503.02531 , 2015. -
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The benefit of having a GAM is that it can be visualized as a series of plots of the functions f j , thus summarizing the effects of all first-degree rules and linear terms.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“GLRM models can therefore be interpreted like linear models and their constituent rules are also readily understood individually.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“A PP informs us of what minimal values for different features not exceeding those in x would be sufficient to obtain the same prediction y .”
What the sources say
- Not checked yetcites [18] [18] A. Dhurandhar, P.-Y. Chen, R. Luss, C.-C. Tu, P. Ting, K. Shanmugam, and P. Das. Explanations based on the missing: Towards contrastive explanations with pertinent negatives. In Advances in Neural Information Processing Systems , 2018. -
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This taxonomy is actionable in that it aids users in choosing an approach for a given application and may also reveal gaps in available explainability techniques.”
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper may give no reason why it holds. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“If the features are (independent) positively correlated with the decision, then the class probabilities should monotonically increase.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper may give no reason why it holds.
None of the sources cited for this claim have been checked yet.
In the paper
“Work in the natural language processing and computer vision domains that generates rationales/explanations derived from input text [11, 28, 39] would be considered as local self explanations.”
What the sources say
- Not checked yetcites [11] [11] Y. Ainur, Y. Choi, and C. Cardie. Automatically generating annotator rationales to improve sentiment classification. In Proceedings of the ACL 2010 Conference Short Papers , 2010. -
- Not checked yetcites [28] [28] L. A. Hendricks, Z. Akata, M. Rohrbach, J. Donahue, B. Schiele, and T. Darrell. Generating visual explanations. In European Conference on Computer Vision , 2016. -
- Not checked yetcites [39] [39] T. Lei, R. Barzilay, and T. Jaakkola. Rationalizing neural predictions. arXiv preprint arXiv:1606.04155 , 2016. -
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Together, our toolkit and taxonomy can help identify gaps where more explainability methods are needed and provide a platform to incorporate them as they are developed.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence. The paper may give no reason why it holds. It may state two separate claims as one.
In the paper
“Nevertheless, the discussion in [59, Sec. 6] as well as our experience in putting together the AIX360 web demo and tutorials (Section 4.6) raise the question of the degree to which a GLRM model with (say) tens of rules is interpretable. While interpretation is still feasible, it may require a non-trivial investment of effort.”
What the sources say
- Not checked yetcites [59] [59] D. Wei, S. Dash, T. Gao, and O. Günlük. Generalized linear rule models. In Proceedings of the 36th International Conference on Machine Learning (ICML) , 2019. -
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
None of the sources cited for this claim have been checked yet.
In the paper
“Methods that propose certain restrictions on the neural network architecture [12, 62] to make it interpretable, yet maintain richness of the hypothesis space to model complicated decision boundaries would fall under the global directly interpretable category.”
What the sources say
- Not checked yetcites [12] [12] D. Alvarez Melis and T. Jaakkola. Towards robust interpretability with selfexplaining neural networks. In S. Bengio, H. Wallach, H. Larochelle, K. Grauman, N. Cesa-Bianchi, and R. Garnett, editors, Advances in Neural Information Processing Systems 31 , pages 7775-7784. 2018. -
- Not checked yetcites [62] [62] Q. Zhang, Y. N. Wu, and S.-C. Zhu. Interpretable convolutional neural networks. In Proceedings of Computer Vision and Pattern Recognition , 2018.
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“The second metric is Monotonicity [41], which simply tries to measure if adding more positive evidence increases the probability of classification in the specified class.”
What the sources say
- Not checked yetcites [41] [41] R. Luss, P.-Y. Chen, A. Dhurandhar, P. Sattigeri, K. Shanmugam, and C.-C. Tu. Generating contrastive explanations with monotonic attribute functions. 2019. -
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The intuition is that removing more important features should reduce the confidence of the classifier more than removing less important ones.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“The first metric we implement is a version of the Faithfulness metric [12], which tries to evaluate if the feature importances returned by an explainability method are the correct ones.”
What the sources say
- Not checked yetcites [12] [12] D. Alvarez Melis and T. Jaakkola. Towards robust interpretability with selfexplaining neural networks. In S. Bengio, H. Wallach, H. Larochelle, K. Grauman, N. Cesa-Bianchi, and R. Garnett, editors, Advances in Neural Information Processing Systems 31 , pages 7775-7784. 2018. -
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Higher-degree rules, which do involve feature interactions, can then be studied separately.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. The quote only partly states this claim.
None of the sources cited for this claim have been checked yet.
In the paper
“Saliency based methods [51, 52], which highlight different portions in an image whose classification we want to understand, can be categorized as local explanation methods that are static and provide feature-based explanations in terms of highlighting pixels/superpixels.”
What the sources say
- Not checked yetcites [51] [51] R. R. Selvaraju, M. Cogswell, A. Das, R. Vedantam, D. Parikh, and D. Batra. Gradcam: Visual explanations from deep networks via gradient-based localization. See https://arxiv. org/abs/1610.02391 v3 , 2016. -
- Not checked yetcites [52] [52] K. Simonyan, A. Vedaldi, and A. Zisserman. Deep inside convolutional networks: Visualising image classification models and saliency maps. CoRR , abs/1312.6034, 2013. -
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The above equation creates a feature importance value in [ 0 , 1 ] . The higher the value more similar the feature and hence higher its importance.”
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
In the paper
“Methods such as partial dependence plots (PDP) and sensitivity analysis [43] are used to study the (global) effects of different input features on the output values and are typically consumed through appropriate visualizations (e.g., PDP plots, scatter plots, control charts).”
What the sources say
- Not checked yetcites [43] [43] C. Molnar. Interpretable machine learning, 2019. -
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
None of the sources cited for this claim have been checked yet.
In the paper
“The base algorithms for both ProtoDash [26] and CEM [18] do not return feature importances. What they return are vectors that are the same dimension as the input.”
What the sources say
- Not checked yetcites [26] [26] K. Gurumoorthy, A. Dhurandhar, G. Cecchi, and C. Agarwal. Efficient data representation by selecting prototypes with importance weights. IEEE Intl. Conference on Data Mining , 2019. -
- Not checked yetcites [18] [18] A. Dhurandhar, P.-Y. Chen, R. Luss, C.-C. Tu, P. Ting, K. Shanmugam, and P. Das. Explanations based on the missing: Towards contrastive explanations with pertinent negatives. In Advances in Neural Information Processing Systems , 2018. -
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“It can also serve as a example for the generation of datasets for other classification problems.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The same is true of linear functions of original, unbinarized numerical features (so-called 'linear terms') if they are included in the GLRM model, so these can be added to the GAM.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
None of the sources cited for this claim have been checked yet.
In the paper
“Methods to explain the predictions of test instances based on similar or influential training instances [26, 33, 36] would be considered as local explanations in the form of samples.”
What the sources say
- Not checked yetcites [26] [26] K. Gurumoorthy, A. Dhurandhar, G. Cecchi, and C. Agarwal. Efficient data representation by selecting prototypes with importance weights. IEEE Intl. Conference on Data Mining , 2019. -
- Not checked yetcites [33] [33] B. Kim, R. Khanna, and O. Koyejo. Examples are not enough, learn to criticize! Criticism for interpretability. In In Advances of Neural Inf. Proc. Systems , 2016. -
- Not checked yetcites [36] [36] P. W. Koh and P. Liang. Understanding black-box predictions via influence functions. In Proceedings of the 34th International Conference on Machine Learning , 2017. -
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“the explanations match the terminology of the domain; they represent higher-level semantic concepts, e.g., 'not being paid competitively', created by the domain expert, rather than mathematical combinations of feature values,”
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“While, a PN informs us of what minimal features if added or increased in value would change the classification of x to something other than y .”
What the sources say
- Not checked yetcites [18] [18] A. Dhurandhar, P.-Y. Chen, R. Luss, C.-C. Tu, P. Ting, K. Shanmugam, and P. Das. Explanations based on the missing: Towards contrastive explanations with pertinent negatives. In Advances in Neural Information Processing Systems , 2018. -
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The demo highlights that three groups of people - data scientists, loan officers, and bank customers - are involved in the scenario and their needs are best served by different explainability methods.”
plaincorrelationaln = 3- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“These modifications bring BRCG-light closer to GLRM [59] in two respects: 1) They conform to the GLRM problem formulation in which rule complexity is penalized in the same way, giving AIX360 users a common interface; 2) They allow reuse of a GLRM sub-algorithm as explained below.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“For example, although the data scientist may demand a global understanding of model behavior through an interpretable model, which can be provided by the GLRM algorithm, a bank customer would ask for justification for their loan application results, which can be generated by the CEM algorithm.”
hedgeddirectn = 3- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“These resources, together with the breadth of the toolkit and its common extensible programming interface, help distinguish AIX360 from existing explainability toolkits.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“We thus believe that our toolkit and taxonomy provide technical, educational, and operational benefits to the community over and above what currently exists.”
hedgeddirect- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Another distinctive feature of AIX360 is its common architecture and programming interface.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The proposed taxonomy (Figure 1) and software architecture (Section 3) add to the criteria above by making both broader distinctions (data vs. model) as well as finer distinctions (features vs. samples, black-box vs. white-box post-hoc).”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper may give no reason why it holds. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Beyond illustrating the application of different methods, the tutorials also provide considerable insight into the datasets that are used and, to the extent that these insights generalize, into the respective problem domains.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The clearest difference between AIX360 and these other toolkits is that AIX360 offers a wider spectrum of explainability methods, notably data explanations, metrics, and persona-specific explanations, the last referring to TED's ability to provide explanations in the language of the persona.”
boosted- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“These insights are a natural consequence of using explainable machine learning and could be of independent interest.”
hedgeddirect- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it. It may state two separate claims as one.
The paper relies on this without support.
Many machine learning techniques are not easily explainable, even by experts in the field.
“However, many machine learning techniques, which are responsible for much of the advances in AI, are not easily explainable, even by experts in the field.”
The paper relies on this without support.
There remains a gap between what society needs and what the research community is producing.
“growing volume of publications, there remains a gap between what society needs and what the research community is producing.”
The paper relies on this without support.
A lack of a precise definition of an explanation is one reason for the gap between what society needs and what the research community is producing.
“One reason for this gap is a lack of a precise definition of an explanation.”
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Measures have to be taken to address the risk-related concerns and demonstrate compliance with the law [8].”
From Trustworthy AI: From Principles to Practices (2023) · cites this paper as [8]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“To facilitate quality control and comparability, some of the toolkits also offer XAI evaluations37,39,42.”
From Orchestrating explainable artificial intelligence for multimodal and longitudinal data in medical imaging (2024) · cites this paper as [37]
The cited source says what the claim attributes to it.
In the citing paper
“There are multiple toolkits, such as AIX-36037, Alibi38, Captum39, EthicalML-XAI40, iNNvestigate41, Quantus42, among others, offering readily implemented XAI methods for a wide variety of tasks applicable to medical imaging (Table 1).”
From Orchestrating explainable artificial intelligence for multimodal and longitudinal data in medical imaging (2024) · cites this paper as [37]
The cited source says what the claim attributes to it.
In the citing paper
“Various toolboxes have been released in the past years to assist the algorithm experimentation and software development to enhance AI trustworthiness in different aspects such as fairness [12, 13, 71], XAI [56, 1, 8], and adversarial robustness [55, 2].”
From Trustworthy AI: From Principles to Practices (2023) · cites this paper as [8]
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“Laws for data privacy protection like the GDPR require data protection impact assessment (DPIA) if any data processing poses a risk to data privacy.”
From Trustworthy AI: From Principles to Practices (2023) · cites this paper as [8]
Experimental — accuracy not yet measured
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“Checklist-based assessments have been studied to qualitatively evaluate accountability and auditability [8, 315].”
From Trustworthy AI: From Principles to Practices (2023) · cites this paper as [8]
Experimental — accuracy not yet measured
Citations
Cites
Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization
Selvaraju, R. R., Cogswell, M., Das, A., Vedantam, R., Parikh, D., & Batra, D. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.74 · Cited by 24,513
"Why Should I Trust You?": Explaining the Predictions of Any Classifier
Ribeiro, M. T., Singh, S., & Guestrin, C. (2016) · Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2939672.2939778 · Cited by 17,555
Distilling the Knowledge in a Neural Network
Hinton, G., Vinyals, O., & Dean, J. (2015) · arXiv · doi:10.48550/arxiv.1503.02531 · Cited by 14,204 · cited 2×
“[13, 14, 31], which learn a simpler model based on a complex model’s predictions, would be considered as global interpretations that are learned using a post-hoc surrogate model.”
BackgroundMethodRudin, C. (2019) · Nature Machine Intelligence · doi:10.1038/s42256-019-0048-x · Cited by 10,561 · cited 1×
“2We use the terms explainable and interpretable fairly interchangeably; some scholars make a strong distinction [49].”
BackgroundPeeking Inside the Black-Box: A Survey on Explainable Artificial Intelligence (XAI)
Adadi, A., & Berrada, M. (2018) · IEEE Access · doi:10.1109/access.2018.2870052 · Cited by 6,294 · cited 4×
“The rapid expansion of explainable AI research has motivated several recent papers that survey the field and identify criteria to systematically classify explainability methods and techniques [9, 15, 25, 43].”
BackgroundMethodInfluentialDeep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Maps
Simonyan, K., Vedaldi, A., & Zisserman, A. (2013) · arXiv · doi:10.48550/arxiv.1312.6034 · Cited by 5,370 · cited 1×
“• Saliency Methods [static → model → local → post-hoc → features]: Saliency based methods [51, 52], which highlight different portions in an image whose classification we want to understand, can be categorized as local explanation meth-ods that are static and provide feature-based explanations in…”
BackgroundExplanation in artificial intelligence: Insights from the social sciences
Miller, T. (2019) · Artificial Intelligence · doi:10.1016/j.artint.2018.07.007 · Cited by 5,302
InfoGAN: Interpretable Representation Learning by Information Maximizing Generative Adversarial NetsPreprint
Chen, X., Duan, Y., Houthooft, R., Schulman, J., Sutskever, I., & Abbeel, P. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1606.03657 · Cited by 3,557 · cited 1×
“• High-Level Feature Learning Methods [static→ data→ features]: Methods that learn high-level features in an unsupervised manner [16, 38] through variational autoencoder or generative adversarial network frameworks would naturally fall under the data followed by features category.”
BackgroundHastie, T. J., & Tibshirani, R. J. (2014) · Wiley StatsRef: Statistics Reference Online · doi:10.1002/9781118445112.stat03141 · Cited by 3,156
Towards A Rigorous Science of Interpretable Machine Learning
Doshi-Velez, F., & Kim, B. (2017) · arXiv · doi:10.48550/arxiv.1702.08608 · Cited by 3,121 · cited 3×
“Although explanations are difficult to quantitatively evaluate and the gold standard is typically human evaluation [21], the AIX360 toolkit provides two quantitative metrics that serve as proxies of how “good” a particular feature-based local explanation is likely to be.”
Background
Research works printed but not linked: 11
- [12][12] D. Alvarez Melis and T. Jaakkola. Towards robust interpretability with selfexplaining neural networks. In S. Bengio, H. Wallach, H. Larochelle, K. Grauman, N. Cesa-Bianchi, and R. Garnett, editors, Advances in Neural Information Processing Systems 31 , pages 7775-7784. 2018. -
- [14][14] C. Buciluˇ a, R. Caruana, and A. Niculescu-Mizil. Model compression. In Proceedings of the 12th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining , 2006. -
- [18][18] A. Dhurandhar, P.-Y. Chen, R. Luss, C.-C. Tu, P. Ting, K. Shanmugam, and P. Das. Explanations based on the missing: Towards contrastive explanations with pertinent negatives. In Advances in Neural Information Processing Systems , 2018. -
- [30][30] M. Hind, D. Wei, M. Campbell, N. C. F. Codella, A. Dhurandhar, A. Mojsilovic, K. N. Ramamurthy, and K. R. Varshney. TED: Teaching AI to explain its decisions. In Proceedings of the 2019 AAAI/ACM Conference on AI, Ethics, and Society (AIES) , pages 123-129, 2019. -
- [32][32] F. Hohman, A. Head, R. Caruana, R. DeLine, and S. M. Drucker. Gamut: A design probe to understand how data scientists understand machine learning models. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems , page 579. ACM, 2019. -
- [34][34] B. Kim, K. R. Varshney, and A. Weller, editors. Proc. ICML Workshop Human Interpret. Mach. Learn. Stockholm, Sweden, June 2018. -
- [38][38] A. Kumar, P. Sattigeri, and A. Balakrishnan. Variational inference of disentangled latent concepts from unlabeled observations. In Proceedings of the Sixth International Conference on Learning Representations , 2018. -
- [40][40] S. Lundberg and S.-I. Lee. Unified framework for interpretable methods. In Advances of Neural Inf. Proc. Systems , 2017. -
- [45][45] D. B. Pasternak. Illinois and City of Chicago poised to implement new laws addressing changes in the workplace - signs of things to come? The National Law Review , June 2019. -
- [58][58] T. Wang, C. Rudin, F. Doshi-Velez, Y. Liu, E. Klampfl, and P. MacNeille. A Bayesian framework for learning rule sets for interpretable classification. Journal of Machine Learning Research , 18(70):1-37, 2017. -
- [60][60] D. Weidele, H. Strobelt, and M. Martino. Deepling: A visual interpretability system for convolutional neural networks. In Proceedings SysML , 2019. -
Cited by
Sorted by citations
Items 101–200 of 273
Drozdal, J., Weisz, J. D., Wang, D., Dass, G., Yao, B., Zhao, C., Muller, M. J., Lin, J., & Su, H. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2001.06509 · Cited by 25
Controlling Neural Networks with Rule RepresentationsPreprint
Seo, S., Arık, S. Ö., Yoon, J., Zhang, X. D., Sohn, K., & Pfister, T. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.07804 · Cited by 25
“The lack of understanding of the rationale behind their reasoning and inconsistencies of their outputs with human judgement often reduce the trust of the users [3, 26].”
BackgroundBarbado, A., & Corcho, Ó. (2022) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2022.105222 · Cited by 33
Explainable AI in Aerospace for Enhanced System Performance
Sutthithatip, S., Perinpanayagam, S., Aslam, S., & Wileman, A. (2021) · IEEE/AIAA Digital Avionics Systems Conference (DASC) · doi:10.1109/dasc52595.2021.9594488 · Cited by 24
Counterfactual Explanation of Machine Learning Survival Models
Kovalev, M. S., Utkin, L. V., Coolen, F. P. A., & Konstantinov, A. V. (2021) · Informatica · doi:10.15388/21-infor468 · Cited by 26
“A lot of explanation methods have been developed in order to overcome this obstacle [4, 25, 46, 47] and to explain the model outcomes.”
Kuźba, M., & Biecek, P. (2020) · Communications in computer and information science · doi:10.1007/978-3-030-65965-3_30 · Cited by 23
“And even for a single area of application, different actors may have different needs related to model interpretability [2].”
RecoXplainer: A Library for Development and Offline Evaluation of Explainable Recommender Systems
Çoba, L., Confalonieri, R., & Zanker, M. (2022) · IEEE Computational Intelligence Magazine · doi:10.1109/mci.2021.3129958 · Cited by 26
Shajalal, M., Boden, A., & Stevens, G. (2022) · Electronic Markets · doi:10.1007/s12525-022-00599-z · Cited by 23
“This opaqueness leads to a situation where users might question the predictions, because they are unable to understand the underlying decision making processes (i.e. the reasons for why a maybe counter-intuitive recommendation has been given) (Arya et al., 2019).”
BackgroundExplainability and vision foundation models: A survey
Kazmierczak, R., Berthier, É., Frehse, G., & Franchi, G. (2025) · Information Fusion · doi:10.1016/j.inffus.2025.103184 · Cited by 45
Fox, S., & Rey, V. F. (2024) · Machine Learning and Knowledge Extraction · doi:10.3390/make6030071 · Cited by 22
“Different people can have different Di ff erent people can have di ff erent requirements for explanations [60], and even experts may not agree about explainability [61]. for explanations [60], and even experts may not agree about explainabil-ity , to use a colloquial Hence, to use a colloquial…”
BackgroundLarasati, R. A., Liddo, A. D., & Motta, E. (2023) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/3631614 · Cited by 24
“Previous researches in explainable AI were claimed to be not strongly informed and involving real users [1], including in explainable AI for healthcare [4].”
BackgroundCan Explainable AI Explain Unfairness? A Framework for Evaluating Explainable AIPreprint
Alikhademi, K., Richardson, B., Drobina, E., & Gilbert, J. E. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.07483 · Cited by 66
“In addition in our study, we referred to three XAI tools: LIME, AI Explainability 360, and ad-hoc explainability tools [4, 7, 11, 26].”
AI Explainability 360: Impact and Design
Arya, V., Bellamy, R., Chen, P., Dhurandhar, A., Hind, M., Hoffman, S. C., Houde, S., Liao, Q. V., Luss, R., Mojsilović, A., et al. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i11.21540 · Cited by 20
Self-citationUncertainty aware and explainable diagnosis of retinal disease
Singh, A., Sengupta, S., Rasheed, M. A., Jayakumar, V., & Lakshminarayanan, V. (2021) · SPIE Medical Imaging: Imaging Informatics for Healthcare, Research, and Applications · doi:10.1117/12.2581362 · Cited by 20
Effective Explanations for Entity Resolution Models
Teofili, T., Firmani, D., Koudas, N., Martello, V., Merialdo, P., & Srivastava, D. (2022) · IEEE International Conference on Data Engineering (ICDE) · doi:10.1109/icde53745.2022.00248 · Cited by 22
Rule extraction with guarantees from regression models
Johansson, U., Sönströd, C., Löfström, T., & Boström, H. (2022) · Pattern Recognition · doi:10.1016/j.patcog.2022.108554 · Cited by 19
Proceedings of the 20th Python in Science Conference
Kapoor, V., & Carabaña, C. (2021) · Proceedings of the Python in Science Conferences · doi:10.25080/majora-1b6fd038-02b · Cited by 20
Synthetic Benchmarks for Scientific Research in Explainable Machine LearningPreprint
Liu, Y., Khandagale, S., White, C., & Neiswanger, W. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.12543 · Cited by 25
“With the widespread deployment of models in applications that impact human lives, explainability is becoming increasingly important for the purposes of debugging, legal obligations, and mitigating bias [41, 69, 7, 21].”
BackgroundInfluentialArtificial Intelligence in economic decision making: how to assure a trust?
Bejger, S., & Elster, S. (2020) · Ekonomia i Prawo · doi:10.12775/eip.2020.028 · Cited by 20
“It is necessary to point out that transparent models are considered to be directly (locally or globally) interpretable (c.f. Arya et al., 2019).”
BackgroundMethodQuestion-Driven Design Process for Explainable AI User Experiences
Liao, Q. V., Pribić, M., Han, J., Miller, S., & Sow, D. (2021) · arXiv · doi:10.48550/arxiv.2104.03483 · Cited by 18
“…there is no agreed-upon definition or criteria of AI explainability, and there are different related terms used in the literature such as interpretability and transparency, a common goal shared by XAI work is to make AI’s decisions or functions understandable by people [8, 11, 12, 30, 41, 44, 45].”
Self-citationCugny, R., Aligon, J., Chevalier, M., Roman‐Jimenez, G., & Teste, O. (2022) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3511808.3557247 · Cited by 25
“Currently, available XAI libraries such as DeepExplain Ancona et al. [2018], AI Explainability 360 Arya et al. [2019], and Alibi Klaise et al. [2021] are gathering state-of-the-art XAI solutions.”
Ghai, B., Liao, Q. V., Zhang, Y., Bellamy, R., & Mueller, K. D. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2001.09219 · Cited by 17
Self-citationFoundations of Explainable Knowledge-Enabled SystemsPreprint
Chari, S., Gruen, D. M., Seneviratne, O. W., & McGuinness, D. L. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.07520 · Cited by 17
Giannini, A., & Kwik, J. (2023) · Criminal Law Forum · doi:10.1007/s10609-023-09451-1 · Cited by 16
BrightBox — A rough set based technology for diagnosing mistakes of machine learning models
Janusz, A., Zalewska, A., Wawrowski, Ł., Biczyk, P., Ludziejewski, J., Sikora, M., & Ślȩzak, D. (2023) · Applied Soft Computing · doi:10.1016/j.asoc.2023.110285 · Cited by 19
Ghanvatkar, S., & Rajan, V. (2024) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2024.3393719 · Cited by 19
“Also, high number of concepts in the explanation can put a cognitive burden [42].”
TextFlint: Unified Multilingual Robustness Evaluation Toolkit for Natural Language ProcessingPreprint
Gui, T., Wang, X., Zhang, Q., Liu, Q., Zou, Y., Zhou, X., Zheng, R., Zhang, C., Wu, Q., Ye, J., et al. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.11441 · Cited by 31
Self-citationExplainable Reinforcement and Causal Learning for Improving Trust to 6G Stakeholders
Arana‐Catania, M., Sonee, A., Khan, A.-M., Fatehi, K., Tang, Y., Jin, B., Soligo, A., Boyle, D., Călinescu, R., Yadav, P., et al. (2025) · IEEE Open Journal of the Communications Society · doi:10.1109/ojcoms.2025.3563415 · Cited by 19
“To facilitate this, interactive user interfaces can be developed to enable users to explore and customize the variety of explanatory information forms at different depths [53], [54].”
Chat-XAI: A New Chatbot to Explain Artificial Intelligence
Gao, M., Liu, X., Xu, A., & Akkiraju, R. (2021) · Lecture notes in networks and systems · doi:10.1007/978-3-030-82199-9_9 · Cited by 15
Machine Learning Verification and Safety for Unmanned Aircraft - A Literature Study
Torens, C., Jünger, F., Schirmer, S., Schopferer, S., Maienschein, T., & Dauer, J. C. (2022) · AIAA SciTech Forum · doi:10.2514/6.2022-1133 · Cited by 15
Understanding Person Identification Through Gait
Hanisch, S., Muschter, E., Hatzipanayioti, A., Li, S., & Strufe, T. (2023) · Proceedings on Privacy Enhancing Technologies · doi:10.56553/popets-2023-0011 · Cited by 15
“The field of explainable machine learning [45, 2] focuses on the interpretability of learned machine learning models.”
BackgroundWhat Does It Mean to Explain? A User-Centered Study on AI Explainability
Yang, L., Wang, H., & Deleris, L. A. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-77772-2_8 · Cited by 15
ProtoPShare: Prototype Sharing for Interpretable Image Classification and Similarity DiscoveryPreprint
Rymarczyk, D., Struski, Ł., Tabor, J., & Zieliński, B. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.14340 · Cited by 23
“Ergo, more and more methods provide human-understandable justifications for their output [2, 3, 4, 5, 8, 10, 13, 30].”
BackgroundAn Open API Architecture to Discover the Trustworthy Explanation of Cloud AI Services
Wang, Z., Liu, Y., & Huang, J. (2024) · IEEE Transactions on Cloud Computing · doi:10.1109/tcc.2024.3398609 · Cited by 16
“IBM’s Ex-plainability 360 toolkit [25] incorporates an array of model explanation methods within its Python library.”
MethodDindorf, C., Horst, F., Slijepčević, D., Dumphart, B., Dully, J., Zeppelzauer, M., Horsak, B., & Fröhlich, M. (2024) · Springer optimization and its applications · doi:10.1007/978-3-031-76047-1_4 · Cited by 17
A Multi-layered Approach for Tailored Black-Box Explanations
Henin, C., & Métayer, D. L. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-68796-0_1 · Cited by 14
“AIX360 [23] contains eight explainability algorithms and allows users to choose among them based on a taxonomy including criteria such as “understand the data or the model” or “self-explaining model or post-hoc explanations”.”
MethodExplicabilidad (de la inteligencia artificial)
Alcarazo, L. O. D. Z. (2022) · EUNOMÍA Revista en Cultura de la Legalidad · doi:10.20318/eunomia.2022.6819 · Cited by 29
Messalas, A., Aridas, C. K., & Kanellopoulos, Y. (2020) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata50022.2020.9378034 · Cited by 14
“LIME is used by the majority of well-known open-source frameworks (Microsoft’s InterpretML [4], IBM’s AI Explainability 360 [5], Oracle’s Skater”
MethodArtificial Intelligence for Earth System Predictability (AI4ESP) (2021 Workshop Report)
Hickmon, N. L., Varadharajan, C., Hoffman, F. M., Wainwright, H. M., & Collis, S. (2022) · OSTI OAI (U.S. Department of Energy Office of Scientific and Technical Information) · doi:10.2172/1888810 · Cited by 16
Longo, L., Brčić, M., Cabitza, F., Choi, J., Confalonieri, R., Ser, J. D., Guidotti, R., Hayashi, Y., Herrera, F., Holzinger, A., et al. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2310.19775 · Cited by 14
“Some researchers use terms like explainability and interpretability syn-onymously [23,26], while others draw significant distinctions between them [64].”
BackgroundAn Explanation Framework for Interpretable Credit Scoring
Demajo, L. M., Vella, V., & Dingli, A. (2021) · International Journal of Artificial Intelligence & Applications · doi:10.5121/ijaia.2021.12102 · Cited by 13
“…loan officer would gain more confidence in the model's prediction by looking at other similar loan applications with the same outcome, and hence understanding why a loan application has been denied compared to other loan applications that were previously accepted and then ended up defaulting [11].”
BackgroundMethodInfluentialThe Methods and Approaches of Explainable Artificial Intelligence
Szczepański, M., Choraś, M., Pawlicki, M., & Pawlicka, A. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-77970-2_1 · Cited by 14
“It offers a diverse selection of algorithms like ProtoDash [42] or Contrastive Explanation Method (CEM) [43], even improving some of them [15].”
Interpreting Deep Neural Networks Through Variable ImportancePreprint
Ish-Horowicz, J., Udwin, D., Flaxman, S. R., Filippi, S., & Crawford, L. A. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1901.09839 · Cited by 18
The SAGE Framework for Explaining Context in Explainable Artificial Intelligence
Mill, E., Garn, W., Ryman-Tubb, N. F., & Turner, C. J. (2024) · Applied Artificial Intelligence · doi:10.1080/08839514.2024.2318670 · Cited by 14
“Finally, a more recent paper (Arya et al. 2019) addresses the topic of explanation goals by providing a comprehensive taxonomy of question types using the format of a decision tree.”
Causal Analysis for Robust Interpretability of Neural Networks
Ahmad, O. S., Béreux, N., Baret, L., Hashemi, V., & Lécué, F. (2024) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv57701.2024.00462 · Cited by 12
“Different techniques have been proposed to score the relevance of explanations [5, 1, 3, 4, 22].”
BackgroundMetrics and Evaluations of Time Series Explanations: An Application in Affect Computing
Fouladgar, N., Alirezaie, M., & Främling, K. (2022) · IEEE Access · doi:10.1109/access.2022.3155115 · Cited by 11
Interpretable Machine Learning: Moving From Mythos to DiagnosticsPreprint
Chen, V., Li, J., Kim, J. S., Plumb, G., & Talwalkar, A. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.06254 · Cited by 15
“The top-end of our taxonomy aims to differentiate between the various perspectives explanations provide based on three factors commonly discussed in existing literature (Arya et al., 2019; Guidotti et al., 2018; Doshi-Velez & Kim, 2017).”
The Stakeholder Playbook for Explaining AI SystemsPreprint
Hoffman, R., Klein, G. L., Mueller, S. T., Jalaeian, M., & Tate, C. (2021) · doi:10.31234/osf.io/9pqez · Cited by 12
Cloud-Based XAI Services for Assessing Open Repository Models Under Adversarial Attacks
Wang, Z., & Liu, Y. (2024) · IEEE International Conference on Software Services Engineering (SSE) · doi:10.1109/sse62657.2024.00031 · Cited by 11
Understanding Human Decision Processes: Inferring Decision Strategies From Behavioral Data
Walsh, S. E., & Feigh, K. M. (2022) · Journal of Cognitive Engineering and Decision Making · doi:10.1177/15553434221122899 · Cited by 11
“…AI — an attempt to increase the transparency and observability of AI systems so that humans can better understand what these systems are doing (Arya et al., 2019; Preece, 2018; Shin, 2021), (2) the ability to maintain a short and long term memory of interactions (Amershi et al., 2019), (3)…”
BackgroundTroncoso-García, A. R., Martínez-Ballesteros, M., Alvarez, F. M., & Troncoso, A. (2025) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2025.3540513 · Cited by 10
“These methods, known as post-hoc interpretability, are applied after training to explain predictions [4].”
Martínez, M. A. M., Nadj, M., Langner, M., Toreini, P., & Maedche, A. (2023) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/3607145 · Cited by 12
“10 In particular, LIME and SHAP were selected since they are popular and widely implemented in research and practice, as exemplified by toolkits such as AIX360 [ 7 ] or InterpretML [ 72 ].”
MethodPropagating Transparency: A Deep Dive into the Interpretability of Neural Networks
Somani, A., Horsch, A., Bopardikar, A. S., & Prasad, D. K. (2024) · Nordic Machine Intelligence · doi:10.5617/nmi.10755 · Cited by 9
Ramya, R., Priya, S. B., Thamizhikkavi, P., & Anand, M. (2024) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3693-9173-0.ch004 · Cited by 11
Thoughtful Adoption of NLP for Civic Participation: Understanding Differences Among Policymakers
Guridi, J. A., Cheyre, C., & Yang, Q. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3711091 · Cited by 12
“Our findings extend prior work on NLP tools for participation, which focused on a singular type of user within governments and its technical challenges [100].”
Explainable AI for Enhancing Efficiency of DL-Based Channel Estimation
Gizzini, A. K., Medjahdi, Y., Ghandour, A. J., & Clavier, L. (2025) · IEEE Transactions on Machine Learning in Communications and Networking · doi:10.1109/tmlcn.2025.3596548 · Cited by 9
“Moreover, in terms of the provided explanations, the XAI methods can be further classified into [23]: Model-agnostic vs model-specific: Model-agnostic XAI schemes are independent of the internal architecture of the black-box model including the weights and the hidden layers.”
Interpretability-Guided Convolutional Neural Networks for Seismic Fault Segmentation
Liu, Z., Zhou, C., Hu, G., & Song, C. (2020) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp40776.2020.9053472 · Cited by 9
“However, most of them focus on generating post-hoc explanation [18] and limited works are devoted to include the interpretability into the process of training.”
BackgroundNeurosymbolic system profiling: A template-based approach
Amador-Domínguez, E., Serrano, E., & Manrique, D. (2024) · Knowledge-Based Systems · doi:10.1016/j.knosys.2024.111441 · Cited by 10
User Driven Model Adjustment via Boolean Rule Explanations
Daly, E., Mattetti, M., Alkan, Ö., & Nair, R. S. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i7.16737 · Cited by 10
“Although BRCG is proposed for binary classification models, it can be generalized to multi-class problems using a one-vs.”
MethodInfluentialWhat Changed? Interpretable Model Comparison
Nair, R., Mattetti, M., Daly, E., Wei, D., Alkan, Ö., & Zhang, Y. (2021) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2021/393 · Cited by 8
“In terms of rule set learning algorithms, we have chosen that of [Dash et al. , 2018] (and its computationally simpler variant [Arya et al. , 2019]) because it explicitly optimizes the trade-off between accuracy (fidelity to the original model in our case) and rule set complexity and does so in a…”
MethodInfluentialSelf-citationTOWARDS USER-CENTRIC EXPLANATIONS FOR EXPLAINABLE MODELS: A REVIEW
Hassan, M. A., Sulaiman, R., Abdulgabber, M. A., & Kahtan, H. (2021) · Journal of Information System and Technology Management · doi:10.35631/jistm.622004 · Cited by 9
“A growing number of open-source frameworks incorporate XAI technology for end-users to understand and manage AI systems (Arya et al., 2019).”
Explainable Deep Learning approach for Shoulder Abnormality Detection in X-Rays Dataset
Mall, P. K., & Singh, P. K. (2022) · INTERNATIONAL JOURNAL OF NEXT-GENERATION COMPUTING · doi:10.47164/ijngc.v13i3.611 · Cited by 8
XAI Method Properties: A (Meta-)study.Preprint
Schwalbe, G., & Finzel, B. (2021) · arXiv (Cornell University) · Cited by 10
Mohammed, I., & Guillet, B. D. (2025) · Tourism Economics · doi:10.1177/13548166251382289 · Cited by 7
“XAI is known to offer both global (model-level) and local (output-speci fi c) explanations (Mohseni et al., 2021), as well as static or interactive formats (Arya et al., 2019).”
Explainability in machine learning: a pedagogical perspective
Bueff, A., Papantonis, I., Simkute, A., & Belle, V. (2025) · Frontiers in Education · doi:10.3389/feduc.2025.1595209 · Cited by 7
User centric explanations: a breakthrough for explainable models
Hassan, M. A., Abdulhak, M., bin Sulaiman, R., & Kahtan, H. (2021) · doi:10.1109/icit52682.2021.9491641 · Cited by 7
Attention-like feature explanation for tabular data
Konstantinov, A. V., & Utkin, L. V. (2022) · International Journal of Data Science and Analytics · doi:10.1007/s41060-022-00351-y · Cited by 7
Jin, W., Fan, J., Gromala, D., Pasquier, P., & Hamarneh, G. (2021) · arXiv (Cornell University) · Cited by 8
Vukadin, D., Afrić, P., Šilić, M., & Delač, G. (2024) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3649458 · Cited by 7
“5 ] , when normalized such that the absolute sum of the attribution scores is equal to 1.”
Füßl, A., & Nissen, V. (2025) · Requirements Engineering · doi:10.1007/s00766-025-00437-6 · Cited by 7
“Static XUIs deliver static explanations that do not change in reaction to the user’s feedback [38], for instance in the form of documentation.”
Explanation of Siamese Neural Networks for Weakly Supervised Learning
Utkin, L. V., Kovalev, M. S., & Kasimov, E. M. (2020) · Computing and Informatics · doi:10.31577/cai_2020_6_1172 · Cited by 6
Uncertainty Interpretation of the Machine Learning Survival Model Predictions
Utkin, L. V., Zaborovsky, V. S., Kovalev, M. S., Konstantinov, A. V., Politaeva, N. A., & Lukashin, A. (2021) · IEEE Access · doi:10.1109/access.2021.3108341 · Cited by 6
“Therefore, explanation components in machine learning models, which could interpret their predictions and understand the decisionmaking process [9]–[12], have to be developed.”
BackgroundLet the CAT out of the bag: Contrastive Attributed explanations for Text
Chemmengath, S., Azad, A. P., Luss, R., & Dhurandhar, A. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.484 · Cited by 8
Self-citationPredicting the need for XAI from high-granularity interaction data
de Santana, V. F., Fucs, A., Segura, V., de Moraes, D. B., & Cerqueira, R. (2023) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2023.103029 · Cited by 6
Mythical Ethical Principles for AI and How to Attain Them
Slavkovik, M. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-24349-3_15 · Cited by 6
ProtoMIL: Multiple Instance Learning with Prototypical Parts for Fine-Grained InterpretabilityPreprint
Rymarczyk, D., Kaczyńska, A., Kraus, J., Pardyl, A., & Zieliński, B. (2021) · arXiv (Cornell University) · Cited by 6
Labadie, R., Slijepčević, D., Chen, X., Böck, A. J., Babic, A., Freimann, L., Atzmüller, C., & Zeppelzauer, M. (2025) · Information Processing & Management · doi:10.1016/j.ipm.2025.104309 · Cited by 5
Towards the explainability of protein language models
Hunklinger, A., & Ferruz, N. (2026) · Nature Machine Intelligence · doi:10.1038/s42256-026-01232-w · Cited by 12
Towards the Certification of AI-based Systems
Denzel, P., Brunner, S., Billeter, Y., Forster, O., Frischknecht-Gruber, C. M.-L., Reif, M., Schilling, F.-P., Weng, J., Chavarriaga, R., Amini, A., et al. (2024) · IEEE Swiss Conference on Data Science (SDS) · doi:10.1109/sds60720.2024.00020 · Cited by 6
“E.g., [22], [24] propose such a taxonomy encompassing many well-established methods in ML research.”
BackgroundUtkin, L. V., DROBINTSEV, P. D., Kovalev, M. S., & Konstantinov, A. V. (2021) · Conference of Open Innovations Association (FRUCT) · doi:10.23919/fruct50888.2021.9347612 · Cited by 5
Pietilä, E., & Moreno-Sánchez, P. A. (2024) · World Congress on Medical Physics and Biomedical Engineering, September 7 - 12, 2009, Munich, Germany · doi:10.1007/978-3-031-49062-0_60 · Cited by 5
Utkin, L. V., Kovalev, M. S., & Kasimov, E. M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2005.02387 · Cited by 14
“Therefore, explainability of deep learning models is an topical direction of research nowadays, and, as a result, a lot of methods have been developed to address the interpretation problems and to get accurate explanations for obtained predictions [5, 11, 12, 21, 24, 37, 38, 39, 52].”
BackgroundResisting Out-of-Distribution Data Problem in Perturbation of XAIPreprint
Qiu, L., Yang, Y., Cao, C. C., Liu, J., Zheng, Y., Ngai, H. H. T., Hsiao, J. H., & Chen, L. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2107.14000 · Cited by 27
“the models’ outputs, which are model-agnosic and easily adopted in many real-world applications [10], [11].”
BackgroundTrustworthy Artificial Intelligence: Enhancing Trustworthiness Through Explainable AI (XAI)Preprint
Paramesha, M., Rane, N. L., & Rane, J. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4880090 · Cited by 6
XTSC-Bench: Quantitative Benchmarking for Explainers on Time Series Classification
Höllig, J., Thoma, S., & Grimm, F. (2023) · International Conference on Machine Learning and Applications · doi:10.1109/icmla58977.2023.00168 · Cited by 6
“For image, tabular, and textual data, a standard is slowly emerging [38] [39] with easy-to-adopt frameworks and the inclusion of some general metrics into explanation frameworks (e.g., [11], [10]) as well as a framework dedicated to quantization [12].”
BackgroundMethodBasics of Auditable AI Systems
Gräupner, O. S., Pawlaszczyk, D., & Hummert, C. (2023) · Congress in Computer Science, Computer Engineering, and Applied Computing (CSCE) · doi:10.1109/csce60160.2023.00382 · Cited by 4
“The XAI software libraries AI Explainability 360 [13], Alibi [14], Captum [15], iNNvestigate [16], InterpretML [17], LIME [18], SHAP [19], Skater [20], TF-explain [21], Quantus [22] and Zennit [23] are compared with each other.”
MethodCaro-Martínez, M., Jiménez-Díaz, G., & Recio-García, J. A. (2022) · International Journal of Interactive Multimedia and Artificial Intelligence · doi:10.9781/ijimai.2021.12.001 · Cited by 5
Explainable Regression Via Prototypes
Filho, R. M., Lacerda, A. M., & Pappa, G. L. (2022) · ACM Transactions on Evolutionary Learning and Optimization · doi:10.1145/3576903 · Cited by 5
“For ProtoDash we use the implementation available in [Arya et al. 2019] to ind the prototype points.”
MethodRethinking Logic Minimization for Tabular Machine Learning
Qiao, L., Wang, W., Dasgupta, S., & Lin, B. (2022) · IEEE Transactions on Artificial Intelligence · doi:10.1109/tai.2022.3224415 · Cited by 4
“(adult and chess) are from the UCI Machine Learning Repository [16] and the last one (retention) is from the AIX360 package [17].”
Borba, R. L., Ferreira, I. E. D. P., & Ramos, P. H. B. (2024) · Technovation · doi:10.1016/j.technovation.2024.103118 · Cited by 4
Biryukov, D. N., & Dudkin, A. S. (2025) · Scientific and technical journal of information technologies mechanics and optics · doi:10.17586/2226-1494-2025-25-3-373-386 · Cited by 4
A Generic Framework for Black-box Explanations
Henin, C., & Métayer, D. L. (2020) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata50022.2020.9377863 · Cited by 6
“For example, AIX360 (“AI Explainability 360”) [2] contains eight explainability algorithms and allows users to choose among them based on a taxonomy of pre-defined criteria.”
MethodUnderstanding, Visualizing and Explaining XAI Through Case Studies
Karpagam, G. R., Varma, A. P., Samrddhi, M., & Shivathmika, S., V (2022) · International Conference on Advanced Computing and Communication Systems (ICACCS) · doi:10.1109/icaccs54159.2022.9785199 · Cited by 4
Incorporating Attribution Importance for Improving Faithfulness Metrics
Zhao, Z., & Αλέτρας, Ν. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.261 · Cited by 12
Context-Aware Feature Selection and Classification
Wang, J., & Bilgic, M. (2023) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2023/480 · Cited by 5
Quality Characteristics of Artificially Intelligent Systems.
Smith, A. L., & Raphaël Clifford, A. (2020) · Cited by 4
Deep Learning Based Decision Support for Medicine -- A Case Study on Skin Cancer DiagnosisPreprint
Lucieri, A., Dengel, A. R., & Ahmed, S. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.05112 · Cited by 4
“A variety of taxonomies for xAI methods exist in literature [16, 17].”
BackgroundLost in Translation: The Limits of Explainability in AIPreprint
Wasserman-Rozen, H., Gilad-Bachrach, R., & Elkin-Koren, N. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4531323 · Cited by 4
Dual feature-based and example-based explanation methods
Konstantinov, A. V., Kozlov, B. N., Kirpichenko, S. R., Utkin, L. V., & Muliukha, V. (2025) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2025.1506074 · Cited by 3
Metadata
- Authors
- Arya, V., Bellamy, R. K. E., Chen, P.-Y., Dhurandhar, A., Hind, M., Hoffman, S. C., Houde, S., Liao, Q. V., Luss, R., Mojsilović, A., Mourad, S., Pedemonte, P., Raghavendra, R., Richards, J., Sattigeri, P., Shanmugam, K., Singh, M., Varshney, K. R., Wei, D., & Zhang, Y.
- ORCID
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2019
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1909.03012
- OpenAlex
- W2972059645
- Semantic Scholar
- c57a28759b6e1ddd7be03fa41e82b01130c8f8b2
- Cited by
- 268
- References
- 46
- Citations by year
- 2026: 6 · 2025: 20 · 2024: 46 · 2023: 42 · 2022: 51 · 2021: 71 · 2020: 30 · 2019: 2
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Physical Sciences › Computer Science › Software › Software Testing and Debugging Techniques
- Keywords
- explainable AI, explainability evaluation metrics, open source software, explainability requirements
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-10-09, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-09 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
