The DOI matches its DataCite record; 44 of the 46 references it cites were found in a registry or an index; none of the 35 sources its claims cite is checked for support yet.
One Explanation Does Not Fit All: A Toolkit and Taxonomy of AI Explainability Techniques
Open accessAbstract
As artificial intelligence and machine learning algorithms make further inroads into society, calls are increasing from multiple stakeholders for these algorithms to explain their outputs. At the same time, these stakeholders, whether they be affected citizens, government regulators, domain experts, or system developers, present different requirements for explanations. Toward addressing these needs, we introduce AI Explainability 360 (http://aix360.mybluemix.net/), an open-source software toolkit featuring eight diverse and state-of-the-art explainability methods and two evaluation metrics. Equally important, we provide a taxonomy to help entities requiring explanations to navigate the space of explanation methods, not only those in the toolkit but also in the broader literature on explainability. For data scientists and other users of the toolkit, we have implemented an extensible software architecture that organizes methods according to their place in the AI modeling pipeline. We also discuss enhancements to bring research innovations closer to consumers of explanations, ranging from simplified, more accessible versions of algorithms, to tutorials and an interactive web demo to introduce AI explainability to different audiences and application domains. Together, our toolkit and taxonomy can help identify gaps where more explainability methods are needed and provide a platform to incorporate them as they are developed.
Overview
AI snapshot
Written from the paper’s full text.
TL;DR
The paper introduces AI Explainability 360 (AIX360), an open-source toolkit with eight explainability algorithms and two evaluation metrics, plus a taxonomy to help different explanation consumers choose methods. It describes algorithmic enhancements, educational materials, and comparisons showing BRCG-light trades accuracy for reduced computation.
Key findings
- AIX360 contains eight explainability algorithms—BRCG, GLRM, ProtoDash, ProfWeight, TED, CEM, CEM-MAF, and DIP-VAE—and two metrics, Faithfulness and Monotonicity.
- The proposed taxonomy organizes explanations by static/interactive, data/model, local/global, direct/post-hoc, and other distinctions; Table 1 indicates AIX360 uniquely covers data explanations, directly interpretable methods, local post-hoc, global post-hoc, persona-specific explanations, and metrics among the compared toolkits.
- BRCG-light replaces integer programming with beam search; on 15 datasets, it is worse on average than BRCG-IP but better than BRS, AM, and BCD, and beam width B=5 gives better results than smaller widths on most datasets, particularly larger ones.
- The TED employee-retention synthetic dataset has 10,000 entries, 8 features, 25 rules, and a feature space of over 80 million possibilities; the toolkit also includes a FICO-based web demo, five tutorials, and 13 Jupyter notebooks.
Methods
- Design: proposes a taxonomy decision tree and implements an extensible Python class hierarchy organized by the AI modeling pipeline, including data explainers, directly interpretable explainers, local post-hoc explainers, and global post-hoc explainers.
- Data or sample: BRCG-light is evaluated on the same 15 datasets as [17]; the TED use case uses a synthetic employee-retention dataset with 10,000 entries; the web demo uses the FICO Explainable Machine Learning Challenge dataset, and tutorials cover credit approval, healthcare cost prediction, dermoscopic images, NHANES data, and employee retention.
- Main analysis: descriptive toolkit comparison in Table 1 and accuracy-complexity trade-off curves for BRCG-light versus BRCG-IP, BRS, AM, and BCD; no formal user study is reported in the text.
Limitations
- The paper states the taxonomy is “by no means” claimed to be perfect or complete, and the toolkit lacks methods in three taxonomy categories marked with “?”: interactive, static → data → distributions, and static → model → global → post-hoc → visualize.
- The paper states BRCG-light is inferior to BRCG-IP on average, and that if beam search fails to find a negative-objective solution, it cannot certify that none exists, unlike integer programming run to completion.
- The paper states explanations are difficult to quantitatively evaluate, human evaluation is the gold standard, and the two included metrics are proxies and not novel; evident from the text, the toolkit and taxonomy are evaluated mainly through descriptive comparison and trade-off curves rather than user studies.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
34 Own interpretation · 22 No basis given · 20 Not checked yet · 13 Own result
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“we introduce AI Explainability 360 1 , an open-source software toolkit featuring eight diverse and state-of-the-art explainability methods and two evaluation metrics.”
- Also stated in: § 1 INTRODUCTION · p. 2 · plain
“The current version of the toolkit contains eight explainability algorithms:”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § 1 INTRODUCTION · p. 2 · plain
None of the sources cited for this claim have been checked yet.
In the paper
“two evaluation metrics”
- Also stated in: § 1 INTRODUCTION · p. 2 · plain
“The toolkit also includes two metrics from the explainability literature: Faithfulness [12] and Monotonicity [41].”
What the sources say
- Not checked yetcites [12] [12] D. Alvarez Melis and T. Jaakkola. Towards robust interpretability with selfexplaining neural networks. In S. Bengio, H. Wallach, H. Larochelle, K. Grauman, N. Cesa-Bianchi, and R. Garnett, editors, Advances in Neural Information Processing Systems 31 , pages 7775-7784. 2018. -
- Not checked yetcites [41] [41] R. Luss, P.-Y. Chen, A. Dhurandhar, P. Sattigeri, K. Shanmugam, and C.-C. Tu. Generating contrastive explanations with monotonic attribute functions. 2019. -
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § 1 INTRODUCTION · p. 2 · plain
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“It is the most comprehensive explainability toolkit across different ways of explaining (see Table 1 and Section 5).”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“we have implemented an extensible software architecture that organizes methods according to their place in the AI modeling pipeline.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“we introduce AI Explainability 360 1 , an open-source software toolkit featuring eight diverse and state-of-the-art explainability methods and two evaluation metrics.”
- Also stated in: § One Explanation Does Not Fit All: A Toolkit and Taxonomy of AI Explainability Techniques · p. 1 · plain
“We have released the toolkit into the open source community under the name AI Explainability 360 (AIX360).”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § One Explanation Does Not Fit All: A Toolkit and Taxonomy of AI Explainability Techniques · p. 1 · plain
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“resulting in a feature space of over 80 million possibilities.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In particular, a beam search width of 5 (the default in AIX360) gives better results than smaller widths on most datasets.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“In the AIX360 toolkit we add another layer of interpretability by also discerning features that are important in more easily interpreting the output.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“the AIX360 toolkit provides two quantitative metrics that serve as proxies of how 'good' a particular feature-based local explanation is likely to be.”
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“In AIX360, we have made the above suggestion a reality by equipping GLRM models with the ability to visualize the GAM part of the model.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Probably not a substantial claim. 54
- It may state two separate claims as one. 20
- The quote only partly states this claim. 2
In the paper
“Again, we do not claim that this is a complete listing, although most of the methods reviewed by Guidotti et al. [25] are included.”
What the sources say
- Not checked yetcites [25] [25] R. Guidotti, A. Monreale, S. Ruggieri, F. Turini, F. Giannotti, and D. Pedreschi. A survey of methods for explaining black box models. ACM computing surveys (CSUR) , 51(5):93, 2018. -
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“These educational materials include a general guidance for the key concepts of explainability, a web demo that illustrates the usage of different explainability methods, and multiple tutorials.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“The decision tree leaves indicate the methods currently available through the toolkit along with the modalities they can work with.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“AIX360 focuses on static explanations, like much of the literature to date.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“The web demo was created based on the FICO Explainable Machine Learning Challenge dataset [22], a real-world scenario where a machine learning system is used to support decisions on loan applications by predicting the repayment risk of the applicants.”
What the sources say
- Not checked yetcites [22] [22] FICO. FICO Explainable Machine Learning Challenge. https://community.fico. com/s/explainable-machine-learning-challenge, 2018. Last accessed 2019-08. -
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“These comparisons show that BRCG-light occupies an intermediate position, inferior to BRCG-IP as may be expected, but superior to the earlier methods.”
hedgedcorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“AIX360 contains such a dataset for employee retention with 10,000 entries, created by an available python script that can be modified by changing the distribution of features, changing the rules, or the size of the dataset.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“AIX360 was developed with the goal of providing accessible resources on explainability to non-technical stakeholders.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“We created 25 rules, motivated by common retention scenarios, such as not getting a promotion in a while, not being paid competitively, receiving a disappointing evaluation, being a new employee in organizations with inherently high attrition, not having a salary that is consistent with positive evaluations, mid-career crisis, etc.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. The quote only partly states this claim.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The leaves in the decision tree are labeled with algorithms in the AIX360 toolkit or a question mark ('?') if the category is not represented in the current toolkit.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“In AIX360, we have replaced the integer programming components with a heuristic beam search algorithm and have modified the problem formulation accordingly.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In the current implementation of this use case, we further vary the application of these rules depending on various positions and organizations.”
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“The modules implementing GLRM follow [59] plus the enhancement of Section 4.3 below while the module implementing BRCG-light is novel.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In addition to the above base classes, AIX360 includes dataset classes to facilitate loading and processing of commonly used datasets so that users can easily experiment with the implemented algorithms.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“We created 25 rules, motivated by common retention scenarios, such as not getting a promotion in a while, not being paid competitively, receiving a disappointing evaluation, being a new employee in organizations with inherently high attrition, not having a salary that is consistent with positive evaluations, mid-career crisis, etc.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“The proposed taxonomy based on questions about what is explained (e.g., data or model), how it is explained (e.g., direct/post-hoc, static/interactive) and at what level (i.e. local/global).”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“These are indicated in Figure 1 by '?' in three cases: interactive, static → data → distributions, and static → model → global → post-hoc → visualize.”
plainn = 3- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“We have also provided a simple yet comprehensive taxonomy that structures the explainability space and serves multiple purposes, including guiding practitioners, revealing algorithmic gaps to researchers, and informing design choices related to explainability software (e.g., class hierarchy) for data scientists and developers.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“The AIX360 toolkit currently includes five tutorials in the form of Jupyter notebooks that show data scientists and other developers how to use different explanation methods across several application domains.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Preliminary work in this direction was initiated in AIX360 by defining a class for Keras-based classifiers that is utilized by CEMExplainer and CEMMAFImageExplainer.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Some of the algorithms were enhanced from their published versions for AIX360 to make them more usable and their outputs easier to consume.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The toolkit also contains two explainability metrics, a credit approval demonstration, five elaborate tutorials covering different real-world use cases, and 13 Jupyter notebooks, making it accessible to practitioners and non-experts.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Overall, the comparisons show that BRCG-light provides trade-offs that are worse on average than BRCG-IP, as may be expected given the dramatic reduction in computation, but better than the other methods.”
hedgedcorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“AIX360 also targets industry-specific users with the tutorials and web demo in Section 4.6.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“The AIX360 toolkit solicits contributions related to explainable AI to enable it to grow.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Since there is no single approach to explainable AI that always works best, we require organizing principles for the space of possibilities and tools that bridge the gap from research to practice.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper may give no reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Equally important, we provide a taxonomy to help entities requiring explanations to navigate the space of explanation methods, not only those in the toolkit but also in the broader literature on explainability.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“different people in different settings may require different kinds of explanations.”
- Also stated in: § ABSTRACT · p. 1 · plain
“these stakeholders, whether they be affected citizens, government regulators, domain experts, or system developers, present different requirements for explanations.”
plainconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
- Also stated in: § ABSTRACT · p. 1 · plain
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“We show that the taxonomy in Figure 1 allows different consumers to navigate the space of explanations and find the right algorithm or class of algorithms appropriate for their task.”
boosteddirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper may give no reason why it holds.
None of the sources cited for this claim have been checked yet.
In the paper
“Knowledge distillation-type approaches [13, 14, 31], which learn a simpler model based on a complex model's predictions, would be considered as global interpretations that are learned using a post-hoc surrogate model.”
What the sources say
- Not checked yetcites [13] [13] L. J. Ba and R. Caurana. Do deep nets really need to be deep? CoRR , abs/1312.6184, 2013. -
- Not checked yetcites [14] [14] C. Buciluˇ a, R. Caruana, and A. Niculescu-Mizil. Model compression. In Proceedings of the 12th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining , 2006. -
- Not checked yetcites [31] [31] G. Hinton, O. Vinyals, and J. Dean. Distilling the knowledge in a neural network. In https://arxiv.org/abs/1503.02531 , 2015. -
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The benefit of having a GAM is that it can be visualized as a series of plots of the functions f j , thus summarizing the effects of all first-degree rules and linear terms.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“GLRM models can therefore be interpreted like linear models and their constituent rules are also readily understood individually.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“A PP informs us of what minimal values for different features not exceeding those in x would be sufficient to obtain the same prediction y .”
What the sources say
- Not checked yetcites [18] [18] A. Dhurandhar, P.-Y. Chen, R. Luss, C.-C. Tu, P. Ting, K. Shanmugam, and P. Das. Explanations based on the missing: Towards contrastive explanations with pertinent negatives. In Advances in Neural Information Processing Systems , 2018. -
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This taxonomy is actionable in that it aids users in choosing an approach for a given application and may also reveal gaps in available explainability techniques.”
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper may give no reason why it holds. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“If the features are (independent) positively correlated with the decision, then the class probabilities should monotonically increase.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper may give no reason why it holds.
None of the sources cited for this claim have been checked yet.
In the paper
“Work in the natural language processing and computer vision domains that generates rationales/explanations derived from input text [11, 28, 39] would be considered as local self explanations.”
What the sources say
- Not checked yetcites [11] [11] Y. Ainur, Y. Choi, and C. Cardie. Automatically generating annotator rationales to improve sentiment classification. In Proceedings of the ACL 2010 Conference Short Papers , 2010. -
- Not checked yetcites [28] [28] L. A. Hendricks, Z. Akata, M. Rohrbach, J. Donahue, B. Schiele, and T. Darrell. Generating visual explanations. In European Conference on Computer Vision , 2016. -
- Not checked yetcites [39] [39] T. Lei, R. Barzilay, and T. Jaakkola. Rationalizing neural predictions. arXiv preprint arXiv:1606.04155 , 2016. -
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Together, our toolkit and taxonomy can help identify gaps where more explainability methods are needed and provide a platform to incorporate them as they are developed.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence. The paper may give no reason why it holds. It may state two separate claims as one.
In the paper
“Nevertheless, the discussion in [59, Sec. 6] as well as our experience in putting together the AIX360 web demo and tutorials (Section 4.6) raise the question of the degree to which a GLRM model with (say) tens of rules is interpretable. While interpretation is still feasible, it may require a non-trivial investment of effort.”
What the sources say
- Not checked yetcites [59] [59] D. Wei, S. Dash, T. Gao, and O. Günlük. Generalized linear rule models. In Proceedings of the 36th International Conference on Machine Learning (ICML) , 2019. -
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
None of the sources cited for this claim have been checked yet.
In the paper
“Methods that propose certain restrictions on the neural network architecture [12, 62] to make it interpretable, yet maintain richness of the hypothesis space to model complicated decision boundaries would fall under the global directly interpretable category.”
What the sources say
- Not checked yetcites [12] [12] D. Alvarez Melis and T. Jaakkola. Towards robust interpretability with selfexplaining neural networks. In S. Bengio, H. Wallach, H. Larochelle, K. Grauman, N. Cesa-Bianchi, and R. Garnett, editors, Advances in Neural Information Processing Systems 31 , pages 7775-7784. 2018. -
- Not checked yetcites [62] [62] Q. Zhang, Y. N. Wu, and S.-C. Zhu. Interpretable convolutional neural networks. In Proceedings of Computer Vision and Pattern Recognition , 2018.
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“The second metric is Monotonicity [41], which simply tries to measure if adding more positive evidence increases the probability of classification in the specified class.”
What the sources say
- Not checked yetcites [41] [41] R. Luss, P.-Y. Chen, A. Dhurandhar, P. Sattigeri, K. Shanmugam, and C.-C. Tu. Generating contrastive explanations with monotonic attribute functions. 2019. -
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The intuition is that removing more important features should reduce the confidence of the classifier more than removing less important ones.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“The first metric we implement is a version of the Faithfulness metric [12], which tries to evaluate if the feature importances returned by an explainability method are the correct ones.”
What the sources say
- Not checked yetcites [12] [12] D. Alvarez Melis and T. Jaakkola. Towards robust interpretability with selfexplaining neural networks. In S. Bengio, H. Wallach, H. Larochelle, K. Grauman, N. Cesa-Bianchi, and R. Garnett, editors, Advances in Neural Information Processing Systems 31 , pages 7775-7784. 2018. -
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Higher-degree rules, which do involve feature interactions, can then be studied separately.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. The quote only partly states this claim.
None of the sources cited for this claim have been checked yet.
In the paper
“Saliency based methods [51, 52], which highlight different portions in an image whose classification we want to understand, can be categorized as local explanation methods that are static and provide feature-based explanations in terms of highlighting pixels/superpixels.”
What the sources say
- Not checked yetcites [51] [51] R. R. Selvaraju, M. Cogswell, A. Das, R. Vedantam, D. Parikh, and D. Batra. Gradcam: Visual explanations from deep networks via gradient-based localization. See https://arxiv. org/abs/1610.02391 v3 , 2016. -
- Not checked yetcites [52] [52] K. Simonyan, A. Vedaldi, and A. Zisserman. Deep inside convolutional networks: Visualising image classification models and saliency maps. CoRR , abs/1312.6034, 2013. -
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The above equation creates a feature importance value in [ 0 , 1 ] . The higher the value more similar the feature and hence higher its importance.”
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
In the paper
“Methods such as partial dependence plots (PDP) and sensitivity analysis [43] are used to study the (global) effects of different input features on the output values and are typically consumed through appropriate visualizations (e.g., PDP plots, scatter plots, control charts).”
What the sources say
- Not checked yetcites [43] [43] C. Molnar. Interpretable machine learning, 2019. -
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
None of the sources cited for this claim have been checked yet.
In the paper
“The base algorithms for both ProtoDash [26] and CEM [18] do not return feature importances. What they return are vectors that are the same dimension as the input.”
What the sources say
- Not checked yetcites [26] [26] K. Gurumoorthy, A. Dhurandhar, G. Cecchi, and C. Agarwal. Efficient data representation by selecting prototypes with importance weights. IEEE Intl. Conference on Data Mining , 2019. -
- Not checked yetcites [18] [18] A. Dhurandhar, P.-Y. Chen, R. Luss, C.-C. Tu, P. Ting, K. Shanmugam, and P. Das. Explanations based on the missing: Towards contrastive explanations with pertinent negatives. In Advances in Neural Information Processing Systems , 2018. -
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“It can also serve as a example for the generation of datasets for other classification problems.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The same is true of linear functions of original, unbinarized numerical features (so-called 'linear terms') if they are included in the GLRM model, so these can be added to the GAM.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
None of the sources cited for this claim have been checked yet.
In the paper
“Methods to explain the predictions of test instances based on similar or influential training instances [26, 33, 36] would be considered as local explanations in the form of samples.”
What the sources say
- Not checked yetcites [26] [26] K. Gurumoorthy, A. Dhurandhar, G. Cecchi, and C. Agarwal. Efficient data representation by selecting prototypes with importance weights. IEEE Intl. Conference on Data Mining , 2019. -
- Not checked yetcites [33] [33] B. Kim, R. Khanna, and O. Koyejo. Examples are not enough, learn to criticize! Criticism for interpretability. In In Advances of Neural Inf. Proc. Systems , 2016. -
- Not checked yetcites [36] [36] P. W. Koh and P. Liang. Understanding black-box predictions via influence functions. In Proceedings of the 34th International Conference on Machine Learning , 2017. -
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“the explanations match the terminology of the domain; they represent higher-level semantic concepts, e.g., 'not being paid competitively', created by the domain expert, rather than mathematical combinations of feature values,”
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“While, a PN informs us of what minimal features if added or increased in value would change the classification of x to something other than y .”
What the sources say
- Not checked yetcites [18] [18] A. Dhurandhar, P.-Y. Chen, R. Luss, C.-C. Tu, P. Ting, K. Shanmugam, and P. Das. Explanations based on the missing: Towards contrastive explanations with pertinent negatives. In Advances in Neural Information Processing Systems , 2018. -
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The demo highlights that three groups of people - data scientists, loan officers, and bank customers - are involved in the scenario and their needs are best served by different explainability methods.”
plaincorrelationaln = 3- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“These modifications bring BRCG-light closer to GLRM [59] in two respects: 1) They conform to the GLRM problem formulation in which rule complexity is penalized in the same way, giving AIX360 users a common interface; 2) They allow reuse of a GLRM sub-algorithm as explained below.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“For example, although the data scientist may demand a global understanding of model behavior through an interpretable model, which can be provided by the GLRM algorithm, a bank customer would ask for justification for their loan application results, which can be generated by the CEM algorithm.”
hedgeddirectn = 3- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“These resources, together with the breadth of the toolkit and its common extensible programming interface, help distinguish AIX360 from existing explainability toolkits.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“We thus believe that our toolkit and taxonomy provide technical, educational, and operational benefits to the community over and above what currently exists.”
hedgeddirect- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Another distinctive feature of AIX360 is its common architecture and programming interface.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The proposed taxonomy (Figure 1) and software architecture (Section 3) add to the criteria above by making both broader distinctions (data vs. model) as well as finer distinctions (features vs. samples, black-box vs. white-box post-hoc).”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper may give no reason why it holds. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Beyond illustrating the application of different methods, the tutorials also provide considerable insight into the datasets that are used and, to the extent that these insights generalize, into the respective problem domains.”
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The clearest difference between AIX360 and these other toolkits is that AIX360 offers a wider spectrum of explainability methods, notably data explanations, metrics, and persona-specific explanations, the last referring to TED's ability to provide explanations in the language of the persona.”
boosted- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“These insights are a natural consequence of using explainable machine learning and could be of independent interest.”
hedgeddirect- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it. It may state two separate claims as one.
The paper relies on this without support.
Many machine learning techniques are not easily explainable, even by experts in the field.
“However, many machine learning techniques, which are responsible for much of the advances in AI, are not easily explainable, even by experts in the field.”
The paper relies on this without support.
There remains a gap between what society needs and what the research community is producing.
“growing volume of publications, there remains a gap between what society needs and what the research community is producing.”
The paper relies on this without support.
A lack of a precise definition of an explanation is one reason for the gap between what society needs and what the research community is producing.
“One reason for this gap is a lack of a precise definition of an explanation.”
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Measures have to be taken to address the risk-related concerns and demonstrate compliance with the law [8].”
From Trustworthy AI: From Principles to Practices (2023) · cites this paper as [8]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“To facilitate quality control and comparability, some of the toolkits also offer XAI evaluations37,39,42.”
From Orchestrating explainable artificial intelligence for multimodal and longitudinal data in medical imaging (2024) · cites this paper as [37]
The cited source says what the claim attributes to it.
In the citing paper
“There are multiple toolkits, such as AIX-36037, Alibi38, Captum39, EthicalML-XAI40, iNNvestigate41, Quantus42, among others, offering readily implemented XAI methods for a wide variety of tasks applicable to medical imaging (Table 1).”
From Orchestrating explainable artificial intelligence for multimodal and longitudinal data in medical imaging (2024) · cites this paper as [37]
The cited source says what the claim attributes to it.
In the citing paper
“Various toolboxes have been released in the past years to assist the algorithm experimentation and software development to enhance AI trustworthiness in different aspects such as fairness [12, 13, 71], XAI [56, 1, 8], and adversarial robustness [55, 2].”
From Trustworthy AI: From Principles to Practices (2023) · cites this paper as [8]
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“Laws for data privacy protection like the GDPR require data protection impact assessment (DPIA) if any data processing poses a risk to data privacy.”
From Trustworthy AI: From Principles to Practices (2023) · cites this paper as [8]
Experimental — accuracy not yet measured
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“Checklist-based assessments have been studied to qualitatively evaluate accountability and auditability [8, 315].”
From Trustworthy AI: From Principles to Practices (2023) · cites this paper as [8]
Experimental — accuracy not yet measured
Citations
Cites
Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization
Selvaraju, R. R., Cogswell, M., Das, A., Vedantam, R., Parikh, D., & Batra, D. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.74 · Cited by 24,513
"Why Should I Trust You?": Explaining the Predictions of Any Classifier
Ribeiro, M. T., Singh, S., & Guestrin, C. (2016) · Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2939672.2939778 · Cited by 17,555
Distilling the Knowledge in a Neural Network
Hinton, G., Vinyals, O., & Dean, J. (2015) · arXiv · doi:10.48550/arxiv.1503.02531 · Cited by 14,204 · cited 2×
“[13, 14, 31], which learn a simpler model based on a complex model’s predictions, would be considered as global interpretations that are learned using a post-hoc surrogate model.”
BackgroundMethodRudin, C. (2019) · Nature Machine Intelligence · doi:10.1038/s42256-019-0048-x · Cited by 10,561 · cited 1×
“2We use the terms explainable and interpretable fairly interchangeably; some scholars make a strong distinction [49].”
BackgroundPeeking Inside the Black-Box: A Survey on Explainable Artificial Intelligence (XAI)
Adadi, A., & Berrada, M. (2018) · IEEE Access · doi:10.1109/access.2018.2870052 · Cited by 6,294 · cited 4×
“The rapid expansion of explainable AI research has motivated several recent papers that survey the field and identify criteria to systematically classify explainability methods and techniques [9, 15, 25, 43].”
BackgroundMethodInfluentialDeep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Maps
Simonyan, K., Vedaldi, A., & Zisserman, A. (2013) · arXiv · doi:10.48550/arxiv.1312.6034 · Cited by 5,370 · cited 1×
“• Saliency Methods [static → model → local → post-hoc → features]: Saliency based methods [51, 52], which highlight different portions in an image whose classification we want to understand, can be categorized as local explanation meth-ods that are static and provide feature-based explanations in…”
BackgroundExplanation in artificial intelligence: Insights from the social sciences
Miller, T. (2019) · Artificial Intelligence · doi:10.1016/j.artint.2018.07.007 · Cited by 5,302
InfoGAN: Interpretable Representation Learning by Information Maximizing Generative Adversarial NetsPreprint
Chen, X., Duan, Y., Houthooft, R., Schulman, J., Sutskever, I., & Abbeel, P. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1606.03657 · Cited by 3,557 · cited 1×
“• High-Level Feature Learning Methods [static→ data→ features]: Methods that learn high-level features in an unsupervised manner [16, 38] through variational autoencoder or generative adversarial network frameworks would naturally fall under the data followed by features category.”
BackgroundHastie, T. J., & Tibshirani, R. J. (2014) · Wiley StatsRef: Statistics Reference Online · doi:10.1002/9781118445112.stat03141 · Cited by 3,156
Towards A Rigorous Science of Interpretable Machine Learning
Doshi-Velez, F., & Kim, B. (2017) · arXiv · doi:10.48550/arxiv.1702.08608 · Cited by 3,121 · cited 3×
“Although explanations are difficult to quantitatively evaluate and the gold standard is typically human evaluation [21], the AIX360 toolkit provides two quantitative metrics that serve as proxies of how “good” a particular feature-based local explanation is likely to be.”
Background
Research works printed but not linked: 11
- [12][12] D. Alvarez Melis and T. Jaakkola. Towards robust interpretability with selfexplaining neural networks. In S. Bengio, H. Wallach, H. Larochelle, K. Grauman, N. Cesa-Bianchi, and R. Garnett, editors, Advances in Neural Information Processing Systems 31 , pages 7775-7784. 2018. -
- [14][14] C. Buciluˇ a, R. Caruana, and A. Niculescu-Mizil. Model compression. In Proceedings of the 12th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining , 2006. -
- [18][18] A. Dhurandhar, P.-Y. Chen, R. Luss, C.-C. Tu, P. Ting, K. Shanmugam, and P. Das. Explanations based on the missing: Towards contrastive explanations with pertinent negatives. In Advances in Neural Information Processing Systems , 2018. -
- [30][30] M. Hind, D. Wei, M. Campbell, N. C. F. Codella, A. Dhurandhar, A. Mojsilovic, K. N. Ramamurthy, and K. R. Varshney. TED: Teaching AI to explain its decisions. In Proceedings of the 2019 AAAI/ACM Conference on AI, Ethics, and Society (AIES) , pages 123-129, 2019. -
- [32][32] F. Hohman, A. Head, R. Caruana, R. DeLine, and S. M. Drucker. Gamut: A design probe to understand how data scientists understand machine learning models. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems , page 579. ACM, 2019. -
- [34][34] B. Kim, K. R. Varshney, and A. Weller, editors. Proc. ICML Workshop Human Interpret. Mach. Learn. Stockholm, Sweden, June 2018. -
- [38][38] A. Kumar, P. Sattigeri, and A. Balakrishnan. Variational inference of disentangled latent concepts from unlabeled observations. In Proceedings of the Sixth International Conference on Learning Representations , 2018. -
- [40][40] S. Lundberg and S.-I. Lee. Unified framework for interpretable methods. In Advances of Neural Inf. Proc. Systems , 2017. -
- [45][45] D. B. Pasternak. Illinois and City of Chicago poised to implement new laws addressing changes in the workplace - signs of things to come? The National Law Review , June 2019. -
- [58][58] T. Wang, C. Rudin, F. Doshi-Velez, Y. Liu, E. Klampfl, and P. MacNeille. A Bayesian framework for learning rule sets for interpretable classification. Journal of Machine Learning Research , 18(70):1-37, 2017. -
- [60][60] D. Weidele, H. Strobelt, and M. Martino. Deepling: A visual interpretability system for convolutional neural networks. In Proceedings SysML , 2019. -
Cited by
Sorted by citations
Items 201–273 of 273
Empowering scientific discovery with explainable small domain-specific and large language models
Yu, H., Wang, Y., Cheng, T., Yan, Y., Dawson, K. A., Li, S. F. Y., Zheng, Y., & Jin, Y. (2025) · Artificial Intelligence Review · doi:10.1007/s10462-025-11365-w · Cited by 4
On Explainability in AI-Solutions: A Cross-Domain Survey
Antón, S. D. D., Schneider, D., & Schotten, H. D. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-14862-0_17 · Cited by 4
Vadrevu, S., Nagi, R., Xiong, J., & Hwu, W. (2021) · Workshop on Trustworthy Natural Language Processing (TrustNLP) · doi:10.18653/v1/2021.trustnlp-1.5 · Cited by 3
Durumeric, A. E. P., & Voth, G. A. (2023) · The Journal of Chemical Physics · doi:10.1063/5.0146812 · Cited by 3
Nakao, Y., & Yokota, T. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-35969-9_3 · Cited by 4
Using Explainable AI for Neural Network-Based Network Attack Detection
Zou, Q., Zhang, L., Sun, X., Singhal, A., & Liu, P. (2024) · Computer · doi:10.1109/mc.2023.3342602 · Cited by 3
Explainable AI for Mixed Data Clustering
Amling, J., Scheele, S., Slany, E., Lang, M., & Schmid, U. (2024) · Communications in computer and information science · doi:10.1007/978-3-031-63797-1_3 · Cited by 3
Fanoos: Multi-resolution, Multi-strength, Interactive Explanations for Learned Systems
Bayani, D., & Mitsch, S. (2022) · Lecture notes in computer science · doi:10.1007/978-3-030-94583-1_3 · Cited by 4
Comment on "Statistical Modeling: The Two Cultures" by Leo Breiman
Kennedy, E. H., Bonvini, M., & Mishler, A. (2021) · Observational Studies · doi:10.1353/obs.2021.0001 · Cited by 3
RITUAL: a Platform Quantifying the Trustworthiness of Supervised Machine Learning
Celdrán, A. H., Bauer, J., Demirci, M., Leupp, J., Franco, M. F., Sánchez, P. M. S., Bovet, G., Pérez, G. M., & Stiller, B. (2022) · International Conference on Network and Service Management (CNSM) · doi:10.23919/cnsm55787.2022.9965139 · Cited by 3
Explaining classifiers to understand coarse-grained modelsPreprint
Durumeric, A. E. P., & Voth, G. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2109.07337 · Cited by 2
Counterfactual Generation Through Multi-objective Constrained OptimisationPreprint
Monteiro, W. R., & Reynoso-Meza, G. (2022) · Research Square · doi:10.21203/rs.3.rs-1325730/v1 · Cited by 3
Understanding Person Identification Through GaitPreprint
Hanisch, S., Muschter, E., Hatzipanayioti, A., Li, S., & Strufe, T. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2203.04179 · Cited by 3
“The field of explainable machine learning [45, 2] focuses on the interpretability of learned machine learning models.”
BackgroundTrustML: A Python package for computing the trustworthiness of ML models
Manzano, M., Ayala, C. P., & Gómez, C. (2024) · SoftwareX · doi:10.1016/j.softx.2024.101740 · Cited by 3
Ethical Governance of Artificial Intelligence in Organizations
Saidin, S. S., Ahmad, N., & Aziz, S. (2025) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3693-6507-6.ch003 · Cited by 2
Amling, J., Slany, E., Dormagen, C., Kretschmann, M., & Scheele, S. (2025) · Communications in computer and information science · doi:10.1007/978-3-032-08324-1_4 · Cited by 2
Tabular machine learning using conjunctive threshold neural networks
Wang, W., Qiao, L., & Lin, B. (2022) · Machine Learning with Applications · doi:10.1016/j.mlwa.2022.100429 · Cited by 2
Lenhart, A. (2022) · ACM Conference on Computer Supported Cooperative Work (CSCW) · doi:10.1145/3500868.3559460 · Cited by 2
“The concepts included: awareness-based techniques for bias mitigation [5], Proxy variables [12], ADS audits [4, 12], interpretation of ADS [4, 17], Contestability [2], Gaming [18] •From your point of view what are the hardest questions your team is grappling with regarding ethical/responsible use of ADS? •What is your…”
MethodInfluentialLeewis, S., & Smit, K. (2023) · Hawaii International Conference on System Sciences (HICSS) · doi:10.24251/hicss.2023.206 · Cited by 3
Flores, M. A. A. (2024) · Justicia · doi:10.17081/just.29.45.7143 · Cited by 2
Concepts and Measures Towards Trustworthy AI in Industrial Manufacturing
Zelba, F., Balzereit, K., & Windmann, S. (2024) · IEEE International Conference on Emerging Technologies and Factory Automation (ETFA) · doi:10.1109/etfa61755.2024.10710991 · Cited by 2
“This brings benefits for the developer of the AI system to draw conclusions about the confidence of the AI system [12], and also for the machine operator: For example for anomaly detection, the operator might not only want to know, when an anomaly occurred, but also why the AI system labelled a…”
BackgroundInterpretable neural network classification model using first-order logic rules
Tuo, H., Meng, Z., Shi, Z., & Zhang, D. (2024) · Neurocomputing · doi:10.1016/j.neucom.2024.128840 · Cited by 2
Feature selection methods for high-dimensional biomedical time-to-event data: a review
Tan, H., Deng, C., Chen, S., Luo, Q., Hu, G., & Quan, Y. (2022) · International Conference on Big Data Technologies (ICBDT) · doi:10.1145/3565291.3565309 · Cited by 2
The Solvability of Interpretability Evaluation Metrics
Zhou, Y., & Shah, J. (2023) · Findings of the Association for Computational Linguistics: EACL · doi:10.18653/v1/2023.findings-eacl.182 · Cited by 12
ForestMonkey: Toolkit for Reasoning with AI-Based Defect Detection and Classification Models
Zhang, J., Cosma, G., Bugby, S. L., & Watkins, J. (2023) · IEEE Symposium Series on Computational Intelligence (SSCI) · doi:10.1109/ssci52147.2023.10371878 · Cited by 2
“One such toolkit is XAI360 [1], published by Arya et al.”
Assured AI reference architecture
Tyler, M., & McCeney, J. (2024) · Assurance and Security for AI-enabled Systems · doi:10.1117/12.3027227 · Cited by 3
“The AIX360 toolkit [33] from IBM implements a few of these.”
MethodVitrAI: Applying Explainable AI in the Real World
Hanussek, M., Koetter, F., Kintz, M., & Drawehn, J. (2021) · Lecture notes in networks and systems · doi:10.1007/978-3-030-82196-8_2 · Cited by 2
Towards the Design of Explanation-aware Decision Support Systems
Kolajo, T., & Daramola, O. (2024) · Lecture notes in networks and systems · doi:10.1007/978-3-031-73110-5_7 · Cited by 1
Dindorf, C., Dully, J., Simon, S., Perchthaler, D., Becker, S. T., Ehmann, H., Heitmann, K. R., Stetter, B. J., Diers, C., & Fröhlich, M. (2026) · Scientific Reports · doi:10.1038/s41598-025-33707-y · Cited by 1
Uncertainty Quantification of Surrogate Explanations: an Ordinal Consensus Approach
Schulz, J., Santos‐Rodríguez, R., & Poyiadzi, R. (2022) · Proceedings of the Northern Lights Deep Learning Workshop · doi:10.7557/18.6294 · Cited by 1
Current Study and Method on Artificial Intelligent-based on Venture Capital Decision
Hu, L. (2024) · International Conference on Economic Management and Big Data Application (ICEMBDA) · doi:10.4108/eai.27-10-2023.2341962 · Cited by 1
How to Explain It to System Testers?
Degen, H., & Budnik, C. J. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-60606-9_10 · Cited by 1
Credit Card Fraud Detection with LIME and SHAP
Swetha, P. (2024) · International Journal for Research in Applied Science and Engineering Technology · doi:10.22214/ijraset.2024.63375 · Cited by 1
FROM INSIGHT TO IMPACT: THE EVOLUTION OF DATA-DRIVEN DECISION MAKING IN THE AGE OF AI
Doshi, P. (2025) · International Journal of Artificial Intelligence & Applications · doi:10.5121/ijaia.2025.16306 · Cited by 1
Human-in-the-Loop without the Hype: A Conceptual Taxonomy of Human Roles in Materials AI
Huy, N. T., Bich, L. T., & Minh, P. Q. (2024) · Journal of Artificial Intelligence for Materials Science · doi:10.68159/g989274613 · Cited by 1
Severity Prediction of Covid-19 Patient Using Machine Learning Techniques
Ravikumar, D. P., R, A. K. N., Moudgalya, P., Shriman, A. S., & Srihari, N. U. (2022) · International Journal of Innovations in Engineering and Science · doi:10.46335/ijies.2022.7.9.24 · Cited by 1
Disjunctive Threshold Networks for Tabular Data Classification
Wang, W., Qiao, L., & Lin, B. (2023) · IEEE Open Journal of the Computer Society · doi:10.1109/ojcs.2023.3282948 · Cited by 1
“The other three datasets are: house (House_16H) [30], retention (TED Dataset) [31], and re-cidivism (Predicting Recidivism) [32].”
BackgroundExplanation Ontology in Action: A Clinical Use-CasePreprint
Chari, S., Seneviratne, O. W., Gruen, D. M., Foreman, M. A., Das, A. K., & McGuinness, D. L. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.01478 · Cited by 1
“Additionally, there have been some promising machine learning (ML) model efforts in the explainability space [1,6] that could be used to generate system recommendations to populate specific explanation types.”
BackgroundPilot Investigation for a Comprehensive Taxonomy of Autonomous EntitiesPreprint
Wagner, W., Źakowska, A., Aladi, C. C., & Santhosh, J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.03482 · Cited by 1
“”[10] Their specific use case is not generalizable beyond the software they are classifying because of the nature of their taxonomy being derivative of the inner mathematics in AI.”
An Explainable Probabilistic Classifier for Categorical Data Inspired to Quantum PhysicsPreprint
Guidotti, E., & Ferrara, A. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2105.13988 · Cited by 1
“We refer the reader to the survey in [1, 2, 11] for more explanation methods.”
MethodComputer Science & Information Technology (CS & IT)
(2020) · doi:10.5121/csit.2020.1015 · Cited by 1
Counterfactual explanations for machine learning models on heterogeneous data
Wang, Y. (2023) · doi:10.32657/10356/169968 · Cited by 1
Félix, E., Amadieu, F., & Broisin, J. (2024) · Research Square · doi:10.21203/rs.3.rs-3888008/v1 · Cited by 1
Explainable Artificial Intelligence across Domains: Refinement of SHAP and Practical Applications
Kovvuri, V. R. R. (2024) · Cronfa (Swansea University) · doi:10.23889/suthesis.67149 · Cited by 2
Unbiased learning of protein conformational representation via unsupervised random forestPreprint
Sahil, M., Ahalawat, N., & Mondal, J. (2024) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2024.11.30.626148 · Cited by 1
Do's and Don'ts for Human and Digital Worker IntegrationPreprint
Muthusamy, V., Unuvar, M., Völzer, H., & Weisz, J. D. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.07738 · Cited by 5
(2021) · PeerJ Computer Science · doi:10.7287/peerj-cs.479v0.2/reviews/1
“…machines (Srinivasan et al., 2019), time series (Karlsson et al., 2019), multi-labelled and ontology-linked data (Panigutti et al., 2020b) or logic problems (Biecek, 2018); software toolkits including the implementation of various XAI algorithms have been also introduced (Arya et al., 2019).”
de Pereira, J. R. L. (2021) · DOAJ (DOAJ: Directory of Open Access Journals)
Exploring User’s Perception of Explainability of Blocked Content in Online Social Network Services
Alsulami, M. M. (2022) · International Conference on Engineering and Emerging Technologies (ICEET) · doi:10.1109/iceet56468.2022.10007278 · Cited by 2
“It is essential to address that there are diverse types of explanations as mentioned in [6].”
BackgroundBeyond Predictions: Explainability and Learning from Machine Learning
Deng, C.-Y., Mitani, A., Chen, C., Peng, L. H., Hammel, N., & Liu, Y. (2023) · Springer eBooks · doi:10.1007/978-3-031-24052-2_15
teex: A toolbox for the evaluation of explanations
Antoñanzas, J. M., Jia, Y., Frank, E., Bifet, A., & Pfahringer, B. (2023) · Neurocomputing · doi:10.1016/j.neucom.2023.126642
“…specializing in generating explanations ( Alibi [6], dalex [7], iNNvestigate [8], zennit [9]) and libraries that include some evaluation metrics ( Captum [10], AIX360 [11], TorchRay [12]), but there is relatively little comprehensive tool support for the streamlined evaluation of XAI techniques.”
Miro, M. E., Resetar, S. A., Hyde, K., Steier, J., Wilson, M. T., Abdurahaman, Z. F., & Wolf, V. (2023) · RAND Corporation eBooks · doi:10.7249/rra2846-1
Reséndez, V., Araujo, T., Helberger, N., & de Vreese, C. H. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4678521
Machine Learning Prediction of Stroke Occurrence: A Systematic ReviewPreprint
Lolak, S., Suppasilp, C., Poprom, N., Sapankaew, T., Yin, M. S., Thammasudjarit, R., McKay, G. J., Attia, J., & Thakkinstian, A. (2024) · medRxiv · doi:10.1101/2024.03.28.24305014
Digital Transformation Using Industry 4.0 and Artificial Intelligence
Keerthika, M., Pragadeesh, M., Santhiya, M., Jebamalar, G. B., & Venu, H. (2024) · Wiley eBooks · doi:10.1002/9781394216147.ch2 · Cited by 1
(2024) · Advances in public policy and administration (APPA) book series · doi:10.4018/979-8-3693-0507-2.ch001
Learning About Explainable AI with Very Little Programming
Dodge, J. E., Diawuo, A., Dai, E., & Das, R. K. (2024) · Springer eBooks · doi:10.1007/978-3-031-61290-9_10
Abstracting General Syntax for XAI after Decomposing Explanation Sub-ComponentsPreprint
Wormald, S. E., Maldaner, M. K., O'Connor, K., Dizon-Paradis, O. P., & Woodard, D. L. (2024) · Research Square · doi:10.21203/rs.3.rs-4824427/v1
Raymond, C., Ratté, S., & Daoust, M. (2024) · IEEE International Conference on Collaborative Advances in Software and Computing (CASCON) · doi:10.1109/cascon62161.2024.10837695
Challenges and Future Perspectives in Explainable AI A Roadmap for New Scholars
Sil, C., Ghosh, P., Das, S., & Mondal, M. A. (2025) · International Conference on Intelligent Systems, Advanced Computing and Communication (ISACC) · doi:10.1109/isacc65211.2025.10969376
“Interpretability builds user confidence and trust in these systems ( [4], [5], [6]).”
Yaganti, D. (2024) · International Journal of Advanced Research in Science Communication and Technology · doi:10.48175/ijarsct-19200a
Explabox: A Python Toolkit for Standardized Auditing and Explanation of Text Models
Robeer, M., Bron, M. P., Herrewijnen, E., Hoeseni, R., & Bex, F. (2025) · The Journal of Open Source Software · doi:10.21105/joss.08253
“…in a model-agnostic manner often have to combine multiple, highly-specialized libraries, such as AIF360 (Bellamy et al., 2018) for fairness metrics, alibi explain (Klaise et al., 2021) or AIX360 (Arya et al., 2019) for local explanations, and CheckList (Ribeiro et al., 2020) for behavioral testing.”
Impact of Interactive Interface Explainability on User Acceptance of AI-Generated Logos
Li, J., & Min, J.-K. (2026) · Journal of Digital Contents Society · doi:10.9728/dcs.2026.27.3.699
Evaluating the Quality of Generative AI Explanations: A Mathematics Perspective
Stulianec, A., & Fortis, A. (2026) · Lecture notes on data engineering and communications technologies · doi:10.1007/978-3-032-22798-0_12
Evaluating Actionability in Explainable AI
Mansi, G., Kim, J., & Riedl, M. O. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-30849-8_5 · Cited by 1
Issues and Challenges in Multimodal Sentiment Analysis
Singh, P., Lavania, R., Alam, M., Shahid, M., & Lapin, V. G. (2026) · Lecture notes in networks and systems · doi:10.1007/978-3-032-27834-0_58
Metadata
- Authors
- Arya, V., Bellamy, R. K. E., Chen, P.-Y., Dhurandhar, A., Hind, M., Hoffman, S. C., Houde, S., Liao, Q. V., Luss, R., Mojsilović, A., Mourad, S., Pedemonte, P., Raghavendra, R., Richards, J., Sattigeri, P., Shanmugam, K., Singh, M., Varshney, K. R., Wei, D., & Zhang, Y.
- ORCID
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2019
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1909.03012
- OpenAlex
- W2972059645
- Semantic Scholar
- c57a28759b6e1ddd7be03fa41e82b01130c8f8b2
- Cited by
- 268
- References
- 46
- Citations by year
- 2026: 6 · 2025: 20 · 2024: 46 · 2023: 42 · 2022: 51 · 2021: 71 · 2020: 30 · 2019: 2
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Physical Sciences › Computer Science › Software › Software Testing and Debugging Techniques
- Keywords
- explainable AI, explainability evaluation metrics, open source software, explainability requirements
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-10-09, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-09 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
