Explainable AI: Interpreting, Explaining and Visualizing Deep Learning
The DOI matches its Crossref record; 21 of the 21 references it cites were found in a registry or an index.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“One reason why people generally ask for explanations is to create a shared meaning of the decision-making process.”
In the citing paper
“The need for explainability can also be motivated by the social dimension of explanations [33].”
In the citing paper
“In the remainder, we focus on quantitative metrics, which are less well-studied in the literature and are needed for an objective initial assessment of explanation quality and a formal comparison of explanation methods [33].”
In the citing paper
“Moreover, explainers can provide an empty explanation (i.e. without information content) to soothe users or carefully select one suiting their goals [33].”
In the citing paper
“When evaluating post-hoc explanations, the problem is there is no ground truth, as we do not know the real inner workings of the model [33].”
1 more claim about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Visualizing and understanding convolutional networks
Zeiler, M. D., & Fergus, R. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10590-1_53 · Cited by 15,839 · cited 4×
“Other popular explanation methods leveraging the model’s internal structure are Deconvolution [94] and Guided Backprogagation [86].”
MethodInfluentialOn Pixel-Wise Explanations for Non-Linear Classifier Decisions by Layer-Wise Relevance Propagation
Bach, S., Binder, A., Montavon, G., Klauschen, F., Müller, K.-R., & Samek, W. (2015) · PLOS ONE · doi:10.1371/journal.pone.0130140 · Cited by 4,524 · cited 7×
“In Chapter 2, Weller [9] focuses on the challenges of transparency.”
BackgroundMethodInfluentialMethods for interpreting and understanding deep neural networks
Montavon, G., Samek, W., & Müller, K.-R. (2018) · Digital Signal Processing · doi:10.1016/j.dsp.2017.10.011 · Cited by 2,665 · cited 7×
“Furthermore, SA has been shown to suffer from fundamental problems such as gradient shattering and explanation discontinuities, and is therefore considered suboptimal for explanation of today’s AI models [60].”
BackgroundInfluentialConcrete Problems in AI Safety
Amodei, D., Olah, C., Steinhardt, J., Christiano, P., Schulman, J., & Mané, D. (2016) · arXiv · doi:10.48550/arxiv.1606.06565 · Cited by 1,314
Unmasking Clever Hans predictors and assessing what machines really learn
Lapuschkin, S., Wäldchen, S., Binder, A., Montavon, G., Samek, W., & Müller, K.-R. (2019) · Nature Communications · doi:10.1038/s41467-019-08987-4 · Cited by 1,047 · cited 10×
“Under restrictive assumptions, [5] famously proved the existence of a general equilibrium for a competitive economy.”
BackgroundMethodInfluentialLayer-Wise Relevance Propagation: An Overview
Montavon, G., Binder, A., Lapuschkin, S., Samek, W., & Müller, K.-R. (2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-28954-6_10 · Cited by 750 · cited 3×
“Layer-wise Relevance Propagation (LRP) [9,58] provides a general framework for explaining individual predictions, i.”
BackgroundMethodTowards Explainable Artificial Intelligence
Samek, W., & Müller, K.-R. (2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-28954-6_1 · Cited by 580
The (Un)reliability of Saliency Methods
Kindermans, P.-J., Hooker, S., Adebayo, J., Alber, M., Schütt, K. T., Dähne, S., Erhan, D., & Kim, B. (2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-28954-6_14 · Cited by 580
Unmasking Clever Hans predictors and assessing what machines really learn
Lapuschkin, S., Wäldchen, S., Binder, A., Montavon, G., Samek, W., & Müller, K. (2019) · RePEc: Research Papers in Economics · Cited by 580
Towards Reverse-Engineering Black-Box Neural Networks
Oh, S. J., Schiele, B., & Fritz, M. (2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-28954-6_7 · Cited by 291
Transparency: Motivations and Challenges
Weller, A. (2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-28954-6_2 · Cited by 198 · cited 1×
“We refer the reader to [91] for a discussion of the challenges of transparency.”
BackgroundInterpretable Deep Learning in Drug Discovery
Preuer, K., Klambauer, G., Rippmann, F., Hochreiter, S., & Unterthiner, T. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-28954-6_18 · Cited by 165
Explaining and Interpreting LSTMs
Arras, L., Arjona-Medina, J., Widrich, M., Montavon, G., Gillhofer, M., Müller, K.-R., Hochreiter, S., & Samek, W. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-28954-6_11 · Cited by 138 · cited 4×
“Layer-wise Relevance Propagation (LRP) [9,58] is a propagation-based explanation framework, which is applicable to general neural network structures, including deep neural networks [13], LSTMs [5,7], and Fisher Vector classifiers [44].”
BackgroundMethodInfluentialNeuralHydrology – Interpreting LSTMs in Hydrology
Kratzert, F., Herrnegger, M., Klotz, D., Hochreiter, S., & Klambauer, G. (2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-28954-6_19 · Cited by 129
Gradient-Based Vs. Propagation-Based Explanations: An Axiomatic Comparison
Montavon, G. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-28954-6_13 · Cited by 48
Interpretability in Intelligent Systems – A New Concept?
Hansen, L. K., & Rieger, L. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-28954-6_3 · Cited by 48
Quantum-Chemical Insights from Interpretable Atomistic Neural Networks
Schütt, K. T., Gastegger, M., Tkatchenko, A., & Müller, K. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-28954-6_17 · Cited by 46
Understanding Patch-Based Learning of Video Data by Explaining Predictions
Anders, C. J., Montavon, G., Samek, W., & Müller, K. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-28954-6_16 · Cited by 39
Interpretable Text-to-Image Synthesis with Hierarchical Semantic Layout Generation
Hong, S., Yang, D., Choi, J., & Lee, H. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-28954-6_5 · Cited by 5
Unsupervised Discrete Representation Learning
Hu, W., Miyato, T., Tokui, S., Matsumoto, E., & Sugiyama, M. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-28954-6_6 · Cited by 3
Feature Fallacy: Complications with Interpreting Linear Decoding Weights in fMRI
Douglas, P. K., & Anderson, A. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-28954-6_20 · Cited by 3
Cited by
Arrieta, A. B., Díaz-Rodríguez, N., Del Ser, J., Bennetot, A., Tabik, S., Barbado, A., García, S., Gil-López, S., Molina, D., Benjamins, R., et al. (2019) · arXiv · doi:10.48550/arxiv.1910.10045 · Cited by 11,321
Barredo Arrieta, A., Díaz-Rodríguez, N., Del Ser, J., Bennetot, A., Tabik, S., Barbado, A., Garcia, S., Gil-Lopez, S., Molina, D., Benjamins, R., et al. (2020) · Information Fusion · doi:10.1016/j.inffus.2019.12.012 · Cited by 10,423
ArcFace: Additive Angular Margin Loss for Deep Face Recognition
Deng, J., Guo, J., Xue, N., & Zafeiriou, S. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00482 · Cited by 7,781
“Model inversion can not only help researchers to visualize neural networks to understand their properties [69] but also can be used for data-free distillation, quantization and pruning [33], [34], [35].”
BackgroundExplainability for artificial intelligence in healthcare: a multidisciplinary perspective
the Precise4Q consortium, Amann, J., Blasimme, A., Vayena, E., Frey, D., & Madai, V. I. (2020) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-020-01332-6 · Cited by 2,203
XAI—Explainable artificial intelligence
Gunning, D., Stefik, M., Choi, J., Miller, T., Stumpf, S., & Yang, G.-Z. (2019) · Science Robotics · doi:10.1126/scirobotics.aay7120 · Cited by 2,053
Metadata
- Venue
- Lecture Notes in Computer Science
- Publisher
- Springer International Publishing
- Published
- 2019
- ISSN
- 0302-9743 (ISSN-L)
- 1611-3349
- OpenAlex
- W3000716014
- Cited by
- 1,377
- References
- 21
- Citations by year
- 2026: 129 · 2025: 204 · 2024: 244 · 2023: 233 · 2022: 259 · 2021: 205 · 2020: 91 · 2019: 7
- FWCI
- 53.75
- Type
- conference paper
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Lecture notes in computer science (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Physical Sciences › Computer Science › Software › Software Testing and Debugging Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Adversarial Robustness in Machine Learning
- Keywords
- explainable AI, interpretability, deep learning, model visualization, explainable deep learning
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.