The DOI matches its Crossref record; 32 of the 32 references it cites were found in a registry or an index.
Right for the Right Reasons: Training Differentiable Models by Constraining their Explanations
Open accessAbstract
Expressive classifiers such as neural networks are among the most accurate supervised learning methods in use today, but their opaque decision boundaries make them difficult to trust in critical applications. We propose a method to explain the predictions of any differentiable model via the gradient of the class label with respect to the input (which provides a normal to the decision boundary). Not only is this approach orders of magnitude faster at identifying input dimensions of high sensitivity than sample-based perturbation methods (e.g. LIME), but it also lends itself to efficiently discovering multiple qualitatively different decision boundaries as well as decision boundaries that are consistent with expert annotation. On multiple datasets, we show our approach generalizes much better when test conditions differ from those in training.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Some papers already optimize for interpretability by using a regularization term or objective function during training of the predictive model (e.g., [33,137,191,211,244,276,277,289]) or by relating rewards to explainability and presentation quality in reinforcement learning (e.g., [268]).”
From From Anecdotal Evidence to Quantitative Evaluation Methods: A Systematic Review on Evaluating Explainable AI (2023) · cites this paper as [211]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
UCI Machine Learning Repository
Asuncion, A. (2007) · Medical Entomology and Zoology · Cited by 24,190
"Why Should I Trust You?": Explaining the Predictions of Any Classifier
Ribeiro, M. T., Singh, S., & Guestrin, C. (2016) · Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2939672.2939778 · Cited by 17,555
Visualizing and understanding convolutional networks
Zeiler, M. D., & Fergus, R. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10590-1_53 · Cited by 15,839
Lipton, Z. C. (2018) · Queue · doi:10.1145/3236386.3241340 · Cited by 5,427
Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Maps
Simonyan, K., Vedaldi, A., & Zisserman, A. (2013) · arXiv · doi:10.48550/arxiv.1312.6034 · Cited by 5,370
On Pixel-Wise Explanations for Non-Linear Classifier Decisions by Layer-Wise Relevance Propagation
Bach, S., Binder, A., Montavon, G., Klauschen, F., Müller, K.-R., & Samek, W. (2015) · PLOS ONE · doi:10.1371/journal.pone.0130140 · Cited by 4,524
Dwork, C., Hardt, M., Pitassi, T., Reingold, O., & Zemel, R. (2012) · Proceedings of the 3rd Innovations in Theoretical Computer Science Conference · doi:10.1145/2090236.2090255 · Cited by 3,501
Distillation as a Defense to Adversarial Perturbations Against Deep Neural Networks
Papernot, N., McDaniel, P. D., Wu, X., Jha, S., & Swami, A. (2016) · IEEE Symposium on Security and Privacy (S&P) · doi:10.1109/sp.2016.41 · Cited by 3,234
Towards A Rigorous Science of Interpretable Machine Learning
Doshi-Velez, F., & Kim, B. (2017) · arXiv · doi:10.48550/arxiv.1702.08608 · Cited by 3,121
Self-citation
Flagged first, then by citations
Research works printed but not linked: 4
- David Baehrens, Timon Schroeter, Stefan Harmeling, Motoaki Kawanabe, Katja Hansen, and Klaus-Robert Müller. How to explain individual classification decisions. Journal of Machine Learning Research, 11(Jun):1803-1831, 2010.
- Fong and Vedaldi, 2017] Ruth Fong and Andrea Vedaldi. Inter- pretable explanations of black boxes by meaningful perturbation. arXiv preprint arXiv:1704.03296, 2017. · arXiv
- Tao Lei, Regina Barzilay, and Tommi Jaakkola. Ra- tionalizing neural predictions. arXiv preprint arXiv:1606.04155, 2016. · arXiv
- Zachary C Lipton. The mythos of model inter- pretability. arXiv preprint arXiv:1606.03490, 2016. · arXiv
Cited by
Sorted by citations
Items 101–200 of 511
A Human-Grounded Evaluation Benchmark for Local Explanations of Machine LearningPreprint
Mohseni, S., Block, J. E., & Ragan, E. D. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1801.05075 · Cited by 80
Regularizing Black-box Models for Improved InterpretabilityPreprint
Plumb, G., Al-Shedivat, M., Cabrera, Á. A., Perer, A., Xing, E. P., & Talwalkar, A. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1902.06787 · Cited by 53
Machine Learning and Prediction in Psychological Assessment
Fokkema, M., Iliescu, D., Greiff, S., & Ziegler, M. D. (2022) · European Journal of Psychological Assessment · doi:10.1027/1015-5759/a000714 · Cited by 63
An explainable AI framework for robust and transparent data-driven wind turbine power curve models
Letzgus, S., & Müller, K. (2023) · Energy and AI · doi:10.1016/j.egyai.2023.100328 · Cited by 48
QED: A Framework and Dataset for Explanations in Question Answering
Lamm, M., Palomaki, J., Alberti, C., Andor, D., Choi, E., Soares, L. B., & Collins, M. (2021) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00398 · Cited by 59
Bourgeais, V., Zehraoui, F., Hamdoune, M. B., & Hanczar, B. (2021) · BMC Bioinformatics · doi:10.1186/s12859-021-04370-7 · Cited by 49
Remembering for the right reasons: Explanations reduce catastrophic forgetting
Ebrahimi, S., Petryk, S., Gokul, A., Gan, W., Gonzalez, J. E., Rohrbach, M., & Darrell, T. (2021) · Applied AI Letters · doi:10.1002/ail2.44 · Cited by 43
Gradient-based Analysis of NLP Models is Manipulable
Wang, J., Tuyls, J., Wallace, E., & Singh, S. (2020) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2020.findings-emnlp.24 · Cited by 56
MARTA: Leveraging Human Rationales for Explainable Text Classification
Arous, I., Dolamic, L., Yang, J., Bhardwaj, A., Cuccu, G., & Cudré-Mauroux, P. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i7.16734 · Cited by 45
Hase, P., & Bansal, M. (2022) · LNLS · doi:10.18653/v1/2022.lnls-1.4 · Cited by 71
Attention Calibration for Transformer-based Sequential Recommendation
Zhou, P., Ye, Q., Xie, Y., Gao, J., Wang, S., Kim, J. B., You, C., & Kim, S. (2023) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3583780.3614785 · Cited by 39
Obtaining Faithful Interpretations from Compositional Neural Networks
Subramanian, S., Bogin, B., Gupta, N., Wolfson, T., Singh, S., Berant, J., & Gardner, M. (2020) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2020.acl-main.495 · Cited by 44
Defining Explainable AI for Requirements Analysis
Sheh, R., & Monteath, I. (2018) · Künstliche Intell. · doi:10.1007/s13218-018-0559-3 · Cited by 44
ILIME: Local and Global Interpretable Model-Agnostic Explainer of Black-Box Decision
Elshawi, R., Mohamed, Y., Al-Mallah, M., & Sakr, S. (2019) · Symposium on Advances in Databases and Information Systems · doi:10.1007/978-3-030-28730-6_4 · Cited by 45
Answer Questions with Right Image Regions: A Visual Attention Regularization Approach
Liu, Y., Guo, Y., Yin, J., Song, X., Liu, W., Nie, L., & Zhang, M. (2022) · ACM Transactions on Multimedia Computing Communications and Applications · doi:10.1145/3498340 · Cited by 40
Teney, D., Abbasnejad, E., Lucey, S., & van den Hengel, A. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01626 · Cited by 39
Attention-Aligned Transformer for Image Captioning
Fei, Z. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i1.19940 · Cited by 37
Regional Tree Regularization for Interpretability in Deep Neural Networks
Wu, M., Parbhoo, S., Hughes, M., Kindle, R., Celi, L., Zazzi, M., Roth, V., & Doshi-Velez, F. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i04.6112 · Cited by 38
Self-citationExplainable Models with Consistent Interpretations
Pillai, V., & Pirsiavash, H. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i3.16344 · Cited by 38
QLIME-A Quadratic Local Interpretable Model-Agnostic Explanation Approach
Bramhall, S., Horn, H., Tieu, M., & Lohia, N. (2020) · SMU Scholar (Southern Methodist University) · Cited by 35
MultiplexNet: Towards Fully Satisfied Logical Constraints in Neural Networks
Hoernle, N., Karampatsis, R.-M., Belle, V., & Gal, K. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i5.20512 · Cited by 47
GNES: Learning to Explain Graph Neural Networks
Gao, Y., Sun, T., Bhatt, R., Yu, D., Hong, S.-S., & Zhao, L. (2021) · Proceedings · doi:10.1109/icdm51629.2021.00023 · Cited by 34
Towards Trustable Skin Cancer Diagnosis via Rewriting Model's Decision
Yan, S., Yu, Z. T., Zhang, X., Mahapatra, D., Chandra, S. S., Janda, M., Soyer, H. P., & Ge, Z. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01113 · Cited by 36
Personalized explanation in machine learning: A conceptualizationPreprint
Schneider, J., & Handali, J. P. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1901.00770 · Cited by 69
Adversarial Attacks in Explainable Machine Learning: A Survey of Threats Against Models and Humans
Vadillo, J., Santana, R., & Lozano, J. A. (2024) · Wiley Interdisciplinary Reviews Data Mining and Knowledge Discovery · doi:10.1002/widm.1567 · Cited by 42
Equivariant and Invariant Grounding for Video Question Answering
Li, Y., Wang, X., Xiao, J., & Chua, T. (2022) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3503161.3548035 · Cited by 34
Multimodal Explanations by Predicting Counterfactuality in Videos
Kanehira, A., Takemoto, K., Inayoshi, S., & Harada, T. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00879 · Cited by 33
Visual Causal Scene Refinement for Video Question Answering
Wei, Y.-S., Liu, Y., Yan, H., Li, G., & Lin, L. (2023) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3581783.3611873 · Cited by 40
Wu, X., Li, L., Tao, X., Yuan, J., & Xie, H. (2025) · IEEE Transactions on Emerging Topics in Computational Intelligence · doi:10.1109/tetci.2025.3537918 · Cited by 33
RES: A Robust Framework for Guiding Visual Explanation
Gao, Y., Sun, T., Bai, G., Gu, S., Hong, S. R., & Liang, Z. (2022) · Knowledge Discovery and Data Mining · doi:10.1145/3534678.3539419 · Cited by 40
On Validating, Repairing and Refining Heuristic ML ExplanationsPreprint
Ignatiev, A., Narodytska, N., & Marques-Silva, J. (2019) · arXiv.org · doi:10.48550/arxiv.1907.02509 · Cited by 80
Mir, A. N., & Rizvi, D. R. (2025) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2025.111413 · Cited by 34
Rationalizing Text Matching: Learning Sparse Alignments via Optimal Transport
Swanson, K., Yu, L., & Lei, T. (2020) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2020.acl-main.496 · Cited by 37
Explainable Machine Learning with Prior Knowledge: An Overview
Beckh, K., Müller, S., Jakobs, M., Toborek, V., Tan, H., Fischer, R., Welke, P., Houben, S., & von Rueden, L. (2021) · Lancaster EPrints (Lancaster University) · doi:10.48550/arxiv.2105.10172 · Cited by 52
Balayn, A., Soilis, P., Lofi, C., Yang, J., & Bozzon, A. (2021) · International World Wide Web Conference (WWW) · doi:10.1145/3442381.3450069 · Cited by 32
Linder, R., Mohseni, S., Yang, F., Pentyala, S., Ragan, E. D., & Hu, X. (2021) · Applied AI Letters · doi:10.1002/ail2.49 · Cited by 30
A Survey on Explainability in Machine Reading ComprehensionPreprint
Thayaparan, M., Valentino, M., & Freitas, A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.00389 · Cited by 54
Multi-task learning with dynamic re-weighting to achieve fairness in healthcare predictive modeling
Li, C., Ding, S., Zou, N., Hu, X., Jiang, X., & Zhang, K. (2023) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2023.104399 · Cited by 31
Happiness Prediction With Domain Knowledge Integration and Explanation Consistency
Wu, X., Li, L., Tao, X., Xing, F., & Yuan, J. (2025) · IEEE Transactions on Computational Social Systems · doi:10.1109/tcss.2025.3529946 · Cited by 29
Freedom at Work: Understanding, Alienation, and the AI-Driven Workplace
Vredenburgh, K. (2022) · Canadian Journal of Philosophy · doi:10.1017/can.2021.39 · Cited by 28
Explanatory Interactive Machine Learning
Pfeuffer, N., Baum, L., Stammer, W., Abdel-Karim, B. M., Schramowski, P., Bucher, A. M., Hügel, C., Rohde, G. G. U., Kersting, K., & Hinz, O. F. (2023) · Business & Information Systems Engineering · doi:10.1007/s12599-023-00806-x · Cited by 38
Visual Question Answering: A Survey of Methods, Datasets, Evaluation, and Challenges
Kim, B. S., Kim, J., Lee, D., & Jang, B. (2025) · ACM Computing Surveys · doi:10.1145/3728635 · Cited by 38
Towards Robust Classification Model by Counterfactual and Invariant Data Generation
Chang, C., Adam, G. A., & Goldenberg, A. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.01496 · Cited by 31
Interpreting Deep Learning Models in Natural Language Processing: A ReviewPreprint
Sun, X., Yang, D., Li, X., Zhang, T., Meng, Y., Qiu, H., Wang, G., Hovy, E. H., & Li, J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.10470 · Cited by 64
From AI to the Era of Explainable AI in Healthcare 5.0: Current State and Future Outlook
Rahman, A., Kundu, D., Debnath, T., Rahman, M., Das, U. K., Miah, A. S. M., & Muhammad, G. (2025) · Expert Systems · doi:10.1111/exsy.70060 · Cited by 28
Deceptive AI Explanations: Creation and Detection
Schneider, J., Meske, C., & Vlachos, M. (2022) · International Conference on Agents and Artificial Intelligence (ICAART) · doi:10.5220/0010768300003116 · Cited by 27
Shapley Explanation NetworksPreprint
Wang, R., Wang, X., & Inouye, D. I. (2021) · International Conference on Learning Representations · doi:10.48550/arxiv.2104.02297 · Cited by 62
Hybrid Predictive Models: When an Interpretable Model Collaborates with a Black-box ModelPreprint
Wang, T., & Lin, Q. (2021) · arXiv (Cornell University) · Cited by 26
Benefits of Intermediate Annotations in Reading Comprehension
Dua, D., Singh, S., & Gardner, M. (2020) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2020.acl-main.497 · Cited by 26
Towards an Interpretable Approach to Classify and Summarize Crisis Events from Microblogs
Nguyen, T. H., & Rudra, K. (2022) · International World Wide Web Conference (WWW) · doi:10.1145/3485447.3512259 · Cited by 25
Interpretable brain disease classification and relevance-guided deep learning
Tinauer, C., Heber, S., Pirpamer, L., Damulina, A., Schmidt, R., Stollberger, R., Ropele, S., & Langkammer, C. (2022) · Scientific Reports · doi:10.1038/s41598-022-24541-7 · Cited by 26
Feature selection: Key to enhance node classification with graph neural networks
Maurya, S. K., Liu, X., & Murata, T. (2023) · CAAI Transactions on Intelligence Technology · doi:10.1049/cit2.12166 · Cited by 29
Redundancy-aware Transformer for Video Question Answering
Li, Y., Yang, X., Zhang, A., Feng, C., Wang, X., & Chua, T. (2023) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3581783.3612577 · Cited by 24
SoK: Explainable Machine Learning in Adversarial Environments
Noppel, M., & Wressnegger, C. (2024) · IEEE Symposium on Security and Privacy (S&P) · doi:10.1109/sp54263.2024.00021 · Cited by 29
Contextual Semantic Interpretability
Marcos, D., Fong, R., Lobry, S., Flamary, R., Courty, N., & Tuia, D. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-69538-5_22 · Cited by 24
Proceedings of the 17th Python in Science Conference
(2018) · Proceedings of the Python in Science Conferences · doi:10.25080/majora-4af1f417-018 · Cited by 24
Discover-then-Name: Task-Agnostic Concept Bottlenecks via Automated Concept Discovery
Rao, S., Mahajan, S., Böhle, M., & Schiele, B. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72980-5_26 · Cited by 41
Fuzzy logic interpretation of quadratic networks
Fan, F., & Wang, G. (2019) · Neurocomputing · doi:10.1016/j.neucom.2019.09.001 · Cited by 28
Prompt-Driven Latent Domain Generalization for Medical Image Classification
Yan, S., Yu, Z. T., Liu, C., Ju, L., Mahapatra, D., Betz‐Stablein, B., Mar, V., Janda, M., Soyer, H. P., & Ge, Z. (2024) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2024.3443119 · Cited by 22
Embedding deep networks into visual explanations
Qi, Z., Khorram, S., & Li, F. (2020) · Artificial Intelligence · doi:10.1016/j.artint.2020.103435 · Cited by 26
Show or suppress? Managing input uncertainty in machine learning model explanations
Wang, D., Zhang, W., & Lim, B. Y. (2021) · Artificial Intelligence · doi:10.1016/j.artint.2021.103456 · Cited by 24
Harnessing Prior Knowledge for Explainable Machine Learning: An Overview
Beckh, K., Müller, S., Jakobs, M., Toborek, V., Tan, H., Fischer, R., Welke, P., Houben, S., & von Rueden, L. (2023) · IEEE Conference on Secure and Trustworthy Machine Learning (SaTML) · doi:10.1109/satml54575.2023.00038 · Cited by 23
Reveal to Revise: An Explainable AI Life Cycle for Iterative Bias Correction of Deep Models
Pahde, F., Dreyer, M., Samek, W., & Lapuschkin, S. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-43895-0_56 · Cited by 21
FunnyBirds: A Synthetic Vision Dataset for a Part-Based Analysis of Explainable AI Methods
Hesse, R., Schaub-Meyer, S., & Roth, S. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00368 · Cited by 22
Attention Calibration for Transformer in Neural Machine Translation
Lu, Y., Zeng, J., Zhang, J., Wu, S., & Li, M. (2021) · doi:10.18653/v1/2021.acl-long.103 · Cited by 22
Overinterpretation reveals image classification model pathologiesPreprint
Carter, B., Jain, S., Mueller, J. W., & Gifford, D. K. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.08907 · Cited by 30
A review of machine learning in scanpath analysis for passive gaze-based interaction
Selim, A. M., Barz, M., Bhatti, O. S., Alam, H., & Sonntag, D. (2024) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2024.1391745 · Cited by 29
Optimizing for Interpretability in Deep Neural Networks with Tree Regularization
Wu, M., Parbhoo, S., Hughes, M. C., Röth, V., & Doshi‐Velez, F. (2021) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.12558 · Cited by 32
Self-citation$$\alpha$$ILP: thinking visual scenes as differentiable logic programs
Shindo, H., Pfanschilling, V., Dhami, D. S., & Kersting, K. (2023) · Machine Learning · doi:10.1007/s10994-023-06320-1 · Cited by 21
Wargnier-Dauchelle, V., Grenier, T., Durand‐Dubief, F., Cotton, F., & Sdika, M. (2023) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2023.3282789 · Cited by 21
An Analysis of Attention over Clinical Notes for Predictive Tasks
Jain, S., Mohammadi, R., & Wallace, B. (2019) · Clinical Natural Language Processing Workshop (ClinicalNLP) · doi:10.18653/v1/w19-1902 · Cited by 24
Right for Better Reasons: Training Differentiable Models by Constraining their Influence Functions
Shao, X., Skryagin, A., Stammer, W., Schramowski, P., & Kristian Kersting, B. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i11.17148 · Cited by 20
Thinking Like a Developer? Comparing the Attention of Humans with Neural Models of Code
Paltenghi, M., & Pradel, M. (2021) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase51524.2021.9678712 · Cited by 20
From Demo to Design in Teaching Machine Learning
Bilstrup, K.-E. K., Kaspersen, M. H., Assent, I., Enni, S. A., & Petersen, M. G. (2022) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3531146.3534634 · Cited by 26
Han, T., Tu, W.-W., & Li, Y.-F. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i9.16934 · Cited by 20
Saliency is a Possible Red Herring When Diagnosing Poor GeneralizationPreprint
Viviano, J. D., Simpson, B., Dutil, F., Bengio, Y., & Cohen, J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.00199 · Cited by 23
Interactive Disentanglement: Learning Concepts by Interacting with their Prototype Representations
Stammer, W., Memmel, M., Schramowski, P., & Kristian Kersting, B. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01007 · Cited by 19
Explainable deep learning: concepts, methods, and new developments
Samek, W. (2023) · Elsevier eBooks · doi:10.1016/b978-0-32-396098-4.00008-9 · Cited by 20
Consistent Explanations by Contrastive Learning
Pillai, V., Koohpayegani, S. A., Ouligian, A., Fong, D., & Pirsiavash, H. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00997 · Cited by 19
Ex-Fuzzy: A library for symbolic explainable AI through fuzzy logic programming
Fumanal-Idocin, J., & Andreu-Pérez, J. (2024) · Neurocomputing · doi:10.1016/j.neucom.2024.128048 · Cited by 18
Eldrandaly, K. A., Abdel‐Basset, M., Ibrahim, M., & AbdelAziz, N. M. (2022) · Enterprise Information Systems · doi:10.1080/17517575.2022.2098537 · Cited by 19
On Guiding Visual Attention with Language Specification
Petryk, S., Dunlap, L., Nasseri, K., Gonzalez, J. E., Darrell, T., & Rohrbach, A. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01756 · Cited by 23
Refining Language Models with Compositional ExplanationsPreprint
Yao, H., Chen, Y., Ye, Q., Jin, X., & Ren, X. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.10415 · Cited by 20
A typology for exploring the mitigation of shortcut behaviour
Friedrich, F., Stammer, W., Schramowski, P., & Kersting, K. (2023) · Nature Machine Intelligence · doi:10.1038/s42256-023-00612-w · Cited by 23
Interpreting and Correcting Medical Image Classification with PIP-Net
Nauta, M., Hegeman, J. H., Geerdink, J., Schlötterer, J., van Keulen, M., & Seifert, C. (2024) · Communications in computer and information science · doi:10.1007/978-3-031-50396-2_11 · Cited by 18
Code Gradients: Towards Automated Traceability of LLM-Generated Code
North, M., Atapour–Abarghouei, A., & Bencomo, N. (2024) · IEEE International Requirements Engineering Conference (RE) · doi:10.1109/re59067.2024.00038 · Cited by 18
Han, X., & Tsvetkov, Y. (2021) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2021.findings-emnlp.374 · Cited by 25
Fairness and Bias in Robot Learning
Londoño, L., Hurtado, J. V., Hertz, N., Kellmeyer, P., Vöeneky, S., & Valada, A. (2024) · Proceedings of the IEEE · doi:10.1109/jproc.2024.3403898 · Cited by 43
Kordbagheri, A., Kordbagheri, M., Tayim, N., Fakhrou, A. A., & Davoudi, M. (2024) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2024.109372 · Cited by 19
Singh, N., Lee, K., Coz, D., Angermueller, C., Huang, S. S., Loh, A., & Liu, Y. (2020) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw50498.2020.00376 · Cited by 16
Low-Pass Image Filtering to Achieve Adversarial Robustness
Ziyadinov, V., & Tereshonok, M. V. (2023) · Sensors · doi:10.3390/s23229032 · Cited by 15
On the Connection between Saliency Guided Training and Robustness in Image Classification
Karkehabadi, A., Oftadeh, P., Shafaie, D., & Hassanpour, J. (2024) · International Conference on Intelligent Control and Information Processing · doi:10.1109/icicip60808.2024.10477811 · Cited by 16
Good Teachers Explain: Explanation-Enhanced Knowledge Distillation
Parchami-Araghi, A., Böhle, M., Rao, S., & Schiele, B. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-73464-9_18 · Cited by 20
Huo, Y., Wong, D. F., Ni, L. M.-S., Chao, L. S., & Zhang, J. (2020) · Knowledge-Based Systems · doi:10.1016/j.knosys.2020.106389 · Cited by 15
Supervised Contrastive Learning for Interpretable Long-Form Document Matching
Jha, A., Rakesh, V., Chandrashekar, J., Samavedhi, A., & Reddy, C. K. A. (2022) · ACM Transactions on Knowledge Discovery from Data · doi:10.1145/3542822 · Cited by 20
Learning credible DNNs via incorporating prior knowledge and model local explanation
Du, M., Liu, N., Yang, F., & Hu, X. (2020) · Knowledge and Information Systems · doi:10.1007/s10115-020-01517-5 · Cited by 17
Alakent, B., Kaya-Özkiper, K., & Soyer‐Uzun, S. (2022) · Chemosphere · doi:10.1016/j.chemosphere.2022.136248 · Cited by 14
Deceptive XAI: Typology, Creation and Detection
Schneider, J., Meske, C., & Vlachos, M. (2023) · SN Computer Science · doi:10.1007/s42979-023-02401-z · Cited by 14
Lee, M., Park, T., Shin, J.-Y., & Park, M. (2024) · Scientific Reports · doi:10.1038/s41598-024-68541-1 · Cited by 17
Improve the Deep Learning Models in Forestry Based on Explanations and Expertise
Cheng, X., Doosthosseini, A., & Kunkel, J. M. (2022) · Frontiers in Plant Science · doi:10.3389/fpls.2022.902105 · Cited by 14
Metadata
- Authors
- Ross, A. S., Hughes, M. C., & Doshi-Velez, F.
- Affiliations
- Harvard University (US)
- Harvard University
- Venue
- Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence
- Published
- 2017-08
- Pages
- 2662-2670
- OpenAlex
- W2595017202
- Cited by
- 515
- References
- 31
- Citations by year
- 2026: 34 · 2025: 46 · 2024: 58 · 2023: 73 · 2022: 64 · 2021: 93 · 2020: 67 · 2019: 43 · 2018: 31 · 2017: 5
- FWCI
- 18.21
- Type
- conference paper
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- International Joint Conference on Artificial Intelligence (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- Defense Advanced Research Projects Agency (W911NF-16-1-0561)
- Air Force Office of Scientific Research (FA9550-17, FA9550-, FA9550-17-1, -16-1-)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Physical Sciences › Computer Science › Artificial Intelligence › Adversarial Robustness in Machine Learning
- Physical Sciences › Computer Science › Software › Software Testing and Debugging Techniques
- Keywords
- explainable AI, gradient-based explanation, decision boundaries, neural network interpretability, perturbation method, lime
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
