Explanations can be manipulated and geometry is to blame

Deep Residual Learning for Image Recognition

He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474 · see citing works

ImageNet classification with deep convolutional neural networks

Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155 · see citing works

Very Deep Convolutional Networks for Large-Scale Image Recognition

Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 74,248 · see citing works

ImageNet Large Scale Visual Recognition Challenge

Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380 · see citing works

Learning Multiple Layers of Features from Tiny Images

Krizhevsky, A. (2024) · doi:10.57702/zp44cu3g · Cited by 23,890 · see citing works

A Unified Approach to Interpreting Model Predictions

Lundberg, S., & Lee, S.-I. (2017) · arXiv · doi:10.48550/arxiv.1705.07874 · Cited by 23,707 · see citing works

"Why Should I Trust You?": Explaining the Predictions of Any Classifier

Ribeiro, M. T., Singh, S., & Guestrin, C. (2016) · Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2939672.2939778 · Cited by 17,555 · see citing works

Visualizing and understanding convolutional networks

Zeiler, M. D., & Fergus, R. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10590-1_53 · Cited by 15,839 · see citing works

Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Maps

Simonyan, K., Vedaldi, A., & Zisserman, A. (2013) · arXiv · doi:10.48550/arxiv.1312.6034 · Cited by 5,370 · see citing works

On Pixel-Wise Explanations for Non-Linear Classifier Decisions by Layer-Wise Relevance Propagation

Bach, S., Binder, A., Montavon, G., Klauschen, F., Müller, K.-R., & Samek, W. (2015) · PLOS ONE · doi:10.1371/journal.pone.0130140 · Cited by 4,524 · see citing works

Axiomatic attribution for deep networks

Sundararajan, M., Taly, A., & Yan, Q. (2017) · arXiv · doi:10.48550/arxiv.1703.01365 · Cited by 4,087 · see citing works

Striving for Simplicity: The All Convolutional Net

Springenberg, J. T., Dosovitskiy, A., Brox, T., & Riedmiller, M. (2014) · arXiv · doi:10.48550/arxiv.1412.6806 · Cited by 3,447 · see citing works

Learning Important Features Through Propagating Activation Differences

Shrikumar, A., Greenside, P., & Kundaje, A. (2017) · arXiv · doi:10.48550/arxiv.1704.02685 · Cited by 2,761 · see citing works

SmoothGrad: removing noise by adding noise

Smilkov, D., Thorat, N., Kim, B., Viégas, F., & Wattenberg, M. (2017) · arXiv · doi:10.48550/arxiv.1706.03825 · Cited by 1,467 · see citing works

Explaining nonlinear classification decisions with deep taylor decomposition

Montavon, G., Lapuschkin, S., Binder, A., Samek, W., & Müller, K.-R. (2017) · Pattern Recognition · doi:10.1016/j.patcog.2016.11.008 · Cited by 1,357 · see citing works

Interpretability Beyond Feature Attribution: Quantitative Testing with Concept Activation Vectors (TCAV)

Kim, B., Wattenberg, M., Gilmer, J., Cai, C., Wexler, J., Viegas, F., & Sayres, R. (2017) · arXiv · doi:10.48550/arxiv.1711.11279 · Cited by 1,240 · see citing works

Unmasking Clever Hans predictors and assessing what machines really learn

Lapuschkin, S., Wäldchen, S., Binder, A., Montavon, G., Samek, W., & Müller, K.-R. (2019) · Nature Communications · doi:10.1038/s41467-019-08987-4 · Cited by 1,047 · see citing works

Interpretation of Neural Networks Is Fragile

Ghorbani, A., Abid, A., & Zou, J. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33013681 · Cited by 765 · see citing works

How to Explain Individual Classification DecisionsPreprint

Baehrens, D., Schroeter, T. S., Stefan Harmeling, B., Kawanabe, M., Hansen, K., & Mueller, K.-R. (2009) · arXiv (Cornell University) · doi:10.48550/arxiv.0912.1128 · Cited by 743 · see citing works

The (Un)reliability of Saliency Methods

Kindermans, P.-J., Hooker, S., Adebayo, J., Alber, M., Schütt, K. T., Dähne, S., Erhan, D., & Kim, B. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-28954-6_14 · Cited by 652 · see citing works

Towards better understanding of gradient-based attribution methods for Deep Neural NetworksPreprint

Ancona, M., Ceolini, E., Öztireli, C., & Groß, M. H. (2017) · Zurich Open Repository and Archive (University of Zurich) · doi:10.3929/ethz-b-000249929 · Cited by 634 · see citing works

Visualizing Deep Neural Network Decisions: Prediction Difference Analysis

Zintgraf, L. M., Cohen, T. S., Adel, T., & Welling, M. (2017) · arXiv · doi:10.48550/arxiv.1702.04595 · Cited by 487 · see citing works

Real Time Image Saliency for Black Box ClassifiersPreprint

Dabkowski, P., & Gal, Y. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1705.07857 · Cited by 404 · see citing works

Learning how to explain neural networks: PatternNet and PatternAttributionPreprint

Kindermans, P.-J., Schütt, K. T., Alber, M., Müller, K. R., Erhan, D., Kim, B., & Dähne, S. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1705.05598 · Cited by 325 · see citing works

A Survey on Explainable Artificial Intelligence (XAI): Toward Medical XAI

Tjoa, E., & Guan, C. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.3027314 · Cited by 2,524 · see citing works

Explaining Deep Neural Networks and Beyond: A Review of Methods and Applications

Samek, W., Montavon, G., Lapuschkin, S., Anders, C. J., & Muller, K.-R. (2021) · Proceedings of the IEEE · doi:10.1109/jproc.2021.3060483 · Cited by 1,477 · see citing works

A Unifying Review of Deep and Shallow Anomaly Detection

Ruff, L., Kauffmann, J., Vandermeulen, R. A., Montavon, G., Samek, W., Kloft, M., Dietterich, T. G., & Muller, K.-R. (2021) · Proceedings of the IEEE · doi:10.1109/jproc.2021.3052449 · Cited by 1,080 · see citing works

A Survey on Neural Network Interpretability

Zhang, Y., Tino, P., Leonardis, A., & Tang, K. (2021) · IEEE Transactions on Emerging Topics in Computational Intelligence · doi:10.1109/tetci.2021.3100641 · Cited by 923 · see citing works

Fooling LIME and SHAP: Adversarial Attacks on Post hoc Explanation Methods

Slack, D., Hilgard, S., Jia, E., Singh, S., & Lakkaraju, H. (2020) · Proceedings of the AAAI/ACM Conference on AI, Ethics, and Society · doi:10.1145/3375627.3375830 · Cited by 900 · see citing works

Explainable machine learning in deployment

Bhatt, U., Xiang, A., Sharma, S., Weller, A., Taly, A., Jia, Y., Ghosh, J., Puri, R., Moura, J. M. F., & Eckersley, P. (2020) · Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency · doi:10.1145/3351095.3375624 · Cited by 633 · see citing works

Obtaining genetics insights from deep learning via explainable artificial intelligence

Novakovsky, G., Dexter, N., Libbrecht, M. W., Wasserman, W. W., & Mostafavi, S. (2022) · Nature Reviews Genetics · doi:10.1038/s41576-022-00532-2 · Cited by 387 · see citing works

A Survey of Algorithmic Recourse: Contrastive Explanations and Consequential Recommendations

Karimi, A.-H., Barthe, G., Schölkopf, B., & Valera, I. (2023) · ACM Computing Surveys · doi:10.1145/3527848 · Cited by 301 · see citing works

Anti-Adversarially Manipulated Attributions for Weakly and Semi-Supervised Semantic Segmentation

Lee, J., Kim, E., & Yoon, S. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00406 · Cited by 291 · see citing works

Higher-Order Explanations of Graph Neural Networks via Relevant Walks

Schnake, T., Eberle, O., Lederer, J., Nakajima, S., Schütt, K. T., Müller, K., & Montavon, G. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3115452 · Cited by 289 · see citing works

The Disagreement Problem in Explainable Machine Learning: A Practitioner's PerspectivePreprint

Krishna, S., Han, T., Gu, A., Jabbari, S., Wu, Z. S., & Lakkaraju, H. (2023) · Research Square · doi:10.21203/rs.3.rs-2963888/v1 · Cited by 279 · see citing works

Recent Advances in Trustworthy Explainable Artificial Intelligence: Status, Challenges, and Perspectives

Rawal, A., McCoy, J., Rawat, D. B., Sadler, B. M., & Amant, R. S. (2021) · IEEE Transactions on Artificial Intelligence · doi:10.1109/tai.2021.3133846 · Cited by 243 · see citing works

"How do I fool you?": Manipulating User Trust via Misleading Black Box Explanations

Lakkaraju, H., & Bastani, O. (2020) · Proceedings of the AAAI/ACM Conference on AI, Ethics, and Society · doi:10.1145/3375627.3375833 · Cited by 241 · see citing works

Making deep neural networks right for the right scientific reasons by interacting with their explanations

Schramowski, P., Stammer, W., Teso, S., Brugger, A., Herbert, F., Shao, X., Luigs, H.-G., Mahlein, A.-K., & Kersting, K. (2020) · Nature Machine Intelligence · doi:10.1038/s42256-020-0212-3 · Cited by 207 · see citing works

Adversarial attacks and defenses in explainable artificial intelligence: A survey

Baniecki, H., & Biecek, P. (2024) · Information Fusion · doi:10.1016/j.inffus.2024.102303 · Cited by 204 · see citing works

Evaluating Explanation Methods for Deep Learning in Security

Warnecke, A., Arp, D., Wressnegger, C., & Rieck, K. (2020) · IEEE European Symposium on Security and Privacy · doi:10.1109/eurosp48549.2020.00018 · Cited by 152 · see citing works

Explainability and Interpretability in Electric Load Forecasting Using Machine Learning Techniques – A Review

Baur, L., Ditschuneit, K., Schambach, M., Kaymakci, C., Wollmann, T., & Sauer, A. (2024) · Energy and AI · doi:10.1016/j.egyai.2024.100358 · Cited by 141 · see citing works

Toward Explainable Artificial Intelligence for Regression Models: A methodological perspective

Letzgus, S., Wagner, P., Lederer, J., Samek, W., Müller, K., & Montavon, G. (2022) · IEEE Signal Processing Magazine · doi:10.1109/msp.2022.3153277 · Cited by 129 · see citing works

Black Box Attacks on Explainable Artificial Intelligence(XAI) methods in Cyber Security

Kuppa, A., & Le-Khac, N.-A. (2020) · 2020 International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn48605.2020.9206780 · Cited by 123 · see citing works

Toward Transparent AI: A Survey on Interpreting the Inner Structures of Deep Neural Networks

Räuker, T., Ho, A., Casper, S., & Hadfield-Menell, D. (2023) · 2023 IEEE Conference on Secure and Trustworthy Machine Learning (SaTML) · doi:10.1109/satml54575.2023.00039 · Cited by 122 · see citing works

Robust Explainability: A tutorial on gradient-based attribution methods for deep neural networks

Nielsen, I. E., Dera, D., Rasool, G., Ramachandran, R. P., & Bouaynaya, N. C. (2022) · IEEE Signal Processing Magazine · doi:10.1109/msp.2022.3142719 · Cited by 115 · see citing works

Guided Integrated Gradients: an Adaptive Path Method for Removing Noise

Kapishnikov, A., Venugopalan, S., Avci, B., Wedin, B., Terry, M. A., & Bolukbasi, T. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00501 · Cited by 113 · see citing works

Survey on Explainable AI: Techniques, challenges and open issues

Abusitta, A., Li, M. Q., & Fung, B. C. M. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2024.124710 · Cited by 98 · see citing works

Reliable Post hoc Explanations: Modeling Uncertainty in ExplainabilityPreprint

Slack, D., Hilgard, S., Singh, S., & Lakkaraju, H. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2008.05030 · Cited by 85 · see citing works

Explaining Explanations: Axiomatic Feature Interactions for Deep NetworksPreprint

Janizek, J. D., Sturmfels, P., & Lee, S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.04138 · Cited by 84 · see citing works

SoK: Explainable Machine Learning for Computer Security Applications

Nadeem, A., Vos, D., Cao, C., Pajola, L., Dieck, S., Baumgartner, R., & Verwer, S. (2023) · IEEE European Symposium on Security and Privacy · doi:10.1109/eurosp57164.2023.00022 · Cited by 79 · see citing works

Beyond Post hoc Explanations: A Comprehensive Framework for Accountable AI in Medical Imaging Through Transparency, Interpretability, and Explainability

Singh, Y., Hathaway, Q. A., Keishing, V., Salehi, S., Wei, Y., Horvat, N., Vera-Garcia, D. V., Choudhary, A., Mula Kh, A., Quaia, E., et al. (2025) · Bioengineering · doi:10.3390/bioengineering12080879 · Cited by 72 · see citing works

Invertible Concept-based Explanations for CNN Models with Non-negative Concept Activation Vectors

Zhang, R., Madumal, P., Miller, T., Ehinger, K. A., & Rubinstein, B. I. P. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i13.17389 · Cited by 70 · see citing works

Toward Interpretable Machine Learning: Transparent Deep Neural Networks and BeyondPreprint

Samek, W., Montavon, G., Lapuschkin, S., Anders, C. J., & Müller, K. (2020) · arXiv (Cornell University) · Cited by 70 · see citing works

A review of visualisation-as-explanation techniques for convolutional neural networks and their evaluation

Mohamed, E., Sirlantzis, K., & Howells, G. (2022) · Displays · doi:10.1016/j.displa.2022.102239 · Cited by 67 · see citing works

Exploring Evaluation Methods for Interpretable Machine Learning: A Survey

Alangari, N., Menaï, M. E. B., Mathkour, H. I., & Almosallam, I. A. (2023) · Information · doi:10.3390/info14080469 · Cited by 65 · see citing works

Application and Potential of Artificial Intelligence in Heart Failure: Past, Present, and Future

Yoon, M., Park, J. J., Hur, T., Hua, C.-H., Hussain, M., Lee, S., & Choi, D. (2023) · International Journal of Heart Failure · doi:10.36628/ijhf.2023.0050 · Cited by 63 · see citing works

Shapley explainability on the data manifoldPreprint

Frye, C., de Mijolla, D., Begley, T., Cowton, L., Stanley, M., & Feige, I. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.01272 · Cited by 63 · see citing works

Fairness via Explanation Quality

Dai, J. C., Upadhyay, S., Aïvodji, U., Bach, S. H., & Lakkaraju, H. (2022) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1145/3514094.3534159 · Cited by 62 · see citing works

You shouldn’t trust me: Learning models which conceal unfairness from multiple explanation methods.

Dimanov, B., Bhatt, U., Jamnik, M., & Weller, A. (2020) · Apollo (University of Cambridge) · doi:10.17863/cam.48825 · Cited by 58 · see citing works

An Experimental Study of Quantitative Evaluations on Saliency Methods

Li, X., Shi, Y., Li, H., Bai, W., Cao, C. C., & Chen, L. (2021) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3447548.3467148 · Cited by 57 · see citing works

Self-explaining AI as an Alternative to Interpretable AI

Elton, D. C. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-52152-3_10 · Cited by 57 · see citing works

XAI Handbook: Towards a Unified Framework for Explainable AI

Palacio, S., Lucieri, A., Munir, M., Ahmed, S., Hees, J., & Dengel, A. R. (2021) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw54120.2021.00420 · Cited by 56 · see citing works

Leveraging explanations in interactive machine learning: An overview

Teso, S., Alkan, Ö., Stammer, W., & Daly, E. (2023) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2023.1066049 · Cited by 55 · see citing works

Towards robust explanations for deep neural networks

Dombrowski, A.-K., Anders, C. J., Müller, K., & Kessel, P. (2021) · Pattern Recognition · doi:10.1016/j.patcog.2021.108194 · Cited by 52 · see citing works

BMB-LIME: LIME with modeling local nonlinearity and uncertainty in explainability

Hung, Y.-H., & Lee, C. (2024) · Knowledge-Based Systems · doi:10.1016/j.knosys.2024.111732 · Cited by 51 · see citing works

Gradient-based Analysis of NLP Models is Manipulable

Wang, J., Tuyls, J., Wallace, E., & Singh, S. (2020) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2020.findings-emnlp.24 · Cited by 48 · see citing works

Adversarial Attacks and Defenses

Liu, N., Du, M., Guo, R., Liu, H., & Hu, X. (2021) · ACM SIGKDD Explorations Newsletter · doi:10.1145/3468507.3468519 · Cited by 47 · see citing works

Anti-Adversarially Manipulated Attributions for Weakly Supervised Semantic Segmentation and Object Localization

Lee, J., Kim, E., Mok, J., & Yoon, S. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3166916 · Cited by 45 · see citing works

Robust and Stable Black Box ExplanationsPreprint

Lakkaraju, H., Arsov, N., & Bastani, O. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.06169 · Cited by 45 · see citing works

Revisiting the Performance-Explainability Trade-Off in Explainable Artificial Intelligence (XAI)

Crook, B., Schlüter, M., & Speith, T. (2023) · IEEE International Requirements Engineering Conference Workshops (REW) · doi:10.1109/rew57809.2023.00060 · Cited by 41 · see citing works

Explainable artificial intelligence approaches for brain–computer interfaces: a review and design space

Rajpura, P., Cecotti, H., & Meena, Y. K. (2024) · Journal of Neural Engineering · doi:10.1088/1741-2552/ad6593 · Cited by 41 · see citing works

IG 2 : Integrated Gradient on Iterative Gradient Path for Feature Attribution

Zhuo, Y., & Ge, Z. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3388092 · Cited by 40 · see citing works

Model extraction from counterfactual explanationsPreprint

Aïvodji, U., Bolot, A., & Gambs, S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2009.01884 · Cited by 39 · see citing works

Adversarial Attacks in Explainable Machine Learning: A Survey of Threats Against Models and Humans

Vadillo, J., Santana, R., & Lozano, J. A. (2024) · Wiley Interdisciplinary Reviews Data Mining and Knowledge Discovery · doi:10.1002/widm.1567 · Cited by 38 · see citing works

A Survey on the Robustness of Feature Importance and Counterfactual ExplanationsPreprint

Mishra, S., Dutta, S., Long, J., & Magazzeni, D. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2111.00358 · Cited by 38 · see citing works

Please Tell Me More: Privacy Impact of Explainability through the Lens of Membership Inference Attack

Liu, H., Wu, Y., Yu, Z., & Zhang, N. (2024) · IEEE Symposium on Security and Privacy (S&P) · doi:10.1109/sp54263.2024.00120 · Cited by 37 · see citing works

Robustifying models against adversarial attacks by Langevin dynamics

Srinivasan, V., Rohrer, C., Marbán, A., Müller, K., Samek, W., & Nakajima, S. (2021) · Neural Networks · doi:10.1016/j.neunet.2020.12.024 · Cited by 35 · see citing works

Algorithmic Fairness and Vertical Equity: Income Fairness with IRS Tax Audit Models

Black, E., Elzayn, H., Chouldechova, A., Goldin, J. S., & Ho, D. E. (2022) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3531146.3533204 · Cited by 34 · see citing works

Vulnerabilities of Connectionist AI Applications: Evaluation and Defense

Berghoff, C., Neu, M., & von Twickel, A. (2020) · Frontiers in Big Data · doi:10.3389/fdata.2020.00023 · Cited by 33 · see citing works

SAFARI: Versatile and Efficient Evaluations for Robustness of Interpretability

Huang, W., Zhao, X., Jin, G., & Huang, X. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00190 · Cited by 33 · see citing works

Sequential Integrated Gradients: a simple but effective method for explaining language models

Enguehard, J. (2023) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2023.findings-acl.477 · Cited by 32 · see citing works

Faithfulness Tests for Natural Language Explanations

Atanasova, P., Camburu, O.-M., Lioma, C., Lukasiewicz, T., Simonsen, J. G., & Augenstein, I. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-short.25 · Cited by 31 · see citing works

ML-Based QoE Estimation in 5G Networks Using Different Regression Techniques

Schwarzmann, S., Marquezan, C. C., Trivisonno, R., Nakajima, S., Barriac, V., & Zinner, T. (2022) · IEEE Transactions on Network and Service Management · doi:10.1109/tnsm.2022.3179924 · Cited by 31 · see citing works

Do gradient-based explanations tell anything about adversarial robustness to android malware?

Melis, M., Scalas, M., Demontis, A., Maiorca, D., Biggio, B., Giacinto, G., & Roli, F. (2021) · International Journal of Machine Learning and Cybernetics · doi:10.1007/s13042-021-01393-7 · Cited by 30 · see citing works

NoiseGrad — Enhancing Explanations by Introducing Stochasticity to Model Weights

Bykov, K., Hedström, A., Nakajima, S., & Höhne, M. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i6.20561 · Cited by 30 · see citing works

How Much Can I Trust You? -- Quantifying Uncertainties in Explaining Neural NetworksPreprint

Bykov, K., Höhne, M., Müller, K., Nakajima, S., & Kloft, M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.09000 · Cited by 30 · see citing works

Disguising Attacks with Explanation-Aware Backdoors

Noppel, M., Peter, L., & Wressnegger, C. (2023) · IEEE Symposium on Security and Privacy (S&P) · doi:10.1109/sp46215.2023.10179308 · Cited by 29 · see citing works

A simple defense against adversarial attacks on heatmap explanationsPreprint

Rieger, L., & Hansen, L. K. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.06381 · Cited by 29 · see citing works

Improving explainable AI with patch perturbation-based evaluation pipeline: a COVID-19 X-ray image analysis case study

Sun, J., Shi, W., Giuste, F., Vaghani, Y. S., Tang, L., & Wang, M. D. (2023) · Scientific Reports · doi:10.1038/s41598-023-46493-2 · Cited by 27 · see citing works

Smoothed Geometry for Robust AttributionPreprint

Wang, Z., Wang, H., Ramkumar, S., Fredrikson, M., Mardziel, P., & Datta, A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.06643 · Cited by 26 · see citing works

Synthetic Benchmarks for Scientific Research in Explainable Machine LearningPreprint

Liu, Y., Khandagale, S., White, C., & Neiswanger, W. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.12543 · Cited by 25 · see citing works

Disentangled Explanations of Neural Network Predictions by Finding Relevant Subspaces

Chormai, P., Herrmann, J., Müller, K., & Montavon, G. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3388275 · Cited by 24 · see citing works

SoK: Explainable Machine Learning in Adversarial Environments

Noppel, M., & Wressnegger, C. (2024) · IEEE Symposium on Security and Privacy (S&P) · doi:10.1109/sp54263.2024.00021 · Cited by 24 · see citing works

Best of both worlds: local and global explanations with human-understandable conceptsPreprint

Schrouff, J., Baur, S., Hou, S., Mincu, D., Loreaux, E., Blanes, R., Wexler, J., Karthikesalingam, A., & Kim, B. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.08641 · Cited by 24 · see citing works

Saliency Methods for Explaining Adversarial Attacks

Gu, J., & Tresp, V. (2019) · arXiv · doi:10.48550/arxiv.1908.08413 · Cited by 23 · see citing works

Perturbing Inputs for Fragile Interpretations in Deep Natural Language Processing

Sinha, S., Chen, H., Sekhon, A., Ji, Y., & Qi, Y. (2021) · BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP (BlackboxNLP) · doi:10.18653/v1/2021.blackboxnlp-1.33 · Cited by 23 · see citing works

Spurious Features Everywhere - Large-Scale Detection of Harmful Spurious Features in ImageNet

Neuhaus, Y., Augustin, M., Boreiko, V., & Hein, M. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01851 · Cited by 23 · see citing works

Explaining Bayesian Neural NetworksPreprint

Bykov, K., Höhne, M., Creosteanu, A., Müller, K., Klauschen, F., Nakajima, S., & Kloft, M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2108.10346 · Cited by 22 · see citing works

Towards the Unification and Robustness of Perturbation and Gradient Based ExplanationsPreprint

Agarwal, S., Jabbari, S., Agarwal, C., Upadhyay, S., Wu, Z. S., & Lakkaraju, H. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.10618 · Cited by 20 · see citing works

PyTorch-FEA: Autograd-enabled Finite Element Analysis Methods with Applications for Biomechanical Analysis of Human Aorta

Liang, L., Liu, M., Elefteriades, J. A., & Sun, W. (2023) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2023.107616 · Cited by 19 · see citing works

Attributional Robustness Training Using Input-Gradient Spatial Alignment

Singh, M., Kumari, N., Mangla, P., Sinha, A., Balasubramanian, V. N., & Krishnamurthy, B. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58583-9_31 · Cited by 19 · see citing works

On the Lack of Robust Interpretability of Neural Text Classifiers

Zafar, M. B., Donini, M., Slack, D., Archambeau, C., Das, S. R., & Kenthapadi, K. (2021) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2021.findings-acl.327 · Cited by 18 · see citing works

Adversarial Infidelity Learning for Model Interpretation

Liang, J., Bai, B., Cao, Y., Bai, K., & Wang, F. (2020) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3394486.3403071 · Cited by 18 · see citing works

Finding Experts in Transformer ModelsPreprint

Suau, X., Zappella, L., & Apostoloff, N. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2005.07647 · Cited by 18 · see citing works

XAI enhancing cyber defence against adversarial attacks in industrial applications

Makridis, G., Theodoropoulos, S., Dardanis, D., Makridis, I., Separdani, M. M., Fatouros, G., Kyriazis, D., & Koulouris, P. (2022) · IEEE International Conference on Image Processing, Applications and Systems (IPAS) · doi:10.1109/ipas55744.2022.10052858 · Cited by 17 · see citing works

FIMAP: Feature Importance by Minimal Adversarial Perturbation

Chapman-Rounds, M., Bhatt, U., Pazos, E., Schulz, M.-A., & Georgatzis, K. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i13.17362 · Cited by 17 · see citing works

Do Input Gradients Highlight Discriminative Features?Preprint

Shah, H., Jain, P., & Netrapalli, P. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.12781 · Cited by 17 · see citing works

A Human-Centric Perspective on Model Monitoring

Shergadwala, M., Lakkaraju, H., & Kenthapadi, K. (2022) · Proceedings of the AAAI Conference on Human Computation and Crowdsourcing · doi:10.1609/hcomp.v10i1.21997 · Cited by 16 · see citing works

Backdoor Attacks on the DNN Interpretation System

Fang, S., & Choromanska, A. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i1.19935 · Cited by 16 · see citing works

Preventing deception with explanation methods using focused sampling

Vreš, D., & Robnik‐Šikonja, M. (2022) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-022-00900-w · Cited by 16 · see citing works

The Impact of Adversarial Attacks on Interpretable Semantic Segmentation in Cyber–Physical Systems

Gipiškis, R., Chiaro, D., Preziosi, M., Prezioso, E., & Piccialli, F. (2023) · IEEE Systems Journal · doi:10.1109/jsyst.2023.3281079 · Cited by 16 · see citing works

Diffeomorphic Counterfactuals With Generative Models

Dombrowski, A.-K., Gerken, J. E., Müller, K., & Kessel, P. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3339980 · Cited by 15 · see citing works

Interpretable Deep Neural Network to Predict Estrogen Receptor Status from Haematoxylin-Eosin Images

Seegerer, P., Binder, A., Saitenmacher, R., Bockmayr, M. L., Alber, M., Jurmeister, P. S., Klauschen, F., & Müller, K. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-50402-1_2 · Cited by 15 · see citing works

TagVet

Pirch, L., Warnecke, A., Wressnegger, C., & Rieck, K. (2021) · European Workshop on System Security · doi:10.1145/3447852.3458719 · Cited by 15 · see citing works

Fooling Partial Dependence via Data Poisoning

Baniecki, H., Kretowicz, W., & Biecek, P. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-26409-2_8 · Cited by 15 · see citing works

Machine Learning Explainability and Robustness

Datta, A., Fredrikson, M., Leino, K. R. M., Lu, K., Sen, S., & Wang, Z. (2021) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3447548.3470806 · Cited by 15 · see citing works

On Saliency Maps and Adversarial Robustness

Mangla, P., Singh, V., & Balasubramanian, V. N. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-67661-2_17 · Cited by 15 · see citing works

Debiased-CAM to mitigate image perturbations with faithful visual explanations of machine learning

Zhang, W., Dimiccoli, M., & Lim, B. Y. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3517522 · Cited by 15 · see citing works

Consistent Counterfactuals for Deep ModelsPreprint

Black, E., Wang, Z., Fredrikson, M., & Datta, A. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.03109 · Cited by 15 · see citing works

Pixel-Grounded Prototypical Part Networks

Carmichael, Z., Lohit, S., Cherian, A., Jones, M., & Scheirer, W. J. (2024) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv57701.2024.00470 · Cited by 14 · see citing works

NeuralSanitizer: Detecting Backdoors in Neural Networks

Zhu, H., Zhao, Y., Zhang, S., & Chen, K. (2024) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2024.3390599 · Cited by 14 · see citing works

Nullius in Explanans: an ethical risk assessment for explainable AI

Nannini, L., Huyskes, D., Panai, E., Pistilli, G., & Tartaro, A. (2024) · Ethics and Information Technology · doi:10.1007/s10676-024-09800-7 · Cited by 14 · see citing works

"Is your explanation stable?"

Gan, Y., Mao, Y., Zhang, X., Ji, S., Pu, Y., Han, M., Yin, J., & Wang, T. (2022) · ACM SIGSAC Conference on Computer and Communications Security (CCS) · doi:10.1145/3548606.3559392 · Cited by 14 · see citing works

Robust Models Are More Interpretable Because Attributions Look NormalPreprint

Wang, Z., Fredrikson, M., & Datta, A. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.11257 · Cited by 14 · see citing works

Robust Explanation Constraints for Neural NetworksPreprint

Wicker, M., Heo, J., Costabello, L., & Weller, A. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2212.08507 · Cited by 9 · see citing works

A geometrical perspective on explanations for deep neural networks

Dombrowski, A.-K. (2023) · DepositOnce · doi:10.14279/depositonce-17404

Towards robust explanations for deep neural networks

Dombrowski, A.-K., Anders, C. J., Müller, K., & Kessel, P. (2021) · Pattern Recognition · doi:10.1016/j.patcog.2021.108194 · Cited by 52 · see citing works

Corrupting Neuron Explanations of Deep Visual Features

Divyansh, F. (2023) · eScholarship (California Digital Library)

Explainability for neural networks

Rieger, L. (2020) · Technical University of Denmark, DTU Orbit (Technical University of Denmark, DTU)