The DOI matches its DataCite record; 24 of the 27 references it cites were found in a registry or an index.
Explanations can be manipulated and geometry is to blame
Open accessAbstract
Explanation methods aim to make neural networks more trustworthy and interpretable. In this paper, we demonstrate a property of explanation methods which is disconcerting for both of these purposes. Namely, we show that explanations can be manipulated arbitrarily by applying visually hardly perceptible perturbations to the input that keep the network's output approximately constant. We establish theoretically that this phenomenon can be related to certain geometrical properties of neural networks. This allows us to derive an upper bound on the susceptibility of explanations to manipulations. Based on this result, we propose effective mechanisms to enhance the robustness of explanations.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Adversarial Vulnerability: Recent research demonstrates that explanations can be manipulated to appear reasonable while maintaining incorrect predictions [34].”
From Beyond Post hoc Explanations: A Comprehensive Framework for Accountable AI in Medical Imaging Through Transparency, Interpretability, and Explainability (2025) · cites this paper as [34]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
Learning Multiple Layers of Features from Tiny Images
Krizhevsky, A. (2024) · doi:10.57702/zp44cu3g · Cited by 23,889
A Unified Approach to Interpreting Model Predictions
Lundberg, S., & Lee, S.-I. (2017) · arXiv · doi:10.48550/arxiv.1705.07874 · Cited by 23,707
"Why Should I Trust You?": Explaining the Predictions of Any Classifier
Ribeiro, M. T., Singh, S., & Guestrin, C. (2016) · Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2939672.2939778 · Cited by 17,555
Visualizing and understanding convolutional networks
Zeiler, M. D., & Fergus, R. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10590-1_53 · Cited by 15,839
Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Maps
Simonyan, K., Vedaldi, A., & Zisserman, A. (2013) · arXiv · doi:10.48550/arxiv.1312.6034 · Cited by 5,370
On Pixel-Wise Explanations for Non-Linear Classifier Decisions by Layer-Wise Relevance Propagation
Bach, S., Binder, A., Montavon, G., Klauschen, F., Müller, K.-R., & Samek, W. (2015) · PLOS ONE · doi:10.1371/journal.pone.0130140 · Cited by 4,524
Self-citation
Flagged first, then by citations
3 of the 27 references couldn’t be matched to a known paper.
Research works printed but not linked: 7
- [6][6] Ramprasaath R. Selvaraju, Abhishek Das, Ramakrishna Vedantam, Michael Cogswell, Devi Parikh, and Dhruv Batra. Grad-cam: Why did you say that? visual explanations from deep networks via gradient-based localization. CoRR , abs/1610.02391, 2016. - · arXiv
- [14][14] Avanti Shrikumar, Peyton Greenside, and Anshul Kundaje. Learning important features through propagating activation differences. In Proceedings of the 34th International Conference on Machine Learning, ICML 2017, Sydney, NSW, Australia, 6-11 August 2017 , pages 3145-3153, 2017. -
- [15][15] Ruth C Fong and Andrea Vedaldi. Interpretable explanations of black boxes by meaningful perturbation. In 2017 IEEE international conference on computer vision (ICCV) , pages 3449-3457. IEEE, 2017. -
- [22][22] Julius Adebayo, Justin Gilmer, Michael Muelly, Ian J. Goodfellow, Moritz Hardt, and Been Kim. Sanity checks for saliency maps. CoRR , abs/1810.03292, 2018. - · arXiv
- [23][23] Maximilian Alber, Sebastian Lapuschkin, Philipp Seegerer, Miriam Hägele, Kristof T. Schütt, Grégoire Montavon, Wojciech Samek, Klaus-Robert Müller, Sven Dähne, and Pieter-Jan Kindermans. innvestigate neural networks! Journal of Machine Learning Research 20 , 2019. -
- [29][29] Gao Huang, Zhuang Liu, and Kilian Q. Weinberger. Densely connected convolutional networks. CoRR , abs/1608.06993, 2016. - · arXiv
- [31][31] Loring W Tu. Differential geometry: connections, curvature, and characteristic classes , volume 275. Springer, 2017.
Cited by
Sorted by citations
Items 101–200 of 206
Defense Against Explanation Manipulation
Tang, R., Liu, N., Yang, F., Zou, N., & Hu, X. (2022) · Frontiers in Big Data · doi:10.3389/fdata.2022.704203 · Cited by 13
Machine Guides, Human Supervises: Interactive Learning with Global ExplanationsPreprint
Popordanoska, T., Kumar, M., & Teso, S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2009.09723 · Cited by 17
REM: An Integrative Rule Extraction Methodology for Explainable Data Analysis in HealthcarePreprint
Shams, Z., Dimanov, B., Kola, S., Simidjievski, N., Terre, H. A., Scherer, P., Matjašec, U., Abraham, J., Jamnik, M., & Lió, P. (2021) · medRxiv · doi:10.1101/2021.01.25.21250459 · Cited by 15
SEAT: Stable and Explainable Attention
Hu, L., Liu, Y., Liu, N., Huai, M., Sun, L., & Wang, D. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i11.26517 · Cited by 12
Understanding and Enhancing Robustness of Concept-Based Models
Sinha, S., Huai, M., Sun, J., & Zhang, A. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i12.26765 · Cited by 12
Initialization Noise in Image Gradients and Saliency Maps
Woerl, A.-C., Disselhoff, J., & Wand, M. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00176 · Cited by 12
Learning Fair Rule ListsPreprint
Aïvodji, U., Ferry, J., Gambs, S., Huguet, M., & Siala, M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1909.03977 · Cited by 14
Rethinking the Role of Gradient-Based Attribution Methods for Model InterpretabilityPreprint
Srinivas, S., & Fleuret, F. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.09128 · Cited by 12
A Game-Theoretic Taxonomy of Visual Concepts in DNNsPreprint
Xu, C., Chu, C., Zheng, Y., Ren, J., & Zhang, Q. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.10938 · Cited by 12
Huang, Q.-X., Chiang, L.-K., Chiu, M.-Y., & Sun, H. (2023) · IEEE Transactions on Reliability · doi:10.1109/tr.2023.3303923 · Cited by 11
Lim, D., Lee, H., & Kim, S. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00640 · Cited by 12
Neural dynamics of natural scene processing across cortical areas as revealed by EEG decoding
Orima, T., & Motoyoshi, I. (2023) · Frontiers in Neuroscience · doi:10.1167/jov.23.9.5228 · Cited by 11
Understanding prediction discrepancies in classification
Renard, X., Laugel, T., & Detyniecki, M. (2024) · Machine Learning · doi:10.1007/s10994-024-06557-4 · Cited by 12
Aggregating explanation methods for stable and robust explainabilityPreprint
Rieger, L., & Hansen, L. K. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1903.00519 · Cited by 16
How Much Should I Trust You? Modeling Uncertainty of Black Box Explanations.Preprint
Slack, D., Hilgard, S., Singh, S., & Lakkaraju, H. (2020) · arXiv (Cornell University) · Cited by 11
Towards Stable and Explainable Attention Mechanisms
Hu, L., Wang, X., Liu, Y., Liu, N., Huai, M., Sun, L., & Wang, D. (2025) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2025.3538583 · Cited by 10
Visualizing Color-Wise Saliency of Black-Box Image Classification Models
Hatakeyama, Y., Sakuma, H., Konishi, Y., & Suenaga, K. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-69535-4_12 · Cited by 10
FAR: A General Framework for Attributional Robustness
Ivankay, A., Girardi, I., Marchiori, C., & Pascal Frossard, B. (2021) · British Machine Vision Conference (BMVC) · doi:10.5244/c.35.57 · Cited by 10
Tjoa, E., Heng, G., Lu, Y., & Guan, C. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1911.08136 · Cited by 10
Seven challenges for harmonizing explainability requirementsPreprint
Chen, J., & Storchan, V. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2108.05390 · Cited by 10
Do Transformers and CNNs Learn Different Concepts of Brain Age?
Siegel, N. T., Kainmueller, D., Deniz, F., Ritter, K., & Schulz, M.-A. (2025) · Human Brain Mapping · doi:10.1002/hbm.70243 · Cited by 12
Xin, X., Hooker, G., & Huang, F. (2025) · Insurance: Mathematics and Economics · doi:10.1016/j.insmatheco.2025.103135 · Cited by 6
On Smoother Attributions using Neural Stochastic Differential Equations
Jha, S. K., Ewetz, R., Velasquez, A., & Jha, S. (2021) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2021/73 · Cited by 9
Finding Representative Interpretations on Convolutional Neural Networks
Lam, P. C.-H., Chu, L., Torgonskiy, M., Pei, J., Zhang, Y., & Wang, L. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00138 · Cited by 9
Duy, V. N. L., Iwazaki, S., & Takeuchi, I. (2021) · arXiv (Cornell University) · Cited by 9
Characterizing the risk of fairwashingPreprint
Aïvodji, U., Arai, H., Gambs, S., & Hara, S. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.07504 · Cited by 9
von Struensee, S. (2021) · SSRN Electronic Journal · doi:10.2139/ssrn.3880779 · Cited by 10
Overlooked Trustworthiness of Explainability in Medical AIPreprint
Zhang, J., Chao, H., Kalra, M. K., Wang, G., & Yan, P. (2021) · medRxiv · doi:10.1101/2021.12.23.21268289 · Cited by 9
A-XAI: adversarial machine learning for trustable explainability
Agrawal, N., Pendharkar, I., Shroff, J., Raghuvanshi, J., Neogi, A., Patil, S., Walambe, R. A., & Kotecha, K. V. (2024) · AI and Ethics · doi:10.1007/s43681-023-00368-4 · Cited by 8
Towards Automating Model Explanations with Certified Robustness Guarantees
Huai, M., Liu, J., Miao, C., Yao, L., & Zhang, A. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i6.20651 · Cited by 8
Trustworthy Convolutional Neural Networks: A Gradient Penalized-based ApproachPreprint
Halliwell, N., & Lécué, F. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2009.14260 · Cited by 8
Selective Ensembles for Consistent PredictionsPreprint
Black, E., Leino, K. R. M., & Fredrikson, M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2111.08230 · Cited by 12
The Manifold Hypothesis for Gradient-Based Explanations
Bordt, S., Upadhyay, U., Akata, Z., & Ulrike Von Luxburg, A. (2023) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw59228.2023.00378 · Cited by 10
Robustness of Visual Explanations to Common Data Augmentation Methods
Tětková, L., & Hansen, L. K. (2023) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw59228.2023.00381 · Cited by 8
Stability of Explainable Recommendation
Vijayaraghavan, S., & Mohapatra, P. (2023) · ACM Conference on Recommender Systems (RecSys) · doi:10.1145/3604915.3608853 · Cited by 7
Burgess, M. (2024) · IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC) · doi:10.1109/vl/hcc60511.2024.00021 · Cited by 7
Self-learn to Explain Siamese Networks Robustly
Chen, C., Shen, Y., Ma, G., Kong, X., Rangarajan, S., Zhang, X., & Xie, S. (2021) · Proceedings · doi:10.1109/icdm51629.2021.00116 · Cited by 7
Towards More Robust Interpretation via Local Gradient Alignment
Joo, S., Jeong, S., Heo, J., Weller, A., & Moon, T. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i7.25986 · Cited by 7
Preemptively pruning Clever-Hans strategies in deep neural networks
Linhardt, L., Müller, K., & Montavon, G. (2023) · Information Fusion · doi:10.1016/j.inffus.2023.102094 · Cited by 10
Self-citationTransferability of coVariance Neural Networks
Sihag, S., Mateos, G., McMillan, C. T., & Ribeiro, A. (2024) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2024.3378887 · Cited by 6
Kunz, J. (2024) · Linköping studies in science and technology. Dissertations · doi:10.3384/9789180754712 · Cited by 7
Diffeomorphic Explanations with Normalizing Flows
Dombrowski, A.-K., Gerken, J. E., & Kessel, P. (2021) · International Conference on Machine Learning · Cited by 6
Self-citationAdversarial Machine Learning: An Interpretation PerspectivePreprint
Liu, N., Du, M., & Hu, X. (2020) · arXiv (Cornell University) · Cited by 6
Counterfactual Explanations of Concept DriftPreprint
Hinder, F., & Hammer, B. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.12822 · Cited by 6
Towards Rigorous Interpretations: a Formalisation of Feature AttributionPreprint
Afchar, D., Hennequin, R., & Guigue, V. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2104.12437 · Cited by 6
Perturbing Inputs for Fragile Interpretations in Deep Natural Language ProcessingPreprint
Sinha, S., Chen, H., Sekhon, A., Ji, Y., & Qi, Y. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2108.04990 · Cited by 18
Empirical Analysis of SHAP Stability Under Data Corruption Across Datasets and Model Architectures
Stow, M. T., & Stewart, A. A. (2025) · IARJSET · doi:10.17148/iarjset.2025.12810 · Cited by 6
Adversarial Attacks on the Interpretation of Neuron Activation Maximization
Nanfack, G., Fulleringer, A., Marty, J., Eickenberg, M., & Belilovsky, E. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i5.28228 · Cited by 9
ExAD: An Ensemble Approach for Explanation-based Adversarial DetectionPreprint
Vardhan, R., Liu, N., Chinprutthiwong, P., Fu, W., Hu, Z., Hu, X., & Gu, G. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.11526 · Cited by 6
Model Poisoning Attack Against Neural Network Interpreters in IoT Devices
Zhang, X., Li, F., Zhang, H., Zhang, H., Huang, Z., Fan, L., Cheng, X., & Hu, P. (2024) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2024.3486218 · Cited by 5
Cybiński, K., Płodzień, M., Tomza, M., Lewenstein, M., Dauphin, A., & Dawid, A. (2024) · Machine Learning Science and Technology · doi:10.1088/2632-2153/ad9079 · Cited by 8
XAI: regulatory and ethical aspects
Nannini, L. (2025) · Elsevier eBooks · doi:10.1016/b978-0-44-329135-7.00020-5 · Cited by 4
Statistically Consistent Saliency Estimation
Luo, S., Barut, E., & Jin, F. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00078 · Cited by 4
Resilience of Bayesian Layer-Wise Explanations under Adversarial Attacks
Carbone, G., Bortolussi, L., & Sanguinetti, G. (2022) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn55064.2022.9892788 · Cited by 5
Are Interpretations Fairly Evaluated? A Definition Driven Pipeline for Post-Hoc InterpretabilityPreprint
Liu, N., Meng, Y., Hu, X., Tie, W., & Long, B. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2009.07494 · Cited by 5
Knowledge Infused Policy Gradients for Adaptive Pandemic ControlPreprint
Roy, K., Zhang, Q., Gaur, M., & Sheth, A. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.06245 · Cited by 4
Exploring black-box adversarial attacks on Interpretable Deep Learning Systems
Zhan, Y., Zheng, B., Liu, D., Deng, B., & Xu, Y. (2025) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2025.104423 · Cited by 4
Explanation-based Adversarial Detection with Noise Reduction
Su, J., Yang, Z., Ren, Z., & Jin, F. (2024) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata62323.2024.10825913 · Cited by 3
Explaining vulnerabilities of biased news classifiers through rough sets and granular computing
Fenza, G., Gaeta, A., Loia, V., Orciuoli, F., & Stanzione, C. (2025) · Information Sciences · doi:10.1016/j.ins.2025.122439 · Cited by 3
A Practical Upper Bound for the Worst-Case Attribution Deviations
Wang, F., & Kong, A. W. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.02358 · Cited by 3
He, J., Chen, K., Meng, G., Zhang, J., & Li, C. (2023) · ACM SIGSAC Conference on Computer and Communications Security (CCS) · doi:10.1145/3576915.3616605 · Cited by 3
Mitigating Preconception in Machine Learning Classifiers
Ngie, H. M., Nderu, L., Mutanu, L. M., & Mwigereri, D. G. (2021) · International Conference on Electrical, Computer, Communications and Mechatronics Engineering (ICECCME) · doi:10.1109/iceccme52200.2021.9591043 · Cited by 3
A comprehensive and reliable feature attribution method: Double-sided remove and reconstruct (DoRaR)
Qin, D., Amariucai, G. T., Qiao, D., Guan, Y., & Shen, F. (2024) · Neural Networks · doi:10.1016/j.neunet.2024.106166 · Cited by 3
A Simple and Effective Method to Defend Against Saliency Map Attack
Si, N., Chang, H., & Li, Y. (2021) · International Conference on Frontiers of Electronics, Information and Computation Technologies · doi:10.1145/3474198.3478141 · Cited by 3
Towards Gradient-Based Saliency Consensus Training for Adversarial Robustness
Li, Q., Shen, C. Q., Hu, Q., Lin, C., Ji, X., & Qi, S. (2022) · IEEE Transactions on Dependable and Secure Computing · doi:10.1109/tdsc.2022.3184594 · Cited by 5
Identifying Untrustworthy Predictions in Neural Networks by Geometric Gradient AnalysisPreprint
Schwinn, L., Nguyen, A., Raab, R., Bungert, L., Tenbrinck, D., Zanca, D., Burger, M., & Eskofier, B. M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.12196 · Cited by 3
Toward a Unified Framework for Debugging Gray-box Models.Preprint
Bontempelli, A., Giunchiglia, F., Passerini, A., & Teso, S. (2021) · Iris (University of Trento) · doi:10.48550/arxiv.2109.11160 · Cited by 3
Enhanced Regularizers for Attributional Robustness
Sarkar, A., Sarkar, A., & Balasubramanian, V. N. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i3.16355 · Cited by 2
Decoding Brain Structure and Gene Expression Interactions in Alzheimer’s Disease Pathology
Niwarthana, A., Kasi, C., Chan, Y. H., Wang, C., & Rajapakse, J. C. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10888440 · Cited by 2
Interpretability adversarial example detection through multi-interpretation aggregation comparison
Chen, Z., Wang, Z., Pan, D., Leng, T., Liu, Y., & Zhu, H. (2025) · Applied Soft Computing · doi:10.1016/j.asoc.2025.113212 · Cited by 2
Algebraic Adversarial Attacks on Integrated Gradients
Simpson, L., Costanza, F., Millar, K., Cheng, A., Lim, C., & Chew, H. G. (2024) · International Conference on Machine Learning and Cybernetics · doi:10.1109/icmlc63072.2024.10935253 · Cited by 2
Improving Interpretability of CNN Models Using Non-Negative Concept Activation Vectors.
Zhang, R., Madumal, P., Miller, T., Ehinger, K. A., & Rubinstein, B. I. P. (2020) · Cited by 2
Black-box Adversarial Attack against Visual Interpreters for Deep Neural Networks
Hirose, Y., & Ono, S. (2023) · doi:10.23919/mva57639.2023.10215758 · Cited by 2
Black-Box Attacks on Image Activity Prediction and its Natural Language Explanations
Baia, A. E., Poggioni, V., & Cavallaro, A. (2023) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw60793.2023.00396 · Cited by 2
SoK: Unintended Interactions among Machine Learning Defenses and Risks
Duddu, V., Szyller, S., & Asokan, N. (2024) · IEEE Symposium on Security and Privacy (S&P) · doi:10.1109/sp54263.2024.00243 · Cited by 7
Fixed-point analysis of weighted integrated gradients
Kamolov, S. (2026) · Annals of Mathematics and Computer Science · doi:10.56947/amcs.v33.792 · Cited by 2
Human-Unrecognizable Differential Private Noised Image Generation Method
Kim, H. K., Shin, J., & Choi, Y.-H. (2024) · Sensors · doi:10.3390/s24103166 · Cited by 2
REM: An Integrative Rule Extraction Methodology for Explainable Data Analysis in HealthcarePreprint
Shams, Z., Dimanov, B., Kola, S., Simidjievski, N., Andrés-Terré, H., Scherer, P. C., Matjašec, U., Abraham, J., Jamnik, M., & Lió, P. (2021) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2021.01.22.427799 · Cited by 2
Quantifying Trustworthiness of Explainability in Medical AIPreprint
Zhang, J., Chao, H., Dasegowda, G., Wang, G., Kalra, M. K., & Yan, P. (2022) · Research Square · doi:10.21203/rs.3.rs-1897856/v1 · Cited by 2
Explainable Adversarial Attacks on Coarse-to-Fine Classifiers
Heidarizadeh, A., Hatfield, C., Lazzarotto, L., Cai, H., & Atia, G. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10889828 · Cited by 1
Composite Explanation-Aware Attacks
Noppel, M., & Wressnegger, C. (2025) · IEEE Security and Privacy Workshops (SPW) · doi:10.1109/spw67851.2025.00022 · Cited by 1
Poster: Fooling XAI with Explanation-Aware Backdoors
Noppel, M., & Wressnegger, C. (2023) · ACM SIGSAC Conference on Computer and Communications Security (CCS) · doi:10.1145/3576915.3624379 · Cited by 1
Sparse Attacks for Manipulating Explanations in Deep Neural Network Models
Ajalloeian, A., Moosavi-Dezfooli, S. M., Vlachos, M., & Frossard, P. (2023) · Proceedings · doi:10.1109/icdm58522.2023.00101 · Cited by 1
Chang, K.-J., Lin, T., Hsu, C., Hwang, D., Chen, S., Chiou, S., Li, C.-Y., Chen, L., Hsu, C.-R., & Chang, W.-H. (2024) · IEEE Computational Intelligence Magazine · doi:10.1109/mci.2024.3401348 · Cited by 1
Fooling Neural Network Interpretations: Adversarial Noise to Attack Images
Song, Q., Kong, X., & Wang, Z. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-93049-3_4 · Cited by 1
MoreauGrad: Sparse and Robust Interpretation of Neural Networks via Moreau Envelope
Zhang, J., & Farnia, F. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00193 · Cited by 4
Boundary Attributions Provide Normal (Vector) Explanations.Preprint
Wang, Z., Fredrikson, M., & Datta, A. (2021) · arXiv (Cornell University) · Cited by 1
Do not explain without context: addressing the blind spot of model explanationsPreprint
Woźnica, K., Pȩkala, K., Baniecki, H., Kretowicz, W., Sienkiewicz, E., & Biecek, P. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2105.13787 · Cited by 1
From medical imaging to explainable artificial intelligence
Tjoa, E. (2022) · DR-NTU (Nanyang Technological University) · doi:10.32657/10356/164493 · Cited by 1
Explaining Explanations and Perturbing Perturbations
Jia, E. (2020) · Digital Access to Scholarship at Harvard (DASH) (Harvard University)
Brittle Features of Device Authentication
García, W., Chhotaray, A., Choi, J. I., Adari, S. K., Butler, K. R. B., & Jha, S. (2021) · ACM Conference on Data and Application Security and Privacy (CODASPY) · doi:10.1145/3422337.3447842
Nachvollziehbare Künstliche Intelligenz: Methoden, Chancen und Risiken
Höhne, M. (2021) · Datenschutz und Datensicherheit - DuD · doi:10.1007/s11623-021-1470-x
AdjointBackMapV2: Precise reconstruction of arbitrary CNN unit’s activation via adjoint operators
Wan, Q., Cheung, S. W., & Choe, Y. (2023) · Neural Networks · doi:10.1016/j.neunet.2023.11.009
DARE: Towards Robust Text Explanations in Biomedical and Healthcare Applications
Ivankay, A., Rigotti, M., & Pascal Frossard, B. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.644
A Comprehensive and Reliable Feature Attribution Method: Double-Sided Remove and Reconstruct (DoRaR)Preprint
Dong, Q., Amariucai, G. T., Qiao, D., Guan, Y., & Shen, F. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4617062
Towards robust explainability of deep neural networks against attribution attacks
Wang, F. (2024) · DR-NTU (Nanyang Technological University) · doi:10.32657/10356/175394
A Review of XAI Failures and Works on Its Influence on SecurityPreprint
Banerjee, I. (2024) · Preprints.org · doi:10.20944/preprints202407.0754.v1
Debiased Learning via Composed Conceptual Sensitivity Regularization
Joo, S., & Moon, T. (2024) · IEEE Access · doi:10.1109/access.2024.3477454
Prototype-Based Explanation for Semantic Gap Reduction With Distributional Embedding
Joo, H., Hong, S., Han, H., Yoon, Y., & Lee, J. (2025) · IEEE Access · doi:10.1109/access.2025.3535884
Metadata
- Authors
- Dombrowski, A.-K., Alber, M., Anders, C. J., Ackermann, M., Müller, K.-R., & Kessel, P.
- Affiliations
- Technische Universität Berlin (DE)
- ORCID
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2019
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1906.07983
- OpenAlex
- W2951306478
- Cited by
- 171
- References
- 27
- Citations by year
- 2025: 17 · 2024: 29 · 2023: 36 · 2022: 19 · 2021: 41 · 2020: 24 · 2019: 5
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Physical Sciences › Computer Science › Artificial Intelligence › Adversarial Robustness in Machine Learning
- Physical Sciences › Computer Science › Software › Software Testing and Debugging Techniques
- Keywords
- explanation methods, neural network interpretability, explanation robustness, input perturbation, explainable AI
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review