CoChat
Sign Up
PreprintCited by 46Adversarial Robustness in Machine LearningExplainable Artificial Intelligence (XAI)Advanced Neural Network Applications

The DOI matches its DataCite record; 3 of the 3 references it cites were found in a registry or an index.

Characterizing the Decision Boundary of Deep Neural Networks

Open access
Karimi, Hamid, Derr, Tyler, Tang, Jiliang·2019·arXiv
DOI 10.48550/arxiv.1912.11460arXiv 1912.11460
Open this paper in CoChat — free accountOpen PDF

Abstract

Deep neural networks and in particular, deep neural classifiers have become an integral part of many modern applications. Despite their practical success, we still have limited knowledge of how they work and the demand for such an understanding is evergrowing. In this regard, one crucial aspect of deep neural network classifiers that can help us deepen our knowledge about their decision-making behavior is to investigate their decision boundaries. Nevertheless, this is contingent upon having access to samples populating the areas near the decision boundary. To achieve this, we propose a novel approach we call Deep Decision boundary Instance Generation (DeepDIG). DeepDIG utilizes a method based on adversarial example generation as an effective way of generating samples near the decision boundary of any deep neural network model. Then, we introduce a set of important principled characteristics that take advantage of the generated instances near the decision boundary to provide multifaceted understandings of deep neural networks. We have performed extensive experiments on multiple representative datasets across various deep neural network models and characterized their decision boundaries. The code is publicly available at https://github.com/hamidkarimi/DeepDIG/.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.1912.11460

Cites

3 of 3 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Flagged first, then by citations

Show all 3 references

Research works printed but not linked: 35

  1. [1][1] Motasem Alfarra, Adel Bibi, Hasan Hammoud, Mohamed Gaafar, and Bernard Ghanem. 2020. On the Decision Boundaries of Deep Neural Networks: A Tropical Geometry Perspective. https://openreview.net/forum?id=BylldnNFwS -
  2. [2][2] Léon Bottou, Frank E Curtis, and Jorge Nocedal. 2018. Optimization methods for large-scale machine learning. Siam Review 60, 2 (2018), 223-311. -
  3. [3][3] Nello Cristianini, John Shawe-Taylor, et al. 2000. An introduction to support vector machines and other kernel-based learning methods . Cambridge university press. -
  4. [4][4] Tyler Derr, Hamid Karimi, Xiaorui Liu, Jiejun Xu, and Jiliang Tang. 2019. Deep Adversarial Network Alignment. arXiv preprint arXiv:1902.10307 (2019). - · arXiv
  5. [5][5] Simant Dube. 2018. High Dimensional Spaces, Deep Learning and Adversarial Examples. arXiv preprint arXiv:1801.00634 (2018). - · arXiv
  6. [6][6] Vincent Dumoulin and Francesco Visin. 2016. A guide to convolution arithmetic for deep learning. arXiv preprint arXiv:1603.07285 (2016). - · arXiv
  7. [7][7] Wenqi Fan, Tyler Derr, Yao Ma, Jianping Wang, Jiliang Tang, and Qing Li. 2019. Deep Adversarial Social Recommendation. In Proceedings of the 28th International Joint Conference on Artificial Intelligence (IJCAI'19) . AAAI Press, 1351-1357. http://dl.acm.org/citation.cfm?id=3367032.3367224 -
  8. [8][8] Alhussein Fawzi, Seyed-Mohsen Moosavi-Dezfooli, Pascal Frossard, and Stefano Soatto. 2018. Empirical study of the topology and geometry of deep networks. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition . 3762-3770. -
  9. [10][10] Warren He, Bo Li, and Dawn Xiaodong Song. 2018. Decision Boundary Analysis of Adversarial Examples. In ICLR . -
  10. [11][11] Tin Kam Ho and Mitra Basu. 2002. Complexity measures of supervised classification problems. IEEE Transactions on Pattern Analysis & Machine Intelligence 3 (2002), 289-300. -
  11. [12][12] Brody Huval, Tao Wang, Sameep Tandon, Jeff Kiske, Will Song, Joel Pazhayampallil, Mykhaylo Andriluka, Pranav Rajpurkar, Toki Migimatsu, Royce Cheng-Yue, et al. 2015. An empirical evaluation of deep learning on highway driving. arXiv preprint arXiv:1504.01716 (2015). - · arXiv
  12. [13][13] Adel Jaouen and Erwan Le Merrer. 2018. zoNNscan: a boundary-entropy index for zone inspection of neural models. arXiv preprint arXiv:1808.06797 (2018). - · arXiv
  13. [14][14] Hamid Karimi*, Tyler Derr*, Aaron Brookhouse, and Jiliang Tang. 2019. MultiFactor Congressional Vote Prediction. In Advances in Social Networks Analysis and Mining (ASONAM), 2019 IEEE/ACM International Conference on . IEEE. -
  14. [16][16] Hamid Karimi, Proteek Roy, Sari Saba-Sadiya, and Jiliang Tang. 2018. MultiSource Multi-Class Fake News Detection. In Proceedings of the 27th International Conference on Computational Linguistics . Association for Computational Linguistics, Santa Fe, New Mexico, USA, 1546-1557. https://www.aclweb.org/anthology/ C18-1131 -
  15. [17][17] Hamid Karimi and Jiliang Tang. 2019. Learning Hierarchical Discourse-level Structure for Fake News Detection. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) . Association for Computational Linguistics, Minneapolis, Minnesota, 3432-3442. https://doi.org/ 10.18653/v1/N19-1347 - · DOI
  16. [18][18] H. Karimi, J. Tang, and Y. Li. 2018. Toward End-to-End Deception Detection in Videos. In 2018 IEEE International Conference on Big Data (Big Data) . 1278-1283. https://doi.org/10.1109/BigData.2018.8621909 - · DOI
  17. [19][19] H. Karimi, C. VanDam, L. Ye, and J. Tang. 2018. End-to-End Compromised Account Detection. In 2018 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining (ASONAM) . 314-321. https://doi.org/10. 1109/ASONAM.2018.8508296 -
  18. [22][22] Yann LeCun, Léon Bottou, Yoshua Bengio, and Patrick Haffner. 1998. Gradientbased learning applied to document recognition. Proc. IEEE 86, 11 (1998), 22782324. -
  19. [23][23] Yu Li, Peter Richtarik, Lizhong Ding, and Xin Gao. 2018. On the decision boundary of deep neural networks. arXiv preprint arXiv:1808.05385 (2018). - · arXiv
  20. [24][24] Ana C Lorena, Luís PF Garcia, Jens Lehmann, Marcilio CP Souto, and Tin K Ho. 2018. How Complex is your classification problem? A survey on measuring classification complexity. arXiv preprint arXiv:1808.03591 (2018). - · arXiv
  21. [25][25] Stéphane Mallat. 2016. Understanding deep convolutional networks. Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences 374, 2065 (2016), 20150203. -
  22. [26][26] Seyed-Mohsen Moosavi-Dezfooli, Alhussein Fawzi, Jonathan Uesato, and Pascal Frossard. 2019. Robustness via curvature regularization, and vice versa. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition . 9078-9086. -
  23. [27][27] Vinod Nair and Geoffrey E Hinton. 2010. Rectified linear units improve restricted boltzmann machines. In Proceedings of the 27th international conference on machine learning (ICML-10) . 807-814. -
  24. [28][28] Albert Orriols-Puig, Núria Macia, and Tin Kam Ho. 2010. Documentation for the data complexity library in C++. Universitat Ramon Llull, La Salle 196 (2010), 1-40. -
  25. [29][29] Adam Paszke, Sam Gross, Francisco Massa, Adam Lerer, James Bradbury, Gregory Chanan, Trevor Killeen, Zeming Lin, Natalia Gimelshein, Luca Antiga, et al. 2019. PyTorch: An imperative style, high-performance deep learning library. In Advances in Neural Information Processing Systems . 8024-8035. -
  26. [30][30] Kexin Pei, Yinzhi Cao, Junfeng Yang, and Suman Jana. 2017. Deepxplore: Automated whitebox testing of deep learning systems. In Proceedings of the 26th Symposium on Operating Systems Principles . ACM, 1-18. -
  27. [31][31] Jonathon Shlens. 2014. A tutorial on principal component analysis. arXiv preprint arXiv:1404.1100 (2014). - · arXiv
  28. [32][32] Christian Szegedy, Sergey Ioffe, Vincent Vanhoucke, and Alexander A Alemi. 2017. Inception-v4, inception-resnet and the impact of residual connections on learning. In Thirty-First AAAI Conference on Artificial Intelligence . -
  29. [33][33] Christian Szegedy, Wei Liu, Yangqing Jia, Pierre Sermanet, Scott Reed, Dragomir Anguelov, Dumitru Erhan, Vincent Vanhoucke, and Andrew Rabinovich. 2015. Going deeper with convolutions. In Proceedings of the IEEE conference on computer vision and pattern recognition . 1-9. -
  30. [34][34] Christian Szegedy, Wojciech Zaremba, Ilya Sutskever, Joan Bruna, Dumitru Erhan, Ian Goodfellow, and Rob Fergus. 2013. Intriguing properties of neural networks. arXiv preprint arXiv:1312.6199 (2013). - · arXiv
  31. [35][35] Han Xiao, Kashif Rasul, and Roland Vollgraf. 2017. Fashion-mnist: a novel image dataset for benchmarking machine learning algorithms. arXiv preprint arXiv:1708.07747 (2017). - · arXiv
  32. [36][36] Han Xu, Yao Ma, Haochen Liu, Debayan Deb, Hui Liu, Jiliang Tang, and Anil Jain. 2019. Adversarial attacks and defenses in images, graphs and text: A review. arXiv preprint arXiv:1909.08072 (2019). - · arXiv
  33. [37][37] Roozbeh Yousefzadeh and Dianne P O'Leary. 2019. Investigating Decision Boundaries of Trained Neural Networks. arXiv preprint arXiv:1908.02802 (2019). - · arXiv
  34. [38][38] Xiaoyong Yuan, Pan He, Qile Zhu, Rajendra Rana Bhat, and Xiaolin Li. 2017. Adversarial examples: Attacks and defenses for deep learning. arXiv preprint arXiv:1712.07107 (2017). - · arXiv
  35. [39][39] Wei Emma Zhang, Quan Z Sheng, and Ahoud Abdulrahmn F Alhazmi. 2019. Generating Textual Adversarial Examples for Deep Learning Models: A Survey. arXiv preprint arXiv:1901.06796 (2019). · arXiv

Cited by

Sorted by citations

See all 46

Metadata

Authors
Karimi, H., Derr, T., & Tang, J.
Affiliations
Michigan State University (US)
ORCID
Venue
arXiv
Publisher
arXiv
Published
2019
ISSN
2331-8422 (ISSN-L)
DOI
10.48550/arxiv.1912.11460
arXiv
1912.11460
OpenAlex
W2997733093
Cited by
46
References
3
Citations by year
2025: 4 · 2024: 10 · 2023: 7 · 2022: 13 · 2021: 11 · 2020: 1
Type
posted content
Language
en
Open access
Licence
arxiv.org/licenses/nonexclusive-distrib/1.0/
Locations
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Adversarial Robustness in Machine Learning
  • Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
Keywords
decision boundaries, deep neural network, adversarial example generation, instance generation, interpretability

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review