Adversarial Risk and the Dangers of Evaluating Against Weak Attacks
Open accessThe DOI matches its OpenAlex record; 42 of the 42 references it cites were found in a registry or an index.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Human-level control through deep reinforcement learning
Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G., et al. (2015) · Nature · doi:10.1038/nature14236 · Cited by 30,357
Learning Multiple Layers of Features from Tiny Images
Krizhevsky, A. (2024) · doi:10.57702/zp44cu3g · Cited by 23,395
Towards Evaluating the Robustness of Neural Networks
Carlini, N., & Wagner, D. (2017) · 2017 IEEE Symposium on Security and Privacy (SP) · doi:10.1109/sp.2017.49 · Cited by 8,859
Intriguing properties of neural networks
Szegedy, C., Zaremba, W., Sutskever, I., Bruna, J., Erhan, D., Goodfellow, I., & Fergus, R. (2013) · arXiv · doi:10.48550/arxiv.1312.6199 · Cited by 8,143
Towards Deep Learning Models Resistant to Adversarial Attacks
Madry, A., Makelov, A., Schmidt, L., Tsipras, D., & Vladu, A. (2017) · arXiv · doi:10.48550/arxiv.1706.06083 · Cited by 6,602
Adversarial examples in the physical world
Kurakin, A., Goodfellow, I. J., & Bengio, S. (2018) · Artificial Intelligence Safety and Security · doi:10.1201/9781351251389-8 · Cited by 5,375
Multivariate stochastic approximation using a simultaneous perturbation gradient approximation
Spall, J. C. (1992) · IEEE Transactions on Automatic Control · doi:10.1109/9.119632 · Cited by 2,283 · cited 16×
“We found SPSA to reliably produce adversarial examples, but we believe the specific choice of gradient-free optimizer is relatively unimportant.”
MethodInfluentialEnsemble Adversarial Training: Attacks and Defenses
Tramèr, F., Kurakin, A., Papernot, N., Goodfellow, I., Boneh, D., & McDaniel, P. (2017) · arXiv · doi:10.48550/arxiv.1705.07204 · Cited by 2,176 · cited 7×
“In the case of gradient-based adversaries, a model may exploit gradient masking to bypass the specific adversary, without achieving true adversarial robustness (Tramèr et al., 2017; Goodfellow and Papernot, 2017).”
BackgroundMethodInfluentialObfuscated gradients give a false sense of security: Circumventing defenses to adversarial examples
Athalye, A., Carlini, N., & Wagner, D. (2018) · arXiv · doi:10.48550/arxiv.1802.00420 · Cited by 2,172 · cited 3×
“…work also demonstrated that image classifiers can be fooled without direct access to the model, so called ‘black-box’ or ‘oblivious’ attacks, (Paper-not et al., 2017; 2016), even when using printed images or 3D physical objects (Kurakin et al., 2016b; Brown et al., 2017; Athalye et al., 2018b).”
BackgroundMethodAdversarial Examples: Attacks and Defenses for Deep Learning
Yuan, X., He, P., Zhu, Q., & Li, X. (2019) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2018.2886017 · Cited by 1,733 · cited 1×
“The emergence of adversarial examples and the increasing deployment of machine learning models in real world production systems has motivated extensive research on developing models that can defend against adversarial attacks (Warde-Farley and Goodfellow, 2016; Yuan et al., 2017).”
BackgroundChen, P.-Y., Zhang, H., Sharma, Y., Yi, J., & Hsieh, C.-J. (2017) · Proceedings of the 10th ACM Workshop on Artificial Intelligence and Security · doi:10.1145/3128572.3140448 · Cited by 1,656
Pixel Recurrent Neural Networks
van den Oord, A., Kalchbrenner, N., & Kavukcuoglu, K. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1601.06759 · Cited by 1,437
Self-citationAdversarial Examples for Evaluating Reading Comprehension Systems
Jia, R., & Liang, P. (2017) · Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d17-1215 · Cited by 1,410 · cited 2×
“…examples are the most straightforward to study in the visual domain, they have also been demonstrated in other domains such as reinforcement learning (Huang et al., 2017), robotics (Pinto et al., 2017), malware detection (Grosse et al., 2016), and natural language processing (Jia and Liang, 2017).”
BackgroundTransferability in Machine Learning: from Phenomena to Black-Box Attacks using Adversarial Samples
Papernot, N., McDaniel, P., & Goodfellow, I. (2016) · arXiv · doi:10.48550/arxiv.1605.07277 · Cited by 1,326 · cited 3×
“Subsequent work also demonstrated that image classifiers can be fooled without direct access to the model, so called ‘black-box’ or ‘oblivious’ attacks, (Papernot et al., 2017; 2016), even when using printed images or 3D physical objects (Kurakin et al., 2016b; Brown et al., 2017; Athalye et al.,…”
BackgroundEvolution Strategies as a Scalable Alternative to Reinforcement Learning
Salimans, T., Ho, J., Chen, X., Sidor, S., & Sutskever, I. (2017) · arXiv · doi:10.48550/arxiv.1703.03864 · Cited by 1,027
Defense Against Adversarial Attacks Using High-Level Representation Guided Denoiser
Liao, F., Liang, M., Dong, Y., Pang, T., Hu, X., & Zhu, J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00191 · Cited by 902
Olah, C., Mordvintsev, A., & Schubert, L. (2017) · Distill · doi:10.23915/distill.00007 · Cited by 880
Provable defenses against adversarial examples via the convex outer adversarial polytope
Wong, E., & Kolter, J. Z. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.00851 · Cited by 634
Towards Deep Neural Network Architectures Robust to Adversarial Examples
Gu, S., & Rigazio, L. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1412.5068 · Cited by 622
Salimans, T., Karpathy, A., Chen, X., & Kingma, D. P. (2017) · arXiv · doi:10.48550/arxiv.1701.05517 · Cited by 584 · cited 2×
“Additionally, although previous implementations of SPSA for neural networks tend to sample v from Gaussian distributions (Salimans et al., 2017a; Ilyas et al., 2017) as is done in natural evolution strategies (Wierstra et al., 2008), we sample v from a Rademacher distribution (i.e., Bernoulli ±1),…”
MethodPixelDefend: Leveraging Generative Models to Understand and Defend against Adversarial Examples
Song, Y., Kim, T., Nowozin, S., Ermon, S., & Kushman, N. (2017) · arXiv · doi:10.48550/arxiv.1710.10766 · Cited by 562
Brown, T. B., Mané, D., Roy, A., Abadi, M., & Gilmer, J. (2017) · arXiv · doi:10.48550/arxiv.1712.09665 · Cited by 509 · cited 1×
“…work also demonstrated that image classifiers can be fooled without direct access to the model, so called ‘black-box’ or ‘oblivious’ attacks, (Paper-not et al., 2017; 2016), even when using printed images or 3D physical objects (Kurakin et al., 2016b; Brown et al., 2017; Athalye et al., 2018b).”
BackgroundRobust adversarial reinforcement learning
Pinto, L., Davidson, J., Sukthankar, R., & Gupta, A. (2017) · arXiv · doi:10.48550/arxiv.1703.02702 · Cited by 507 · cited 1×
“…examples are the most straightforward to study in the visual domain, they have also been demonstrated in other domains such as reinforcement learning (Huang et al., 2017), robotics (Pinto et al., 2017), malware detection (Grosse et al., 2016), and natural language processing (Jia and Liang, 2017).”
BackgroundCountering Adversarial Images using Input Transformations
Guo, C., Rana, M., Cissé, M., & van der Maaten, L. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.00117 · Cited by 394
Glasmachers, T., Wierstra, D., Schaul, T., Schmidhuber, J., & Yi, S. (2008) · Cited by 355
Adversarial Examples Are Not Easily Detected: Bypassing Ten Detection Methods
Carlini, N., & Wagner, D. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1705.07263 · Cited by 307
Certifying Some Distributional Robustness with Principled Adversarial Training
Sinha, A., Namkoong, H., Volpi, R., & Duchi, J. C. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1710.10571 · Cited by 307
Adversarial Perturbations Against Deep Neural Networks for Malware Classification
Grosse, K., Papernot, N., Manoharan, P., Michael Backes, A., & McDaniel, P. D. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1606.04435 · Cited by 299
Adversarial Examples: Attacks and Defenses for Deep Learning
Yuan, X., He, P. L., Zhu, Q., & Li, X. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1712.07107 · Cited by 213
MagNet: a Two-Pronged Defense against Adversarial Examples
Meng, D., & Chen, H. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1705.09064 · Cited by 194
Mitigating Adversarial Effects Through Randomization
Xie, C., Wang, J., Zhang, Z., Ren, Z., & Yuille, A. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.01991 · Cited by 181
Interactive and interpretable machine learning models for human machine collaboration
Kim, B. (2015) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 130
Robust linear least squares regressionPreprint
Audibert, J.-Y., Catoni, O., & Paris-est, U. ́. (2010) · Cited by 126
Provably Minimally-Distorted Adversarial Examples
Carlini, N., Katz, G., Barrett, C., & Dill, D. L. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1709.10207 · Cited by 95
Empirical risk minimization for heavy-tailed losses
Brownlees, C. T., & Joly, É. (2014) · Cited by 89
Increasing the Interpretability of Recurrent Neural Networks Using Hidden Markov Models
Krakovna, V., & Doshi‐Velez, F. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1606.05320 · Cited by 48
Piecewise Linear Neural Networks verification: A comparative studyPreprint
Bunel, R., Turkaslan, I., Torr, P. H. S., Kohli, P., & Kumar, M. P. P. (2017) · arXiv (Cornell University) · Cited by 45
Self-citationQuery-Efficient Black-box Adversarial Examples (superceded)Preprint
Ilyas, A., Engstrom, L., Athalye, A., & Lin, J. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1712.07113 · Cited by 42
Global random optimization by simultaneous perturbation stochastic approximation
Maryak, J. L., & Chin, D. C. (2001) · Winter Simulation Conference · doi:10.5555/564124.564167 · Cited by 37
Cited by
Theoretically principled trade-off between robustness and accuracy
Zhang, H., Yu, Y., Jiao, J., Xing, E. P., Ghaoui, L. E., & Jordan, M. I. (2019) · arXiv · doi:10.48550/arxiv.1901.08573 · Cited by 1,560
Adversarial Examples Are Not Bugs, They Are Features
Ilyas, A., Santurkar, S., Tsipras, D., Engstrom, L., Tran, B., & Madry, A. (2019) · arXiv · doi:10.48550/arxiv.1905.02175 · Cited by 971
Square Attack: A Query-Efficient Black-Box Adversarial Attack via Random Search
Andriushchenko, M., Croce, F., Flammarion, N., & Hein, M. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58592-1_29 · Cited by 800
Raschka, S., Patterson, J., & Nolet, C. (2020) · Information · doi:10.3390/info11040193 · Cited by 703
Using Self-Supervised Learning Can Improve Model Robustness and Uncertainty
Hendrycks, D., Mazeika, M., Kadavath, S., & Song, D. (2019) · arXiv · doi:10.48550/arxiv.1906.12340 · Cited by 634
Metadata
- Authors
- Uesato, J., O’Donoghue, B., van den Oord, A., & Kohli, P.
- Venue
- arXiv (Cornell University)
- Publisher
- Cornell University
- Published
- 2018-02-15
- Pages
- 5025-5034
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1802.05666
- OpenAlex
- W2786104118
- Cited by
- 353
- References
- 42
- Type
- posted content
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.