The DOI matches its OpenAlex record; 68 of the 68 references it cites were found in a registry or an index.
On Evaluating Adversarial Robustness
Open accessOverview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Mastering the game of Go with deep neural networks and tree search
Silver, D., Huang, A., Maddison, C. J., Guez, A., Sifre, L., van den Driessche, G., Schrittwieser, J., Antonoglou, I., Panneershelvam, V., Lanctot, M., et al. (2016) · Nature · doi:10.1038/nature16961 · Cited by 15,612
Explaining and Harnessing Adversarial Examples
Goodfellow, I. J., Shlens, J., & Szegedy, C. (2014) · arXiv · doi:10.48550/arxiv.1412.6572 · Cited by 10,381
Self-citationTowards Evaluating the Robustness of Neural Networks
Carlini, N., & Wagner, D. (2017) · 2017 IEEE Symposium on Security and Privacy (SP) · doi:10.1109/sp.2017.49 · Cited by 8,859
Self-citationIntriguing properties of neural networks
Szegedy, C., Zaremba, W., Sutskever, I., Bruna, J., Erhan, D., Goodfellow, I., & Fergus, R. (2013) · arXiv · doi:10.48550/arxiv.1312.6199 · Cited by 8,143
Self-citationTowards Deep Learning Models Resistant to Adversarial Attacks
Madry, A., Makelov, A., Schmidt, L., Tsipras, D., & Vladu, A. (2017) · arXiv · doi:10.48550/arxiv.1706.06083 · Cited by 6,602
Self-citationAdversarial examples in the physical world
Kurakin, A., Goodfellow, I. J., & Bengio, S. (2018) · Artificial Intelligence Safety and Security · doi:10.1201/9781351251389-8 · Cited by 5,375
Self-citationDeepFool: A Simple and Accurate Method to Fool Deep Neural Networks
Moosavi-Dezfooli, S.-M., Fawzi, A., & Frossard, P. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.282 · Cited by 5,317
The Limitations of Deep Learning in Adversarial Settings
Papernot, N., McDaniel, P., Jha, S., Fredrikson, M., Celik, Z. B., & Swami, A. (2016) · 2016 IEEE European Symposium on Security and Privacy (EuroS&P) · doi:10.1109/eurosp.2016.36 · Cited by 3,993
Self-citationPractical Black-Box Attacks against Machine Learning
Papernot, N., McDaniel, P., Goodfellow, I., Jha, S., Celik, Z. B., & Swami, A. (2017) · Proceedings of the 2017 ACM on Asia Conference on Computer and Communications Security · doi:10.1145/3052973.3053009 · Cited by 3,495
Self-citationEnsemble Adversarial Training: Attacks and Defenses
Tramèr, F., Kurakin, A., Papernot, N., Goodfellow, I., Boneh, D., & McDaniel, P. (2017) · arXiv · doi:10.48550/arxiv.1705.07204 · Cited by 2,176
Self-citationObfuscated gradients give a false sense of security: Circumventing defenses to adversarial examples
Athalye, A., Carlini, N., & Wagner, D. (2018) · arXiv · doi:10.48550/arxiv.1802.00420 · Cited by 2,172 · cited 11×
“In their analysis of the ICLR 2018 defenses (Athalye et al., 2018), the authors spent five times longer re-implementing the defenses than performing the security evaluation of the reimplementations.”
BackgroundInfluentialSelf-citationThe protection of information in computer systems
Saltzer, J. H., & Schroeder, M. D. (1975) · Proceedings of the IEEE · doi:10.1109/proc.1975.9939 · Cited by 2,126 · cited 1×
“The open design of security mechanisms is a cornerstone of the field of cryptography (Saltzer & Schroeder, 1975).”
BackgroundEvasion attacks against machine learning at test time
Biggio, B., Corona, I., Maiorca, D., Nelson, B. A., Srndic, N., Laskov, P., Giacinto, G., & Roli, F. (2017) · CINECA IRIS Institutial Research Information System (University of Genoa) · Cited by 1,870
Reluplex: An Efficient SMT Solver for Verifying Deep Neural Networks
Katz, G., Barrett, C., Dill, D. L., Julian, K., & Kochenderfer, M. J. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-63387-9_5 · Cited by 1,706
Chen, P.-Y., Zhang, H., Sharma, Y., Yi, J., & Hsieh, C.-J. (2017) · Proceedings of the 10th ACM Workshop on Artificial Intelligence and Security · doi:10.1145/3128572.3140448 · Cited by 1,656
Transferability in Machine Learning: from Phenomena to Black-Box Attacks using Adversarial Samples
Papernot, N., McDaniel, P., & Goodfellow, I. (2016) · arXiv · doi:10.48550/arxiv.1605.07277 · Cited by 1,326
Self-citationDelving into Transferable Adversarial Examples and Black-box Attacks
Liu, Y., Chen, X., Liu, C., & Song, D. (2016) · arXiv · doi:10.48550/arxiv.1611.02770 · Cited by 1,310
Decision-based adversarial attacks: Reliable attacks against black-box machine learning models
Brendel, W., Rauber, J., & Bethge, M. (2017) · arXiv · doi:10.48550/arxiv.1712.04248 · Cited by 1,018 · cited 2×
“• The Boundary Attack (Brendel et al., 2017) is general-purpose hard-label attack and performs a descent along the decision boundary using a rejection sampling approach.”
BackgroundSelf-citationAdversarial Examples Are Not Easily Detected: Bypassing Ten Detection Methods
Carlini, N., & Wagner, D. (2017) · Proceedings of the 10th ACM Workshop on Artificial Intelligence and Security · doi:10.1145/3128572.3140444 · Cited by 966
Self-citationDalvi, N., Domingos, P., Mausam, Sanghai, S., & Verma, D. (2004) · Proceedings of the tenth ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/1014052.1014066 · Cited by 887
Can machine learning be secure?
Barreno, M., Nelson, B., Sears, R., Joseph, A. D., & Tygar, J. D. (2006) · Proceedings of the 2006 ACM Symposium on Information, computer and communications security · doi:10.1145/1128817.1128824 · Cited by 836
The security of machine learning
Barreno, M., Nelson, B., Joseph, A. D., & Tygar, J. D. (2010) · Machine Learning · doi:10.1007/s10994-010-5188-5 · Cited by 817
Lowd, D., & Meek, C. (2005) · Proceedings of the eleventh ACM SIGKDD international conference on Knowledge discovery in data mining · doi:10.1145/1081870.1081950 · Cited by 755
Certified Robustness to Adversarial Examples with Differential Privacy
Lecuyer, M., Atlidakis, V., Geambasu, R., Hsu, D., & Jana, S. (2019) · 2019 IEEE Symposium on Security and Privacy (SP) · doi:10.1109/sp.2019.00044 · Cited by 750
Provable defenses against adversarial examples via the convex outer adversarial polytope
Wong, E., & Kolter, J. Z. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.00851 · Cited by 634
EAD: Elastic-Net Attacks to Deep Neural Networks via Adversarial Examples
Chen, P.-Y., Sharma, Y., Zhang, H., Yi, J., & Hsieh, C.-J. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11302 · Cited by 569
Certified Defenses against Adversarial Examples
Raghunathan, A., Steinhardt, J., & Liang, P. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1801.09344 · Cited by 520
Carlini, N., Mishra, P., Vaidya, T., Zhang, Y., Sherr, M., Shields, C., Wagner, D., & Zhou, W. (2016) · USENIX Security Symposium · Cited by 458
Self-citationLarge-scale malware classification using random projections and neural networks
Dahl, G. E., Stokes, J. W., Deng, L., & Yu, D. (2013) · 2013 IEEE International Conference on Acoustics, Speech and Signal Processing · doi:10.1109/icassp.2013.6638293 · Cited by 439
Technical Report on the CleverHans v2.1.0 Adversarial Examples Library
Papernot, N., Faghri, F., Carlini, N., Goodfellow, I., Feinman, R., Kurakin, A., Xie, C., Sharma, Y., Brown, T., Roy, A., et al. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1610.00768 · Cited by 381
Self-citationAutoZOOM: Autoencoder-Based Zeroth Order Optimization Method for Attacking Black-Box Neural Networks
Tu, C.-C., Ting, P., Chen, P.-Y., Liu, S., Zhang, H., Yi, J., Hsieh, C.-J., & Cheng, S.-M. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.3301742 · Cited by 361
Adversarial Risk and the Dangers of Evaluating Against Weak Attacks
Uesato, J., O’Donoghue, B., van den Oord, A., & Kohli, P. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.05666 · Cited by 353
Adversarial Examples that Fool both Computer Vision and Time-Limited HumansPreprint
Elsayed, G. F., Shankar, S., Cheung, B., Papernot, N., Kurakin, A., Goodfellow, I., & Sohl‐Dickstein, J. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.08195 · Cited by 342
Self-citationFoolbox v0.8.0: A Python toolbox to benchmark the robustness of machine learning modelsPreprint
Rauber, J., Brendel, W., & Bethge, M. (2017) · arXiv (Cornell University) · Cited by 325
Self-citationEvaluating Robustness of Neural Networks with Mixed Integer Programming
Tjeng, V., Xiao, K., & Tedrake, R. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.07356 · Cited by 312
Nightmare at test time: robust learning by feature deletion
Globerson, A., & Roweis, S. (2006) · Proceedings of the 23rd international conference on Machine learning - ICML '06 · doi:10.1145/1143844.1143889 · Cited by 309
Motivating the Rules of the Game for Adversarial Example ResearchPreprint
Gilmer, J., Adams, R. P., Goodfellow, I., Andersen, D., & Dahl, G. E. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1807.06732 · Cited by 272
Self-citation(2017) · arXiv (Cornell University) · Cited by 261
On the Effectiveness of Interval Bound Propagation for Training Verifiably Robust Models
Gowal, S., Dvijotham, K., Stanforth, R., Bunel, R., Qin, C., Uesato, J., Arandjelović, R., Mann, T., & Kohli, P. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1810.12715 · Cited by 261
Benchmarking Neural Network Robustness to Common Corruptions and Surface VariationsPreprint
Hendrycks, D., & Dietterich, T. G. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1807.01697 · Cited by 239
MagNet and "Efficient Defenses Against Adversarial Attacks" are Not Robust to Adversarial ExamplesPreprint
Carlini, N., & Wagner, D. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.08478 · Cited by 230
Self-citationAdversarial Examples Are a Natural Consequence of Test Error in NoisePreprint
Ford, N., Gilmer, J., Carlini, N., & Cubuk, E. D. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1901.10513 · Cited by 230
Self-citationPractical Black-Box Attacks on Deep Neural Networks Using Efficient Query Mechanisms
Bhagoji, A. N., He, W., Li, B., & Song, D. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01258-8_10 · Cited by 226
Towards the first adversarially robust neural network model on MNIST
Schott, L., Rauber, J., Bethge, M., & Brendel, W. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.09190 · Cited by 225
Self-citationPrior Convictions: Black-Box Adversarial Attacks with Bandits and Priors
Ilyas, A., Engstrom, L., & Mądry, A. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1807.07978 · Cited by 218
Self-citationDefensive Distillation is Not Robust to Adversarial Examples
Carlini, N., & Wagner, D. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1607.04311 · Cited by 216
Self-citationRobustness of classifiers: from adversarial to random noise
Fawzi, A., Moosavi-Dezfooli, S.-M., & Pascal Frossard, B. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1608.08967 · Cited by 204
Multiple classifier systems for robust classifier design in adversarial environments
Biggio, B., Fumera, G., & Roli, F. (2010) · International Journal of Machine Learning and Cybernetics · doi:10.1007/s13042-010-0007-7 · Cited by 187
On the Robustness of the CVPR 2018 White-Box Adversarial Example DefensesPreprint
Athalye, A., & Carlini, N. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1804.03286 · Cited by 156
Self-citationDetection of Malicious PDF Files Based on Hierarchical Document Structure.
Šrndić, N., & Laskov, P. (2013) · Network and Distributed System Security Symposium · Cited by 151
Decision Boundary Analysis of Adversarial Examples
He, W., Li, B., & Song, D. X. (2018) · International Conference on Learning Representations · Cited by 144
Training for Faster Adversarial Robustness Verification via Inducing ReLU StabilityPreprint
Xiao, K., Tjeng, V., Shafiullah, N. M. M., & Mądry, A. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1809.03008 · Cited by 139
Self-citationAdversarial Example Defenses: Ensembles of Weak Defenses are not StrongPreprint
He, W., Wei, J., Chen, X., Carlini, N., & Song, D. X. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1706.04701 · Cited by 129
Self-citationEvaluating and Understanding the Robustness of Adversarial Logit PairingPreprint
Engstrom, L., Ilyas, A., & Athalye, A. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1807.10272 · Cited by 126
Self-citationSoK: Science, Security and the Elusive Goal of Security as a Scientific Pursuit
Herley, C., & van Oorschot, P. C. (2017) · IEEE Symposium on Security and Privacy (S&P) · doi:10.1109/sp.2017.38 · Cited by 121
Attacking the Madry Defense Model with $L_1$-based Adversarial ExamplesPreprint
Sharma, Y., & Chen, P. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1710.10733 · Cited by 110
Feature weighting for improved classifier robustness
Kołcz, A., & Teo, C.-H. (2009) · ANU Open Research (Australian National University) · Cited by 102
European conference on machine learning and knowledge discovery in databases
Luttinen, J., Raiko, T., & Ilin, A. (2014) · Cited by 79
Logit Pairing Methods Can Fool Gradient-Based AttacksPreprint
Mosbach, M., Andriushchenko, M., Trost, T. A., Hein, M., & Klakow, D. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1810.12042 · Cited by 69
With Friends Like These, Who Needs Adversaries?Preprint
Jetley, S., Lord, N. A., & Torr, P. H. S. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1807.04200 · Cited by 55
L2-Nonexpansive Neural NetworksPreprint
Qian, H., & Wegman, M. N. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.07896 · Cited by 45
Bypassing Feature Squeezing by Increasing Adversary StrengthPreprint
Sharma, Y., & Chen, P. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1803.09868 · Cited by 38
Is AmI (Attacks Meet Interpretability) Robust to Adversarial Examples?Preprint
Carlini, N. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1902.02322 · Cited by 33
Self-citationLu, P.-H., Chen, P., & Yu, C.-M. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1803.09638 · Cited by 30
Comment on "Biologically inspired protection of deep networks from adversarial attacks"Preprint
Brendel, W., & Bethge, M. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1704.01547 · Cited by 28
Self-citationOn the Limitation of MagNet Defense Against L1-Based Adversarial Examples
Lu, P.-H., Chen, P., Chen, K.-C., & Yu, C.-M. (2018) · International Conference on Dependable Systems and Networks workshops · doi:10.1109/dsn-w.2018.00065 · Cited by 20
Generative Adversarial Examples.Preprint
Song, Y., Shu, R., Kushman, N., & Ermon, S. (2018) · arXiv (Cornell University) · Cited by 13
The Efficacy of SHIELD under Different Threat ModelsPreprint
Cornelius, C. T., Das, N., Chen, S.-T., Chen, L., Kounavis, M. E., & Chau, D. H. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1902.00541 · Cited by 6
Cited by
Adversarial Examples Are Not Bugs, They Are Features
Ilyas, A., Santurkar, S., Tsipras, D., Engstrom, L., Tran, B., & Madry, A. (2019) · arXiv · doi:10.48550/arxiv.1905.02175 · Cited by 971
Self-citationHigh-Frequency Component Helps Explain the Generalization of Convolutional Neural Networks
Wang, H., Wu, X., Huang, Z., & Xing, E. P. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00871 · Cited by 638
Fast is better than free: Revisiting adversarial training
Wong, E., Rice, L., & Kolter, J. Z. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2001.03994 · Cited by 544
On Adaptive Attacks to Adversarial Example Defenses
Tramer, F., Carlini, N., Brendel, W., & Madry, A. (2020) · arXiv · doi:10.48550/arxiv.2002.08347 · Cited by 486
Self-citationJailbreaking Leading Safety-Aligned LLMs with Simple Adaptive Attacks
Andriushchenko, M., Croce, F., & Flammarion, N. (2024) · arXiv · doi:10.48550/arxiv.2404.02151 · Cited by 396
Metadata
- Authors
- Carlini, N., Athalye, A., Papernot, N., Brendel, W., Rauber, J., Tsipras, D., Goodfellow, I., Mądry, A., & Kurakin, A.
- Venue
- arXiv (Cornell University)
- Publisher
- Cornell University
- Published
- 2019-02-18
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1902.06705
- OpenAlex
- W2913848079
- Cited by
- 524
- References
- 68
- Type
- posted content
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.