The DOI matches its Crossref record; 53 of the 53 references it cites were found in a registry or an index.
Adversarial Examples Improve Image Recognition
Open accessAbstract
Adversarial examples are commonly viewed as a threat to ConvNets. Here we present an opposite perspective: adversarial examples can be used to improve image recognition models if harnessed in the right manner. We propose AdvProp, an enhanced adversarial training scheme which treats adversarial examples as additional examples, to prevent overfitting. Key to our method is the usage of a separate auxiliary batch norm for adversarial examples, as they have different underlying distributions to normal examples. We show that AdvProp improves a wide range of models on various image recognition tasks and performs better when the models are bigger. For instance, by applying AdvProp to the latest EfficientNet-B7 [28] on ImageNet, we achieve significant improvements on ImageNet (+0.7%), ImageNet-C (+6.5%), ImageNet-A (+7.0%), Stylized-ImageNet (+4.8%). With an enhanced EfficientNet-B8, our method achieves the state-of-the-art 85.5% ImageNet top-1 accuracy without extra data. This result even surpasses the best model in [20] which is trained with 3.5B Instagram images (~3000X more than ImageNet) and ~9.4X more parameters. Code and models will be made publicly available.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Densely Connected Convolutional Networks
Huang, G., Liu, Z., Van Der Maaten, L., & Weinberger, K. Q. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.243 · Cited by 48,566
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
Rethinking the Inception Architecture for Computer Vision
Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., & Wojna, Z. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.308 · Cited by 32,138
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S., & Szegedy, C. (2015) · arXiv · doi:10.48550/arxiv.1502.03167 · Cited by 27,818
EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks
Tan, M., & Le, Q. V. (2019) · arXiv · doi:10.48550/arxiv.1905.11946 · Cited by 17,072
Self-citationExplaining and Harnessing Adversarial Examples
Goodfellow, I. J., Shlens, J., & Szegedy, C. (2014) · arXiv · doi:10.48550/arxiv.1412.6572 · Cited by 10,381
Howard, A., Sandler, M., Chen, B., Wang, W., Chen, L.-C., Tan, M., Chu, G., Vasudevan, V., Zhu, Y., Pang, R., et al. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00140 · Cited by 9,708
Self-citationIntriguing properties of neural networks
Szegedy, C., Zaremba, W., Sutskever, I., Bruna, J., Erhan, D., Goodfellow, I., & Fergus, R. (2013) · arXiv · doi:10.48550/arxiv.1312.6199 · Cited by 8,143
Towards Deep Learning Models Resistant to Adversarial Attacks
Madry, A., Makelov, A., Schmidt, L., Tsipras, D., & Vladu, A. (2017) · arXiv · doi:10.48550/arxiv.1706.06083 · Cited by 6,602
mixup: Beyond Empirical Risk Minimization
Zhang, H., Cisse, M., Dauphin, Y. N., & Lopez-Paz, D. (2017) · arXiv · doi:10.48550/arxiv.1710.09412 · Cited by 5,831
Arbitrary Style Transfer in Real-Time with Adaptive Instance Normalization
Huang, X., & Belongie, S. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.167 · Cited by 5,076
On Assessing ML Model Robustness: A Methodological Framework (Academic Track)
Awadid, A., & Robert, B. (2025) · OASIcs : OpenAccess Series in Informatics · doi:10.4230/oasics.saia.2024.1 · Cited by 4,702
RandAugment: Practical automated data augmentation with a reduced search space
Cubuk, E. D., Zoph, B., Shlens, J., & Le, Q. V. (2019) · arXiv · doi:10.48550/arxiv.1909.13719 · Cited by 3,223
Self-citationVirtual Adversarial Training: A Regularization Method for Supervised and Semi-Supervised Learning
Miyato, T., Maeda, S.-I., Koyama, M., & Ishii, S. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2858821 · Cited by 2,843
Improved regularization of convolutional neural networks with cutout
DeVries, T., & Taylor, G. W. (2017) · arXiv · doi:10.48550/arxiv.1708.04552 · Cited by 2,776
Self-Training With Noisy Student Improves ImageNet Classification
Xie, Q., Luong, M.-T., Hovy, E., & Le, Q. V. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01070 · Cited by 2,393
Self-citationAdversarial machine learning at scale
Kurakin, A., Goodfellow, I., & Bengio, S. (2016) · arXiv · doi:10.48550/arxiv.1611.01236 · Cited by 2,325
Ensemble Adversarial Training: Attacks and Defenses
Tramèr, F., Kurakin, A., Papernot, N., Goodfellow, I., Boneh, D., & McDaniel, P. (2017) · arXiv · doi:10.48550/arxiv.1705.07204 · Cited by 2,176
Theoretically principled trade-off between robustness and accuracy
Zhang, H., Yu, Y., Jiao, J., Xing, E. P., Ghaoui, L. E., & Jordan, M. I. (2019) · arXiv · doi:10.48550/arxiv.1901.08573 · Cited by 1,560
Geirhos, R., Rubisch, P., Michaelis, C., Bethge, M., Wichmann, F. A., & Brendel, W. (2018) · arXiv · doi:10.48550/arxiv.1811.12231 · Cited by 1,490
Exploring the Limits of Weakly Supervised Pretraining
Mahajan, D., Girshick, R., Ramanathan, V., He, K., Paluri, M., Li, Y., Bharambe, A., & van der Maaten, L. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01216-8_12 · Cited by 1,224
AutoAugment: Learning Augmentation Policies from Data
Cubuk, E. D., Zoph, B., Mane, D., Vasudevan, V., & Le, Q. V. (2018) · arXiv · doi:10.48550/arxiv.1805.09501 · Cited by 1,106
Self-citationHendrycks, D., Zhao, K., Basart, S., Steinhardt, J., & Song, D. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01501 · Cited by 1,090
Feature denoising for improving adversarial robustness
Xie, C., Wu, Y., Maaten, L. V. D., Yuille, A. L., & He, K. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00059 · Cited by 940
Self-citationMixup: Beyond empirical risk minimization
Zhang, H. (2024) · arXiv (Cornell University) · doi:10.57702/dcy1c3gw · Cited by 773
Unlabeled Data Improves Adversarial RobustnessPreprint
Carmon, Y., Raghunathan, A., Schmidt, L., Liang, P., & Duchi, J. C. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.13736 · Cited by 696
Learning Data Augmentation Strategies for Object Detection
Zoph, B., Cubuk, E. D., Ghiasi, G., Lin, T.-Y., Shlens, J., & Le, Q. V. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58583-9_34 · Cited by 570
Self-citationDeep Co-Training for Semi-Supervised Image Recognition
Qiao, S., Shen, W., Zhang, Z., Wang, B., & Yuille, A. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01267-0_9 · Cited by 507
Self-citationAdversarially Robust Generalization Requires More Data
Schmidt, L., Santurkar, S., Tsipras, D., Talwar, K., & Mądry, A. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1804.11285 · Cited by 476
Smart Augmentation Learning an Optimal Data Augmentation Strategy
Lemley, J., Bazrafkan, S., & Corcoran, P. (2017) · IEEE Access · doi:10.1109/access.2017.2696121 · Cited by 428
Boyle, E., LaVigne, R., & Vaikuntanathan, V. (2018) · arXiv (Cornell University) · doi:10.4230/lipics.itcs.2019.16 · Cited by 408
Adversarial Training Can Hurt GeneralizationPreprint
Raghunathan, A., Xie, S. M., Yang, F., Duchi, J. C., & Liang, P. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.06032 · Cited by 305
Understanding and Mitigating the Tradeoff Between Robustness and AccuracyPreprint
Raghunathan, A., Xie, S. M., Yang, F., Duchi, J. C., & Liang, P. (2020) · International Conference on Machine Learning · doi:10.48550/arxiv.2002.10716 · Cited by 269
Improving Robustness Without Sacrificing Accuracy with Patch Gaussian AugmentationPreprint
Lopes, R. G., Yin, D., Poole, B., Gilmer, J., & Cubuk, E. D. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.02611 · Cited by 251
Benchmarking Neural Network Robustness to Common Corruptions and Surface VariationsPreprint
Hendrycks, D., & Dietterich, T. G. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1807.01697 · Cited by 239
Disentangling Adversarial Robustness and Generalization
Stutz, D., Hein, M., & Schiele, B. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00714 · Cited by 223
RandAugment: Practical data augmentation with no separate search.Preprint
Cubuk, E. D., Zoph, B., Shlens, J., & Le, Q. V. (2019) · arXiv (Cornell University) · Cited by 197
Self-citationAdversarial AutoAugmentPreprint
Zhang, X., Wang, Q., Zhang, J., & Zhong, Z. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1912.11188 · Cited by 179
Boosting Adversarial Training with Hypersphere EmbeddingPreprint
Pang, T., Yang, X. H., Dong, Y., Xu, K., Zhu, J., & Su, H. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.08619 · Cited by 178
Interpreting Adversarially Trained Convolutional Neural Networks
Zhang, T., & Zhu, Z. (2019) · ePrints Soton (University of Southampton) · doi:10.48550/arxiv.1905.09797 · Cited by 176
Are Labels Required for Improving Adversarial Robustness?
Uesato, J., Alayrac, J.-B., Huang, P.-S., Stanforth, R., Fawzi, A., & Kohli, P. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.13725 · Cited by 159
Adversarially Robust Generalization Just Requires More Unlabeled DataPreprint
Zhai, R., Cai, T., He, D., Chen, D., He, K., Hopcroft, J. E., & Wang, L. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.00555 · Cited by 153
Robustness to Adversarial Perturbations in Learning from Incomplete DataPreprint
Najafi, A., Maeda, S., Koyama, M., & Miyato, T. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.13021 · Cited by 128
CAT: Customized Adversarial Training for Improved Robustness
Cheng, M., Lei, Q., Chen, P., Dhillon, I. S., & Hsieh, C. (2022) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2022/95 · Cited by 128
Adversarial Robustness May Be at Odds With SimplicityPreprint
Nakkiran, P. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1901.00532 · Cited by 124
There Is No Free Lunch In Adversarial Robustness (But There Are Unexpected Benefits)Preprint
Tsipras, D., Santurkar, S., Engstrom, L., Turner, A., & Mądry, A. (2018) · arXiv (Cornell University) · Cited by 54
Min, Y., Chen, L., & Karbasi, A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.11080 · Cited by 49
Implicit Bias of Gradient Descent based Adversarial Training on Separable DataPreprint
Li, Y., Fang, E. X., Xu, H., & Zhao, T. (2020) · arXiv (Cornell University) · Cited by 19
Inductive Bias of Gradient Descent based Adversarial Training on Separable DataPreprint
Li, Y., Fang, E. X., Xu, H., & Zhao, T. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.02931 · Cited by 12
Cited by
Going deeper with Image Transformers
Touvron, H., Cord, M., Sablayrolles, A., Synnaeve, G., & Jegou, H. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00010 · Cited by 1,259
Normalization Techniques in Training DNNs: Methodology, Analysis and Application
Huang, L., Qin, J., Zhou, Y., Zhu, F., Liu, L., & Shao, L. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3250241 · Cited by 537
Adversarial Reciprocal Points Learning for Open Set Recognition
Chen, G., Peng, P., Wang, X., & Tian, Y. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3106743 · Cited by 344
Advances in Adversarial Attacks and Defenses in Computer Vision: A Survey
Akhtar, N., Mian, A., Kardan, N., & Shah, M. (2021) · IEEE Access · doi:10.1109/access.2021.3127960 · Cited by 302
VOLO: Vision Outlooker for Visual Recognition
Yuan, L., Hou, Q., Jiang, Z., Feng, J., & Yan, S. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3206108 · Cited by 288
Metadata
- Authors
- Xie, C., Tan, M., Gong, B., Wang, J., Yuille, A. L., & Le, Q. V.
- Venue
- 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2020-06
- Pages
- 816-825
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W3035743198
- Cited by
- 488
- References
- 53
- FWCI
- 34.07
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.