Adversarial Noise Layer: Regularize Neural Network by Adding Noise
Open accessThe DOI matches its Crossref record; 23 of the 23 references it cites were found in a registry or an index.
Abstract
In this paper, we introduce a novel regularization method called Adversarial Noise Layer (ANL), which are able to significantly improve CNN's generalization ability by adding carefully crafted noise into the intermediate layer activations. ANL can be easily implemented and integrated with most of the mainstream CNN-based models. We compared the effects of the different types of noise and visually demonstrate that our proposed adversarial noise instruct CNN models to learn to extract cleaner feature maps, which further reduce the risk of over-fitting. We also conclude that models trained with ANL are more robust to the adversarial examples generated by FGSM than the traditional adversarial training approaches.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Tabular data can be easily shuffled, but the perturbation of images can have unpredictable effects, with research demonstrating this type of manipulation (for example, adversarial noise) both as an attack against algorithms 65 and a regularization mechanism leading to increased robustness 66 and resilience against inversion attacks.”
From Secure, privacy-preserving and federated machine learning in medical imaging (2020) · cites this paper as [66]
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474 · cited 5×
“We also explore the effects of different noises on the VGG-16 (Si-monyan and Zisserman 2015) and ResNet (He et al. 2016a) models using CIFAR-10 and CIFAR-100 (Krizhevsky and Hinton 2009) datasets.”
MethodInfluentialVery Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148 · cited 11×
“[21] introduced the methods to avoid over-fitting by random horizontal flipping train data, which directly enlarge training dataset.”
BackgroundMethodInfluentialImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155 · cited 4×
“Many regularization methods [3, 4, 5] have been proposed to prevent over-fitting by adding noise into the training data.”
BackgroundMethodInfluentialGradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805 · cited 5×
“We trained a LeNet-5 (LeCun et al. 1998) network on MNIST for 3 epochs.”
MethodInfluentialThe Nature of Statistical Learning Theory
Vapnik, V. N. (1995) · doi:10.1007/978-1-4757-2440-0 · Cited by 39,138
(2014) · Cited by 33,419
Learning Multiple Layers of Features from Tiny Images
Krizhevsky, A. (2024) · doi:10.57702/zp44cu3g · Cited by 23,395
MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications
Howard, A. G., Zhu, M., Chen, B., Kalenichenko, D., Wang, W., Weyand, T., Andreetto, M., & Adam, H. (2017) · arXiv · doi:10.48550/arxiv.1704.04861 · Cited by 19,015
Visualizing and understanding convolutional networks
Zeiler, M. D., & Fergus, R. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10590-1_53 · Cited by 15,839 · cited 2×
“The modern view of deep CNN architectures is that deep neural network extracts the vision features layer by layer (Zeiler and Fergus 2014).”
BackgroundIdentity mappings in deep residual networks
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46493-0_38 · Cited by 10,741
Research works printed but not linked: 1
- rosenblatt, 1957, The Perceptron A perceiving and recognizing automaton Project PARA
Cited by
Secure, privacy-preserving and federated machine learning in medical imaging
Kaissis, G. A., Makowski, M. R., Rückert, D., & Braren, R. F. (2020) · Nature Machine Intelligence · doi:10.1038/s42256-020-0186-1 · Cited by 1,676
“…but the perturbation of images can have unpredictable effects, with research demonstrating this type of manipulation (for example, adversarial noise) both as an attack against algorithms 65 and a regularization mechanism leading to increased robustness 66 and resilience against inversion attacks.”
BackgroundDigital Electronics and Analog Photonics for Convolutional Neural Networks (DEAP-CNNs)
Bangari, V., Marquez, B. A., Miller, H., Tait, A. N., Nahmias, M. A., de Lima, T. F., Peng, H.-T., Prucnal, P. R., & Shastri, B. J. (2020) · IEEE Journal of Selected Topics in Quantum Electronics · doi:10.1109/jstqe.2019.2945540 · Cited by 241
SecureBERT: A Domain-Specific Language Model for Cybersecurity
Aghaei, E., Niu, X., Shadid, W., & Al-Shaer, E. (2023) · Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering · doi:10.1007/978-3-031-25538-0_3 · Cited by 210
“Referring to previous works on maintaining robust neural networks [18,31,33], incorporation of noise to an unstable neural network model with a limited training set can act as a regularizer and help reduce overfitting during the training.”
Rubik’s Cube+: A self-supervised feature learning framework for 3D medical image analysis
Zhu, J., Li, Y., Hu, Y., Ma, K., Zhou, S. K., & Zheng, Y. (2020) · Medical Image Analysis · doi:10.1016/j.media.2020.101746 · Cited by 161
Deep learning in electron microscopy
Ede, J. M. (2020) · Machine Learning Science and Technology · doi:10.1088/2632-2153/abd614 · Cited by 143
Metadata
- Authors
- You, Z., Ye, J., Li, K., Xu, Z., & Wang, P.
- Affiliations
- Peking University (CN)
- University of Electronic Science and Technology of China (CN)
- Australian National University (AU)
- Venue
- 2019 IEEE International Conference on Image Processing (ICIP)
- Publisher
- IEEE
- Published
- 2019-09
- Pages
- 909-913
- ISSN
- 1522-4880 (ISSN-L)
- OpenAlex
- W2971018118
- Semantic Scholar
- a39149da8f9ec8fc398b9f1506c61e17650e3118
- Cited by
- 80
- References
- 23
- Citations by year
- 2026: 1 · 2025: 8 · 2024: 15 · 2023: 12 · 2022: 11 · 2021: 11 · 2020: 15 · 2019: 7
- FWCI
- 4.21
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- Proceedings - International Conference on Image Processing (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Adversarial Robustness in Machine Learning
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Data Classification
- Keywords
- neural network regularization, convolutional neural networks, generalization, overfitting, feature maps, adversarial examples, FGSM, adversarial robustness, noise injection
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Adversarial Noise Layer: Regularize Neural Network by Adding Noise. https://app.cochat.ai/papers/10.1109/icip.2019.8803055
- The paper
- You, Z., Ye, J., Li, K., Xu, Z., & Wang, P. (2019). Adversarial Noise Layer: Regularize Neural Network by Adding Noise. 2019 IEEE International Conference on Image Processing (ICIP). https://doi.org/10.1109/icip.2019.8803055
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.