CoChat
Sign Up
PreprintCited by 2,499Advanced Neural Network ApplicationsDomain Adaptation and Few-Shot LearningMachine Learning and Data Classification

The Effectiveness of Data Augmentation in Image Classification using Deep Learning

Open access
Perez, Luis, Wang, Jason·2017·arXiv
DOI 10.48550/arxiv.1712.04621arXiv 1712.04621
Open this paper in CoChat — free accountOpen PDF

Abstract

In this paper, we explore and compare multiple solutions to the problem of data augmentation in image classification. Previous work has demonstrated the effectiveness of data augmentation through simple techniques, such as cropping, rotating, and flipping input images. We artificially constrain our access to data to a small subset of the ImageNet dataset, and compare each data augmentation technique in turn. One of the more successful data augmentations strategies is the traditional transformations mentioned above. We also experiment with GANs to generate images of different styles. Finally, we propose a method to allow a neural net to learn augmentations that best improve the classifier, which we call neural augmentation. We discuss the successes and shortcomings of this method on various datasets.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.1712.04621

Cites

1 of 1 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Feature space augmentation based on CNNs and AEs, adversarial training, and especially GAN-based models are among the key techniques for data augmentation.

    “Feature space augmentation based on CNNs and AEs, adversarial training and especially GAN-based models are among the key techniques.”

    From Deepfakes: current and future trends (2024) · cites this paper as Perez and Wang 2017

    The Methods (p. 2) and Related Work (p. 2) discuss GAN-based and neural-network approaches to data augmentation. They do not identify CNN- or autoencoder-based feature-space augmentation or adversarial training as separate key techniques. The Conclusion (p. 7) also says traditional augmentation was very effective and GAN and neural approaches did not perform much better, so the emphasis on GANs is not supported. (LLM, conf=0.88)

    Experimental — accuracy not yet measured

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 15

  1. [4][4] H. S. Baird. Document image analysis. chapter Document Image Defect Models, pages 315-325. IEEE Computer Society Press, Los Alamitos, CA, USA, 1995. 2 -
  2. [5][5] D. C. Ciresan, U. Meier, L. M. Gambardella, and J. Schmidhuber. Deep big simple neural nets excel on handwritten digit recognition. CoRR , abs/1003.0358, 2010. 2 - · arXiv
  3. [6][6] Y. Gal and Z. Ghahramani. A Theoretically Grounded Application of Dropout in Recurrent Neural Networks. ArXiv e-prints , Dec. 2015. 2 -
  4. [7][7] S. Gurumurthy, R. Kiran Sarvadevabhatla, and V. Babu Radhakrishnan. DeLiGAN : Generative Adversarial Networks for Diverse and Limited Data. ArXiv e-prints , June 2017. 2 -
  5. [8][8] A. Halevy, P. Norvig, and F. Pereira. The unreasonable effectiveness of data. IEEE Intelligent Systems , 24(2):8-12, Mar. 2009. 1 -
  6. [9][9] E. Jannik Bjerrum. SMILES Enumeration as Data Augmentation for Neural Network Modeling of Molecules. ArXiv e-prints , Mar. 2017. 3 -
  7. [10][10] Y. Kubo, G. Tucker, and S. Wiesler. Compacting Neural Network Classifiers via Dropout Training. ArXiv e-prints , Nov. 2016. 2 -
  8. [11][11] X. Liang, Z. Hu, H. Zhang, C. Gan, and E. P. Xing. Recurrent topic-transition GAN for visual paragraph generation. CoRR , abs/1703.07022, 2017. 2 - · arXiv
  9. [12][12] Y. Ma and D. Klabjan. Convergence analysis of batch normalization for deep neural nets. CoRR , abs/1705.08011, 2017. 2 - · arXiv
  10. [13][13] M. Marchesi. Megapixel Size Image Creation using Generative Adversarial Networks. ArXiv e-prints , May 2017. 2 -
  11. [14][14] C. N. Vasconcelos and B. N. Vasconcelos. Increasing deep learning melanoma classification by classical and expert knowledge based image transforms. CoRR , abs/1702.07025, 2017. 1 - · arXiv
  12. [15][15] B. Wang and D. Klabjan. Regularization for unsupervised deep neural nets. CoRR , abs/1608.04426, 2016. 2 - · arXiv
  13. [16][16] S. C. Wong, A. Gatt, V. Stamatescu, and M. D. McDonnell. Understanding data augmentation for classification: when to warp? CoRR , abs/1609.08764, 2016. 1 - · arXiv
  14. [17][17] S. Xiang and H. Li. On the Effects of Batch and Weight Normalization in Generative Adversarial Networks. ArXiv e-prints , Apr. 2017. 2 -
  15. [18][18] Y. Xu, R. Jia, L. Mou, G. Li, Y. Chen, Y. Lu, and Z. Jin. Improved relation classification by deep recurrent neural networks with data augmentation. CoRR , abs/1601.03651, 2016. 1 - · arXiv

Cited by

Sorted by citations

Authors
Perez, L., & Wang, J.
ORCID
Wang, Jason
Venue
arXiv
Publisher
arXiv
Published
2017
ISSN
2331-8422 (ISSN-L)
DOI
10.48550/arxiv.1712.04621
arXiv
1712.04621
OpenAlex
W2775795276
Cited by
2,499
References
1
Citations by year
2026: 15 · 2025: 135 · 2024: 301 · 2023: 321 · 2022: 312 · 2021: 519 · 2020: 459 · 2019: 328 · 2018: 102 · 2017: 4
Type
posted content
Language
en
Open access
Licence
arxiv.org/licenses/nonexclusive-distrib/1.0/
Locations
  • arXiv (Cornell University) (submittedVersion)
  • viXra (submittedVersion)
  • arXiv (Cornell University)
Topics
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
  • Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
  • Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Data Classification
Keywords
data augmentation, image classification, generative adversarial networks, ImageNet, image transformation, limited training data, deep learning

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review