The DOI matches its Crossref record; 83 of the 83 references it cites were found in a registry or an index.
A Systematic Review on Data Scarcity Problem in Deep Learning: Solution and Applications
Abstract
Recent advancements in deep learning architecture have increased its utility in real-life applications. Deep learning models require a large amount of data to train the model. In many application domains, there is a limited set of data available for training neural networks as collecting new data is either not feasible or requires more resources such as in marketing, computer vision, and medical science. These models require a large amount of data to avoid the problem of overfitting. One of the data space solutions to the problem of limited data is data augmentation. The purpose of this study focuses on various data augmentation techniques that can be used to further improve the accuracy of a neural network. This saves the cost and time consumption required to collect new data for the training of deep neural networks by augmenting available data. This also regularizes the model and improves its capability of generalization. The need for large datasets in different fields such as computer vision, natural language processing, security, and healthcare is also covered in this survey paper. The goal of this paper is to provide a comprehensive survey of recent advancements in data augmentation techniques and their application in various domains.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Pan, S. J., & Yang, Q. (2010) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2009.191 · Cited by 23,387
A survey on Image Data Augmentation for Deep Learning
Shorten, C., & Khoshgoftaar, T. M. (2019) · Journal of Big Data · doi:10.1186/s40537-019-0197-0 · Cited by 13,203
Towards Evaluating the Robustness of Neural Networks
Carlini, N., & Wagner, D. (2017) · 2017 IEEE Symposium on Security and Privacy (SP) · doi:10.1109/sp.2017.49 · Cited by 8,859
Intriguing properties of neural networks
Szegedy, C., Zaremba, W., Sutskever, I., Bruna, J., Erhan, D., Goodfellow, I., & Fergus, R. (2013) · arXiv · doi:10.48550/arxiv.1312.6199 · Cited by 8,143
Weiss, K., Khoshgoftaar, T. M., & Wang, D. (2016) · Journal of Big Data · doi:10.1186/s40537-016-0043-6 · Cited by 6,260
Image Style Transfer Using Convolutional Neural Networks
Gatys, L. A., Ecker, A. S., & Bethge, M. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.265 · Cited by 6,025
Domain Adaptation via Transfer Component Analysis
Pan, S. J., Tsang, I. W., Kwok, J. T., & Yang, Q. (2011) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2010.2091281 · Cited by 4,753
Learning and Transferring Mid-level Image Representations Using Convolutional Neural Networks
Oquab, M., Bottou, L., Laptev, I., & Sivic, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.222 · Cited by 3,150 · cited 1×
“learning (Oquab et al., 2014; S. J. Pan et al., 2011), parameter-based transfer learning (Tommasi et al.”
BackgroundSurvey on deep learning with class imbalance
Johnson, J. M., & Khoshgoftaar, T. M. (2019) · Journal of Big Data · doi:10.1186/s40537-019-0192-5 · Cited by 3,032
Revisiting Unreasonable Effectiveness of Data in Deep Learning Era
Sun, C., Shrivastava, A., Singh, S., & Gupta, A. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.97 · Cited by 2,484
Frid-Adar, M., Diamant, I., Klang, E., Amitai, M., Goldberger, J., & Greenspan, H. (2018) · Neurocomputing · doi:10.1016/j.neucom.2018.09.013 · Cited by 1,938
The Unreasonable Effectiveness of Data
Halevy, A., Norvig, P., & Pereira, F. (2009) · IEEE Intelligent Systems · doi:10.1109/mis.2009.36 · Cited by 1,767
Data augmentation for improving deep learning in image classification problem
Mikolajczyk, A., & Grochowski, M. (2018) · 2018 International Interdisciplinary PhD Workshop (IIPhDW) · doi:10.1109/iiphdw.2018.8388338 · Cited by 1,697
Villarraga Ossa, E. F. (2021) · LA Referencia (Red Federada de Repositorios Institucionales de Publicaciones Científicas) · Cited by 1,688
A systematic review of systematic review process research in software engineering
Kitchenham, B., & Brereton, P. (2013) · Information and Software Technology · doi:10.1016/j.infsof.2013.07.010 · Cited by 1,094
Cost-Sensitive Learning of Deep Feature Representations From Imbalanced Data
Khan, S. H., Hayat, M., Bennamoun, M., Sohel, F. A., & Togneri, R. (2018) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2017.2732482 · Cited by 967
Transfer Learning for Visual Categorization: A Survey
Shao, L., Zhu, F., & Li, X. (2015) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2014.2330900 · Cited by 895
Multi-grade brain tumor classification using deep CNN with extensive data augmentation
Sajjad, M., Khan, S., Muhammad, K., Wu, W., Ullah, A., & Baik, S. W. (2019) · Journal of Computational Science · doi:10.1016/j.jocs.2018.12.003 · Cited by 891
Improving Deep Learning with Generic Data Augmentation
Taylor, L., & Nitschke, G. (2018) · 2018 IEEE Symposium Series on Computational Intelligence (SSCI) · doi:10.1109/ssci.2018.8628742 · Cited by 796
CovidGAN: Data Augmentation Using Auxiliary Classifier GAN for Improved Covid-19 Detection
Waheed, A., Goyal, M., Gupta, D., Khanna, A., Al-Turjman, F., & Pinheiro, P. R. (2020) · IEEE Access · doi:10.1109/access.2020.2994762 · Cited by 759
Zero-Shot Learning with Semantic Output Codes
Palatucci, M., Pomerleau, D., Hinton, G. E., & Mitchell, T. M. (2018) · Figshare · doi:10.1184/r1/6476456 · Cited by 752
Convolutional Neural Network With Data Augmentation for SAR Target Recognition
Ding, J., Chen, B., Liu, H., & Huang, M. (2016) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2015.2513754 · Cited by 708
What you saw is not what you get: Domain adaptation using asymmetric kernel transforms
Kulis, B., Saenko, K., & Darrell, T. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995702 · Cited by 688
GRAM: Graph-based Attention Model for Healthcare Representation Learning
Choi, E., Bahadori, M. T., Song, L., Stewart, W. F., & Sun, J. (2017) · Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/3097983.3098126 · Cited by 637
Adaptation Regularization: A General Framework for Transfer Learning
Long, M., Wang, J., Ding, G., Pan, S. J., & Yu, P. S. (2014) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2013.111 · Cited by 606
Evaluating deep learning architectures for Speech Emotion Recognition
Fayek, H. M., Lech, M., & Cavedon, L. (2017) · Neural Networks · doi:10.1016/j.neunet.2017.02.013 · Cited by 554
Domain Transfer Multiple Kernel Learning
Duan, L., Tsang, I. W., & Xu, D. (2012) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2011.114 · Cited by 548
Computer vision and deep learning techniques for pedestrian detection and tracking: A survey
Brunetti, A., Buongiorno, D., Trotta, G. F., & Bevilacqua, V. (2018) · Neurocomputing · doi:10.1016/j.neucom.2018.01.092 · Cited by 536
A new image classification method using CNN transfer learning and web data augmentation
Han, D., Liu, Q., & Fan, W. (2018) · Expert Systems with Applications · doi:10.1016/j.eswa.2017.11.028 · Cited by 512
A survey on deep learning based face recognition
Guo, G., & Zhang, N. (2019) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2019.102805 · Cited by 485
Data Augmentation Using Random Image Cropping and Patching for Deep CNNs
Takahashi, R., Matsubara, T., & Uehara, K. (2020) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2019.2935128 · Cited by 477
Boosting for transfer learning with multiple sources
Yao, Y., & Doretto, G. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5539857 · Cited by 464
Learning With Augmented Features for Supervised and Semi-Supervised Heterogeneous Domain Adaptation
Li, W., Duan, L., Xu, D., & Tsang, I. W. (2014) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.167 · Cited by 449
Deep learning-based image recognition for autonomous driving
Fujiyoshi, H., Hirakawa, T., & Yamashita, T. (2019) · IATSS Research · doi:10.1016/j.iatssr.2019.11.008 · Cited by 439
Applications of Generative Adversarial Networks (GANs): An Updated Review
Alqahtani, H., Kavakli-Thorne, M., & Kumar, G. (2021) · Archives of Computational Methods in Engineering · doi:10.1007/s11831-019-09388-y · Cited by 431
Smart Augmentation Learning an Optimal Data Augmentation Strategy
Lemley, J., Bazrafkan, S., & Corcoran, P. (2017) · IEEE Access · doi:10.1109/access.2017.2696121 · Cited by 428
A survey on heterogeneous transfer learning
Day, O., & Khoshgoftaar, T. M. (2017) · Journal of Big Data · doi:10.1186/s40537-017-0089-0 · Cited by 360
Do We Really Need to Collect Millions of Faces for Effective Face Recognition?
Masi, I., Trần, A. T., Hassner, T., Leksut, J. T., & Medioni, G. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46454-1_35 · Cited by 339
Recent advances in deep learning
Wang, X., Zhao, Y., & Pourpanah, F. (2020) · International Journal of Machine Learning and Cybernetics · doi:10.1007/s13042-020-01096-5 · Cited by 321
MIMETIC: Mobile encrypted traffic classification using multimodal deep learning
Aceto, G., Ciuonzo, D., Montieri, A., & Pescapè, A. (2019) · Computer Networks · doi:10.1016/j.comnet.2019.106944 · Cited by 288
Exploring Generalization in Deep Learning
Neyshabur, B., Bhojanapalli, S., McAllester, D., & Srebro, N. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1706.08947 · Cited by 284
Heterogeneous Defect Prediction
Nam, J., Fu, W., Kim, S., Menzies, T., & Tan, L. (2018) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2017.2720603 · Cited by 277
The survey: Text generation models in deep learning
Iqbal, T., & Qureshi, S. (2022) · Journal of King Saud University - Computer and Information Sciences · doi:10.1016/j.jksuci.2020.04.001 · Cited by 232
Safety in numbers: Learning categories from few examples with multi model knowledge transfer
Tommasi, T., Orabona, F., & Caputo, B. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5540064 · Cited by 216
KAME: Knowledge-based Attention Model for Diagnosis Prediction in Healthcare
Ma, F., You, Q., Xiao, H., Chitta, R., Zhou, J., & Gao, J. (2018) · Proceedings of the 27th ACM International Conference on Information and Knowledge Management · doi:10.1145/3269206.3271701 · Cited by 213
Spectral images based environmental sound classification using CNN with meaningful data augmentation
Mushtaq, Z., Su, S.-F., & Tran, Q.-V. (2021) · Applied Acoustics · doi:10.1016/j.apacoust.2020.107581 · Cited by 188
Improved Mixed-Example Data Augmentation
Summers, C., & Dinneen, M. J. (2019) · 2019 IEEE Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv.2019.00139 · Cited by 177
Feature Ensemble Plus Sample Selection: Domain Adaptation for Sentiment Classification
Xia, R., Zong, C., Hu, X., & Cambria, E. (2013) · IEEE Intelligent Systems · doi:10.1109/mis.2013.27 · Cited by 172
Regularizing Deep Networks with Semantic Data Augmentation
Wang, Y., Huang, G., Song, S., Pan, X., Xia, Y., & Wu, C. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3052951 · Cited by 163
Risk Prediction on Electronic Health Records with Prior Medical Knowledge
Ma, F., Gao, J., Suo, Q., You, Q., Zhou, J. L., & Zhang, A. (2018) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3219819.3220020 · Cited by 162
GAN augmentation to deal with imbalance in imaging-based intrusion detection
Andresini, G., Appice, A., Rose, L., & Malerba, D. (2021) · Future Generation Computer Systems · doi:10.1016/j.future.2021.04.017 · Cited by 162
Forward Noise Adjustment Scheme for Data Augmentation
Moreno-Barea, F. J., Strazzera, F., Jerez, J. M., Urda, D., & Franco, L. (2018) · 2018 IEEE Symposium Series on Computational Intelligence (SSCI) · doi:10.1109/ssci.2018.8628917 · Cited by 158
On overfitting, generalization, and randomly expanded training sets
Karystinos, G. N., & Pados, D. A. (2000) · IEEE Transactions on Neural Networks · doi:10.1109/72.870038 · Cited by 148
PacketCGAN: Exploratory Study of Class Imbalance for Encrypted Traffic Classification Using CGAN
Wang, P., Li, S., Ye, F., Wang, Z., & Zhang, M. (2020) · International Conference on Communications · doi:10.1109/icc40277.2020.9148946 · Cited by 146
A survey on face data augmentation for the training of deep neural networks
Wang, X., Wang, K., & Lian, S. (2020) · Neural Computing and Applications · doi:10.1007/s00521-020-04748-3 · Cited by 141
Semi-supervised task-driven data augmentation for medical image segmentation
Chaitanya, K., Karani, N., Baumgartner, C. F., et al. (2020) · Medical Image Analysis · doi:10.1016/j.media.2020.101934 · Cited by 134
Dhiraj, & Jain, D. K. (2019) · Pattern Recognition Letters · doi:10.1016/j.patrec.2019.01.014 · Cited by 120
Bang, S., Baek, F., Park, S., Kim, W., & Kim, H. (2020) · Automation in Construction · doi:10.1016/j.autcon.2020.103198 · Cited by 120
PAC-GAN: Packet Generation of Network Traffic using Generative Adversarial Networks
Cheng, A. (2019) · IEEE Annual Information Technology, Electronics and Mobile Communication Conference (IEMCON) · doi:10.1109/iemcon.2019.8936224 · Cited by 110
Pandey, S., Singh, P. R., & Tian, J. (2019) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2019.101782 · Cited by 91
Generative Adversarial Network Based Image Augmentation for Insect Pest Classification Enhancement
Lu, C., Rustia, D. J. A., & Lin, T. (2019) · IFAC-PapersOnLine · doi:10.1016/j.ifacol.2019.12.406 · Cited by 85
A Preliminary Study on Data Augmentation of Deep Learning for Image Classification
Lei, C., Hu, B., Wang, D., Zhang, S., & Chen, Z. (2019) · Asia-Pacific Symposium on Internetware · doi:10.1145/3361242.3361259 · Cited by 78
Document-level multi-topic sentiment classification of Email data with BiLSTM and data augmentation
Liu, S., Lee, K., & Lee, I. (2020) · Knowledge-Based Systems · doi:10.1016/j.knosys.2020.105918 · Cited by 71
Meng, F., Liu, H., Liang, Y., Tu, J., & Liu, M. (2019) · IEEE Transactions on Image Processing · doi:10.1109/tip.2019.2913544 · Cited by 66
Data augmentation using generative adversarial networks for robust speech recognition
Qian, Y., Hu, H., & Tan, T. (2019) · Speech Communication · doi:10.1016/j.specom.2019.08.006 · Cited by 66
Human action recognition in drone videos using a few aerial training examples
Sultani, W., & Shah, M. A. (2021) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2021.103186 · Cited by 64
Rating Augmentation with Generative Adversarial Networks towards Accurate Collaborative Filtering
Chae, D., Kang, J.-S., Kim, S., & Choi, J. (2019) · International World Wide Web Conference (WWW) · doi:10.1145/3308558.3313413 · Cited by 62
Combating Negative Transfer From Predictive Distribution Differences
Seah, C.-W., Ong, Y.-S., & Tsang, I. W.-H. (2012) · IEEE Transactions on Cybernetics · doi:10.1109/tsmcb.2012.2225102 · Cited by 59
Malik, K. M., Krishnamurthy, M., Alobaidi, M., Hussain, M., Alam, F., & Malik, G. M. (2019) · Expert Systems with Applications · doi:10.1016/j.eswa.2019.113120 · Cited by 56
Adversarial Framing for Image and Video Classification
Zając, M., Żołna, K., Rostamzadeh, N., & Pinheiro, P. O. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.330110077 · Cited by 55
A Case Study of the Augmentation and Evaluation of Training Data for Deep Learning
Ding, J., Li, X., Kang, X., & Gudivada, V. N. (2019) · Journal of Data and Information Quality · doi:10.1145/3317573 · Cited by 48
Introduction to the special issue on deep learning approaches for machine translation
Costa‐jussà, M. R., Allauzen, A., Barrault, L., Cho, K., & Schwenk, H. (2017) · Computer Speech & Language · doi:10.1016/j.csl.2017.03.001 · Cited by 45
A novel data augmentation scheme for pedestrian detection with attribute preserving GAN
Liu, S., Guo, H., Hu, J., Zhao, X. F., Zhao, C., Wang, T., Zhu, Y., Wang, J., & Tang, M. (2020) · Neurocomputing · doi:10.1016/j.neucom.2020.02.094 · Cited by 43
A multi-cascaded model with data augmentation for enhanced paraphrase detection in short texts
Shakeel, M. H., Karim, A., & Khan, I. (2020) · Information Processing & Management · doi:10.1016/j.ipm.2020.102204 · Cited by 41
Acoustic data augmentation for Mandarin-English code-switching speech recognition
Long, Y., Li, Y., Zhang, Q., et al. (2019) · Applied Acoustics · doi:10.1016/j.apacoust.2019.107175 · Cited by 40
Cognitive data augmentation for adversarial defense via pixel masking
Agarwal, A., Mayank Vatsa, A., Singh, R., & Ratha, N. (2021) · Pattern Recognition Letters · doi:10.1016/j.patrec.2021.01.032 · Cited by 38
A deep inference learning framework for healthcare
Dai, Y., & Wang, G. (2018) · Pattern Recognition Letters · doi:10.1016/j.patrec.2018.02.009 · Cited by 33
Text data augmentations: Permutation, antonyms and negation
Haralabopoulos, G., Torres, M. T., Anagnostopoulos, I. E., & McAuley, D. (2021) · Expert Systems with Applications · doi:10.1016/j.eswa.2021.114769 · Cited by 33
Örnek, A. H., & Ceylan, M. (2019) · International Conference on Telecommunications and Signal Processing (TSP) · doi:10.1109/tsp.2019.8769068 · Cited by 30
Structure-augmented knowledge graph embedding for sparse data with rule learning
Zhao, F., Sun, H., Jin, L., & Jin, H. (2020) · Computer Communications · doi:10.1016/j.comcom.2020.05.017 · Cited by 27
Object-adaptive LSTM network for real-time visual tracking with adversarial data augmentation
Du, Y., Yan, Y., Chen, S., & Yang, H. (2019) · Neurocomputing · doi:10.1016/j.neucom.2019.12.022 · Cited by 24
Progressive and Aligned Pose Attention Transfer for Person Image Generation
Zhu, Z., Huang, T., Xu, M., Shi, B., Cheng, W., & Bai, X. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3068236 · Cited by 24
Cited by
Zhao, Z., Alzubaidi, L., Zhang, J., Duan, Y., & Gu, Y. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.122807 · Cited by 410
Towards Trustworthy Machine Learning in Production: An Overview of the Robustness in MLOps Approach
Bayram, F., & Ahmed, B. S. (2025) · ACM Computing Surveys · doi:10.1145/3708497 · Cited by 48
Towards Understanding the Interplay of Generative Artificial Intelligence and the Internet
Martínez, G., Watson, L., Reviriego, P., Hernández, J. A., Juarez, M., & Sarkar, R. (2023) · arXiv · doi:10.48550/arxiv.2306.06130 · Cited by 36
Metadata
- Authors
- Bansal, M. A., Sharma, D. R., & Kathuria, D. M.
- Venue
- ACM Computing Surveys
- Published
- 2022-01-31
- Volume
- 54
- Issue
- 10s
- Pages
- 1-29
- ISSN
- 0360-0300 (ISSN-L)
- 1557-7341
- OpenAlex
- W4206337041
- Cited by
- 306
- References
- 83
- FWCI
- 4.96
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.