The DOI matches its Crossref record; 35 of the 35 references it cites were found in a registry or an index.
Data augmentation for improving deep learning in image classification problem
Abstract
These days deep learning is the fastest-growing field in the field of Machine Learning (ML) and Deep Neural Networks (DNN). Among many of DNN structures, the Convolutional Neural Networks (CNN) are currently the main tool used for the image analysis and classification purposes. Although great achievements and perspectives, deep neural networks and accompanying learning algorithms have some relevant challenges to tackle. In this paper, we have focused on the most frequently mentioned problem in the field of machine learning, that is the lack of sufficient amount of the training data or uneven class balance within the datasets. One of the ways of dealing with this problem is so called data augmentation. In the paper we have compared and analyzed multiple methods of data augmentation in the task of image classification, starting from classical image transformations like rotating, cropping, zooming, histogram based methods and finishing at Style Transfer and Generative Adversarial Networks, along with the representative examples. Next, we presented our own method of data augmentation based on image style transfer. The method allows to generate the new images of high perceptual quality that combine the content of a base image with the appearance of another ones. The newly created images can be used to pre-train the given neural network in order to improve the training process efficiency. Proposed method is validated on the three medical case studies: skin melanomas diagnosis, histopathological images and breast magnetic resonance imaging (MRI) scans analysis, utilizing the image classification in order to provide a diagnose. In such kind of problems the data deficiency is one of the most relevant issues. Finally, we discuss the advantages and disadvantages of the methods being analyzed.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
Image-to-Image Translation with Conditional Adversarial Networks
Isola, P., Zhu, J.-Y., Zhou, T., & Efros, A. A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.632 · Cited by 22,930
Labaca-Castro, R. (2023) · Machine Learning under Malware Attack · doi:10.1007/978-3-658-40442-0_9 · Cited by 19,272
Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network
Ledig, C., Theis, L., Huszar, F., Caballero, J., Cunningham, A., Acosta, A., Aitken, A., Tejani, A., Totz, J., Wang, Z., et al. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.19 · Cited by 12,696
Image Style Transfer Using Convolutional Neural Networks
Gatys, L. A., Ecker, A. S., & Bethge, M. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.265 · Cited by 6,025
Shin, H.-C., Roth, H. R., Gao, M., Lu, L., Xu, Z., Nogues, I., Yao, J., Mollura, D., & Summers, R. M. (2016) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2016.2528162 · Cited by 5,759
Random Erasing Data Augmentation
Zhong, Z., Zheng, L., Kang, G., Li, S., & Yang, Y. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i07.7000 · Cited by 3,617
Random Erasing Data Augmentation
Zhong, Z., Zheng, L., Kang, G., Li, S., & Yang, Y. (2017) · arXiv · doi:10.48550/arxiv.1708.04896 · Cited by 3,617
Deep learning and its applications to machine health monitoring
Zhao, R., Yan, R., Chen, Z., Mao, K., Wang, P., & Gao, R. X. (2019) · Mechanical Systems and Signal Processing · doi:10.1016/j.ymssp.2018.05.050 · Cited by 2,894
A Neural Algorithm of Artistic Style
Gatys, L., Ecker, A., & Bethge, M. (2016) · Journal of Vision · doi:10.1167/16.12.326 · Cited by 2,612
The Effectiveness of Data Augmentation in Image Classification using Deep Learning
Perez, L., & Wang, J. (2017) · arXiv · doi:10.48550/arxiv.1712.04621 · Cited by 2,499
Generative Adversarial Text to Image Synthesis
Reed, S., Akata, Z., Yan, X., Logeswaran, L., Schiele, B., & Lee, H. (2016) · arXiv · doi:10.48550/arxiv.1605.05396 · Cited by 2,494
One Pixel Attack for Fooling Deep Neural Networks
Su, J., Vargas, D. V., & Sakurai, K. (2019) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2019.2890858 · Cited by 2,406
Image quilting for texture synthesis and transfer
Efros, A. A., & Freeman, W. T. (2001) · Proceedings of the 28th annual conference on Computer graphics and interactive techniques · doi:10.1145/383259.383296 · Cited by 2,347
Hertzmann, A., Jacobs, C. E., Oliver, N., Curless, B., & Salesin, D. H. (2001) · Proceedings of the 28th annual conference on Computer graphics and interactive techniques · doi:10.1145/383259.383295 · Cited by 1,518
Survey on data-driven industrial process monitoring and diagnosis
Qin, S. J. (2012) · Annual Reviews in Control · doi:10.1016/j.arcontrol.2012.09.004 · Cited by 1,470
NIPS 2016 Tutorial: Generative Adversarial Networks
Goodfellow, I. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1701.00160 · Cited by 1,229
Semantic Image Inpainting with Deep Generative Models
Yeh, R. A., Chen, C., Lim, T. Y., Schwing, A. G., Hasegawa-Johnson, M., & Do, M. N. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.728 · Cited by 1,206
Photographic Image Synthesis with Cascaded Refinement Networks
Chen, Q., & Koltun, V. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.168 · Cited by 887
Synthetic data augmentation using GAN for improved liver lesion classification
Frid-Adar, M., Klang, E., Amitai, M., Goldberger, J., & Greenspan, H. (2018) · 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018) · doi:10.1109/isbi.2018.8363576 · Cited by 860
Luan, F., Paris, S., Shechtman, E., & Bala, K. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.740 · Cited by 714
Unsupervised learning of hierarchical representations with convolutional deep belief networks
Lee, H., Grosse, R., Ranganath, R., & Ng, A. Y. (2011) · Communications of the ACM · doi:10.1145/2001269.2001295 · Cited by 388
(2017) · arXiv (Cornell University) · Cited by 261
GP-GAN: Towards Realistic High-Resolution Image Blending
Wu, H., Zheng, S., Zhang, J., & Huang, K. (2019) · Proceedings of the 27th ACM International Conference on Multimedia · doi:10.1145/3343031.3350944 · Cited by 200
Style Transfer Via Texture Synthesis
Elad, M., & Milanfar, P. (2017) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2678168 · Cited by 171
Deep Learning and Its Applications to Machine Health Monitoring: A SurveyPreprint
Zhao, R., Yan, R., Chen, Z., Mao, K., Wang, P. E., & Gao, R. X. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1612.07640 · Cited by 154
Split and Match: Example-Based Adaptive Patch Sampling for Unsupervised Style Transfer
Frigo, O., Sabater, N., Delon, J., et al. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.66 · Cited by 134
GP-GAN: Towards Realistic High-Resolution Image BlendingPreprint
Wu, H., Zheng, S., Zhang, J., & Huang, K. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.07195 · Cited by 126
Deep neural networks approach to skin lesions classification — A comparative analysis
Kwasigroch, A., Mikołajczyk, A., & Grochowski, M. (2017) · International Conference on Methods and Models in Automation and Robotics · doi:10.1109/mmar.2017.8046978 · Cited by 88
Self-citationLeakage fault detection in district metered areas of water distribution systems
Eliades, D. G., & Polycarpou, M. M. (2012) · Journal of Hydroinformatics · doi:10.2166/hydro.2012.109 · Cited by 75
Robust Convolutional Neural Networks under Adversarial NoisePreprint
Jin, J., Dündar, A., & Culurciello, E. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1511.06306 · Cited by 74
Data-Driven Color Augmentation Techniques for Deep Skin Image AnalysisPreprint
Galdrán, A., Álvarez-Gila, A., Meyer, M. I., Saratxaga, C. L., Araújo, T., Garrote, E., Aresta, G., Costa, P., Mendonça, A. M., & Campilho, A. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.03702 · Cited by 60
Exploring the Neural Algorithm of Artistic StylePreprint
Nikulin, Y. V., & Novak, R. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1602.07188 · Cited by 42
Kwasigroch, A., Mikołajczyk, A., & Grochowski, M. (2017) · Advances in intelligent systems and computing · doi:10.1007/978-3-319-60699-6_81 · Cited by 34
Self-citationImproving the Neural Algorithm of Artistic StylePreprint
Novak, R., & Nikulin, Y. V. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1605.04603 · Cited by 14
Research works printed but not linked: 11
- 0, ISBI 2017
- 0, ISIC Archive
- glowacz, 2018, Recognition of Thermal Images of Direct Current Motor with Application of Area Perimeter Vector and Bayes Classifier, Measurement Science Review, 15, 119, 10.1515/msr-2015-0018 · doi:10.1515/msr-2015-0018
- 10.4028/www.scientific.net/KEM.588.333 · doi:10.4028/www.scientific.net/kem.588.333
- rutkowski, 2018, Identification of the Contamination Source Location in the Drinking Water Distribution System Based on the Neural Network Classifier, The 10th IFAC Symposium on Fault Detection Supervision and Safety of Technical Processes (SafeProcess 2018)
- 10.1007/978-3-642-23935-9_49 · doi:10.1007/978-3-642-23935-9_49
- 0, Mole Check
- 0, DERMOFIT Datasets
- 10.1007/978-3-319-60699-6_79 · doi:10.1007/978-3-319-60699-6_79
- 10.1117/12.2297218 · doi:10.1117/12.2297218
- 10.2478/v10006-012-0070-1 · doi:10.2478/v10006-012-0070-1
Cited by
A survey on Image Data Augmentation for Deep Learning
Shorten, C., & Khoshgoftaar, T. M. (2019) · Journal of Big Data · doi:10.1186/s40537-019-0197-0 · Cited by 13,203
Albumentations: fast and flexible image augmentations
Buslaev, A., Iglovikov, V. I., Khvedchenya, E., Parinov, A., Druzhinin, M., & Kalinin, A. A. (2020) · Information · doi:10.3390/info11020125 · Cited by 2,714
AutoML: A survey of the state-of-the-art
He, X., Zhao, K., & Chu, X. (2021) · Knowledge-Based Systems · doi:10.1016/j.knosys.2020.106622 · Cited by 1,691
Exploring the effect of image enhancement techniques on COVID-19 detection using chest X-ray images
Rahman, T., Khandakar, A., Qiblawey, Y., Tahir, A., Kiranyaz, S., Abul Kashem, S. B., Islam, M. T., Al Maadeed, S., Zughaier, S. M., Khan, M. S., et al. (2021) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2021.104319 · Cited by 1,147
A review of medical image data augmentation techniques for deep learning applications
Chlap, P., Min, H., Vandenberg, N., Dowling, J., Holloway, L., & Haworth, A. (2021) · Journal of Medical Imaging and Radiation Oncology · doi:10.1111/1754-9485.13261 · Cited by 956
Metadata
- Authors
- Mikolajczyk, A., & Grochowski, M.
- Venue
- 2018 International Interdisciplinary PhD Workshop (IIPhDW)
- Publisher
- IEEE
- Published
- 2018-05
- Pages
- 117-122
- OpenAlex
- W2809598685
- Cited by
- 1,697
- References
- 35
- FWCI
- 40.69
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.