The DOI matches its Crossref record; 154 of the 154 references it cites were found in a registry or an index.
A Survey on Data Augmentation for Text Classification
Open accessAbstract
Data augmentation, the artificial creation of training data for machine learning by transformations, is a widely studied research field across machine learning disciplines. While it is useful for increasing a model's generalization capabilities, it can also address many other challenges and problems, from overcoming a limited amount of training data to regularizing the objective, to limiting the amount of data used to protect privacy. Based on a precise description of the goals and applications of data augmentation and a taxonomy for existing works, this survey is concerned with data augmentation methods for textual classification and aims at providing a concise and comprehensive overview for researchers and practitioners. Derived from the taxonomy, we divide more than 100 methods into 12 different groupings and give state-of-the-art references expounding which methods are highly promising by relating them to each other. Finally, research perspectives that may constitute a building block for future work are provided.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
Glove: Global Vectors for Word Representation
Pennington, J., Socher, R., & Manning, C. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1162 · Cited by 34,071
(2014) · Cited by 33,419
SMOTE synthetic minority over-sampling technique
Chawla, N. V., Bowyer, K. W., Hall, L. O., & Kegelmeyer, W. P. (2002) · Journal of Artificial Intelligence Research · doi:10.1613/jair.953 · Cited by 32,865
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372
Kaugeranna, R., Kaugeranna, E., & Aion, (. S. 4. 6. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.giscience.2023.43 · Cited by 13,690
A survey on Image Data Augmentation for Deep Learning
Shorten, C., & Khoshgoftaar, T. M. (2019) · Journal of Big Data · doi:10.1186/s40537-019-0197-0 · Cited by 13,203
Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks
Reimers, N., & Gurevych, I. (2019) · Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · doi:10.18653/v1/d19-1410 · Cited by 12,778
Proceedings of the 25th international conference on Machine learning - ICML '08
(2008) · doi:10.1145/1390156 · Cited by 6,680
mixup: Beyond Empirical Risk Minimization
Zhang, H., Cisse, M., Dauphin, Y. N., & Lopez-Paz, D. (2017) · arXiv · doi:10.48550/arxiv.1710.09412 · Cited by 5,831
Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation
Wu, Y., Schuster, M., Chen, Z., Le, Q. V., Norouzi, M., Macherey, W., Krikun, M., Cao, Y., Gao, Q., Macherey, K., et al. (2016) · arXiv · doi:10.48550/arxiv.1609.08144 · Cited by 5,319 · cited 2×
“In this context, the basic idea of the method of Belinkov and Bisk [38] is to add artificial and natural noise to the training data so that, in their case, neural machine translation ( NMT ) models are less susceptible to adversarial examples.”
Harris, Z. S. (1954) · WORD · doi:10.1080/00437956.1954.11659520 · Cited by 4,807
DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter
Sanh, V., Debut, L., Chaumond, J., & Wolf, T. (2019) · arXiv · doi:10.48550/arxiv.1910.01108 · Cited by 4,653
Introduction to WordNet: An On-line Lexical Database*
Miller, G. A., Beckwith, R., Fellbaum, C., Gross, D., & Miller, K. J. (1990) · International Journal of Lexicography · doi:10.1093/ijl/3.4.235 · Cited by 4,197
Random Erasing Data Augmentation
Zhong, Z., Zheng, L., Kang, G., Li, S., & Yang, Y. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i07.7000 · Cited by 3,617
Random Erasing Data Augmentation
Zhong, Z., Zheng, L., Kang, G., Li, S., & Yang, Y. (2017) · arXiv · doi:10.48550/arxiv.1708.04896 · Cited by 3,617
Neural Networks and the Bias/Variance Dilemma
Geman, S., Bienenstock, E., & Doursat, R. (1992) · Neural Computation · doi:10.1162/neco.1992.4.1.1 · Cited by 3,578 · cited 1×
“On the other hand, they show a high variance for different subsets of training data [19].”
Character-level Convolutional Networks for Text Classification
Zhang, X., Zhao, J., & LeCun, Y. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1509.01626 · Cited by 3,205
Domain randomization for transferring deep neural networks from simulation to the real world
Tobin, J., Fong, R., Ray, A., Schneider, J., Zaremba, W., & Abbeel, P. (2017) · 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2017.8202133 · Cited by 3,124 · cited 1×
“With the help of adversarial training, these automatic adversarial example generators can be used as data augmentation methods, as done, for example, in [23], [7], [24], or [25], in order for models to be less susceptible to such easy alterations.”
Best practices for convolutional neural networks applied to visual document analysis
Simard, P. Y., Steinkraus, D., & Platt, J. C. (2005) · Seventh International Conference on Document Analysis and Recognition, 2003. Proceedings. · doi:10.1109/icdar.2003.1227801 · Cited by 2,741
SeqGAN: Sequence Generative Adversarial Nets with Policy Gradient
Yu, L., Zhang, W., Wang, J., & Yu, Y. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.10804 · Cited by 2,285
Proximal Splitting Methods in Signal Processing
Combettes, P. L., & Pesquet, J.-C. (2011) · Springer Optimization and Its Applications · doi:10.1007/978-1-4419-9569-8_10 · Cited by 2,183
Generating Sentences from a Continuous Space
Bowman, S. R., Vilnis, L., Vinyals, O., Dai, A., Jozefowicz, R., & Bengio, S. (2016) · Proceedings of The 20th SIGNLL Conference on Computational Natural Language Learning · doi:10.18653/v1/k16-1002 · Cited by 2,061
EDA: Easy Data Augmentation Techniques for Boosting Performance on Text Classification Tasks
Wei, J., & Zou, K. (2019) · Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · doi:10.18653/v1/d19-1670 · Cited by 1,911
Proceedings for the 5th International Conference on Learning Representations
Srivastava, A., & Sutton, C. A. (2017) · Cited by 1,829
TinyBERT: Distilling BERT for natural language understanding
Jiao, X., Yin, Y., Shang, L., Jiang, X., Chen, X., Li, L., Wang, F., & Liu, Q. (2020) · Findings of the Association for Computational Linguistics: EMNLP 2020 · doi:10.18653/v1/2020.findings-emnlp.372 · Cited by 1,786
A Synopsis of Linguistic Theory, 1930-1955
Firth, J. R. (1957) · Medical Entomology and Zoology · Cited by 1,675
Deep Learning--based Text Classification: A Comprehensive Review
Minaee, S., Kalchbrenner, N., Cambria, E., Nikzad, N., Chenaghlu, M., & Gao, J. (2022) · ACM Computing Surveys · doi:10.1145/3439726 · Cited by 1,538
Unsupervised Data Augmentation for Consistency Training
Xie, Q., Dai, Z., Hovy, E., Luong, M.-T., & Le, Q. V. (2019) · arXiv · doi:10.48550/arxiv.1904.12848 · Cited by 1,517
Understanding Black-box Predictions via Influence Functions
Koh, P. W., & Liang, P. (2017) · arXiv · doi:10.48550/arxiv.1703.04730 · Cited by 1,514
Deep learning and the information bottleneck principle
Tishby, N., & Zaslavsky, N. (2015) · 2015 IEEE Information Theory Workshop (ITW) · doi:10.1109/itw.2015.7133169 · Cited by 1,409
A Decomposable Attention Model for Natural Language Inference
Parikh, A., Täckström, O., Das, D., & Uszkoreit, J. (2016) · Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d16-1244 · Cited by 1,296
(2019) · doi:10.18653/v1/p19-1356 · Cited by 1,291
Audio augmentation for speech recognition
Ko, T., Peddinti, V., Povey, D., & Khudanpur, S. (2015) · Interspeech 2015 · doi:10.21437/interspeech.2015-711 · Cited by 1,104
Understanding Data Augmentation for Classification: When to Warp?
Wong, S. C., Gatt, A., Stamatescu, V., & McDonnell, M. D. (2016) · 2016 International Conference on Digital Image Computing: Techniques and Applications (DICTA) · doi:10.1109/dicta.2016.7797091 · Cited by 1,007
Right for the Wrong Reasons: Diagnosing Syntactic Heuristics in Natural Language Inference
McCoy, R. T., Pavlick, E., & Linzen, T. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1334 · Cited by 944
HotFlip: White-Box Adversarial Examples for Text Classification
Ebrahimi, J., Rao, A., Lowd, D., & Dou, D. (2018) · Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers) · doi:10.18653/v1/p18-2006 · Cited by 922
Synthetic data augmentation using GAN for improved liver lesion classification
Frid-Adar, M., Klang, E., Amitai, M., Goldberger, J., & Greenspan, H. (2018) · 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018) · doi:10.1109/isbi.2018.8363576 · Cited by 860
When does label smoothing help?
Müller, R., Kornblith, S., & Hinton, G. (2019) · arXiv · doi:10.48550/arxiv.1906.02629 · Cited by 859
Improving Deep Learning with Generic Data Augmentation
Taylor, L., & Nitschke, G. (2018) · 2018 IEEE Symposium Series on Computational Intelligence (SSCI) · doi:10.1109/ssci.2018.8628742 · Cited by 796
Generating Natural Language Adversarial Examples
Alzantot, M., Sharma, Y., Elgohary, A., Ho, B.-J., Srivastava, M., & Chang, K.-W. (2018) · Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d18-1316 · Cited by 787
Mixup: Beyond empirical risk minimization
Zhang, H. (2024) · arXiv (Cornell University) · doi:10.57702/dcy1c3gw · Cited by 773
Extracting Training Data from Large Language Models
Carlini, N., Tramer, F., Wallace, E., Jagielski, M., Herbert-Voss, A., Lee, K., Roberts, A., Brown, T., Song, D., Erlingsson, U., et al. (2020) · arXiv · doi:10.48550/arxiv.2012.07805 · Cited by 727
Time Series Data Augmentation for Deep Learning: A Survey
Wen, Q., Sun, L., Yang, F., Song, X., Gao, J., Wang, X., & Xu, H. (2021) · Proceedings of the Thirtieth International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2021/631 · Cited by 727
Tenney, I., Xia, P., Chen, B., Wang, A., Poliak, A., McCoy, R. T., Kim, N., Van Durme, B., Bowman, S. R., Das, D., et al. (2019) · arXiv · doi:10.48550/arxiv.1905.06316 · Cited by 698
Scaling to very very large corpora for natural language disambiguation
Banko, M., & Brill, E. (2001) · Proceedings of the 39th Annual Meeting on Association for Computational Linguistics - ACL '01 · doi:10.3115/1073012.1073017 · Cited by 675
A Survey of Data Augmentation Approaches for NLP
Feng, S., Gangal, V., Wei, J., Chandar, S., Vosoughi, S., Mitamura, T., & Hovy, E. (2021) · Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021 · doi:10.18653/v1/2021.findings-acl.84 · Cited by 670
Contextual Augmentation: Data Augmentation by Words with Paradigmatic Relations
Kobayashi, S. (2018) · Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 2 (Short Papers) · doi:10.18653/v1/n18-2072 · Cited by 603
Shafahi, A., Najibi, M., Ghiasi, A., Xu, Z., Dickerson, J., Studer, C., Davis, L. S., Taylor, G., & Goldstein, T. (2019) · ETH Zurich · doi:10.3929/ethz-b-000460345 · Cited by 580
Massive Exploration of Neural Machine Translation Architectures
Britz, D., Goldie, A., Luong, M.-T., & Le, Q. (2017) · Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d17-1151 · Cited by 482
ConSERT: A Contrastive Framework for Self-Supervised Sentence Representation Transfer
Yan, Y., Li, R., Wang, S., Zhang, F., Wu, W., & Xu, W. (2021) · Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · doi:10.18653/v1/2021.acl-long.393 · Cited by 474
Manifold Mixup: Better Representations by Interpolating Hidden States
Verma, V., Lamb, A., Beckham, C., Najafi, A., Mitliagkas, I., Courville, A. C., López-Paz, D., & Bengio, Y. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1806.05236 · Cited by 421
Text Understanding from Scratch
Zhang, X., & LeCun, Y. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1502.01710 · Cited by 395
Synthetic and Natural Noise Both Break Neural Machine Translation
Belinkov, Y., & Bisk, Y. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.02173 · Cited by 386
Assessing BERT's Syntactic Abilities
Goldberg, Y. (2019) · arXiv · doi:10.48550/arxiv.1901.05287 · Cited by 385
Counter-fitting Word Vectors to Linguistic Constraints
Mrkšić, N., Ó Séaghdha, D., Thomson, B., Gašić, M., Rojas-Barahona, L. M., Su, P.-H., Vandyke, D., Wen, T.-H., & Young, S. (2016) · Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.18653/v1/n16-1018 · Cited by 354
Vocal Tract Length Perturbation (VTLP) improves speech recognition
Jaitly, N., & Hinton, E. (2013) · Cited by 348
Chen, J., Yang, Z., & Yang, D. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.194 · Cited by 347
Conditional BERT Contextual Augmentation
Wu, X., Lv, S., Zang, L., Han, J., & Hu, S. (2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-22747-0_7 · Cited by 336
Data Augmentation by Pairing Samples for Images Classification
Inoue, H. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1801.02929 · Cited by 319
Distributional Smoothing with Virtual Adversarial Training
Miyato, T., Maeda, S., Koyama, M., Nakae, K., & Ishii, S. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1507.00677 · Cited by 317
Wang, W. Y., & Yang, D. (2015) · Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d15-1306 · Cited by 312
Crisis informatics—New data for extraordinary times
Palen, L., & Anderson, K. M. (2016) · Science · doi:10.1126/science.aag2579 · Cited by 309
Sentic LSTM: a Hybrid Network for Targeted Aspect-Based Sentiment Analysis
Ma, Y., Peng, H., Khan, T., Cambria, E., & Hussain, A. (2018) · Cognitive Computation · doi:10.1007/s12559-018-9549-x · Cited by 309
Generating Sentences by Editing Prototypes
Guu, K., Hashimoto, T. B., Oren, Y., & Liang, P. (2018) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00030 · Cited by 300
Do Not Have Enough Data? Deep Learning to the Rescue!
Anaby-Tavor, A., Carmeli, B., Goldbraich, E., Kantor, A., Kour, G., Shlomov, S., Tepper, N., & Zwerdling, N. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i05.6233 · Cited by 300
Data Augmentation using Pre-trained Transformer Models
Kumar, V., Choudhary, A., & Cho, E. (2020) · Proceedings of the 2nd Workshop on Life-long Learning for Spoken Language Systems · doi:10.18653/v1/2020.lifelongnlp-1.3 · Cited by 294
Release Strategies and the Social Impacts of Language Models
Solaiman, I., Brundage, M., Clark, J., Askell, A., Herbert-Voss, A., Wu, J., Radford, A., Krueger, G., Kim, J. W., Kreps, S., et al. (2019) · arXiv · doi:10.48550/arxiv.1908.09203 · Cited by 292 · cited 1×
“For instance, language models like GPT can contain biases that are then propagated into the dataset [160].”
(2018) · International Conference on Learning Representations · Cited by 285
FreeLB: Enhanced Adversarial Training for Natural Language Understanding
Zhu, C., Cheng, Y., Gan, Z., Sun, S., Goldstein, T., & Liu, J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1909.11764 · Cited by 268
Data Augmentation for Low-Resource Neural Machine Translation
Fadaee, M., Bisazza, A., & Monz, C. (2017) · Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers) · doi:10.18653/v1/p17-2090 · Cited by 266
Delta-encoder: an effective sample synthesis method for few-shot object recognition
Schwartz, E., Karlinsky, L., Shtok, J., Harary, S., Marder, M., Feris, R., Kumar, A., Giryes, R., & Bronstein, A. M. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1806.04734 · Cited by 266
CommonGen: A constrained text generation challenge for generative commonsense reasoning
Lin, B. Y., Zhou, W., Shen, M., Zhou, P., Bhagavatula, C., Choi, Y., & Ren, X. (2020) · Findings of the Association for Computational Linguistics: EMNLP 2020 · doi:10.18653/v1/2020.findings-emnlp.165 · Cited by 239 · cited 3×
“[129] consider another filtering mechanism in their work that does not need any human assistance and is sophisticated by incorporating two perspectives.”
InfluentialRobust Neural Machine Translation with Doubly Adversarial Inputs
Cheng, Y., Jiang, L., & Macherey, W. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1425 · Cited by 227
CLEAR: Contrastive Learning for Sentence Representation
Wu, Z., Wang, S., Gu, J., Khabsa, M., Sun, F., & Ma, H. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.15466 · Cited by 214
Adversarial Training for Large Neural Language ModelsPreprint
Liu, X., Cheng, H., He, P., Chen, W., Wang, Y., Poon, H., & Gao, J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2004.08994 · Cited by 210
Data Noising as Smoothing in Neural Network Language Models
Xie, Z., Wang, S., Li, J., Lévy, D., Nie, A., Jurafsky, D., & Ng, A. Y. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.02573 · Cited by 195
SwitchOut: an Efficient Data Augmentation Algorithm for Neural Machine Translation
Wang, X., Pham, H., Dai, Z., & Neubig, G. (2018) · Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d18-1100 · Cited by 194
Emotion Classification with Data Augmentation Using Generative Adversarial Networks
Zhu, X., Liu, Y., Li, J., Wan, T., & Qin, Z. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-93040-4_28 · Cited by 188
CERT: Contrastive Self-supervised Learning for Language Understanding
Fang, H., & Xie, P. (2020) · doi:10.36227/techrxiv.12308378.v1 · Cited by 187
A Field Guide to Forward-Backward Splitting with a FASTA Implementation
Goldstein, T., Studer, C., & Baraniuk, R. G. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1411.3406 · Cited by 184
Data augmentation instead of explicit regularizationPreprint
Hernández-García, Á., & Peter König, B. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1806.03852 · Cited by 181
Learning to Compose Domain-Specific Transformations for Data Augmentation
Ratner, A., Ehrenberg, H. R., Hussain, Z., Dunnmon, J., & Ré, C. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1709.01643 · Cited by 180
Adversarial Training Methods for Semi-Supervised Text Classification
Miyato, T., Dai, A. M., & Goodfellow, I. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1605.07725 · Cited by 179
Good-Enough Compositional Data Augmentation
Andreas, J. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.676 · Cited by 175
CERT: Contrastive Self-supervised Learning for Language UnderstandingPreprint
Fang, H., & Xie, P. (2020) · arXiv.org · doi:10.36227/techrxiv.12308378 · Cited by 170
Text Data Augmentation Made Simple By Leveraging NLP Cloud APIsPreprint
Coulombe, C. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1812.04718 · Cited by 168
(2020) · International Conference on Learning Representations · Cited by 168
Mixup-Transformer: Dynamic Data Augmentation for NLP Tasks
Sun, L., Xia, C., Yin, W., Liang, T., Yu, P. S., & He, L. (2020) · International Conference on Computational Linguistics · doi:10.18653/v1/2020.coling-main.305 · Cited by 168
A Generative Model for category text generation
Li, Y., Pan, Q., Wang, S., Yang, T., & Cambria, E. (2018) · Information Sciences · doi:10.1016/j.ins.2018.03.050 · Cited by 163
Towards Scalable and Reliable Capsule Networks for Challenging NLP Applications
Zhao, W., Peng, H., Eger, S., Cambria, E., & Yang, M. (2019) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p19-1150 · Cited by 163
Syntactic Data Augmentation Increases Robustness to Inference Heuristics
Min, J., McCoy, R. T., Das, D., Pitler, E., & Linzen, T. (2020) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2020.acl-main.212 · Cited by 163
Jiang, H., He, P., Chen, W., Liu, X., Gao, J., & Zhao, T. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.197 · Cited by 162
The GEM Benchmark: Natural Language Generation, its Evaluation and Metrics
Gehrmann, S., Adewumi, T., Aggarwal, K., Ammanamanchi, P. S., Aremu, A., Bosselut, A., Chandu, K. R., Clinciu, M.-A., Das, D., Dhole, K., et al. (2021) · Proceedings of the 1st Workshop on Natural Language Generation, Evaluation, and Metrics (GEM 2021) · doi:10.18653/v1/2021.gem-1.10 · Cited by 159
DAGA: Data Augmentation with a Generation Approach for Low-resource Tagging Tasks
Ding, B., Liu, L., Bing, L., Kruengkrai, C., Nguyen, T. H., Joty, S., Si, L., & Miao, C. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.488 · Cited by 157
Generative Data Augmentation for Commonsense Reasoning
Yang, Y., Malaviya, C., Fernandez, J., Swayamdipta, S., Bras, R. J. L., Wang, J., Bhagavatula, C., Choi, Y., & Downey, D. (2020) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2020.findings-emnlp.90 · Cited by 156
Bayer, M., Kaufhold, M., Buchhold, B., Keller, M., Dallmeyer, J., & Reuter, C. (2021) · International Journal of Machine Learning and Cybernetics · doi:10.1007/s13042-022-01553-3 · Cited by 156
Self-citationSoft Contextual Data Augmentation for Neural Machine Translation
Gao, F., Zhu, J., Wu, L., Xia, Y., Qin, T., Cheng, X., Zhou, W., & Liu, T. (2019) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p19-1555 · Cited by 154
GPT3Mix: Leveraging Large-scale Language Models for Text Augmentation
Yoo, K. M., Park, D., Kang, J., Lee, S.-W., & Park, W. (2021) · Findings of the Association for Computational Linguistics: EMNLP 2021 · doi:10.18653/v1/2021.findings-emnlp.192 · Cited by 151
Personalized Machine Translation: Preserving Original Author Traits
Rabinovich, E., Patel, R. N., Mirkin, S., Specia, L., & Wintner, S. (2017) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/e17-1101 · Cited by 149
Augmenting Data with Mixup for Sentence Classification: An Empirical StudyPreprint
Guo, H., Mao, Y., & Zhang, R. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.08941 · Cited by 140
Shen, D., Zheng, M., Shen, Y., Qu, Y., & Chen, W. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2009.13818 · Cited by 139
Data Augmentation via Dependency Tree Morphing for Low-Resource Languages
Şahin, G. G., & Steedman, M. J. (2018) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d18-1545 · Cited by 137
Data augmentation for low resource languages
Ragni, A., Knill, K., Rath, S. P., & Gales, M. (2014) · Interspeech (USB) · doi:10.21437/interspeech.2014-207 · Cited by 134
Kaufhold, M., Bayer, M., & Reuter, C. (2019) · Information Processing & Management · doi:10.1016/j.ipm.2019.102132 · Cited by 126
Self-citationLearning word dependencies in text by means of a deep recurrent belief network
Chaturvedi, I., Ong, Y.-S., Tsang, I. W.-H., Welsch, R. E., & Cambria, E. (2016) · Knowledge-Based Systems · doi:10.1016/j.knosys.2016.07.019 · Cited by 120
Augment to Prevent: Short-Text Data Augmentation in Deep Learning for Hate-Speech Classification
Rizos, G., Hemker, K., & Schuller, B. W. (2019) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3357384.3358040 · Cited by 119
NL-Augmenter 🦎 → 🐍 A Framework for Task-Sensitive Natural Language Augmentation
Dhole, K., Gangal, V., Gehrmann, S., Gupta, A., Li, Z., Mahamood, S., Mahadiran, A., Mille, S., Shrivastava, A., Tan, S., et al. (2023) · Northern European Journal of Language Technology · doi:10.3384/nejlt.2000-1533.2023.4725 · Cited by 118
Data Augmentation for Visual Question Answering
Kafle, K., Yousefhussien, M., & Kanan, C. (2017) · International Conference on Natural Language Generation · doi:10.18653/v1/w17-3529 · Cited by 117
Aroyehun, S. T., & Gelbukh, A. F. (2018) · International Conference on Computational Linguistics · Cited by 116
Learning Data Manipulation for Augmentation and WeightingPreprint
Hu, Z., Tan, B., Salakhutdinov, R., Mitchell, T. M., & Xing, E. P. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.12795 · Cited by 115
Improving Short Text Classification Through Global Augmentation Methods
Marivate, V. N., & Sefara, T. J. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-57321-8_21 · Cited by 107
Data Boost: Text Data Augmentation Through Reinforcement Learning Guided Conditional Generation
Liu, R., Xu, G., Jia, C., Ma, W., Wang, L., & Vosoughi, S. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.726 · Cited by 102
A Closer Look At Feature Space Data Augmentation For Few-Shot Intent Classification
Kumar, V., Glaude, H., de Lichy, C., & Campbell, W. M. (2019) · Workshop on Deep Learning Approaches for Low-Resource NLP (DeepLo) · doi:10.18653/v1/d19-6101 · Cited by 96
Data Augmentation for deep neural network acoustic modeling
Cui, X., Goel, V., & Kingsbury, B. E. D. (2014) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2014.6854671 · Cited by 90
Sequence-Level Mixed Sample Data Augmentation
Guo, D., Kim, Y., & Rush, A. M. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.447 · Cited by 89
Employing BERT-DCNN with sentic knowledge base for social media sentiment analysis
Jain, P. K., Quamer, W., Saravanan, V., & Pamula, R. (2022) · Journal of Ambient Intelligence and Humanized Computing · doi:10.1007/s12652-022-03698-z · Cited by 89
How Effective is Task-Agnostic Data Augmentation for Pretrained Transformers?
Longpre, S., Wang, Y., & DuBois, C. (2020) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2020.findings-emnlp.394 · Cited by 83
Nonlinear Mixup: Out-Of-Manifold Data Augmentation for Text Classification
Guo, H. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i04.5822 · Cited by 81
CoDA: Contrast-enhanced and Diversity-promoting Data Augmentation for Natural Language UnderstandingPreprint
Qu, Y., Shen, D., Shen, Y., Sajeev, S., Han, J., & Chen, W. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.08670 · Cited by 81
GenAug: Data Augmentation for Finetuning Text Generators
Feng, S. Y., Gangal, V., Kang, D., Mitamura, T., & Hovy, E. H. (2020) · Workshop on Knowledge Extraction and Integration for Deep Learning Architectures: Deep Learning Inside Out (DeeLIO) · doi:10.18653/v1/2020.deelio-1.4 · Cited by 77
Robust Training under Linguistic Adversity
Li, Y., Cohn, T., & Baldwin, T. (2017) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/e17-2004 · Cited by 76
Improving Neural Language Modeling via Adversarial TrainingPreprint
Wang, D., Gong, C., & Liu, Q. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.03805 · Cited by 72
Model-portability experiments for textual temporal analysis
Kolomiyets, O., Bethard, S. J., & Moens, M. (2011) · Lirias · Cited by 65
A novel approach to generate a large scale of supervised data for short text sentiment analysis
Sun, X. N., & He, J. (2018) · Multimedia Tools and Applications · doi:10.1007/s11042-018-5748-4 · Cited by 65
Residuals and Influence in Regression.
Robinson, A., Cook, R. D., & Weisberg, S. (1984) · Journal of the Royal Statistical Society Series A (General) · doi:10.2307/2981746 · Cited by 59
Neural Data-to-Text Generation with LM-based Text Augmentation
Chang, E., Shen, X., Zhu, D., Demberg, V., & Su, H. (2021) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/2021.eacl-main.64 · Cited by 58
Neural Data Augmentation via Example ExtrapolationPreprint
Lee, K., Guu, K., He, L., Dozat, T., & Chung, H. W. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.01335 · Cited by 57
AugLy: Data Augmentations for RobustnessPreprint
Papakipos, Z., & Bitton, J. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2201.06494 · Cited by 56
Soft Contextual Data Augmentation for Neural Machine TranslationPreprint
Zhu, J., Gao, F., Wu, L., Xia, Y., Qin, T., Zhou, W., Cheng, X., & Liu, T. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.10523 · Cited by 54
Vania, C., Kementchedjhieva, Y., Søgaard, A., & Lopez, A. (2019) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d19-1102 · Cited by 54
EasyAug: An Automatic Textual Data Augmentation Platform for Classification Tasks
Qiu, S., Xu, B., Zhang, J., Wang, Y., Shen, X., de Melo, G., Long, C., & Li, X. (2020) · International World Wide Web Conference (WWW) · doi:10.1145/3366424.3383552 · Cited by 54
Local Additivity Based Data Augmentation for Semi-supervised NER
Chen, J., Wang, Z., Tian, R., Yang, Z., & Yang, D. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.95 · Cited by 54
Controlled Text Generation for Data Augmentation in Intelligent Artificial Agents
Malandrakis, N., Shen, M., Goyal, A. K., Gao, S., Sethi, A. R., & Metallinou, A. (2019) · Workshop on Neural Generation and Translation (WNGT) · doi:10.18653/v1/d19-5609 · Cited by 49
Substructure Substitution: Structured Data Augmentation for NLP
Shi, H., Livescu, K., & Gimpel, K. (2021) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2021.findings-acl.307 · Cited by 45
TEXTUAL DATA AUGMENTATION FOR NEURAL NETWORKS
Jungiewicz, M., & Smywiński-Pohl, A. (2019) · Computer Science · doi:10.7494/csci.2019.20.1.3023 · Cited by 42
AugLy: Data Augmentations for Adversarial Robustness
Papakipos, Z., & Bitton, J. (2022) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw56347.2022.00027 · Cited by 41
Labeled Data Generation with Encoder-Decoder LSTM for Semantic Slot Filling
Kurata, G., Xiang, B., & Zhou, B. (2016) · Interspeech (USB) · doi:10.21437/interspeech.2016-727 · Cited by 39
C2L: Causally Contrastive Learning for Robust Text Classification
Choi, S. L., Jeong, M., Han, H., & Hwang, S.-W. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i10.21296 · Cited by 39
Tell Me How to Ask Again: Question Data Augmentation with Controllable Rewriting in Continuous Space
Liu, D., Gong, Y., Fu, J., Yan, Y., Chen, J., Lv, J., Duan, N., & Zhou, M. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.467 · Cited by 37
Keep Calm and Switch On! Preserving Sentiment and Fluency in Semantic Text Exchange
Feng, S. Y., Li, A. W., & Hoey, J. (2019) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d19-1272 · Cited by 35
Improving Grammatical Error Correction with Data Augmentation by Editing Latent Representation
Wan, Z., Wan, X., & Wang, W. (2020) · International Conference on Computational Linguistics · doi:10.18653/v1/2020.coling-main.200 · Cited by 35
Pre-trained Data Augmentation for Text Classification
Abonizio, H., & Barbon, S. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-61377-8_38 · Cited by 32
ALP: Data Augmentation Using Lexicalized PCFGs for Few-Shot Text Classification
Kim, H. H., Woo, D., Oh, S. J., Cha, J.-W., & Han, Y.-S. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i10.21336 · Cited by 30
Fast Cross-domain Data Augmentation through Neural Sentence EditingPreprint
Raille, G., Djambazovska, S., & Musat, C. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.10254 · Cited by 14
Classification for Crisis-Related Tweets Leveraging Word Embeddings and Data Augmentation.
Wang, C., & Lillis, D. (2019) · Research Repository UCD (University College Dublin) · Cited by 13
Quantifying the Evaluation of Heuristic Methods for Textual Data Augmentation
Kashefi, O., & Hwa, R. (2020) · Workshop on Noisy User-generated Text (W-NUT) · doi:10.18653/v1/2020.wnut-1.26 · Cited by 13
Empirical Study of Text Augmentation on Social Media Text in VietnamesePreprint
Luu, S. T., Nguyen, K. V., & Nguyen, N. L.-T. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2009.12319 · Cited by 10
Kaufhold, M., Fromm, J., Riebe, T., Mirbabaie, M., Kühn, P., Basyurt, A. S., Bayer, M., Stöttinger, M., Eyilmez, K., Möller, R., et al. (2021) · TUbilio (Technical University of Darmstadt) · doi:10.18420/muc2021-mci-ws08-263 · Cited by 9
Self-citation(2014) · doi:10.4230/oasics.slate.2021.16 · Cited by 1
Opening the Black Box of Deep Neural Networks via Information
Shwartz-Ziv, R., & Tishby, N. (2017) · arXiv · doi:10.48550/arxiv.1703.00810
AugMix: A Simple Data Processing Method to Improve Robustness and Uncertainty
Hendrycks, D., Mu, N., Cubuk, E. D., Zoph, B., Gilmer, J., & Lakshminarayanan, B. (2019) · arXiv · doi:10.48550/arxiv.1912.02781
Cited by
Khan, A. A., Chaudhari, O., & Chandra, R. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.122778 · Cited by 530
Medical Image Data Augmentation: Techniques, Comparisons and Interpretations
Goceri, E. (2023) · Artificial Intelligence Review · doi:10.1007/s10462-023-10453-z · Cited by 459
Data augmentation approaches in natural language processing: A survey
Li, B., Hou, Y., & Che, W. (2022) · AI Open · doi:10.1016/j.aiopen.2022.03.001 · Cited by 350
A Survey of GPT-3 Family Large Language Models Including ChatGPT and GPT-4
Kalyan, K. S. (2024) · Natural Language Processing Journal · doi:10.1016/j.nlp.2023.100048 · Cited by 335
Image Data Augmentation Approaches: A Comprehensive Survey and Future Directions
Kumar, T., Brennan, R., Mileo, A., & Bendechache, M. (2024) · IEEE Access · doi:10.1109/access.2024.3470122 · Cited by 287
Metadata
- Authors
- Bayer, M., Kaufhold, M.-A., & Reuter, C.
- Venue
- ACM Computing Surveys
- Published
- 2022-12-15
- Volume
- 55
- Issue
- 7
- Pages
- 1-39
- ISSN
- 0360-0300 (ISSN-L)
- 1557-7341
- OpenAlex
- W3180181113
- Cited by
- 425
- References
- 154
- FWCI
- 30.21
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.