The DOI matches its Crossref record; 156 of the 156 references it cites were found in a registry or an index.
Data augmentation approaches in natural language processing: A survey
Open accessAbstract
As an effective strategy, data augmentation (DA) alleviates data scarcity scenarios where deep learning techniques may fail. It is widely applied in computer vision then introduced to natural language processing and achieves improvements in many tasks. One of the main focuses of the DA methods is to improve the diversity of training data, thereby helping the model to better generalize to unseen testing data. In this survey, we frame DA methods into three categories based on diversity of augmented data, including paraphrasing, noising, and sampling. Our paper sets out to analyze DA methods in detail according to the above categories. Further, we also introduce their applications in NLP tasks as well as the challenges.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Distributed Representations of Words and Phrases and their Compositionality
Mikolov, T., Sutskever, I., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1310.4546 · Cited by 24,533
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372
WordNet: a lexical database for English
Miller, G. A. (1995) · Communications of the ACM · doi:10.1145/219717.219748 · Cited by 14,015
Kaugeranna, R., Kaugeranna, E., & Aion, (. S. 4. 6. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.giscience.2023.43 · Cited by 13,690
A survey on Image Data Augmentation for Deep Learning
Shorten, C., & Khoshgoftaar, T. M. (2019) · Journal of Big Data · doi:10.1186/s40537-019-0197-0 · Cited by 13,203
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer
Raffel, C., Shazeer, N., Roberts, A., Lee, K., Narang, S., Matena, M., Zhou, Y., Li, W., & Liu, P. J. (2019) · arXiv · doi:10.48550/arxiv.1910.10683 · Cited by 10,929
mixup: Beyond Empirical Risk Minimization
Zhang, H., Cisse, M., Dauphin, Y. N., & Lopez-Paz, D. (2017) · arXiv · doi:10.48550/arxiv.1710.09412 · Cited by 5,831
DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter
Sanh, V., Debut, L., Chaumond, J., & Wolf, T. (2019) · arXiv · doi:10.48550/arxiv.1910.01108 · Cited by 4,653
Generative Adversarial Networks
Goodfellow, I. J., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1406.2661 · Cited by 4,477
5th International Conference on Learning Representations (ICLR 17)
Havrylov, S., & Titov, I. (2017) · Cited by 3,503
Character-level Convolutional Networks for Text Classification
Zhang, X., Zhao, J., & LeCun, Y. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1509.01626 · Cited by 3,205
Baker, C. F., Fillmore, C. J., & Lowe, J. B. (1998) · Proceedings of the 36th annual meeting on Association for Computational Linguistics - · doi:10.3115/980845.980860 · Cited by 2,518
Generative Adversarial Networks
(2022) · The Science of Deep Learning · doi:10.1017/9781108891530.013 · Cited by 2,402
EDA: Easy Data Augmentation Techniques for Boosting Performance on Text Classification Tasks
Wei, J., & Zou, K. (2019) · Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · doi:10.18653/v1/d19-1670 · Cited by 1,911
TinyBERT: Distilling BERT for natural language understanding
Jiao, X., Yin, Y., Shang, L., Jiang, X., Chen, X., Li, L., Wang, F., & Liu, Q. (2020) · Findings of the Association for Computational Linguistics: EMNLP 2020 · doi:10.18653/v1/2020.findings-emnlp.372 · Cited by 1,786
Proceedings of the 40th Annual Meeting on Association for Computational Linguistics
Isabelle, P. (2002) · Cited by 1,635
Unsupervised Data Augmentation for Consistency Training
Xie, Q., Dai, Z., Hovy, E., Luong, M.-T., & Le, Q. V. (2019) · arXiv · doi:10.48550/arxiv.1904.12848 · Cited by 1,517
Siamese Recurrent Architectures for Learning Sentence Similarity
Mueller, J., & Thyagarajan, A. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v30i1.10350 · Cited by 935
VerbNet: A broad-coverage, comprehensive verb lexicon
Schuler, K. K. (2005) · Scholarly Commons (University of Pennsylvania) · doi:10.5281/zenodo.8100881 · Cited by 827
Mixup: Beyond empirical risk minimization
Zhang, H. (2024) · arXiv (Cornell University) · doi:10.57702/dcy1c3gw · Cited by 773
A Survey of Data Augmentation Approaches for NLP
Feng, S., Gangal, V., Wei, J., Chandar, S., Vosoughi, S., Mitamura, T., & Hovy, E. (2021) · Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021 · doi:10.18653/v1/2021.findings-acl.84 · Cited by 670
Contextual Augmentation: Data Augmentation by Words with Paradigmatic Relations
Kobayashi, S. (2018) · Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 2 (Short Papers) · doi:10.18653/v1/n18-2072 · Cited by 603
TextAttack: A Framework for Adversarial Attacks, Data Augmentation, and Adversarial Training in NLP
Morris, J., Lifland, E., Yoo, J. Y., Grigsby, J., Jin, D., & Qi, Y. (2020) · Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing: System Demonstrations · doi:10.18653/v1/2020.emnlp-demos.16 · Cited by 556
Extracting paraphrases from a parallel corpus
Barzilay, R., & McKeown, K. R. (2001) · Proceedings of the 39th Annual Meeting on Association for Computational Linguistics - ACL '01 · doi:10.3115/1073012.1073020 · Cited by 470
A Survey on Data Augmentation for Text Classification
Bayer, M., Kaufhold, M.-A., & Reuter, C. (2023) · ACM Computing Surveys · doi:10.1145/3544558 · Cited by 425
Improving language models by retrieving from trillions of tokens
Borgeaud, S., Mensch, A., Hoffmann, J., Cai, T., Rutherford, E., Millican, K., Driessche, G. V. D., Lespiau, J.-B., Damoc, B., Clark, A., et al. (2021) · arXiv · doi:10.48550/arxiv.2112.04426 · Cited by 382
Conditional BERT Contextual Augmentation
Wu, X., Lv, S., Zang, L., Han, J., & Hu, S. (2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-22747-0_7 · Cited by 336
WANLI: Worker and AI Collaboration for Natural Language Inference Dataset Creation
Liu, A., Swayamdipta, S., Smith, N. A., & Choi, Y. (2022) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2022.findings-emnlp.508 · Cited by 329
Wang, W. Y., & Yang, D. (2015) · Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d15-1306 · Cited by 312
Do Not Have Enough Data? Deep Learning to the Rescue!
Anaby-Tavor, A., Carmeli, B., Goldbraich, E., Kantor, A., Kour, G., Shlomov, S., Tepper, N., & Zwerdling, N. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i05.6233 · Cited by 300
Generating Phrasal and Sentential Paraphrases: A Survey of Data-Driven Methods
Madnani, N., & Dorr, B. J. (2010) · Computational Linguistics · doi:10.1162/coli_a_00002 · Cited by 298
Improving Neural Machine Translation Models with Monolingual Data
Sennrich, R., Haddow, B., & Birch, A. (2016) · Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p16-1009 · Cited by 296 · cited 1×
“Sennrich et al. [83] train an English-to-Chinese NMT model using existing parallel corpus, and use the target English monolingual corpus to generate Chinese corpus through the above English-to-Chinese model.”
MethodData Augmentation using Pre-trained Transformer Models
Kumar, V., Choudhary, A., & Cho, E. (2020) · Proceedings of the 2nd Workshop on Life-long Learning for Spoken Language Systems · doi:10.18653/v1/2020.lifelongnlp-1.3 · Cited by 294
Generalization through Memorization: Nearest Neighbor Language Models
Khandelwal, U., Levy, O., Jurafsky, D., Zettlemoyer, L., & Lewis, M. (2019) · arXiv · doi:10.48550/arxiv.1911.00172 · Cited by 285
WebGPT: Browser-assisted question-answering with human feedback
Nakano, R., Hilton, J., Balaji, S., Wu, J., Ouyang, L., Kim, C., Hesse, C., Jain, S., Kosaraju, V., Saunders, W., et al. (2021) · arXiv · doi:10.48550/arxiv.2112.09332 · Cited by 272
Data Augmentation for Low-Resource Neural Machine Translation
Fadaee, M., Bisazza, A., & Monz, C. (2017) · Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers) · doi:10.18653/v1/p17-2090 · Cited by 266 · cited 1×
“Rules 最终版(右边这个小的) context ([54, 55]).”
A Group-Theoretic Framework for Data AugmentationPreprint
Chen, S., Dobriban, E., & Lee, J. H. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1907.10905 · Cited by 259
Regularization for Deep Learning: A Taxonomy
Kukačka, J., Golkov, V., & Cremers, D. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1710.10686 · Cited by 255
A Kernel Theory of Modern Data Augmentation
Dao, T., Gu, A., Ratner, A., Smith, V., De, C., & Ré, C. (2018) · PubMed · doi:10.48550/arxiv.1803.06084 · Cited by 241
Robust Neural Machine Translation with Doubly Adversarial Inputs
Cheng, Y., Jiang, L., & Macherey, W. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1425 · Cited by 227
Counterfactual Data Augmentation for Mitigating Gender Stereotypes in Languages with Rich Morphology
Zmigrod, R., Mielke, S. J., Wallach, H., & Cotterell, R. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1161 · Cited by 214
Syntactic Data Augmentation Increases Robustness to Inference Heuristics
Min, J., McCoy, R. T., Das, D., Pitler, E., & Linzen, T. (2020) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2020.acl-main.212 · Cited by 213
Data Noising as Smoothing in Neural Network Language Models
Xie, Z., Wang, S., Li, J., Lévy, D., Nie, A., Jurafsky, D., & Ng, A. Y. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.02573 · Cited by 195
SwitchOut: an Efficient Data Augmentation Algorithm for Neural Machine Translation
Wang, X., Pham, H., Dai, Z., & Neubig, G. (2018) · Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d18-1100 · Cited by 194
Internet-Augmented Dialogue Generation
Komeili, M., Shuster, K., & Weston, J. (2022) · Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2022.acl-long.579 · Cited by 192
An Analysis of Simple Data Augmentation for Named Entity Recognition
Dai, X., & Adel, H. (2020) · Proceedings of the 28th International Conference on Computational Linguistics · doi:10.18653/v1/2020.coling-main.343 · Cited by 184
Thakur, N., Reimers, N., Daxenberger, J., & Gurevych, I. (2021) · Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.18653/v1/2021.naacl-main.28 · Cited by 176
Good-Enough Compositional Data Augmentation
Andreas, J. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.676 · Cited by 175
Text Data Augmentation Made Simple By Leveraging NLP Cloud APIsPreprint
Coulombe, C. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1812.04718 · Cited by 168
Mixup-Transformer: Dynamic Data Augmentation for NLP Tasks
Sun, L., Xia, C., Yin, W., Liang, T., Yu, P. S., & He, L. (2020) · International Conference on Computational Linguistics · doi:10.18653/v1/2020.coling-main.305 · Cited by 168
SSMBA: Self-Supervised Manifold Based Data Augmentation for Improving Out-of-Domain Robustness
Ng, N., Cho, K., & Ghassemi, M. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.97 · Cited by 167
Improved Relation Classification by Deep Recurrent Neural Networks with Data Augmentation
Xu, Y., Jia, R., Mou, L., Li, G., Chen, Y., Lu, Y., & Jin, Z. G. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1601.03651 · Cited by 161
Self-training Improves Pre-training for Natural Language Understanding
Du, J., Grave, É., Gunel, B., Chaudhary, V., Çelebi, O., Auli, M., Stoyanov, V., & Conneau, A. (2021) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2021.naacl-main.426 · Cited by 159
Generalized Data Augmentation for Low-Resource Translation
Xia, M., Kong, X., Anastasopoulos, A., & Neubig, G. (2019) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p19-1579 · Cited by 157
Soft Contextual Data Augmentation for Neural Machine Translation
Gao, F., Zhu, J., Wu, L., Xia, Y., Qin, T., Cheng, X., Zhou, W., & Liu, T. (2019) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p19-1555 · Cited by 154
CoSDA-ML: Multi-Lingual Code-Switching Data Augmentation for Zero-Shot Cross-Lingual NLP
Qin, L., Ni, M., Zhang, Y., & Che, W. (2020) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2020/533 · Cited by 154
Self-citationForecasting emerging technologies using data augmentation and deep learning
Zhou, Y. J., Dong, F., Liu, Y., Li, Z., Du, J.-F., & Zhang, L. (2020) · Scientometrics · doi:10.1007/s11192-020-03351-6 · Cited by 142
Augmenting Data with Mixup for Sentence Classification: An Empirical StudyPreprint
Guo, H., Mao, Y., & Zhang, R. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.08941 · Cited by 140
Data Augmentation via Dependency Tree Morphing for Low-Resource Languages
Şahin, G. G., & Steedman, M. J. (2018) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d18-1545 · Cited by 137
A Survey of Text Data Augmentation
Liu, P., Wang, X., Xiang, C. J., & Meng, W. (2020) · International Conference on Computer Communication and Network Security (CCNS) · doi:10.1109/ccns50731.2020.00049 · Cited by 133
FlipDA: Effective and Robust Data Augmentation for Few-Shot Learning
Zhou, J., Zheng, Y., Tang, J., Jian, L., & Yang, Z. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.592 · Cited by 128
Adaptive Semiparametric Language Models
Yogatama, D., d’Autume, C. D. M., & Kong, L. (2021) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00371 · Cited by 126
Aroyehun, S. T., & Gelbukh, A. F. (2018) · International Conference on Computational Linguistics · Cited by 116
Conditional Augmentation for Aspect Term Extraction via Masked Sequence-to-Sequence Generation
Li, K., Chen, C., Quan, X., Ling, Q. H., & Song, Y. (2020) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2020.acl-main.631 · Cited by 116
Fabbri, A. R., Han, S., Li, H., Li, H., Ghazvininejad, M., Joty, S., Radev, D., & Mehdad, Y. (2021) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2021.naacl-main.57 · Cited by 116
Learning Data Manipulation for Augmentation and WeightingPreprint
Hu, Z., Tan, B., Salakhutdinov, R., Mitchell, T. M., & Xing, E. P. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.12795 · Cited by 115
Submodular Optimization-based Diverse Paraphrasing and its Effectiveness in Data Augmentation
Kumar, A., Bhattamishra, S., Bhandari, M., & Talukdar, P. P. (2019) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n19-1363 · Cited by 112
How Effective is Task-Agnostic Data Augmentation for Pretrained Transformers?
Longpre, S., Wang, Y., & DuBois, C. (2020) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2020.findings-emnlp.394 · Cited by 109
Proceedings of the First Workshop on Trolling, Aggression and Cyberbullying (TRAC-2018)
Kumar, R., Ojha, A. K., Zampieri, M., & Malmasi, S. (2018) · Cited by 108
AdvAug: Robust Adversarial Augmentation for Neural Machine Translation
Cheng, Y., Jiang, L., Macherey, W., & Eisenstein, J. (2020) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2020.acl-main.529 · Cited by 102
Data Boost: Text Data Augmentation Through Reinforcement Learning Guided Conditional Generation
Liu, R., Xu, G., Jia, C., Ma, W., Wang, L., & Vosoughi, S. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.726 · Cited by 102
Parallel Data Augmentation for Formality Style Transfer
Zhang, Y., Ge, T., & Sun, X. (2020) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2020.acl-main.294 · Cited by 85
AdvEntuRe: Adversarial Training for Textual Entailment with Knowledge-Guided Examples
Kang, D., Khot, T., Sabharwal, A., & Hovy, E. H. (2018) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p18-1225 · Cited by 84
MulDA: A Multilingual Data Augmentation Framework for Low-Resource Cross-Lingual NER
Liu, L., Ding, B., Bing, L., Joty, S., Si, L., & Miao, C. (2021) · doi:10.18653/v1/2021.acl-long.453 · Cited by 83
Multiple Data Augmentation Strategies for Improving Performance on Automatic Short Answer Scoring
Lun, J., Zhu, J., Tang, Y., & Yang, M. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i09.7062 · Cited by 82
Logic-Guided Data Augmentation and Regularization for Consistent Question Answering
Asai, A., & Hajishirzi, H. (2020) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2020.acl-main.499 · Cited by 81
KnowDis: Knowledge Enhanced Data Augmentation for Event Causality Detection via Distant Supervision
Zuo, X., Chen, Y., Liu, K., & Zhao, J. (2020) · International Conference on Computational Linguistics · doi:10.18653/v1/2020.coling-main.135 · Cited by 80
Lexical-Constraint-Aware Neural Machine Translation via Data Augmentation
Chen, G., Chen, Y., Wang, Y., & Li, V. O. K. (2020) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2020/496 · Cited by 76
Consistency Regularization for Cross-Lingual Fine-Tuning
Zheng, B., Dong, L., Huang, S., Wang, W., Chi, Z., Singhal, S., Che, W., Liu, T., Song, X., & Wei, F. (2021) · doi:10.18653/v1/2021.acl-long.264 · Cited by 73
Self-citationDocument-level multi-topic sentiment classification of Email data with BiLSTM and data augmentation
Liu, S., Lee, K., & Lee, I. (2020) · Knowledge-Based Systems · doi:10.1016/j.knosys.2020.105918 · Cited by 71
Local Additivity Based Data Augmentation for Semi-supervised NER
Chen, J., Wang, Z., Tian, R., Yang, Z., & Yang, D. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.95 · Cited by 66
Textual Data Augmentation for Efficient Active Learning on Tiny Datasets
Quteineh, H., Samothrakis, S., & Sutcliffe, R. F. E. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.600 · Cited by 62
Aggression Identification Using Deep Learning and Data Augmentation
Risch, J., & Krestel, R. (2018) · International Conference on Computational Linguistics · Cited by 58
An Exploration of Data Augmentation and Sampling Techniques for Domain-Agnostic Question Answering
Longpre, S., Lu, Y., Tu, Z., & DuBois, C. (2019) · Workshop on Machine Reading for Question Answering (MRQA) · doi:10.18653/v1/d19-5829 · Cited by 58
Better Robustness by More Coverage: Adversarial and Mixup Data Augmentation for Robust Finetuning
Si, C., Zhang, Z., Qi, F., Liu, Z., Wang, Y., Liu, Q., & Sun, M. (2021) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2021.findings-acl.137 · Cited by 56
Soft Contextual Data Augmentation for Neural Machine TranslationPreprint
Zhu, J., Gao, F., Wu, L., Xia, Y., Qin, T., Zhou, W., Cheng, X., & Liu, T. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.10523 · Cited by 54
HateGAN: Adversarial Generative-Based Data Augmentation for Hate Speech Detection
Cao, R., & Lee, R. K.-W. (2020) · International Conference on Computational Linguistics · doi:10.18653/v1/2020.coling-main.557 · Cited by 54
HiddenCut: Simple Data Augmentation for Natural Language Understanding with Better Generalizability
Chen, J., Shen, D., Chen, W., & Yang, D. (2021) · doi:10.18653/v1/2021.acl-long.338 · Cited by 54
Nugent, T., Stelea, N., & Leidner, J. L. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-86967-0_12 · Cited by 53
Valentin, B., & Alexandra, B.-D. (2020) · Joint Research Centre (European Commission) · doi:10.18653/v1/2020.coling-main.23 · Cited by 50
Controlled Text Generation for Data Augmentation in Intelligent Artificial Agents
Malandrakis, N., Shen, M., Goyal, A. K., Gao, S., Sethi, A. R., & Metallinou, A. (2019) · Workshop on Neural Generation and Translation (WNGT) · doi:10.18653/v1/d19-5609 · Cited by 49
Insufficient Data Can Also Rock! Learning to Converse Using Smaller Data with Augmentation
Li, J., Qiu, L., Tang, B., Chen, D., Zhao, D., & Yan, R. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33016698 · Cited by 45
Substructure Substitution: Structured Data Augmentation for NLP
Shi, H., Livescu, K., & Gimpel, K. (2021) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2021.findings-acl.307 · Cited by 45
A multi-cascaded model with data augmentation for enhanced paraphrase detection in short texts
Shakeel, M. H., Karim, A., & Khan, I. (2020) · Information Processing & Management · doi:10.1016/j.ipm.2020.102204 · Cited by 44
Automatically Learning Data Augmentation Policies for Dialogue Tasks
Niu, T., & Bansal, M. (2019) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d19-1132 · Cited by 41
Data Augmentation for Deep Learning of Judgment Documents
Yan, G., Yu, L., Zhang, S., & Chen, Z. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-36204-1_19 · Cited by 38
Tell Me How to Ask Again: Question Data Augmentation with Controllable Rewriting in Continuous Space
Liu, D., Gong, Y., Fu, J., Yan, Y., Chen, J., Lv, J., Duan, N., & Zhou, M. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.467 · Cited by 37
Text Data Augmentation: Towards better detection of spear-phishing emailsPreprint
Regina, M., Meyer, M., & Goutal, S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.02033 · Cited by 35
Improving Grammatical Error Correction with Data Augmentation by Editing Latent Representation
Wan, Z., Wan, X., & Wang, W. (2020) · International Conference on Computational Linguistics · doi:10.18653/v1/2020.coling-main.200 · Cited by 35
Multilingual Transfer Learning for QA using Translation as Data Augmentation
Bornea, M. A., Pan, L., Rosenthal, S., Florian, R., & Sil, A. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i14.17491 · Cited by 34
Twitter Data Augmentation for Monitoring Public Opinion on COVID-19 Intervention Measures
Lin, M., Last, M., & Litvak, M. (2020) · Workshop on NLP for COVID-19 (NLP-COVID19) · doi:10.18653/v1/2020.nlpcovid19-2.19 · Cited by 33
Dictionary-based Data Augmentation for Cross-Domain Neural Machine TranslationPreprint
Peng, W., Huang, C., Li, T., Chen, Y., & Liu, Q. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2004.02577 · Cited by 32
Pre-trained Data Augmentation for Text Classification
Abonizio, H., & Barbon, S. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-61377-8_38 · Cited by 32
Hierarchical Data Augmentation and the Application in Text Classification
Yu, S., Yang, J., Liu, D., Li, R., Zhang, Y., & Zhao, S. (2019) · IEEE Access · doi:10.1109/access.2019.2960263 · Cited by 31
On Data Augmentation for Extreme Multi-label ClassificationPreprint
Zhang, D., Li, T., Zhang, H., & Yin, B. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2009.10778 · Cited by 31
Dialogue Distillation: Open-Domain Dialogue Augmentation Using Unpaired Data
Zhang, R., Zheng, Y., Shao, J., Mao, X., Xi, Y., & Huang, M. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.277 · Cited by 31
UXLA: A Robust Unsupervised Data Augmentation Framework for Zero-Resource Cross-Lingual NLP
Bari, M. S., Mohiuddin, T., & Joty, S. (2021) · doi:10.18653/v1/2021.acl-long.154 · Cited by 30
Aggression Detection in Social Media using Deep Neural Networks.
Madisetty, S., & Desarkar, M. S. (2018) · Research Archive of Indian Institute of Technology Hyderabad (Indian Institute of Technology Hyderabad) · Cited by 29
Unsupervised Data Augmentation with Naive Augmentation and without Unlabeled Data
Lowell, D., Howard, B. E., Lipton, Z. C., & Wallace, B. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.408 · Cited by 29
AugNLG: Few-shot Natural Language Generation using Self-trained Data Augmentation
Xu, X., Wang, G., Kim, Y.-B., & Lee, S. (2021) · doi:10.18653/v1/2021.acl-long.95 · Cited by 28
Data Augmentation with Atomic Templates for Spoken Language Understanding
Zhao, Z., Zhu, S., & Yu, K. (2019) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d19-1375 · Cited by 27
Neural Retrieval for Question Answering with Cross-Attention Supervised Data Augmentation
Yang, Y., Jin, N., Lin, K., Guo, M., & Cer, D. M. (2021) · doi:10.18653/v1/2021.acl-short.35 · Cited by 27
Dialog State Tracking with Reinforced Data Augmentation
Yin, Y., Shang, L., Jiang, X., Chen, X. D., & Liu, Q. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i05.6491 · Cited by 26
Si, C., Zhang, Z., Qi, F., Liu, Z., Wang, Y., Liu, Q., & Sun, M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.15699 · Cited by 26
Can We Achieve More with Less? Exploring Data Augmentation for Toxic Comment ClassificationPreprint
Rastogi, C., Mofid, N., & Hsiao, F.-I. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.00875 · Cited by 25
Variational Hierarchical Dialog Autoencoder for Dialog State Tracking Data Augmentation
Yoo, K. M., Lee, H., Dernoncourt, F., Bui, T., Chang, W. H., & Lee, S. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.274 · Cited by 24
Ibrahim, M., Torki, M., & El-Makky, N. (2020) · International Workshop on Semantic Evaluation (SemEval) · doi:10.18653/v1/2020.semeval-1.248 · Cited by 20
Guo, Z., Liu, Z., Ling, Z.-H., Wang, S., Jin, L., & Li, Y. (2020) · International Conference on Computational Linguistics · doi:10.18653/v1/2020.coling-main.542 · Cited by 20
Improving Commonsense Causal Reasoning by Adversarial Training and Data Augmentation
Staliūnaitė, I., Gorinski, P. J., & Iacobacci, I. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i15.17630 · Cited by 20
Montella, S., Fabre, B., Urvoy, T., Heinecke, J., & Rojas-Barahona, L. M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.00571 · Cited by 19
Data Augmentation for Spoken Language Understanding via Pretrained ModelsPreprint
Peng, B., Zhu, C., Zeng, M., & Gao, J. (2020) · arXiv (Cornell University) · Cited by 18
Daval‐Frérot, G., & Weis, Y. (2020) · International Workshop on Semantic Evaluation (SemEval) · doi:10.18653/v1/2020.semeval-1.246 · Cited by 17
Louvan, S., & Magnini, B. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2009.03695 · Cited by 16
Data Augmentation for Multiclass Utterance Classification – A Systematic Study
Xu, B., Qiu, S., Zhang, J., Wang, Y., Shen, X., & de Melo, G. (2020) · International Conference on Computational Linguistics · doi:10.18653/v1/2020.coling-main.479 · Cited by 16
C2C-GenDA: Cluster-to-Cluster Generation for Data Augmentation of Slot Filling
Hou, Y., Chen, S., Che, W., Chen, C., & Liu, T. C. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i14.17540 · Cited by 16
Self-citationData Augmentation for Hypernymy Detection
Kober, T., Weeds, J., Bertolini, L., et al. (2021) · doi:10.18653/v1/2021.eacl-main.89 · Cited by 15
Data Augmentation for Neural Online Chats Response Selection
Du, W., & Black, A. W. (2018) · doi:10.18653/v1/w18-5708 · Cited by 14
Fast Cross-domain Data Augmentation through Neural Sentence EditingPreprint
Raille, G., Djambazovska, S., & Musat, C. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.10254 · Cited by 14
Data Augmentation with Adversarial Training for Cross-Lingual NLI
Dong, X., Zhu, Y., Fu, Z., Xu, D., & de Melo, G. (2021) · doi:10.18653/v1/2021.acl-long.401 · Cited by 14
MultiMix: A Robust Data Augmentation Strategy for Cross-Lingual NLP.Preprint
Bari, M., Mohiuddin, M. T., & Joty, S. (2020) · arXiv (Cornell University) · Cited by 13
Domain Transfer based Data Augmentation for Neural Query Translation
Yao, L., Yang, B., Zhang, H., Chen, B., & Luo, W. (2020) · International Conference on Computational Linguistics · doi:10.18653/v1/2020.coling-main.399 · Cited by 12
Data Augmentation for Spoken Language Understanding via Joint Variational Generation
Yoo, K. M., Shin, Y., & Lee, S. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33017402 · Cited by 11
Zhao, Z., Papalexakis, E. E., & Ma, X. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.266 · Cited by 10
Data Augmentation for Copy-Mechanism in Dialogue State Tracking
Song, X., Zang, L., & Hu, S. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-77961-0_59 · Cited by 10
CoRI: Collective Relation Integration with Data Augmentation for Open Information Extraction
Jiang, Z., Han, J., Sisman, B., & Xin, D. (2021) · doi:10.18653/v1/2021.acl-long.363 · Cited by 8
Cross-language Sentence Selection via Data Augmentation and Rationale Training
Chen, Y., Kedzie, C., Nair, S., Galuščáková, P., Zhang, R., Oard, D. W., & McKeown, K. R. (2021) · doi:10.18653/v1/2021.acl-long.300 · Cited by 8
Data Augmentation with Transformers for Text Classification
Tapia-Téllez, J. M., & Escalante, H. J. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-60887-3_22 · Cited by 7
Kovatchev, V., Smith, P., Lee, M. G., & Devine, R. T. (2021) · doi:10.18653/v1/2021.acl-long.96 · Cited by 7
Reverse Operation based Data Augmentation for Solving Math Word ProblemsPreprint
Liu, Q., Guan, W., Li, S., Cheng, F., Kawahara, D., & Kurohashi, S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.01556 · Cited by 6
Palomino-Ochoa at TASS 2020: Transformer-based Data Augmentation for Overcoming Few-Shot Learning.
Palomino, D., & Ochoa-Luna, J. E. (2020) · IberLEF@SEPLN · Cited by 5
Deep Transformer based Data Augmentation with Subword Units for Morphologically Rich Online ASRPreprint
Tarján, B., Szaszák, G., Fegyó, T., & Mihajlik, P. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.06949 · Cited by 4
GANgster: A Fraud Review Detector based on Regulated GAN with Data Augmentation.Preprint
Shehnepoor, S., Togneri, R. B., Liu, W., & Bennamoun, M. (2020) · arXiv (Cornell University) · Cited by 3
BLCU-NLP at SemEval-2020 Task 5: Data Augmentation for Efficient Counterfactual Detecting
Liu, C., & Yu, D. (2020) · International Workshop on Semantic Evaluation (SemEval) · doi:10.18653/v1/2020.semeval-1.81 · Cited by 3
Cited by
Survey of Hallucination in Natural Language Generation
Ji, Z., Lee, N., Frieske, R., Yu, T., Su, D., Xu, Y., Ishii, E., Bang, Y. J., Madotto, A., & Fung, P. (2023) · ACM Computing Surveys · doi:10.1145/3571730 · Cited by 5,025
“Since the data format varies between downstream tasks, there is still a gap for data processing methods between tasks, and currently, no universal method is effective for all NLG tasks [101].”
MethodKhan, A. A., Chaudhari, O., & Chandra, R. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.122778 · Cited by 530
Self-supervised learning for recommender systems: A survey
Yu, J., Yin, H., Xia, X., Chen, T., Li, J., & Huang, Z. (2024) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2023.3282907 · Cited by 413
A Survey of GPT-3 Family Large Language Models Including ChatGPT and GPT-4
Kalyan, K. S. (2024) · Natural Language Processing Journal · doi:10.1016/j.nlp.2023.100048 · Cited by 335
Hou, J., Jiang, H., Wan, C., Yi, L., Gao, S., Ding, Y., & Xue, S. (2022) · Measurement · doi:10.1016/j.measurement.2022.111206 · Cited by 86
Metadata
- Authors
- Li, B., Hou, Y., & Che, W.
- Venue
- AI Open
- Publisher
- Elsevier BV
- Published
- 2022
- Volume
- 3
- Pages
- 71-90
- ISSN
- 2666-6510 (ISSN-L)
- OpenAlex
- W3201915713
- Cited by
- 350
- References
- 156
- FWCI
- 24.80
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.