Data Augmentation for Low-Resource Neural Machine Translation
Open accessThe DOI matches its Crossref record; 2 of the 2 references it cites were found in a registry or an index.
Abstract
The quality of a Neural Machine Translation system depends substantially on the availability of sizable parallel corpora.For low-resource language pairs this is not the case, resulting in poor translation quality.Inspired by work in computer vision, we propose a novel data augmentation approach that targets low-frequency words by generating new sentence pairs containing rare words in new, synthetically created contexts.Experimental results on simulated low-resource settings show that our method improves translation quality by up to 2.9 BLEU points over the baseline and up to 3.2 BLEU over back-translation.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
BLEU: a method for automatic evaluation of machine translation
Papineni, K., Roukos, S., Ward, T., & Zhu, W.-J. (2001) · Proceedings of the 40th Annual Meeting on Association for Computational Linguistics - ACL '02 · doi:10.3115/1073083.1073135 · Cited by 21,344 · cited 2×
“We measure translation quality by single-reference case-insensitive BLEU (Papineni et al., 2002) computed with the multi-bleu.perl script from Moses.”
InfluentialProceedings of the British Machine Vision Conference 2014
(2014) · doi:10.5244/c.28 · Cited by 1,337
Research works printed but not linked: 14
- Dzmitry Bahdanau, Kyunghyun Cho, and Yoshua Ben- gio. 2015. Neural machine translation by jointly learning to align and translate. In Proceedings of the International Conference on Learning Represen- tations (ICLR).
- Ondřej Bojar, Rajen Chatterjee, Christian Feder- mann, Yvette Graham, Barry Haddow, Matthias Huck, Antonio Jimeno Yepes, Philipp Koehn, Varvara Logacheva, Christof Monz, Matteo Negri, Aurelie Neveol, Mariana Neves, Martin Popel, Matt Post, Raphael Rubino, Carolina Scarton, Lucia Specia, Marco Turchi, Karin Verspoor, and Marcos Zampieri. 2016. Findings of the 2016 conference on machine translation. In Proceedings of the First Conference on Ma- chine Translation. Association for Computational Linguistics, Berlin, Germany, pages 131-198. http://www.aclweb.org/anthology/W/W16/W16- 2301.
- Kyunghyun Cho, B van Merrienboer, Dzmitry Bah- danau, and Yoshua Bengio. 2014. On the proper- ties of neural machine translation: Encoder-decoder approaches. In Eighth Workshop on Syntax, Seman- tics and Structure in Statistical Translation (SSST- 8), 2014.
- Long Duong, Trevor Cohn, Steven Bird, and Paul Cook. 2015. A neural network model for low- resource universal dependency parsing. In Proceed- ings of the 2015 Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics, Lisbon, Portugal, pages 339-348. http://aclweb.org/anthology/D15-1040.
- Chris Dyer, Victor Chahuneau, and Noah A. Smith. 2013. A simple, fast, and effective reparameteriza- tion of ibm model 2. In Proceedings of the 2013 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. Association for Computa- tional Linguistics, Atlanta, Georgia, pages 644-648. http://www.aclweb.org/anthology/N13-1073.
- Sepp Hochreiter and Jürgen Schmidhuber. 1997. Long short-term memory. Neural Computation 9(8):1735-1780.
- Rafal Jozefowicz, Wojciech Zaremba, and Ilya Sutskever. 2015. An empirical exploration of re- current network architectures. In Francis Bach and David Blei, editors, Proceedings of the 32nd International Conference on Machine Learning. PMLR, Lille, France, volume 37 of Proceedings of Machine Learning Research, pages 2342-2350. http://proceedings.mlr.press/v37/jozefowicz15.pdf.
- Alex Krizhevsky, Ilya Sutskever, and Geoffrey E Hinton. 2012. Imagenet classification with deep convolutional neural networks. In F. Pereira, C. J. C. Burges, L. Bottou, and K. Q. Weinberger, editors, Advances in Neural Information Process- ing Systems 25, Curran Associates, Inc., pages 1097-1105. http://papers.nips.cc/paper/4824- imagenet-classification-with-deep-convolutional- neural-networks.pdf.
- Thang Luong, Hieu Pham, and Christopher D. Man- ning. 2015. Effective approaches to attention-based neural machine translation. In Proceedings of the 2015 Conference on Empirical Methods in Natu- ral Language Processing. Association for Compu- tational Linguistics, Lisbon, Portugal, pages 1412- 1421. http://aclweb.org/anthology/D15-1166.
- Yuval Marton, Chris Callison-Burch, and Philip Resnik. 2009. Improved statistical machine translation using monolingually-derived para- phrases. In Proceedings of the 2009 Confer- ence on Empirical Methods in Natural Lan- guage Processing. Association for Computa- tional Linguistics, Singapore, pages 381-390. http://www.aclweb.org/anthology/D/D09/D09- 1040.
- Rico Sennrich, Barry Haddow, and Alexandra Birch. 2016a. Improving neural machine translation models with monolingual data. In Proceed- ings of the 54th Annual Meeting of the As- sociation for Computational Linguistics (Volume 1: Long Papers). Association for Computa- tional Linguistics, Berlin, Germany, pages 86-96. http://www.aclweb.org/anthology/P16-1009.
- Rico Sennrich, Barry Haddow, and Alexandra Birch. 2016b. Neural machine translation of rare words with subword units. In Proceed- ings of the 54th Annual Meeting of the As- sociation for Computational Linguistics (Volume 1: Long Papers). Association for Computational Linguistics, Berlin, Germany, pages 1715-1725. http://www.aclweb.org/anthology/P16-1162.
- Ilya Sutskever, Oriol Vinyals, and Quoc V Le. 2014. Sequence to sequence learning with neural net- works. In Z. Ghahramani, M. Welling, C. Cortes, N. D. Lawrence, and K. Q. Weinberger, editors, Advances in Neural Information Processing Sys- tems 27, Curran Associates, Inc., pages 3104- 3112. http://papers.nips.cc/paper/5346-sequence- to-sequence-learning-with-neural-networks.pdf.
- Barret Zoph, Deniz Yuret, Jonathan May, and Kevin Knight. 2016. Transfer learning for low-resource neural machine translation. In Proceedings of the 2016 Conference on Empirical Methods in Natu- ral Language Processing. Association for Computa- tional Linguistics, Austin, Texas, pages 1568-1575. https://aclweb.org/anthology/D16-1163.
Cited by
Liu, P., Yuan, W., Fu, J., Jiang, Z., Hayashi, H., & Neubig, G. (2023) · ACM Computing Surveys · doi:10.1145/3560815 · Cited by 4,361
Liu, P., Yuan, W., Fu, J., Jiang, Z., Hayashi, H., & Neubig, G. (2021) · arXiv · doi:10.48550/arxiv.2107.13586 · Cited by 4,352
A Survey on Data Augmentation for Text Classification
Bayer, M., Kaufhold, M.-A., & Reuter, C. (2023) · ACM Computing Surveys · doi:10.1145/3544558 · Cited by 425
Conditional BERT Contextual Augmentation
Wu, X., Lv, S., Zang, L., Han, J., & Hu, S. (2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-22747-0_7 · Cited by 336
Data augmentation approaches in natural language processing: A survey
Li, B., Hou, Y., & Che, W. (2022) · AI Open · doi:10.1016/j.aiopen.2022.03.001 · Cited by 350
“Rules 最终版(右边这个小的) context ([54, 55]).”
Metadata
- Authors
- Fadaee, M., Bisazza, A., & Monz, C.
- Affiliations
- University of Amsterdam (NL)
- ORCID
- Bisazza, Arianna
- Venue
- Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers)
- Published
- 2017
- Pages
- 567-573
- ISSN
- 0736-587X (ISSN-L)
- OpenAlex
- W2610850660
- Cited by
- 266
- References
- 2
- Citations by year
- 2026: 21 · 2025: 26 · 2024: 43 · 2023: 38 · 2022: 43 · 2021: 41 · 2020: 29 · 2019: 18 · 2018: 6 · 2017: 1
- FWCI
- 6.74
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- Locations
- Proceedings of the conference - Association for Computational Linguistics. Meeting (publishedVersion, cc-by)
- UvA-DARE (University of Amsterdam) (publishedVersion, cc-by)
- arXiv (Cornell University) (submittedVersion)
- University of Groningen research database (University of Groningen / Centre for Information Technology) (submittedVersion, cc-by)
- Data Archiving and Networked Services (DANS) (submittedVersion, other-oa)
- arXiv (Cornell University)
- Funders
- Nvidia
- Nederlandse Organisatie voor Wetenschappelijk Onderzoek (639.021.646)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
- Keywords
- data augmentation, low-resource neural machine translation, low-frequency words, back-translation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Data Augmentation for Low-Resource Neural Machine Translation. https://app.cochat.ai/papers/10.18653/v1/p17-2090
- The paper
- Fadaee, M., Bisazza, A., & Monz, C. (2017). Data Augmentation for Low-Resource Neural Machine Translation. Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers). https://doi.org/10.18653/v1/p17-2090
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.

