The DOI matches its Crossref record; 38 of the 38 references it cites were found in a registry or an index.
A Convolutional Encoder Model for Neural Machine Translation
Open accessAbstract
The prevalent approach to neural machine translation relies on bi-directional LSTMs to encode the source sentence.We present a faster and simpler architecture based on a succession of convolutional layers.This allows to encode the source sentence simultaneously compared to recurrent networks for which computation is constrained by temporal dependencies.On WMT'16 English-Romanian translation we achieve competitive accuracy to the state-of-the-art and on WMT'15 English-German we outperform several recently published results.Our models obtain almost the same accuracy as a very deep LSTM setup on WMT'14 English-French translation.We speed up CPU decoding by more than two times at the same or higher accuracy as a strong bidirectional LSTM. 1
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
(2014) · Cited by 33,419
Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation
Cho, K., van Merrienboer, B., Gulcehre, C., Bahdanau, D., Bougares, F., Schwenk, H., & Bengio, Y. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1179 · Cited by 25,545
Sequence to Sequence Learning with Neural Networks
Sutskever, I., Vinyals, O., & Le, Q. V. (2014) · arXiv · doi:10.48550/arxiv.1409.3215 · Cited by 17,766
Neural Machine Translation by Jointly Learning to Align and Translate
Bahdanau, D., Cho, K., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1409.0473 · Cited by 16,213
Effective Approaches to Attention-based Neural Machine Translation
Luong, T., Pham, H., & Manning, C. D. (2015) · Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d15-1166 · Cited by 8,382
On the Properties of Neural Machine Translation: Encoder–Decoder Approaches
Cho, K., van Merrienboer, B., Bahdanau, D., & Bengio, Y. (2014) · Proceedings of SSST-8, Eighth Workshop on Syntax, Semantics and Structure in Statistical Translation · doi:10.3115/v1/w14-4012 · Cited by 7,099
Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation
Wu, Y., Schuster, M., Chen, Z., Le, Q. V., Norouzi, M., Macherey, W., Krikun, M., Cao, Y., Gao, Q., Macherey, K., et al. (2016) · arXiv · doi:10.48550/arxiv.1609.08144 · Cited by 5,319
Natural Language Processing (almost) from Scratch
Collobert, R., Weston, J., Bottou, L., Karlen, M., Kavukcuoglu, K., & Kuksa, P. P. (2011) · arXiv (Cornell University) · doi:10.48550/arxiv.1103.0398 · Cited by 4,962
Moses: open source toolkit for statistical machine translation
Koehn, P., Zens, R., Dyer, C., Bojar, O., Constantin, A., Herbst, E., Hoang, H., Birch, A., Callison-Burch, C., Federico, M., et al. (2007) · Proceedings of the 45th Annual Meeting of the ACL on Interactive Poster and Demonstration Sessions - ACL '07 · doi:10.3115/1557769.1557821 · Cited by 4,735
On the difficulty of training recurrent neural networks
Pascanu, R., Mikolov, T., & Bengio, Y. (2012) · arXiv · doi:10.48550/arxiv.1211.5063 · Cited by 4,310
Moses : open source toolkit for statistical machine translation
Koehn, P., Hoang, H., Birch, A., Callison-Burch, C., Federico, M., Bertoldi, N., Cowan, B., Shen, W., Moran, C., Zens, R., et al. (2007) · Edinburgh Research Explorer (University of Edinburgh) · Cited by 1,547
Sequence Level Training with Recurrent Neural Networks
Ranzato, M., Chopra, S., Auli, M., & Zaremba, W. (2015) · arXiv · doi:10.48550/arxiv.1511.06732 · Cited by 1,426
Self-citationSukhbaatar, S., Szlam, A., Weston, J., & Fergus, R. (2015) · arXiv · doi:10.48550/arxiv.1503.08895 · Cited by 1,345
Recurrent Continuous Translation Models
Kalchbrenner, N., & Blunsom, P. (2013) · Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d13-1176 · Cited by 1,232
Torch7: A Matlab-like Environment for Machine Learning
Collobert, R., Kavukcuoglu, K., & Farabet, C. (2011) · Infoscience (Ecole Polytechnique Fédérale de Lausanne) · Cited by 1,186
On Using Very Large Target Vocabulary for Neural Machine Translation
Jean, S., Cho, K., Memisevic, R., & Bengio, Y. (2015) · Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · doi:10.3115/v1/p15-1001 · Cited by 862
A Simple, Fast, and Effective Reparameterization of IBM Model 2
Dyer, C., Chahuneau, V., & Smith, N. A. (2018) · doi:10.1184/r1/6472985 · Cited by 767
Addressing the Rare Word Problem in Neural Machine Translation
Luong, T., Sutskever, I., Le, Q., Vinyals, O., & Zaremba, W. (2015) · Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · doi:10.3115/v1/p15-1002 · Cited by 619
Sequence Level Training with Recurrent Neural Networks
Ranzato, M., Chopra, S., Auli, M., & Zaremba, W. (2016) · International Conference on Learning Representations · Cited by 572
Self-citationNeural Machine Translation in Linear Time
Kalchbrenner, N., Espeholt, L., Simonyan, K., Oord, A. V. D., Graves, A., & Kavukcuoglu, K. (2016) · arXiv · doi:10.48550/arxiv.1610.10099 · Cited by 414 · cited 2×
“Concurrently to our work, (Kalchbrenner et al., 2016) have introduced convolutional translation models without an explicit attention mechanism but their approach does not yet result in state-ofthe-art accuracy. (Lamb and Xie, 2016) also proposed a multi-layer CNN to generate a fixed-size encoder representation but the…”
BackgroundOn Using Very Large Target Vocabulary for Neural Machine TranslationPreprint
Jean, S., Cho, K., Memisevic, R., & Bengio, Y. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1412.2007 · Cited by 319
A Character-level Decoder without Explicit Segmentation for Neural Machine Translation
Chung, J., Cho, K., & Bengio, Y. (2016) · Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p16-1160 · Cited by 309
Deep Recurrent Models with Fast-Forward Connections for Neural Machine Translation
Zhou, J., Cao, Y., Wang, X., Li, P., & Xu, W. (2016) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00105 · Cited by 216
Edinburgh Neural Machine Translation Systems for WMT 16
Sennrich, R., Haddow, B., & Birch, A. (2016) · Conference on Machine Translation (WMT) · doi:10.18653/v1/w16-2323 · Cited by 199
Is Neural Machine Translation Ready for Deployment? A Case Study on 30 Translation DirectionsPreprint
Junczys-Dowmunt, M., Dwojak, T., & Hoang, H. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1610.01108 · Cited by 170
Montreal Neural Machine Translation Systems for WMT’15
Jean, S., Fırat, O., Cho, K., Memisevic, R., & Bengio, Y. (2015) · Conference on Machine Translation (WMT) · doi:10.18653/v1/w15-3014 · Cited by 140
Encoding Source Language with Convolutional Neural Network for Machine Translation
Meng, F., Lu, Z., Wang, M., Li, H., Jiang, W., & Liu, Q. (2015) · Annual Meeting of the Association for Computational Linguistics · doi:10.3115/v1/p15-1003 · Cited by 120
Vocabulary Manipulation for Neural Machine Translation
Mi, H.-T., Wang, Z., & Ittycheriah, A. (2016) · Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p16-2021 · Cited by 68
Convolutional Neural Network Language Models
Pham, N.-Q., Kruszewski, G., & Boleda, G. (2016) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d16-1123 · Cited by 57
Encoding Source Language with Convolutional Neural Network for Machine TranslationPreprint
Meng, F., Lu, Z., Wang, M., Li, H., Jiang, W., & Liu, Q. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1503.01838 · Cited by 45
Neural Machine Translation with Recurrent Attention Modeling
Yang, Z., Hu, Z., Deng, Y., Dyer, C., & Smola, A. J. (2017) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/e17-2061 · Cited by 45
Vocabulary Selection Strategies for Neural Machine TranslationPreprint
L'Hostis, G., Grangier, D., & Auli, M. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1610.00072 · Cited by 41
Self-citationContext-Dependent Translation Selection Using Convolutional Neural Network
Hu, B., Tu, Z., Lu, Z., Li, H., & Chen, Q. (2015) · doi:10.3115/v1/p15-2088 · Cited by 23
MetaMind Neural Machine Translation System for WMT 2016
Bradbury, J., & Socher, R. (2016) · Conference on Machine Translation (WMT) · doi:10.18653/v1/w16-2308 · Cited by 17
Context-Dependent Translation Selection Using Convolutional Neural NetworkPreprint
Tu, Z., Hu, B., Lu, Z., & Li, H. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1503.02357 · Cited by 9
Cited by
Graph neural networks: A review of methods and applications
Zhou, J., Cui, G., Hu, S., Zhang, Z., Yang, C., Liu, Z., Wang, L., Li, C., & Sun, M. (2020) · AI Open · doi:10.1016/j.aiopen.2021.01.001 · Cited by 6,880
Convolutional Sequence to Sequence Learning
Gehring, J., Auli, M., Grangier, D., Yarats, D., & Dauphin, Y. N. (2017) · arXiv · doi:10.48550/arxiv.1705.03122 · Cited by 2,850
“Architec-1 tures which are partially convolutional have shown strong performance on larger tasks but their decoder is still recurrent (Gehring et al., 2016).”
BackgroundSelf-citationDeformable ConvNets V2: More Deformable, Better Results
Zhu, X., Hu, H., Lin, S., & Dai, J. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00953 · Cited by 2,943
GCNet: Non-Local Networks Meet Squeeze-Excitation Networks and Beyond
Cao, Y., Xu, J., Lin, S., Wei, F., & Hu, H. (2019) · 2019 IEEE/CVF International Conference on Computer Vision Workshop (ICCVW) · doi:10.1109/iccvw.2019.00246 · Cited by 2,307
A Call for Clarity in Reporting BLEU Scores
Post, M. (2018) · Proceedings of the Third Conference on Machine Translation: Research Papers · doi:10.18653/v1/w18-6319 · Cited by 2,112
Metadata
- Authors
- Gehring, J., Auli, M., Grangier, D., & Dauphin, Y.
- Venue
- Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
- Published
- 2017
- Pages
- 123-135
- OpenAlex
- W2552839021
- Cited by
- 405
- References
- 38
- FWCI
- 26.42
- Type
- conference paper
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.