The DOI matches its Crossref record; 32 of the 32 references it cites were found in a registry or an index.
Document-Level Neural Machine Translation with Hierarchical Attention Networks
Open accessAbstract
Neural Machine Translation (NMT) can be improved by including document-level contextual information.For this purpose, we propose a hierarchical attention model to capture the context in a structured and dynamic manner.The model is integrated in the original NMT architecture as another level of abstraction, conditioning on the NMT model's own previous hidden states.Experiments show that hierarchical attention significantly improves the BLEU score over a strong NMT baseline with the state-of-the-art in context-aware methods, and that both the encoder and decoder benefit from context in complementary ways.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Exploiting Generative AI to Scale up Intelligent Tutoring Systems
Jakubův, J., Chvalovský, K., Goertzel, Z., Kaliszyk, C., Olšák, M., Piotrowski, B., Schulz, S., Suda, M., & Urban, J. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.itp.2023.19 · Cited by 76,658
Neural Machine Translation by Jointly Learning to Align and Translate
Bahdanau, D., Cho, K., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1409.0473 · Cited by 16,213
Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation
Wu, Y., Schuster, M., Chen, Z., Le, Q. V., Norouzi, M., Macherey, W., Krikun, M., Cao, Y., Gao, Q., Macherey, K., et al. (2016) · arXiv · doi:10.48550/arxiv.1609.08144 · Cited by 5,319
Hierarchical Attention Networks for Document Classification
Yang, Z., Yang, D., Dyer, C., He, X., Smola, A., & Hovy, E. (2016) · Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.18653/v1/n16-1174 · Cited by 4,712
NLTK: The Natural Language Toolkit
Loper, E., & Bird, S. (2002) · arXiv (Cornell University) · doi:10.48550/arxiv.cs/0205028 · Cited by 1,844
OpenNMT: Open-Source Toolkit for Neural Machine Translation
Klein, G., Kim, Y., Deng, Y., Senellart, J., & Rush, A. (2017) · Proceedings of ACL 2017, System Demonstrations · doi:10.18653/v1/p17-4012 · Cited by 1,749
Moses : open source toolkit for statistical machine translation
Koehn, P., Hoang, H., Birch, A., Callison-Burch, C., Federico, M., Bertoldi, N., Cowan, B., Shen, W., Moran, C., Zens, R., et al. (2007) · Edinburgh Research Explorer (University of Edinburgh) · Cited by 1,547
Statistical Significance Tests for Machine Translation Evaluation.
Koehn, P. (2004) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · Cited by 1,449
The measurement of textual coherence with latent semantic analysis
Foltz, P. W., Kintsch, W., & Landauer, T. K. (1998) · Discourse Processes · doi:10.1080/01638539809545029 · Cited by 749
OpenSubtitles2016: Extracting Large Parallel Corpora from Movie and TV Subtitles
Lison, P., & Tiedemann, J. (2016) · Language Resources and Evaluation Conference (LREC) · doi:10.63317/3fi26b3nobqg · Cited by 656
WIT3: Web Inventory of Transcribed and Translated Talks
Cettolo, M., Girardi, C., & Federico, M. (2012) · Cited by 543
Findings of the 2009 workshop on statistical machine translation
Callison-Burch, C., Koehn, P., Monz, C., & Schroeder, J. (2009) · Proceedings of the Fourth Workshop on Statistical Machine Translation - StatMT '09 · doi:10.3115/1626431.1626433 · Cited by 343
Context-Aware Neural Machine Translation Learns Anaphora Resolution
Voita, E., Serdyukov, P., Sennrich, R., & Titov, I. (2018) · Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p18-1117 · Cited by 279
Neural Machine Translation with Extended Context
Tiedemann, J., & Scherrer, Y. (2017) · Proceedings of the Third Workshop on Discourse in Machine Translation · doi:10.18653/v1/w17-4811 · Cited by 217
Variational Neural Machine Translation
Zhang, B., Xiong, D., su, J., Duan, H., & Zhang, M. (2016) · Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d16-1050 · Cited by 208
Exploiting Cross-Sentence Context for Neural Machine Translation
Wang, L., Tu, Z., Way, A., & Liu, Q. (2017) · Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d17-1301 · Cited by 190
Does Neural Machine Translation Benefit from Larger Context?Preprint
Jean, S., Lauly, S., Fırat, O., & Cho, K. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1704.05135 · Cited by 174
Learning to Remember Translation History with a Continuous Cache
Tu, Z., Liu, Y., Shi, S., & Zhang, T. (2018) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00029 · Cited by 161
Document Context Neural Machine Translation with Memory Networks
Maruf, S., & Haffari, G. (2018) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p18-1118 · Cited by 156
Context Gates for Neural Machine Translation
Tu, Z., Liu, Y., Lu, Z., Liu, X., & Li, H. (2017) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00048 · Cited by 126
Evaluating Discourse Phenomena in Neural Machine Translation
Bawden, R., Sennrich, R., Birch, A., & Haddow, B. (2017) · Zurich Open Repository and Archive (University of Zurich) · doi:10.48550/arxiv.1711.00513 · Cited by 84
Memory-enhanced Decoder for Neural Machine Translation
Wang, M., Lu, Z., Li, H., & Liu, Q. (2016) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d16-1027 · Cited by 77
Using Sense-labeled Discourse Connectives for Statistical Machine Translation
Meyer, T., & Popescu-Belis, A. (2012) · Infoscience (Ecole Polytechnique Fédérale de Lausanne) · Cited by 60
Context Adaptation in Statistical Machine Translation Using Models with Exponentially Decaying Cache
Tiedemann, J. (2010) · Cited by 60
Extending Machine Translation Evaluation Metrics with Lexical Cohesion to Document Level
Wong, B. T. M., & Kit, C. (2012) · Cited by 57
Implicitation of Discourse Connectives in (Machine) Translation
Meyer, T., & Webber, B. (2013) · Infoscience (Ecole Polytechnique Fédérale de Lausanne) · Cited by 53
Validation of an Automatic Metric for the Accuracy of Pronoun Translation (APT)
Werlen, L. M., & Popescu-Belis, A. (2017) · Workshop on Discourse in Machine Translation (DiscoMT) · doi:10.18653/v1/w17-4802 · Cited by 49
Neural Machine Translation with Recurrent Attention Modeling
Yang, Z., Hu, Z., Deng, Y., Dyer, C., & Smola, A. J. (2017) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/e17-2061 · Cited by 45
Latent Semantic Analysis Models on Wikipedia and TASA
Stefanescu, D. C., Banjade, R., & Rus, V. (2014) · Language Resources and Evaluation Conference (LREC) · doi:10.63317/2er8kfepc2bj · Cited by 31
On Integrating Discourse in Machine Translation
Smith, K. (2017) · Workshop on Discourse in Machine Translation (DiscoMT) · doi:10.18653/v1/w17-4814 · Cited by 29
Consistent Translation of Repeated Nouns using Syntactic and Semantic Cues
Pu, X., Mascarell, L., & Popescu-Belis, A. (2017) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/e17-1089 · Cited by 17
Lapshinova‐Koltunski, E., & Hardmeier, C. (2017) · Workshop on Discourse in Machine Translation (DiscoMT) · doi:10.18653/v1/w17-4810 · Cited by 11
Cited by
Multilingual Denoising Pre-training for Neural Machine Translation
Liu, Y., Gu, J., Goyal, N., Li, X., Edunov, S., Ghazvininejad, M., Lewis, M., & Zettlemoyer, L. (2020) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00343 · Cited by 1,527
Lin, T., Wang, Y., Liu, X., & Qiu, X. (2022) · AI Open · doi:10.1016/j.aiopen.2022.10.001 · Cited by 1,422
ETC: Encoding Long and Structured Inputs in Transformers
Ainslie, J., Ontañón, S., Alberti, C., Cvicek, V., Fisher, Z., Pham, P., Ravula, A., Sanghai, S., Wang, Q., & Yang, L. (2020) · Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.19 · Cited by 268
LongT5: Efficient Text-To-Text Transformer for Long Sequences
Guo, M., Ainslie, J., Uthus, D., Ontanon, S., Ni, J., Sung, Y.-H., & Yang, Y. (2021) · arXiv · doi:10.48550/arxiv.2112.07916 · Cited by 230
LongT5: Efficient Text-To-Text Transformer for Long Sequences
Guo, M., Ainslie, J., Uthus, D., Ontanon, S., Ni, J., Sung, Y.-H., & Yang, Y. (2022) · Findings of the Association for Computational Linguistics: NAACL 2022 · doi:10.18653/v1/2022.findings-naacl.55 · Cited by 230
Metadata
- Authors
- Miculicich, L., Ram, D., Pappas, N., & Henderson, J.
- Venue
- Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing
- Published
- 2018
- Pages
- 2947-2954
- OpenAlex
- W2891534142
- Cited by
- 256
- References
- 32
- FWCI
- 17.48
- Type
- conference paper
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.