Findings of the 2018 Conference on Machine Translation (WMT18)
Open accessThe DOI matches its Crossref record; 69 of the 69 references it cites were found in a registry or an index.
Abstract
Ondřej Bojar, Christian Federmann, Mark Fishel, Yvette Graham, Barry Haddow, Matthias Huck, Philipp Koehn, Christof Monz. Proceedings of the Third Conference on Machine Translation: Shared Task Papers. 2018.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
Exploiting Generative AI to Scale up Intelligent Tutoring Systems
Jakubův, J., Chvalovský, K., Goertzel, Z., Kaliszyk, C., Olšák, M., Piotrowski, B., Schulz, S., Suda, M., & Urban, J. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.itp.2023.19 · Cited by 76,658
Neural Machine Translation by Jointly Learning to Align and Translate
Bahdanau, D., Cho, K., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1409.0473 · Cited by 16,213
Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation
Wu, Y., Schuster, M., Chen, Z., Le, Q. V., Norouzi, M., Macherey, W., Krikun, M., Cao, Y., Gao, Q., Macherey, K., et al. (2016) · arXiv · doi:10.48550/arxiv.1609.08144 · Cited by 5,319
OpenNMT: Open-Source Toolkit for Neural Machine Translation
Klein, G., Kim, Y., Deng, Y., Senellart, J., & Rush, A. (2017) · Proceedings of ACL 2017, System Demonstrations · doi:10.18653/v1/p17-4012 · Cited by 1,749
Moses : open source toolkit for statistical machine translation
Koehn, P., Hoang, H., Birch, A., Callison-Burch, C., Federico, M., Bertoldi, N., Cowan, B., Shen, W., Moran, C., Zens, R., et al. (2007) · Edinburgh Research Explorer (University of Edinburgh) · Cited by 1,547
Self-citationKenLM: Faster and Smaller Language Model Queries
Heafield, K. (2011) · Cited by 1,145
Understanding Back-Translation at Scale
Edunov, S., Ott, M., Auli, M., & Grangier, D. (2018) · Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d18-1045 · Cited by 993
Phrase-Based & Neural Unsupervised Machine Translation
Lample, G., Ott, M., Conneau, A., Denoyer, L., & Ranzato, M. (2018) · Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d18-1549 · Cited by 615
Findings of the 2016 Conference on Machine Translation
Bojar, O., Chatterjee, R., Federmann, C., Graham, Y., Haddow, B., Huck, M., Jimeno Yepes, A., Koehn, P., Logacheva, V., Monz, C., et al. (2016) · Proceedings of the First Conference on Machine Translation: Volume 2, Shared Task Papers · doi:10.18653/v1/w16-2301 · Cited by 539
Self-citationFindings of the 2014 Workshop on Statistical Machine Translation
Bojar, O., Buck, C., Federmann, C., Haddow, B., Koehn, P., Leveling, J., Monz, C., Pecina, P., Post, M., Saint-Amand, H., et al. (2014) · Proceedings of the Ninth Workshop on Statistical Machine Translation · doi:10.3115/v1/w14-3302 · Cited by 529
Self-citationAchieving Human Parity on Automatic Chinese to English News Translation
Hassan, H., Aue, A., Chen, C., Chowdhary, V., Clark, J. H., Federmann, C., Huang, X., Junczys-Dowmunt, M., Lewis, W. D., Li, M., et al. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1803.05567 · Cited by 521
Self-citationFindings of the 2017 Conference on Machine Translation (WMT17)
Bojar, O., Chatterjee, R., Federmann, C., Graham, Y., Haddow, B., Huang, S., Huck, M., Koehn, P., Liu, Q., Logacheva, V., et al. (2017) · Proceedings of the Second Conference on Machine Translation · doi:10.18653/v1/w17-4717 · Cited by 395
Self-citation(Meta-) evaluation of machine translation
Callison-Burch, C., Fordyce, C., Koehn, P., Monz, C., & Schroeder, J. (2007) · Proceedings of the Second Workshop on Statistical Machine Translation - StatMT '07 · doi:10.3115/1626355.1626373 · Cited by 379
Self-citationContinuous Measurement Scales in Human Evaluation of Machine Translation
Graham, Y., Baldwin, T., Moffat, A., & Zobel, J. (2013) · Trinity's Access to Research Output (TARA) (Trinity College Dublin) · Cited by 353
Self-citationFindings of the 2009 workshop on statistical machine translation
Callison-Burch, C., Koehn, P., Monz, C., & Schroeder, J. (2009) · Proceedings of the Fourth Workshop on Statistical Machine Translation - StatMT '09 · doi:10.3115/1626431.1626433 · Cited by 343
Self-citationFindings of the 2013 Workshop on Statistical Machine Translation
Buck, C., Callison-Burch, C., Federmann, C., Haddow, B., Monz, C., Post, M., Soricut, R., & Specia, L. (2013) · Cited by 309
Self-citationNematus: a Toolkit for Neural Machine Translation
Sennrich, R., Firat, O., Cho, K., Birch, A., Haddow, B., Hitschler, J., Junczys-Dowmunt, M., Läubli, S., Miceli Barone, A. V., Mokry, J., et al. (2017) · Proceedings of the Software Demonstrations of the 15th Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/e17-3017 · Cited by 291
Self-citationManual and automatic evaluation of machine translation between European languages
Koehn, P., & Monz, C. (2006) · Proceedings of the Workshop on Statistical Machine Translation - StatMT '06 · doi:10.3115/1654650.1654666 · Cited by 269
Self-citationFurther meta-evaluation of machine translation
Callison-Burch, C., Fordyce, C., Koehn, P., Monz, C., & Schroeder, J. (2008) · Proceedings of the Third Workshop on Statistical Machine Translation - StatMT '08 · doi:10.3115/1626394.1626403 · Cited by 267
Self-citationTraining Tips for the Transformer Model
Popel, M., & Bojar, O. (2018) · The Prague Bulletin of Mathematical Linguistics · doi:10.2478/pralin-2018-0002 · Cited by 266
Self-citationMorfessor 2.0: Python Implementation and Extensions for Morfessor Baseline
Virpioja, S., Smit, P., Grönroos, S.-A., & Kurimo, M. (2013) · Aaltodoc (Aalto University) · Cited by 255
Findings of the 2013 Workshop on Statistical Machine Translation
Bojar, O., Buck, C., Callison-Burch, C., Federmann, C., Haddow, B., Koehn, P., Monz, C., Post, M., Soricut, R., & Specia, L. (2013) · UvA-DARE (University of Amsterdam) · Cited by 236
Self-citationCallison-Burch, C., Koehn, P., Monz, C., Peterson, K., Przybocki, M. A., & Zaidan, O. F. (2010) · UvA-DARE (University of Amsterdam) · Cited by 180
Self-citationSockeye: A Toolkit for Neural Machine Translation
Hieber, F., Domhan, T., Denkowski, M., Vilar, D., Sokolov, A., Clifton, A., & Post, M. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1712.05690 · Cited by 171
Findings of the Third Shared Task on Multimodal Machine Translation
Barrault, L., Bougares, F., Specia, L., Lala, C., Elliott, D., & Frank, S. (2018) · Proceedings of the Third Conference on Machine Translation: Shared Task Papers · doi:10.18653/v1/w18-6402 · Cited by 141
Can machine translation systems be evaluated by the crowd alone
GRAHAM, Y., BALDWIN, T., MOFFAT, A., & ZOBEL, J. (2017) · Natural Language Engineering · doi:10.1017/s1351324915000339 · Cited by 140
Self-citationFindings of the WMT 2018 Shared Task on Parallel Corpus Filtering
Koehn, P., Khayrallah, H., Heafield, K., & Forcada, M. L. (2018) · Conference on Machine Translation (WMT) · doi:10.18653/v1/w18-6453 · Cited by 99
Self-citation(2016) · doi:10.18653/v1/n16-1046 · Cited by 94
Results of the WMT18 Metrics Shared Task: Both characters and embeddings achieve good performance
Ma, Q., Bojar, O., & Graham, Y. (2018) · Proceedings of the Third Conference on Machine Translation: Shared Task Papers · doi:10.18653/v1/w18-6450 · Cited by 88
Self-citationTarget-side Word Segmentation Strategies for Neural Machine Translation
Huck, M., Rieß, S., & Fraser, A. (2017) · Conference on Machine Translation (WMT) · doi:10.18653/v1/w17-4706 · Cited by 81
Findings of the WMT 2018 Shared Task on Quality Estimation
Specia, L., Blain, F., Logacheva, V., Astudillo, R., & Martins, A. F. T. (2018) · Proceedings of the Third Conference on Machine Translation: Shared Task Papers · doi:10.18653/v1/w18-6451 · Cited by 75
Is Machine Translation Getting Better over Time?
Graham, Y., Baldwin, T., Moffat, A., & Zobel, J. (2014) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.3115/v1/e14-1047 · Cited by 69
Self-citationCzEng 1.6: Enlarged Czech-English Parallel Corpus with Processing Tools Dockered
Bojar, O., Dušek, O., Kocmi, T., Libovický, J., Novák, M., Popel, M., Sudarikov, R., & Variš, D. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-45510-5_27 · Cited by 69
Self-citationFindings of the WMT 2019 Shared Task on Automatic Post-Editing
Chatterjee, R., Federmann, C., Negri, M., & Turchi, M. (2019) · Conference on Machine Translation (WMT) · doi:10.18653/v1/w19-5402 · Cited by 65
Self-citationCUNI Transformer Neural MT System for WMT18
Popel, M. (2018) · Conference on Machine Translation (WMT) · doi:10.18653/v1/w18-6424 · Cited by 47
Junczys-Dowmunt, M. (2018) · Conference on Machine Translation (WMT) · doi:10.18653/v1/w18-6415 · Cited by 39
Stahlberg, F., de Gispert, A., Hasler, E., & Byrne, B. (2017) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/e17-2058 · Cited by 37
Alibaba’s Neural Machine Translation Systems for WMT18
Deng, Y., Cheng, S., Lu, J., Song, K., Wang, J., Wu, S., Yao, L., Zhang, G., Zhang, H., Zhang, P., et al. (2018) · Conference on Machine Translation (WMT) · doi:10.18653/v1/w18-6408 · Cited by 35
Findings of the WMT 2018 Biomedical Translation Shared Task: Evaluation on Medline test sets
Neves, M., Yepes, A. J., Névéol, A., Grozea, C., Siu, A., Kittner, M., & Verspoor, K. M. (2018) · Conference on Machine Translation (WMT) · doi:10.18653/v1/w18-6403 · Cited by 32
Appraise: an Open-Source Toolkit for Manual Evaluation of MT Output
Federmann, C. (2012) · The Prague Bulletin of Mathematical Linguistics · doi:10.2478/v10108-012-0006-9 · Cited by 29
Self-citationThe University of Cambridge’s Machine Translation Systems for WMT18
Stahlberg, F., de Gispert, A., & Byrne, B. (2018) · Conference on Machine Translation (WMT) · doi:10.18653/v1/w18-6427 · Cited by 22
NICT’s Neural and Statistical Machine Translation Systems for the WMT18 News Translation Task
Marie, B., Wang, R., Fujita, A., Utiyama, M., & Sumita, E. (2018) · Conference on Machine Translation (WMT) · doi:10.18653/v1/w18-6419 · Cited by 21
The JHU Machine Translation Systems for WMT 2017
Ding, S., Khayrallah, H., Koehn, P., Post, M., Kumar, G., & Duh, K. (2017) · Conference on Machine Translation (WMT) · doi:10.18653/v1/w17-4724 · Cited by 18
Self-citationTiedemann, J., Cap, F., Kanerva, J., Ginter, F., Stymne, S., Östling, R., & Marco, M. W.-D. (2016) · Conference on Machine Translation (WMT) · doi:10.18653/v1/w16-2326 · Cited by 16
The University of Edinburgh’s Submissions to the WMT18 News Translation Task
Haddow, B., Bogoychev, N., Emelin, D., et al. (2018) · doi:10.18653/v1/w18-6412 · Cited by 16
Self-citationTilde’s Machine Translation Systems for WMT 2018
Pinnis, M., Rikters, M., & Krišlauks, R. (2018) · Conference on Machine Translation (WMT) · doi:10.18653/v1/w18-6423 · Cited by 15
LMU Munich's Neural Machine Translation Systems for News Articles and Health Information Texts
Huck, M., Braune, F., & Fraser, A. (2017) · Conference on Machine Translation (WMT) · doi:10.18653/v1/w17-4730 · Cited by 14
Cognate-aware morphological segmentation for multilingual neural translation
Grönroos, S.-A., Virpioja, S., & Kurimo, M. (2018) · Conference on Machine Translation (WMT) · doi:10.18653/v1/w18-6410 · Cited by 14
Burlot, F., Scherrer, Y., Ravishankar, V., Bojar, O., Grönroos, S.-A., Koponen, M., Nieminen, T., & Yvon, F. (2018) · Conference on Machine Translation (WMT) · doi:10.18653/v1/w18-6433 · Cited by 14
Self-citationTencent Neural Machine Translation Systems for WMT18
Wang, M., Gong, L., Zhu, W., Xie, J., & Bian, C. (2018) · Conference on Machine Translation (WMT) · doi:10.18653/v1/w18-6429 · Cited by 14
The NiuTrans Machine Translation System for WMT18
Wang, Q., Li, B., Liu, J., Jiang, B., Zhang, Z., Li, Y., Lin, Y., Xiao, T., & Zhu, J. (2018) · doi:10.18653/v1/w18-6430 · Cited by 12
The RWTH Aachen University Supervised Machine Translation Systems for WMT 2018
Schamper, J., Rosendahl, J., Bahar, P., Kim, Y., Nix, A., & Ney, H. (2018) · Conference on Machine Translation (WMT) · doi:10.18653/v1/w18-6426 · Cited by 12
NTT’s Neural Machine Translation Systems for WMT 2018
Morishita, M., Suzuki, J., & Nagata, M. (2018) · Conference on Machine Translation (WMT) · doi:10.18653/v1/w18-6421 · Cited by 11
The Karlsruhe Institute of Technology Systems for the News Translation Task in WMT 2018
Ha, T.-L., Niehues, J., & Waibel, A. (2018) · Repository KITopen (Karlsruhe Institute of Technology) · doi:10.5445/ir/1000145062 · Cited by 10
The Karlsruhe Institute of Technology Systems for the News Translation Task in WMT 2018
Pham, N.-Q., Niehues, J., & Waibel, A. H. (2018) · Conference on Machine Translation (WMT) · doi:10.18653/v1/w18-6422 · Cited by 9
LMU Munich’s Neural Machine Translation Systems at WMT 2018
Huck, M., Stojanovski, D., Hangya, V., & Fraser, A. (2018) · Conference on Machine Translation (WMT) · doi:10.18653/v1/w18-6446 · Cited by 9
Phrase-based Unsupervised Machine Translation with Compositional Phrase Embeddings
Del, M., Tättar, A., & Fishel, M. (2018) · Conference on Machine Translation (WMT) · doi:10.18653/v1/w18-6407 · Cited by 9
Self-citationAn Empirical Study of Machine Translation for the Shared Task of WMT18
Bei, C., Zong, H., Wang, Y., Fan, B., Li, S., & Yuan, C. (2018) · Conference on Machine Translation (WMT) · doi:10.18653/v1/w18-6404 · Cited by 9
Kocmi, T., Sudarikov, R., & Bojar, O. (2018) · doi:10.18653/v1/w18-6416 · Cited by 6
Self-citationThe MLLP-UPV German-English Machine Translation System for WMT18
Iranzo-Sánchez, J., Baquero-Arnal, P., Díaz-Munío, G. V. G., Martinez-Villaronga, A. A., Civera, J., & Juan, A. (2018) · Conference on Machine Translation (WMT) · doi:10.18653/v1/w18-6414 · Cited by 6
The University of Maryland’s Chinese-English Neural Machine Translation Systems at WMT18
Xu, W., & Carpuat, M. J. (2018) · Conference on Machine Translation (WMT) · doi:10.18653/v1/w18-6431 · Cited by 6
Graça, M., Kim, Y., Schamper, J., Geng, J., & Ney, H. (2018) · Conference on Machine Translation (WMT) · doi:10.18653/v1/w18-6409 · Cited by 5
The TALP-UPC Machine Translation Systems for WMT18 News Shared Translation Task
Casas, N., Escolano, C., Costa‐jussà, M. R., & Fonollosa, J. A. R. (2018) · Conference on Machine Translation (WMT) · doi:10.18653/v1/w18-6406 · Cited by 5
The LMU Munich Unsupervised Machine Translation Systems
Stojanovski, D., Hangya, V., Huck, M., & Fraser, A. (2018) · Conference on Machine Translation (WMT) · doi:10.18653/v1/w18-6428 · Cited by 4
PROMT Systems for WMT 2018 Shared Translation Task
Molchanov, A. P. (2018) · Conference on Machine Translation (WMT) · doi:10.18653/v1/w18-6420 · Cited by 3
Robust parfda Statistical Machine Translation Results
Biçici, E. (2018) · doi:10.18653/v1/w18-6405 · Cited by 3
PROMT Systems for WMT 2019 Shared Translation Task
Molchanov, A. P. (2019) · Conference on Machine Translation (WMT) · doi:10.18653/v1/w19-5331 · Cited by 3
TencentFmRD Neural Machine Translation for WMT18
Hu, B., Han, A., & Huang, S. (2018) · doi:10.18653/v1/w18-6413 · Cited by 2
Cited by
Stanza: A Python Natural Language Processing Toolkit for Many Human Languages
Qi, P., Zhang, Y., Zhang, Y., Bolton, J., & Manning, C. D. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics: System Demonstrations · doi:10.18653/v1/2020.acl-demos.14 · Cited by 1,431
Analyzing Multi-Head Self-Attention: Specialized Heads Do the Heavy Lifting, the Rest Can Be Pruned
Voita, E., Talbot, D., Moiseev, F., Sennrich, R., & Titov, I. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1580 · Cited by 1,146
“The Transformer achieved state-of-the-art results in recent shared translation tasks (Bojar et al., 2018; Niehues et al., 2018).”
BackgroundMembership Inference Attacks on Machine Learning: A Survey
Hu, H., Salcic, Z., Sun, L., Dobbie, G., Yu, P. S., & Zhang, X. (2022) · ACM Computing Surveys · doi:10.1145/3523273 · Cited by 564
Findings of the 2019 Conference on Machine Translation (WMT19)
Barrault, L., Bojar, O., Costa-jussà, M. R., Federmann, C., Fishel, M., Graham, Y., Haddow, B., Huck, M., Koehn, P., Malmasi, S., et al. (2019) · Proceedings of the Fourth Conference on Machine Translation (Volume 2: Shared Task Papers, Day 1) · doi:10.18653/v1/w19-5301 · Cited by 461
Self-citationBeyond English-Centric Multilingual Machine Translation
Fan, A., Bhosale, S., Schwenk, H., Ma, Z., El-Kishky, A., Goyal, S., Baines, M., Çelebi, O., Wenzek, G., Chaudhary, V., et al. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.11125 · Cited by 452
Metadata
- Authors
- Bojar, O., Federmann, C., Fishel, M., Graham, Y., Haddow, B., Koehn, P., & Monz, C.
- Venue
- Proceedings of the Third Conference on Machine Translation: Shared Task Papers
- Published
- 2018
- Pages
- 272-303
- OpenAlex
- W2903193068
- Cited by
- 520
- References
- 69
- FWCI
- 35.89
- Type
- conference paper
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.