N-gram-based Machine Translation
Open accessThe DOI matches its Crossref record; 27 of the 27 references it cites were found in a registry or an index.
Abstract
This article describes in detail an n-gram approach to statistical machine translation. This approach consists of a log-linear combination of a translation model based on n-grams of bilingual units, which are referred to as tuples, along with four specific feature functions. Translation performance, which happens to be in the state of the art, is demonstrated with Spanish-to-English and English-to-Spanish translations of the European Parliament Plenary Sessions (EPPS).
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A Mathematical Theory of Communication
Shannon, C. E. (1948) · Bell System Technical Journal · doi:10.1002/j.1538-7305.1948.tb01338.x · Cited by 88,486
A Mathematical Theory of Communication
Shannon, C. E. (1948) · Bell System Technical Journal · doi:10.1002/j.1538-7305.1948.tb00917.x · Cited by 48,949
BLEU: a method for automatic evaluation of machine translation
Papineni, K., Roukos, S., Ward, T., & Zhu, W.-J. (2001) · Proceedings of the 40th Annual Meeting on Association for Computational Linguistics - ACL '02 · doi:10.3115/1073083.1073135 · Cited by 21,344 · cited 2×
“Translation accuracy is measured in terms of the BLEU score (Papineni et al. 2002), which is computed here for translations generated by using the tuple n -gram model alone, in the case of Table 2, and by using the tuple n -gram model along with the additional four feature functions described in…”
MethodPress, W. H., Teukolsky, S. A., Vetterling, W. T., & Flannery, B. P. (1994) · Cited by 15,411
Communication Theory of Secrecy Systems
Shannon, C. E. (1949) · Bell System Technical Journal · doi:10.1002/j.1538-7305.1949.tb00928.x · Cited by 9,440 · cited 1×
“The beginnings of statistical machine translation (SMT) can be traced back to the early fifties, closely related to the ideas from which information theory arose (Shannon and Weaver 1949) and inspired by works on cryptography (Shannon 1949, 1951) during World War II.”
BackgroundNumerical Recipes in C: The Art of Scientific Computing.
Birchenhall, C., Press, W. H., Teukolsky, S. A., Vetterling, W. T., & Flannery, B. P. (1994) · The Economic Journal · doi:10.2307/2234664 · Cited by 4,355
The mathematics of statistical machine translation: parameter estimation
Brown, P. F., Pietra, V. J. D., Pietra, S. A. D., & Mercer, R. L. (1993) · Cited by 3,973
A Systematic Comparison of Various Statistical Alignment Models
Och, F. J., & Ney, H. (2003) · Computational Linguistics · doi:10.1162/089120103321337421 · Cited by 3,854 · cited 1×
“Three different alignment sets are considered: source-to-target, the union of source-to-target and target-to-source, and the “refined” alignment method described by Och and Ney (2003).”
MethodStatistical phrase-based translation
Koehn, P., Och, F. J., & Marcu, D. (2003) · Proceedings of the 2003 Conference of the North American Chapter of the Association for Computational Linguistics on Human Language Technology - NAACL '03 · doi:10.3115/1073445.1073462 · Cited by 3,197 · cited 2×
“…from them in two respects: first, word-based translation models have been replaced by phrase-based translation models (Zens, Och, and Ney 2002; Koehn, Och, and Marcu 2003) which are directly estimated from aligned bilingual corpora by considering relative frequencies, and second, the noisy…”
MethodA maximum entropy approach to natural language processing
Berger, A. L., Pietra, V. J. D., & Pietra, S. A. D. (1996) · doi:10.5555/234285.234289 · Cited by 3,065
Prediction and Entropy of Printed English
Shannon, C. E. (1951) · Bell System Technical Journal · doi:10.1002/j.1538-7305.1951.tb01366.x · Cited by 2,686
De Roeck, A. (1995) · Handbook of Pragmatics · doi:10.1075/hop.m.comm2 · Cited by 1,715
A statistical approach to machine translation
Brown, P. F., Cocke, J., Pietra, S. A. D., Pietra, V. J. D., Jelinek, F., Lafferty, J., Mercer, R. L., & Roossin, P. S. (1990) · doi:10.5555/92858.92860 · Cited by 1,655
Improved backing-off for M-gram language modeling
Kneser, R., & Ney, H. (2002) · 1995 International Conference on Acoustics, Speech, and Signal Processing · doi:10.1109/icassp.1995.479394 · Cited by 1,473 · cited 1×
“The options for Kneser–Ney smoothing (Kneser and Ney 1995) and interpolation of higher and lower n -grams are used in these trainings.”
MethodComputational linguistics in 1990
Karlgren, H. (1990) · Proceedings of the 13th conference on Computational linguistics - · doi:10.3115/992507.992531 · Cited by 1,243
Discriminative training and maximum entropy models for statistical machine translation
Och, F. J., & Ney, H. (2001) · Proceedings of the 40th Annual Meeting on Association for Computational Linguistics - ACL '02 · doi:10.3115/1073083.1073133 · Cited by 1,034 · cited 3×
“…which are directly estimated from aligned bilingual corpora by considering relative frequencies, and second, the noisy channel approach has been expanded to a more general maximum entropy approach in which a log-linear combination of multiple feature functions is implemented (Och and Ney 2002).”
BackgroundInfluentialImproved statistical alignment models
Och, F. J., & Ney, H. (2000) · Proceedings of the 38th Annual Meeting on Association for Computational Linguistics - ACL '00 · doi:10.3115/1075218.1075274 · Cited by 1,001 · cited 1×
“In our system implementation, GIZA++ (Och and Ney 2000) is used for computing the alignments.”
MethodMachine Translation: Past, Present, Future
Hutchins, W. J. (1986) · Medical Entomology and Zoology · Cited by 476
Sproat, R., Samuelsson, C., Chu‐Carroll, J., & Carpenter, B. (2003) · The Handbook of Linguistics · doi:10.1002/9780470756409.ch25 · Cited by 376
Phrase-Based Statistical Machine Translation
Zens, R., Och, F. J., & Ney, H. (2002) · Lecture Notes in Computer Science · doi:10.1007/3-540-45751-8_2 · Cited by 352
A Smorgasbord of Features for Statistical Machine Translation
Och, F. J., Gildea, D., Khudanpur, S. P., Sarkar, A., Yamada, K., Fraser, A., Kumar, S., Shen, L., Smith, D. A., Eng, K., et al. (2004) · Cited by 261
Machine Translation with Inferred Stochastic Finite-State Transducers
Casacuberta, F., & Vidal, E. (2004) · Computational Linguistics · doi:10.1162/089120104323093294 · Cited by 148 · cited 2×
“The translation system described in this article implements a translation model that has been derived from the finite-state perspective—more specifically, from the work of Casacuberta (2001) and Casacuberta and Vidal (2004).”
BackgroundMethodFinite-state speech-to-speech translation
Vidal, E. (2002) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.1997.599563 · Cited by 137 · cited 1×
“According to this, SMT has also been approached from a finite-state point of view as the most natural way of integrating ASR and SMT (Riccardi, Pieraccini, and Bocchieri 1996; Vidal 1997; Knight and Al-Onaizan 1998; Bangalore and Riccardi 2000).”
MethodVerbmobil: A Translation System for Face-to-Face Dialog
Kay, M., Norvig, P., & Gawron, M. (1992) · Medical Entomology and Zoology · Cited by 115
Stochastic automata for language modeling
Riccardi, G., Pieraccini, R., & Bocchieri, E. (1996) · Computer Speech & Language · doi:10.1006/csla.1996.0014 · Cited by 96 · cited 1×
“According to this, SMT has also been approached from a finite-state point of view as the most natural way of integrating ASR and SMT (Riccardi, Pieraccini, and Bocchieri 1996; Vidal 1997; Knight and Al-Onaizan 1998; Bangalore and Riccardi 2000).”
MethodIntegration of POStag-based Source Reordering into SMT Decoding by an Extended Search Graph
Crego, J., & Acebal, J. B. M. (2006) · Conference of the Association for Machine Translation in the Americas · Cited by 20
Self-citationPhrase linguistic classification and generalization for improving statistical machine translation
de Gispert, A. (2005) · Annual Meeting of the Association for Computational Linguistics: Student Research Workshop (ACL SRW) · doi:10.3115/1628960.1628974 · Cited by 12
Cited by
Fast and Robust Neural Network Joint Models for Statistical Machine Translation
Devlin, J., Zbib, R., Huang, Z., Lamar, T., Schwartz, R., & Makhoul, J. (2014) · Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.3115/v1/p14-1129 · Cited by 481
“Although there has been a substantial amount of past work in lexicalized joint models (Marino et al., 2006; Crego and Yvon, 2010), nearly all of these papers have used older statistical techniques such as Kneser-Ney or Maximum Entropy.”
MethodAssessing sentence scoring techniques for extractive text summarization
Ferreira, R., de Souza Cabral, L., Lins, R. D., Pereira e Silva, G., Freitas, F., Cavalcanti, G. D. C., Lima, R., Simske, S. J., & Favaro, L. (2013) · Expert Systems with Applications · doi:10.1016/j.eswa.2013.04.023 · Cited by 318
Metadata
- Authors
- Mariño, J. B., Banchs, R. E., Crego, J. M., de Gispert, A., Lambert, P., Fonollosa, J. A. R., & Costa-jussà, M. R.
- Venue
- Computational Linguistics
- Publisher
- MIT Press - Journals
- Published
- 2006-12
- Volume
- 32
- Issue
- 4
- Pages
- 527-549
- ISSN
- 0891-2017 (ISSN-L)
- 1530-9312
- OpenAlex
- W2144879357
- Cited by
- 234
- References
- 27
- FWCI
- 17.60
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.