The DOI matches its Crossref record; 33 of the 33 references it cites were found in a registry or an index.
Learning bilingual word embeddings with (almost) no bilingual data
Open accessAbstract
Most methods to learn bilingual word embeddings rely on large parallel corpora, which is difficult to obtain for most language pairs.This has motivated an active research line to relax this requirement, with methods that use document-aligned corpora or bilingual dictionaries of a few thousand words instead.In this work, we further reduce the need of bilingual resources using a very simple self-learning approach that can be combined with any dictionary-based mapping technique.Our method exploits the structural similarity of embedding spaces, and works with as little bilingual evidence as a 25 word dictionary or even an automatically generated list of numerals, obtaining results comparable to those of systems that use richer resources.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Distributed Representations of Words and Phrases and their Compositionality
Mikolov, T., Sutskever, I., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1310.4546 · Cited by 24,533
The Stanford CoreNLP Natural Language Processing Toolkit
Manning, C., Surdeanu, M., Bauer, J., Finkel, J., Bethard, S., & McClosky, D. (2014) · Proceedings of 52nd Annual Meeting of the Association for Computational Linguistics: System Demonstrations · doi:10.3115/v1/p14-5010 · Cited by 7,037
Makhzani, A., Shlens, J., Jaitly, N., Goodfellow, I., & Frey, B. (2015) · arXiv · doi:10.48550/arxiv.1511.05644 · Cited by 1,579
Parallel Data, Tools and Interfaces in OPUS
Tiedemann, J. (2012) · Language Resources and Evaluation · Cited by 1,421
Exploiting Similarities among Languages for Machine Translation
Mikolov, T., Le, Q. V., & Sutskever, I. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1309.4168 · Cited by 1,346
The WaCky wide web: a collection of very large linguistically processed web-crawled corpora
Baroni, M., Bernardini, S., Ferraresi, A., & Zanchetta, E. (2009) · Language Resources and Evaluation · doi:10.1007/s10579-009-9081-4 · Cited by 1,200
Improving Vector Space Word Representations Using Multilingual Correlation
Faruqui, M., & Dyer, C. (2014) · Proceedings of the 14th Conference of the European Chapter of the Association for Computational Linguistics · doi:10.3115/v1/e14-1049 · Cited by 620
Bilingual Word Embeddings for Phrase-Based Machine Translation
Zou, W. Y., Socher, R., Cer, D., & Manning, C. D. (2013) · Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d13-1141 · Cited by 518
Inducing Crosslingual Distributed Representations of Words
Klementiev, A., Titov, I., & Bhattarai, B. (2012) · International Conference on Computational Linguistics · Cited by 389
Normalized Word Embedding and Orthogonal Transform for Bilingual Word Translation
Xing, C., Wang, D., Liu, C., & Lin, Y. (2015) · Proceedings of the 2015 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.3115/v1/n15-1104 · Cited by 381
Learning principled bilingual mappings of word embeddings while preserving monolingual invariance
Artetxe, M., Labaka, G., & Agirre, E. (2016) · Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d16-1250 · Cited by 369
Self-citationBilingual Word Representations with Monolingual Quality in Mind
Luong, T., Pham, H., & Manning, C. D. (2015) · Proceedings of the 1st Workshop on Vector Space Modeling for Natural Language Processing · doi:10.3115/v1/w15-1521 · Cited by 315
Improving zero-shot learning by mitigating the hubness problem
Dinu, G., Lazaridou, A., & Baroni, M. (2015) · Figshare · doi:10.5281/zenodo.2654863 · Cited by 310
An Autoencoder Approach to Learning Bilingual Word Representations
P, S. C. A., Lauly, S., Larochelle, H., Khapra, M. M., Ravindran, B., Raykar, V. C., & Saha, A. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1402.1454 · Cited by 309
BilBOWA: Fast Bilingual Distributed Representations without Word Alignments
Gouws, S., Bengio, Y., & Corrado, G. S. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1410.2455 · Cited by 285
Offline bilingual word vectors, orthogonal transformations and the inverted softmax
Smith, S. L., Turban, D. H. P., Hamblin, S., & Hammerla, N. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1702.03859 · Cited by 238
Hubness and Pollution: Delving into Cross-Space Mapping for Zero-Shot Learning
Lazaridou, A., Dinu, G., & Baroni, M. (2015) · Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · doi:10.3115/v1/p15-1027 · Cited by 210
Cross-lingual Models of Word Embeddings: An Empirical Comparison
Upadhyay, S., Faruqui, M., Dyer, C., & Roth, D. (2016) · Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p16-1157 · Cited by 177
Deep Multilingual Correlation for Improved Word Embeddings
Lu, A., Wang, W., Bansal, M., Gimpel, K., & Livescu, K. (2015) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.3115/v1/n15-1028 · Cited by 134
Bilingual Distributed Word Representations from Document-Aligned Comparable Data
Vulić, I., & Moens, M. (2016) · Journal of Artificial Intelligence Research · doi:10.1613/jair.4986 · Cited by 132
Barone, A. V. M. (2016) · Workshop on Representation Learning for NLP (RepL4NLP) · doi:10.18653/v1/w16-1614 · Cited by 123
Cross-lingual Wikification Using Multilingual Embeddings
Tsai, C.-T., & Roth, D. (2016) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n16-1072 · Cited by 110
Ten Pairs to Tag – Multilingual POS Tagging via Coarse Mapping between Embeddings
Zhang, Y., Gaddy, D., Barzilay, R., & Jaakkola, T. (2016) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n16-1156 · Cited by 107
On the Role of Seed Lexicons in Learning Bilingual Word Embeddings
Vulić, I., & Korhonen, A. (2016) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p16-1024 · Cited by 99
Distributed Word Representation Learning for Cross-Lingual Dependency Parsing
Xiao, M., & Guo, Y. (2014) · Conference on Computational Natural Language Learning · doi:10.3115/v1/w14-1613 · Cited by 98
Inverted indexing for cross-lingual NLP
Søgaard, A., Agić, Ż., Alonso, H. M., Plank, B., Bohnet, B., & Johannsen, A. (2015) · doi:10.3115/v1/p15-1165 · Cited by 82
Mogadala, A., & Rettinger, A. (2016) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n16-1083 · Cited by 80
A Framework for the Construction of Monolingual and Cross-lingual Word Similarity Datasets
Camacho-Collados, J., Pilehvar, M. T., & Roberto Navigli, A. (2015) · doi:10.3115/v1/p15-2001 · Cited by 54
A Study on Bootstrapping Bilingual Vector Spaces from Non-Parallel Data (and Nothing Else)
Vulić, I., & Moens, M. (2013) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d13-1168 · Cited by 43
Learning Translation Models from Monolingual Continuous Representations
Zhao, K., Hassan, H., & Auli, M. (2015) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.3115/v1/n15-1176 · Cited by 41
A Distribution-based Model to Learn Bilingual Word Embeddings
Cao, H., Zhao, T., Zhang, S., & Meng, Y. (2016) · International Conference on Computational Linguistics · Cited by 31
Cross-lingual Induction of Selectional Preferences with Bilingual Vector Spaces
Peirsman, Y., & Padó, S. (2010) · Lirias · Cited by 29
Unifying Bayesian Inference and Vector Space Models for Improved Decipherment
Dou, Q., Vaswani, A., Knight, K. K., & Dyer, C. (2015) · doi:10.3115/v1/p15-1081 · Cited by 19
Cited by
XNLI: Evaluating Cross-lingual Sentence Representations
Conneau, A., Rinott, R., Lample, G., Williams, A., Bowman, S., Schwenk, H., & Stoyanov, V. (2018) · Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d18-1269 · Cited by 915
Phrase-Based & Neural Unsupervised Machine Translation
Lample, G., Ott, M., Conneau, A., Denoyer, L., & Ranzato, M. (2018) · Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d18-1549 · Cited by 615
On the Cross-lingual Transferability of Monolingual Representations
Artetxe, M., Ruder, S., & Yogatama, D. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.421 · Cited by 598
Self-citationA robust self-learning method for fully unsupervised cross-lingual mappings of word embeddings
Artetxe, M., Labaka, G., & Agirre, E. (2018) · Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p18-1073 · Cited by 555
Self-citationA Survey of Cross-lingual Word Embedding Models
Ruder, S., Vulić, I., & Søgaard, A. (2018) · Apollo (University of Cambridge) · doi:10.17863/cam.30462 · Cited by 510
Metadata
- Authors
- Artetxe, M., Labaka, G., & Agirre, E.
- Venue
- Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
- Published
- 2017
- Pages
- 451-462
- OpenAlex
- W2741602058
- Cited by
- 455
- References
- 33
- FWCI
- 36.58
- Type
- conference paper
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.