The DOI matches its Crossref record; 56 of the 56 references it cites were found in a registry or an index.
Adversarial Training for Unsupervised Bilingual Lexicon Induction
Open accessAbstract
Word embeddings are well known to capture linguistic regularities of the language on which they are trained.Researchers also observe that these regularities can transfer across languages.However, previous endeavors to connect separate monolingual word embeddings typically require cross-lingual signals as supervision, either in the form of parallel corpus or seed lexicon.In this work, we show that such cross-lingual connection can actually be established without any form of supervision.We achieve this end by formulating the problem as a natural adversarial game, and investigating techniques that are crucial to successful training.We carry out evaluation on the unsupervised bilingual lexicon induction task.Even though this task appears intrinsically cross-lingual, we are able to demonstrate encouraging performance without any cross-lingual clues.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
(2014) · Cited by 33,419
Distributed Representations of Words and Phrases and their Compositionality
Mikolov, T., Sutskever, I., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1310.4546 · Cited by 24,533
Labaca-Castro, R. (2023) · Machine Learning under Malware Attack · doi:10.1007/978-3-658-40442-0_9 · Cited by 19,272
GAN(Generative Adversarial Nets)
(2017) · Journal of Japan Society for Fuzzy Theory and Intelligent Informatics · doi:10.3156/jsoft.29.5_177_2 · Cited by 19,270
Unsupervised representation learning with deep convolutional generative adversarial networks
Radford, A., Metz, L., & Chintala, S. (2015) · arXiv · doi:10.48550/arxiv.1511.06434 · Cited by 12,235
Domain-Adversarial Training of Neural Networks
Ganin, Y., Ustinova, E., Ajakan, H., Germain, P., Larochelle, H., Laviolette, F., Marchand, M., & Lempitsky, V. (2017) · Advances in Computer Vision and Pattern Recognition · doi:10.1007/978-3-319-58347-1_10 · Cited by 8,318
Improved Techniques for Training GANs
Salimans, T., Goodfellow, I., Zaremba, W., Cheung, V., Radford, A., & Chen, X. (2016) · arXiv · doi:10.48550/arxiv.1606.03498 · Cited by 6,965
Exploiting Similarities among Languages for Machine Translation
Mikolov, T., Le, Q. V., & Sutskever, I. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1309.4168 · Cited by 1,346
Training with Noise is Equivalent to Tikhonov Regularization
Bishop, C. M. (1995) · Neural Computation · doi:10.1162/neco.1995.7.1.108 · Cited by 1,325
f-GAN: Training Generative Neural Samplers using Variational Divergence Minimization
Nowozin, S., Cseke, B., & Tomioka, R. (2016) · arXiv · doi:10.48550/arxiv.1606.00709 · Cited by 1,183 · cited 2×
“Adversarial training involves alternate gradient update of the generator and discriminator, which we implement with a simpler variant algorithm described in (Nowozin et al., 2016).”
BackgroundMethodDual Learning for Machine Translation
Xia, Y., He, D., Qin, T., Wang, L., Yu, N., Liu, T., & Ma, W. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.00179 · Cited by 636
Improving Vector Space Word Representations Using Multilingual Correlation
Faruqui, M., & Dyer, C. (2014) · Proceedings of the 14th Conference of the European Chapter of the Association for Computational Linguistics · doi:10.3115/v1/e14-1049 · Cited by 620 · cited 1×
“…2016), or word level (i.e. seed lexicon) (Gouws and Søgaard, 2015; Wick et al., 2016; Duong et al., 2016; Shi et al., 2015; Mikolov et al., 2013a; Dinu et al., 2015; Lazaridou et al., 2015; Faruqui and Dyer, 2014; Lu et al., 2015; Ammar et al., 2016; Zhang et al., 2016a, 2017; Smith et al., 2017).”
Bilingual Word Embeddings for Phrase-Based Machine Translation
Zou, W. Y., Socher, R., Cer, D., & Manning, C. D. (2013) · Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d13-1141 · Cited by 518
Learning in Implicit Generative ModelsPreprint
Mohamed, S., & Lakshminarayanan, B. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1610.03483 · Cited by 472
Normalized Word Embedding and Orthogonal Transform for Bilingual Word Translation
Xing, C., Wang, D., Liu, C., & Lin, Y. (2015) · Proceedings of the 2015 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.3115/v1/n15-1104 · Cited by 381
Learning principled bilingual mappings of word embeddings while preserving monolingual invariance
Artetxe, M., Labaka, G., & Agirre, E. (2016) · Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d16-1250 · Cited by 369
Bilingual Word Representations with Monolingual Quality in Mind
Luong, T., Pham, H., & Manning, C. D. (2015) · Proceedings of the 1st Workshop on Vector Space Modeling for Natural Language Processing · doi:10.3115/v1/w15-1521 · Cited by 315
Improving zero-shot learning by mitigating the hubness problem
Dinu, G., Lazaridou, A., & Baroni, M. (2015) · Figshare · doi:10.5281/zenodo.2654863 · Cited by 310
An Autoencoder Approach to Learning Bilingual Word Representations
P, S. C. A., Lauly, S., Larochelle, H., Khapra, M. M., Ravindran, B., Raykar, V. C., & Saha, A. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1402.1454 · Cited by 309
Amortised MAP Inference for Image Super-resolution
Sønderby, C. K., Caballero, J., Theis, L., Shi, W., & Huszár, F. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1610.04490 · Cited by 300
Learning Bilingual Lexicons from Monolingual Corpora
Haghighi, A., Liang, P., Berg-Kirkpatrick, T., & Klein, D. (2008) · Cited by 299
Adversarial Deep Averaging Networks for Cross-Lingual Sentiment Classification
Chen, X., Sun, Y., Athiwaratkun, B., Cardie, C., & Weinberger, K. (2018) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00039 · Cited by 293
BilBOWA: Fast Bilingual Distributed Representations without Word Alignments
Gouws, S., Bengio, Y., & Corrado, G. S. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1410.2455 · Cited by 285
Massively Multilingual Word Embeddings
Ammar, W., Mulcaire, G., Tsvetkov, Y., Lample, G., Dyer, C., & Smith, N. A. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1602.01925 · Cited by 263
Dropout Training as Adaptive Regularization
Wager, S., Wang, S., & Liang, P. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1307.1493 · Cited by 245
Offline bilingual word vectors, orthogonal transformations and the inverted softmax
Smith, S. L., Turban, D. H. P., Hamblin, S., & Hammerla, N. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1702.03859 · Cited by 238
Hubness and Pollution: Delving into Cross-Space Mapping for Zero-Shot Learning
Lazaridou, A., Dinu, G., & Baroni, M. (2015) · Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · doi:10.3115/v1/p15-1027 · Cited by 210
Cross-lingual Models of Word Embeddings: An Empirical Comparison
Upadhyay, S., Faruqui, M., Dyer, C., & Roth, D. (2016) · Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p16-1157 · Cited by 177
Multilingual Distributed Representations without Word AlignmentPreprint
Hermann, K. M., & Blunsom, P. (2013) · Oxford University Research Archive (ORA) (University of Oxford) · doi:10.48550/arxiv.1312.6173 · Cited by 156
Efficient orthogonal parametrisation of recurrent neural networks using householder reflections
Mhammedi, Z., Hellicar, A., Rahman, A., & Bailey, J. (2017) · Minerva Access (University of Melbourne) · Cited by 139
On the universal structure of human lexical semantics
Youn, H., Sutton, L. D., Smith, E., Moore, C., Wilkins, J. F., Maddieson, I., Croft, W., & Tanmoy Bhattacharya, A. (2016) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1520752113 · Cited by 137
Deep Multilingual Correlation for Improved Word Embeddings
Lu, A., Wang, W., Bansal, M., Gimpel, K., & Livescu, K. (2015) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.3115/v1/n15-1028 · Cited by 134
Domain Adaptation for Machine Translation by Mining Unseen Words
Daumé, H., & Jagarlamudi, J. (2011) · Cited by 133
(2013) · Cited by 131
Vulić, I., & Moens, M. (2015) · doi:10.3115/v1/p15-2118 · Cited by 123
Barone, A. V. M. (2016) · Workshop on Representation Learning for NLP (RepL4NLP) · doi:10.18653/v1/w16-1614 · Cited by 123
Simple task-specific bilingual word embeddings
Gouws, S., & Søgaard, A. (2015) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.3115/v1/n15-1157 · Cited by 120
Learning Crosslingual Word Embeddings without Bilingual Corpora
Duong, L., Kanayama, H., Ma, T., Bird, S., & Cohn, T. (2016) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d16-1136 · Cited by 113
Ten Pairs to Tag – Multilingual POS Tagging via Coarse Mapping between Embeddings
Zhang, Y., Gaddy, D., Barzilay, R., & Jaakkola, T. (2016) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n16-1156 · Cited by 107
On the Role of Seed Lexicons in Learning Bilingual Word Embeddings
Vulić, I., & Korhonen, A. (2016) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p16-1024 · Cited by 99
Strassel, S. M., & Tracey, J. (2016) · Language Resources and Evaluation Conference (LREC) · doi:10.63317/3xtxb975en3d · Cited by 95
Identifying Word Translations from Comparable Corpora Using Latent Topic Models
Vulić, I., Smet, W. D., & Moens, M. (2011) · Lirias · Cited by 85
Learning Bilingual Word Representations by Marginalizing Alignments
Kočiský, T., Hermann, K. M., & Blunsom, P. (2014) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.3115/v1/p14-2037 · Cited by 81
Combining Bilingual and Comparable Corpora for Low Resource Machine Translation
Irvine, A., & Callison-Burch, C. (2013) · Cited by 63
Learning Cross-lingual Word Embeddings via Matrix Co-factorization
Shi, T., Liu, Z., Liu, Y., & Sun, M. (2015) · doi:10.3115/v1/p15-2093 · Cited by 59
Self-citationLarge Scale Decipherment for Out-of-Domain Machine Translation
Dou, Q., & Knight, K. K. (2012) · Cited by 52
Efficient Orthogonal Parametrisation of Recurrent Neural Networks Using Householder ReflectionsPreprint
Mhammedi, Z., Hellicar, A., Rahman, A., & Bailey, J. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1612.00188 · Cited by 46
Cross-Lingual Semantic Similarity of Words as the Similarity of Their Semantic Word Responses
Vulić, I., & Moens, M. (2013) · Lirias · Cited by 45
A Distribution-based Model to Learn Bilingual Word Embeddings
Cao, H., Zhao, T., Zhang, S., & Meng, Y. (2016) · International Conference on Computational Linguistics · Cited by 31
Minimally-Constrained Multilingual Embeddings via Artificial Code-Switching
Wick, M., Kanani, P. H., & Pocock, A. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v30i1.10360 · Cited by 29
Bilingual Lexicon Induction from Non-Parallel Data with Minimal Supervision
Zhang, M., Peng, H., Liu, Y., Luan, H., & Sun, M. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.10988 · Cited by 28
Self-citationDependency-Based Decipherment for Resource-Limited Machine Translation
Dou, Q., & Knight, K. K. (2013) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d13-1173 · Cited by 20
Unifying Bayesian Inference and Vector Space Models for Improved Decipherment
Dou, Q., Vaswani, A., Knight, K. K., & Dyer, C. (2015) · doi:10.3115/v1/p15-1081 · Cited by 19
Cross-Lingual Word Representations via Spectral Graph Embeddings
Oshikiri, T., Fukui, K., & Shimodaira, H. (2016) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p16-2080 · Cited by 10
Inducing Bilingual Lexica From Non-Parallel Data With Earth Mover’s Distance Regularization
Zhang, M., Liu, Y., Luan, H., Liu, Y., & Sun, M. (2016) · International Conference on Computational Linguistics · Cited by 8
Self-citation
Cited by
Unsupervised Neural Machine Translation
Artetxe, M., Labaka, G., Agirre, E., & Cho, K. (2017) · arXiv · doi:10.48550/arxiv.1710.11041 · Cited by 632
On the Cross-lingual Transferability of Monolingual Representations
Artetxe, M., Ruder, S., & Yogatama, D. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.421 · Cited by 598
A Survey of Cross-lingual Word Embedding Models
Ruder, S., Vulić, I., & Søgaard, A. (2018) · Apollo (University of Cambridge) · doi:10.17863/cam.30462 · Cited by 510
Unsupervised Statistical Machine Translation
Artetxe, M., Labaka, G., & Agirre, E. (2018) · Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d18-1399 · Cited by 315
Adversarial Deep Averaging Networks for Cross-Lingual Sentiment Classification
Chen, X., Sun, Y., Athiwaratkun, B., Cardie, C., & Weinberger, K. (2018) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00039 · Cited by 293
Metadata
- Authors
- Zhang, M., Liu, Y., Luan, H., & Sun, M.
- Venue
- Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
- Published
- 2017
- Pages
- 1959-1970
- OpenAlex
- W2740132093
- Cited by
- 256
- References
- 56
- FWCI
- 20.58
- Type
- conference paper
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.