Bilingual Word Representations with Monolingual Quality in Mind
Open accessThe DOI matches its Crossref record; 47 of the 50 references it cites were found in a registry or an index.
Abstract
Recent work in learning bilingual representations tend to tailor towards achieving good performance on bilingual tasks, most often the crosslingual document classification (CLDC) evaluation, but to the detriment of preserving clustering structures of word representations monolingually.In this work, we propose a joint model to learn word representations from scratch that utilizes both the context coocurrence information through the monolingual component and the meaning equivalent signals from the bilingual constraint.Specifically, we extend the recently popular skipgram model to learn high quality bilingual representations efficiently.Our learned embeddings achieve a new state-of-the-art accuracy of 80.3 for the German to English CLDC task and a highly competitive performance of 90.7 for the other classification direction.At the same time, our models outperform best embeddings from past bilingual representation work by a large margin in the monolingual word similarity evaluation. 1
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“Besides, Hewitt and Manning [125], Jawahar et al. [126], Kim et al. [127] proposed several methods to extract dependency trees and constituency trees from BERT, which proved the BERT's ability to encode syntax structure.”
From Pre-trained models for natural language processing: A survey (2020) · cites this paper as [126]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Glove: Global Vectors for Word Representation
Pennington, J., Socher, R., & Manning, C. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1162 · Cited by 34,071
Self-citation(2003) · Journal of Machine Learning Research · doi:10.5555/944919.944937 · Cited by 32,337
Efficient Estimation of Word Representations in Vector Space
Mikolov, T., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1301.3781 · Cited by 26,568
Distributed Representations of Words and Phrases and their Compositionality
Mikolov, T., Sutskever, I., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1310.4546 · Cited by 24,533
Blei, D. M., Ng, A. Y., & Jordan, M. I. (2002) · Advances in Neural Information Processing Systems 14 · doi:10.7551/mitpress/1120.003.0082 · Cited by 12,223
Learning Word Vectors for Sentiment Analysis
Maas, A. L., Daly, R. E., Pham, P. T., Huang, D., Ng, A. Y., & Potts, C. (2011) · Cited by 6,960
Recursive Deep Models for Semantic Compositionality Over a Sentiment Treebank
Socher, R., Perelygin, A., Wu, J., Chuang, J., Manning, C. D., Ng, A., & Potts, C. (2013) · Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d13-1170 · Cited by 6,878
Self-citationRecurrent neural network based language model
Mikolov, T., Karafiát, M., Burget, L., Černocký, J., & Khudanpur, S. (2010) · Interspeech 2010 · doi:10.21437/interspeech.2010-343 · Cited by 5,390
A unified architecture for natural language processing: deep neural networks with multitask learning
Collobert, R., & Weston, J. (2008) · Proceedings of the 25th international conference on Machine learning - ICML '08 · doi:10.1145/1390156.1390177 · Cited by 5,058 · cited 1×
“Work in the later trend includes (Collobert and Weston, 2008; Huang et al., 2012; Luong et al., 2013).”
Natural Language Processing (almost) from Scratch
Collobert, R., Weston, J., Bottou, L., Karlen, M., Kavukcuoglu, K., & Kuksa, P. P. (2011) · arXiv (Cornell University) · doi:10.48550/arxiv.1103.0398 · Cited by 4,962
Research works printed but not linked: 5
- S. T. Dumais, G. W. Furnas, T. K. Landauer, S. Deer- wester, and R. Harshman. 1988. Using latent se- mantic analysis to improve access to textual infor- mation. In CHI.
- Stephan Gouws, Yoshua Bengio, and Greg Corrado. 2014. Bilbowa: Fast bilingual distributed repre- sentations without word alignments. In NIPS Deep Learning Workshop.
- Michael Gutmann and Aapo Hyvärinen. 2012. Noise- contrastive estimation of unnormalized statistical models, with applications to natural image statistics. JMLR, 13:307-361.
- Karl Moritz Hermann and Phil Blunsom. 2014. Multi- lingual Models for Compositional Distributional Se- mantics. In ACL.
- Tomas Mikolov, Ilya Sutskever, Kai Chen, Greg Cor- rado, and Jeffrey Dean. 2013c. Distributed repre- sentations of words and phrases and their composi- tionality. In NIPS.
Cited by
Pre-trained models for natural language processing: A survey
Qiu, X., Sun, T., Xu, Y., Shao, Y., Dai, N., & Huang, X. (2020) · Science China Technological Sciences · doi:10.1007/s11431-020-1647-3 · Cited by 1,591
“tions shared across languages plays an important role in many cross-lingual NLP tasks. Cross-Lingual Language Understanding (XLU) Most of the early works focus on learning multilingual word embedding [45, 123, 158], which represents text from multiple languages in a single semantic space. However, these methods usuall…”
BackgroundMassively Multilingual Sentence Embeddings for Zero-Shot Cross-Lingual Transfer and Beyond
Artetxe, M., & Schwenk, H. (2019) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00288 · Cited by 791
A Survey of Cross-lingual Word Embedding Models
Ruder, S., Vulić, I., & Søgaard, A. (2018) · Apollo (University of Cambridge) · doi:10.17863/cam.30462 · Cited by 510
Learning bilingual word embeddings with (almost) no bilingual data
Artetxe, M., Labaka, G., & Agirre, E. (2017) · Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p17-1042 · Cited by 455
Learning principled bilingual mappings of word embeddings while preserving monolingual invariance
Artetxe, M., Labaka, G., & Agirre, E. (2016) · Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d16-1250 · Cited by 369
XTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual Generalization
Hu, J., Ruder, S., Siddhant, A., Neubig, G., Fırat, O., & Johnson, M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.11080 · Cited by 278
A Survey of Cross-lingual Word Embedding Models
Ruder, S., Vulić, I., & Søgaard, A. (2019) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.11640 · Cited by 266
Massively Multilingual Word Embeddings
Ammar, W., Mulcaire, G., Tsvetkov, Y., Lample, G., Dyer, C., & Smith, N. A. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1602.01925 · Cited by 263
Adversarial Training for Unsupervised Bilingual Lexicon Induction
Zhang, M., Liu, Y., Luan, H., & Sun, M. (2017) · Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p17-1179 · Cited by 256
Artetxe, M., Labaka, G., & Agirre, E. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11992 · Cited by 220
Learning Joint Multilingual Sentence Representations with Neural Machine Translation
Schwenk, H., & Douze, M. (2017) · Proceedings of the 2nd Workshop on Representation Learning for NLP · doi:10.18653/v1/w17-2619 · Cited by 197
Cross-lingual Models of Word Embeddings: An Empirical Comparison
Upadhyay, S., Faruqui, M., Dyer, C., & Roth, D. (2016) · Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p16-1157 · Cited by 177
Glavaš, G., Litschko, R., Ruder, S., & Vulić, I. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1070 · Cited by 180
Mrkšić, N., Vulić, I., Séaghdha, D. Ó., Leviant, I., Reichart, R., Gašić, M., Korhonen, A., & Young, S. (2017) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00063 · Cited by 170
“the basis of parallel word-aligned data (Luong et al., 2015; Coulmance et al., 2015) or sentence-aligned data (Hermann and Blunsom, 2014a; Hermann and Blunsom, 2014b; Chandar et al.”
Ponti, E. M., O’Horan, H., Berzak, Y., Vulić, I., Reichart, R., Poibeau, T., Shutova, E., & Korhonen, A. (2019) · Computational Linguistics · doi:10.1162/coli_a_00357 · Cited by 135
Earth Mover's Distance Minimization for Unsupervised Bilingual Lexicon Induction
Zhang, M., Liu, Y., Luan, H., & Sun, M. (2017) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d17-1207 · Cited by 170
GLUECoS: An Evaluation Benchmark for Code-Switched NLP
Khanuja, S., Dandapat, S., Srinivasan, A., Sitaram, S., & Choudhury, M. (2020) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2020.acl-main.329 · Cited by 257
Vulić, I., & Moens, M. (2015) · doi:10.3115/v1/p15-2118 · Cited by 123
Cross-Lingual Sentiment Classification with Bilingual Document Representation Learning
Zhou, X., Wan, X., & Xiao, J. (2016) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p16-1133 · Cited by 128
Learning Crosslingual Word Embeddings without Bilingual Corpora
Duong, L., Kanayama, H., Ma, T., Bird, S., & Cohn, T. (2016) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d16-1136 · Cited by 113
Bilingual Distributed Word Representations from Document-Aligned Comparable Data
Vulić, I., & Moens, M. (2016) · Journal of Artificial Intelligence Research · doi:10.1613/jair.4986 · Cited by 132
Cross-lingual Wikification Using Multilingual Embeddings
Tsai, C.-T., & Roth, D. (2016) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n16-1072 · Cited by 110
Ten Pairs to Tag – Multilingual POS Tagging via Coarse Mapping between Embeddings
Zhang, Y., Gaddy, D., Barzilay, R., & Jaakkola, T. (2016) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n16-1156 · Cited by 107
Bilingual Lexicon Induction with Semi-supervision in Non-Isometric Embedding Spaces
Patra, B., Moniz, J. R. A., Garg, S., Gormley, M. R., & Neubig, G. (2019) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p19-1018 · Cited by 130
Multilingual Relation Extraction using Compositional Universal Schema
Verga, P. W., Belanger, D., Strubell, E., Roth, B., & McCallum, A. (2016) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n16-1103 · Cited by 112
On the Role of Seed Lexicons in Learning Bilingual Word Embeddings
Vulić, I., & Korhonen, A. (2016) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p16-1024 · Cited by 99
Deep Learning in Sentiment Analysis: Recent Architectures
Abdullah, T., & Ahmet, A. (2022) · ACM Computing Surveys · doi:10.1145/3548772 · Cited by 134
XQA: A Cross-lingual Open-domain Question Answering Dataset
Liu, J., Lin, Y., Liu, Z., & Sun, M. (2019) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p19-1227 · Cited by 146
A Representation Learning Framework for Multi-Source Transfer Parsing
Guo, J., Che, W., Yarowsky, D., Wang, H., & Liu, T. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v30i1.10352 · Cited by 93
Mogadala, A., & Rettinger, A. (2016) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n16-1083 · Cited by 80
From static to dynamic word representations: a survey
Wang, Y., Hou, Y., Che, W., & Liu, T. (2020) · International Journal of Machine Learning and Cybernetics · doi:10.1007/s13042-020-01069-8 · Cited by 103
Concatenated Power Mean Word Embeddings as Universal Cross-Lingual Sentence Representations
Rücklé, A., Eger, S., Peyrard, M., & Gurevych, I. (2018) · TUbilio (Technical University of Darmstadt) · doi:10.48550/arxiv.1803.01400 · Cited by 76
BERT is Not an Interlingua and the Bias of Tokenization
Singh, J., McCann, B., Socher, R., & Xiong, C. (2019) · Workshop on Deep Learning Approaches for Low-Resource NLP (DeepLo) · doi:10.18653/v1/d19-6106 · Cited by 108
Kumar, A., & de Albuquerque, V. H. C. (2021) · ACM Transactions on Asian and Low-Resource Language Information Processing · doi:10.1145/3461764 · Cited by 102
Zero-Shot Cross-lingual Classification Using Multilingual Neural Machine TranslationPreprint
Eriguchi, A., Johnson, M., Fırat, O., Kazawa, H., & Macherey, W. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1809.04686 · Cited by 92
A Strong Baseline for Learning Cross-Lingual Word Embeddings from Sentence Alignments
Levy, O., Søgaard, A., & Goldberg, Y. (2017) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/e17-1072 · Cited by 69
Cross-lingual learning for text processing: A survey
Pikuliak, M., Šimko, M., & Bieliková, M. (2020) · Expert Systems with Applications · doi:10.1016/j.eswa.2020.113765 · Cited by 87
Analyzing the Limitations of Cross-lingual Word Embedding Mappings
Ormazabal, A., Artetxe, M., Labaka, G., Soroa, A., & Agirre, E. (2019) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p19-1492 · Cited by 80
XLDA: Cross-Lingual Data Augmentation for Natural Language Inference and Question AnsweringPreprint
Singh, J., McCann, B., Keskar, N. S., Xiong, C., & Socher, R. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.11471 · Cited by 93
Improving Cross-Lingual Word Embeddings by Meeting in the Middle
Doval, Y., Camacho-Collados, J., Espinosa-Anke, L., & Schockaert, S. (2018) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d18-1027 · Cited by 64
Redmond, K., Luo, L., & Zeng, Q. (2019) · Workshop on Binary Analysis Research (BAR) · doi:10.14722/bar.2019.23057 · Cited by 76
Word Embeddings for Code-Mixed Language Processing
Pratapa, A., Choudhury, M., & Sitaram, S. (2018) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d18-1344 · Cited by 55
Improving Sequence-to-Sequence Learning via Optimal TransportPreprint
Chen, L., Zhang, Y., Zhang, R., Tao, C., Gan, Z., Zhang, H., Li, B., Shen, D., Chen, C., & Carin, L. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1901.06283 · Cited by 99
Barnes, J., Lambert, P., & Badía, T. (2016) · International Conference on Computational Linguistics · Cited by 72
A Call for More Rigor in Unsupervised Cross-lingual Learning
Artetxe, M., Ruder, S., Yogatama, D., Labaka, G., & Agirre, E. (2020) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2020.acl-main.658 · Cited by 85
Deep Persian sentiment analysis: Cross-lingual training for low-resource languages
Ghasemi, R., Asli, S. A. A., & Momtazi, S. (2020) · Journal of Information Science · doi:10.1177/0165551520962781 · Cited by 55
Are Multilingual Models Effective in Code-Switching?
Winata, G. I., Cahyawijaya, S., Liu, Z., Lin, Z., Madotto, A., & Fung, P. (2021) · Workshop on Computational Approaches to Code Switching · doi:10.18653/v1/2021.calcs-1.20 · Cited by 105
Using Word Embedding for Cross-Language Plagiarism Detection
Ferrero, J., Besacier, L., Schwab, D., & Agnès, F. (2017) · Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics: Volume 2, Short Papers · doi:10.18653/v1/e17-2066 · Cited by 46
The Routledge Handbook of Translation and Methodology
Zanettin, F., & Rundle, C. (2022) · Routledge eBooks · doi:10.4324/9781315158945 · Cited by 72
Tareq, M., Islam, M. F., Deb, S., Rahman, S., & Mahmud, A. A. (2023) · IEEE Access · doi:10.1109/access.2023.3277787 · Cited by 64
Cross-Language Question Re-Ranking
Martino, G. D. S., Romeo, S. O., Barroón-Cedeño, A., Joty, S., Màrquez, L., Moschitti, A., & Nakov, P. (2017) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3077136.3080743 · Cited by 45
Cross-language Learning with Adversarial Neural Networks
Joty, S., Nakov, P., Màrquez, L., & Jaradat, I. (2017) · Conference on Computational Natural Language Learning · doi:10.18653/v1/k17-1024 · Cited by 43
Multilingual Training of Crosslingual Word Embeddings
Duong, L., Kanayama, H., Ma, T., Bird, S., & Cohn, T. (2017) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/e17-1084 · Cited by 42
Joint Representation Learning of Cross-lingual Words and Entities via Attentive Distant Supervision
Cao, Y., Hou, L., Li, J., Liu, Z., Li, C., Chen, X., & Dong, T. (2018) · Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d18-1021 · Cited by 41
A Systematic Review of Cross-Lingual Sentiment Analysis: Tasks, Strategies, and Prospects
Zhao, C., Wu, M., Yang, X., Zhang, W., Zhang, S., Wang, S., & Li, D. (2024) · ACM Computing Surveys · doi:10.1145/3645106 · Cited by 46
Akhtar, M. S., Sawant, P., Sen, S., Ekbal, A., & Bhattacharyya, P. (2018) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n18-1053 · Cited by 40
Non-Linear Instance-Based Cross-Lingual Mapping for Non-Isomorphic Embedding Spaces
Glavaš, G., & Vulić, I. (2020) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2020.acl-main.675 · Cited by 55
Cross-lingual Alignment vs Joint Training: A Comparative Study and A Simple Unified FrameworkPreprint
Wang, Z.-R., Xie, J., Xu, R., Yang, Y., Neubig, G., & Carbonell, J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.04708 · Cited by 67
Morph-fitting: Fine-Tuning Word Vector Spaces with Simple Language-Specific Rules
Vulić, I., Mrkšić, N., Reichart, R., Séaghdha, D. Ó., Young, S. J., & Korhonen, A. (2017) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p17-1006 · Cited by 46
MultiVec: a Multilingual and Multilevel Representation Learning Toolkit for NLP
Bérard, A., Servan, C., Pietquin, O., & Besacier, L. (2016) · Language Resources and Evaluation Conference (LREC) · doi:10.63317/52gcepr8aezz · Cited by 38
Cross-Lingual Propagation for Deep Sentiment Analysis
Dong, X., & de Melo, G. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.12071 · Cited by 39
Natural Language Processing Methods for Language Modeling
Nemeskey, D. M. (2021) · Eötvös Loránd Tudományegyetem · doi:10.15476/elte.2020.066 · Cited by 85
Identifying Semantic Divergences in Parallel Text without Annotations
Vyas, Y., Niu, X., & Carpuat, M. J. (2018) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n18-1136 · Cited by 45
Mohiuddin, T., & Joty, S. (2019) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n19-1386 · Cited by 42
Lo, C.-K., Simard, M., Stewart, D. A., Larkin, S., Goutte, C., & Littell, P. (2018) · Conference on Machine Translation (WMT) · doi:10.18653/v1/w18-6481 · Cited by 35
Towards End-to-End Multilingual Question Answering
Loginova, E., Varanasi, S., & Neumann, G. (2020) · Information Systems Frontiers · doi:10.1007/s10796-020-09996-1 · Cited by 44
Building Earth Mover's Distance on Bilingual Word Embeddings for Machine Translation
Zhang, M., Liu, Y., Luan, H., Sun, M., Izuha, T., & Hao, J. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v30i1.10351 · Cited by 31
A Distribution-based Model to Learn Bilingual Word Embeddings
Cao, H., Zhao, T., Zhang, S., & Meng, Y. (2016) · International Conference on Computational Linguistics · Cited by 31
Grégoire, F., & Langlais, P. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1806.05559 · Cited by 30
Learning Bilingual Word Embeddings Using Lexical Definitions
Shi, W., Chen, M., Tian, Y., & Chang, K.-W. (2019) · Workshop on Representation Learning for NLP (RepL4NLP) · doi:10.18653/v1/w19-4316 · Cited by 30
Qiu, Q., Tian, M., Tao, L., Xie, Z., & Ma, K. (2024) · Ore Geology Reviews · doi:10.1016/j.oregeorev.2023.105863 · Cited by 30
A neural generative autoencoder for bilingual word embeddings
Su, J., Wu, S., Zhang, B., Wu, C., Qin, Y., & Xiong, D. (2017) · Information Sciences · doi:10.1016/j.ins.2017.09.070 · Cited by 30
Gastaldi, J. L. (2020) · Philosophy & Technology · doi:10.1007/s13347-020-00393-9 · Cited by 64
Joanis, E., Knowles, R., Kühn, R., Larkin, S., Littell, P., Lo, C.-K., Stewart, D. A., & Micher, J. C. (2020) · Language Resources and Evaluation · Cited by 57
Cross-lingual Argumentation Mining: Machine Translation (and a bit of Projection) is All You Need!
Eger, S., Daxenberger, J., Stab, C., & Gurevych, I. (2018) · TUbilio (Technical University of Darmstadt) · doi:10.48550/arxiv.1807.08998 · Cited by 74
Does aggression lead to hate? Detecting and reasoning offensive traits in hinglish code-mixed texts
Sengupta, A., Bhattacharjee, S. K., Akhtar, M. S., & Chakraborty, T. (2021) · Neurocomputing · doi:10.1016/j.neucom.2021.11.053 · Cited by 28
Bilingual Lexicon Induction from Non-Parallel Data with Minimal Supervision
Zhang, M., Peng, H., Liu, Y., Luan, H., & Sun, M. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.10988 · Cited by 28
Cross-language text alignment: A proposed two-level matching scheme for plagiarism detection
Roostaee, M., Fakhrahmad, S. M., & Sadreddini, M. H. (2020) · Expert Systems with Applications · doi:10.1016/j.eswa.2020.113718 · Cited by 35
Jointly Learning to Embed and Predict with Multiple Languages
Ferreira, D. C., Martins, A. F. T., & Almeida, M. S. C. (2016) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p16-1190 · Cited by 28
Variable Mini-Batch Sizing and Pre-Trained Embeddings
Abdou, M., Gloncak, V., & Bojar, O. (2017) · Conference on Machine Translation (WMT) · doi:10.18653/v1/w17-4780 · Cited by 27
Cross-Lingual Cross-Modal Retrieval with Noise-Robust Learning
Wang, Y., Dong, J., Liang, T., Zhang, M., Cai, R., & Wang, X. (2022) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3503161.3548003 · Cited by 42
Multilingual Epidemiological Text Classification: A Comparative Study
Mutuvi, S., Boroş, E., Doucet, A., Jatowt, A., Lejeune, G., & Odeo, M. (2020) · International Conference on Computational Linguistics · doi:10.18653/v1/2020.coling-main.543 · Cited by 31
An Exploration of Word Embedding Initialization in Deep-Learning TasksPreprint
Kocmi, T., & Bojar, O. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.09160 · Cited by 37
En-Ar Bilingual Word Embeddings without Word Alignment: Factors Effects
Alqaisi, T., & O’Keefe, S. (2019) · Arabic Natural Language Processing Workshop (WANLP) · doi:10.18653/v1/w19-4611 · Cited by 24
Learning Unsupervised Multilingual Word Embeddings with Incremental Multilingual Hubs
Heyman, G., Verreet, B., Vulić, I., & Moens, M. (2019) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n19-1188 · Cited by 32
Robust Cross-Lingual Hypernymy Detection Using Dependency Context
Upadhyay, S., Vyas, Y., Carpuat, M. J., & Roth, D. (2018) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n18-1056 · Cited by 24
Cross-lingual Lexical Sememe Prediction
Qi, F., Lin, Y., Sun, M., Zhu, H., Xie, R., & Liu, Z. (2018) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d18-1033 · Cited by 24
Proceedings of the 4th Workshop on Representation Learning for NLP (RepL4NLP-2019)
Augenstein, I., Gella, S., Ruder, S., Kann, K., Can, B., Conneau, A., Welbl, J., Ren, X., & Rei, M. (2019) · doi:10.18653/v1/w19-43 · Cited by 27
Modeling Code-Switch Languages Using Bilingual Parallel Corpus
Lee, G., & Li, H. (2020) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2020.acl-main.80 · Cited by 37
Addressing Noise in Multidialectal Word Embeddings
Erdmann, A., Zalmout, N., & Habash, N. Y. (2018) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p18-2089 · Cited by 23
Zennaki, O., Semmar, N., & Besacier, L. (2018) · Natural Language Engineering · doi:10.1017/s1351324918000293 · Cited by 23
A Multi-task Approach to Learning Multilingual Representations
Singla, K., Can, D., & Narayanan, S. (2018) · Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers) · doi:10.18653/v1/p18-2035 · Cited by 22
“2014), BiSkip-UnsupAlign (Luong et al., 2015) and para doc (Pham et al.”
BackgroundMethodInfluentialSemantic Drift in Multilingual Representations
Beinborn, L., & Choenni, R. (2020) · Computational Linguistics · doi:10.1162/coli_a_00382 · Cited by 48
Bubenhofer, N. (2020) · De Gruyter eBooks · doi:10.1515/9783110698732 · Cited by 38
Beyond Bilingual: Multi-sense Word Embeddings using Multilingual Context
Upadhyay, S., Chang, K.-W., Taddy, M. A., Kalai, A. T., & Zou, J. (2017) · Workshop on Representation Learning for NLP (RepL4NLP) · doi:10.18653/v1/w17-2613 · Cited by 21
AI-based personality prediction for human well-being from text data: a systematic review
Singh, S., & Singh, W. (2023) · Multimedia Tools and Applications · doi:10.1007/s11042-023-17282-w · Cited by 29
Towards a Universal Sentiment Classifier in Multiple languages
Xu, K., & Wan, X. (2017) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d17-1053 · Cited by 21
Integrating Social Media into a Pan-European Flood Awareness System: A Multilingual ApproachPreprint
Lorini, V., Castillo, C., Dottori, F., Kalaš, M., Nappo, D., & Salamon, P. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1904.10876 · Cited by 22
Unsupervised Neural Machine Translation
Artetxe, M., Labaka, G., Agirre, E., & Cho, K. (2017) · arXiv · doi:10.48550/arxiv.1710.11041 · Cited by 632
Metadata
- Authors
- Luong, T., Pham, H., & Manning, C. D.
- Affiliations
- Stanford University (US)
- Corresponding author
- Manning, Christopher D.
- Venue
- Proceedings of the 1st Workshop on Vector Space Modeling for Natural Language Processing
- Published
- 2015
- Pages
- 151-159
- OpenAlex
- W2251765408
- Cited by
- 315
- References
- 50
- Citations by year
- 2026: 2 · 2025: 4 · 2024: 8 · 2023: 14 · 2022: 18 · 2021: 31 · 2020: 57 · 2019: 57 · 2018: 55 · 2017: 36 · 2016: 31 · 2015: 2
- FWCI
- 23.29
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- Locations
- Workshop on Vector Space Modeling for Natural Language Processing (VSM-NLP) (publishedVersion, cc-by)
- Funders
- Bloomberg L.P.
- Defense Advanced Research Projects Agency (HR0011-12-C-0015)
- Advanced Research Projects Agency
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Keywords
- word embeddings, skip-gram model, word co-occurrence, German-English translation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
![Figure 1 Bilingual Skipgram Model - besides predicting within languages, the model also predicts cross-lingually based on the alignment information. Glosses for German text are: modern economy trading [finance center] .](https://figures.cochat.ai/paper-figures/e4e7d2e6046c4671873409db20e07f7d/bilingual-word-representations-with-monolingual-quality-in-mind-figure-1.png)
