The DOI matches its Crossref record; 47 of the 50 references it cites were found in a registry or an index.
Bilingual Word Representations with Monolingual Quality in Mind
Open accessAbstract
Recent work in learning bilingual representations tend to tailor towards achieving good performance on bilingual tasks, most often the crosslingual document classification (CLDC) evaluation, but to the detriment of preserving clustering structures of word representations monolingually.In this work, we propose a joint model to learn word representations from scratch that utilizes both the context coocurrence information through the monolingual component and the meaning equivalent signals from the bilingual constraint.Specifically, we extend the recently popular skipgram model to learn high quality bilingual representations efficiently.Our learned embeddings achieve a new state-of-the-art accuracy of 80.3 for the German to English CLDC task and a highly competitive performance of 90.7 for the other classification direction.At the same time, our models outperform best embeddings from past bilingual representation work by a large margin in the monolingual word similarity evaluation. 1
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“Besides, Hewitt and Manning [125], Jawahar et al. [126], Kim et al. [127] proposed several methods to extract dependency trees and constituency trees from BERT, which proved the BERT's ability to encode syntax structure.”
From Pre-trained models for natural language processing: A survey (2020) · cites this paper as [126]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Glove: Global Vectors for Word Representation
Pennington, J., Socher, R., & Manning, C. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1162 · Cited by 34,071
Self-citation(2003) · Journal of Machine Learning Research · doi:10.5555/944919.944937 · Cited by 32,337
Efficient Estimation of Word Representations in Vector Space
Mikolov, T., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1301.3781 · Cited by 26,568
Distributed Representations of Words and Phrases and their Compositionality
Mikolov, T., Sutskever, I., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1310.4546 · Cited by 24,533
Blei, D. M., Ng, A. Y., & Jordan, M. I. (2002) · Advances in Neural Information Processing Systems 14 · doi:10.7551/mitpress/1120.003.0082 · Cited by 12,223
Learning Word Vectors for Sentiment Analysis
Maas, A. L., Daly, R. E., Pham, P. T., Huang, D., Ng, A. Y., & Potts, C. (2011) · Cited by 6,961
Recursive Deep Models for Semantic Compositionality Over a Sentiment Treebank
Socher, R., Perelygin, A., Wu, J., Chuang, J., Manning, C. D., Ng, A., & Potts, C. (2013) · Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d13-1170 · Cited by 6,878
Self-citationRecurrent neural network based language model
Mikolov, T., Karafiát, M., Burget, L., Černocký, J., & Khudanpur, S. (2010) · Interspeech 2010 · doi:10.21437/interspeech.2010-343 · Cited by 5,390
A unified architecture for natural language processing: deep neural networks with multitask learning
Collobert, R., & Weston, J. (2008) · Proceedings of the 25th international conference on Machine learning - ICML '08 · doi:10.1145/1390156.1390177 · Cited by 5,058
Natural Language Processing (almost) from Scratch
Collobert, R., Weston, J., Bottou, L., Karlen, M., Kavukcuoglu, K., & Kuksa, P. P. (2011) · arXiv (Cornell University) · doi:10.48550/arxiv.1103.0398 · Cited by 4,962
Research works printed but not linked: 5
- S. T. Dumais, G. W. Furnas, T. K. Landauer, S. Deer- wester, and R. Harshman. 1988. Using latent se- mantic analysis to improve access to textual infor- mation. In CHI.
- Stephan Gouws, Yoshua Bengio, and Greg Corrado. 2014. Bilbowa: Fast bilingual distributed repre- sentations without word alignments. In NIPS Deep Learning Workshop.
- Michael Gutmann and Aapo Hyvärinen. 2012. Noise- contrastive estimation of unnormalized statistical models, with applications to natural image statistics. JMLR, 13:307-361.
- Karl Moritz Hermann and Phil Blunsom. 2014. Multi- lingual Models for Compositional Distributional Se- mantics. In ACL.
- Tomas Mikolov, Ilya Sutskever, Kai Chen, Greg Cor- rado, and Jeffrey Dean. 2013c. Distributed repre- sentations of words and phrases and their composi- tionality. In NIPS.
Cited by
Pre-trained models for natural language processing: A survey
Qiu, X., Sun, T., Xu, Y., Shao, Y., Dai, N., & Huang, X. (2020) · Science China Technological Sciences · doi:10.1007/s11431-020-1647-3 · Cited by 1,591
“tions shared across languages plays an important role in many cross-lingual NLP tasks. Cross-Lingual Language Understanding (XLU) Most of the early works focus on learning multilingual word embedding [45, 123, 158], which represents text from multiple languages in a single semantic space. However, these methods usuall…”
BackgroundMassively Multilingual Sentence Embeddings for Zero-Shot Cross-Lingual Transfer and Beyond
Artetxe, M., & Schwenk, H. (2019) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00288 · Cited by 791
A Survey of Cross-lingual Word Embedding Models
Ruder, S., Vulić, I., & Søgaard, A. (2018) · Apollo (University of Cambridge) · doi:10.17863/cam.30462 · Cited by 510
Learning bilingual word embeddings with (almost) no bilingual data
Artetxe, M., Labaka, G., & Agirre, E. (2017) · Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p17-1042 · Cited by 455
Learning principled bilingual mappings of word embeddings while preserving monolingual invariance
Artetxe, M., Labaka, G., & Agirre, E. (2016) · Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d16-1250 · Cited by 369
Metadata
- Authors
- Luong, T., Pham, H., & Manning, C. D.
- Affiliations
- Stanford University (US)
- Corresponding author
- Manning, Christopher D.
- Venue
- Proceedings of the 1st Workshop on Vector Space Modeling for Natural Language Processing
- Published
- 2015
- Pages
- 151-159
- OpenAlex
- W2251765408
- Cited by
- 315
- References
- 50
- Citations by year
- 2026: 2 · 2025: 4 · 2024: 8 · 2023: 14 · 2022: 18 · 2021: 31 · 2020: 57 · 2019: 57 · 2018: 55 · 2017: 36 · 2016: 31 · 2015: 2
- FWCI
- 23.29
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- Locations
- Workshop on Vector Space Modeling for Natural Language Processing (VSM-NLP) (publishedVersion, cc-by)
- Funders
- Bloomberg L.P.
- Defense Advanced Research Projects Agency (HR0011-12-C-0015)
- Advanced Research Projects Agency
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Keywords
- word embeddings, skip-gram model, word co-occurrence, German-English translation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Bilingual Word Representations with Monolingual Quality in Mind. https://app.cochat.ai/papers/10.3115/v1/w15-1521
- The paper
- Luong, T., Pham, H., & Manning, C. D. (2015). Bilingual Word Representations with Monolingual Quality in Mind. Proceedings of the 1st Workshop on Vector Space Modeling for Natural Language Processing. https://doi.org/10.3115/v1/w15-1521
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.