Improving Vector Space Word Representations Using Multilingual Correlation
Open accessThe DOI matches its Crossref record; 43 of the 43 references it cites were found in a registry or an index.
Abstract
The distributional hypothesis of Harris (1954), according to which the meaning of words is evidenced by the contexts they occur in, has motivated several effective techniques for obtaining vector space semantic representations of words using unannotated text corpora. This paper argues that lexico-semantic content should additionally be invariant across languages and proposes a simple technique based on canonical correlation analysis (CCA) for incorporating multilingual evidence into vectors generated monolingually. We evaluate the resulting word representations on standard lexical semantic evaluation tasks and show that our method produces substantially better semantic representations than monolingual techniques.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Besides, Hewitt and Manning [125], Jawahar et al. [126], Kim et al. [127] proposed several methods to extract dependency trees and constituency trees from BERT, which proved the BERT's ability to encode syntax structure.”
From Pre-trained models for natural language processing: A survey (2020) · cites this paper as [125]
Citations
Cites
(2008) · Journal of Machine Learning Research · Cited by 33,051
Efficient Estimation of Word Representations in Vector Space
Mikolov, T., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1301.3781 · Cited by 26,568 · cited 6×
“This dataset contains word pairs that are different syntactic forms of a given word and was prepared by Mikolov et al. (2013a).”
BackgroundMethodInfluentialIndexing by latent semantic analysis
Deerwester, S., Dumais, S. T., Furnas, G. W., Landauer, T. K., & Harshman, R. (1990) · Journal of the American Society for Information Science · doi:10.1002/(sici)1097-4571(199009)41:6<391::aid-asi1>3.0.co;2-9 · Cited by 12,751
Golub, G. H., & Loan, C. F. V. (1996) · Johns Hopkins University Press eBooks · Cited by 6,027
A unified architecture for natural language processing: deep neural networks with multitask learning
Collobert, R., & Weston, J. (2008) · Proceedings of the 25th international conference on Machine learning - ICML '08 · doi:10.1145/1390156.1390177 · Cited by 5,058 · cited 6×
“Our method can also be seen as an application of multi-view learning (Chang et al., 2013; Collobert and Weston, 2008), where one of the views can be used to capture cross-lingual information.”
BackgroundMethodInfluentialHarris, Z. S. (1954) · WORD · doi:10.1080/00437956.1954.11659520 · Cited by 4,807
Approximate Statistical Tests for Comparing Supervised Classification Learning Algorithms
Dietterich, T. G. (1998) · Neural Computation · doi:10.1162/089976698300017197 · Cited by 3,840 · cited 2×
“01) according to the McNemar’s test (Dietterich, 1998).”
MethodInfluentialWord association norms, mutual information, and lexicography
Church, K., & Hanks, P. (1990) · doi:10.5555/89086.89095 · Cited by 3,590
Linguistic Regularities in Continuous Space Word Representations
Mikolov, T., Yih, W.-T., & Zweig, G. (2013) · North American Chapter of the Association for Computational Linguistics · Cited by 2,912
From Frequency to Meaning: Vector Space Models of Semantics
Turney, P. D., & Pantel, P. (2010) · Journal of Artificial Intelligence Research · doi:10.1613/jair.2934 · Cited by 2,866 · cited 1×
“Using cooccurrence statistics from a large corpus of text (Deerwester et al., 1990; Turney and Pantel, 2010), 1 it is possible to construct high-quality semantic vectors — as judged by both correlations with human judgements of semantic relatedness (Turney, 2006; Agirre et al., 2009) and as…”
Background
Cited by
Items 601–617 of 617
Efficient Feature Selection for Word Embedding Dimension Reduction
Xue, J., Wang, Y.-C., Wei, C., & Kuo, C.-C. J. (2024) · Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC) · doi:10.1109/apsipaasc63619.2025.10848837
“We use the widely-used word similarity datasets [15] to evaluate our method.”
Tsai, C.-T., Upadhyay, S., & Roth, D. (2024) · Synthesis lectures on human language technologies · doi:10.1007/978-3-031-74901-8_4
Generating Tibetan Named Entity Data Using Cross-lingual Word Embedding
Ma, W., Zhao, K., & Zhao, D. (2025) · International Conference on Artificial Intelligence and Computer Engineering (ICAICE) · doi:10.1109/icaice68195.2025.11382448
“[10] introduced an innovative CCA approach, applying Canonical Correlation Analysis (CCA) to map two or more languages into a shared semantic space.”
Agrawal, R., & Lnu, S. R. (2025) · International Conference on Electronics and Computing, Communication Networking Automation Technologies (ICEC2NT) · doi:10.1109/icec2nt65402.2025.11380043
“Approaches such as BiCCA [16] and LASER [17] learned multilingual sentence embeddings using aligned data, while models like XLM [18] utilized shared subword vocabularies and parallel corpora to improve transfer.”
QAACoder: A Question Answering Approach to Actor Detection in the Conflict and Mediation Domain
Hosseini, M., Munia, M. S., Khan, L. R., Brandt, P. T., Osorio, J., & D'Orazio, V. J. (2026) · Lecture notes in computer science · doi:10.1007/978-981-95-7072-0_23
Saluja, V., & Dongardive, J. (2025) · International Conference on Artificial Intelligence and Speech Technology (AIST) · doi:10.1109/aist68591.2025.11441610
“Previous methods were based on bilingual dictionaries or parallel corpus to incorporate alignment [16].”
Modèles statistiques pour la prédiction de cadres sémantiques
Michalon, O. (2017) · theses.fr (ABES) · doi:10.70675/4499fd19za899z46dfzad6fz4000451b58e5
Learning distributed representations of sentences using neural networks
Conneau, A. (2019) · theses.fr (ABES) · doi:10.70675/b3ecf08ez353ez4532zb829z7c06c26a7e07
Zhang, Z. (2019) · theses.fr (ABES) · doi:10.70675/df0f1f11z8a2ez45b3z8bf2z660c4be2e250 · Cited by 4
Unsupervised cross-lingual representation modeling for variable length phrases
Liu, J. (2020) · theses.fr (ABES) · doi:10.70675/d93d53a6z857fz47e6z8dc8z85289e135ca6
Analyse du discours conversationnel dans le cadre de communications médiées par ordinateur
Auguste, J. (2020) · theses.fr (ABES) · doi:10.70675/60f1f619z22c5z4f5cza402z4ff7f222bb61
Évaluation en extraction de lexiques bilingues à partir de corpus comparables
Laville, M. (2023) · theses.fr (ABES) · doi:10.70675/6d684a85z62f8z4860zbde5z96e2fde4be63
Neural methods for spoken dialogue understanding
Chapuis, É. (2021) · theses.fr (ABES) · doi:10.70675/1fc9d449zab9az41c9zaa43z5f3ca7ec8ba4
A Variance-Invariance Approach to Better Word Embeddings
Albujasim, Z. M., & Inkpen, D. Z. (2026) · Communications in computer and information science · doi:10.1007/978-3-032-20322-9_22
Jiang, L., & Jia, Z. (2026) · Journal of Engineering and Applied Science · doi:10.1186/s44147-026-01229-7
“Techniques ranging from Canonical Correlation Analysis to unsupervised manifold alignment via Generative Adversarial Networks have successfully demonstrated that distinct languages share isomorphic latent structures [18, 19].”
Metadata
- Authors
- Faruqui, M., & Dyer, C.
- Affiliations
- Carnegie Mellon University (US)
- Venue
- Proceedings of the 14th Conference of the European Chapter of the Association for Computational Linguistics
- Published
- 2014
- Pages
- 462-471
- OpenAlex
- W342285082
- Cited by
- 620
- References
- 43
- Citations by year
- 2026: 3 · 2025: 8 · 2024: 33 · 2023: 19 · 2022: 28 · 2021: 57 · 2020: 106 · 2019: 100 · 2018: 91 · 2017: 61 · 2016: 67 · 2015: 33 · 2014: 14
- FWCI
- 34.35
- Type
- conference paper
- Language
- en
- Open access
- green
- figshare.com
- Licence
- cc-by
- Locations
- Conference of the European Chapter of the Association for Computational Linguistics (publishedVersion)
- KiltHub Repository (submittedVersion)
- Figshare (submittedVersion, cc-by)
- KiltHub Repository
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Sentiment Analysis and Opinion Mining
- Keywords
- word embeddings, multilingual word representation, distributional semantics, canonical correlation analysis, word meaning, word sense disambiguation, word similarity
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.