Joint Representation Learning of Cross-lingual Words and Entities via Attentive Distant Supervision
Open accessThe DOI matches its Crossref record; 5 of the 5 references it cites were found in a registry or an index.
Abstract
Joint representation learning of words and entities benefits many NLP tasks, but has not been well explored in cross-lingual settings.In this paper, we propose a novel method for joint representation learning of cross-lingual words and entities.It captures mutually complementary knowledge, and enables cross-lingual inferences among knowledge bases and texts.Our method does not require parallel corpora, and automatically generates comparable data via distant supervision using multi-lingual knowledge bases.We utilize two types of regularizers to align cross-lingual words and entities, and design knowledge attention and crosslingual attention to further reduce noises.We conducted a series of experiments on three tasks: word translation, entity relatedness, and cross-lingual entity linking.The results, both qualitatively and quantitatively, demonstrate the significance of our method.1 https://en.wikipedia.org/wiki/Help: Interlanguage_links• We did qualitative analysis to have an intuitive impression of our embeddings, and quantitative analysis in three tasks: word translation, entity relatedness, and crosslingual entity linking.Experiment results show that our method demonstrates significant improvements in all three tasks.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Cumulated gain-based evaluation of IR techniques
Järvelin, K., & Kekäläinen, J. (2002) · ACM Transactions on Information Systems · doi:10.1145/582415.582418 · Cited by 4,841
A Structured Self-attentive Sentence Embedding
Lin, Z., Feng, M., Santos, C. N. D., Yu, M., Xiang, B., Zhou, B., & Bengio, Y. (2017) · arXiv · doi:10.48550/arxiv.1703.03130 · Cited by 1,743
Improving Vector Space Word Representations Using Multilingual Correlation
Faruqui, M., & Dyer, C. (2014) · Proceedings of the 14th Conference of the European Chapter of the Association for Computational Linguistics · doi:10.3115/v1/e14-1049 · Cited by 620
Knowledge Graph and Text Jointly Embedding
Wang, Z., Zhang, J., Feng, J., & Chen, Z. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1167 · Cited by 406
Bilingual Word Representations with Monolingual Quality in Mind
Luong, T., Pham, H., & Manning, C. D. (2015) · Proceedings of the 1st Workshop on Vector Space Modeling for Natural Language Processing · doi:10.3115/v1/w15-1521 · Cited by 315
Cited by
KGAT: Knowledge Graph Attention Network for Recommendation
Wang, X., He, X., Cao, Y., Liu, M., & Chua, T.-S. (2019) · Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3292500.3330989 · Cited by 2,147
Self-citationERNIE: Enhanced Language Representation with Informative Entities
Zhang, Z., Han, X., Liu, Z., Jiang, X., Sun, M., & Liu, Q. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1139 · Cited by 1,482
Self-citationK-BERT: Enabling Language Representation with Knowledge Graph
Liu, W., Zhou, P., Zhao, Z., Wang, Z., Ju, Q., Deng, H., & Wang, P. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i03.5681 · Cited by 894
“Cao et al. (2018) carried out cross-lingual representation learning for words and entities via attentive distant supervision.”
BackgroundKEPLER: A Unified Model for Knowledge Embedding and Pre-trained Language Representation
Wang, X., Gao, T., Zhu, Z., Zhang, Z., Liu, Z., Li, J., & Tang, J. (2021) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00360 · Cited by 676
Self-citationCao, Y., Wang, X., He, X., Hu, Z., & Chua, T.-S. (2019) · The World Wide Web Conference · doi:10.1145/3308558.3313705 · Cited by 630
Self-citation
Metadata
- Authors
- Cao, Y., Hou, L., Li, J., Liu, Z., Li, C., Chen, X., & Dong, T.
- Venue
- Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing
- Published
- 2018
- Pages
- 227-237
- OpenAlex
- W2891328459
- Cited by
- 41
- References
- 5
- FWCI
- 2.50
- Type
- conference paper
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Joint Representation Learning of Cross-lingual Words and Entities via Attentive Distant Supervision. https://app.cochat.ai/papers/10.18653/v1/d18-1021
- The paper
- Cao, Y., Hou, L., Li, J., Liu, Z., Li, C., Chen, X., & Dong, T. (2018). Joint Representation Learning of Cross-lingual Words and Entities via Attentive Distant Supervision. Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing. https://doi.org/10.18653/v1/d18-1021
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.