Dict2vec : Learning Word Embeddings using Lexical Dictionaries
Open accessThe DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.
Abstract
Learning word embeddings on large unlabeled corpus has been shown to be successful in improving many natural language tasks.The most efficient and popular approaches learn or retrofit such representations using additional external data.Resulting embeddings are generally better than their corpus-only counterparts, although such resources cover a fraction of words in the vocabulary.In this paper, we propose a new approach, Dict2vec, based on one of the largest yet refined datasource for describing words -natural language dictionaries.Dict2vec builds new word pairs from dictionary entries so that semantically-related words are moved closer, and negative sampling filters out pairs whose words are unrelated in dictionaries.We evaluate the word representations obtained using Dict2vec on eleven datasets for the word similarity task and on four datasets for a text classification task.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
WordNet: a lexical database for English
Miller, G. A. (1995) · Communications of the ACM · doi:10.1145/219717.219748 · Cited by 14,015 · cited 1×
“The retrofitting introduces external knowledge from the WordNet semantic lexicon (Miller, 1995).”
BackgroundEnriching Word Vectors with Subword Information
Bojanowski, P., Grave, E., Joulin, A., & Mikolov, T. (2017) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00051 · Cited by 9,645 · cited 1×
“…strong semantic relations be-tween words (like synonymy or meronymy) happens rarely within the same window, so these relations will not be well embedded into vectors. fastText introduced in Bojanowski et al. (2016) uses internal additional information from the corpus to solve the latter drawback.”
BackgroundThe proof and measurement of association between two things
Spearman, C. (1904) · The American Journal of Psychology · doi:10.2307/1412159 · Cited by 8,039
Recurrent neural network based language model
Mikolov, T., Karafiát, M., Burget, L., Černocký, J., & Khudanpur, S. (2010) · Interspeech 2010 · doi:10.21437/interspeech.2010-343 · Cited by 5,390 · cited 1×
“Recurrent neural networks are another way to exploit the context of a word by considering the sequence of words preceding it (Mikolov et al., 2010; Sutskever et al., 2011).”
BackgroundA unified architecture for natural language processing: deep neural networks with multitask learning
Collobert, R., & Weston, J. (2008) · Proceedings of the 25th international conference on Machine learning - ICML '08 · doi:10.1145/1390156.1390177 · Cited by 5,058
Bag of Tricks for Efficient Text Classification
Joulin, A., Grave, E., Bojanowski, P., & Mikolov, T. (2017) · Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics: Volume 2, Short Papers · doi:10.18653/v1/e17-2068 · Cited by 4,545
Bag of Tricks for Efficient Text Classification
Joulin, A., Grave, E., Bojanowski, P., & Mikolov, T. (2016) · arXiv · doi:10.48550/arxiv.1607.01759 · Cited by 4,542
Fast and Robust Neural Network Joint Models for Statistical Machine Translation
Devlin, J., Zbib, R., Huang, Z., Lamar, T., Schwartz, R., & Makhoul, J. (2014) · Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.3115/v1/p14-1129 · Cited by 481 · cited 2×
“Finding such representations for words and sentences has been one hot topic over the last few years in Natural Language Processing (NLP) (Mikolov et al., 2013; Pennington et al., 2014) and has led to many improvements in core NLP tasks such as Word Sense Disambiguation (Iacobacci et al., 2016), Machine Translation (De…”
BackgroundKnowledge Graph and Text Jointly Embedding
Wang, Z., Zhang, J., Feng, J., & Chen, Z. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1167 · Cited by 406 · cited 2×
“Recent approaches have proposed to tackle this issue using an attentive model for context selection (Ling et al., 2015), or by us-ing external sources – like knowledge graphs – in order to improve the embeddings (Wang et al., 2014).”
BackgroundMethodEmbeddings for Word Sense Disambiguation: An Evaluation Study
Iacobacci, I., Pilehvar, M. T., & Navigli, R. (2016) · Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p16-1085 · Cited by 253
Cited by
Evaluating word embedding models: methods and experimental results
Wang, B., Wang, A., Chen, F., Wang, Y., & Kuo, C.-C. J. (2019) · APSIPA Transactions on Signal and Information Processing · doi:10.1017/atsip.2019.12 · Cited by 323
Evolution of Semantic Similarity—A Survey
Chandrasekaran, D., & Mago, V. (2022) · ACM Computing Surveys · doi:10.1145/3440755 · Cited by 303
A survey of word embeddings based on deep learning
Wang, S., Zhou, W., & Jiang, C. (2020) · Computing · doi:10.1007/s00607-019-00768-7 · Cited by 193
Furlan, R., Gatti, M., Menè, R., Shiffer, D., Marchiori, C., Giaj Levra, A., Saturnino, V., Brunetta, E., & Dipaola, F. (2021) · JMIR Medical Informatics · doi:10.2196/24073 · Cited by 67
Analogies minus analogy test: measuring regularities in word embeddings
Fournier, L., Dupoux, E., & Dunbar, E. (2020) · Proceedings of the 24th Conference on Computational Natural Language Learning · doi:10.18653/v1/2020.conll-1.29 · Cited by 19
Metadata
- Authors
- Tissier, J., Gravier, C., & Habrard, A.
- Venue
- Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing
- Published
- 2017
- Pages
- 254-263
- OpenAlex
- W2758506174
- Cited by
- 107
- References
- 10
- FWCI
- 6.73
- Type
- conference paper
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Dict2vec : Learning Word Embeddings using Lexical Dictionaries. https://app.cochat.ai/papers/10.18653/v1/d17-1024
- The paper
- Tissier, J., Gravier, C., & Habrard, A. (2017). Dict2vec : Learning Word Embeddings using Lexical Dictionaries. Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing. https://doi.org/10.18653/v1/d17-1024
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.