The DOI matches its Crossref record; 194 of the 194 references it cites were found in a registry or an index.
From Word To Sense Embeddings: A Survey on Vector Representations of Meaning
Open accessAbstract
Over the past years, distributed semantic representations have proved to be effective and flexible keepers of prior knowledge to be integrated into downstream applications. This survey focuses on the representation of meaning. We start from the theoretical background behind word vector space models and highlight one of their major limitations: the meaning conflation deficiency, which arises from representing a word with all its possible meanings as a single vector. Then, we explain how this deficiency can be addressed through a transition from the word level to the more fine-grained level of word senses (in its broader acceptation) as a method for modelling unambiguous lexical meaning. We present a comprehensive overview of the wide range of techniques in the two main branches of sense representation, i.e., unsupervised and knowledge-based. Finally, this survey covers the main evaluation procedures and applications for this type of representation, and provides an analysis of four of its important aspects: interpretability, sense granularity, adaptability to different domains and compositionality.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Maximum Likelihood from Incomplete Data Via the EM Algorithm
Dempster, A. P., Laird, N. M., & Rubin, D. B. (1977) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1977.tb01600.x · Cited by 50,444
Glove: Global Vectors for Word Representation
Pennington, J., Socher, R., & Manning, C. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1162 · Cited by 34,071
(2008) · Journal of Machine Learning Research · Cited by 33,051
(2003) · Journal of Machine Learning Research · doi:10.5555/944919.944937 · Cited by 32,337
Efficient Estimation of Word Representations in Vector Space
Mikolov, T., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1301.3781 · Cited by 26,568
Distributed Representations of Words and Phrases and their Compositionality
Mikolov, T., Sutskever, I., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1310.4546 · Cited by 24,533
Convolutional Neural Networks for Sentence Classification
Kim, Y. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1181 · Cited by 14,831
WordNet: a lexical database for English
Miller, G. A. (1995) · Communications of the ACM · doi:10.1145/219717.219748 · Cited by 14,015
Deep Contextualized Word Representations
Peters, M., Neumann, M., Iyyer, M., Gardner, M., Clark, C., Lee, K., & Zettlemoyer, L. (2018) · Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers) · doi:10.18653/v1/n18-1202 · Cited by 11,983
Introduction to Modern Information Retrieval
Salton, G., & McGill, M. J. (1983) · Virtual Defense Library (Ministerio de Defensa) · Cited by 11,390
node2vec: Scalable Feature Learning for Networks
Grover, A., & Leskovec, J. (2016) · Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2939672.2939754 · Cited by 10,926
Enriching Word Vectors with Subword Information
Bojanowski, P., Grave, E., Joulin, A., & Mikolov, T. (2017) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00051 · Cited by 9,645
A vector space model for automatic indexing
Salton, G., Wong, A., & Yang, C. S. (1975) · Communications of the ACM · doi:10.1145/361219.361220 · Cited by 7,521
Landauer, T. K., & Dumais, S. T. (1997) · Psychological Review · doi:10.1037/0033-295x.104.2.211 · Cited by 6,282
(2013) · Cited by 5,726
A unified architecture for natural language processing: deep neural networks with multitask learning
Collobert, R., & Weston, J. (2008) · Proceedings of the 25th international conference on Machine learning - ICML '08 · doi:10.1145/1390156.1390177 · Cited by 5,058
Natural Language Processing (almost) from Scratch
Collobert, R., Weston, J., Bottou, L., Karlen, M., Kavukcuoglu, K., & Kuksa, P. P. (2011) · arXiv (Cornell University) · doi:10.48550/arxiv.1103.0398 · Cited by 4,962
Freebase: a collaboratively created graph database for structuring human knowledge
Bollacker, K., Evans, C., Paritosh, P., Sturge, T., & Taylor, J. (2008) · Proceedings of the 2008 ACM SIGMOD international conference on Management of data · doi:10.1145/1376616.1376746 · Cited by 4,852
Harris, Z. S. (1954) · WORD · doi:10.1080/00437956.1954.11659520 · Cited by 4,807
Maximum Likelihood from Incomplete Data via the EM Algorithm
Dempster, A. P., Laird, N. M., & Rubin, D. B. (1976) · Cited by 4,517
Knowledge Graph Embedding by Translating on Hyperplanes
Wang, Z., Zhang, J., Feng, J., & Chen, Z. (2014) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v28i1.8870 · Cited by 3,915
Learning Entity and Relation Embeddings for Knowledge Graph Completion
Lin, Y., Liu, Z., Sun, M., Liu, Y., & Zhu, X. (2015) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v29i1.9491 · Cited by 3,749
Thumbs Up or Thumbs Down? Semantic Orientation Applied to Unsupervised Classification of Reviews
Peter, P., & Turney (2002) · Cited by 3,650
Using Information Content to Evaluate Semantic Similarity in a Taxonomy
Resnik, P. (1995) · arXiv (Cornell University) · doi:10.48550/arxiv.cmp-lg/9511007 · Cited by 3,193
Linguistic Regularities in Continuous Space Word Representations
Mikolov, T., Yih, W.-T., & Zweig, G. (2013) · North American Chapter of the Association for Computational Linguistics · Cited by 2,912
From Frequency to Meaning: Vector Space Models of Semantics
Turney, P. D., & Pantel, P. (2010) · Journal of Artificial Intelligence Research · doi:10.1613/jair.2934 · Cited by 2,866
Baker, C. F., Fillmore, C. J., & Lowe, J. B. (1998) · Proceedings of the 36th annual meeting on Association for Computational Linguistics - · doi:10.3115/980845.980860 · Cited by 2,518
Unsupervised Learning by Probabilistic Latent Semantic Analysis
Hofmann, T. (2001) · Machine Learning · doi:10.1023/a:1007617005950 · Cited by 2,456
Embedding Entities and Relations for Learning and Inference in Knowledge Bases
Yang, B., Yih, W.-T., He, X., Gao, J., & Deng, L. (2014) · arXiv · doi:10.48550/arxiv.1412.6575 · Cited by 2,252
A Comprehensive Survey of Graph Embedding: Problems, Techniques, and Applications
Cai, H., Zheng, V. W., & Chang, K. C.-C. (2018) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2018.2807452 · Cited by 2,034
Computing semantic relatedness using Wikipedia-based explicit semantic analysis
Gabrilovich, E., & Markovitch, S. (2007) · Cited by 1,981
(2010) · Cited by 1,906
Word sense disambiguation: A survey
Navigli, R. (2009) · ACM Computing Surveys · doi:10.1145/1459352.1459355 · Cited by 1,819
Knowledge Graph Embedding via Dynamic Mapping Matrix
Ji, G., He, S., Xu, L., Liu, K., & Zhao, J. (2015) · Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · doi:10.3115/v1/p15-1067 · Cited by 1,816
Producing high-dimensional semantic spaces from lexical co-occurrence
Lund, K., & Burgess, C. (1996) · Behavior Research Methods, Instruments, & Computers · doi:10.3758/bf03204766 · Cited by 1,811
Lesk, M. (1986) · Proceedings of the 5th annual international conference on Systems documentation - SIGDOC '86 · doi:10.1145/318723.318728 · Cited by 1,770
Conceptual spaces: the geometry of thought
(2000) · Choice Reviews Online · doi:10.5860/choice.38-1526 · Cited by 1,643
Neural Word Embedding as Implicit Matrix Factorization
Levy, O., & Goldberg, Y. (2014) · neural information processing systems · Cited by 1,582
Thumbs Up or Thumbs Down? Semantic Orientation Applied to Unsupervised Classification of Reviews
Turney, P. D. (2002) · arXiv (Cornell University) · doi:10.48550/arxiv.cs/0212032 · Cited by 1,575
Haveliwala, T. H. (2002) · Proceedings of the 11th international conference on World Wide Web · doi:10.1145/511446.511513 · Cited by 1,567
(2000) · CrossRef Listing of Deleted DOIs · doi:10.1162/153244303322533223 · Cited by 1,566
Navigli, R., & Ponzetto, S. P. (2012) · Artificial Intelligence · doi:10.1016/j.artint.2012.07.001 · Cited by 1,465
Contextual correlates of synonymy
Rubenstein, H., & Goodenough, J. B. (1965) · Communications of the ACM · doi:10.1145/365628.365657 · Cited by 1,425
Exploiting Similarities among Languages for Machine Translation
Mikolov, T., Le, Q. V., & Sutskever, I. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1309.4168 · Cited by 1,346
Mining the Web for Synonyms: PMI-IR versus LSA on TOEFL
Turney, P. D. (2001) · Lecture Notes in Computer Science · doi:10.1007/3-540-44795-4_42 · Cited by 1,285
Automatic word sense discrimination
Schütze, H. (1998) · doi:10.5555/972719.972724 · Cited by 1,266
A Primer on Neural Network Models for Natural Language Processing
Goldberg, Y. (2016) · Journal of Artificial Intelligence Research · doi:10.1613/jair.4992 · Cited by 1,201
Human Behaviour and the Principle of Least Effort.
Florence, P. S., & Zipf, G. K. (1950) · The Economic Journal · doi:10.2307/2226729 · Cited by 1,194
SimLex-999: Evaluating Semantic Models With (Genuine) Similarity Estimation
Hill, F., Reichart, R., & Korhonen, A. (2015) · Computational Linguistics · doi:10.1162/coli_a_00237 · Cited by 1,175
DeepWalk: Online Learning of Social Representations
Perozzi, B., Al‐Rfou, R., & Skiena, S. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1403.6652 · Cited by 1,107
Improving Word Representations via Global Context and Multiple Word Prototypes
Huang, E., Socher, R., Manning, C. D., & Ng, A. Y. (2012) · Cited by 1,073
Dependency-Based Word Embeddings
Levy, O., & Goldberg, Y. (2014) · Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers) · doi:10.3115/v1/p14-2050 · Cited by 1,047
Placing search in context: the concept revisited.
Finkelstein, L., Gabrilovich, E., Matias, Y., Rivlin, E., Solan, Z., Wolfman, G., & Ruppin, E. (2002) · Cited by 961
Wikify!: linking documents to encyclopedic knowledge
Mihalcea, R., & Csomai, A. (2007) · Proceedings of the sixteenth ACM conference on Conference on information and knowledge management · doi:10.1145/1321440.1321475 · Cited by 909
Zipf’s word frequency law in natural language: A critical review and future directions
Piantadosi, S. T. (2014) · Psychonomic Bulletin & Review · doi:10.3758/s13423-014-0585-6 · Cited by 889
An Adapted Lesk Algorithm for Word Sense Disambiguation Using WordNet
Banerjee, S., & Pedersen, T. (2002) · Lecture Notes in Computer Science · doi:10.1007/3-540-45715-1_11 · Cited by 858
Parsing with Compositional Vector Grammars
Socher, R., Bauer, J., Manning, C. D., & Ng, A. Y. (2013) · Cited by 828
ConceptNet 5.5: An Open Multilingual Graph of General Knowledge
Speer, R., Chin, J., & Havasi, C. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1612.03975 · Cited by 758
Representing Text for Joint Embedding of Text and Knowledge Bases
Toutanova, K., Chen, D., Pantel, P., Poon, H., Choudhury, P., & Gamon, M. (2015) · Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d15-1174 · Cited by 750
Poincaré Embeddings for Learning Hierarchical Representations
Nickel, M., & Kiela, D. (2017) · arXiv · doi:10.48550/arxiv.1705.08039 · Cited by 667
Semi-supervised sequence tagging with bidirectional language models
Peters, M., Ammar, W., Bhagavatula, C., & Power, R. (2017) · Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p17-1161 · Cited by 655
Word translation without parallel data
Lample, G., Conneau, A., Ranzato, M., Denoyer, L., & Jeǵou, H. (2018) · International Conference on Learning Representations · Cited by 653
Miller, G. A., Leacock, C., Tengi, R., & Bunker, R. T. (1993) · Proceedings of the workshop on Human Language Technology - HLT '93 · doi:10.3115/1075671.1075742 · Cited by 601
Learned in Translation: Contextualized Word Vectors
McCann, B., Bradbury, J., Xiong, C., & Socher, R. (2017) · arXiv · doi:10.48550/arxiv.1708.00107 · Cited by 572 · cited 3×
“…been evaluated in a wide range of NLP tasks, including sentiment analysis, question answering and classification, textual entailment, semantic role labeling, reading comprehension, named entity extraction, and coreference resolution (Peters et al., 2018; Salant & Berant, 2018; McCann et al., 2017).”
BackgroundMethodA robust self-learning method for fully unsupervised cross-lingual mappings of word embeddings
Artetxe, M., Labaka, G., & Agirre, E. (2018) · Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p18-1073 · Cited by 555
Bilingual Word Embeddings for Phrase-Based Machine Translation
Zou, W. Y., Socher, R., Cer, D., & Manning, C. D. (2013) · Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d13-1141 · Cited by 518
context2vec: Learning Generic Context Embedding with Bidirectional LSTM
Melamud, O., Goldberger, J., & Dagan, I. (2016) · Proceedings of The 20th SIGNLL Conference on Computational Natural Language Learning · doi:10.18653/v1/k16-1006 · Cited by 513
A Survey of Cross-lingual Word Embedding Models
Ruder, S., Vulić, I., & Søgaard, A. (2018) · Apollo (University of Cambridge) · doi:10.17863/cam.30462 · Cited by 510
"I Don’t Believe in Word Senses"
Kilgarriff, A. (1997) · Computers and the Humanities · doi:10.1023/a:1000583911091 · Cited by 493
Similarity, separability, and the triangle inequality.
Tversky, A., & Gati, I. (1982) · Psychological Review · doi:10.1037//0033-295x.89.2.123 · Cited by 469
Efficient Non-parametric Estimation of Multiple Embeddings per Word in Vector Space
Neelakantan, A., Shankar, J., Passos, A., & McCallum, A. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1113 · Cited by 442
Knowledge Graph and Text Jointly Embedding
Wang, Z., Zhang, J., Feng, J., & Chen, Z. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1167 · Cited by 406
A word at a time: computing word relatedness using temporal semantic analysis
Radinsky, K., Agichtein, E., Gabrilovich, E., & Markovitch, S. (2011) · Proceedings of the 20th international conference on World wide web · doi:10.1145/1963405.1963455 · Cited by 405
Liu, Y., Liu, Z., Chua, T.-S., & Sun, M. (2015) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v29i1.9522 · Cited by 381
Learning principled bilingual mappings of word embeddings while preserving monolingual invariance
Artetxe, M., Labaka, G., & Agirre, E. (2016) · Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d16-1250 · Cited by 369
CoNLL 2017 Shared Task: Multilingual Parsing from Raw Text to Universal Dependencies
Zeman, D., Popel, M., Straka, M., Hajic, J., Nivre, J., Ginter, F., Luotolahti, J., Pyysalo, S., Petrov, S., Potthast, M., et al. (2017) · Proceedings of the CoNLL 2017 Shared Task: Multilingual Parsing from Raw Text to Universal Dependencies · doi:10.18653/v1/k17-3001 · Cited by 367
A structured vector space model for word meaning in context
Erk, K., & Padó, S. (2008) · Proceedings of the Conference on Empirical Methods in Natural Language Processing - EMNLP '08 · doi:10.3115/1613715.1613831 · Cited by 366
Multi-Prototype Vector-Space Models of Word Meaning
Reisinger, J., & Mooney, R. J. (2010) · Cited by 347
Improving Statistical Machine Translation Using Word Sense Disambiguation
Carpuat, M. J., & Wu, D. (2007) · Cited by 343
Biemann, C. (2006) · doi:10.3115/1654758.1654774 · Cited by 322
Vector Space Models of Word Meaning and Phrase Meaning: A Survey
Erk, K. (2012) · Language and Linguistics Compass · doi:10.1002/lnco.362 · Cited by 321
(1992) · Cited by 316
Word Sense Disambiguation: A Unified Evaluation Framework and Empirical Comparison
Raganato, A., Camacho-Collados, J., & Navigli, R. (2017) · Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics: Volume 1, Long Papers · doi:10.18653/v1/e17-1010 · Cited by 316
Self-citationIt Makes Sense: A Wide-Coverage Word Sense Disambiguation System for Free Text
Zhong, Z., & Ng, H. T. (2010) · National University of Singapore · Cited by 277
Improving Lexical Embeddings with Semantic Knowledge
Yu, M., & Dredze, M. (2014) · Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers) · doi:10.3115/v1/p14-2089 · Cited by 276
Linking and Extending an Open Multilingual Wordnet
Bond, F., & Foster, R. (2013) · Cited by 269
Word Representations via Gaussian Embedding
Vilnis, L., & McCallum, A. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1412.6623 · Cited by 267
SensEmbed: Learning Sense Embeddings for Word and Relational Similarity
Iacobacci, I., Pilehvar, M. T., & Navigli, R. (2015) · Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · doi:10.3115/v1/p15-1010 · Cited by 267
Self-citationA Unified Model for Word Sense Representation and Disambiguation
Chen, X., Liu, Z., & Sun, M. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1110 · Cited by 265
Massively Multilingual Word Embeddings
Ammar, W., Mulcaire, G., Tsvetkov, Y., Lample, G., Dyer, C., & Smith, N. A. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1602.01925 · Cited by 263
Meyerson, A. (2001) · Annual Symposium on Foundations of Computer Science · doi:10.1109/sfcs.2001.959917 · Cited by 262
Random Walks for Knowledge-Based Word Sense Disambiguation
Agirre, E., López de Lacalle, O., & Soroa, A. (2014) · Computational Linguistics · doi:10.1162/coli_a_00164 · Cited by 256
Embeddings for Word Sense Disambiguation: An Evaluation Study
Iacobacci, I., Pilehvar, M. T., & Navigli, R. (2016) · Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p16-1085 · Cited by 253
Self-citationProblems With Evaluation of Word Embeddings Using Word Similarity Tasks
Faruqui, M., Tsvetkov, Y., Rastogi, P., & Dyer, C. (2016) · Proceedings of the 1st Workshop on Evaluating Vector-Space Representations for NLP · doi:10.18653/v1/w16-2506 · Cited by 246
Wikidata: a new platform for collaborative data collection
Vrandečić, D. (2012) · Proceedings of the 21st International Conference on World Wide Web · doi:10.1145/2187980.2188242 · Cited by 241
Beyond TFIDF weighting for text categorization in the vector space model
Soucy, P., & Mineau, G. W. (2005) · Cited by 235
Do Multi-Sense Embeddings Improve Natural Language Understanding?
Li, J., & Jurafsky, D. (2015) · Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d15-1200 · Cited by 232
Unsupervised Learning by Probabilistic Latent Semantic Analysis
HofmannThomas (2001) · Machine Learning · doi:10.5555/599609.599631 · Cited by 220
A Survey of Word Embeddings Evaluation MethodsPreprint
Bakarov, A. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1801.09536 · Cited by 217
TorusE: Knowledge Graph Embedding on a Lie Group
Ebisu, T., & Ichise, R. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11538 · Cited by 212
AutoExtend: Extending Word Embeddings to Embeddings for Synsets and Lexemes
Rothe, S., & Schütze, H. (2015) · Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · doi:10.3115/v1/p15-1173 · Cited by 203
Neural Sequence Learning Models for Word Sense Disambiguation
Raganato, A., Delli Bovi, C., & Navigli, R. (2017) · Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d17-1120 · Cited by 197
Question Answering with Subgraph EmbeddingsPreprint
Bordes, A., Chopra, S., & Weston, J. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1406.3676 · Cited by 191
Camacho-Collados, J., Pilehvar, M. T., & Navigli, R. (2016) · Artificial Intelligence · doi:10.1016/j.artint.2016.07.005 · Cited by 188
Self-citationStructured Training for Neural Network Transition-Based Parsing
Weiss, D., Alberti, C., Collins, M., & Petrov, S. (2015) · Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · doi:10.3115/v1/p15-1032 · Cited by 180
Cross-lingual Models of Word Embeddings: An Empirical Comparison
Upadhyay, S., Faruqui, M., Dyer, C., & Roth, D. (2016) · Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p16-1157 · Cited by 177
Mrkšić, N., Vulić, I., Séaghdha, D. Ó., Leviant, I., Reichart, R., Gašić, M., Korhonen, A., & Young, S. (2017) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00063 · Cited by 170
Charagram: Embedding Words and Sentences via Character n-grams
Wieting, J., Bansal, M., Gimpel, K., & Livescu, K. (2016) · Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d16-1157 · Cited by 168
Clustering and Diversifying Web Search Results with Graph-Based Word Sense Induction
Marco, A. D., & Roberto Navigli, A. (2012) · Computational Linguistics · doi:10.1162/coli_a_00148 · Cited by 166
CoNLL 2018 Shared Task : Multilingual Parsing from Raw Text to Universal Dependencies
Zeman, D., Hajič, J., Popel, M., Potthast, M., Straka, M., Ginter, F., Nivre, J., & Petrov, S. (2018) · Conference on Computational Natural Language Learning · Cited by 166
Collaboratively built semi-structured content and Artificial Intelligence: The story so far
Hovy, E., Navigli, R., & Ponzetto, S. P. (2013) · Artificial Intelligence · doi:10.1016/j.artint.2012.10.002 · Cited by 164
RC-NET: A General Framework for Incorporating Knowledge into Word Representations
Xu, C., Bai, Y., Bian, J., Gao, B., Wang, G., Liu, X., & Liu, T.-Y. (2014) · Proceedings of the 23rd ACM International Conference on Conference on Information and Knowledge Management · doi:10.1145/2661829.2662038 · Cited by 160
Probabilistic FastText for Multi-Sense Word Embeddings
Athiwaratkun, B., Wilson, A., & Anandkumar, A. (2018) · Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p18-1001 · Cited by 158
Evaluation of Word Vector Representations by Subspace Alignment
Tsvetkov, Y., Faruqui, M., Wang, L., Lample, G., & Dyer, C. (2015) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d15-1243 · Cited by 156
Sense Discrimination with Parallel Corpora
Ide, N., Erjavec, T., & Tufis, D. (2002) · SENSEVAL · doi:10.3115/1118675.1118683 · Cited by 145
SemEval-2017 Task 2: Multilingual and Cross-lingual Semantic Word Similarity
Camacho-Collados, J., Pilehvar, M. T., Collier, N., & Roberto Navigli, A. (2017) · International Workshop on Semantic Evaluation (SemEval) · doi:10.18653/v1/s17-2002 · Cited by 144
Self-citationMaking Sense of Word Embeddings
Pelevina, M., Arefiev, N., Biemann, C., & Panchenko, A. (2016) · Workshop on Representation Learning for NLP (RepL4NLP) · doi:10.18653/v1/w16-1620 · Cited by 140
Specializing Word Embeddings for Similarity or Relatedness
Kiela, D., Hill, F., & Clark, S. C. (2015) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d15-1242 · Cited by 139
Semi-supervised Word Sense Disambiguation with Neural ModelsPreprint
Yuan, D., Richardson, J., Doherty, R., Evans, C., & Altendorf, E. E. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1603.07012 · Cited by 135
A Simple, Similarity-based Model for Selectional Preferences
Erk, K. (2007) · Cited by 134
Word sense disambiguation vs. statistical machine translation
Carpuat, M. J., & Wu, D. (2005) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.3115/1219840.1219888 · Cited by 128
Towards Better UD Parsing: Deep Contextualized Word Embeddings, Ensemble, and Treebank ConcatenationPreprint
Che, W., Liu, Y., Wang, Y., Zheng, B., & Liu, T. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1807.03121 · Cited by 127
Vulić, I., & Moens, M. (2015) · doi:10.3115/v1/p15-2118 · Cited by 123
From senses to texts: An all-in-one graph-based approach for measuring semantic similarity
Pilehvar, M. T., & Roberto Navigli, A. (2015) · Artificial Intelligence · doi:10.1016/j.artint.2015.07.005 · Cited by 117
Self-citationSymmetric Pattern Based Word Embeddings for Improved Word Similarity Prediction
Schwartz, R., Reichart, R., & Rappoport, A. (2015) · Conference on Computational Natural Language Learning · doi:10.18653/v1/k15-1026 · Cited by 116
Snow, R., Prakash, S., Jurafsky, D. S., & Ng, A. Y. (2007) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · Cited by 113
A Probabilistic Model for Learning Multi-Prototype Word Embeddings
Tian, F., Dai, H., Bian, J., Gao, B., Zhang, R., Chen, E., & Liu, T. (2014) · International Conference on Computational Linguistics · Cited by 113
Conceptual Spaces - The Geometry of Thought.
Schwering, A. (2008) · Künstliche Intell. · Cited by 110
A survey of embedding models of entities and relationships for knowledge graph completion
Nguyen, D. Q. (2020) · doi:10.18653/v1/2020.textgraphs-1.1 · Cited by 103
Ontologically Grounded Multi-sense Representation Learning for Semantic Vector Space Models
Jauhar, S. K., Dyer, C., & Hovy, E. H. (2015) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.3115/v1/n15-1070 · Cited by 98
Athiwaratkun, B., & Wilson, A. (2017) · Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p17-1151 · Cited by 98
Bridge Text and Knowledge by Learning Multi-Prototype Entity Mention Embedding
Cao, Y., Huang, L., Ji, H., Chen, X., & Li, J. (2017) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p17-1149 · Cited by 97
Incorporating Glosses into Neural Word Sense Disambiguation
Luo, F., Liu, T., Xia, Q., Chang, B., & Sui, Z. (2018) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p18-1230 · Cited by 96
Intrinsic Evaluation of Word Vectors Fails to Predict Extrinsic Performance
Chiu, B., Korhonen, A., & Pyysalo, S. (2016) · Workshop on Evaluating Vector-Space Representations for NLP · doi:10.18653/v1/w16-2501 · Cited by 95
Investigations on word senses and word usages
Erk, K., McCarthy, D., & Gaylord, N. (2009) · doi:10.3115/1687878.1687882 · Cited by 90
Wikify! Linking Documents to Encyclopedic Knowledge
Mihalcea, R., & Csomai, A. (2007) · University of North Texas Digital Library (University of North Texas) · Cited by 89
Learning context-sensitive word embeddings with neural tensor skip-gram model
Liu, P., Qiu, X., & Huang, X. (2015) · International Conference on Artificial Intelligence · Cited by 85
Entity Disambiguation by Knowledge and Text Jointly Embedding
Fang, W., Zhang, J., Wang, D., Chen, Z., & Li, M. (2016) · Conference on Computational Natural Language Learning · doi:10.18653/v1/k16-1026 · Cited by 83
Using part-of-speech patterns to reduce query ambiguity
Allan, J., & Raghavan, H. (2002) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/564376.564430 · Cited by 82
Separated by an Un-common Language: Towards Judgment Language Informed Vector Space ModelingPreprint
Leviant, I., & Reichart, R. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1508.00106 · Cited by 82
Syntax-Aware Multi-Sense Word Embeddings for Deep Compositional Models of Meaning
Cheng, J., & Kartsaklis, D. (2015) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d15-1177 · Cited by 80
Handling Homographs in Neural Machine Translation
Liu, F., Han, L., & Neubig, G. (2018) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n18-1121 · Cited by 79
Embedding Words and Senses Together via Joint Knowledge-Enhanced Training
Mancini, M., Camacho-Collados, J., Iacobacci, I., & Roberto Navigli, A. (2017) · Conference on Computational Natural Language Learning · doi:10.18653/v1/k17-1012 · Cited by 77
Self-citationStructured Training for Neural Network Transition-Based ParsingPreprint
Weiss, D., Alberti, C., Collins, M., & Petrov, S. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1506.06158 · Cited by 75
Knowledge-based Word Sense Disambiguation using Topic Models
Chaplot, D. S., & Salakhutdinov, R. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.12027 · Cited by 74
Charagram: Embedding Words and Sentences via Character n-gramsPreprint
Wieting, J., Bansal, M., Gimpel, K., & Livescu, K. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1607.02789 · Cited by 72
Random Walks and Neural Network Language Models on Knowledge Bases
Goikoetxea, J., Soroa, A., & Agirre, E. (2015) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.3115/v1/n15-1165 · Cited by 71
Contextual spelling correction using latent semantic analysis
Jones, M. P., & Martin, J. (1997) · Conference on Applied Natural Language Processing · doi:10.3115/974557.974582 · Cited by 65
Improving Cross-Lingual Word Embeddings by Meeting in the Middle
Doval, Y., Camacho-Collados, J., Espinosa-Anke, L., & Schockaert, S. (2018) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d18-1027 · Cited by 64
Self-citationThe people's web meets linguistic knowledge: automatic sense alignment of Wikipedia and Wordnet
Niemann, E., & Gurevych, I. (2011) · TUbilio (Technical University of Darmstadt) · Cited by 63
Learning Sense-specific Word Embeddings By Exploiting Bilingual Resources
Guo, J., Che, W., Wang, H., & Liu, T. (2014) · International Conference on Computational Linguistics · Cited by 63
Supersense Embeddings: A Unified Model for Supersense Interpretation, Prediction, and Utilization
Flek, L., & Gurevych, I. (2016) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p16-1191 · Cited by 56
de Cruys, T. V., Poibeau, T., Korhonen, A., Cruys, T. V. D., Korhonen, A., Vector, L., Word, W., Cruys, T. V. D., & Korhonen, A. (2011) · HAL · Cited by 54
Mapping Text to Knowledge Graph Entities using Multi-Sense LSTMs
Kartsaklis, D., Pilehvar, M. T., & Collier, N. (2018) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d18-1221 · Cited by 54
Self-citationSemi-supervised sequence modeling with syntactic topic models
Li, W., & McCallum, A. (2005) · Cited by 53
WiC: 10, 000 Example Pairs for Evaluating Context-Sensitive RepresentationsPreprint
Pilehvar, M. T., & Camacho-Collados, J. (2018) · North American Chapter of the Association for Computational Linguistics · doi:10.48550/arxiv.1808.09121 · Cited by 50
Self-citationDynamic and Static Prototype Vectors for Semantic Composition
Reddy, S., Klapaftis, I. P., McCarthy, D., & Manandhar, S. (2011) · Cited by 48
Supervised Distributional Hypernym Discovery via Domain Adaptation
Espinosa-Anke, L., Camacho-Collados, J., Bovi, C. D., & Saggion, H. (2016) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d16-1041 · Cited by 48
Self-citationContextualized Word Representations for Reading Comprehension
Salant, S., & Berant, J. (2018) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n18-2088 · Cited by 45
Context-Dependent Knowledge Graph Embedding
Luo, Y., Wang, Q., Wang, B., & Guo, L. (2015) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d15-1191 · Cited by 44
Camacho-Collados, J., & Roberto Navigli, A. (2016) · Workshop on Evaluating Vector-Space Representations for NLP · doi:10.18653/v1/w16-2508 · Cited by 43
Self-citationAutomatic Induction of Synsets from a Graph of Synonyms
Ustalov, D., Panchenko, A., & Biemann, C. (2017) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p17-1145 · Cited by 42
Automated WordNet Construction Using Word Embeddings
Khodak, M., Risteski, A., Fellbaum, C., & Arora, S. (2017) · doi:10.18653/v1/w17-1902 · Cited by 41
Bilingual Learning of Multi-sense Embeddings with Discrete Autoencoders
Šuster, S., Titov, I., & van Noord, G. (2016) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n16-1160 · Cited by 39
Mrkšić, N., Vulić, I., Ó Séaghdha, D., Leviant, I., Reichart, R., Gašić, M., Korhonen, A., & Young, S. J. (2017) · arXiv (Cornell University) · doi:10.17863/cam.10174 · Cited by 37
Sense-aware semantic analysis: a multi-prototype word representation model using Wikipedia
Wu, Z., & Giles, C. L. (2015) · Cited by 35
Intrinsic Subspace Evaluation of Word Embedding Representations
Yaghoobzadeh, Y., & Schütze, H. (2016) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p16-1023 · Cited by 33
MUSE: Modularizing Unsupervised Sense Embeddings
Lee, G.-H., & Chen, Y.-N. (2017) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d17-1034 · Cited by 32
Biemann, C. (2006) · Cited by 32
A Robust Approach to Aligning Heterogeneous Lexical Resources
Pilehvar, M. T., & Roberto Navigli, A. (2014) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.3115/v1/p14-1044 · Cited by 30
Self-citationUnsupervised Does Not Mean Uninterpretable: The Case for Word Sense Induction and Disambiguation
Panchenko, A., Ruppert, E., Faralli, S., Ponzetto, S. P., & Biemann, C. (2017) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/e17-1009 · Cited by 29
Chen, T., Xu, R., He, Y., & Wang, X. (2015) · doi:10.3115/v1/p15-2003 · Cited by 28
Knowledge Base Unification via Sense Embeddings and Disambiguation
Bovi, C. D., Espinosa-Anke, L., & Roberto Navigli, A. (2015) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d15-1084 · Cited by 27
Unsupervised Translation Sense Clustering
Bansal, M., DeNero, J., & Lin, D. (2012) · Cited by 25
Unsupervised Learning of Distributional Relation Vectors
Bouraoui, Z., Jameel, S., & Schockaert, S. (2018) · ORCA Online Research @Cardiff (Cardiff University) · doi:10.18653/v1/p18-1003 · Cited by 21
Beyond Bilingual: Multi-sense Word Embeddings using Multilingual Context
Upadhyay, S., Chang, K.-W., Taddy, M. A., Kalai, A. T., & Zou, J. (2017) · Workshop on Representation Learning for NLP (RepL4NLP) · doi:10.18653/v1/w17-2613 · Cited by 21
Semantic web-mining and deep vision for lifelong object discovery
Young, J., Kunze, L., Basile, V., Cabrio, E., Hawes, N., & Barbara Caputo, B. (2017) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2017.7989323 · Cited by 20
Context-Dependent Sense Embedding
Qiu, L., Tu, K., & Yu, Y. H. (2016) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d16-1018 · Cited by 19
Sense-Aaware Semantic Analysis: A Multi-Prototype Word Representation Model Using Wikipedia
Wu, Z., & Giles, C. L. (2015) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v29i1.9496 · Cited by 19
Bilingual embeddings with random walks over multilingual wordnets
Goikoetxea, J., Soroa, A., & Agirre, E. (2018) · Knowledge-Based Systems · doi:10.1016/j.knosys.2018.03.017 · Cited by 18
SeVeN: Augmenting Word Embeddings with Unsupervised Relation VectorsPreprint
Espinosa-Anke, L., & Schockaert, S. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1808.06068 · Cited by 17
Best of Both Worlds: Making Word Sense Embeddings Interpretable
Panchenko, A. (2016) · Language Resources and Evaluation Conference (LREC) · doi:10.63317/28qikyxvfibj · Cited by 16
Inducing Embeddings for Rare and Unseen Words by Leveraging Lexical Resources
Pilehvar, M. T., & Collier, N. H. (2017) · Apollo (University of Cambridge) · doi:10.17863/cam.9211 · Cited by 16
Self-citationMapping Text to Knowledge Graph Entities using Multi-Sense LSTMsPreprint
Kartsaklis, D., Pilehvar, M. T., & Collier, N. (2018) · arXiv (Cornell University) · doi:10.17863/cam.35220 · Cited by 13
Self-citationVector Embedding of Wikipedia Concepts and Entities
Sherkat, E., & Milios, E. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-59569-6_50 · Cited by 12
Improving Cross-Lingual Word Embeddings by Meeting in the Middle
Doval, Y., Camacho-Collados, J., Espinosa-Anke, L., & Schockaert, S. (2018) · ORCA Online Research @Cardiff (Cardiff University) · doi:10.48550/arxiv.1808.08780 · Cited by 12
Self-citationSpot the Odd Man Out: Exploring the Associative Power of Lexical Resources
Stanovsky, G., & Hopkins, M. (2018) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d18-1182 · Cited by 9
Vector Embedding of Wikipedia Concepts and EntitiesPreprint
Sherkat, E., & Milios, E. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1702.03470 · Cited by 9
One Representation per Word - Does it make Sense for Composition?
Kober, T., Weeds, J., Wilkie, J., Reffin, J., & Weir, D. R. (2017) · doi:10.18653/v1/w17-1910 · Cited by 7
Detecting Asymmetric Semantic Relations in Context: A Case-Study on Hypernymy Detection
Vyas, Y., & Carpuat, M. J. (2017) · Joint Conference on Lexical and Computational Semantics · doi:10.18653/v1/s17-1004 · Cited by 6
Towards a unifying framework for conceptual represention and reasoning in cognitive systems
Lieto, A., Radicioni, D. P., Rho, V., & Mensa, E. (2017) · Intelligenza Artificiale · doi:10.3233/ia-170111 · Cited by 6
(1949) · Max Planck Digital Library
(2013)
Cited by
Günther, F., Rinaldi, L., & Marelli, M. (2019) · Perspectives on Psychological Science · doi:10.1177/1745691619861372 · Cited by 341
Evolution of Semantic Similarity—A Survey
Chandrasekaran, D., & Mago, V. (2022) · ACM Computing Surveys · doi:10.1145/3440755 · Cited by 303
A survey on aspect-based sentiment classification
Brauwers, G., & Frasincar, F. (2023) · ACM Computing Surveys · doi:10.1145/3503044 · Cited by 165
Debiasing pretrained text encoders by paying attention to paying attention
Gaci, Y., Benatallah, B., Casati, F., & Benabdeslem, K. (2022) · Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2022.emnlp-main.651 · Cited by 14
Nonlinear transformation of probabilities by large language models
Hintze, A., Bisht, C., Schossau, J., & Hertwig, R. (2025) · Computers in Human Behavior: Artificial Humans · doi:10.1016/j.chbah.2025.100227 · Cited by 1
Metadata
- Authors
- Camacho-Collados, J., & Pilehvar, M. T.
- Venue
- Journal of Artificial Intelligence Research
- Publisher
- AI Access Foundation
- Published
- 2018-12-06
- Volume
- 63
- Pages
- 743-788
- ISSN
- 1076-9757 (ISSN-L)
- OpenAlex
- W2799894091
- Cited by
- 363
- References
- 194
- FWCI
- 28.43
- Type
- journal article
- Language
- en
- Open access
- diamond
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.