The DOI matches its Crossref record; 20 of the 22 references it cites were found in a registry or an index.
Knowledge Graph and Text Jointly Embedding
Open accessAbstract
We examine the embedding approach to reason new relational facts from a largescale knowledge graph and a text corpus.We propose a novel method of jointly embedding entities and words into the same continuous vector space.The embedding process attempts to preserve the relations between entities in the knowledge graph and the concurrences of words in the text corpus.Entity names and Wikipedia anchors are utilized to align the embeddings of entities and words in the same space.Large scale experiments on Freebase and a Wikipedia/NY Times corpus show that jointly embedding brings promising improvement in the accuracy of predicting facts, compared to separately embedding knowledge graphs and text.Particularly, jointly embedding enables the prediction of facts containing entities out of the knowledge graph, which cannot be handled by previous embedding methods.At the same time, concerning the quality of the word embeddings, experiments on the analogical reasoning task show that jointly embedding is comparable to or slightly better than word2vec (Skip-Gram).
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“Inspired by these work, Rubinstein et al. [118] found that distributional word representations are good at predicting taxonomic properties (e.g., dog is an animal) but fail to learn attributive properties (e.g., swan is white).”
From Pre-trained models for natural language processing: A survey (2020) · cites this paper as [118]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Efficient Estimation of Word Representations in Vector Space
Mikolov, T., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1301.3781 · Cited by 26,568 · cited 16×
“NEG guarantees that maximizing Eq.”
BackgroundMethodInfluentialDistributed Representations of Words and Phrases and their Compositionality
Mikolov, T., Sutskever, I., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1310.4546 · Cited by 24,533
WordNet: a lexical database for English
Miller, G. A. (1995) · Communications of the ACM · doi:10.1145/219717.219748 · Cited by 14,015
(2013) · Cited by 5,726
Natural Language Processing (almost) from Scratch
Collobert, R., Weston, J., Bottou, L., Karlen, M., Kavukcuoglu, K., & Kuksa, P. P. (2011) · arXiv (Cornell University) · doi:10.48550/arxiv.1103.0398 · Cited by 4,962 · cited 1×
“Generally, word embeddings are learned from a given text corpus without supervision by predicting the context of each word or predicting the current word given its context (Bengio et al., 2003; Collobert et al., 2011; Mikolov et al., 2013a; Mikolov et al., 2013b).”
BackgroundFreebase: a collaboratively created graph database for structuring human knowledge
Bollacker, K., Evans, C., Paritosh, P., Sturge, T., & Taylor, J. (2008) · Proceedings of the 2008 ACM SIGMOD international conference on Management of data · doi:10.1145/1376616.1376746 · Cited by 4,852 · cited 12×
“Knowledge graphs such as Freebase (Bollacker et al., 2008) and WordNet (Miller, 1995) have become important resources for many AI & NLP applications such as Q & A.”
BackgroundInfluentialKnowledge Graph Embedding by Translating on Hyperplanes
Wang, Z., Zhang, J., Feng, J., & Chen, Z. (2014) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v28i1.8870 · Cited by 3,915 · cited 2×
“Recently, targeting knowledge graph completion, a promising paradigm of embedding was proposed, which is able to reason new facts only from the knowledge graph (Bordes et al., 2011; Bordes et al., 2013; Socher et al., 2013; Wang et al., 2014).”
BackgroundSelf-citationDistant supervision for relation extraction without labeled data
Mintz, M., Bills, S., Snow, R., & Jurafsky, D. (2009) · Proceedings of the Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLP: Volume 2 - ACL-IJCNLP '09 · doi:10.3115/1690219.1690287 · Cited by 2,752 · cited 3×
“For (Mintz et al., 2009), we use the implementation in (Surdeanu et al., 2012) 4 .”
BackgroundMethodA neural probabilistic language model
BengioYoshua, DucharmeRéjean, VincentPascal, & JanvinChristian (2003) · Journal of Machine Learning Research · doi:10.5555/944919.944966 · Cited by 2,644
Reasoning With Neural Tensor Networks for Knowledge Base Completion
Socher, R., Chen, D., Manning, C. D., & Ng, A. Y. (2013) · neural information processing systems · Cited by 2,228
Research works printed but not linked: 1
- Tomas Mikolov, Ilya Sutskever, Kai Chen, Greg S Cor- rado, and Jeff Dean. 2013b. Distributed representa- tions of words and phrases and their compositional- ity. In Advances in Neural Information Processing Systems 26, pages 3111-3119.
Cited by
A Survey on Knowledge Graphs: Representation, Acquisition, and Applications
Ji, S., Pan, S., Cambria, E., Marttinen, P., & Yu, P. S. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2021.3070843 · Cited by 2,947
Knowledge Graph Embedding: A Survey of Approaches and Applications
Wang, Q., Mao, Z., Wang, B., & Guo, L. (2017) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2017.2754499 · Cited by 2,654
“, entity types [25], [26], relation paths [27], [28], [29], textual descriptions [30], [31], [32], [33], and even logical rules [23], [34], [35], to learn more pre-”
BackgroundInfluentialPre-trained models for natural language processing: A survey
Qiu, X., Sun, T., Xu, Y., Shao, Y., Dai, N., & Huang, X. (2020) · Science China Technological Sciences · doi:10.1007/s11431-020-1647-3 · Cited by 1,591
“Early studies [197, 217, 201, 205] focused on learning knowledge graph embeddings and word embedding jointly.”
BackgroundERNIE: Enhanced Language Representation with Informative Entities
Zhang, Z., Han, X., Liu, Z., Jiang, X., Sun, M., & Liu, Q. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1139 · Cited by 1,482
“In fact, some work has attempted to joint representation learning of words and entities for effectively leveraging external KGs and achieved promising results (Wang et al., 2014; Toutanova et al., 2015; Han et al., 2016; Yamada et al., 2016; Cao et al., 2017, 2018).”
BackgroundA review: Knowledge reasoning over knowledge graph
Chen, X., Jia, S., & Xiang, Y. (2020) · Expert Systems with Applications · doi:10.1016/j.eswa.2019.112948 · Cited by 1,035
K-BERT: Enabling Language Representation with Knowledge Graph
Liu, W., Zhou, P., Zhao, Z., Wang, Z., Ju, Q., Deng, H., & Wang, P. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i03.5681 · Cited by 894
“Wang et al. (2014) proposed a novel method of jointly embedding entities and words into the same continuous vector space basing on the idea of word2vec (Mikolov et al. 2013).”
MethodSelf-citationKG-BERT: BERT for Knowledge Graph Completion
Yao, L., Mao, C., & Luo, Y. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1909.03193 · Cited by 366
“Text-enhanced models DKRL and SSP can also outperform structure only methods TransE and TransH.”
BackgroundMethodInfluentialRepresenting Text for Joint Embedding of Text and Knowledge Bases
Toutanova, K., Chen, D., Pantel, P., Poon, H., Choudhury, P., & Gamon, M. (2015) · Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d15-1174 · Cited by 750
“Wang et al. (2014a) combined knowledge base and text information by embedding knowledge base entities and the words in their names in the same vector space, but did not model the textual co-occurrences of entity pairs and the expressed textual relations.”
BackgroundMethodRepresentation Learning of Knowledge Graphs with Entity Descriptions
Xie, R., Liu, Z., Jia, J., Luan, H., & Sun, M. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v30i1.10329 · Cited by 725
“(Wang et al. 2014a) combines entity embeddings with word embeddings into a joint continuous vector space by alignment models using entity names or Wikipedia anchors.”
BackgroundMethodKEPLER: A Unified Model for Knowledge Embedding and Pre-trained Language Representation
Wang, X., Gao, T., Zhu, Z., Zhang, Z., Liu, Z., Li, J., & Tang, J. (2021) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00360 · Cited by 676
Knowledge Enhanced Contextual Word Representations
Peters, M. E., Neumann, M., Logan, R., Schwartz, R., Joshi, V., Singh, S., & Smith, N. A. (2019) · Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · doi:10.18653/v1/d19-1005 · Cited by 661
“These methods broadly fall into two categories: translational distance models (Bordes et al., 2013; Wang et al., 2014b; Lin et al., 2015; Xiao et al., 2016) which use a distance-based scoring function, and linear models (Nickel et al., 2011; Yang et al., 2014; Trouillon et al., 2016; Dettmers et…”
BackgroundMethodKnowledge Graph Embedding Based Question Answering
Huang, X., Zhang, J., Li, D., & Li, P. (2019) · Proceedings of the Twelfth ACM International Conference on Web Search and Data Mining · doi:10.1145/3289600.3290956 · Cited by 556
“Attempts [37, 38, 50] have also been made to apply TransE and word2vec [28] to model a KG and a corpus respectively, and then fuse them based on anchors in Wikipedia [38], entity descriptions [50], or contextual words of predicates/entities learned from the corpus [37].”
BackgroundMethodSelf-citationMulti-Task Feature Learning for Knowledge Graph Enhanced Recommendation
Wang, H., Zhang, F., Zhao, M., Li, W., Xie, X., & Guo, M. (2019) · The World Wide Web Conference · doi:10.1145/3308558.3313411 · Cited by 535
“ified into the following two categories: (1) Translational distance models exploit distance-based scoring functions when learning representations of entities and relations, such as TransE [2], TransH [35], and TransR [13]; (2) Semantic matching models measure plausibility of knowledge triples by matching latent semant…”
BackgroundMethodNatural language processing applied to mental illness detection: a narrative review
Zhang, T., Schoene, A. M., Ji, S., & Ananiadou, S. (2022) · npj Digital Medicine · doi:10.1038/s41746-022-00589-7 · Cited by 476
“Other emerging techniques like attention mechanism 187 , knowledge graph 188 , and commonsense reasoning 189 , can also be introduced for textual feature extraction.”
BackgroundFrom Word To Sense Embeddings: A Survey on Vector Representations of Meaning
Camacho-Collados, J., & Pilehvar, M. T. (2018) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.11259 · Cited by 363
Distant Supervision for Relation Extraction with Sentence-Level Attention and Entity Descriptions
Ji, G., Liu, K., He, S., & Zhao, J. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.10953 · Cited by 357
“Another line is to introduce external semantic repositories such as knowledge graphs (Weston et al. 2013; Wang et al. 2014).”
BackgroundJoint Learning of the Embedding of Words and Entities for Named Entity Disambiguation
Yamada, I., Shindo, H., Takeda, H., & Takefuji, Y. (2016) · Proceedings of The 20th SIGNLL Conference on Computational Natural Language Learning · doi:10.18653/v1/k16-1025 · Cited by 332
“Particularly, Wang et al. (Wang et al., 2014) have recently revealed that the joint modeling of the embedding of words and entities can improve performance in several tasks including the link prediction task, which is somewhat analogous to our experimental results.”
ResultImage-embodied Knowledge Representation Learning
Xie, R., Liu, Z., Luan, H., & Sun, M. (2017) · Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2017/438 · Cited by 268
A survey on incorporating domain knowledge into deep learning for medical image analysis
Xie, X., Niu, J., Liu, X., Chen, Z., Tang, S., & Yu, S. (2021) · Medical Image Analysis · doi:10.1016/j.media.2021.101985 · Cited by 311
Self-citationKnowledge Transfer for Out-of-Knowledge-Base Entities : A Graph Neural Network Approach
Hamaguchi, T., Oiwa, H., Shimbo, M., & Matsumoto, Y. (2017) · Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2017/250 · Cited by 291
Structure-Augmented Text Representation Learning for Efficient Knowledge Graph Completion
Wang, B., Shen, T., Long, G., Zhou, T., Wang, Y., & Chang, Y. (2021) · Proceedings of the Web Conference 2021 · doi:10.1145/3442381.3450043 · Cited by 213
“Typically, they either use text embeddings to represent entities/relations and align heterogeneous representations into the same space [37, 39, 43], or employ largescale raw corpora containing co-occurrence of entities to enrich the graph embeddings [42].”
BackgroundResultRepresentation learning of knowledge graphs with hierarchical types
Xie, R., Liu, Z., & Sun, M. (2016) · International Joint Conference on Artificial Intelligence · Cited by 394
Iteratively Learning Embeddings and Rules for Knowledge Graph Reasoning
Zhang, W., Paudel, B., Wang, L., Chen, J., Zhu, H., Zhang, W., Bernstein, A., & Chen, H. (2019) · The World Wide Web Conference · doi:10.1145/3308558.3313612 · Cited by 163
“rning, while other assumptions or neural network models don’t have. Besides triples in KGs, some embedding methods also utilize other information during learning, for examples, entity descriptions in [40][43][39][42], entity types in [12][45], entity images in [44], and paths in [11][21][25], which can be regarded as…”
BackgroundCoLAKE: Contextualized Language and Knowledge Embedding
Sun, T., Shao, Y., Qiu, X., Guo, Q., Hu, Y., Huang, X., & Zhang, Z. (2020) · Proceedings of the 28th International Conference on Computational Linguistics · doi:10.18653/v1/2020.coling-main.327 · Cited by 185
SSP: Semantic Space Projection for Knowledge Graph Embedding with Text Descriptions
Xiao, H., Huang, M., Meng, L., & Zhu, X. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.10952 · Cited by 172
Yamada, I., Asai, A., Sakuma, J., Shindo, H., Takeda, H., Takefuji, Y., & Matsumoto, Y. (2020) · Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing: System Demonstrations · doi:10.18653/v1/2020.emnlp-demos.4 · Cited by 164
“Additionally, there have been various relational embedding models proposed (Bordes et al., 2013; Wang et al., 2014; Lin et al., 2015) that aim to learn the entity representations that are particularly effective for knowledge graph completion tasks.”
BackgroundSTransE: a novel embedding model of entities and relationships in knowledge bases
Nguyen, D. Q., Sirts, K., Qu, L., & Johnson, M. (2016) · Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.18653/v1/n16-1054 · Cited by 177
Enriching contextualized language model from knowledge graph for biomedical information extraction
Fei, H., Ren, Y., Zhang, Y., Ji, D., & Liang, X. (2021) · Briefings in Bioinformatics · doi:10.1093/bib/bbaa110 · Cited by 172
Text-enhanced representation learning for knowledge graph
Wang, Z., & Li, J. (2016) · International Joint Conference on Artificial Intelligence · Cited by 240
Self-citationBeyond Triplets: Hyper-Relational Knowledge Graph Embedding for Link Prediction
Rosso, P., Yang, D., & Cudré-Mauroux, P. (2020) · International World Wide Web Conference (WWW) · doi:10.1145/3366423.3380257 · Cited by 223
“Second, some related techniques learn entity/relation embeddings from triplets in a KG jointly with third-party data sources, in particular with text (e.g., Wikipedia articles) [6, 10, 15, 29, 33, 36, 42, 43, 47, 50].”
BackgroundAligning Knowledge and Text Embeddings by Entity Descriptions
Zhong, H., Zhang, J., Wang, Z., Wan, H., & Chen, Z. (2015) · Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d15-1031 · Cited by 163
“It is used in (Socher et al., 2013; Wang et al., 2014b; Wang et al., 2014a).”
BackgroundMethodResultInfluentialSelf-citationExploring Large Language Models for Knowledge Graph Completion
Yao, L., Peng, J., Mao, C., & Luo, Y. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10889242 · Cited by 207
“[ 29] suggested embedding entities and words in the same vector space by aligning Wikipedia anchors with entity names.”
Neural Knowledge Acquisition via Mutual Attention Between Knowledge Graph and Text
Han, X., Liu, Z., & Sun, M. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11927 · Cited by 168
Machine Knowledge: Creation and Curation of Comprehensive Knowledge Bases
Weikum, G., Dong, X. L., Razniewski, S., & Suchanek, F. M. (2021) · Foundations and Trends in Databases · doi:10.1561/1900000064 · Cited by 202
Encoding Temporal Information for Time-Aware Link Prediction
Jiang, T., Liu, T., Ge, T., Sha, L., Li, S., Chang, B., & Sui, Z. (2016) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d16-1260 · Cited by 169
“Many models have been proposed for KB embedding (Nickel et al., 2011; Bordes et al., 2013; Socher et al., 2013 2013; Wang et al., 2014a; Zhao et al., 2015), entity type and relationship domain (Guo et al., 2015; Chang et al., 2014), and relation path (Lin et al., 2015a; Gu et al., 2015).”
BackgroundMethodSong, M., Park, H., & Shin, K.-S. (2019) · Information Processing & Management · doi:10.1016/j.ipm.2018.12.005 · Cited by 163
Knowledge Enhanced Contextual Word RepresentationsPreprint
Peters, M. E., Neumann, M., Logan, R. L., Schwartz, R., Joshi, V., Singh, S., & Smith, N. A. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1909.04164 · Cited by 149
“These methods broadly fall into two categories: translational distance models (Bordes et al., 2013; Wang et al., 2014b; Lin et al., 2015; Xiao et al., 2016) which use a distance-based scoring function, and linear models (Nickel et al., 2011; Yang et al., 2014; Trouillon et al., 2016; Dettmers et…”
BackgroundMethodTowards Time-Aware Knowledge Graph Completion
Jiang, T., Liu, T., Ge, T., Sha, L., Chang, B., Li, S., & Sui, Z. (2016) · International Conference on Computational Linguistics · Cited by 242
Knowledge Base Completion with Out-of-Knowledge-Base Entities: A Graph Neural Network Approach
Hamaguchi, T., Oiwa, H., Shimbo, M., & Matsumoto, Y. (2018) · Transactions of the Japanese Society for Artificial Intelligence · doi:10.1527/tjsai.f-h72 · Cited by 133
Knowledge Graph Representation with Jointly Structural and Textual Encoding
Xu, J., Qiu, X., Chen, K., & Huang, X. (2017) · Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2017/183 · Cited by 121
Knowledge graph embedding with concepts
Guan, N., Song, D., & Liao, L. (2018) · Knowledge-Based Systems · doi:10.1016/j.knosys.2018.10.008 · Cited by 121
Cross-lingual Wikification Using Multilingual Embeddings
Tsai, C.-T., & Roth, D. (2016) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n16-1072 · Cited by 110
“We adopt the “Alignment by Wikipedia Anchors” model proposed in Wang et al. (2014).”
MethodCommunicative Message Passing for Inductive Relation Reasoning
Mai, S., Zheng, S., Yang, Y., & Hu, H. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i5.16554 · Cited by 151
Luca, A. R., Ursuleanu, T. F., Gheorghe, L., Grigorovici, R., Iancu, S., Hlusneac, M., & Grigorovici, A. (2022) · Informatics in Medicine Unlocked · doi:10.1016/j.imu.2022.100911 · Cited by 122
Multi-source knowledge fusion: a survey
Zhao, X., Jia, Y., Li, A., Jiang, R., & Song, Y. (2020) · World Wide Web · doi:10.1007/s11280-020-00811-0 · Cited by 120
Dict2vec : Learning Word Embeddings using Lexical Dictionaries
Tissier, J., Gravier, C., & Habrard, A. (2017) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d17-1024 · Cited by 141
“Recent approaches have proposed to tackle this issue using an attentive model for context selection (Ling et al., 2015), or by us-ing external sources – like knowledge graphs – in order to improve the embeddings (Wang et al., 2014).”
BackgroundMethodRepresentation Learning for Natural Language Processing
Liu, Z., Lin, Y., & Sun, M. (2020) · Springer eBooks · doi:10.1007/978-981-15-5573-2 · Cited by 140
Leveraging Deep Neural Networks and Knowledge Graphs for Entity DisambiguationPreprint
Huang, H., Heck, L. P., & Ji, H. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1504.07678 · Cited by 104
“Some recent work learned distributed representations for entities directly from KGs for semantic parsing (Bordes et al., 2012), link prediction (Bordes et al., 2013; Socher et al., 2013; Wang et al., 2014; Lin et al., 2015), and question answering (Bordes et al., 2014; Yang et al., 2014).”
BackgroundKnowledge graph informed fake news classification via heterogeneous representation ensembles
Koloski, B., Stepišnik-Perdih, T., Robnik‐Šikonja, M., Pollak, S., & Škrlj, B. (2022) · Neurocomputing · doi:10.1016/j.neucom.2022.01.096 · Cited by 101
“[10] reported that such approaches can introduce significant improvement; with the increase of the newer methods and mechanisms popular in NLP today we believe this is a promising research venue.”
BackgroundBridge Text and Knowledge by Learning Multi-Prototype Entity Mention Embedding
Cao, Y., Huang, L., Ji, H., Chen, X., & Li, J. (2017) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p17-1149 · Cited by 97
“Though following the basic components of three models in (Wang et al., 2014; Yamada et al., 2016), MPME designs different structure in text model and joint model to combine text and knowledge in phrase level via multi-prototype mention embedding, rather than aligning between singleprototype word…”
BackgroundMethodInfluentialLearning Distributed Representations of Texts and Entities from Knowledge Base
Yamada, I., Shindo, H., Takeda, H., & Takefuji, Y. (2017) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00069 · Cited by 96
Lastra-Díaz, J. J., Goikoetxea, J., Taieb, M. A. H., García-Serrano, A. M., Aouicha, M. B., & Agirre, E. (2019) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2019.07.010 · Cited by 104
“…(1) the joint approach, in which the loss function of the text-based model is extended to include relational constraints (Halawi et al., 2012; Wang et al., 2014a; Yu and Dredze, 2014; Xu et al., 2014; Bian et al., 2014; Kiela et al., 2015; Aletras and Stevenson, 2015; Liu et al., 2015;…”
InfluentialKnowledge graph enhanced neural collaborative recommendation
Sang, L., Xu, M. G., Qian, S., & Wu, X. (2020) · Expert Systems with Applications · doi:10.1016/j.eswa.2020.113992 · Cited by 91
Knowledge representation learning with entities, attributes and relations
Lin, Y., Liu, Z., & Sun, M. (2016) · International Joint Conference on Artificial Intelligence · Cited by 122
A survey on knowledge graph embeddings with literals: Which model links better literal-ly?
Gesese, G. A., Biswas, R., Alam, M., & Sack, H. (2020) · Semantic Web · doi:10.3233/sw-200404 · Cited by 119
Entity Disambiguation by Knowledge and Text Jointly Embedding
Fang, W., Zhang, J., Wang, D., Chen, Z., & Li, M. (2016) · Conference on Computational Natural Language Learning · doi:10.18653/v1/k16-1026 · Cited by 83
“Alignment by Wikipedia Anchors (Wang et al., 2014a).”
BackgroundMethodInfluentialSelf-citationYamada, I., Asai, A., Sakuma, J., Shindo, H., Takeda, H., Takefuji, Y., & Matsumoto, Y. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1812.06280 · Cited by 81
Embedding Words and Senses Together via Joint Knowledge-Enhanced Training
Mancini, M., Camacho-Collados, J., Iacobacci, I., & Navigli, R. (2017) · Conference on Computational Natural Language Learning · doi:10.18653/v1/k17-1012 · Cited by 93
Corpus-level Fine-grained Entity Typing Using Contextual Information
Yaghoobzadeh, Y., & Schütze, H. (2015) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d15-1083 · Cited by 90
“, 2013) while others use a combination of within-KB generalization and information extraction from text (Weston et al., 2013; Socher et al., 2013; Jiang et al., 2012; Riedel et al., 2013; Wang et al., 2014).”
BackgroundQuestion Answering over Knowledge Base using Factual Memory Networks
Jain, S. (2016) · doi:10.18653/v1/n16-2016 · Cited by 79
“We pre-train our word vectors using method described by (Wang et al., 2014) to initialize our embeddings.”
MethodKnowledge Graph Embeddings and Explainable AI
Bianchi, F., Rossiello, G., Luca, C., Palmonari, M., & Minervini, P. (2020) · Studies on the semantic web · doi:10.3233/ssw200011 · Cited by 100
“Jointly [95] is an embedding method in which textual knowledge is used to enrich the representation of entities and relationships.”
BackgroundMethodTang, X., Chen, L., Cui, J., & Wei, B. (2019) · Information Processing & Management · doi:10.1016/j.ipm.2019.01.005 · Cited by 66
A Semantic-aware Representation Framework for Online Log Analysis
Meng, W., Liu, Y., Huang, Y., Zhang, S., Zaiter, F., Chen, B. J., & Pei, D. (2020) · International Conference on Computer Communications and Networks (ICCCN) · doi:10.1109/icccn49398.2020.9209707 · Cited by 80
“TransE model [19] is the most effective representation method for triples.”
Random Walks and Neural Network Language Models on Knowledge Bases
Goikoetxea, J., Soroa, A., & Agirre, E. (2015) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.3115/v1/n15-1165 · Cited by 71
“…explored embedding KBs in low-dimensional continous vector spaces, representing each entity in a k-dimensional vector and characterizing typed relations between entities in the KB (e.g. born-in-city in Freebase or part-of in Word-Net) as operations in the k-dimensional space (Wang et al., 2014).”
BackgroundNoise Mitigation for Neural Entity Typing and Relation Extraction
Yaghoobzadeh, Y., Adel, H., & Schütze, H. (2017) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/e17-1111 · Cited by 83
Hu, Z., Huang, P.-Y., Deng, Y., Gao, Y., & Xing, E. P. (2015) · doi:10.3115/v1/p15-1125 · Cited by 68
“Though recent knowledge graph embeddings (Lin et al., 2015; Wang et al., 2014) integrate the relational structure among entities, they primarily target at link prediction and lack an explicit relatedness measure.”
BackgroundInferring Affective Meanings of Words from Word Embedding
Li, M., Lu, Q., Long, Y., & Gui, L. (2017) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2017.2723012 · Cited by 74
“More comprehensive studies use more kinds of contexts and knowledge base are explored to improve word embedding including the use of cross-lingual context [59], word definition context, knowledge base context [60], morphology context [61], and word embedding frommulti-views ormulti-resources [62], [63].”
BackgroundDevelopment of process safety knowledge graph: A Case study on delayed coking process
Mao, S., Zhao, Y., Chen, J., Wang, B., & Tang, Y. S. (2020) · Computers & Chemical Engineering · doi:10.1016/j.compchemeng.2020.107094 · Cited by 72
Li, Y., Zheng, R., Tian, T., Hu, Z., Iyer, R., & Sycara, K. P. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1605.03924 · Cited by 81
“Knowledge graph embedding methods (Wang et al., 2014; Lin et al., 2015) give embeddings of entities and relations but lack category representations and relatedness measure.”
MethodEmbedding Learning with Events in Heterogeneous Information Networks
Gui, H., Liu, J., Tao, F., Jiang, M., Norick, B., Kaplan, L., & Han, J. (2017) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2017.2733530 · Cited by 65
“Another line of research is embedding learning in Knowledge Bases (KBs) [41], [42], [43], [44], [45], which is also relevant to embedding learning in HINs.”
Combining Two and Three-Way Embedding Models for Link Prediction in Knowledge Bases
García-Durán, A., Bordes, A., Usunier, N., & Grandvalet, Y. (2016) · Journal of Artificial Intelligence Research · doi:10.1613/jair.5013 · Cited by 66
Exploiting Structured Knowledge in Text via Graph-Guided Representation Learning
Shen, T., Mao, Y., He, P., Long, G., Trischler, A., & Chen, W. (2020) · Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.722 · Cited by 63
Knowledge Representation Learning: A Quantitative ReviewPreprint
Lin, Y., Han, X., Xie, R., Liu, Z., & Sun, M. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1812.10901 · Cited by 73
“[70, 71] propose jointly learning both entities and words embeddings by projecting them into the a unified semantic space, which aligns the entities and word embeddings using entity names, descriptions and Wikipedia anchors.”
BackgroundRepresentation Learning for Natural Language Processing
Liu, Z., Lin, Y., & Sun, M. (2023) · Springer eBooks · doi:10.1007/978-981-99-1600-9 · Cited by 79
Incorporating Knowledge Graph Embeddings into Topic Modeling
Yao, L., Zhang⋆, Y., Wei, B., Jin, Z., Zhang, R., Zhang, Y., & Chen, Q. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.10951 · Cited by 60
“Knowledge graph embedding aims at embedding entities and relationships of knowledge graphs in vector spaces (Bordes et al. 2011; 2013; Wang et al. 2014b; 2014a; Guo et al. 2015; Xie et al. 2016).”
Application and evaluation of knowledge graph embeddings in biomedical data
Alshahrani, M., Thafar, M. A., & Essack, M. (2021) · PeerJ Computer Science · doi:10.7717/peerj-cs.341 · Cited by 68
“Subsequently Wang et al. (2014) showed the effective utilization of both structured and unstructured information by aligning the KG corpus with the text corpus in a joint model and de fi ning an aggregated loss for both representations.”
BackgroundMethodInfluentialChallenges, Techniques, and Trends of Simple Knowledge Graph Question Answering: A Survey
Yani, M., & Krisnadhi, A. A. (2021) · Information · doi:10.3390/info12070271 · Cited by 72
“…string matching mentions (ED, EP, RP, AM, SS) 75.7 He and Golub [42] 2016 LSTM and temporal CNN as encoder and LSTM with attention as decoder, or direct query construction (EP, RP, AM) 70.9 Lukovnikov et al. [43] 2017 GRU, GRU, string matching mentions, direct query construction (EP, RP, SS, AM)”
InfluentialDeep learning approach on information diffusion in heterogeneous networks
Molaei, S., Zare, H., & Veisi, H. (2019) · Knowledge-Based Systems · doi:10.1016/j.knosys.2019.105153 · Cited by 59
“Various studies have been conducted on homogeneous networks including semantic parsing [15], control of epidemic diseases [16, 17] and link prediction [18, 19, 20].”
BackgroundSingle or Multiple? Combining Word Representations Independently Learned from Text and WordNet
Goikoetxea, J., Agirre, E., & Soroa, A. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v30i1.10321 · Cited by 61
“…Socher, and Manning 2014; Huang et al. 2012) and use flat lists of relations from KBs to either modify the learning algorithms (Halawi et al. 2012; Wang et al. 2014a; Tian et al. 2015; Rastogi, Van Durme, and Copyright c© 2016, Association for the Advancement of Artificial Intelligence…”
MethodNeuPL: Attention-based Semantic Matching and Pair-Linking for Entity Disambiguation
Phan, M. C., Sun, A., Tay, Y., Han, J., & Li, C. (2017) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3132847.3132963 · Cited by 66
“Jointly modeling words and entities in the same continuous space have been shown to improve the quality of both word and entity embeddings [46] and benefit entity disambiguation task [10, 47].”
BackgroundSemantic Concept Spaces: Guided Topic Model Refinement using Word-Embedding Projections
El‐Assady, M., Kehlbeck, R., Collins, C. M., Keim, D. A., & Deußen, O. (2019) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2019.2934654 · Cited by 56
“xxxxxxx edge representations in accessible formats has sparked a bustling research area [56] at the intersection of linguistics and machine learning.”
BackgroundAnticipating Stock Market of the Renowned Companies: A Knowledge Graph Approach
Liu, Y., Zeng, Q., Ordieres-Meré, J. B., & Yang, H. (2019) · Complexity · doi:10.1155/2019/9202457 · Cited by 61
Mapping Text to Knowledge Graph Entities using Multi-Sense LSTMs
Kartsaklis, D., Pilehvar, M. T., & Collier, N. (2018) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d18-1221 · Cited by 66
“The idea of using textual features to improve the entity vectors is not well explored, and most of the existing work focuses again on the representation of relations (Xie et al., 2016; Wang et al., 2014; Wang and Li, 2016) as opposed to entities.”
BackgroundMelluso, N., Grangel-González, I., & Fantoni, G. (2022) · Computers in Industry · doi:10.1016/j.compind.2022.103676 · Cited by 53
Weakly-supervised Relation Extraction by Pattern-enhanced Embedding Learning
Qu, M., Ren, X., Zhang, Y., & Han, J. (2018) · International World Wide Web Conference (WWW) · doi:10.1145/3178876.3186024 · Cited by 66
Shuang, K., Zhang, Z., Loo, J., & Su, S. (2019) · Information Fusion · doi:10.1016/j.inffus.2019.06.009 · Cited by 54
TransRHS: A Representation Learning Method for Knowledge Graphs with Relation Hierarchical Structure
Zhang, F., Wang, X., Li, Z., & Li, J. (2020) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2020/413 · Cited by 56
Incorporating World Knowledge to Document Clustering via Heterogeneous Information Networks
Wang, C., Song, Y., El-Kishky, A., Roth, D., Zhang, M., & Han, J. (2015) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/2783258.2783374 · Cited by 57
“People have found it useful to use world knowledge as distant supervision for entity and relation extraction and embedding [25, 39, 41].”
BackgroundRelation Learning on Social Networks with Multi-Modal Graph Edge Variational Autoencoders
Yang, C., Zhang, J., Wang, H., Li, S., Kim, M., Walker, M., Xiao, Y., & Han, J. (2020) · ACM International Conference on Web Search and Data Mining (WSDM) · doi:10.1145/3336191.3371829 · Cited by 58
“of relation learning has been intensively studied in knowledge graph completion and relation extraction. Some existing works rely more on the reasoning over existing knowledge graphs with typed links [2, 9, 29, 40, 41], while others leverage more on the modeling of textual contexts with weak supervision [13, 20, 22, 3…”
BackgroundSelf-citationMulti-Task Neural Network for Non-discrete Attribute Prediction in Knowledge Graphs
Tay, Y., Tuan, L. A., Phan, M. C., & Hui, S. C. (2017) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3132847.3132937 · Cited by 62
“For example, a recently fashionable line of research is concerned with joint representations of textual information with knowledge graphs [34, 35, 40].”
BackgroundPair-Linking for Collective Entity Disambiguation: Two Could Be Better Than All
Phan, M. C., Sun, A., Tay, Y., Han, J., & Li, C. (2018) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2018.2857493 · Cited by 48
Embeddings in Natural Language Processing: Theory and Advances in Vector Representations of Meaning
Pilehvar, M. T., & Camacho-Collados, J. (2020) · Synthesis lectures on human language technologies · doi:10.2200/s01057ed1v01y202009hlt047 · Cited by 88
Distributed representation learning for knowledge graphs with entity descriptions
Fan, M., Zhou, Q., Zheng, T. F., & Grishman, R. (2016) · Pattern Recognition Letters · doi:10.1016/j.patrec.2016.09.005 · Cited by 44
“Several open questions that we cannot answer with RLKB are expected to explore in the future, such as how to discriminate the embeddings of multi-relations between two entities (Wang et al., 2014b), or how to model the knowledge described by a sequence of relations (Garcı́a-Durán et al., 2015).”
BackgroundInfluentialCross-modal Knowledge Graph Contrastive Learning for Machine Learning Method Recommendation
Cao, X., Shi, Y., Wang, J., Yu, H., Wang, X., & Yan, Z. (2022) · Proceedings of the 30th ACM International Conference on Multimedia · doi:10.1145/3503161.3548273 · Cited by 38
“To exploit multi-modal information, previous studies have incorporated text descriptions [27, 29], relationship types [12, 31], and visual information [30] into knowledge graphs to obtain more effective knowledge representations.”
MethodJoint Representation Learning of Text and Knowledge for Knowledge Graph CompletionPreprint
Han, X., Liu, Z., & Sun, M. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.04125 · Cited by 45
Combining Word and Entity Embeddings for Entity Linking
Moreno, J. G., Besançon, R., Beaumont, R., D’hondt, E., Ligozat, A., Rosset, S., Tannier, X., & Grau, B. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-58068-5_21 · Cited by 42
“However, like for [27], these works do not directly use the context of an entity mention to built the vector representation but use an alignment function to achieve some matching between the mention and the entity.”
BackgroundMethodInfluentialJoint Representation Learning of Cross-lingual Words and Entities via Attentive Distant Supervision
Cao, Y., Hou, L., Li, J., Liu, Z., Li, C., Chen, X., & Dong, T. (2018) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d18-1021 · Cited by 42
Identifying influential nodes in heterogeneous networks
Molaei, S., Farahbakhsh, R., Salehi, M., & Crespi, N. (2020) · Expert Systems with Applications · doi:10.1016/j.eswa.2020.113580 · Cited by 41
Knowledge Graphs and Big Data Processing
Janev, V., Graux, D., Jabeen, H., & Sallinger, E. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-53199-7 · Cited by 48
“TransH [462] is en extension of TransE, which addresses the limitations of TransE in modeling N-M relations.”
Background
Metadata
- Authors
- Wang, Z., Zhang, J., Feng, J., & Chen, Z.
- Affiliations
- Sun Yat-sen University (CN)
- Venue
- Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP)
- Published
- 2014
- Pages
- 1591-1601
- OpenAlex
- W2158028897
- Cited by
- 406
- References
- 22
- Citations by year
- 2026: 4 · 2025: 10 · 2024: 20 · 2023: 22 · 2022: 25 · 2021: 46 · 2020: 66 · 2019: 53 · 2018: 62 · 2017: 45 · 2016: 38 · 2015: 14
- FWCI
- 18.87
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- Locations
- Conference on Empirical Methods in Natural Language Processing (EMNLP) (publishedVersion, cc-by)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Advanced Graph Neural Networks
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
- Keywords
- knowledge graph embedding, knowledge graph completion, word embeddings, analogical reasoning, Freebase, Word2Vec comparison
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.