Biological applications of knowledge graph embedding models
Open accessThe DOI matches its Crossref record; 28 of the 28 references it cites were found in a registry or an index.
Abstract
Complex biological systems are traditionally modelled as graphs of interconnected biological entities. These graphs, i.e. biological knowledge graphs, are then processed using graph exploratory approaches to perform different types of analytical and predictive tasks. Despite the high predictive accuracy of these approaches, they have limited scalability due to their dependency on time-consuming path exploratory procedures. In recent years, owing to the rapid advances of computational technologies, new approaches for modelling graphs and mining them with high accuracy and scalability have emerged. These approaches, i.e. knowledge graph embedding (KGE) models, operate by learning low-rank vector representations of graph nodes and edges that preserve the graph’s inherent structure. These approaches were used to analyse knowledge graphs from different domains where they showed superior performance and accuracy compared to previous graph exploratory approaches. In this work, we study this class of models in the context of biological knowledge graphs and their different applications. We then show how KGE models can be a natural fit for representing complex biological knowledge modelled as graphs. We also discuss their predictive and analytical capabilities in different biology applications. In this regard, we present two example case studies that demonstrate the capabilities of KGE models: prediction of drug–target interactions and polypharmacy side effects. Finally, we analyse different practical considerations for KGEs, and we discuss possible opportunities and challenges related to adopting them for modelling biological systems.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Tissue-based map of the human proteome
Uhlén, M., Fagerberg, L., Hallström, B. M., Lindskog, C., Oksvold, P., Mardinoglu, A., Sivertsson, Å., Kampf, C., Sjöstedt, E., Asplund, A., et al. (2015) · Science · doi:10.1126/science.1260419 · Cited by 15,286
WordNet: a lexical database for English
Miller, G. A. (1995) · Communications of the ACM · doi:10.1145/219717.219748 · Cited by 14,015 · cited 1×
“They were also used to model data from different types of domains such as general human knowledge [35], lexical information [36] and biological systems [12].”
Methodnode2vec: Scalable Feature Learning for Networks
Grover, A., & Leskovec, J. (2016) · Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2939672.2939754 · Cited by 10,926 · cited 1×
“The Deep-Walk [65], Node2Vec [66], etc are uni-relational graphs embedding methods, thus, they we do not include them in this study.”
MethodDeepWalk: online learning of social representations
Perozzi, B., Al-Rfou, R., & Skiena, S. (2014) · Proceedings of the 20th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/2623330.2623732 · Cited by 10,123
KEGG: new perspectives on genomes, pathways, diseases and drugs
Kanehisa, M., Furumichi, M., Tanabe, M., Sato, Y., & Morishima, K. (2017) · Nucleic Acids Research · doi:10.1093/nar/gkw1092 · Cited by 8,865
Network biology: understanding the cell's functional organization
Barabási, A.-L., & Oltvai, Z. N. (2004) · Nature Reviews Genetics · doi:10.1038/nrg1272 · Cited by 7,903
KEGG as a reference resource for gene and protein annotation
Kanehisa, M., Sato, Y., Kawashima, M., Furumichi, M., & Tanabe, M. (2016) · Nucleic Acids Research · doi:10.1093/nar/gkv1070 · Cited by 7,387
Szklarczyk, D., Morris, J. H., Cook, H., Kuhn, M., Wyder, S., Simonovic, M., Santos, A., Doncheva, N. T., Roth, A., Bork, P., et al. (2017) · Nucleic Acids Research · doi:10.1093/nar/gkw937 · Cited by 6,980
Practical Bayesian Optimization of Machine Learning Algorithms
Snoek, J., Larochelle, H., & Adams, R. P. (2012) · arXiv · doi:10.48550/arxiv.1206.2944 · Cited by 6,691
LINE: Large-scale Information Network Embedding
Tang, J., Qu, M., Wang, M., Zhang, M., Yan, J., & Mei, Q. (2015) · Proceedings of the 24th International Conference on World Wide Web · doi:10.1145/2736277.2741093 · Cited by 5,416 · cited 2×
“They have also examined other different approaches such as the LINE model [87] which uses a composite learning technique where it learns half of the embeddings’ dimensions from the direct neighbour nodes, and the other half from the second hop connected neighbours.”
MethodThe Gene Ontology Resource: 20 years and still GOing strong
The Gene Ontology Consortium (2019) · Nucleic Acids Research · doi:10.1093/nar/gky1055 · Cited by 4,747
DrugBank: a comprehensive resource for in silico drug discovery and exploration
Wishart, D. S. (2006) · Nucleic Acids Research · doi:10.1093/nar/gkj067 · Cited by 3,892
Fagerberg, L., Hallström, B. M., Oksvold, P., Kampf, C., Djureinovic, D., Odeberg, J., Habuka, M., Tahmasebpoor, S., Danielsson, A., Edlund, K., et al. (2014) · Molecular & Cellular Proteomics · doi:10.1074/mcp.m113.035600 · Cited by 3,665
ClinVar: public archive of relationships among sequence variation and human phenotype
Landrum, M. J., Lee, J. M., Riley, G. R., Jang, W., Rubinstein, W. S., Church, D. M., & Maglott, D. R. (2014) · Nucleic Acids Research · doi:10.1093/nar/gkt1113 · Cited by 3,516
How many drug targets are there?
Overington, J. P., Al-Lazikani, B., & Hopkins, A. L. (2006) · Nature Reviews Drug Discovery · doi:10.1038/nrd2199 · Cited by 3,505
Knowledge Graph Embedding: A Survey of Approaches and Applications
Wang, Q., Mao, Z., Wang, B., & Guo, L. (2017) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2017.2754499 · Cited by 2,654 · cited 2×
“Multiple studies have explored knowledge graph embedding (KGE) models, their technical design, training objectives and predictive capabilities on general benchmarking settings [15, 24, 59].”
BackgroundConvolutional 2D Knowledge Graph Embeddings
Dettmers, T., Minervini, P., Stenetorp, P., & Riedel, S. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11573 · Cited by 2,486
Embedding Entities and Relations for Learning and Inference in Knowledge Bases
Yang, B., Yih, W.-T., He, X., Gao, J., & Deng, L. (2014) · arXiv · doi:10.48550/arxiv.1412.6575 · Cited by 2,252 · cited 10×
“However, the growth rate of the TransE and DistMult models is considerably smaller than the growth of both the ComplEx and TriModel models.”
BackgroundMethodInfluentialComplex Embeddings for Simple Link Prediction
Trouillon, T., Welbl, J., Riedel, S., Gaussier, É., & Bouchard, G. (2016) · arXiv · doi:10.48550/arxiv.1606.06357 · Cited by 2,100
Modeling polypharmacy side effects with graph convolutional networks
Zitnik, M., Agrawal, M., & Leskovec, J. (2018) · Bioinformatics · doi:10.1093/bioinformatics/bty294 · Cited by 1,501
Trends in Prescription Drug Use Among Adults in the United States From 1999-2012
Kantor, E. D., Rehm, C. D., Haas, J. S., Chan, A. T., & Giovannucci, E. L. (2015) · JAMA · doi:10.1001/jama.2015.13766 · Cited by 1,219
Observed versus latent features for knowledge base and text inference
Toutanova, K., & Chen, D. (2015) · Proceedings of the 3rd Workshop on Continuous Vector Space Models and their Compositionality · doi:10.18653/v1/w15-4007 · Cited by 1,070
Data-driven prediction of drug effects and interactions
Tatonetti, N. P., Ye, P. P., Daneshjou, R., & Altman, R. B. (2012) · Science Translational Medicine · doi:10.1126/scitranslmed.3003377 · Cited by 936 · cited 2×
“The drug side-effects represented in the dataset are collected from the SIDER (Side Effect Resource) database [47] and the OFFSIDES and TWOSIDES databases [80].”
BackgroundMethodUnderstanding multicellular function and disease with human tissue-specific networks
Greene, C. S., Krishnan, A., Wong, A. K., Ricciotti, E., Zelaya, R. A., Himmelstein, D. S., Zhang, R., Hartmann, B. M., Zaslavsky, E., Sealfon, S. C., et al. (2015) · Nature Genetics · doi:10.1038/ng.3259 · Cited by 832
Reducing safety-related drug attrition: the use of in vitro pharmacological profiling
Bowes, J., Brown, A. J., Hamon, J., Jarolimek, W., Sridhar, A., Waldron, G., & Whitebread, S. (2012) · Nature Reviews Drug Discovery · doi:10.1038/nrd3845 · Cited by 748 · cited 1×
“Polypharmacy side-effects are a specific case of adverse drug reactions that can cause significant clinical problems and represent a major challenge for public health and pharmaceutical industry [78].”
BackgroundHolographic embeddings of knowledge graphs
Nickel, M., Rosasco, L., & Poggio, T. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v30i1.10314 · Cited by 559
PyTorch-BigGraph: A Large-scale Graph Embedding System
Lerer, A., Wu, L., Shen, J., Lacroix, T., Wehrstedt, L., Bose, A., & Peysakhovich, A. (2019) · arXiv · doi:10.48550/arxiv.1903.12287 · Cited by 247 · cited 1×
“They can also be implemented to operate in a multi-machine design, where they perform embedding training in a distributed fashion [104].”
BackgroundKnowledge Base Completion: Baselines Strike Back
Kadlec, R., Bajgar, O., & Kleindienst, J. (2017) · Proceedings of the 2nd Workshop on Representation Learning for NLP · doi:10.18653/v1/w17-2609 · Cited by 173 · cited 1×
“• Hyper-parameter sensitivity The outcome predictive accuracy of KGE embeddings is sensitive to their hyper-parameters [118].”
Background
Cited by
Knowledge Graphs: Opportunities and Challenges
Peng, C., Xia, F., Naseriparsa, M., & Osborne, F. (2023) · Artificial Intelligence Review · doi:10.1007/s10462-023-10465-9 · Cited by 717
Zhang, B., Shi, H., & Wang, H. (2023) · Journal of Multidisciplinary Healthcare · doi:10.2147/jmdh.s410301 · Cited by 347
Ye, Q., Hsieh, C.-Y., Yang, Z., Kang, Y., Chen, J., Cao, D., He, S., & Hou, T. (2021) · Nature Communications · doi:10.1038/s41467-021-27137-3 · Cited by 261
Toward better drug discovery with knowledge graph
Zeng, X., Tu, X., Liu, Y., Fu, X., & Su, Y. (2022) · Current Opinion in Structural Biology · doi:10.1016/j.sbi.2021.09.003 · Cited by 229
Metadata
- Authors
- Mohamed, S. K., Nounu, A., & Nováček, V.
- Venue
- Briefings in Bioinformatics
- Publisher
- Oxford University Press (OUP)
- Published
- 2020-02-17
- Volume
- 22
- Issue
- 2
- Pages
- 1679-1693
- ISSN
- 1467-5463 (ISSN-L)
- 1477-4054
- OpenAlex
- W3007807538
- Cited by
- 143
- References
- 28
- FWCI
- 5.78
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.