CoChat
Sign Up
PreprintCited by 15Biomedical Text Mining and OntologiesSemantic Web and OntologiesTopic Modeling

BIOS: An Algorithmically Generated Biomedical Knowledge Graph

Open access
Yu, Sheng, Yuan, Zheng, Xia, Jun, Luo, Shengxuan, Ying, Huaiyuan, Zeng, Sihang, Ren, Jingyi, Yuan, Hongyi +6 more·2022·arXiv
DOI 10.48550/arxiv.2203.09975arXiv 2203.09975
Open this paper in CoChat — free accountOpen PDF

Abstract

Biomedical knowledge graphs (BioMedKGs) are essential infrastructures for biomedical and healthcare big data and artificial intelligence (AI), facilitating natural language processing, model development, and data exchange. For decades, these knowledge graphs have been developed via expert curation; however, this method can no longer keep up with today's AI development, and a transition to algorithmically generated BioMedKGs is necessary. In this work, we introduce the Biomedical Informatics Ontology System (BIOS), the first large-scale publicly available BioMedKG generated completely by machine learning algorithms. BIOS currently contains 4.1 million concepts, 7.4 million terms in two languages, and 7.3 million relation triplets. We present the methodology for developing BIOS, including the curation of raw biomedical terms, computational identification of synonymous terms and aggregation of these terms to create concept nodes, semantic type classification of the concepts, relation identification, and biomedical machine translation. We provide statistics on the current BIOS content and perform preliminary assessments of term quality, synonym grouping, and relation extraction. The results suggest that machine learning-based BioMedKG development is a viable alternative to traditional expert curation.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.2203.09975

Cites

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • The ground truth is a refined version of the BIOS knowledge graph containing 21,706 unique medical concepts and 416,302 total relationships.

    “Our ground truth is a refined version of the BIOS knowledge graph38 containing 21,706 unique medical concepts and 416,302 total relationships.”

    From Medical large language models are vulnerable to data-poisoning attacks (2025) · cites this paper as [38]

  • The BIOS knowledge graph subset used is unlikely to be a complete representation of all medical concepts and their relations.

    “We report primary results using a subset of the BIOS knowledge graph38, which, while being the most complete biomedical knowledge graph we could identify, is unlikely to be a complete representation of all medical concepts and their relations.”

    From Medical large language models are vulnerable to data-poisoning attacks (2025) · cites this paper as [38]

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

No references could be resolved yet.

Research works printed but not linked: 44

  1. [1]1. Aronson, A. R. Effective mapping of biomedical text to the UMLS Metathesaurus: the MetaMap program. Proceedings of the AMIA Symposium 17 (2001).
  2. [3]3. Hosseini, A., Chen, T., Wu, W., Sun, Y. & Sarrafzadeh, M. HeteroMed: Heterogeneous Information Network for Medical Diagnosis. in Proceedings of the 27th ACM International Conference on Information and Knowledge Management 763-772 (Association for Computing Machinery, 2018). doi:10.1145/3269206.3271805. · DOI · Paper page
  3. [4]4. Jin, Q. et al. Biomedical Question Answering: A Survey of Approaches and Challenges. ACM Comput. Surv. 55 , 35:1-35:36 (2022).
  4. [6]6. Zhang, R. et al. Drug repurposing for COVID-19 via knowledge graph completion. Journal of Biomedical Informatics 115 , 103696 (2021).
  5. [7]7. Paulheim, H. How much is a Triple? Estimating the Cost of Knowledge Graph Creation. in International Semantic Web Conference (2018).
  6. [8]8. Robinson, P. N. et al. The Human Phenotype Ontology: A Tool for Annotating and Analyzing Human Hereditary Disease. The American Journal of Human Genetics 83 , 610-615 (2008).
  7. [13]13. Huang, Z., Xu, W. & Yu, K. Bidirectional LSTM-CRF Models for Sequence Tagging. arXiv:1508.01991 [cs] (2015). · arXiv
  8. [18]18. Carlson, A. et al. Toward an Architecture for Never-Ending Language Learning. in TwentyFourth AAAI Conference on Artificial Intelligence (2010).
  9. [19]19. Mitchell, T. et al. Never-ending learning. Commun. ACM 61 , 103-115 (2018).
  10. [20]20. Devlin, J., Chang, M.-W., Lee, K. & Toutanova, K. BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. in Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) 4171-4186 (Association for Computational Linguistics, 2019). doi:10.18653/v1/N19-1423. · DOI · Paper page
  11. [21]21. Yang, Y ., Chen, W., Li, Z., He, Z. & Zhang, M. Distantly Supervised NER with Partial Annotation Learning and Reinforcement Learning. in Proceedings of the 27th International Conference on Computational Linguistics 2159-2169 (Association for Computational Linguistics, 2018).
  12. [22]22. Shang, J. et al. Learning Named Entity Tagger using Domain-Specific Dictionary. in Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing 2054-2064 (Association for Computational Linguistics, 2018). doi:10.18653/v1/D18-1230. · DOI
  13. [23]23. Zhang, W. et al. Denoising Distantly Supervised Named Entity Recognition via a Hypergeometric Probabilistic Model. Proceedings of the AAAI Conference on Artificial Intelligence 35 , 14481-14488 (2021).
  14. [24]24. Wang, Y. et al. Discontinuous Named Entity Recognition as Maximal Clique Discovery. in Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) 764-774 (Association for Computational Linguistics, 2021). doi:10.18653/v1/2021.acllong.63. · DOI
  15. [25]25. Fei, H. et al. Rethinking Boundaries: End-To-End Recognition of Discontinuous Mentions with Pointer Networks. Proceedings of the AAAI Conference on Artificial Intelligence 35 , 1278512793 (2021).
  16. [26]26. Yu, J., Bohnet, B. & Poesio, M. Named Entity Recognition as Dependency Parsing. in Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics 64706476 (Association for Computational Linguistics, 2020). doi:10.18653/v1/2020.acl-main.577. · DOI
  17. [27]27. Fu, Y ., Tan, C., Chen, M., Huang, S. & Huang, F. Nested Named Entity Recognition with Partially-Observed TreeCRFs. Proceedings of the AAAI Conference on Artificial Intelligence 35 , 12839-12847 (2021).
  18. [28]28. Yuan, Z., Tan, C., Huang, S. & Huang, F. Fusing Heterogeneous Factors with Triaffine Mechanism for Nested Named Entity Recognition. arXiv:2110.07480 [cs] (2021). · arXiv
  19. [29]29. Yan, H. et al. A Unified Generative Framework for Various NER Subtasks. in Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) 5808-5822 (Association for Computational Linguistics, 2021). doi:10.18653/v1/2021.acl-long.451. · DOI · Paper page
  20. [30]30. Mikolov, T., Sutskever, I., Chen, K., Corrado, G. S. & Dean, J. Distributed Representations of Words and Phrases and their Compositionality. in Advances in Neural Information Processing Systems 26 (eds. Burges, C. J. C., Bottou, L., Welling, M., Ghahramani, Z. & Weinberger, K. Q.) 3111-3119 (Curran Associates, Inc., 2013).
  21. [31]31. Pennington, J., Socher, R. & Manning, C. D. Glove: Global vectors for word representation. in In EMNLP (2014).
  22. [32]32. Liu, F., Shareghi, E., Meng, Z., Basaldella, M. & Collier, N. Self-Alignment Pretraining for Biomedical Entity Representations. in Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies 4228-4238 (Association for Computational Linguistics, 2021). doi:10.18653/v1/2021.naacl-main.334. · DOI
  23. [33]33. Yuan, Z. et al. CODER: Knowledge-infused cross-lingual medical term embedding for term normalization. Journal of Biomedical Informatics 126 , 103983 (2022).
  24. [34]34. Nguyen, V., Yip, H. Y. & Bodenreider, O. Biomedical Vocabulary Alignment at Scale in the UMLS Metathesaurus. in Proceedings of the Web Conference 2021 2672-2683 (Association for Computing Machinery, 2021).
  25. [35]35. Uzuner, Ö., South, B. R., Shen, S. & DuVall, S. L. 2010 i2b2/VA challenge on concepts, assertions, and relations in clinical text. J Am Med Inform Assoc amiajnl-2011-000203 (2011) doi:10.1136/amiajnl-2011-000203. · DOI
  26. [36]36. Rastegar-Mojarad, M. et al. BioCreative/OHNLP Challenge 2018. in Proceedings of the 2018 ACM International Conference on Bioinformatics, Computational Biology, and Health Informatics 575 (Association for Computing Machinery, 2018). doi:10.1145/3233547.3233672. · DOI
  27. [38]38. Mintz, M., Bills, S., Snow, R. & Jurafsky, D. Distant Supervision for Relation Extraction Without Labeled Data. in Proceedings of the Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLP: Volume 2 - Volume 2 1003-1011 (Association for Computational Linguistics, 2009).
  28. [39]39. Surdeanu, M., Tibshirani, J., Nallapati, R. & Manning, C. D. Multi-instance Multi-label Learning for Relation Extraction. in Proceedings of the 2012 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning 455-465 (Association for Computational Linguistics, 2012).
  29. [40]40. Angeli, G., Tibshirani, J., Wu, J. Y . & Manning, C. D. Combining distant and partial supervision for relation extraction. in In Proceedings of EMNLP 1556-1567 (2014).
  30. [41]41. Zeng, D., Liu, K., Chen, Y. & Zhao, J. Distant Supervision for Relation Extraction via Piecewise Convolutional Neural Networks. in Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing 1753-1762 (Association for Computational Linguistics, 2015). doi:10.18653/v1/D15-1203. · DOI
  31. [42]42. Ji, G., Liu, K., He, S. & Zhao, J. Distant Supervision for Relation Extraction with SentenceLevel Attention and Entity Descriptions. Proceedings of the AAAI Conference on Artificial Intelligence 31 , (2017).
  32. [43]43. Lin, Y ., Lu, K., Chen, Y ., Hong, C. & Yu, S. High-throughput relation extraction algorithm development associating knowledge articles and electronic health records. arXiv:2009.03506 [cs, stat] (2020). · arXiv
  33. [45]45. Chen, J., Guo, Z. & Yang, J. Distant Supervision for Relation Extraction via Noise Filtering. in 2021 13th International Conference on Machine Learning and Computing 361-367 (Association for Computing Machinery, 2021). doi:10.1145/3457682.3457743. · DOI
  34. [47]47. Qiao, B. et al. A joint model for entity and relation extraction based on BERT. Neural Comput & Applic (2021) doi:10.1007/s00521-021-05815-z. · DOI
  35. [48]48. Lai, T., Ji, H., Zhai, C. & Tran, Q. H. Joint Biomedical Entity and Relation Extraction with Knowledge-Enhanced Collective Inference. arXiv:2105.13456 [cs] (2021). · arXiv
  36. [49]49. Vaswani, A. et al. Attention is All you Need. in Advances in Neural Information Processing Systems 30 (eds. Guyon, I. et al.) 5998-6008 (Curran Associates, Inc., 2017).
  37. [50]50. Luo, S., Ying, H., Li, J. & Yu, S. Sentence Alignment with Parallel Documents Facilitates Biomedical Machine Translation. arXiv:2104.08588 [cs] (2022). · arXiv
  38. [53]53. Lample, G., Ott, M., Conneau, A., Denoyer, L. & Ranzato, M. Phrase-Based & Neural Unsupervised Machine Translation. in Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing 5039-5049 (Association for Computational Linguistics, 2018). doi:10.18653/v1/D18-1549. · DOI
  39. [54]54. Gu, Y. et al. Domain-Specific Language Model Pretraining for Biomedical Natural Language Processing. ACM Trans. Comput. Healthcare 3 , 2:1-2:23 (2021).
  40. [55]55. Zhu, M., Zhang, Y., Chen, W., Zhang, M. & Zhu, J. Fast and accurate shift-reduce constituent parsing. in Proceedings of the 51st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) 434-443 (2013).
  41. [56]56. Johnson, J., Douze, M. & Jégou, H. Billion-Scale Similarity Search with GPUs. IEEE Transactions on Big Data 7 , 535-547 (2021).
  42. [57]57. Zeng, S., Yuan, Z. & Yu, S. Automatic Biomedical Term Clustering by Learning Fine-grained Term Representations. arXiv:2204.00391 [cs] (2022). · arXiv
  43. [58]58. Hagen, L. & Kahng, A. B. New spectral methods for ratio cut partitioning and clustering. IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems 11 , 1074-1085 (1992).
  44. [59]59. Kumar, M. N. K., Zhou, C. & Wu, M. X. Laser-facilitated epicutaneous immunotherapy to IgEmediated allergy. Journal of Controlled Release 235 , 82-90 (2016).

Cited by

Sorted by citations

Authors
Yu, S., Yuan, Z., Xia, J., Luo, S., Ying, H., Zeng, S., Ren, J., Yuan, H., Zhao, Z., Lin, Y., Lu, K., Wang, J., Xie, Y., & Shum, H.-Y.
Affiliations
  • Tsinghua University (CN)
  • Beijing Institute of Technology (CN)
  • University of Southern California (US)
ORCID
Venue
arXiv
Publisher
arXiv
Published
2022
ISSN
2331-8422 (ISSN-L)
DOI
10.48550/arxiv.2203.09975
arXiv
2203.09975
OpenAlex
W4221142373
Cited by
15
References
0
Citations by year
2025: 7 · 2024: 2 · 2023: 5 · 2022: 1
Type
posted content
Language
en
Open access
Licence
creativecommons.org/licenses/by-nc-sa/4.0/legalcode
Locations
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Topics
  • Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Biomedical Text Mining and Ontologies
  • Physical Sciences › Computer Science › Artificial Intelligence › Semantic Web and Ontologies
  • Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
Keywords
biomedical knowledge graphs, biomedical terminology, synonym identification, relation extraction

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review