CoChat

CancerKG.ORG - A Web-scale, Interactive, Verifiable Knowledge Graph-LLM Hybrid for Assisting with Optimal Cancer Treatment and Care

Open access
Gubanov, Michael, Pyayt, Anna, Karolak, Aleksandra · 2024 · Proceedings of the 33rd ACM International Conference on Information and Knowledge Management

The DOI matches its Crossref record; 34 of the 34 references it cites were found in a registry or an index.

Abstract

Here, we describe one of the first Web-scale hybrid Knowledge Graph (KG)-Large Language Model (LLM), populated with the latest peer-reviewed medical knowledge on colorectal Cancer. It is currently being evaluated to assist with both medical research and clinical information retrieval tasks at Moffitt Cancer Center and Research Institute, which is one of the top Cancer centers in the U.S. and in the world. Our hybrid is remarkable as it serves the user needs better than just an LLM, KG or a search-engine in isolation. LLMs as is are known to exhibit hallucinations and catastrophic forgetting as well as are trained on outdated corpora. The state of the art KGs, such as PrimeKG, cBioPortal, ChEMBL, NCBI, and other require manual curation, hence are quickly getting stale. CancerKG is unsupervised and is capable of automatically ingesting and organizing the latest medical findings. To alleviate the LLMs shortcomings, the verified KG serves as a Retrieval Augmented Generation (RAG) guardrail. CancerKG exhibits 5 different advanced user interfaces, each tailored to serve different data modalities better and more convenient for the user. We evaluated CancerKG on real user queries and report a high NDCG score on a large-scale corpora of approximately 44K publications.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1145/3627673.3680094

Cites

34 of 34 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 34 references

Research works printed but not linked: 20

  1. Zia Abedjan, John Morcos, Michael Gubanov, Ihab F. Ilyas, Michael Stonebraker, Paolo Papotti, and Mourad Ouzzani. 2014. DATAXFORMER: Leveraging the Web for Semantic Transformations. In CIDR.
  2. Zohra Bellahsene, Angela Bonifati, and Erhard Rahm. 2011. Schema Matching and Mapping. In Springer.
  3. Breda Corish. 2018. Medical knowledge doubles every few months; how can clinicians keep up. Elsevier Connect (2018).
  4. Michael Gubanov. 2017. Hybrid: A Large-scale In-memory Image Analytics System. In CIDR.
  5. M. Gubanov, C. Jermaine, Z. Gao, and S. Luo. 2016. Hybrid: A Large-scale Linear-relational Database Management System. In MIT NEDB.
  6. Michael Gubanov, Chris Jermaine, Zekai Gao, and Shangyu Luo. 2016. Hybrid: A Large-scale Linear-relational Database Management System. In MIT Annual DB Conference.
  7. Michael Gubanov, Anna Pyayt, and Sophie Pavia. 2022. Visualizing and Querying Large-scale Structured Datasets by Learning Multi-layered 3D Meta-Profiles. In BigData. IEEE.
  8. Michael N. Gubanov and Philip A. Bernstein. 2006. Structural text search and comparison using automatically extracted schema. In WebDB.
  9. L. C. Jain and L. R. Medsker. 1999. Recurrent Neural Networks: Design and Applications (1st ed.). CRC Press Inc. USA.
  10. Bhimesh Kandibedala, Anna Pyayt, Chris Caballero, and Michael N. Gubanov. 2023. Scalable Hierarchical Metadata Classification in Heterogeneous Large-scale Datasets. In EDBT DOLAP 2023.
  11. Rituparna Khan and Michael Gubanov. 2018. Towards Unsupervised Web Tables Clustering. In IEEE BigData.
  12. Rituparna Khan and Michael Gubanov. 2020. Towards Tabular Embeddings, Training the Relational Models. In IEEE Big Data.
  13. Rituparna Khan and Michael Gubanov. 2020. WebLens: Towards Interactive Large-Scale Structured Data Profiling. In CIKM.
  14. Rituparna Khan and Michael Gubanov. 2020. WebLens: Towards Interactive Web-scale Data Integration, Training the Models. In IEEE Big Data.
  15. Sophie Pavia, Montasir Shams, Rituparna Khan, Anna Pyayt, and Michael N.Gubanov. 2021. Learning Tabular Embeddings at Web Scale. In Big Data. IEEE.
  16. Thomas Pellissier Tanon Gerhard Weikum and Fabian Suchanek. 2020. YAGO4: A Reason-able Knowledge Base. In ESWC Andreas Harth Sabrina Kirrane Axel-Cyrille Ngonga Ngomo Heiko Paulheim Anisa Rula Anna Lisa Gentile Peter Haase and Michael Cochez (Eds.).
  17. Montasir Shams, Sophie Pavia, Rituparna Khan, Anna Pyayt, and Michael N.Gubanov. 2021. Towards Unveiling Dark Web Structured Data. In Big Data. IEEE.
  18. Mark Simmons, Daniel Armstrong, Dylan Soderman, and Michael Gubanov.2017. Hybrid.media: High Velocity Video Ingestion in an In-Memory Scalable Analytical Polystore. In IEEE Bigdata.
  19. Lucy Lu Wang, Kyle Lo, Yoganand Chandrasekhar, Russell Reas, Jiangjiang Yang, Doug Burdick, Darrin Eide, Kathryn Funk, Yannis Katsis, Rodney Kinney, Yunyao Li, Ziyang Liu, William Merrill, Paul Mooney, Dewey Murdick, Devvret Rishi, Jerry Sheehan, Zhihong Shen, Brandon Stilson, Alex Wade, Kuansan Wang, Nancy Xin Ru Wang, Chris Wilhelm, Boya Xie, Douglas Raymond, Daniel S. Weld, Oren Etzioni, and Sebastian Kohlmeier. 2020. CORD-19: The COVID-19 Open Research Dataset. In arXiv, cs.DL 2004.10706.
  20. Bhimesh Kandibedala, Anna Pyayt, Nickolas Piraino, Chris Caballero, and Michael Gubanov. 2023. COVIDKG.ORG-a Web-scale COVID-19 Interactive, Trustworthy Knowledge Graph, Constructed and Interrogated for Bias using Deep-Learning. In EDBT 2023.

Cited by

See all 10

Metadata

Authors
Gubanov, M., Pyayt, A., & Karolak, A.
Affiliations
  • Florida State University (US)
  • University of South Florida (US)
  • Moffitt Cancer Center (US)
Venue
Proceedings of the 33rd ACM International Conference on Information and Knowledge Management
Publisher
ACM
Published
2024-10-21
Pages
4497-4505
ISSN
2155-0751 (ISSN-L)
OpenAlex
W4403577847
Cited by
10
References
34
Citations by year
2026: 4 · 2025: 6
FWCI
18.07
Type
conference paper
Language
en
Open access
Locations
  • ACM International Conference on Information and Knowledge Management (CIKM) (publishedVersion)
  • arXiv (Cornell University) (submittedVersion, cc-by-nc-nd)
  • arXiv (Cornell University)
Funders
  • FL DOH (90)
  • NSF (2345794)
Topics
  • Health Sciences › Medicine › Health Informatics › Biomedical Text Mining and Ontologies
  • Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
  • Physical Sciences › Computer Science › Information Systems › Information Retrieval and Search Behavior
Keywords
knowledge graphs, large language models, colorectal cancer, cancer therapy, medical information retrieval, retrieval-augmented generation, LLM hallucination mitigation

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: CancerKG.ORG - A Web-scale, Interactive, Verifiable Knowledge Graph-LLM Hybrid for Assisting with Optimal Cancer Treatment and Care. https://app.cochat.ai/papers/10.1145/3627673.3680094
The paper
Gubanov, M., Pyayt, A., & Karolak, A. (2024). CancerKG.ORG - A Web-scale, Interactive, Verifiable Knowledge Graph-LLM Hybrid for Assisting with Optimal Cancer Treatment and Care. Proceedings of the 33rd ACM International Conference on Information and Knowledge Management. https://doi.org/10.1145/3627673.3680094

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.