CancerKG.ORG - A Web-scale, Interactive, Verifiable Knowledge Graph-LLM Hybrid for Assisting with Optimal Cancer Treatment and Care
Open accessThe DOI matches its Crossref record; 34 of the 34 references it cites were found in a registry or an index.
Abstract
Here, we describe one of the first Web-scale hybrid Knowledge Graph (KG)-Large Language Model (LLM), populated with the latest peer-reviewed medical knowledge on colorectal Cancer. It is currently being evaluated to assist with both medical research and clinical information retrieval tasks at Moffitt Cancer Center and Research Institute, which is one of the top Cancer centers in the U.S. and in the world. Our hybrid is remarkable as it serves the user needs better than just an LLM, KG or a search-engine in isolation. LLMs as is are known to exhibit hallucinations and catastrophic forgetting as well as are trained on outdated corpora. The state of the art KGs, such as PrimeKG, cBioPortal, ChEMBL, NCBI, and other require manual curation, hence are quickly getting stale. CancerKG is unsupervised and is capable of automatically ingesting and organizing the latest medical findings. To alleviate the LLMs shortcomings, the verified KG serves as a Retrieval Augmented Generation (RAG) guardrail. CancerKG exhibits 5 different advanced user interfaces, each tailored to serve different data modalities better and more convenient for the user. We evaluated CancerKG on real user queries and report a high NDCG score on a large-scale corpora of approximately 44K publications.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“For instance, in oncology, AI agents can analyze a patient’s genetic profile alongside clinical data to recommend targeted therapies that are more likely to be effective, minimizing adverse effects and improving prognosis.93”
From A foundational architecture for AI agents in healthcare (2025) · cites this paper as [93]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
Cerami, E., Gao, J., Dogrusoz, U., Gross, B. E., Sumer, S. O., Aksoy, B. A., Jacobsen, A., Byrne, C. J., Heuer, M. L., Larsson, E., et al. (2012) · Cancer Discovery · doi:10.1158/2159-8290.cd-12-0095 · Cited by 17,455
WordNet: An Electronic Lexical Database
(1998) · The MIT Press eBooks · doi:10.7551/mitpress/7287.001.0001 · Cited by 4,857
A relational model of data for large shared data banks
Codd, E. F. (1983) · Communications of the ACM · doi:10.1145/357980.358007 · Cited by 4,796
A STATISTICAL INTERPRETATION OF TERM SPECIFICITY AND ITS APPLICATION IN RETRIEVAL
SPARCK JONES, K. (1972) · Journal of Documentation · doi:10.1108/eb026526 · Cited by 4,505
DBpedia: A Nucleus for a Web of Open Data
Auer, S., Bizer, C., Kobilarov, G., Lehmann, J., Cyganiak, R., & Ives, Z. (2007) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-76298-0_52 · Cited by 2,454
Scaling Instruction-Finetuned Language Models
Chung, H. W., Hou, L., Longpre, S., Zoph, B., Tay, Y., Fedus, W., Li, Y., Wang, X., Dehghani, M., Brahma, S., et al. (2022) · arXiv · doi:10.48550/arxiv.2210.11416 · Cited by 1,441 · cited 4×
“It is a RAG-based system [15] comprised of an LLM (a choice of Meta Llama 2 [18], Google FLAN T5 [27], GPT-2 [71] or GPT-4 [61]) moderated by our trustworthy Knowledge Graph (KG).”
InfluentialMalard, F., Wolter, A. C., Marquevielle, J., Morvan, E., Ecoutin, A., Rüdisser, S. H., Allain, F. H. T., & Campagne, S. (2024) · Nucleic Acids Research · doi:10.1093/nar/gkae201 · Cited by 1,273
Malard, F., Wolter, A. C., Marquevielle, J., et al. (2024) · HAL (Le Centre pour la Communication Scientifique Directe) · doi:10.1093/nar · Cited by 1,259
Spark SQL: Relational Data Processing in Spark
Armbrust, M., Xin, R. S., Lian, C., Huai, Y., Liu, D., Bradley, J. K., Meng, X., Kaftan, T., Franklin, M. J., Ghodsi, A., et al. (2015) · Proceedings of the 2015 ACM SIGMOD International Conference on Management of Data · doi:10.1145/2723372.2742797 · Cited by 1,253
Research works printed but not linked: 20
- Zia Abedjan, John Morcos, Michael Gubanov, Ihab F. Ilyas, Michael Stonebraker, Paolo Papotti, and Mourad Ouzzani. 2014. DATAXFORMER: Leveraging the Web for Semantic Transformations. In CIDR.
- Zohra Bellahsene, Angela Bonifati, and Erhard Rahm. 2011. Schema Matching and Mapping. In Springer.
- Breda Corish. 2018. Medical knowledge doubles every few months; how can clinicians keep up. Elsevier Connect (2018).
- Michael Gubanov. 2017. Hybrid: A Large-scale In-memory Image Analytics System. In CIDR.
- M. Gubanov, C. Jermaine, Z. Gao, and S. Luo. 2016. Hybrid: A Large-scale Linear-relational Database Management System. In MIT NEDB.
- Michael Gubanov, Chris Jermaine, Zekai Gao, and Shangyu Luo. 2016. Hybrid: A Large-scale Linear-relational Database Management System. In MIT Annual DB Conference.
- Michael Gubanov, Anna Pyayt, and Sophie Pavia. 2022. Visualizing and Querying Large-scale Structured Datasets by Learning Multi-layered 3D Meta-Profiles. In BigData. IEEE.
- Michael N. Gubanov and Philip A. Bernstein. 2006. Structural text search and comparison using automatically extracted schema. In WebDB.
- L. C. Jain and L. R. Medsker. 1999. Recurrent Neural Networks: Design and Applications (1st ed.). CRC Press Inc. USA.
- Bhimesh Kandibedala, Anna Pyayt, Chris Caballero, and Michael N. Gubanov. 2023. Scalable Hierarchical Metadata Classification in Heterogeneous Large-scale Datasets. In EDBT DOLAP 2023.
- Rituparna Khan and Michael Gubanov. 2018. Towards Unsupervised Web Tables Clustering. In IEEE BigData.
- Rituparna Khan and Michael Gubanov. 2020. Towards Tabular Embeddings, Training the Relational Models. In IEEE Big Data.
- Rituparna Khan and Michael Gubanov. 2020. WebLens: Towards Interactive Large-Scale Structured Data Profiling. In CIKM.
- Rituparna Khan and Michael Gubanov. 2020. WebLens: Towards Interactive Web-scale Data Integration, Training the Models. In IEEE Big Data.
- Sophie Pavia, Montasir Shams, Rituparna Khan, Anna Pyayt, and Michael N.Gubanov. 2021. Learning Tabular Embeddings at Web Scale. In Big Data. IEEE.
- Thomas Pellissier Tanon Gerhard Weikum and Fabian Suchanek. 2020. YAGO4: A Reason-able Knowledge Base. In ESWC Andreas Harth Sabrina Kirrane Axel-Cyrille Ngonga Ngomo Heiko Paulheim Anisa Rula Anna Lisa Gentile Peter Haase and Michael Cochez (Eds.).
- Montasir Shams, Sophie Pavia, Rituparna Khan, Anna Pyayt, and Michael N.Gubanov. 2021. Towards Unveiling Dark Web Structured Data. In Big Data. IEEE.
- Mark Simmons, Daniel Armstrong, Dylan Soderman, and Michael Gubanov.2017. Hybrid.media: High Velocity Video Ingestion in an In-Memory Scalable Analytical Polystore. In IEEE Bigdata.
- Lucy Lu Wang, Kyle Lo, Yoganand Chandrasekhar, Russell Reas, Jiangjiang Yang, Doug Burdick, Darrin Eide, Kathryn Funk, Yannis Katsis, Rodney Kinney, Yunyao Li, Ziyang Liu, William Merrill, Paul Mooney, Dewey Murdick, Devvret Rishi, Jerry Sheehan, Zhihong Shen, Brandon Stilson, Alex Wade, Kuansan Wang, Nancy Xin Ru Wang, Chris Wilhelm, Boya Xie, Douglas Raymond, Daniel S. Weld, Oren Etzioni, and Sebastian Kohlmeier. 2020. CORD-19: The COVID-19 Open Research Dataset. In arXiv, cs.DL 2004.10706.
- Bhimesh Kandibedala, Anna Pyayt, Nickolas Piraino, Chris Caballero, and Michael Gubanov. 2023. COVIDKG.ORG-a Web-scale COVID-19 Interactive, Trustworthy Knowledge Graph, Constructed and Interrogated for Bias using Deep-Learning. In EDBT 2023.
Cited by
Miao, Y., Zhao, Y., Luo, Y., Wang, H., & Wu, Y. (2025) · Journal of Medical Internet Research · doi:10.2196/80557 · Cited by 38
A foundational architecture for AI agents in healthcare
Liu, F., Niu, Y., Zhang, Q., Wang, K., Dong, Z., Wong, I. N., Cheng, L., Li, T., Duan, L., Li, K., et al. (2025) · Cell Reports Medicine · doi:10.1016/j.xcrm.2025.102374 · Cited by 41
Sezgin, E., Jackson, D. I., Kocaballi, A. B., Bibart, M., Zupanec, S., Landier, W., Audino, A., Ranalli, M., & Skeens, M. (2025) · Cancer Medicine · doi:10.1002/cam4.70554 · Cited by 30
Metadata
- Authors
- Gubanov, M., Pyayt, A., & Karolak, A.
- Affiliations
- Florida State University (US)
- University of South Florida (US)
- Moffitt Cancer Center (US)
- Venue
- Proceedings of the 33rd ACM International Conference on Information and Knowledge Management
- Publisher
- ACM
- Published
- 2024-10-21
- Pages
- 4497-4505
- ISSN
- 2155-0751 (ISSN-L)
- OpenAlex
- W4403577847
- Cited by
- 10
- References
- 34
- Citations by year
- 2026: 4 · 2025: 6
- FWCI
- 18.07
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- ACM International Conference on Information and Knowledge Management (CIKM) (publishedVersion)
- arXiv (Cornell University) (submittedVersion, cc-by-nc-nd)
- arXiv (Cornell University)
- Funders
- FL DOH (90)
- NSF (2345794)
- Topics
- Health Sciences › Medicine › Health Informatics › Biomedical Text Mining and Ontologies
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Physical Sciences › Computer Science › Information Systems › Information Retrieval and Search Behavior
- Keywords
- knowledge graphs, large language models, colorectal cancer, cancer therapy, medical information retrieval, retrieval-augmented generation, LLM hallucination mitigation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: CancerKG.ORG - A Web-scale, Interactive, Verifiable Knowledge Graph-LLM Hybrid for Assisting with Optimal Cancer Treatment and Care. https://app.cochat.ai/papers/10.1145/3627673.3680094
- The paper
- Gubanov, M., Pyayt, A., & Karolak, A. (2024). CancerKG.ORG - A Web-scale, Interactive, Verifiable Knowledge Graph-LLM Hybrid for Assisting with Optimal Cancer Treatment and Care. Proceedings of the 33rd ACM International Conference on Information and Knowledge Management. https://doi.org/10.1145/3627673.3680094
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.