CS-KG 2.0: A Large-scale Knowledge Graph of Computer Science
Open accessAbstract
The rapid evolution of AI and the increased accessibility of scientific articles through open access marks a pivotal moment in research. AI-driven tools are reshaping how scientists explore, interpret, and contribute to the body of scientific knowledge, offering unprecedented opportunities. Nonetheless, a significant challenge remains: dealing with the overwhelming number of papers published every year. A promising solution is the use of knowledge graphs, which provide structured, interconnected, and formalized frameworks that improve the capabilities of AI systems to integrate information from the literature. This paper presents the last version of the Computer Science Knowledge Graph (CS-KG 2.0), an extensive knowledge base generated from 15 million research papers. CS-KG 2.0 describes 25 million entities linked by 67 million relationships, offering a nuanced representation of the scientific knowledge within the field of computer science. This innovative resource facilitates new research opportunities in key areas such as analysis and forecasting of research trends, hypothesis generation, smart literature search, automatic production of literature review, and scientific question-answering.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Scholarly knowledge platforms increasingly rely on explicit entities and relations to support comparison, retrieval, and reuse.
“Scholarly knowledge platforms increasingly rely on explicit entities and relations to support comparison, retrieval, and reuse [3][4][5].”
From Diagnosing the limits of large language models for structured scientific evidence extraction (2026) · cites this paper as [5]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
SciBERT: A Pretrained Language Model for Scientific Text
Beltagy, I., Lo, K., & Cohan, A. (2019) · Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · doi:10.18653/v1/d19-1371 · Cited by 3,218 · see citing works
Introduction to Statistical Relational Learning
(2007) · doi:10.7551/mitpress/7432.001.0001 · Cited by 1,643 · see citing works
Conversational agents in healthcare: a systematic review
Laranjo, L., Dunn, A. G., Tong, H. L., Kocaballi, A. B., Chen, J., Bashir, R., Surian, D., Gallego, B., Magrabi, F., Lau, A. Y. S., et al. (2018) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocy072 · Cited by 1,388 · cited 1× · see citing works
“…methods for smart and tailored literature searches 1–3 , assisting in or even automating the creation of literature reviews 4 , enhancing academic writing and refer-encing 5,6 , automatically formulating novel hypotheses 7,8 , developing specialized conversational agents 9,10 , and much more.”
Artificial intelligence for literature reviews: opportunities and challenges
Bolaños, F., Salatino, A., Osborne, F., & Motta, E. (2024) · Artificial Intelligence Review · doi:10.1007/s10462-024-10902-3 · Cited by 246 · cited 2× · see citing works
“…of effectively interpreting and answering natural language questions about a single 15-page paper, a task currently undertaken by several LLM-based services 4 , does not extend to understanding the key entities, narratives, and concepts of a research field represented by millions of such papers.”
Self-citationBrody, S. (2021) · Journal of the Medical Library Association · doi:10.5195/jmla.2021.1331 · Cited by 24 · see citing works
Flagged first, then by citations
Research works printed but not linked: 57
- [1]Xu, J. et al. Building a pubmed knowledge graph. Scientific data 7, 205 (2020). 32591513 PMC7320186 · DOI
- [2]Cadeddu, A. et al. A comparative analysis of knowledge injection strategies for large language models in the scholarly domain. Engineering Applications of Artificial Intelligence 133, 108166 (2024). · DOI
- [3]Khanal, S. S., Prasad, P., Alsadoon, A. & Maag, A. A systematic review: machine learning based recommendation systems for e-learning. Education and Information Technologies 25, 2635–2664 (2020). · DOI
- [5]Buscaldi, D. et al. Citation prediction by leveraging transformers and natural language processing heuristics. Information Processing & Management 61, 103583 (2024). · DOI
- [7]Krenn, M. et al. Forecasting the future of artificial intelligence with machine learning-based link prediction in an exponentially growing knowledge network. Nature Machine Intelligence 5, 1326–1335 (2023). · DOI
- [8]Borrego, A. et al. Completing scientific facts in knowledge graphs of research concepts. IEEE Access 10, 125867–125880 (2022). · DOI
- [9]Meloni, A. et al. Integrating conversational agents and knowledge graphs within the scholarly domain. Ieee Access 11, 22468–22489 (2023). · DOI
- [11]Bornmann, L. & Mutz, R. Growth rates of modern science: A bibliometric analysis based on the number of publications and cited references. Journal of the Association for Information Science and Technology 66, 2215–2222, 10.1002/asi.23329 (2015). · DOI · Paper page
- [13]Fathalla, S., Auer, S. & Lange, C. Towards the semantic formalization of science. In Hung, C., Cerný, T., Shin, D. & Bechini, A. (eds.) SAC ’20: The 35th ACM/SIGAPP Symposium on Applied Computing, online event, [Brno, Czech Republic], March 30 - April 3, 2020, 2057–2059, 10.1145/3341105.3374132 (ACM, 2020). · DOI
- [14]Jiang, A. Q. et al. Mistral 7b. arXiv preprint arXiv:2310.06825 (2023). · arXiv
- [15]Touvron, H. et al. Llama: Open and efficient foundation language models. arXiv preprint arXiv:2302.13971 (2023). · arXiv
- [16]Huang, W. et al. How good are low-bit quantized llama3 models? an empirical study. arXiv preprint arXiv:2404.14047 (2024). · arXiv
- [17]Team, G. et al. Gemma: Open models based on gemini research and technology. arXiv preprint arXiv:2403.08295 (2024). · arXiv
- [19]Gan, L. et al. Hidden entity detection from github leveraging large language models. In Workshop on Deep Learning and Large Language Models for Knowledge Graphs (2024).
- [20]Lewis, P. et al. Retrieval-augmented generation for knowledge-intensive nlp tasks. Advances in Neural Information Processing Systems 33, 9459–9474 (2020).
- [21]Dacrema, M. F., Cremonesi, P. & Jannach, D. Are we really making much progress? A worrying analysis of recent neural recommendation approaches. In Bogers, T., Said, A., Brusilovsky, P. & Tikk, D. (eds.) Proceedings of the 13th ACM Conference on Recommender Systems, RecSys 2019, Copenhagen, Denmark, September 16-20, 2019, 101–109, 10.1145/3298689.3347058 (ACM, 2019). · DOI
- [22]Anelli, V. W. et al. Elliot: A comprehensive and rigorous framework for reproducible recommender systems evaluation. In Proceedings of the 44th international ACM SIGIR conference on research and development in information retrieval, 2405–2414 (2021).
- [23]Auer, S. et al. Towards a knowledge graph for science. In Proceedings of the 8th international conference on web intelligence, mining and semantics, 1–6 (2018).
- [24]Kuhn, T. & Dumontier, M. Genuine semantic publishing. Data Science 1, 139–154 (2017). · DOI
- [25]Peng, C., Xia, F., Naseriparsa, M. & Osborne, F. Knowledge graphs: Opportunities and challenges. Artificial Intelligence Review 1–32 (2023). PMC10068207 37362886
- [26]Hogan, A. et al. Knowledge graphs. ACM Computing Surveys (Csur) 54, 1–37 (2021). · DOI
- [28]Kumar, A., Singh, S. S., Singh, K. & Biswas, B. Link prediction techniques, applications, and performance: A survey. Physica A: Statistical Mechanics and its Applications 553, 124289 (2020). · DOI
- [29]Nayyeri, M. et al. Trans4e: Link prediction on scholarly knowledge graphs. Neurocomputing 461, 530–542, 10.1016/j.neucom.2021.02.100 (2021). · DOI
- [30]Lehmann, J. et al. Dbpedia–a large-scale, multilingual knowledge base extracted from wikipedia. Semantic web 6, 167–195 (2015). · DOI
- [31]Nuzzolese, A. G., Gentile, A. L., Presutti, V. & Gangemi, A. Semantic web conference ontology-a refactoring solution. In European semantic web conference, 84–87 (Springer, 2016).
- [32]Kelley, A. & Garijo, D. A framework for creating knowledge graphs of scientific software metadata. Quantitative Science Studies 2, 1423–1446 (2021). · DOI
- [33]Groth, P., Gibson, A. & Velterop, J. The anatomy of a nanopublication. Information services & use 30, 51–56 (2010). · DOI
- [34]Kuhn, T. et al. Decentralized provenance-aware publishing with nanopublications. PeerJ Computer Science 2, e78 (2016). · DOI
- [35]Peroni, S. & Shotton, D. The spar ontologies. In The Semantic Web–ISWC 2018: 17th International Semantic Web Conference, Monterey, CA, USA, October 8–12, 2018, Proceedings, Part II 17, 119–136 (Springer, 2018).
- [36]Salatino, A., Osborne, F. & Motta, E. Cso classifier 3.0: a scalable unsupervised method for classifying documents in terms of research topics. International Journal on Digital Libraries 1–20 (2022).
- [38]Färber, M., Lamprecht, D., Krause, J., Aung, L. & Haase, P. Semopenalex: The scientific landscape in 26 billion rdf triples. In International Semantic Web Conference, 94–112 (Springer, 2023).
- [39]Jaradeh, M. Y. et al. Open research knowledge graph: next generation infrastructure for semantic scholarly knowledge. In Proceedings of the 10th International Conference on Knowledge Capture, 243–246 (2019).
- [40]Dessì, D. et al. Ai-kg: an automatically generated knowledge graph of artificial intelligence. In The Semantic Web–ISWC 2020: 19th International Semantic Web Conference, Athens, Greece, November 2–6, 2020, Proceedings, Part II 19, 127–143 (Springer, 2020).
- [41]Dessí, D., Osborne, F., Reforgiato Recupero, D., Buscaldi, D. & Motta, E. Cs-kg: A large-scale knowledge graph of research entities and claims in computer science. In International Semantic Web Conference, 678–696 (Springer, 2022).
- [42]Schindler, D., Zapilko, B. & Krüger, F. Investigating software usage in the social sciences: A knowledge graph approach. In European Semantic Web Conference, 271–286 (Springer, 2020).
- [43]Zhang, Y., Wang, M., Saberi, M. & Chang, E. From big scholarly data to solution-oriented knowledge repository. Frontiers in big Data 2, 38 (2019). 33693361 PMC7931919 · DOI
- [44]D’Souza, J. & Auer, S. Pattern-based acquisition of scientific entities from scholarly article titles. In International Conference on Asian Digital Libraries, 401–410 (Springer, 2021).
- [45]Priem, J., Piwowar, H. & Orr, R. Openalex: A fully-open index of scholarly works, authors, venues, institutions, and concepts. arXiv preprint arXiv:2205.01833 (2022). · arXiv
- [46]Effendy, S. & Yap, R. H. Analysing trends in computer science research: A preliminary study using the microsoft academic graph. In Proceedings of the 26th international conference on world wide web companion, 1245–1250 (2017).
- [47]Dessì, D., Osborne, F., Recupero, D. R., Buscaldi, D. & Motta, E. Generating knowledge graphs by employing natural language processing and machine learning techniques within the scholarly domain. Future Generation Computer Systems 116, 253–264 (2021). · DOI
- [48]Panagopoulos, G. et al. Scientometrics for success and influence in the microsoft academic graph. In Complex Networks and Their Applications VIII: Volume 2 Proceedings of the Eighth International Conference on Complex Networks and Their Applications COMPLEX NETWORKS 2019 8, 1007–1017 (Springer, 2020).
- [49]Huang, Y., Lu, W., Liu, J., Cheng, Q. & Bu, Y. Towards transdisciplinary impact of scientific publications: A longitudinal, comprehensive, and large-scale analysis on microsoft academic graph. Information Processing & Management 59, 102859 (2022). · DOI
- [51]Bordes, A., Usunier, N., Garcia-Duran, A., Weston, J. & Yakhnenko, O. Translating embeddings for modeling multi-relational data. Advances in neural information processing systems26 (2013).
- [52]Dessì, D., Osborne, F., Recupero, D. R., Buscaldi, D. & Motta, E. SCICERO: A deep learning and NLP approach for generating scientific knowledge graphs in the computer science domain. Knowl. Based Syst. 258, 109945 (2022). · DOI
- [53]Wadden, D., Wennberg, U., Luan, Y. & Hajishirzi, H. Entity, relation, and event extraction with contextualized span representations. In Inui, K., Jiang, J., Ng, V. & Wan, X. (eds.) Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing, EMNLP-IJCNLP 2019, Hong Kong, China, November 3-7, 2019, 5783–5788, 10.18653/V1/D19-1585 (Association for Computational Linguistics, 2019). · DOI
- [54]Luan, Y., He, L., Ostendorf, M. & Hajishirzi, H. Multi-Task Identification of Entities, Relations, and Coreference for Scientific Knowledge Graph Construction. In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing. 3219–3232 (2018).
- [55]Salatino, A. A., Thanapalasingam, T., Mannocci, A., Osborne, F. & Motta, E. The computer science ontology: a large-scale taxonomy of research areas. In The Semantic Web–ISWC 2018: 17th International Semantic Web Conference, Monterey, CA, USA, October 8–12, 2018, Proceedings, Part II 17, 187–205 (Springer, 2018).
- [56]Manning, C. D. et al. The stanford corenlp natural language processing toolkit. In Proceedings of 52nd annual meeting of the association for computational linguistics: system demonstrations, 55–60 (2014).
- [57]Angeli, G., Premkumar, M. J. J. & Manning, C. D. Leveraging linguistic structure for open domain information extraction. In Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 1: Long Papers), 344–354 (2015).
- [58]Mikolov, T., Chen, K., Corrado, G. & Dean, J. Efficient estimation of word representations in vector space. arXiv preprint arXiv:1301.3781 (2013). · arXiv
- [60]Orlandi, F., Graux, D. & O’Sullivan, D. Benchmarking rdf metadata representations: Reification, singleton property and rdf. In 2021 IEEE 15th International Conference on Semantic Computing (ICSC), 233–240 (IEEE, 2021).
- [62]Fleiss, J. L., Nee, J. C. & Landis, J. R. Large sample variance of kappa in the case of different sets of raters. Psychological bulletin 86, 974 (1979). · DOI
- [63]Nickel, M., Murphy, K., Tresp, V. & Gabrilovich, E. A review of relational machine learning for knowledge graphs. Proceedings of the IEEE 104, 11–33 (2015). · DOI
- [65]Lin, Y., Liu, Z., Sun, M., Liu, Y. & Zhu, X. Learning entity and relation embeddings for knowledge graph completion. In Bonet, B. & Koenig, S. (eds.) Proceedings of the Twenty-Ninth AAAI Conference on Artificial Intelligence, January 25-30, 2015, Austin, Texas, USA, 2181–2187, 10.1609/AAAI.V29I1.9491 (AAAI Press, 2015). · DOI · Paper page
- [66]Trouillon, T., Welbl, J., Riedel, S., Gaussier, É. & Bouchard, G. Complex embeddings for simple link prediction. In Balcan, M. & Weinberger, K. Q. (eds.) Proceedings of the 33nd International Conference on Machine Learning, ICML 2016, New York City, NY, USA, June 19-24, 2016, vol. 48 of JMLR Workshop and Conference Proceedings, 2071–2080 (JMLR.org, 2016).
- [67]Yang, B., Yih, W., He, X., Gao, J. & Deng, L. Embedding entities and relations for learning and inference in knowledge bases. In Bengio, Y. & LeCun, Y. (eds.) 3rd International Conference on Learning Representations, ICLR 2015, San Diego, CA, USA, May 7-9, 2015, Conference Track Proceedings (2015).
- [68]Nickel, M., Tresp, V. & Kriegel, H. A three-way model for collective learning on multi-relational data. In Getoor, L. & Scheffer, T. (eds.) Proceedings of the 28th International Conference on Machine Learning, ICML 2011, Bellevue, Washington, USA, June 28 - July 2, 2011, 809–816 (Omnipress, 2011).
Cited by
Sorted by citations
Diagnosing the limits of large language models for structured scientific evidence extraction
Tan, Z., D’Souza, J., & Auer, S. (2026) · International Journal on Digital Libraries · doi:10.1007/s00799-026-00449-9
- Authors
- Dessí, D., Osborne, F., Buscaldi, D., Reforgiato Recupero, D., & Motta, E.
- Affiliations
- The Open University (GB)
- Université Sorbonne Paris Nord (FR)
- Corresponding author
- Osborne, Francesco
- Venue
- Scientific Data
- Published
- 2025-06-09
- Volume
- 12
- Issue
- 1
- Pages
- 964-964
- ISSN
- 2052-4463 (ISSN-L)
- PMC
- PMC12149285
- OpenAlex
- W4411136962
- Cited by
- 17
- References
- 5
- Citations by year
- 2026: 12 · 2025: 5
- Type
- data paper
- Language
- en
- Open access
- gold
- doi.org
- Locations
- Scientific Data (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- BOA (University of Milano-Bicocca) (publishedVersion, cc-by)
- Open Research Online (The Open University) (acceptedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- UNICA IRIS Institutional Research Information System (University of Cagliari) (submittedVersion, other-oa)
- Funders
- Italian Ministry of University and Research
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Semantic Web and Ontologies
- Physical Sciences › Computer Science › Artificial Intelligence › Advanced Graph Neural Networks
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Keywords
- knowledge base, research papers, entity linking, hypothesis generation, literature searching, scientific question answering
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review