The Semantic Scholar Open Data Platform
Open accessAbstract
The volume of scientific output is creating an urgent need for automated tools to help scientists keep up with developments in their field. Semantic Scholar (S2) is an open data platform and website aimed at accelerating science by helping scholars discover and understand scientific literature. We combine public and proprietary data sources using state-of-the-art techniques for scholarly PDF content extraction and automatic knowledge graph construction to build the Semantic Scholar Academic Graph, the largest open scientific literature graph to-date, with 200M+ papers, 80M+ authors, 550M+ paper-authorship edges, and 2.4B+ citation edges. The graph includes advanced semantic features such as structurally parsed text, natural language summaries, and vector embeddings. In this paper, we describe the components of the S2 data processing pipeline and the associated APIs offered by the platform. We will update this living document to reflect changes as we add new data offerings and improve existing services.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Semantic Scholar provides reference enrichment including citation, year, and impact.
“Semantic Scholar (Kinney et al., 2023) Dycke et al. (2023a) DOI → BibJSON Reference enrichment; citation, year, impact.”
From Can AI Be a Good Peer Reviewer? A Survey of Peer Review Process, Evaluation, and the Future (2026) · cites this paper as Kinney et al., 2023
Large language models can overlook or misuse details when faced with challenging reasoning problems.
“LLMs can overlook or misuse details when faced with challenging reasoning problems 5 .”
From Language agents achieve superhuman synthesis of scientific knowledge (2024) · cites this paper as [5]
Section 3.4.1 discusses the difficulty of generating short summaries of scientific papers, and Section 3.3 lists models used in the Semantic Scholar pipeline. Neither addresses whether large language models overlook or misuse details in challenging reasoning problems; searches for that claim and a paraphrase found no relevant passage. Page numbers were not available in our copy. (LLM, conf=0.77)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
EfficientDet: Scalable and Efficient Object Detection
Tan, M., Pang, R., & Le, Q. V. (2019) · arXiv · Cited by 9,841 · cited 1× · see citing works
“org/ (12)EfficientDet (Tan et al., 2020) model trained on PubLayNet (Zhong et al.”
SciRepEval: A Multi-Format Benchmark for Scientific Document Representations
Singh, A., D'Arcy, M., Cohan, A., Downey, D., & Feldman, S. (2022) · arXiv · doi:10.48550/arxiv.2211.13308 · Cited by 76 · cited 3×
“The code, models, and data for SPECTER are available at https://github.com/allenai/SPECTER and for SciRep-Eval at https://github.com/allenai/SciRepEval.”
Self-citation
Flagged first, then by citations
Research works printed but not linked: 15
- Waleed Ammar, Dirk Groeneveld, Chandra Bhagavat- ula, Iz Beltagy, Miles Crawford, Doug Downey, Ja- son Dunkelberger, Ahmed Elgohary, Sergey Feld- man, Vu A. Ha, Rodney Michael Kinney, Sebas- tian Kohlmeier, Kyle Lo, Tyler C. Murray, Hsu- Han Ooi, Matthew E. Peters, Joanna L. Power, Sam Skjonsberg, Lucy Lu Wang, Christopher Wilhelm, Zheng Yuan, Madeleine van Zuylen, and Oren Et- zioni. 2018. Construction of the Literature Graph in Semantic Scholar. In NAACL. https://doi.org/10. 18653/v1/N18-3011 · DOI · Paper page
- Iz Beltagy, Kyle Lo, and Arman Cohan. 2019. SciB- ERT: A Pretrained Language Model for Scientific Text. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natu- ral Language Processing (EMNLP-IJCNLP). Asso- ciation for Computational Linguistics, Hong Kong, China, 3615-3620. https://doi.org/10.18653/v1/ D19-1371 · DOI · Paper page
- Isabel Cachola, Kyle Lo, Arman Cohan, and Daniel S. Weld. 2020. TLDR: Extreme Summarization of Sci- entific Documents. In FINDINGS. https://doi.org/ 10.18653/v1/2020.findings-emnlp.428 · DOI · Paper page
- Arman Cohan, Sergey Feldman, Iz Belt- agy, Doug Downey, and Daniel S. Weld. 2020. SPECTER: Document-level Repre- sentation Learning using Citation-informed Transformers. arXiv 2004.07180 (2020). https://doi.org/10.18653/v1/2020.acl-main.207 · DOI
- Neil Houlsby, Andrei Giurgiu, Stanislaw Jastrzeb- ski, Bruna Morrone, Quentin De Laroussilhe, An- drea Gesmundo, Mona Attariyan, and Sylvain Gelly. 2019. Parameter-Efficient Transfer Learning for NLP. In Proceedings of the 36th International Con- ference on Machine Learning.
- Guolin Ke, Qi Meng, Thomas Finley, Taifeng Wang, Wei Chen, Weidong Ma, Qiwei Ye, and Tie-Yan Liu. 2017. LightGBM: A Highly Efficient Gradient Boosting Decision Tree. In NIPS.
- Mike Lewis, Yinhan Liu, Naman Goyal, Mar- jan Ghazvininejad, Abdelrahman Mohamed, Omer Levy, Ves Stoyanov, and Luke Zettlemoyer. 2019. Bart: Denoising sequence-to-sequence pre-training for natural language generation, translation, and comprehension. arXiv preprint arXiv:1910.13461 (2019). · arXiv
- Kyle Lo, Lucy Lu Wang, Mark Neumann, Rod- ney Michael Kinney, and Daniel S. Weld. 2020. S2ORC: The Semantic Scholar Open Research Cor- pus. In ACL. https://doi.org/10.18653/V1/2020. · DOI · Paper page
- ACL-MAIN.447 · DOI · Paper page
- Zejiang Shen, Kyle Lo, Lucy Lu Wang, Bailey Kuehl, Daniel S Weld, and Doug Downey. 2022. VILA: Improving structured content extraction from scien- tific PDFs using visual layout groups. Transactions of the Association for Computational Linguistics 10 (2022), 376-392.
- Zejiang Shen, Ruochen Zhang, Melissa Dell, Benjamin Charles Germain Lee, Jacob Carlson, and Weining Li. 2021. LayoutParser: A unified toolkit for deep learning based document image analysis. In Interna- tional Conference on Document Analysis and Recog- nition. Springer, 131-146.
- Arnab Sinha, Zhihong Shen, Yang Song, Hao Ma, Dar- rin Eide, Bo-June Paul Hsu, and Kuansan Wang. 2015. An Overview of Microsoft Academic Ser- vice (MAS) and Applications. Proceedings of the 24th International Conference on World Wide Web (2015). https://doi.org/10.1145/2740908.2742839 · DOI
- Shivashankar Subramanian, Daniel King, Doug Downey, and Sergey Feldman. 2021. S2AND: A Benchmark and Evaluation System for Author Name Disambiguation. ArXiv abs/2103.07534 (2021). · arXiv
- Marco Valenzuela, Vu A. Ha, and Oren Etzioni. 2015. Identifying Meaningful Citations. In AAAI Work- shop: Scholarly Big Data.
- Xu Zhong, Jianbin Tang, and Antonio Jimeno Yepes. 2019. PubLayNet: largest dataset ever for docu- ment layout analysis. In 2019 International Confer- ence on Document Analysis and Recognition (IC- DAR). IEEE, 1015-1022. https://doi.org/10.1109/ ICDAR.2019.00166 · DOI
Cited by
Sorted by citations
A review of large language models and autonomous agents in chemistry
Ramos, M. C., Collison, C. J., & White, A. D. (2025) · Chemical Science · doi:10.1039/d4sc03921a · Cited by 274 · see citing works
How should the advancement of large language models affect the practice of science?
Binz, M., Alaniz, S., Roskies, A., Aczel, B., Bergstrom, C. T., Allen, C., Schad, D., Wulff, D., West, J. D., Zhang, Q., et al. (2025) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2401227121 · Cited by 74 · see citing works
Language agents achieve superhuman synthesis of scientific knowledge
Skarlinski, M. D., Cox, S., Laurent, J. M., Braza, J. D., Hinks, M., Hammerling, M. J., Ponnapati, M., Rodriques, S. G., & White, A. D. (2024) · arXiv · doi:10.48550/arxiv.2409.13740 · Cited by 49 · see citing works
Synthesizing scientific literature with retrieval-augmented language models
Asai, A., He, J., Shao, R., Shi, W., Singh, A., Chang, J. C., Lo, K., Soldaini, L., Feldman, S., D’Arcy, M., et al. (2026) · Nature · doi:10.1038/s41586-025-10072-4 · Cited by 38 · see citing works
Self-citationLitLLM: A Toolkit for Scientific Literature Review
Agarwal, S., Sahu, G., Puri, A., Laradji, I. H., Dvijotham, K. D., Stanley, J., Charlin, L., & Pal, C. (2024) · arXiv · doi:10.48550/arxiv.2402.01788 · Cited by 13 · see citing works
HALoGEN: Fantastic LLM Hallucinations and Where to Find Them
Ravichander, A., Ghela, S., Wadden, D., & Choi, Y. (2025) · Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2025.acl-long.71 · Cited by 13 · see citing works
CiteME: Can Language Models Accurately Cite Scientific Claims?
Press, O., Hochlehnert, A., Prabhu, A., Udandarao, V., Press, O., & Bethge, M. (2024) · arXiv · doi:10.48550/arxiv.2407.12861 · Cited by 4
Can AI Be a Good Peer Reviewer? A Survey of Peer Review Process, Evaluation, and the Future
Wu, S., Jiang, O., Zhao, Y., Hu, T., Ma, Y., Zhang, K., Patwardhan, M., & Cohan, A. (2026) · Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2026.acl-long.1504 · Cited by 1 · see citing works
Self-citationMemGym: a Long-Horizon Memory Environment for LLM Agents
Xu, W., Wang, Y., Mei, K., Liang, K., Wang, Z., Jin, M., Zhang, H., Zhang, S.-X., Hua, W., Sahu, S., et al. (2026) · arXiv · doi:10.48550/arxiv.2605.20833
“C ODE QA ingests SWE-smith [51] bug-and-patch instances; M EM G YM -DR ingests results from academic search backends (arXiv, Semantic Scholar [22], OpenAlex [35], and Wikipedia).”
- Authors
- Kinney, R., Anastasiades, C., Authur, R., Beltagy, I., Bragg, J., Buraczynski, A., Cachola, I., Candra, S., Chandrasekhar, Y., Cohan, A., Crawford, M., Downey, D., Dunkelberger, J., Etzioni, O., Evans, R., Feldman, S., Gorney, J., Graham, D., Hu, F., Huff, R., King, D., Kohlmeier, S., Kuehl, B., Langan, M., Lin, D., Liu, H., Lo, K., Lochner, J., MacMillan, K., Murray, T., Newell, C., Rao, S., Rohatgi, S., Sayre, P., Shen, Z., Singh, A., Soldaini, L., Subramanian, S., Tanaka, A., Wade, A. D., Wagner, L., Wang, L. L., Wilhelm, C., Wu, C., Yang, J., Zamarron, A., Van Zuylen, M., & Weld, D. S.
- Affiliations
- Allen Institute for Artificial Intelligence (US)
- ORCID
- Kinney, Rodney
- Anastasiades, Chloe
- Authur, Russell
- Bragg, Jonathan
- Cachola, Isabel
- Candra, Stefan
- Chandrasekhar, Yoganand
- Cohan, Arman
- Downey, Doug
- Feldman, Sergey
- Hu, Fangzhou
- Huff, Regan
- King, Daniel
- Kuehl, Bailey
- Liu, Haokun
- Lo, Kyle
- Lochner, Jaron
- MacMillan, Kelsey
- Newell, Chris
- Rao, Smita
- Shen, Zejiang
- Singh, Amanpreet
- Soldaini, Luca
- Subramanian, Shivashankar
- Wade, Alex D.
- Wagner, Linda
- Wang, Lucy Lu
- Yang, Jiangjiang
- Zamarron, Angele
- Weld, Daniel S.
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2023
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 2301.10140
- OpenAlex
- W4318146754
- Cited by
- 64
- References
- 2
- Citations by year
- 2026: 7 · 2025: 21 · 2024: 22 · 2023: 13 · 2022: 1
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- arXiv (Cornell University) (submittedVersion, cc-by)
- arXiv (Cornell University) (cc-by)
- Funders
- National Science Foundation (2213656)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › scientometrics and bibliometrics research
- Physical Sciences › Computer Science › Artificial Intelligence › Semantic Web and Ontologies
- Social Sciences › Arts and Humanities › Literature and Literary Theory › Digital Humanities and Scholarship
- Keywords
- Semantic Scholar, open data portals, knowledge graph construction, citation networks, vector embeddings, semantic parsing, data pipelines, API
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
