SciBERT: A Pretrained Language Model for Scientific Text
Open accessThe DOI matches its Crossref record; 37 of the 37 references it cites were found in a registry or an index; 9 of the 33 sources its claims cite were checked for support.
Abstract
Iz Beltagy, Kyle Lo, Arman Cohan. Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP). 2019.
Overview
CoChat Summary
TL;DR
SciBERT is a BERT-based pretrained language model trained on a 3.17B-token corpus of 1.14M scientific papers, with an in-domain WordPiece vocabulary. It improves over BERT-Base across scientific NLP tasks and achieves new state-of-the-art results on several datasets.
Key findings
- SciBERT outperforms BERT-Base on scientific tasks by +2.11 F1 with finetuning and +2.43 F1 without finetuning.
- Domain breakdowns: biomedical +1.92 F1 with finetuning and +3.59 F1 without; computer science +3.55 F1 with finetuning and +1.13 F1 without; multidomain +0.49 F1 with finetuning and +0.93 F1 without.
- Finetuning beats frozen BERT embeddings by +3.25 F1 with SciBERT and +3.58 F1 with BERT-Base on average.
- Using SCIVOCAB instead of BASEVOCAB gives +0.60 F1 averaged across datasets: +0.76 F1 biomedical, +0.61 F1 computer science, +0.11 F1 multidomain. SciBERT achieves new SOTA on BC5CDR, ChemProt, EBM-NLP, ACL-ARC, the NER part of SciERC, and SciCite.
Methods
- SciBERT follows the BERT-Base architecture and is pretrained on a random sample of 1.14M Semantic Scholar papers: 18% computer science and 82% broad biomedical, using full text, averaging 154 sentences (2,769 tokens) per paper, for 3.17B tokens.
- The authors build SCIVOCAB, a 30K WordPiece vocabulary with 42% token overlap with BASEVOCAB, and train four variants: cased/uncased and BASEVOCAB/SCIVOCAB.
- Evaluation covers NER, PICO extraction, text classification, relation classification, and dependency parsing, using datasets including EBM-NLP, SciERC, ACL-ARC, SciCite, and Paper Field; results are macro F1 for most tasks, micro F1 for ChemProt, and LAS/UAS for DEP, averaged over multiple random seeds.
Limitations
- The paper states future work will release a BERT-Large analogue and experiment with different proportions of papers from each domain, noting these models are costly to train and aiming for a single resource useful across multiple domains.
- The paper notes SciBERT performs slightly worse than SOTA on JNLPBA, NCBI-disease, and GENIA, attributing these to comparison models: a BiLSTM-CRF ensemble trained on multiple NER datasets, BIOBERT trained on 18B biomedical tokens, and a parser using POS features not used here.
- Evident from the text: the pretraining corpus is limited to computer science and biomedical papers, so coverage of other scientific domains is not established; frozen-embedding experiments did not use extensive hyperparameter search; and SciERC relation results are not comparable to prior work because this paper uses gold entities while prior work performs joint entity and relation extraction.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
9 Valid · 0 Not valid · 16 Not checked · 29 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Yet while both BERT and ELMo have released pretrained models, they are still trained on general domain corpora such as news articles and Wikipedia.”
§ SCIBERT: A Pretrained Language Model for Scientific Text > 1 Introduction
What the sources say
- Not checked — no full text of the sourcecites Devlin et al., 2019 matched to “BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding” (2019) source
- Partly supportedcites Peters et al., 2018 matched to “Deep Contextualized Word Representations” (2018) sourceExperimental — accuracy not yet measured
Section 3.4 says the ELMo biLM was pretrained on the 1B Word Benchmark, and the Introduction says the trained models were made publicly available. The paper does not discuss BERT or Wikipedia, or identify the benchmark text as news articles, so it does not support those parts of the sentence. (LLM, conf=0.86)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“As shown through ELMo (Peters et al., 2018), GPT (Radford et al., 2018) and BERT (Devlin et al., 2019), unsupervised pretraining of language models on large corpora significantly improves performance on many NLP tasks.”
§ SCIBERT: A Pretrained Language Model for Scientific Text > 1 Introduction
What the sources say
- Supportedcites Peters et al., 2018 matched to “Deep Contextualized Word Representations” (2018) source
Section 2 describes pretraining ELMo’s bidirectional language model on unlabeled data, and Section 3.4 identifies the large 1B Word Benchmark training corpus. Section 4 reports that adding ELMo improved results across six NLP benchmark tasks, with relative error reductions of 6–20%. This supports the claim as it relates to ELMo; the other cited models are not attributed to this source. (LLM, conf=0.92)
- Not matchedcites Radford et al., 2018
An author–year citation the paper’s reference list doesn’t settle. We don’t search these by name.
- Not checked — no full text of the sourcecites Devlin et al., 2019 matched to “BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding” (2019) source
boostedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“SCIBERT significantly outperformed BERT-Base and achieves new SOTA results on several of these tasks, even compared to some reported BIOBERT (Lee et al., 2019) results on biomedical tasks.”
§ SCIBERT: A Pretrained Language Model for Scientific Text > 7 Conclusion and Future Work
What the sources say
- Supportedcites Lee et al., 2019 matched to “BioBERT: a pre-trained biomedical language representation model for biomedical text mining” (2019) source
The citation identifies the source of the reported BioBERT results used as a comparator, rather than attributing the SciBERT comparison to Lee et al. The Experimental results (§4.3) report BioBERT performance on biomedical named-entity recognition, relation extraction, and question-answering tasks. (LLM, conf=0.90)
boostedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“In Table 2, we compare SCIBERT results with reported BIOBERT results on the subset of datasets included in (Lee et al., 2019) BC5CDR and ChemProt, and performs similarly on JNLPBA despite being trained on a substantially smaller biomedical corpus.”
§ SCIBERT: A Pretrained Language Model for Scientific Text > 4.1 Biomedical Domain
What the sources say
- Supportedcites Lee et al., 2019 matched to “BioBERT: a pre-trained biomedical language representation model for biomedical text mining” (2019) source
The results tables in our copy report BioBERT scores for BC5CDR, ChemProt, and JNLPBA (section 6; page unavailable). The citation identifies the source of those reported BioBERT results; the comparison with SciBERT is the citing authors’ own conclusion. (LLM, conf=0.90)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“In addition, SCIBERT outperforms the SOTA on SciCite (Co-han et al., 2019).”
§ SCIBERT: A Pretrained Language Model for Scientific Text > 4.3 Multiple Domains
What the sources say
- Partly supportedcites Cohan et al., 2019 matched to “Structural Scaffolds for Citation Intent Classification in Scientific Publications” (2019) sourceExperimental — accuracy not yet measured
Table 4 (section 4.3 Results; page unavailable) shows that the paper’s BiLSTM-Attn model with ELMo and both scaffolds outperformed the listed previous SOTA on SciCite (84.0 versus 79.6 macro F1). It does not report a SciBERT result, so it does not support attributing that improvement to SciBERT. (LLM, conf=0.85)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on an assumption not shown here.
- Partly supported
17 more claims
Create a free account to see all 54 claims and to verify the 13 references still open.
- Probably not a substantial claim. 17
- It may state two separate claims as one. 17
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“With their word-piece vocabulary, contextual embeddings, and self-supervised pre-training on large unlabelled corpora these models have essentially removed the need for most pre-processing beyond automatically-applied lowercasing. 14,31”
From Data extraction methods for systematic review (semi)automation: Update of a living systematic review (2025) · cites this paper as [31]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“SciBERT, introduced by Beltagy et al. [16], was the first language model tailored for scientific texts.”
From Evaluating Large Language Models for Structured Science Summarization in the Open Research Knowledge Graph (2024) · cites this paper as [16]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Hence, we base our experiments on well-established large language models (LLM) from the general and scientific domain -RoBERTa (Liu et al., 2019), BioBERT (Lee et al., 2020) and SciBERT ( Beltagy et al., 2019) -with the recommended default hyperparameter settings.”
From NLPeer: A Unified Resource for the Computational Study of Peer Review (2023) · cites this paper as Beltagy et al., 2019
The cited source says what the claim attributes to it.
In the citing paper
“Although the first experiments with BERT ( 39 ) were disappointing, fine-tuning SciBERT ( 40 ) led to the best results and is the current production architecture of the platform.”
From scite: a smart citation index that displays the context of citations and classifies their intent using deep learning (2021) · cites this paper as [40]
The cited source says what the claim attributes to it.
In the citing paper
“Similar observations have been made in prior work, e.g. Beltagy et al. (2019) found that pre-training BERT on text from research papers improved its performance on scientific tasks.”
From Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer (2019) · cites this paper as Beltagy et al. (2019)
7 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Exploiting Generative AI to Scale up Intelligent Tutoring Systems
Jakubův, J., Chvalovský, K., Goertzel, Z., Kaliszyk, C., Olšák, M., Piotrowski, B., Schulz, S., Suda, M., & Urban, J. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.itp.2023.19 · Cited by 76,658
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325 · cited 7×
“3617 Casing We follow Devlin et al. (2019) in using the cased models for NER and the uncased models for all other tasks.”
BackgroundMethodInfluentialDeep Contextualized Word Representations
Peters, M., Neumann, M., Iyyer, M., Gardner, M., Clark, C., Lee, K., & Zettlemoyer, L. (2018) · Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers) · doi:10.18653/v1/n18-1202 · Cited by 11,983
MIMIC-III, a freely accessible critical care database
Johnson, A. E. W., Pollard, T. J., Shen, L., Lehman, L.-W. H., Feng, M., Ghassemi, M., Moody, B., Szolovits, P., Anthony Celi, L., & Mark, R. G. (2016) · Scientific Data · doi:10.1038/sdata.2016.35 · Cited by 8,141
BioBERT: a pre-trained biomedical language representation model for biomedical text mining
Lee, J., Yoon, W., Kim, S., Kim, D., Kim, S., So, C. H., & Kang, J. (2020) · Bioinformatics · doi:10.1093/bioinformatics/btz682 · Cited by 7,218 · cited 5×
“Recent work on domain adaptation of BERT includes B IO B ERT (Lee et al., 2019) and C LINI - CAL B ERT (Alsentzer et al., 2019; Huang et al., 2019).”
MethodResultInfluentialGoogle's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation
Wu, Y., Schuster, M., Chen, Z., Le, Q. V., Norouzi, M., Macherey, W., Krikun, M., Cao, Y., Gao, Q., Macherey, K., et al. (2016) · arXiv · doi:10.48550/arxiv.1609.08144 · Cited by 5,319
Universal Language Model Fine-tuning for Text Classification
Howard, J., & Ruder, S. (2018) · Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p18-1031 · Cited by 4,100 · cited 2×
“We finetune for 2 to 5 epochs using a batch size of 32 and a learning rate of 5e-6, 1e5, 2e-5, or 5e-5 with a slanted triangular schedule (Howard and Ruder, 2018) which is equivalent to the linear warmup followed by linear decay (Devlin et al.”
Method
Cited by
Items 1,001–1,100 of 3,596
Huang, Z., He, L., Yang, Y., Li, A., Zhang, Z., Wu, S., Wang, Y., He, Y. Z., & Liu, X. (2024) · Journal of Cheminformatics · doi:10.1186/s13321-024-00874-5 · Cited by 16
“To investigate the effects of different BERT models on NER performance, the performance of MatSciBERT [21], BioBERT [31], and SciBERT [32] was evaluated for the NER (5) task.”
MethodLiu, K., Ma, Z., Kang, X., Zhong, Z., Jiao, Z., Baird, G. L., Bai, H. X., & Miao, Q. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72384-1_41 · Cited by 29
“We regard ResNet101 [5,9] pre-trained on ImageNet as the image encoder, and a six-layer pre-trained SciBERT [1] model as the text encoder.”
Bakker, R. M., Schoevers, A. J., van Drie, R. A. N., Schraagen, M., & de Boer, M. (2025) · Artificial Intelligence and Law · doi:10.1007/s10506-025-09437-x · Cited by 20
exHarmony: Authorship and Citations for Benchmarking the Reviewer Assignment Problem
Ebrahimi, S., Salamat, S., Arabzadeh, N., Bashari, M., & Bagheri, E. (2025) · Lecture notes in computer science · doi:10.1007/978-3-031-88714-7_1 · Cited by 17
Integrated Digital Library System for Long Documents and their Elements
Chekuri, S., Chandrasekar, P., Banerjee, B., Park, S. H., Masrourisaadat, N., Ahuja, A., Ingram, W. A., & Fox, E. A. (2023) · ACM/IEEE Joint Conference on Digital Libraries · doi:10.1109/jcdl57899.2023.00012 · Cited by 15
“BERT [20] and SciBERT [8] are some popular language models that uses transformers to perform various sequence tasks including classification.”
MethodInfluentialMultiple Sclerosis Severity Classification From Clinical Text
D’Costa, A., Denkovski, S., Malyska, M., Moon, S. Y., Rufino, B., Yang, Z., Killian, T. W., & Ghassemi, M. (2020) · Clinical Natural Language Processing Workshop (ClinicalNLP) · doi:10.18653/v1/2020.clinicalnlp-1.2 · Cited by 16
A Global Dataset Mapping the AI Innovation from Academic Research to Industrial Patents
Gong, H., Zou, H., Liang, X., Meng, S., Cai, P., Xu, X., & Qu, J. (2025) · Scientific Data · doi:10.1038/s41597-025-05518-3 · Cited by 15
Accurate Medical Named Entity Recognition Through Specialized NLP Models
Hu, J., Bao, R., Lin, Y., Zhang, H., & Xiang, Y. (2024) · arXiv · doi:10.48550/arxiv.2412.08255 · Cited by 14
“Precision% F1-score Bert [23] 82.5 81.0 ClinicalBERT [24] 85.2 83.5 SciBert [25] 84.1 82.8 BlueBert [26] 87.3 85.0 BioBert [27] 89.8 87.6 Through the experimental results, we can see that BioBERT performs best in the task of medical named entity recognition, surpassing other models in precision and…”
InfluentialGuo, Y., Al-Garadi, M. A., Book, W., Ivey, L. C., Rodriguez, F. H., Raskind-Hood, C. L., Robichaux, C. J., & Sarker, A. (2023) · Journal of the American Heart Association · doi:10.1161/jaha.123.030046 · Cited by 17
Ngo, G. H., Nguyen, M., Chen, N. F., & Sabuncu, M. R. (2022) · Medical Image Analysis · doi:10.1016/j.media.2022.102540 · Cited by 16
The Effect of Metadata on Scientific Literature Tagging: A Cross-Field Cross-Model Study
Zhang, Y., Jin, B., Zhu, Q., Yu, M., & Han, J. (2023) · International World Wide Web Conference (WWW) · doi:10.1145/3543507.3583354 · Cited by 35
“Previous classifers built upon pre-trained language models (PLMs) mainly utilize BERT [10], BioBERT [20], SciBERT [3], XLNet [46], or RoBERTa [25] to derive document representations.”
MethodMosca, E., Abdalla, M. H. I., Basso, P., Musumeci, M., & Groh, G. (2023) · Proceedings of the 3rd Workshop on Trustworthy Natural Language Processing (TrustNLP 2023) · doi:10.18653/v1/2023.trustnlp-1.17 · Cited by 14
FedBFPT: An Efficient Federated Learning Framework for Bert Further Pre-training
Wang, X., Li, H., Chen, K., & Shou, L. (2023) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2023/483 · Cited by 20
“These models are typically trained on general corpora but can yield better performance on specialized domain tasks after undergoing further pre-training [Beltagy et al. , 2019] using specialized datasets.”
MethodA tree-like structured perceptron for transition-based biomedical event extraction
Su, F., Tao, Q., Zhou, J., Li, B., Li, F., Teng, C., & Ji, D. (2023) · Knowledge-Based Systems · doi:10.1016/j.knosys.2023.111180 · Cited by 14
Lamproudis, A., Henriksson, A., & Dalianis, H. (2021) · International conference Recent advances in natural language processing · doi:10.26615/978-954-452-072-4_090 · Cited by 14
Measurement Extraction with Natural Language Processing: A Review
Göpfert, J., Kuckertz, P., Weinand, J. M., Kotzur, L., & Stolten, D. (2022) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2022.findings-emnlp.161 · Cited by 26
Pack Together: Entity and Relation Extraction with Levitated Marker.Preprint
Ye, D., Lin, Y., & Sun, M. (2021) · arXiv (Cornell University) · Cited by 14
Large Language Models Meet Graph Neural Networks: A Perspective of Graph Mining
You, Y., Liu, Z., Wen, X., Zhang, Y., & Ai, W. (2025) · Mathematics · doi:10.3390/math13071147 · Cited by 19
Liu, Y., Liu, D., Yang, Z., Ge, X., Yao, W., Wu, J., Avdeev, M., & Shi, S. (2025) · Energy storage materials · doi:10.1016/j.ensm.2025.104390 · Cited by 22
Improving Bug Localization With Effective Contrastive Learning Representation
Luo, Z., Wang, W., & Cen, C. (2022) · IEEE Access · doi:10.1109/access.2022.3228802 · Cited by 14
Chen, L., Qi, Y., Wu, A., Deng, L., & Jiang, T. (2023) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2023.3315143 · Cited by 17
“(cid:2) Domain-specific PLMs: MedBERT [25], PubMed-BERT [26], SciBERT [27], and UmlsBERT [28] show advantages on multiple biomedical NLP tasks.”
BackgroundMethodZhang, Z., Li, Z., Zhu, J., Guo, Z., Shi, B., & Hu, B. (2024) · Knowledge-Based Systems · doi:10.1016/j.knosys.2024.111650 · Cited by 14
HANSynergy: Heterogeneous Graph Attention Network for Drug Synergy Prediction
Cheng, N., Wang, L. S., Liu, Y., Song, B., & Ding, C. (2024) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.4c00003 · Cited by 16
Improved multi-label hierarchical patent classification using LLMs
Rafieian, B., & Vázquez, P. (2025) · World Patent Information · doi:10.1016/j.wpi.2025.102356 · Cited by 17
Exploiting Position and Contextual Word Embeddings for Keyphrase Extraction from Scientific Papers
Patel, K., & Caragea, C. (2021) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/2021.eacl-main.136 · Cited by 14
Citation Recommendation for Research Papers via Knowledge Graphs
Brack, A., Hoppe, A., & Ewerth, R. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-86324-1_20 · Cited by 19
MS-Mentions: Consistently Annotating Entity Mentions in Materials Science Procedural Text
O’Gorman, T., Jensen, Z., Mysore, S., Huang, K., Mahbub, R., Olivetti, E., & McCallum, A. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.101 · Cited by 14
When BERT Started Traveling: TourBERT—A Natural Language Processing Model for the Travel Industry
Arefeva, V., & Egger, R. (2022) · Digital · doi:10.3390/digital2040030 · Cited by 14
Zhang, L., Su, J., Min, Z., Miao, Z., Hu, Q., Fu, B., Shi, X., & Chen, Y. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i11.26635 · Cited by 22
“We use BERT-base (Devlin et al. 2019) or RoBERTa-large (Liu et al. 2019) as the encoder on DocRED, and SciBERT-base (Beltagy, Lo, and Cohan 2019) on CDR and GDA.”
MethodAnnotating Materials Science Text: A Semi-automated Approach for Crafting Outputs with Gemini Pro
Sayeed, H. M., Mohanty, T., & Sparks, T. D. (2024) · Integrating materials and manufacturing innovation · doi:10.1007/s40192-024-00356-4 · Cited by 21
Exploring the Politeness of Instructional Strategies from Human-Human Online Tutoring Dialogues
Lin, J., Raković, M., Lang, D., Gašević, D., & Chen, G. (2022) · International Conference on Learning Analytics and Knowledge (LAK) · doi:10.1145/3506860.3506904 · Cited by 19
“To automatically identify the dialogue acts, our previous work [21] applied the BERT language model [1] to train a dialogue act classifier, which was built on 3,629 utterances (training, validation, and testing datasets in the ratio of 80%:10%:10%) from tutors and students.”
BackgroundMethodInfluentialRequirements Classification for Smart Allocation: A Case Study in the Railway Industry
Bashir, S., Abbas, M., Ferrari, A., Saadatmand, M., & Lindberg, P. (2023) · IEEE International Requirements Engineering Conference (RE) · doi:10.1109/re57278.2023.00028 · Cited by 14
“The BERT variants considered in our paper are BERT base [30], RoBERTa [31], and SciBERT [32].”
Luschi, A., Nesi, P., & Iadanza, E. (2023) · Heliyon · doi:10.1016/j.heliyon.2023.e21723 · Cited by 17
“Notable examples of successful BERT-based models in this domain are: • SciBERT [34] is an extension of the foundational BERT architecture, tailored to enhance its performance when dealing with scientific data.”
BackgroundIndustry-sensitive language modeling for business
Borchert, P., Coussement, K., Weerdt, J. D., & Caigny, A. D. (2024) · European Journal of Operational Research · doi:10.1016/j.ejor.2024.01.023 · Cited by 14
Enhancing Relation Extraction from Biomedical Texts by Large Language Models
Asada, M., & Fukuda, K. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-60615-1_1 · Cited by 22
End-to-end framework for agricultural entity extraction – A hybrid model with transformer
Mol, E. A. N., & Kumar, M. B. S. (2024) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2024.109309 · Cited by 14
BERTweet.BR: a pre-trained language model for tweets in Portuguese
Carneiro, F., Vianna, D., Carvalho, J., Plastino, A., & Paes, A. (2024) · Neural Computing and Applications · doi:10.1007/s00521-024-10711-3 · Cited by 14
“…downstream tasks in various languages, when applied to specialized domains, such as biomedical, sci-entific, or legal texts, the generic-domain representations have been shown to underperform in many target domain tasks, as shown in works like Lee et al [26];Beltagy et al [4]; Chalkidis et al [9].”
DeB3RTa: A Transformer-Based Model for the Portuguese Financial Domain
Pires, H. F., Paucar, V. L., & Carvalho, J. P. (2025) · Big Data and Cognitive Computing · doi:10.3390/bdcc9030051 · Cited by 16
“…of domain adaptation, recent scientific literature has high-lighted the effectiveness of mixed-domain PLMs. Notable examples include SciBERT [49], which was developed for computer science and biomedical domains; BioBERTpt(all) [50], which was trained on Brazilian clinical text and…”
Text2Brain: Synthesis of Brain Activation Maps from Free-Form Text Query
Ngo, G. H., Nguyen, M., Chen, N. F., & Sabuncu, M. R. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-87234-2_57 · Cited by 16
“By finetuning a high-capacity SciBERT-based text encoder to predict coordinate-based meta-analytic maps, Text2Brain captures the rich relationship in the language representational space, allowing the model to generalize its prediction for synonymous queries.”
Affect Analysis in Arabic Text: Further Pre-Training Language Models for Sentiment and Emotion
Alshehri, W., Al-Twairesh, N., & Alothaim, A. (2023) · Applied Sciences · doi:10.3390/app13095609 · Cited by 14
“Moreover, in [74], it was shown that pre-training with a custom vocabulary has outcomes that coincide with the outcomes that result from pre-training with a general vocabulary.”
Liu, H., Sarol, M. J., & Halil Kilicoglu, B. (2021) · International Workshop on Semantic Evaluation (SemEval) · doi:10.18653/v1/2021.semeval-1.45 · Cited by 14
Revisiting named entity recognition in food computing: enhancing performance and robustness
Akujuobi, U., Liu, S., & Besold, T. R. (2024) · Artificial Intelligence Review · doi:10.1007/s10462-024-10834-y · Cited by 18
“This finding has been replicated in numerous studies (Devlin et al. 2018; Wu and He 2019; Xu et al. 2019), with notable performance in the specialized domains of biomedical NER (bioNER) (Lee et al. 2020; Alsentzer et al. 2019; Beltagy et al. 2019).”
Enhancing TextGCN for depression detection on social media with emotion representation
Mao, H., & Qing, H. (2025) · Frontiers in Psychology · doi:10.3389/fpsyg.2025.1612769 · Cited by 20
BOND: Bootstrapping From-Scratch Name Disambiguation with Multi-task Promoting
Cheng, Y., Chen, B., Zhang, F., & Tang, J. (2024) · International World Wide Web Conference (WWW) · doi:10.1145/3589334.3645580 · Cited by 14
Automatically learning linguistic structures for entity relation extraction
Yang, W., Chen, Y., Xu, J., Qin, Y., & Chen, P. (2024) · Information Processing & Management · doi:10.1016/j.ipm.2024.103904 · Cited by 15
BioKGrapher: Initial evaluation of automated knowledge graph construction from biomedical literature
Schäfer, H., Idrissi-Yaghir, A., Arzideh, K., Damm, H., Pakull, T. M. G., Schmidt, C. S., Bahn, M., Lodde, G. C., Livingstone, E., Schadendorf, D., et al. (2024) · Computational and Structural Biotechnology Journal · doi:10.1016/j.csbj.2024.10.017 · Cited by 19
Soft cosine and extended cosine adaptation for pre-trained language model semantic vector analysis
Ijebu, F. F., Liu, Y., Sun, C., & Usip, P. U. (2024) · Applied Soft Computing · doi:10.1016/j.asoc.2024.112551 · Cited by 16
Jiang, J., Ying, F., & Dhuny, R. (2025) · Applied Sciences · doi:10.3390/app15073783 · Cited by 18
Machine learning approaches for automated software traceability: A systematic literature review
Alturayeif, N., Hassine, J., & Ahmad, I. (2025) · Journal of Systems and Software · doi:10.1016/j.jss.2025.112536 · Cited by 18
Pandey, S. R., Tile, J. D., & Oghaz, M. M. (2025) · PLoS ONE · doi:10.1371/journal.pone.0328848 · Cited by 17
“Their study explored BERT variants such as BioBERT [42], SciBERT [43] and Clini-calBERT [40] in predicting 30-day readmissions for elderly patients.”
Farewell to Aimless Large-scale Pretraining: Influential Subset Selection for Language Model
Wang, X., Zhou, W., Zhang, Q., Zhou, J., Gao, S., Wang, J., Zhang, M., Gao, X., Chen, Y. W., & Gui, T. (2023) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2023.findings-acl.35 · Cited by 21
Tang, X., Tran, A., Tan, J. T. C., & Gerstein, M. (2023) · Clinical Natural Language Processing Workshop (ClinicalNLP) · doi:10.18653/v1/2023.clinicalnlp-1.58 · Cited by 19
Leveraging Socio-contextual Information in BERT for Fake Health News Detection in Social Media
Upadhyay, R., Pasi, G., & Viviani, M. (2023) · OASIS@HT · doi:10.1145/3599696.3612902 · Cited by 17
“[32] proposed a self-ensemble SciBERT [4] model for detecting health misinformation in news, using a custom”
MethodEnhancing Biomedical Lay Summarisation with External Knowledge Graphs
Goldsack, T., Zhang, Z., Tang, C., Scarton, C., & Lin, C. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.498 · Cited by 28
Zheng, A., Zhao, H., Luo, Z., Feng, C., Liu, X., & Ye, Y. (2021) · Information Processing & Management · doi:10.1016/j.ipm.2021.102638 · Cited by 16
Large Scale Substitution-based Word Sense Induction
Eyal, M., Sadde, S., Taub-Tabib, H., & Goldberg, Y. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.325 · Cited by 14
BERT_SE: A Pre-trained Language Representation Model for Software Engineering
Fávero, E. M. D. B., & Casanova, D. (2021) · NLP Techniques and Applications · doi:10.5121/csit.2021.111909 · Cited by 13
“The use of pre-trained models for specific domains has shown good results in their applications, such as SciBERT [40] - a pre-trained Language Model for Scientific Text, and BioBERT [41] - a pre-trained biomedical language representation model for biomedical text mining.”
MethodJoint Biomedical Entity and Relation Extraction with Knowledge-Enhanced Collective InferencePreprint
Lai, T., Ji, H., Zhai, C., & Tran, Q. H. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2105.13456 · Cited by 19
“Our model first constructs a contextualized representation for each input token using SciBERT (Beltagy et al., 2019).”
BackgroundMethodInfluentialDeveloping a general-purpose clinical language inference model from a large corpus of clinical notesPreprint
Sushil, M., Ludwig, D., Butte, A. J., & Rudrapatna, V. A. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2210.06566 · Cited by 19
rbio1 - training scientific reasoning LLMs with biological world models as soft verifiersPreprint
Istrate, A.-M., Milletarì, F., Castrotorres, F., Tomczak, J. M., Torkar, M., Li, D., & Karaletsos, T. (2025) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2025.08.18.670981 · Cited by 27
Wang, X., Huey, S. L., Sheng, R., Mehta, S., & Wang, F. (2025) · Campbell Systematic Reviews: Better Evidence for a Better World · doi:10.1002/cl2.70073 · Cited by 13
“These vectors are useful for downstream classification tasks (Lewis, Ott, et al. 2020).”
InfluentialMaterialBERT for natural language processing of materials science texts
Yoshitake, M., Sato, F., Kawano, H., & Teraoka, H. (2022) · Science and Technology of Advanced Materials Methods · doi:10.1080/27660400.2022.2124831 · Cited by 30
“following way: first, a vocabulary list was made in the same way as the authors of SciBERT [19] did except the vocabulary size, where the vocabulary list was made during the training of a tokenizer with SentencePiece [31] using our material science corpus.”
MethodInfluentialDenoising Graph Inference Network for Document-Level Relation Extraction
Wang, H., Qin, K., Duan, G., & Luo, G. (2023) · Big Data Mining and Analytics · doi:10.26599/bdma.2022.9020051 · Cited by 13
Gerasimenko, N. A., Chernyavsky, A. S., & Никифорова, М. А. (2022) · Doklady Mathematics · doi:10.1134/s1064562422060072 · Cited by 13
“The resulting model is referred to as RuSciBERT.”
MethodInfluentialQuestion-answering system extracts information on injection drug use from clinical notes
Mahbub, M., Goethert, I., Danciu, I., Knight, K., Srinivasan, S., Tamang, S. R., Rozenberg‐Ben‐Dror, K., Solares, H., Martins, S. B., Trafton, J. A., et al. (2024) · Communications Medicine · doi:10.1038/s43856-024-00470-6 · Cited by 15
“After reviewing the hyperparameters utilized in various QA tasks as outlined in [62, 63, 64, 52, 65, 66, 67, 68, 53, 25], we set the document stride to 128 and opted for a batch size of 32, a learning rate of 3 e − 5 and a training epoch count of 5 for the training configurations.”
MethodEvolutions of semantic consistency in research topic via contextualized word embedding
Huang, S., Lu, W. P., Cheng, Q., Luo, Z., & Huang, Y. (2024) · Information Processing & Management · doi:10.1016/j.ipm.2024.103859 · Cited by 13
Introducing MagBERT: A language model for magnesium textual data mining and analysis
Kumar, S., Jaafreh, R., Singh, N., Hamad, K., & Yoon, D. H. (2024) · Journal of Magnesium and Alloys · doi:10.1016/j.jma.2024.08.010 · Cited by 13
Dynamic Privacy-Preserving Recommendations on Academic Graph Data
Purificato, E., Wehnert, S., & Luca, E. W. D. (2021) · Computers · doi:10.3390/computers10090107 · Cited by 14
“This method is opposed to the second one of employing the contextual word embedding distance between the hypernym (with optional expansion to synonyms and domains) and the whole text of the title, computed by the BERTScore [55] using the pre-trained SciBERT model [56].”
MethodErdengasileng, A., Han, Q., Zhao, T., Tian, S., Sui, X., Li, K., Wang, W., Wang, J., Hu, T., Pan, F., et al. (2022) · Database · doi:10.1093/database/baac066 · Cited by 16
“We tried different per-trained models on different tracks, including Bidirectional Encoder Representations from Transformers (BERT) (27) (Tracks 1, 2, 3 and 5), BioBERT (28) (Track 1, 2, and 3), PubMedBERT (29) abstract only (Track 5), PubMedBERT fulltext [Tracks 1, 2, 3 (abstract only and full text) and 5], Sentence…”
MethodCOVIDScholar: An automated COVID-19 research aggregation and analysis platform
Dagdelen, J. M., Trewartha, A., Huo, H., Fei, Y., He, T., Cruse, K., Wang, Z., Subramanian, A., Justus, B., Ceder, G., et al. (2023) · PLoS ONE · doi:10.1371/journal.pone.0281147 · Cited by 13
“ROC curves for discipline classification models of paper abstracts using a fine-tuned SciBERT [28] model adapted for classification.”
MethodInfluentialWhen Does Pretraining Help? Assessing Self-Supervised Learning for Law and the CaseHOLD Dataset
Zheng, L., Guha, N., Anderson, B. R., Henderson, P., & Ho, D. E. (2021) · arXiv · doi:10.48550/arxiv.2104.08671
“DS scores may also be readily extended to estimate the domain-specificity of tasks in other domains with existing pretrained models like SciBERT and BioBERT [3, 25].”
BackgroundMethodResultInfluentialHow Have Global Scientists Responded to Tackling COVID-19?Preprint
Cao, L., & Hou, W. (2022) · medRxiv · doi:10.1101/2022.08.16.22278871 · Cited by 13
Wang, P., Li, S., Liu, S., Tang, J., & Wang, T. (2023) · Information Processing & Management · doi:10.1016/j.ipm.2023.103409 · Cited by 16
Towards Better Document-level Relation Extraction via Iterative Inference
Zhang, L., Su, J., Chen, Y., Miao, Z., Min, Z., Hu, Q., & Shi, X. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.568 · Cited by 22
A Hybrid Citation Recommendation Model With SciBERT and GraphSAGE
Dinh, T. N., Pham, P., Giang, N. L., Nguyên, N. T., & Vo, B. (2024) · IEEE Transactions on Systems Man and Cybernetics Systems · doi:10.1109/tsmc.2024.3490774 · Cited by 14
“In this article, we construct a novel context-aware citation recommendation model by combining two of the latest achievements with regard to scientific textual/contextual and graph-based data representation learning techniques: 1) SciBERT [15] and 2) GraphSAGE [17].”
InfluentialA document-level relation extraction method based on dual-angle attention transfer fusion
Wei, F., Yang, W., Liu, S., Fu, C., Dai, Q., Chen, D., Tian, X., Kong, B., & Jia, L. (2025) · Expert Systems with Applications · doi:10.1016/j.eswa.2025.126615 · Cited by 14
Bonnet, S., & Teuteberg, F. (2025) · International Journal of Knowledge Management · doi:10.4018/ijkm.368223 · Cited by 16
Choi, J., Yoon, J., & Lee, C. (2025) · Computers & Industrial Engineering · doi:10.1016/j.cie.2025.111034 · Cited by 13
Improving Policing with Natural Language Processing
Dixon, A., & Birks, D. (2021) · Workshop on NLP for Positive Impact (NLP4PI) · doi:10.18653/v1/2021.nlp4posimpact-1.13 · Cited by 19
Exploiting ICD Hierarchy for Classification of EHRs in Spanish Through Multi-Task Transformers
Blanco, A., Pérez, A., & Casillas, A. (2021) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2021.3112130 · Cited by 16
A Dataset for N-ary Relation Extraction of Drug Combinations
Tiktinsky, A., Viswanathan, V., Niezni, D., Azagury, D. M., Shamay, Y., Taub-Tabib, H., Hope, T., & Goldberg, Y. (2022) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2022.naacl-main.233 · Cited by 22
Chen, H.-H., Nguyen, H., & Alghamdi, A. A. (2022) · Scientometrics · doi:10.1007/s11192-022-04380-z · Cited by 14
“We encode sentences with BERT, and SCI-BERT embeddings trained on the BERT architecture and further fine-tune it in our dataset.”
BackgroundMethodInfluentialYadav, S., Lokala, U., Daniulaityte, R., Thirunarayan, K., Lamy, F. R., & Sheth, A. (2021) · PLoS ONE · doi:10.1371/journal.pone.0248299 · Cited by 20
An ALBERT-based Similarity Measure for Mathematical Answer Retrieval
Reusch, A., Thiele, M., & Lehner, W. (2021) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3404835.3463023 · Cited by 13
RPT: Toward Transferable Model on Heterogeneous Researcher Data via Pre-Training
Qiao, Z., Fu, Y., Wang, P., Xiao, M., Ning, Z., Zhang, D., Du, Y., & Zhou, Y. (2022) · IEEE Transactions on Big Data · doi:10.1109/tbdata.2022.3152386 · Cited by 19
“For example, SciBERT [17] leverages BERT on scientific publications to improve the performance ondownstream”
MethodFact-condition statements and super relation extraction for geothermic knowledge graphs construction
Chen, Q., Yao, H. L., Li, S., Li, X., Kang, X., Lai, W., & Kuang, J. (2022) · Geoscience Frontiers · doi:10.1016/j.gsf.2022.101412 · Cited by 13
mDAPT: Multilingual Domain Adaptive Pretraining in a Single Model
Jørgensen, R. K., Hartmann, M., Dai, X., & Elliott, D. (2021) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2021.findings-emnlp.290 · Cited by 13
Schema matching based on energy domain pre-trained language model
Pan, Z., Yang, M., & Monti, A. (2023) · Energy Informatics · doi:10.1186/s42162-023-00277-0 · Cited by 13
“Scibert even outperforms BioBert results on BC5CDR and ChemProt in the biomedical domain and achieves new SOTA results on ACLARC, and the NER part of SciERC (Beltagy et al. 2019).”
BackgroundMethodResultInfluentialSekli, G. M. (2024) · Kybernetes · doi:10.1108/k-03-2024-0554 · Cited by 14
Sequential Span Classification with Neural Semi-Markov CRFs for Biomedical Abstracts
Yamada, K. C., Hirao, T., Sasano, R., Takeda, K., & Nagata, M. (2020) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2020.findings-emnlp.77 · Cited by 18
LitSearch: A Retrieval Benchmark for Scientific Literature Search
Ajith, A., Xia, M., Chevalier, A., Goyal, T., Chen, D., & Gao, T. (2024) · arXiv · doi:10.48550/arxiv.2407.18940 · Cited by 13
“There are also language models and retrieval models specifically trained for scientific document understanding and retrieval tasks, such as SciBERT (Beltagy et al., 2019) and SPECTER (Cohan et al., 2020).”
MethodExploring Jiu-Jitsu Argumentation for Writing Peer Review Rebuttals
Purkayastha, S., Lauscher, A., & Gurevych, I. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.894 · Cited by 24
Lancheros, B. S., Pastor, G. C., & Mitkov, R. (2024) · Language Resources and Evaluation · doi:10.1007/s10579-024-09738-8 · Cited by 13
“Beltagy et al. (2019) re-trained BERT using biomedical data from Semantic Scholar to create SciBERT.”
KMTLabeler: An Interactive Knowledge-Assisted Labeling Tool for Medical Text Classification
Wang, H., Ouyang, Y., Wu, Y., Jiang, C., Jin, L., Cao, Y., & Li, Q. (2024) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2024.3406387 · Cited by 15
“Noteworthy models like SciB-ERT [17], and ClinicalBERT [18] were pre-trained on diverse corpora such as PubMed and MIMIC-III, indicating their applicability and potential in various medical and scientific domains.”
Nentidis, A., Katsimpras, G., Krithara, A., López, S. L., Farré-Maduell, E., Krallinger, M., Loukachevitch, N., Davydova, V., Tutubalina, E. V., & Παλιούρας, Γ. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-71908-0_1 · Cited by 13
“In contrast, participants were able to use a wider variety of models for English, such as BioLinkBERT [52] or SciBERT [7], and Spanish.”
Augmenting biomedical named entity recognition with general-domain resources
Yin, Y., Kim, H., Xiao, X., Wei, C.-H., Kang, J., Lu, Z., Xu, H., Fang, M., & Chen, Q. (2024) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2024.104731 · Cited by 16
Wong, G. C., Kane, R. L., Chu, C.-C. J., Lin, C.-H., Kuo, C., & Chung, K. C. (2024) · Journal of Hand Surgery (European Volume) · doi:10.1177/17531934241295493 · Cited by 13
“We adapted the SciBERT NLP model (Beltagy et al., 2019; Lewis et al., 2020) to perform two tasks: article classification (distinguishing original from non-original research) and named entity recognition.”
Alzheimer's disease knowledge graph enhances knowledge discovery and disease prediction
Yang, Y., Yu, K., Gao, S., Yu, S., Xiong, D., Qin, C., Chen, H., Tang, J., Tang, N., & Zhu, H. (2025) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2025.110285 · Cited by 14
Kawamura, H., Miura, T., Maeda, Y., Okada, Y., & Zempo, K. (2025) · IEEE Access · doi:10.1109/access.2025.3573648 · Cited by 16
Metadata
- Authors
- Beltagy, I., Lo, K., & Cohan, A.
- Affiliations
- Allen Institute for Artificial Intelligence (US)
- ORCID
- Venue
- Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP)
- Published
- 2019
- Pages
- 3613-3618
- OpenAlex
- W2970771982
- Semantic Scholar
- 156d217b0a911af97fa1b5a71dc909ccef7a8028
- Cited by
- 3,218
- References
- 33
- Citations by year
- 2026: 328 · 2025: 534 · 2024: 542 · 2023: 626 · 2022: 478 · 2021: 486 · 2020: 203 · 2019: 19
- FWCI
- 113.46
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- Locations
- Conference on Empirical Methods in Natural Language Processing (EMNLP) (publishedVersion, cc-by)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Keywords
- SciBERT, pre-trained language models, scientific texts, scientific publications, biomedical text, natural language processing
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-11-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-11-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.