A pre-training and self-training approach for biomedical named entity recognition
Open accessThe DOI matches its Crossref record; 70 of the 71 references it cites were found in a registry or an index.
Abstract
Named entity recognition (NER) is a key component of many scientific literature mining tasks, such as information retrieval, information extraction, and question answering; however, many modern approaches require large amounts of labeled training data in order to be effective. This severely limits the effectiveness of NER models in applications where expert annotations are difficult and expensive to obtain. In this work, we explore the effectiveness of transfer learning and semi-supervised self-training to improve the performance of NER models in biomedical settings with very limited labeled data (250-2000 labeled samples). We first pre-train a BiLSTM-CRF and a BERT model on a very large general biomedical NER corpus such as MedMentions or Semantic Medline, and then we fine-tune the model on a more specific target NER task that has very limited training data; finally, we apply semi-supervised self-training using unlabeled data to further boost model performance. We show that in NER tasks that focus on common biomedical entity types such as those in the Unified Medical Language System (UMLS), combining transfer learning with self-training enables a NER model such as a BiLSTM-CRF or BERT to obtain similar performance with the same model trained on 3x-8x the amount of labeled data. We further show that our approach can also boost performance in a low-resource application where entities types are more rare and not specifically covered in UMLS.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures


Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“self-training can propagate both knowledge and error from high confidence predictions on unlabelled samples [34]”
From PICO entity extraction for preclinical animal literature. (2022) · cites this paper as [34]
In the citing paper
“training from larger annotated corpora may reduce the error propagation and boost performance”
From PICO entity extraction for preclinical animal literature. (2022) · cites this paper as [34]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325 · cited 3×
“Using a base NER model such as the popular Bidirectional Long Short Term Memory Conditional Random Field (BiLSTM-CRF) [10] or state-of-the-art Bidirectional Encoder Representations from Transformers (BERT) [11], we show that the combination of transfer learning and semi-supervised learning can significantly reduce the…”
BackgroundMethodSemi-supervised classification with graph convolutional networks
Kipf, T. N., & Welling, M. (2016) · arXiv · doi:10.48550/arxiv.1609.02907 · Cited by 24,853
Pan, S. J., & Yang, Q. (2010) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2009.191 · Cited by 23,387 · cited 1×
“In transfer learning, a model that is trained on one task is then retrained on and applied to a different related task; knowledge gained when training on the first task may boost performance on the second task, especially when labeled training data is scarce for the second task [27].”
BackgroundTransformers: State-of-the-Art Natural Language Processing
Wolf, T., Debut, L., Sanh, V., Chaumond, J., Delangue, C., Moi, A., Cistac, P., Rault, T., Louf, R., Funtowicz, M., et al. (2020) · Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing: System Demonstrations · doi:10.18653/v1/2020.emnlp-demos.6 · Cited by 8,741
BioBERT: a pre-trained biomedical language representation model for biomedical text mining
Lee, J., Yoon, W., Kim, S., Kim, D., Kim, S., So, C. H., & Kang, J. (2020) · Bioinformatics · doi:10.1093/bioinformatics/btz682 · Cited by 7,218 · cited 2×
“For our BERT model, we utilize the pre-trained WordPiece vocabulary and model weights from BlueBERT Base [53], which is the BERT Base model pre-trained on PubMed abstracts and MIMIC III clinical notes, as this model has shown superior performance on biomedical and medical NER tasks compared to other BERT-based models…”
MethodNeural Architectures for Named Entity Recognition
Lample, G., Ballesteros, M., Subramanian, S., Kawakami, K., & Dyer, C. (2016) · Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.18653/v1/n16-1030 · Cited by 4,401 · cited 1×
“Recent work has shown that supervised machine learning approaches, especially deep neural networks, achieve superior performance on various NER tasks [1, 2, 21].”
BackgroundTarvainen, A., & Valpola, H. (2017) · arXiv · doi:10.48550/arxiv.1703.01780 · Cited by 4,275
HuggingFace's Transformers: State-of-the-art Natural Language Processing
Wolf, T., Debut, L., Sanh, V., Chaumond, J., Delangue, C., Moi, A., Cistac, P., Rault, T., Louf, R., Funtowicz, M., et al. (2019) · arXiv · doi:10.48550/arxiv.1910.03771 · Cited by 3,347
Virtual Adversarial Training: A Regularization Method for Supervised and Semi-Supervised Learning
Miyato, T., Maeda, S.-I., Koyama, M., & Ishii, S. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2858821 · Cited by 2,843
A survey on semi-supervised learning
van Engelen, J. E., & Hoos, H. H. (2020) · Machine Learning · doi:10.1007/s10994-019-05855-6 · Cited by 2,666
End-to-end Sequence Labeling via Bi-directional LSTM-CNNs-CRF
Ma, X., & Hovy, E. (2016) · Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p16-1101 · Cited by 2,567
Pre-trained models for natural language processing: A survey
Qiu, X., Sun, T., Xu, Y., Shao, Y., Dai, N., & Huang, X. (2020) · Science China Technological Sciences · doi:10.1007/s11431-020-1647-3 · Cited by 1,591
A Survey on Deep Learning for Named Entity Recognition
Li, J., Sun, A., Han, J., & Li, C. (2022) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2020.2981314 · Cited by 1,567
An overview of MetaMap: historical perspective and recent advances
Aronson, A. R., & Lang, F.-M. (2010) · Journal of the American Medical Informatics Association · doi:10.1136/jamia.2009.002733 · Cited by 1,519 · cited 8×
“ScispaCy is a deep-learning-based approach trained on the MedMentions dataset, while MetaMap is a rulebased approach that utilizes a manually curated dictionary.”
MethodInfluentialPeng, Y., Yan, S., & Lu, Z. (2019) · Proceedings of the 18th BioNLP Workshop and Shared Task · doi:10.18653/v1/w19-5006 · Cited by 899 · cited 4×
“This is expected—as we showed in Table 5, BlueBERT Base already has strong performance in NER tasks because the base model is already pre-trained, and the second round of pre-training https://doi.org/10.1371/journal.pone.0246310.g002 PLOS ONE | https://doi.org/10.1371/journal.pone.0246310 February 9, 2021 16 / 23 usin…”
MethodInfluentialTransfer Learning for Low-Resource Neural Machine Translation
Zoph, B., Yuret, D., May, J., & Knight, K. (2016) · Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d16-1163 · Cited by 788
Transfer Learning in Natural Language Processing
Ruder, S., Peters, M. E., Swayamdipta, S., & Wolf, T. (2019) · Proceedings of the 2019 Conference of the North · doi:10.18653/v1/n19-5004 · Cited by 587
ScispaCy: Fast and Robust Models for Biomedical Natural Language Processing
Neumann, M., King, D., Beltagy, I., & Ammar, W. (2019) · Proceedings of the 18th BioNLP Workshop and Shared Task · doi:10.18653/v1/w19-5034 · Cited by 488 · cited 2×
“All models are implemented using the Huggingface Transformers library [60], and training is performed using the Adam optimizer with batch size 32 and learning rate 5e − 5. https://doi.org/10.1371/journal.pone.0246310.g001 PLOS ONE | https://doi.org/10.1371/journal.pone.0246310 February 9, 2021 5 / 23 As a final baseli…”
MethodInfluentialA Survey on Recent Advances in Named Entity Recognition from Deep Learning models
Yadav, V., & Bethard, S. J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.11470 · Cited by 464 · cited 1×
“Recent work has shown that supervised machine learning approaches, especially deep neural networks, achieve superior performance on various NER tasks [1, 2, 21].”
BackgroundBioWordVec, improving biomedical word embeddings with subword information and MeSH
Zhang, Y., Chen, Q., Yang, Z., Lin, H., & Lu, Z. (2019) · Scientific Data · doi:10.1038/s41597-019-0055-0 · Cited by 455 · cited 1×
“3 million unique words [50]; however, our pre-training and NER datasets only use a small fraction of this total vocabulary.”
BackgroundDe-identification of patient notes with recurrent neural networks
Dernoncourt, F., Lee, J. Y., Uzuner, O., & Szolovits, P. (2017) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocw156 · Cited by 378 · cited 1×
“In general, machine learning approaches tend to be more flexible than rule-based approaches; however, they require large volumes of word-level annotations which are expensive and difficult to obtain in biomedical settings [9].”
BackgroundA novel method for prokaryotic promoter prediction based on DNA stability
Kanhere, A., & Bansal, M. (2005) · BMC Bioinformatics · doi:10.1186/1471-2105-6-1 · Cited by 375
SemMedDB: a PubMed-scale repository of biomedical semantic predications
Kilicoglu, H., Shin, D., Fiszman, M., Rosemblat, G., & Rindflesch, T. C. (2012) · Bioinformatics · doi:10.1093/bioinformatics/bts591 · Cited by 372
Unsupervised Cross-Domain Image Generation
Taigman, Y., Polyak, A., & Wolf, L. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.02200 · Cited by 359
ProMiner: rule-based protein and gene entity recognition
Hanisch, D., Fundel, K., Mevissen, H.-T., Zimmer, R., & Fluck, J. (2005) · BMC Bioinformatics · doi:10.1186/1471-2105-6-s1-s14 · Cited by 346
Segura-Bédmar, I., Martínez, P., & Herrero-Zazo, M. (2013) · LA Referencia (Red Federada de Repositorios Institucionales de Publicaciones Científicas) · Cited by 297
ChemSpot: a hybrid system for chemical named entity recognition
Rocktäschel, T., Weidlich, M., & Leser, U. (2012) · Bioinformatics · doi:10.1093/bioinformatics/bts183 · Cited by 269
Transfer learning for biomedical named entity recognition with neural networks
Giorgi, J. M., & Bader, G. D. (2018) · Bioinformatics · doi:10.1093/bioinformatics/bty449 · Cited by 188
Extraction of protein interaction information from unstructured text using a context-free grammar
Temkin, J. M., & Gilder, M. R. (2003) · Bioinformatics · doi:10.1093/bioinformatics/btg279 · Cited by 186
Eftimov, T., Koroušić Seljak, B., & Korošec, P. (2017) · PLOS ONE · doi:10.1371/journal.pone.0179488 · Cited by 171 · cited 2×
“Rule-based methods require human experts to manually hand-craft specific rules to identify different types of named entities—examples include termmatching with an existing concept database such as the Unified Medical Language System (UMLS) [5, 6] or pattern matching based on part-of-speech and sentence structure [7, 8…”
MethodMedMentions: A Large Biomedical Corpus Annotated with UMLS ConceptsPreprint
Mohan, S., & Li, D. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1902.09476 · Cited by 168 · cited 1×
“com/chanzuckerberg/ MedMentions), which consists of approximately 4K abstracts manually annotated for UMLS entities by human experts [65].”
BackgroundStrong Baselines for Neural Semi-Supervised Learning under Domain Shift
Ruder, S., & Plank, B. (2018) · Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p18-1096 · Cited by 165
Few-Shot Named Entity Recognition via Meta-Learning
Li, J., Chiu, B., Feng, S., & Wang, H. (2022) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2020.3038670 · Cited by 165 · cited 1×
“Recent work has shown that supervised machine learning approaches, especially deep neural networks, achieve superior performance on various NER tasks [1, 2, 21].”
BackgroundA Neural Named Entity Recognition and Multi-Type Normalization Tool for Biomedical Text Mining
Kim, D., Lee, J., So, C. H., Jeon, H., Jeong, M., Choi, Y.-H., Yoon, W., Sung, M., & Kang, J. (2019) · IEEE Access · doi:10.1109/access.2019.2920708 · Cited by 146 · cited 1×
“More recently, BERT has shown state-of-the-art performance across a wide range of natural language processing tasks including named entity recognition [11, 25, 26].”
BackgroundDeep Model Based Transfer and Multi-Task Learning for Biological Image Analysis
Zhang, W., Li, R., Zeng, T., Sun, Q., Kumar, S., Ye, J., & Ji, S. (2020) · IEEE Transactions on Big Data · doi:10.1109/tbdata.2016.2573280 · Cited by 143
Domain Adaptation of Rule-Based Annotators for Named-Entity Recognition Tasks
Chiticariu, L., Krishnamurthy, R., Li, Y., Reiss, F. R., & Vaithyanathan, S. (2010) · Cited by 129
Transfer Learning for Named-Entity Recognition with Neural Networks
Lee, J. Y., Dernoncourt, F., & Szolovits, P. (2018) · Language Resources and Evaluation Conference (LREC) · doi:10.63317/3zgnr6mgyt6m · Cited by 128
A Survey on Contextual Embeddings
Coelho, J., Neto, A., Tavares, M., Coutinho, C., Ribeiro, R., & Batista, F. (2020) · arXiv (Cornell University) · doi:10.4230/oasics.slate.2021.12 · Cited by 109
Better Modeling of Incomplete Annotations for Named Entity Recognition
Jie, Z., Xie, P., Lu, W., Ding, R., & Li, L. (2019) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n19-1079 · Cited by 107
A simple semi-supervised algorithm for named entity recognition
Liao, W., & Veeramachaneni, S. (2009) · doi:10.3115/1621829.1621837 · Cited by 105
Towards reliable named entity recognition in the biomedical domain
Giorgi, J., & Bader, G. D. (2019) · Bioinformatics · doi:10.1093/bioinformatics/btz504 · Cited by 102
Targeted enrichment by solution-based hybrid capture to identify genetic sequence variants in barley
Hill, C. B., Wong, D., Tibbits, J., Forrest, K., Hayden, M., Zhang, X.-Q., Westcott, S., Angessa, T. T., & Li, C. (2019) · Scientific Data · doi:10.1038/s41597-019-0011-z · Cited by 96
Biomedical Named Entity Recognition with Multilingual BERT
Hakala, K., & Pyysalo, S. (2019) · Proceedings of The 5th Workshop on BioNLP Open Shared Tasks · doi:10.18653/v1/d19-5709 · Cited by 96 · cited 1×
“Following previous work on applying BERT for NER [59], during training and inference, we only use the label from the first subword token associated with each word.”
MethodSemantic MEDLINE: An advanced information management application for biomedicine
Rindflesch, T. C., Kilicoglu, H., Fiszman, M., Rosemblat, G., & Shin, D. (2011) · Information Services & Use · doi:10.3233/isu-2011-0627 · Cited by 93 · cited 1×
“gov/SemMedDB/), which consists of approximately 28M PubMed abstracts that are automatically annotated for all UMLS entities using the rule/dictionary-based MetaMap tool [63, 64], and MedMentions (available online at url https://github.”
MethodEvolution of transfer learning in natural language processingPreprint
Malte, A., & Ratadiya, P. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.07370 · Cited by 87
A Bidirectional LSTM and Conditional Random Fields Approach to Medical Named Entity Recognition
Xu, K., Zhou, Z., Hao, T., & Liu, W. (2017) · Advances in intelligent systems and computing · doi:10.1007/978-3-319-64861-3_33 · Cited by 84
Using machine learning to maintain rule-based named-entity recognition and classification systems
Petasis, G., Vichot, F., Wolinski, F., Παλιούρας, Γ., Karkaletsis, V., & Spyropoulos, C. D. (2001) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.3115/1073012.1073067 · Cited by 80
Biological, translational, and clinical language processing
Cohen, K. B., Demner‐Fushman, D., Friedman, C., Hirschman, L., & Pestian, J. P. (2007) · Cited by 79
Gorinski, P. J., Wu, H., Grover, C., Tobin, R., Talbot, C., Whalley, H. C., Sudlow, C. L. M., Whiteley, W. N., & Alex, B. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1903.03985 · Cited by 77 · cited 1×
“Traditional NER approaches generally utilized manually crafted expert rules and heuristics and to identify entities of interest [12–18], such as persons, locations, and organizations; these types of rule-based approaches are still in use today in domain areas such as medicine where labeled training data is difficult t…”
MethodScientific Information Extraction with Semi-supervised Neural Tagging
Luan, Y., Ostendorf, M., & Hajishirzi, H. (2017) · Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d17-1279 · Cited by 77
A context pattern induction method for named entity extraction
Talukdar, P. P., Brants, T., Liberman, M., & Pereira, F. M. B. (2006) · Conference on Computational Natural Language Learning · doi:10.3115/1596276.1596303 · Cited by 70
MetaNER: Named Entity Recognition with Meta-Learning
Li, J., Shang, S., & Shao, L. (2020) · International World Wide Web Conference (WWW) · doi:10.1145/3366423.3380127 · Cited by 65
Aggregating Machine Learning and Rule Based Heuristics for Named Entity Recognition
Gali, K., Surana, H., Vaidya, A., Shishtla, P. M., & Sharma, D. M. (2008) · International Joint Conference on Natural Language Processing · Cited by 61
HUNER: improving biomedical NER with pretraining
Weber, L., Münchmeyer, J., Rocktäschel, T., Habibi, M., & Leser, U. (2020) · Bioinformatics · doi:10.1093/bioinformatics/btz528 · Cited by 58 · cited 1×
“Similarly, [33] showed that pre-training a BiLSTM-CRF model on a silver standard corpus of 5M sentences from PubMed abstracts, tagged using a trained CRF model rather than human experts, boosts performance on downstream biomedical NER tasks for different entity types.”
MethodRule-Based Method for Entity Resolution
Li, L., Li, J., & Gao, H. (2014) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2014.2320713 · Cited by 56
Khan, M. R., Ziyadi, M., & AbdelHady, M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2001.08904 · Cited by 55
Sun, C. H., & Yang, Z. (2019) · Workshop on BioNLP Open Shared Tasks (BioNLP-OST) · doi:10.18653/v1/d19-5715 · Cited by 54
DTranNER: biomedical named entity recognition with deep learning-based label-label transition model
Hong, S., & Lee, J.-G. (2020) · BMC Bioinformatics · doi:10.1186/s12859-020-3393-1 · Cited by 43
Effect of Character and Word Features in Bidirectional LSTM-CRF for NER
Ronran, C., & Lee, S. (2020) · IEEE International Conference on Big Data and Smart Computing (BigComp) · doi:10.1109/bigcomp48618.2020.00132 · Cited by 33 · cited 1×
“We note that while recent work introduces more complex sequence tagging architectures, such as incorporating character-level inputs [51] and convolutional neural networks (CNNs) [52], we kept our BiLSTM-CRF model fairly simple to show that our approach works with both simple and state-of-the-art models.”
MethodRule-based pattern extractor and named entity recognition: A hybrid approach
Sari, Y. A. P., Hassan, M. F., & Zamin, N. B. (2010) · International Symposium on Information Technology · doi:10.1109/itsim.2010.5561392 · Cited by 32
Dynamic Transfer Learning for Named Entity Recognition
Bhatia, P., Arumae, K., & Celikkaya, B. (2019) · Studies in computational intelligence · doi:10.1007/978-3-030-24409-5_7 · Cited by 27
Kim, J., Ko, Y., & Seo, J. (2019) · IEEE Access · doi:10.1109/access.2019.2914168 · Cited by 22
Evaluating and combining biomedical named entity recognition systems
Vlachos, A. (2007) · Workshop on Biomedical Language Processing (BioNLP) · doi:10.3115/1572392.1572430 · Cited by 18
Multi-domain evaluation framework for named entity recognition tools
Abdallah, Z. S., Carman, M., & Haffari, G. (2016) · Computer Speech & Language · doi:10.1016/j.csl.2016.10.003 · Cited by 17
Semi-supervised learning for named entity recognition using weakly labeled training data
Zafarian, A., Rokni, A., Khadivi, S., & Ghiasifard, S. (2015) · CSI International Symposium on Artificial Intelligence and Signal Processing · doi:10.1109/aisp.2015.7123504 · Cited by 16
Tafti, A. P., Fu, S., Khurana, A., Mastorakos, G. M., Poole, K. G., Traub, S. J., Yiannias, J. A., & Liu, H. (2019) · IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm47256.2019.8982942 · Cited by 15 · cited 1×
“Traditional NER approaches generally utilized manually crafted expert rules and heuristics and to identify entities of interest [12–18], such as persons, locations, and organizations; these types of rule-based approaches are still in use today in domain areas such as medicine where labeled training data is difficult t…”
MethodOverview of the TAC 2018 Systematic Review Information Extraction Track.
Schmitt, C., Walker, V. R., Williams, A. R., Varghese, A., Ahmad, Y., Rooney, A., & Wolfe, M. S. (2018) · Theory and applications of categories · Cited by 8
(2001) · doi:10.1002/pds.4850 · Cited by 7
NAACL HLT 2010 Tutorial Abstracts
Baldwin, J., Clark, P. E., & Tür, G. (2010) · North American Chapter of the Association for Computational Linguistics · Cited by 3
(2015) · doi:10.4230/oasics.slate.2021.8 · Cited by 1 · cited 1×
“Using a base NER model such as the popular Bidirectional Long Short Term Memory Conditional Random Field (BiLSTM-CRF) [10] or state-of-the-art Bidirectional Encoder Representations from Transformers (BERT) [11], we show that the combination of transfer learning and semi-supervised learning can significantly reduce the…”
Method
Research works printed but not linked: 4
- Devlin J, Chang MW, Lee K, Toutanova K. Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:181004805. 2018;.
- JY Lee, 2018, LREC
- J Lee, 2020, BioBERT: a pre-trained biomedical language representation model for biomedical text mining, Bioinformatics, 36, 1234, 10.1093/bioinformatics/btz682 · DOI · Paper page
- A Tarvainen, 2017, ICLR (Workshop)
Cited by
AMMU: A survey of transformer-based biomedical pretrained language models
Kalyan, K. S., Rajasekharan, A., & Sangeetha, S. (2022) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2021.103982 · Cited by 278
“For example, Gao et al. [63] fine-tuned BlueBERT on a large general biomedical NER corpus like MedMentions [64] or Semantic Medline before fine-tuning on the small target NER corpus.”
BackgroundMethodInfluentialPre-trained Language Models in Biomedical Domain: A Systematic Survey
Wang, B., Xie, Q., Pei, J., Chen, Z., Tiwari, P., Li, Z., & Fu, J. (2024) · ACM Computing Surveys · doi:10.1145/3611651 · Cited by 169
“BioBERT [121], BlueBERT [179], SciBERT [16], PubMedBERT [66], BioMegatron [215], Yuan et al [286], Wei et al [258], Gao et al [58], Mascio et al [148], Guo et al [69], [73], Sont et al [221].”
MethodInfluentialThe role of large language models in medical image processing: a narrative review
Tian, D., Jiang, S., Zhang, L., Lu, X., & Xu, Y. (2024) · Quantitative Imaging in Medicine and Surgery · doi:10.21037/qims-23-892 · Cited by 95
“…imaging field, the studies conducted by Shang Gao and J. Blair Christian’s team exploring the efficacy of early LLM Bidirectional Encoder Representations from Transformers (BERT) transfer learning and semi-supervised self-training in Named Entity Recognition (NER) could be a reference point (26).”
Large-scale application of named entity recognition to biomedicine and epidemiology
Raza, S., Reji, D. J., Shajan, F., & Bashir, S. R. (2022) · PLOS Digital Health · doi:10.1371/journal.pdig.0000152 · Cited by 81
“However, the latter works show that adding the language models on top of traditional models (e.g., BiLSTM) shows good performance [42,43], which may be attributed to large-scale pre-training tasks on the top.”
BackgroundBiomedical named entity recognition based on fusion multi-features embedding
Li, M., Yang, H., & Liu, Y. (2023) · Technology and Health Care · doi:10.3233/thc- · Cited by 52
Metadata
- Authors
- Gao, S., Kotevska, O., Sorokine, A., & Christian, J. B.
- Affiliations
- Oak Ridge National Laboratory (US)
- Corresponding author
- Gao, Shang
- Christian, J. Blair
- Venue
- PLOS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2021-02-09
- Volume
- 16
- Issue
- 2
- Pages
- e0246310
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC7872256
- OpenAlex
- W3129160532
- Cited by
- 46
- References
- 71
- Citations by year
- 2026: 2 · 2025: 6 · 2024: 9 · 2023: 14 · 2022: 10 · 2021: 5
- FWCI
- 2.98
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- public-domain
- creativecommons.org/publicdomain/zero/1.0/ (vor)
- Locations
- PLoS ONE (publishedVersion, public-domain)
- PubMed Central (publishedVersion, public-domain)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- OSTI OAI (U.S. Department of Energy Office of Scientific and Technical Information) (submittedVersion)
- Funders
- U.S. Department of Energy
- Topics
- Health Sciences › Medicine › Health Informatics › Biomedical Text Mining and Ontologies
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning in Healthcare
- Keywords
- biomedical named entity recognition, transfer learning, limited labeled data, BiLSTM-CRF, BERT, fine-tuning, UMLS, scientific literature mining, unlabeled data
- MeSH terms
- Supervised Machine Learning, Unsupervised Machine Learning, Artificial Intelligence, Humans, Models, Theoretical, Terminology as Topic, Transfer, Psychology, Unified Medical Language System, Recognition, Psychology
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.