BioGPT: generative pre-trained transformer for biomedical text generation and mining
Open accessThe DOI matches its Crossref record; 73 of the 74 references it cites were found in a registry or an index, and 1 are not checked yet.
Abstract
Pre-trained language models have attracted increasing attention in the biomedical domain, inspired by their great success in the general natural language domain. Among the two main branches of pre-trained language models in the general language domain, i.e. BERT (and its variants) and GPT (and its variants), the first one has been extensively studied in the biomedical domain, such as BioBERT and PubMedBERT. While they have achieved great success on a variety of discriminative downstream biomedical tasks, the lack of generation ability constrains their application scope. In this paper, we propose BioGPT, a domain-specific generative Transformer language model pre-trained on large-scale biomedical literature. We evaluate BioGPT on six biomedical natural language processing tasks and demonstrate that our model outperforms previous models on most tasks. Especially, we get 44.98%, 38.42% and 40.76% F1 score on BC5CDR, KD-DTI and DDI end-to-end relation extraction tasks, respectively, and 78.2% accuracy on PubMedQA, creating a new record. Our case study on text generation further demonstrates the advantage of BioGPT on biomedical literature to generate fluent descriptions for biomedical terms.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Notably, in healthcare, medical NLP benchmarks like MedQA7, PubMedQA8 and the Massive Multitask Language Understanding (MMLU) serve as the de-facto reporting standard for state-of-the-art medical LLMs9–11 with claims of ‘superhuman’ performance in patient-facing tasks12.”
From Medical large language models are vulnerable to data-poisoning attacks (2025) · cites this paper as [10]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Our language module uses BioGPT23, an autoregressive generative model based on the Transformer24 decoder architecture of GPT-325, trained on 15 million biomedical articles from PubMed with a vocabulary size of 42,384.”
From Generating dermatopathology reports from gigapixel whole slide images with HistoGPT (2025) · cites this paper as [23]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“medical domain-specific LLMs such as Medical Pathways Language Model (Med-PaLM) [2] and Biomedical Generative Pretrained Transformer (BioGPT) [3] have shown improved performance across various clinical natural language processing (NLP) tasks, including question answering, summarization, entity recognition, relation extraction, document classification, and literature mining.”
From Retrieval-Augmented Generation (RAG) in Healthcare: A Comprehensive Review (2025) · cites this paper as [3]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“BioGPT is based on GPT-246 and trained using biomedical literature and has shown improved performance on text classification tasks over BERT-based architectures23.”
From Text classification models for assessing the completeness of randomized controlled trial publications based on CONSORT reporting guidelines (2024) · cites this paper as [23]
The cited source says what the claim attributes to it.
In the citing paper
“fine-tuned BioGPT23 has shown superior performance to BERT-based models in document classification”
From Text classification models for assessing the completeness of randomized controlled trial publications based on CONSORT reporting guidelines (2024) · cites this paper as [23]
8 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Exploiting Generative AI to Scale up Intelligent Tutoring Systems
Jakubův, J., Chvalovský, K., Goertzel, Z., Kaliszyk, C., Olšák, M., Piotrowski, B., Schulz, S., Suda, M., & Urban, J. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.itp.2023.19 · Cited by 76,658
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372
RoBERTa: A Robustly Optimized BERT Pretraining Approach
Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., Levy, O., Lewis, M., Zettlemoyer, L., & Stoyanov, V. (2019) · arXiv · doi:10.48550/arxiv.1907.11692 · Cited by 16,515
Kaugeranna, R., Kaugeranna, E., & Aion, (. S. 4. 6. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.giscience.2023.43 · Cited by 13,690
Lewis, M., Liu, Y., Goyal, N., Ghazvininejad, M., Mohamed, A., Levy, O., Stoyanov, V., & Zettlemoyer, L. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.703 · Cited by 8,821
Lewis, M., Liu, Y., Goyal, N., Ghazvininejad, M., Mohamed, A., Levy, O., Stoyanov, V., & Zettlemoyer, L. (2019) · arXiv · doi:10.48550/arxiv.1910.13461 · Cited by 8,816
Transformers: State-of-the-Art Natural Language Processing
Wolf, T., Debut, L., Sanh, V., Chaumond, J., Delangue, C., Moi, A., Cistac, P., Rault, T., Louf, R., Funtowicz, M., et al. (2020) · Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing: System Demonstrations · doi:10.18653/v1/2020.emnlp-demos.6 · Cited by 8,741
MIMIC-III, a freely accessible critical care database
Johnson, A. E. W., Pollard, T. J., Shen, L., Lehman, L.-W. H., Feng, M., Ghassemi, M., Moody, B., Szolovits, P., Anthony Celi, L., & Mark, R. G. (2016) · Scientific Data · doi:10.1038/sdata.2016.35 · Cited by 8,141
BioBERT: a pre-trained biomedical language representation model for biomedical text mining
Lee, J., Yoon, W., Kim, S., Kim, D., Kim, S., So, C. H., & Kang, J. (2020) · Bioinformatics · doi:10.1093/bioinformatics/btz682 · Cited by 7,218
Liu, P., Yuan, W., Fu, J., Jiang, Z., Hayashi, H., & Neubig, G. (2023) · ACM Computing Surveys · doi:10.1145/3560815 · Cited by 4,361 · cited 1×
“Prompt is recently extensively explored in NLP [48] to elicit the knowledge from a pre-trained language model.”
BackgroundLiu, P., Yuan, W., Fu, J., Jiang, Z., Hayashi, H., & Neubig, G. (2021) · arXiv · doi:10.48550/arxiv.2107.13586 · Cited by 4,352 · cited 1×
“Prompt is recently extensively explored in NLP [48] to elicit the knowledge from a pre-trained language model.”
BackgroundGLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding
Wang, A., Singh, A., Michael, J., Hill, F., Levy, O., & Bowman, S. (2018) · Proceedings of the 2018 EMNLP Workshop BlackboxNLP: Analyzing and Interpreting Neural Networks for NLP · doi:10.18653/v1/w18-5446 · Cited by 4,222
SciBERT: A Pretrained Language Model for Scientific Text
Beltagy, I., Lo, K., & Cohan, A. (2019) · Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · doi:10.18653/v1/d19-1371 · Cited by 3,218
Prefix-Tuning: Optimizing Continuous Prompts for Generation
Li, X. L., & Liang, P. (2021) · Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · doi:10.18653/v1/2021.acl-long.353 · Cited by 2,473
fairseq: A Fast, Extensible Toolkit for Sequence Modeling
Ott, M., Edunov, S., Baevski, A., Fan, A., Gross, S., Ng, N., Grangier, D., & Auli, M. (2019) · Proceedings of the 2019 Conference of the North · doi:10.18653/v1/n19-4009 · Cited by 2,344
Domain-specific language model pretraining for biomedical natural language processing
Gu, Y., Tinn, R., Cheng, H., Lucas, M., Usuyama, N., Liu, X., Naumann, T., Gao, J., & Poon, H. (2022) · ACM Transactions on Computing for Healthcare · doi:10.1145/3458754 · Cited by 2,170 · cited 13×
“Vocabulary: [9] also points that in-domain vocabulary is vital.”
BackgroundMethodInfluentialSelf-citationAttention-Based Bidirectional Long Short-Term Memory Networks for Relation Classification
Zhou, P., Shi, W., Tian, J., Qi, Z., Li, B., Hao, H., & Xu, B. (2016) · Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers) · doi:10.18653/v1/p16-2034 · Cited by 2,012
ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators
Clark, K., Luong, M.-T., Le, Q. V., & Manning, C. D. (2020) · arXiv · doi:10.48550/arxiv.2003.10555 · Cited by 1,844
Question Answering For Toxicological Information Extraction
Ferreira, B. C. L., Gonçalo Oliveira, H., Amaro, H., Laranjeiro, Â., & Silva, C. (2022) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/oasics.slate.2022.3 · Cited by 1,520
Relation Classification via Convolutional Deep Neural Network
Zeng, D., Liu, K., Lai, S., Zhou, G., & Zhao, J. (2015) · Cited by 1,467
Neural Machine Translation of Rare Words with Subword Units
Sennrich, R., Haddow, B., & Birch, A. (2016) · Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p16-1162 · Cited by 974
Neural Machine Translation of Rare Words with Subword Units
Sennrich, R., Haddow, B., & Birch, A. (2015) · arXiv · doi:10.48550/arxiv.1508.07909 · Cited by 950
Peng, Y., Yan, S., & Lu, Z. (2019) · Proceedings of the 18th BioNLP Workshop and Shared Task · doi:10.18653/v1/w19-5006 · Cited by 899
BioCreative V CDR task corpus: a resource for chemical disease relation extraction
Li, J., Sun, Y., Johnson, R. J., Sciaky, D., Wei, C.-H., Leaman, R., Davis, A. P., Mattingly, C. J., Wiegers, T. C., & Lu, Z. (2016) · Database · doi:10.1093/database/baw068 · Cited by 870
LUKE: Deep Contextualized Entity Representations with Entity-aware Self-attentionPreprint
Yamada, I., Asai, A., Shindo, H., Takeda, H., & Matsumoto, Y. (2020) · Conference on Empirical Methods in Natural Language Processing · doi:10.48550/arxiv.2010.01057 · Cited by 802
PubMedQA: A Dataset for Biomedical Research Question Answering
Jin, Q., Dhingra, B., Liu, Z., Cohen, W., & Lu, X. (2019) · Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · doi:10.18653/v1/d19-1259 · Cited by 685
A Novel Cascade Binary Tagging Framework for Relational Triple Extraction
Wei, Z., Su, J., Wang, Y., Tian, Y., & Chang, Y. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.136 · Cited by 649
Tsatsaronis, G., Balikas, G., Malakasiotis, P., Partalas, I., Zschunke, M., Alvers, M. R., Weissenborn, D., Krithara, A., Petridis, S., Polychronopoulos, D., et al. (2015) · BMC Bioinformatics · doi:10.1186/s12859-015-0564-6 · Cited by 598
LUKE: Deep Contextualized Entity Representations with Entity-aware Self-attention
Yamada, I., Asai, A., Shindo, H., Takeda, H., & Matsumoto, Y. (2020) · Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.523 · Cited by 590
Extracting Relational Facts by an End-to-End Neural Model with Copy Mechanism
Zeng, X., Zeng, D., He, S., Liu, K., & Zhao, J. (2018) · Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p18-1047 · Cited by 519
The DDI corpus: An annotated corpus with pharmacological substances and drug–drug interactions
Herrero-Zazo, M., Segura-Bedmar, I., Martínez, P., & Declerck, T. (2013) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2013.07.011 · Cited by 478
SPECTER: Document-level Representation Learning using Citation-informed Transformers
Cohan, A., Feldman, S., Beltagy, I., Downey, D., & Weld, D. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.207 · Cited by 475
TPLinker: Single-stage Joint Extraction of Entities and Relations Through Token Pair Linking
Wang, Y., Yu, B., Zhang, Y., Liu, T., Zhu, H., & Sun, L. (2020) · Proceedings of the 28th International Conference on Computational Linguistics · doi:10.18653/v1/2020.coling-main.138 · Cited by 457
Self-citationGraphRel: Modeling Text as Relational Graphs for Joint Entity and Relation Extraction
Fu, T.-J., Li, P.-H., & Ma, W.-Y. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1136 · Cited by 447
Tsujii, J., & Hajič, J. (2014) · International Conference on Computational Linguistics · Cited by 375
QANet: Combining Local Convolution with Global Self-Attention for Reading Comprehension
Yu, A. W., Dohan, D., Luong, M.-T., Zhao, R., Chen, K., Norouzi, M., & Le, Q. V. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1804.09541 · Cited by 368
Large language models are few-shot clinical information extractors
Agrawal, M., Hegselmann, S., Lang, H., Kim, Y., & Sontag, D. (2022) · Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2022.emnlp-main.130 · Cited by 358
LinkBERT: Pretraining Language Models with Document Links
Yasunaga, M., Leskovec, J., & Liang, P. (2022) · Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2022.acl-long.551 · Cited by 327
REBEL: Relation Extraction By End-to-end Language generation
Huguet Cabot, P.-L., & Navigli, R. (2021) · Findings of the Association for Computational Linguistics: EMNLP 2021 · doi:10.18653/v1/2021.findings-emnlp.204 · Cited by 261
Thinking about GPT-3 In-Context Learning for Biomedical IE? Think Again
Gutiérrez, B. J., McNeal, N., Washington, C., Chen, Y., Li, L., Sun, H., & Su, Y. (2022) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2022.findings-emnlp.329 · Cited by 246
Joint Entity and Relation Extraction With Set Prediction Networks
Sui, D., Zeng, X., Chen, Y., Liu, K., & Zhao, J. (2024) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2023.3264735 · Cited by 214
SciFive: a text-to-text transformer model for biomedical literaturePreprint
Phan, L., Anibal, J., Tran, H., Chanana, S., Bahadroglu, E., Peltekian, A., & Altan-Bonnet, G. Y. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.03598 · Cited by 214
Reinforced Mnemonic Reader for Machine Reading Comprehension
Hu, M., Peng, Y., Huang, Z., Qiu, X., Wei, F., & Zhou, M. (2018) · Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2018/570 · Cited by 199
BioELECTRA:Pretrained Biomedical text Encoder using Discriminators
Kanakarajan, K. R., Kundumani, B., & Sankarasubbu, M. (2021) · Workshop on Biomedical Language Processing (BioNLP) · doi:10.18653/v1/2021.bionlp-1.16 · Cited by 181
A Partition Filter Network for Joint Entity and Relation Extraction
Yan, Z., Zhang, C., Fu, J., Zhang, Q., & Wei, Z. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.17 · Cited by 167
A Relation-Specific Attention Network for Joint Entity and Relation Extraction
Yuan, Y., Zhou, X., Pan, S., Zhu, Q., Song, Z., & Guo, L. J. (2020) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2020/561 · Cited by 147
Global-to-Local Neural Networks for Document-Level Relation Extraction
Wang, D., Hu, W. P., Cao, E., & Sun, W. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.303 · Cited by 146
Joint Type Inference on Entities and Relations via Graph Convolutional Networks
Sun, C., Gong, Y., Wu, Y., Gong, M., Jiang, D., Lan, M., Sun, S., & Duan, N. (2019) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p19-1131 · Cited by 139
Automatic semantic classification of scientific literature according to the hallmarks of cancer
Baker, S., Silins, I., Guo, Y., Ali, I., Högberg, J., Stenius, U., & Korhonen, A. (2015) · Bioinformatics · doi:10.1093/bioinformatics/btv585 · Cited by 128
Proceedings of the 18th BioNLP Workshop and Shared Task
(2019) · doi:10.18653/v1/w19-50 · Cited by 100
DARE: Data Augmented Relation Extraction with GPT-2Preprint
Papanikolaou, Y., & Pierleoni, A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2004.13845 · Cited by 95
GPT-3 Models are Poor Few-Shot Learners in the Biomedical DomainPreprint
Moradi, M., Blagec, K., Haberl, F., & Samwald, M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2109.02555 · Cited by 95
Attention as Relation: Learning Supervised Multi-head Self-Attention for Relation Extraction
Liu, J., Chen, S. W., Wang, B., Zhang, J., Li, N., & Xu, T. (2020) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2020/524 · Cited by 87
A sequence-to-sequence approach for document-level relation extraction
Giorgi, J., Bader, G. D., & Wang, B. (2022) · Workshop on Biomedical Language Processing (BioNLP) · doi:10.18653/v1/2022.bionlp-1.2 · Cited by 83
Minimize Exposure Bias of Seq2Seq Models in Joint Entity and Relation Extraction
Zhang, R. H., Liu, Q., Fan, A. X., Ji, H., Zeng, D., Cheng, F., Kawahara, D., & Kurohashi, S. (2020) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2020.findings-emnlp.23 · Cited by 70
Results of the Seventh Edition of the BioASQ Challenge
Nentidis, A., Bougiatiotis, K., Krithara, A., & Παλιούρας, Γ. (2020) · Communications in computer and information science · doi:10.1007/978-3-030-43887-6_51 · Cited by 54
Large Language Models are Few-Shot Clinical Information ExtractorsPreprint
Agrawal, M., Hegselmann, S., Lang, H., et al. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2205.12689 · Cited by 49
Reinforced Mnemonic Reader for Machine Reading ComprehensionPreprint
Hu, M., Peng, Y., Huang, Z., et al. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1705.02798 · Cited by 41
ELECTRAMed: a new pre-trained language representation model for biomedical NLPPreprint
Miolo, G., Mantoan, G., & Orsenigo, C. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2104.09585 · Cited by 35
Discovering drug–target interaction knowledge from biomedical literature
Hou, Y., Xia, Y., Wu, L., Xie, S., Yang, F., Zhu, J., Qin, T., & Liu, T. (2022) · Bioinformatics · doi:10.1093/bioinformatics/btac648 · Cited by 20
Self-citationGlobal-to-Local Neural Networks for Document-Level Relation ExtractionPreprint
Wang, D., Hu, W. P., Cao, E., et al. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2009.10359 · Cited by 6
A sequence-to-sequence approach for document-level relation extractionPreprint
Giorgi, J., Bader, G. D., & Wang, B. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2204.01098 · Cited by 3
Discovering Drug-Target Interaction Knowledge from Biomedical LiteraturePreprint
Hou, Y., Xia, Y., Wu, L., et al. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2109.13187
Self-citation
Research works printed but not linked: 8
- Wang, 2019, International Conference on Learning Representations
- Devlin, 2019, Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers), 4171
- Clark, 2019, International Conference on Learning Representations
- Radford, 2019, Language models are unsupervised multitask learners, OpenAI blog, 1, 9
- Nentidis, Joint European Conference on Machine Learning and Knowledge Discovery in Databases
- Liu, 2020, Proceedings of the Twenty-Ninth International Conference on International Joint Conferences on Artificial Intelligence, 3787
- Tsu-Jui, 2019, Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, 1409
- Kingma, 2015, International Conference on Learning Representations
Cited by
Large language models encode clinical knowledge
Singhal, K., Azizi, S., Tu, T., Mahdavi, S. S., Wei, J., Chung, H. W., Scales, N., Tanwani, A., Cole-Lewis, H., Pfohl, S., et al. (2023) · Nature · doi:10.1038/s41586-023-06291-2 · Cited by 4,083
Large Language Models Encode Clinical Knowledge
Singhal, K., Azizi, S., Tu, T., Mahdavi, S. S., Wei, J., Chung, H. W., Scales, N., Tanwani, A., Cole-Lewis, H., Pfohl, S., et al. (2022) · arXiv · doi:10.48550/arxiv.2212.13138 · Cited by 4,083
Ray, P. P. (2023) · Internet of Things and Cyber-Physical Systems · doi:10.1016/j.iotcps.2023.04.003 · Cited by 2,463
Toward expert-level medical question answering with large language models
Singhal, K., Tu, T., Gottweis, J., Sayres, R., Wulczyn, E., Amin, M., Hou, L., Clark, K., Pfohl, S. R., Cole-Lewis, H., et al. (2025) · Nature Medicine · doi:10.1038/s41591-024-03423-7 · Cited by 1,734
Autonomous chemical research with large language models
Boiko, D. A., MacKnight, R., Kline, B., & Gomes, G. (2023) · Nature · doi:10.1038/s41586-023-06792-0 · Cited by 1,050
Metadata
- Authors
- Luo, R., Sun, L., Xia, Y., Qin, T., Zhang, S., Poon, H., & Liu, T.-Y.
- Affiliations
- Microsoft Research Asia (China) (CN)
- Peking University (CN)
- Microsoft (United States) (US)
- Corresponding author
- Xia, Yingce
- Qin, Tao
- Venue
- Briefings in Bioinformatics
- Publisher
- Oxford University Press (OUP)
- Published
- 2022-09-24
- Volume
- 23
- Issue
- 6
- ISSN
- 1467-5463 (ISSN-L)
- 1477-4054
- OpenAlex
- W4297253404
- Cited by
- 1,150
- References
- 65
- Citations by year
- 2026: 329 · 2025: 375 · 2024: 287 · 2023: 159
- FWCI
- 67.11
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- academic.oup.com/journals/pages/open_access/funder_policies/chorus/standard_publication_model (vor)
- Locations
- Briefings in Bioinformatics (publishedVersion)
- PubMed (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Health Sciences › Medicine › Health Informatics › Biomedical Text Mining and Ontologies
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning in Healthcare
- Keywords
- BioGPT, generative pre-trained transformer, biomedical natural language processing, relation extraction, drug-drug interactions, PubMedQA, biomedical literature, domain-specific language models
- MeSH terms
- Natural Language Processing, Data Mining
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.