BioGPT: generative pre-trained transformer for biomedical text generation and mining
Open accessThe DOI matches its Crossref record; 73 of the 74 references it cites were found in a registry or an index, and 1 are not checked yet.
Abstract
Pre-trained language models have attracted increasing attention in the biomedical domain, inspired by their great success in the general natural language domain. Among the two main branches of pre-trained language models in the general language domain, i.e. BERT (and its variants) and GPT (and its variants), the first one has been extensively studied in the biomedical domain, such as BioBERT and PubMedBERT. While they have achieved great success on a variety of discriminative downstream biomedical tasks, the lack of generation ability constrains their application scope. In this paper, we propose BioGPT, a domain-specific generative Transformer language model pre-trained on large-scale biomedical literature. We evaluate BioGPT on six biomedical natural language processing tasks and demonstrate that our model outperforms previous models on most tasks. Especially, we get 44.98%, 38.42% and 40.76% F1 score on BC5CDR, KD-DTI and DDI end-to-end relation extraction tasks, respectively, and 78.2% accuracy on PubMedQA, creating a new record. Our case study on text generation further demonstrates the advantage of BioGPT on biomedical literature to generate fluent descriptions for biomedical terms.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Notably, in healthcare, medical NLP benchmarks like MedQA7, PubMedQA8 and the Massive Multitask Language Understanding (MMLU) serve as the de-facto reporting standard for state-of-the-art medical LLMs9–11 with claims of ‘superhuman’ performance in patient-facing tasks12.”
From Medical large language models are vulnerable to data-poisoning attacks (2025) · cites this paper as [10]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Our language module uses BioGPT23, an autoregressive generative model based on the Transformer24 decoder architecture of GPT-325, trained on 15 million biomedical articles from PubMed with a vocabulary size of 42,384.”
From Generating dermatopathology reports from gigapixel whole slide images with HistoGPT (2025) · cites this paper as [23]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“medical domain-specific LLMs such as Medical Pathways Language Model (Med-PaLM) [2] and Biomedical Generative Pretrained Transformer (BioGPT) [3] have shown improved performance across various clinical natural language processing (NLP) tasks, including question answering, summarization, entity recognition, relation extraction, document classification, and literature mining.”
From Retrieval-Augmented Generation (RAG) in Healthcare: A Comprehensive Review (2025) · cites this paper as [3]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“BioGPT is based on GPT-246 and trained using biomedical literature and has shown improved performance on text classification tasks over BERT-based architectures23.”
From Text classification models for assessing the completeness of randomized controlled trial publications based on CONSORT reporting guidelines (2024) · cites this paper as [23]
The cited source says what the claim attributes to it.
In the citing paper
“fine-tuned BioGPT23 has shown superior performance to BERT-based models in document classification”
From Text classification models for assessing the completeness of randomized controlled trial publications based on CONSORT reporting guidelines (2024) · cites this paper as [23]
8 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Exploiting Generative AI to Scale up Intelligent Tutoring Systems
Jakubův, J., Chvalovský, K., Goertzel, Z., Kaliszyk, C., Olšák, M., Piotrowski, B., Schulz, S., Suda, M., & Urban, J. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.itp.2023.19 · Cited by 76,658
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372
RoBERTa: A Robustly Optimized BERT Pretraining Approach
Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., Levy, O., Lewis, M., Zettlemoyer, L., & Stoyanov, V. (2019) · arXiv · doi:10.48550/arxiv.1907.11692 · Cited by 16,515
Kaugeranna, R., Kaugeranna, E., & Aion, (. S. 4. 6. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.giscience.2023.43 · Cited by 13,690
Lewis, M., Liu, Y., Goyal, N., Ghazvininejad, M., Mohamed, A., Levy, O., Stoyanov, V., & Zettlemoyer, L. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.703 · Cited by 8,821
Lewis, M., Liu, Y., Goyal, N., Ghazvininejad, M., Mohamed, A., Levy, O., Stoyanov, V., & Zettlemoyer, L. (2019) · arXiv · doi:10.48550/arxiv.1910.13461 · Cited by 8,816
Transformers: State-of-the-Art Natural Language Processing
Wolf, T., Debut, L., Sanh, V., Chaumond, J., Delangue, C., Moi, A., Cistac, P., Rault, T., Louf, R., Funtowicz, M., et al. (2020) · Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing: System Demonstrations · doi:10.18653/v1/2020.emnlp-demos.6 · Cited by 8,741
Research works printed but not linked: 8
- Wang, 2019, International Conference on Learning Representations
- Devlin, 2019, Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers), 4171
- Clark, 2019, International Conference on Learning Representations
- Radford, 2019, Language models are unsupervised multitask learners, OpenAI blog, 1, 9
- Nentidis, Joint European Conference on Machine Learning and Knowledge Discovery in Databases
- Liu, 2020, Proceedings of the Twenty-Ninth International Conference on International Joint Conferences on Artificial Intelligence, 3787
- Tsu-Jui, 2019, Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, 1409
- Kingma, 2015, International Conference on Learning Representations
Cited by
Items 201–300 of 1,017
Embeddings from language models are good learners for single-cell data analysis
Liu, T., Chen, T., Zheng, W., Luo, X., Chen, Y. T., & Zhao, H. (2026) · Patterns · doi:10.1016/j.patter.2025.101431 · Cited by 44
Self-citationEYE-Llama, an in-domain large language model for ophthalmology
Haghighi, T., Gholami, S., Sokol, J. T., Kishnani, E., Ahsaniyan, A., Rahmanian, H., Hedayati, F., Leng, T., & Alam, M. N. (2025) · iScience · doi:10.1016/j.isci.2025.112984 · Cited by 46
On the Scalability of GNNs for Molecular Graphs
Sypetkowski, M., Wenkel, F., Poursafaei, F., Dickson, N., Suri, K., Fradkin, P., & Beaini, D. (2024) · neural information processing systems · doi:10.52202/079017-0626 · Cited by 73
Does the sun rise for ChatGPT? Scientific discovery in the age of generative AI
Leslie, D. (2023) · AI and Ethics · doi:10.1007/s43681-023-00315-3 · Cited by 39
Synthesizing scientific literature with retrieval-augmented language models
Asai, A., He, J., Shao, R., Shi, W., Singh, A., Chang, J. C., Lo, K., Soldaini, L., Feldman, S., D’Arcy, M., et al. (2026) · Nature · doi:10.1038/s41586-025-10072-4 · Cited by 38
“Scientific LMs. Scientific LMs have spanned various domains, including biomedical 53–55 , medical 56–59 , biomedical 60–62 , geoscience 63 and astronomy 64 , with some models such as SciGLM 65 and Uni-SMART 66 that aim to cover diverse scientific domains in a single model.”
Mahbod, A., Saeidi, N., Hatamikia, S., & Woitek, R. (2025) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2025.110571 · Cited by 44
Autonomous Multiobjective Optimization Using Large Language Model
Huang, Y., Wu, S., Zhang, W., Wu, J., Feng, L., & Tan, K. C. (2025) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2025.3561001 · Cited by 58
On the Challenges of Fuzzing Techniques via Large Language Models
Huang, L., Zhao, P., Ma, L., & Chen, H. (2025) · IEEE International Conference on Software Services Engineering (SSE) · doi:10.1109/sse67621.2025.00028 · Cited by 42
Clinical insights: A comprehensive review of language models in medicine
Neveditsin, N., Lingras, P., & Mago, V. (2025) · PLOS Digital Health · doi:10.1371/journal.pdig.0000800 · Cited by 37
“This decoder-based model, based on GPT-2 and trained on millions of PubMed abstracts, has demonstrated proficiency in specialized tasks, including text classification, and biomedical text generation [89].”
InfluentialUse of SNOMED CT in Large Language Models: Scoping Review
Chang, E., & Sung, S. (2024) · JMIR Medical Informatics · doi:10.2196/62924 · Cited by 50
Artificial intelligence for drug delivery: Yesterday, today and tomorrow
Wu, Y., Wang, N., Xiong, P., Wang, R., Deng, J., & Ouyang, D. (2025) · Acta Pharmaceutica Sinica B · doi:10.1016/j.apsb.2025.09.022 · Cited by 45
Generating dermatopathology reports from gigapixel whole slide images with HistoGPT
Tran, M., Schmidle, P., Guo, R. R., Wagner, S. J., Koch, V., Lupperger, V., Novotny, B., Murphree, D. H., Hardway, H. D., D’Amato, M., et al. (2025) · Nature Communications · doi:10.1038/s41467-025-60014-x · Cited by 36
“They use the feature mean of the pre-trained Perceiver Resampler as the image representation andtheEOStokenof thepre-trainedBioGPTasthetext representation.”
InfluentialAssessing Empathy in Large Language Models with Real-World Physician-Patient Interactions
Luo, M., Warren, C. J., Cheng, L., Abdul-Muhsin, H. M., & Banerjee, I. (2024) · 2024 IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata62323.2024.10825307 · Cited by 36
“Large Language Models (LLMs) have exhibited exceptional performance in clinical and biomedical areas [24, 33].”
Infusing behavior science into large language models for activity coaching
Hegde, N., Vardhan, M., Nathani, D., Rosenzweig, E., Speed, C. A., Karthikesalingam, A., & Seneviratne, M. G. (2024) · PLOS Digital Health · doi:10.1371/journal.pdig.0000431 · Cited by 44
Scott, I. A., & Zuccon, G. (2024) · Internal Medicine Journal · doi:10.1111/imj.16393 · Cited by 38
Artificial intelligence for neurodegenerative experimental models
Marzi, S. J., Schilder, B. M., Nott, A., Frigerio, C. S., Willaime‐Morawek, S., Bucholc, M., Hanger, D. P., James, C., Lewis, P. A., Lourida, I., et al. (2023) · Alzheimer's & Dementia · doi:10.1002/alz.13479 · Cited by 35
Withers, C. A., Rufai, A. M., Venkatesan, A., Tirunagari, S., Lobentanzer, S., Harrison, M., & Zdrazil, B. (2025) · Expert Opinion on Drug Discovery · doi:10.1080/17460441.2025.2490835 · Cited by 40
Shen, O. Y.-J., Pratap, J. S., Li, X., Chen, N. C., & Bhashyam, A. R. (2024) · Clinical Orthopaedics and Related Research · doi:10.1097/corr.0000000000002995 · Cited by 36
The probable future of toxicology - probabilistic risk assessment
Maertens, A., Antignac, E., Benfenati, E., Bloch, D., Fritsche, E., Hoffmann, S., Jaworska, J. S., Loizou, G. D., McNally, K., Piechota, P., et al. (2024) · ALTEX · doi:10.14573/altex.2310301 · Cited by 38
Rapid Review of Generative AI in Smart Medical Applications
Sun, Y., & Ortiz, J. (2024) · International Journal of Computer Science and Information Technology · doi:10.62051/ijcsit.v3n2.10 · Cited by 36
A topical review on AI-interlinked biodomain sensors for multi-purpose applications
Thapa, R., Poudel, S., Krukiewicz, K., & Kunwar, A. (2024) · Measurement · doi:10.1016/j.measurement.2024.114123 · Cited by 38
LUNA: A Model-Based Universal Analysis Framework for Large Language Models
Song, D., Xie, X., Song, J., Zhu, D., Huang, Y., Juefei-Xu, F., & Ma, L. (2024) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2024.3411928 · Cited by 41
A review of reinforcement learning for natural language processing and applications in healthcare
Liu, Y., Wang, H., Zhou, H., Li, M., Hou, Y., Zhou, S., Wang, F., Hoetzlein, R., & Zhang, R. (2024) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocae215 · Cited by 34
Wysocka, M., Wysocki, O., Delmas, M., Mutel, V., & Freitas, A. (2024) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2024.104724 · Cited by 44
Knowledge grounded medical dialogue generation using augmented graphs
Varshney, D., Zafar, A., Behera, N. K., & Ekbal, A. (2023) · Scientific Reports · doi:10.1038/s41598-023-29213-8 · Cited by 55
Zagirova, D., Pushkov, S., Leung, G. H. D., Liu, B. H. M., Urban, A., Sidorenko, D., Kalashnikov, A., Kozlova, E., Naumov, V., Pun, F. W., et al. (2023) · Aging · doi:10.18632/aging.205055 · Cited by 37
Survey of Multimodal Medical Question Answering
Demirhan, H., & Zadrozny, W. (2023) · BioMedInformatics · doi:10.3390/biomedinformatics4010004 · Cited by 39
CataLM: empowering catalyst design through large language models
Wang, L., Chen, X., Du, Y., Zhou, Y., Gao, Y., & Cui, W. (2025) · International Journal of Machine Learning and Cybernetics · doi:10.1007/s13042-024-02473-0 · Cited by 40
A survey on cutting-edge relation extraction techniques based on language models
Diaz-Garcia, J. A., & Amador, J. (2025) · Artificial Intelligence Review · doi:10.1007/s10462-025-11280-0 · Cited by 46
Checcucci, E., Verri, P., Amparore, D., Cacciamani, G. E., Fiori, C., Breda, A., & Porpiglia, F. (2023) · Minerva Urology and Nephrology · doi:10.23736/s2724-6051.23.05326-0 · Cited by 32
Raza, S., & Schwartz, B. (2023) · Scientific Reports · doi:10.1038/s41598-023-35482-0 · Cited by 39
Liu, L., Yang, X., Lei, J., Shen, Y., Wang, J., Wei, P., Chu, Z., Qin, Z., & Ren, K. (2026) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2026.3709941 · Cited by 31
“A synchronized training mechanism is formulated to retrieve clinical guidelines and leverage medical knowledge, significantly improving the clinical reasoning capabilities of LLMs and decrease the requirements for computational resources.”
Bonfigli, A., Bacco, L., Merone, M., & Dell’Orletta⋄, F. (2024) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2024.103003 · Cited by 36
Liu, P., Tao, J., & Ren, Z. (2025) · Nature Machine Intelligence · doi:10.1038/s42256-024-00977-6 · Cited by 43
Target identification and assessment in the era of AI
Pun, F. W., Podolskiy, D. I., Izumchenko, E., Mortlock, A. A., Oprea, T. I., Scheibye‐Knudsen, M., Fortney, K., Morgen, E. K., Ren, F., & Zhavoronkov, A. A. (2026) · Nature Reviews Drug Discovery · doi:10.1038/s41573-026-01412-8 · Cited by 40
Auditing and Generating Synthetic Data with Controllable Trust Trade-offs
Belgodere, B. M., Dognin, P., Ivankay, A., Melnyk, I., Mroueh, Y., Mojsilović, A., Navrátil, J., Nitsure, A., Padhi, I., Rigotti, M., et al. (2024) · IEEE Journal on Emerging and Selected Topics in Circuits and Systems · doi:10.1109/jetcas.2024.3477976 · Cited by 41
Large language model trained on clinical oncology data predicts cancer progression
Zhu, M., Lin, H., Jiang, J., Jinia, A. J., Jee, J., Pichotta, K., Waters, M., Rose, D., Schultz, N., Chalise, S., et al. (2025) · npj Digital Medicine · doi:10.1038/s41746-025-01780-2 · Cited by 30
Language models for materials discovery and sustainability: Progress, challenges, and opportunities
Pei, Z., Yin, J., & Zhang, J. (2025) · Progress in Materials Science · doi:10.1016/j.pmatsci.2025.101495 · Cited by 30
Human-centred artificial intelligence for mobile health sensing: challenges and opportunities
Dang, T., Spathis, D., Ghosh, A., & Mascolo, C. (2023) · Royal Society Open Science · doi:10.1098/rsos.230806 · Cited by 30
Košprdić, M., Prodanović, N., Ljajić, A., Bašaragin, B., & Milošević, N. (2024) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2024.102970 · Cited by 39
Virtual laboratories: transforming research with AI
Klami, A., Damoulas, T., Engkvist, O., Rinke, P., & Kaski, S. (2024) · Data-Centric Engineering · doi:10.1017/dce.2024.15 · Cited by 36
Santoso, J. T., Hartono, B., Silalahi, F. D., & Muthohir, M. (2024) · Journal of Technology Informatics and Engineering · doi:10.51903/jtie.v3i3.211 · Cited by 30
Shao, Y., Lv, X.-Y., Ying, S., & Guo, Q. (2024) · Frontiers in Bioscience-Landmark · doi:10.31083/j.fbl2912404 · Cited by 34
Hou, S., Zhao, A., Liang, J., Shen, Z., & Wu, H. (2025) · Knowledge-Based Systems · doi:10.1016/j.knosys.2025.113624 · Cited by 30
Puniya, B. L. (2025) · Journal of Molecular Biology · doi:10.1016/j.jmb.2025.169181 · Cited by 31
Natural language processing in medical text processing: A scoping literature review
Elvas, L. B., Almeida, A. I., & Ferreira, J. C. (2025) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2025.106049 · Cited by 31
Are ChatGPT and other pretrained language models good parasitologists?
Šlapeta, J. R. (2023) · Trends in Parasitology · doi:10.1016/j.pt.2023.02.006 · Cited by 36
TabText: Language-Based Representations of Tabular Health Data for Predictive ModellingPreprint
Carballo, K. V., Na, L., Ma, Y., Boussioux, L., Zeng, C., Soenksen, L. R., & Bertsimas, D. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2206.10381 · Cited by 30
Huang, Q., Wu, S., Ou, Z., & Gao, Y. (2025) · Intelligent Oncology · doi:10.1016/j.intonc.2025.03.004 · Cited by 34
Zhang, R., Wang, Y., Yang, W., Wen, J., Liu, W., Zhi, S., Li, G., Chai, N., Huang, J., Xie, Y., et al. (2025) · Advanced Science · doi:10.1002/advs.202503926 · Cited by 39
A Comprehensive Review of Multimodal Large Language Models for Medical Imaging and Omics Data
Vavekanand, R. (2026) · Archives of Computational Methods in Engineering · doi:10.1007/s11831-026-10504-y · Cited by 33
Matzko, R., & Konur, S. (2024) · Network Modeling Analysis in Health Informatics and Bioinformatics · doi:10.1007/s13721-024-00455-4 · Cited by 28
“BioGPT is a domain-specific generative Transformer language model trained on 15 million PubMed abstracts.”
AI Advances in ICU with an Emphasis on Sepsis Prediction: An Overview
Stylianides, C., Nicolaou, A., Sulaiman, W. A., Alexandropoulou, C.-A., Panagiotopoulos, I., Karathanasopoulou, K., Dimitrakopoulos, G., Kleanthous, S., Politi, E., Ntalaperas, D., et al. (2025) · Machine Learning and Knowledge Extraction · doi:10.3390/make7010006 · Cited by 28
“Some popular transformer-based models trained specifically on healthcare data are BioBERT [253], MedBERT [254], BEHRT [255], BioGPT [256], Med-Palm [257], Foresight [258], and Gemini [259].”
HealthBench: Evaluating Large Language Models Towards Improved Human Health
Arora, R. K., Wei, J., Hicks, R. S., Bowman, P., Quiñonero-Candela, J., Tsimpourlas, F., Sharman, M., Shah, M., Vallone, A., Beutel, A., et al. (2025) · arXiv · doi:10.48550/arxiv.2505.08775 · Cited by 654
“Some works have focused on specialized medical models (Luo et al., 2022; Singhal et al., 2023; Li et al., 2023; Singhal et al., 2025; Saab et al., 2024), and others on general models (Nori et al., 2023; Gilson et al., 2023; Takagi et al., 2023).”
Foundation models for bioinformatics
Chen, Z., Wei, L., & Gao, G. (2024) · Quantitative Biology · doi:10.1002/qub2.69 · Cited by 29
Li, Y., Gupta, V., Kilic, M. N. T., Choudhary, K. K., Wines, D., Liao, W., Choudhary, A., & Agrawal, A. (2024) · Digital Discovery · doi:10.1039/d4dd00199k · Cited by 39
DALL-M: Context-aware clinical data augmentation with large language models
Hsieh, C., Moreira, C., Nobre, I. B., Sousa, S. C., Ouyang, C., Brereton, M. F., Jorge, J. A., & Nascimento, J. C. (2025) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2025.110022 · Cited by 32
Multimodal integration strategies for clinical application in oncology
Zhang, B., Wan, Z., Luo, Y., Zhao, X., Samayoa, J. A., Zhao, W., & Wu, S. (2025) · Frontiers in Pharmacology · doi:10.3389/fphar.2025.1609079 · Cited by 36
Lee, M. (2023) · Mathematics · doi:10.3390/math11112451 · Cited by 28
Gao, K., He, S., He, Z., Lin, J., Pei, Q., Shao, J., & Zhang, W. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2308.14149 · Cited by 32
Using GPT-4 to write a scientific review article: a pilot evaluation study
Wang, Z. P., Bhandary, P., Wang, Y., & Moore, J. H. (2024) · BioData Mining · doi:10.1186/s13040-024-00371-3 · Cited by 28
Digital Alchemy: The Rise of Machine and Deep Learning in Small-Molecule Drug Discovery
Manan, A., Baek, E., Ilyas, S., & Lee, D. (2025) · International Journal of Molecular Sciences · doi:10.3390/ijms26146807 · Cited by 32
Yang, T., Xiao, Y., Bao, Z., Hao, J., & Peng, J. (2025) · Briefings in Bioinformatics · doi:10.1093/bib/bbaf601 · Cited by 33
He, J., Zhang, B., Rouhizadeh, H., Chen, Y., Yang, R., Lu, J. S., Chen, X., Liu, N., & Teodoro, D. (2026) · Artificial Intelligence Review · doi:10.21203/rs.3.rs-8330917/v1 · Cited by 33
Developing ChatGPT for biology and medicine: a complete review of biomedical question answering
Li, Q., Li, L., & Li, Y. (2024) · Biophysics Reports · doi:10.52601/bpr.2024.240004 · Cited by 36
Large Language Models in Oncology: Revolution or Cause for Concern?
Caglayan, A., Slusarczyk, W., Rabbani, R. D., Ghose, A., Papadopoulos, V. P., & Boussios, S. (2024) · Current Oncology · doi:10.3390/curroncol31040137 · Cited by 30
Sequential Optimal Experimental Design of Perturbation Screens Guided by Multi-modal Priors
Huang, K., Lopez, R., Hütter, J.-C., Kudo, T., Rios, A., & Regev, A. (2024) · Lecture notes in computer science · doi:10.1007/978-1-0716-3989-4_2 · Cited by 28
Transforming Hospital Quality Improvement Through Harnessing the Power of Artificial Intelligence
Abukhadijah, H. J., & Nashwan, A. J. (2024) · Global Journal on Quality and Safety in Healthcare · doi:10.36401/jqsh-24-4 · Cited by 35
Das, A., Tariq, A., Batalini, F., Dhara, B., & Banerjee, I. (2024) · medRxiv · doi:10.1101/2024.03.20.24304627 · Cited by 42
Haoyu, T., Kuo, Y., Xin, D., Chenxi, Z., Mingwei, Y., Hongyan, W., Yiming, L., Minjie, H., Qiang, Z., Yu, J., et al. (2024) · Digital Chinese Medicine · doi:10.1016/j.dcmed.2025.01.007 · Cited by 29
Decoding the mind: A RAG-LLM on ICD-11 for decision support in psychology
Cremaschi, M., Ditolve, D., Curcio, C., Panzeri, A., Spoto, A., & Maurino, A. (2025) · Expert Systems with Applications · doi:10.1016/j.eswa.2025.127191 · Cited by 32
Utilizing large language models for gastroenterology research: a conceptual framework
Berry, P., Dhanakshirur, R. R., & Khanna, S. (2025) · Therapeutic Advances in Gastroenterology · doi:10.1177/17562848251328577 · Cited by 29
A New Era of Artificial Intelligence (AI): Transforming Drug Discovery and Development
Ali, S., Tian, X., Chen, H., & Zhou, J. (2025) · Journal of Medicinal Chemistry · doi:10.1021/acs.jmedchem.5c03159 · Cited by 26
scELMo: Embeddings from Language Models are Good Learners for Single-cell Data Analysis
Liu, T., Chen, T., Zheng, W., Luo, X., Chen, Y., & Zhao, H. (2023) · doi:10.1101/2023.12.07.569910 · Cited by 30
Self-citationTang, X., Tran, A., Tan, J. T. C., & Gerstein, M. (2024) · Bioinformatics · doi:10.1093/bioinformatics/btae260 · Cited by 43
GRATCR: Epitope-Specific T Cell Receptor Sequence Generation With Data-Efficient Pre-Trained Models
Zhou, Z., Chen, J., Lin, S. L., Hong, L., Wei, D., & Xiong, Y. (2025) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2024.3514089 · Cited by 26
Natural Language Processing for Digital Health in the Era of Large Language Models
Sarker, A., Zhang, R., Wang, Y., Xiao, Y., Das, S., Schutte, D., Oniani, D., Xie, Q., & Xu, H. (2024) · Yearbook of Medical Informatics · doi:10.1055/s-0044-1800750 · Cited by 39
End-to-end multimodal pathology foundation model with clinical dialogue
Vorontsov, E., Shaikovski, G., Casson, A., Viret, J., Zimmermann, E., Tenenholtz, N., Wang, Y. K., Bernhard, J., Godrich, R., Retámero, J. A., et al. (2026) · Nature Medicine · doi:10.1038/s41591-026-04521-4 · Cited by 30
Integrating domain knowledge for biomedical text analysis into deep learning: A survey
Cai, L., Li, J., Lv, H., Liu, W., Niu, H., & Wang, Z. (2023) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2023.104418 · Cited by 27
Large Language Model and Text Generation
Wu, Y. (2024) · Cognitive informatics in biomedicine and healthcare · doi:10.1007/978-3-031-55865-8_10 · Cited by 34
Comparative Study of Large Language Model Architectures on Frontier
Yin, J., Bose, A., Cong, G., Lyngaas, I., & Anthony, Q. G. (2024) · IEEE International Parallel and Distributed Processing Symposium (IPDPS) · doi:10.1109/ipdps57955.2024.00056 · Cited by 26
Ferrati, F., Kim, P. H., & Muffatto, M. (2024) · Foundations and Trends® in Entrepreneurship · doi:10.1561/0300000121 · Cited by 30
A survey on biomedical automatic text summarization with large language models
Huang, Z., Chen, X., Wang, Y., Huang, J., & Zhao, X. (2025) · Information Processing & Management · doi:10.1016/j.ipm.2025.104216 · Cited by 27
Younesi, A., Oustad, E., Ansari, M., Fahringer, T., & Buyya, R. (2025) · Internet of Things · doi:10.1016/j.iot.2025.101815 · Cited by 34
Artificial Intelligence for Learning Material Synthesis Processes of Thermoelectric Materials
Na, G. S. (2023) · Chemistry of Materials · doi:10.1021/acs.chemmater.3c01834 · Cited by 27
FORGE: Pre-Training Open Foundation Models for Science
Yin, J., Dash, S., Wang, F., & Shankar, M. A. (2023) · International Conference for High Performance Computing, Networking, Storage and Analysis (SC) · doi:10.1145/3581784.3613215 · Cited by 34
Aftab, W., Apostolou, Z., Bouazoune, K., & Straub, T. (2024) · BMC Bioinformatics · doi:10.1186/s12859-024-05902-7 · Cited by 24
Park, J., Kim, S., Kim, J., Lee, D., Bae, S., Shin, H., Lee, D., & Choi, H. (2025) · Advanced Science · doi:10.1002/advs.202513210 · Cited by 27
MedEval: A Multi-Level, Multi-Task, and Multi-Domain Medical Benchmark for Language Model Evaluation
He, Z., Wang, Y., Yan, A., Liu, Y., Chang, E. Y., Gentili, A., McAuley, J., & Hsu, C. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.540 · Cited by 42
Applying Large Language Models for Causal Structure Learning in Non Small Cell Lung Cancer
Naik, N., Khandelwal, A., Joshi, M., Atre, M., Wright, H., Kannan, K. K., Hill, S., Mamidipudi, G., Srinivasa, G., Bifulco, C. B., et al. (2024) · IEEE International Conference on Healthcare Informatics (ICHI) · doi:10.1109/ichi61247.2024.00110 · Cited by 30
Biomedical Natural Language Processing in the Era of Large Language Models
Usuyama, N., Wong, C., Zhang, S., Naumann, T., & Poon, H. (2025) · Annual Review of Biomedical Data Science · doi:10.1146/annurev-biodatasci-103123-095406 · Cited by 27
Self-citationVisual reasoning consistency and robustness analysis of multimodal LLMs
Jegham, N., Abdelatti, M. F., & Hendawi, A. (2025) · Pattern Recognition · doi:10.1016/j.patcog.2025.112765 · Cited by 27
Dynamic Uncertainty-Aware Multimodal Fusion for Outdoor Health Monitoring
Fang, Z., Zheng, L., Hu, S., Tao, Y., Deng, Y., Chen, X., & Fang, Y. M. (2026) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2026.3684749 · Cited by 27
BioAug: Conditional Generation based Data Augmentation for Low-Resource Biomedical NER
Ghosh, S., Tyagi, U., Kumar, S., & Manocha, D. (2023) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3539618.3591957 · Cited by 22
Large Language Models as Instructors: A Study on Multilingual Clinical Entity Extraction
Méoni, S., de la Clergerie, É. V., & Ryffel, T. (2023) · Workshop on Biomedical Language Processing (BioNLP) · doi:10.18653/v1/2023.bionlp-1.15 · Cited by 40
Artificial intelligence as a catalyst for combustion science and engineering
Ihme, M., & Chung, W. T. (2024) · Proceedings of the Combustion Institute · doi:10.1016/j.proci.2024.105730 · Cited by 22
Li, C., Xing, W., Song, Y., & Lyu, B. (2024) · Computers and Education Artificial Intelligence · doi:10.1016/j.caeai.2024.100338 · Cited by 28
Goryanin, I., Goryanin, I., & Demin, O. (2025) · Drug Discovery Today · doi:10.1016/j.drudis.2025.104448 · Cited by 21
Beyond boundaries: exploring the transformative power of AI in pharmaceuticals
Suri, G. S., Kaur, G., & Shinde, D. A. (2024) · Discover Artificial Intelligence · doi:10.1007/s44163-024-00192-7 · Cited by 21
Domain-Specific Large Language Model for Renewable Energy and Hydrogen Deployment Strategies
Gabbar, H. A., & Hemied, O. S. (2024) · Energies · doi:10.3390/en17236063 · Cited by 26
Metadata
- Authors
- Luo, R., Sun, L., Xia, Y., Qin, T., Zhang, S., Poon, H., & Liu, T.-Y.
- Affiliations
- Microsoft Research Asia (China) (CN)
- Peking University (CN)
- Microsoft (United States) (US)
- Corresponding author
- Xia, Yingce
- Qin, Tao
- Venue
- Briefings in Bioinformatics
- Publisher
- Oxford University Press (OUP)
- Published
- 2022-09-24
- Volume
- 23
- Issue
- 6
- ISSN
- 1467-5463 (ISSN-L)
- 1477-4054
- OpenAlex
- W4297253404
- Cited by
- 1,150
- References
- 65
- Citations by year
- 2026: 329 · 2025: 375 · 2024: 287 · 2023: 159
- FWCI
- 67.11
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- academic.oup.com/journals/pages/open_access/funder_policies/chorus/standard_publication_model (vor)
- Locations
- Briefings in Bioinformatics (publishedVersion)
- PubMed (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Health Sciences › Medicine › Health Informatics › Biomedical Text Mining and Ontologies
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning in Healthcare
- Keywords
- BioGPT, generative pre-trained transformer, biomedical natural language processing, relation extraction, drug-drug interactions, PubMedQA, biomedical literature, domain-specific language models
- MeSH terms
- Natural Language Processing, Data Mining
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.