PubMed and beyond: biomedical literature search in the age of artificial intelligence
Open accessThe DOI matches its Crossref record; 49 of the 49 references it cites were found in a registry or an index.
Abstract
Biomedical research yields vast information, much of which is only accessible through the literature. Consequently, literature search is crucial for healthcare and biomedicine. Recent improvements in artificial intelligence (AI) have expanded functionality beyond keywords, but they might be unfamiliar to clinicians and researchers. In response, we present an overview of over 30 literature search tools tailored to common biomedical use cases, aiming at helping readers efficiently fulfill their information needs. We first discuss recent improvements and continued challenges of the widely used PubMed. Then, we describe AI-based literature search tools catering to five specific information needs: 1. Evidence-based medicine. 2. Precision medicine and genomics. 3. Searching by meaning, including questions. 4. Finding related articles with literature recommendation. 5. Discovering hidden associations through literature mining. Finally, we discuss the impacts of recent developments of large language models such as ChatGPT on biomedical information seeking.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372 · cited 1×
“As a result, they provide point-of-care evidence that can guide clinical decision-making.”
Cochrane Handbook for Systematic Reviews of Interventions
(2019) · doi:10.1002/9781119536604 · Cited by 14,828
dbSNP: the NCBI database of genetic variation
Sherry, S. T. (2001) · Nucleic Acids Research · doi:10.1093/nar/29.1.308 · Cited by 7,502 · cited 1×
“PubMed should be the fi rst choice for three types of literature search practices: (1) exploring biomedical topics via keyword query such as “ diabetes treatment ” , with PMC enabling keyword search within the full text, when available; (2) searching for single citations with”
MethodUniProt: the universal protein knowledgebase in 2021
The UniProt Consortium, Bateman, A., Martin, M.-J., Orchard, S., Magrane, M., Agivetova, R., Ahmad, S., Alpi, E., Bowler-Barnett, E. H., Britto, R., et al. (2021) · Nucleic Acids Research · doi:10.1093/nar/gkaa1100 · Cited by 6,372 · cited 1×
“Such information is typically stored in manually curated databases such as UniProt, 29 dbSNP, 30 and ClinVar.”
MethodA New Initiative on Precision Medicine
Collins, F. S., & Varmus, H. (2015) · New England Journal of Medicine · doi:10.1056/nejmp1500523 · Cited by 5,202
Large Language Models Encode Clinical Knowledge
Singhal, K., Azizi, S., Tu, T., Mahdavi, S. S., Wei, J., Chung, H. W., Scales, N., Tanwani, A., Cole-Lewis, H., Pfohl, S., et al. (2022) · arXiv · doi:10.48550/arxiv.2212.13138 · Cited by 4,083
Large language models encode clinical knowledge
Singhal, K., Azizi, S., Tu, T., Mahdavi, S. S., Wei, J., Chung, H. W., Scales, N., Tanwani, A., Cole-Lewis, H., Pfohl, S., et al. (2023) · Nature · doi:10.1038/s41586-023-06291-2 · Cited by 4,083 · cited 2×
“65 This suggests that LLMs can provide direct answers to natural language questions using relevant documents returned from a traditional search engine.”
BackgroundClinVar: public archive of relationships among sequence variation and human phenotype
Landrum, M. J., Lee, J. M., Riley, G. R., Jang, W., Rubinstein, W. S., Church, D. M., & Maglott, D. R. (2014) · Nucleic Acids Research · doi:10.1093/nar/gkt1113 · Cited by 3,516 · cited 1×
“31 These databases manually summarize and maintain primary fi ndings from the literature about each data entry.”
BackgroundThe well-built clinical question: A key to evidence-based decisions
(1995) · ACP Journal Club · doi:10.7326/acpjc-1995-123-3-a12 · Cited by 2,931 · cited 1×
“15 Accordingly, clinical questions should be structured effectively, incorporating at least the “ PICO ” elements 16 ( P opulation, I ntervention, C ompari-son, and O utcome).”
BackgroundAmberger, J. S., Bocchini, C. A., Schiettecatte, F., Scott, A. F., & Hamosh, A. (2015) · Nucleic Acids Research · doi:10.1093/nar/gku1205 · Cited by 2,691
A Survey of Large Language Models
Zhao, W. X., Zhou, K., Li, J., Tang, T., Dong, Z., Hou, Y., Zhang, B., Min, Y., Zhang, J., Liu, P., et al. (2026) · Frontiers of Computer Science · doi:10.1007/s11704-026-60308-3 · Cited by 2,093
A Survey of Large Language Models
Zhao, W. X., Zhou, K., Li, J., Tang, T., Wang, X., Hou, Y., Min, Y., Zhang, B., Zhang, J., Dong, Z., et al. (2023) · arXiv · doi:10.48550/arxiv.2303.18223 · Cited by 2,090
DisGeNET: a discovery platform for the dynamical exploration of human diseases and their genes
Pinero, J., Queralt-Rosinach, N., Bravo, A., Deu-Pons, J., Bauer-Mehren, A., Baron, M., Sanz, F., & Furlong, L. I. (2015) · Database · doi:10.1093/database/bav028 · Cited by 1,124 · cited 1×
“PubMed should be the fi rst choice for three types of literature search practices: (1) exploring biomedical topics via keyword query such as “ diabetes treatment ” , with PMC enabling keyword search within the full text, when available; (2) searching for single citations with”
Explainable Recommendation: A Survey and New Perspectives
Zhang, Y., & Chen, X. (2020) · Foundations and Trends® in Information Retrieval · doi:10.1561/1500000066 · Cited by 755
Jin, D., Pan, E., Oufattole, N., Weng, W.-H., Fang, H., & Szolovits, P. (2021) · doi:10.20944/preprints202105.0498.v1 · Cited by 718
Marshall, I. J., & Wallace, B. C. (2019) · Systematic Reviews · doi:10.1186/s13643-019-1074-9 · Cited by 638 · cited 1×
“20 Despite efforts to use machine learning to automate this screening process, 21 – 26 these features are not yet integrated into web-based EBM search engines due to the intrinsic complexity and low tolerance for errors in this task.”
MethodTsatsaronis, G., Balikas, G., Malakasiotis, P., Partalas, I., Zschunke, M., Alvers, M. R., Weissenborn, D., Krithara, A., Petridis, S., Polychronopoulos, D., et al. (2015) · BMC Bioinformatics · doi:10.1186/s12859-015-0564-6 · Cited by 598 · cited 1×
“2 depicts the architecture of an ideal EBM search engine, which allows PICO-style input and ranks results based on evidence quality.”
DISEASES: Text mining and data integration of disease–gene associations
Pletscher-Frankild, S., Pallejà, A., Tsafou, K., Binder, J. X., & Jensen, L. J. (2015) · Methods · doi:10.1016/j.ymeth.2014.11.020 · Cited by 591
Evaluating large language models on medical evidence summarization
Tang, L., Sun, Z., Idnay, B., Nestor, J. G., Soroush, A., Elias, P. A., Xu, Z., Ding, Y., Durrett, G., Rousseau, J. F., et al. (2023) · npj Digital Medicine · doi:10.1038/s41746-023-00896-7 · Cited by 423
Evaluating Large Language Models on Medical Evidence Summarization
Tang, L., Sun, Z., Idnay, B., Nestor, J. G., Soroush, A., Elias, P. A., Xu, Z., Ding, Y., Durrett, G., Rousseau, J., et al. (2023) · doi:10.1101/2023.04.22.23288967 · Cited by 423 · cited 1×
“20 Despite efforts to use machine learning to automate this screening process, 21 – 26 these features are not yet integrated into web-based EBM search engines due to the intrinsic complexity and low tolerance for errors in this task.”
PubTator central: automated concept annotation for biomedical full text articles
Wei, C.-H., Allot, A., Leaman, R., & Lu, Z. (2019) · Nucleic Acids Research · doi:10.1093/nar/gkz389 · Cited by 400
Self-citationOpportunities and Challenges for ChatGPT and Large Language Models in Biomedicine and Health
Tian, S., Jin, Q., Yeganova, L., Lai, P.-T., Zhu, Q., Chen, X., Yang, Y., Chen, Q., Kim, W., Comeau, D. C., et al. (2023) · Briefings in Bioinformatics · doi:10.1093/bib/bbad493 · Cited by 359
Self-citationSemi-automated screening of biomedical citations for systematic reviews
Wallace, B. C., Trikalinos, T. A., Lau, J., Brodley, C., & Schmid, C. H. (2010) · BMC Bioinformatics · doi:10.1186/1471-2105-11-55 · Cited by 351 · cited 1×
“20 Despite efforts to use machine learning to automate this screening process, 21 – 26 these features are not yet integrated into web-based EBM search engines due to the intrinsic complexity and low tolerance for errors in this task.”
Can large language models reason about medical questions?
Liévin, V., Hother, C. E., Motzfeldt, A. G., & Winther, O. (2022) · arXiv · doi:10.48550/arxiv.2207.08143 · Cited by 343
RobotReviewer: evaluation of a system for automatically assessing bias in clinical trials
Marshall, I. J., Kuiper, J., & Wallace, B. C. (2016) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocv044 · Cited by 317
Keep up with the latest coronavirus research
Chen, Q., Allot, A., & Lu, Z. (2020) · Nature · doi:10.1038/d41586-020-00694-1 · Cited by 295
Self-citationMatching patients to clinical trials with large language models
Jin, Q., Wang, Z., Floudas, C. S., Chen, F., Gong, C., Bracken-Clarke, D., Xue, E., Yang, Y., Sun, J., & Lu, Z. (2024) · Nature Communications · doi:10.1038/s41467-024-53081-z · Cited by 287
Self-citationMatching Patients to Clinical Trials with Large Language Models
Jin, Q., Wang, Z., Floudas, C. S., Chen, F., Gong, C., Bracken-Clarke, D., Xue, E., Yang, Y., Sun, J., & Lu, Z. (2023) · arXiv · doi:10.48550/arxiv.2307.15051 · Cited by 287
Self-citationCan ChatGPT Write a Good Boolean Query for Systematic Review Literature Search?
Wang, S., Scells, H., Koopman, B., & Zuccon, G. (2023) · Proceedings of the 46th International ACM SIGIR Conference on Research and Development in Information Retrieval · doi:10.1145/3539618.3591703 · Cited by 275
Understanding PubMed(R) user search behavior through log analysis
Islamaj Dogan, R., Murray, G. C., Neveol, A., & Lu, Z. (2009) · Database · doi:10.1093/database/bap018 · Cited by 265
Self-citationLitCovid: an open database of COVID-19 literature
Chen, Q., Allot, A., & Lu, Z. (2021) · Nucleic Acids Research · doi:10.1093/nar/gkaa952 · Cited by 253 · cited 2×
“This overview article aims to acquaint readers with available tools, discuss best practices, identify functionality gaps for different search scenarios, and ultimately facilitate biomedical literature retrieval.”
BackgroundSelf-citationPubMed related articles: a probabilistic topic-based model for content similarity
Lin, J., & Wilbur, W. J. (2007) · BMC Bioinformatics · doi:10.1186/1471-2105-8-423 · Cited by 243 · cited 1×
“Modern literature search engines often provide a list of articles related to individual articles, such as the “similar articles” section in PubMed 59 .”
BackgroundThe coronavirus pandemic in five powerful charts
Callaway, E., Cyranoski, D., Mallapaty, S., Stoye, E., & Tollefson, J. (2020) · Nature · doi:10.1038/d41586-020-00758-2 · Cited by 237
Nye, B., Li, J. J., Patel, R., Yang, Y., Marshall, I., Nenkova, A., & Wallace, B. (2018) · Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p18-1019 · Cited by 224
Wei, C.-H., Peng, Y., Leaman, R., Davis, A. P., Mattingly, C. J., Li, J., Wiegers, T. C., & Lu, Z. (2016) · Database · doi:10.1093/database/baw032 · Cited by 198
Self-citationJin, Q., Yang, Y., Chen, Q., & Lu, Z. (2024) · Bioinformatics · doi:10.1093/bioinformatics/btae075 · Cited by 176 · cited 1×
“LLMs can alleviate these access dif fi culties by autonomously utilizing tools such as utilities of specialised databases, 72 and directly summarize the database entries to answer users ’ information-seeking questions.”
MethodSelf-citationBest Match: New relevance search for PubMed
Fiorini, N., Canese, K., Starchenko, G., Kireev, E., Kim, W., Miller, V., Osipov, M., Kholodov, M., Ismagilov, R., Mohan, S., et al. (2018) · PLOS Biology · doi:10.1371/journal.pbio.2005343 · Cited by 175
Self-citationEvaluating Verifiability in Generative Search Engines
Liu, N. F., Zhang, T., & Liang, P. (2023) · arXiv · Cited by 143 · cited 1×
“However, these LLM-generated answers are susceptible to precision and recall errors 91-93 and should be carefully verified before use.”
BackgroundRecent advances in biomedical literature mining
Zhao, S., Su, C., Lu, Z., & Wang, F. (2021) · Briefings in Bioinformatics · doi:10.1093/bib/bbaa057 · Cited by 134 · cited 1×
“40 Results in LitSense can be fi ltered by sections, such as Conclusions.”
BackgroundSelf-citationLiterature Based Discovery: Models, methods, and trends
Henry, S., & McInnes, B. T. (2017) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2017.08.011 · Cited by 121
A survey on literature based discovery approaches in biomedical domain
Gopalakrishnan, V., Jha, K., Jin, W., & Zhang, A. (2019) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2019.103141 · Cited by 76
BioReader: a text mining tool for performing classification of biomedical literature
Simon, C., Davidsen, K., Hansen, C., Seymour, E., Barnkob, M. B., & Olsen, L. R. (2019) · BMC Bioinformatics · doi:10.1186/s12859-019-2607-x · Cited by 74
LION LBD: a literature-based discovery system for cancer biology
Pyysalo, S., Baker, S., Ali, I., Haselwimmer, S., Shah, T., Young, A., Guo, Y., Högberg, J., Stenius, U., Narita, M., et al. (2019) · Bioinformatics · doi:10.1093/bioinformatics/bty845 · Cited by 65
AI-generated text may have a role in evidence-based medicine
Peng, Y., Rousseau, J. F., Shortliffe, E. H., & Weng, C. (2023) · Nature Medicine · doi:10.1038/s41591-023-02366-9 · Cited by 64 · cited 1×
“67 70 However, these preliminary evaluations have exposed various issues, such as potential bias and hallucination, which must be addressed before widespread use.”
BackgroundLitSuggest: a web-based system for literature recommendation and curation using machine learning
Allot, A., Lee, K., Chen, Q., Luo, L., & Lu, Z. (2021) · Nucleic Acids Research · doi:10.1093/nar/gkab326 · Cited by 61 · cited 1×
“LitSuggest, 49 a literature recommendation system based on machine learning, rates candidate articles on their similarity to a user-supplied list of positive articles and dissimilarity to an optional list of negative articles.”
BackgroundSelf-citationCan ChatGPT Write a Good Boolean Query for Systematic Review Literature Search?
Wang, S., Scells, H., Koopman, B., & Zuccon, G. (2023) · arXiv · doi:10.48550/arxiv.2302.03495 · Cited by 40
Impact of PubMed search filters on the retrieval of evidence by physicians
Shariff, S. Z., Sontrop, J. M., Haynes, R. B., Iansavichus, A. V., McKibbon, K. A., Wilczynski, N. L., Weir, M. A., Speechley, M. R., Thind, A., & Garg, A. X. (2012) · Canadian Medical Association Journal · doi:10.1503/cmaj.101661 · Cited by 38
AI science search engines are exploding in number — are they any good?
Sanderson, K. (2023) · Nature · doi:10.1038/d41586-023-01273-w · Cited by 27
SciRide Finder: a citation-based paradigm in biomedical literature search
Volanakis, A., & Krawczyk, K. (2018) · Scientific Reports · doi:10.1038/s41598-018-24571-0 · Cited by 19
Cited by
PubTator 3.0: an AI-powered literature resource for unlocking biomedical knowledge
Wei, C.-H., Allot, A., Lai, P.-T., Leaman, R., Tian, S., Luo, L., Jin, Q., Wang, Z., Chen, Q., & Lu, Z. (2024) · Nucleic Acids Research · doi:10.1093/nar/gkae235 · Cited by 176
Self-citationHidden flaws behind expert-level accuracy of multimodal GPT-4 vision in medicine
Jin, Q., Chen, F., Zhou, Y., Xu, Z., Cheung, J. M., Chen, R., Summers, R. M., Rousseau, J. F., Ni, P., Landsman, M. J., et al. (2024) · npj Digital Medicine · doi:10.1038/s41746-024-01185-7 · Cited by 146
Self-citationLarge Language Model‐Based Chatbots in Higher Education
Yigci, D., Eryilmaz, M., Yetisen, A. K., Tasoglu, S., & Ozcan, A. (2025) · Advanced Intelligent Systems · doi:10.1002/aisy.202400429 · Cited by 113
Large language models in biomedicine and health: current research landscape and future directions
Lu, Z., Peng, Y., Cohen, T., Ghassemi, M., Weng, C., & Tian, S. (2024) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocae202 · Cited by 92
Self-citationAccelerating clinical evidence synthesis with large language models
Wang, Z., Cao, L., Danek, B., Jin, Q., Lu, Z., & Sun, J. (2025) · npj Digital Medicine · doi:10.1038/s41746-025-01840-7 · Cited by 69
“Once the term set is fi nalized, users can click the “ Search Studies ” button to construct the search query and retrieve relevant studies from the literature. c The recall of search results for reviews across four topics.”
Self-citation
Metadata
- Authors
- Jin, Q., Leaman, R., & Lu, Z.
- Venue
- eBioMedicine
- Publisher
- Elsevier BV
- Published
- 2024-02
- Volume
- 100
- Pages
- 104988
- ISSN
- 2352-3964 (ISSN-L)
- OpenAlex
- W4391544808
- Cited by
- 124
- References
- 49
- FWCI
- 47.45
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.