Best Match: New relevance search for PubMed
Open accessAbstract
PubMed is a free search engine for biomedical literature accessed by millions of users from around the world each day. With the rapid growth of biomedical literature-about two articles are added every minute on average-finding and retrieving the most relevant papers for a given query is increasingly challenging. We present Best Match, a new relevance search algorithm for PubMed that leverages the intelligence of our users and cutting-edge machine-learning technology as an alternative to the traditional date sort order. The Best Match algorithm is trained with past user searches with dozens of relevance-ranking signals (factors), the most important being the past usage of an article, publication date, relevance score, and type of article. This new algorithm demonstrates state-of-the-art retrieval performance in benchmarking experiments as well as an improved user experience in real-world testing (over 20% increase in user click-through rate). Since its deployment in June 2017, we have observed a significant increase (60%) in PubMed searches with relevance sort order: it now assists millions of PubMed searches each week. In this work, we hope to increase the awareness and transparency of this new relevance sort option for PubMed users, enabling them to retrieve information more effectively.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The explosion of scientific literature, coupled with the complexity and specificity of many research questions, further adds to the challenges of systematic reviews.
“The explosion of scientific literature, coupled with the complexity and specificity of many research questions, further adds to these challenges (Fiorini et al., 2018).”
From Can large language models replace humans in systematic reviews? Evaluating <scp>GPT</scp> ‐4's efficacy in screening and extracting data from peer‐reviewed and grey literature in multiple languages (2024) · cites this paper as Fiorini et al., 2018
The Introduction describes PubMed’s large biomedical literature collection and says query ambiguity and complexity can put irrelevant results first. That supports a general challenge in finding relevant research, but the paper does not connect it specifically to the conduct of systematic reviews or discuss the specificity of their research questions. (LLM, conf=0.82)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Optimizing search engines using clickthrough data
Joachims, T. (2002) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/775047.775067 · Cited by 3,921 · see citing works
Robertson, S. E., Walker, S., Jones, S., Hancock‐Beaulieu, M., & Gatford, M. (1994) · Text REtrieval Conference · Cited by 2,212 · see citing works
Learning to rank for information retrieval
Liu, T. (2010) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/1835449.1835676 · Cited by 1,879 · see citing works
Learning to Rank for Information Retrieval
Liu, T. (2009) · Foundations and Trends® in Information Retrieval · doi:10.1561/1500000016 · Cited by 1,575 · see citing works
Accurately interpreting clickthrough data as implicit feedback
Joachims, T., Granka, L., Pan, B., Hembrooke, H., & Gay, G. (2005) · Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/1076034.1076063 · Cited by 1,408 · see citing works
From RankNet to LambdaRank to LambdaMART: An Overview
Burges, C. J. C. (2010) · Cited by 1,005 · see citing works
Encyclopedia of Machine Learning and Data Mining
Webb, G. I., & Sammut, C. (2017) · Springer eBooks · doi:10.1007/978-1-4899-7687-1 · Cited by 926 · see citing works
A Deep Relevance Matching Model for Ad-hoc Retrieval
Guo, J., Fan, Y., Ai, Q., & Croft, W. B. (2016) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/2983323.2983769 · Cited by 821 · see citing works
Learning to Rank Short Text Pairs with Convolutional Deep Neural Networks
Severyn, A., & Moschitti, A. (2015) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/2766462.2767738 · Cited by 736 · see citing works
Literature mining for the biologist: from information retrieval to biological discovery
Jensen, L. J., Šarić, J., & Peer Bork, B. (2006) · Nature Reviews Genetics · doi:10.1038/nrg1768 · Cited by 632 · see citing works
DNorm: disease name normalization with pairwise learning to rank
Leaman, R., Islamaj, R., & Lu, Z. (2013) · Bioinformatics · doi:10.1093/bioinformatics/btt474 · Cited by 484 · see citing works
Self-citationUnderstanding PubMed(R) user search behavior through log analysis
Islamaj Dogan, R., Murray, G. C., Neveol, A., & Lu, Z. (2009) · Database · doi:10.1093/database/bap018 · Cited by 265 · see citing works
Self-citationYahoo! Learning to Rank Challenge Overview
Chapelle, O., & Chang, Y. (2010) · Cited by 231 · see citing works
TREC genomics special issue overview
Hersh, W., & Voorhees, E. M. (2008) · Information Retrieval · doi:10.1007/s10791-008-9076-6 · Cited by 180 · see citing works
A model to estimate intrinsic document relevance from the clickthrough logs of a web search engine
Dupret, G., & Liao, C. Y. (2010) · ACM International Conference on Web Search and Data Mining (WSDM) · doi:10.1145/1718487.1718510 · Cited by 137 · see citing works
Neural information retrieval: at the end of the early years
Onal, K. D., Zhang, Y., Altıngövde, İ. S., Rahman, M. M., Karagöz, P., Braylan, A., Dang, B., Chang, H.-L., Kim, H., McNamara, Q., et al. (2017) · Information Retrieval · doi:10.1007/s10791-017-9321-y · Cited by 137 · see citing works
Fiorini, N., Lipman, D. J., & Lu, Z. (2017) · eLife · doi:10.7554/elife.28801 · Cited by 128 · see citing works
Self-citationKavuluru, R., Rios, A., & Lu, Y. (2015) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2015.04.007 · Cited by 126 · see citing works
Online Controlled Experiments and A/B Testing
Kohavi, R., & Longbotham, R. (2016) · Encyclopedia of Machine Learning and Data Mining · doi:10.1007/978-1-4899-7502-7_891-1 · Cited by 96 · see citing works
Banner advertising: Measuring effectiveness and optimizing placement
Sherman, L., & Deighton, J. (2001) · Journal of Interactive Marketing · doi:10.1002/dir.1011 · Cited by 88 · see citing works
MeSH Now: Automatic MeSH indexing at PubMed scale via learning to rank
Mao, Y., & Lu, Z. (2017) · Journal of Biomedical Semantics · doi:10.1186/s13326-017-0123-3 · Cited by 87 · see citing works
Self-citationAn empirical study of tokenization strategies for biomedical information retrieval
Jiang, J., & Zhai, C. (2007) · Information Retrieval · doi:10.1007/s10791-007-9027-7 · Cited by 78 · see citing works
Hersh, W. (2008) · Computers in health care · doi:10.1007/978-0-387-78703-9 · Cited by 75 · see citing works
A machine learning approach for improved BM25 retrieval
Svore, K. M., & Burges, C. J. C. (2009) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/1645953.1646237 · Cited by 66 · see citing works
Two-Stage Learning to Rank for Information Retrieval
Dang, V., Bendersky, M., & Croft, W. B. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-36973-5_36 · Cited by 64 · see citing works
Agrawal, R., Halverson, A., Kenthapadi, K., Mishra, N., & Tsaparas, P. (2009) · ACM International Conference on Web Search and Data Mining (WSDM) · doi:10.1145/1498759.1498824 · Cited by 62 · see citing works
Kim, S., Fiorini, N., Wilbur, W. J., & Lu, Z. (2017) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2017.09.014 · Cited by 58 · see citing works
Self-citationDeep Learning for Information Retrieval
Li, H., & Lu, Z. (2016) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/2911451.2914800 · Cited by 57 · see citing works
Self-citationEvaluating Relevance Ranking Strategies for MEDLINE Retrieval
Lu, Z., Kim, W., & Wilbur, W. J. (2008) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m2935 · Cited by 51 · see citing works
Self-citationSvore, K. M., Kanani, P. H., & Khan, N. (2010) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/1835449.1835477 · Cited by 47 · see citing works
Chen, J., Guo, M., Li, S., & Liu, B. (2017) · Bioinformatics · doi:10.1093/bioinformatics/btx429 · Cited by 38 · see citing works
Deep Learning for Biomedical Information Retrieval: Learning Textual Relevance from Click Logs
Mohan, S., Fiorini, N., Kim, S., & Lu, Z. (2017) · doi:10.18653/v1/w17-2328 · Cited by 37 · see citing works
Self-citationLarge-Scale Learning to Rank Using Boosted Decision Trees
Svore, K. M., & Burges, C. J. C. (2011) · Cambridge University Press eBooks · doi:10.1017/cbo9781139042918.009 · Cited by 26 · see citing works
A survey on Learning to Rank (LETOR) approaches in information retrieval
Phophalia, A. (2011) · Nirma University International Conference on Engineering · doi:10.1109/nuicone.2011.6153228 · Cited by 17 · see citing works
Position-Aware Representations for Relevance Matching in Neural Information Retrieval
Hui, K., Yates, A., Berberich, K., & de Melo, G. (2017) · International World Wide Web Conference (WWW) · doi:10.1145/3041021.3054258 · Cited by 15 · see citing works
Learning to rank-based gene summary extraction
Shang, Y., Hao, H., Wu, J., & Lin, H. (2014) · BMC Bioinformatics · doi:10.1186/1471-2105-15-s12-s10 · Cited by 10 · see citing works
A Field Sensor: computing the composition and intent of PubMed queries
Yeganova, L. E., Kim, W. B., Comeau, D. C., Wilbur, W. J., & Lu, Z. (2018) · Database · doi:10.1093/database/bay052 · Cited by 6 · see citing works
Self-citationETH Zurich at TREC Clinical Decision Support 2016.
Greuter, S., Junker, P., Kuhn, L., Mance, F., Mermet, V., Rellstab, A., & Eickhoff, C. (2016) · Text REtrieval Conference · Cited by 4 · see citing works
WaterlooClarke: TREC 2015 Clinical Decision Support Track
Ghenai, A., Khalilov, E., Valov, P., & Clarke, C. L. A. (2015) · Text REtrieval Conference · Cited by 3 · see citing works
Learning to rank for biomedical information retrieval
Xu, B., Lin, H., Lin, Y., Ma, Y., Yang, L., Wang, J., & Yang, Z. (2015) · IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm.2015.7359729 · Cited by 3 · see citing works
A Generative Model for Generating Relevance Labels from Human Judgments and Click-Logs
Ye, X., Li, J., Qi, Z., Peng, B., & Massey, D. (2014) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/2661829.2661897 · Cited by 2 · see citing works
Flagged first, then by citations
1 of the 42 references couldn’t be matched to a known paper.
Research works printed but not linked: 1
- [27]Li H. and Leckenby J. D. Internet advertising formats and effectiveness. Center for Interactive Advertising, pages 1– 31, 2004.
Cited by
Sorted by citations
Database resources of the National Center for Biotechnology Information: update
Wheeler, D. L. (2003) · Nucleic Acids Research · doi:10.1093/nar/gkh073 · Cited by 10,691 · see citing works
Database resources of the national center for biotechnology information
Sayers, E. W., Bolton, E. E., Brister, J. R., Canese, K., Chan, J., Comeau, D. C., Connor, R., Funk, K., Kelly, C., Kim, S., et al. (2022) · Nucleic Acids Research · doi:10.1093/nar/gkab1112 · Cited by 2,812 · see citing works
Self-citationDatabase resources of the National Center for Biotechnology Information
Sayers, E. W., Beck, J. D., Bolton, E., Bourexis, D., Brister, J. R., Canese, K., Comeau, D. C., Funk, K., Kim, S., Klimke, W. A., et al. (2020) · Nucleic Acids Research · doi:10.1093/nar/gkaa892 · Cited by 960 · see citing works
Self-citationDatabase resources of the National Center for Biotechnology Information
Sayers, E. W., Agarwala, R., Bolton, E., Brister, J. R., Canese, K., Clark, K., Connor, R. P., Fiorini, N., Funk, K., Hefferon, T. W., et al. (2018) · Nucleic Acids Research · doi:10.1093/nar/gky1069 · Cited by 560 · see citing works
Self-citationDatabase resources of the National Center for Biotechnology Information in 2023
Sayers, E. W., Bolton, E., Brister, J. R., Canese, K., Chan, J., Comeau, D. C., Farrell, C. M., Feldgarden, M., Fine, A. M., Funk, K., et al. (2022) · Nucleic Acids Research · doi:10.1093/nar/gkac1032 · Cited by 436 · see citing works
Self-citationDatabase resources of the National Center for Biotechnology Information
Sayers, E. W., Beck, J. D., Brister, J. R., Bolton, E., Canese, K., Comeau, D. C., Funk, K., Ketter, A., Kim, S., Kimchi, A., et al. (2019) · Nucleic Acids Research · doi:10.1093/nar/gkz899 · Cited by 412 · see citing works
Self-citationDatabase resources of the National Center for Biotechnology Information
Sayers, E. W., Beck, J. D., Bolton, E., Brister, J. R., Chan, J., Comeau, D. C., Connor, R. P., DiCuccio, M. N., Farrell, C. M., Feldgarden, M., et al. (2023) · Nucleic Acids Research · doi:10.1093/nar/gkad1044 · Cited by 383 · see citing works
Self-citationKhraisha, Q., Put, S., Kappenberg, J., Warraitch, A., & Hadfield, K. (2024) · Research Synthesis Methods · doi:10.1002/jrsm.1715 · Cited by 269 · see citing works
Khraisha, Q., Put, S., Kappenberg, J., Warraitch, A., & Hadfield, K. (2023) · arXiv · doi:10.48550/arxiv.2310.17526 · Cited by 268 · see citing works
LitCovid: an open database of COVID-19 literature
Chen, Q., Allot, A., & Lu, Z. (2021) · Nucleic Acids Research · doi:10.1093/nar/gkaa952 · Cited by 253 · see citing works
Self-citationJin, Q., Kim, W., Chen, Q., Comeau, D. C., Yeganova, L., Wilbur, W. J., & Lu, Z. (2023) · Bioinformatics · doi:10.1093/bioinformatics/btad651 · Cited by 175 · see citing works
Self-citationPubMed and beyond: biomedical literature search in the age of artificial intelligence
Jin, Q., Leaman, R., & Lu, Z. (2024) · EBioMedicine · doi:10.1016/j.ebiom.2024.104988 · Cited by 140 · see citing works
Self-citationDefining Aging in Place: The Intersectionality of Space, Person, and Time
Rogers, W. A., Ramadhani, W., & Harris, M. T. (2020) · Innovation in Aging · doi:10.1093/geroni/igaa036 · Cited by 119 · see citing works
Cho, S., Ensari, I., Weng, C., Kahn, M. G., & Natarajan, K. (2021) · JMIR mhealth and uhealth · doi:10.2196/20738 · Cited by 110 · see citing works
(2024) · ACM eBooks · doi:10.1145/3674127 · Cited by 82 · see citing works
Artificial Intelligence in Action: Addressing the COVID-19 Pandemic with Natural Language Processing
Chen, Q., Leaman, R., Allot, A., Luo, L., Wei, C.-H., Yan, S., & Lu, Z. (2021) · Annual Review of Biomedical Data Science · doi:10.1146/annurev-biodatasci-021821-061045 · Cited by 75 · see citing works
Self-citationHow user intelligence is improving PubMed
Fiorini, N., Leaman, R., Lipman, D. J., & Lu, Z. (2018) · Nature Biotechnology · doi:10.1038/nbt.4267 · Cited by 74 · see citing works
Self-citationLi, Y., Datta, S., Rastegar-Mojarad, M., Lee, K., Paek, H., Glasgow, J., Liston, C., He, L., Wang, X., & Xu, Y. (2025) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocaf030 · Cited by 69 · see citing works
Exploring semi-supervised variational autoencoders for biomedical relation extraction
Zhang, Y., & Lu, Z. (2019) · Methods · doi:10.1016/j.ymeth.2019.02.021 · Cited by 66 · see citing works
Self-citationSMAC, a computational system to link literature, biomedical and expression data
Pirro, S., Gadaleta, E., Galgani, A., Colizzi, V., & Chelala, C. (2019) · Scientific Reports · doi:10.1038/s41598-019-47046-2 · Cited by 65 · see citing works
Using the contextual language model BERT for multi-criteria classification of scientific articles
Ambalavanan, A. K., & Devarakonda, M. V. (2020) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2020.103578 · Cited by 56 · see citing works
LitSense: making sense of biomedical literature at sentence level
Allot, A., Chen, Q., Kim, S., Alvarez, R. V., Comeau, D. C., Wilbur, W. J., & Lu, Z. (2019) · Nucleic Acids Research · doi:10.1093/nar/gkz289 · Cited by 55 · see citing works
Self-citationDISNET: a framework for extracting phenotypic disease information from public sources
García, G. L., Rodríguez‐González, A., Santamaría, L. P., del Valle, E. P. G., Zanin, M., & Menasalvas, E. (2020) · PeerJ · doi:10.7717/peerj.8580 · Cited by 44 · see citing works
A Systematic Review of Fairness, Accountability, Transparency, and Ethics in Information Retrieval
Bernard, N., & Balog, K. (2023) · ACM Computing Surveys · doi:10.1145/3637211 · Cited by 43 · see citing works
Advancing Chinese biomedical text mining with community challenges
Zong, H., Wu, R., Cha, J., Feng, W., Wu, E., Li, J., Shao, A., Tao, L., Li, Z., Tang, B., et al. (2024) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2024.104716 · Cited by 42 · see citing works
Brown, P., Tan, A.-C., El-Esawi, M. A., Liehr, T., Blanck, O., Gladue, D. P., Almeida, G. M. D. F., Cernava, T., Sorzano, C. Ó. S., Yeung, A. W. K., et al. (2019) · Database · doi:10.1093/database/baz085 · Cited by 42 · see citing works
Information Retrieval and Knowledge Organization: A Perspective from the Philosophy of Science
Hjørland, B. (2021) · Information · doi:10.3390/info12030135 · Cited by 42 · see citing works
Applications of natural language processing in ophthalmology: present and future
Chen, J., & Baxter, S. L. (2022) · Frontiers in Medicine · doi:10.3389/fmed.2022.906554 · Cited by 40 · see citing works
Artificial intelligence behind the scenes: PubMed’s Best Match algorithm
Kiester, L., & Turp, C. (2022) · Journal of the Medical Library Association JMLA · doi:10.5195/jmla.2022.1236 · Cited by 36 · see citing works
Bermejo‐Pareja, F., & del Ser, T. (2024) · Journal of Clinical Medicine · doi:10.3390/jcm13020536 · Cited by 35 · see citing works
PPFIA4 Promotes Colon Cancer Cell Proliferation and Migration by Enhancing Tumor Glycolysis
Huang, J., Yang, M., Liu, Z., Li, X., Wang, J., Fu, N., Cao, T., & Yang, X. (2021) · Frontiers in Oncology · doi:10.3389/fonc.2021.653200 · Cited by 32 · see citing works
Biomedical event extraction with a novel combination strategy based on hybrid deep neural networks
Zhu, L., & Zheng, H. (2020) · BMC Bioinformatics · doi:10.1186/s12859-020-3376-2 · Cited by 31 · see citing works
Biomedical Relation Extraction With Knowledge Graph-Based Recommendations
Sousa, D., & Couto, F. M. (2022) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2022.3173558 · Cited by 31 · see citing works
MedAide: Information fusion and anatomy of medical intents via LLM-based agent collaboration
Yang, D., Wei, J., Li, M., Liu, J., Liu, L., Hu, M., He, J., Ju, Y., Zhou, W., Liu, Y., et al. (2025) · Information Fusion · doi:10.1016/j.inffus.2025.103743 · Cited by 28 · see citing works
PubMed Labs: an experimental system for improving biomedical literature search
Fiorini, N., Canese, K., Bryzgunov, R., Radetska, I., Gindulytė, A., Latterner, M., Miller, V., Osipov, M., Kholodov, M., Starchenko, G., et al. (2018) · Database · doi:10.1093/database/bay094 · Cited by 28 · see citing works
Self-citationLazarus, J. V., Palayew, A., Rasmussen, L. N., Andersen, T. H., Nicholson, J., & Norgaard, O. (2020) · Journal of Medical Internet Research · doi:10.2196/23449 · Cited by 25 · see citing works
Morshed, T., & Hayden, S. R. (2019) · Annals of Emergency Medicine · doi:10.1016/j.annemergmed.2019.07.003 · Cited by 24 · see citing works
Adam, G. P., DeYoung, J., Paul, A., Saldanha, I. J., Balk, E. M., Trikalinos, T. A., & Wallace, B. (2024) · JAMIA Open · doi:10.1093/jamiaopen/ooae098 · Cited by 21 · see citing works
Gobeill, J., Caucheteur, D., Michel, P.-A., Mottin, L., Pasche, E., & Ruch, P. (2020) · Nucleic Acids Research · doi:10.1093/nar/gkaa328 · Cited by 20 · see citing works
Supporting Scholarly Search by Query Expansion and Citation Analysis
Khalid, S., & Wu, S. (2020) · Engineering Technology & Applied Science Research · doi:10.48084/etasr.3655 · Cited by 19 · see citing works
Navigation-based candidate expansion and pretrained language models for citation recommendation
Nogueira, R. F., Jiang, Z., Cho, K., & Lin, J. (2020) · Scientometrics · doi:10.1007/s11192-020-03718-9 · Cited by 19 · see citing works
Literature Review of COVID-19, Pulmonary and Extrapulmonary Disease
Yazdanpanah, F., Garg, A., Shadman, S., & Asmarz, H. Y. (2021) · The American Journal of the Medical Sciences · doi:10.1016/j.amjms.2021.01.023 · Cited by 17 · see citing works
Generating Biomedical Question Answering Corpora From Q&A Forums
Lamúrias, A., Sousa, D., & Couto, F. M. (2020) · IEEE Access · doi:10.1109/access.2020.3020868 · Cited by 16 · see citing works
Problem gambling during Covid-19
Frisone, F., Alibrandi, A., & Settineri, S. (2020) · Mediterranean Journal of Clinical Psychology · doi:10.6092/2282-1619/mjcp-2457 · Cited by 15 · see citing works
Systematic review of flaxseed (Linum usitatissimum L.) extract and formulation in wound healing
Sharil, A. T. M., Ezzat, M. B., Widya, L., Nurhakim, M. H. A., Hikmah, A. R. N., Zafira, Z. N., & Haris, M. S. (2022) · Journal of Pharmacy & Pharmacognosy Research · doi:10.56499/jppres21.1125_10.1.1 · Cited by 15 · see citing works
Hersh, W. (2021) · Springer eBooks · doi:10.1007/978-3-030-58721-5_23 · Cited by 14 · see citing works
Zhao, S., Su, C., Sboner, A., & Wang, F. (2019) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3357384.3358038 · Cited by 14 · see citing works
Leaman, R., Wei, C.-H., Allot, A., & Lu, Z. (2020) · PLoS Biology · doi:10.1371/journal.pbio.3000716 · Cited by 14 · see citing works
Self-citationDo it faster with PICOS: Generative AI-Assisted systematic review screening
Vallamchetla, S. K., Abdelkader, O., Elnaggar, A., Ramadan, D., Islam Shourav, M. M., Riaz, I. B., & Lin, M. P. (2025) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2025.104860 · Cited by 13 · see citing works
Comprehensive review of academic search systems: evolution, analysis, and future research directions
Khalid, S., Almutairi, S. S., Namoun, A., Khan, J., Khattak, H. A., & Shah, H. (2025) · Social Network Analysis and Mining · doi:10.1007/s13278-025-01476-1 · Cited by 13 · see citing works
Scells, H., Zuccon, G., & Koopman, B. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-45439-5_27 · Cited by 13 · see citing works
Lee, J.-C., Lee, B. J., Park, C., Song, H., Ock, C., Sung, H., Woo, S., Youn, Y., Jung, K., Jung, J. H., et al. (2023) · PLoS ONE · doi:10.1371/journal.pone.0281422 · Cited by 13 · see citing works
Discovering novel disease comorbidities using electronic medical records
Chaganti, S., Welty, V. F., Taylor, W. D., Albert, K. M., Failla, M. D., Cascio, C. J., Smith, S. A., Mawn, L. A., Resnick, S. M., Beason‐Held, L. L., et al. (2019) · PLoS ONE · doi:10.1371/journal.pone.0225495 · Cited by 13 · see citing works
The Central Metabolism Model of Anopheles gambiae: A Tool for Understanding Malaria Vector Biology
Adedeji, E. O., Ogunlana, O. O., Fatumo, S., Aromolaran, O., Beder, T., Koenig, R., & Adebiyi, E. F. (2023) · Springer eBooks · doi:10.1007/978-3-031-33370-5_16 · Cited by 12 · see citing works
Gatekeeping should be conserved in the open science era
Desmond, H. (2024) · Synthese · doi:10.1007/s11229-024-04559-2 · Cited by 12 · see citing works
Better synonyms for enriching biomedical search
Yeganova, L. E., Kim, S., Chen, Q., Balasanov, G., Wilbur, W. J., & Lu, Z. (2020) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocaa151 · Cited by 12 · see citing works
Self-citationKlopfenstein, D. V., & Dampier, W. (2020) · Research Synthesis Methods · doi:10.1002/jrsm.1456 · Cited by 10 · see citing works
Towards a unified search: Improving PubMed retrieval with full text
Kim, W. B., Yeganova, L. E., Comeau, D. C., Wilbur, W. J., & Lu, Z. (2022) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2022.104211 · Cited by 10 · see citing works
Self-citationLADER: Log-Augmented DEnse Retrieval for Biomedical Literature Search
Jin, Q., Shin, A., & Lu, Z. (2023) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3539618.3592005 · Cited by 10 · see citing works
Self-citationThe Weight of Surgical Knowledge
Choi, J., Stave, C. D., & Spain, D. A. (2021) · Annals of Surgery · doi:10.1097/sla.0000000000005365 · Cited by 10 · see citing works
Risk factors for surgical site infections using a data-driven approach
van Niekerk, J. M., Vos, M. D., Stein, A., Braakman‐Jansen, L. M. A., holt, A. F. V. I. ’., & van Gemert‐Pijnen, J. E. W. C. (2020) · PLoS ONE · doi:10.1371/journal.pone.0240995 · Cited by 10 · see citing works
Castells, P., & Jannach, D. (2024) · ACM eBooks · doi:10.1145/3674127.3674131 · Cited by 9 · see citing works
Shiferaw, K. B., Waltemath, D., & Zeleke, A. A. (2022) · Studies in health technology and informatics · doi:10.3233/shti220541 · Cited by 9 · see citing works
The Governance of Core Competencies for Public Health: A Rapid Review of the Literature
Sandhu, H. S., Otterman, V., Tjaden, L., Shephard, R., Apatu, E., Ruggiero, E. D., Musto, R., Pawa, J., Steinberg, M., & Betker, C. (2023) · Public health reviews · doi:10.3389/phrs.2023.1606110 · Cited by 9 · see citing works
Rhatomy, S., Rasyid, F. A., & Phatama, K. Y. (2020) · Annals of Medicine and Surgery · doi:10.1016/j.amsu.2020.06.001 · Cited by 9 · see citing works
Reporting quality of meta-analyses in acupuncture: Investigating adherence to the PRISMA statement
Chu, Q., Ma, H., Mandizadza, O. O., Xu, X., & Ji, C. (2024) · Medicine · doi:10.1097/md.0000000000039933 · Cited by 8 · see citing works
Ranking ‘by Relevance’ in Academic Literature Searches: Prevalence, Definitions, and Implications
Jordan, K., & Tsai, S. P. (2024) · Postdigital Science and Education · doi:10.1007/s42438-024-00530-z · Cited by 8 · see citing works
ARtPM: Article Retrieval for Precision Medicine
Milliken, L. K., Motomarry, S. K., & Kulkarni, A. (2019) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2019.103224 · Cited by 8 · see citing works
A relevance and quality-based ranking algorithm applied to evidence-based medicine
Serrano‐Guerrero, J., Romero, F. P., & Olivas, J. Á. (2020) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2020.105415 · Cited by 8 · see citing works
Research note. Open letter to the users of the new PubMed: a critical appraisal
García‐Puente, M., Pastor-Ramón, E., Agirre, O., Morán, J. M., & Herrera‐Peco, I. (2020) · El Profesional de la Informacion · doi:10.3145/epi.2020.may.36 · Cited by 8 · see citing works
Yeganova, L. E., Kim, W. B., Tian, S., Comeau, D. C., Wilbur, W. J., & Lu, Z. (2025) · Nucleic Acids Research · doi:10.1093/nar/gkaf417 · Cited by 7 · see citing works
Self-citationChen, H., Zhao, J., Zheng, S., Zhang, X., Duan, H., & Lü, X. (2025) · BMC Medical Research Methodology · doi:10.1186/s12874-025-02674-3 · Cited by 7 · see citing works
Stenzl, A., Armstrong, A. J., Sboner, A., Ghith, J., Serfass, L., Bland, C. S., Schijvenaars, B. J. A., & Sternberg, C. N. (2024) · European Urology Focus · doi:10.1016/j.euf.2024.05.022 · Cited by 7 · see citing works
Ebeid, I. A. (2022) · Frontiers in Big Data · doi:10.3389/fdata.2022.965619 · Cited by 7 · see citing works
Sampson, M., Nama, N., O’Hearn, K., Murto, K., Nasr, A., Katz, S. L., Macartney, G. M., Momoli, F., & McNally, J. D. (2020) · International Journal of Technology Assessment in Health Care · doi:10.1017/s0266462320002159 · Cited by 7 · see citing works
Evaluating pretrained transformer models for citation recommendation
Nogueira, R. F., Jiang, Z., Cho, K., & Lin, J. (2020) · Cited by 6 · see citing works
BEEDS: Large-Scale Biomedical Event Extraction using Distant Supervision and Question Answering
Wang, X. D., Leser, U., & Weber, L. (2022) · Workshop on Biomedical Language Processing (BioNLP) · doi:10.18653/v1/2022.bionlp-1.28 · Cited by 6 · see citing works
Tian, S., Chen, Q., Comeau, D. C., Wilbur, W. J., & Lu, Z. (2024) · Bioinformatics · doi:10.1093/bioinformatics/btae672 · Cited by 5 · see citing works
Self-citationBentegeac, R., Guellec, B. L., Leblanc, V., Lenain, R., Dauchet, L., Gauthier, V., Gerard, E., Chazard, E., Amouyel, P., Aymes, E., et al. (2026) · Research Synthesis Methods · doi:10.1017/rsm.2026.10079 · Cited by 5 · see citing works
High-precision information retrieval for rapid clinical guideline updates
Borchert, F., Wullenweber, P., Oeser, A., Kreuzberger, N., Karge, T., Langer, T. G., Skoetz, N., Wieler, L. H., Schapranow, M.-P., & Bert Arnrich, A. (2025) · npj Digital Medicine · doi:10.1038/s41746-025-01648-5 · Cited by 5 · see citing works
Rashed, W. M., Adel, F., Rezk, M. A., Basiouny, L., Rezk, A. A., & Abdel-Razek, A. H. (2022) · Database · doi:10.1093/database/baac013 · Cited by 5 · see citing works
Biomedical Text Mining: Biocuration and Literature Search Engines
Acharya, K. K., Sravanthi, D., Moushumi, G., Kitchlu, A., Bindurani, B., Manchigegowda, S. B., Akhilesh, B., & Divya, D. (2024) · Elsevier eBooks · doi:10.1016/b978-0-323-95502-7.00101-9 · Cited by 5 · see citing works
Inferring Drug–Gene Relationships in Cancer Using Literature-Augmented Large Language Models
Lai, Y.-J., Wang, L.-J., Yasaka, T. M., Shin, Y., Ning, M., Tan, Y., Shih, C.-H., Guo, Y., Chen, P.-Y., Galloway, H., et al. (2025) · Cancer Research Communications · doi:10.1158/2767-9764.crc-25-0030 · Cited by 4 · see citing works
Trippas, J. R. (2024) · ACM eBooks · doi:10.1145/3674127.3674135 · Cited by 4 · see citing works
Ciulla, M. M., & Vivona, P. (2019) · PeerJ · doi:10.7717/peerj.6363 · Cited by 4 · see citing works
Unbalanced Multistage Heat Conduction and Mass Diffusion Algorithm in an Educational Digital Library
Yin, P., Wang, G., Bhuiyan, M. Z. A., Shan, M., & Qi, F. (2019) · IEEE Access · doi:10.1109/access.2019.2946262 · Cited by 4 · see citing works
Knowledge-based framework for estimating the relevance of scientific articles
Fernández-Isabel, A., Barriuso, A. A., Cabezas, J., de Diego, I. M., & Pinheiro, J. F. J. V. (2020) · Expert Systems with Applications · doi:10.1016/j.eswa.2020.113692 · Cited by 4 · see citing works
History of Mastoidectomy: PubMed, Best Matches, Secondary References, and Inaccuracies
Mudry, A. C. (2020) · Otology & Neurotology · doi:10.1097/mao.0000000000002802 · Cited by 4 · see citing works
Yeganova, L. E., Kim, W. G., Comeau, D. C., Wilbur, W. J., & Lu, Z. (2021) · Workshop on Biomedical Language Processing (BioNLP) · doi:10.18653/v1/2021.bionlp-1.27 · Cited by 4 · see citing works
Self-citationDesigning Formulae for Ranking Search Results: Mixed Methods Evaluation Study
Douze, L., Sylvia Pelayo, A., Messaadi, N., Julien Grosjean, A., Kerdelhué, G., & Marcilly, R. (2022) · JMIR Human Factors · doi:10.2196/30258 · Cited by 4 · see citing works
Graph-Enriched Biomedical Entity Representation Transformer
Sakhovskiy, A., Semenova, N., Kadurin, A., & Tutubalina, E. V. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-42448-9_10 · Cited by 4 · see citing works
Holtzapple, E., Cochran, B., & Miškov-Živanov, N. (2021) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2021.07.04.451062 · Cited by 4 · see citing works
Turki, H., Chebil, K., Dossou, B. F. P., Emezue, C. C., Owodunni, A. T., Taieb, M. A. H., & Aouicha, M. B. (2024) · Heliyon · doi:10.1016/j.heliyon.2024.e38448 · Cited by 3 · see citing works
Causes of Irregular Expenditure in KwaZulu-Natal Municipalities: Perspectives of Councillors
Zungu, A., Sibanda, M., & Nomlala, B. C. (2025) · International Journal of Applied Research in Business and Management · doi:10.51137/wrp.ijarbm.2025.azcb.45697 · Cited by 3 · see citing works
Lim, Z. W., & Meade, M. J. (2025) · Seminars in Orthodontics · doi:10.1053/j.sodo.2025.04.002 · Cited by 3 · see citing works
Suda-King, C., Winch, L., Tucker, J. M., Zuehlke, A. D., Hunter, C. M., & Simmons, J. M. (2024) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocae191 · Cited by 3 · see citing works
Song, C., Zeng, Z., Tian, C., Li, K., Yao, Y., Zheng, S., Liu, Z., & Sun, M. (2024) · AI Open · doi:10.1016/j.aiopen.2024.08.002 · Cited by 3 · see citing works
Turki, H., Dossou, B. F. P., Emezue, C. C., Owodunni, A. T., Taieb, M. A. H., Aouicha, M. B., Hassen, H. B., & Masmoudi, A. (2024) · Journal of Biomedical Semantics · doi:10.1186/s13326-024-00319-w · Cited by 3 · see citing works
A context-enhanced neural network model for biomedical event trigger detection
Wang, Z., Ren, Y., Peng, Q., & Ji, D. (2024) · Information Sciences · doi:10.1016/j.ins.2024.121625 · Cited by 3 · see citing works
- Authors
- Fiorini, N., Canese, K., Starchenko, G., Kireev, E., Kim, W., Miller, V., Osipov, M., Kholodov, M., Ismagilov, R., Mohan, S., Ostell, J., & Lu, Z.
- Affiliations
- National Institutes of Health (US)
- Corresponding author
- Lu, Zhiyong
- Venue
- PLOS Biology
- Publisher
- Public Library of Science (PLoS)
- Published
- 2018-08-28
- Volume
- 16
- Issue
- 8
- Pages
- e2005343
- ISSN
- 1544-9173 (ISSN-L)
- 1545-7885
- PMC
- PMC6112631
- OpenAlex
- W2889414415
- Cited by
- 175
- References
- 42
- Citations by year
- 2026: 11 · 2025: 16 · 2024: 42 · 2023: 14 · 2022: 19 · 2021: 19 · 2020: 32 · 2019: 18 · 2018: 3
- FWCI
- 27.77
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- public-domain
- creativecommons.org/publicdomain/zero/1.0/ (vor)
- Locations
- PLoS Biology (publishedVersion, public-domain)
- Europe PMC (PubMed Central) (publishedVersion, public-domain)
- PubMed Central (publishedVersion, public-domain)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Figshare (submittedVersion, cc-by)
- Topics
- Physical Sciences › Computer Science › Information Systems › Information Retrieval and Search Behavior
- Physical Sciences › Computer Science › Information Systems › Recommender Systems and Techniques
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › scientometrics and bibliometrics research
- Keywords
- PubMed, relevance ranking, biomedical literature retrieval, search result sorting, user search behavior, click-through rate
- MeSH terms
- Machine Learning, Algorithms, Humans, Publications, MEDLINE, Information Storage and Retrieval, PubMed, Data Mining, Search Engine
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review