The DOI matches its Crossref record; 56 of the 56 references it cites were found in a registry or an index.
PubMed and beyond: a survey of web tools for searching biomedical literature
Open accessAbstract
The past decade has witnessed the modern advances of high-throughput technology and rapid growth of research capacity in producing large-scale biological data, both of which were concomitant with an exponential growth of biomedical literature. This wealth of scholarly knowledge is of significant importance for researchers in making scientific discoveries and healthcare professionals in managing health-related matters. However, the acquisition of such information is becoming increasingly difficult due to its large volume and rapid growth. In response, the National Center for Biotechnology Information (NCBI) is continuously making changes to its PubMed Web service for improvement. Meanwhile, different entities have devoted themselves to developing Web tools for helping users quickly and efficiently search and retrieve relevant publications. These practices, together with maturity in the field of text mining, have led to an increase in the number and quality of various Web tools that provide comparable literature search service to PubMed. In this study, we review 28 such tools, highlight their respective innovations, compare them to the PubMed system and one another, and discuss directions for future development. Furthermore, we have built a website dedicated to tracking existing systems and future advances in the field of biomedical literature search. Taken together, our work serves information seekers in choosing tools for their needs and service providers and developers in keeping current in the field. Database URL: http://www.ncbi.nlm.nih.gov/CBBresearch/Lu/search.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Database resources of the National Center for Biotechnology Information: update
Wheeler, D. L. (2004) · Nucleic Acids Research · doi:10.1093/nar/gkh073 · Cited by 10,641
Optimizing search engines using clickthrough data
Joachims, T. (2002) · Proceedings of the eighth ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/775047.775067 · Cited by 3,873
Utilization of the PICO framework to improve searching PubMed for clinical questions
Schardt, C., Adams, M. B., Owens, T., Keitz, S., & Fontelo, P. (2007) · BMC Medical Informatics and Decision Making · doi:10.1186/1472-6947-7-16 · Cited by 3,053
Robertson, S. E., Walker, S., Jones, S., Hancock‐Beaulieu, M., & Gatford, M. (1994) · Text REtrieval Conference · Cited by 2,212
Developing a Test Collection for the Evaluation of Integrated Search
Lykke, M., Larsen, B., Lund, H., & Ingwersen, P. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-12275-0_63 · Cited by 969
Database resources of the National Center for Biotechnology Information
Sayers, E. W., Barrett, T., Benson, D. A., Bolton, E., Bryant, S. H., Canese, K., Chetvernin, V., Church, D. M., DiCuccio, M., Federhen, S., et al. (2010) · Nucleic Acids Research · doi:10.1093/nar/gkp967 · Cited by 804
Self-citationLiterature mining for the biologist: from information retrieval to biological discovery
Jensen, L. J., Saric, J., & Bork, P. (2006) · Nature Reviews Genetics · doi:10.1038/nrg1768 · Cited by 631
GoPubMed: exploring PubMed with the Gene Ontology
Doms, A., & Schroeder, M. (2005) · Nucleic Acids Research · doi:10.1093/nar/gki470 · Cited by 549
Content-rich biological network constructed by mining PubMed abstracts
Chen, H., & Sharp, B. M. (2004) · BMC Bioinformatics · doi:10.1186/1471-2105-5-147 · Cited by 345
Overview of BioCreative II gene normalization
Morgan, A. A., Lu, Z., Wang, X., Cohen, A. M., Fluck, J., Ruch, P., Divoli, A., Fundel, K., Leaman, R., Hakenberg, J., et al. (2008) · Genome Biology · doi:10.1186/gb-2008-9-s2-s3 · Cited by 327
Self-citationBiomedical Language Processing: What's Beyond PubMed?
Hunter, L., & Cohen, K. B. (2006) · Molecular Cell · doi:10.1016/j.molcel.2006.02.012 · Cited by 308
Overview of the protein-protein interaction annotation extraction task of BioCreative II
Krallinger, M., Leitner, F., Rodriguez-Penagos, C., & Valencia, A. (2008) · Genome Biology · doi:10.1186/gb-2008-9-s2-s4 · Cited by 298
Author name disambiguation in MEDLINE
Torvik, V. I., & Smalheiser, N. R. (2009) · ACM Transactions on Knowledge Discovery from Data · doi:10.1145/1552303.1552304 · Cited by 285
Understanding PubMed(R) user search behavior through log analysis
Islamaj Dogan, R., Murray, G. C., Neveol, A., & Lu, Z. (2009) · Database · doi:10.1093/database/bap018 · Cited by 265
Self-citationCheng, D., Knox, C., Young, N., Stothard, P., Damaraju, S., & Wishart, D. S. (2008) · Nucleic Acids Research · doi:10.1093/nar/gkn296 · Cited by 254
Tanabe, L., Scherf, U., Smith, L. H., Lee, J. K., Hunter, L., & Weinstein, J. N. (1999) · BioTechniques · doi:10.2144/99276bc03 · Cited by 251
PubMed related articles: a probabilistic topic-based model for content similarity
Lin, J., & Wilbur, W. J. (2007) · BMC Bioinformatics · doi:10.1186/1471-2105-8-423 · Cited by 243
Krallinger, M., Valencia, A., & Hirschman, L. (2008) · Genome Biology · doi:10.1186/gb-2008-9-s2-s8 · Cited by 231
Getting Started in Text Mining
Cohen, K. B., & Hunter, L. (2008) · PLoS Computational Biology · doi:10.1371/journal.pcbi.0040020 · Cited by 230
EBIMed—text crunching to gather facts for proteins from Medline
Rebholz-Schuhmann, D., Kirsch, H., Arregui, M., Gaudan, S., Riethoven, M., & Stoehr, P. (2007) · Bioinformatics · doi:10.1093/bioinformatics/btl302 · Cited by 217
Evaluation of query expansion using MeSH in PubMed
Lu, Z., Kim, W., & Wilbur, W. J. (2009) · Information Retrieval · doi:10.1007/s10791-008-9074-8 · Cited by 177
Self-citationSiadaty, M. S., Shu, J., & Knaus, W. A. (2007) · BMC Medical Informatics and Decision Making · doi:10.1186/1472-6947-7-1 · Cited by 166
BioText Search Engine: beyond abstract search
Hearst, M. A., Divoli, A., Guturu, H., Ksikes, A., Nakov, P., Wooldridge, M. A., & Ye, J. (2007) · Bioinformatics · doi:10.1093/bioinformatics/btm301 · Cited by 153
MedlineRanker: flexible ranking of biomedical literature
Fontaine, J.-F., Barbosa-Silva, A., Schaefer, M., Huska, M. R., Muro, E. M., & Andrade-Navarro, M. A. (2009) · Nucleic Acids Research · doi:10.1093/nar/gkp353 · Cited by 147
Fernández, J. M., Hoffmann, R., & Valencia, A. (2007) · Nucleic Acids Research · doi:10.1093/nar/gkm298 · Cited by 147
Text-mining approaches in molecular biology and biomedicine
Krallinger, M., Erhardt, R. A.-A., & Valencia, A. (2005) · Drug Discovery Today · doi:10.1016/s1359-6446(05)03376-3 · Cited by 147
A li B aba : PubMed as a graph
Plake, C., Schiemann, T., Pankalla, M., Hakenberg, J., & Leser, U. (2006) · Bioinformatics · doi:10.1093/bioinformatics/btl408 · Cited by 137
Biomedical Text Mining and Its Applications
Rodriguez‐Esteban, R. (2009) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1000597 · Cited by 112
Towards Automatic Recognition of Scientifically Rigorous Clinical Research Evidence
Kilicoglu, H., Demner-Fushman, D., Rindflesch, T. C., Wilczynski, N. L., & Haynes, R. B. (2009) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m2996 · Cited by 101
The Use of Implicit Evidence for Relevance Feedback in Web Retrieval
White, R. W., Ruthven, I. G., & Jose, J. M. (2002) · Lecture notes in computer science · doi:10.1007/3-540-45886-7_7 · Cited by 101
High-performance gene name normalization with G e N o
Wermter, J., Tomanek, K., & Hahn, U. (2009) · Bioinformatics · doi:10.1093/bioinformatics/btp071 · Cited by 101
eTBLAST: a web server to identify expert reviewers, appropriate journals and similar publications
Errami, M., Wren, J. D., Hicks, J. M., & Garner, H. R. (2007) · Nucleic Acids Research · doi:10.1093/nar/gkm221 · Cited by 100
Yale Image Finder (YIF): a new search engine for retrieving biomedical images
Xu, S., McCusker, J. P., & Krauthammer, M. O. (2008) · Bioinformatics · doi:10.1093/bioinformatics/btn340 · Cited by 98
Semi-automatic semantic annotation of PubMed queries: A study on quality, efficiency, satisfaction
Névéol, A., Islamaj, R., & Lu, Z. (2010) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2010.11.001 · Cited by 93
Self-citationXplorMed: a tool for exploring MEDLINE abstracts
Perez‐Iratxeta, C., Peer Bork, B., & Andrade-Navarro, M. A. (2001) · Trends in Biochemical Sciences · doi:10.1016/s0968-0004(01)01926-0 · Cited by 76
Plikus, M. V., Zhang, Z., & Chuong, C. (2006) · BMC Bioinformatics · doi:10.1186/1471-2105-7-424 · Cited by 70
MScanner: a classifier for retrieving Medline citations
Poulter, G., Rubin, D. L., Altman, R. B., & Seoighe, C. (2008) · BMC Bioinformatics · doi:10.1186/1471-2105-9-108 · Cited by 65
Inbred strains in biomedical research
Potter, M. (1980) · Cell · doi:10.1016/0092-8674(80)90497-3 · Cited by 65
Smalheiser, N. R., Zhou, W., & Torvik, V. I. (2008) · Journal of Biomedical Discovery and Collaboration · doi:10.1186/1747-5333-3-2 · Cited by 56
PubNet: a flexible system for visualizing literature derived networks
Douglas, S. M., Montelione, G. T., & Gerstein, M. (2005) · Genome biology · doi:10.1186/gb-2005-6-9-r80 · Cited by 54
ask MEDLINE: a free-text, natural language query tool for MEDLINE/PubMed
Fontelo, P. A., Liu, F., & Ackerman, M. J. (2005) · BMC Medical Informatics and Decision Making · doi:10.1186/1472-6947-5-5 · Cited by 53
The Usefulness of Dynamically Categorizing Search Results
Pratt, W., & Fagan, L. M. (2000) · Journal of the American Medical Informatics Association · doi:10.1136/jamia.2000.0070605 · Cited by 49
Biomedical knowledge navigation by literature clustering
Yamamoto, Y., & Takagi, T. (2006) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2006.07.004 · Cited by 47
MiSearch adaptive pubMed search tool
States, D. J., Ade, A. S., Wright, Z. C., Bookvich, A. V., & Athey, B. D. (2008) · Bioinformatics · doi:10.1093/bioinformatics/btn033 · Cited by 47
Getting Started in Text Mining: Part Two
Rzhetsky, A., Seringhaus, M. R., & Gerstein, M. (2009) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1000411 · Cited by 44
PubFinder: a tool for improving retrieval rate of relevant PubMed abstracts
Goetz, T., & der Lieth, C. W. V. (2005) · Nucleic Acids Research · doi:10.1093/nar/gki429 · Cited by 44
Finding query suggestions for PubMed.
Lu, Z., Wilbur, W. J., McEntyre, J., Iskhakov, A., & Szilagyi, L. (2009) · PubMed · Cited by 39
Self-citationOhta, T., Masuda, K., Hara, T., Tsujii, J., Tsuruoka, Y., Takeuchi, J., Kim, J.-D., Miyao, Y., Yakushiji, A., YOSHIDA, K., et al. (2006) · doi:10.3115/1225403.1225408 · Cited by 36
Enabling multi-level relevance feedback on PubMed by integrating rank learning into DBMS
Yu, H., Kim, T., Oh, J., Ko, I., Kim, S., & Han, W.-S. (2010) · BMC Bioinformatics · doi:10.1186/1471-2105-11-s2-s6 · Cited by 31
BabelMeSH: development of a cross-language tool for MEDLINE/PubMed.
Liu, F., Ackerman, M., & Fontelo, P. (2006) · PubMed · Cited by 24
What's new in the library? What's new in GenBank? Let PubCrawler tell you
Hokamp, K. (1999) · Trends in Genetics · doi:10.1016/s0168-9525(99)01808-9 · Cited by 24
Introduction to special issue on learning to rank for information retrieval
Liu, T., Joachims, T., Li, H., & Zhai, C. (2009) · Information Retrieval · doi:10.1007/s10791-009-9120-1 · Cited by 14
Fattore, M., & Arrigo, P. (2005) · PubMed · Cited by 11
Rinaldi, A. C. (2010) · EMBO Reports · doi:10.1038/embor.2010.57 · Cited by 6
Clegg, A. B., & Shepherd, A. J. (2008) · Methods in molecular biology · doi:10.1007/978-1-60327-429-6_25 · Cited by 5
askMEDLINE: a report on a year-long experience.
Fontelo, P. A., Liu, F., Ackerman, M. J., Schardt, C. M., & Keitz, S. A. (2006) · Europe PMC (PubMed Central) · Cited by 4
Cited by
Deep Learning--based Text Classification: A Comprehensive Review
Minaee, S., Kalchbrenner, N., Cambria, E., Nikzad, N., Chenaghlu, M., & Gao, J. (2022) · ACM Computing Surveys · doi:10.1145/3439726 · Cited by 1,538
A survey of current trends in computational drug repositioning
Li, J., Zheng, S., Chen, B., Butte, A. J., Swamidass, S. J., & Lu, Z. (2016) · Briefings in Bioinformatics · doi:10.1093/bib/bbv020 · Cited by 555
Self-citationA Survey on Text Classification: From Traditional to Deep Learning
Li, Q., Peng, H., Li, J., Xia, C., Yang, R., Sun, L., Yu, P. S., & He, L. (2022) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3495162 · Cited by 494
DNorm: disease name normalization with pairwise learning to rank
Leaman, R., Islamaj Doğan, R., & Lu, Z. (2013) · Bioinformatics · doi:10.1093/bioinformatics/btt474 · Cited by 484
Self-citationJarada, T. N., Rokne, J. G., & Alhajj, R. (2020) · Journal of Cheminformatics · doi:10.1186/s13321-020-00450-7 · Cited by 384
Metadata
- Authors
- Lu, Z.
- Venue
- Database
- Publisher
- Oxford University Press (OUP)
- Published
- 2011-01-18
- Volume
- 2011
- Issue
- 0
- Pages
- baq036-baq036
- ISSN
- 1758-0463 (ISSN-L)
- OpenAlex
- W2162965868
- Cited by
- 571
- References
- 56
- FWCI
- 15.05
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.