The DOI matches its Crossref record; 22 of the 26 references it cites were found in a registry or an index.
Improving accuracy for identifying related PubMed queries by an integrated approach
Open accessAbstract
PubMed is the most widely used tool for searching biomedical literature online. As with many other online search tools, a user often types a series of multiple related queries before retrieving satisfactory results to fulfill a single information need. Meanwhile, it is also a common phenomenon to see a user type queries on unrelated topics in a single session. In order to study PubMed users' search strategies, it is necessary to be able to automatically separate unrelated queries and group together related queries. Here, we report a novel approach combining both lexical and contextual analyses for segmenting PubMed query sessions and identifying related queries and compare its performance with the previous approach based solely on concept mapping. We experimented with our integrated approach on sample data consisting of 1539 pairs of consecutive user queries in 351 user sessions. The prediction results of 1396 pairs agreed with the gold-standard annotations, achieving an overall accuracy of 90.7%. This demonstrates that our approach is significantly better than the previously published method. By applying this approach to a one day query log of PubMed, we found that a significant proportion of information needs involved more than one PubMed query, and that most of the consecutive queries for the same information need are lexically related. Finally, the proposed PubMed distance is shown to be an accurate and meaningful measure for determining the contextual similarity between biological terms. The integrated approach can play a critical role in handling real-world PubMed query log data as is demonstrated in our experiments.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Term weighting was shown to be a more effective strategy compared with term proximity.
“Although term weighting was shown to be a more effective strategy compared with term proximity, certain aspects of term proximity seem useful for MEDLINE retrieval.”
From Understanding PubMed(R) user search behavior through log analysis (2009) · cites this paper as [80]
The Methods and Discussion sections compare lexical and contextual analyses for identifying related PubMed queries, not term weighting and term proximity for MEDLINE retrieval. Searches for “term weighting,” “term proximity,” and their retrieval context found no passage addressing the claimed comparison; page numbers were not available in our copy. (LLM, conf=0.76)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Binary Codes capable of currecting deletions, insertions, and reversals
Levenshtein, V. I. (1965) · Soviet physics. Doklady · Cited by 10,387
The Google Similarity Distance
Cilibrasi, R., & Vitanyi, P. M. B. (2007) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2007.48 · Cited by 1,775
Analysis of a very large web search engine query log
Silverstein, C. D., Marais, H., Henzinger, M. R., & Moricz, M. (1999) · ACM SIGIR Forum · doi:10.1145/331403.331405 · Cited by 1,153
Statistical Theory and Methodology in Science and Engineering
Lloyd, E., & Brownlee, K. A. (1961) · Technometrics · doi:10.2307/1266563 · Cited by 1,046
AnO(ND) difference algorithm and its variations
Myers, E. W. (1986) · Algorithmica · doi:10.1007/bf01840446 · Cited by 936
Algorithms for approximate string matching
Ukkonen, E. (1985) · Information and Control · doi:10.1016/s0019-9958(85)80046-2 · Cited by 610
Statistical Theory and Methodology in Science and Engineering
Balaam, L. N., & Brownlee, K. A. (1966) · Biometrics · doi:10.2307/2528228 · Cited by 405
Ahrens, H. (1968) · Biometrische Zeitschrift · doi:10.1002/bimj.19680100225 · Cited by 378
Huang, C., Chien, L., & Oyang, Y. (2003) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.10256 · Cited by 243
Evaluation of query expansion using MeSH in PubMed
Lu, Z., Kim, W. K., & Wilbur, W. J. (2008) · Information Retrieval · doi:10.1007/s10791-008-9074-8 · Cited by 188
Self-citationA Day in the Life of PubMed: Analysis of a Typical Day's Query Log
Herskovic, J. R., Tanaka, L. Y., Hersh, W., & Bernstam, E. V. (2007) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m2191 · Cited by 170
Salama, N. R., Chuang, J. S., & Schekman, R. W. (1997) · Molecular Biology of the Cell · doi:10.1091/mbc.8.2.205 · Cited by 152
Using Google distance to weight approximate ontology matches
Gligorov, R., Kate, W. R. T. T., Aleksovski, Z., & van Harmelen, F. (2007) · International World Wide Web Conference (WWW) · doi:10.1145/1242572.1242676 · Cited by 127
Text mining for biology - the way forward: opinions from leading scientists
Altman, R. B., Bergman, C., Blake, J. A., Blaschke, C., Cohen, A. M., Gannon, F., Grivell, L. A., Hahn, U., Hersh, W., Hirschman, L., et al. (2008) · Genome biology · doi:10.1186/gb-2008-9-s2-s7 · Cited by 99
Analysis of the query logs of a Web site search engine
Chau, M., Fang, X., & Sheng, O. R. L. (2005) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.20210 · Cited by 99
Using association rules to discover search engines related queries
Fonseca, B. M., Golgher, P. B., de Moura, E. S., & Ziviani, N. (2004) · International Conference on Numerical Simulation of Optoelectronic Devices (NUSOD) · doi:10.1109/laweb.2003.1250284 · Cited by 91
A Membrane Protein Enriched in Endoplasmic Reticulum Exit Sites Interacts with COPII
Tang, B. L., Ong, Y. S., Huang, B., Wei, S., Wong, E. T., Qi, R. Z., Horstmann, H., & Hong, W. (2001) · Journal of Biological Chemistry · doi:10.1074/jbc.m106189200 · Cited by 78
Concept recognition for extracting protein interaction relations from biomedical text
Baumgartner, W. A., Lu, Z., Johnson, H. L., Caporaso, J. G., Paquette, J., Lindemann, A., White, E. K., Medvedeva, O., Cohen, K. B., & Hunter, L. (2008) · Genome biology · doi:10.1186/gb-2008-9-s2-s9 · Cited by 68
Self-citationTemporal analysis of a very large topically categorized Web query log
Beitzel, S. M., Jensen, E. C., Chowdhury, A., Frieder, O., & Grossman, D. A. (2006) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.20464 · Cited by 65
Entrez: Making use of its power
Geer, R. C. (2003) · Briefings in Bioinformatics · doi:10.1093/bib/4.2.179 · Cited by 45
Shi, X., & Yang, C. C. (2007) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.20632 · Cited by 29
(2001) · doi:10.1002/pds.4850 · Cited by 7
Flagged first, then by citations
4 of the 26 references couldn’t be matched to a known paper.
Research works printed but not linked: 2
- He D, Göker A. Detecting session boundaries from web user logs. In: Proceedings of the BCS-IRSG 22nd annual colloquium on information retrieval research, 2000.
- Hersh W, Bhupatiraju RT. TREC genomics track overview. In: Proceedings of the twelfth text retrieval conference (TREC 2003), 2003. · DOI
Cited by
Sorted by citations
Understanding PubMed(R) user search behavior through log analysis
Islamaj Dogan, R., Murray, G. C., Neveol, A., & Lu, Z. (2009) · Database · doi:10.1093/database/bap018 · Cited by 265
Self-citationKurata, K., Morioka, T., Yokoi, K., & Matsubayashi, M. (2013) · PLoS ONE · doi:10.1371/journal.pone.0060925 · Cited by 66
Current issues in biomedical text mining and natural language processing
Chapman, W. W., & Cohen, K. B. (2009) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2009.09.001 · Cited by 48
Yoo, I., & Mosa, A. S. M. (2015) · JMIR Medical Informatics · doi:10.2196/medinform.3740 · Cited by 36
Mu, X., Ryu, H., & Lü, K. (2011) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2011.01.008 · Cited by 27
A Study on Pubmed Search Tag Usage Pattern: Association Rule Mining of a Full-day Pubmed Query Log
Mosa, A. S. M., & Yoo, I. (2013) · BMC Medical Informatics and Decision Making · doi:10.1186/1472-6947-13-8 · Cited by 26
In search of the right literature search engine(s)Preprint
Bajpai, A. K., Davuluri, S., Haridas, H., Kasliwal, G., Deepti, H., Ks, S., Chandrashekar, D. S., Bora, P., Farouk, M., Chitturi, N., et al. (2011) · Nature Precedings · doi:10.1038/npre.2011.2101.3 · Cited by 23
Author keywords in biomedical journal articles.
Aurélie Névéol, A., Islamaj, R., & Lu, Z. (2010) · PubMed Central · Cited by 19
Self-citationConsoli, S., & Stilianakis, N. I. (2015) · International Transactions in Operational Research · doi:10.1111/itor.12240 · Cited by 12
Using Multiple External Collections for Query Expansion.
Zhu, D., & Carterette, B. (2011) · Text REtrieval Conference · Cited by 10
Biomedical Text Mining: Biocuration and Literature Search Engines
Acharya, K. K., Sravanthi, D., Moushumi, G., Kitchlu, A., Bindurani, B., Manchigegowda, S. B., Akhilesh, B., & Divya, D. (2024) · Elsevier eBooks · doi:10.1016/b978-0-323-95502-7.00101-9 · Cited by 5
Predicting clicks of PubMed articles.
Mao, Y., & Lu, Z. (2013) · Europe PMC (PubMed Central) · Cited by 3
Self-citationHypothesis Discovery Exploiting Closed Chains of Relations
Seki, K. (2015) · Lecture notes in computer science · doi:10.1007/978-3-662-48567-5_5 · Cited by 2
In search of the right literature search engine(s)Preprint
Acharya, K. K., Bajpai, A. K., Davuluri, S., Haridas, H., Kasliwal, G., Deepti, H., Ks, S., Chandrashekar, D. S., Bora, P., Farouk, M., et al. (2011) · Nature Precedings · doi:10.1038/npre.2008.2101 · Cited by 1
Supporting E-Health Information Seekers: From Simple Strategies to Knowledge-Based Methods
Fan, L., Dahamna, B., & Darmoni, S. J. (2012) · InTech eBooks · doi:10.5772/50348
Supervised hypothesis discovery using syllogistic patterns in the biomedical literature
Seki, K., & Uehara, K. (2013) · International Joint Conference on Artificial Intelligence
A terminological portrait of Breast Cancer to improve PubMed search precisionPreprint
Khakimova, A. K., Золотарев, О., Zatsman, I., & Gu, D. (2022) · Research Square · doi:10.21203/rs.3.rs-2362612/v1
Zhang, L., Yin, M., Sun, M., Shi, J., Song, N., & Chen, H. (2026) · The Electronic Library · doi:10.1108/el-08-2025-0329
Metadata
- Authors
- Lu, Z., & Wilbur, W. J.
- Affiliations
- National Center for Biotechnology Information (US)
- United States National Library of Medicine (US)
- Corresponding author
- Lu, Zhiyong
- ORCID
- Lu, Zhiyong
- Venue
- Journal of Biomedical Informatics
- Publisher
- Elsevier BV
- Published
- 2009-10
- Volume
- 42
- Issue
- 5
- Pages
- 831-838
- ISSN
- 1532-0464 (ISSN-L)
- PMC
- PMC2764279
- OpenAlex
- W2138067727
- Cited by
- 18
- References
- 26
- Citations by year
- 2026: 1 · 2024: 1 · 2022: 1 · 2015: 3 · 2013: 4 · 2012: 1
- FWCI
- 7.22
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Licence
- Locations
- Journal of Biomedical Informatics (publishedVersion)
- PubMed (publishedVersion)
- PubMed Central (acceptedVersion)
- Funders
- National Institutes of Health (Z99 LM999999)
- Topics
- Physical Sciences › Computer Science › Information Systems › Information Retrieval and Search Behavior
- Health Sciences › Medicine › Health Informatics › Biomedical Text Mining and Ontologies
- Physical Sciences › Computer Science › Information Systems › Recommender Systems and Techniques
- Keywords
- PubMed, biomedical literature retrieval, lexical analysis, contextual analysis, concept mapping, query logs, information needs
- MeSH terms
- Medical Informatics, Terminology as Topic, Information Storage and Retrieval, PubMed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review