Retrieval of diagnostic and treatment studies for clinical use through PubMed and PubMed's Clinical Queries filters
Open accessThe DOI matches its Crossref record; 27 of the 27 references it cites were found in a registry or an index.
Abstract
OBJECTIVE: Clinical Queries filters were developed to improve the retrieval of high-quality studies in searches on clinical matters. The study objective was to determine the yield of relevant citations and physician satisfaction while searching for diagnostic and treatment studies using the Clinical Queries page of PubMed compared with searching PubMed without these filters. MATERIALS AND METHODS: Forty practicing physicians, presented with standardized treatment and diagnosis questions and one question of their choosing, entered search terms which were processed in a random, blinded fashion through PubMed alone and PubMed Clinical Queries. Participants rated search retrievals for applicability to the question at hand and satisfaction. RESULTS: For treatment, the primary outcome of retrieval of relevant articles was not significantly different between the groups, but a higher proportion of articles from the Clinical Queries searches met methodologic criteria (p=0.049), and more articles were published in core internal medicine journals (p=0.056). For diagnosis, the filtered results returned more relevant articles (p=0.031) and fewer irrelevant articles (overall retrieval less, p=0.023); participants needed to screen fewer articles before arriving at the first relevant citation (p<0.05). Relevance was also influenced by content terms used by participants in searching. Participants varied greatly in their search performance. DISCUSSION: Clinical Queries filtered searches returned more high-quality studies, though the retrieval of relevant articles was only statistically different between the groups for diagnosis questions. CONCLUSION: Retrieving clinically important research studies from Medline is a challenging task for physicians. Methodological search filters can improve search retrieval.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“As past research has demonstrated, use of database field codes or query filters is an efficient and effective strategy for identifying high-quality articles for individual clinician use [42,43] and systematic reviews [44].”
Citations
Cites
Evidence-Based Medicine: How to Practice and Teach EBM
Sackett, D. L. (2000) · Cited by 5,950
Evidence-based medicine : how to practice and teach EBM
Straus, S. E. (2005) · Cited by 1,367
Haynes, R. B., & Wilczynski, N. L. (2004) · BMJ · doi:10.1136/bmj.38068.557998.ee · Cited by 547
Self-citationObstacles to answering doctors' questions about patient care with evidence: qualitative study
Ely, J. W., Osheroff, J. A., Ebell, M. H., Chambliss, M. L., Vinson, D. C., Stevermer, J. J., & Pifer, E. A. (2002) · BMJ · doi:10.1136/bmj.324.7339.710 · Cited by 503
Haynes, R. B., McKibbon, K. A., Wilczynski, N. L., Walter, S. D., & Werre, S. R. (2005) · BMJ · doi:10.1136/bmj.38446.498542.8f · Cited by 439
Self-citationAnswering Physicians' Clinical Questions: Obstacles and Potential Solutions
Ely, J. W., Osheroff, J. A., Chambliss, M. L., Ebell, M. H., & Rosenbaum, M. E. (2005) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m1608 · Cited by 388
Accessing pre-appraised evidence: fine-tuning the 5S model into a 6S model
DiCenso, A., Bayley, L., & Haynes, R. B. (2009) · Evidence Based Nursing · doi:10.1136/ebn.12.4.99-b · Cited by 370
Self-citationDawes, M., & Sampson, U. (2003) · International Journal of Medical Informatics · doi:10.1016/s1386-5056(03)00023-6 · Cited by 321
The paths from research to improved health outcomes
Glasziou, P., & Haynes, B. (2005) · Evidence Based Nursing · doi:10.1136/ebn.8.2.36 · Cited by 283
How do primary care physicians seek answers to clinical questions? A literature review.
Coumou, H. C. H., & Meijman, F. J. (2006) · Europe PMC (PubMed Central) · Cited by 254
Green, M. L., & Ruff, T. R. (2005) · Academic Medicine · doi:10.1097/00001888-200502000-00016 · Cited by 247
Hersh, W. R. (2002) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m0996 · Cited by 183
Do Online Information Retrieval Systems Help Experienced Clinicians Answer Clinical Questions?
Westbrook, J. I. (2005) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m1717 · Cited by 181
Green, M. L. (1999) · Academic Medicine · doi:10.1097/00001888-199906000-00017 · Cited by 178
Can primary care physicians' questions be answered using the medical journal literature?
Gorman, P., Ash, J. S., & Wykoff, L. W. (1994) · PubMed Central · Cited by 156
Accessing preappraised evidence: fine-tuning the 5S model into a 6S model
(2009) · Annals of Internal Medicine · doi:10.7326/0003-4819-151-6-200909150-02002 · Cited by 143
Pluye, P., Grad, R. M., Dunikowski, L. G., & Stephenson, R. (2005) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2005.05.004 · Cited by 121
McKibbon, K. A., & Fridsma, D. B. (2006) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m2087 · Cited by 111
Self-citationGeneral practitioners’ use of online evidence during consultations
Magrabi, F., Coiera, E. W., Westbrook, J. I., Gosling, A. S., & Vickland, V. (2004) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2004.10.003 · Cited by 104
Wilczynski, N. L., McKibbon, K. A., & Haynes, R. B. (2001) · PubMed · Cited by 101
Self-citationMcKibbon, K. A., Wilczynski, N. L., & Haynes, R. B. (2004) · BMC Medicine · doi:10.1186/1741-7015-2-33 · Cited by 78
Self-citationKoonce, T. Y., Giuse, N. B., & Todd, P. M. (2004) · Europe PMC (PubMed Central) · Cited by 46
The information-seeking behaviour of paediatricians accessing web-based resources
Prendiville, T. W., Saunders, J., & Fitzsimons, J. (2009) · Archives of Disease in Childhood · doi:10.1136/adc.2008.149278 · Cited by 45
Evaluation of PubMed filters used for evidence-based searching: validation using relative recall
Hoogendam, A., de Vries Robbé, P. F., Stalenhoef, A. F. H., & Overbeke, A. J. P. M. (2009) · Journal of the Medical Library Association : JMLA · doi:10.3163/1536-5050.97.3.007 · Cited by 34
Westbrook, J. I., Gosling, A. S., & Westbrook, M. T. (2005) · Internal Medicine Journal · doi:10.1111/j.1445-5994.2005.00836.x · Cited by 25
Finding the gold in Medline: clinical queries
Haynes, R. B., & Wilczynski, N. (2005) · BMJ Evidence-Based Medicine · doi:10.1136/ebm.10.4.101 · Cited by 24
Self-citationFinding the gold in MEDLINE: Clinical Queries
R. Brian Haynes, M., & Nancy Wilczynski, M. (2005) · ACP Journal Club · doi:10.7326/acpjc-2005-142-1-a08 · Cited by 17
Research works printed but not linked: 1
- Hersh, 2000, Factors associated with successful answering of clinical questions using an information retrieval system, Bull Med Libr Assoc, 88, 323
Cited by
Chaudoir, S. R., Dugan, A. G., & Barr, C. H. (2013) · Implementation Science · doi:10.1186/1748-5908-8-22 · Cited by 800
Zwierzyna, M., Davies, M., Hingorani, A. D., & Hunter, J. (2018) · BMJ · doi:10.1136/bmj.k2130 · Cited by 127
Boosting efficiency in a clinical literature surveillance system with LightGBM
Lokker, C., Abdelkader, W., Bagheri, E., Parrish, R., Cotoi, C., Navarro, T., Germini, F., Linkins, L., Haynes, R. B., Chu, L., et al. (2024) · PLOS Digital Health · doi:10.1371/journal.pdig.0000299 · Cited by 46
Self-citationZiemann, S., Paetzolt, I., Grüßer, L., Coburn, M., Rossaint, R., & Kowark, A. (2022) · BMC Medical Research Methodology · doi:10.1186/s12874-021-01501-9 · Cited by 26
Morshed, T., & Hayden, S. R. (2019) · Annals of Emergency Medicine · doi:10.1016/j.annemergmed.2019.07.003 · Cited by 29
Metadata
- Authors
- Lokker, C., Haynes, R. B., Wilczynski, N. L., McKibbon, K. A., & Walter, S. D.
- Affiliations
- McMaster University (CA)
- Corresponding author
- Lokker, Cynthia
- Venue
- Journal of the American Medical Informatics Association
- Publisher
- Oxford University Press (OUP)
- Published
- 2011-09
- Volume
- 18
- Issue
- 5
- Pages
- 652-659
- ISSN
- 1067-5027 (ISSN-L)
- 1527-974X
- PMC
- PMC3168323
- OpenAlex
- W2154595335
- Cited by
- 31
- References
- 27
- Citations by year
- 2025: 3 · 2023: 2 · 2022: 7 · 2021: 1 · 2020: 3 · 2019: 2 · 2018: 3 · 2017: 1 · 2015: 4 · 2014: 1 · 2013: 2 · 2012: 2
- FWCI
- 4.60
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Journal of the American Medical Informatics Association (publishedVersion)
- Europe PMC (PubMed Central) (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- Funders
- Canadian Institutes of Health Research (177748)
- Topics
- Physical Sciences › Computer Science › Information Systems › Information Retrieval and Search Behavior
- Health Sciences › Health Professions › General Health Professions › Health Sciences Research and Education
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Keywords
- search filters, literature searching, diagnostic studies, treatment studies, physician satisfaction, methodological quality, MEDLINE, internal medicine journals
- MeSH terms
- Consumer Behavior, Humans, Internal Medicine, Ontario, Practice Patterns, Physicians', Sensitivity and Specificity, User-Computer Interface, Single-Blind Method, Information Storage and Retrieval, PubMed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.