Optimal search strategies for retrieving scientifically strong studies of diagnosis from Medline: analytical survey
Open accessThe DOI matches its Crossref record; 28 of the 28 references it cites were found in a registry or an index.
Abstract
OBJECTIVE: To develop and test optimal Medline search strategies for retrieving sound clinical studies on prevention or treatment of health disorders. DESIGN: Analytical survey. DATA SOURCES: 161 clinical journals indexed in Medline for the year 2000. MAIN OUTCOME MEASURES: Sensitivity, specificity, precision, and accuracy of 4862 unique terms in 18 404 combinations. RESULTS: Only 1587 (24.2%) of 6568 articles on treatment met criteria for testing clinical interventions. Combinations of search terms reached peak sensitivities of 99.3% (95% confidence interval 98.7% to 99.8%) at a specificity of 70.4% (69.8% to 70.9%). Compared with best single terms, best multiple terms increased sensitivity for sound studies by 4.1% (absolute increase), but with substantial loss of specificity (absolute difference 23.7%) when sensitivity was maximised. When terms were combined to maximise specificity, 97.4% (97.3% to 97.6%) was achieved, about the same as that achieved by the best single term (97.6%, 97.4% to 97.7%). The strategies newly reported in this paper outperformed other validated search strategies except for two strategies that had slightly higher specificity (98.1% and 97.6% v 97.4%) but lower sensitivity (42.0% and 92.8% v 93.1%). CONCLUSION: New empirical search strategies have been validated to optimise retrieval from Medline of articles reporting high quality clinical studies on prevention or treatment of health disorders.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Empirical evidence of design-related bias in studies of diagnostic tests.
Lijmer, J. G. (1999) · JAMA · doi:10.1001/jama.282.11.1061 · Cited by 1,861
Jaeschke, R. (1994) · JAMA · doi:10.1001/jama.1994.03510290071040 · Cited by 1,049
Robinson, K. A., & Dickersin, K. (2002) · International Journal of Epidemiology · doi:10.1093/ije/31.1.150 · Cited by 833
Developing Optimal Search Strategies for Detecting Clinically Sound Studies in MEDLINE
Haynes, R. B., Wilczynski, N., McKibbon, K. A., Walker, C. J., & Sinclair, J. C. (1994) · Journal of the American Medical Informatics Association · doi:10.1136/jamia.1994.95153434 · Cited by 765
Self-citationObstacles to answering doctors' questions about patient care with evidence: qualitative study
Ely, J. W., Osheroff, J. A., Ebell, M. H., Chambliss, M. L., Vinson, D. C., Stevermer, J. J., & Pifer, E. A. (2002) · BMJ · doi:10.1136/bmj.324.7339.710 · Cited by 503
Optimal search strategies for retrieving systematic reviews from Medline: analytical survey
Montori, V. M., Wilczynski, N. L., Morgan, D., & Haynes, R. B. (2005) · BMJ · doi:10.1136/bmj.38336.804167.47 · Cited by 422
Self-citationOnline Access to MEDLINE in Clinical Settings: A Study of Use and Usefulness
Haynes, R. B., McKibbon, K. A., Walker, C. J., Ryan, N., Fitzgerald, D., & Ramsden, M. F. (1990) · Annals of Internal Medicine · doi:10.7326/0003-4819-112-1-78 · Cited by 287
Self-citationResidents’ medical information needs in clinic: are they being met?
Green, M. L., Ciampi, M. A., & Ellis, P. J. (2000) · The American Journal of Medicine · doi:10.1016/s0002-9343(00)00458-7 · Cited by 180
Identifying Diagnostic Studies in MEDLINE: Reducing the Number Needed to Read
Bachmann, L. M. (2002) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m1124 · Cited by 173
Publications on diagnostic test evaluation in family medicine journals
Devillé, W. L. J. M., Bezemer, P. D., & Bouter, L. M. (2000) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(99)00144-4 · Cited by 161
General practitioners' perceptions of effective health care
Tomlin, Z., Humphrey, C., & Rogers, S. (1999) · BMJ · doi:10.1136/bmj.318.7197.1532 · Cited by 144
Adams, C. E., Power, A., Frederick, K., & Lefebvre, C. (1994) · Psychological Medicine · doi:10.1017/s0033291700027896 · Cited by 122
Developing optimal search strategies for detecting sound clinical prediction studies in MEDLINE.
Wong, S. S.-L., Wilczynski, N. L., Haynes, R. B., & Ramkissoonsingh, R. (2003) · PubMed Central · Cited by 115
Self-citationWilczynski, N. L., McKibbon, K. A., & Haynes, R. B. (2001) · PubMed · Cited by 101
Self-citationDeveloping optimal search strategies for detecting clinically sound causation studies in MEDLINE.
Wilczynski, N. L., & Haynes, R. B. (2003) · PubMed · Cited by 96
Self-citationA high-yield strategy to identify randomized controlled trials for systematic reviews.
Jadad, A. R., & McQuay, H. J. (1993) · PubMed · Cited by 78
Bock, P. K. (1994) · Anthropology News · doi:10.1111/an.1994.35.7.6.1 · Cited by 78
Robustness of empirical search strategies for clinical content in MEDLINE.
Wilczynski, N. L., & Haynes, R. B. (2002) · PubMed · Cited by 65
Self-citationMarson, A. G., & Chadwick, D. W. (1996) · Epilepsia · doi:10.1111/j.1528-1157.1996.tb00575.x · Cited by 60
Vincent, S., Greenley, S., & Beaven, O. (2003) · Health Information & Libraries Journal · doi:10.1046/j.1365-2532.2003.00427.x · Cited by 55
van der Weijden, T. (1997) · Family Practice · doi:10.1093/fampra/14.3.204 · Cited by 55
Assessment of methodologic search filters in MEDLINE.
Wilczynski, N. L., Walker, C. J., McKibbon, K. A., & Haynes, R. B. (1993) · PubMed Central · Cited by 52
Self-citationHow to keep up with the medical literature.
Vandam, L. D. (1985) · THE JOURNAL OF JAPAN SOCIETY FOR CLINICAL ANESTHESIA · doi:10.2199/jjsca.5.13 · Cited by 45
A Two-Term MEDLINE Search Strategy for Identifying Randomized Trials in Obstetrics and Gynecology
Nwosu, C. (1998) · Obstetrics & Gynecology · doi:10.1016/s0029-7844(97)00703-5 · Cited by 44
Veness, M., Rikard‐Bell, G., & Ward, J. (2003) · Australasian Radiology · doi:10.1046/j.1440-1673.2003.01211.x · Cited by 44
Assessment of MEDLINE search strategies for randomized controlled trials in prosthodontics
Dumbrigue, H. B., Esquivel, J. F., & Jones, J. S. (2000) · Journal of Prosthodontics · doi:10.1111/j.1532-849x.2000.00008.x · Cited by 34
In Search of Controlled Evidence for Health Care Quality Improvement
Balas, E. A., Stockham, M. G., Mitchell, J. A., Sievert, M. E. C., Ewigman, B., & Boren, S. A. (1997) · Journal of Medical Systems · doi:10.1023/a:1022887224126 · Cited by 23
Cited by
Hochberg, M. C., Altman, R. D., April, K. T., Benkhalti, M., Guyatt, G., McGowan, J., Towheed, T., Welch, V., Wells, G., & Tugwell, P. (2012) · Arthritis Care & Research · doi:10.1002/acr.21596 · Cited by 3,068
Performance of Transient Elastography for the Staging of Liver Fibrosis: A Meta-Analysis
Friedrich–Rust, M., Ong, M., Martens, S., Sarrazin, C., Bojunga, J., Zeuzem, S., & Herrmann, E. (2008) · Gastroenterology · doi:10.1053/j.gastro.2008.01.034 · Cited by 1,490
Systematic Reviews of Diagnostic Test Accuracy
Leeflang, M. M. G., Deeks, J. J., Gatsonis, C., & Bossuyt, P. M. M. (2008) · Annals of Internal Medicine · doi:10.7326/0003-4819-149-12-200812160-00008 · Cited by 1,124
Recommendations on the Use of 18F-FDG PET in Oncology
Fletcher, J. W., Djulbegovic, B., Soares, H. P., Siegel, B. A., Lowe, V. J., Lyman, G. H., Coleman, R. E., Wahl, R., Paschold, J. C., Avril, N., et al. (2008) · Journal of Nuclear Medicine · doi:10.2967/jnumed.107.047787 · Cited by 1,101
Faller, H., Schuler, M., Richard, M., Heckl, U., Weis, J., & Küffner, R. (2013) · Journal of Clinical Oncology · doi:10.1200/jco.2011.40.8922 · Cited by 912
Metadata
- Authors
- Haynes, R. B., & Wilczynski, N. L.
- Venue
- BMJ
- Publisher
- BMJ
- Published
- 2004-04-08
- Volume
- 328
- Issue
- 7447
- Pages
- 1040
- ISSN
- 0007-1447 (ISSN-L)
- 0959-8138
- 1468-5833
- OpenAlex
- W2111561507
- Cited by
- 547
- References
- 28
- FWCI
- 44.80
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.