The DOI matches its Crossref record.
Developing Optimal Search Strategies for Detecting Clinically Sound Studies in MEDLINE
Open accessAbstract
OBJECTIVE: To develop optimal MEDLINE search strategies for retrieving sound clinical studies of the etiology, prognosis, diagnosis, prevention, or treatment of disorders in adult general medicine. DESIGN: Analytic survey of operating characteristics of search strategies developed by computerized combinations of terms selected to detect studies meeting basic methodologic criteria for direct clinical use in adult general medicine. MEASURES: The sensitivities, specificities, precision, and accuracy of 134,264 unique combinations of search terms were determined by comparison with a manual review of all articles (the "gold standard") in ten internal medicine and general medicine journals for 1986 and 1991. RESULTS: Less than half of the studies of the topics of interest met basic criteria for scientific merit for testing clinical applications. Combinations of search terms reached peak sensitivities of 82% for sound studies of etiology, 92% for prognosis, 92% for diagnosis, and 99% for therapy in 1991. Compared with the best single terms, multiple terms increased sensitivity for sound studies by over 30% (absolute increase), but with some loss of specificity when sensitivity was maximized. For 1986, combinations reached peak sensitivities of 72% for etiology, 95% for prognosis, 86% for diagnosis, and 98% for therapy. When search terms were combined to maximize specificity, over 93% specificity was achieved for all purpose categories in both years. Compared with individual terms, combined terms achieved near-perfect specificity that was maintained with modest increases in sensitivity in all purpose categories except therapy. Increases in accuracy were achieved by combining terms for all purpose categories, with peak accuracies reaching over 90% for therapy in 1986 and 1991. CONCLUSIONS: The retrieval of studies of important clinical topics cited in MEDLINE can be substantially enhanced by selected combinations of indexing terms and textwords.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cited by
Moher, D., Schulz, K. F., & Altman, D. G. (2001) · BMC Medical Research Methodology · doi:10.1186/1471-2288-1-2 · Cited by 2,755
Major risk factors for stillbirth in high-income countries: a systematic review and meta-analysis
Flenady, V., Koopmans, L., Middleton, P., Frøen, J. F., Smith, G. C., Gibbons, K., Coory, M., Gordon, A., Ellwood, D., McIntyre, H. D., et al. (2011) · The Lancet · doi:10.1016/s0140-6736(10)62233-7 · Cited by 1,247
Systematic Reviews of Diagnostic Test Accuracy
Leeflang, M. M. G., Deeks, J. J., Gatsonis, C., & Bossuyt, P. M. M. (2008) · Annals of Internal Medicine · doi:10.7326/0003-4819-149-12-200812160-00008 · Cited by 1,124
The STARD Statement for Reporting Studies of Diagnostic Accuracy: Explanation and Elaboration
Bossuyt, P. M., Reitsma, J. B., Bruns, D. E., Gatsonis, C. A., Glasziou, P. P., Irwig, L. M., Moher, D., Rennie, D., de Vet, H. C. W., & Lijmer, J. G. (2003) · Annals of Internal Medicine · doi:10.7326/0003-4819-138-1-200301070-00012-w1 · Cited by 1,124
A systematic review of rapid diagnostic tests for the detection of tuberculosis infection
Dinnes, J., Deeks, J., Kunst, H., Gibson, A., Cummins, E., Waugh, N., Drobniewski, F., & Lalvani, A. (2007) · Health Technology Assessment · doi:10.3310/hta11030 · Cited by 666
Steenstra, I. A., Verbeek, J. H., Heymans, M. W., & Bongers, P. M. (2005) · Occupational and Environmental Medicine · doi:10.1136/oem.2004.015842 · Cited by 495
Optimal search strategies for retrieving systematic reviews from Medline: analytical survey
Montori, V. M., Wilczynski, N. L., Morgan, D., & Haynes, R. B. (2005) · BMJ · doi:10.1136/bmj.38336.804167.47 · Cited by 422
Self-citationReducing Workload in Systematic Review Preparation Using Automated Citation Classification
Cohen, A. M., Hersh, W. R., Peterson, K., & Yen, P.-Y. (2006) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m1929 · Cited by 411
Wilson, K., Gibson, N., Willan, A., & Cook, D. (2000) · Archives of Internal Medicine · doi:10.1001/archinte.160.7.939 · Cited by 415
Rocuronium versus succinylcholine for rapid sequence induction intubation
Tran, D. T., Newton, E. K., Mount, V. A., Lee, J. S., Wells, G. A., & Perry, J. J. (2015) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd002788.pub3 · Cited by 391
Affective disorders and risk of developing dementia: systematic review
da Silva, J., Gonçalves-Pereira, M., Xavier, M., & Mukaetova-Ladinska, E. B. (2013) · British Journal of Psychiatry · doi:10.1192/bjp.bp.111.101931 · Cited by 327
A systematic review of cognitive decline in the general elderly population
Park, H. L., O'Connell, J. E., & Thomson, R. G. (2003) · International Journal of Geriatric Psychiatry · doi:10.1002/gps.1023 · Cited by 279
The Challenges of Searching for and Retrieving Qualitative Studies
Barroso, J., Gollop, C. J., Sandelowski, M., Meynell, J., Pearce, P. F., & Collins, L. J. (2003) · Western Journal of Nursing Research · doi:10.1177/0193945902250034 · Cited by 272
Reboldi, G., Gentile, G., Angeli, F., Ambrosio, G., Mancia, G., & Verdecchia, P. (2011) · Journal of Hypertension · doi:10.1097/hjh.0b013e3283469976 · Cited by 275
Pontes‐Arruda, A., DeMichele, S., Seth, A., & Singer, P. (2008) · Journal of Parenteral and Enteral Nutrition · doi:10.1177/0148607108324203 · Cited by 230
Text Categorization Models for High-Quality Article Retrieval in Internal Medicine
Aphinyanaphongs, Y. (2004) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m1641 · Cited by 177
Brosseau, L., Wells, G. A., Tugwell, P., Egan, M., Wilson, K. G., Dubouloz, C.-J., Casimiro, L., Robinson, V. A., McGowan, J., Busch, A., et al. (2008) · Physical Therapy · doi:10.2522/ptj.20070200 · Cited by 163
Prioritising references for systematic reviews with RobotAnalyst: A user study
Przybyła, P., Brockmeier, A. J., Kontonatsios, G., Le Pogam, M., McNaught, J., von Elm, E., Nolan, K., & Ananiadou, S. (2018) · Research Synthesis Methods · doi:10.1002/jrsm.1311 · Cited by 148
“52 Subsequent studies 15 - 25 , 26 - 29 , 32 , 33 , 36 have explored different feature spaces ( words or Active learning 54 - 56 is the process of using a classification model's predictions to iteratively select training data.”
BackgroundSearching multiple databases for systematic reviews: added value or diminishing returns?
Stevinson, C., & Lawlor, D. A. (2004) · Complementary Therapies in Medicine · doi:10.1016/j.ctim.2004.09.003 · Cited by 143
Brosseau, L., Wells, G. A., Tugwell, P., Egan, M., Wilson, K. G., Dubouloz, C.-J., Casimiro, L., Robinson, V. A., McGowan, J., Busch, A., et al. (2008) · Physical Therapy · doi:10.2522/ptj.20070115 · Cited by 106
Doust, J. A., Pietrzak, E., Sanders, S., & Glasziou, P. P. (2005) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2004.09.011 · Cited by 106
Walters, L. A., Wilczynski, N. L., & Haynes, R. B. (2006) · Qualitative Health Research · doi:10.1177/1049732305284027 · Cited by 89
Self-citationA new algorithm for reducing the workload of experts in performing systematic reviews
Matwin, S., Kouznetsov, A., Inkpen, D., Frunza, O., & O'Blenis, P. (2010) · Journal of the American Medical Informatics Association · doi:10.1136/jamia.2010.004325 · Cited by 100
Effectiveness of Amiodarone for Conversion of Atrial Fibrillation to Sinus Rhythm: A Meta-analysis
Letelier, L. M., Udol, K., Ena, J., Weaver, B., & Guyatt, G. H. (2003) · Archives of Internal Medicine · doi:10.1001/archinte.163.7.777 · Cited by 97
Lefebvre, C., Eisinga, A., McDonald, S., & Paul, N. (2008) · Emerging Themes in Epidemiology · doi:10.1186/1742-7622-5-13 · Cited by 93
Cross-Topic Learning for Work Prioritization in Systematic Review Creation and Update
Cohen, A. M., Ambert, K., & McDonagh, M. (2009) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m3162 · Cited by 88
Precision of healthcare systematic review searches in a cross‐sectional sample
Sampson, M., Tetzlaff, J., & Urquhart, C. (2011) · Research Synthesis Methods · doi:10.1002/jrsm.42 · Cited by 80
Identifying observational studies of surgical interventions in MEDLINE and EMBASE
Fraser, C., Murray, A., & Burr, J. (2006) · BMC Medical Research Methodology · doi:10.1186/1471-2288-6-41 · Cited by 58
Finding evidence for comparing medical interventions: AHRQ and the Effective Health Care Program
Relevo, R., & Balshem, H. (2011) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.11.022 · Cited by 52
Topic search filters: a systematic scoping review
Damarell, R. A., May, N., Hammond, S., Sladek, R. M., & Tieman, J. J. (2019) · Health Information & Libraries Journal · doi:10.1111/hir.12244 · Cited by 48
Lefebvre, C., Glanville, J., Beale, S., Boachie, C., Duffy, S., Fraser, C., Harbour, J., McCool, R., & Smith, L. (2017) · Health Technology Assessment · doi:10.3310/hta21690 · Cited by 49
New-onset hyperglycemia and acute coronary syndrome: a systematic overview and meta-analysis
Angeli, F., Verdecchia, P., Karthikeyan, G., Mazzotta, G., Pinto, M., Repaci, S., Gatteschi, C., Gentile, G., Cavallini, C., & Reboldi, G. (2010) · Current Diabetes Reviews · doi:10.2174/157339910790909413 · Cited by 48
Taylor, K. S., Heneghan, C. J., Stevens, R. J., Adams, E. C., Nunan, D., & Ward, A. (2015) · PLOS ONE · doi:10.1371/journal.pone.0126375 · Cited by 48
Development of a PubMed based search tool for identifying sex and gender specific health literature
Song, M. M., Simonsen, C. K., Wilson, J. D., & Jenkins, M. R. (2016) · Journal of Women's Health · doi:10.1089/jwh.2015.5217 · Cited by 45
Mullins, M. M., DeLuca, J. B., Crepaz, N., & Lyles, C. M. (2014) · Research Synthesis Methods · doi:10.1002/jrsm.1098 · Cited by 39
Impact of PubMed search filters on the retrieval of evidence by physicians
Shariff, S. Z., Sontrop, J. M., Haynes, R. B., Iansavichus, A. V., McKibbon, K. A., Wilczynski, N. L., Weir, M. A., Speechley, M. R., Thind, A., & Garg, A. X. (2012) · Canadian Medical Association Journal · doi:10.1503/cmaj.101661 · Cited by 38
Self-citationAutomatically Identifying Health Outcome Information in MEDLINE Records
Demner-Fushman, D., Few, B., Hauser, S. E., & Thoma, G. (2006) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m1911 · Cited by 35
(2010) · Cited by 32
Multiple systematic reviews: methods for assessing discordances of results
Moja, L., Fernandez del Rio, M. P., Banzi, R., Cusi, C., D’Amico, R., Liberati, A., Lodi, G., Lucenteforte, E., Minozzi, S., Pecoraro, V., et al. (2012) · Internal and Emergency Medicine · doi:10.1007/s11739-012-0846-1 · Cited by 27
Should Systematic Reviewers Search for Randomized, Controlled Trials Published as Letters?
Iansavichene, A. E., Sampson, M., McGowan, J., & Ajiferuke, I. S. Y. (2008) · Annals of Internal Medicine · doi:10.7326/0003-4819-148-9-200805060-00023 · Cited by 9
Metadata
- Authors
- Haynes, R. B., Wilczynski, N., McKibbon, K. A., Walker, C. J., & Sinclair, J. C.
- Venue
- Journal of the American Medical Informatics Association
- Publisher
- Oxford University Press (OUP)
- Published
- 1994-11-01
- Volume
- 1
- Issue
- 6
- Pages
- 447-458
- ISSN
- 1067-5027 (ISSN-L)
- 1527-974X
- OpenAlex
- W1530232666
- Cited by
- 765
- References
- 0
- FWCI
- 7.50
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.