The DOI matches its Crossref record.
Optimal search strategies for retrieving scientifically strong studies of treatment from Medline: analytical survey
Open accessAbstract
Abstract Objective To develop and test optimal Medline search strategies for retrieving sound clinical studies on prevention or treatment of health disorders. Design Analytical survey. Data sources 161 clinical journals indexed in Medline for the year 2000. Main outcome measures Sensitivity, specificity, precision, and accuracy of 4862 unique terms in 18 404 combinations. Results Only 1587 (24.2%) of 6568 articles on treatment met criteria for testing clinical interventions. Combinations of search terms reached peak sensitivities of 99.3% (95% confidence interval 98.7% to 99.8%) at a specificity of 70.4% (69.8% to 70.9%). Compared with best single terms, best multiple terms increased sensitivity for sound studies by 4.1% (absolute increase), but with substantial loss of specificity (absolute difference 23.7%) when sensitivity was maximised. When terms were combined to maximise specificity, 97.4% (97.3% to 97.6%) was achieved, about the same as that achieved by the best single term (97.6%, 97.4% to 97.7%). The strategies newly reported in this paper outperformed other validated search strategies except for two strategies that had slightly higher specificity (98.1% and 97.6% v 97.4%) but lower sensitivity (42.0% and 92.8% v 93.1%). Conclusion New empirical search strategies have been validated to optimise retrieval from Medline of articles reporting high quality clinical studies on prevention or treatment of health disorders.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cited by
Hochberg, M. C., Altman, R. D., April, K. T., Benkhalti, M., Guyatt, G., McGowan, J., Towheed, T., Welch, V., Wells, G., & Tugwell, P. (2012) · Arthritis Care & Research · doi:10.1002/acr.21596 · Cited by 3,068
Faller, H., Schuler, M., Richard, M., Heckl, U., Weis, J., & Küffner, R. (2013) · Journal of Clinical Oncology · doi:10.1200/jco.2011.40.8922 · Cited by 912
Terwee, C. B., Jansma, E. P., Riphagen, I. I., & de Vet, H. C. W. (2009) · Quality of Life Research · doi:10.1007/s11136-009-9528-5 · Cited by 849
Sud, S., Friedrich, J. O., Taccone, P., Polli, F., Adhikari, N. K. J., Latini, R., Pesenti, A., Guérin, C., Mancebo, J., Curley, M. A. Q., et al. (2010) · Intensive Care Medicine · doi:10.1007/s00134-009-1748-1 · Cited by 563
Does monitoring goal progress promote goal attainment? A meta-analysis of the experimental evidence.
Harkin, B., Webb, T. L., Chang, B. P. I., Prestwich, A., Conner, M., Kellar, I., Benn, Y., & Sheeran, P. (2016) · Psychological Bulletin · doi:10.1037/bul0000025 · Cited by 564
Adams, J., Hillier-Brown, F. C., Moore, H. J., Lake, A. A., Araujo-Soares, V., White, M., & Summerbell, C. (2016) · Systematic Reviews · doi:10.1186/s13643-016-0337-y · Cited by 486
Eddy, D. M., Hollingworth, W., Caro, J. J., Tsevat, J., McDonald, K. M., & Wong, J. B. (2012) · Value in Health · doi:10.1016/j.jval.2012.04.012 · Cited by 466
Doig, G. S., Heighes, P. T., Simpson, F., Sweetman, E. A., & Davies, A. R. (2009) · Intensive Care Medicine · doi:10.1007/s00134-009-1664-4 · Cited by 464
McKibbon, K. A., Lokker, C., Wilczynski, N. L., Ciliska, D., Dobbins, M., Davis, D. A., Haynes, R. B., & Straus, S. E. (2010) · Implementation Science · doi:10.1186/1748-5908-5-16 · Cited by 345
“Using methodologic filters for interventions [10], qualitative studies [11], and economics [12], brought the retrieval set down to 27 randomized controlled trials, 113 potential qualitative studies, or 12 economic analyses, respectively.”
Self-citationBiomedical Ontologies in Action: Role in Knowledge Management, Data Integration and Decision Support
Bodenreider, O. (2008) · Yearbook of Medical Informatics · doi:10.1055/s-0038-1638585 · Cited by 368
Geersing, G.-J., Bouwmeester, W., Zuithoff, P., Spijker, R., Leeflang, M., & Moons, K. (2012) · PLoS ONE · doi:10.1371/journal.pone.0032844 · Cited by 350
Krallinger, M., Valencia, A., & Hirschman, L. (2008) · Genome Biology · doi:10.1186/gb-2008-9-s2-s8 · Cited by 231
Rygård, S. L., Butler, E., Granholm, A., Møller, M. H., Cohen, J., Finfer, S., Perner, A., Myburgh, J., Venkatesh, B., & Delaney, A. (2018) · Intensive Care Medicine · doi:10.1007/s00134-018-5197-6 · Cited by 211
Doig, G. S., Heighes, P. T., Simpson, F., & Sweetman, E. A. (2011) · Injury · doi:10.1016/j.injury.2010.06.008 · Cited by 189
Halladay, C. W., Trikalinos, T. A., Schmid, I. T., Schmid, C. H., & Dahabreh, I. J. (2015) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2014.12.017 · Cited by 166
Klimas, J., Gorfinkel, L., Fairbairn, N., Amato, L., Ahamad, K., Nolan, S., Simel, D. L., & Wood, E. (2019) · JAMA Network Open · doi:10.1001/jamanetworkopen.2019.3365 · Cited by 162
Retrieving randomized controlled trials from medline : a comparison of 38 published search filters
McKibbon, K. A., Wilczynski, N. L., Haynes, R. B., & for the Hedges Team (2009) · Health Information & Libraries Journal · doi:10.1111/j.1471-1842.2008.00827.x · Cited by 126
Self-citationPark, C. L., Pustejovsky, J. E., Trevino, K., Sherman, A. C., Esposito, C., Berendsen, M., & Salsman, J. M. (2019) · Cancer · doi:10.1002/cncr.32078 · Cited by 125
Merluzzi, T. V., Pustejovsky, J. E., Philip, E. J., Sohl, S. J., Berendsen, M., & Salsman, J. M. (2019) · Psycho-Oncology · doi:10.1002/pon.5148 · Cited by 122
Retrieving Clinical Evidence: A Comparison of PubMed and Google Scholar for Quick Clinical Searches
Shariff, S. Z., Bejaimal, S. A., Sontrop, J. M., Iansavichus, A. V., Haynes, R. B., Weir, M. A., & Garg, A. X. (2013) · Journal of Medical Internet Research · doi:10.2196/jmir.2624 · Cited by 119
Self-citationLefebvre, C., Eisinga, A., McDonald, S., & Paul, N. (2008) · Emerging Themes in Epidemiology · doi:10.1186/1742-7622-5-13 · Cited by 93
Effects of probiotics on nonalcoholic fatty liver disease: a systematic review and meta-analysis
Tang, Y., Huang, J., Zhang, W. Y., Qin, S., Yang, Y. X., Ren, H., Yang, Q.-B., & Hu, H. (2019) · Therapeutic Advances in Gastroenterology · doi:10.1177/1756284819878046 · Cited by 85
Precision of healthcare systematic review searches in a cross‐sectional sample
Sampson, M., Tetzlaff, J., & Urquhart, C. (2011) · Research Synthesis Methods · doi:10.1002/jrsm.42 · Cited by 80
Meta‐analysis and aggregation of multiple published prediction models
Debray, T. P. A., Koffijberg, H., Nieboer, D., Vergouwe, Y., Steyerberg, E. W., & Moons, K. G. M. (2014) · Statistics in Medicine · doi:10.1002/sim.6080 · Cited by 73
de Mello, M. B., Righi, N. C., Schuch, F. B., Signori, L. U., & da Silva, A. M. V. (2022) · Annals of Physical and Rehabilitation Medicine · doi:10.1016/j.rehab.2021.101586 · Cited by 63
Taljaard, M., McGowan, J., Grimshaw, J. M., Brehaut, J. C., McRae, A., Eccles, M. P., & Donner, A. (2010) · BMC Medical Research Methodology · doi:10.1186/1471-2288-10-15 · Cited by 62
Slobogean, G. P., Verma, A., Giustini, D., Slobogean, B. L., & Mulpuri, K. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2009.01.013 · Cited by 62
La Touche, R., Martínez García, S., Serrano García, B., Proy Acosta, A., Adraos Juárez, D., Fernández Pérez, J. J., Angulo-Díaz-Parreño, S., Cuenca-Martínez, F., Paris-Alemany, A., & Suso-Martí, L. (2020) · Pain Medicine · doi:10.1093/pm/pnaa021 · Cited by 60
Identifying observational studies of surgical interventions in MEDLINE and EMBASE
Fraser, C., Murray, A., & Burr, J. (2006) · BMC Medical Research Methodology · doi:10.1186/1471-2288-6-41 · Cited by 58
Limited search strategies were effective in finding relevant nonrandomized studies
Furlan, A. D., Irvin, E., & Bombardier, C. (2006) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2006.03.004 · Cited by 54
Loke, Y. K., Golder, S. P., & Vandenbroucke, J. P. (2011) · Therapeutic Advances in Drug Safety · doi:10.1177/2042098611401129 · Cited by 49
Lefebvre, C., Glanville, J., Beale, S., Boachie, C., Duffy, S., Fraser, C., Harbour, J., McCool, R., & Smith, L. (2017) · Health Technology Assessment · doi:10.3310/hta21690 · Cited by 49
Kastner, M., Straus, S. E., McKibbon, K. A., & Goldsmith, C. H. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2008.06.001 · Cited by 47
Self-citationPsychosocial interventions for cancer survivors: a meta-analysis of effects on positive affect
Salsman, J. M., Pustejovsky, J. E., Schueller, S. M., Hernandez, R., Berendsen, M., McLouth, L. E. S., & Moskowitz, J. T. (2019) · Journal of Cancer Survivorship · doi:10.1007/s11764-019-00811-8 · Cited by 45
Impact of PubMed search filters on the retrieval of evidence by physicians
Shariff, S. Z., Sontrop, J. M., Haynes, R. B., Iansavichus, A. V., McKibbon, K. A., Wilczynski, N. L., Weir, M. A., Speechley, M. R., Thind, A., & Garg, A. X. (2012) · Canadian Medical Association Journal · doi:10.1503/cmaj.101661 · Cited by 38
Self-citationCatalá-López, F., Aleixandre-Benavent, R., Caulley, L., Hutton, B., Tabarés-Seisdedos, R., Moher, D., & Alonso-Arroyo, A. (2020) · Trials · doi:10.1186/s13063-019-3944-9 · Cited by 38
Citation impact was highly variable for reporting guidelines of health research: a citation analysis
Caulley, L., Cheng, W., Catalá-López, F., Whelan, J., Khoury, M., Ferraro, J., Husereau, D., Altman, D. G., & Moher, D. (2020) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2020.07.013 · Cited by 37
Lokker, C., Haynes, R. B., Wilczynski, N. L., McKibbon, K. A., & Walter, S. D. (2011) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2011-000233 · Cited by 31
Self-citationPubMed had a higher sensitivity than Ovid-MEDLINE in the search for systematic reviews
Katchamart, W., Faulkner, A., Feldman, B., Tomlinson, G., & Bombardier, C. (2011) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.06.004 · Cited by 25
Bayliss, S. E., Davenport, C. F., & Pennant, M. E. (2014) · Health Information & Libraries Journal · doi:10.1111/hir.12075 · Cited by 20
Grenet, G., Le, H. H., Bejan-Angoulvant, T., Erpeldinger, S., Boussageon, R., Kassaï, B., Moulin, P., Gueyffier, F., & Cucherat, M. (2019) · Diabetes & Metabolism · doi:10.1016/j.diabet.2019.05.003 · Cited by 6
Comparison of PubMed and Google Scholar Literature Searches
Anders, M. E., & Evans, D. P. (2010) · Respiratory Care · doi:10.4187/respcare.10550578 · Cited by 3
Metadata
- Authors
- Haynes, R. B., McKibbon, K. A., Wilczynski, N. L., Walter, S. D., & Werre, S. R.
- Venue
- BMJ
- Publisher
- BMJ
- Published
- 2005-05-13
- Volume
- 330
- Issue
- 7501
- Pages
- 1179
- ISSN
- 0007-1447 (ISSN-L)
- 0959-8138
- 1468-5833
- OpenAlex
- W4229668175
- Cited by
- 439
- References
- 0
- FWCI
- 30.60
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
