An optimal search filter for retrieving systematic reviews and meta-analyses
Open accessThe DOI matches its Crossref record; 5 of the 5 references it cites were found in a registry or an index.
Abstract
Background: Health-evidence.ca is an online registry of systematic reviews evaluating the effectiveness of public health interventions. Extensive searching of bibliographic databases is required to keep the registry up to date. However, search filters have been developed to assist in searching the extensive amount of published literature indexed. Search filters can be designed to find literature related to a certain subject (i.e. content-specific filter) or particular study designs (i.e. methodological filter). The objective of this paper is to describe the development and validation of the health-evidence.ca Systematic Review search filter and to compare its performance to other available systematic review filters. Methods: This analysis of search filters was conducted in MEDLINE, EMBASE, and CINAHL. The performance of thirty-one search filters in total was assessed. A validation data set of 219 articles indexed between January 2004 and December 2005 was used to evaluate performance on sensitivity, specificity, precision and the number needed to read for each filter. Results: Nineteen of 31 search filters were effective in retrieving a high level of relevant articles (sensitivity scores greater than 85%). The majority achieved a high degree of sensitivity at the expense of precision and yielded large result sets. The main advantage of the health-evidence.ca Systematic Review search filter in comparison to the other filters was that it maintained the same level of sensitivity while reducing the number of articles that needed to be screened. Conclusions: The health-evidence.ca Systematic Review search filter is a useful tool for identifying published systematic reviews, with further screening to identify those evaluating the effectiveness of public health interventions. The filter that narrows the focus saves considerable time and resources during updates of this online resource, without sacrificing sensitivity.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
McAuley, L., Pham, B., Tugwell, P., & Moher, D. (2000) · The Lancet · doi:10.1016/s0140-6736(00)02786-0 · Cited by 812 · cited 3×
“A survey of librarians revealed that users find search strings too long [38,40].”
BackgroundOptimal search strategies for retrieving systematic reviews from Medline: analytical survey
Montori, V. M., Wilczynski, N. L., Morgan, D., & Haynes, R. B. (2005) · BMJ · doi:10.1136/bmj.38336.804167.47 · Cited by 422
Evidence-Based Implementation of Evidence-Based Medicine
Grol, R., & Grimshaw, J. (1999) · The Joint Commission Journal on Quality Improvement · doi:10.1016/s1070-3241(16)30464-3 · Cited by 421
Retrieving randomized controlled trials from medline : a comparison of 38 published search filters
McKibbon, K. A., Wilczynski, N. L., Haynes, R. B., & for the Hedges Team (2009) · Health Information & Libraries Journal · doi:10.1111/j.1471-1842.2008.00827.x · Cited by 126
Identifying observational studies of surgical interventions in MEDLINE and EMBASE
Fraser, C., Murray, A., & Burr, J. (2006) · BMC Medical Research Methodology · doi:10.1186/1471-2288-6-41 · Cited by 58
Cited by
Clark, J. M., Sanders, S., Carter, M., Honeyman, D., Cleo, G., Auld, Y., Booth, D., Condron, P., Dalais, C., Bateup, S., et al. (2020) · Journal of the Medical Library Association · doi:10.5195/jmla.2020.834 · Cited by 601
Okoth, K., Chandan, J. S., Marshall, T., Thangaratinam, S., Thomas, G. N., Nirantharakumar, K., & Adderley, N. J. (2020) · BMJ · doi:10.1136/bmj.m3502 · Cited by 416
Kitsiou, S., Paré, G., & Jaana, M. (2015) · Journal of Medical Internet Research · doi:10.2196/jmir.4174 · Cited by 327
“A systematic search of MEDLINE, EMBASE, CINAHL, and the Cochrane Library (Cochrane Database of Systematic Reviews, DARE, and the Health Technology Assessment Database) was conducted on December 13, 2013, and updated on December 3, 2014, using key terms and clinical query filters [14,15] to identify all relevant, peer-…”
Exercise and sleep: a systematic review of previous meta‐analyses
Kelley, G. A., & Kelley, K. S. (2017) · Journal of Evidence-Based Medicine · doi:10.1111/jebm.12236 · Cited by 258
Lunny, C., Brennan, S. E., McDonald, S., & McKenzie, J. E. (2017) · Systematic Reviews · doi:10.1186/s13643-017-0617-1 · Cited by 184
Metadata
- Authors
- Lee, E., Dobbins, M., DeCorby, K., McRae, L., Tirilis, D., & Husson, H.
- Venue
- BMC Medical Research Methodology
- Published
- 2012-04-18
- Volume
- 12
- Issue
- 1
- Pages
- 51-51
- ISSN
- 1471-2288 (ISSN-L)
- OpenAlex
- W1988453884
- Cited by
- 151
- References
- 5
- FWCI
- 3.42
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: An optimal search filter for retrieving systematic reviews and meta-analyses. https://app.cochat.ai/papers/10.1186/1471-2288-12-51
- The paper
- Lee, E., Dobbins, M., DeCorby, K., McRae, L., Tirilis, D., & Husson, H. (2012). An optimal search filter for retrieving systematic reviews and meta-analyses. BMC Medical Research Methodology. https://doi.org/10.1186/1471-2288-12-51
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.