Developing optimal search strategies for detecting clinically sound and relevant causation studies in EMBASE
Open accessThe DOI matches its Crossref record; 1 of the 1 references it cites were found in a registry or an index.
Abstract
Background: Evaluating the existence and strength of an association between a putative cause and adverse clinical outcome is complex and best done by assessing all available evidence. With the increasing burden of chronic disease, greater time demands on health professionals, and the explosion of information, effective retrieval of best evidence has become both more important and more difficult. Optimal search retrieval can be hampered by a number of obstacles, especially poor search strategies, but using empirically tested methodological search filters can enhance the accuracy of searches for sound evidence concerning etiology. Although such filters have previously been developed for studies of relevance to causation in MEDLINE, no empirically tested search strategy exists for EMBASE. Methods: An analytic survey was conducted, comparing hand searches of journals with retrievals from EMBASE for candidate search terms and combinations. 6 research assistants read all issues of 55 journals indexed in EMBASE. All articles were rated using purpose and quality indicators and categorized into clinically relevant original studies, review articles, general papers, or case reports. The original and review articles were then categorized as 'pass' or 'fail' for scientific merit according to explicit criteria in the areas of causation (etiology) and other clinical topics. Candidate search strategies were developed for causation, then run in a subset of 55 EMBASE journals, the retrievals being compared with the hand search data. The sensitivity, specificity, precision, and accuracy of the search strategies were calculated. Results: Of the 1489 studies classified as causation, 14% were methodologically sound. When search terms were combined, sensitivity reached 92%. Compared with the best single-term strategy, the best combination of terms resulted in an absolute increase in sensitivity (19%) and specificity (5.2%). Maximizing specificity for combined terms resulted in an increase of 7.1% compared with the single term but this came at an expense of sensitivity (39% absolute decrease). A search strategy that optimized the trade-off between sensitivity and specificity achieved 81.9% for sensitivity and 81.4% for specificity. Conclusion: We have discovered search strategies that retrieve high quality studies of causation from EMBASE with high sensitivity, high specificity, or an optimal balance of each.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Association of Journal Quality Indicators With Methodological Quality of Clinical Research Articles
Lee, K. P. (2002) · JAMA · doi:10.1001/jama.287.21.2805 · Cited by 284 · cited 1×
“The over-whelming amount of available information, coupled with the over 2 million new articles that get published each year [10-12], makes keeping up-to-date challenging and difficult [10,13].”
Cited by
Clark, J. M., Sanders, S., Carter, M., Honeyman, D., Cleo, G., Auld, Y., Booth, D., Condron, P., Dalais, C., Bateup, S., et al. (2020) · Journal of the Medical Library Association · doi:10.5195/jmla.2020.834 · Cited by 601
Mueller, M., D’Addario, M., Egger, M., Cevallos, M., Dekkers, O., Mugglin, C., & Scott, P. (2018) · BMC Medical Research Methodology · doi:10.1186/s12874-018-0495-9 · Cited by 400
Death anxiety interventions in patients with advanced cancer: a systematic review
Grossman, C. H., Brooker, J., Michael, N., & Kissane, D. (2018) · Palliative Medicine · doi:10.1177/0269216317722123 · Cited by 144
Limited search strategies were effective in finding relevant nonrandomized studies
Furlan, A. D., Irvin, E., & Bombardier, C. (2006) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2006.03.004 · Cited by 54
Development of a PubMed based search tool for identifying sex and gender specific health literature
Song, M. M., Simonsen, C. K., Wilson, J. D., & Jenkins, M. R. (2016) · Journal of Women's Health · doi:10.1089/jwh.2015.5217 · Cited by 45
Metadata
- Authors
- Haynes, R. B., Kastner, M., Wilczynski, N. L., & the Hedges Team
- Venue
- BMC Medical Informatics and Decision Making
- Published
- 2005-03-22
- Volume
- 5
- Issue
- 1
- Pages
- 8-8
- ISSN
- 1472-6947 (ISSN-L)
- OpenAlex
- W1605272245
- Cited by
- 65
- References
- 1
- FWCI
- 2.58
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Developing optimal search strategies for detecting clinically sound and relevant causation studies in EMBASE. https://app.cochat.ai/papers/10.1186/1472-6947-5-8
- The paper
- Haynes, R. B., Kastner, M., Wilczynski, N. L., & the Hedges Team. (2005). Developing optimal search strategies for detecting clinically sound and relevant causation studies in EMBASE. BMC Medical Informatics and Decision Making. https://doi.org/10.1186/1472-6947-5-8
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.