Automatic Boolean Query Formulation for Systematic Review Literature Search
Open accessThe DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.
Abstract
Formulating Boolean queries for systematic review literature search is a challenging task. Commonly, queries are formulated by information specialists using the protocol specified in the review and interactions with the research team. Information specialists have in-depth experience on how to formulate queries in this domain, but may not have in-depth knowledge about the reviews’ topics. Query formulation requires a significant amount of time and effort, and is performed interactively; specialists repeatedly formulate queries, attempt to validate their results, and reformulate specific Boolean clauses. In this paper, we investigate the possibility of automatically formulating a Boolean query from the systematic review protocol. We propose a novel five-step approach to automatic query formulation, specific to Boolean queries in this domain, which approximates the process by which information specialists formulate queries. In this process, we use syntax parsing to derive the logical structure of high-level concepts in a query, automatically extract and map concepts to entities in order to perform entity expansion, and finally apply post-processing operations (such as stemming and search filters).
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Methods for the thematic synthesis of qualitative research in systematic reviews
Thomas, J., & Harden, A. (2008) · BMC Medical Research Methodology · doi:10.1186/1471-2288-8-45 · Cited by 9,312
An algorithm for suffix stripping
Porter, M. F. (1980) · Program · doi:10.1108/eb046814 · Cited by 8,096 · cited 2×
“The use of standard English stemmers, e.g., Porter and Krovetz [20, 33], may not be suitable to keywords in these queries as they are medical terms which are frequently derived from Latin and Greek — and may be a combination of several words [21], e.g., “acroceph-alopolysyndactylie”.”
BackgroundNatural language interfaces to databases – an introduction
Androutsopoulos, I., Ritchie, G. D., & Thanisch, P. (1995) · Natural Language Engineering · doi:10.1017/s135132490000005x · Cited by 768
Reducing Workload in Systematic Review Preparation Using Automated Citation Classification
Cohen, A. M., Hersh, W. R., Peterson, K., & Yen, P.-Y. (2006) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m1929 · Cited by 411 · cited 5×
“Note that even small increases in precision can have a significant impact on both the total cost of a review, and the time required to produce a review [5, 42].”
BackgroundMethodInfluentialSemi-automated screening of biomedical citations for systematic reviews
Wallace, B. C., Trikalinos, T. A., Lau, J., Brodley, C., & Schmid, C. H. (2010) · BMC Bioinformatics · doi:10.1186/1471-2105-11-55 · Cited by 351 · cited 1×
“The majority of the research that is focused on reducing the workload of the screening phase has primarily investigated the use of active learning [5, 28, 48].”
BackgroundReducing systematic review workload through certainty-based screening
Miwa, M., Thomas, J., O’Mara-Eves, A., & Ananiadou, S. (2014) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2014.06.005 · Cited by 190
Twelve tips for undertaking a systematic review
Reeves, S., Koppel, I., Barr, H., Freeth, D., & Hammick, M. (2002) · Medical Teacher · doi:10.1080/01421590220145707 · Cited by 64 · cited 1×
“Formulating queries according to the method described above can take several weeks, if not months [16, 35].”
Method
Cited by
Automation of systematic literature reviews: A systematic literature review
van Dinter, R., Tekinerdogan, B., & Catal, C. (2021) · Information and Software Technology · doi:10.1016/j.infsof.2021.106589 · Cited by 432
Can ChatGPT Write a Good Boolean Query for Systematic Review Literature Search?
Wang, S., Scells, H., Koopman, B., & Zuccon, G. (2023) · Proceedings of the 46th International ACM SIGIR Conference on Research and Development in Information Retrieval · doi:10.1145/3539618.3591703 · Cited by 275
Self-citationFrom Intention To Implementation: Automating Biomedical Research via LLMs
Luo, Y., Shi, L., Li, Y., Zhuang, A., Gong, Y., Liu, L., & Lin, C. (2024) · arXiv · doi:10.48550/arxiv.2412.09429 · Cited by 53
Zero-shot Generative Large Language Models for Systematic Review Screening Automation
Wang, S., Scells, H., Zhuang, S., Potthast, M., Koopman, B., & Zuccon, G. (2024) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-56027-9_25 · Cited by 26
“Research has explored the automatic creation of effective Boolean queries [39, 41, 40, 38, 55] (also with respect to the use of controlled vocabularies such as MeSH [53, 50, 51]), and the ranking of the set of documents retrieved by the Boolean query (a task called “screening prioritisa-tion”) [32,…”
BackgroundSelf-citation
Metadata
- Authors
- Scells, H., Zuccon, G., Koopman, B., & Clark, J.
- Venue
- Proceedings of The Web Conference 2020
- Publisher
- ACM
- Published
- 2020-04-20
- Pages
- 1071-1081
- OpenAlex
- W3012603674
- Cited by
- 46
- References
- 7
- FWCI
- 1.22
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Automatic Boolean Query Formulation for Systematic Review Literature Search. https://app.cochat.ai/papers/10.1145/3366423.3380185
- The paper
- Scells, H., Zuccon, G., Koopman, B., & Clark, J. (2020). Automatic Boolean Query Formulation for Systematic Review Literature Search. Proceedings of The Web Conference 2020. https://doi.org/10.1145/3366423.3380185
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.