Leveraging artificial intelligence to enhance systematic reviews in health research: advanced tools and challenges
Open accessThe DOI matches its Crossref record; 13 of the 13 references it cites were found in a registry or an index.
Abstract
Artificial Intelligence (AI) is transforming systematic reviews (SRs) in health research by automating processes such as study screening, data extraction, and quality assessment. This perspective highlights recent advancements in AI tools that enhance efficiency and accuracy in SRs. It discusses the benefits, challenges, and future directions of AI integration, emphasising the need for human oversight to ensure the reliability of AI outputs in evidence synthesis and decision-making in healthcare.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Other recent work has demonstrated promise for LLMs in data extraction 7,8”
From Automation of Systematic Reviews with Large Language Models (2025) · cites this paper as [7]
Experimental — accuracy not yet measuredThe check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“though these studies rely on self-defined reference standards and evaluate on small datasets.”
From Automation of Systematic Reviews with Large Language Models (2025) · cites this paper as [7]
Experimental — accuracy not yet measuredThe check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“This approach represented a methodological improvement over prior work that relied on self-created ground truths 7 .”
From Automation of Systematic Reviews with Large Language Models (2025) · cites this paper as [7]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
An open source machine learning framework for efficient and transparent systematic reviews
van de Schoot, R., de Bruin, J., Schram, R., Zahedi, P., de Boer, J., Weijdema, F., Kramer, B., Huijts, M., Hoogerwerf, M., Ferdinands, G., et al. (2021) · Nature Machine Intelligence · doi:10.1038/s42256-020-00287-7 · Cited by 1,157
Collins, G. S., Dhiman, P., Andaur Navarro, C. L., Ma, J., Hooft, L., Reitsma, J. B., Logullo, P., Beam, A. L., Peng, L., Van Calster, B., et al. (2021) · BMJ Open · doi:10.1136/bmjopen-2020-048008 · Cited by 852
Marshall, I. J., & Wallace, B. C. (2019) · Systematic Reviews · doi:10.1186/s13643-019-1074-9 · Cited by 638 · cited 2×
“Tools like RobotReviewer have high accuracy in extracting relevant details from randomised control trials (RCTs) [10].”
BackgroundMethodHarrison, H., Griffin, S. J., Kuhn, I., & Usher-Smith, J. A. (2020) · BMC Medical Research Methodology · doi:10.1186/s12874-020-0897-3 · Cited by 449 · cited 1×
“Several software tools support titles and abstract screening, with Abstrackr and Rayyan being the most validated [5, 6].”
MethodReducing Workload in Systematic Review Preparation Using Automated Citation Classification
Cohen, A. M., Hersh, W. R., Peterson, K., & Yen, P.-Y. (2006) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m1929 · Cited by 411 · cited 1×
“Since 2005, artificial intelligence (AI) tools have gained increasing attention [1] for their ability to automate these processes, offering increased efficiency and accuracy [2].”
BackgroundRobotReviewer: evaluation of a system for automatically assessing bias in clinical trials
Marshall, I. J., Kuiper, J., & Wallace, B. C. (2016) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocv044 · Cited by 317 · cited 1×
“For instance, RobotReviewer uses NLP to identify relevant text and assess the risk of bias in RCTs, achieving an accuracy rate of 71–78.3% [11], though it is less precise than Cochrane reviews.”
MethodInfluentialEvaluating the effectiveness of large language models in abstract screening: a comparative analysis
Li, M., Sun, J., & Tan, X. M. (2024) · Systematic Reviews · doi:10.1186/s13643-024-02609-x · Cited by 177 · cited 1×
“0 API script achieved 96% screening specificity and 93% sensitivity when prompted with inclusion and exclusion criteria [13], showcasing the capability of base models without fine-tuning.”
BackgroundO’Connor, A. M., Tsafnat, G., Thomas, J., Glasziou, P., Gilbert, S. B., & Hutton, B. (2019) · Systematic Reviews · doi:10.1186/s13643-019-1062-0 · Cited by 167 · cited 1×
“The performance of these tools depends on the effectiveness of the underlying ML paradigms and algorithms, the quality and quantity of data used for training, and the degree of human involvement [9].”
MethodHamel, C., Kelly, S. E., Thavorn, K., Rice, D. B., Wells, G. A., & Hutton, B. (2020) · BMC Medical Research Methodology · doi:10.1186/s12874-020-01129-1 · Cited by 140 · cited 1×
“Several software tools support titles and abstract screening, with Abstrackr and Rayyan being the most validated [5, 6].”
MethodHow to optimize the systematic review process using AI tools
Fabiano, N., Gupta, A., Bhambra, N., Luu, B., Wong, S., Maaz, M., Fiedorowicz, J. G., Smith, A. L., & Solmi, M. (2024) · JCPP Advances · doi:10.1002/jcv2.12234 · Cited by 130 · cited 2×
“Since 2005, artificial intelligence (AI) tools have gained increasing attention [1] for their ability to automate these processes, offering increased efficiency and accuracy [2].”
BackgroundMethod
Cited by
Long-term air pollution exposure and incident dementia: a systematic review and meta-analysis
Rogowski, C. B. B., Bredell, C., Shi, Y., Tien-Smith, A. Z., Szybka, M., Fung, K. W., Hong, L., Phillips, V., Andersen, Z. J., Sharp, S. J., et al. (2025) · The Lancet Planetary Health · doi:10.1016/s2542-5196(25)00118-4 · Cited by 65
Leadership training in healthcare: a systematic umbrella review
Phillipson, J., Pinto, A. C., Kingsley‐Smith, H., Krachler, N., McGivern, G., & Lyons, O. (2025) · BMJ Leader · doi:10.1136/leader-2025-001269 · Cited by 51
“105 However, these tools currently lack the nuanced judgement and contextual understanding required for independent assessments.”
Andersen, T. H., Marcussen, T. M., Termannsen, A., Lawaetz, T. W. H., & Nørgaard, O. (2025) · Cochrane Evidence Synthesis and Methods · doi:10.1002/cesm.70036 · Cited by 62
Automation of Systematic Reviews with Large Language Models
Cao, C., Arora, R., Cento, P., Budak, A., Manta, K., Farahani, E., Cecere, M., Selemon, A., Sang, J., Gong, L. X., et al. (2025) · medRxiv · doi:10.1101/2025.06.13.25329541 · Cited by 33
Artificial Intelligence in Uveitis: Innovations in Diagnosis and Therapeutic Strategies
Murugan, S., Sanjay, S., Somanath, A., Mahendradas, P., Patil, A., Kaur, K., & Gurnani, B. (2024) · Clinical ophthalmology · doi:10.2147/opth.s495307 · Cited by 26
Metadata
- Authors
- Ge, L., Agrawal, R., Singer, M., Kannapiran, P., De Castro Molina, J. A., Teow, K. L., Yap, C. W., & Abisheganaden, J. A.
- Affiliations
- National Skin Centre (SG)
- Tan Tock Seng Hospital (SG)
- Yale University (US)
- Corresponding author
- Ge, Lixia
- Venue
- Systematic Reviews
- Published
- 2024-10-25
- Volume
- 13
- Issue
- 1
- Pages
- 269-269
- ISSN
- 2046-4053 (ISSN-L)
- PMC
- PMC11504244
- OpenAlex
- W4403778417
- Cited by
- 92
- References
- 13
- Citations by year
- 2026: 53 · 2025: 38 · 2024: 1
- FWCI
- 11.61
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by-nc-nd
- creativecommons.org/licenses/by-nc-nd/4.0 (tdm)
- creativecommons.org/licenses/by-nc-nd/4.0 (vor)
- Locations
- Systematic Reviews (publishedVersion, cc-by-nc-nd)
- PubMed Central (publishedVersion, cc-by-nc-nd)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Social Sciences › General Social Sciences › Computational and Text Analysis Methods
- Keywords
- artificial intelligence, automated data extraction, quality assessment, evidence synthesis, human oversight, healthcare decision-making, AI tools
- MeSH terms
- Systematic Reviews as Topic, Artificial Intelligence, Humans, Reproducibility of Results, Biomedical Research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Leveraging artificial intelligence to enhance systematic reviews in health research: advanced tools and challenges. https://app.cochat.ai/papers/10.1186/s13643-024-02682-2
- The paper
- Ge, L., Agrawal, R., Singer, M., Kannapiran, P., De Castro Molina, J. A., Teow, K. L., Yap, C. W., & Abisheganaden, J. A. (2024). Leveraging artificial intelligence to enhance systematic reviews in health research: advanced tools and challenges. Systematic Reviews. https://doi.org/10.1186/s13643-024-02682-2
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.