CoChat

The DOI matches its Crossref record; 48 of the 50 references it cites were found in a registry or an index; 32 of the 89 sources its claims cite were checked for support.

How to conduct systematic reviews more expeditiously?

Open access

Abstract

Healthcare consumers, researchers, patients and policy makers increasingly use systematic reviews (SRs) to aid their decision-making process. However, the conduct of SRs can be a time-consuming and resource-intensive task. Often, clinical practice guideline developers or other decision-makers need to make informed decisions in a timely fashion (e.g. outbreaks of infection, hospital-based health technology assessments). Possible approaches to address the issue of timeliness in the production of SRs are to (a) implement process parallelisation, (b) adapt and apply innovative technologies, and/or (c) modify SR processes (e.g. study eligibility criteria, search sources, data extraction or quality assessment). Highly parallelised systematic reviewing requires substantial resources to support a team of experienced information specialists, reviewers and methodologists working alongside with clinical content experts to minimise the time for completing individual review steps while maximising the parallel progression of multiple steps. Effective coordination and management within the team and across external stakeholders are essential elements of this process. Emerging innovative technologies have a great potential for reducing workload and improving efficiency of SR production. The most promising areas of application would be to allow automation of specific SR tasks, in particular if these tasks are time consuming and resource intensive (e.g. language translation, study selection, data extraction). Modification of SR processes involves restricting, truncating and/or bypassing one or more SR steps, which may risk introducing bias to the review findings. Although the growing experiences in producing various types of rapid reviews (RR) and the accumulation of empirical studies exploring potential bias associated with specific SR tasks have contributed to the methodological development for expediting SR production, there is still a dearth of research examining the actual impact of methodological modifications and comparing the findings between RRs and SRs. This evidence would help to inform as to which SR tasks can be accelerated or truncated and to what degree, while maintaining the validity of review findings. Timely delivered SRs can be of value in informing healthcare decisions and recommendations, especially when there is practical urgency and there is no other relevant synthesised evidence.

Overview

CoChat Summary

TL;DR

This commentary outlines three approaches to expedite systematic reviews (SRs): process parallelisation, innovative technologies/automation, and methodological modifications. It concludes that parallelisation can speed reviews without increasing bias or reducing cost, while automation and methodological modifications may reduce cost but risk bias, and more empirical evidence comparing rapid reviews (RRs) with SRs is needed.

Key findings

  • Three approaches are proposed: process parallelisation, application of innovative technologies, and methodological modifications. Table 1 indicates all three increase speed; parallelisation does not reduce cost or increase risk of bias, whereas innovative technologies and methodological modifications reduce cost but possibly increase risk of bias.
  • Automation examples include a semi-automated screening strategy that reduced screening workload by 50% without missing any relevant bibliographic citation; RobotReviewer achieved 71.0% overall accuracy versus 78.3% for published review assessments (a 10% difference); and Google Translate accuracy varied by extraction item and language across Chinese, Japanese, Spanish, French, and German.
  • Methodological modifications and RRs vary widely: RR production time ranges from 1 to 32 weeks. Adding Embase to Medline changed the pooled effect estimate by only 6%; searches in databases additional to CCTR, Medline, and Embase identified only 2.4% more studies; and in 9 SRs of diagnostic test accuracy studies, 93% of 302 included citations were retrieved by searching Medline, Embase, and reference lists.
  • Bypassing quality assessment may introduce substantial bias: pooled estimates from low-quality trials showed 34% greater benefit than high-quality trials. The paper states there is still insufficient empirical evidence comparing RR findings with SR findings and no single accepted definition of RR or formally established methodology guidance for conducting RRs.

Methods

  • Design: narrative methodological commentary/overview, not an empirical study or systematic review.
  • Data or sample: no primary data; the paper draws on published methodological and empirical literature and examples, including studies of automation, rapid reviews, search strategies, language restriction, and quality assessment.
  • Main analysis: conceptual synthesis of three approaches to expediting SRs, with a table summarising expected impacts on speed, cost, and risk of bias, and discussion of illustrative evidence.

Limitations

  • Stated: there is a dearth of research examining the actual impact of methodological modifications and comparing findings between RRs and SRs; empirical evidence from such comparisons is insufficient.
  • Stated: there is no single accepted definition of what a rapid review constitutes, nor any formally established methodology guidance for how to conduct RRs.
  • Stated: much of the evidence focuses on SRs of randomised trials of health interventions, and more empirical evidence is needed as SR methodology expands to other question types. Evident from the text: as a commentary/overview, it does not report a systematic search strategy or formal quality appraisal of the cited evidence.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1186/s13643-015-0147-7

Cites

48 of 48 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Verification

Claims the paper makes

15 Valid · 1 Not valid · 21 Not checked · 30 Own results and interpretations

20 more claims · 7 with their cited sources checked

Create a free account to see all 67 claims and to verify the 57 references still open.

See all claims — free account
  • Probably not a substantial claim. 34
  • It may state two separate claims as one. 13
  • The quote only partly states this claim. 3

Create a free account to see these claims.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Show all 48 references

Research works printed but not linked: 7

  1. Hopman JK Z, Edrees H, Allen T, Allegranzi B. WHO Guideline and systematic review on hand hygiene and the use of chlorine in the context of Ebola. Geneva: World Health Organization; 2015.
  2. WHO/UNICEF/WFP. Nutritional care of children and adults with Ebola virus disease in treatment centres. Interim guideline. Geneva: World Health Organization; 2014.
  3. Grama A, Gupta A, Karypis G, Kumar V. Introduction to parallel computing (2nd edition). Essex: Pearson; 2003.
  4. Scott A, Harstall C. Utilizing diverse HTA products in the Alberta Health Technologies Decision Process: Work in Progress. 2012. http://www.ihe.ca/publications/utilizing-diverse-hta-products-in-the-alberta-health-technologies-decision-process-work-in-progress . Accessed on 5 November 2015.
  5. Cochrane Innovations. Cochrane response—the new rapid review from Cochrane. 2014. http://innovations.cochrane.org/response . Accessed on 5 November 2015.
  6. Webber J. Rapid Review Summit: Then Now and in the Future. Vancouver, Biritish Columbia February 3 and 4, 2015. https://www.cadth.ca/sites/default/files/pdf/RR%20Summit_FINAL_Report.pdf . Accessed on 5 November 2015.
  7. Cochrane Collaboration. The EMBASE screening project: six months old and going strong. 2014. http://community.cochrane.org/news/news-events/current-news/embase-screening-project-six-months-old-and-going-strong . Accessed on 5 November 2015.

Cited by

See all 104

Metadata

Authors
Tsertsvadze, A., Chen, Y.-F., Moher, D., Sutcliffe, P., & McCarthy, N.
Affiliations
  • University of Warwick (GB)
  • Ottawa Hospital (CA)
Corresponding author
Tsertsvadze, Alexander
Venue
Systematic Reviews
Published
2015-11-12
Volume
4
Issue
1
Pages
160-160
ISSN
2046-4053 (ISSN-L)
OpenAlex
W2180291732
Cited by
104
References
50
Citations by year
2026: 5 · 2025: 9 · 2024: 11 · 2023: 6 · 2022: 7 · 2021: 25 · 2020: 12 · 2019: 9 · 2018: 7 · 2017: 9 · 2016: 4
FWCI
1.10
Type
journal article
Language
en
Open access
Licence
cc-by
Locations
  • Systematic Reviews (publishedVersion, cc-by)
  • Europe PMC (PubMed Central) (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • Warwick Research Archive Portal (University of Warwick) (acceptedVersion)
  • uO Research (University of Ottawa) (submittedVersion, public-domain)
Funders
Public Health England (GB)
Topics
  • Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
  • Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Clinical practice guidelines implementation
  • Social Sciences › Sociology and Political Science › Delphi Technique in Research
Keywords
timeliness, rapid review, parallelization, data extraction, study eligibility criteria, information professionals, health technology assessment
MeSH terms
Administrative Personnel, Cost-Benefit Analysis, Decision Making, Disease Outbreaks, Humans, Research Design, Review Literature as Topic, Technology Assessment, Biomedical, Evidence-Based Medicine

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-04, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-04 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (qwen3.8-omni-flash and gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: How to conduct systematic reviews more expeditiously? https://app.cochat.ai/papers/10.1186/s13643-015-0147-7
The paper
Tsertsvadze, A., Chen, Y.-F., Moher, D., Sutcliffe, P., & McCarthy, N. (2015). How to conduct systematic reviews more expeditiously? Systematic Reviews. https://doi.org/10.1186/s13643-015-0147-7

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.