CoChat

Proposed triggers for retiring a living systematic review

Open access

The DOI matches its Crossref record; 31 of the 32 references it cites were found in a registry or an index.

Abstract

Living systematic reviews (LSRs) are systematic reviews that are continually updated, incorporating relevant new evidence as it becomes available. LSRs are critical for decision-making in topics where the evidence continues to evolve. It is not feasible to continue to update LSRs indefinitely; however, guidance on when to retire LSRs from the living mode is not clear. We propose triggers for making such a decision. The first trigger is to retire LSRs when the evidence becomes conclusive for the outcomes that are required for decision-making. Conclusiveness of evidence is best determined based on the GRADE certainty of evidence construct, which is more comprehensive than solely relying on statistical considerations. The second trigger to retire LSRs is when the question becomes less pertinent for decision-making as determined by relevant stakeholders, including people affected by the problem, healthcare professionals, policymakers and researchers. LSRs can also be retired from a living mode when new studies are not anticipated to be published on the topic and when resources become unavailable to continue updating. We describe examples of retired LSRs and apply the proposed approach using one LSR about adjuvant tyrosine kinase inhibitors in high-risk renal cell carcinoma that we retired from a living mode and published its last update.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1136/bmjebm-2022-112100

Cites

31 of 31 references verified0 citation errors · 0 not checkable

Statistics

Figures

Figure 1 Trial sequential analysis derived from a living systematic review evaluating the effect of adjuvant tyrosine kinase inhibitors on overall survival in high-risk renal cell carcinoma. Adapted from Riaz et al.9
Figure 1 Trial sequential analysis derived from a living systematic review evaluating the effect of adjuvant tyrosine kinase inhibitors on overall survival in high-risk renal cell carcinoma. Adapted from Riaz et al.9CC BY-NC · PubMed Central

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 31 references

Cited by

See all 19

Metadata

Authors
Murad, M. H., Wang, Z., Chu, H., Lin, L., El Mikati, I. K., Khabsa, J., Akl, E. A., Nieuwlaat, R., Schuenemann, H. J., & Riaz, I. B.
Affiliations
  • Mayo Clinic (US)
  • University of Minnesota (US)
  • Banner - University Medical Center Tucson (US)
  • American University of Beirut (LB)
  • McMaster University (CA)
  • Humanitas University (IT)
  • Mayo Clinic Hospital (US)
Corresponding author
Murad, Mohammad Hassan
Venue
BMJ Evidence-Based Medicine
Publisher
BMJ
Published
2023-03-08
Volume
28
Issue
5
Pages
348-352
ISSN
  • 1356-5524 (ISSN-L)
  • 2515-446X
  • 2515-4478
OpenAlex
W4323542543
Cited by
17
References
32
Citations by year
2026: 4 · 2025: 5 · 2024: 6 · 2023: 2
FWCI
1.21
Type
journal article
Language
en
Open access
Locations
  • BMJ Evidence-Based Medicine (publishedVersion, cc-by-nc)
  • PubMed Central (publishedVersion, cc-by-nc)
  • PubMed (publishedVersion)
  • HighWire Press Open Archive (submittedVersion)
Topics
  • Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
  • Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Clinical practice guidelines implementation
  • Social Sciences › Sociology and Political Science › Delphi Technique in Research
Keywords
living systematic review, GRADE certainty of evidence, stakeholder relevance, resource constraints, high-risk renal cell carcinoma

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Proposed triggers for retiring a living systematic review. https://app.cochat.ai/papers/10.1136/bmjebm-2022-112100
The paper
Murad, M. H., Wang, Z., Chu, H., Lin, L., El Mikati, I. K., Khabsa, J., Akl, E. A., Nieuwlaat, R., Schuenemann, H. J., & Riaz, I. B. (2023). Proposed triggers for retiring a living systematic review. BMJ Evidence-Based Medicine. https://doi.org/10.1136/bmjebm-2022-112100

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.