Living cumulative network meta-analysis to reduce waste in research: A paradigmatic shift for systematic reviews?
Open accessThe DOI matches its Crossref record; 24 of the 24 references it cites were found in a registry or an index.
Abstract
In a recent research article in BMC Medicine, Créquit and colleagues demonstrate how published systematic reviews in lung cancer provide a fragmented, out-of-date picture of the evidence for all treatments. The results and conclusions drawn from this study, based on cumulative network meta-analyses (NMA) of evidence from randomized clinical trials over time, are quite compelling. The inherent waste of research resulting from incomplete evidence synthesis has wide-reaching implications for a range of target groups including developers of systematic reviews and guidelines and their end-users, health care professionals and patients at the point of care. Building on emerging concepts for living systematic reviews and NMA, the authors propose "living cumulative NMA" as a potential solution and paradigmatic shift. Here we describe how recent innovations within authoring, dissemination, and updating of systematic reviews and trustworthy guidelines may greatly facilitate the production of living NMA. Some additional challenges need to be solved for NMA in general, and for living cumulative NMA in particular, before a paradigmatic shift for systematic reviews can become reality.Please see related research article: https://bmcmedicine.biomedcentral.com/articles/10.1186/s12916-016-0555-0.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Further, with increasing movement toward living reviews, such efforts will require technological advances in order to be sustainable [11, 12].”
From A question of trust: can we build an evidence base to gain trust in systematic review automation technologies? (2019) · cites this paper as [11]
Experimental — accuracy not yet measuredIn the citing paper
“Living systematic reviews deal with the main limitation of traditional reviews—that of providing an overview of the relevant evidence only at a specific time.”
From Drug treatments for covid-19: living systematic review and network meta-analysis (2020) · cites this paper as [4]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Dermyshi, E., Wang, Y., Yan, C., Hong, W., Qiu, G., Gong, X., & Zhang, T. (2017) · Neonatology · doi:10.1159/000454668 · Cited by 24,451
GRADE: an emerging consensus on rating quality of evidence and strength of recommendations
Guyatt, G. H., Oxman, A. D., Vist, G. E., Kunz, R., Falck-Ytter, Y., Alonso-Coello, P., & Schünemann, H. J. (2008) · BMJ · doi:10.1136/bmj.39489.470347.ad · Cited by 23,305 · cited 1×
“Systematic reviews and trustworthy guidelines need to provide evidence for all outcomes to allow an assessment of the balance between the desirable and undesirable consequences of a course of action [4, 24].”
BackgroundSelf-citationGRADE guidelines: 1. Introduction—GRADE evidence profiles and summary of findings tables
Guyatt, G., Oxman, A. D., Akl, E. A., Kunz, R., Vist, G., Brozek, J., Norris, S., Falck-Ytter, Y., Glasziou, P., & deBeer, H. (2011) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.04.026 · Cited by 10,681 · cited 1×
“ratings to inform clinicians, patients, guideline developers, and policy decision-makers [20].”
BackgroundSelf-citationNorderyd, O. M., Koch, G., Papias, A., Köhler, A. A., Helkimo, A. N., Brahm, C., Lindmark, U., Lindfors, N., Mattsson, A., Rolander, B., et al. (2015) · PubMed · Cited by 3,584
What is ‘quality of evidence’ and why is it important to clinicians?
Guyatt, G. H., Oxman, A. D., Kunz, R., Vist, G. E., Falck-Ytter, Y., & Schünemann, H. J. (2008) · BMJ · doi:10.1136/bmj.39490.551019.be · Cited by 3,250
Self-citationCombination of direct and indirect evidence in mixed treatment comparisons
Lu, G., & Ades, A. E. (2004) · Statistics in Medicine · doi:10.1002/sim.1875 · Cited by 2,166 · cited 1×
“These advances include systematic reviews that use network meta-analyses (NMA), the statistical technique that allows comparing multiple treatments at a time [8, 9], the methods of which are rapidly evolving [10].”
BackgroundPuhan, M. A., Schunemann, H. J., Murad, M. H., Li, T., Brignardello-Petersen, R., Singh, J. A., Kessels, A. G., Guyatt, G. H., & for the GRADE Working Group (2014) · BMJ · doi:10.1136/bmj.g5630 · Cited by 1,812 · cited 4×
“Authors have already presented two systems based on GRADE principles for making quality of evidence ratings in NMAs [21, 22].”
InfluentialSelf-citationGoing from evidence to recommendations
Guyatt, G. H., Oxman, A. D., Kunz, R., Falck-Ytter, Y., Vist, G. E., Liberati, A., & Schünemann, H. J. (2008) · BMJ · doi:10.1136/bmj.39493.646875.ae · Cited by 1,810 · cited 1×
“org/publicdomain/ze Over the past decades the world has seen large advances in standards, methods, and systems for conducting and reporting systematic reviews and trustworthy guidelines [4–7].”
BackgroundSelf-citationSalanti, G. (2012) · Research Synthesis Methods · doi:10.1002/jrsm.1037 · Cited by 1,729
Evaluating the quality of evidence from a network meta-analysis
Salanti, G., Del Giovane, C., Chaimani, A., Caldwell, D. M., & Higgins, J. P. T. (2014) · PLoS ONE · doi:10.1371/journal.pone.0099682 · Cited by 1,402 · cited 4×
“Authors have already presented two systems based on GRADE principles for making quality of evidence ratings in NMAs [21, 22].”
Influential
Cited by
Meta-analysis and the science of research synthesis
Gurevitch, J., Koricheva, J., Nakagawa, S., & Stewart, G. (2018) · Nature · doi:10.1038/nature25753 · Cited by 1,709
Drug treatments for covid-19: living systematic review and network meta-analysis
Siemieniuk, R. A., Bartoszko, J. J., Zeraatkar, D., Kum, E., Qasim, A., Díaz Martinez, J. P., Izcovich, A., Rochwerg, B., Lamontagne, F., Han, M. A., et al. (2020) · BMJ · doi:10.1136/bmj.m2980 · Cited by 846
Self-citationPijls, B. G., Jolani, S., Atherley, A., Derckx, R. T., Dijkstra, J. I. R., Franssen, G. H. L., Hendriks, S., Richters, A., Venemans-Jellema, A., Zalpuri, S., et al. (2021) · BMJ Open · doi:10.1136/bmjopen-2020-044640 · Cited by 586
Pelch, K., Wignall, J. A., Goldstone, A. E., Ross, P. K., Blain, R. B., Shapiro, A. J., Holmgren, S. D., Hsieh, J.-H., Svoboda, D., Auerbach, S. S., et al. (2019) · Toxicology · doi:10.1016/j.tox.2019.06.006 · Cited by 266
van der Vlist, A. C., Winters, M., Weir, A., Ardern, C. L., Welton, N. J., Caldwell, D. M., Verhaar, J. A. N., & de Vos, R.-J. (2021) · British Journal of Sports Medicine · doi:10.1136/bjsports-2019-101872 · Cited by 198
“66 67 The protocol was registered prospectively and patients were involved in selecting outcomes most relevant to them in the design phase.”
Metadata
- Authors
- Vandvik, P. O., Brignardello-Petersen, R., & Guyatt, G. H.
- Affiliations
- University of Oslo (NO)
- McMaster University (CA)
- Corresponding author
- Vandvik, Per Olav
- Venue
- BMC Medicine
- Published
- 2016-03-29
- Volume
- 14
- Issue
- 1
- Pages
- 59-59
- ISSN
- 1741-7015 (ISSN-L)
- PMC
- PMC4812628
- OpenAlex
- W2322318282
- Cited by
- 69
- References
- 24
- Citations by year
- 2026: 1 · 2025: 6 · 2024: 1 · 2023: 11 · 2022: 6 · 2021: 14 · 2020: 11 · 2019: 5 · 2018: 11 · 2017: 1 · 2016: 2
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- BMC Medicine (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Universidad de Chile (submittedVersion, cc-by-nc-nd)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Clinical practice guidelines implementation
- Social Sciences › Sociology and Political Science › Delphi Technique in Research
- Keywords
- living systematic review, research waste, evidence synthesis, lung cancer treatment, randomized controlled trials, guideline development, evidence dissemination
- MeSH terms
- Humans, Meta-Analysis as Topic, Evidence-Based Medicine, Biomedical Research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Living cumulative network meta-analysis to reduce waste in research: A paradigmatic shift for systematic reviews? https://app.cochat.ai/papers/10.1186/s12916-016-0596-4
- The paper
- Vandvik, P. O., Brignardello-Petersen, R., & Guyatt, G. H. (2016). Living cumulative network meta-analysis to reduce waste in research: A paradigmatic shift for systematic reviews? BMC Medicine. https://doi.org/10.1186/s12916-016-0596-4
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.