The DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.
GRADE approach to rate the certainty from a network meta-analysis: avoiding spurious judgments of imprecision in sparse networks
Abstract
When direct and indirect estimates of treatment effects are coherent, network meta-analysis (NMA) estimates should have increased precision (narrower confidence or credible intervals compared with relying on direct estimates alone), a benefit of NMA. We have, however, observed cases of sparse networks in which combining direct and indirect estimates results in marked widening of the confidence intervals. In many cases, the assumption of common between-study heterogeneity across the network seems to be responsible for this counterintuitive result. Although the assumption of common between-study heterogeneity across paired comparisons may, in many cases, not be appropriate, it is required to ensure the feasibility of estimating NMA treatment effects. This is especially the case in sparse networks, in which data are insufficient to reliably estimate different variances across the network. The result, however, may be spuriously wide confidence intervals for some of the comparisons in the network (and, in the Grading of Recommendations Assessment, Development, and Evaluation approach, inappropriately low ratings of the certainty of the evidence through rating down for serious imprecision). Systematic reviewers should be aware of the problem and plan sensitivity analyses that produce intuitively sensible confidence intervals. These sensitivity analyses may include using informative priors for the between-study heterogeneity parameter in the Bayesian framework and the use of fixed effects models.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Puhan, M. A., Schunemann, H. J., Murad, M. H., Li, T., Brignardello-Petersen, R., Singh, J. A., Kessels, A. G., Guyatt, G. H., & for the GRADE Working Group (2014) · BMJ · doi:10.1136/bmj.g5630 · Cited by 1,812
Self-citationSalanti, G. (2012) · Research Synthesis Methods · doi:10.1002/jrsm.1037 · Cited by 1,729
Network meta‐analysis for indirect treatment comparisons
Lumley, T. (2002) · Statistics in Medicine · doi:10.1002/sim.1201 · Cited by 1,206
Turner, R. M., Davey, J., Clarke, M. J., Thompson, S. G., & Higgins, J. P. (2012) · International Journal of Epidemiology · doi:10.1093/ije/dys041 · Cited by 837
Advances in the GRADE approach to rate the certainty in estimates from a network meta-analysis
Brignardello-Petersen, R., Bonner, A., Alexander, P. E., Siemieniuk, R. A., Furukawa, T. A., Rochwerg, B., Hazlewood, G. S., Alhazzani, W., Mustafa, R. A., Murad, M. H., et al. (2018) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2017.10.005 · Cited by 753
Self-citationDemystifying trial networks and network meta-analysis
Mills, E. J., Thorlund, K., & Ioannidis, J. P. A. (2013) · BMJ · doi:10.1136/bmj.f2914 · Cited by 742
An international registry of systematic-review protocols
Booth, A., Clarke, M., Ghersi, D., Moher, D., Petticrew, M., & Stewart, L. (2011) · The Lancet · doi:10.1016/s0140-6736(10)60903-8 · Cited by 512
Fluid Resuscitation in Sepsis: A Systematic Review and Network Meta-analysis
Rochwerg, B., Alhazzani, W., Sindi, A., Heels-Ansdell, D., Thabane, L., Fox-Robichaud, A., Mbuagbaw, L., Szczeklik, W., Alshamsi, F., Altayyar, S., et al. (2014) · Annals of Internal Medicine · doi:10.7326/m14-0178 · Cited by 309
Self-citationPublishing Protocols of Systematic Reviews: Comparing What Was Done to What Was Planned
Silagy, C. A., Middleton, P., & Hopewell, S. (2002) · JAMA · doi:10.1001/jama.287.21.2831 · Cited by 188
Bias Due to Changes in Specified Outcomes during the Systematic Review Process
Kirkham, J. J., Altman, D. G., & Williamson, P. R. (2010) · PLoS ONE · doi:10.1371/journal.pone.0009810 · Cited by 164
Cited by
Drug treatments for covid-19: living systematic review and network meta-analysis
Siemieniuk, R. A., Bartoszko, J. J., Zeraatkar, D., Kum, E., Qasim, A., Díaz Martinez, J. P., Izcovich, A., Rochwerg, B., Lamontagne, F., Han, M. A., et al. (2020) · BMJ · doi:10.1136/bmj.m2980 · Cited by 846
Self-citationTsapas, A., Avgerinos, I., Karagiannis, T., Malandris, K., Manolopoulos, A., Andreadis, P., Liakos, A., Matthews, D. R., & Bekiari, E. (2020) · Annals of Internal Medicine · doi:10.7326/m20-0864 · Cited by 346
Brignardello-Petersen, R., Florez, I. D., Izcovich, A., Santesso, N., Hazlewood, G., Alhazanni, W., Yepes-Nuñez, J. J., Tomlinson, G., Schünemann, H. J., & Guyatt, G. H. (2020) · BMJ · doi:10.1136/bmj.m3900 · Cited by 320
Self-citationNonrestorative Treatments for Caries: Systematic Review and Network Meta-analysis
Urquhart, O., Tampi, M. P., Pilcher, L., Slayton, R. L., Araujo, M. W. B., Fontana, M., Guzmán-Armstrong, S., Nascimento, M. M., Nový, B. B., Tinanoff, N., et al. (2019) · Journal of Dental Research · doi:10.1177/0022034518800014 · Cited by 296
Self-citationInterventions for Reversing Prediabetes: A Systematic Review and Meta-Analysis
Galaviz, K. I., Weber, M. B., Suvada, K., Gujral, U. P., Wei, J., Merchant, R., Dharanendra, S., Haw, J. S., Narayan, K. M. V., & Ali, M. K. (2022) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2021.10.020 · Cited by 149
Metadata
- Authors
- Brignardello-Petersen, R., Murad, M. H., Walter, S. D., McLeod, S., Carrasco-Labra, A., Rochwerg, B., Schünemann, H. J., Tomlinson, G., & Guyatt, G. H.
- Venue
- Journal of Clinical Epidemiology
- Publisher
- Elsevier BV
- Published
- 2019-01
- Volume
- 105
- Pages
- 60-67
- ISSN
- 0895-4356 (ISSN-L)
- OpenAlex
- W2894278684
- Cited by
- 173
- References
- 10
- FWCI
- 8.14
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: GRADE approach to rate the certainty from a network meta-analysis: avoiding spurious judgments of imprecision in sparse networks. https://app.cochat.ai/papers/10.1016/j.jclinepi.2018.08.022
- The paper
- Brignardello-Petersen, R., Murad, M. H., Walter, S. D., McLeod, S., Carrasco-Labra, A., Rochwerg, B., Schünemann, H. J., Tomlinson, G., & Guyatt, G. H. (2019). GRADE approach to rate the certainty from a network meta-analysis: avoiding spurious judgments of imprecision in sparse networks. Journal of Clinical Epidemiology. https://doi.org/10.1016/j.jclinepi.2018.08.022
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.