The DOI matches its Crossref record; 8 of the 8 references it cites were found in a registry or an index.
GRADE approach to rate the certainty from a network meta-analysis: addressing incoherence
Open accessAbstract
This article presents official guidance from the Grading of Recommendations Assessments, Development, and Evaluation (GRADE) working group on how to address incoherence when assessing the certainty in the evidence from network meta-analysis. Incoherence represents important differences between direct and indirect estimates that contribute to a network estimate. Bias due to limitations in study design or publication bias, indirectness, and intransitivity may be responsible for incoherence. Addressing incoherence requires a judgment regarding the importance of the impact on the network estimate. Reviewers need to be alert to the possibility of misguidedly arriving at excessively low ratings of certainty by rating down for both incoherence and other closely related GRADE domains. This article describes and illustrates each of these issues and provides explicit guidance on how to deal with them.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
GRADE guidelines 6. Rating the quality of evidence—imprecision
Guyatt, G. H., Oxman, A. D., Kunz, R., Brozek, J., Alonso-Coello, P., Rind, D., Devereaux, P. J., Montori, V. M., Freyschuss, B., Vist, G., et al. (2011) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2011.01.012 · Cited by 2,693 · cited 1×
“This would require considering differences between the estimates in the absolute scale [7] because these are the estimates that clinicians, patients, and guideline panels use to make decisions.”
BackgroundSelf-citationPuhan, M. A., Schunemann, H. J., Murad, M. H., Li, T., Brignardello-Petersen, R., Singh, J. A., Kessels, A. G., Guyatt, G. H., & for the GRADE Working Group (2014) · BMJ · doi:10.1136/bmj.g5630 · Cited by 1,812 · cited 5×
“incoherence when finalizing the assessment of each network estimate [2].”
BackgroundMethodInfluentialSelf-citationSalanti, G. (2012) · Research Synthesis Methods · doi:10.1002/jrsm.1037 · Cited by 1,729
Cipriani, A., Furukawa, T. A., Salanti, G., Geddes, J. R., Higgins, J. P., Churchill, R., Watanabe, N., Nakagawa, A., Omori, I. M., McGuire, H., et al. (2009) · The Lancet · doi:10.1016/s0140-6736(09)60046-5 · Cited by 1,654
GRADE guidelines: 9. Rating up the quality of evidence
Guyatt, G. H., Oxman, A. D., Sultan, S., Glasziou, P., Akl, E. A., Alonso-Coello, P., Atkins, D., Kunz, R., Brozek, J., Montori, V., et al. (2011) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2011.06.004 · Cited by 1,336 · cited 1×
“The GRADE approach recognizes that, when rating the overall quality of evidence for a particular outcome, reviewers should look at the whole picture rather than a completely separate examination of each of the five reasons for rating down [8].”
BackgroundSelf-citationThe GRADE Working Group clarifies the construct of certainty of evidence
Hultcrantz, M., Rind, D., Akl, E. A., Treweek, S., Mustafa, R. A., Iorio, A., Alper, B. S., Meerpohl, J. J., Murad, M. H., Ansari, M. T., et al. (2017) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2017.05.006 · Cited by 853 · cited 1×
“Judging whether there is a dominant estimate requires establishing what it is in which we are rating the certainty [6].”
BackgroundSelf-citationAdvances in the GRADE approach to rate the certainty in estimates from a network meta-analysis
Brignardello-Petersen, R., Bonner, A., Alexander, P. E., Siemieniuk, R. A., Furukawa, T. A., Rochwerg, B., Hazlewood, G. S., Alhazzani, W., Mustafa, R. A., Murad, M. H., et al. (2018) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2017.10.005 · Cited by 753 · cited 3×
“Previous GRADE guidance [1,2] has emphasized that rating the certainty of the estimates from NMA requires considering the certainty of both the direct and indirect evidence.”
BackgroundSelf-citationGetReal in network meta-analysis: a review of the methodology
Efthimiou, O., Debray, T. P. A., van Valkenhoef, G., Trelle, S., Panayidou, K., Moons, K. G. M., Reitsma, J. B., Shang, A., Salanti, G., & on behalf of GetReal Methods Review Group (2016) · Research Synthesis Methods · doi:10.1002/jrsm.1195 · Cited by 401 · cited 2×
“Transitivity, which implies that the direct comparisons that contribute to an indirect comparison are similar enough that we need not be overly concerned about effect modification biasing the indirect comparison, is one of the underlying assumptions of NMA [10].”
Background
Cited by
Drug treatments for covid-19: living systematic review and network meta-analysis
Siemieniuk, R. A., Bartoszko, J. J., Zeraatkar, D., Kum, E., Qasim, A., Díaz Martinez, J. P., Izcovich, A., Rochwerg, B., Lamontagne, F., Han, M. A., et al. (2020) · BMJ · doi:10.1136/bmj.m2980 · Cited by 846
“5 27 28 Two people with experience in using GRADE rated each domain for each comparison separately and resolved discrepancies by consensus.”
Self-citationBrignardello-Petersen, R., Florez, I. D., Izcovich, A., Santesso, N., Hazlewood, G., Alhazanni, W., Yepes-Nuñez, J. J., Tomlinson, G., Schünemann, H. J., & Guyatt, G. H. (2020) · BMJ · doi:10.1136/bmj.m3900 · Cited by 320
Self-citationSiemieniuk, R. A., Bartoszko, J. J., Díaz Martinez, J. P., Kum, E., Qasim, A., Zeraatkar, D., Izcovich, A., Mangala, S., Ge, L., Han, M. A., et al. (2021) · BMJ · doi:10.1136/bmj.n2231 · Cited by 79
Self-citationMannucci, E., Caiulo, C., Naletto, L., Madama, G., & Monami, M. (2021) · Endocrine · doi:10.1007/s12020-021-02889-6 · Cited by 30
Sridharan, K., & Sivaramakrishnan, G. (2025) · BMC Medical Education · doi:10.1186/s12909-025-08300-6 · Cited by 9
Metadata
- Authors
- Brignardello-Petersen, R., Mustafa, R. A., Siemieniuk, R. A. C., Murad, M. H., Agoritsas, T., Izcovich, A., Schünemann, H. J., & Guyatt, G. H.
- Venue
- Journal of Clinical Epidemiology
- Publisher
- Elsevier BV
- Published
- 2019-04
- Volume
- 108
- Pages
- 77-85
- ISSN
- 0895-4356 (ISSN-L)
- OpenAlex
- W2902259954
- Cited by
- 202
- References
- 8
- FWCI
- 5.92
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: GRADE approach to rate the certainty from a network meta-analysis: addressing incoherence. https://app.cochat.ai/papers/10.1016/j.jclinepi.2018.11.025
- The paper
- Brignardello-Petersen, R., Mustafa, R. A., Siemieniuk, R. A. C., Murad, M. H., Agoritsas, T., Izcovich, A., Schünemann, H. J., & Guyatt, G. H. (2019). GRADE approach to rate the certainty from a network meta-analysis: addressing incoherence. Journal of Clinical Epidemiology. https://doi.org/10.1016/j.jclinepi.2018.11.025
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.