The DOI matches its Crossref record; 32 of the 32 references it cites were found in a registry or an index.
Evaluating the Quality of Evidence from a Network Meta-Analysis
Open accessAbstract
Systematic reviews that collate data about the relative effects of multiple interventions via network meta-analysis are highly informative for decision-making purposes. A network meta-analysis provides two types of findings for a specific outcome: the relative treatment effect for all pairwise comparisons, and a ranking of the treatments. It is important to consider the confidence with which these two types of results can enable clinicians, policy makers and patients to make informed decisions. We propose an approach to determining confidence in the output of a network meta-analysis. Our proposed approach is based on methodology developed by the Grading of Recommendations Assessment, Development and Evaluation (GRADE) Working Group for pairwise meta-analyses. The suggested framework for evaluating a network meta-analysis acknowledges (i) the key role of indirect comparisons (ii) the contributions of each piece of direct evidence to the network meta-analysis estimates of effect size; (iii) the importance of the transitivity assumption to the validity of network meta-analysis; and (iv) the possibility of disagreement between direct evidence and indirect evidence. We apply our proposed strategy to a systematic review comparing topical antibiotics without steroids for chronically discharging ears with underlying eardrum perforations. The proposed framework can be used to determine confidence in the results from a network meta-analysis. Judgements about evidence from a network meta-analysis can be different from those made about evidence from pairwise meta-analyses.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures







Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Finally, to assess the credibility of the findings of each network meta-analysis, the findings were incorporated into the Confidence in Network Meta-Analysis (CINeMA) application, which is an adaptation of the Grading of Recommendations Assessment, Development, and Evaluation approach [19–21].”
From Antidepressants for the treatment of adults with major depressive disorder in the maintenance phase: a systematic review and network meta-analysis (2023) · cites this paper as [19]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“We rated the credibility of the evidence included in the network meta-analysis using CINeMA33 (appendix pp 16–17).”
From Comparative effectiveness and risk of preterm birth of local treatments for cervical intraepithelial neoplasia and stage IA1 cervical cancer: a systematic review and network meta-analysis (2022) · cites this paper as [33]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Additionally, we assessed the certainty of evidence contributing to network estimates of the main outcomes with the Grading of Recommendations Assessment, Development and Evaluation (GRADE) framework.15”
The cited source says what the claim attributes to it.
In the citing paper
“Where there appeared to be a bene fi t of probiotics over placebo in analyses containing more than 1 RCT, we assessed the level of certainty of evidence according to GRADE criteria. 37”
From Efficacy of Probiotics in Irritable Bowel Syndrome: Systematic Review and Meta-analysis (2023) · cites this paper as [37]
The cited source says what the claim attributes to it.
In the citing paper
“However, due to a combination of 1 or more of heterogeneity between studies, possible publication bias, risk of bias of studies, and modest ef fi cacy, the level of certainty of evidence would not be graded as anything more than low or very low, according to GRADE criteria, 37 in almost all of our analyses.”
From Efficacy of Probiotics in Irritable Bowel Syndrome: Systematic Review and Meta-analysis (2023) · cites this paper as [37]
9 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Salanti, G., Ades, A. E., & Ioannidis, J. P. A. (2011) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.03.016 · Cited by 3,766 · cited 2×
“The ranking of the treatments should be done using probabilistic methods, for example using ‘rankograms’ or the surface under the cumulative ranking curve (SUCRA), which take into account the estimated effect sizes and their accompanying uncertainty [8].”
MethodSelf-citationInterpretation of random effects meta-analyses
Riley, R. D., Higgins, J. P. T., & Deeks, J. J. (2011) · BMJ · doi:10.1136/bmj.d549 · Cited by 2,884
Self-citationGRADE guidelines: 4. Rating the quality of evidence—study limitations (risk of bias)
Guyatt, G. H., Oxman, A. D., Vist, G., Kunz, R., Brozek, J., Alonso-Coello, P., Montori, V., Akl, E. A., Djulbegovic, B., & Falck-Ytter, Y. (2011) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.07.017 · Cited by 2,798 · cited 2×
“In the GRADE approach, randomized trials are evaluated according to generation of the allocation sequence, concealment of the allocation sequence, blinding, incomplete accounting of participants and outcome events, selective outcome reporting bias and other limitations [15].”
MethodA Re-Evaluation of Random-Effects Meta-Analysis
Higgins, J. P. T., Thompson, S. G., & Spiegelhalter, D. J. (2009) · Journal of the Royal Statistical Society Series A: Statistics in Society · doi:10.1111/j.1467-985x.2008.00552.x · Cited by 2,569 · cited 1×
“A particularly convenient way to do this is to look at predictive intervals for the effect in a new study of each comparison [14;25;26].”
BackgroundSelf-citationChecking consistency in mixed treatment comparison meta-analysis
Dias, S., Welton, N. J., Caldwell, D. M., & Ades, A. E. (2010) · Statistics in Medicine · doi:10.1002/sim.3767 · Cited by 2,521 · cited 1×
“Approaches that focus on evaluating the involvement of a particular comparison in network inconsistency (such as the node-splitting approach or simple comparisons of direct and indirect estimates [22;23]) are more relevant to making judgements about (pairwise) network meta-analysis effect estimates than are global ass…”
BackgroundSelf-citationGraphical tools for network meta-analysis in STATA
Chaimani, A., Higgins, J. P. T., Mavridis, D., Spyridonos, P., & Salanti, G. (2013) · PLoS ONE · doi:10.1371/journal.pone.0076654 · Cited by 2,473 · cited 3×
“The contribution plot can be obtained in STATA (see [14]).”
BackgroundMethodSelf-citationGRADE guidelines: 7. Rating the quality of evidence—inconsistency
Guyatt, G. H., Oxman, A. D., Kunz, R., Woodcock, J., Brozek, J., Helfand, M., Alonso-Coello, P., Glasziou, P., Jaeschke, R., Akl, E. A., et al. (2011) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2011.03.017 · Cited by 2,320
Self-citationCombination of direct and indirect evidence in mixed treatment comparisons
Lu, G., & Ades, A. E. (2004) · Statistics in Medicine · doi:10.1002/sim.1875 · Cited by 2,166
Consistency and inconsistency in network meta-analysis: concepts and models for multi-arm studies
Higgins, J. P. T., Jackson, D., Barrett, J. K., Lu, G., Ades, A. E., & White, I. R. (2012) · Research Synthesis Methods · doi:10.1002/jrsm.1044 · Cited by 2,098 · cited 1×
“The design-by-treatment interaction inconsistency model [29] produces a statistically significant test result for the presence of inconsistency in the network (P = 0.”
BackgroundSelf-citationPeters, J. L., Sutton, A. J., Jones, D. R., Abrams, K. R., & Rushton, L. (2008) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2007.11.010 · Cited by 2,053
Cited by
Hutton, B., Salanti, G., Caldwell, D. M., Chaimani, A., Schmid, C. H., Cameron, C., Ioannidis, J. P. A., Straus, S., Thorlund, K., Jansen, J. P., et al. (2015) · Annals of Internal Medicine · doi:10.7326/m14-2385 · Cited by 8,269
Self-citationCipriani, A., Furukawa, T. A., Salanti, G., Chaimani, A., Atkinson, L. Z., Ogawa, Y., Leucht, S., Ruhe, H. G., Turner, E. H., Higgins, J. P. T., et al. (2018) · The Lancet · doi:10.1016/s0140-6736(17)32802-7 · Cited by 3,541
Self-citationCINeMA: an approach for assessing confidence in the results of a network meta-analysis
Nikolakopoulou, A., Higgins, J. P. T., Papakonstantinou, T., Chaimani, A., Del Giovane, C., Egger, M., & Salanti, G. (2020) · PLOS Medicine · doi:10.1371/journal.pmed.1003082 · Cited by 1,935
“In other words, we are not using assessments of confidence to decide whether to present direct or indirect (or combined) evidence, as has been suggested by others [4,5].”
BackgroundMethodInfluentialSelf-citationPuhan, M. A., Schunemann, H. J., Murad, M. H., Li, T., Brignardello-Petersen, R., Singh, J. A., Kessels, A. G., Guyatt, G. H., & for the GRADE Working Group (2014) · BMJ · doi:10.1136/bmj.g5630 · Cited by 1,812
Huhn, M., Nikolakopoulou, A., Schneider-Thoma, J., Krause, M., Samara, M., Peter, N., Arndt, T., Bäckers, L., Rothe, P., Cipriani, A., et al. (2019) · The Lancet · doi:10.1016/s0140-6736(19)31135-3 · Cited by 1,753
Self-citationThe Mass Production of Redundant, Misleading, and Conflicted Systematic Reviews and Meta‐analyses
IOANNIDIS, J. P. A. (2016) · The Milbank Quarterly · doi:10.1111/1468-0009.12210 · Cited by 1,483
Cortese, S., Adamo, N., Del Giovane, C., Mohr-Jensen, C., Hayes, A. J., Carucci, S., Atkinson, L. Z., Tessari, L., Banaschewski, T., Coghill, D., et al. (2018) · The Lancet Psychiatry · doi:10.1016/s2215-0366(18)30269-4 · Cited by 1,716
Pillinger, T., McCutcheon, R. A., Vano, L., Mizuno, Y., Arumuham, A., Hindley, G., Beck, K., Natesan, S., Efthimiou, O., Cipriani, A., et al. (2020) · The Lancet Psychiatry · doi:10.1016/s2215-0366(19)30416-x · Cited by 1,090
Network meta-analysis: an introduction for clinicians
Rouse, B., Chaimani, A., & Li, T. (2017) · Internal and Emergency Medicine · doi:10.1007/s11739-016-1583-7 · Cited by 875
“the indirect or mixed evidence overall [33].”
Self-citationCipriani, A., Zhou, X., Del Giovane, C., Hetrick, S. E., Qin, B., Whittington, C., Coghill, D., Zhang, Y., Hazell, P., Leucht, S., et al. (2016) · The Lancet · doi:10.1016/s0140-6736(16)30385-3 · Cited by 734
“21 To determine whether the results were aff ected by study characteristics, we did subgroup network meta-analyses in WinBUGS for primary outcomes according to the following variables: sex ratio, age group, treatment duration, severity of symptoms (see appendix p 12 for details), comorbid…”
Fluoride toothpastes of different concentrations for preventing dental caries
Walsh, T., Worthington, H. V., Glenny, A.-M., Marinho, V. C., & Jeroncic, A. (2019) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd007868.pub3 · Cited by 620
Cuijpers, P., Noma, H., Karyotaki, E., Cipriani, A., & Furukawa, T. A. (2019) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2019.0268 · Cited by 539
Papakonstantinou, T., Nikolakopoulou, A., Higgins, J. P. T., Egger, M., & Salanti, G. (2020) · Campbell Systematic Reviews · doi:10.1002/cl2.1080 · Cited by 596
Self-citationOwen, P. J., Miller, C. T., Mundell, N. L., Verswijveren, S. J. J. M., Tagliaferri, S. D., Brisby, H., Bowe, S. J., & Belavy, D. L. (2020) · British Journal of Sports Medicine · doi:10.1136/bjsports-2019-100886 · Cited by 544
Systemic pharmacological treatments for chronic plaque psoriasis: a network meta-analysis
Sbidian, E., Chaimani, A., Garcia-Doval, I., Do, G., Hua, C., Mazaud, C., Droitcourt, C., Hughes, C., Ingram, J. R., Naldi, L., et al. (2017) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd011535.pub2 · Cited by 433
Self-citationBrunoni, A. R., Chaimani, A., Moffa, A. H., Razza, L. B., Gattaz, W. F., Daskalakis, Z. J., & Carvalho, A. F. (2017) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2016.3644 · Cited by 520
“Credibility of Evidence and Limitations of the Present Review We combined the contributions of the direct comparisons for the 2 primary outcomes with the risk of bias assessments to obtain the percentage of information coming from low, unclear,andhighriskofbiasstudies.(112)Thedatapresented ineFigure9 in Supplement 2 i…”
MethodSelf-citationPalmer, S. C., Mavridis, D., Nicolucci, A., Johnson, D. W., Tonelli, M., Craig, J. C., Maggo, J., Gray, V., De Berardis, G., Ruospo, M., et al. (2016) · JAMA · doi:10.1001/jama.2016.9400 · Cited by 420
Zhou, X., Teng, T., Zhang, Y., Del Giovane, C., Furukawa, T. A., Weisz, J. R., Li, X., Cuijpers, P., Coghill, D., Xiang, Y., et al. (2020) · The Lancet Psychiatry · doi:10.1016/s2215-0366(20)30137-1 · Cited by 367
Black, C. J., Staudacher, H. M., & Ford, A. C. (2022) · Gut · doi:10.1136/gutjnl-2021-325214 · Cited by 353
Siontis, G. C. M., Stefanini, G. G., Mavridis, D., Siontis, K. C., Alfonso, F., Pérez-Vizcayno, M. J., Byrne, R. A., Kastrati, A., Meier, B., Salanti, G., et al. (2015) · The Lancet · doi:10.1016/s0140-6736(15)60657-2 · Cited by 349
Self-citationCipriani, A., Furukawa, T. A., Salanti, G., Chaimani, A., Atkinson, L. Z., Ogawa, Y., Leucht, S., Ruhe, H. G., Turner, E. H., Higgins, J. P. T., et al. (2018) · Focus · doi:10.1176/appi.focus.16407 · Cited by 328
Self-citationVisualizing Assumptions and Results in Network Meta-analysis: The Network Graphs Package
Chaimani, A., & Salanti, G. (2015) · The Stata Journal: Promoting communications on statistics and Stata · doi:10.1177/1536867x1501500402 · Cited by 323
“The bars are colored according to the bias level (see the edgecolor() option of the networkplot command), and their length is proportional to the percentage contribution of each direct comparison to the network estimates (Salanti et al. 2014).”
Self-citationPage, M. J., McKenzie, J. E., & Higgins, J. P. T. (2018) · BMJ Open · doi:10.1136/bmjopen-2017-019703 · Cited by 278
Self-citationBiological soil health indicators respond to tillage intensity: A US meta-analysis
Nunes, M. R., Karlen, D. L., Veum, K. S., Moorman, T. B., & Cambardella, C. A. (2020) · Geoderma · doi:10.1016/j.geoderma.2020.114335 · Cited by 298
De Crescenzo, F., Ciabattini, M., D’Alò, G. L., De Giorgi, R., Del Giovane, C., Cassar, C., Janiri, L., Clark, N., Ostacher, M. J., & Cipriani, A. (2018) · PLOS Medicine · doi:10.1371/journal.pmed.1002715 · Cited by 274
“…the Cochrane tool [15], Three authors (FDC, CDG, AC) used the Grading of Recommendations Assessment, Development and Evaluation (GRADE) approach [16], through the Confidence in Network Meta-Analysis Software (CINeMA) [17], to evaluate the strength of evidence for results at the end of treatment…”
MethodWeibel, S., Rücker, G., Eberhart, L. H., Pace, N. L., Hartl, H. M., Jordan, O. L., Mayer, D., Riemer, M., Schaefer, M. S., Raj, D., et al. (2020) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd012859.pub2 · Cited by 168
Schwingshackl, L., Chaimani, A., Hoffmann, G., Schwedhelm, C., & Boeing, H. (2018) · European Journal of Epidemiology · doi:10.1007/s10654-017-0352-x · Cited by 273
Self-citationAnti-vascular endothelial growth factor for diabetic macular oedema: a network meta-analysis
Virgili, G., Parravano, M., Evans, J. R., Gordon, I., & Lucenteforte, E. (2017) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd007419.pub5 · Cited by 228
Terkawi, A. S., Mavridis, D., Sessler, D. I., Nunemaker, M. S., Doais, K. S., Terkawi, R. S., Terkawi, Y. S., Petropoulou, M., & Nemergut, E. C. (2017) · Anesthesiology · doi:10.1097/aln.0000000000001607 · Cited by 255
“Treatment rankings based on SUCRA scores, from largest to smallest, were F/S/O (96), F/O (85), LP/S (85), LP (80), F/S (77), EA (69), FIC (58), F (41), LB (39), placebo (39), ITM (34), PA (31), ACB (30), AA (17), O (15), and finally PCA (3).”
Systemic treatments for metastatic cutaneous melanoma
Pasquali, S., Hadjinicolaou, A. V., Chiarion Sileni, V., Rossi, C. R., & Mocellin, S. (2018) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd011123.pub2 · Cited by 237
Riley, R. D., Jackson, D., Salanti, G., Burke, D. L., Price, M., Kirkham, J., & White, I. R. (2017) · BMJ · doi:10.1136/bmj.j3932 · Cited by 247
Self-citationUndertaking network meta‐analyses
Chaimani, A., Caldwell, D. M., Li, T., Higgins, J. P., & Salanti, G. (2019) · Cochrane Handbook for Systematic Reviews of Interventions · doi:10.1002/9781119536604.ch11 · Cited by 213
Self-citationVasopressors for hypotensive shock
Gamper, G., Havel, C., Arrich, J., Losert, H., Pace, N. L., Müllner, M., & Herkner, H. (2016) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd003709.pub4 · Cited by 239
Minoxidil: a comprehensive review
Gupta, A. K., Talukder, M., Venkataraman, M., & Bamimore, M. A. (2022) · Journal of Dermatological Treatment · doi:10.1080/09546634.2021.1945527 · Cited by 233
“We used the Grading of Recommendations Assessment, Development and Evaluation (GRADE) approach (91) to assess the quality of evidence across the six studies.”
MethodLack of evidence to favor specific preventive interventions in psychosis: a network meta‐analysis
Davies, C., Cipriani, A., Ioannidis, J. P. A., Radua, J., Stahl, D., Provenzani, U., McGuire, P., & Fusar‐Poli, P. (2018) · World Psychiatry · doi:10.1002/wps.20526 · Cited by 229
Interventions for the management of malignant pleural effusions: a network meta-analysis
Clive, A. O., Jones, H. E., Bhatnagar, R., Preston, N. J., & Maskell, N. (2016) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd010529.pub2 · Cited by 228
Network Meta-Analysis and Cost-Effectiveness Analysis of New Generation Antidepressants
Khoo, A. L., Zhou, H. J., Teng, M., Lin, L., Zhao, Y. J., Soh, L. B., Mok, Y. M., Lim, B. P., & Gwee, K. P. (2015) · CNS Drugs · doi:10.1007/s40263-015-0267-6 · Cited by 228
“meta-analysis, a common heterogeneity variance was assumed for every direct comparison [16].”
BackgroundFurukawa, T. A., Salanti, G., Atkinson, L. Z., Leucht, S., Ruhe, H. G., Turner, E. H., Chaimani, A., Ogawa, Y., Takeshima, N., Hayasaka, Y., et al. (2016) · BMJ Open · doi:10.1136/bmjopen-2015-010919 · Cited by 214
“GRADE quality assessment of all comparisons in the network We will also assess the quality of evidence contributing to network estimates of the main outcomes with the GRADE framework, which characterises the quality of a body of evidence on the basis of the study limitations, imprecision, inconsistency, indirectness a…”
BackgroundMethodSelf-citationTramacere, I., Del Giovane, C., Salanti, G., D'Amico, R., & Filippini, G. (2015) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd011381.pub2 · Cited by 210
Self-citationDautzenberg, L., Beglinger, S., Tsokani, S., Zevgiti, S., Raijmann, R. C. M. A., Rodondi, N., Scholten, R. J. P. M., Rutjes, A. W. S., Di Nisio, M., Emmelot‐Vonk, M., et al. (2021) · Journal of the American Geriatrics Society · doi:10.1111/jgs.17375 · Cited by 209
Suijkerbuijk, Y. B., Schaafsma, F. G., van Mechelen, J. C., Ojajärvi, A., Corbière, M., & Anema, J. R. (2017) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd011867.pub2 · Cited by 207
Antiepileptic drug monotherapy for epilepsy: a network meta-analysis of individual participant data
Nevitt, S. J., Sudell, M., Weston, J., Tudur Smith, C., & Marson, A. G. (2017) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd011412.pub3 · Cited by 161
Network meta-analyses should be the highest level of evidence in treatment guidelines
Leucht, S., Chaimani, A., Cipriani, A. S., Davis, J. M., Furukawa, T. A., & Salanti, G. (2016) · European Archives of Psychiatry and Clinical Neuroscience · doi:10.1007/s00406-016-0715-4 · Cited by 202
“This issue is examined in several ways including statistical tests that compare the direct and indirect evidence for all comparisons where both are available [17].”
Self-citationUncertainty in Treatment Rankings: Reanalysis of Network Meta-analyses of Randomized Trials
Trinquart, L., Attiche, N., Bafeta, A., Porcher, R., & Ravaud, P. (2016) · Annals of Internal Medicine · doi:10.7326/m15-2521 · Cited by 202
Bighelli, I., Salanti, G., Huhn, M., Schneider‐Thoma, J., Krause, M., Reitmeir, C., Wallis, S., Schwermann, F., Pitschel‐Walz, G., Barbui, C., et al. (2018) · World Psychiatry · doi:10.1002/wps.20577 · Cited by 199
“We evaluated the quality of evidence of primary outcome based on the Grading of Recommendations Assessment, Development and Evaluation (GRADE) framework, adapted to network meta-analyis (9).”
MethodSelf-citationA primer on network meta-analysis with emphasis on mental health
Mavridis, D., Giannatsi, M., Cipriani, A., & Salanti, G. (2015) · Evidence Based Mental Health · doi:10.1136/eb-2015-102088 · Cited by 198
Self-citationAiolfi, A., Cavalli, M., Ferraro, S. D., Manfredini, L., Bonitta, G., Bruni, P. G., Bona, D., & Campanelli, G. (2021) · Annals of Surgery · doi:10.1097/sla.0000000000004735 · Cited by 192
“The confidence in estimates of the outcome was assessed using Confidence in Network Meta-Analysis (CINeMA).(23) Statistical analyses were carried out using JAGS and R-Cran 3.”
MethodNew generation antidepressants for depression in children and adolescents: a network meta-analysis
Hetrick, S. E., McKenzie, J. E., Bailey, A. P., Sharma, V., Moller, C. I., Badcock, P. B., Cox, G., Merry, S., & Meader, N. (2021) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd013674.pub2 · Cited by 266
Anti-vascular endothelial growth factor for diabetic macular oedema: a network meta-analysis
Virgili, G., Parravano, M., Evans, J. R., Gordon, I., & Lucenteforte, E. (2018) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd007419.pub6 · Cited by 184
Pasquali, S., Yim, G., Vohra, R. S., Mocellin, S., Nyanhongo, D., Marriott, P., Geh, J. I., & Griffiths, E. A. (2017) · Annals of Surgery · doi:10.1097/sla.0000000000001905 · Cited by 183
“Evidence Grading The Grading of Recommendation, Assessment, Development and Evaluation system adapted to network meta-analysis was employed to grade the quality of evidence into 4 levels: high, moderate, low, and very low quality.(26) The quality can be downgraded by 1 (serious concern) or 2 levels (very serious conce…”
MethodPharmacological interventions for the treatment of delirium in critically ill adults
Burry, L., Hutton, B., Williamson, D. R., Mehta, S., Adhikari, N. K., Cheng, W., Ely, E. W., Egerod, I., Fergusson, D. A., & Rose, L. (2019) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd011749.pub2 · Cited by 175
Network meta-analysis explained
Dias, S., & Caldwell, D. M. (2019) · Archives of Disease in Childhood - Fetal and Neonatal Edition · doi:10.1136/archdischild-2018-315224 · Cited by 172
Self-citationSystemic pharmacological treatments for chronic plaque psoriasis: a network meta-analysis
Sbidian, E., Chaimani, A., Garcia-Doval, I., Doney, L., Dressler, C., Hua, C., Hughes, C., Naldi, L., Afach, S., & Le Cleach, L. (2020) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd011535.pub3 · Cited by 173
Self-citationPalpacuer, C., Duprez, R., Huneau, A., Locher, C., Boussageon, R., Laviolle, B., & Naudet, F. (2018) · Addiction · doi:10.1111/add.13974 · Cited by 172
“We assessed the quality of evidence contributing to each network estimate for total alcohol consumption (TAC) using the Grading of Recommendations Assessment, Development and Evaluation (GRADE) framework [30].”
MethodKishi, T., Ikuta, T., Matsuda, Y., Sakuma, K., Okuya, M., Mishima, K., & Iwata, N. (2021) · Molecular Psychiatry · doi:10.1038/s41380-020-00946-6 · Cited by 169
Merz, J., Schwarzer, G., & Gerger, H. (2019) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2019.0951 · Cited by 166
Systemic pharmacological treatments for chronic plaque psoriasis: a network meta-analysis
Sbidian, E., Chaimani, A., Garcia-Doval, I., Doney, L., Dressler, C., Hua, C., Hughes, C., Naldi, L., Afach, S., & Le Cleach, L. (2021) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd011535.pub4 · Cited by 170
Self-citationInterventions for myopia control in children: a living systematic review and network meta-analysis
Lawrenson, J. G., Shah, R., Huntjens, B., Downie, L. E., Virgili, G., Dhakal, R., Verkicharla, P. K., Li, D., Mavi, S., Kernohan, A., et al. (2023) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd014758.pub2 · Cited by 164
Effects of oils and solid fats on blood lipids: a systematic review and network meta-analysis
Schwingshackl, L., Bogensberger, B., Benčič, A., Knüppel, S., Boeing, H., & Hoffmann, G. (2018) · Journal of Lipid Research · doi:10.1194/jlr.p085522 · Cited by 162
Kishi, T., Ikuta, T., Matsuda, Y., Sakuma, K., Okuya, M., Nomura, I., Hatano, M., & Iwata, N. (2022) · Molecular Psychiatry · doi:10.1038/s41380-021-01334-4 · Cited by 161
Schwingshackl, L., Chaimani, A., Schwedhelm, C., Toledo, E., Pünsch, M., Hoffmann, G., & Boeing, H. (2019) · Critical Reviews in Food Science and Nutrition · doi:10.1080/10408398.2018.1463967 · Cited by 161
“To assess the credibility of evidence from the network metaanalysis, we used the GRADE system extended for network meta-analysis following the approach suggested by Salanti et al. (Supplemental Appendix 2) (Salanti et al. 2014).”
MethodSelf-citationCombining randomized and non-randomized evidence in network meta-analysis
Efthimiou, O., Mavridis, D., Debray, T. P. A., Samara, M., Belger, M., Siontis, G. C. M., Leucht, S., Salanti, G., & 4, O. B. O. G. W. P. (2017) · Statistics in Medicine · doi:10.1002/sim.7223 · Cited by 183
“The weights of pairwise meta-analyses in estimating each NMA treatment effect form the ‘hat matrix’ [52] and can also be presented in a contribution matrix [51].”
Self-citationAiolfi, A., Cavalli, M., Micheletto, G., Lombardo, F., Bonitta, G., Morlacchi, A., Bruni, P. G., Campanelli, G., & Bona, D. (2019) · Hernia · doi:10.1007/s10029-019-01964-2 · Cited by 159
Chaimani, A., Caldwell, D. M., Li, T., Higgins, J. P. T., & Salanti, G. (2017) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2016.11.015 · Cited by 158
“There are statistical means to examine heterogeneity in a NMA, such as an I-square, and the estimate of the common heterogeneity variance (6,67,68).”
BackgroundMethodInfluentialSelf-citationBisphosphonates in multiple myeloma: an updated network meta-analysis
Mhaskar, R. S., Kumar, A., Miladinović, B., & Djulbegović, B. (2017) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd003188.pub4 · Cited by 159
Miller, K. J., Gonçalves-Bradley, D. C., Areerob, P., Hennessy, D., Mesagno, C., & Grace, F. (2020) · Ageing Research Reviews · doi:10.1016/j.arr.2019.100999 · Cited by 152
Cipriani, A., Williams, T., Nikolakopoulou, A., Salanti, G., Chaimani, A., Ipser, J., Cowen, P. J., Geddes, J. R., & Stein, D. J. (2017) · Psychological Medicine · doi:10.1017/s003329171700349x · Cited by 161
“…the quality of evidence contributing to each network estimate using the GRADE framework, which characterises the quality of a body of evidence on the basis of the study limitations, imprecision, inconsistency, indirectness, and publication bias for the primary outcomes (Salanti et al. 2014).”
MethodSelf-citationWu, Y.-C., Tseng, P.-T., Tu, Y.-K., Hsu, C.-Y., Liang, C.-S., Yeh, T.-C., Chen, T.-Y., Chu, C.-S., Matsuoka, Y. J., Stubbs, B., et al. (2019) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2018.4365 · Cited by 148
Schwingshackl, L., Hoffmann, G., Iqbal, K., Schwedhelm, C., & Boeing, H. (2018) · The American Journal of Clinical Nutrition · doi:10.1093/ajcn/nqy151 · Cited by 147
“(28) for the primary outcomes (Supplemental Tables 16 and 17).”
BackgroundGianola, S., Bargeri, S., Castillo, G. D., Corbetta, D., Turolla, A., Andreano, A., Moja, L., & Castellini, G. (2021) · British Journal of Sports Medicine · doi:10.1136/bjsports-2020-103596 · Cited by 176
Krause, M., Zhu, Y., Huhn, M., Schneider‐Thoma, J., Bighelli, I., Chaimani, A., & Leucht, S. (2018) · European Neuropsychopharmacology · doi:10.1016/j.euroneuro.2018.03.008 · Cited by 163
Self-citationAu, W. Y., & Cheung, P. P.-H. (2022) · BMJ · doi:10.1136/bmj-2022-069989 · Cited by 143
“22 The plot was drawn with the function netmeta::funnel.”
BackgroundSystemic pharmacological treatments for chronic plaque psoriasis: a network meta-analysis
Sbidian, É., Chaimani, A., García-Doval, I., Doney, L., Dressler, C., Hua, C., Hughes, C., Naldi, L., Afach, S., & Cleach, L. L. (2022) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd011535.pub5 · Cited by 225
Self-citationPompoli, A., Furukawa, T. A., Imai, H., Tajika, A., Efthimiou, O., & Salanti, G. (2016) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd011004.pub2 · Cited by 142
Self-citationDressings and topical agents for treating venous leg ulcers
Norman, G., Westby, M. J., Rithalia, A. D., Stubbs, N. C., Soares, M. O., & Dumville, J. C. (2018) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd012583.pub2 · Cited by 186
“The contribution of each piece of indirect evidence to a mixed treatment contrast depends on its point estimate, precision and relative location within the network, and on that of any direct evidence or other indirect evidence (Chaimani 2013; Salanti 2014).”
BackgroundMethodDressings and securement devices for central venous catheters (CVC)
Ullman, A. J., Cooke, M. L., Mitchell, M. L., Lin, F. F., New, K., Long, D. A., Mihala, G., & Rickard, C. M. (2015) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd010367.pub2 · Cited by 176
Giacoppo, D., Laudani, C., Occhipinti, G., Spagnolo, M., Greco, A., Rochira, C., Agnello, F. G., Landolina, D., Mauro, M. S., Finocchiaro, S., et al. (2024) · Circulation · doi:10.1161/circulationaha.123.067583 · Cited by 140
“12,13 In Bayesian analyses, overdispersed vague priors for a common distribution mean effect and uniform between-trial heterogeneity random-effects parameters were given.”
BackgroundMethodPalmer, S. C., Saglimbene, V. M., Mavridis, D., Salanti, G., Craig, J. C., Tonelli, M. A., Wiebe, N., & Strippoli, G. F. (2014) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd010590.pub2 · Cited by 157
Self-citationSystemic pharmacological treatments for chronic plaque psoriasis: a network meta-analysis
Sbidian, É., Chaimani, A., Guelimi, R., García-Doval, I., Hua, C., Hughes, C., Naldi, L., Kinberger, M., Afach, S., & Cleach, L. L. (2023) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd011535.pub6 · Cited by 204
Self-citationKishi, T., Ikuta, T., Sakuma, K., Okuya, M., Hatano, M., Matsuda, Y., & Iwata, N. (2023) · Molecular Psychiatry · doi:10.1038/s41380-022-01824-z · Cited by 136
Comparative efficacy of cartilage repair procedures in the knee: a network meta-analysis
Riboh, J. C., Cvetanovich, G. L., Cole, B. J., & Yanke, A. B. (2016) · Knee Surgery Sports Traumatology Arthroscopy · doi:10.1007/s00167-016-4300-1 · Cited by 132
Zhu, Y., Krause, M., Huhn, M., Rothe, P., Schneider‐Thoma, J., Chaimani, A., Li, C., Davis, J. M., & Leucht, S. (2017) · The Lancet Psychiatry · doi:10.1016/s2215-0366(17)30270-5 · Cited by 136
Self-citationOstuzzi, G., Bertolini, F., Tedeschi, F., Vita, G., Brambilla, P., Fabro, L. D., Gastaldon, C., Papola, D., Purgato, M., Nosari, G., et al. (2022) · World Psychiatry · doi:10.1002/wps.20972 · Cited by 148
de Zoete, R. M. J., Armfield, N. R., McAuley, J. H., Chen, K. S.-M., & Sterling, M. M. (2020) · British Journal of Sports Medicine · doi:10.1136/bjsports-2020-102664 · Cited by 162
Spadaccini, M., Iannone, A., Maselli, R., Badalamenti, M., Desai, M., Chandrasekar, V. T., Patel, H. K., Fugazza, A., Pellegatta, G., Galtieri, P. A., et al. (2021) · The Lancet. Gastroenterology & hepatology · doi:10.1016/s2468-1253(21)00215-6 · Cited by 139
Interventions to promote adherence to antiretroviral therapy in Africa: a network meta-analysis
Mills, E. J., Lester, R. T., Thorlund, K., Lorenzi, M. F., Muldoon, K. A., Kanters, S., Linnemayr, S., Gross, R., Calderon, Y., Amico, K. R., et al. (2014) · The Lancet HIV · doi:10.1016/s2352-3018(14)00003-4 · Cited by 131
Tramacere, I., Boncoraglio, G. B., Banzi, R., Giovane, C. D., Kwag, K. H., Squizzato, A., & Moja, L. (2019) · BMC Medicine · doi:10.1186/s12916-019-1298-5 · Cited by 140
Efficacy of Probiotics in Irritable Bowel Syndrome: Systematic Review and Meta-analysis
Goodoory, V. C., Khasawneh, M., Black, C. J., Quigley, E. M. M., Moayyedi, P., & Ford, A. C. (2023) · Gastroenterology · doi:10.1053/j.gastro.2023.07.018 · Cited by 128
Yin, S., Xu, P., Wang, B., Lu, Y., Wu, Q., Zhou, M.-L., Wu, J., Cai, J., Sun, X., & Yuan, H. (2019) · BMJ · doi:10.1136/bmj.l2222 · Cited by 127
El‐Boghdadly, K., Desai, N., Halpern, S. H., Blake, L., Odor, P. M., Bampoe, S., Carvalho, B., & Sultan, P. (2020) · Anaesthesia · doi:10.1111/anae.15160 · Cited by 121
Introducing the Treatment Hierarchy Question in Network Meta-Analysis
Salanti, G., Nikolakopoulou, A., Efthimiou, O., Mavridis, D., Egger, M., & White, I. R. (2021) · American Journal of Epidemiology · doi:10.1093/aje/kwab278 · Cited by 124
“An attempt to produce statements about the credibility of ranking can be found in Salanti et al. (23) and is subject to ongoing research extending the Confidence in Network Meta-Analysis (CINeMA) framework (24).”
Self-citationAntiepileptic drug monotherapy for epilepsy: a network meta-analysis of individual participant data
Nevitt, S. J., Sudell, M., Cividini, S., Marson, A. G., & Smith, C. T. (2022) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd011412.pub4 · Cited by 164
Yue, J.-L., Chang, X.-W., Zheng, J.-W., Shi, L., Xiang, Y., Que, J., Yuan, K., Teng, T., Teng, T., Li, Y., et al. (2023) · Sleep Medicine Reviews · doi:10.1016/j.smrv.2023.101746 · Cited by 132
Tseng, C., Chen, T.-T., Wu, M., Chan, M.-C., Shih, M., & Tu, Y. (2020) · Critical Care · doi:10.1186/s13054-020-03419-y · Cited by 123
Fujii, T., Salanti, G., Belletti, A., Bellomo, R., Carr, A. C., Furukawa, T. A., Luethi, N., Luo, Y., Putzu, A., Sartini, C., et al. (2021) · Intensive Care Medicine · doi:10.1007/s00134-021-06558-0 · Cited by 118
“The transitivity assumption was evaluated by comparing the distribution of potential effect modifiers across treatment comparisons [21].”
Self-citationWeibel, S., Schaefer, M. S., Raj, D., Rücker, G., Pace, N. L., Schlesinger, T., Meybohm, P., Kienbaum, P., Eberhart, L. H. J., & Kranke, P. (2020) · Anaesthesia · doi:10.1111/anae.15295 · Cited by 120
Antiepileptic drug monotherapy for epilepsy: a network meta-analysis of individual participant data
Nevitt, S. J., Sudell, M., Weston, J., Smith, C. T., & Marson, A. G. (2017) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd011412.pub2 · Cited by 138
Interventions for the management of malignant pleural effusions: a network meta-analysis
Dipper, A., Jones, H. E., Bhatnagar, R., Preston, N. J., Maskell, N. A., & Clive, A. O. (2020) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd010529.pub3 · Cited by 112
Research Techniques Made Simple: Network Meta-Analysis
Watt, J. A., Tricco, A. C., Straus, S. E., Veroniki, A. A., Naglie, G., & Drucker, A. M. (2018) · Journal of Investigative Dermatology · doi:10.1016/j.jid.2018.10.028 · Cited by 108
“It provides a framework for determining the quality of evidence in NMA-derived effect estimates for each outcome (Brignardello-Petersen et al., 2018; Salanti et al., 2014).”
BackgroundRomandini, M., Tullio, I. D., Congedi, F., Kalemaj, Z., D'Ambrosio, M., Laforí, A., Quaranta, C., Buti, J., & Perfetti, G. (2019) · Journal Of Clinical Periodontology · doi:10.1111/jcpe.13080 · Cited by 121
Metadata
- Authors
- Salanti, G., Del Giovane, C., Chaimani, A., Caldwell, D. M., & Higgins, J. P. T.
- Affiliations
- University of Ioannina (GR)
- University of Bristol (GB)
- Corresponding author
- Higgins, Julian P. T.
- Venue
- PLoS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2014-07-03
- Volume
- 9
- Issue
- 7
- Pages
- e99682
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC4084629
- OpenAlex
- W2074147400
- Cited by
- 1,402
- References
- 32
- Citations by year
- 2026: 116 · 2025: 181 · 2024: 150 · 2023: 144 · 2022: 151 · 2021: 170 · 2020: 152 · 2019: 115 · 2018: 96 · 2017: 56 · 2016: 46 · 2015: 17 · 2014: 8
- FWCI
- 41.47
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- PLoS ONE (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- IRIS UNIMORE (University of Modena and Reggio Emilia) (submittedVersion, cc-by)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Figshare (submittedVersion, cc-by)
- Bristol Research (University of Bristol) (submittedVersion)
- Funders
- Medical Research Council (MR/K025643/1, MR/K023233/1, G0902118)
- FP7 Ideas: European Research Council (260559)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Sociology and Political Science › Delphi Technique in Research
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Clinical practice guidelines implementation
- Keywords
- network meta-analysis, quality of evidence, indirect comparison, transitivity assumption, direct and indirect evidence, treatment ranking, GRADE framework, topical antibiotics, chronic otitis media, tympanic membrane perforation
- MeSH terms
- Humans, Models, Theoretical, Meta-Analysis as Topic
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.