Evaluating the Quality of Evidence from a Network Meta-Analysis
Open accessThe DOI matches its Crossref record; 32 of the 32 references it cites were found in a registry or an index.
Abstract
Systematic reviews that collate data about the relative effects of multiple interventions via network meta-analysis are highly informative for decision-making purposes. A network meta-analysis provides two types of findings for a specific outcome: the relative treatment effect for all pairwise comparisons, and a ranking of the treatments. It is important to consider the confidence with which these two types of results can enable clinicians, policy makers and patients to make informed decisions. We propose an approach to determining confidence in the output of a network meta-analysis. Our proposed approach is based on methodology developed by the Grading of Recommendations Assessment, Development and Evaluation (GRADE) Working Group for pairwise meta-analyses. The suggested framework for evaluating a network meta-analysis acknowledges (i) the key role of indirect comparisons (ii) the contributions of each piece of direct evidence to the network meta-analysis estimates of effect size; (iii) the importance of the transitivity assumption to the validity of network meta-analysis; and (iv) the possibility of disagreement between direct evidence and indirect evidence. We apply our proposed strategy to a systematic review comparing topical antibiotics without steroids for chronically discharging ears with underlying eardrum perforations. The proposed framework can be used to determine confidence in the results from a network meta-analysis. Judgements about evidence from a network meta-analysis can be different from those made about evidence from pairwise meta-analyses.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures







Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Finally, to assess the credibility of the findings of each network meta-analysis, the findings were incorporated into the Confidence in Network Meta-Analysis (CINeMA) application, which is an adaptation of the Grading of Recommendations Assessment, Development, and Evaluation approach [19–21].”
From Antidepressants for the treatment of adults with major depressive disorder in the maintenance phase: a systematic review and network meta-analysis (2023) · cites this paper as [19]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“We rated the credibility of the evidence included in the network meta-analysis using CINeMA33 (appendix pp 16–17).”
From Comparative effectiveness and risk of preterm birth of local treatments for cervical intraepithelial neoplasia and stage IA1 cervical cancer: a systematic review and network meta-analysis (2022) · cites this paper as [33]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Additionally, we assessed the certainty of evidence contributing to network estimates of the main outcomes with the Grading of Recommendations Assessment, Development and Evaluation (GRADE) framework.15”
The cited source says what the claim attributes to it.
In the citing paper
“Where there appeared to be a bene fi t of probiotics over placebo in analyses containing more than 1 RCT, we assessed the level of certainty of evidence according to GRADE criteria. 37”
From Efficacy of Probiotics in Irritable Bowel Syndrome: Systematic Review and Meta-analysis (2023) · cites this paper as [37]
The cited source says what the claim attributes to it.
In the citing paper
“However, due to a combination of 1 or more of heterogeneity between studies, possible publication bias, risk of bias of studies, and modest ef fi cacy, the level of certainty of evidence would not be graded as anything more than low or very low, according to GRADE criteria, 37 in almost all of our analyses.”
From Efficacy of Probiotics in Irritable Bowel Syndrome: Systematic Review and Meta-analysis (2023) · cites this paper as [37]
9 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Salanti, G., Ades, A. E., & Ioannidis, J. P. A. (2011) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.03.016 · Cited by 3,766 · cited 2×
“The ranking of the treatments should be done using probabilistic methods, for example using ‘rankograms’ or the surface under the cumulative ranking curve (SUCRA), which take into account the estimated effect sizes and their accompanying uncertainty [8].”
MethodSelf-citationInterpretation of random effects meta-analyses
Riley, R. D., Higgins, J. P. T., & Deeks, J. J. (2011) · BMJ · doi:10.1136/bmj.d549 · Cited by 2,884
Self-citationGRADE guidelines: 4. Rating the quality of evidence—study limitations (risk of bias)
Guyatt, G. H., Oxman, A. D., Vist, G., Kunz, R., Brozek, J., Alonso-Coello, P., Montori, V., Akl, E. A., Djulbegovic, B., & Falck-Ytter, Y. (2011) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.07.017 · Cited by 2,798 · cited 2×
“In the GRADE approach, randomized trials are evaluated according to generation of the allocation sequence, concealment of the allocation sequence, blinding, incomplete accounting of participants and outcome events, selective outcome reporting bias and other limitations [15].”
MethodA Re-Evaluation of Random-Effects Meta-Analysis
Higgins, J. P. T., Thompson, S. G., & Spiegelhalter, D. J. (2009) · Journal of the Royal Statistical Society Series A: Statistics in Society · doi:10.1111/j.1467-985x.2008.00552.x · Cited by 2,569 · cited 1×
“A particularly convenient way to do this is to look at predictive intervals for the effect in a new study of each comparison [14;25;26].”
BackgroundSelf-citationChecking consistency in mixed treatment comparison meta-analysis
Dias, S., Welton, N. J., Caldwell, D. M., & Ades, A. E. (2010) · Statistics in Medicine · doi:10.1002/sim.3767 · Cited by 2,521 · cited 1×
“Approaches that focus on evaluating the involvement of a particular comparison in network inconsistency (such as the node-splitting approach or simple comparisons of direct and indirect estimates [22;23]) are more relevant to making judgements about (pairwise) network meta-analysis effect estimates than are global ass…”
BackgroundSelf-citationGraphical tools for network meta-analysis in STATA
Chaimani, A., Higgins, J. P. T., Mavridis, D., Spyridonos, P., & Salanti, G. (2013) · PLoS ONE · doi:10.1371/journal.pone.0076654 · Cited by 2,473 · cited 3×
“The contribution plot can be obtained in STATA (see [14]).”
BackgroundMethodSelf-citationGRADE guidelines: 7. Rating the quality of evidence—inconsistency
Guyatt, G. H., Oxman, A. D., Kunz, R., Woodcock, J., Brozek, J., Helfand, M., Alonso-Coello, P., Glasziou, P., Jaeschke, R., Akl, E. A., et al. (2011) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2011.03.017 · Cited by 2,320
Self-citationCombination of direct and indirect evidence in mixed treatment comparisons
Lu, G., & Ades, A. E. (2004) · Statistics in Medicine · doi:10.1002/sim.1875 · Cited by 2,166
Consistency and inconsistency in network meta-analysis: concepts and models for multi-arm studies
Higgins, J. P. T., Jackson, D., Barrett, J. K., Lu, G., Ades, A. E., & White, I. R. (2012) · Research Synthesis Methods · doi:10.1002/jrsm.1044 · Cited by 2,098 · cited 1×
“The design-by-treatment interaction inconsistency model [29] produces a statistically significant test result for the presence of inconsistency in the network (P = 0.”
BackgroundSelf-citationPeters, J. L., Sutton, A. J., Jones, D. R., Abrams, K. R., & Rushton, L. (2008) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2007.11.010 · Cited by 2,053
Cited by
Items 101–200 of 999
Nikolakopoulou, A., Mavridis, D., Furukawa, T. A., Cipriani, A., Tricco, A. C., Straus, S. E., Siontis, G. C. M., Egger, M., & Salanti, G. (2018) · BMJ · doi:10.1136/bmj.k585 · Cited by 107
Self-citationChaimani, A., Salanti, G., Leucht, S., Geddes, J. R., & Cipriani, A. (2017) · Evidence Based Mental Health · doi:10.1136/eb-2017-102753 · Cited by 106
Self-citationDressings and topical agents for treating pressure ulcers
Westby, M. J., Dumville, J. C., Soares, M. O., Stubbs, N. C., & Norman, G. (2017) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd011947.pub2 · Cited by 146
Support surfaces for pressure ulcer prevention: A network meta-analysis
Shi, C., Dumville, J. C., & Cullum, N. A. (2018) · PLoS ONE · doi:10.1371/journal.pone.0192707 · Cited by 128
Effects of Probiotics in Preterm Infants: A Network Meta-analysis
Chi, C., Li, C., Buys, N. J., Wang, W., Yin, C., & Sun, J. (2020) · PEDIATRICS · doi:10.1542/peds.2020-0706 · Cited by 114
Lawlor, E. R., Islam, N., Bates, S., Griffin, S. J., Hill, A. J., Hughes, C. A., Sharp, S. J., & Ahern, A. L. (2020) · Obesity Reviews · doi:10.1111/obr.13013 · Cited by 103
“To compare types of 3wCBT, random-effects network metaanalysis of RCTs was conducted to estimate the indirect and mixed (direct plus indirect) evidence.(53) Basic assumptions were checked conceptually and statistically.”
BackgroundMethodJing, T., Zhang, S., Bai, M., Chen, Z., Gao, S., Li, S., & Zhang, J. (2023) · Nutrients · doi:10.3390/nu15143156 · Cited by 139
Bellos, I., Pergialiotis, V., Papapanagiotou, A., Loutradis, D., & Daskalakis, G. (2020) · American Journal of Obstetrics and Gynecology · doi:10.1016/j.ajog.2020.03.016 · Cited by 102
Wu, H., Zhou, P., Lin, X., Wang, S., & Zhang, S. (2021) · Journal of Assisted Reproduction and Genetics · doi:10.1007/s10815-021-02125-0 · Cited by 115
“We estimated the ranking probabilities for all treatments of being at each possible rank for each intervention and the treatment hierarchy was summarized as surface under the cumulative ranking curve [23].”
MethodProgestogens for preventing miscarriage: a network meta-analysis
Devall, A., Papadopoulou, A., Podesek, M., Haas, D. M., Price, M. J., Coomarasamy, A., & Gallos, I. D. (2021) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd013792.pub2 · Cited by 146
“Salanti 2014 Salanti G, Del Giovane C, Chaimani A, Caldwell DM, Higgins JP. Evaluating the quality of evidence from a network metaanalysis.”
BackgroundMethodTwenty years of network meta‐analysis: Continuing controversies and recent developments
Ades, A. E., Welton, N. J., Dias, S., Phillippo, D., & Caldwell, D. M. (2024) · Research Synthesis Methods · doi:10.1002/jrsm.1700 · Cited by 127
“98,132,134,136 However quality or confidence ratings for NMA estimates are generated, it is unclear how they are intended to impact on treatment decisions, because there is no relation between the confidence in evidence and the impact of that evidence on the rank ordering of treatments.”
Self-citationPapageorgiou, S. N., Papageorgiou, P., Deschner, J., & Götz, W. (2016) · Journal of Dentistry · doi:10.1016/j.jdent.2016.03.010 · Cited by 100
What phytotherapy needs: Evidence‐based guidelines for better clinical practice
Colalto, C. (2017) · Phytotherapy Research · doi:10.1002/ptr.5977 · Cited by 121
“In this methodology, the clinical decisions —and also the related recommendations and their strength— depend on the research evidence (Brozek et al., 2009; Salanti et al., 2014).”
BackgroundRheumatoid arthritis risk in periodontitis patients: A systematic review and meta-analysis
Qiao, Y., Wang, Z., Li, Y., Han, Y., Zhou, Y., & Cao, X. (2020) · Joint Bone Spine · doi:10.1016/j.jbspin.2020.04.024 · Cited by 98
Meta-Analysis and Meta-Synthesis Methodologies: Rigorously Piecing Together Research
Leary, H., & Walker, A. E. (2018) · TechTrends · doi:10.1007/s11528-018-0312-7 · Cited by 136
Lemborexant vs suvorexant for insomnia: A systematic review and network meta-analysis
Kishi, T., Nomura, I., Matsuda, Y., Sakuma, K., Okuya, M., Ikuta, T., & Iwata, N. (2020) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2020.05.025 · Cited by 95
Chen, X., He, H., Xie, K., Zhang, L., & Cao, C. (2023) · Obesity Reviews · doi:10.1111/obr.13666 · Cited by 119
“33”
Watt, J. A., & Giovane, C. D. (2021) · Methods in molecular biology · doi:10.1007/978-1-0716-1566-9_12 · Cited by 110
Maneiro, J. R., Souto, A., & Gómez-Reino, J. J. (2017) · Seminars in Arthritis and Rheumatism · doi:10.1016/j.semarthrit.2017.02.007 · Cited by 98
Locher, C., Kossowsky, J., Koechlin, H., Lam, T. L., Barthel, J., Berde, C. B., Gaab, J., Schwarzer, G., Linde, K., & Meißner, K. (2020) · Archives of Pediatrics and Adolescent Medicine · doi:10.1001/jamapediatrics.2019.5856 · Cited by 106
Palmer, S. C., Tunnicliffe, D. J., Singh‐Grewal, D., Mavridis, D., Tonelli, M. A., Johnson, D. W., Craig, J. C., Tong, A., & Strippoli, G. F. (2017) · American Journal of Kidney Diseases · doi:10.1053/j.ajkd.2016.12.008 · Cited by 95
Surgical procedures in the pilonidal sinus disease: a systematic review and network meta-analysis
Bi, S., Sun, K., Chen, S., & Gu, J. (2020) · Scientific Reports · doi:10.1038/s41598-020-70641-7 · Cited by 106
Mo, J., Li, J., Yang, Z., Liu, Z., & Feng, J. (2017) · Annals of Clinical and Translational Neurology · doi:10.1002/acn3.469 · Cited by 90
Network meta-analysis: the highest level of medical evidence?
Faltinsen, E. G., Storebø, O. J., Jakobsen, J. C., Boesen, K., Lange, T., & Gluud, C. (2018) · BMJ Evidence-Based Medicine · doi:10.1136/bmjebm-2017-110887 · Cited by 91
“It is also vital to consider the transitivity assumption (see box 1) when assessing quality in network meta-analyses.(14) A recent meta-review found that 35 out of 77 (45%) network meta-analyses did not specify a plan on how to address possible effect modifiers, and the modifiers were inappropriately reported in 36 of…”
BackgroundLiang, K., Li, H., Bu, X., Li, X., Cao, L., Liu, J., Gao, Y., Li, B., Qiu, C., Bao, W., et al. (2021) · Translational Psychiatry · doi:10.1038/s41398-021-01453-0 · Cited by 90
Daly, C., Neupane, B., Beyene, J., Thabane, L., Straus, S. E., & Hamid, J. S. (2019) · BMJ Open · doi:10.1136/bmjopen-2018-024625 · Cited by 103
“34 The contribution of evidence within a direct comparison to an NMA has also been quantified.(35) However, given the limited information available on the study characteristics in the selected publicly available data sets, we explored only trial size (ie, total subjects) and the amount of information available (ie, nu…”
BackgroundCanullo, L., FABBRO, M. D., Khijmatgar, S., Panda, S., Ravidà, A., Tommasato, G., Sculean, A., & Pesce, P. (2021) · Clinical Oral Investigations · doi:10.1007/s00784-021-04248-1 · Cited by 94
“There are some proposed tools that were developed for interpreting the impact on results and decision making from network meta-analysis [126, 127].”
MethodNevill, C. R., Cooper, N. J., & Sutton, A. J. (2023) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2023.02.016 · Cited by 104
Sehmbi, H., Brull, R., Ceballos, K. R., Shah, U. J., Martin, J. E., Tobías, A., Solo, K., & Abdallah, F. W. (2020) · Anaesthesia · doi:10.1111/anae.15288 · Cited by 105
Athanasiou, A., Veroniki, A. A., Efthimiou, O., Kalliala, I., Naci, H., Bowden, S., Paraskevaidi, M., Arbyn, M., Lyons, D., Martin-Hirsch, P., et al. (2022) · The Lancet Oncology · doi:10.1016/s1470-2045(22)00334-5 · Cited by 112
Self-citationTurri, G., Ostuzzi, G., Vita, G., Barresi, V., Scarpa, A., Milella, M. S., Mazzarotto, R., Ruzzenente, A., Barbui, C., & Pedrazzani, C. (2024) · JAMA Network Open · doi:10.1001/jamanetworkopen.2024.14702 · Cited by 98
Weng, Q., Goh, S.-L., Wu, J., Persson, M. S. M., Wei, J., Sarmanova, A., Li, X., Hall, M., Doherty, M., Jiang, T., et al. (2023) · British Journal of Sports Medicine · doi:10.1136/bjsports-2022-105898 · Cited by 84
“30 31 The results were evaluated for evidence quality, which was classified into high, moderate, low or very low levels (online supplemental appendix 2).”
Pease, A., Lo, C., Earnest, A., Kiriakova, V., Liew, D., & Zoungas, S. (2020) · Diabetes Technology & Therapeutics · doi:10.1089/dia.2019.0417 · Cited by 83
Carvalho, H. N., Verdonck, M., Cools, W., Geerts, L., Forget, P., & Poelaert, J. (2020) · British Journal of Anaesthesia · doi:10.1016/j.bja.2020.05.063 · Cited by 89
Akshintala, V. S., Weiland, C. J. S., Bhullar, F. A., Kamal, A., Kanthasamy, K. A., Kuo, A., Tomasetti, C., Gürakar, M., Drenth, J. P. H., Yadav, D. K., et al. (2021) · The Lancet. Gastroenterology & hepatology · doi:10.1016/s2468-1253(21)00170-9 · Cited by 94
Wounds research for patient benefit: a 5-year programme of research
Cullum, N. A., Buckley, H., Dumville, J. C., Hall, J., Lamb, K. V., Madden, M., Morley, R., O’Meara, S., Saramago, P., Soares, M. O., et al. (2016) · Programme Grants for Applied Research · doi:10.3310/pgfar04130 · Cited by 107
Tsartsou, E., Proutsos, N., Castanas, E., & Kampa, M. (2019) · Frontiers in Nutrition · doi:10.3389/fnut.2019.00006 · Cited by 84
“Network Meta-Analysis (or indirect method meta-analysis) (53), was performed, using fixed effects.”
MethodLandry, E. C., Sandoval, X. C. R., Simeone, C. N., Tidball, G., Lea, J., & Westerberg, B. D. (2020) · Otology & Neurotology · doi:10.1097/mao.0000000000002472 · Cited by 82
“The plots calculated both inconsistency factors (IF) and heterogeneity variance (t(2)) (24).”
BackgroundChang, E., Josan, A. S., Purohit, R., Patel, C. K., & Xue, K. (2022) · Ophthalmology · doi:10.1016/j.ophtha.2022.06.042 · Cited by 91
Ostuzzi, G., Bertolini, F., Giovane, C. D., Tedeschi, F., Bovo, C., Gastaldon, C., Nosè, M., Ogheri, F., Papola, D., Purgato, M., et al. (2021) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2020.20071120 · Cited by 93
The efficacy of powered toothbrushes: A systematic review and network meta‐analysis
Thomassen, T. M. J. A., van der Weijden, G. A., & Slot, D. E. (2021) · International Journal of Dental Hygiene · doi:10.1111/idh.12563 · Cited by 102
Snetselaar, L., Cheek, J. J., Fox, S. S., Healy, H. S., Schweizer, M. L., Bao, W., Kamholz, J. A., & Titcomb, T. J. (2022) · Neurology · doi:10.1212/wnl.0000000000201371 · Cited by 94
“data, we used both local and global approaches.(18,19) Specifically, we used the side-splitting approach(20) to detect comparisons for which direct evidence disagrees with indirect evidence from the network.”
MethodZhou, X., Zhang, Y., Furukawa, T. A., Cuijpers, P., Pu, J., Weisz, J. R., Yang, L., Hetrick, S. E., Del Giovane, C., Cohen, D., et al. (2019) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2018.3070 · Cited by 80
“The certainty of the evidence for efficacy outcomeswas assessed using the Grading of Recommendations Assessment, Development and Evaluation (GRADE) framework across the following 5 domains: study limitations, imprecision, heterogeneity and inconsistency, indirectness, and publication bias.(29) The following subgroup a…”
MethodYu, Q., Wong, K.-K., Lei, O.-K., Nie, J., Shi, Q., Zou, L., & Kong, Z. (2022) · Sports Medicine - Open · doi:10.1186/s40798-022-00529-5 · Cited by 80
Aiolfi, A., Nosotti, M., Micheletto, G., Khor, D., Bonitta, G., Perali, C., Marin, J. N., Biraghi, T., & Bona, D. (2020) · Surgery · doi:10.1016/j.surg.2020.09.010 · Cited by 80
Jericho, B., Luo, A., & Berle, D. (2021) · Acta Psychiatrica Scandinavica · doi:10.1111/acps.13366 · Cited by 105
Fong, K. M., Au, S. Y., & Ng, G. W. Y. (2019) · Critical Care · doi:10.1186/s13054-019-2596-1 · Cited by 83
Kossmeier, M., Tran, U. S., & Voracek, M. (2020) · BMC Medical Research Methodology · doi:10.1186/s12874-020-0911-9 · Cited by 91
Mundre, P., Black, C. J., Mohammed, N., & Ford, A. C. (2020) · The Lancet. Gastroenterology & hepatology · doi:10.1016/s2468-1253(20)30296-x · Cited by 83
Devi, N., Madaan, P., Kandoth, N., Bansal, D., & Sahu, J. K. (2023) · Archives of Pediatrics and Adolescent Medicine · doi:10.1001/jamapediatrics.2022.5648 · Cited by 92
An overview of conducting systematic reviews with network meta-analysis
Caldwell, D. M. (2014) · Systematic Reviews · doi:10.1186/2046-4053-3-109 · Cited by 79
“Attention is turning to how approaches, such as GRADE, can be extended to NMA [40,41].”
MethodSelf-citationLi, K.-P., Yang, X.-S., & Wu, T. (2022) · Frontiers in Endocrinology · doi:10.3389/fendo.2022.810242 · Cited by 79
Bellos, I., Karageorgiou, V., Pergialiotis, V., & Perrea, D. N. (2020) · Clinical Microbiology and Infection · doi:10.1016/j.cmi.2020.03.019 · Cited by 78
Cheng, H.-Y., McGuinness, L. A., Elbers, R. G., MacArthur, G. J., Taylor, A., McAleenan, A., Dawson, S., López-López, J. A., Higgins, J. P. T., Cowlishaw, S., et al. (2020) · BMJ · doi:10.1136/bmj.m3934 · Cited by 78
Self-citationNiglio, S. A., Jia, R., Ji, J., Ruder, S. F., Patel, V. G., Martini, A., Sfakianos, J. P., Marqueen, K. E., Waingankar, N., Mehrazin, R., et al. (2019) · European Urology · doi:10.1016/j.eururo.2019.05.037 · Cited by 84
Concoff, A. L., Rosen, J. E., Fu, F. H., Bhandari, M., Boyer, K. M., Karlsson, J., Einhorn, T. A., & Schemitsch, E. H. (2019) · JBJS Reviews · doi:10.2106/jbjs.rvw.18.00150 · Cited by 85
Huhn, M., Nikolakopoulou, A., Schneider‐Thoma, J., Krause, M., Samara, M. T., Peter, N. L., Arndt, T. J., Bäckers, L., Rothe, P., Cipriani, A., et al. (2020) · FOCUS The Journal of Lifelong Learning in Psychiatry · doi:10.1176/appi.focus.18306 · Cited by 103
Self-citationCastellini, G., Pillastrini, P., Vanti, C., Bargeri, S., Giagio, S., Bordignon, E., Fasciani, F., Marzioni, F., Innocenti, T., Chiarotto, A., et al. (2022) · Journal of physiotherapy · doi:10.1016/j.jphys.2022.09.007 · Cited by 104
Interventions for heavy menstrual bleeding; overview of Cochrane reviews and network meta-analysis
Rodriguez, M. B., Dias, S., Jordan, V., Lethaby, A. E., Lensen, S. F., WISE, M. R., Wilkinson, J., Brown, J., & Farquhar, C. M. (2022) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd013180.pub2 · Cited by 113
Zheng, Q., Yang, H., Sun, L., Wei, R., Fu, X., Wang, Y., Huang, Y., Liu, Y., & Liu, W. J. (2020) · Pharmacological Research · doi:10.1016/j.phrs.2020.105020 · Cited by 78
Theta burst stimulation for depression: a systematic review and network and pairwise meta-analysis
Kishi, T., Ikuta, T., Sakuma, K., Hatano, M., Matsuda, Y., Wilkening, J., Goya-Maldonado, R., Tik, M., Williams, N. R., Kito, S., et al. (2024) · Molecular Psychiatry · doi:10.1038/s41380-024-02630-5 · Cited by 74
“Finally, the results were incorporated into the Con fi dence in Network Meta-Analysis application, an adaptation of the Grading of Recommendations Assessment, Development, and Evaluation approach, to evaluate the credibility of the fi ndings of each of the network meta-analyses [21 – 23].”
Wang, R., van Welie, N., van Rijswijk, J., JOHNSON, N. P., Norman, R. J., Dreyer, K., Mijatovic, V., & Mol, B. W. (2019) · Ultrasound in Obstetrics and Gynecology · doi:10.1002/uog.20238 · Cited by 76
Schwingshackl, L., Neuenschwander, M., Hoffmann, G., Buyken, A. E., & Schlesinger, S. (2020) · The American Journal of Clinical Nutrition · doi:10.1093/ajcn/nqz273 · Cited by 73
Kelley, G. A., Kelley, K. S., & Pate, R. R. (2019) · BMJ Open · doi:10.1136/bmjopen-2019-031220 · Cited by 90
“The a priori plan was to examine for the strength of evidence for network meta- analyses using the approach described by Salanti et al.96 However, since that time, an alternative approach has been suggested,97 with no clear consensus and continuing controversy on the best approach for network meta- analysis, including…”
MethodPhillippo, D. M., Dias, S., Welton, N. J., Caldwell, D. M., Taske, N., & Ades, A. E. (2019) · Annals of Internal Medicine · doi:10.7326/m18-3542 · Cited by 72
“(8) formally evaluates the influence of the direct evidence on each estimate and uses this to combine quality judgements from each piece of direct evidence into an overall quality assessment.”
Self-citationLiu, J.-W., Lin, S.-H., Wang, L.-C., Chiu, H.-Y., & Lee, J. (2021) · JAMA Network Open · doi:10.1001/jamanetworkopen.2021.19151 · Cited by 84
New generation antidepressants for depression in children and adolescents: a network meta-analysis
Hetrick, S. E., Meader, N., Bailey, A. P., Badcock, P. B., Moller, C. I., Cox, G., Merry, S., & McKenzie, J. E. (2020) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd013674 · Cited by 73
Yunitri, N., Chu, H., Kang, X. L., Wiratama, B. S., Lee, T., Chang, L., Liu, D., Kustanti, C. Y., Chiang, K., Chen, R., et al. (2023) · Psychological Medicine · doi:10.1017/s0033291722003737 · Cited by 93
“Regarding publication bias, a comparison-adjusted funnel plot by the order of appearance of the interventions (Salanti, Del Giovane, Chaimani, Caldwell, & Higgins, 2014) was produced by the netmeta package.”
MethodVandvik, P. O., Brignardello-Petersen, R., & Guyatt, G. H. (2016) · BMC Medicine · doi:10.1186/s12916-016-0596-4 · Cited by 69
“Authors have already presented two systems based on GRADE principles for making quality of evidence ratings in NMAs [21, 22].”
InfluentialComparative efficacy of methods for surfactant administration: a network meta-analysis
Bellos, I., Fitrou, G., Panza, R., & Pandita, A. (2021) · Archives of Disease in Childhood Fetal & Neonatal · doi:10.1136/archdischild-2020-319763 · Cited by 77
D’Antonio, F., Berghella, V., Mascio, D. D., Saccone, G., Sileo, F. G., Flacco, M. E., Odibo, A. O., Liberati, M., Manzoli, L., & Khalil, A. A. (2021) · European Journal of Obstetrics & Gynecology and Reproductive Biology · doi:10.1016/j.ejogrb.2021.04.023 · Cited by 76
Calpin, G. G., Ryan, F. R., McHugh, F. T., & McGuire, B. B. (2023) · British Journal of Urology · doi:10.1111/bju.16093 · Cited by 86
“The con fi dence in estimates of the outcome was assessed using ‘ Con fi dence in Network Meta-Analysis ’ (CINeMA) [29].”
Ribeiro, E. L. A., Lima, T. D. M., Vieira, M. E. B., Storpirtis, S., & Aguiar, P. M. (2018) · European Journal of Clinical Pharmacology · doi:10.1007/s00228-018-2498-1 · Cited by 102
“Network meta-analyses were evaluated, considering the adjustments proposed by Salanti et al., 2014 [13].”
MethodInterventions for unexplained infertility: a systematic review and network meta-analysis
Wang, R., Danhof, N. A., Tjon-Kon-Fat, R. I., Eijkemans, M. J. C., Bossuyt, P. M., Mochtar, M. H., van der Veen, F., Bhattacharya, S., Mol, B. W., & van Wely, M. (2019) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd012692.pub2 · Cited by 80
Zhu, Y., Zhang, C., Siafis, S., Zhuo, K., Zhu, D., Wu, H., Liu, D., Jiang, K., Wang, J., Leucht, S., et al. (2021) · Schizophrenia Research · doi:10.1016/j.schres.2021.08.013 · Cited by 69
Aiolfi, A., Gagner, M., Zappa, M. A., Lastraioli, C., Lombardo, F., Panizzo, V., Bonitta, G., Cavalli, M., Campanelli, G., & Bona, D. (2022) · Obesity Surgery · doi:10.1007/s11695-022-05950-z · Cited by 78
“The confidence in estimates of the outcome was assessed using Confidence in Network Meta-Analysis (CINeMA) [39].”
MethodJalalzadeh, H., Groenen, H., Buis, D. R., Dreissen, Y. E. M., Goosen, J. H. M., IJpma, F. F. A., van der Laan, M. J., Schaad, R. R., Segers, P., van der Zwet, W. C., et al. (2022) · The Lancet Microbe · doi:10.1016/s2666-5247(22)00187-2 · Cited by 88
Neuenschwander, M., HOFFMANN, G. E., Schwingshackl, L., & Schlesinger, S. (2019) · European Journal of Epidemiology · doi:10.1007/s10654-019-00534-1 · Cited by 77
Management of paediatric obstructive sleep apnoea: A systematic review and network meta‐analysis
Lin, S., Su, Y., Wu, Y., Chang, J. Z., & Tu, Y. (2019) · International Journal of Paediatric Dentistry · doi:10.1111/ipd.12593 · Cited by 74
The use of GRADE approach in systematic reviews of animal studies
Wei, D., Tang, K., Wang, Q., Estill, J. A. M., Yao, L., Wang, X., Chen, Y., & Yang, K. (2016) · Journal of Evidence-Based Medicine · doi:10.1111/jebm.12198 · Cited by 80
Datta, N. R., Stutz, E., Gómez, S., & Bodis, S. B. (2018) · International Journal of Radiation Oncology*Biology*Physics · doi:10.1016/j.ijrobp.2018.09.037 · Cited by 72
Belland, B. R., Walker, A. E., & Kim, N. J. (2017) · Review of Educational Research · doi:10.3102/0034654317723009 · Cited by 103
“But for Bayesian network meta-analysis to be of maximum utility in education research, there is a need for more multiple treatment studies to enhance researchers’ ability to (a) strengthen comparisons (Salanti et al., 2014) and (b) use a hierarchical approach to Bayesian network meta-analysis so as to address nesting…”
BackgroundInfluentialTedesco, T. K., Gimenez, T., Floriano, I., Montagner, A. F., Camargo, L. B., Calvo, A. F. B., Morimoto, S., & Raggio, D. P. (2018) · PLOS ONE · doi:10.1371/journal.pone.0206296 · Cited by 68
Rokkas, T., Gisbert, J. P., Gasbarrini, A., Hold, G. L., Tilg, H., Malfertheiner, P., Mégraud, F., & O’Morain, C. A. (2019) · United European Gastroenterology Journal · doi:10.1177/2050640619854587 · Cited by 75
“the inverse of variance of each direct comparison.(25) Rokkas et al.”
BackgroundMethodInfluentialThorlund, J. B., Simić, M., Pihl, K., Berthelsen, D. B., Day, R. O., Koes, B. W., & Juhl, C. B. (2022) · Journal of Orthopaedic and Sports Physical Therapy · doi:10.2519/jospt.2022.10490 · Cited by 74
Krause, M., Gutsmiedl, K., Bighelli, I., Schneider-Thoma, J., Chaimani, A., & Leucht, S. (2019) · European Neuropsychopharmacology · doi:10.1016/j.euroneuro.2019.07.130 · Cited by 65
Self-citationMinimally invasive treatments for benign prostatic hyperplasia: a Cochrane network meta‐analysis
Franco, J. V. A., Jung, J. H., Imamura, M., Borofsky, M. S., Omar, M. I., Liquitay, C. M. E., Young, S. J., Golzarian, J., Veroniki, A. A., Garegnani, L., et al. (2021) · British Journal of Urology · doi:10.1111/bju.15653 · Cited by 80
Factor XI Inhibitors in Early Clinical Trials: A Meta-analysis
Galli, M., Laborante, R., Ortega‐Paz, L., Franchi, F., Rollini, F., D’Amario, D., Capodanno, D., Tremoli, E., Gibson, C. M., Mehran, R., et al. (2023) · Thrombosis and Haemostasis · doi:10.1055/a-2043-0346 · Cited by 69
Brupbacher, G., Gerger, H., Zander-Schellenberg, T., Straus, D., Porschke, H., Gerber, M., von Känel, R., & Schmidt-Trucksäss, A. (2021) · Sleep Medicine Reviews · doi:10.1016/j.smrv.2021.101452 · Cited by 64
Treatment for HIV-associated cryptococcal meningitis
Tenforde, M. W., Shapiro, A. E., Rouse, B., Jarvis, J. N., Li, T., Eshun‐Wilson, I., & Ford, N. P. (2018) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd005647.pub3 · Cited by 77
“This Cochrane Review and NMA therefore incorporates new evidence to inform the best antifungal regimens for the treatment of HIV-associated cryptococcal meningitis.”
BackgroundMethodInfluentialAiolfi, A., Tornese, S., Bonitta, G., Rausa, E., Micheletto, G., & Bona, D. (2019) · Surgery for Obesity and Related Diseases · doi:10.1016/j.soard.2019.03.006 · Cited by 64
Interventions for convergence insufficiency: a network meta-analysis
Scheiman, M. M., Kulp, M. T., Cotter, S. A., Lawrenson, J. G., Wang, L., & Li, T. (2020) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd006768.pub3 · Cited by 89
Description of network meta-analysis geometry: A metrics design study
Tonin, F. S., Borba, H. H. L., Mendes, A. M., Wiens, A., Fernández-Llimós, F., & Pontarolo, R. (2019) · PLoS ONE · doi:10.1371/journal.pone.0212650 · Cited by 65
“This pattern may suggest study treatment preference bias (e.g. publication bias, missing outcome data), with strong or ubiquitous avoidance of head-to-head comparisons of active treatments [21, 48], and should be carefully interpreted.”
BackgroundZanjir, M., Lighvan, N. L., Yarascavitch, C., Beyene, J., Shah, P. S., & Azarpazhooh, A. (2019) · Journal of Endodontics · doi:10.1016/j.joen.2019.09.002 · Cited by 62
Bouché, P.-A., Corsia, S., Dechartres, A., Resche‐Rigon, M., & Nizard, R. (2020) · Clinical Orthopaedics and Related Research · doi:10.1097/corr.0000000000001324 · Cited by 64
Botta, C., Ciliberto, D., Rossi, M., Staropoli, N., Cucè, M., Galeano, T., Tagliaferri, P., & Tassone, P. (2017) · Blood Advances · doi:10.1182/bloodadvances.2016003905 · Cited by 67
“Loop inconsistency and heterogeneity were assessed by evaluating the logarithm of the ratio of 2 odds ratios (RoR) from direct and indirect evidence in the loop with the ifplot command in STATA.(21,22) RoR values close to 0 indicate that both direct and indirect evidence are in agreement.”
MethodInfluentialSystemic treatments for eczema: a network meta-analysis
Sawangjit, R., Dilokthornsakul, P., Lloyd-Lavery, A., Lai, N. M., Dellavalle, R. P., & Chaiyakunapruk, N. (2020) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd013206.pub2 · Cited by 80
Immune checkpoint inhibitors and targeted therapies for metastatic melanoma: A network meta-analysis
Pasquali, S., Chiarion‐Sileni, V., Rossi, C. R., & Mocellin, S. (2017) · Cancer Treatment Reviews · doi:10.1016/j.ctrv.2017.01.006 · Cited by 63
“Finally, since different comparisons might be characterized by a different risk of bias, the relative contribution of each direct evidence was properly accounted for, using the data from the network contribution matrix [45].”
MethodO'Connor, A. M., Hu, D., Totton, S. C., Scott, N., Winder, C. B., Wang, B., Wang, C., Glanville, J., Wood, H., White, B., et al. (2019) · Animal Health Research Reviews · doi:10.1017/s1466252320000031 · Cited by 60
“To describe the overall quality of the evidence network and the bias across the studies, we employed a modification of the GRADE approach for network meta-analysis (Salanti et al., 2014; Papakonstantinou et al., 2018) using the Confidence in Network Meta-Analysis (CINEMA) online software (http://cinema.”
Dressings and topical agents for treating venous leg ulcers
Norman, G., Dumville, J. C., Westby, M. J., Stubbs, N. C., & Soares, M. O. (2017) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd012583 · Cited by 74
Metadata
- Authors
- Salanti, G., Del Giovane, C., Chaimani, A., Caldwell, D. M., & Higgins, J. P. T.
- Affiliations
- University of Ioannina (GR)
- University of Bristol (GB)
- Corresponding author
- Higgins, Julian P. T.
- Venue
- PLoS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2014-07-03
- Volume
- 9
- Issue
- 7
- Pages
- e99682
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC4084629
- OpenAlex
- W2074147400
- Cited by
- 1,402
- References
- 32
- Citations by year
- 2026: 116 · 2025: 181 · 2024: 150 · 2023: 144 · 2022: 151 · 2021: 170 · 2020: 152 · 2019: 115 · 2018: 96 · 2017: 56 · 2016: 46 · 2015: 17 · 2014: 8
- FWCI
- 41.47
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- PLoS ONE (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- IRIS UNIMORE (University of Modena and Reggio Emilia) (submittedVersion, cc-by)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Figshare (submittedVersion, cc-by)
- Bristol Research (University of Bristol) (submittedVersion)
- Funders
- Medical Research Council (MR/K025643/1, MR/K023233/1, G0902118)
- FP7 Ideas: European Research Council (260559)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Sociology and Political Science › Delphi Technique in Research
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Clinical practice guidelines implementation
- Keywords
- network meta-analysis, quality of evidence, indirect comparison, transitivity assumption, direct and indirect evidence, treatment ranking, GRADE framework, topical antibiotics, chronic otitis media, tympanic membrane perforation
- MeSH terms
- Humans, Models, Theoretical, Meta-Analysis as Topic
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.