CINeMA: An approach for assessing confidence in the results of a network meta-analysis
Open accessThe DOI matches its Crossref record; 62 of the 62 references it cites were found in a registry or an index.
Abstract
BACKGROUND: The evaluation of the credibility of results from a meta-analysis has become an important part of the evidence synthesis process. We present a methodological framework to evaluate confidence in the results from network meta-analyses, Confidence in Network Meta-Analysis (CINeMA), when multiple interventions are compared. METHODOLOGY: CINeMA considers 6 domains: (i) within-study bias, (ii) reporting bias, (iii) indirectness, (iv) imprecision, (v) heterogeneity, and (vi) incoherence. Key to judgments about within-study bias and indirectness is the percentage contribution matrix, which shows how much information each study contributes to the results from network meta-analysis. The contribution matrix can easily be computed using a freely available web application. In evaluating imprecision, heterogeneity, and incoherence, we consider the impact of these components of variability in forming clinical decisions. CONCLUSIONS: Via 3 examples, we show that CINeMA improves transparency and avoids the selective use of evidence when forming judgments, thus limiting subjectivity in the process. CINeMA is easy to apply even in large and complicated networks.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures




Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Certainty of treatment effect estimates for each outcome at the treatment level were assessed using the Confidence in Network Meta-Analysis (CINeMA) approach, covering six domains of bias: within study bias, across study bias, indirectness, imprecision, heterogeneity, and inconsistency.50 51”
The cited source says what the claim attributes to it.
In the citing paper
“Finally, to assess the credibility of the findings of each network meta-analysis, the findings were incorporated into the Confidence in Network Meta-Analysis (CINeMA) application, which is an adaptation of the Grading of Recommendations Assessment, Development, and Evaluation approach [19–21].”
From Antidepressants for the treatment of adults with major depressive disorder in the maintenance phase: a systematic review and network meta-analysis (2023) · cites this paper as [20]
The cited source says what the claim attributes to it.
In the citing paper
“We applied the CINeMA web application, which facilitates the grading of confidence in the results as high, moderate, low, and very low (Nikolakopoulou et al., 2020) for primary outcomes.”
From Efficacy, acceptability and side-effects of oral versus long-acting- injectables antipsychotics: Systematic review and network meta-analysis (2024) · cites this paper as Nikolakopoulou et al., 2020
The cited source says what the claim attributes to it.
In the citing paper
“The Confidence in Network Meta-Analysis (CINeMA) tool [30, 31] was employed to assess the quality of evidence in six domains, including within-study bias, across-studies bias, indirectness, imprecision, heterogeneity, and incoherence.”
From Comparing caloric restriction regimens for effective weight management in adults: a systematic review and network meta-analysis (2024) · cites this paper as [30]
The cited source says what the claim attributes to it.
In the citing paper
“The certainty of evidence was evaluated using the CINeMA (Confidence in Network Meta-Analysis) framework, which adapts the GRADE approach for network meta-analyses, addressing within-study bias, reporting bias, indirectness, imprecision, heterogeneity, and inconsistency”
7 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
RoB 2: a revised tool for assessing risk of bias in randomised trials
Sterne, J. A. C., Savović, J., Page, M. J., Elbers, R. G., Blencowe, N. S., Boutron, I., Cates, C. J., Cheng, H.-Y., Corbett, M. S., Eldridge, S. M., et al. (2019) · BMJ · doi:10.1136/bmj.l4898 · Cited by 34,787
Self-citationThe Cochrane Collaboration's tool for assessing risk of bias in randomised trials
Higgins, J. P. T., Altman, D. G., Gotzsche, P. C., Juni, P., Moher, D., Oxman, A. D., Savovic, J., Schulz, K. F., Weeks, L., Sterne, J. A. C., et al. (2011) · BMJ · doi:10.1136/bmj.d5928 · Cited by 33,817
Self-citationDermyshi, E., Wang, Y., Yan, C., Hong, W., Qiu, G., Gong, X., & Zhang, T. (2017) · Neonatology · doi:10.1159/000454668 · Cited by 24,451
GRADE: an emerging consensus on rating quality of evidence and strength of recommendations
Guyatt, G. H., Oxman, A. D., Vist, G. E., Kunz, R., Falck-Ytter, Y., Alonso-Coello, P., & Schünemann, H. J. (2008) · BMJ · doi:10.1136/bmj.39489.470347.ad · Cited by 23,305
GRADE guidelines: 1. Introduction—GRADE evidence profiles and summary of findings tables
Guyatt, G., Oxman, A. D., Akl, E. A., Kunz, R., Vist, G., Brozek, J., Norris, S., Falck-Ytter, Y., Glasziou, P., & deBeer, H. (2011) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.04.026 · Cited by 10,681
Hutton, B., Salanti, G., Caldwell, D. M., Chaimani, A., Schmid, C. H., Cameron, C., Ioannidis, J. P. A., Straus, S., Thorlund, K., Jansen, J. P., et al. (2015) · Annals of Internal Medicine · doi:10.7326/m14-2385 · Cited by 8,269 · cited 1×
“org/cmi/about-us), based on previous work [4,16,17].”
Self-citationNorderyd, O. M., Koch, G., Papias, A., Köhler, A. A., Helkimo, A. N., Brahm, C., Lindmark, U., Lindfors, N., Mattsson, A., Rolander, B., et al. (2015) · PubMed · Cited by 3,584
Cipriani, A., Furukawa, T. A., Salanti, G., Chaimani, A., Atkinson, L. Z., Ogawa, Y., Leucht, S., Ruhe, H. G., Turner, E. H., Higgins, J. P. T., et al. (2018) · The Lancet · doi:10.1016/s0140-6736(17)32802-7 · Cited by 3,541 · cited 1×
“A third network, comparing the effectiveness of 18 antidepressants for major depression [12], is evaluated for all domains and is presented in S1 Text.”
Self-citationInterpretation of random effects meta-analyses
Riley, R. D., Higgins, J. P. T., & Deeks, J. J. (2011) · BMJ · doi:10.1136/bmj.d549 · Cited by 2,884
Self-citationGRADE guidelines: 4. Rating the quality of evidence—study limitations (risk of bias)
Guyatt, G. H., Oxman, A. D., Vist, G., Kunz, R., Brozek, J., Alonso-Coello, P., Montori, V., Akl, E. A., Djulbegovic, B., & Falck-Ytter, Y. (2011) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.07.017 · Cited by 2,798
Research works printed but not linked: 2
- 2017, CINeMA: Confidence in Network Meta-Analysis
- T Papakonstantinou, 2020, flow_contribution: R package to calculate contribution of studies in network meta-analysis, GitHub
Cited by
Items 701–800 of 1,004
Yoshihiro, S., Hongo, T., Yamamoto, M., Taito, S., & Kataoka, Y. (2023) · Critical Care Medicine · doi:10.1097/ccm.0000000000006114 · Cited by 7
Gao, X., Zhang, H., Fu, X., Yang, Y., & Dou, J. (2024) · Journal of Clinical Nursing · doi:10.1111/jocn.17136 · Cited by 12
Pessôa, R. L., Kessler, V. G., Becker, G. G., Garcia, G. M., Araldi, P. V. D., & Aver, P. V. (2024) · Vascular and Endovascular Surgery · doi:10.1177/15385744241253201 · Cited by 10
Furukawa, Y., Imai, K., Takahashi, Y., Efthimiou, O., & Leucht, S. (2024) · Schizophrenia Bulletin · doi:10.1093/schbul/sbae098 · Cited by 11
Sethasathien, S., Phinyo, P., Sittiwangkul, R., & Silvilairat, S. (2024) · Thrombosis Research · doi:10.1016/j.thromres.2024.109093 · Cited by 14
Monica, M., Reczek, M., & Kawalec, P. (2024) · Therapeutic Advances in Medical Oncology · doi:10.1177/17588359241263710 · Cited by 8
Yadgarov, M. Y., Бондоевич, Б. Л., Ракова, Е., & Likar, Y. (2024) · Clinical Nuclear Medicine · doi:10.1097/rlu.0000000000005412 · Cited by 8
Mellick, L. B., Walsh, P. F., Clanton, C., Kalra, S., & McKinney, S. M. (2024) · Pediatric Pulmonology · doi:10.1002/ppul.27391 · Cited by 8
“CINeMA, a specialized extension of the GRADE framework for network meta ‐ analyses, was also reported [29].”
Wang, G., Fu, J., Li, X., Wang, J., Zhai, J., & Du, B. (2024) · Diabetes Obesity and Metabolism · doi:10.1111/dom.16114 · Cited by 8
Norepinephrine vs. phenylephrine for spinal hypotension in cesarean section: a network meta-analysis
Imai, E., Kataoka, Y., Watanabe, J., Okano, H., Kamimura, Y., Tsuji, T., Ogura, Y., Kodaira, A., & Yamazaki, T. (2025) · Journal of Anesthesia · doi:10.1007/s00540-025-03528-4 · Cited by 14
“Two reviewers (EI and HO) assessed confidence in each outcome using the Confidence in Network Meta-Analysis (CIN-eMA) tool [38, 39], with a third reviewer (JW or Y. Kataoka) resolving disagreements.”
Zhao, L., Shi, P., Xiong, X., & Zeng, J. (2021) · Medicine · doi:10.1097/md.0000000000026864 · Cited by 7
Pergialiotis, V., Bellos, I., Douligeris, A., Thomakos, N., Rodolakis, A., & Haidopoulos, D. A. (2021) · European Journal of Surgical Oncology · doi:10.1016/j.ejso.2021.09.008 · Cited by 7
Motiwala, M. A., Gul, M., & Ghafoor, R. (2022) · Evidence-Based Dentistry · doi:10.1038/s41432-022-0827-9 · Cited by 7
Krishnan, A., Khurana, S., Sharma, S., & Menon, G. R. (2022) · International Journal of Microbiology Research · doi:10.4103/ijmr.ijmr_3275_20 · Cited by 7
Retrieval barriers in individual participant data reviews with network meta-analysis
Veroniki, A. A., Stewart, L. A., Le, S. P. C., Clarke, M. J., Tricco, A. C., & Straus, S. E. (2022) · BMJ Evidence-Based Medicine · doi:10.1136/bmjebm-2022-112024 · Cited by 7
Tustumi, F., Coelho, F. F., Magalhães, D. D. P., Júnior, S. S., Jeismann, V. B., Fonseca, G. M., Krüger, J. A. P., D′Albuquerque, L. A. C., & Herman, P. (2023) · Transplantation Reviews · doi:10.1016/j.trre.2023.100763 · Cited by 7
Li, M., Yang, Q., Shi, J., Zhang, X., Lin, H., & Ge, F. (2023) · BMC Neurology · doi:10.1186/s12883-023-03356-7 · Cited by 7
Roheger, M., Ernst, M., Folkerts, A., Krohm, F., Liebermann‐Jordanidis, H., Chakraverty, D., Droz, M., Adams, A., Eggers, C., Monsef, I., et al. (2021) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd013856 · Cited by 9
Luo, Y., Chaimani, A., Furukawa, T. A., Kataoka, Y., Ogawa, Y., Cipriani, A., & Salanti, G. (2020) · Research Synthesis Methods · doi:10.1002/jrsm.1413 · Cited by 6
Self-citationOsorio, D. L. S., Maldonado, D., Rijs, K., van der Marel, C., Klimek, M., & Calvache, J. A. (2024) · Canadian Journal of Anesthesia/Journal canadien d anesthésie · doi:10.1007/s12630-024-02760-y · Cited by 9
Manzar, D., Nair, N., Suntres, E., Rodrigues, M., Alghanemi, L. G., & Abu‐Hilal, M. (2024) · Advances in Dermatology and Allergology · doi:10.5114/ada.2024.141125 · Cited by 8
Chen, K., Zhang, Y., Zou, J., Wang, D., Yu, X., Sun, Y., Li, Y., Niu, J., Chen, Y., Zhao, P., et al. (2024) · Frontiers in Oncology · doi:10.3389/fonc.2024.1403967 · Cited by 6
Hu, Y., Wu, S., Zhang, H., Wang, K., Zhang, L., Ma, Y., & Li, H. (2024) · Neurology and Therapy · doi:10.1007/s40120-024-00684-9 · Cited by 6
“We also used the confidence in network meta-analysis (CINeMA) tool to evaluate the quality of evidence in six key domains, including within-study bias, reporting bias, indirectness, imprecision, heterogeneity, and inconsistency [9].”
Pettenuzzo, T., Ocagli, H., Sella, N., CASSAI, A. D., Zarantonello, F., Congedi, S., Chiaruttini, M. V., Pistollato, E., Nardelli, M., Biscaro, M., et al. (2024) · Journal of Anesthesia Analgesia and Critical Care · doi:10.1186/s44158-024-00214-x · Cited by 11
Fu, W., Zhao, M., Ding, S. L., Xin, M., Yang, K., Jiang, L., Wu, F., Wu, X., Wang, J., Chen, J., et al. (2025) · Frontiers in Pharmacology · doi:10.3389/fphar.2024.1519869 · Cited by 12
Caldwell, D. M., Palmer, J. C., Webster, K. E., Davies, S. R., Hughes, H., Rona, J., Churchill, R. C., Hetrick, S. E., & Welton, N. J. (2025) · Prevention Science · doi:10.1007/s11121-025-01786-y · Cited by 4
“SMD 0.20 informed the minimally important difference (MID) in the CINeMA assessments (Nikolakopoulou et al., 2020).”
InfluentialMingpun, W., Sobanska, A., Nimworapan, M., Chayanupatkul, M., Dhippayom, T., & Dilokthornsakul, P. (2025) · Hepatology International · doi:10.1007/s12072-025-10812-8 · Cited by 7
Li, T., Zheng, Q., Xu, J., Li, Y., Zhang, M., Zhang, B., Zhou, L. N., & Tian, J. (2025) · Journal of Evidence-Based Medicine · doi:10.1111/jebm.70026 · Cited by 6
“We assessed the certainty of evidence in the NMA via the Confidence in Network Meta-Analysis (CINeMA) online application [27].”
Minozzi, S., Cinquini, M., Arienti, C., Battain, P. C., Brigadoi, G., Vicario, M. D., Domenico, G. D., Farma, T., Federico, S., Innocenti, T., et al. (2025) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2025.111811 · Cited by 7
Wang, J., Lian, N., Tang, K., Deng, Y., & Li, T. (2025) · Travel Medicine and Infectious Disease · doi:10.1016/j.tmaid.2025.102868 · Cited by 6
Yang, X., Su, B., Chen, Y., Yang, J., Huang, H., Chen, B., & Pain Group of the Chinese Society of Anesthesiology (2025) · Anesthesiology and Perioperative Science · doi:10.1007/s44254-025-00111-8 · Cited by 8
“Network meta-analysis quality was evaluated using CINeMA (Confidence in Network Meta-Analysis) software (Institute of Social and Preventative Medicine, University of Bern, Switzerland) [18, 19].”
Chen, L., Chen, M., & Huang, W. (2025) · European Journal of Ophthalmology · doi:10.1177/11206721251350017 · Cited by 6
Pál, A., Papócsi, P., Kelemen, K., Cavalcante, B. G. N., Hegyi, P., Kerémi, B., Gede, N., Hermann, P., Géczi, Z., & Róth, I. (2025) · BMC Oral Health · doi:10.1186/s12903-025-06433-0 · Cited by 8
“The CINEMA (Confidence in Network Meta-Analysis) assessment was used to evaluate the certainty of evidence in network meta-analyses (NMAs) [21].”
Hodkinson, A., Sulochana, H. R., Kontopantelis, E., Adeniji, C., van Marwijk, H., McMillan, B., Bower, P., & Panagioti, M. (2025) · BMC Medicine · doi:10.1186/s12916-025-04240-6 · Cited by 7
“The quality of the evidence for the primary outcomes was assessed using the online Confidence in Network Meta-Analysis (CINeMA) tool [40, 41] across the key domains of within-study bias, reporting bias, indirect-ness, imprecision and incoherence or inconsistency.”
Yan, R., Chen, L., Lin, G., Shi, Y., Huang, W., Mai, Y., Sun, J., & Li, D. (2025) · Frontiers in Endocrinology · doi:10.3389/fendo.2025.1518871 · Cited by 8
“We also applied the CINeMA (Con fi dence in Network Meta-Analysis) framework to evaluate the certainty of evidence across six domains: within-study bias, reporting bias, indirectness, imprecision, heterogeneity, and incoherence (34, 35).”
Etrusco, A., Ata, B., Agrifoglio, V., D'Amato, A., Wyns, C., Vitagliano, A., Alviggi, C., Conforti, A., Favilli, A., FRANCISCIS, P. D., et al. (2025) · Ultrasound in Obstetrics and Gynecology · doi:10.1002/uog.29302 · Cited by 7
Network Meta-Analysis of Quality of Life in Heart Failure With Reduced Ejection Fraction
Margaryan, R., Sepehrvand, N., Ouwerkerk, W., Tromp, J., Turgeon, R. D., & Ezekowitz, J. A. (2025) · Circulation Heart Failure · doi:10.1161/circheartfailure.125.013074 · Cited by 6
Aguilera-Eguía, R. A., Pamela Serón, S., Gutiérrez-Arias, R. E., Herrera-Serna, B. Y., Galdavini, V. P., Inostroza-Reyes, G., Yáñez-Baeza, C., Fuentes-Barría, H., Belmar-Arriagada, H., Inostroza-Quiroz, J., et al. (2025) · Journal of Clinical Medicine · doi:10.3390/jcm14196762 · Cited by 7
“This indicates that comparator selection is crucial, and using an inadequate common comparator can lead to erroneous conclusions [114,115].”
Jiang, L., Ding, H., Lee, D., & Chun, B. (2025) · Biomedicines · doi:10.3390/biomedicines13102548 · Cited by 6
“Based on these criteria, the certainty of evidence was classified as high, moderate, low, or very low, providing a transparent framework to interpret the robustness of the pooled findings [27].”
Zou, H., Liu, M., Lu, Z., Wang, J., & Zhao, P. (2025) · Journal of Orthopaedic and Sports Physical Therapy · doi:10.2519/jospt.2025.13366 · Cited by 10
Xiong, Z., Yuan, Y., Qiu, B., Yang, Y., Bai, Y., Wang, J., Wang, T., Liu, H., Shangguan, Y., Jiang, S., et al. (2025) · BMC Geriatrics · doi:10.1186/s12877-025-06607-z · Cited by 9
“At the same time, two researchers (J.W. and T.W.) employed CINeMA [44] to evaluate the confidence in each comparison against controls, assessing factors such as within-study bias, reporting bias, indirectness, imprecision, heterogeneity, and inconsistency by established guidelines.”
Huang, J., Tao, P., Meng, C., Qin, L.-L., Chen, W., Wu, W.-Y., Ran, Y., & Zhou, C.-Q. (2025) · Journal of Neurology · doi:10.1007/s00415-025-13567-2 · Cited by 7
“…was assessed using the Confidence in Network Meta-Analysis framework (CINeMA; accessible at https:// cinema. ispm. unibe. ch/), which evaluates confidence in NMA estimates across six key domains: within-study bias, reporting bias, indirectness, imprecision, heterogeneity, and incoherence [29, 30].”
Qi, Y.-J., Zhang, J., Lobera, E. S., Song, Q., Zhong, R.-H., Kontogianni, K., Huang, Z., Ariza‐Prota, M., Gupta, N., Madan, M., et al. (2026) · Pulmonology · doi:10.1080/25310429.2025.2593067 · Cited by 6
Liu, H.-M., Wu, T.-J., Liou, C., Chiu, W., Kang, Y., & Chen, C. (2022) · Journal of Plastic Reconstructive & Aesthetic Surgery · doi:10.1016/j.bjps.2022.06.058 · Cited by 6
Placebo Effect and Its Determinants in Ocular Hypotensive Therapy
Choe, S., Kim, Y. K., woo-Suk, C., Ko, D., Lee, M., Shim, S. R., & Ha, A. (2023) · Ophthalmology · doi:10.1016/j.ophtha.2023.06.012 · Cited by 6
Wang, S., Kong, G., Wu, G., Cui, H., Qian, Z., Xu, L., Wei, Y., Wang, J., Huang, J., Wang, J., et al. (2023) · BMJ Open · doi:10.1136/bmjopen-2023-075525 · Cited by 6
Natale, P., Palmer, S. C., Jauré, A., Saglimbene, V. M., Iannone, A., Sluiter, A., Craig, J. C., & Strippoli, G. F. (2024) · Journal of Hypertension · doi:10.1097/hjh.0000000000003663 · Cited by 6
Siafis, S., Lorenz, C., Wu, H., Zhu, Y., Schneider‐Thoma, J., Bighelli, I., Li, C., Hansen, W., Padberg, F., Salanti, G., et al. (2024) · Systematic Reviews · doi:10.1186/s13643-024-02585-2 · Cited by 6
Self-citationFlores-Ferreyra, B. I., Argueta‐Figueroa, L., Rosas, R. T., Carrasco‐Gutiérrez, R., Santana, M. Á. C., & Moyaho‐Bernal, M. D. L. Á. (2024) · Journal of Prosthodontic Research · doi:10.2186/jpr.jpr_d_23_00263 · Cited by 6
de Witte, M., Nategh, L., Antipas, H., Westphal, A., Lautenschlager, N. T., Baker, F. A., & Lampit, A. (2024) · Aging & Mental Health · doi:10.1080/13607863.2024.2373969 · Cited by 7
Securing skin grafts: A network meta-analysis
Seretis, K. G., & Bounas, N. (2024) · Journal of Plastic Reconstructive & Aesthetic Surgery · doi:10.1016/j.bjps.2024.07.005 · Cited by 6
Effectiveness of safety-netting approaches for acutely ill children: a network meta-analysis
Burvenich, R., Bos, D. A. G., Lowie, L., Peeters, K., Toelen, J., Wynants, L., & Verbakel, J. Y. J. (2024) · British Journal of General Practice · doi:10.3399/bjgp.2024.0141 · Cited by 6
Understanding Network Meta‐Analysis: A Practical Introduction for Nurses
Sharifnia, A. M., Biroš, E., & Cleary, M. L. (2024) · Journal of Advanced Nursing · doi:10.1111/jan.16421 · Cited by 10
“The SUCRA values are reported for each plot; the higher the value, the more probable the intervention will be the best. in Network Meta-Analysis (CINeMA) (Nikolakopoulou et al. 2020) approaches.”
Yang, R., Hu, C., Zhuo, Y., Tan, Q., Shen, Y., Jiang, K., Xia, Q. J., & Deng, L. (2024) · Phytomedicine · doi:10.1016/j.phymed.2024.156295 · Cited by 9
Novel Therapies to Reduce Rehospitalization Risk in Worsening Heart Failure
Lima, I. G. C. V., Nunes, J. T., Godoy, L. C., McDonald, M., & Bocchi, E. A. (2024) · JACC Advances · doi:10.1016/j.jacadv.2024.101451 · Cited by 11
Бондоевич, Б. Л., Kuznetsov, I. V., Yadgarov, M. Y., Викторович, Р. П., Polyakov, P. A., Yavorovskiy, A. G., Yakovlev, A. А., Grechko, A. V., & Likhvantsev, V. V. (2025) · Journal of Clinical Medicine · doi:10.3390/jcm14020492 · Cited by 6
“A frequentist random-effects network meta-analysis (NMA) was performed using the CINeMA (Confidence in Network Meta-Analysis) framework [26] and CINeMA software v. 2.0.0 [27].”
InfluentialYu, D., Li, J., Cheng, Y., Wang, H., Ma, X., Ding, T., & Zhu, Z. (2025) · PLoS ONE · doi:10.1371/journal.pone.0313309 · Cited by 9
Cheong, C., Kim, N. W., Shim, S. R., & Kang, J. (2025) · Diseases of the Colon & Rectum · doi:10.1097/dcr.0000000000003687 · Cited by 6
Beverly, A., Ong, G., Doree, C. J., Welton, N. J., & Estcourt, L. J. (2020) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd013649 · Cited by 6
Cortese, S., Giovane, C. D., Chamberlain, S. R., Philipsen, A., Young, S., Bilbow, A., & Cipriani, A. (2022) · BMJ Open · doi:10.1136/bmjopen-2021-058102 · Cited by 6
Lyu, D., Gong, M., Zhang, Y., & Lyu, X. (2022) · Systematic Reviews · doi:10.1186/s13643-022-01964-x · Cited by 6
A Network Meta-Analysis of Intravenous Versus Oral Acetaminophen for Patent Ductus Arteriosus
Olowoyeye, A., Nnamdi-Nwosu, O., Manalastas, M., & Okwundu, C. I. (2022) · Pediatric Cardiology · doi:10.1007/s00246-022-03053-1 · Cited by 8
Tian, X., Wang, Y., Qi, M., Lu, X., & Lei, J. (2023) · BMJ Open · doi:10.1136/bmjopen-2022-062555 · Cited by 8
Li, M.-Y., Huang, Y.-L., Chen, J., Kang, Y., & Chen, C. (2023) · Facial Plastic Surgery & Aesthetic Medicine · doi:10.1089/fpsam.2022.0383 · Cited by 6
Marques, G. L., Albuquerque, A. M., Romaniello, G., Bozzi, F. P. L., da Cunha, G. P., Andraus, G. S., Hastreiter, G., Maniesi, B. D. P., Baena, C. P., & Guedes, M. H. (2023) · Frontiers in Cardiovascular Medicine · doi:10.3389/fcvm.2023.1040936 · Cited by 6
Watanabe, J., Kataoka, Y., Koike, A., Miki, A., Shiozawa, M., SAKURAGI, M., Harao, M., Kitayama, J., & Sata, N. (2023) · Breast Cancer · doi:10.1007/s12282-023-01460-7 · Cited by 6
Wang, S., Lin, Y., Yeh, W., Chang, Y., Chiang, C., Chen, C., Tseng, L., Lee, H., Liu, C., & Cheng, H. (2023) · The Journal of Clinical Endocrinology & Metabolism · doi:10.1210/clinem/dgad247 · Cited by 6
Luo, J., Tao, Y., Xu, Y., Yang, L., Zhang, H., Chen, Y., Liu, X., Zhang, Y., Lan, R., Chen, Y., et al. (2023) · Journal of Diabetes and its Complications · doi:10.1016/j.jdiacomp.2023.108518 · Cited by 9
Chu, H., Lin, L., Wang, Z., Wang, Z., Chen, Y., & Cappelleri, J. C. (2023) · Wiley Interdisciplinary Reviews Computational Statistics · doi:10.1002/wics.1639 · Cited by 7
Bu, Z., Wan, S.-R., Steinmann, P., Yin, Z.-T., Tan, J.-P., Li, W., Tang, Z.-Y., Jiang, S., Ye, M.-M., Xu, J.-Y., et al. (2024) · Journal of Cancer · doi:10.7150/jca.91301 · Cited by 9
Pharmacological Interventions for Post-operative Sore Throat (POST): A Network Meta-analysis
(2020) · Signa Vitae · doi:10.22514/sv.2020.16.0085 · Cited by 6
Network meta-analysis of infliximab biosimilars for the treatment of rheumatoid arthritis
Hanrahan, C. T., & Lee, T. A. (2021) · American Journal of Health-System Pharmacy · doi:10.1093/ajhp/zxab042 · Cited by 6
Liew, A. K. C., Yeh, Y., Abdullah, D., & Tu, Y. (2021) · Restorative Dentistry & Endodontics · doi:10.5395/rde.2021.46.e41 · Cited by 8
Hoshijima, H., Mihara, T., Kokubu, S., Takeda, S., Shiga, T., & Mizuta, K. (2022) · Children · doi:10.3390/children9091280 · Cited by 6
Xu, Y.-F., Chen, Y.-R., Bu, F.-L., Huang, Y., Sun, Y.-X., Li, C., Sellick, J., Liu, J., Qin, D.-M., & Liu, Z. (2022) · Frontiers in Oncology · doi:10.3389/fonc.2022.942941 · Cited by 6
Ho, R., Olszewska-Guizzo, A. (., Roberts, A. C. (., Russo, A. (., & Kühn, S. (2023) · Frontiers research topics · doi:10.3389/978-2-8325-3324-6 · Cited by 9
Network meta-analyses in reproductive medicine: challenges and opportunities
Wang, R., Seidler, A. L., Askie, L. M., Norman, R. J., Bhattacharya, S., van Wely, M., & Mol, B. W. (2020) · Human Reproduction · doi:10.1093/humrep/deaa126 · Cited by 6
Costantini, I., Paul, E., Caldwell, D. M., López-López, J. A., & Pearson, R. M. (2020) · Systematic Reviews · doi:10.1186/s13643-020-01500-9 · Cited by 6
Who Wins the Battle Against Obesity? A Network Meta-Analysis Comparing Tirzepatide and Semaglutide
Bernardi, J. C., Cavalcante, D. V. S., Huntermann, R., Molinari, M. E., Zanon, L. Z., Khater, J., Gomez, V. A., & Fischer‐Bacca, C. O. (2026) · Journal of Diabetes · doi:10.1111/1753-0407.70192 · Cited by 5
Munkholm, K., Ussing, A., Brink, M., Edemann-Callesen, H., Canbolat, S. S., Christensen, R., Dahl, K. S., Ebdrup, B. H., Jensen, M. E. J., Kierulf-Lassen, C., et al. (2023) · European Archives of Psychiatry and Clinical Neuroscience · doi:10.1007/s00406-023-01680-0 · Cited by 6
Thakker, A., Ramchandani, J. P., Divall, P., Sutton, A. J., Johnson, N., & Dias, J. J. (2024) · Clinical Orthopaedics and Related Research · doi:10.1097/corr.0000000000003300 · Cited by 9
“For the network meta-analysis, we evaluated the credibility of intervention effects by considering within-study bias, reporting bias, indirectness, imprecision, heterogeneity, and incoherence based on CINeMA recommendations [37].”
InfluentialComparative Efficacy of CFTR Modulators: A Network Meta-analysis
Iftikhar, I. H., Rao, S. T., Nadama, R., Janahi, I. A., & BaHammam, A. S. (2025) · Lung · doi:10.1007/s00408-025-00802-w · Cited by 7
“The certainty of network estimates was assessed in four grades (very low, low, moderate, or high) using the Confidence in Network Meta-Analysis approach (CINeMA) [15].”
Yan, R., Zheng, X., Yin, Y., Zhang, J., Cui, Y., Su, D., Wan, Z., & Feng, T. (2025) · Movement Disorders · doi:10.1002/mds.30179 · Cited by 6
Rattanpornsompong, K., Rattanaprukskul, K., Prachanukoon, S., Sriwangyang, K., Rinkrathok, M., Tagami, J., & Porntaveetus, T. (2025) · BMC Oral Health · doi:10.1186/s12903-025-05782-0 · Cited by 5
“Publication bias was evaluated through adjusted funnel plots and Egger’s test, while the confidence rating of the NMA was assessed using the Confidence in Network Meta-Analysis (CINeMA) web tool [37].”
Fernandes, H., Novais, C., Sousa‐Pinto, B., Soares-da-Silva, P., & Azevedo, L. F. (2025) · Psychotherapy and Psychosomatics · doi:10.1159/000546269 · Cited by 7
“Data extraction and data items; risk of bias assessment; data analysis; confidence in evidence; and fundamental concepts can be assessed in the online supplementary materials [21].”
Sa-nguansai, S., Rattanasiri, S., Pornsuriyasak, P., Numthavaj, P., McKay, G. J., Attia, J. R., & Thakkinstian, A. (2025) · Scientific Reports · doi:10.1038/s41598-025-05823-2 · Cited by 6
Non-invasive respiratory support in preterm infants as primary mode: a network meta-analysis
Mukerji, A., Shah, P. S., Kadam, M., Borhan, S., & Razak, A. (2025) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd014895.pub2 · Cited by 5
Xue, Y., Tang, K., Li, H., & Jin, X. (2025) · Journal of Psychosomatic Research · doi:10.1016/j.jpsychores.2025.112324 · Cited by 7
Efficacy and Drug Interactions of Glaucoma Medications
Hsia, Y., Wang, C., Su, C., Huang, J., Wang, T.-H., & Tu, Y. (2025) · Ophthalmology · doi:10.1016/j.ophtha.2025.07.009 · Cited by 10
Hanen, G., Mohammed, H. E., Nasser, M., Haseeb, M. E., Yaser, H., Yaser, S., & Allam, S. (2025) · International Journal of Colorectal Disease · doi:10.1007/s00384-025-04970-2 · Cited by 5
“We assessed the credibility of each active control comparison using CINeMA [32, 33], an online tool adapted from GRADE for network meta-analyses by the Cochrane Comparing Multiple Interventions Methods Group.”
Versteegh, M., Idema, D. L., Huygens, S. A., Jenniskens, K., Pierik, M. J., Römkens, T. E. H., van Schaik, F. D. M., Wahab, P. J., Veld, L. F. H. I. ’., Kusters, M. P. T., et al. (2025) · Gastro Hep Advances · doi:10.1016/j.gastha.2025.100764 · Cited by 6
Treatments of depressive symptoms in cancer patients: A systematic review and network meta-analysis
Fu, W., Liu, Y., Jiang, Y., Chu, H., Shao, R., Chen, P., Zheng, X., Li, C., He, J., Lin, K., et al. (2025) · Translational Psychiatry · doi:10.1038/s41398-025-03507-z · Cited by 6
“We assessed the certainty of effect estimates for the primary outcomes using the CINeMA (Con fi dence in Network Meta-Analysis) framework and web-based application [15, 16].”
Zhou, L., Zhang, B., Kang, R., Wang, Y., Qin, J., Xiao, Q., & Hui, V. C. C. (2025) · Neurorehabilitation · doi:10.1177/10538135251366668 · Cited by 5
“…overall strength of evidence was determined by two independent researchers using the Con fi dence In Network Meta-Analysis (CINeMA) software, a web application developed based on the Grading of Recommendations, Assessment, Development, and Evaluation (GRADE) framework (Nikolakopoulou et al., 2020).”
Yao, X., Ma, K., Zhao, B., He, A., Sun, W., Gao, J., Lai, H., Wang, X., Wang, Y., & Song, H. (2025) · CNS Drugs · doi:10.1007/s40263-025-01228-x · Cited by 10
“…was evaluated by Confidence in Network Meta-Analysis (CINeMA) across within-study bias, reporting bias, indirectness, imprecision, heterogeneity, and incoherence, classifying pairwise comparisons into “high,” “moderate,” “low,” or “very low” in confidence rating (Supplementary eMethod 1) [19].”
Gil, A. M. C., Vázquez, L. P., Velázquez, M. S., & Santiago, L. L. O. (2025) · Journal of Esthetic and Restorative Dentistry · doi:10.1111/jerd.70043 · Cited by 5
Tran, T. Q. T., Huang, S.-W., Ho, H. Q., Hsu, C., Hou, W., & Kang, J. (2025) · Medicine · doi:10.1097/md.0000000000046096 · Cited by 6
“[13]”
Farmakis, I. T., Binder, H., Chopard, R., Christodoulou, K. C., Evrenoglou, T., Fengler, K., Giri, J. S., Hobohm, L., Jaber, W. A., Klok, F. A., et al. (2026) · American Heart Journal · doi:10.1016/j.ahj.2026.107365 · Cited by 5
Huang, M., Liu, H., Zeng, L., & Chen, J. (2026) · Journal of Pain Research · doi:10.2147/jpr.s590557 · Cited by 6
“Publication bias was assessed with Begg’s test and visualized using a comparison-corrected funnel plot generated in Stata 16.”
Leaviss, J., Booth, A., Coyle, D., Daly, G., Davis, S., Dawes, H., Deary, V., Dwivedi, K., Forsyth, J. E., Fryer, K., et al. (2026) · BMJ Medicine · doi:10.1136/bmjmed-2025-001746 · Cited by 7
“We adapted GRADE to incorporate elements of Confidence in Network Meta-Analysis (CINeMA), 36 a framework largely based on GRADE, modified to facilitate assessment of network meta-analyses.”
Singh, N. P., Makkar, J. K., Khurana, B. J. K., Borle, A., & Singh, P. M. (2026) · Anaesthesia · doi:10.1111/anae.70204 · Cited by 8
Metadata
- Authors
- Nikolakopoulou, A., Higgins, J. P. T., Papakonstantinou, T., Chaimani, A., Del Giovane, C., Egger, M., & Salanti, G.
- Affiliations
- University of Bern (CH)
- University of Bristol (GB)
- Inserm (FR)
- Corresponding author
- Salanti, Georgia
- ORCID
- Venue
- PLOS Medicine
- Publisher
- Public Library of Science (PLoS)
- Published
- 2020-04-03
- Volume
- 17
- Issue
- 4
- Pages
- e1003082
- ISSN
- 1549-1277 (ISSN-L)
- 1549-1676
- PMC
- PMC7122720
- OpenAlex
- W3015163167
- Semantic Scholar
- 35bd793fad0fbf74d7f784a8052d834bc4e80f96
- Cited by
- 1,935
- References
- 62
- Citations by year
- 2026: 557 · 2025: 398 · 2024: 336 · 2023: 231 · 2022: 201 · 2021: 155 · 2020: 52
- FWCI
- 97.06
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- PLoS Medicine (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- IRIS UNIMORE (University of Modena and Reggio Emilia) (submittedVersion, cc-by)
- HAL (submittedVersion, cc-by)
- RePEc: Research Papers in Economics (submittedVersion)
- Bern Open Repository and Information System (University of Bern) (submittedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Figshare (submittedVersion, cc-by)
- Bristol Research (University of Bristol) (submittedVersion, cc-by)
- Open Access CRIS of the University of Bern
- Funders
- Schweizerischer Nationalfonds zur Förderung der Wissenschaftlichen Forschung (179158, 174281)
- Campbell Collaboration
- Cochrane Collaboration
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Sociology and Political Science › Delphi Technique in Research
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Clinical practice guidelines implementation
- Keywords
- network meta-analysis, cinema, credibility assessment, reporting bias, indirectness, imprecision, heterogeneity, incoherence, transparency, evidence synthesis
- MeSH terms
- Network Meta-Analysis as Topic, Coronary Artery Disease, Electrocardiography, Exercise Test, Humans, Confidence Intervals, Randomized Controlled Trials as Topic, Magnetic Resonance Imaging, Cine
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.