CINeMA: An approach for assessing confidence in the results of a network meta-analysis
Open accessThe DOI matches its Crossref record; 62 of the 62 references it cites were found in a registry or an index.
Abstract
BACKGROUND: The evaluation of the credibility of results from a meta-analysis has become an important part of the evidence synthesis process. We present a methodological framework to evaluate confidence in the results from network meta-analyses, Confidence in Network Meta-Analysis (CINeMA), when multiple interventions are compared. METHODOLOGY: CINeMA considers 6 domains: (i) within-study bias, (ii) reporting bias, (iii) indirectness, (iv) imprecision, (v) heterogeneity, and (vi) incoherence. Key to judgments about within-study bias and indirectness is the percentage contribution matrix, which shows how much information each study contributes to the results from network meta-analysis. The contribution matrix can easily be computed using a freely available web application. In evaluating imprecision, heterogeneity, and incoherence, we consider the impact of these components of variability in forming clinical decisions. CONCLUSIONS: Via 3 examples, we show that CINeMA improves transparency and avoids the selective use of evidence when forming judgments, thus limiting subjectivity in the process. CINeMA is easy to apply even in large and complicated networks.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures




Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Certainty of treatment effect estimates for each outcome at the treatment level were assessed using the Confidence in Network Meta-Analysis (CINeMA) approach, covering six domains of bias: within study bias, across study bias, indirectness, imprecision, heterogeneity, and inconsistency.50 51”
The cited source says what the claim attributes to it.
In the citing paper
“Finally, to assess the credibility of the findings of each network meta-analysis, the findings were incorporated into the Confidence in Network Meta-Analysis (CINeMA) application, which is an adaptation of the Grading of Recommendations Assessment, Development, and Evaluation approach [19–21].”
From Antidepressants for the treatment of adults with major depressive disorder in the maintenance phase: a systematic review and network meta-analysis (2023) · cites this paper as [20]
The cited source says what the claim attributes to it.
In the citing paper
“We applied the CINeMA web application, which facilitates the grading of confidence in the results as high, moderate, low, and very low (Nikolakopoulou et al., 2020) for primary outcomes.”
From Efficacy, acceptability and side-effects of oral versus long-acting- injectables antipsychotics: Systematic review and network meta-analysis (2024) · cites this paper as Nikolakopoulou et al., 2020
The cited source says what the claim attributes to it.
In the citing paper
“The Confidence in Network Meta-Analysis (CINeMA) tool [30, 31] was employed to assess the quality of evidence in six domains, including within-study bias, across-studies bias, indirectness, imprecision, heterogeneity, and incoherence.”
From Comparing caloric restriction regimens for effective weight management in adults: a systematic review and network meta-analysis (2024) · cites this paper as [30]
The cited source says what the claim attributes to it.
In the citing paper
“The certainty of evidence was evaluated using the CINeMA (Confidence in Network Meta-Analysis) framework, which adapts the GRADE approach for network meta-analyses, addressing within-study bias, reporting bias, indirectness, imprecision, heterogeneity, and inconsistency”
7 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
RoB 2: a revised tool for assessing risk of bias in randomised trials
Sterne, J. A. C., Savović, J., Page, M. J., Elbers, R. G., Blencowe, N. S., Boutron, I., Cates, C. J., Cheng, H.-Y., Corbett, M. S., Eldridge, S. M., et al. (2019) · BMJ · doi:10.1136/bmj.l4898 · Cited by 34,787
Self-citationThe Cochrane Collaboration's tool for assessing risk of bias in randomised trials
Higgins, J. P. T., Altman, D. G., Gotzsche, P. C., Juni, P., Moher, D., Oxman, A. D., Savovic, J., Schulz, K. F., Weeks, L., Sterne, J. A. C., et al. (2011) · BMJ · doi:10.1136/bmj.d5928 · Cited by 33,817
Self-citationDermyshi, E., Wang, Y., Yan, C., Hong, W., Qiu, G., Gong, X., & Zhang, T. (2017) · Neonatology · doi:10.1159/000454668 · Cited by 24,451
GRADE: an emerging consensus on rating quality of evidence and strength of recommendations
Guyatt, G. H., Oxman, A. D., Vist, G. E., Kunz, R., Falck-Ytter, Y., Alonso-Coello, P., & Schünemann, H. J. (2008) · BMJ · doi:10.1136/bmj.39489.470347.ad · Cited by 23,305
GRADE guidelines: 1. Introduction—GRADE evidence profiles and summary of findings tables
Guyatt, G., Oxman, A. D., Akl, E. A., Kunz, R., Vist, G., Brozek, J., Norris, S., Falck-Ytter, Y., Glasziou, P., & deBeer, H. (2011) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.04.026 · Cited by 10,681
Hutton, B., Salanti, G., Caldwell, D. M., Chaimani, A., Schmid, C. H., Cameron, C., Ioannidis, J. P. A., Straus, S., Thorlund, K., Jansen, J. P., et al. (2015) · Annals of Internal Medicine · doi:10.7326/m14-2385 · Cited by 8,269 · cited 1×
“org/cmi/about-us), based on previous work [4,16,17].”
Self-citationNorderyd, O. M., Koch, G., Papias, A., Köhler, A. A., Helkimo, A. N., Brahm, C., Lindmark, U., Lindfors, N., Mattsson, A., Rolander, B., et al. (2015) · PubMed · Cited by 3,584
Cipriani, A., Furukawa, T. A., Salanti, G., Chaimani, A., Atkinson, L. Z., Ogawa, Y., Leucht, S., Ruhe, H. G., Turner, E. H., Higgins, J. P. T., et al. (2018) · The Lancet · doi:10.1016/s0140-6736(17)32802-7 · Cited by 3,541 · cited 1×
“A third network, comparing the effectiveness of 18 antidepressants for major depression [12], is evaluated for all domains and is presented in S1 Text.”
Self-citationInterpretation of random effects meta-analyses
Riley, R. D., Higgins, J. P. T., & Deeks, J. J. (2011) · BMJ · doi:10.1136/bmj.d549 · Cited by 2,884
Self-citationGRADE guidelines: 4. Rating the quality of evidence—study limitations (risk of bias)
Guyatt, G. H., Oxman, A. D., Vist, G., Kunz, R., Brozek, J., Alonso-Coello, P., Montori, V., Akl, E. A., Djulbegovic, B., & Falck-Ytter, Y. (2011) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.07.017 · Cited by 2,798
Research works printed but not linked: 2
- 2017, CINeMA: Confidence in Network Meta-Analysis
- T Papakonstantinou, 2020, flow_contribution: R package to calculate contribution of studies in network meta-analysis, GitHub
Cited by
Items 901–1,000 of 1,004
Tang, Y., He, P., Li, Y., Ma, G., Zhang, Y., Wang, L., & Nie, K. (2025) · European Journal of Neuroscience · doi:10.1111/ejn.70008 · Cited by 4
“We examined the confidence of evidence using the confidence of network meta-analysis (CINeMA) web application, which grades the confidence of the results as high, moderate, low and very low (Nikolakopoulou et al. 2020).”
Li, X., Gao, M. Y., & Hua, J. (2025) · BMC Cardiovascular Disorders · doi:10.1186/s12872-025-04745-1 · Cited by 4
“The extent of downgrading varied depending on the severity of the issue, with a possible reduction by one or two levels [28].”
Yang, Y., Lv, Q., Hou, X.-Z., Lv, Y., Zhang, X., Wu, Q., Ye, X., Yang, C., Huang, M., & Wang, S. (2025) · Frontiers in Cardiovascular Medicine · doi:10.3389/fcvm.2025.1550435 · Cited by 8
“Similarly, being identical to the GRADE method, our con fi dence in the quality of evidence was rated as high, moderate, low, or very low for each relative intervention effect (38, 39).”
Marques, E. M. R., Dennis, J. A., Beswick, A. D., Higgins, J. P. T., Thom, H. H. Z., Welton, N. J., Burston, A., Hunt, L. P., Whitehouse, M. R., & Blom, A. W. (2021) · BMJ Open · doi:10.1136/bmjopen-2020-040205 · Cited by 4
Self-citationde Lima, J. B., Soares, D. D. S., Ferrari, F., Carvas, N., Carvalho, G. U., Leitão, S. A. T., Goldraich, L. A., Clausell, N., & Stein, R. (2020) · BMJ Open · doi:10.1136/bmjopen-2020-044975 · Cited by 7
Zhang, X., Liu, Y., Wang, M., Li, Q., Zhang, W., Zhang, R., & Wu, Y. (2021) · Frontiers in Pharmacology · doi:10.3389/fphar.2021.637667 · Cited by 4
Okano, H., Sakuraya, M., Masuyama, T., Kimata, S., & Hokari, S. (2022) · JA Clinical Reports · doi:10.1186/s40981-022-00525-4 · Cited by 5
Zhou, F., Huang, E., Zheng, E., & Deng, J. (2022) · Acupuncture in Medicine · doi:10.1177/09645284221076504 · Cited by 5
Boczar, K. E., Shin, S., Bezzina, K. A., Geejo, A., Pearson, A., Shahab, S., Fehlmann, C. A., Visintini, S. M., Beanlands, R. S., & Wells, G. A. (2022) · BMJ Open · doi:10.1136/bmjopen-2022-062702 · Cited by 5
A gentle introduction to network meta-analysis for orthodontists
Tu, Y., Hsu, J.-Y., Chang, Y.-H., Zheng, K.-W., & Pandis, N. (2024) · Seminars in Orthodontics · doi:10.1053/j.sodo.2024.01.009 · Cited by 4
Does progress in microfracture techniques necessarily translate into clinical effectiveness?
Muthu, S., Viswanathan, V. K., Sakthivel, M., & Thabrez, M. (2024) · World Journal of Orthopedics · doi:10.5312/wjo.v15.i3.266 · Cited by 6
Sahota, O., Narayanasamy, M. J., Bastounis, A., Paskins, Z., Bishop, S., Langley, T. E., Gittoes, N. J. L., Davis, S., Baily, A., Holmes, M., et al. (2024) · Health Technology Assessment · doi:10.3310/wypf0472 · Cited by 6
Ayesh, H., Suhail, S., Ayesh, S. K., & Niswender, K. D. (2024) · Metabolism Open · doi:10.1016/j.metop.2024.100284 · Cited by 5
Two decades of network meta‐analysis: Roadmap to their applications and challenges
Veroniki, A. A., Flórez, I. D., Hutton, B., Straus, S. E., & Tricco, A. C. (2024) · Research Synthesis Methods · doi:10.1002/jrsm.1744 · Cited by 5
Papola, D., Ostuzzi, G., Gastaldon, C., Purgato, M., Giovane, C. D., Pompoli, A., Karyotaki, E., Sijbrandij, M., Furukawa, T. A., Cuijpers, P. J., et al. (2020) · BMJ Open · doi:10.1136/bmjopen-2020-038909 · Cited by 4
Bolzan, J. A., & de Oliveira, C. L. (2021) · BMJ Open Science · doi:10.1136/bmjos-2020-100077 · Cited by 4
Natanasabapathy, V., Arul, B., Srinivasan, V., Santosh, S. S., Vasudevan, A., Arockiam, S., Namasivayam, A., Kandaswamy, D., & Srinivasan, M. R. (2021) · Evidence-Based Dentistry · doi:10.1038/s41432-021-0207-x · Cited by 4
Martín, Zhou, Y., Takagi, T., & Tian, Y. (2021) · Naunyn-Schmiedeberg s Archives of Pharmacology · doi:10.1007/s00210-021-02128-9 · Cited by 7
Pharmacological Management of Gambling Disorder: A Systematic Review and Network Meta-AnalysisPreprint
Ioannidis, K., Giovane, C. D., Tzagarakis, C., Solly, J. E., Westwood, S. J., Parlatini, V., Bowden‐Jones, H., Grant, J. E., Cortese, S., & Chamberlain, S. R. (2023) · medRxiv · doi:10.1101/2023.10.20.23297314 · Cited by 5
Ways to improve the methodology of meta-analysis in sports and exercise medicine
Owen, P. J. (2024) · VUBIR (Vrije Universiteit Brussel) · doi:10.1136/bmjsem-2024-002256
Abulehia, A., Ayesh, H., Ayesh, O., Jaber, D., Asad, T., Itbaisha, A., Abugharbieh, H., Gharbia, R., Abu‐Hilal, L. H., & Leon, B. G. C. (2026) · Endocrinology, Diabetes & Metabolism · doi:10.1002/edm2.70187 · Cited by 3
Zhou, D., Chen, D., Song, P., Hu, Z., Xu, S., Zhu, R., & Chen, Y. (2024) · Journal of Evidence-Based Medicine · doi:10.1111/jebm.12634 · Cited by 4
Regional analgesia techniques following nephrectomy: a systematic review and network meta-analysis
HUANG, J., Xia, L. I. U., Wang, L., Lei, Z. H. U., He, D., Ruijuan, L. I. U., & Wenjun, Y. A. N. (2024) · Minerva Anestesiologica · doi:10.23736/s0375-9393.24.18373-3 · Cited by 3
Navigating the waters of acute minor stroke therapies: a systematic review and network meta-analysis
Yao, X., He, A., Zhao, B., SUN, W. M., Wu, X., Wang, X., Song, C., Song, H., & Wang, Y. (2025) · Journal of Thrombosis and Haemostasis · doi:10.1016/j.jtha.2025.02.017 · Cited by 3
Fares‐Otero, N. E., Amoretti, S., Solé, B., Halligan, S. L., Vieta, E., Leucht, S., Seedat, S., & Harrer, M. (2025) · European Journal of Psychotraumatology · doi:10.1080/20008066.2025.2508548 · Cited by 5
“The confidence in estimates of the main outcomes will be evaluated with the framework Confidence in Network Meta-Analysis (CINeMA) (Nikolakopoulou et al., 2020), an adaptation of the Grading of Recommendations Assessment, Development, and Evaluation framework (GRADE) specifically developed for NMA.”
Amagasa, S., Utsumi, S., Okajima, K., & Uematsu, S. (2025) · Archives of Disease in Childhood · doi:10.1136/archdischild-2024-327523 · Cited by 3
“16 17 This stemmed from the small number of cases and events in each RCT, resulting in wide confidence intervals for effect sizes.”
Terao, I., Tsuge, T., Sato, T., Endo, K., Kotake, K., Banno, M., & Kataoka, Y. (2025) · Psychiatry and Clinical Neurosciences Reports · doi:10.1002/pcn5.70136 · Cited by 10
Intarakhao, P., Thiarawat, P., & Dhippayom, T. (2025) · Indian Journal of Anaesthesia · doi:10.4103/ija.ija_189_25 · Cited by 3
Ekkunagul, T., MacLeod, C. S., Francis, J., Nagy, J., & Forget, P. (2025) · BMJ Open · doi:10.1136/bmjopen-2024-090678 · Cited by 3
Zhang, J., Wang, J., Xiang, X., Zhang, N., Zhang, K., Zhang, P., & Wen, H. (2025) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2025.1624825 · Cited by 3
Rujirawan, T., Osiri, S., & Chotvorrarak, K. (2025) · International Endodontic Journal · doi:10.1111/iej.70007 · Cited by 5
“The quality of evidence for the outcome was assessed using the Confidence in Network Meta-Analysis (CINeMA) approach, which is an adaptation of the GRADE framework for NMAs, developed by the Cochrane Comparing Multiple Interventions Methods Group (Nikolakopoulou et al. 2020).”
InfluentialYi, M., Chen, S., Chao, J., Ma, Y., Li, X., Zhang, H., Hu, L., & Wang, Y. (2025) · Age and Ageing · doi:10.1093/ageing/afaf193 · Cited by 4
Liu, L., Chen, Y., Tian, M., Wu, Z., Zhang, P., Zhang, T., Yang, J., Qu, H., Fan, Z., Wu, S., et al. (2025) · Integrative Medicine Research · doi:10.1016/j.imr.2025.101206 · Cited by 4
Müller, T., Künzi, A., Heitlinger, E., Krämer, B., von Känel, R., Hättenschwiler, J. A., Hilpert, M., Imboden, C., Holsboer‐Trachsler, E., Hatzinger, M., et al. (2025) · European Archives of Psychiatry and Clinical Neuroscience · doi:10.1007/s00406-025-02082-0 · Cited by 4
“At the network level, two investigators (TM and AK) independently determined the risk of bias using the Confidence in Network Meta-Analysis (CIN-eMA) framework along five dimensions: within-study bias, indirectness, incoherence, imprecision and heterogeneity [29].”
Chen, J., Gu, H., Wu, H., & Feng, Y. (2025) · Journal of Ethnopharmacology · doi:10.1016/j.jep.2025.120401 · Cited by 3
Li, Z., Luo, S., Bai, X., Huang, L., & Wang, D. (2025) · Journal of Sports Sciences · doi:10.1080/02640414.2025.2544433 · Cited by 3
“As this study involved a NMA, we applied the Confidence in Network Meta-Analysis (CINeMA; https://cinema.ispm.unibe.ch/) framework to assess the certainty of evidence (Nikolakopoulou et al., 2020).”
Siafis, S., Furukawa, Y., Schneider‐Thoma, J., Nomura, N., Fares‐Otero, N. E., Storosum, B. W. C., Zantvoord, J. B., Schwarz, C. J., Schulz, J., Naiser, H., et al. (2025) · F1000Research · doi:10.12688/f1000research.169873.1 · Cited by 3
“They contributed to key elements of the study design, including the definition of inclusion criteria and selection of outcomes, with particular emphasis on examining dose-effects and adverse events in addition to efficacy.”
Self-citationProphylactic antibiotics in hand trauma surgery: a network meta-analysis
Yusuf, S. M., Zhang, C., Takenoshita, M., Wade, R. G., & Wormald, J. C. R. (2025) · British journal of surgery · doi:10.1093/bjs/znaf191 · Cited by 3
Park, J. M., Park, H.-J., Yoon, S. Y., Kim, Y. W., Shin, J. I., & Lee, S. C. (2025) · Journal of Clinical Medicine · doi:10.3390/jcm14196913 · Cited by 7
“We assessed the certainty of evidence for the main outcomes using Confidence in Network Meta-Analysis (CINeMA) [16].”
Etrusco, A., Agrifoglio, V., Farfán, J. C. C., Bernabeu, A., Laganà, A. S., Renau, B. M., D’Amato, A., FRANCISCIS, P. D., Rozalén, A. F., & Riemma, G. (2025) · Journal of Assisted Reproduction and Genetics · doi:10.1007/s10815-025-03633-z · Cited by 4
“Furthermore, the Confidence in Network Meta-Analysis framework (CIN-eMA) criteria were used to evaluate the certainty of the evidence [27].”
Wolfe, D. M., Hamel, C., Berard, J. A., Veroniki, A. A., Skidmore, B., Kanji, S., Rabheru, K., McGee, S. F., Forbes, L. M., Machado, I., et al. (2025) · Cancers · doi:10.3390/cancers17213430 · Cited by 7
Zhang, W., Xu, N., Chen, H., Li, X., Li, J., & Yang, X. (2025) · Worldviews on Evidence-Based Nursing · doi:10.1111/wvn.70076 · Cited by 3
Bright, H. R., Phan, D. B., Zahid, A., Aval, L. M., Manupati, S., Smith, C. H., Exton, L. S., Ezejimofor, M. C., Lunt, M., Warren, R. B., et al. (2025) · Dermatology and Therapy · doi:10.1007/s13555-025-01578-w · Cited by 3
“The certainty of network estimates was assessed using Confidence in Network Meta-analysis (CINeMA) approach [12].”
He, H., Li, C., Wen, Z., Zhang, W., Doherty, M., Zhang, Y., Xie, J., Wang, Y., Xie, D., Wei, J., et al. (2025) · Clinical Orthopaedics and Related Research · doi:10.1097/corr.0000000000003749 · Cited by 3
Nahiz, N., Jakobsen, J. C., Lukoschewitz, J. D., Doleman, B., Petersen, J. J., Seven, E., Olesen, A. S. O., Miger, K. C., Tonning, S. H., El‐Sheikh, M., et al. (2025) · Heart · doi:10.1136/heartjnl-2025-326601 · Cited by 3
Fluoride Varnish for Caries Prevention in Preschoolers: An Overview of Reviews
Couto, F. M., de Sousa, F. S. D. O., Dhyppolito, I. M., Barja‐Fidalgo, F., dos Santos, A. P. P., & Nadanovsky, P. (2025) · Community Dentistry And Oral Epidemiology · doi:10.1111/cdoe.70032 · Cited by 5
“However, since SR with NMA were also included, the CINeMA assessment [29] was used to collect the quality or certainty of evidence in these SRs.”
Zhao, Y., Guo, C., Zhang, D., Wei, X., Jiang, X., & Bi, H. (2025) · Clinical Rehabilitation · doi:10.1177/02692155251394944 · Cited by 4
S, M. S. V., Behl, S., Vaidya, P. C., Tiwari, P., Bharti, S. K., Nahan, N., Sahu, J. K., & Bansal, D. (2025) · EClinicalMedicine · doi:10.1016/j.eclinm.2025.103655 · Cited by 3
“Additionally, we employed the Confidence in Network Meta-Analysis (CINeMA) framework 30,31 to evaluate the confidence of evidence across the six domains: within-study bias, reporting bias, indirectness, imprecision, heterogeneity, and incoherence.”
Ji, R., Huang, W., Weng, M., & Zhang, M. (2025) · Frontiers in Medicine · doi:10.3389/fmed.2025.1673193 · Cited by 9
Viero, C. M., Alves, P., Munhoz, O. L., Cabral, T. S., Galvão, C. M., da Costa, V. Z., Eberhardt, T. D., Franco, M. S., & de Lima, S. B. S. (2025) · Revista da Escola de Enfermagem da USP · doi:10.1590/1980-220x-reeusp-2025-0099es · Cited by 3
Deng, B., Li, H., Chen, C., He, J., Zhang, W., & Lin, H. (2025) · Food Science & Nutrition · doi:10.1002/fsn3.71243 · Cited by 4
“Certainty of evidence for every network estimate was graded using the Confidence in Network Meta-Analysis (CINeMA) framework (Nikolakopoulou et al. 2020).”
Zhang, Y., Yan, H., Li, J., Ji, S., & Cao, C. (2025) · BMC Oral Health · doi:10.1186/s12903-025-07371-7 · Cited by 3
“The reliability of evidence was evaluated through CIN-eMA (Confidence in Network Meta-Analysis) methodology [30].”
Huang, H., Chen, X., Wang, Z., & Zhang, Y. (2025) · BMC Cancer · doi:10.1186/s12885-025-15432-x · Cited by 4
“To evaluate confidence in the results, we used the CIN-eMA (Confidence in Network Meta-Analysis) web application, which considers factors such as within-study bias, reporting bias, indirectness, imprecision, heterogeneity, and inconsistency [39].”
Yang, Y., Wang, J., Wang, T., Yuan, Y., Qiu, B., Hu, W., Wang, F., Tang, Z.-H., & Lin, S.-C. (2025) · BMC Musculoskeletal Disorders · doi:10.1186/s12891-025-09341-0 · Cited by 5
“The confidence of evidence was also evaluated using the CINeMA (Confidence in Network Meta-Analysis) web application, through which the confidence in the results was graded as high, moderate, low, or very low [30].”
de Oliveira, A. V., Sampaio, A. L. N., Mascarenhas, R. W., Pinto, L. O. A. D., & Andriolo, R. B. (2025) · World Journal of Urology · doi:10.1007/s00345-025-06137-8 · Cited by 5
“To evaluate the risk of bias in individual studies, we used the Revised Cochrane Risk-of-Bias Tool for Randomised Trials (RoB-2) [23] and to evaluate the certainty of evidence we used the Confidence in Network Meta-Analysis (CINeMA) guideline [24].”
Cheng, H.-Y., Liang, C.-W., Liu, Y., Chang, C., Chang, W.-L., Cheng, T.-A., Chuang, H., Hsu, Y.-C., & Lin, C. (2025) · Global Spine Journal · doi:10.1177/21925682251408367 · Cited by 3
“25,26”
Xue, T., Qiu, Y., Li, X., Xie, M., Wang, W., Chen, Z., Xie, H., Bai, Y., Yang, A., Meng, F., et al. (2026) · Molecular Psychiatry · doi:10.1038/s41380-025-03438-7 · Cited by 5
Wang, S., Li, C., & Fan, D. P. (2026) · Cardiovascular Therapeutics · doi:10.1155/cdr/6345873 · Cited by 3
“CINeMA (Con fi dence in Network Meta-Analysis) approach was used to evaluate the con-fi dence in the fi ndings from NMA, which considers six domains: within-study bias, reporting bias, indirectness, imprecision, heterogeneity, and incoherence [30].”
Bu, Z., Chong, J., Ma, J., Ma, Y., Jiang, F., & Chen, Y. (2026) · The American Journal of Chinese Medicine · doi:10.1142/s0192415x26500047 · Cited by 3
Kamrul-Hasan, A. B. M., Mahajan, K., Khalil, I., Shahriar, N., Nagendra, L., Dutta, D. J., & Pappachan, J. M. (2026) · Endocrine Practice · doi:10.1016/j.eprac.2026.02.002 · Cited by 5
Hussain, U., Kunwar, S. S., Khan, U. W., Kamran, M. A., Thakfan, A. S., Alshahrani, O., Rehman, A., Niazi, F. H., Shah, A. M., Alam, S., et al. (2026) · BMC Oral Health · doi:10.1186/s12903-026-07755-3 · Cited by 6
“We evaluated confidence in the network meta-analysis estimates for WSL score, WSL size and prevalence with the CINeMA (Confidence in Network Meta-Analysis) approach [37].”
Wang, W., Yuan, C., Wang, F., Liu, A., Fang, H., & Liu, J. (2026) · BMC Surgery · doi:10.1186/s12893-026-03609-5 · Cited by 4
“To assess study quality and the certainty of evidence, the Cochrane Risk of Bias 2.0 (RoB 2) tool [23] and the Confidence in Network Meta-Analysis (CINeMA) framework [24] were applied.”
InfluentialJiang, L., Ding, H., Seo, H., & Chun, B. (2025) · EClinicalMedicine · doi:10.1186/s12984-025-01756-z · Cited by 8
“Evidence was graded as high, moderate, low, or very low, with downgrading applied in the presence of serious limitations [29].”
Hu, J., Wang, J., Zhang, H., Jiang, Y., Deng, L., Long, E., & Liu, S. (2026) · Frontiers in Cardiovascular Medicine · doi:10.3389/fcvm.2026.1758366 · Cited by 3
Yu, T., Metelli, S., Papakonstantinou, T., & Chaimani, A. (2026) · Research Synthesis Methods · doi:10.1017/rsm.2026.10074 · Cited by 8
Self-citationYalın, N., Yildiz, A., Siafis, S., Vieta, E., & Leucht, S. (2026) · European Neuropsychopharmacology · doi:10.1016/j.euroneuro.2026.112818 · Cited by 6
Etrusco, A., Agrifoglio, V., D’Amato, A., Wyns, C., Donna, M. C. D., Vitagliano, A., Alviggi, C., Conforti, A., Laganà, A. S., Busnelli, A., et al. (2026) · International Journal of Gynecology & Obstetrics · doi:10.1002/ijgo.71059 · Cited by 3
“24 CINeMA evaluates confidence across six domains (within-study bias, reporting bias, indirectness, imprecision, heterogeneity, and incoherence), which are combined to derive an overall certainty rating for each network estimate (high, moderate, low, or very low).”
Tong, L., Panagiotopoulou, O. M., Radio, M., Miguel, C., Harrer, M., Andersson, G., Riper, H. M., Cuijpers, P. J., & Karyotaki, E. (2026) · The British Journal of Psychiatry · doi:10.1192/bjp.2026.10653 · Cited by 3
Kishi, T., Sakuma, K., & Iwata, N. (2022) · Pharmacopsychiatry · doi:10.1055/a-1860-2793 · Cited by 3
de Souza, M. B., Mascarenhas, R. O., Maia, L. B., Fonseca, L. S., Silva, H. J., de Zoete, R. M. J., McAuley, J. H., Henschke, N., & Oliveira, V. C. (2022) · PLoS ONE · doi:10.1371/journal.pone.0274406 · Cited by 4
Watt, J. A., Hofmeister, M., Giovane, C. D., Turner, R., Tricco, A. C., Mavridis, D., Straus, S. E., & Veroniki, A. A. (2023) · BMJ Evidence-Based Medicine · doi:10.1136/bmjebm-2022-112136 · Cited by 3
Sandau, N., Aagaard, T. V., Hróbjartsson, A., Harris, I. A., & Brorson, S. (2024) · BMC Musculoskeletal Disorders · doi:10.1186/s12891-023-07119-w · Cited by 4
Wachiraphansakul, N., Vongchaiudomchoke, T., Manosroi, W., & Nochaiwong, S. (2024) · PLoS ONE · doi:10.1371/journal.pone.0297488 · Cited by 3
Martínez-Calderón, J., & García‐Muñoz, C. (2024) · Disability and Rehabilitation · doi:10.1080/09638288.2024.2355304 · Cited by 5
Chen, J., Sun, Y., Shao, Y., Meng, A., Bai, Y., Li, X., Zhou, Z., Wang, H., & Zhi, X. (2024) · Precision Medical Sciences · doi:10.1002/prm2.12131 · Cited by 6
Uimonen, M., Liukkonen, R. J., Ponkilainen, V., Vaajala, M., Tarkiainen, J., Pakarinen, O., Haapanen, M., & Kuitunen, I. (2024) · European Heart Journal Open · doi:10.1093/ehjopen/oeae052 · Cited by 3
Yasuo, S., Hayashi, M., Suda, C., Kataoka, Y., Taito, S., Imai, E., & Sazanami, K. (2024) · Cureus · doi:10.7759/cureus.64682 · Cited by 4
Harris, R., Neale, E. P., & Batterham, M. J. (2024) · Nutrition Reviews · doi:10.1093/nutrit/nuae119 · Cited by 6
“We then used the CINeMA (Confidence in Network Meta-Analysis) framework 24 to assess the confidence in the treatment effects.”
Ha, S., Kang, S.-W., & Lee, S. (2024) · Integrative Medicine Research · doi:10.1016/j.imr.2024.101114 · Cited by 7
“21 , 22 To assess imprecision, the minimum clinically important difference was established at 1.90 on a scale of 0–10 for pain intensity and 2.5 mm for MMO.”
InfluentialMahardawi, B., Thet, P. H., Kaboosaya, B., & Pimkhaokham, A. (2025) · Oral and Maxillofacial Surgery · doi:10.1007/s10006-025-01330-w · Cited by 3
“The table of the quality of evidence from all comparisons was generated using the CINeMA website [27].”
Chen, Y., Foster, J. P., Rohmah, I., Schmied, V. A., Marks, A., Wang, M., & Chiu, H. (2025) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2025.105035 · Cited by 4
Vichara-Anont, I., Lumkul, L., Phinyo, P., Wongsa, C., & Thongngarm, T. (2025) · The Journal of Allergy and Clinical Immunology In Practice · doi:10.1016/j.jaip.2025.02.018 · Cited by 3
Salam, A., Dhurjati, R., Vidyasagar, K., Kaistha, P., Esam, H., Haghdoost, F., Pant, R., Kumar, A., Kanukula, R., Thode, R., et al. (2025) · JMIR Research Protocols · doi:10.2196/65205 · Cited by 4
Dourado, J., Wignakumar, A., Emile, S., Rogers, P., Weiss, B., Khan, S. M., Aeschbacher, P., & Wexner, S. (2025) · Journal of Gastrointestinal Surgery · doi:10.1016/j.gassur.2025.102041 · Cited by 2
Singh, N. P., Siddiqui, N. T., Makkar, J. K., Guffey, R. C., & Singh, P. M. (2025) · Canadian Journal of Anesthesia/Journal canadien d anesthésie · doi:10.1007/s12630-025-02924-4 · Cited by 5
Liu, J., Peng, W. K., & Jia, Y. (2025) · PLoS ONE · doi:10.1371/journal.pone.0322929 · Cited by 6
“The CINeMA assessment, conducted using online software, evaluated the credibility of evidence for both direct and indirect comparisons between non-pharmacological interventions and comparator [16].”
Shahzad, F., Rasheed, T., Siddiqui, M. R., Hamid, H., Khalid, M. B., Shabbir, H., Shami, B., Abdullah, A., & Ahmed, S. I. (2025) · Annals of Clinical and Translational Neurology · doi:10.1002/acn3.70122 · Cited by 3
“The overall quality of evidence was assessed by the GRADE Approach for Network Meta-Analysis [8].”
InfluentialWang, T., Gu, Y., Li, Y., Chen, J., & Zeng, L. (2025) · Journal of Pain Research · doi:10.2147/jpr.s543756 · Cited by 3
Xiong, Y., Huang, W., Wang, C., Ma, W., Jin, S., Lin, J., Deng, X., Peng, Y., Huang, Y., Du, X., et al. (2025) · BJOG An International Journal of Obstetrics & Gynaecology · doi:10.1111/1471-0528.70016 · Cited by 4
“We used the CINeMA framework to evaluate the evidence quality in the network meta-analysis across six domains: within-study bias, reporting bias, indirectness, imprecision, heterogeneity and inconsistency [17, 18].”
Matterne, U., Tischer, C., Wang, J., Knüttel, H., Genuneit, J., Perkin, M. R., & Apfelbacher, C. (2021) · F1000Research · doi:10.12688/f1000research.51490.2 · Cited by 3
Farmakis, I. T., Doundoulakis, I., Zafeiropoulos, S., Pagiantza, A., Apostolidou‐Kiouti, F., Kourti, O., Kassimis, G., Haidich, A., Karvounis, H. I., & Giannakoulas, G. A. (2021) · Hellenic Journal of Cardiology · doi:10.1016/j.hjc.2021.06.008 · Cited by 3
Post-extubation use of non-invasive respiratory support in preterm infants: a network meta-analysis
Razak, A., Shah, P. S., Ye, X. Y., & Mukerji, A. (2021) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd014509 · Cited by 3
Traditional Chinese medicine for the prevention and treatment of COVID-19
Wang, X., Wang, Y., Lu, H., & Yan, L. (2021) · Medicine · doi:10.1097/md.0000000000028375 · Cited by 3
Yang, D., Lei, Y., Li, Q., & Zuo, Y. (2023) · BMJ Open · doi:10.1136/bmjopen-2022-069724 · Cited by 4
Zhao, T., Tang, C., Huang, Y., Wang, H., & Guo, M. (2023) · PLoS ONE · doi:10.1371/journal.pone.0287445 · Cited by 4
Bu, Z., Liu, Y.-N., Shahjalal, M., Zheng, Y., Liu, C., Ye, M.-M., Xu, J.-Y., Peng, X.-Y., Wang, X., Chen, X., et al. (2023) · Frontiers in Pediatrics · doi:10.3389/fped.2023.1180694 · Cited by 3
Chen, Y.-R., Zhao, R., Xu, Y.-F., Ma, Y.-J., Hu, S. X., Wang, X.-H., Fan, B., Zhou, Y.-J., Huang, Y., Robinson, N., et al. (2023) · Integrative Medicine Research · doi:10.1016/j.imr.2023.101004 · Cited by 3
Xu, Y., Wang, Y., Huang, K., Huang, W., Zhao, S., & Jiang, Z. (2024) · Journal of Evidence-Based Medicine · doi:10.1111/jebm.12586 · Cited by 3
Yue, L., Lu, X., Zhang, X., Niu, L., Wen, Y. W., Li, X., Wang, Y., Xing, G., & Li, G. (2024) · Frontiers in Pharmacology · doi:10.3389/fphar.2024.1348360 · Cited by 4
Cui, L., Liu, X., Li, Y., Jing, T., Liu, D., Ren, C., Yin, T., Wang, Y., Zhao, Z., Wang, J., et al. (2024) · Frontiers in Pharmacology · doi:10.3389/fphar.2024.1321405 · Cited by 3
Metadata
- Authors
- Nikolakopoulou, A., Higgins, J. P. T., Papakonstantinou, T., Chaimani, A., Del Giovane, C., Egger, M., & Salanti, G.
- Affiliations
- University of Bern (CH)
- University of Bristol (GB)
- Inserm (FR)
- Corresponding author
- Salanti, Georgia
- ORCID
- Venue
- PLOS Medicine
- Publisher
- Public Library of Science (PLoS)
- Published
- 2020-04-03
- Volume
- 17
- Issue
- 4
- Pages
- e1003082
- ISSN
- 1549-1277 (ISSN-L)
- 1549-1676
- PMC
- PMC7122720
- OpenAlex
- W3015163167
- Semantic Scholar
- 35bd793fad0fbf74d7f784a8052d834bc4e80f96
- Cited by
- 1,935
- References
- 62
- Citations by year
- 2026: 557 · 2025: 398 · 2024: 336 · 2023: 231 · 2022: 201 · 2021: 155 · 2020: 52
- FWCI
- 97.06
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- PLoS Medicine (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- IRIS UNIMORE (University of Modena and Reggio Emilia) (submittedVersion, cc-by)
- HAL (submittedVersion, cc-by)
- RePEc: Research Papers in Economics (submittedVersion)
- Bern Open Repository and Information System (University of Bern) (submittedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Figshare (submittedVersion, cc-by)
- Bristol Research (University of Bristol) (submittedVersion, cc-by)
- Open Access CRIS of the University of Bern
- Funders
- Schweizerischer Nationalfonds zur Förderung der Wissenschaftlichen Forschung (179158, 174281)
- Campbell Collaboration
- Cochrane Collaboration
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Sociology and Political Science › Delphi Technique in Research
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Clinical practice guidelines implementation
- Keywords
- network meta-analysis, cinema, credibility assessment, reporting bias, indirectness, imprecision, heterogeneity, incoherence, transparency, evidence synthesis
- MeSH terms
- Network Meta-Analysis as Topic, Coronary Artery Disease, Electrocardiography, Exercise Test, Humans, Confidence Intervals, Randomized Controlled Trials as Topic, Magnetic Resonance Imaging, Cine
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.