CINeMA: An approach for assessing confidence in the results of a network meta-analysis
Open accessThe DOI matches its Crossref record; 62 of the 62 references it cites were found in a registry or an index.
Abstract
BACKGROUND: The evaluation of the credibility of results from a meta-analysis has become an important part of the evidence synthesis process. We present a methodological framework to evaluate confidence in the results from network meta-analyses, Confidence in Network Meta-Analysis (CINeMA), when multiple interventions are compared. METHODOLOGY: CINeMA considers 6 domains: (i) within-study bias, (ii) reporting bias, (iii) indirectness, (iv) imprecision, (v) heterogeneity, and (vi) incoherence. Key to judgments about within-study bias and indirectness is the percentage contribution matrix, which shows how much information each study contributes to the results from network meta-analysis. The contribution matrix can easily be computed using a freely available web application. In evaluating imprecision, heterogeneity, and incoherence, we consider the impact of these components of variability in forming clinical decisions. CONCLUSIONS: Via 3 examples, we show that CINeMA improves transparency and avoids the selective use of evidence when forming judgments, thus limiting subjectivity in the process. CINeMA is easy to apply even in large and complicated networks.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures




Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Certainty of treatment effect estimates for each outcome at the treatment level were assessed using the Confidence in Network Meta-Analysis (CINeMA) approach, covering six domains of bias: within study bias, across study bias, indirectness, imprecision, heterogeneity, and inconsistency.50 51”
The cited source says what the claim attributes to it.
In the citing paper
“Finally, to assess the credibility of the findings of each network meta-analysis, the findings were incorporated into the Confidence in Network Meta-Analysis (CINeMA) application, which is an adaptation of the Grading of Recommendations Assessment, Development, and Evaluation approach [19–21].”
From Antidepressants for the treatment of adults with major depressive disorder in the maintenance phase: a systematic review and network meta-analysis (2023) · cites this paper as [20]
The cited source says what the claim attributes to it.
In the citing paper
“We applied the CINeMA web application, which facilitates the grading of confidence in the results as high, moderate, low, and very low (Nikolakopoulou et al., 2020) for primary outcomes.”
From Efficacy, acceptability and side-effects of oral versus long-acting- injectables antipsychotics: Systematic review and network meta-analysis (2024) · cites this paper as Nikolakopoulou et al., 2020
The cited source says what the claim attributes to it.
In the citing paper
“The Confidence in Network Meta-Analysis (CINeMA) tool [30, 31] was employed to assess the quality of evidence in six domains, including within-study bias, across-studies bias, indirectness, imprecision, heterogeneity, and incoherence.”
From Comparing caloric restriction regimens for effective weight management in adults: a systematic review and network meta-analysis (2024) · cites this paper as [30]
The cited source says what the claim attributes to it.
In the citing paper
“The certainty of evidence was evaluated using the CINeMA (Confidence in Network Meta-Analysis) framework, which adapts the GRADE approach for network meta-analyses, addressing within-study bias, reporting bias, indirectness, imprecision, heterogeneity, and inconsistency”
7 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
RoB 2: a revised tool for assessing risk of bias in randomised trials
Sterne, J. A. C., Savović, J., Page, M. J., Elbers, R. G., Blencowe, N. S., Boutron, I., Cates, C. J., Cheng, H.-Y., Corbett, M. S., Eldridge, S. M., et al. (2019) · BMJ · doi:10.1136/bmj.l4898 · Cited by 34,787
Self-citationThe Cochrane Collaboration's tool for assessing risk of bias in randomised trials
Higgins, J. P. T., Altman, D. G., Gotzsche, P. C., Juni, P., Moher, D., Oxman, A. D., Savovic, J., Schulz, K. F., Weeks, L., Sterne, J. A. C., et al. (2011) · BMJ · doi:10.1136/bmj.d5928 · Cited by 33,817
Self-citationDermyshi, E., Wang, Y., Yan, C., Hong, W., Qiu, G., Gong, X., & Zhang, T. (2017) · Neonatology · doi:10.1159/000454668 · Cited by 24,451
GRADE: an emerging consensus on rating quality of evidence and strength of recommendations
Guyatt, G. H., Oxman, A. D., Vist, G. E., Kunz, R., Falck-Ytter, Y., Alonso-Coello, P., & Schünemann, H. J. (2008) · BMJ · doi:10.1136/bmj.39489.470347.ad · Cited by 23,305
GRADE guidelines: 1. Introduction—GRADE evidence profiles and summary of findings tables
Guyatt, G., Oxman, A. D., Akl, E. A., Kunz, R., Vist, G., Brozek, J., Norris, S., Falck-Ytter, Y., Glasziou, P., & deBeer, H. (2011) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.04.026 · Cited by 10,681
Hutton, B., Salanti, G., Caldwell, D. M., Chaimani, A., Schmid, C. H., Cameron, C., Ioannidis, J. P. A., Straus, S., Thorlund, K., Jansen, J. P., et al. (2015) · Annals of Internal Medicine · doi:10.7326/m14-2385 · Cited by 8,269 · cited 1×
“org/cmi/about-us), based on previous work [4,16,17].”
Self-citationNorderyd, O. M., Koch, G., Papias, A., Köhler, A. A., Helkimo, A. N., Brahm, C., Lindmark, U., Lindfors, N., Mattsson, A., Rolander, B., et al. (2015) · PubMed · Cited by 3,584
Cipriani, A., Furukawa, T. A., Salanti, G., Chaimani, A., Atkinson, L. Z., Ogawa, Y., Leucht, S., Ruhe, H. G., Turner, E. H., Higgins, J. P. T., et al. (2018) · The Lancet · doi:10.1016/s0140-6736(17)32802-7 · Cited by 3,541 · cited 1×
“A third network, comparing the effectiveness of 18 antidepressants for major depression [12], is evaluated for all domains and is presented in S1 Text.”
Self-citationInterpretation of random effects meta-analyses
Riley, R. D., Higgins, J. P. T., & Deeks, J. J. (2011) · BMJ · doi:10.1136/bmj.d549 · Cited by 2,884
Self-citationGRADE guidelines: 4. Rating the quality of evidence—study limitations (risk of bias)
Guyatt, G. H., Oxman, A. D., Vist, G., Kunz, R., Brozek, J., Alonso-Coello, P., Montori, V., Akl, E. A., Djulbegovic, B., & Falck-Ytter, Y. (2011) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.07.017 · Cited by 2,798
Research works printed but not linked: 2
- 2017, CINeMA: Confidence in Network Meta-Analysis
- T Papakonstantinou, 2020, flow_contribution: R package to calculate contribution of studies in network meta-analysis, GitHub
Cited by
Items 301–400 of 1,004
An, Y., Gao, J., Xu, J., Qi, W., Wang, L., & Tian, M. (2023) · International Journal of Surgery · doi:10.1097/js9.0000000000000776 · Cited by 32
Ortiz-Seller, A., Martorell, P., Barranco, H., Pascual-Camps, I., Morcillo, E. J., & Ortiz, J. L. (2024) · Survey of Ophthalmology · doi:10.1016/j.survophthal.2024.02.005 · Cited by 27
Huang, J., Li, Y., Chen, M., Cai, Z., Cai, Z., & Jiang, Z. (2024) · International Journal of Behavioral Nutrition and Physical Activity · doi:10.1186/s12966-024-01657-9 · Cited by 25
“The Confidence in Network Meta-Analysis (CIN-eMA) tool [30, 31] was employed to assess the quality of evidence in six domains, including within-study bias, across-studies bias, indirectness, imprecision, heterogeneity, and incoherence.”
MethodDifferent doses of dual orexin receptor antagonists in primary insomnia: a Bayesian network analysis
Xue, T., Wu, X., Li, J., Chen, S., Wang, Z., Tan, X., Wang, Z., & Zhang, J. (2023) · Frontiers in Pharmacology · doi:10.3389/fphar.2023.1175372 · Cited by 24
Srisurapanont, M., Suradom, C., Suttajit, S., Kongsaengdao, S., & Maneeton, B. (2024) · General Hospital Psychiatry · doi:10.1016/j.genhosppsych.2024.02.008 · Cited by 27
Liu, Y., Niu, P., Yan, J., Ji, H., Wang, Z., Jin, X., Lv, L., Feng, C.-N., Du, X., Yang, F., et al. (2024) · Journal of Ethnopharmacology · doi:10.1016/j.jep.2024.118297 · Cited by 24
Choice of supraglottic airway devices: a network meta-analysis of randomised controlled trials
Kanakaraj, M., Bhat, A. D., Singh, N. P., Balasubramanian, S., Tyagi, A., Aathreya, R., & Singh, P. M. (2024) · British Journal of Anaesthesia · doi:10.1016/j.bja.2024.09.001 · Cited by 28
Turrini, G., Purgato, M., Cadorin, C., Bartucz, M. B., Cristofalo, D., Gastaldon, C., Nosè, M., Ostuzzi, G., Papola, D., Prina, E., et al. (2024) · The Lancet Regional Health - Europe · doi:10.1016/j.lanepe.2024.101152 · Cited by 39
Makkar, J. K., Singh, N. P., Khurana, B. J. K., Chawla, J. K., & Singh, P. M. (2025) · Anaesthesia · doi:10.1111/anae.16566 · Cited by 22
“Five individual domains were assessed for seriousness: limitations; indirectness; imprecision; inconsistency; andpublication bias [11].”
Torres, T. R., Barcelos, A., Filipe, P., & Fonseca, J. E. (2021) · Frontiers in Medicine · doi:10.3389/fmed.2020.618163 · Cited by 24
Bastounis, A., Langley, T. E., Davis, S., Paskins, Z., Gittoes, N. J. L., Leonardi‐Bee, J., & Sahota, O. (2022) · JBMR Plus · doi:10.1002/jbm4.10620 · Cited by 22
Wang, B., Chiu, H., Luh, H., Lin, C., Hsieh, S.-H., Chen, T., Wu, C.-R., & Chen, P. (2022) · PLoS ONE · doi:10.1371/journal.pone.0265932 · Cited by 28
Munhoz, O. L., Morais, B. X., dos Santos, W. M., de Paula, C. C., & Magnago, T. S. B. D. S. (2022) · Revista Latino-Americana de Enfermagem · doi:10.1590/1518-8345.6219.3708 · Cited by 40
Adamina, M., Andreou, A., Arezzo, A., Christogiannis, C., Lorenzo, N. D., Gioumidou, M., Glavind, J., Iavazzo, C. R., Mavridis, D., Muysoms, F. E., et al. (2022) · Surgical Endoscopy · doi:10.1007/s00464-022-09625-9 · Cited by 27
Evereklioğlu, C., Şener, H., Polat, O. A., Sönmez, H. K., Sener, A. B. G., & Horozoğlu, F. (2023) · Graefe s Archive for Clinical and Experimental Ophthalmology · doi:10.1007/s00417-023-06089-y · Cited by 23
Wu, S., Wang, L., He, Y., Shi, F., Zhuang, H., Mei, L., & Qian, Y.-L. (2023) · Complementary Therapies in Clinical Practice · doi:10.1016/j.ctcp.2023.101802 · Cited by 25
Barry, G. S., Sehmbi, H., Retter, S., Bailey, J. G., Tablante, R., & Uppal, V. (2023) · British Journal of Anaesthesia · doi:10.1016/j.bja.2023.08.024 · Cited by 26
Abouarab, A. H., Brülle, R., Aboukilila, M. Y., Weibel, S., & Schnabel, A. (2023) · Pain Practice · doi:10.1111/papr.13314 · Cited by 25
Ayesh, H., Beran, A., Suhail, S., Ayesh, S. K., & Niswender, K. D. (2024) · Biomedicines · doi:10.3390/biomedicines12102328 · Cited by 25
“The certainty of evidence was assessed using the Confidence in Network Meta-Analysis (CINeMA) framework [17].”
MethodPharmacological Treatments of Bell's Palsy in Adults: A Systematic Review and Network Meta‐Analysis
Jalali, M. M., Soleimani, R., Soltanipour, S., & Jalali, S. M. (2021) · The Laryngoscope · doi:10.1002/lary.29368 · Cited by 25
Schefft, C., Heinitz, C., Guhn, A., Brakemeier, E., Sterzer, P., & Köhler, S. (2023) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2023.1189970 · Cited by 28
Fornaro, M., Caiazza, C., Billeci, M., Berk, M., Marx, W., Balanzá‐Martínez, V., Prisco, M. D., Pezone, R., Simone, G. D., Solini, N., et al. (2024) · Molecular Psychiatry · doi:10.1038/s41380-024-02645-y · Cited by 26
Komora, P., Vámos, O., Gede, N., Hegyi, P., Kelemen, K., Galvács, A., Varga, G., Kerémi, B., & Vág, J. (2024) · Scientific Reports · doi:10.1038/s41598-024-69367-7 · Cited by 44
Normative data for instrumented posturography: a systematic review and meta-analysis
Julienne, A., Verbecque, E., & Besnard, S. (2024) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2024.1498107 · Cited by 31
Chan, B. S., Yu, D. S. F., Wong, C. W. Y., & Li, P. W. C. (2025) · European Journal of Preventive Cardiology · doi:10.1093/eurjpc/zwaf167 · Cited by 24
Xavier, A. A. D. S., da Rosa, P. P., Mackmill, L. D. B., & Roll, V. F. B. (2020) · Research in Veterinary Science · doi:10.1016/j.rvsc.2020.11.013 · Cited by 28
Ashrafi, M. H., Ahmad, S. B., Antoniou, S. A., Khan, T., & Antoniou, G. A. (2022) · European Journal of Vascular and Endovascular Surgery · doi:10.1016/j.ejvs.2021.10.058 · Cited by 23
Chen, J., Lee, T. H., Kuo, G. C., Huang, Y., Chen, P.-R., Chen, S., Yang, H., Hsu, H., Hsiao, C.-C., Yang, C., et al. (2022) · Frontiers in Cardiovascular Medicine · doi:10.3389/fcvm.2022.960581 · Cited by 22
Outcomes of Different Quality of Life Assessment Modalities After Breast Cancer Therapy
Kastora, S. L., Holmquist, A., Valachis, A., Rocco, N., Meattini, I., Somaiah, N., Peled, A. W., Chatterjee, A., Catanuto, G., Tasoulis, M. K., et al. (2023) · JAMA Network Open · doi:10.1001/jamanetworkopen.2023.16878 · Cited by 21
Schubert, A., Seneviratne, V., Stolz, J., Wiesmann, T., Wulf, H., Eberhart, L. H. J., & Dinges, H. (2023) · European Journal of Anaesthesiology · doi:10.1097/eja.0000000000001860 · Cited by 23
Jung, A., Carvalho, G. F., Szikszay, T. M., Pawlowsky, V., Gabler, T., & Luedtke, K. (2023) · Physical Therapy · doi:10.1093/ptj/pzad154 · Cited by 21
Chen, Y., Chen, J., & Hsieh, F. (2023) · Journal of the Chinese Medical Association · doi:10.1097/jcma.0000000000001026 · Cited by 25
Neto, M. G., Durães, A. R., Conceição, L. S. R., Saquetto, M. B., Alves, I. G. N., Smart, N. A., & Carvalho, V. O. (2024) · Journal of physiotherapy · doi:10.1016/j.jphys.2024.02.018 · Cited by 24
Jiang, Y., Peng, H., Song, Y., Huang, L. K., Chen, H., Li, P., Yang, G., Song, Y., Chen, Q., & Yao, N. (2025) · PeerJ · doi:10.7717/peerj.19175 · Cited by 26
“This instrument, developed by the Cochrane group, is grounded in a GRADE adaptation tailored for network meta-analysis, particularly aimed at the comparison of various interventions ( Nikolakopoulou et al., 2020 ).”
de Carvalho, C. C., El‐Boghdadly, K., Guedes, I. H. L., Dantas, M. V. M., Tomé, D. P. B., Ramos, I. B., Gomes, C. S. H., Alves, G. K. P. A., Bezerra, A. P., Neto, J. M. D. S., et al. (2026) · Anaesthesia · doi:10.1111/anae.70121 · Cited by 32
A network meta-analysis of the dose–response effects of lurasidone on acute schizophrenia
Srisurapanont, M., Suttajit, S., Likhitsathian, S., Maneeton, B., & Maneeton, N. (2021) · Scientific Reports · doi:10.1038/s41598-021-84836-z · Cited by 22
Xu, Y., Guo, X., Peng, H., Dai, H., Huang, Z., & Zhao, J. (2022) · Journal of Orthopaedic Surgery and Research · doi:10.1186/s13018-021-02904-6 · Cited by 22
The complexity underlying treatment rankings: how to use them and what to look at
Chiocchia, V., White, I. R., & Salanti, G. (2022) · BMJ Evidence-Based Medicine · doi:10.1136/bmjebm-2021-111904 · Cited by 21
Self-citationFeber, L., Peter, N. L., Schneider‐Thoma, J., Siafis, S., Bighelli, I., Hansen, W., Baldez, D. P., Salanti, G., Keefe, R. S. E., Engel, R. R., et al. (2023) · Systematic Reviews · doi:10.1186/s13643-023-02213-5 · Cited by 19
Self-citationSequí‐Domínguez, I., Mavridis, D., Cavero‐Redondo, I., Saz‐Lara, A., Martínez‐Vizcaíno, V., & de Arenas‐Arroyo, S. N. (2023) · British Journal of Sports Medicine · doi:10.1136/bjsports-2022-106285 · Cited by 26
A network meta-analysis of surgical treatments of complete rectal prolapse
Emile, S. H., Khan, S. M., Garoufalia, Z., Silva‐Alvarenga, E., Gefen, R., Horesh, N., Freund, M. R., & Wexner, S. D. (2023) · Techniques in Coloproctology · doi:10.1007/s10151-023-02813-2 · Cited by 20
Stubnya, B. G., Kocsis, K., Váncsa, S., Kovács, K., Agócs, G., Stubnya, M. P., Suskó, E., Hegyi, P., & Bejek, Z. (2023) · The Journal of Arthroplasty · doi:10.1016/j.arth.2023.06.004 · Cited by 28
Adverse effects of immunotherapies for multiple sclerosis: a network meta-analysis
Tramacere, I., Virgili, G., Perduca, V., Lucenteforte, E., Benedetti, M. D., Capobussi, M., Castellini, G., Frau, S., González‐Lorenzo, M., Featherstone, R. M., et al. (2023) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd012186.pub2 · Cited by 31
Light exposure therapy for myopia control: a systematic review and Bayesian network meta-analysis
Zaabaar, E., Zhang, X. J., Zhang, Y., Bui, C. H. T., Tang, F. Y., Kam, K. W., Szeto, S., Young, A. L., Wong, I. C. K., Ip, P., et al. (2023) · British Journal of Ophthalmology · doi:10.1136/bjo-2023-323798 · Cited by 20
Deng, X., Zhou, L., Liang, C., Shang, X., Xu, H., Liu, W., Liang, S., Wang, Y., Xu, M., Guo, K., et al. (2024) · The Journal of Headache and Pain · doi:10.1186/s10194-024-01723-4 · Cited by 24
Yi, Y., Zhao, W., Lv, S., Zhang, G., Rong, Y., Wang, X., Yang, J., & Li, M. (2024) · General Hospital Psychiatry · doi:10.1016/j.genhosppsych.2024.07.011 · Cited by 25
Pan, S., Su, E.-L., Huang, C., Chuang, S., Chiang, C., Chen, C., & Cheng, H. (2024) · Age and Ageing · doi:10.1093/ageing/afae175 · Cited by 26
Farhat, L. C., Flores, J. M., Avila-Quintero, V. J., Polanczyk, G. V., Cipriani, A., Furukawa, T. A., Bloch, M. H., & Cortese, S. (2023) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2023.3985 · Cited by 25
Chen, H., Qiu, Y., Yin, Z., Wang, Z., Tang, Y., Ni, H., Lu, J., Chen, Z., Kong, Y., & Wang, Z. (2023) · Frontiers in Immunology · doi:10.3389/fimmu.2023.1280226 · Cited by 23
McHugh, F. T., Ryan, É. J., Ryan, O. K., Tan, J., Boland, P. A., Whelan, M. C., Kelly, M. E., McNamara, D. A., Neary, P. C., O’Riordan, J. M., et al. (2024) · Diseases of the Colon & Rectum · doi:10.1097/dcr.0000000000003256 · Cited by 19
Tripodi, V. F., Sardo, S., Ippolito, M., & Cortegiani, A. (2025) · Journal of Anesthesia Analgesia and Critical Care · doi:10.1186/s44158-025-00272-9 · Cited by 40
“The certainty of the evidence was evaluated utilizing the Grading of Recommendations, Assessment, Development, and Evaluation (GRADE) approach for network meta-analysis [18].”
Bozzo, A., Deng, J., Abbas, U., Bhasin, R., Deodat, M., Wariach, S., Sanger, S., Axelrod, D. E., Masrouha, K. Z., TURCOTTE, R. E., et al. (2021) · Clinical Orthopaedics and Related Research · doi:10.1097/corr.0000000000001749 · Cited by 19
Shi, C., Dumville, J. C., Cullum, N. A., Rhodes, S., & McInnes, E. (2020) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd013761 · Cited by 36
Hayashi, M., Kano, K., Kuroda, N., Yamamoto, N., Shiroshita, A., & Kataoka, Y. (2022) · Academic Emergency Medicine · doi:10.1111/acem.14568 · Cited by 26
Theodoridis, X., Kalopitas, G., Vadarlis, A., Bakaloudi, D. R., Gkiourtzis, Ν., Dionysopoulos, G., Karanika, E., Tsekitsidi, E., & Chourdakis, M. (2022) · Pharmacology & Therapeutics · doi:10.1016/j.pharmthera.2022.108294 · Cited by 25
Zhao, T., Tang, C., Huang, Y., Lu, Q., Guo, M., & Wang, H. (2023) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2023.104452 · Cited by 19
Peng, G., Yan, Z., Liu, Y., Li, J., Ma, J., Tong, N., & Wang, Y. (2023) · Reproductive Biology and Endocrinology · doi:10.1186/s12958-023-01075-9 · Cited by 47
Jeong, H., Yim, H. W., Lee, S., Potenza, M. N., & Kim, N. J. (2023) · Psychotherapy and Psychosomatics · doi:10.1159/000529753 · Cited by 25
Kihal, A., Rodríguez-Prado, M., & Calsamiglia, S. (2023) · Journal of Dairy Science · doi:10.3168/jds.2022-23028 · Cited by 19
Papola, D., Ostuzzi, G., Todesco, B., Gastaldon, C., Hanna, F., Chatterjee, S., van Ommeren, M., & Barbui, C. (2023) · The Lancet Psychiatry · doi:10.1016/s2215-0366(23)00176-1 · Cited by 19
Yumoto, T., Kuribara, T., Yamada, K., Sato, T., Koba, S., Tetsuhara, K., Kashiura, M., & Sakuraya, M. (2023) · Acute Medicine & Surgery · doi:10.1002/ams2.914 · Cited by 23
de Carvalho, C. C., Guedes, I. H. L., Dantas, M. V. M., Batista, P. H. A., Neto, J. B. L., de França, A. V. R., Souza, D. B. G., & El‐Boghdadly, K. (2025) · Anaesthesia · doi:10.1111/anae.16597 · Cited by 22
Sun, Y., Ji, M., Zhang, X., Chen, J., Wang, Y., & Wang, Z. (2022) · Journal of Affective Disorders · doi:10.1016/j.jad.2022.06.017 · Cited by 19
Veroniki, A. A., Tsokani, S., White, I. R., Schwarzer, G., Rücker, G., Mavridis, D., Higgins, J. P. T., & Salanti, G. (2021) · BMC Medical Research Methodology · doi:10.1186/s12874-021-01401-y · Cited by 18
“Our results highlight the need for a widespread use of tools that assess confidence in the NMA findings, such as CINeMA [30], that factor-in inconsistency concerns in the interpretation.”
BackgroundMethodInfluentialSelf-citationRicci, C., Serbassi, F., Alberici, L., Ingaldi, C., Gaetani, L., Raffele, E. D., Pironi, L., Sasdelli, A. S., Mosconi, C., Marco, M. D., et al. (2023) · Surgery · doi:10.1016/j.surg.2023.08.005 · Cited by 24
Fornaro, M., Caiazza, C., Rossano, F., Cilmi, F., Prisco, M. D., Vieta, E., Thompson, T., Solmi, M., Carvalho, A. F., Iasevoli, F., et al. (2024) · European Neuropsychopharmacology · doi:10.1016/j.euroneuro.2024.01.011 · Cited by 19
Lappas, A. S., Glarou, E., Polyzopoulou, Z. A., Goss, G., Huhn, M., Samara, M. T., & Christodoulou, G. N. (2024) · Sleep Medicine · doi:10.1016/j.sleep.2024.05.032 · Cited by 21
Solmi, M., Fornaro, M., Caiolo, S., Lussignoli, M., Caiazza, C., Prisco, M. D., Solini, N., de Bartolomeis, A., Iasevoli, F., Pigato, G., et al. (2024) · Molecular Psychiatry · doi:10.1038/s41380-024-02733-z · Cited by 24
Fu, Z., Wang, Y., Zhao, L., Li, Y., & Song, Q. (2025) · Aging Clinical and Experimental Research · doi:10.1007/s40520-024-02920-6 · Cited by 21
“The confidence in network meta-analysis primary outcome was assessed using the confidence in network meta-analysis (CINeMA) framework (https:// cinema. ispm. unibe. ch/) constructed based on GRADE grading [23].”
Yang, S., Xin, S., Ju, R., & Zang, P. (2025) · PLoS ONE · doi:10.1371/journal.pone.0314787 · Cited by 28
“We planned to use the CINeMA system (Confidence in Network Meta-Analysis), an adaptation of the GRADE (Grading of Recommendations, Assessment, Development, and Evaluations) approach, to assess the evidence for network meta-analysis [13,14].”
Gao, S., Xie, X., Fan, L., & Yu, L. (2025) · Frontiers in Immunology · doi:10.3389/fimmu.2025.1654343 · Cited by 24
Zhou, S., Xu, Y., Yang, Y., Song, H., Wang, X., & Yu, Y. (2025) · BMC Public Health · doi:10.1186/s12889-025-25044-6 · Cited by 26
“In this study, the quality of evidence was evaluated following the CINeMA principles [31].”
Schneider‐Thoma, J., Kapfhammer, A., Wang, D., Bighelli, I., Siafis, S., Wu, H., Hansen, W., Davis, J. M., Salanti, G., & Leucht, S. (2021) · Systematic Reviews · doi:10.1186/s13643-021-01760-z · Cited by 20
Self-citationManaging neuropsychiatric symptoms in patients with dementia
Watt, J. A., Thompson, W., Marple, R., Brown, D., & Liu, B. (2022) · BMJ · doi:10.1136/bmj-2021-069187 · Cited by 26
Lunny, C., Veroniki, A. A., Hutton, B., White, I. R., Higgins, J. P. T., Wright, J. M., Kim, J. Y., Thirugnanasampanthar, S. S., Siddiqui, S., Watt, J. A., et al. (2022) · BMJ Evidence-Based Medicine · doi:10.1136/bmjebm-2022-111944 · Cited by 22
Self-citationAlam, M. K., Kanwal, B., Shqaidef, A. J., Alswairki, H. J., Alfawzan, A. A., Alabdullatif, A. I., Aalmunif, A. N., Aljrewey, S. H., Alothman, T. A., Shrivastava, D., et al. (2023) · Journal of Functional Biomaterials · doi:10.3390/jfb14040209 · Cited by 23
Chaichan, W., Ruengorn, C., Thavorn, K., Hutton, B., Szepietowski, J. C., Bernstein, J. A., Chuamanochan, M., & Nochaiwong, S. (2023) · The Journal of Allergy and Clinical Immunology In Practice · doi:10.1016/j.jaip.2023.03.058 · Cited by 21
Reina‐Gutiérrez, S., Meseguer-Henarejos, A. B., Torres-Costoso, A. I., Álvarez‐Bueno, C., Cavero‐Redondo, I., de Arenas‐Arroyo, S. N., Guzmán‐Pavón, M. J., Sánchez‐López, M., & Martínez‐Vizcaíno, V. (2023) · Scandinavian Journal of Medicine and Science in Sports · doi:10.1111/sms.14407 · Cited by 25
Ding, X., Ma, Y., Ma, Y., Chen, C., Zhang, X., Duan, Q., & Ma, Y. (2023) · International Journal of Surgery · doi:10.1097/js9.0000000000000630 · Cited by 26
Yuan, X. G., Wu, J., Yin, H. M., Ming, C., & Cheng, S. J. (2023) · Techniques in Coloproctology · doi:10.1007/s10151-023-02855-6 · Cited by 18
Systemic corticosteroids for the prevention of bronchopulmonary dysplasia, a network meta-analysis
Hay, S., Ovelman, C., Zupancic, J. A. F., Doyle, L. W., Onland, W., Konstantinidis, M., Shah, P. S., & Soll, R. F. (2023) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd013730.pub2 · Cited by 24
Li, G., Duan, S., Zhu, T., Ren, Z., Xia, H. M., Wang, Z., Liu, L., & Liu, Z. (2023) · The Journal of Headache and Pain · doi:10.1186/s10194-023-01662-6 · Cited by 21
A network meta-analysis of different acupuncture modalities in the treatment of bronchial asthma
Wang, X., Zeng, S., Li, Z., Li, Y., & Jia, H. (2023) · BMC Pulmonary Medicine · doi:10.1186/s12890-023-02645-8 · Cited by 18
Costantini, I., López-López, J. A., Caldwell, D. M., Campbell, A., Hadjipanayi, V., Cantrell, S. J., Thomas, T., Badmann, N., Paul, E., James, D. M., et al. (2023) · BMJ Mental Health · doi:10.1136/bmjment-2023-300811 · Cited by 23
Lunny, C., Veroniki, A. A., Higgins, J. P. T., Dias, S., Hutton, B., Wright, J. M., White, I. R., Whiting, P. F., & Tricco, A. C. (2024) · Systematic Reviews · doi:10.1186/s13643-023-02388-x · Cited by 21
Self-citationBokor, L. A., Martyin, K., Krebs, M., Galajda, N. Á., Meznerics, F. A., Szabó, B., Hegyi, P., Lőrincz, K. K., Kiss, N., Bánvölgyi, A., et al. (2024) · Autoimmunity Reviews · doi:10.1016/j.autrev.2024.103723 · Cited by 22
Wang, J., Yuan, Y., Xie, T., Zhang, L., Xu, H., Lin, S.-C., Yang, Y., Zhu, D., & Zhuang, J. (2025) · Journal of science and medicine in sport · doi:10.1016/j.jsams.2025.01.003 · Cited by 26
Smith, E., Cooper, N. J., Sutton, A. J., Abrams, K. R., & Hubbard, S. (2021) · BMC Public Health · doi:10.1186/s12889-021-10162-8 · Cited by 23
Liu, S., Hu, J., Zhao, C., Liu, H., & He, C. (2025) · Frontiers in Endocrinology · doi:10.3389/fendo.2025.1513641 · Cited by 17
Vámos, O., Komora, P., Gede, N., Hegyi, P. J., Kelemen, K., Varga, G., Mikulás, K., Kerémi, B., & Kispélyi, B. (2024) · Nicotine & Tobacco Research · doi:10.1093/ntr/ntae085 · Cited by 17
Belavý, D. L., Kaczorowski, S., Saueressig, T., Owen, P. J., & Nikolakopoulou, A. (2024) · BMJ Open Sport & Exercise Medicine · doi:10.1136/bmjsem-2024-002262 · Cited by 20
“27 Two notable GRADE-based approaches, namely, the Confidence in Network Meta-Analysis (CINeMA) 28 and the method proposed by Puhan et al , 29 30 provide systematic tools for assessing and interpreting the quality of evidence, allowing researchers to gain a nuanced understanding of the reliability…”
Self-citationLiang, L.-B., Wang, S., Li, K., & Wu, C. (2025) · The Journal of Prevention of Alzheimer s Disease · doi:10.1016/j.tjpad.2025.100207 · Cited by 21
Bu, Z., Liu, F.-S., Shahjalal, M., Song, Y.-K., Li, M., Zhuo, R.-E., Zhong, Q., Du, Y.-W., Lu, C.-G., Yang, Z.-H., et al. (2025) · BMJ Evidence-Based Medicine · doi:10.1136/bmjebm-2024-113512 · Cited by 23
“51 52 We incorporated the results of the RoB 2 assessments into the CINeMA framework, with particular emphasis on the domain of within-study bias.”
López‐Moreno, M., López‐Gil, J. F., Bravo‐Sànchez, A., Bertotti, G., & Roldán‐Ruiz, A. (2025) · Clinical Nutrition · doi:10.1016/j.clnu.2025.09.001 · Cited by 18
Angelakis, I., Huggett, C., Gooding, P., Panagioti, M., & Hodkinson, A. (2022) · The British Journal of Psychiatry · doi:10.1192/bjp.2022.35 · Cited by 17
Schorer, R., Dombret, A.-L., Hagerman, A., Bédat, B., & Putzu, A. (2022) · British Journal of Anaesthesia · doi:10.1016/j.bja.2022.08.039 · Cited by 18
Sehmbi, H., Retter, S., Shah, U. J., Nguyen, D. L., Martin, J. E., & Uppal, V. (2022) · British Journal of Anaesthesia · doi:10.1016/j.bja.2022.08.042 · Cited by 18
Almadhoon, H. W., Hamdallah, A., Eida, M. A., Al‐kafarna, M., Atallah, D. A., AbuIriban, R. W., Asla, M. M., Abdelsalam, A., Awad, A. A., Nawar, A. A., et al. (2022) · The Journal of the American Dental Association · doi:10.1016/j.adaj.2022.08.017 · Cited by 17
Choi, J. H., Lee, S. H., Kim, J. S., Park, N., Lee, M. H., Lee, M. W., Cho, I. R., Paik, W. H., Ryu, J. K., & Kim, Y. (2022) · Gut and Liver · doi:10.5009/gnl220268 · Cited by 19
He, S., Choong, E. K. M., Duangthip, D., Chu, C. H., & Lo, E. C. M. (2023) · International Journal of Paediatric Dentistry · doi:10.1111/ipd.13055 · Cited by 22
Metadata
- Authors
- Nikolakopoulou, A., Higgins, J. P. T., Papakonstantinou, T., Chaimani, A., Del Giovane, C., Egger, M., & Salanti, G.
- Affiliations
- University of Bern (CH)
- University of Bristol (GB)
- Inserm (FR)
- Corresponding author
- Salanti, Georgia
- ORCID
- Venue
- PLOS Medicine
- Publisher
- Public Library of Science (PLoS)
- Published
- 2020-04-03
- Volume
- 17
- Issue
- 4
- Pages
- e1003082
- ISSN
- 1549-1277 (ISSN-L)
- 1549-1676
- PMC
- PMC7122720
- OpenAlex
- W3015163167
- Semantic Scholar
- 35bd793fad0fbf74d7f784a8052d834bc4e80f96
- Cited by
- 1,935
- References
- 62
- Citations by year
- 2026: 557 · 2025: 398 · 2024: 336 · 2023: 231 · 2022: 201 · 2021: 155 · 2020: 52
- FWCI
- 97.06
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- PLoS Medicine (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- IRIS UNIMORE (University of Modena and Reggio Emilia) (submittedVersion, cc-by)
- HAL (submittedVersion, cc-by)
- RePEc: Research Papers in Economics (submittedVersion)
- Bern Open Repository and Information System (University of Bern) (submittedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Figshare (submittedVersion, cc-by)
- Bristol Research (University of Bristol) (submittedVersion, cc-by)
- Open Access CRIS of the University of Bern
- Funders
- Schweizerischer Nationalfonds zur Förderung der Wissenschaftlichen Forschung (179158, 174281)
- Campbell Collaboration
- Cochrane Collaboration
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Sociology and Political Science › Delphi Technique in Research
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Clinical practice guidelines implementation
- Keywords
- network meta-analysis, cinema, credibility assessment, reporting bias, indirectness, imprecision, heterogeneity, incoherence, transparency, evidence synthesis
- MeSH terms
- Network Meta-Analysis as Topic, Coronary Artery Disease, Electrocardiography, Exercise Test, Humans, Confidence Intervals, Randomized Controlled Trials as Topic, Magnetic Resonance Imaging, Cine
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.