CINeMA: An approach for assessing confidence in the results of a network meta-analysis
Open accessThe DOI matches its Crossref record; 62 of the 62 references it cites were found in a registry or an index.
Abstract
BACKGROUND: The evaluation of the credibility of results from a meta-analysis has become an important part of the evidence synthesis process. We present a methodological framework to evaluate confidence in the results from network meta-analyses, Confidence in Network Meta-Analysis (CINeMA), when multiple interventions are compared. METHODOLOGY: CINeMA considers 6 domains: (i) within-study bias, (ii) reporting bias, (iii) indirectness, (iv) imprecision, (v) heterogeneity, and (vi) incoherence. Key to judgments about within-study bias and indirectness is the percentage contribution matrix, which shows how much information each study contributes to the results from network meta-analysis. The contribution matrix can easily be computed using a freely available web application. In evaluating imprecision, heterogeneity, and incoherence, we consider the impact of these components of variability in forming clinical decisions. CONCLUSIONS: Via 3 examples, we show that CINeMA improves transparency and avoids the selective use of evidence when forming judgments, thus limiting subjectivity in the process. CINeMA is easy to apply even in large and complicated networks.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures




Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Certainty of treatment effect estimates for each outcome at the treatment level were assessed using the Confidence in Network Meta-Analysis (CINeMA) approach, covering six domains of bias: within study bias, across study bias, indirectness, imprecision, heterogeneity, and inconsistency.50 51”
The cited source says what the claim attributes to it.
In the citing paper
“Finally, to assess the credibility of the findings of each network meta-analysis, the findings were incorporated into the Confidence in Network Meta-Analysis (CINeMA) application, which is an adaptation of the Grading of Recommendations Assessment, Development, and Evaluation approach [19–21].”
From Antidepressants for the treatment of adults with major depressive disorder in the maintenance phase: a systematic review and network meta-analysis (2023) · cites this paper as [20]
The cited source says what the claim attributes to it.
In the citing paper
“We applied the CINeMA web application, which facilitates the grading of confidence in the results as high, moderate, low, and very low (Nikolakopoulou et al., 2020) for primary outcomes.”
From Efficacy, acceptability and side-effects of oral versus long-acting- injectables antipsychotics: Systematic review and network meta-analysis (2024) · cites this paper as Nikolakopoulou et al., 2020
The cited source says what the claim attributes to it.
In the citing paper
“The Confidence in Network Meta-Analysis (CINeMA) tool [30, 31] was employed to assess the quality of evidence in six domains, including within-study bias, across-studies bias, indirectness, imprecision, heterogeneity, and incoherence.”
From Comparing caloric restriction regimens for effective weight management in adults: a systematic review and network meta-analysis (2024) · cites this paper as [30]
The cited source says what the claim attributes to it.
In the citing paper
“The certainty of evidence was evaluated using the CINeMA (Confidence in Network Meta-Analysis) framework, which adapts the GRADE approach for network meta-analyses, addressing within-study bias, reporting bias, indirectness, imprecision, heterogeneity, and inconsistency”
7 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
RoB 2: a revised tool for assessing risk of bias in randomised trials
Sterne, J. A. C., Savović, J., Page, M. J., Elbers, R. G., Blencowe, N. S., Boutron, I., Cates, C. J., Cheng, H.-Y., Corbett, M. S., Eldridge, S. M., et al. (2019) · BMJ · doi:10.1136/bmj.l4898 · Cited by 34,787
Self-citationThe Cochrane Collaboration's tool for assessing risk of bias in randomised trials
Higgins, J. P. T., Altman, D. G., Gotzsche, P. C., Juni, P., Moher, D., Oxman, A. D., Savovic, J., Schulz, K. F., Weeks, L., Sterne, J. A. C., et al. (2011) · BMJ · doi:10.1136/bmj.d5928 · Cited by 33,817
Self-citationDermyshi, E., Wang, Y., Yan, C., Hong, W., Qiu, G., Gong, X., & Zhang, T. (2017) · Neonatology · doi:10.1159/000454668 · Cited by 24,451
GRADE: an emerging consensus on rating quality of evidence and strength of recommendations
Guyatt, G. H., Oxman, A. D., Vist, G. E., Kunz, R., Falck-Ytter, Y., Alonso-Coello, P., & Schünemann, H. J. (2008) · BMJ · doi:10.1136/bmj.39489.470347.ad · Cited by 23,305
GRADE guidelines: 1. Introduction—GRADE evidence profiles and summary of findings tables
Guyatt, G., Oxman, A. D., Akl, E. A., Kunz, R., Vist, G., Brozek, J., Norris, S., Falck-Ytter, Y., Glasziou, P., & deBeer, H. (2011) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.04.026 · Cited by 10,681
Hutton, B., Salanti, G., Caldwell, D. M., Chaimani, A., Schmid, C. H., Cameron, C., Ioannidis, J. P. A., Straus, S., Thorlund, K., Jansen, J. P., et al. (2015) · Annals of Internal Medicine · doi:10.7326/m14-2385 · Cited by 8,269 · cited 1×
“org/cmi/about-us), based on previous work [4,16,17].”
Self-citationNorderyd, O. M., Koch, G., Papias, A., Köhler, A. A., Helkimo, A. N., Brahm, C., Lindmark, U., Lindfors, N., Mattsson, A., Rolander, B., et al. (2015) · PubMed · Cited by 3,584
Cipriani, A., Furukawa, T. A., Salanti, G., Chaimani, A., Atkinson, L. Z., Ogawa, Y., Leucht, S., Ruhe, H. G., Turner, E. H., Higgins, J. P. T., et al. (2018) · The Lancet · doi:10.1016/s0140-6736(17)32802-7 · Cited by 3,541 · cited 1×
“A third network, comparing the effectiveness of 18 antidepressants for major depression [12], is evaluated for all domains and is presented in S1 Text.”
Self-citationInterpretation of random effects meta-analyses
Riley, R. D., Higgins, J. P. T., & Deeks, J. J. (2011) · BMJ · doi:10.1136/bmj.d549 · Cited by 2,884
Self-citationGRADE guidelines: 4. Rating the quality of evidence—study limitations (risk of bias)
Guyatt, G. H., Oxman, A. D., Vist, G., Kunz, R., Brozek, J., Alonso-Coello, P., Montori, V., Akl, E. A., Djulbegovic, B., & Falck-Ytter, Y. (2011) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.07.017 · Cited by 2,798
Research works printed but not linked: 2
- 2017, CINeMA: Confidence in Network Meta-Analysis
- T Papakonstantinou, 2020, flow_contribution: R package to calculate contribution of studies in network meta-analysis, GitHub
Cited by
Items 601–700 of 1,004
Amadita, K., Gray, F., Gee, E., Ekpo, E. U., & Jimenez, Y. A. (2024) · Radiography · doi:10.1016/j.radi.2024.10.009 · Cited by 11
Huang, W., Yu, Y. Y., Chen, L., Tang, X., Fang, X., Ou, X., & Du, X. (2024) · American Journal of Obstetrics & Gynecology MFM · doi:10.1016/j.ajogmf.2024.101572 · Cited by 11
Chen, Q. H., Yang, Y., Xu, J., Wang, J., Fang, T., Yuan, Y., Wang, C., & Zhang, L. (2024) · Endocrine Practice · doi:10.1016/j.eprac.2024.11.013 · Cited by 10
Huang, J., Bao, C., Chen, Y., Zhu, W., Zhang, K., Liu, C., & Tang, C. (2024) · EClinicalMedicine · doi:10.1016/j.eclinm.2024.103034 · Cited by 11
Yamamoto, S., Horita, N., Imai, R., & Niitsu, T. (2025) · Lung · doi:10.1007/s00408-024-00777-0 · Cited by 9
“We evaluated the reliability of network meta-analysis results using the confidence in network meta-analysis (CINeMA) framework [25], assessing credibility across six domains: within-study bias, reporting bias, indirectness, imprecision, heterogeneity, and incoherence.”
Cohen, S. E., de Boer, A., Storosum, B. W. C., Mattila, T., Niemeijer, M. J., GELLER, D. A., Denys, D. A. J. P., & Zantvoord, J. B. (2025) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1016/j.jaac.2025.01.001 · Cited by 12
Jin, Q., Xu, G. Z., Ying, Y., Liu, L., Zheng, H., Xu, S., Yin, P., & Chen, Y. (2025) · Journal of Ovarian Research · doi:10.1186/s13048-025-01595-5 · Cited by 15
“In addition, we examined the confidence of evidence using the CINeMA web application, which grades the confidence of the results as high, moderate, low, and very low [14].”
Yuan, Y., Chen, C., Lin, Y., Luo, Y., Yang, Z., Guo, J., Liu, Q., Sun, L., & Fan, G. (2025) · Frontiers in Pharmacology · doi:10.3389/fphar.2024.1462965 · Cited by 14
Gao, W., Zhang, Q., Zhang, L., Xu, M., Zhu, Y., & Han, J. (2025) · European Journal of Oncology Nursing · doi:10.1016/j.ejon.2025.102798 · Cited by 9
Peng, Q., Wang, J., Li, K., Xia, C., Yao, C., Guo, Q., Gong, X., Tang, X., & Jiang, Q. (2025) · Frontiers in Pharmacology · doi:10.3389/fphar.2025.1536023 · Cited by 14
Etrusco, A., Agrifoglio, V., D’Amato, A., Chiàntera, V., Laganà, A. S., Haydamous, J., Cobellis, L., FRANCISCIS, P. D., Vannuccini, S., Krentel, H., et al. (2025) · Frontiers in Endocrinology · doi:10.3389/fendo.2025.1571727 · Cited by 11
Luca, B. D., Canozzi, A., Mosconi, C., Gastaldon, C., Papola, D., Metelli, A., Tedeschi, F., Amaddeo, F., Purgato, M., Solmi, M., et al. (2025) · The British Journal of Psychiatry · doi:10.1192/bjp.2025.18 · Cited by 14
Huang, K., Zhang, G., Gains, H., He, R., Jiao, Y., Jia, Y., & Chen, L. (2025) · Journal of the American Medical Directors Association · doi:10.1016/j.jamda.2025.105583 · Cited by 16
Costa, R. F. D., Reis‐Pardal, J., Arantes‐Oliveira, S., Ferreira, J. C., Azevedo, L. F., & Melo, P. (2025) · International Journal of Molecular Sciences · doi:10.3390/ijms26083488 · Cited by 10
“In addition, since it has been reported that the adhesive application technique (ER vs. SE) [8,25–27] and the ACAD protocol (chemical vs. biological) [7,28] might influence the BR treatment’s effect, we explored the effects of these two covariates in NMA effects estimates based on random-effects…”
Ramai, D., Qatomah, A., Chun, M., Beran, A., Danpanichkul, P., Rashid, M., Sathapanasiri, T., Chaiyakunapruk, N., Previtera, M. J., Spadaccini, M., et al. (2025) · Endoscopy · doi:10.1055/a-2643-7667 · Cited by 9
Chen, N.-C., Pu, L., & Chen, K. (2025) · Disability and Rehabilitation · doi:10.1080/09638288.2025.2522790 · Cited by 11
“Heterogeneity assesses variability across studies, and incoherence examines consistency between direct and indirect evidence [42]. these factors were integrated to determine overall evidence confidence.”
Ciren, Z., Tsui, H. K. H., & Chan, S. K. W. (2025) · Adolescent Research Review · doi:10.1007/s40894-025-00270-6 · Cited by 22
“To assess the certainty of evidence for each comparison, the Confidence-In-Network-Meta-Analysis (CINeMA) framework was used (Nikolakopoulou et al., 2020).”
Gosling, C. J., Boisseleau, L., Solmi, M., Sandbank, M. P., Jurek, L., Nourredine, M., Porcu, G., Murgia, E., Raduà, J., Fusar‐Poli, P., et al. (2025) · Nature Human Behaviour · doi:10.1038/s41562-025-02256-9 · Cited by 10
“This decision aligns with previous large umbrella reviews 31 and with the typical grading process in network meta-analyses 32 .”
Wang, J., Yin, J., Wang, C., & Zhu, Y. (2025) · BMC Surgery · doi:10.1186/s12893-025-03176-1 · Cited by 10
Nava, P., Sabri, H., Hazrati, P., Nava, C., Saleh, M. H. A., & Wang, H. (2026) · Clinical Oral Implants Research · doi:10.1111/clr.70100 · Cited by 9
“The confidence in the results of the network meta-analysis was evaluated using the CINeMA (Confidence in Network Meta-Analysis) framework (Nikolakopoulou et al. 2020), which follows the GRADE principles tailored to NMA.”
Chu, C., Liao, A. H.-W., Chen, C., Lin, Y.-C., & Kang, Y. (2021) · Scientific Reports · doi:10.1038/s41598-021-85179-5 · Cited by 17
Bellos, I., Boletis, I. N., & Lionaki, S. (2022) · Kidney International Reports · doi:10.1016/j.ekir.2022.02.020 · Cited by 9
Martín, Zhou, Y., Takagi, T., & Tian, Y. (2022) · International Journal of Clinical Pharmacy · doi:10.1007/s11096-022-01410-x · Cited by 11
Chen, C.-Y., Huang, C., Chen, W., Huang, M., & Wei, Y.-F. (2022) · International Immunopharmacology · doi:10.1016/j.intimp.2022.108848 · Cited by 15
Liao, G., Wang, X., Li, Y., Chen, X., Huang, K., Bai, L., Ye, Y., & Peng, Y. (2022) · Pharmaceutics · doi:10.3390/pharmaceutics15010006 · Cited by 11
Network Meta-Analysis of Behavioral Programs for Smoking Cessation in Healthy People
Xu, M., Guo, K., Shang, X., Zhou, L., Fenfen, E., Yang, C., Wu, Y., Li, X., & Yang, K. (2023) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2023.02.032 · Cited by 12
Dinges, H., Al-Dahna, T., Rücker, G., Wulf, H., Eberhart, L. H. J., Wiesmann, T., & Schubert, A. (2023) · Minerva Anestesiologica · doi:10.23736/s0375-9393.23.17410-4 · Cited by 9
Deng, X., Shang, X., Guo, K., Zhou, L., Wang, Y., Wu, Y., Liang, S., Fenfen, E., Liu, W., Wang, Z., et al. (2023) · Addiction Biology · doi:10.1111/adb.13303 · Cited by 11
Li, P., Peng, J., Ding, Z., Zhou, X., & Liang, R. (2022) · Evidence-based Complementary and Alternative Medicine · doi:10.1155/2022/3616036 · Cited by 17
Jamjanya, S., Vejjabhinanta, V., Tanasombatkul, K., & Phinyo, P. (2023) · Journal of Dermatological Treatment · doi:10.1080/09546634.2023.2231582 · Cited by 9
Fujii, T., Belletti, A., Carr, A. C., Furukawa, T. A., Luethi, N., Putzu, A., Sartini, C., Salanti, G., Tsujimoto, Y., Udy, A. A., et al. (2019) · BMJ Open · doi:10.1136/bmjopen-2019-033458 · Cited by 8
Self-citationLin, Y.-C., Lai, T.-S., Chen, Y.-T., Chou, Y.-H., Chen, Y.-M., Hung, K.-Y., & Tu, Y.-K. (2025) · Journal of the Formosan Medical Association · doi:10.1016/j.jfma.2024.09.037 · Cited by 10
Sehmbi, H., Retter, S., Shah, U. J., Nguyen, D. L., Martin, J. E., & Uppal, V. (2023) · Canadian Journal of Anesthesia/Journal canadien d anesthésie · doi:10.1007/s12630-023-02510-6 · Cited by 7
Hasan, F., Tu, Y., Lin, C., Yuliana, L. T., Romadlon, D. S., & Chiu, H. (2023) · BMJ Supportive & Palliative Care · doi:10.1136/spcare-2023-004363 · Cited by 14
Guo, C.-H., Zhong, J., Jin, X., & Zhang, J.-E. (2023) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2023.104680 · Cited by 8
Hoang, K. D., Chen, J., Huang, T., Kang, Y., & Chen, C. (2024) · PLoS ONE · doi:10.1371/journal.pone.0279784 · Cited by 8
de Carvalho, C. C., Genuino, W. P., Morais, M. C. V., Paiva, H., Rodrigues, A. I., & El‐Boghdadly, K. (2024) · Regional Anesthesia & Pain Medicine · doi:10.1136/rapm-2024-105547 · Cited by 8
A network meta-analysis of the timing of wound dressing removal
Hwang, R., Crook, D., Allan, C., & Sarkar, S. (2024) · Annals of The Royal College of Surgeons of England · doi:10.1308/rcsann.2023.0083 · Cited by 8
Visualizing the assumptions of network meta‐analysis
Tu, Y., Lai, P., Huang, Y., & Hodges, J. S. (2024) · Research Synthesis Methods · doi:10.1002/jrsm.1760 · Cited by 8
Mo, J., Wang, D., Xiao, J., Chen, Q., An, R., & Liu, H. L. (2024) · BMC Anesthesiology · doi:10.1186/s12871-024-02737-w · Cited by 14
“These variables include the evaluation of bias within the study, bias in reporting, lack of directness, imprecision, and heterogeneity [23, 24].”
BackgroundShi, F., Yu, J., Wang, H., & Wu, C. (2024) · Current Problems in Cardiology · doi:10.1016/j.cpcardiol.2024.102881 · Cited by 9
Pornsuriyasak, P., Sa-nguansai, S., Thadanipon, K., Numthavaj, P., McKay, G. J., Attia, J., & Thakkinstian, A. (2025) · BMC Medicine · doi:10.1186/s12916-025-03847-z · Cited by 10
“The certainty of the evidence generated from the NMA was assessed using the Confidence in Network Meta-Analysis (CIN-eMA) framework [34].”
Ahmed, I., Mustafaoğlu, R., Memon, A. R., Zafeer, R., Xiong, H.-Y., Straudi, S., & Runge, N. (2025) · Clinical Journal of Pain · doi:10.1097/ajp.0000000000001282 · Cited by 10
“For NMA, the certainty of evidence for each comparison (direct and indirect) was assessed utilizing the con fi dence in network meta-analysis (CINeMA) framework, 29 as detailed in the web application accessible at http://cinema.ispm.ch/.”
Acute pain service for postoperative pain in adults: a network meta-analysis
Chen, L., Feng, X., Ye, L., Yang, J., Zhou, R., Qiu, Y., Chen, G., & Zhu, T. (2025) · International Journal of Surgery · doi:10.1097/js9.0000000000002419 · Cited by 13
“Network meta-analysis quality was rated using the CINeMA tool [ 14 , 15 ] (https://cinema.ispm.unibe. ch/), based on the GRADE framework, evaluating within-study bias, reporting bias, indirectness, imprecision, heterogeneity, and incoherence.”
Fornaro, M., Caiazza, C., Pistone, L., Lorenzo, C. D., Crincoli, W., Pezone, R., Tufano, G., Oliva, V., Prisco, M. D., Miola, A., et al. (2025) · European Neuropsychopharmacology · doi:10.1016/j.euroneuro.2025.04.003 · Cited by 9
Hussain, N., Brull, R., Freedenberg, A. T., Vannabouathong, C., D'Souza, R. S., Havlik, S., Beachy, P., Gunawan, A., Weaver, T. E., McIsaac, D. I., et al. (2025) · Anesthesiology · doi:10.1097/aln.0000000000005607 · Cited by 11
Analysing complex interventions using component network meta-analysis
Veroniki, A. A., Wolfe, D. M., Hutton, B., Schwarzer, G., McIsaac, D. I., Straus, S. E., Jackson, D., & Tricco, A. C. (2026) · BMJ · doi:10.1136/bmj-2024-083075 · Cited by 10
“Currently, frameworks that assess the certainty of evidence in standard NMAs, such as CINEMA 52 (Confidence in Network Meta-Analysis) and GRADE 53 (Grading of Recommendations, Assessment, Development, and Evaluations), have not yet been formally extended to CNMA, and can be applied only to overall intervention effects…”
Nøhr, N., Zangger, G., Dalum, F. B., Skou, S. T., Juhl, C. B., & Bricca, A. (2025) · Journal of Physical Activity and Health · doi:10.1123/jpah.2025-0014 · Cited by 10
Flauto, F., Neola, G., Caso, C., Signori, A., Fornarini, G., Scagliarini, S., Rossetti, S., Crocetto, F., Grillone, F., Costanzo, F. D., et al. (2025) · European Urology Oncology · doi:10.1016/j.euo.2025.06.008 · Cited by 9
Vanlinthout, L. E., Driessen, J. J., Stolker, R. J., Lesaffre, E. M. E. H., Berghmans, J. M., & Staals, L. M. (2025) · British Journal of Anaesthesia · doi:10.1016/j.bja.2025.08.036 · Cited by 11
“38,45 In conclusion, we conducted a systematic review and meta-analysis to synthesise and consolidate evidence on the comparative effectiveness of commonly used interventions for facilitating tracheal tube insertion.”
Hoffmann, K., Michalak, M., Rizzo, M., Maggio, V., & Paczkowska, A. (2026) · Expert Opinion on Drug Safety · doi:10.1080/14740338.2025.2586703 · Cited by 8
“CINeMA is a transparent system that considers six domains – within-study bias, reporting bias, indirectness, imprecision, heterogeneity, and incoherence – and summarizes them into a global judgment of confidence for each relative effect estimate [37].”
Schleimer, T., Teichert, F., Henriksen, M., Döding, R., Innocenti, T., Brisby, H., Klotz, M. C. M., Korinth, M., Owen, P. J., Pieper, D., et al. (2026) · RMD Open · doi:10.1136/rmdopen-2025-006275 · Cited by 11
“72 The informative statements suggested by Santesso et al 73 were used to communicate the findings and facilitate interpretation.”
Zhang, Y., Huang, H., Tan, Z., Lei, L., & Chen, X. (2026) · Preventive Medicine · doi:10.1016/j.ypmed.2026.108550 · Cited by 9
Shinozaki, S., Watanabe, J., Kanno, T., Nakazawa, K., & Yano, T. (2026) · Digestive Endoscopy · doi:10.1111/den.70138 · Cited by 13
“Two independent reviewers (S.S. and J.W.) assessed the confidence in the evidence for each outcome using the CINeMA tool [20].”
Yang, H., Zheng, C., Zheng, Q., Xu, H., Li, X., Hao, M., & Fang, Y. (2021) · BMJ Open · doi:10.1136/bmjopen-2020-039122 · Cited by 8
Chiou, K., Chiu, Y.-C., Lee, C., Huang, T., Lai, Y.-C., Yang, C.-J., Hsu, J. C., & Wu, M. (2022) · North American Spine Society Journal (NASSJ) · doi:10.1016/j.xnsj.2022.100177 · Cited by 8
Jin, B., Xv, Y., Zhang, B., Qiao, L., & Liu, H. (2022) · Frontiers in Aging Neuroscience · doi:10.3389/fnagi.2022.1037414 · Cited by 9
A systematic review and Bayesian meta-analysis of the antibiotic treatment courses in AECOPD
Yu, H., Lei, T., Su, X., Zhang, L., Feng, Z., Chen, X., & Liu, J. (2023) · Frontiers in Pharmacology · doi:10.3389/fphar.2023.1024807 · Cited by 8
Nim, C. G., Aspinall, S. L., Cook, C. E., Corrêa, L. A., Donaldson, M. B., Downie, A., Harsted, S., Hartvigsen, J., Jenkins, H. J., McNaughton, D., et al. (2023) · Chiropractic & Manual Therapies · doi:10.1186/s12998-023-00487-z · Cited by 8
Orso, D., Santangelo, S., Guglielmo, N., Bove, T., Cilenti, F., Cristiani, L., & Copetti, R. (2023) · American Journal of Cardiovascular Drugs · doi:10.1007/s40256-023-00586-5 · Cited by 9
Gupta, A. K., Venkataraman, M., & Bamimore, M. A. (2023) · British Journal of Dermatology · doi:10.1093/bjd/ljad070 · Cited by 8
Luo, Q., Yang, C., Huang, L., Xu, G., Hao, T., Sun, M., & Liang, F. (2023) · BMJ Open · doi:10.1136/bmjopen-2023-071554 · Cited by 10
Zhang, Q., Xu, X., Wu, Q., Zhang, J., Huang, S., Wu, L., Tian, M., & Zhang, D. (2024) · Frontiers in Cardiovascular Medicine · doi:10.3389/fcvm.2024.1300319 · Cited by 8
Løvsletten, P. O., Wang, X., Pitre, T., Ødegaard, M., Veroniki, A. A., Lunny, C., Tricco, A. C., Agoritsas, T., & Vandvik, P. O. (2024) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2024.111445 · Cited by 8
Ayesh, H., Suhail, S., Ayesh, S. K., & Niswender, K. D. (2024) · Diabetes Obesity and Metabolism · doi:10.1111/dom.15725 · Cited by 11
Karasuyama, M., Tsuruta, T., Yamamoto, S., Ariie, T., Kawakami, J., Minamikawa, T., Ohzono, H., Moriyama, H., & Gotoh, M. (2024) · Journal of Shoulder and Elbow Surgery · doi:10.1016/j.jse.2024.05.036 · Cited by 8
Farhat, L. C., Behling, E., Landeros‐Weisenberger, A., de Barros, P. M. F., Polanczyk, G. V., Cortese, S., & Bloch, M. H. (2024) · Journal of Child and Adolescent Psychopharmacology · doi:10.1089/cap.2024.0049 · Cited by 13
“Certainty of evidence was evaluated with the Con fi dence In Network Meta-Analysis (CINeMA) framework (Nikolakopoulou et al., 2020).”
Ma, N., Pan, B., Yang, S.-H., Lai, H., Ning, J., Li, Y., Liu, J., Huang, J., Yan, M., Hou, L., et al. (2024) · Journal of Ethnopharmacology · doi:10.1016/j.jep.2024.119254 · Cited by 11
Afach, S., Evrenoglou, T., Oubaya, N., Cleach, L. L., & Sbidian, É. (2021) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2021.01.013 · Cited by 13
Taslimi, S., Ye, V. C., & Zadeh, G. M. (2021) · Neuro-Oncology Advances · doi:10.1093/noajnl/vdab028 · Cited by 10
Taslimi, S., Ye, V. C., Wen, P. Y., & Zadeh, G. M. (2021) · Neuro-Oncology Advances · doi:10.1093/noajnl/vdab029 · Cited by 12
Zhang, K., Zhang, Y., Zhou, J., Xu, L., Zhou, C., Chen, G., & Huang, X. (2022) · Frontiers in Pharmacology · doi:10.3389/fphar.2022.676831 · Cited by 8
Huang, Z., Xu, X., Xu, D., Zhao, P., & Zou, M. (2023) · Medicine · doi:10.1097/md.0000000000032635 · Cited by 14
Hasan, F., Lee, H.-C., Chen, P.-Y., Wang, Y.-H., Yuliana, L. T., Romadlon, D. S., Tu, Y.-K., & Chiu, H.-Y. (2023) · Sleep and Breathing · doi:10.1007/s11325-023-02812-5 · Cited by 9
Tehrani, H. D., Yamini, S., & Vazsonyi, A. T. (2023) · Journal of Experimental Criminology · doi:10.1007/s11292-023-09562-0 · Cited by 15
Exercise treatments for chronic low back pain: a network meta-analysis
Hayden, J. A., Ogilvie, R., Kashif, S., Singh, S., Boulos, L., Stewart, S. A., Wieland, L. S., de Jesus‐Moraleida, F. R., Saragiotto, B. T., Yamato, T. P., et al. (2023) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd015608 · Cited by 18
Network meta‐analysis: methodological points for readers, authors and reviewers
Guelimi, R., Metelli, S., Sbidian, É., van Zuuren, E. J., Flohr, C., Leonardi‐Bee, J., & Cleach, L. L. (2022) · British Journal of Dermatology · doi:10.1111/bjd.21013 · Cited by 8
Lohmöller, K., Carstensen, V., Pogatzki-Zahn, E. M., Freys, S. M., Weibel, S., & Schnabel, A. (2024) · Surgical Endoscopy · doi:10.1007/s00464-023-10667-w · Cited by 7
Musa, R., Elamin, D., Barrie, R., & Kimmie‐Dhansay, F. (2024) · JMIR Research Protocols · doi:10.2196/50479 · Cited by 11
Shortest path or random walks? A framework for path weights in network meta‐analysis
Rücker, G., Papakonstantinou, T., Nikolakopoulou, A., Schwarzer, G., Galla, T., & Davies, A. L. (2024) · Statistics in Medicine · doi:10.1002/sim.10177 · Cited by 7
Self-citationCheng, X., Sun, S., Chen, M., Zhou, X., Rao, M., Guo, D., Xie, J., Huang, Q., & Su, L. (2024) · Obesity Reviews · doi:10.1111/obr.13834 · Cited by 8
“The CINeMA framework 37 was applied to infer the credibility of NMA evidence and assess the quality of effect estimates for all intervention comparisons.”
Jiao, X., Du, M., Li, Q., Huang, C., Ding, R., & Wang, W. (2024) · Archives of Orthopaedic and Trauma Surgery · doi:10.1007/s00402-024-05569-y · Cited by 7
“We used Confidence in Network Meta-Analysis (CIN-eMA) [11 ] to generate network diagrams as well as study limitation bars in the GRADE evaluation.”
Burkhardt, B. E. U., Hummel, J., Rücker, G., & Stiller, B. (2024) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd013707.pub2 · Cited by 16
Chang, C.-Y., Lee, K.-H., Wang, J.-C., Tsai, S., Chen, C., Wu, P., & Chen, W.-M. (2025) · EFORT Open Reviews · doi:10.1530/eor-2024-0070 · Cited by 7
“3.2 (https://cran.r-project.org/ src/base/R-4/) with the ‘ netmeta ’ package and ‘ CINeMA ’ website was used to identify the optimal treatment with result of primary outcome (30).”
InfluentialWu, W., Wu, W.-H., Lee, M., Wu, P.-Y., Tu, Y., Lin, H. H., Chan, C., & Huang, C. (2025) · Sports Medicine · doi:10.1007/s40279-025-02179-5 · Cited by 8
“The certainty of the evidence was assessed using the online CINeMA tool, which evaluates the following criteria: within-study bias, reporting bias, indirectness, imprecision, heterogeneity, and incoher-ence [51, 52].”
Wu, Y., Wang, H., Hui, X., Qian, Z., Wang, M., Fenfen, E., Xu, M., Zhou, L., Deng, X., Li, X., et al. (2025) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2025.106088 · Cited by 10
Zhu, L., Zeng, J., Li, H., Li, K., & Chen, X. (2025) · BMC Pulmonary Medicine · doi:10.1186/s12890-025-03679-w · Cited by 8
“Each domain was rated as “major concerns,” “some concerns,” or “no concerns,” and the overall confidence in the evidence was then determined based on an integrated assessment of these domains [22].”
Wu, B., Liu, W., Wang, S., Li, H., & Yin, M. (2025) · Complementary Therapies in Medicine · doi:10.1016/j.ctim.2025.103188 · Cited by 8
Keesukphan, A., Suntipap, M., Thadanipon, K., Boonmanunt, S. W., Numthavaj, P., McKay, G. J., Attia, J., & Thakkinstian, A. (2025) · PM&R · doi:10.1002/pmrj.13356 · Cited by 7
Chen, Y., Sui, Y., Chen, R., & Zhang, Q. (2025) · Age and Ageing · doi:10.1093/ageing/afaf155 · Cited by 16
Liao, Y.-L., Hsu, P.-S., Lee, C.-T., Su, L., Shen, Y.-Y., Tsou, A., Lan, C., Tzeng, I., Liu, G., & Hsieh, P. (2025) · Frontiers in Aging Neuroscience · doi:10.3389/fnagi.2025.1559388 · Cited by 8
Yeh, J., Huang, C., Lee, C., Chen, Y.-J., Huang, S.-L., Wang, W., Tu, Y., Chiu, T., Chiang, C., Chen, C., et al. (2025) · Annals of Internal Medicine · doi:10.7326/annals-24-02142 · Cited by 9
Wang, C., Sun, J., Liang, Z., Cai, Y., Zhang, M., Tian, S., Yang, W., Cheng, S., Duan, R., & Wang, X. (2025) · European Journal of Pain · doi:10.1002/ejp.70109 · Cited by 11
“CINeMA is a tool designed specifically for NMAs and is used to evaluate the quality of different pieces of evidence and assess reliability based on the following aspects: within-study bias, reporting bias, indirectness, imprecision, heterogeneity and incoherence (Nikolakopoulou et al. 2020).”
Liu, H., Wang, Y., Li, M., Liu, X., Chen, X., Zhu, B., & Wang, H. (2025) · Sleep Medicine · doi:10.1016/j.sleep.2025.106848 · Cited by 8
Wei, Y., Lorenz, C., Siafis, S., Schneider‐Thoma, J., Kim, D. D., Wu, H., Nomura, N., Dong, S., Furukawa, Y., Zhu, Y., et al. (2025) · EClinicalMedicine · doi:10.1016/j.eclinm.2025.103583 · Cited by 9
Self-citationZaccoletti, D., Mosconi, C., Gastaldon, C., Benedetti, L., Gottardi, C., Papola, D., Ponzi, O., Purgato, M., Naudet, F., Cristea, I. A., et al. (2025) · The Lancet Psychiatry · doi:10.1016/s2215-0366(25)00330-x · Cited by 13
Song, J., Dong, H., Wang, C., Zheng, Y., Huang, Y., Wei, Y., Zhang, K., Qing, H., Xiong, Z., Pan, Y., et al. (2026) · BMC Medicine · doi:10.1186/s12916-026-04682-6 · Cited by 12
“Confidence ratings begin at high and are downgraded by one level for domains with some concerns and by two levels for domains with major concerns [33].”
Chiang, C., Lin, J., Tsai, T., Tu, Y., & Tsai, M. (2023) · Academic Emergency Medicine · doi:10.1111/acem.14680 · Cited by 7
Huang, Q., You, M. J., Huang, W., Chen, J., Zeng, Q., Jiang, L., Du, X., Liu, X., Hong, M., & Wang, J. (2023) · Frontiers in Pharmacology · doi:10.3389/fphar.2023.1050412 · Cited by 8
Alvi, A. S., Nasir, J. A., Nizam, M. A., Hamdani, M. M., Bhangar, N. A., Sibtain, S. A., Lalani, A. S., & Warlé, M. C. (2023) · Pain Management · doi:10.2217/pmt-2023-0033 · Cited by 7
Metadata
- Authors
- Nikolakopoulou, A., Higgins, J. P. T., Papakonstantinou, T., Chaimani, A., Del Giovane, C., Egger, M., & Salanti, G.
- Affiliations
- University of Bern (CH)
- University of Bristol (GB)
- Inserm (FR)
- Corresponding author
- Salanti, Georgia
- ORCID
- Venue
- PLOS Medicine
- Publisher
- Public Library of Science (PLoS)
- Published
- 2020-04-03
- Volume
- 17
- Issue
- 4
- Pages
- e1003082
- ISSN
- 1549-1277 (ISSN-L)
- 1549-1676
- PMC
- PMC7122720
- OpenAlex
- W3015163167
- Semantic Scholar
- 35bd793fad0fbf74d7f784a8052d834bc4e80f96
- Cited by
- 1,935
- References
- 62
- Citations by year
- 2026: 557 · 2025: 398 · 2024: 336 · 2023: 231 · 2022: 201 · 2021: 155 · 2020: 52
- FWCI
- 97.06
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- PLoS Medicine (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- IRIS UNIMORE (University of Modena and Reggio Emilia) (submittedVersion, cc-by)
- HAL (submittedVersion, cc-by)
- RePEc: Research Papers in Economics (submittedVersion)
- Bern Open Repository and Information System (University of Bern) (submittedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Figshare (submittedVersion, cc-by)
- Bristol Research (University of Bristol) (submittedVersion, cc-by)
- Open Access CRIS of the University of Bern
- Funders
- Schweizerischer Nationalfonds zur Förderung der Wissenschaftlichen Forschung (179158, 174281)
- Campbell Collaboration
- Cochrane Collaboration
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Sociology and Political Science › Delphi Technique in Research
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Clinical practice guidelines implementation
- Keywords
- network meta-analysis, cinema, credibility assessment, reporting bias, indirectness, imprecision, heterogeneity, incoherence, transparency, evidence synthesis
- MeSH terms
- Network Meta-Analysis as Topic, Coronary Artery Disease, Electrocardiography, Exercise Test, Humans, Confidence Intervals, Randomized Controlled Trials as Topic, Magnetic Resonance Imaging, Cine
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.