Indirect Treatment Comparison/Network Meta-Analysis Study Questionnaire to Assess Relevance and Credibility to Inform Health Care Decision Making: An ISPOR-AMCP-NPC Good Practice Task Force Report
Open accessAbstract
Despite the great realized or potential value of network meta-analysis of randomized controlled trial evidence to inform health care decision making, many decision makers might not be familiar with these techniques. The Task Force developed a consensus-based 26-item questionnaire to help decision makers assess the relevance and credibility of indirect treatment comparisons and network meta-analysis to help inform health care decision making. The relevance domain of the questionnaire (4 questions) calls for assessments about the applicability of network meta-analysis results to the setting of interest to the decision maker. The remaining 22 questions belong to an overall credibility domain and pertain to assessments about whether the network meta-analysis results provide a valid answer to the question they are designed to answer by examining 1) the used evidence base, 2) analysis methods, 3) reporting quality and transparency, 4) interpretation of findings, and 5) conflicts of interest. The questionnaire aims to help readers of network meta-analysis opine about their confidence in the credibility and applicability of the results of a network meta-analysis, and help make decision makers aware of the subtleties involved in the analysis of networks of randomized trial evidence. It is anticipated that user feedback will permit periodic evaluation and modification of the questionnaire.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The study followed a comprehensive systematic review methodology that followed the Cochrane Handbook and ISPOR guidelines, and reported using the PRISMA extension for NMA.
“Strengths of our study include a comprehensive systematic review methodology that followed the Cochrane Handbook44 and ISPOR12 guidelines, and reported using the PRISMA extension for NMA.13”
Cites
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: the PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & for the PRISMA Group (2009) · BMJ · doi:10.1136/bmj.b2535 · Cited by 83,823 · see citing works
Preferred reporting items for systematic reviews and meta-analyses: the PRISMA Statement.
(2009) · PubMed Central · Cited by 44,859 · see citing works
Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & the PRISMA Group* (2009) · Annals of Internal Medicine · doi:10.7326/0003-4819-151-4-200908180-00135 · Cited by 37,554 · see citing works
The Cochrane Collaboration's tool for assessing risk of bias in randomised trials
Higgins, J. P. T., Altman, D. G., Gotzsche, P. C., Juni, P., Moher, D., Oxman, A. D., Savovic, J., Schulz, K. F., Weeks, L., Sterne, J. A. C., et al. (2011) · BMJ · doi:10.1136/bmj.d5928 · Cited by 33,817 · see citing works
Gelman, A., Carlin, J. B., Stern, H. S., Dunson, D. B., Vehtari, A., & Rubin, D. B. (2013) · doi:10.1201/b16018 · Cited by 27,276 · see citing works
GRADE: an emerging consensus on rating quality of evidence and strength of recommendations
Guyatt, G. H., Oxman, A. D., Vist, G. E., Kunz, R., Falck-Ytter, Y., Alonso-Coello, P., & Schünemann, H. J. (2008) · BMJ · doi:10.1136/bmj.39489.470347.ad · Cited by 23,305 · see citing works
Salanti, G., Ades, A. E., & Ioannidis, J. P. A. (2011) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.03.016 · Cited by 3,766 · see citing works
Self-citationHow should meta‐regression analyses be undertaken and interpreted?
Thompson, S. G., & Higgins, J. P. T. (2002) · Statistics in Medicine · doi:10.1002/sim.1187 · Cited by 3,026 · see citing works
Bayesian Data Analysis, 2nd edn
Brix, A. (2005) · Journal of the Royal Statistical Society Series A (Statistics in Society) · doi:10.1111/j.1467-985x.2004.00347_4.x · Cited by 2,588 · see citing works
Checking consistency in mixed treatment comparison meta-analysis
Dias, S., Welton, N. J., Caldwell, D. M., & Ades, A. E. (2010) · Statistics in Medicine · doi:10.1002/sim.3767 · Cited by 2,521 · see citing works
Combination of direct and indirect evidence in mixed treatment comparisons
Lu, G., & Ades, A. E. (2004) · Statistics in Medicine · doi:10.1002/sim.1875 · Cited by 2,149 · see citing works
Bucher, H. C., Guyatt, G. H., Griffith, L. E., & Walter, S. D. (1997) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(97)00049-8 · Cited by 2,052 · see citing works
The Hazards of Scoring the Quality of Clinical Trials for Meta-analysis
Jüni, P. (1999) · JAMA · doi:10.1001/jama.282.11.1054 · Cited by 1,981 · see citing works
Simultaneous comparison of multiple treatments: Combining direct and indirect evidence.
Caldwell, D. M., Ades, A. E., & Higgins, J. P. T. (2005) · BMJ · doi:10.1136/bmj.331.7521.897 · Cited by 1,600 · cited 4× · see citing works
“the comparison of interest would be considered [4,5,10,12].”
BackgroundResultInfluentialDias, S., Sutton, A. J., Ades, A. E., & Welton, N. J. (2013) · Medical Decision Making · doi:10.1177/0272989x12458724 · Cited by 1,207 · see citing works
Toward Evidence-Based Medical Statistics. 1: The P Value Fallacy
Goodman, S. N. (1999) · Annals of Internal Medicine · doi:10.7326/0003-4819-130-12-199906150-00008 · Cited by 1,188 · see citing works
Jansen, J. P., Fleurence, R., Devine, B., Itzler, R. F., Barrett, A., Hawkins, N., Lee, K., Boersma, C., Annemans, L., & Cappelleri, J. C. (2011) · Value in Health · doi:10.1016/j.jval.2011.04.002 · Cited by 1,036 · see citing works
Self-citationSong, F., Altman, D. G., Glenny, A., & Deeks, J. J. (2003) · BMJ · doi:10.1136/bmj.326.7387.472 · Cited by 944 · see citing works
The Interpretation of Random-Effects Meta-Analysis in Decision Models
Ades, A. E., Lu, G., & Higgins, J. P. T. (2005) · Medical Decision Making · doi:10.1177/0272989x05282643 · Cited by 861 · see citing works
Hoaglin, D. C., Hawkins, N., Jansen, J. P., Scott, D. A., Itzler, R. F., Cappelleri, J. C., Boersma, C., Thompson, D., Larholt, K. M., Díaz, M., et al. (2011) · Value in Health · doi:10.1016/j.jval.2011.01.011 · Cited by 771 · see citing works
Self-citationAssessing Evidence Inconsistency in Mixed Treatment Comparisons
Lu, G., & Ades, A. E. (2006) · Journal of the American Statistical Association · doi:10.1198/016214505000001302 · Cited by 756 · see citing works
Demystifying trial networks and network meta-analysis
Mills, E. J., Thorlund, K., & Ioannidis, J. P. A. (2013) · BMJ · doi:10.1136/bmj.f2914 · Cited by 742 · see citing works
Jansen, J. P., Crawford, B., Bergman, G., & Stam, W. B. (2008) · Value in Health · doi:10.1111/j.1524-4733.2008.00347.x · Cited by 386 · see citing works
Self-citationUse of Indirect and Mixed Treatment Comparisons for Technology Assessment
Sutton, A. J., Ades, A. E., Cooper, N. J., & Abrams, K. R. (2008) · PharmacoEconomics · doi:10.2165/00019053-200826090-00006 · Cited by 354 · see citing works
A case study of multiple-treatments meta-analysis demonstrates that covariates should be considered
Salanti, G., Marinho, V. C., & Higgins, J. P. T. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2008.10.001 · Cited by 302 · see citing works
Self-citationSchmid, C. H., Stark, P. C., Berlin, J. A., Landais, P., & Lau, J. (2004) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2003.12.001 · Cited by 245 · see citing works
Cooper, N. J., Sutton, A. J., Morris, D. H., Ades, A. E., & Welton, N. J. (2009) · Statistics in Medicine · doi:10.1002/sim.3594 · Cited by 238 · see citing works
Exploring the Geometry of Treatment Networks
Salanti, G., Kavvoura, F. K., & Ioannidis, J. P. A. (2008) · Annals of Internal Medicine · doi:10.7326/0003-4819-148-7-200804010-00011 · Cited by 229 · see citing works
Self-citationIndirect Comparisons: A Review of Reporting and Methodological Quality
Donegan, S., Williamson, P. R., Gamble, C. L., & Smith, C. T. (2010) · PLoS ONE · doi:10.1371/journal.pone.0011054 · Cited by 146 · see citing works
Berger, M. L., Martin, B. C., Husereau, D., Worley, K., Allen, J. D., Yang, W., Quon, N. C., Mullins, C. D., Kahler, K. H., & Crown, W. H. (2014) · Value in Health · doi:10.1016/j.jval.2013.12.011 · Cited by 130 · see citing works
Mixed treatment comparisons using aggregate and individual participant level data
Saramago, P., Sutton, A. J., Cooper, N. J., & Manca, A. (2012) · Statistics in Medicine · doi:10.1002/sim.5442 · Cited by 116 · see citing works
Evidence Synthesis for Decision Making 7
Ades, A. E., Caldwell, D. M., Reken, S., Welton, N. J., Sutton, A. J., & Dias, S. (2013) · Medical Decision Making · doi:10.1177/0272989x13485156 · Cited by 98 · see citing works
Indirect comparisons: the mesh and mess of clinical trials
Ioannidis, J. P. A. (2006) · The Lancet · doi:10.1016/s0140-6736(06)69615-3 · Cited by 94 · see citing works
Network meta‐analysis of individual and aggregate level data
Jansen, J. P. (2012) · Research Synthesis Methods · doi:10.1002/jrsm.1048 · Cited by 94 · see citing works
Self-citationDias, S., Welton, N. J., Marinho, V. C., Salanti, G., Higgins, J. P. T., & Ades, A. E. (2010) · Journal of the Royal Statistical Society Series A (Statistics in Society) · doi:10.1111/j.1467-985x.2010.00639.x · Cited by 85 · see citing works
Self-citationAssessing the potential for outcome reporting bias in a review: a tutorial
Dwan, K. M., Gamble, C. L., Kolamunnage‐Dona, R., Mohammed, S., Powell, C., & Williamson, P. R. (2010) · Trials · doi:10.1186/1745-6215-11-52 · Cited by 64 · see citing works
Directed acyclic graphs can help understand bias in indirect and mixed treatment comparisons
Jansen, J. P., Schmid, C. H., & Salanti, G. (2012) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2012.01.002 · Cited by 62 · see citing works
Self-citationDonegan, S., Williamson, P. R., D’Alessandro, U., & Smith, C. T. (2012) · Statistics in Medicine · doi:10.1002/sim.5470 · Cited by 50 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Hutton, B., Salanti, G., Caldwell, D. M., Chaimani, A., Schmid, C. H., Cameron, C., Ioannidis, J. P. A., Straus, S., Thorlund, K., Jansen, J. P., et al. (2015) · Annals of Internal Medicine · doi:10.7326/m14-2385 · Cited by 8,269 · see citing works
Self-citationCINeMA: an approach for assessing confidence in the results of a network meta-analysis
Nikolakopoulou, A., Higgins, J. P. T., Papakonstantinou, T., Chaimani, A., Del Giovane, C., Egger, M., & Salanti, G. (2020) · PLOS Medicine · doi:10.1371/journal.pmed.1003082 · Cited by 1,935 · see citing works
Self-citationPuhan, M. A., Schunemann, H. J., Murad, M. H., Li, T., Brignardello-Petersen, R., Singh, J. A., Kessels, A. G., Guyatt, G. H., & for the GRADE Working Group (2014) · BMJ · doi:10.1136/bmj.g5630 · Cited by 1,812 · see citing works
Ranking treatments in frequentist network meta-analysis works without resampling methods
Rücker, G., & Schwarzer, G. (2015) · BMC Medical Research Methodology · doi:10.1186/s12874-015-0060-8 · Cited by 1,732 · see citing works
Comparisons of Interventions for Preventing Falls in Older Adults
Tricco, A. C., Thomas, S. M., Veroniki, A. A., Hamid, J. S., Cogo, E., Strifler, L., Khan, P. A., Robson, R. C., Sibley, K. M., MacDonald, H. R., et al. (2017) · JAMA · doi:10.1001/jama.2017.15006 · Cited by 618 · see citing works
Zaccardi, F., Webb, D. R., Htike, Z. Z., Youssef, D. A. H., Khunti, K., & Davies, M. J. (2016) · Diabetes Obesity and Metabolism · doi:10.1111/dom.12670 · Cited by 496 · see citing works
Network meta-analysis: a technique to gather evidence from direct and indirect comparisons
Tonin, F. S., Rotta, I., Mendes, A. M., & Pontarolo, R. (2017) · Pharmacy Practice · doi:10.18549/pharmpract.2017.01.943 · Cited by 406 · see citing works
Methods for Population-Adjusted Indirect Comparisons in Health Technology Appraisal
Phillippo, D., Ades, A. E., Dias, S., Palmer, S., Abrams, K. R., & Welton, N. J. (2017) · Medical Decision Making · doi:10.1177/0272989x17725740 · Cited by 401 · see citing works
Get real in individual participant data (IPD) meta‐analysis: a review of the methodology
Debray, T. P. A., Moons, K. G. M., van Valkenhoef, G., Efthimiou, O., Hummel, N., Groenwold, R. H. H., Reitsma, J. B., & on behalf of the GetReal methods review group (2015) · Research Synthesis Methods · doi:10.1002/jrsm.1160 · Cited by 348 · see citing works
Veroniki, A. A., Cogo, E., Rios, P., Straus, S. E., Finkelstein, Y., Kealey, R., Reynen, E., Soobiah, C., Thavorn, K., Hutton, B., et al. (2017) · BMC Medicine · doi:10.1186/s12916-017-0845-1 · Cited by 339 · see citing works
Mitra, S., Flórez, I. D., Tamayo, M. E., Mbuagbaw, L. C. E., Vanniyasingam, T., Veroniki, A. A., Zea, A. M., Zhang, Y., Sadeghirad, B., & Thabane, L. (2018) · JAMA · doi:10.1001/jama.2018.1896 · Cited by 330 · see citing works
BUGSnet: an R package to facilitate the conduct and reporting of Bayesian network Meta-analyses
Béliveau, A., Boyne, D. J., Slater, J., Brenner, D. R., & Arora, P. (2019) · BMC Medical Research Methodology · doi:10.1186/s12874-019-0829-2 · Cited by 319 · see citing works
Riley, R. D., Jackson, D., Salanti, G., Burke, D. L., Price, M. J., Kirkham, J. J., & White, I. R. (2017) · BMJ · doi:10.1136/bmj.j3932 · Cited by 244 · see citing works
Self-citationUndertaking network meta‐analyses
Chaimani, A., Caldwell, D. M., Li, T., Higgins, J. P. T., & Salanti, G. (2019) · Wiley eBooks · doi:10.1002/9781119536604.ch11 · Cited by 287 · see citing works
Self-citationVeroniki, A. A., Rios, P., Cogo, E., Straus, S. E., Finkelstein, Y., Kealey, R., Reynen, E., Soobiah, C., Thavorn, K., Hutton, B., et al. (2017) · BMJ Open · doi:10.1136/bmjopen-2017-017248 · Cited by 222 · see citing works
Veroniki, A. A., Straus, S. E., Fyraridis, A., & Tricco, A. C. (2016) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2016.02.016 · Cited by 220 · see citing works
Management of Frailty: A Systematic Review and Network Meta-analysis of Randomized Controlled Trials
Negm, A. M., Kennedy, C. C., Thabane, L., Veroniki, A. A., Adachi, J. D., Richardson, J. A., Cameron, I. D., Giangregorio, A., Πετροπούλου, Μ., Alsaad, S. M., et al. (2019) · Journal of the American Medical Directors Association · doi:10.1016/j.jamda.2019.08.009 · Cited by 188 · see citing works
Marinovich, M. L., Azizi, L., Macaskill, P., Irwig, L., Morrow, M., Solin, L. J., & Houssami, N. (2016) · Annals of Surgical Oncology · doi:10.1245/s10434-016-5446-2 · Cited by 180 · see citing works
Jaime, J., Eddy, D. M., Kan, H. J., Kaltz, C., Patel, B. V., Eldessouki, R., & Briggs, A. H. (2014) · Value in Health · doi:10.1016/j.jval.2014.01.003 · Cited by 167 · see citing works
Self-citationChaimani, A., Caldwell, D. M., Li, T., Higgins, J. P. T., & Salanti, G. (2017) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2016.11.015 · Cited by 159 · see citing works
Self-citationTricco, A. C., Zarin, W., Cardoso, R., Veroniki, A. A., Khan, P. A., Nincic, V., Ghassemi, M., Warren, R., Sharpe, J. P., Page, A. V., et al. (2018) · BMJ · doi:10.1136/bmj.k4029 · Cited by 164 · see citing works
Hazlewood, G. S., Barnabe, C. C. M., TOMLINSON, G. A., Marshall, D. A., Devoe, D. J. A., & Bombardier, C. (2016) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd010227.pub2 · Cited by 145 · see citing works
Πετροπούλου, Μ., Nikolakopoulou, A., Veroniki, A. A., Rios, P. D. L., Vafaei, A., Zarin, W., Gianatsi, M., Sullivan, S. M., Tricco, A. C., Chaimani, A., et al. (2016) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2016.11.002 · Cited by 135 · see citing works
Self-citationBerger, M. L., Martin, B. C., Husereau, D., Worley, K., Allen, J. D., Yang, W., Quon, N. C., Mullins, C. D., Kahler, K. H., & Crown, W. H. (2014) · Value in Health · doi:10.1016/j.jval.2013.12.011 · Cited by 130 · see citing works
Katsanos, K. H., Kitrou, P. M., Spiliοpoulos, S., Maroulis, I. C., Petsas, T. G., & Karnabatidis, D. (2017) · PLoS ONE · doi:10.1371/journal.pone.0184597 · Cited by 126 · see citing works
Jung, S. Y., Lee, S. H., Lee, S., Yang, S., Noh, H., Chung, E. K., & Lee, J. I. (2017) · Critical Care · doi:10.1186/s13054-017-1916-6 · Cited by 126 · see citing works
Kristensen, F. B., Husereau, D., Huić, M., Drummond, M., Berger, M. L., Bond, K., Augustovski, F., Booth, A., Bridges, J. F. P., Grimshaw, J., et al. (2018) · Value in Health · doi:10.1016/j.jval.2018.08.010 · Cited by 125 · see citing works
Oba, Y., Sarva, S. T., & Dias, S. (2015) · Thorax · doi:10.1136/thoraxjnl-2014-206732 · Cited by 120 · see citing works
Slattery, B. W., Haugh, S., O'Connor, L., Francis, K., Dwyer, C. P., O'Higgins, S., Egan, J., & McGuire, B. E. (2019) · Journal of Medical Internet Research · doi:10.2196/11086 · Cited by 115 · see citing works
Indirect Comparisons and Network Meta-Analyses
Kiefer, C., Sturtz, S., & Bender, R. (2015) · Deutsches Ärzteblatt international · doi:10.3238/arztebl.2015.0803 · Cited by 114 · see citing works
Katsanos, K. H., Kitrou, P. M., Spiliοpoulos, S., Διαμαντόπουλος, Α., & Karnabatidis, D. (2016) · Journal of Endovascular Therapy · doi:10.1177/1526602816671740 · Cited by 112 · see citing works
Cope, S. F., Zhang, J., Saletan, S., Smiechowski, B., Jansen, J. P., & Schmid, P. (2014) · BMC Medicine · doi:10.1186/1741-7015-12-93 · Cited by 107 · see citing works
Self-citationResearch Techniques Made Simple: Network Meta-Analysis
Watt, J. A., Tricco, A. C., Straus, S. E., Veroniki, A. A., Naglie, G., & Drucker, A. M. (2018) · Journal of Investigative Dermatology · doi:10.1016/j.jid.2018.10.028 · Cited by 106 · see citing works
Zoratti, M. J., Siddiqua, A., Morassut, R. E., Zeraatkar, D., Chou, R., van Holten, J., Xie, F., & Druyts, E. (2020) · EClinicalMedicine · doi:10.1016/j.eclinm.2019.12.007 · Cited by 101 · see citing works
Characteristics and knowledge synthesis approach for 456 network meta-analyses: a scoping review
Zarin, W., Veroniki, A. A., Nincic, V., Vafaei, A., Reynen, E., Motiwala, S. S., Antony, J., Sullivan, S. M., Rios, P. D. L., Daly, C., et al. (2017) · BMC Medicine · doi:10.1186/s12916-016-0764-6 · Cited by 94 · see citing works
Self-citationWatt, J. A., & Giovane, C. D. (2021) · Methods in molecular biology · doi:10.1007/978-1-0716-1566-9_12 · Cited by 95 · see citing works
Benefits and Harms of Once-Weekly Glucagon-like Peptide-1 Receptor Agonist Treatments
Zaccardi, F., Htike, Z. Z., Webb, D. R., Khunti, K., & Davies, M. J. (2015) · Annals of Internal Medicine · doi:10.7326/m15-1432 · Cited by 91 · see citing works
Daly, C., Neupane, B., Beyene, J., Thabane, L., Straus, S. E., & Hamid, J. S. (2019) · BMJ Open · doi:10.1136/bmjopen-2018-024625 · Cited by 90 · see citing works
Florez, I. D., Veroniki, A.-A., Al Khalifah, R., Yepes-Nuñez, J. J., Sierra, J. M., Vernooij, R. W. M., Acosta-Reyes, J., Granados, C. M., Pérez-Gaxiola, G., Cuello-Garcia, C., et al. (2018) · PLOS ONE · doi:10.1371/journal.pone.0207701 · Cited by 87 · see citing works
de Almeida, M. O., Yamato, T. P., Parreira, P. D. C. S., Costa, L. O. P., Kamper, S. J., & Saragiotto, B. T. (2019) · Brazilian Journal of Physical Therapy · doi:10.1016/j.bjpt.2019.04.004 · Cited by 87 · see citing works
Min, S. H., Yoon, J., Hahn, S., & Cho, Y. M. (2016) · Diabetes/Metabolism Research and Reviews · doi:10.1002/dmrr.2818 · Cited by 85 · see citing works
Is providing uncertainty intervals in treatment ranking helpful in a network meta-analysis?
Veroniki, A. A., Straus, S. E., Rücker, G., & Tricco, A. C. (2018) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2018.02.009 · Cited by 82 · see citing works
How to Conduct a Bayesian Network Meta-Analysis
Hu, D., O'Connor, A. M. C., Wang, C., Sargeant, J. M., & Winder, C. B. (2020) · Frontiers in Veterinary Science · doi:10.3389/fvets.2020.00271 · Cited by 83 · see citing works
Yuan, J.-Q., Tsoi, K. K. F., Yang, M. G., Wang, J. Y., Threapleton, D. E., Yang, Z., Zou, B., Mao, C., Tang, J. L., & Chan, F. K. L. (2016) · Alimentary Pharmacology & Therapeutics · doi:10.1111/apt.13642 · Cited by 86 · see citing works
An overview of conducting systematic reviews with network meta-analysis
Caldwell, D. M. (2014) · Systematic Reviews · doi:10.1186/2046-4053-3-109 · Cited by 79 · see citing works
Noone, C., Leahy, J., Morrissey, E. C., Newell, J., Newell, M., Dwyer, C. P., Murphy, J., Doyle, F., Murphy, A. W., & Molloy, G. J. (2019) · European Journal of Preventive Cardiology · doi:10.1177/2047487319879786 · Cited by 69 · see citing works
A scoping review of indirect comparison methods and applications using individual patient data
Veroniki, A. A., Straus, S. E., Soobiah, C., Elliott, M. J., & Tricco, A. C. (2016) · BMC Medical Research Methodology · doi:10.1186/s12874-016-0146-y · Cited by 64 · see citing works
Botta, C., Ciliberto, D., Rossi, M., Staropoli, N., Cucè, M., Galeano, T., Tagliaferri, P., & Tassone, P. (2017) · Blood Advances · doi:10.1182/bloodadvances.2016003905 · Cited by 60 · see citing works
Gu, S., Shi, J., Tang, Z., Sawhney, M. S., Hu, H., Shi, L., Fonseca, V. A., & Dong, H. (2015) · PLoS ONE · doi:10.1371/journal.pone.0126704 · Cited by 62 · see citing works
Schlueter, M., González-Rojas, N., Baldwin, M., Groenke, L., Voß, F., & Reason, T. (2016) · Therapeutic Advances in Respiratory Disease · doi:10.1177/1753465815624612 · Cited by 60 · see citing works
Giovannoni, G., Lang, S., Wolff, R. F., Duffy, S., Hyde, R., Kinter, E. T., Wakeford, C., Sormani, M. P., & Kleijnen, J. (2020) · Neurology and Therapy · doi:10.1007/s40120-020-00212-5 · Cited by 58 · see citing works
Kawalec, P., Holko, P., Moćko, P., & Pilc, A. (2017) · Rheumatology International · doi:10.1007/s00296-017-3919-7 · Cited by 58 · see citing works
Yanes‐Lane, M., Ortíz‐Brizuela, E., Campbell, J. R., Benedetti, A., Churchyard, G., Oxlade, O., & Menzies, D. (2021) · PLoS Medicine · doi:10.1371/journal.pmed.1003738 · Cited by 55 · see citing works
Lim, J., Farhat, I., Douros, A., & Panagiotoglou, D. (2022) · PLoS ONE · doi:10.1371/journal.pone.0266142 · Cited by 56 · see citing works
Antiemetics in Children With Acute Gastroenteritis: A Meta-analysis
Niño-Serna, L. F., Acosta-Reyes, J. L., Veroniki, A. A., & Flórez, I. D. (2020) · PEDIATRICS · doi:10.1542/peds.2019-3260 · Cited by 61 · see citing works
Burr, N. E., Lummis, K., Sood, R., Kane, J. S., & Subramanian, V. (2016) · The Lancet. Gastroenterology & hepatology · doi:10.1016/s2468-1253(16)30162-5 · Cited by 52 · see citing works
Node-making process in network meta-analysis of nonpharmacological treatment are poorly reported
James, A., Yavchitz, A., Ravaud, P., & Boutron, I. (2017) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2017.11.018 · Cited by 52 · see citing works
Cope, S. F., Clemens, A., Hammès, F., Noack, H., & Jansen, J. P. (2015) · Value in Health · doi:10.1016/j.jval.2014.10.012 · Cited by 51 · see citing works
Self-citationHu, H., Feng, C., Jiang, Z., Wang, L., Shrestha, S., Yan, J., Shu, Y., Ge, L., Lai, W., Hua, F., et al. (2020) · Clinical Oral Investigations · doi:10.1007/s00784-020-03610-z · Cited by 53 · see citing works
Wilson, F. R., Varu, A., Mitra, D., Cameron, C. G., & Iyer, S. S. (2017) · Breast Cancer Research and Treatment · doi:10.1007/s10549-017-4404-4 · Cited by 49 · see citing works
Estimating the contribution of studies in network meta-analysis: paths, flows and streams
Papakonstantinou, T., Nikolakopoulou, A., Rücker, G., Chaimani, A., Schwarzer, G., Egger, M., & Salanti, G. (2018) · F1000Research · doi:10.12688/f1000research.14770.1 · Cited by 49 · see citing works
Self-citationAssessing Confidence in the Results of Network Meta-Analysis (Cinema)Preprint
Nikolakopoulou, A., Higgins, J. P. T., Papakonstantinou, T., Chaimani, A., Giovane, C. D., Egger, M., & Salanti, G. (2019) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/597047 · Cited by 49 · see citing works
Self-citationA Comparison of National Guidelines for Network Meta-Analysis
Laws, A., Kendall, R., & Hawkins, N. (2014) · Value in Health · doi:10.1016/j.jval.2014.06.001 · Cited by 47 · see citing works
Antonopoulos, C. N., Mylonas, S., Moulakakis, K. G., Sergentanis, T. Ν., Sfyroeras, G. S., Lazaris, A. M., Kakisis, J. D., & Vasdekis, S. N. (2016) · Journal of Vascular Surgery · doi:10.1016/j.jvs.2016.08.095 · Cited by 48 · see citing works
Current treatment of ocular toxoplasmosis in immunocompetent patients: a network meta-analysis
Zhang, Y., Lin, X., & Lü, F. (2018) · Acta Tropica · doi:10.1016/j.actatropica.2018.04.026 · Cited by 48 · see citing works
Tricco, A. C., Blondal, E., Veroniki, A. A., Soobiah, C., Vafaei, A., Ivory, J. D., Strifler, L., Cardoso, R., Reynen, E., Nincic, V., et al. (2016) · BMC Medicine · doi:10.1186/s12916-016-0761-9 · Cited by 47 · see citing works
Wilson, F. R., Coombes, M., Brezden‐Masley, C., Yurchenko, M., Wylie, Q., Douma, R., Varu, A., Hutton, B., Skidmore, B., & Cameron, C. G. (2018) · Systematic Reviews · doi:10.1186/s13643-018-0854-y · Cited by 46 · see citing works
Using individual participant data to improve network meta-analysis projects
Riley, R. D., Dias, S., Donegan, S., Tierney, J. F., Stewart, L. A., Efthimiou, O., & Phillippo, D. (2022) · BMJ Evidence-Based Medicine · doi:10.1136/bmjebm-2022-111931 · Cited by 46 · see citing works
Dobrow, M., Miller, F. A., Frank, C., & Brown, A. D. (2017) · Health Research Policy and Systems · doi:10.1186/s12961-017-0188-6 · Cited by 46 · see citing works
Siciliano, M. A., Caridà, G., Ciliberto, D., D’Apolito, M., Pelaia, C., Caracciolo, D., Riillo, C., Correale, P., Galvano, A., Russo, A., et al. (2022) · ESMO Open · doi:10.1016/j.esmoop.2022.100465 · Cited by 42 · see citing works
Systematic review and network meta-analysis of treatment for moderate-to-severe ulcerative colitis
Trigo-Vicente, C., Gimeno‐Ballester, V., García‐López, S., & Val, A. L.-D. (2018) · International Journal of Clinical Pharmacy · doi:10.1007/s11096-018-0743-4 · Cited by 43 · see citing works
Sandhu, S. S., Cheema, M. S., & Khehra, H. S. (2016) · American Journal of Orthodontics and Dentofacial Orthopedics · doi:10.1016/j.ajodo.2015.12.025 · Cited by 43 · see citing works
Network meta-analysis: users’ guide for pediatricians
Khalifah, R. A. A., Flórez, I. D., Guyatt, G. H., & Thabane, L. (2018) · BMC Pediatrics · doi:10.1186/s12887-018-1132-9 · Cited by 40 · see citing works
Śladowska, K., Kawalec, P., Holko, P., & Osiecka, O. (2022) · Neurological Sciences · doi:10.1007/s10072-022-06197-3 · Cited by 43 · see citing works
Iheozor‐Ejiofor, Z., Gordon, M. A., Clegg, A. J., Freeman, S. C., Gjuladin-Hellon, T., MacDonald, J. K., & Akobeng, A. K. (2019) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd013210.pub2 · Cited by 41 · see citing works
Ismaila, A., Huisman, E. L., Punekar, Y. S., & Karabis, A. (2015) · International Journal of COPD · doi:10.2147/copd.s92412 · Cited by 40 · see citing works
Yang, J., & Lei, S. (2023) · Frontiers in Immunology · doi:10.3389/fimmu.2023.1274241 · Cited by 39 · see citing works
Tonin, F. S., Borba, H. H. L., Leonart, L. P., Mendes, A. M., Steimbach, L. M., Pontarolo, R., & Fernández-Llimós, F. (2018) · International Journal of Epidemiology · doi:10.1093/ije/dyy197 · Cited by 38 · see citing works
An Assessment of the Methodological Quality of Published Network Meta-Analyses: A Systematic Review
Chambers, J. D., Naci, H., Wouters, O. J., Pyo, J., Gunjal, S., Kennedy, I. R., Hoey, M. G., Winn, A. N., & Neumann, P. J. (2015) · PLoS ONE · doi:10.1371/journal.pone.0121715 · Cited by 37 · see citing works
Estimating the contribution of studies in network meta-analysis: paths, flows and streams
Papakonstantinou, T., Nikolakopoulou, A., Rücker, G., Chaimani, A., Schwarzer, G., Egger, M., & Salanti, G. (2018) · F1000Research · doi:10.12688/f1000research.14770.3 · Cited by 37 · see citing works
Self-citationWingerchuk, D. M., Zhang, I., Kielhorn, A., Royston, M., Levy, M., Fujihara, K., Nakashima, I., Tanvir, I., Paul, F., & Pittock, S. J. (2021) · Neurology and Therapy · doi:10.1007/s40120-021-00295-8 · Cited by 40 · see citing works
A Comparison of National Guidelines for Network Meta-Analysis
Laws, A., Tao, R., Wang, S., Padhiar, A., & Goring, S. M. (2019) · Value in Health · doi:10.1016/j.jval.2019.05.013 · Cited by 37 · see citing works
Mitra, S., Flórez, I. D., Tamayo, M. E., Aune, D., Mbuagbaw, L. C. E., Veroniki, A. A., & Thabane, L. (2016) · BMJ Open · doi:10.1136/bmjopen-2016-011271 · Cited by 36 · see citing works
Isla, D., de Castro, J., Juan, Ó., Grau, S., Orofino, J., Gordo, R., Rubio‐Terres, C., & Rubio-Rodríguez, D. (2016) · ClinicoEconomics and Outcomes Research · doi:10.2147/ceor.s121093 · Cited by 34 · see citing works
Research Note: Comparing interventions with network meta-analysis
Bagg, M. K., Salanti, G., & McAuley, J. H. (2018) · Journal of physiotherapy · doi:10.1016/j.jphys.2018.02.014 · Cited by 34 · see citing works
Self-citationPratt, M., Wieland, L. S., Ahmadzai, N., Butler, C., Wolfe, D. M., Pussagoda, K., Skidmore, B., Veroniki, A. A., Rios, P. D. L., Tricco, A. C., et al. (2020) · Systematic Reviews · doi:10.1186/s13643-020-01328-3 · Cited by 33 · see citing works
Tien, Y.-Y., Shih, M., Tien, C.-P., Huang, H., & Tu, Y. (2022) · The Journal of the American Board of Family Medicine · doi:10.3122/jabfm.2022.01.210273 · Cited by 33 · see citing works
Mankowski, C., Patel, S. B., Trueman, D., Bentley, A., & Poole, C. (2016) · PLoS ONE · doi:10.1371/journal.pone.0150973 · Cited by 33 · see citing works
Qian, D., Zhang, T., Zheng, P., Liang, Z., Wang, S., Xie, J., Zhao, L., Zhang, Y., & Situ, B. (2018) · Diabetes Therapy · doi:10.1007/s13300-018-0482-5 · Cited by 33 · see citing works
Zhang, C., Kwong, J. S. W., Yuan, R.-X., Chen, H., Xu, C., Wang, X., Yang, G.-L., Yan, J.-Z., Peng, L., Zeng, X., et al. (2017) · Scientific Reports · doi:10.1038/srep41021 · Cited by 32 · see citing works
Risk of Bias in Network Meta-Analysis (RoB NMA) tool
Lunny, C., Higgins, J. P. T., White, I. R., Dias, S., Hutton, B., Wright, J. M., Veroniki, A.-A., Whiting, P. F., & Tricco, A. C. (2025) · BMJ · doi:10.1136/bmj-2024-079839 · Cited by 34 · see citing works
Bushe, C., Day, K., Reed, V., Karlsdotter, K., Berggren, L., Pitcher, A., Televantou, F., & Haynes, V. (2016) · Journal of Psychopharmacology · doi:10.1177/0269881116636105 · Cited by 31 · see citing works
Fleischmann, R., Tongbram, V., van Vollenhoven, R., Tang, D. H., Chung, J. B., Collier, D. H., Urs, S., Ndirangu, K., Wells, G. A., & Pope, J. E. (2017) · RMD Open · doi:10.1136/rmdopen-2016-000371 · Cited by 31 · see citing works
Kuno, T., Takagi, H., Sugiyama, T., Ando, T., Miyashita, S., Valentin, N., Shimada, Y. J., Kodaira, M., Numasawa, Y., Kanei, Y., et al. (2019) · Catheterization and Cardiovascular Interventions · doi:10.1002/ccd.28498 · Cited by 31 · see citing works
Methodological quality of systematic reviews on treatments for osteoporosis: A cross-sectional study
Tsoi, A. K., Ho, L. T. F., Wu, I. X. Y., Wong, C. H. L., Ho, R. S. T., Lim, J. Y. Y., Mao, C., Lee, E. K. P., & Chung, V. C. (2020) · Bone · doi:10.1016/j.bone.2020.115541 · Cited by 31 · see citing works
Kokaliaris, C., Evans, R., Hawkins, N., Mahajan, A., Scott, D. A., Sutherland, C. S., Nam, J., & Sajeev, G. (2024) · Advances in Therapy · doi:10.1007/s12325-024-02845-6 · Cited by 31 · see citing works
Moćko, P., Kawalec, P., & Pilc, A. (2016) · Pharmacological Reports · doi:10.1016/j.pharep.2016.07.013 · Cited by 30 · see citing works
McCool, R., Fleetwood, K. J., Glanville, J., Arber, M. R., Goodall, H., & Naidoo, S. (2018) · Value in Health · doi:10.1016/j.jval.2018.03.012 · Cited by 30 · see citing works
Tricco, A. C., Ashoor, H. M., Antony, J., Bouck, Z., Rodrigues, M., Pham, B., Khan, P. A., Nincic, V., Darvesh, N., Yazdi, F., et al. (2021) · Journal of General Internal Medicine · doi:10.1007/s11606-021-06642-7 · Cited by 30 · see citing works
Yoon, J., Min, S. H., Ahn, C. H., Cho, Y. M., & Hahn, S. (2018) · Scientific Reports · doi:10.1038/s41598-018-22443-1 · Cited by 29 · see citing works
- Authors
- Jansen, J. P., Trikalinos, T., Cappelleri, J. C., Daw, J., Andes, S., Eldessouki, R., & Salanti, G.
- Affiliations
- Tufts University (US)
- Brown University (US)
- Pfizer (United States) (US)
- UPMC Health System (US)
- Fayoum University (EG)
- University of Ioannina (GR)
- Corresponding author
- Jansen, Jeroen P.
- ORCID
- Venue
- Value in Health
- Publisher
- Elsevier BV
- Published
- 2014-03
- Volume
- 17
- Issue
- 2
- Pages
- 157-173
- ISSN
- 1098-3015 (ISSN-L)
- OpenAlex
- W2035613798
- Cited by
- 319
- References
- 38
- Citations by year
- 2026: 15 · 2025: 17 · 2024: 28 · 2023: 20 · 2022: 22 · 2021: 22 · 2020: 36 · 2019: 17 · 2018: 36 · 2017: 30 · 2016: 39 · 2015: 27 · 2014: 10
- FWCI
- 34.46
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Licence
- Locations
- Value in Health (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Economics, Econometrics and Finance › Economics and Econometrics › Health Systems, Economic Evaluations, Quality of Life
- Social Sciences › Sociology and Political Science › Delphi Technique in Research
- Keywords
- network meta-analysis, indirect treatment comparison, healthcare decision-making, credibility assessment, applicability, reporting quality, transparency, conflicts of interest, randomized controlled trials
- MeSH terms
- Decision Making, Delivery of Health Care, Humans, Surveys and Questionnaires, Research Design, Meta-Analysis as Topic, Randomized Controlled Trials as Topic, Evidence-Based Medicine, Advisory Committees, Internationality
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review