The DOI matches its Crossref record; 56 of the 56 references it cites were found in a registry or an index.
Network meta-analysis: a technique to gather evidence from direct and indirect comparisons
Open accessAbstract
Systematic reviews and pairwise meta-analyses of randomized controlled trials, at the intersection of clinical medicine, epidemiology and statistics, are positioned at the top of evidence-based practice hierarchy. These are important tools to base drugs approval, clinical protocols and guidelines formulation and for decision-making. However, this traditional technique only partially yield information that clinicians, patients and policy-makers need to make informed decisions, since it usually compares only two interventions at the time. In the market, regardless the clinical condition under evaluation, usually many interventions are available and few of them have been studied in head-to-head studies. This scenario precludes conclusions to be drawn from comparisons of all interventions profile (e.g. efficacy and safety). The recent development and introduction of a new technique - usually referred as network meta-analysis, indirect meta-analysis, multiple or mixed treatment comparisons - has allowed the estimation of metrics for all possible comparisons in the same model, simultaneously gathering direct and indirect evidence. Over the last years this statistical tool has matured as technique with models available for all types of raw data, producing different pooled effect measures, using both Frequentist and Bayesian frameworks, with different software packages. However, the conduction, report and interpretation of network meta-analysis still poses multiple challenges that should be carefully considered, especially because this technique inherits all assumptions from pairwise meta-analysis but with increased complexity. Thus, we aim to provide a basic explanation of network meta-analysis conduction, highlighting its risks and benefits for evidence-based practice, including information on statistical methods evolution, assumptions and steps for performing the analysis.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000100 · Cited by 28,164
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gotzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · BMJ · doi:10.1136/bmj.b2700 · Cited by 17,648
Hutton, B., Salanti, G., Caldwell, D. M., Chaimani, A., Schmid, C. H., Cameron, C., Ioannidis, J. P. A., Straus, S., Thorlund, K., Jansen, J. P., et al. (2015) · Annals of Internal Medicine · doi:10.7326/m14-2385 · Cited by 8,269
Checking consistency in mixed treatment comparison meta-analysis
Dias, S., Welton, N. J., Caldwell, D. M., & Ades, A. E. (2010) · Statistics in Medicine · doi:10.1002/sim.3767 · Cited by 2,521 · cited 2×
“Node-splitting analysis is an alternative method to evaluate inconsistency, since it assesses whether direct and indirect evidence on a specific node (the split node of a closed loop in the network) are in agreement.(34,47)”
MethodGraphical tools for network meta-analysis in STATA
Chaimani, A., Higgins, J. P. T., Mavridis, D., Spyridonos, P., & Salanti, G. (2013) · PLoS ONE · doi:10.1371/journal.pone.0076654 · Cited by 2,473
Systematic Review and Meta-analysis: When One Study Is Just not Enough
Garg, A. X., Hackam, D., & Tonelli, M. (2008) · Clinical Journal of the American Society of Nephrology · doi:10.2215/cjn.01430307 · Cited by 2,258
Combination of direct and indirect evidence in mixed treatment comparisons
Lu, G., & Ades, A. E. (2004) · Statistics in Medicine · doi:10.1002/sim.1875 · Cited by 2,166
Bucher, H. C., Guyatt, G. H., Griffith, L. E., & Walter, S. D. (1997) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(97)00049-8 · Cited by 2,052
Salanti, G. (2012) · Research Synthesis Methods · doi:10.1002/jrsm.1037 · Cited by 1,729
Dias, S., Sutton, A. J., Ades, A. E., & Welton, N. J. (2013) · Medical Decision Making · doi:10.1177/0272989x12458724 · Cited by 1,207
Network meta‐analysis for indirect treatment comparisons
Lumley, T. (2002) · Statistics in Medicine · doi:10.1002/sim.1201 · Cited by 1,206
Evaluation of networks of randomized trials
Salanti, G., Higgins, J. P., Ades, A., & Ioannidis, J. P. (2008) · Statistical Methods in Medical Research · doi:10.1177/0962280207080643 · Cited by 1,078
Conceptual and technical challenges in network meta-analysis
Cipriani, A., Higgins, J. P. T., Geddes, J. R., & Salanti, G. (2013) · Annals of Internal Medicine · doi:10.7326/0003-4819-159-2-201307160-00008 · Cited by 1,072
Jansen, J. P., Fleurence, R., Devine, B., Itzler, R., Barrett, A., Hawkins, N., Lee, K., Boersma, C., Annemans, L., & Cappelleri, J. C. (2011) · Value in Health · doi:10.1016/j.jval.2011.04.002 · Cited by 1,036
Network meta-analysis: an introduction for clinicians
Rouse, B., Chaimani, A., & Li, T. (2017) · Internal and Emergency Medicine · doi:10.1007/s11739-016-1583-7 · Cited by 875
Automating network meta‐analysis
van Valkenhoef, G., Lu, G., de Brock, B., Hillege, H., Ades, A. E., & Welton, N. J. (2012) · Research Synthesis Methods · doi:10.1002/jrsm.1054 · Cited by 786
Hoaglin, D. C., Hawkins, N., Jansen, J. P., Scott, D. A., Itzler, R., Cappelleri, J. C., Boersma, C., Thompson, D., Larholt, K. M., Diaz, M., et al. (2011) · Value in Health · doi:10.1016/j.jval.2011.01.011 · Cited by 770
van Valkenhoef, G., Dias, S., Ades, A. E., & Welton, N. J. (2016) · Research Synthesis Methods · doi:10.1002/jrsm.1167 · Cited by 695
Jansen, J. P., & Naci, H. (2013) · BMC Medicine · doi:10.1186/1741-7015-11-159 · Cited by 656
Recent developments in meta‐analysis
Sutton, A. J., & Higgins, J. P. T. (2008) · Statistics in Medicine · doi:10.1002/sim.2934 · Cited by 590
Evaluation of inconsistency in networks of interventions
Veroniki, A. A., Vasiliadis, H. S., Higgins, J. P., & Salanti, G. (2013) · International Journal of Epidemiology · doi:10.1093/ije/dys222 · Cited by 576
CHALMERS, I. (1993) · Annals of the New York Academy of Sciences · doi:10.1111/j.1749-6632.1993.tb26345.x · Cited by 561
GetReal in network meta-analysis: a review of the methodology
Efthimiou, O., Debray, T. P. A., van Valkenhoef, G., Trelle, S., Panayidou, K., Moons, K. G. M., Reitsma, J. B., Shang, A., Salanti, G., & on behalf of GetReal Methods Review Group (2016) · Research Synthesis Methods · doi:10.1002/jrsm.1195 · Cited by 401
Jansen, J. P., Crawford, B., Bergman, G., & Stam, W. (2008) · Value in Health · doi:10.1111/j.1524-4733.2008.00347.x · Cited by 385
Network Meta-Analysis Using R: A Review of Currently Available Automated Packages
Neupane, B., Richer, D., Bonner, A. J., Kibret, T., & Beyene, J. (2014) · PLoS ONE · doi:10.1371/journal.pone.0115065 · Cited by 362
Jansen, J. P., Trikalinos, T., Cappelleri, J. C., Daw, J., Andes, S., Eldessouki, R., & Salanti, G. (2014) · Value in Health · doi:10.1016/j.jval.2014.01.004 · Cited by 319
Reporting of results from network meta-analyses: methodological systematic review
Bafeta, A., Trinquart, L., Seror, R., & Ravaud, P. (2014) · BMJ · doi:10.1136/bmj.g1741 · Cited by 220
Network meta-analysis for comparing treatment effects of multiple interventions: an introduction
Catalá-López, F., Tobías, A., Cameron, C., Moher, D., & Hutton, B. (2014) · Rheumatology International · doi:10.1007/s00296-014-2994-2 · Cited by 170
Meta-analysis of Multitreatment Studies
Hasselblad, V. (1998) · Medical Decision Making · doi:10.1177/0272989x9801800110 · Cited by 165
Statistical Models and Methods for Network Meta-Analysis
Madden, L. V., Piepho, H., & Paul, P. A. (2016) · Phytopathology · doi:10.1094/phyto-12-15-0342-rvw · Cited by 122
Bafeta, A., Trinquart, L., Séror, R., & Ravaud, P. (2013) · BMJ · doi:10.1136/bmj.f3675 · Cited by 107
Hutton, B., Salanti, G., Chaimani, A., Caldwell, D. M., Schmid, C., Thorlund, K., Mills, E., Catalá-López, F., Turner, L., Altman, D. G., et al. (2014) · PLoS ONE · doi:10.1371/journal.pone.0092508 · Cited by 105
A Bayesian network meta-analysis for binary outcome: how to do it
Greco, T., Landoni, G., Biondi‐Zoccai, G., D’Ascenzo, F., & Zangrillo, A. (2013) · Statistical Methods in Medical Research · doi:10.1177/0962280213500185 · Cited by 98
Multiple treatment and indirect treatment comparisons: An overview of network meta-analysis
Bhatnagar, N., Lakshmi, P. V. M., & Jeyashree, K. (2014) · Perspectives in Clinical Research · doi:10.4103/2229-3485.140550 · Cited by 97
Multiple treatment comparison meta-analyses: a step forward into complexity
Mills, E. J., Bansback, N. J., Ghement, Tholund, Kelly, S., Puhan, M. A., & Wright, G. (2011) · Clinical Epidemiology · doi:10.2147/clep.s16526 · Cited by 93
Mavridis, D., White, I. R., Higgins, J. P. T., Cipriani, A., & Salanti, G. (2014) · Statistics in Medicine · doi:10.1002/sim.6365 · Cited by 92
Fisher, L. D., Gent, M., & Buller, H. R. (2001) · American Heart Journal · doi:10.1067/mhj.2001.111262 · Cited by 89
Debray, T. P. A., Schuit, E., Efthimiou, O., Reitsma, J. B., Ioannidis, J. P. A., Salanti, G., Moons, K. G. M., & Workpackage, O. B. O. G. (2016) · Statistical Methods in Medical Research · doi:10.1177/0962280216660741 · Cited by 86
An overview of conducting systematic reviews with network meta-analysis
Caldwell, D. M. (2014) · Systematic Reviews · doi:10.1186/2046-4053-3-109 · Cited by 83
Beyene, J., Kibret, T., & Richer, D. (2014) · Clinical Epidemiology · doi:10.2147/clep.s69660 · Cited by 81
Systematic review or meta-analysis? Their place in the evidence hierarchy
Paul, M., & Leibovici, L. (2013) · Clinical Microbiology and Infection · doi:10.1111/1469-0691.12489 · Cited by 76
How to read and understand and use systematic reviews and meta‐analyses
Leucht, S., Kissling, W., & Davis, J. M. (2009) · Acta Psychiatrica Scandinavica · doi:10.1111/j.1600-0447.2009.01388.x · Cited by 76
Kim, H., Gurrin, L. C., Ademi, Z., & Liew, D. (2013) · British Journal of Clinical Pharmacology · doi:10.1111/bcp.12150 · Cited by 67
Two new methods to fit models for network meta-analysis with random inconsistency effects
Law, M. W.-M., Jackson, D., Turner, R., Rhodes, K. M., & Viechtbauer, W. (2016) · BMC Medical Research Methodology · doi:10.1186/s12874-016-0184-5 · Cited by 65
Riaz, I. B., Khan, M. S., Riaz, H., & Goldberg, R. J. (2015) · The American Journal of Medicine · doi:10.1016/j.amjmed.2015.10.009 · Cited by 61
Automated drawing of network plots in network meta‐analysis
Rücker, G., & Schwarzer, G. (2015) · Research Synthesis Methods · doi:10.1002/jrsm.1143 · Cited by 57
Extending Treatment Networks in Health Technology Assessment: How Far Should We Go?
Caldwell, D. M., Dias, S., & Welton, N. J. (2015) · Value in Health · doi:10.1016/j.jval.2015.03.1792 · Cited by 56
Do Current Clinical Trials Meet Society’s Needs?
Pocock, S., & Gersh, B. J. (2014) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2014.08.008 · Cited by 51
Planning future studies based on the precision of network meta‐analysis results
Nikolakopoulou, A., Mavridis, D., & Salanti, G. (2015) · Statistics in Medicine · doi:10.1002/sim.6608 · Cited by 44
A multilevel approach to network meta-analysis within a frequentist framework
Greco, T., Edefonti, V. C., Biondi‐Zoccai, G., Decarli, A., Gasparini, M., Zangrillo, A., & Landoni, G. (2015) · Contemporary Clinical Trials · doi:10.1016/j.cct.2015.03.005 · Cited by 41
Unsolved issues of mixed treatment comparison meta‐analysis: network size and inconsistency
Sturtz, S., & Bender, R. (2012) · Research Synthesis Methods · doi:10.1002/jrsm.1057 · Cited by 40
Guidance on the implementation and reporting of a drug safety Bayesian network meta‐analysis
Ohlssen, D. I., Price, K. L., Xia, H. A., Hong, H., Kerman, J., Fu, H., Quartey, G., Heilmann, C. R., Ma, H., & Carlin, B. P. (2013) · Pharmaceutical Statistics · doi:10.1002/pst.1592 · Cited by 33
Sobieraj, D. M., Cappelleri, J. C., Baker, W. L., Phung, O. J., White, C. M., & Coleman, C. I. (2013) · BMJ Open · doi:10.1136/bmjopen-2013-003111 · Cited by 33
Bayesian network meta‐analysis for cluster randomized trials with binary outcomes
Uhlmann, L., Jensen, K., & Kieser, M. (2016) · Research Synthesis Methods · doi:10.1002/jrsm.1210 · Cited by 21
Berlin, J. A., & Cepeda, M. S. (2011) · Clinical Trials · doi:10.1177/1740774511427062 · Cited by 10
Cited by
Muka, T., Glisic, M., Milic, J., Verhoog, S., Bohlius, J., Bramer, W., Chowdhury, R., & Franco, O. H. (2020) · European Journal of Epidemiology · doi:10.1007/s10654-019-00576-5 · Cited by 660
Network meta-analysis: application and practice using Stata
Shim, S., Yoon, B.-H., Shin, I.-S., & Bae, J.-M. (2017) · Epidemiology and Health · doi:10.4178/epih.e2017047 · Cited by 656
Organised inpatient (stroke unit) care for stroke: network meta-analysis
Langhorne, P., Ramachandra, S., & Stroke Unit Trialists' Collaboration (2020) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000197.pub4 · Cited by 369
Employment Instability and Fertility in Europe: A Meta-Analysis
Alderotti, G., Vignoli, D., Baccini, M., & Matysiak, A. (2021) · Demography · doi:10.1215/00703370-9164737 · Cited by 277
Benz, F., Knoop, T., Ballesio, A., Bacaro, V., Johann, A. F., Rücker, G., Feige, B., Riemann, D., & Baglioni, C. (2020) · Clinical Psychology Review · doi:10.1016/j.cpr.2020.101873 · Cited by 142
Metadata
- Authors
- Tonin, F. S., Rotta, I., Mendes, A. M., & Pontarolo, R.
- Venue
- Pharmacy Practice
- Publisher
- JCFCorp SG PTE LTD
- Published
- 2017-03-31
- Volume
- 15
- Issue
- 1
- Pages
- 943-943
- ISSN
- 1885-642X (ISSN-L)
- 1886-3655
- OpenAlex
- W2603440970
- Cited by
- 405
- References
- 56
- FWCI
- 31.78
- Type
- journal article
- Language
- en
- Open access
- diamond
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.