The DOI matches its Crossref record; 32 of the 32 references it cites were found in a registry or an index.
Network Meta-Analysis Using R: A Review of Currently Available Automated Packages
Open accessAbstract
Network meta-analysis (NMA)--a statistical technique that allows comparison of multiple treatments in the same meta-analysis simultaneously--has become increasingly popular in the medical literature in recent years. The statistical methodology underpinning this technique and software tools for implementing the methods are evolving. Both commercial and freely available statistical software packages have been developed to facilitate the statistical computations using NMA with varying degrees of functionality and ease of use. This paper aims to introduce the reader to three R packages, namely, gemtc, pcnetmeta, and netmeta, which are freely available software tools implemented in R. Each automates the process of performing NMA so that users can perform the analysis with minimal computational effort. We present, compare and contrast the availability and functionality of different important features of NMA in these three packages so that clinical investigators and researchers can determine which R packages to implement depending on their analysis needs. Four summary tables detailing (i) data input and network plotting, (ii) modeling options, (iii) assumption checking and diagnostic testing, and (iv) inference and reporting tools, are provided, along with an analysis of a previously published dataset to illustrate the outputs available from each package. We demonstrate that each of the three packages provides a useful set of tools, and combined provide users with nearly all functionality that might be desired when conducting a NMA.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Conducting Meta-Analyses in R with the metafor Package
Viechtbauer, W. (2010) · Journal of Statistical Software · doi:10.18637/jss.v036.i03 · Cited by 20,464 · cited 1×
“As netmeta package uses contrast-level data as input, we used the external function escalc available in the R package metafor [37] to convert the arm-level data into contrast-level data in each trial (relative treatment effect, namely, log-odds ratio) for the netmeta package.”
MethodGeneral methods for monitoring convergence of iterative simulations
Brooks, S. P., & Gelman, A. (1998) · Journal of Computational and Graphical Statistics · doi:10.1080/10618600.1998.10474787 · Cited by 6,045
Salanti, G., Ades, A. E., & Ioannidis, J. P. A. (2011) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.03.016 · Cited by 3,766
Checking consistency in mixed treatment comparison meta-analysis
Dias, S., Welton, N. J., Caldwell, D. M., & Ades, A. E. (2010) · Statistics in Medicine · doi:10.1002/sim.3767 · Cited by 2,521 · cited 1×
“It models the relative effects (e.g., log-odds ratio) fitting a generalized linear model (GLM) under the Bayesian framework by linking to JAGS, OpenBUGS or WinBUGS as first described by Lu and Ades [7], and extended by others [6, 12, 28, 31].”
MethodCombination of direct and indirect evidence in mixed treatment comparisons
Lu, G., & Ades, A. E. (2004) · Statistics in Medicine · doi:10.1002/sim.1875 · Cited by 2,166
Consistency and inconsistency in network meta-analysis: concepts and models for multi-arm studies
Higgins, J. P. T., Jackson, D., Barrett, J. K., Lu, G., Ades, A. E., & White, I. R. (2012) · Research Synthesis Methods · doi:10.1002/jrsm.1044 · Cited by 2,098 · cited 2×
“The presence of heterogeneity and inconsistency in the network can be quantified and assessed statistically, for which different methods have been proposed [11–16].”
BackgroundMethodBucher, H. C., Guyatt, G. H., Griffith, L. E., & Walter, S. D. (1997) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(97)00049-8 · Cited by 2,052
Salanti, G. (2012) · Research Synthesis Methods · doi:10.1002/jrsm.1037 · Cited by 1,729
Dias, S., Sutton, A. J., Ades, A. E., & Welton, N. J. (2013) · Medical Decision Making · doi:10.1177/0272989x12458724 · Cited by 1,207
Network meta‐analysis for indirect treatment comparisons
Lumley, T. (2002) · Statistics in Medicine · doi:10.1002/sim.1201 · Cited by 1,206
White, I. R., Barrett, J. K., Jackson, D., & Higgins, J. P. T. (2012) · Research Synthesis Methods · doi:10.1002/jrsm.1045 · Cited by 1,114
Conceptual and technical challenges in network meta-analysis
Cipriani, A., Higgins, J. P. T., Geddes, J. R., & Salanti, G. (2013) · Annals of Internal Medicine · doi:10.7326/0003-4819-159-2-201307160-00008 · Cited by 1,072 · cited 2×
“The presence of heterogeneity and inconsistency in the network can be quantified and assessed statistically, for which different methods have been proposed [11–16].”
BackgroundMethodIncident diabetes in clinical trials of antihypertensive drugs: a network meta-analysis
Elliott, W. J., & Meyer, P. M. (2007) · The Lancet · doi:10.1016/s0140-6736(07)60108-1 · Cited by 1,016
Automating network meta‐analysis
van Valkenhoef, G., Lu, G., de Brock, B., Hillege, H., Ades, A. E., & Welton, N. J. (2012) · Research Synthesis Methods · doi:10.1002/jrsm.1054 · Cited by 786
Hoaglin, D. C., Hawkins, N., Jansen, J. P., Scott, D. A., Itzler, R., Cappelleri, J. C., Boersma, C., Thompson, D., Larholt, K. M., Diaz, M., et al. (2011) · Value in Health · doi:10.1016/j.jval.2011.01.011 · Cited by 770
Assessing Evidence Inconsistency in Mixed Treatment Comparisons
Lu, G., & Ades, A. E. (2006) · Journal of the American Statistical Association · doi:10.1198/016214505000001302 · Cited by 756
Network meta‐analysis, electrical networks and graph theory
Rücker, G. (2012) · Research Synthesis Methods · doi:10.1002/jrsm.1058 · Cited by 730
van Valkenhoef, G., Dias, S., Ades, A. E., & Welton, N. J. (2016) · Research Synthesis Methods · doi:10.1002/jrsm.1167 · Cited by 695
Dias, S., Sutton, A. J., Welton, N. J., & Ades, A. E. (2013) · Medical Decision Making · doi:10.1177/0272989x13485157 · Cited by 466
A graphical tool for locating inconsistency in network meta-analyses
Krahn, U., Binder, H., & König, J. (2013) · BMC Medical Research Methodology · doi:10.1186/1471-2288-13-35 · Cited by 458
Assessing key assumptions of network meta‐analysis: a review of methods
Donegan, S., Williamson, P., D'Alessandro, U., & Tudur Smith, C. (2013) · Research Synthesis Methods · doi:10.1002/jrsm.1085 · Cited by 267
Reporting of results from network meta-analyses: methodological systematic review
Bafeta, A., Trinquart, L., Seror, R., & Ravaud, P. (2014) · BMJ · doi:10.1136/bmj.g1741 · Cited by 220
König, J., Krahn, U., & Binder, H. (2013) · Statistics in Medicine · doi:10.1002/sim.6001 · Cited by 205
Bayesian Measures of Model Complexity and Fit
Spiegelhalter, D. J., Best, N. G., Carlin, B. P., & Van Der Linde, A. (2002) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/1467-9868.00353 · Cited by 151
Characteristics of Networks of Interventions: A Description of a Database of 186 Published Networks
Nikolakopoulou, A., Chaimani, A., Veroniki, A. A., Vasiliadis, H. S., Schmid, C. H., & Salanti, G. (2014) · PLoS ONE · doi:10.1371/journal.pone.0086754 · Cited by 139
Network meta-analysis of randomized clinical trials: Reporting the proper summaries
Zhang, J., Carlin, B. P., Neaton, J. D., Soon, G. G., Nie, L., Kane, R. L., Virnig, B. A., & Chu, H. (2013) · Clinical Trials · doi:10.1177/1740774513498322 · Cited by 129
Evaluating novel agent effects in multiple-treatments meta-regression
Salanti, G., Dias, S., Welton, N. J., Ades, A. E., Golfinopoulos, V., Kyrgiou, M., Mauri, D., & Ioannidis, J. P. A. (2010) · Statistics in Medicine · doi:10.1002/sim.4001 · Cited by 111
Comparing Bayesian and Frequentist Approaches for Multiple Outcome Mixed Treatment Comparisons
Hong, H., Carlin, B. P., Shamliyan, T., Wyman, J. F., Ramakrishnan, R., Sainfort, F., & Kane, R. L. (2013) · Medical Decision Making · doi:10.1177/0272989x13481110 · Cited by 95
Lee, A. W. (2014) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2013.07.014 · Cited by 90
Xiong, T., Bhurke, S., Loke, Y. K., Abdelhamid, A. S., Sutton, A. J., Eastwood, A. J., Holland, R., Chen, Y., Walsh, T., Glenny, A., et al. (2012) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2012.06.022 · Cited by 26
pcnetmeta: Patient-Centered Network Meta-Analysis
Lin, L., Zhang, J., & Chu, H. (2014) · doi:10.32614/cran.package.pcnetmeta · Cited by 7
Cited by
Cipriani, A., Zhou, X., Del Giovane, C., Hetrick, S. E., Qin, B., Whittington, C., Coghill, D., Zhang, Y., Hazell, P., Leucht, S., et al. (2016) · The Lancet · doi:10.1016/s0140-6736(16)30385-3 · Cited by 734
Owen, R. K., Bradbury, N., Xin, Y., Cooper, N., & Sutton, A. (2019) · Research Synthesis Methods · doi:10.1002/jrsm.1373 · Cited by 427
Ferreyro, B. L., Angriman, F., Munshi, L., Del Sorbo, L., Ferguson, N. D., Rochwerg, B., Ryu, M. J., Saskin, R., Wunsch, H., da Costa, B. R., et al. (2020) · JAMA · doi:10.1001/jama.2020.9524 · Cited by 425
Network meta-analysis: a technique to gather evidence from direct and indirect comparisons
Tonin, F. S., Rotta, I., Mendes, A. M., & Pontarolo, R. (2017) · Pharmacy Practice · doi:10.18549/pharmpract.2017.01.943 · Cited by 405
GetReal in network meta-analysis: a review of the methodology
Efthimiou, O., Debray, T. P. A., van Valkenhoef, G., Trelle, S., Panayidou, K., Moons, K. G. M., Reitsma, J. B., Shang, A., Salanti, G., & on behalf of GetReal Methods Review Group (2016) · Research Synthesis Methods · doi:10.1002/jrsm.1195 · Cited by 401
Metadata
- Authors
- Neupane, B., Richer, D., Bonner, A. J., Kibret, T., & Beyene, J.
- Venue
- PLoS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2014-12-26
- Volume
- 9
- Issue
- 12
- Pages
- e115065
- ISSN
- 1932-6203 (ISSN-L)
- OpenAlex
- W2075535893
- Cited by
- 362
- References
- 32
- FWCI
- 10.57
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.