A Microsoft-Excel-based tool for running and critically appraising network meta-analyses—an overview and application of NetMetaXL
Open accessThe DOI matches its Crossref record; 13 of the 13 references it cites were found in a registry or an index.
Abstract
BACKGROUND: The use of network meta-analysis has increased dramatically in recent years. WinBUGS, a freely available Bayesian software package, has been the most widely used software package to conduct network meta-analyses. However, the learning curve for WinBUGS can be daunting, especially for new users. Furthermore, critical appraisal of network meta-analyses conducted in WinBUGS can be challenging given its limited data manipulation capabilities and the fact that generation of graphical output from network meta-analyses often relies on different software packages than the analyses themselves. METHODS: We developed a freely available Microsoft-Excel-based tool called NetMetaXL, programmed in Visual Basic for Applications, which provides an interface for conducting a Bayesian network meta-analysis using WinBUGS from within Microsoft Excel. . This tool allows the user to easily prepare and enter data, set model assumptions, and run the network meta-analysis, with results being automatically displayed in an Excel spreadsheet. It also contains macros that use NetMetaXL's interface to generate evidence network diagrams, forest plots, league tables of pairwise comparisons, probability plots (rankograms), and inconsistency plots within Microsoft Excel. All figures generated are publication quality, thereby increasing the efficiency of knowledge transfer and manuscript preparation. RESULTS: We demonstrate the application of NetMetaXL using data from a network meta-analysis published previously which compares combined resynchronization and implantable defibrillator therapy in left ventricular dysfunction. We replicate results from the previous publication while demonstrating result summaries generated by the software. CONCLUSIONS: Use of the freely available NetMetaXL successfully demonstrated its ability to make running network meta-analyses more accessible to novice WinBUGS users by allowing analyses to be conducted entirely within Microsoft Excel. NetMetaXL also allows for more efficient and transparent critical appraisal of network meta-analyses, enhanced standardization of reporting, and integration with health economic evaluations which are frequently Excel-based.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
General methods for monitoring convergence of iterative simulations
Brooks, S. P., & Gelman, A. (1998) · Journal of Computational and Graphical Statistics · doi:10.1080/10618600.1998.10474787 · Cited by 6,045
Gelman, A. (2006) · Bayesian Analysis · doi:10.1214/06-ba117a · Cited by 4,050
Salanti, G., Ades, A. E., & Ioannidis, J. P. A. (2011) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.03.016 · Cited by 3,766 · cited 6×
“The league table arranges the presentation of summary estimates by ranking the treatments in order of most pronounced impact on the outcome under consideration, based on SUCRA [18].”
BackgroundMethodInfluentialGraphical tools for network meta-analysis in STATA
Chaimani, A., Higgins, J. P. T., Mavridis, D., Spyridonos, P., & Salanti, G. (2013) · PLoS ONE · doi:10.1371/journal.pone.0076654 · Cited by 2,473 · cited 4×
“The majority of network meta-analyses conducted to date have used WinBUGS [3], although new routines have been developed which allow network meta-analyses to be conducted with STATA [6,7,21], R [22], and SAS [23].”
BackgroundMethodInfluentialConsistency and inconsistency in network meta-analysis: concepts and models for multi-arm studies
Higgins, J. P. T., Jackson, D., Barrett, J. K., Lu, G., Ades, A. E., & White, I. R. (2012) · Research Synthesis Methods · doi:10.1002/jrsm.1044 · Cited by 2,098
What to add to nothing? Use and avoidance of continuity corrections in meta‐analysis of sparse data
J. Sweeting, M., J. Sutton, A., & C. Lambert, P. (2004) · Statistics in Medicine · doi:10.1002/sim.1761 · Cited by 1,734 · cited 3×
“’ The latter is thought to ‘ let the data drive the analysis, ’ but the use of a vague prior should not be used unthinkingly especially when data is sparse because a vague prior may actually influence the analysis [10,12-16].”
BackgroundMethodInfluentialSimultaneous comparison of multiple treatments: Combining direct and indirect evidence.
Caldwell, D. M., Ades, A. E., & Higgins, J. P. T. (2005) · BMJ · doi:10.1136/bmj.331.7521.897 · Cited by 1,600 · cited 3×
“An important limitation of standard meta-analysis (i.e., pairwise meta-analysis) is that it compares only two treatments at a time [1].”
BackgroundMethodDias, S., Sutton, A. J., Ades, A. E., & Welton, N. J. (2013) · Medical Decision Making · doi:10.1177/0272989x12458724 · Cited by 1,207 · cited 3×
“An advantage of the Bayesian approach is that special precautions do not usually need to be taken in the case of the occasional trial with a zero cell count [17].”
BackgroundMethodWhite, I. R., Barrett, J. K., Jackson, D., & Higgins, J. P. T. (2012) · Research Synthesis Methods · doi:10.1002/jrsm.1045 · Cited by 1,114
Reducing and meta-analysing estimates from distributed lag non-linear models
Gasparrini, A., & Armstrong, B. (2013) · BMC Medical Research Methodology · doi:10.1186/1471-2288-13-1 · Cited by 1,081
Turner, R. M., Davey, J., Clarke, M. J., Thompson, S. G., & Higgins, J. P. (2012) · International Journal of Epidemiology · doi:10.1093/ije/dys041 · Cited by 837 · cited 2×
“…ratios but allows the user to use informative priors for between-study heterogeneity variances derived from based on a publication by Turner et al. [14] which is potentially useful when data is sparse), and initial values for parameter estimates (NetMetaXL selects these randomly from a uniform…”
MethodNetwork meta‐analysis, electrical networks and graph theory
Rücker, G. (2012) · Research Synthesis Methods · doi:10.1002/jrsm.1058 · Cited by 730
Lambert, P. C., Sutton, A. J., Burton, P. R., Abrams, K. R., & Jones, D. R. (2005) · Statistics in Medicine · doi:10.1002/sim.2112 · Cited by 511 · cited 3×
“A prior distribution of a parameter represents the uncertainty about the parameter before the current data are examined [10,12-16].”
BackgroundMethod
Cited by
Owen, R. K., Bradbury, N., Xin, Y., Cooper, N., & Sutton, A. (2019) · Research Synthesis Methods · doi:10.1002/jrsm.1373 · Cited by 427
Mitra, S., Florez, I. D., Tamayo, M. E., Mbuagbaw, L., Vanniyasingam, T., Veroniki, A. A., Zea, A. M., Zhang, Y., Sadeghirad, B., & Thabane, L. (2018) · JAMA · doi:10.1001/jama.2018.1896 · Cited by 324
BUGSnet: an R package to facilitate the conduct and reporting of Bayesian network Meta-analyses
Béliveau, A., Boyne, D. J., Slater, J., Brenner, D., & Arora, P. (2019) · BMC Medical Research Methodology · doi:10.1186/s12874-019-0829-2 · Cited by 312
Tools to support the automation of systematic reviews: a scoping review.
Khalil, H., Ameen, D., & Zarnegar, A. (2022) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2021.12.005 · Cited by 190
Drug Treatment of Idiopathic Pulmonary Fibrosis
Canestaro, W. J., Forrester, S. H., Raghu, G., Ho, L., & Devine, B. E. (2016) · Chest · doi:10.1016/j.chest.2015.11.013 · Cited by 186
Metadata
- Authors
- Brown, S., Hutton, B., Clifford, T., Coyle, D., Grima, D., Wells, G., & Cameron, C.
- Venue
- Systematic Reviews
- Published
- 2014-09-29
- Volume
- 3
- Issue
- 1
- Pages
- 110-110
- ISSN
- 2046-4053 (ISSN-L)
- OpenAlex
- W2109391487
- Cited by
- 209
- References
- 13
- FWCI
- 16.02
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.