Network meta-analysis: application and practice using Stata
Open accessThe DOI matches its Crossref record; 47 of the 47 references it cites were found in a registry or an index.
Abstract
This review aimed to arrange the concepts of a network meta-analysis (NMA) and to demonstrate the analytical process of NMA using Stata software under frequentist framework. The NMA tries to synthesize evidences for a decision making by evaluating the comparative effectiveness of more than two alternative interventions for the same condition. Before conducting a NMA, 3 major assumptions-similarity, transitivity, and consistency-should be checked. The statistical analysis consists of 5 steps. The first step is to draw a network geometry to provide an overview of the network relationship. The second step checks the assumption of consistency. The third step is to make the network forest plot or interval plot in order to illustrate the summary size of comparative effectiveness among various interventions. The fourth step calculates cumulative rankings for identifying superiority among interventions. The last step evaluates publication bias or effect modifiers for a valid inference from results. The synthesized evidences through five steps would be very useful to evidence-based decision-making in healthcare. Thus, NMA should be activated in order to guarantee the quality of healthcare system.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures






Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The network meta-analysis was performed following the current Preferred Reporting Items for Systematic Reviews and Meta-Analyses guideline items (26,27): 1) a network geometry was created to explore the comparisons between resistance training loads; 2) transitivity was tested by fitting a network inconsistency assumption along with Q test and side-splitting analyses between indirect and direct”
From Resistance training load effects on muscle hypertrophy and strength gain: systematic review and network meta-analysis. (2021) · cites this paper as [26]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hutton, B., Salanti, G., Caldwell, D. M., Chaimani, A., Schmid, C. H., Cameron, C., Ioannidis, J. P. A., Straus, S., Thorlund, K., Jansen, J. P., et al. (2015) · Annals of Internal Medicine · doi:10.7326/m14-2385 · Cited by 8,269
Salanti, G., Ades, A. E., & Ioannidis, J. P. A. (2011) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.03.016 · Cited by 3,766
Checking consistency in mixed treatment comparison meta-analysis
Dias, S., Welton, N. J., Caldwell, D. M., & Ades, A. E. (2010) · Statistics in Medicine · doi:10.1002/sim.3767 · Cited by 2,521
Combination of direct and indirect evidence in mixed treatment comparisons
Lu, G., & Ades, A. E. (2004) · Statistics in Medicine · doi:10.1002/sim.1875 · Cited by 2,166
Consistency and inconsistency in network meta-analysis: concepts and models for multi-arm studies
Higgins, J. P. T., Jackson, D., Barrett, J. K., Lu, G., Ades, A. E., & White, I. R. (2012) · Research Synthesis Methods · doi:10.1002/jrsm.1044 · Cited by 2,098
Bucher, H. C., Guyatt, G. H., Griffith, L. E., & Walter, S. D. (1997) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(97)00049-8 · Cited by 2,052
Salanti, G. (2012) · Research Synthesis Methods · doi:10.1002/jrsm.1037 · Cited by 1,729
Cipriani, A., Furukawa, T. A., Salanti, G., Geddes, J. R., Higgins, J. P., Churchill, R., Watanabe, N., Nakagawa, A., Omori, I. M., McGuire, H., et al. (2009) · The Lancet · doi:10.1016/s0140-6736(09)60046-5 · Cited by 1,654
Network meta‐analysis for indirect treatment comparisons
Lumley, T. (2002) · Statistics in Medicine · doi:10.1002/sim.1201 · Cited by 1,206
White, I. R., Barrett, J. K., Jackson, D., & Higgins, J. P. T. (2012) · Research Synthesis Methods · doi:10.1002/jrsm.1045 · Cited by 1,114
Conceptual and technical challenges in network meta-analysis
Cipriani, A., Higgins, J. P. T., Geddes, J. R., & Salanti, G. (2013) · Annals of Internal Medicine · doi:10.7326/0003-4819-159-2-201307160-00008 · Cited by 1,072
Jansen, J. P., Fleurence, R., Devine, B., Itzler, R., Barrett, A., Hawkins, N., Lee, K., Boersma, C., Annemans, L., & Cappelleri, J. C. (2011) · Value in Health · doi:10.1016/j.jval.2011.04.002 · Cited by 1,036
Hoaglin, D. C., Hawkins, N., Jansen, J. P., Scott, D. A., Itzler, R., Cappelleri, J. C., Boersma, C., Thompson, D., Larholt, K. M., Diaz, M., et al. (2011) · Value in Health · doi:10.1016/j.jval.2011.01.011 · Cited by 770
White, I. R. (2015) · The Stata Journal: Promoting communications on statistics and Stata · doi:10.1177/1536867x1501500403 · Cited by 766
Assessing Evidence Inconsistency in Mixed Treatment Comparisons
Lu, G., & Ades, A. E. (2006) · Journal of the American Statistical Association · doi:10.1198/016214505000001302 · Cited by 756
Demystifying trial networks and network meta-analysis
Mills, E. J., Thorlund, K., & Ioannidis, J. P. A. (2013) · BMJ · doi:10.1136/bmj.f2914 · Cited by 742
Dias, S., Welton, N. J., Sutton, A. J., Caldwell, D. M., Lu, G., & Ades, A. E. (2013) · Medical Decision Making · doi:10.1177/0272989x12455847 · Cited by 728
Ioannidis, J. P. A. (2009) · Canadian Medical Association Journal · doi:10.1503/cmaj.081086 · Cited by 716
Jansen, J. P., & Naci, H. (2013) · BMC Medicine · doi:10.1186/1741-7015-11-159 · Cited by 656
Evaluation of inconsistency in networks of interventions
Veroniki, A. A., Vasiliadis, H. S., Higgins, J. P., & Salanti, G. (2013) · International Journal of Epidemiology · doi:10.1093/ije/dys222 · Cited by 576
A graphical tool for locating inconsistency in network meta-analyses
Krahn, U., Binder, H., & König, J. (2013) · BMC Medical Research Methodology · doi:10.1186/1471-2288-13-35 · Cited by 458
Network meta-analysis: a technique to gather evidence from direct and indirect comparisons
Tonin, F. S., Rotta, I., Mendes, A. M., & Pontarolo, R. (2017) · Pharmacy Practice · doi:10.18549/pharmpract.2017.01.943 · Cited by 405
Network meta-analysis-highly attractive but more methodological research is needed
Li, T., Puhan, M. A., Vedula, S. S., Singh, S., Dickersin, K., & The Ad Hoc Network Meta-analysis Methods Meeting Working Group (2011) · BMC Medicine · doi:10.1186/1741-7015-9-79 · Cited by 361
How to Use an Article Reporting a Multiple Treatment Comparison Meta-analysis
Mills, E. J., Ioannidis, J. P. A., Thorlund, K., Schünemann, H. J., Puhan, M. A., & Guyatt, G. H. (2012) · JAMA · doi:10.1001/2012.jama.11228 · Cited by 360
Nikolakopoulou, A., White, I. R., & Salanti, G. (2020) · Handbook of Meta-Analysis · doi:10.1201/9781315119403-10 · Cited by 303
A case study of multiple-treatments meta-analysis demonstrates that covariates should be considered
Salanti, G., Marinho, V., & Higgins, J. P. T. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2008.10.001 · Cited by 302
Assessing key assumptions of network meta‐analysis: a review of methods
Donegan, S., Williamson, P., D'Alessandro, U., & Tudur Smith, C. (2013) · Research Synthesis Methods · doi:10.1002/jrsm.1085 · Cited by 267
Empirical Evaluation of Very Large Treatment Effects of Medical Interventions
Pereira, T. V., Horwitz, R. I., & Ioannidis, J. P. A. (2012) · JAMA · doi:10.1001/jama.2012.13444 · Cited by 257
Issues in Comparisons Between Meta-analyses and Large Trials
Ioannidis, J. P. A. (1998) · JAMA · doi:10.1001/jama.279.14.1089 · Cited by 253
Exploring the Geometry of Treatment Networks
Salanti, G., Kavvoura, F. K., & Ioannidis, J. P. A. (2008) · Annals of Internal Medicine · doi:10.7326/0003-4819-148-7-200804010-00011 · Cited by 231
Kyrgiou, M., Salanti, G., Pavlidis, N., Paraskevaidis, E., & Ioannidis, J. P. A. (2006) · JNCI Journal of the National Cancer Institute · doi:10.1093/jnci/djj443 · Cited by 187
Meta-analysis of Multitreatment Studies
Hasselblad, V. (1998) · Medical Decision Making · doi:10.1177/0272989x9801800110 · Cited by 165
Baker, S. G., & Kramer, B. S. (2002) · BMC Medical Research Methodology · doi:10.1186/1471-2288-2-13 · Cited by 116
Mixed treatment comparisons using aggregate and individual participant level data
Saramago, P., Sutton, A. J., Cooper, N. J., & Manca, A. (2012) · Statistics in Medicine · doi:10.1002/sim.5442 · Cited by 116
Chaimani, A., Salanti, G., Leucht, S., Geddes, J. R., & Cipriani, A. (2017) · Evidence-Based Mental Health · doi:10.1136/eb-2017-102753 · Cited by 110
Multiple treatment and indirect treatment comparisons: An overview of network meta-analysis
Bhatnagar, N., Lakshmi, P. V. M., & Jeyashree, K. (2014) · Perspectives in Clinical Research · doi:10.4103/2229-3485.140550 · Cited by 100
Indirect comparisons: the mesh and mess of clinical trials
Ioannidis, J. P. A. (2006) · The Lancet · doi:10.1016/s0140-6736(06)69615-3 · Cited by 99
Multiple treatment comparison meta-analyses: a step forward into complexity
Mills, E. J., Bansback, N. J., Ghement, Tholund, Kelly, S., Puhan, M. A., & Wright, G. (2011) · Clinical Epidemiology · doi:10.2147/clep.s16526 · Cited by 93
An overview of conducting systematic reviews with network meta-analysis
Caldwell, D. M. (2014) · Systematic Reviews · doi:10.1186/2046-4053-3-109 · Cited by 83
Schmitz, S., Adams, R., Walsh, C., Barry, M. G., & FitzGerald, O. (2011) · Annals of the Rheumatic Diseases · doi:10.1136/annrheumdis-2011-200228 · Cited by 76
Statistical approaches for conducting network meta‐analysis in drug development
Jones, B. C., Roger, J., Lane, P. W., Lawton, A., Fletcher, C., Cappelleri, J. C., Tate, H., Moneuse, P., & on behalf of PSI Health Technology Special Interest Group, E. S. S. (2011) · Pharmaceutical Statistics · doi:10.1002/pst.533 · Cited by 59
Dakin, H., Welton, N. J., Ades, A. E., Collins, S., Orme, M. E., & Kelly, S. (2011) · Statistics in Medicine · doi:10.1002/sim.4284 · Cited by 57
Biondi‐Zoccai, G., Abbate, A., Benedetto, U., Palmerini, T., D’Ascenzo, F., & Frati, G. (2015) · International Journal of Cardiology · doi:10.1016/j.ijcard.2015.01.023 · Cited by 52
Bae, J. (2014) · Epidemiology and Health · doi:10.4178/epih/e2014019 · Cited by 32
Self-citationIntervention Meta-Analysis Using STATA Software
Shim, S. R., Shin, I., & Bae, J. (2016) · Journal of Health Informatics and Statistics · doi:10.21032/jhis.2016.41.1.123 · Cited by 29
Self-citationReken, S., Sturtz, S., Kiefer, C., Böhler, Y.-B., & Wieseler, B. (2016) · PLoS ONE · doi:10.1371/journal.pone.0160712 · Cited by 18
Suggestions for the promotion of evidence-based public health in South Korea
Bae, J. (2017) · Epidemiology and Health · doi:10.4178/epih.e2017030 · Cited by 11
Self-citation
Cited by
Owen, P. J., Miller, C. T., Mundell, N. L., Verswijveren, S. J. J. M., Tagliaferri, S. D., Brisby, H., Bowe, S. J., & Belavy, D. L. (2020) · British Journal of Sports Medicine · doi:10.1136/bjsports-2019-100886 · Cited by 544
Network meta-analysis: application and practice using R software
Shim, S. R., Kim, S.-J., Lee, J., & Rücker, G. (2019) · Epidemiology and Health · doi:10.4178/epih.e2019013 · Cited by 483
“따라서 국문으로 되어진 선행연구[1-3]를 통하여 충분한 개념 정립이 수반되어야 한다.”
Self-citationHuang, X., Zhao, X., Li, B., Cai, Y., Zhang, S., Wan, Q., & Yu, F. (2022) · Journal of Sport and Health Science · doi:10.1016/j.jshs.2021.05.003 · Cited by 392
“, College Station, TX, USA).(39) The network analysis pooled the individual study results.”
MethodInfluentialNorenhag, J., Du, J., Olovsson, M., Verstraelen, H., Engstrand, L., & Brusselaers, N. (2020) · BJOG: An International Journal of Obstetrics & Gynaecology · doi:10.1111/1471-0528.15854 · Cited by 383
“To enable direct and indirect comparisons between all CSTs, we used a fixed network meta-analysis approach, 19 and a classic pairwise meta-analysis to validate the results and explore heterogeneity (see Supplementary material, Appendix S1).”
MethodLOPEZ, P., RADAELLI, R., TAAFFE, D. R., NEWTON, R. U., GALVÃO, D. A., TRAJANO, G. S., TEODORO, J. L., KRAEMER, W. J., HÄKKINEN, K., & PINTO, R. S. (2021) · Medicine & Science in Sports & Exercise · doi:10.1249/mss.0000000000002585 · Cited by 340
“The network meta-analysis was performed following the current PRISMA guideline items (26, 27): 1) a network geometry was created to explore the comparisons between resistance training loads; 2) transitivity was tested by fitting a network inconsistency assumption along with Q test and side-splitting analyses between i…”
Method
Metadata
- Authors
- Shim, S., Yoon, B.-H., Shin, I.-S., & Bae, J.-M.
- Affiliations
- Inje University (KR)
- Jeonju University (KR)
- Jeju National University (KR)
- Corresponding author
- Bae, Jong-Myon
- Venue
- Epidemiology and Health
- Publisher
- Korean Society of Epidemiology
- Published
- 2017-10-27
- Volume
- 39
- Pages
- e2017047
- ISSN
- 1225-3596 (ISSN-L)
- 2092-7193
- PMC
- PMC5733388
- OpenAlex
- W2766765254
- Cited by
- 656
- References
- 46
- Citations by year
- 2026: 111 · 2025: 130 · 2024: 124 · 2023: 80 · 2022: 78 · 2021: 59 · 2020: 52 · 2019: 18 · 2018: 4
- FWCI
- 4.99
- Type
- journal article
- Language
- en
- Open access
- diamond
- doi.org
- Licence
- cc-by
- Locations
- Epidemiology and Health (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Sociology and Political Science › Delphi Technique in Research
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Keywords
- network meta-analysis, Stata, comparative effectiveness, network geometry, consistency assumption, transitivity, publication bias, effect modifiers, evidence synthesis, healthcare decision-making
- MeSH terms
- Network Meta-Analysis as Topic, Humans, Software, Treatment Outcome, Biostatistics
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.