The DOI matches its Crossref record; 46 of the 46 references it cites were found in a registry or an index.
Conceptual and Technical Challenges in Network Meta-analysis
Abstract
The increase in treatment options creates an urgent need for comparative effectiveness research. Randomized, controlled trials comparing several treatments are usually not feasible, so other methodological approaches are needed. Meta-analyses provide summary estimates of treatment effects by combining data from many studies. However, an important drawback is that standard meta-analyses can compare only 2 interventions at a time. A new meta-analytic technique, called network meta-analysis (or multiple treatments meta-analysis or mixed-treatment comparison), allows assessment of the relative effectiveness of several interventions, synthesizing evidence across a network of randomized trials. Despite the growing prevalence and influence of network meta-analysis in many fields of medicine, several issues need to be addressed when constructing one to avoid conclusions that are inaccurate, invalid, or not clearly justified. This article explores the scope and limitations of network meta-analysis and offers advice on dealing with heterogeneity, inconsistency, and potential sources of bias in the available evidence to increase awareness among physicians about some of the challenges in interpretation.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“For example, while conducting a NMA it allows to estimate effectiveness of different treatments in the absence of direct comparison between trials (Cipriani et al., 2013), thus, issues regarding inconsistency between either direct or indirect evidence could arise which was assessed in our study and found to be noncontributing (Appendix 1, Table 2).”
From Augmentation strategies for treatment resistant major depression: A systematic review and network meta-analysis (2022) · cites this paper as Cipriani et al., 2013
In the citing paper
“Network meta-analyses facilitate estimation of the comparative efficacy and tolerability of two or more interventions, even when they have not been investigated head-to-head in randomised controlled trials.18 Thus, compared with standard pairwise meta-analyses, network meta-analyses have been found to increase the precision of the estimates.18”
In the citing paper
“We explored the transitivity assumption by comparing the distribution of potential effect modifiers (baseline HbA1c and body weight) across treatment comparisons [14].”
In the citing paper
“These control conditions can lead to reduced network connectivity in network metaanalyses and therefore low statistical power.45”
In the citing paper
“NMA offers additional benefits over standard pairwise analyses in that the comparative efficacy of specific interventions can be estimated and ranked, even when two treatments have never been compared directly head-to-head 25 .”
From Lack of evidence to favor specific preventive interventions in psychosis: a network meta‐analysis (2018) · cites this paper as [25]
1 more claim about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Measuring inconsistency in meta-analyses
Higgins, J. P. T., Thompson, S. G., Deeks, J. J., & Altman, D. G. (2003) · BMJ · doi:10.1136/bmj.327.7414.557 · Cited by 63,139 · cited 1×
“Heterogeneity is usually evaluated by the Cochran Q test or the I(2) statistic (22).”
MethodSelf-citationMeta-analysis in clinical trials
DerSimonian, R., & Laird, N. (1986) · Controlled Clinical Trials · doi:10.1016/0197-2456(86)90046-2 · Cited by 39,552 · cited 1×
“Encompass it Random-effects meta-analysis can be applied (33, 34).”
MethodSalanti, G., Ades, A. E., & Ioannidis, J. P. A. (2011) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.03.016 · Cited by 3,766 · cited 1×
“Probabilities for each treatment taking each possible rank can be plotted in absolute and cumulative rankograms (37, 41–43) or presented in a table (44) ( Appendix Figures 2 and 3 , available at www.annals.org).”
BackgroundSelf-citationHow should meta‐regression analyses be undertaken and interpreted?
Thompson, S. G., & Higgins, J. P. T. (2002) · Statistics in Medicine · doi:10.1002/sim.1187 · Cited by 3,026 · cited 1×
“Explore it Study-level variables (ideally prespecified) can be investigated in a subgroup analysis or metaregression (32).”
BackgroundSelf-citationA Re-Evaluation of Random-Effects Meta-Analysis
Higgins, J. P. T., Thompson, S. G., & Spiegelhalter, D. J. (2009) · Journal of the Royal Statistical Society Series A: Statistics in Society · doi:10.1111/j.1467-985x.2008.00552.x · Cited by 2,569 · cited 1×
“Random-effects meta-analysis can be applied (33, 34).”
Self-citationChecking consistency in mixed treatment comparison meta-analysis
Dias, S., Welton, N. J., Caldwell, D. M., & Ades, A. E. (2010) · Statistics in Medicine · doi:10.1002/sim.3767 · Cited by 2,521
Meta-analysis: Principles and procedures
Egger, M., Smith, G. D., & Phillips, A. N. (1997) · BMJ · doi:10.1136/bmj.315.7121.1533 · Cited by 2,415
Bucher, H. C., Guyatt, G. H., Griffith, L. E., & Walter, S. D. (1997) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(97)00049-8 · Cited by 2,052 · cited 4×
“Consistency in a network meta-analysis can be evaluated statistically by comparing the direct and indirect summary effects in specific loops (8, 18) or across a network by fitting models that allow and do not allow for inconsistency (4, 23, 24).”
BackgroundInfluentialSalanti, G. (2012) · Research Synthesis Methods · doi:10.1002/jrsm.1037 · Cited by 1,729 · cited 3×
“This assumption has been described alongside several terms in the literature, including similarity (14, 15), transitivity (16, 17), consistency (4), and coherence (18).”
BackgroundSelf-citationCipriani, A., Furukawa, T. A., Salanti, G., Geddes, J. R., Higgins, J. P., Churchill, R., Watanabe, N., Nakagawa, A., Omori, I. M., McGuire, H., et al. (2009) · The Lancet · doi:10.1016/s0140-6736(09)60046-5 · Cited by 1,654
Self-citation
Research works printed but not linked: 2
- 10.1002/(SICI)1097-0258(19961230)15:24<2733::AID-SIM562>3.0.CO;2-0 · DOI · Paper page
- Gøtzsche PC, 2007, JAMA, 298, 430
Cited by
Hutton, B., Salanti, G., Caldwell, D. M., Chaimani, A., Schmid, C. H., Cameron, C., Ioannidis, J. P. A., Straus, S., Thorlund, K., Jansen, J. P., et al. (2015) · Annals of Internal Medicine · doi:10.7326/m14-2385 · Cited by 8,269
Self-citationGraphical tools for network meta-analysis in STATA
Chaimani, A., Higgins, J. P. T., Mavridis, D., Spyridonos, P., & Salanti, G. (2013) · PLoS ONE · doi:10.1371/journal.pone.0076654 · Cited by 2,473
“The assumption of consistency (agreement between direct and indirect sources of evidence) underlies the methodology and if it holds, NMA can give valuable information to patients, practitioners and decision makers [3,4].”
BackgroundSelf-citationPuhan, M. A., Schunemann, H. J., Murad, M. H., Li, T., Brignardello-Petersen, R., Singh, J. A., Kessels, A. G., Guyatt, G. H., & for the GRADE Working Group (2014) · BMJ · doi:10.1136/bmj.g5630 · Cited by 1,812
Evaluating the quality of evidence from a network meta-analysis
Salanti, G., Del Giovane, C., Chaimani, A., Caldwell, D. M., & Higgins, J. P. T. (2014) · PLoS ONE · doi:10.1371/journal.pone.0099682 · Cited by 1,402
“A network meta-analysis produces inferences regarding the relative effectiveness or safety of multiple treatments [1–3].”
BackgroundSelf-citationCortese, S., Adamo, N., Del Giovane, C., Mohr-Jensen, C., Hayes, A. J., Carucci, S., Atkinson, L. Z., Tessari, L., Banaschewski, T., Coghill, D., et al. (2018) · The Lancet Psychiatry · doi:10.1016/s2215-0366(18)30269-4 · Cited by 1,716
Self-citation
Metadata
- Authors
- Cipriani, A., Higgins, J. P. T., Geddes, J. R., & Salanti, G.
- Affiliations
- University of Verona (IT)
- Venue
- Annals of Internal Medicine
- Publisher
- American College of Physicians
- Published
- 2013-07-16
- Volume
- 159
- Issue
- 2
- Pages
- 130-137
- ISSN
- 0003-4819 (ISSN-L)
- 1539-3704
- OpenAlex
- W2040557955
- Cited by
- 1,072
- References
- 46
- Citations by year
- 2026: 75 · 2025: 81 · 2024: 88 · 2023: 92 · 2022: 119 · 2021: 116 · 2020: 96 · 2019: 85 · 2018: 101 · 2017: 63 · 2016: 68 · 2015: 46 · 2014: 38 · 2013: 4
- FWCI
- 57.38
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.acpjournals.org/journal/aim/text-and-data-mining (tdm)
- Locations
- Annals of Internal Medicine (publishedVersion)
- PubMed (publishedVersion)
- Explore Bristol Research (publishedVersion)
- Funders
- National Institute for Health and Care Research (NF-SI-0611-10150)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Social Sciences › Sociology and Political Science › Delphi Technique in Research
- Keywords
- network meta-analysis, comparative effectiveness research, heterogeneity, inconsistency, bias
- MeSH terms
- Humans, Meta-Analysis as Topic, Bias, Comparative Effectiveness Research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Conceptual and Technical Challenges in Network Meta-analysis. https://app.cochat.ai/papers/10.7326/0003-4819-159-2-201307160-00008
- The paper
- Cipriani, A., Higgins, J. P. T., Geddes, J. R., & Salanti, G. (2013). Conceptual and Technical Challenges in Network Meta-analysis. Annals of Internal Medicine. https://doi.org/10.7326/0003-4819-159-2-201307160-00008
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.