Multiple treatment comparison meta-analyses: a step forward into complexity
Open accessThe DOI matches its Crossref record; 8 of the 8 references it cites were found in a registry or an index.
Abstract
The use of meta-analysis has become increasingly useful for clinical and policy decision making. A recent development in meta-analysis, multiple treatment comparison (MTC) meta-analysis, provides inferences on the comparative effectiveness of interventions that may have never been directly evaluated in clinical trials. This new approach may be confusing for clinicians and methodologists and raises specific challenges relevant to certain areas of medicine. This article addresses the methodological concepts of MTC meta-analysis, including issues of heterogeneity, choice of model, and adequacy of sample sizes. We address domain-specific challenges relevant to disciplines of medicine, including baseline risks of patient populations. We conclude that MTC meta-analysis is a useful tool in the context of comparative effectiveness and requires further study, as its utility and transparency will likely predict its uptake by the research and clinical community.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
GRADE: an emerging consensus on rating quality of evidence and strength of recommendations
Guyatt, G. H., Oxman, A. D., Vist, G. E., Kunz, R., Falck-Ytter, Y., Alonso-Coello, P., & Schünemann, H. J. (2008) · BMJ · doi:10.1136/bmj.39489.470347.ad · Cited by 23,305
Beta blockade during and after myocardial infarction: An overview of the randomized trials
Yusuf, S., Peto, R., Lewis, J., Collins, R., & Sleight, P. (1985) · Progress in Cardiovascular Diseases · doi:10.1016/s0033-0620(85)80003-7 · Cited by 3,205 · cited 1×
“2 Although meta-analysis has been used in clinical medicine since the 1980s 3,4 and became commonly used in the 1990s, possibly due to the establishment of the Cochrane Collaboration, 5 the methods to refine, reduce bias, and improve meta-analysis have developed slowly.”
Checking consistency in mixed treatment comparison meta-analysis
Dias, S., Welton, N. J., Caldwell, D. M., & Ades, A. E. (2010) · Statistics in Medicine · doi:10.1002/sim.3767 · Cited by 2,521 · cited 4×
“29 To summarize, at least three issues of combinability need to be considered: a homogeneity assumption for each meta-analysis, a similarity assumption for individual comparisons, and a consistency assumption for the combination of evidence from different sources.”
InfluentialNetwork meta‐analysis for indirect treatment comparisons
Lumley, T. (2002) · Statistics in Medicine · doi:10.1002/sim.1201 · Cited by 1,206 · cited 3×
“7,9 In a meta-analysis addressing smoking cessation, 26 two head-to-head trials resulted in superiority of varenicline over bupropion (odds ratio [OR] 1.49, 95% CI 1.49–2.33, P , 0.001), with similar effects in the indirect comparison of nine trials of varenicline and 31 trials of bupro-pion (OR…”
InfluentialIoannidis, J. P. A. (2009) · Canadian Medical Association Journal · doi:10.1503/cmaj.081086 · Cited by 716 · cited 1×
“27,28 Given that this type of hypothesis testing can suffer from low power as well from a lack of balance, 27 Dias et al 29 have proposed two sophisticated methods for checking consistency in an MTC analysis, which rely on back-calculation and node-splitting, respectively.”
Post-randomisation exclusions: the intention to treat principle and excluding patients from analysis
Fergusson, D., Aaron, S. D., Guyatt, G., & Hébert, P. (2002) · BMJ · doi:10.1136/bmj.325.7365.652 · Cited by 708 · cited 1×
“42 Despite the fact that these are RCTs, such crossing over may not occur randomly across arms, as one treatment may be genuinely more beneficial than the other.”
CHALMERS, I. (1993) · Annals of the New York Academy of Sciences · doi:10.1111/j.1749-6632.1993.tb26345.x · Cited by 561
Effect sizes in cumulative meta-analyses of mental health randomized trials evolved over time
Trikalinos, T. A., Churchill, R., Ferri, M., Leucht, S., Tuunainen, A., Wahlbeck, K., & Ioannidis, J. P. A. (2004) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2004.02.018 · Cited by 177
Cited by
Hutton, B., Salanti, G., Caldwell, D. M., Chaimani, A., Schmid, C. H., Cameron, C., Ioannidis, J. P. A., Straus, S., Thorlund, K., Jansen, J. P., et al. (2015) · Annals of Internal Medicine · doi:10.7326/m14-2385 · Cited by 8,269
Ranking treatments in frequentist network meta-analysis works without resampling methods
Rücker, G., & Schwarzer, G. (2015) · BMC Medical Research Methodology · doi:10.1186/s12874-015-0060-8 · Cited by 1,732
Network meta-analysis: application and practice using Stata
Shim, S., Yoon, B.-H., Shin, I.-S., & Bae, J.-M. (2017) · Epidemiology and Health · doi:10.4178/epih.e2017047 · Cited by 656
Network meta-analysis: a technique to gather evidence from direct and indirect comparisons
Tonin, F. S., Rotta, I., Mendes, A. M., & Pontarolo, R. (2017) · Pharmacy Practice · doi:10.18549/pharmpract.2017.01.943 · Cited by 405
GetReal in network meta-analysis: a review of the methodology
Efthimiou, O., Debray, T. P. A., van Valkenhoef, G., Trelle, S., Panayidou, K., Moons, K. G. M., Reitsma, J. B., Shang, A., Salanti, G., & on behalf of GetReal Methods Review Group (2016) · Research Synthesis Methods · doi:10.1002/jrsm.1195 · Cited by 401
“2009; EUnetHTA, 2013; Hoaglin et al., 2011; Ioannidis, 2009; Jansen et al., 2008, 2011a; Malone, 2007; Mills et al., 2011a, 2013b; Naci and Fleurence, 2011; Salanti, 2012; Sutton et al., 2008, 2009; Wells et al., 2009; Welton et al., 2012), which have also been explored in empirical assessments…”
Background
Metadata
- Authors
- Mills, E., Bansback, N., Ghement, Tholund, Kelly, S., Puhan, & Wright, G.
- Venue
- Clinical Epidemiology
- Publisher
- Informa UK Limited
- Published
- 2011-05
- Volume
- 3
- Pages
- 193
- ISSN
- 1179-1349 (ISSN-L)
- OpenAlex
- W2002049303
- Cited by
- 92
- References
- 8
- FWCI
- 7.77
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Multiple treatment comparison meta-analyses: a step forward into complexity. https://app.cochat.ai/papers/10.2147/clep.s16526
- The paper
- Mills, E., Bansback, N., Ghement, Tholund, Kelly, S., Puhan, & Wright, G. (2011). Multiple treatment comparison meta-analyses: a step forward into complexity. Clinical Epidemiology. https://doi.org/10.2147/clep.s16526
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.