Incorporating multiple interventions in meta-analysis: an evaluation of the mixed treatment comparison with the adjusted indirect comparison
Open accessThe DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.
Abstract
Background: Comparing the effectiveness of interventions is now a requirement for regulatory approval in several countries. It also aids in clinical and public health decision-making. However, in the absence of head-to-head randomized trials (RCTs), determining the relative effectiveness of interventions is challenging. Several methodological options are now available. We aimed to determine the comparative validity of the adjusted indirect comparisons of RCTs with the mixed treatment comparison approach. Methods: Using systematic searching, we identified all meta-analyses evaluating more than 3 interventions for a similar disease state with binary outcomes. We abstracted data on each clinical trial including population n and outcomes. We conducted fixed effects meta-analysis of each intervention versus mutual comparator and then applied the adjusted indirect comparison. We conducted a mixed treatment meta-analysis on all trials and compared the point estimates and 95% confidence/credible intervals (CIs/CrIs) to determine important differences. Results: We included data from 7 reviews that met our inclusion criteria, allowing a total of 51 comparisons. According to the a priori consistency rule, we found 2 examples where the analytic comparisons were statistically significant using the mixed treatment comparison over the adjusted indirect comparisons and 1 example where this was vice versa. We found 6 examples where the direction of effect differed according to the indirect comparison method chosen and we found 9 examples where the confidence intervals were importantly different between approaches. Conclusion: In most analyses, the adjusted indirect comparison yields estimates of relative effectiveness equal to the mixed treatment comparison. In less complex indirect comparisons, where all studies share a mutual comparator, both approaches yield similar benefits. As comparisons become more complex, the mixed treatment comparison may be favoured.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Simultaneous comparison of multiple treatments: Combining direct and indirect evidence.
Caldwell, D. M., Ades, A. E., & Higgins, J. P. T. (2005) · BMJ · doi:10.1136/bmj.331.7521.897 · Cited by 1,600 · cited 1×
“Salanti and others have discussed the merits and challenges of the mixed treatment approach.[12,23,24] The mixed treatment comparison is a resource intensive approach to conducting analyses as it requires knowledge of Bayesian principles and working abilities with WinBUGS, a somewhat user-unfriendly software for those…”
BackgroundNetwork meta‐analysis for indirect treatment comparisons
Lumley, T. (2002) · Statistics in Medicine · doi:10.1002/sim.1201 · Cited by 1,206 · cited 1×
“The multiple treatment approaches, based on developing methods by several investigators,[6,7]most recently Lu and Ades,[8] is a generalization of standard pairwise meta-analysis for A versus B trials, to data structures that include, for example, A versus B, B versus C, and A versus C trials.”
MethodEvaluation of networks of randomized trials
Salanti, G., Higgins, J. P., Ades, A., & Ioannidis, J. P. (2008) · Statistical Methods in Medical Research · doi:10.1177/0962280207080643 · Cited by 1,078
Primary Prevention of Cardiovascular Mortality and Events With Statin Treatments
Mills, E. J., Rachlis, B., Wu, P., Devereaux, P. J., Arora, P., & Perri, D. (2008) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2008.08.039 · Cited by 423 · cited 4×
“Unpublished) [4,17,19-22]with three different types of network structures: (I) star-network, having a common comparator and containing no loops (figures 1, 2, 3), (II) single-loop network (figures 4 and 5), containing only one loop, and (III) multi-loop network, containing two or more loops (figures 6 and 7).”
BackgroundInfluentialSelf-citation
Cited by
Consistency and inconsistency in network meta-analysis: concepts and models for multi-arm studies
Higgins, J. P. T., Jackson, D., Barrett, J. K., Lu, G., Ades, A. E., & White, I. R. (2012) · Research Synthesis Methods · doi:10.1002/jrsm.1044 · Cited by 2,098
Salanti, G. (2012) · Research Synthesis Methods · doi:10.1002/jrsm.1037 · Cited by 1,729
“Clinical interest may lie more in comparing mDAB and m M AB, but these two quantities are correlated, and some sort of predefined criteria should be employed to define disagreement such as those suggested in O’Regan et al. (2009).”
BackgroundGetReal in network meta-analysis: a review of the methodology
Efthimiou, O., Debray, T. P. A., van Valkenhoef, G., Trelle, S., Panayidou, K., Moons, K. G. M., Reitsma, J. B., Shang, A., Salanti, G., & on behalf of GetReal Methods Review Group (2016) · Research Synthesis Methods · doi:10.1002/jrsm.1195 · Cited by 401
“have also been explored in empirical assessments (Jonas et al., 2013; Madan et al., 2011; O’Regan et al., 2009; Song et al., 2003, 2008) and simulation studies (Glenny et al.”
BackgroundNikolakopoulou, A., White, I. R., & Salanti, G. (2020) · Handbook of Meta-Analysis · doi:10.1201/9781315119403-10 · Cited by 303
Assessing key assumptions of network meta‐analysis: a review of methods
Donegan, S., Williamson, P., D'Alessandro, U., & Tudur Smith, C. (2013) · Research Synthesis Methods · doi:10.1002/jrsm.1085 · Cited by 267
Metadata
- Authors
- O'Regan, C., Ghement, I., Eyawo, O., Guyatt, G. H., & Mills, E. J.
- Venue
- Trials
- Published
- 2009-09-21
- Volume
- 10
- Issue
- 1
- Pages
- 86-86
- ISSN
- 1745-6215 (ISSN-L)
- OpenAlex
- W2156871467
- Cited by
- 41
- References
- 4
- FWCI
- 6.37
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Incorporating multiple interventions in meta-analysis: an evaluation of the mixed treatment comparison with the adjusted indirect comparison. https://app.cochat.ai/papers/10.1186/1745-6215-10-86
- The paper
- O'Regan, C., Ghement, I., Eyawo, O., Guyatt, G. H., & Mills, E. J. (2009). Incorporating multiple interventions in meta-analysis: an evaluation of the mixed treatment comparison with the adjusted indirect comparison. Trials. https://doi.org/10.1186/1745-6215-10-86
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.