Accounting for correlation in network meta‐analysis with multi‐arm trials
The DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.
Abstract
Multi‐arm trials (trials with more than two arms) are particularly valuable forms of evidence for network meta‐analysis (NMA). Trial results are available either as arm‐level summaries, where effect measures are reported for each arm, or as contrast‐level summaries, where the differences in effect between arms compare with the control arm chosen for the trial. We show that likelihood‐based inference in both contrast‐level and arm‐level formats is identical if there are only two‐arm trials, but that if there are multi‐arm trials, results from the contrast‐level format will be incorrect unless correlations are accounted for in the likelihood. We review Bayesian and frequentist software for NMA with multi‐arm trials that can account for this correlation and give an illustrative example of the difference in estimates that can be introduced if the correlations are not incorporated. We discuss methods of imputing correlations when they cannot be derived from the reported results and urge trialists to report the standard error for the control arm even if only contrast‐level summaries are reported. Copyright © 2012 John Wiley & Sons, Ltd.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
General methods for monitoring convergence of iterative simulations
Brooks, S. P., & Gelman, A. (1998) · Journal of Computational and Graphical Statistics · doi:10.1080/10618600.1998.10474787 · Cited by 6,045
A Re-Evaluation of Random-Effects Meta-Analysis
Higgins, J. P. T., Thompson, S. G., & Spiegelhalter, D. J. (2009) · Journal of the Royal Statistical Society Series A: Statistics in Society · doi:10.1111/j.1467-985x.2008.00552.x · Cited by 2,569 · cited 1×
“This is preferable for small sample sizes (Higgins et al., 2009).”
BackgroundRobust variance estimation in meta‐regression with dependent effect size estimates
Hedges, L. V., Tipton, E., & Johnson, M. C. (2010) · Research Synthesis Methods · doi:10.1002/jrsm.5 · Cited by 2,086 · cited 1×
“Hedges et al. (2010) propose an asymptotically valid approach that may be useful with at least 10–20 “clusters” of dependent data in the same study, but typically that is not the case for NMA.”
BackgroundThe BUGS project: evolution, critique and future directions
Lunn, D., Spiegelhalter, D., Thomas, A., & Best, N. (2009) · Statistics in Medicine · doi:10.1002/sim.3680 · Cited by 1,876
Network meta‐analysis for indirect treatment comparisons
Lumley, T. (2002) · Statistics in Medicine · doi:10.1002/sim.1201 · Cited by 1,206 · cited 1×
“Lumley developed code that can be used to perform NMA and that appears compatible with the inclusion of multi-arm trials (Lumley, 2002).”
MethodEvaluation of networks of randomized trials
Salanti, G., Higgins, J. P., Ades, A., & Ioannidis, J. P. (2008) · Statistical Methods in Medical Research · doi:10.1177/0962280207080643 · Cited by 1,078
Self-citationAssessing Evidence Inconsistency in Mixed Treatment Comparisons
Lu, G., & Ades, A. E. (2006) · Journal of the American Statistical Association · doi:10.1198/016214505000001302 · Cited by 756
Self-citationMultivariate meta‐analysis: Potential and promise
Jackson, D., Riley, R., & White, I. R. (2011) · Statistics in Medicine · doi:10.1002/sim.4172 · Cited by 530
Lambert, P. C., Sutton, A. J., Burton, P. R., Abrams, K. R., & Jones, D. R. (2005) · Statistics in Medicine · doi:10.1002/sim.2112 · Cited by 511 · cited 1×
“Furthermore, for random-effects models, the estimation of the heterogeneity parameter has been shown to be sensitive to the choice of prior in a Bayesian framework (Lambert et al., 2005), although point estimates of treatment effects are usually robust to this.”
BackgroundMultivariate Random-effects Meta-regression: Updates to Mvmeta
White, I. R. (2011) · The Stata Journal: Promoting communications on statistics and Stata · doi:10.1177/1536867x1101100206 · Cited by 400
Cited by
Dias, S., Sutton, A. J., Ades, A. E., & Welton, N. J. (2013) · Medical Decision Making · doi:10.1177/0272989x12458724 · Cited by 1,207
Self-citationMayo-Wilson, E., Dias, S., Mavranezouli, I., Kew, K., Clark, D. M., Ades, A. E., & Pilling, S. (2014) · The Lancet Psychiatry · doi:10.1016/s2215-0366(14)70329-3 · Cited by 680
Self-citationvan Valkenhoef, G., Dias, S., Ades, A. E., & Welton, N. J. (2016) · Research Synthesis Methods · doi:10.1002/jrsm.1167 · Cited by 695
Self-citationBannuru, R. R., Schmid, C. H., Kent, D. M., Vaysbrot, E. E., Wong, J. B., & McAlindon, T. E. (2015) · Annals of Internal Medicine · doi:10.7326/m14-1231 · Cited by 623
Ferreyro, B. L., Angriman, F., Munshi, L., Del Sorbo, L., Ferguson, N. D., Rochwerg, B., Ryu, M. J., Saskin, R., Wunsch, H., da Costa, B. R., et al. (2020) · JAMA · doi:10.1001/jama.2020.9524 · Cited by 425
GetReal in network meta-analysis: a review of the methodology
Efthimiou, O., Debray, T. P. A., van Valkenhoef, G., Trelle, S., Panayidou, K., Moons, K. G. M., Reitsma, J. B., Shang, A., Salanti, G., & on behalf of GetReal Methods Review Group (2016) · Research Synthesis Methods · doi:10.1002/jrsm.1195 · Cited by 401
“The use of such evidence is particularly challenged when direct treatment comparisons (direct evidence) are also available (Edwards et al., 2009; Gartlehner and Moore, 2008; Ioannidis, 2006).”
BackgroundVeroniki, A. A., Cogo, E., Rios, P., Straus, S. E., Finkelstein, Y., Kealey, R., Reynen, E., Soobiah, C., Thavorn, K., Hutton, B., et al. (2017) · BMC Medicine · doi:10.1186/s12916-017-0845-1 · Cited by 339
“In addition, the complexity of the evidence identified in our systematic review is, in contrast to a pairwise metaanalysis model, properly accounted in a NMA model, which models within-trial correlations induced by the multi-arm studies [43].”
A design‐by‐treatment interaction model for network meta‐analysis with random inconsistency effects
Jackson, D., Barrett, J. K., Rice, S., White, I. R., & Higgins, J. P. T. (2014) · Statistics in Medicine · doi:10.1002/sim.6188 · Cited by 304
Assessing key assumptions of network meta‐analysis: a review of methods
Donegan, S., Williamson, P., D'Alessandro, U., & Tudur Smith, C. (2013) · Research Synthesis Methods · doi:10.1002/jrsm.1085 · Cited by 267
Methods for including information from multi-arm trials in pairwise meta-analysis
Rücker, G., Cates, C. J., & Schwarzer, G. (2017) · Research Synthesis Methods · doi:10.1002/jrsm.1259 · Cited by 251
Currier, B. S., Mcleod, J. C., Banfield, L., Beyene, J., Welton, N. J., D'Souza, A. C., Keogh, J. A. J., Lin, L., Coletta, G., Yang, A., et al. (2023) · British Journal of Sports Medicine · doi:10.1136/bjsports-2023-106807 · Cited by 179
“40 44 To account for within-trial correlations in multi-arm trials (≥3 conditions), the SE in the base/reference arm was calculated as the square root of the covariance between calculated effects, 45 assuming a correlation of 0.5 between effect sizes.”
InfluentialSelf-citation
Metadata
- Authors
- Franchini, A. J., Dias, S., Ades, A. E., Jansen, J. P., & Welton, N. J.
- Venue
- Research Synthesis Methods
- Publisher
- Wiley
- Published
- 2012-06
- Volume
- 3
- Issue
- 2
- Pages
- 142-160
- ISSN
- 1759-2879 (ISSN-L)
- 1759-2887
- OpenAlex
- W2104340756
- Cited by
- 89
- References
- 10
- FWCI
- 9.20
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.