The DOI matches its Crossref record; 37 of the 37 references it cites were found in a registry or an index.
Evidence Synthesis for Decision Making 4: Inconsistency in Networks of Evidence Based on Randomized Controlled Trials
Open accessAbstract
Inconsistency can be thought of as a conflict between “direct” evidence on a comparison between treatments B and C and “indirect” evidence gained from AC and AB trials. Like heterogeneity, inconsistency is caused by effect modifiers and specifically by an imbalance in the distribution of effect modifiers in the direct and indirect evidence. Defining inconsistency as a property of loops of evidence, the relation between inconsistency and heterogeneity and the difficulties created by multiarm trials are described. We set out an approach to assessing consistency in 3-treatment triangular networks and in larger circuit structures, its extension to certain special structures in which independent tests for inconsistencies can be created, and describe methods suitable for more complex networks. Sample WinBUGS code is given in an appendix. Steps that can be taken to minimize the risk of drawing incorrect conclusions from indirect comparisons and network meta-analysis are the same steps that will minimize heterogeneity in pairwise meta-analysis. Empirical indicators that can provide reassurance and the question of how to respond to inconsistency are also discussed.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
WinBUGS - A Bayesian modelling framework: Concepts, structure, and extensibility
Lunn, D. J., Thomas, A., Best, N., & Spiegelhalter, D. (2000) · Statistics and Computing · doi:10.1023/a:1008929526011 · Cited by 5,368
Keeley, E. C., Boura, J. A., & Grines, C. L. (2003) · The Lancet · doi:10.1016/s0140-6736(03)12113-7 · Cited by 4,361
The Handbook of Research Synthesis.
Howel, D., Cooper, H., & Hedges, L. V. (1995) · Biometrics · doi:10.2307/2533295 · Cited by 3,642
Checking consistency in mixed treatment comparison meta-analysis
Dias, S., Welton, N. J., Caldwell, D. M., & Ades, A. E. (2010) · Statistics in Medicine · doi:10.1002/sim.3767 · Cited by 2,521 · cited 2×
“Discounting this loop gives ICDF = 7.(25) An FE NMA (consistency model) with a binomial likelihood and logit link(8,10) was fitted to the data, taking SK as the reference treatment, that is, the 8 treatment effects relative to SK are the basic parameters and have been estimated, whereas the remaining relative effects…”
MethodSelf-citationCombination of direct and indirect evidence in mixed treatment comparisons
Lu, G., & Ades, A. E. (2004) · Statistics in Medicine · doi:10.1002/sim.1875 · Cited by 2,166
Self-citationBucher, H. C., Guyatt, G. H., Griffith, L. E., & Walter, S. D. (1997) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(97)00049-8 · Cited by 2,052
Cipriani, A., Furukawa, T. A., Salanti, G., Geddes, J. R., Higgins, J. P., Churchill, R., Watanabe, N., Nakagawa, A., Omori, I. M., McGuire, H., et al. (2009) · The Lancet · doi:10.1016/s0140-6736(09)60046-5 · Cited by 1,654
Simultaneous comparison of multiple treatments: Combining direct and indirect evidence.
Caldwell, D. M., Ades, A. E., & Higgins, J. P. T. (2005) · BMJ · doi:10.1136/bmj.331.7521.897 · Cited by 1,600 · cited 1×
“Where inconsistency has been evident, it illustrates the danger introduced by heterogeneity and in particular by the practice of trying to combine evidence on disparate treatment doses or treatment combinations within meta-analyses, often termed lumping.(1,29) The place for an enquiry into consistency is alongside a c…”
BackgroundSelf-citationDias, S., Sutton, A. J., Ades, A. E., & Welton, N. J. (2013) · Medical Decision Making · doi:10.1177/0272989x12458724 · Cited by 1,207
Self-citationNetwork meta‐analysis for indirect treatment comparisons
Lumley, T. (2002) · Statistics in Medicine · doi:10.1002/sim.1201 · Cited by 1,206 · cited 2×
“This accords with the commonsense notion of inconsistency, which views it as a property of loops of evidence.(14,15) Every additional independent loop in a network of 2-arm trials represents 1 additional ICDF and one further way in which potential inconsistency can be realized.”
BackgroundResultEvaluation of networks of randomized trials
Salanti, G., Higgins, J. P., Ades, A., & Ioannidis, J. P. (2008) · Statistical Methods in Medical Research · doi:10.1177/0962280207080643 · Cited by 1,078
Self-citationSong, F., Altman, D. G., Glenny, A.-M., & Deeks, J. J. (2003) · BMJ · doi:10.1136/bmj.326.7387.472 · Cited by 943
The Handbook of Research Synthesis
Ziegel, E. R., Cooper, H., & Hedges, L. (1995) · Technometrics · doi:10.2307/1269651 · Cited by 927
Assessing Evidence Inconsistency in Mixed Treatment Comparisons
Lu, G., & Ades, A. E. (2006) · Journal of the American Statistical Association · doi:10.1198/016214505000001302 · Cited by 756
Self-citationDias, S., Welton, N. J., Sutton, A. J., & Ades, A. E. (2011) · Bristol Research (University of Bristol) · Cited by 691
Self-citationIndirect comparisons of competing interventions
Glenny, A., Altman, D., Song, F., Sakarovitch, C., Deeks, J., D'Amico, R., Bradburn, M., & Eastwood, A. (2005) · Health Technology Assessment · doi:10.3310/hta9260 · Cited by 677
Deeks, J. J. (2002) · Statistics in Medicine · doi:10.1002/sim.1188 · Cited by 660
IX: Summary of Meta-Analyses of Therapies for Postmenopausal Osteoporosis
Cranney, A., Guyatt, G., Griffith, L., Wells, G., Tugwell, P., Rosen, C., The Osteoporosis Methodology Group, & The Osteoporosis Research Advisory Group (2002) · Endocrine Reviews · doi:10.1210/er.2001-9002 · Cited by 604
BORROWING STRENGTH FROM EXTERNAL TRIALS IN A META-ANALYSIS
HIGGINS, J. P. T., & WHITEHEAD, A. (1996) · Statistics in Medicine · doi:10.1002/(sici)1097-0258(19961230)15:24<2733::aid-sim562>3.0.co;2-0 · Cited by 557
Stochastically dependent effect sizes.
Gleser, L. J., & Olkin, I. (1994) · Cited by 485
Dias, S., Sutton, A. J., Welton, N. J., & Ades, A. E. (2013) · Medical Decision Making · doi:10.1177/0272989x13485157 · Cited by 466
Self-citationSong, F., Loke, Y. K., Walsh, T., Glenny, A.-M., Eastwood, A. J., & Altman, D. G. (2009) · BMJ · doi:10.1136/bmj.b1147 · Cited by 395
Bias Modelling in Evidence Synthesis
Turner, R. M., Spiegelhalter, D. J., Smith, G. C. S., & Thompson, S. G. (2009) · Journal of the Royal Statistical Society Series A: Statistics in Society · doi:10.1111/j.1467-985x.2008.00547.x · Cited by 321
Inconsistency in Networks of Evidence Based on Randomised Controlled Trials
Dias, S., Welton, N. J., Sutton, A. J., Caldwell, D. M., Lu, G., & Ades, A. E. (2011) · Bristol Research (University of Bristol) · Cited by 202
Self-citationSong, F., Xiong, T., Parekh-Bhurke, S., Loke, Y. K., Sutton, A. J., Eastwood, A. J., Holland, R., Chen, Y.-F., Glenny, A.-M., Deeks, J. J., et al. (2011) · BMJ · doi:10.1136/bmj.d4909 · Cited by 199
Self-citationModeling between-trial variance structure in mixed treatment comparisons
Lu, G., & Ades, A. (2009) · Biostatistics · doi:10.1093/biostatistics/kxp032 · Cited by 196
Self-citationMeta-analysis of Multitreatment Studies
Hasselblad, V. (1998) · Medical Decision Making · doi:10.1177/0272989x9801800110 · Cited by 165
Bayesian Measures of Model Complexity and Fit
Spiegelhalter, D. J., Best, N. G., Carlin, B. P., & Van Der Linde, A. (2002) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/1467-9868.00353 · Cited by 151
Meta-analysis by the confidence profile method
Eddy, D. M. (1992) · Cited by 144
Caldwell, D. M., Welton, N. J., & Ades, A. E. (2010) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2009.08.025 · Cited by 142
Self-citationBoland, A., Dundar, Y., Bagust, A., Haycox, A. R., Hill, R. A., Mujica-Mota, R. E., Walley, T., & Dickson, R. (2003) · Health Technology Assessment · doi:10.3310/hta7150 · Cited by 136
Evidence Synthesis for Decision Making 5: The Baseline Natural History Model
Dias, S., Welton, N. J., Sutton, A. J., & Ades, A. E. (2013) · Medical Decision Making · doi:10.1177/0272989x13485155 · Cited by 90
Self-citationDias, S., Welton, N. J., Marinho, V. C., Salanti, G., Higgins, J. P. T., & Ades, A. E. (2010) · Journal of the Royal Statistical Society Series A (Statistics in Society) · doi:10.1111/j.1467-985x.2010.00639.x · Cited by 88
Self-citationGoubar, A., Ades, A. E., Angelis, D. D., McGarrigle, C. A., Mercer, C. H., Tookey, P. A., Fenton, K. A., & Gill, O. N. (2008) · Journal of the Royal Statistical Society Series A (Statistics in Society) · doi:10.1111/j.1467-985x.2007.00537.x · Cited by 72
Self-citationValidity of indirect comparisons in meta-analysis
Caldwell, D. M., Gibb, D. M., & Ades, A. E. (2007) · The Lancet · doi:10.1016/s0140-6736(07)60138-x · Cited by 36
Self-citationPresanis, A. M., Angelis, D. D., Spiegelhalter, D. J., Seaman, S. R., Goubar, A., & Ades, A. E. (2008) · Journal of the Royal Statistical Society Series A (Statistics in Society) · doi:10.1111/j.1467-985x.2008.00543.x · Cited by 34
Self-citationCaldwell, D. M., Welton, N. J., Dias, S., & Ades, A. E. (2012) · Research Synthesis Methods · doi:10.1002/jrsm.1040 · Cited by 29
Self-citation
Cited by
Hutton, B., Salanti, G., Caldwell, D. M., Chaimani, A., Schmid, C. H., Cameron, C., Ioannidis, J. P. A., Straus, S., Thorlund, K., Jansen, J. P., et al. (2015) · Annals of Internal Medicine · doi:10.7326/m14-2385 · Cited by 8,269
Self-citationCINeMA: an approach for assessing confidence in the results of a network meta-analysis
Nikolakopoulou, A., Higgins, J. P. T., Papakonstantinou, T., Chaimani, A., Del Giovane, C., Egger, M., & Salanti, G. (2020) · PLOS Medicine · doi:10.1371/journal.pmed.1003082 · Cited by 1,935
Evaluating the quality of evidence from a network meta-analysis
Salanti, G., Del Giovane, C., Chaimani, A., Caldwell, D. M., & Higgins, J. P. T. (2014) · PLoS ONE · doi:10.1371/journal.pone.0099682 · Cited by 1,402
Self-citationDias, S., Sutton, A. J., Ades, A. E., & Welton, N. J. (2013) · Medical Decision Making · doi:10.1177/0272989x12458724 · Cited by 1,207
Self-citationNetwork meta-analysis: an introduction for clinicians
Rouse, B., Chaimani, A., & Li, T. (2017) · Internal and Emergency Medicine · doi:10.1007/s11739-016-1583-7 · Cited by 875
Metadata
- Authors
- Dias, S., Welton, N. J., Sutton, A. J., Caldwell, D. M., Lu, G., & Ades, A. E.
- Venue
- Medical Decision Making
- Publisher
- SAGE Publications
- Published
- 2013-06-26
- Volume
- 33
- Issue
- 5
- Pages
- 641-656
- ISSN
- 0272-989X (ISSN-L)
- 1552-681X
- OpenAlex
- W2897247590
- Cited by
- 728
- References
- 37
- FWCI
- 43.38
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.