A chain of evidence with mixed comparisons: models for multi‐parameter synthesis and consistency of evidence
The DOI matches its Crossref record; 6 of the 6 references it cites were found in a registry or an index.
Abstract
Multi‐parameter evidence synthesis is a generalization of meta‐analysis in which several parameters are estimated jointly. Here this approach is applied to a common form of data structure in which mixed pairwise comparisons are made between treatments in a ‘chain of evidence’ structure. The data set investigated here, which first appeared in the confidence profile method literature, features three types of data relating to thrombolytic treatment following acute myocardial infarction. There is information on reperfusion (coronary patency) following treatment, information on survival in reperfused and non‐reperfused patients (conditional survival), and independent information on the effect of treatment on survival without specifying reperfusion state (overall survival). The objective of this study is to explore models for combining these three types of evidence within a single model, and some of the evidence consistency issues that arise. Bayesian Markov chain Monte Carlo methods are used to fit two models. The first, proposed in the confidence profile literature, assumes there are no differences between studies in baseline effects (equal study effects). The second model assumes fixed treatment effects but allows for study differences in baseline reperfusion and conditional survival rates by assuming random study effects. The equal study effects model fits the data poorly, and cross‐validation shows that the overall survival evidence is not consistent with the reperfusion and conditional survival evidence under this model. The evidence appears to be consistent within the more loosely structured random study effects model, but results are sensitive to prior assumptions about the between‐study variance. The inconsistency between the three evidence types relates to overall survival, rather than to the effect of treatment on survival. Multi‐parameter evidence synthesis, with suitable checks for evidence consistency, can be used to help determine whether chains of evidence ‘add up’ epidemiologically within an overall model, and to construct parameter distributions for an entire model simultaneously, consistent with all the available data. Copyright © 2003 John Wiley & Sons, Ltd.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Bayesian approaches to random-effects meta-analysis: a comparative study
Smith, T. C., Spiegelhalter, D. J., & Thomas, A. (1995) · Statistics in Medicine · doi:10.1002/sim.4780142408 · Cited by 568 · cited 5×
“This is a variation on ‘exact likelihood’ Bayesian treatments of binary outcome metaanalyses [2, 3, 6], where each k is allowed to take its own value unconstrained by the others.”
BackgroundMethodInfluentialA bivariate approach to meta-analysis
Van Houwelingen, H. C., Zwinderman, K. H., & Stijnen, T. (1993) · Statistics in Medicine · doi:10.1002/sim.4780122405 · Cited by 327
Warn, D. E., Thompson, S. G., & Spiegelhalter, D. J. (2002) · Statistics in Medicine · doi:10.1002/sim.1189 · Cited by 277
The direct use of likelihood for significance testing
Dempster, A. P. (1997) · Statistics and Computing · doi:10.1023/a:1018598421607 · Cited by 220
Ades, A. E., & Cliffe, S. (2002) · Medical Decision Making · doi:10.1177/027298902400448920 · Cited by 104 · cited 2×
“Like the CPM literature, this paper and previous work [24] can be seen as attempts to develop statistical methods for combining data that estimate several, arbitrarily complex, functions of model parameters.”
MethodSelf-citationDetecting and describing heterogeneity in meta-analysis
Hardy, R. J., & Thompson, S. G. (1998) · Statistics in Medicine · doi:10.1002/(sici)1097-0258(19980430)17:8<841::aid-sim781>3.0.co;2-d · cited 1×
“The detection and interpretation of between-study heterogeneity has been discussed extensively in the meta-analysis literature [1, 2, 44].”
Background
Cited by
Checking consistency in mixed treatment comparison meta-analysis
Dias, S., Welton, N. J., Caldwell, D. M., & Ades, A. E. (2010) · Statistics in Medicine · doi:10.1002/sim.3767 · Cited by 2,521
Self-citationCombination of direct and indirect evidence in mixed treatment comparisons
Lu, G., & Ades, A. E. (2004) · Statistics in Medicine · doi:10.1002/sim.1875 · Cited by 2,166
Self-citationDias, S., Sutton, A. J., Ades, A. E., & Welton, N. J. (2013) · Medical Decision Making · doi:10.1177/0272989x12458724 · Cited by 1,207
Self-citationJansen, J. P., Fleurence, R., Devine, B., Itzler, R., Barrett, A., Hawkins, N., Lee, K., Boersma, C., Annemans, L., & Cappelleri, J. C. (2011) · Value in Health · doi:10.1016/j.jval.2011.04.002 · Cited by 1,036
Multivariate meta-analysis for non-linear and other multi-parameter associations
Gasparrini, A., Armstrong, B., & Kenward, M. G. (2012) · Statistics in Medicine · doi:10.1002/sim.5471 · Cited by 772
“This approach may be more broadly described in the context of multi-parameter evidence synthesis [43, 44].”
Metadata
- Authors
- Ades, A. E.
- Venue
- Statistics in Medicine
- Publisher
- Wiley
- Published
- 2003-09-08
- Volume
- 22
- Issue
- 19
- Pages
- 2995-3016
- ISSN
- 0277-6715 (ISSN-L)
- 1097-0258
- OpenAlex
- W2072673200
- Cited by
- 128
- References
- 6
- FWCI
- 9.04
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.