An informed reference prior for between‐study heterogeneity in meta‐analyses of binary outcomes
The DOI matches its Crossref record; 8 of the 8 references it cites were found in a registry or an index.
Abstract
It is well known that when a Bayesian meta‐analysis includes a small number of studies, inference can be sensitive to the choice of prior for the between‐study variance. Choosing a vague prior does not solve the problem, as inferences can be substantially different depending on the degree of vagueness. Moreover, because the data provide little information on between‐study heterogeneity, posterior inferences for the between‐study variance based on vague priors will tend to be unrealistic. It is thus preferable to adopt a reasonable, informed prior for the between‐study variance. However, relatively little is known about what constitutes a realistic distribution. On the basis of data from the Cochrane Database of Systematic Reviews, this paper describes the distribution of between‐study variance in published meta‐analyses, and proposes some realistic, informed priors for use in meta‐analyses of binary outcomes. It is hoped that these priors will improve the calibration of inferences from Bayesian meta‐analyses. Copyright © 2011 John Wiley & Sons, Ltd.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Gelman, A. (2006) · Bayesian Analysis · doi:10.1214/06-ba117a · Cited by 4,050
A Re-Evaluation of Random-Effects Meta-Analysis
Higgins, J. P. T., Thompson, S. G., & Spiegelhalter, D. J. (2009) · Journal of the Royal Statistical Society Series A: Statistics in Society · doi:10.1111/j.1467-985x.2008.00552.x · Cited by 2,569
What to add to nothing? Use and avoidance of continuity corrections in meta‐analysis of sparse data
J. Sweeting, M., J. Sutton, A., & C. Lambert, P. (2004) · Statistics in Medicine · doi:10.1002/sim.1761 · Cited by 1,734 · cited 1×
“5 is added to each cell of the study was used, because it represents the most commonly used method, despite the fact that it can be biased [17].”
MethodUndue reliance on I 2 in assessing heterogeneity may mislead
Rücker, G., Schwarzer, G., Carpenter, J. R., & Schumacher, M. (2008) · BMC Medical Research Methodology · doi:10.1186/1471-2288-8-79 · Cited by 1,287
Dawid, A. P. (1982) · Journal of the American Statistical Association · doi:10.1080/01621459.1982.10477856 · Cited by 625 · cited 1×
“Senn [6] commented that one of the problems with a frequentist analysis of a small number of trials is that the estimate of between-trial variance is unlikely to be credible, and pointed out that this problem is not solved by using a vague prior distribution that incorporates implausible values for the between-study v…”
BackgroundBayesian approaches to random-effects meta-analysis: a comparative study
Smith, T. C., Spiegelhalter, D. J., & Thomas, A. (1995) · Statistics in Medicine · doi:10.1002/sim.4780142408 · Cited by 568 · cited 1×
“[16] used theoretical reasoning to determine which values of £ are reasonable in practice.”
BackgroundLambert, P. C., Sutton, A. J., Burton, P. R., Abrams, K. R., & Jones, D. R. (2005) · Statistics in Medicine · doi:10.1002/sim.2112 · Cited by 511
Trying to be precise about vagueness.
Senn, S. (2007) · Statistics in Medicine · doi:10.1002/sim.2639 · Cited by 105
Cited by
Methods to estimate the between‐study variance and its uncertainty in meta‐analysis
Veroniki, A. A., Jackson, D., Viechtbauer, W., Bender, R., Bowden, J., Knapp, G., Kuss, O., Higgins, J. P., Langan, D., & Salanti, G. (2016) · Research Synthesis Methods · doi:10.1002/jrsm.1164 · Cited by 1,685
“2016, 7 55–79 6 8 for the between-study variance when meta-analysing (log) odds ratios (Pullenayegum, 2011; Turner et al., 2012) and standardised mean differences (Rhodes et al., 2015), and these might considerably improve estimation when few studies are included in the meta-analysis.”
InfluentialTurner, R. M., Davey, J., Clarke, M. J., Thompson, S. G., & Higgins, J. P. (2012) · International Journal of Epidemiology · doi:10.1093/ije/dys041 · Cited by 837
Turner, R. M., Jackson, D., Wei, Y., Thompson, S. G., & Higgins, J. P. T. (2015) · Statistics in Medicine · doi:10.1002/sim.6381 · Cited by 410
“Empirically derived informative prior distributions for heterogeneity variances have been proposed previously by Higgins and Whitehead [3] and by Pullenayegum [14].”
MethodRhodes, K. M., Turner, R. M., & Higgins, J. P. T. (2015) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2014.08.012 · Cited by 395
Bayesian Random-Effects Meta-Analysis Using the bayesmeta R Package
Röver, C. (2020) · Journal of Statistical Software · doi:10.18637/jss.v093.i06 · Cited by 310
“Some empirical evidence to consider for informative priors for certain types of endpoints may be found e.g. in Pullenayegum (2011), Turner et al. (2012), Kontopantelis et al. (2013) and van Erp et al. (2017).”
BackgroundMethodInfluentialBayesian Meta-Analysis with Weakly Informative Prior Distributions
Williams, D. R., Rast, P., & Bürkner, P. C. (2018) · doi:10.31234/osf.io/7tbrm · Cited by 124
“In clinically oriented fields, substantial effort has been invested into deriving an informed prior distribution for between-study variances from empirical studies (Pullenayegum, 2011; Rhodes et al., 2015; Turner, Davey, Clarke, Thompson, & Higgins, 2012).”
BackgroundBayesian estimation in random effects meta‐analysis using a non‐informative prior
Bodnar, O., Link, A., Arendacká, B., Possolo, A., & Elster, C. (2017) · Statistics in Medicine · doi:10.1002/sim.7156 · Cited by 73
Metadata
- Authors
- Pullenayegum, E. M.
- Venue
- Statistics in Medicine
- Publisher
- Wiley
- Published
- 2011-08-25
- Volume
- 30
- Issue
- 26
- Pages
- 3082-3094
- ISSN
- 0277-6715 (ISSN-L)
- 1097-0258
- OpenAlex
- W1633467982
- Cited by
- 64
- References
- 8
- FWCI
- 3.71
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.