On weakly informative prior distributions for the heterogeneity parameter in Bayesian random‐effects meta‐analysis
Open accessThe DOI matches its Crossref record; 33 of the 33 references it cites were found in a registry or an index.
Abstract
The normal‐normal hierarchical model (NNHM) constitutes a simple and widely used framework for meta‐analysis. In the common case of only few studies contributing to the meta‐analysis, standard approaches to inference tend to perform poorly, and Bayesian meta‐analysis has been suggested as a potential solution. The Bayesian approach, however, requires the sensible specification of prior distributions. While noninformative priors are commonly used for the overall mean effect, the use of weakly informative priors has been suggested for the heterogeneity parameter, in particular in the setting of (very) few studies. To date, however, a consensus on how to generally specify a weakly informative heterogeneity prior is lacking. Here we investigate the problem more closely and provide some guidance on prior specification.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Gelman, A., Carlin, J. B., Stern, H. S., & Rubin, D. B. (2003) · doi:10.1201/9780429258480 · Cited by 27,276
Data Analysis Using Regression and Multilevel/Hierarchical Models
Gelman, A., & Hill, J. (2006) · doi:10.1017/cbo9780511790942 · Cited by 13,597
The assessment of anxiety states by rating
HAMILTON, M. (1959) · British Journal of Medical Psychology · doi:10.1111/j.2044-8341.1959.tb00467.x · Cited by 11,455
Statistical Decision Theory and Bayesian Analysis
Berger, J. O. (1985) · Springer Series in Statistics · doi:10.1007/978-1-4757-4286-2 · Cited by 7,722
A basic introduction to fixed-effect and random-effects models for meta-analysis
Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2010) · Research Synthesis Methods · doi:10.1002/jrsm.12 · Cited by 6,793 · cited 1×
“This is a random-effects model, which in the special case of τ = 0 simplifies to the common-effect model (also known as the fixed-effect model).(3,4,20,32) The NNHM provides a good approximation for many types of effect measures where the estimates as well as between-study variability may be assumed to be (approximate…”
MethodGelman, A. (2006) · Bayesian Analysis · doi:10.1214/06-ba117a · Cited by 4,050 · cited 4×
“In such a case, an unequal pair of two data points for example implies that the variance must be positive (a zero variance would have a zero likelihood); in the present NNHM context, however, unequal yi values may be consistent with zero heterogeneity (τ = 0), so that such priors are not a natural choice here, and the…”
BackgroundInfluentialProbability Theory: The Logic of Science
Jaynes, E. T. (2003) · doi:10.1017/cbo9780511790423 · Cited by 4,045
New Effect Size Rules of Thumb
Sawilowsky, S. S. (2009) · Journal of Modern Applied Statistical Methods · doi:10.22237/jmasm/1257035100 · Cited by 3,254
A Re-Evaluation of Random-Effects Meta-Analysis
Higgins, J. P. T., Thompson, S. G., & Spiegelhalter, D. J. (2009) · Journal of the Royal Statistical Society Series A: Statistics in Society · doi:10.1111/j.1467-985x.2008.00552.x · Cited by 2,569
Publication Bias in Meta‐Analysis: Prevention, Assessment and Adjustments
(2005) · doi:10.1002/0470870168 · Cited by 2,368
Probabilistic Forecasts, Calibration and Sharpness
Gneiting, T., Balabdaoui, F., & Raftery, A. E. (2007) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2007.00587.x · Cited by 1,783
Systematic Reviews in Health Care: Meta‐Analysis in Context
(2001) · doi:10.1002/9780470693926 · Cited by 1,693
Aalbers, S., Fusar-Poli, L., Freeman, R. E., Spreen, M., Ket, J. C., Vink, A. C., Maratos, A., Crawford, M., Chen, X.-J., & Gold, C. (2017) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd004517.pub3 · Cited by 838
Turner, R. M., Davey, J., Clarke, M. J., Thompson, S. G., & Higgins, J. P. (2012) · International Journal of Epidemiology · doi:10.1093/ije/dys041 · Cited by 837 · cited 5×
“Empirical evidence on the magnitude of heterogeneities within meta-analyses published in the Cochrane Database of Systematic Reviews is given by Turner et al.(75,79) For example, for a log-OR effect in a general healthcare setting (without restricting to a specific type of outcome), a log-normal distribution with μ =…”
BackgroundInfluentialBayesian approaches to randomized trials
Spiegelhalter, D. J., Freedman, L. S., & Parmar, M. K. B. (1994) · Journal of the Royal Statistical Society. Series A (Statistics in Society) · doi:10.2307/2983527 · Cited by 720 · cited 2×
“An important point to stress is that there is not necessarily a single “correct” prior: the use of different priors may be seen as basing inferences on different preconditions, and the choice of prior depends on which information one is willing to incorporate into the analysis; different analysts may hence draw differ…”
BackgroundDawid, A. P. (1982) · Journal of the American Statistical Association · doi:10.1080/01621459.1982.10477856 · Cited by 625
Bayesian approaches to random-effects meta-analysis: a comparative study
Smith, T. C., Spiegelhalter, D. J., & Thomas, A. (1995) · Statistics in Medicine · doi:10.1002/sim.4780142408 · Cited by 568
Burke, D. L., Ensor, J., & Riley, R. D. (2017) · Statistics in Medicine · doi:10.1002/sim.7141 · Cited by 538
The interplay of Bayesian and frequentist analysis
Bayarri, M. J., & Berger, J. O. (2004) · Statistical Science · doi:10.1214/088342304000000116 · Cited by 525
Turner, R. M., Jackson, D., Wei, Y., Thompson, S. G., & Higgins, J. P. T. (2015) · Statistics in Medicine · doi:10.1002/sim.6381 · Cited by 410 · cited 9×
“Empirical evidence on the magnitude of heterogeneities within meta-analyses published in the Cochrane Database of Systematic Reviews is given by Turner et al.(75,79) For example, for a log-OR effect in a general healthcare setting (without restricting to a specific type of outcome), a log-normal distribution with μ =…”
BackgroundMethodInfluentialWhy prospective registration of systematic reviews makes sense
Stewart, L., Moher, D., & Shekelle, P. (2012) · Systematic Reviews · doi:10.1186/2046-4053-1-7 · Cited by 375
Get real in individual participant data (IPD) meta‐analysis: a review of the methodology
Debray, T. P. A., Moons, K. G. M., van Valkenhoef, G., Efthimiou, O., Hummel, N., Groenwold, R. H. H., Reitsma, J. B., & on behalf of the GetReal methods review group (2015) · Research Synthesis Methods · doi:10.1002/jrsm.1160 · Cited by 348 · cited 1×
“Heterogeneity priors have been investigated previously from different angles; some discussed general considerations for variance parameters(15,25,26) while others motivated particular settings for specific example cases(27,28) or investigated commonly used settings in a systematic literature review.(29) The aim of the…”
BackgroundBayesian Random-Effects Meta-Analysis Using the bayesmeta R Package
Röver, C. (2020) · Journal of Statistical Software · doi:10.18637/jss.v093.i06 · Cited by 310
Self-citationApplied Mixed Models in Medicine
Brown, H., & Prescott, R. (2014) · doi:10.1002/9781118778210 · Cited by 282
Methods for evidence synthesis in the case of very few studies
Bender, R., Friede, T., Koch, A., Kuss, O., Schlattmann, P., Schwarzer, G., & Skipka, G. (2018) · Research Synthesis Methods · doi:10.1002/jrsm.1297 · Cited by 250
Self-citationOutcome selection bias in meta-analysis
Williamson, P. R., Gamble, C., Altman, D. G., & Hutton, J. L. (2005) · Statistical Methods in Medical Research · doi:10.1191/0962280205sm415oa · Cited by 188 · cited 1×
“This might be compromised by selection effects, for example, publication bias(122) or reporting bias.(123) Especially in the case of only few studies, such effects might be hard to detect from the data, and information on the presence of selection effects may need to come from considerations of the context.”
BackgroundStandardized Regression Coefficients: A Further Critique and Review of Some Alternatives
Greenland, S., Maclure, M., Schlesselman, J. J., Poole, C., & Morgenstern, H. (1991) · Epidemiology · doi:10.1097/00001648-199109000-00015 · Cited by 138
Conscientiousness and medication adherence: A meta-analysis
Molloy, G. J., O’Carroll, R. E., & Ferguson, E. (2014) · Annals of Behavioral Medicine · doi:10.1007/s12160-013-9524-4 · Cited by 130 · cited 2×
“Molloy et al.119 investigated the relationship between conscientiousness and medication adherence.”
BackgroundMeta‐analysis of two studies in the presence of heterogeneity with applications in rare diseases
Friede, T., Röver, C., Wandel, S., & Neuenschwander, B. (2017) · Biometrical Journal · doi:10.1002/bimj.201500236 · Cited by 128 · cited 2×
“These are the cases where the use of an informative prior will make the greatest difference, and such situations have been discussed in the context of up to 4,(9) 3–10,(7) or only 2 studies.(8) Heterogeneity priors have been investigated previously from different angles; some discussed general considerations for varia…”
BackgroundSelf-citationBayesian Meta-Analysis with Weakly Informative Prior Distributions
Williams, D. R., Rast, P., & Bürkner, P. C. (2018) · doi:10.31234/osf.io/7tbrm · Cited by 124
Trying to be precise about vagueness.
Senn, S. (2007) · Statistics in Medicine · doi:10.1002/sim.2639 · Cited by 105
Goralczyk, A. D., Hauke, N., Bari, N., Y. Tsui, T., Lorf, T., & Obed, A. (2011) · Hepatology · doi:10.1002/hep.24385 · Cited by 72 · cited 4×
“In the data from the closely related meta-analysis by Goralczyk et al.111 the heterogeneity is estimated at 0.12 (0.38).”
MethodInfluentialNot as golden as standards should be: Interpretation of the Hamilton Rating Scale for Depression
Kriston, L., & von Wolff, A. (2011) · Journal of Affective Disorders · doi:10.1016/j.jad.2010.07.011 · Cited by 55
Cited by
Janse van Mantgem, M. R., van Rheenen, W., Hackeng, A. V., van Es, M. A., Veldink, J. H., van den Berg, L. H., & van Eijk, R. P. A. (2023) · Neurology · doi:10.1212/wnl.0000000000201657 · Cited by 28
“0.(19) Funnel plots were used to visually inspect publication bias and study heterogeneity (eFigure 1, links.”
Method
Metadata
- Authors
- Röver, C., Bender, R., Dias, S., Schmid, C. H., Schmidli, H., Sturtz, S., Weber, S., & Friede, T.
- Venue
- Research Synthesis Methods
- Publisher
- Wiley
- Published
- 2021-02-15
- Volume
- 12
- Issue
- 4
- Pages
- 448-474
- ISSN
- 1759-2879 (ISSN-L)
- 1759-2887
- OpenAlex
- W3043675015
- Cited by
- 179
- References
- 33
- FWCI
- 11.58
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.