Bayesian random effects meta-analysis of trials with binary outcomes: methods for the absolute risk difference and relative risk scales
Abstract
When conducting a meta-analysis of clinical trials with binary outcomes, a normal approximation for the summary treatment effect measure in each trial is inappropriate in the common situation where some of the trials in the meta-analysis are small, or the observed risks are close to 0 or 1. This problem can be avoided by making direct use of the binomial distribution within trials. A fully Bayesian method has already been developed for random effects meta-analysis on the log-odds scale using the BUGS implementation of Gibbs sampling. In this paper we demonstrate how this method can be extended to perform analyses on both the absolute and relative risk scales. Within each approach we exemplify how trial-level covariates, including underlying risk, can be considered. Data from 46 trials of the effect of single-dose ibuprofen on post-operative pain are analysed and the results contrasted with those derived from classical and Bayesian summary statistic methods. The clinical interpretation of the odds ratio scale is not straightforward. The advantages and flexibility of a fully Bayesian approach to meta-analysis of binary outcome data, considered on an absolute risk or relative risk scale, are now available.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
When 2×2 contingency tables are available for binary outcomes, meta-analyses are appropriately performed by using binomial likelihoods.
“For example, when 2×2 contingency tables are available for binary outcomes, meta-analyses are appropriately performed by using binomial likelihoods (Smith et al., 1995; Warn et al., 2002).”
From A Re-Evaluation of Random-Effects Meta-Analysis (2009) · cites this paper as Warn et al., 2002
Common fixed-effect approaches are Mantel-Haenszel and inverse variance; random-effects usually use DerSimonian and Laird, though other methods exist including Bayesian.
“Common fixed-effect approaches are Mantel-Haenszel and inverse variance, whereas random-effects analyses usually use the DerSimonian and Laird approach, although other methods exist, including Bayesian meta-analysis [201].”
From The PRISMA Statement for Reporting Systematic Reviews and Meta-Analyses of Studies That Evaluate Health Care Interventions: Explanation and Elaboration (2009) · cites this paper as [201]
Cites
Meta-analysis in clinical trials
DerSimonian, R., & Laird, N. (1986) · Controlled Clinical Trials · doi:10.1016/0197-2456(86)90046-2 · Cited by 39,552 · see citing works
Gelman, A., Carlin, J. B., Stern, H. S., Dunson, D. B., Vehtari, A., & Rubin, D. B. (2013) · doi:10.1201/b16018 · Cited by 27,276 · see citing works
Cox, D. R. (2008) · Springer eBooks · doi:10.1007/978-0-387-32833-1_5 · Cited by 2,678 · see citing works
The number needed to treat: a clinically useful measure of treatment effect
Cook, R. J., & Sackett, D. L. (1995) · BMJ · doi:10.1136/bmj.310.6977.452 · Cited by 1,885 · see citing works
QUANTITATIVE METHODS IN THE REVIEW OF EPIDEMIOLOGIC LITERATURE1
GREENLAND, S. (1987) · Epidemiologic Reviews · doi:10.1093/oxfordjournals.epirev.a036298 · Cited by 1,644 · see citing works
Review papers : The statistical basis of meta-analysis
Fleiss, J. (1993) · Statistical Methods in Medical Research · doi:10.1177/096228029300200202 · Cited by 1,284 · see citing works
Meta-Analysis in Clinical Research
L'ABBÉ, K. A., DETSKY, A. S., & O'ROURKE, K. (1987) · Annals of Internal Medicine · doi:10.7326/0003-4819-107-2-224 · Cited by 1,267 · see citing works
Systematic Review: Why sources of heterogeneity in meta-analysis should be investigated
Thompson, S. G. (1994) · BMJ · doi:10.1136/bmj.309.6965.1351 · Cited by 1,017 · see citing works
Self-citationHow Many Iterations in the Gibbs Sampler?
Raftery, A. E., & Lewis, S. (1991) · doi:10.21236/ada640705 · Cited by 948 · see citing works
Confidence intervals for the number needed to treat.
Altman, D. G. (1998) · BMJ · doi:10.1136/bmj.317.7168.1309 · Cited by 938 · see citing works
A random‐effects regression model for meta‐analysis
Berkey, C. S., Hoaglin, D. C., Mosteller, F. C., & Colditz, G. A. (1995) · Statistics in Medicine · doi:10.1002/sim.4780140406 · Cited by 882 · see citing works
Uses of ecologic analysis in epidemiologic research.
Morgenstern, H. (1982) · American Journal of Public Health · doi:10.2105/ajph.72.12.1336 · Cited by 795 · see citing works
A Language and Program for Complex Bayesian Modelling
Gilks, W., Thomas, A., & Spiegelhalter, D. (1994) · Journal of the Royal Statistical Society Series D (The Statistician) · doi:10.2307/2348941 · Cited by 760 · see citing works
Self-citationA general parametric approach to the meta‐analysis of randomized clinical trials
Whitehead, A., & Whitehead, J. (1991) · Statistics in Medicine · doi:10.1002/sim.4780101105 · Cited by 750 · see citing works
Bayesian approaches to randomized trials
Spiegelhalter, D. J., Freedman, L. S., & Parmar, M. K. B. (1994) · Journal of the Royal Statistical Society. Series A (Statistics in Society) · doi:10.2307/2983527 · Cited by 720 · see citing works
Self-citationSumming up evidence: one answer is not always enough
Lau, J., Ioannidis, J. P. A., & Schmid, C. H. (1998) · The Lancet · doi:10.1016/s0140-6736(97)08468-7 · Cited by 646 · see citing works
Moore, R. A., Gavaghan, D. J., Tramèr, M. R., Collins, S., & McQuay, J. H. (1998) · Pain · doi:10.1016/s0304-3959(98)00140-7 · Cited by 607 · see citing works
Bayesian approaches to random-effects meta-analysis: a comparative study
Smith, T. C., Spiegelhalter, D. J., & Thomas, A. (1995) · Statistics in Medicine · doi:10.1002/sim.4780142408 · Cited by 568 · see citing works
Self-citationBORROWING STRENGTH FROM EXTERNAL TRIALS IN A META-ANALYSIS
Higgins, J. P. T., & WHITEHEAD, A. (1996) · Statistics in Medicine · doi:10.1002/(sici)1097-0258(19961230)15:24 · Cited by 553 · see citing works
Cholesterol lowering and mortality: the importance of considering initial level of risk.
Smith, G., Song, F., & Sheldon, T. (1993) · British medical journal · doi:10.1136/bmj.306.6889.1367 · Cited by 447 · see citing works
How many Iterations in the Gibbs Sampler?
Raftery, A. E., & Lewis, S. M. (1992) · doi:10.1093/oso/9780198522669.003.0053 · Cited by 345 · see citing works
A bivariate approach to meta-analysis
Van Houwelingen, H. C., Zwinderman, K. H., & Stijnen, T. (1993) · Statistics in Medicine · doi:10.1002/sim.4780122405 · Cited by 327 · see citing works
Sterne, J., Bradburn, M., & Egger, M. (2008) · doi:10.1002/9780470693926.ch18 · Cited by 319 · see citing works
Systematic reviews of trials and other studies.
Sutton, A. J., Abrams, K. R., Jones, D. R., Sheldon, T., & Сонг (1998) · Health Technology Assessment · doi:10.3310/hta2190 · Cited by 268 · see citing works
Investigating underlying risk as a source of heterogeneity in meta-analysis
Thompson, S. G., Smith, T. C., & Sharp, S. J. (1997) · Statistics in Medicine · doi:10.1002/(sici)1097-0258(19971215)16:23 · Cited by 227 · see citing works
Self-citationInterval estimation for Cohen's kappa as a measure of agreement
Blackman, N. J., & Koval, J. J. (2000) · Statistics in Medicine · doi:10.1002/(sici)1097-0258(20000315)19:5 · Cited by 219 · see citing works
Evidence-based medicine: an incomplete method for informing treatment choices
Maynard, A. (1997) · The Lancet · doi:10.1016/s0140-6736(96)05153-7 · Cited by 213 · see citing works
Schmid, C. H., Lau, J., McIntosh, M. W., & Cappelleri, J. C. (1998) · Statistics in Medicine · doi:10.1002/(sici)1097-0258(19980915)17:17 · Cited by 210 · see citing works
Reference Bayesian Methods for Generalized Linear Mixed Models
Natarajan, R., & Kass, R. E. (2000) · Journal of the American Statistical Association · doi:10.1080/01621459.2000.10473916 · Cited by 209 · see citing works
A Single Series from the Gibbs Sampler Provides a False Sense of Security
Gelman, A., & Rubin, D. B. (1992) · doi:10.1093/oso/9780198522669.003.0038 · Cited by 204 · see citing works
Sharp, S. J. (1998) · Stata technical bulletin · Cited by 197 · see citing works
Effect Measures for Meta‒Analysis of Trials with Binary Outcomes
Deeks, J. J., & Altman, D. G. (2001) · doi:10.1002/9780470693926.ch16 · Cited by 176 · see citing works
The relation between treatment benefit and underlying risk in meta-analysis
Sharp, S. J., Thompson, S. G., & Altman, D. G. (1996) · BMJ · doi:10.1136/bmj.313.7059.735 · Cited by 172 · see citing works
Self-citationMeta‐analysis for 2 × 2 tables: A bayesian approach
Carlin, J. B. (1992) · Statistics in Medicine · doi:10.1002/sim.4780110202 · Cited by 164 · see citing works
A prior for the variance in hierarchical models
Daniels, M. J. (1999) · Canadian Journal of Statistics · doi:10.2307/3316112 · Cited by 157 · see citing works
Who benefits from medical interventions?
Smith, G. D., & Egger, M. (1994) · BMJ · doi:10.1136/bmj.308.6921.72 · Cited by 128 · see citing works
Number Needed to Treat: Properties and Problems
Hutton, J. L. (2000) · Journal of the Royal Statistical Society Series A (Statistics in Society) · doi:10.1111/1467-985x.00175 · Cited by 112 · see citing works
AN ALTERNATIVE TO THE USE OF TWO-SIDED TESTS IN CLINICAL TRIALS
Dunnett, C. W., & Gent, M. (1996) · Statistics in Medicine · doi:10.1002/(sici)1097-0258(19960830)15:16 · Cited by 110 · see citing works
Senn, S. J., & Brand, R. (1994) · Statistics in Medicine · doi:10.1002/sim.4780130310 · Cited by 91 · see citing works
Variation in baseline risk as an explanation of heterogeneity in meta-analysis
Walter, S. D. (1997) · Statistics in Medicine · doi:10.1002/(sici)1097-0258(19971230)16:24 · Cited by 80 · see citing works
Systematic reviews of trials and other studies.
Sutton, A. J., Abrams, K. R., Jones, D. R. H., Sheldon, T., & Song, F. (1998) · PubMed · Cited by 79 · see citing works
Lee, W. (1997) · Statistics in Medicine · doi:10.1002/(sici)1097-0258(19970415)16:7 · Cited by 74 · see citing works
Brand, R., & Kragt, H. (1992) · Statistics in Medicine · doi:10.1002/sim.4780111605 · Cited by 64 · see citing works
Statistical Analysis of Medical Data: New Developments
MTW, Everitt, B. J., & Dunn, G. D. (2000) · Journal of the American Statistical Association · doi:10.2307/2669588 · Cited by 48 · see citing works
Exploring Heterogeneity in Randomized Trials Via Meta-Analysis
Schmid, C. H. (1999) · Drug Information Journal · doi:10.1177/009286159903300124 · Cited by 36 · see citing works
Hauschke (1999) · doi:10.1002/(sici)1097-0258(19990115)18:1
Explaining heterogeneity in meta-analysis: a comparison of methods
Thompson, S. G., & Sharp, S. J. (1999) · Statistics in Medicine · doi:10.1002/(sici)1097-0258(19991030)18:20
Self-citation
Flagged first, then by citations
1 of the 49 references couldn’t be matched to a known paper.
Cited by
Sorted by citations
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000100 · Cited by 28,164 · see citing works
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gotzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · BMJ · doi:10.1136/bmj.b2700 · Cited by 17,648 · see citing works
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2009.06.006 · Cited by 10,578 · see citing works
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · Annals of Internal Medicine · doi:10.7326/0003-4819-151-4-200908180-00136 · Cited by 10,349 · see citing works
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · Italian Journal of Public Health · doi:10.2427/5768 · Cited by 3,374 · see citing works
A Re-Evaluation of Random-Effects Meta-Analysis
Higgins, J. P. T., Thompson, S. G., & Spiegelhalter, D. J. (2009) · Journal of the Royal Statistical Society Series A: Statistics in Society · doi:10.1111/j.1467-985x.2008.00552.x · Cited by 2,569 · see citing works
“For example, when 2×2 contingency tables are available for binary outcomes, metaanalyses are appropriately performed by using binomial likelihoods (Smith et al., 1995; Warn et al., 2002).”
MethodSelf-citationCombination of direct and indirect evidence in mixed treatment comparisons
Lu, G., & Ades, A. E. (2004) · Statistics in Medicine · doi:10.1002/sim.1875 · Cited by 2,149 · see citing works
Chang, S.-H., Stoll, C. R. T., Song, J., Varela, J. E., Eagon, C. J., & Colditz, G. A. (2014) · JAMA Surgery · doi:10.1001/jamasurg.2013.3654 · Cited by 1,688 · see citing works
Bayesian Approaches to Clinical Trials and Health‐Care Evaluation
Spiegelhalter, D. J., Abrams, K. R., & Myles, J. P. (2003) · Wiley eBooks · doi:10.1002/0470092602 · Cited by 1,675 · see citing works
Self-citationBriel, M., Meade, M., Mercat, A., Brower, R. G., Talmor, D., Walter, S. D., Slutsky, A. S., Pullenayegum, E., Zhou, Q., Cook, D., et al. (2010) · JAMA · doi:10.1001/jama.2010.218 · Cited by 1,467 · see citing works
Dias, S., Sutton, A. J., Ades, A. E., & Welton, N. J. (2013) · Medical Decision Making · doi:10.1177/0272989x12458724 · Cited by 1,207 · see citing works
Metan: fixed- and random-effects meta-analysis
Harris, R. J., Deeks, J. J., Altman, D. G., Bradburn, M. J., Harbord, R. M., & Sterne, J. A. C. (2008) · The Stata Journal: Promoting communications on statistics and Stata · doi:10.1177/1536867x0800800102 · Cited by 1,027 · see citing works
Arbyn, M., Kyrgiou, M., Simoens, C., Raifu, A. O., Koliopoulos, G., Martin-Hirsch, P., Prendiville, W., & Paraskevaidis, E. (2008) · BMJ · doi:10.1136/bmj.a1284 · Cited by 694 · see citing works
Assessing Evidence Inconsistency in Mixed Treatment Comparisons
Lu, G., & Ades, A. E. (2006) · Journal of the American Statistical Association · doi:10.1198/016214505000001302 · Cited by 756 · see citing works
Recent developments in meta‐analysis
Sutton, A. J., & Higgins, J. P. T. (2007) · Statistics in Medicine · doi:10.1002/sim.2934 · Cited by 583 · see citing works
Dias, S., Welton, N. J., Sutton, A. J., & Ades, A. E. (2011) · Bristol Research (University of Bristol) · Cited by 558 · see citing works
Is This Patient Dead, Vegetative, or Severely Neurologically Impaired?
Booth, C. M., Boone, R. H., TOMLINSON, G. A., & Detsky, A. S. (2004) · JAMA · doi:10.1001/jama.291.7.870 · Cited by 504 · see citing works
Random-Effects Meta-analysis of Inconsistent Effects: A Time for Change
Cornell, J. E., Mulrow, C. D., Localio, R., Stack, C. B., Meibohm, A. R., Guallar, E., & Goodman, S. N. (2014) · Annals of Internal Medicine · doi:10.7326/m13-2886 · Cited by 453 · see citing works
Bangalore, S., Kumar, S., Lobach, I., & Messerli, F. H. (2011) · Circulation · doi:10.1161/circulationaha.110.016337 · Cited by 437 · see citing works
Percutaneous Coronary Intervention Versus Conservative Therapy in Nonacute Coronary Artery Disease
Katritsis, D. G., & Ioannidis, J. P. A. (2005) · Circulation · doi:10.1161/circulationaha.104.521864 · Cited by 427 · see citing works
Effects of lifestyle modification on metabolic syndrome: a systematic review and meta-analysis
Yamaoka, K., & Tango, T. (2012) · BMC Medicine · doi:10.1186/1741-7015-10-138 · Cited by 409 · see citing works
Summarizing historical information on controls in clinical trials
Neuenschwander, B. E., Capkun-Niggli, G., Branson, M., & Spiegelhalter, D. J. (2010) · Clinical Trials · doi:10.1177/1740774509356002 · Cited by 398 · see citing works
Self-citationPeter, J. V., Moran, J. L., Phillips-Hughes, J., Graham, P. L., & Bersten, A. D. (2006) · The Lancet · doi:10.1016/s0140-6736(06)68506-1 · Cited by 395 · see citing works
Peter, J. V., John, P., Graham, P. L., Moran, J. L., George, I. A., & Bersten, A. D. (2008) · BMJ · doi:10.1136/bmj.39537.939039.be · Cited by 351 · see citing works
Meta-analysis of proportions using generalized linear mixed models.
Lin, L., & Chu, H. (2020) · Epidemiology · doi:10.1097/ede.0000000000001232 · Cited by 345 · see citing works
Arcsine‐based transformations for meta‐analysis of proportions: Pros, cons, and alternatives
Lin, L., & Xu, C. (2020) · Health Science Reports · doi:10.1002/hsr2.178 · Cited by 350 · see citing works
Bias caused by sampling error in meta-analysis with small sample sizes
Lin, L. (2018) · PLoS ONE · doi:10.1371/journal.pone.0204056 · Cited by 338 · see citing works
BUGSnet: an R package to facilitate the conduct and reporting of Bayesian network Meta-analyses
Béliveau, A., Boyne, D. J., Slater, J., Brenner, D. R., & Arora, P. (2019) · BMC Medical Research Methodology · doi:10.1186/s12874-019-0829-2 · Cited by 319 · see citing works
Belleville, S., Fouquet, C., Hudon, C., Zomahoun, H. T. V., & Croteau, J. (2017) · Neuropsychology Review · doi:10.1007/s11065-017-9361-5 · Cited by 308 · see citing works
Nikolakopoulou, A., White, I. R., & Salanti, G. (2020) · Chapman & Hall/CRC eBooks · doi:10.1201/9781315119403-10 · Cited by 307 · see citing works
Expected Value of Sample Information Calculations in Medical Decision Modeling
Ades, A. E., Lu, G., & Claxton, K. (2004) · Medical Decision Making · doi:10.1177/0272989x04263162 · Cited by 364 · see citing works
Yu, T., Lin, Y., Zhang, Y., Yang, J., Zhang, Y., Liu, H., & Zhang, B. (2009) · BMC Medical Genetics · doi:10.1186/1471-2350-10-15 · Cited by 261 · see citing works
Rücker, G., Schwarzer, G., Carpenter, J. R., & Olkin, I. (2008) · Statistics in Medicine · doi:10.1002/sim.3511 · Cited by 252 · see citing works
Bayesian statistics in medicine: a 25 year review
Ashby, D. (2006) · Statistics in Medicine · doi:10.1002/sim.2672 · Cited by 233 · see citing works
Gagnier, J. J., Moher, D., Boon, H., Beyene, J., & Bombardier, C. (2012) · BMC Medical Research Methodology · doi:10.1186/1471-2288-12-111 · Cited by 222 · see citing works
Lehmann, D. J., Cortina-Borja, M., Warden, D. R., Smith, A. D., Sleegers, K., Prince, J. A., van Duijn, C. M., & Kehoe, P. G. (2005) · American Journal of Epidemiology · doi:10.1093/aje/kwi202 · Cited by 199 · see citing works
Bayesian Meta-analysis of Hormone Therapy and Mortality in Younger Postmenopausal Women
Salpeter, S. R., Cheng, J., Thabane, L., Buckley, N. S., & Salpeter, E. E. (2009) · The American Journal of Medicine · doi:10.1016/j.amjmed.2009.05.021 · Cited by 201 · see citing works
Modeling between-trial variance structure in mixed treatment comparisons
Lu, G., & Ades, A. E. (2009) · Biostatistics · doi:10.1093/biostatistics/kxp032 · Cited by 196 · see citing works
Huynh, T. T., Perron, S., O’Loughlin, J. L., Joseph, L., Labrecque, M., Tu, J. V., & Théroux, P. (2009) · Circulation · doi:10.1161/circulationaha.108.793745 · Cited by 184 · see citing works
Khan, T. A., Shah, T., Prieto‐Merino, D., Zhang, W., Price, J. F., Fowkes, G. R., Cooper, J. A., Talmud, P. J., Humphries, S. E., Sundström, J., et al. (2013) · International Journal of Epidemiology · doi:10.1093/ije/dyt034 · Cited by 175 · see citing works
Voter overrepresentation, vote misreporting, and turnout bias in postelection surveys
Selb, P., & Munzert, S. (2012) · Electoral Studies · doi:10.1016/j.electstud.2012.11.004 · Cited by 169 · see citing works
Effect of Statins on Kidney Disease Outcomes: A Systematic Review and Meta-analysis
Su, X., Zhang, L., Lv, J., Wang, J., Hou, W., Xie, X., & Zhang, H. (2016) · American Journal of Kidney Diseases · doi:10.1053/j.ajkd.2016.01.016 · Cited by 164 · see citing works
Stone, G. W., Martin, J. L., de Boer, M., Margheri, M., Bramucci, E., Blankenship, J. C., Metzger, D. C., Gibbons, R. J., Lindsay, B., Weiner, B. H., et al. (2009) · Circulation Cardiovascular Interventions · doi:10.1161/circinterventions.108.840066 · Cited by 160 · see citing works
Bayesian inference for categorical data analysis
Agresti, A., & Hitchcock, D. B. (2005) · Stat. Methods Appl. · doi:10.1007/s10260-005-0121-y · Cited by 174 · see citing works
Aiolfi, A., Cavalli, M., Micheletto, G., Lombardo, F., Bonitta, G., Morlacchi, A., Bruni, P. G., Campanelli, G., & Bona, D. (2019) · Hernia · doi:10.1007/s10029-019-01964-2 · Cited by 160 · see citing works
Multiparameter Evidence Synthesis in Epidemiology and Medical Decision-Making: Current Approaches
Ades, A. E., & Sutton, A. J. (2005) · Journal of the Royal Statistical Society Series A (Statistics in Society) · doi:10.1111/j.1467-985x.2005.00377.x · Cited by 159 · see citing works
Chang, S., Freeman, N. L. B., Lee, J. A., Stoll, C. R. T., Calhoun, A. J., Eagon, J. C., & Colditz, G. A. (2017) · Obesity Reviews · doi:10.1111/obr.12647 · Cited by 146 · see citing works
Meta-analysis of rare and adverse event data
Sutton, A. J., Cooper, N. J., Lambert, P. C., Jones, D. R., Abrams, K. R., & Sweeting, M. J. (2002) · Expert Review of Pharmacoeconomics & Outcomes Research · doi:10.1586/14737167.2.4.367 · Cited by 141 · see citing works
Kalil, A. C., Johnson, D. W., Lisco, S. J., & Sun, J. (2017) · Critical Care Medicine · doi:10.1097/ccm.0000000000002235 · Cited by 138 · see citing works
Pandor, A., Goodacre, S. W., Harnan, S., Holmes, M., Pickering, A., Fitzgerald, P., Rees, A., & Stevenson, M. (2011) · Health Technology Assessment · doi:10.3310/hta15270 · Cited by 134 · see citing works
A proposed framework to guide evidence synthesis practice for meta-analysis with zero-events studies
Xu, C., Furuya-Kanamori, L., Zorzela, L., Lin, L., & Vohra, S. (2021) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2021.02.012 · Cited by 117 · see citing works
Ades, A. E. (2003) · Statistics in Medicine · doi:10.1002/sim.1566 · Cited by 128 · see citing works
Perkins, Z., Yet, B., Glasgow, S., Cole, E. M., Marsh, W., Brohi, K., Rasmussen, T. E., & Tai, N. R. M. (2015) · British journal of surgery · doi:10.1002/bjs.9689 · Cited by 127 · see citing works
Filion, K. B., Khoury, F. E., Bielinski, M., Schiller, I., Dendukuri, N., & Brophy, J. M. (2010) · BMC Cardiovascular Disorders · doi:10.1186/1471-2261-10-24 · Cited by 124 · see citing works
Agresti, A., & Min, Y. (2005) · Biometrics · doi:10.1111/j.1541-0420.2005.031228.x · Cited by 121 · see citing works
Shuster, J. J., Jones, L. S., & Salmon, D. A. (2007) · Statistics in Medicine · doi:10.1002/sim.3060 · Cited by 105 · see citing works
Graham, P. L., & Moran, J. L. (2012) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2011.09.012 · Cited by 105 · see citing works
Moran, J. L., Graham, P. L., Rockliff, S., & Bersten, A. D. (2010) · Critical Care · doi:10.1186/cc9182 · Cited by 105 · see citing works
Crichton, J., Naidoo, K., Yet, B., Brundage, S. I., & Perkins, Z. (2017) · The Journal of Trauma: Injury, Infection, and Critical Care · doi:10.1097/ta.0000000000001649 · Cited by 101 · see citing works
Schwenk, G., & Möser, G. (2008) · Quality & Quantity · doi:10.1007/s11135-007-9162-7 · Cited by 100 · see citing works
Multilevel models for meta-analysis, and their application to absolute risk differences
Thompson, S. G., Turner, R., & Warn, D. E. (2001) · Statistical Methods in Medical Research · doi:10.1177/096228020101000602 · Cited by 99 · see citing works
Self-citationAoyama, H., Uchida, K., Aoyama, K., Pechlivanoglou, P., Englesakis, M. F., Yamada, Y., & Fan, E. (2019) · JAMA Network Open · doi:10.1001/jamanetworkopen.2019.8116 · Cited by 96 · see citing works
Multilevel Models for Meta-Analysis
Hox, J. J. (2003) · Psychology Press eBooks · doi:10.4324/9781410606747-9 · Cited by 98 · see citing works
Paul, M., Riebler, A., Bachmann, L. M., Rue, H., & Held, L. (2010) · Statistics in Medicine · doi:10.1002/sim.3858 · Cited by 98 · see citing works
Frost, S. A., Alogso, M.-C., Metcalfe, L., Lynch, J. M., Hunt, L., Sanghavi, R., Alexandrou, E., & Hillman, K. (2016) · Critical Care · doi:10.1186/s13054-016-1553-5 · Cited by 97 · see citing works
Su, X., Xie, X., Liu, L., Lv, J., Song, F., Perkovic, V., & Zhang, H. (2016) · American Journal of Kidney Diseases · doi:10.1053/j.ajkd.2016.07.033 · Cited by 95 · see citing works
Jiyong, J., Tiancha, H., Huiqin, W., & Jingfen, J. (2012) · Clinical Nutrition · doi:10.1016/j.clnu.2012.07.002 · Cited by 91 · see citing works
Heterogeneity in meta-analysis: a comprehensive overview
Stogiannis, D., Siannis, F., & Androulakis, E. (2023) · The International Journal of Biostatistics · doi:10.1515/ijb-2022-0070 · Cited by 92 · see citing works
Anti-Hip Fracture Efficacy of Bisphosphonates: A Bayesian Analysis of Clinical Trials
Nguyen, N. D., Eisman, J. A., & Nguyen, T. V. (2006) · Journal of Bone and Mineral Research · doi:10.1359/jbmr.050903 · Cited by 90 · see citing works
Aiolfi, A., Cavalli, M., Ferraro, S. D., Manfredini, L., Bonitta, G., Bruni, P. G., Bona, D., & Campanelli, G. (2021) · PubMed · doi:10.1097/sla.0000000000004735 · Cited by 89 · see citing works
Tinmouth, A. T., Tannock, I. F., Crump, M., TOMLINSON, G. A., Brandwein, J. M., Minden, M. D., & Sutton, D. (2004) · Transfusion · doi:10.1111/j.0041-1132.2004.04118.x · Cited by 86 · see citing works
Hohl, C. M., Sadatsafavi, M., Nosyk, B., & Anis, A. H. (2008) · Academic Emergency Medicine · doi:10.1111/j.1553-2712.2007.00022.x · Cited by 85 · see citing works
Weng, Q., Goh, S.-L., Wu, J., Persson, M. S. M., Wei, J., Sarmanova, A., Li, X., Hall, M., Doherty, M., Jiang, T., et al. (2023) · British Journal of Sports Medicine · doi:10.1136/bjsports-2022-105898 · Cited by 84 · see citing works
Pitfalls of using the risk ratio in meta‐analysis
Bakbergenuly, I., Hoaglin, D. C., & Kulinskaya, E. (2019) · Research Synthesis Methods · doi:10.1002/jrsm.1347 · Cited by 84 · see citing works
Zeng, C., Doherty, M., Persson, M. S. M., Yang, Z., Sarmanova, A., Zhang, Y., Wei, J., Kaur, J., Li, X., Lei, G., et al. (2021) · Osteoarthritis and Cartilage · doi:10.1016/j.joca.2021.06.004 · Cited by 84 · see citing works
Chu, H., Nie, L., Chen, Y., Huang, Y., & Sun, W. (2010) · Statistical Methods in Medical Research · doi:10.1177/0962280210393712 · Cited by 78 · see citing works
Schmitz, S., Adams, R., Walsh, C., Barry, M. G., & FitzGerald, O. (2011) · Annals of the Rheumatic Diseases · doi:10.1136/annrheumdis-2011-200228 · Cited by 76 · see citing works
Do antidepressants cause suicidality in children? A Bayesian meta-analysis
Kaizar, E. E., Greenhouse, J. B., Seltman, H. J., & Kelleher, K. J. (2006) · Clinical Trials · doi:10.1191/1740774506cn139oa · Cited by 76 · see citing works
Bayesian estimation in random effects meta‐analysis using a non‐informative prior
Bodnar, O., Link, A., Arendacká, B., Possolo, A., & Elster, C. (2017) · Statistics in Medicine · doi:10.1002/sim.7156 · Cited by 73 · see citing works
Medical treatments for idiopathic pulmonary fibrosis: a systematic review and network meta-analysis
Pitre, T., Mah, J. C., Helmeczi, W., Khalid, M. F., Cui, S., Zhang, M., Husnudinov, R., Su, J. S., Banfield, L. E., Guy, B., et al. (2022) · Thorax · doi:10.1136/thoraxjnl-2021-217976 · Cited by 68 · see citing works
Aiolfi, A., Gagner, M., Zappa, M. A., Lastraioli, C., Lombardo, F., Panizzo, V., Bonitta, G., Cavalli, M., Campanelli, G., & Bona, D. (2022) · Obesity Surgery · doi:10.1007/s11695-022-05950-z · Cited by 69 · see citing works
Bagos, P. G., & Nikolopoulos, G. K. (2009) · The International Journal of Biostatistics · doi:10.2202/1557-4679.1168 · Cited by 68 · see citing works
Empirical evidence about inconsistency among studies in a pair‐wise meta‐analysis
Rhodes, K. M., Turner, R., & Higgins, J. P. T. (2015) · Research Synthesis Methods · doi:10.1002/jrsm.1193 · Cited by 66 · see citing works
Aiolfi, A., Tornese, S., Bonitta, G., Rausa, E., Micheletto, G., & Bona, D. (2019) · Surgery for Obesity and Related Diseases · doi:10.1016/j.soard.2019.03.006 · Cited by 63 · see citing works
Panaccione, R., Collins, E. B., MELMED, G. Y., Vermeire, S., Danese, S., Higgins, P., Kwon, C. S., Zhou, W., Ilo, D., Sharma, D., et al. (2023) · Crohn s & Colitis 360 · doi:10.1093/crocol/otad009 · Cited by 63 · see citing works
gemtc: Network Meta-Analysis Using Bayesian Methods
van Valkenhoef, G., & Kuiper, J. (2012) · doi:10.32614/cran.package.gemtc · Cited by 64 · see citing works
Carless, P. A., Moxey, A. J., Stokes, B., & Henry, D. A. (2005) · BMC Cardiovascular Disorders · doi:10.1186/1471-2261-5-19 · Cited by 62 · see citing works
Bangalore, S., Kumar, S., Volodarskiy, A., & Messerli, F. H. (2012) · Heart · doi:10.1136/heartjnl-2012-301968 · Cited by 60 · see citing works
Welton, N. J., Cooper, N. J., Ades, A. E., Lu, G., & Sutton, A. J. (2008) · Statistics in Medicine · doi:10.1002/sim.3377 · Cited by 60 · see citing works
Seow, W., Dudi-Venkata, N. N., Bedrikovetski, S., Kroon, H. M., & Sammour, T. (2022) · Techniques in Coloproctology · doi:10.1007/s10151-022-02739-1 · Cited by 57 · see citing works
A Bayesian approach to evaluating net clinical benefit allowed for parameter uncertainty
Sutton, A. J., Cooper, N. J., Abrams, K. R., Lambert, P. C., & Jones, D. R. (2005) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2004.03.015 · Cited by 55 · see citing works
Sarıkaya, H., da Costa, B. R., Baumgartner, R. W., Duclos, K., Touzé, E., de Bray, J. M., Metso, A. J., Metso, T. M., Arnold, M., Araúz, A., et al. (2013) · PLoS ONE · doi:10.1371/journal.pone.0072697 · Cited by 53 · see citing works
Cooper, N. J., Sutton, A. J., & Abrams, K. R. (2002) · Statistical Methods in Medical Research · doi:10.1191/0962280202sm306ra · Cited by 52 · see citing works
Graphical augmentations to sample‐size‐based funnel plot in meta‐analysis
Lin, L. (2019) · Research Synthesis Methods · doi:10.1002/jrsm.1340 · Cited by 50 · see citing works
Ryan, O. K., Ryan, É. J., Creavin, B., Rausa, E., Kelly, M. E., Petrelli, F., Bonitta, G., Kennelly, R. P., Hanly, A. M., Martin, S., et al. (2020) · European Journal of Surgical Oncology · doi:10.1016/j.ejso.2020.06.037 · Cited by 49 · see citing works
Aiolfi, A., Lombardo, F., Matsushima, K., Sozzi, A., Cavalli, M., Panizzo, V., Bonitta, G., & Bona, D. (2021) · Surgery · doi:10.1016/j.surg.2021.04.014 · Cited by 47 · see citing works
Logman, J., Stephens, J., Heeg, B. M. S., Haider, S., Cappelleri, J. C., Nathwani, D., Tice, A. D., & van Hout, B. A. (2010) · Current Medical Research and Opinion · doi:10.1185/03007995.2010.481251 · Cited by 46 · see citing works
Response rates to pegylated interferon and ribavirin in HCV/HIV coinfection: a research synthesis
Shire, N. J., Welge, J. A., & Sherman, K. E. (2006) · Journal of Viral Hepatitis · doi:10.1111/j.1365-2893.2006.00824.x · Cited by 46 · see citing works
Dakin, H., Fidler, C., & Harper, C. (2010) · Value in Health · doi:10.1111/j.1524-4733.2010.00777.x · Cited by 43 · see citing works
Aiolfi, A., Bona, D., Riva, C. G., Micheletto, G., Rausa, E., Campanelli, G., Olmo, G., Bonitta, G., & Bonavina, L. (2019) · Journal of Laparoendoscopic & Advanced Surgical Techniques · doi:10.1089/lap.2019.0432 · Cited by 46 · see citing works
- Authors
- Warn, D. E., Thompson, S. G., & Spiegelhalter, D. J.
- Affiliations
- MRC Biostatistics Unit (GB)
- Corresponding author
- Warn, D. E.
- Venue
- Statistics in Medicine
- Publisher
- Wiley
- Published
- 2002-05-21
- Volume
- 21
- Issue
- 11
- Pages
- 1601-1623
- ISSN
- 0277-6715 (ISSN-L)
- 1097-0258
- OpenAlex
- W2143109076
- Cited by
- 277
- References
- 49
- Citations by year
- 2026: 5 · 2025: 10 · 2024: 6 · 2023: 12 · 2022: 11 · 2021: 12 · 2020: 14 · 2019: 19 · 2018: 12 · 2017: 13 · 2016: 12 · 2015: 13 · 2014: 11 · 2013: 12 · 2012: 25
- FWCI
- 13.37
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Statistics in Medicine (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Keywords
- binary outcomes, risk difference, relative risk, binomial distribution, ibuprofen, postoperative pain, odds ratio interpretation, small trials
- MeSH terms
- Anti-Inflammatory Agents, Non-Steroidal, Bayes Theorem, Clinical Trials as Topic, Humans, Ibuprofen, Pain, Risk, Meta-Analysis as Topic
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review