Cited by 838Meta-analysis and systematic reviewsDelphi Technique in ResearchStatistical Methods in Epidemiology

The DOI matches its Crossref record; 23 of the 24 references it cites were found in a registry or an index.

Predicting the extent of heterogeneity in meta-analysis, using empirical data from the Cochrane Database of Systematic Reviews

Open access

Turner, Rebecca M, Davey, Jonathan, Clarke, Mike J, Thompson, Simon G, Higgins, Julian PT·2012·International Journal of Epidemiology

DOI 10.1093/ije/dys041PMC PMC3396310

Open this paper in CoChat — free account Open PDF

Abstract

BACKGROUND: Many meta-analyses contain only a small number of studies, which makes it difficult to estimate the extent of between-study heterogeneity. Bayesian meta-analysis allows incorporation of external evidence on heterogeneity, and offers advantages over conventional random-effects meta-analysis. To assist in this, we provide empirical evidence on the likely extent of heterogeneity in particular areas of health care. METHODS: Our analyses included 14 886 meta-analyses from the Cochrane Database of Systematic Reviews. We classified each meta-analysis according to the type of outcome, type of intervention comparison and medical specialty. By modelling the study data from all meta-analyses simultaneously, using the log odds ratio scale, we investigated the impact of meta-analysis characteristics on the underlying between-study heterogeneity variance. Predictive distributions were obtained for the heterogeneity expected in future meta-analyses. RESULTS: Between-study heterogeneity variances for meta-analyses in which the outcome was all-cause mortality were found to be on average 17% (95% CI 10-26) of variances for other outcomes. In meta-analyses comparing two active pharmacological interventions, heterogeneity was on average 75% (95% CI 58-95) of variances for non-pharmacological interventions. Meta-analysis size was found to have only a small effect on heterogeneity. Predictive distributions are presented for nine different settings, defined by type of outcome and type of intervention comparison. For example, for a planned meta-analysis comparing a pharmacological intervention against placebo or control with a subjectively measured outcome, the predictive distribution for heterogeneity is a log-normal (-2.13, 1.58(2)) distribution, which has a median value of 0.12. In an example of meta-analysis of six studies, incorporating external evidence led to a smaller heterogeneity estimate and a narrower confidence interval for the combined intervention effect. CONCLUSIONS: Meta-analysis characteristics were strongly associated with the degree of between-study heterogeneity, and predictive distributions for heterogeneity differed substantially across settings. The informative priors provided will be very beneficial in future meta-analyses including few studies.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Integrity signals

Registry

Crossref · 10.1093/ije/dys041

Cites

23 of 23 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Meta-analysis in clinical trials
DerSimonian, R., & Laird, N. (1986) · Controlled Clinical Trials · doi:10.1016/0197-2456(86)90046-2 · Cited by 39,552
Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series
(2008) · doi:10.1002/9780470712184 · Cited by 25,048
Self-citation
WinBUGS - A Bayesian modelling framework: Concepts, structure, and extensibility
Lunn, D. J., Thomas, A., Best, N., & Spiegelhalter, D. J. (2000) · Statistics and Computing · doi:10.1023/a:1008929526011 · Cited by 5,397
Assessing Risk of Bias in Included Studies
Higgins, J. P., & Altman, D. G. (2008) · Cochrane Handbook for Systematic Reviews of Interventions · doi:10.1002/9780470712184.ch8 · Cited by 3,396
Self-citation
A Re-Evaluation of Random-Effects Meta-Analysis
Higgins, J. P. T., Thompson, S. G., & Spiegelhalter, D. J. (2009) · Journal of the Royal Statistical Society Series A: Statistics in Society · doi:10.1111/j.1467-985x.2008.00552.x · Cited by 2,569
Self-citation
Antidepressants for smoking cessation
Howes, S., Hartmann-Boyce, J., Livingstone-Banks, J., Hong, B., & Lindson, N. (2020) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000031.pub5 · Cited by 1,352
The Interpretation of Random-Effects Meta-Analysis in Decision Models
Ades, A. E., Lu, G., & Higgins, J. P. T. (2005) · Medical Decision Making · doi:10.1177/0272989x05282643 · Cited by 862
Self-citation
Bayesian methods in meta-analysis and evidence synthesis
Sutton, A. J., & Abrams, K. R. (2001) · Statistical Methods in Medical Research · doi:10.1177/096228020101000404 · Cited by 734
Antidepressants for smoking cessation
Hughes, J., Stead, L., & Lancaster, T. (2003) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000031 · Cited by 683
Bayesian approaches to random-effects meta-analysis: a comparative study
Smith, T. C., Spiegelhalter, D. J., & Thomas, A. (1995) · Statistics in Medicine · doi:10.1002/sim.4780142408 · Cited by 568

Flagged first, then by citations

Show all 24 references

1 of the 24 references couldn’t be matched to a known paper.

Research works printed but not linked: 2

Wood, 2006, The Epidemiology of Bias in Randomized (clinical) Controlled Trials: a Meta-epidemiological Study
Foundation for Health Services Research, Health Outcomes Research: A Primer

Sorted by citations

The PRISMA extension statement for reporting of systematic reviews incorporating network meta-analyses of health care interventions: checklist and explanations
Hutton, B., Salanti, G., Caldwell, D. M., Chaimani, A., Schmid, C. H., Cameron, C., Ioannidis, J. P. A., Straus, S., Thorlund, K., Jansen, J. P., et al. (2015) · Annals of Internal Medicine · doi:10.7326/m14-2385 · Cited by 8,269
Analysing data and undertaking meta‐analyses
Deeks, J. J., Higgins, J. P., Altman, D. G., & on behalf of the Cochrane Statistical Methods Group (2019) · Cochrane Handbook for Systematic Reviews of Interventions · doi:10.1002/9781119536604.ch10 · Cited by 2,672
Self-citation
CINeMA: an approach for assessing confidence in the results of a network meta-analysis
Nikolakopoulou, A., Higgins, J. P. T., Papakonstantinou, T., Chaimani, A., Del Giovane, C., Egger, M., & Salanti, G. (2020) · PLOS Medicine · doi:10.1371/journal.pmed.1003082 · Cited by 1,935
Self-citation
Analysing Data and Undertaking Meta‐Analyses
Deeks, J. J., Higgins, J. P., & Altman, D. G. (2008) · Cochrane Handbook for Systematic Reviews of Interventions · doi:10.1002/9780470712184.ch9 · Cited by 1,800
Self-citation
Methods to estimate the between‐study variance and its uncertainty in meta‐analysis
Veroniki, A. A., Jackson, D., Viechtbauer, W., Bender, R., Bowden, J., Knapp, G., Kuss, O., Higgins, J. P., Langan, D., & Salanti, G. (2016) · Research Synthesis Methods · doi:10.1002/jrsm.1164 · Cited by 1,685
Self-citation
Evaluating the quality of evidence from a network meta-analysis
Salanti, G., Del Giovane, C., Chaimani, A., Caldwell, D. M., & Higgins, J. P. T. (2014) · PLoS ONE · doi:10.1371/journal.pone.0099682 · Cited by 1,402
Self-citation
Comparative efficacy and tolerability of medications for attention-deficit hyperactivity disorder in children, adolescents, and adults: a systematic review and network meta-analysis
Cortese, S., Adamo, N., Del Giovane, C., Mohr-Jensen, C., Hayes, A. J., Carucci, S., Atkinson, L. Z., Tessari, L., Banaschewski, T., Coghill, D., et al. (2018) · The Lancet Psychiatry · doi:10.1016/s2215-0366(18)30269-4 · Cited by 1,402
The heterogeneity statistic I2 can be biased in small meta-analyses
von Hippel, P. T. (2015) · BMC Medical Research Methodology · doi:10.1186/s12874-015-0024-z · Cited by 1,229
Evidence Synthesis for Decision Making 2: A Generalized Linear Modeling Framework for Pairwise and Network Meta-analysis of Randomized Controlled Trials
Dias, S., Sutton, A. J., Ades, A. E., & Welton, N. J. (2013) · Medical Decision Making · doi:10.1177/0272989x12458724 · Cited by 1,207
Trial Sequential Analysis in systematic reviews with meta-analysis
Wetterslev, J., Jakobsen, J. C., & Gluud, C. N. (2017) · BMC Medical Research Methodology · doi:10.1186/s12874-017-0315-7 · Cited by 1,216
The Incidence and Prevalence of Thyroid Dysfunction in Europe: A Meta-Analysis
Garmendia Madariaga, A., Santos Palacios, S., Guillén-Grima, F., & Galofré, J. C. (2014) · The Journal of Clinical Endocrinology & Metabolism · doi:10.1210/jc.2013-2409 · Cited by 800
Automated generation of node‐splitting models for assessment of inconsistency in network meta‐analysis
van Valkenhoef, G., Dias, S., Ades, A. E., & Welton, N. J. (2015) · Research Synthesis Methods · doi:10.1002/jrsm.1167 · Cited by 699
Risk of serious infection in biological treatment of patients with rheumatoid arthritis: a systematic review and meta-analysis
Singh, J. A., Cameron, C. G., Noorbaloochi, S., Cullis, T., Tucker, M. D., Christensen, R., Ghogomu, E. T., Coyle, D., Clifford, T., Tugwell, P., et al. (2015) · The Lancet · doi:10.1016/s0140-6736(14)61704-9 · Cited by 624
Living Systematic Reviews: An Emerging Opportunity to Narrow the Evidence-Practice Gap
Elliott, J. H., Turner, T., Clavisi, O., Thomas, J., Higgins, J. P. T., Mavergames, C., & Gruen, R. L. (2014) · PLoS Medicine · doi:10.1371/journal.pmed.1001603 · Cited by 596
Self-citation
CINeMA: Software for semiautomated assessment of the confidence in the results of network meta‐analysis
Papakonstantinou, T., Nikolakopoulou, A., Higgins, J. P. T., Egger, M., & Salanti, G. (2020) · Campbell Systematic Reviews · doi:10.1002/cl2.1080 · Cited by 596
Self-citation
Comparative effectiveness of GLP-1 receptor agonists on glycaemic control, body weight, and lipid profile for type 2 diabetes: systematic review and network meta-analysis
Yao, H., Zhang, A., Li, D., Wu, Y., Wang, C.-Z., Wan, J.-Y., & Yuan, C.-S. (2024) · BMJ · doi:10.1136/bmj-2023-076410 · Cited by 558
Hartung-Knapp-Sidik-Jonkman approach and its modification for random-effects meta-analysis with few studies
Röver, C., Knapp, G., & Friede, T. (2015) · BMC Medical Research Methodology · doi:10.1186/s12874-015-0091-1 · Cited by 527
Systemic pharmacological treatments for chronic plaque psoriasis: a network meta-analysis
Sbidian, É., Chaimani, A., García-Doval, I., Do, G., Hua, C., Mazaud, C., Droitcourt, C., Hughes, C., Ingram, J. R., Naldi, L., et al. (2017) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd011535.pub2 · Cited by 527
Repetitive Transcranial Magnetic Stimulation for the Acute Treatment of Major Depressive Episodes: A Systematic Review With Network Meta-analysis
Brunoni, A. R., Chaimani, A., Moffa, A. H., Razza, L. B., Gattaz, W. F., Daskalakis, Z. J., & Carvalho, A. F. (2017) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2016.3644 · Cited by 520
A Re-Analysis of the Cochrane Library Data: The Dangers of Unobserved Heterogeneity in Meta-Analyses
Kontopantelis, E., Springate, D. A., & Reeves, D. (2013) · PLoS ONE · doi:10.1371/journal.pone.0069930 · Cited by 525
Robust meta‐analytic‐predictive priors in clinical trials with historical control information
Schmidli, H., Gsteiger, S., Roychoudhury, S., O’Hagan, A., Spiegelhalter, D. J., & Neuenschwander, B. E. (2014) · Biometrics · doi:10.1111/biom.12242 · Cited by 482
Evidence Synthesis for Decision Making 3
Dias, S., Sutton, A. J., Welton, N. J., & Ades, A. E. (2013) · Medical Decision Making · doi:10.1177/0272989x13485157 · Cited by 468
Comparison of dietary macronutrient patterns of 14 popular named dietary programmes for weight and cardiovascular risk factor reduction in adults: systematic review and network meta-analysis of randomised trials
Ge, L., Sadeghirad, B., Ball, G. D. C., da Costa, B. R., Hitchcock, C. L., Svendrovski, A., Kiflen, R., Quadri, K., Kwon, H. Y., Karamouzian, M., et al. (2020) · BMJ · doi:10.1136/bmj.m696 · Cited by 426
Comparison of Clinical Outcomes and Adverse Events Associated With Glucose-Lowering Drugs in Patients With Type 2 Diabetes
Palmer, S. C., Mavridis, D., Nicolucci, A., Johnson, D. W., Tonelli, M. A., Craig, J. C., Maggo, J. K., Gray, V., Berardis, G. D., Ruospo, M., et al. (2016) · JAMA · doi:10.1001/jama.2016.9400 · Cited by 435
Effect of omega-3 fatty acids on cardiovascular outcomes: A systematic review and meta-analysis
Khan, S. U., Lone, A. N., Khan, M. S., Virani, S. S., Blumenthal, R. S., Nasir, K., Miller, M., Michos, E. D., Ballantyne, C. M., Boden, W. E., et al. (2021) · eClinicalMedicine · doi:10.1016/j.eclinm.2021.100997 · Cited by 411
“We used I(2) statistics to measure the extent of unexplained statistical heterogeneity: I(2) greater than 50% was considered a high degree of betweenstudy statistical heterogeneity [16].”
Method
Predictive distributions for between‐study heterogeneity and simple methods for their application in Bayesian meta‐analysis
Turner, R. M., Jackson, D., Wei, Y., Thompson, S. G., & Higgins, J. P. T. (2015) · Statistics in Medicine · doi:10.1002/sim.6381 · Cited by 410
Self-citation
Characteristics of meta-analyses and their component studies in the Cochrane Database of Systematic Reviews: a cross-sectional, descriptive analysis
Davey, J., Turner, R. M., Clarke, M. J., & Higgins, J. P. (2011) · BMC Medical Research Methodology · doi:10.1186/1471-2288-11-160 · Cited by 404
Self-citation
Predictive distributions were developed for the extent of heterogeneity in meta-analyses of continuous outcome data
Rhodes, K. M., Turner, R., & Higgins, J. P. T. (2014) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2014.08.012 · Cited by 398
Self-citation
Comparative efficacy and safety of blood pressure-lowering agents in adults with diabetes and kidney disease: a network meta-analysis
Palmer, S. C., Mavridis, D., Navarese, E., Craig, J. C., Tonelli, M., Salanti, G., Wiebe, N., Ruospo, M., Wheeler, D. C., & Strippoli, G. F. M. (2015) · The Lancet · doi:10.1016/s0140-6736(14)62459-4 · Cited by 395
Psychotherapies for depression: a network meta-analysis covering efficacy, acceptability and long-term outcomes of all main treatment types
Cuijpers, P., Quero, S., Noma, H., Ciharova, M., Miguel, C., Karyotaki, E., Cipriani, A., Cristea, I. A., & Furukawa, T. A. (2021) · World Psychiatry · doi:10.1002/wps.20860 · Cited by 388
Comparative Effectiveness of Glucose-Lowering Drugs for Type 2 Diabetes: A Systematic Review and Network Meta-analysis
Tsapas, A., Avgerinos, I., Karagiannis, T., Malandris, K., Manolopoulos, A., Andreadis, P., Liakos, A., Matthews, D. R., & Bekiari, E. (2020) · Annals of Internal Medicine · doi:10.7326/m20-0864 · Cited by 346
Revascularisation versus medical treatment in patients with stable coronary artery disease: network meta-analysis
Windecker, S., Stortecky, S., Stefanini, G. G., daCosta, B. R., Rutjes, A. W., Nisio, M. D., Siletta, M., Maione, A., Alfonso, F., Clemmensen, P. M., et al. (2014) · BMJ · doi:10.1136/bmj.g3859 · Cited by 365
Percutaneous coronary interventional strategies for treatment of in-stent restenosis: a network meta-analysis
Siontis, G. C. M., Stefanini, G. G., Mavridis, D., Siontis, K. C., Alfonso, F., Pérez-Vizcayno, M. J., Byrne, R. A., Kastrati, A., Meier, B., Salanti, G., et al. (2015) · The Lancet · doi:10.1016/s0140-6736(15)60657-2 · Cited by 357
Arcsine‐based transformations for meta‐analysis of proportions: Pros, cons, and alternatives
Lin, L., & Xu, C. (2020) · Health Science Reports · doi:10.1002/hsr2.178 · Cited by 357
Effect of pirfenidone on mortality: pooled analyses and meta-analyses of clinical trials in idiopathic pulmonary fibrosis
Nathan, S. D., Albera, C., Bradford, W. Z., Costabel, U., Glaspole, I., Glassberg, M. K., Kardatzke, D. R., Daigl, M., Kirchgaessler, K.-U., Lancaster, L. H., et al. (2017) · The Lancet Respiratory Medicine · doi:10.1016/s2213-2600(16)30326-5 · Cited by 335
Triptans in the Acute Treatment of Migraine: A Systematic Review and Network Meta‐Analysis
Cameron, C. G., Kelly, S., Hsieh, S., Murphy, M., Chen, L., Kotb, A., Peterson, J., Coyle, D., Skidmore, B., Gomes, T., et al. (2015) · Headache The Journal of Head and Face Pain · doi:10.1111/head.12601 · Cited by 339
Small studies are more heterogeneous than large ones: a meta-meta-analysis
IntHout, J., Ioannidis, J. P. A., Borm, G. F., & Goeman, J. J. (2015) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2015.03.017 · Cited by 314
Bayesian Random-Effects Meta-Analysis Using the bayesmeta R Package
Röver, C. (2020) · Journal of Statistical Software · doi:10.18637/jss.v093.i06 · Cited by 310
Efficacy and safety of COVID-19 vaccines
Graña, C., Ghosn, L., Evrenoglou, T., Jarde, A., Minozzi, S., Bergman, H., Buckley, B. S., Probyn, K., Villanueva, G., Henschke, N., et al. (2022) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd015477 · Cited by 310
Metabolomics and Type 2 Diabetes Risk: An Updated Systematic Review and Meta-analysis of Prospective Cohort Studies
Morze, J., Wittenbecher, C., Schwingshackl, L., Danielewicz, A., Rynkiewicz, A., Hu, F. B., & Guasch‐Ferré, M. (2022) · Diabetes Care · doi:10.2337/dc21-1705 · Cited by 316
Heterogeneity in ecological and evolutionary meta‐analyses: its magnitude and implications
Senior, A. M., Grueber, C. E., Kamiya, T., Lagisz, M., O'Dwyer, K., Santos, E. S. A., & Nakagawa, S. (2016) · Ecology · doi:10.1002/ecy.1591 · Cited by 299
Systematic review with meta‐analysis: comparative efficacy of biologics for induction and maintenance of mucosal healing in Crohn's disease and ulcerative colitis controlled trials
Cholapranee, A., Hazlewood, G. S., Kaplan, G. G., Peyrin‐Biroulet, L., & Ananthakrishnan, A. N. (2017) · Alimentary Pharmacology & Therapeutics · doi:10.1111/apt.14030 · Cited by 298
Updosing nonsedating antihistamines in patients with chronic spontaneous urticaria: a systematic review and meta-analysis
Guillén-Aguinaga, S., Presa, I. J., Aguinaga-Ontoso, E., Guillén‐Grima, F., & Ferrer, M. (2016) · British Journal of Dermatology · doi:10.1111/bjd.14768 · Cited by 289
Dismantling cognitive-behaviour therapy for panic disorder: A systematic review and component network meta-analysis
Pompoli, A., Furukawa, T. A., Efthimiou, O., Imai, H., Tajika, A., & Salanti, G. (2018) · Psychological Medicine · doi:10.1017/s0033291717003919 · Cited by 249
Pain Management Modalities after Total Knee Arthroplasty
Terkawi, A. S., Mavridis, D., Sessler, D. I., Nunemaker, M. S., Doais, K. S., Terkawi, R. S., Terkawi, Y., Πετροπούλου, Μ., & Nemergut, E. C. (2017) · Anesthesiology · doi:10.1097/aln.0000000000001607 · Cited by 259
Neither fixed nor random: weighted least squares meta‐analysis
Stanley, T. D., & Doucouliagos, H. (2015) · Statistics in Medicine · doi:10.1002/sim.6481 · Cited by 258
Urinary tract and genital infections in patients with type 2 diabetes treated with sodium‐glucose co‐transporter 2 inhibitors: A meta‐analysis of randomized controlled trials
Li, D., Wang, T., Shen, S., Fang, Z., Dong, Y., & Tang, H. (2016) · Diabetes Obesity and Metabolism · doi:10.1111/dom.12825 · Cited by 257
The Hartung‐Knapp modification for random‐effects meta‐analysis: A useful refinement but are there any residual concerns?
Jackson, D., Law, M. W.-M., Rücker, G., & Schwarzer, G. (2017) · Statistics in Medicine · doi:10.1002/sim.7411 · Cited by 259
Methods for evidence synthesis in the case of very few studies
Bender, R., Friede, T., Koch, A., Kuss, O., Schlattmann, P., Schwarzer, G., & Skipka, G. (2018) · Research Synthesis Methods · doi:10.1002/jrsm.1297 · Cited by 250
Methods to calculate uncertainty in the estimated overall effect size from a random‐effects meta‐analysis
Veroniki, A. A., Jackson, D., Bender, R., Kuss, O., Langan, D., Higgins, J. P. T., Knapp, G., & Salanti, G. (2019) · Research Synthesis Methods · doi:10.1002/jrsm.1319 · Cited by 236
Self-citation
Multivariate and network meta-analysis of multiple outcomes and multiple treatments: rationale, concepts, and examples
Riley, R. D., Jackson, D., Salanti, G., Burke, D. L., Price, M. J., Kirkham, J. J., & White, I. R. (2017) · BMJ · doi:10.1136/bmj.j3932 · Cited by 251
Systematic review with meta‐analysis: comparative efficacy of immunosuppressants and biologics for reducing hospitalisation and surgery in Crohn's disease and ulcerative colitis
Mao, E. J., Hazlewood, G. S., Kaplan, G. G., Peyrin‐Biroulet, L., & Ananthakrishnan, A. N. (2016) · Alimentary Pharmacology & Therapeutics · doi:10.1111/apt.13847 · Cited by 248
Safety and Efficacy of Antithrombotic Strategies in Patients With Atrial Fibrillation Undergoing Percutaneous Coronary Intervention
Lópes, R. D., Hong, H., Harskamp, R. E., Bhatt, D. L., Mehran, R., Cannon, C. P., Granger, C. B., Verheugt, F. W. A., Li, J., ten Berg, J. M., et al. (2019) · JAMA Cardiology · doi:10.1001/jamacardio.2019.1880 · Cited by 246
Undertaking network meta‐analyses
Chaimani, A., Caldwell, D. M., Li, T., Higgins, J. P. T., & Salanti, G. (2019) · Wiley eBooks · doi:10.1002/9781119536604.ch11 · Cited by 290
Self-citation
Uterotonic agents for preventing postpartum haemorrhage: a network meta-analysis
Gallos, I. D., Williams, H., Price, M. J., Merriel, A., Gee, H., Lissauer, D. M., Moorthy, V., Tobı́as, A., Deeks, J. J., Widmer, M., et al. (2018) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd011689.pub2 · Cited by 237
Practical guide to the meta-analysis of rare events
Efthimiou, O. (2018) · Evidence Based Mental Health · doi:10.1136/eb-2018-102911 · Cited by 231
Random effects meta‐analysis: Coverage performance of 95 % confidence and prediction intervals following REML estimation
Partlett, C., & Riley, R. D. (2017) · Statistics in Medicine · doi:10.1002/sim.7140 · Cited by 240
Statistical methods for meta‐analyses including information from studies without any events—add nothing to nothing and succeed nevertheless
Kuss, O. (2015) · Statistics in Medicine · doi:10.1002/sim.6383 · Cited by 206
Immunomodulators and immunosuppressants for relapsing-remitting multiple sclerosis: a network meta-analysis
Tramacere, I., Giovane, C. D., Salanti, G., D’Amico, R., & Filippini, G. (2015) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd011381.pub2 · Cited by 218
SGLT2 inhibitors and risk of cancer in type 2 diabetes: A systematic review and meta-analysis of randomised controlled trials
Tang, H., Dai, Q., Shi, W., Zhai, S., Song, Y., & Han, J. (2017) · Diabetologia · doi:10.1007/s00125-017-4370-8 · Cited by 206
A Microsoft-Excel-based tool for running and critically appraising network meta-analyses—an overview and application of NetMetaXL
Brown, S. C., Hutton, B., Clifford, T., Coyle, D., Grima, D. T., Wells, G. A., & Cameron, C. G. (2014) · Systematic Reviews · doi:10.1186/2046-4053-3-110 · Cited by 209
Neither fixed nor random: weighted least squares meta‐regression
Stanley, T. D., & Doucouliagos, H. (2017) · Research Synthesis Methods · doi:10.1002/jrsm.1211 · Cited by 205
Prediction intervals for random-effects meta-analysis: A confidence distribution approach
Nagashima, K., Noma, H., & Furukawa, T. A. (2018) · Statistical Methods in Medical Research · doi:10.1177/0962280218773520 · Cited by 199
Efficacy and safety outcomes of oral anticoagulants and antiplatelet drugs in the secondary prevention of venous thromboembolism: systematic review and network meta-analysis
Castellucci, L. A., Cameron, C., Le Gal, G., Rodger, M. A., Coyle, D., Wells, P. S., Clifford, T., Gandara, E., Wells, G., & Carrier, M. (2013) · BMJ · doi:10.1136/bmj.f5133 · Cited by 193
Methotrexate monotherapy and methotrexate combination therapy with traditional and biologic disease modifying antirheumatic drugs for rheumatoid arthritis: abridged Cochrane systematic review and network meta-analysis
Hazlewood, G. S., Barnabe, C. C. M., TOMLINSON, G. A., Marshall, D. A., Devoe, D. J. A., & Bombardier, C. (2016) · BMJ · doi:10.1136/bmj.i1777 · Cited by 193
Treatment of Inguinal Hernia
Aiolfi, A., Cavalli, M., Ferraro, S. D., Manfredini, L., Bonitta, G., Bruni, P. G., Bona, D., & Campanelli, G. (2021) · Annals of Surgery · doi:10.1097/sla.0000000000004735 · Cited by 208
Meta‐analysis of few small studies in orphan diseases
Friede, T., Röver, C., Wandel, S., & Neuenschwander, B. E. (2016) · Research Synthesis Methods · doi:10.1002/jrsm.1217 · Cited by 187
Drug Treatment of Idiopathic Pulmonary Fibrosis
Canestaro, W. J., Forrester, S. H., Raghu, G., Ho, L. A., & Devine, B. E. (2016) · CHEST Journal · doi:10.1016/j.chest.2015.11.013 · Cited by 188
Comparison of four heterogeneity measures for meta‐analysis
Lin, L. (2019) · Journal of Evaluation in Clinical Practice · doi:10.1111/jep.13159 · Cited by 186
On weakly informative prior distributions for the heterogeneity parameter in Bayesian random‐effects meta‐analysis
Röver, C., Bender, R., Dias, S., Schmid, C. H., Schmidli, H., Sturtz, S., Weber, S., & Friede, T. (2021) · Research Synthesis Methods · doi:10.1002/jrsm.1475 · Cited by 209
Interleukin-6 blocking agents for treating COVID-19: a living systematic review
Ghosn, L., Chaimani, A., Evrenoglou, T., Davidson, M., Graña, C., Schmucker, C. M., Bollig, C., Henschke, N., Sguassero, Y., Nejstgaard, C. H., et al. (2021) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd013881 · Cited by 179
Preventing delirium: should non-pharmacological, multicomponent interventions be used? A systematic review and meta-analysis of the literature
Martínez, F. T., Tobar, C., & Hill, N. R. (2014) · Age and Ageing · doi:10.1093/ageing/afu173 · Cited by 177
GRADE approach to rate the certainty from a network meta-analysis: avoiding spurious judgments of imprecision in sparse networks
Brignardello‐Petersen, R., Murad, M. H., Walter, S. D., McLeod, S. L., Carrasco‐Labra, A., Rochwerg, B. N., Schünemann, H. J., TOMLINSON, G. A., & Guyatt, G. H. (2018) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2018.08.022 · Cited by 178
Systemic pharmacological treatments for chronic plaque psoriasis: a network meta-analysis
Sbidian, É., Chaimani, A., García-Doval, I., Doney, L., Dressler, C., Hua, C., Hughes, C., Naldi, L., Afach, S., & Cleach, L. L. (2020) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd011535.pub3 · Cited by 178
Risk of serious infections with immunosuppressive drugs and glucocorticoids for lupus nephritis: a systematic review and network meta-analysis
Singh, J. A., Hossain, A., Kotb, A., & Wells, G. A. (2016) · BMC Medicine · doi:10.1186/s12916-016-0673-8 · Cited by 175
Probiotics for Preterm Infants: A Strain‐Specific Systematic Review and Network Meta‐analysis
van den Akker, C. H. P., van Goudoever, J. B., Szajewska, H., Embleton, N. D., Hojsak, I., Reid, D., Shamir, R., & ESPGHAN Working Group for Probiotics, P. &. C. O. N. (2018) · Journal of Pediatric Gastroenterology and Nutrition · doi:10.1097/mpg.0000000000001897 · Cited by 167
Clinical and Safety Outcomes Associated With Treatment of Acute Venous Thromboembolism
Castellucci, L. A., Cameron, C. G., Gal, G. L., Rodger, M. A., Coyle, D., Wells, P. S., Clifford, T., Gándara, E., Wells, G. A., & Carrier, M. (2014) · JAMA · doi:10.1001/jama.2014.10538 · Cited by 164
Lack of evidence for a harmful effect of sodium‐glucose co‐transporter 2 ( SGLT2 ) inhibitors on fracture risk among type 2 diabetes patients: a network and cumulative meta‐analysis of randomized controlled trials
Tang, H., Li, D., Zhang, J. J., Hsu, Y., Wang, T., Zhai, S., & Song, Y. (2016) · Diabetes Obesity and Metabolism · doi:10.1111/dom.12742 · Cited by 167
Primary inguinal hernia: systematic review and Bayesian network meta-analysis comparing open, laparoscopic transabdominal preperitoneal, totally extraperitoneal, and robotic preperitoneal repair
Aiolfi, A., Cavalli, M., Micheletto, G., Lombardo, F., Bonitta, G., Morlacchi, A., Bruni, P. G., Campanelli, G., & Bona, D. (2019) · Hernia · doi:10.1007/s10029-019-01964-2 · Cited by 166
Effect of postoperative continuation of antibiotic prophylaxis on the incidence of surgical site infection: a systematic review and meta-analysis
de Jonge, S. W., Boldingh, Q. J. J., Solomkin, J. S., Dellinger, E. P., Egger, M., Salanti, G., Allegranzi, B., & Boermeester, M. A. (2020) · The Lancet Infectious Diseases · doi:10.1016/s1473-3099(20)30084-0 · Cited by 160
Efficacy, effectiveness, and safety of herpes zoster vaccines in adults aged 50 and older: systematic review and network meta-analysis
Tricco, A. C., Zarin, W., Cardoso, R., Veroniki, A. A., Khan, P. A., Nincic, V., Ghassemi, M., Warren, R., Sharpe, J. P., Page, A. V., et al. (2018) · BMJ · doi:10.1136/bmj.k4029 · Cited by 168
Likelihood-based random-effects meta-analysis with few studies: empirical and simulation studies
Seide, S., Röver, C., & Friede, T. (2019) · BMC Medical Research Methodology · doi:10.1186/s12874-018-0618-3 · Cited by 160
Demystifying fixed and random effects meta-analysis
Nikolakopoulou, A., Mavridis, D., & Salanti, G. (2014) · Evidence-Based Mental Health · doi:10.1136/eb-2014-101795 · Cited by 157
Association of Mechanical Bowel Preparation and Oral Antibiotics Before Elective Colorectal Surgery With Surgical Site Infection
Toh, J. W. T., Phan, K. H., Hitos, K., Pathma‐Nathan, N., El‐Khoury, T., Richardson, A. J., Morgan, G. J., Engel, A. F., & Ctercteko, G. C. (2018) · JAMA Network Open · doi:10.1001/jamanetworkopen.2018.3226 · Cited by 154
Cholinesterase inhibitors for vascular dementia and other vascular cognitive impairments: a network meta-analysis
Battle, C. E., Abdul‐Rahim, A. H., Shenkin, S. D., Hewitt, J., & Quinn, T. J. (2021) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd013306.pub2 · Cited by 165
Comparative efficacy and acceptability of pharmacological treatments for post-traumatic stress disorder in adults: a network meta-analysis
Cipriani, A., Williams, T., Nikolakopoulou, A., Salanti, G., Chaimani, A., Ipser, J., Cowen, P. J., Geddes, J. R., & Stein, D. J. (2017) · Psychological Medicine · doi:10.1017/s003329171700349x · Cited by 155
Comparison of Efficacy and Safety of 4 Combinations of Laparoscopic and Intraoperative Techniques for Management of Gallstone Disease With Biliary Duct Calculi
Ricci, C., Pagano, N., Taffurelli, G., Pacilio, C. A., Migliori, M., Bazzoli, F., Casadei, R., & Minni, F. (2018) · JAMA Surgery · doi:10.1001/jamasurg.2018.1167 · Cited by 153
Fracture risk in oral glucocorticoid users: a Bayesian meta-regression leveraging control arms of osteoporosis clinical trials
Amiche, M. A., Albaum, J. M., Tadrous, M., Pechlivanoglou, P., Lévesque, L. E., Adachi, J. D., & Cadarette, S. M. (2015) · Osteoporosis International · doi:10.1007/s00198-015-3455-9 · Cited by 144
Methotrexate monotherapy and methotrexate combination therapy with traditional and biologic disease modifying anti-rheumatic drugs for rheumatoid arthritis: A network meta-analysis
Hazlewood, G. S., Barnabe, C. C. M., TOMLINSON, G. A., Marshall, D. A., Devoe, D. J. A., & Bombardier, C. (2016) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd010227.pub2 · Cited by 145
Psychological therapies for panic disorder with or without agoraphobia in adults: a network meta-analysis
Pompoli, A., Furukawa, T. A., Imai, H., Tajika, A., Efthimiou, O., & Salanti, G. (2016) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd011004.pub2 · Cited by 142
Dressings and topical agents for treating venous leg ulcers
Norman, G., Westby, M. J., Rithalia, A. D., Stubbs, N. C., Soares, M. O., & Dumville, J. C. (2018) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd012583.pub2 · Cited by 149
Assessing the association between the methylenetetrahydrofolate reductase (MTHFR) 677C>T polymorphism and blood folate concentrations: a systematic review and meta-analysis of trials and observational studies
Tsang, B. L., Devine, O. J., Cordero, A. M., Marchetta, C., Mulinare, J., Mersereau, P. W., Guo, J., Qi, Y., Berry, R. J., Rosenthal, J., et al. (2015) · American Journal of Clinical Nutrition · doi:10.3945/ajcn.114.099994 · Cited by 140
Bibliographic study showed improving statistical methodology of network meta-analyses published between 1999 and 2015
Πετροπούλου, Μ., Nikolakopoulou, A., Veroniki, A. A., Rios, P. D. L., Vafaei, A., Zarin, W., Gianatsi, M., Sullivan, S. M., Tricco, A. C., Chaimani, A., et al. (2016) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2016.11.002 · Cited by 138
Erythropoiesis-stimulating agents for anaemia in adults with chronic kidney disease: a network meta-analysis
Palmer, S. C., Saglimbene, V. M., Mavridis, D., Salanti, G., Craig, J. C., Tonelli, M. A., Wiebe, N., & Strippoli, G. F. (2014) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd010590.pub2 · Cited by 144
Initial treatment choices to achieve sustained response in major depression: a systematic review and network meta‐analysis
Furukawa, T. A., Shinohara, K., Sahker, E., Karyotaki, E., Miguel, C., Ciharova, M., Bockting, C. L. H., Breedvelt, J. J. F., Tajika, A., Imai, H., et al. (2021) · World Psychiatry · doi:10.1002/wps.20906 · Cited by 126
Pharmacological and dietary-supplement treatments for autism spectrum disorder: a systematic review and network meta-analysis
Siafis, S., Çıray, O., Wu, H., Schneider‐Thoma, J., Bighelli, I., Krause, M., Rodolico, A., Ceraso, A., Deste, G., Huhn, M., et al. (2022) · Molecular Autism · doi:10.1186/s13229-022-00488-4 · Cited by 148
Anti-CD19 chimeric antigen receptor T-cell therapy in acute lymphocytic leukaemia: a systematic review and meta-analysis
Anagnostou, T., Riaz, I. B., Hashmi, S. K., Murad, M. H., & Kenderian, S. S. (2020) · The Lancet Haematology · doi:10.1016/s2352-3026(20)30277-5 · Cited by 132
Percutaneous closure of patent foramen ovale in patients with cryptogenic embolism: a network meta-analysis
Stortecky, S., da Costa, B. R., Mattle, H. P., Carroll, J. D., Hornung, M., Sievert, H., Trelle, S., Windecker, S., Meier, B., & Jüni, P. (2014) · European Heart Journal · doi:10.1093/eurheartj/ehu292 · Cited by 131
Meta‐analysis of two studies in the presence of heterogeneity with applications in rare diseases
Friede, T., Röver, C., Wandel, S., & Neuenschwander, B. (2017) · Biometrical Journal · doi:10.1002/bimj.201500236 · Cited by 128
A comparison of methods for meta‐analysis of a small number of studies with binary outcomes
Mathes, T., & Kuß, O. (2018) · Research Synthesis Methods · doi:10.1002/jrsm.1296 · Cited by 136

Authors: Turner, R. M., Davey, J., Clarke, M. J., Thompson, S. G., & Higgins, J. P.
Affiliations: MRC Biostatistics Unit (GB)
Queen's University Belfast (GB)
Corresponding author: Turner, Rebecca M
ORCID: Turner, Rebecca M
Clarke, Mike J
Thompson, Simon G
Higgins, Julian PT
Venue: International Journal of Epidemiology
Publisher: Oxford University Press (OUP)
Published: 2012-03-29
Volume: 41
Issue: 3
Pages: 818-827
ISSN: 0300-5771 (ISSN-L)
1464-3685
DOI: 10.1093/ije/dys041
PMC: PMC3396310
OpenAlex: W2131701504
Cited by: 837
References: 24
Citations by year: 2026: 53 · 2025: 49 · 2024: 59 · 2023: 76 · 2022: 71 · 2021: 103 · 2020: 98 · 2019: 60 · 2018: 67 · 2017: 61 · 2016: 56 · 2015: 37 · 2014: 32 · 2013: 11 · 2012: 2
FWCI: 7.31
Type: journal article
Language: en
Open access: hybrid
doi.org
Licence: cc-by-nc
Locations: International Journal of Epidemiology (publishedVersion, cc-by-nc)
Europe PMC (PubMed Central) (publishedVersion, cc-by-nc)
PubMed Central (publishedVersion, cc-by-nc)
PubMed (publishedVersion)
UCL Discovery (University College London) (submittedVersion)
HighWire Press Open Archive (submittedVersion)
Explore Bristol Research (submittedVersion)
Funders: British Heart Foundation (RG/08/014/24067)
Medical Research Council (U1052.00.011)
Topics: Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
Social Sciences › Sociology and Political Science › Delphi Technique in Research
Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
Keywords: study heterogeneity, Bayesian meta-analysis, informative priors, external evidence, predictive distribution, Cochrane Database of Systematic Reviews, pharmacological interventions, all-cause mortality, random-effects meta-analysis
MeSH terms: Bayes Theorem, Humans, Research Design, Meta-Analysis as Topic, Outcome Assessment, Health Care

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Predicting the extent of heterogeneity in meta-analysis, using empirical data from the Cochrane Database of Systematic Reviews

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Self-check

Citations

Cites

Cited by

Related

Metadata

Record

About these checks