Confidence intervals for a random‐effects meta‐analysis based on Bartlett‐type corrections
Open accessThe DOI matches its Crossref record; 8 of the 8 references it cites were found in a registry or an index.
Abstract
In medical meta‐analysis, the DerSimonian‐Laird confidence interval for the average treatment effect has been widely adopted in practice. However, it is well known that its coverage probability (the probability that the interval actually includes the true value) can be substantially below the target level. One particular reason is that the validity of the confidence interval depends on the assumption that the number of synthesized studies is sufficiently large. In typical medical meta‐analyses, the number of studies is fewer than 20. In this article, we developed three confidence intervals for improving coverage properties, based on (i) the Bartlett corrected likelihood ratio statistic, (ii) the efficient score statistic, and (iii) the Bartlett‐type adjusted efficient score statistic. The Bartlett and Bartlett‐type corrections improve the large sample approximations for the likelihood ratio and efficient score statistics. Through numerical evaluations by simulations, these confidence intervals demonstrated better coverage properties than the existing methods. In particular, with a moderate number of synthesized studies, the Bartlett and Bartlett‐type corrected confidence intervals performed well. An application to a meta‐analysis of the treatment for myocardial infarction with intravenous magnesium is presented. Copyright © 2011 John Wiley & Sons, Ltd.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Beta blockade during and after myocardial infarction: An overview of the randomized trials
Yusuf, S., Peto, R., Lewis, J., Collins, R., & Sleight, P. (1985) · Progress in Cardiovascular Diseases · doi:10.1016/s0033-0620(85)80003-7 · Cited by 3,205
Publication bias in clinical research
Easterbrook, P. J., Gopalan, R., Berlin, J. A., & Matthews, D. R. (1991) · The Lancet · doi:10.1016/0140-6736(91)90201-y · Cited by 3,109
Cox, D. R., & Hinkley, D. V. (1974) · doi:10.1007/978-1-4899-2887-0 · Cited by 3,089
A Re-Evaluation of Random-Effects Meta-Analysis
Higgins, J. P. T., Thompson, S. G., & Spiegelhalter, D. J. (2009) · Journal of the Royal Statistical Society Series A: Statistics in Society · doi:10.1111/j.1467-985x.2008.00552.x · Cited by 2,569 · cited 3×
“This fact might be a limitation with regard to adopting the random-effects model in meta-analyses, as discussed in [2].”
BackgroundMethodMeta‐Analysis Of Controlled Clinical Trials
Whitehead, A. (2002) · doi:10.1002/0470854200 · Cited by 827
A comparison of statistical methods for meta‐analysis
Brockwell, S. E., & Gordon, I. R. (2001) · Statistics in Medicine · doi:10.1002/sim.650 · Cited by 573 · cited 6×
“Brockwell and Gordon [5] proposed the ‘quantile approximation’ method that modifies the DerSimonian-Laird (DL) approach by widening the lengths of the confidence interval to appropriate sizes.”
BackgroundResultInfluentialEgger, M., & Smith, G. D. (1995) · BMJ · doi:10.1136/bmj.310.6982.752 · Cited by 508
A simple confidence interval for meta-analysis
Sidik, K., & Jonkman, J. N. (2002) · Statistics in Medicine · doi:10.1002/sim.1262 · Cited by 431 · cited 1×
“Sidik and Jonkman [7] also proposed a confidence interval using a quantile of the Student’s t -distribution.”
Method
Cited by
Tufanaru, C., Munn, Z., Stephenson, M., & Aromataris, E. (2015) · International Journal of Evidence-Based Healthcare · doi:10.1097/xeb.0000000000000065 · Cited by 1,057
Power analysis for random-effects meta-analysis
Jackson, D., & Turner, R. (2017) · Research Synthesis Methods · doi:10.1002/jrsm.1240 · Cited by 619
Doi, S. A. R., Barendregt, J. J., Khan, S., Thalib, L., & Williams, G. M. (2015) · Contemporary Clinical Trials · doi:10.1016/j.cct.2015.05.009 · Cited by 581
Fatima, Y., Doi, S. A. R., & Mamun, A. A. (2015) · Obesity Reviews · doi:10.1111/obr.12245 · Cited by 577
Mannan, M., Mamun, A., Doi, S., & Clavarino, A. (2016) · PLoS ONE · doi:10.1371/journal.pone.0157240 · Cited by 421
Sleep quality and obesity in young subjects: a meta‐analysis
Fatima, Y., Doi, S. A. R., & Mamun, A. A. (2016) · Obesity Reviews · doi:10.1111/obr.12444 · Cited by 402
Mannan, M., Mamun, A., Doi, S., & Clavarino, A. (2016) · Asian Journal of Psychiatry · doi:10.1016/j.ajp.2015.12.008 · Cited by 280
Prevention of eating disorders: A systematic review and meta-analysis
Le, L. K.-D., Barendregt, J. J., Hay, P., & Mihalopoulos, C. (2017) · Clinical Psychology Review · doi:10.1016/j.cpr.2017.02.001 · Cited by 275
Veroniki, A. A., Jackson, D., Bender, R., Kuss, O., Langan, D., Higgins, J. P. T., Knapp, G., & Salanti, G. (2019) · Research Synthesis Methods · doi:10.1002/jrsm.1319 · Cited by 236
“Although the Bartlett‐type correction CI has a satisfactory power compared with the WTz, WTt, and PL CIs(52) and performs well when τ(2) = 0,(142) caution is needed for k ≤ 5, as it tends to be overconservative.(17) The Skovgaard statistic CI (method 8) is associated with coverage closer to the nominal level compared…”
BackgroundMethodResultAdvances in the meta-analysis of heterogeneous clinical trials II: The quality effects model
Doi, S. A. R., Barendregt, J. J., Khan, S., Thalib, L., & Williams, G. M. (2015) · Contemporary Clinical Trials · doi:10.1016/j.cct.2015.05.010 · Cited by 227
“The initial problem was that, as heterogeneity increases, the coverage of the RE confidence interval drops well below the nominal level [4], substantially underestimates the statistical error and produces overconfident conclusions [5,6].”
BackgroundPrevalence of epilepsy in autism spectrum disorders: A systematic review and meta-analysis
Liu, X., Sun, X., Sun, C., Zou, M., Chen, Y., Huang, J., Wu, L., & Chen, W.-X. (2022) · Autism · doi:10.1177/13623613211045029 · Cited by 145
“…of the random effects (RE) confidence interval (CI) declines below the nominal level (Brockwell & Gordon, 2001), substantially underestimates the statistical error and produces overconfident conclusions (Noma, 2011; Poole & Greenland, 1999) when the heterogeneity of included studies is increased.”
BackgroundCannabis-Based Products for Chronic Pain: An Updated Systematic Review
Chou, R., Fu, R., Ahmed, A. Y., & Morasco, B. J. (2026) · Annals of Internal Medicine · doi:10.7326/annals-25-03152 · Cited by 4
Metadata
- Authors
- Noma, H.
- Venue
- Statistics in Medicine
- Publisher
- Wiley
- Published
- 2011-10-03
- Volume
- 30
- Issue
- 28
- Pages
- 3304-3312
- ISSN
- 0277-6715 (ISSN-L)
- 1097-0258
- OpenAlex
- W2117681992
- Cited by
- 82
- References
- 8
- FWCI
- 2.03
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.