The DOI matches its Crossref record; 32 of the 32 references it cites were found in a registry or an index.
Random-Effects Meta-Analyses Are Not Always Conservative
Abstract
It is widely held that random-effects summary effect estimates are more conservative than fixed-effects summaries in epidemiologic meta-analysis. This view is based on the fact that random-effects summaries have higher estimated variances and, consequently, wider confidence intervals than fixed-effects summaries when there is evidence of appreciable heterogeneity among the results from the individual studies. In such instances, however, the random-effects point estimates are not invariably closer to the null value nor are their p values invariably larger than those of fixed-effects summaries. Thus, random-effects summaries are not predictably conservative according to either of these two connotations of the term. The authors give an example from a meta-analysis of water chlorination and cancer in which the random-effects summaries are less conservative in both of these alternative senses and possibly more biased than the fixed-effects summaries. The discussion of when to use random effects and when to use fixed effects in computing summary estimates should be replaced by a discussion of whether summary estimates should be computed at all when the studies are not methodologically comparable, when their results are discernibly heterogeneous, or when there is evidence of publication bias.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Meta-analysis in clinical trials
DerSimonian, R., & Laird, N. (1986) · Controlled Clinical Trials · doi:10.1016/0197-2456(86)90046-2 · Cited by 39,552
Operating characteristics of a rank correlation test for publication bias
Begg, C. B., & Mazumdar, M. (1994) · Biometrics · doi:10.2307/2533446 · Cited by 16,955
Publication bias in clinical research
Easterbrook, P. J., Gopalan, R., Berlin, J. A., & Matthews, D. R. (1991) · The Lancet · doi:10.1016/0140-6736(91)90201-y · Cited by 3,109 · cited 1×
“The reluctance of investigators to publish results close to the null value and their extreme reluctance to publish implausible results are well documented (39-42).”
BackgroundQUANTITATIVE METHODS IN THE REVIEW OF EPIDEMIOLOGIC LITERATURE1
GREENLAND, S. (1987) · Epidemiologic Reviews · doi:10.1093/oxfordjournals.epirev.a036298 · Cited by 1,644 · cited 2×
“Following guidance we consider sound (5, 11, 36-38), we should seek explanations for the conflict among the study-specific results.”
MethodSelf-citationFruit and vegetables, and cardiovascular disease: A review
Ness, A. R., & Powles, J. W. (1997) · International Journal of Epidemiology · doi:10.1093/ije/26.1.1 · Cited by 1,368
Estimation of effect size from a series of independent experiments.
Hedges, L. V. (1982) · Psychological Bulletin · doi:10.1037//0033-2909.92.2.490 · Cited by 1,062
Petitti, D. B. (1994) · Medical Entomology and Zoology · Cited by 869
Dickersin, K. (1992) · JAMA · doi:10.1001/jama.1992.03480030052036 · Cited by 854
Chlorination, chlorination by-products, and cancer: a meta-analysis.
Morris, R. D., Audet, A. M., Angelillo, I. F., Chalmers, T. C., & Mosteller, F. (1992) · American Journal of Public Health · doi:10.2105/ajph.82.7.955 · Cited by 545
A LIKELIHOOD APPROACH TO META-ANALYSIS WITH RANDOM EFFECTS
HARDY, R. J., & THOMPSON, S. G. (1996) · Statistics in Medicine · doi:10.1002/(sici)1097-0258(19960330)15:6<619::aid-sim188>3.0.co;2-a · Cited by 522
Cited by
Sterne, J. A. C., Sutton, A. J., Ioannidis, J. P. A., Terrin, N., Jones, D. R., Lau, J., Carpenter, J., Rucker, G., Harbord, R. M., Schmid, C. H., et al. (2011) · BMJ · doi:10.1136/bmj.d4002 · Cited by 7,709
Funnel plots for detecting bias in meta-analysis
Sterne, J. A. C., & Egger, M. (2001) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(01)00377-8 · Cited by 3,779
Updated Method Guidelines for Systematic Reviews in the Cochrane Collaboration Back Review Group
van Tulder, M., Furlan, A., Bombardier, C., & Bouter, L. (2003) · Spine · doi:10.1097/01.brs.0000065484.95996.af · Cited by 2,180
Analysing data and undertaking meta‐analyses
Deeks, J. J., Higgins, J. P., Altman, D. G., & on behalf of the Cochrane Statistical Methods Group (2019) · Cochrane Handbook for Systematic Reviews of Interventions · doi:10.1002/9781119536604.ch10 · Cited by 2,672
Analysing Data and Undertaking Meta‐Analyses
Deeks, J. J., Higgins, J. P., & Altman, D. G. (2008) · Cochrane Handbook for Systematic Reviews of Interventions · doi:10.1002/9780470712184.ch9 · Cited by 1,800
Metadata
- Authors
- Poole, C., & Greenland, S.
- Venue
- American Journal of Epidemiology
- Publisher
- Oxford University Press (OUP)
- Published
- 1999-09-01
- Volume
- 150
- Issue
- 5
- Pages
- 469-475
- ISSN
- 0002-9262 (ISSN-L)
- 1476-6256
- OpenAlex
- W2148326029
- Cited by
- 338
- References
- 32
- FWCI
- 22.10
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Random-Effects Meta-Analyses Are Not Always Conservative. https://app.cochat.ai/papers/10.1093/oxfordjournals.aje.a010035
- The paper
- Poole, C., & Greenland, S. (1999). Random-Effects Meta-Analyses Are Not Always Conservative. American Journal of Epidemiology. https://doi.org/10.1093/oxfordjournals.aje.a010035
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.