The potential and limitations of meta-analysis.
Open accessThe DOI matches its Crossref record; 12 of the 12 references it cites were found in a registry or an index.
Abstract
We are currently wimessing an "epidemic" of meta-analyses and overviews in the scientific literature.This is a relatively new phenomenon and this article addresses some of the important issues raised by their increasing use.In particular the differing applications and limitations of meta- analysis are discussed, with a review of the analytic methods used and the problems and biases encountered.What is meta-analysis?Meta-analysis has come to refer to the combining ofresults from a number ofexperiments or studies examining the same question.Such a process is not new, and some meta-analytic studies were reported as early as 1955.1However, only since the term meta-analysis was first used in 19762 has the technique become recognised as an analytical method.Meta-analysis is a discipline that reviews critically and combines statistically the results of previous research in an attempt to summarise the totality ofevidence relating to a particular medical issue.The term meta-analysis is now often used synonymously with overview.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Primary, Secondary, and Meta-Analysis of Research
GLASS, G. V. (1976) · Educational Researcher · doi:10.3102/0013189x005010003 · Cited by 4,890
Blood pressure, stroke, and coronary heart disease
Collins, R., Peto, R., MacMahon, S., Godwin, J., Qizilbash, N., Collins, R., MacMahon, S., Hebert, P., Eberlein, K. A., Taylor, J. O., et al. (1990) · The Lancet · doi:10.1016/0140-6736(90)90944-z · Cited by 4,491
Beta blockade during and after myocardial infarction: An overview of the randomized trials
Yusuf, S., Peto, R., Lewis, J., Collins, R., & Sleight, P. (1985) · Progress in Cardiovascular Diseases · doi:10.1016/s0033-0620(85)80003-7 · Cited by 3,205
Freiman, J. A., Chalmers, T. C., Smith, H., & Kuebler, R. R. (1978) · New England Journal of Medicine · doi:10.1056/nejm197809282991304 · Cited by 1,628
The Existence of Publication Bias and Risk Factors for Its Occurrence
Dickersin, K. (1990) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.1990.03440100097014 · Cited by 1,417
A method for assessing the quality of a randomized control trial
Chalmers, T. C., Smith, H., Blackburn, B., Silverman, B., Schroeder, B., Reitman, D., & Ambroz, A. (1981) · Controlled Clinical Trials · doi:10.1016/0197-2456(81)90056-8 · Cited by 1,349
The Medical Review Article: State of the Science
MULROW, C. D. (1987) · Annals of Internal Medicine · doi:10.7326/0003-4819-106-3-485 · Cited by 856
Randomized versus historical controls for clinical trials
Sacks, H., Chalmers, T. C., & Smith, H. (1982) · The American Journal of Medicine · doi:10.1016/0002-9343(82)90815-4 · Cited by 834
Publication bias: the case for an international registry of clinical trials.
Simes, R. J. (1986) · Journal of Clinical Oncology · doi:10.1200/jco.1986.4.10.1529 · Cited by 747
Cited by
Thompson, S. G., & Pocock, S. J. (1991) · The Lancet · doi:10.1016/0140-6736(91)91975-z · Cited by 487
Self-citationShould there be a moratorium on the use of cholesterol lowering drugs?
Davey Smith, G., & Pekkanen, J. (1992) · BMJ · doi:10.1136/bmj.304.6824.431 · Cited by 333
Meta-analysis of Hyperhomocysteinemia as a Risk Factor for Venous Thromboembolic Disease
Ray, J. G. (1998) · Archives of Internal Medicine · doi:10.1001/archinte.158.19.2101 · Cited by 321
Single and Combined Strategies for Implementing Changes in Primary Care: A Literature Review
WENSING, M., & GROL, R. (1994) · International Journal for Quality in Health Care · doi:10.1093/intqhc/6.2.115 · Cited by 283
Meta-analysis: Neither quick nor easy
Berman, N. G., & Parker, R. A. (2002) · BMC Medical Research Methodology · doi:10.1186/1471-2288-2-10 · Cited by 270
“As we mentioned in the introduction, there is some disagreement on this subject [5,6, 9 ,11,12,15,16].”
Prevalence and Pattern of Epilepsy in India
Sridharan, R., & Murthy, B. N. (1999) · Epilepsia · doi:10.1111/j.1528-1157.1999.tb05566.x · Cited by 264
Methods for Exploring Heterogeneity in Meta-Analysis
Song, F., Sheldon, T. A., Sutton, A. J., Abrams, K. R., & Jones, D. R. (2001) · Evaluation & the Health Professions · doi:10.1177/01632780122034849 · Cited by 253
Do instructional interventions influence college students’ critical thinking skills? A meta-analysis
Niu, L., Behar-Horenstein, L. S., & Garvan, C. W. (2013) · Educational Research Review · doi:10.1016/j.edurev.2012.12.002 · Cited by 244
Nam, I., Mengersen, K., & Garthwaite, P. (2003) · Statistics in Medicine · doi:10.1002/sim.1410 · Cited by 153
“Critical debate on appropriate interpretation and implementation of meta-analysis also continues to occupy a large literature; see, for example, Mosteller and Chalmers [6] and Henry and Wilson [7] for earlier commentary, Thornton and Lee [8] as a representative of the vexed issue of publication bias, Thompson and Spec…”
BackgroundSir, A., D'Souza, R. F., Uguz, S., George, T., Vahip, S., Hopwood, M., Martin, A. J., Lam, W., & Burt, T. (2005) · The Journal of Clinical Psychiatry · doi:10.4088/jcp.v66n1015 · Cited by 129
Systematic reviews and meta-analysis for the surgeon scientist
Mahid, S. S., Hornung, C. A., Minor, K. S., Turina, M., & Galandiuk, S. (2006) · British Journal of Surgery · doi:10.1002/bjs.5596 · Cited by 109
Villar, J., Mackey, M. E., Carroli, G., & Donner, A. (2001) · Statistics in Medicine · doi:10.1002/sim.1096 · Cited by 96
Metadata
- Authors
- Spector, T. D., & Thompson, S. G.
- Venue
- Journal of Epidemiology and Community Health
- Publisher
- BMJ
- Published
- 1991-06
- Volume
- 45
- Issue
- 2
- Pages
- 89-92
- ISSN
- 0141-7681 (ISSN-L)
- 0143-005X
- 1470-2738
- OpenAlex
- W2010173781
- Cited by
- 122
- References
- 12
- FWCI
- 14.60
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.