An overview of meta-analysis for clinicians
Open accessThe DOI matches its Crossref record; 40 of the 40 references it cites were found in a registry or an index.
Abstract
The number of medical studies being published is increasing exponentially, and clinicians must routinely process large amounts of new information. Moreover, the results of individual studies are often insufficient to provide confident answers, as their results are not consistently reproducible. A meta-analysis is a statistical method for combining the results of different studies on the same topic and it may resolve conflicts among studies. Meta-analysis is being used increasingly and plays an important role in medical research. This review introduces the basic concepts, steps, advantages, and caveats of meta-analysis, to help clinicians understand it in clinical practice and research. A major advantage of a meta-analysis is that it produces a precise estimate of the effect size, with considerably increased statistical power, which is important when the power of the primary study is limited because of a small sample size. A meta-analysis may yield conclusive results when individual studies are inconclusive. Furthermore, meta-analyses investigate the source of variation and different effects among subgroups. In summary, a meta-analysis is an objective, quantitative method that provides less biased estimates on a specific topic. Understanding how to conduct a meta-analysis aids clinicians in the process of making clinical decisions.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: the PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & for the PRISMA Group (2009) · BMJ · doi:10.1136/bmj.b2535 · Cited by 83,823
Bias in meta-analysis detected by a simple, graphical test
Egger, M., Smith, G. D., Schneider, M., & Minder, C. (1997) · BMJ · doi:10.1136/bmj.315.7109.629 · Cited by 56,722
Preferred reporting items for systematic reviews and meta-analyses: the PRISMA Statement.
(2009) · PubMed Central · Cited by 44,859
Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & the PRISMA Group* (2009) · Annals of Internal Medicine · doi:10.7326/0003-4819-151-4-200908180-00135 · Cited by 37,554
Quantifying heterogeneity in a meta‐analysis
Higgins, J. P. T., & Thompson, S. G. (2002) · Statistics in Medicine · doi:10.1002/sim.1186 · Cited by 36,763
Duval, S., & Tweedie, R. (2000) · Biometrics · doi:10.1111/j.0006-341x.2000.00455.x · Cited by 14,099
Power failure: why small sample size undermines the reliability of neuroscience
Button, K. S., Ioannidis, J. P. A., Mokrysz, C., Nosek, B. A., Flint, J., Robinson, E. S. J., & Munafò, M. R. (2013) · Nature Reviews Neuroscience · doi:10.1038/nrn3475 · Cited by 7,641 · cited 1×
“Many studies have false-positive results (type I errors) or are unable to detect small effects (false-negative, type II errors) [2].”
BackgroundPrimary, Secondary, and Meta-Analysis of Research
GLASS, G. V. (1976) · Educational Researcher · doi:10.3102/0013189x005010003 · Cited by 4,890
Funnel plots for detecting bias in meta-analysis
Sterne, J. A. C., & Egger, M. (2001) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(01)00377-8 · Cited by 3,779
How should meta‐regression analyses be undertaken and interpreted?
Thompson, S. G., & Higgins, J. P. T. (2002) · Statistics in Medicine · doi:10.1002/sim.1187 · Cited by 3,026
Fixed-and random-effects models in meta-analysis.
Hedges, L. V., & Vevea, J. L. (1998) · Psychological Methods · doi:10.1037/1082-989x.3.4.486 · Cited by 2,977
Meta-analysis: Principles and procedures
Egger, M., Smith, G. D., & Phillips, A. N. (1997) · BMJ · doi:10.1136/bmj.315.7121.1533 · Cited by 2,415
Random-effects model for meta-analysis of clinical trials: An update
DerSimonian, R., & Kacker, R. (2007) · Contemporary Clinical Trials · doi:10.1016/j.cct.2006.04.004 · Cited by 2,374
The case of the misleading funnel plot
Lau, J., Ioannidis, J. P. A., Terrin, N., Schmid, C. H., & Olkin, I. (2006) · BMJ · doi:10.1136/bmj.333.7568.597 · Cited by 1,766 · cited 1×
“In the absence of publication bias, the funnel plot produces a symmetrical inverted funnel, asymmetry being suggestive of a publication bias [27].”
BackgroundUsers' Guides to the Medical Literature: IX. A Method for Grading Health Care Recommendations
Guyatt, G. H. (1995) · JAMA · doi:10.1001/jama.1995.03530220066035 · Cited by 846 · cited 2×
“of medical studies is considered decisive evidence, as it occupies a top level in the hierarchy of evidence [5].”
BackgroundA general parametric approach to the meta‐analysis of randomized clinical trials
Whitehead, A., & Whitehead, J. (1991) · Statistics in Medicine · doi:10.1002/sim.4780101105 · Cited by 750
Meta‐Analysis in Medical Research: The Handbook for the Understanding and Practice of Meta‐Analysis
(2005) · Wiley eBooks · doi:10.1002/9780470994894 · Cited by 687
Meta-Analysis in Medical Research
Sathian, B., Sreedharan, J., Ahmad, M. Z., Joy, T., Baboo, N., Dixit, S., & Devkota, S. (2009) · Cited by 652
Meta-analysis of genetic association studies
Munafò, M. R., & Flint, J. (2004) · Trends in Genetics · doi:10.1016/j.tig.2004.06.014 · Cited by 642
A method for meta-analysis of molecular association studies
Thakkinstian, A., McElduff, P., D'Este, C., Duffy, D., & Attia, J. (2005) · Statistics in Medicine · doi:10.1002/sim.2010 · Cited by 618
Prevention of organ allograft rejection by a specific Janus kinase 3 inhibitor
Changelian, P. S., Flanagan, M. E., Ball, D. J., Kent, C. R., Magnuson, K. S., Martin, W. H., Rizzuti, B. J., Sawyer, P. S., Perry, B. D., Brissette, W. H., et al. (2003) · Science · doi:10.1126/science.1087061 · Cited by 607
Meta-analysis: Its strengths and limitations
WALKER, E., HERNANDEZ, A. V., & KATTAN, M. W. (2008) · Cleveland Clinic Journal of Medicine · doi:10.3949/ccjm.75.6.431 · Cited by 519 · cited 4×
“Heterogeneity A meta-analysis examines the existence of heterogeneity among primary studies and analyzes the variance in the results of different studies; meta-analysis heterogeneity is the degree of dissimilarity in the individual study results [7].”
BackgroundMethodInfluentialMeta-analysis, funnel plots and sensitivity analysis
Copas, J. (2000) · Biostatistics · doi:10.1093/biostatistics/1.3.247 · Cited by 503 · cited 1×
“Sensitivity testing may also be performed to assess the influence of each individual study on the pooled effect size by omitting each individual study [22].”
BackgroundMurad, M. H., Montori, V. M., Ioannidis, J. P. A., Jaeschke, R., Devereaux, P. J., Prasad, K., Neumann, I., Carrasco-Labra, A., Agoritsas, T., Hatala, R., et al. (2014) · JAMA · doi:10.1001/jama.2014.5559 · Cited by 454 · cited 1×
“In addition, the study results are not consistently reproducible and the results of individual studies are often insufficient to provide confident answers [1].”
ResultPublication Bias: The Problem That Won't Go Away
DICKERSIN, K., & MIN, Y. (1993) · Annals of the New York Academy of Sciences · doi:10.1111/j.1749-6632.1993.tb26343.x · Cited by 427
The Promise and Problems of Meta-Analysis
Bailar, J. C. (1997) · New England Journal of Medicine · doi:10.1056/nejm199708213370810 · Cited by 402
Meta-analysis of randomised controlled trials
Kelly, C. P. (1997) · The Lancet · doi:10.1016/s0140-6736(05)63834-2 · Cited by 382
Zintzaras, E., & Lau, J. (2008) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2007.12.011 · Cited by 361
Sharpe, D. (1997) · Clinical Psychology Review · doi:10.1016/s0272-7358(97)00056-1 · Cited by 334
Meta-analysis of randomised controlled trials
Smith, G. D., & Egger, M. (1997) · The Lancet · doi:10.1016/s0140-6736(05)63833-0 · Cited by 212
A step-by-step guide to systematically identify all relevant animal studies
Leenaars, M., Hooijmans, C. R., van Veggel, N., ter Riet, G., Leeflang, M., Hooft, L., van der Wilt, G. J., Tillema, A., & Ritskes-Hoitinga, M. (2012) · Laboratory Animals · doi:10.1258/la.2011.011087 · Cited by 198
Obstacles and opportunities in meta-analysis of genetic association studies
Salanti, G., Sanderson, S., & Higgins, J. P. T. (2005) · Genetics in Medicine · doi:10.1097/01.gim.0000151839.12032.1a · Cited by 196 · cited 1×
“Evaluation of the causes of heterogeneity It is important to assess the presence of heterogeneity among the studies included in a meta-analysis, and determine the possible causes of heterogeneity, since it can lead to bias, referred to as “mixing apples and oranges,” in the meta-analysis results [21].”
BackgroundInterpreting and understanding meta-analysis graphs--a practical guide.
Ried, K. (2006) · PubMed · Cited by 180
Why we need a broad perspective on meta-analysis
Gotzsche, P. C. (2000) · BMJ · doi:10.1136/bmj.321.7261.585 · Cited by 175
Meta-Analysis of Genetic Association Studies
Lee, Y. H. (2015) · Annals of Laboratory Medicine · doi:10.3343/alm.2015.35.3.283 · Cited by 165
Self-citationSystemic lupus erythematosus susceptibility loci defined by genome scan meta-analysis
Lee, Y. H., & Nath, S. K. (2005) · Human Genetics · doi:10.1007/s00439-005-0073-1 · Cited by 118
Self-citationFind Duplicates among the PubMed, EMBASE, and Cochrane Library Databases in Systematic Review
Qi, X., Yang, M., Ren, W., Jia, J., Wang, J., Han, G., & Fan, D. (2013) · PLoS ONE · doi:10.1371/journal.pone.0071838 · Cited by 98 · cited 3×
“We performed a systematic review and meta-analysis of RCTs, examining the efficacy and safety of tofacitinib in active RA patients using PubMed, EMBASE, CENTRAL, and manual searches [33].”
BackgroundSong, G. G., Seo, Y. H., Kim, J., Choi, S. J., Ji, J. D., & Lee, Y. H. (2015) · Pharmacogenomics · doi:10.2217/pgs.15.90 · Cited by 51
Self-citationSong, G. G., Bae, S., & Lee, Y. H. (2014) · The Korean Journal of Internal Medicine · doi:10.3904/kjim.2014.29.5.656 · Cited by 30
Self-citation(2007) · PubMed
Cited by
Yunitri, N., Kao, C.-C., Chu, H., Voss, J., Chiu, H.-L., Liu, D., Shen, S.-T. H., Chang, P.-C., Kang, X. L., & Chou, K.-R. (2020) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2020.01.005 · Cited by 64
Meta-review on the efficacy of psychological therapies for the treatment of substance use disorders
Dellazizzo, L., Potvin, S., Giguère, S., Landry, C., Léveillé, N., & Dumais, A. (2023) · Psychiatry Research · doi:10.1016/j.psychres.2023.115318 · Cited by 55
Chen, X., Pu, J., Liu, Y., Tian, L., Chen, Y., Gui, S., Xu, S., Song, X., & Xie, P. (2020) · Psychiatry Research · doi:10.1016/j.psychres.2020.113320 · Cited by 34
Lower circulating IGF-1 levels in fibromyalgia: meta-analysis highlighting potential pathogenic role
Lee, Y. H., & Song, G. G. (2024) · Clinical and Experimental Rheumatology · doi:10.55563/clinexprheumatol/g17lb8 · Cited by 2
Self-citation
Metadata
- Authors
- Lee, Y. H.
- Venue
- The Korean Journal of Internal Medicine
- Published
- 2018-03-01
- Volume
- 33
- Issue
- 2
- Pages
- 277-283
- ISSN
- 1226-3303 (ISSN-L)
- 2005-6648
- OpenAlex
- W2780385632
- Cited by
- 291
- References
- 40
- FWCI
- 5.30
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.