A Statistical Method for Synthesizing Meta-Analyses
Open accessThe DOI matches its Crossref record; 6 of the 6 references it cites were found in a registry or an index.
Abstract
Multiple meta-analyses may use similar search criteria and focus on the same topic of interest, but they may yield different or sometimes discordant results. The lack of statistical methods for synthesizing these findings makes it challenging to properly interpret the results from multiple meta-analyses, especially when their results are conflicting. In this paper, we first introduce a method to synthesize the meta-analytic results when multiple meta-analyses use the same type of summary effect estimates. When meta-analyses use different types of effect sizes, the meta-analysis results cannot be directly combined. We propose a two-step frequentist procedure to first convert the effect size estimates to the same metric and then summarize them with a weighted mean estimate. Our proposed method offers several advantages over existing methods by Hemming et al. (2012). First, different types of summary effect sizes are considered. Second, our method provides the same overall effect size as conducting a meta-analysis on all individual studies from multiple meta-analyses. We illustrate the application of the proposed methods in two examples and discuss their implications for the field of meta-analysis.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Meta-analysis: Principles and procedures
Egger, M., Smith, G. D., & Phillips, A. N. (1997) · BMJ · doi:10.1136/bmj.315.7121.1533 · Cited by 2,415
meta-analysis bias in location and selection of studies
Egger, M., & Smith, G. D. (1998) · BMJ · doi:10.1136/bmj.316.7124.61 · Cited by 1,374 · cited 2×
“Liansheng Larry Tang,1 Michael Caudy,2 and Faye Taxman2 1 Department of Statistics, George Mason University, Fairfax, VA 22030, USA 2Department of Criminology, Law and Society, George Mason University, Fairfax, VA 22030, USA Correspondence should be addressed to Liansheng Larry Tang; tang7814@yahoo.com Received 16 May…”
BackgroundMethodology in conducting a systematic review of systematic reviews of healthcare interventions
Smith, V., Devane, D., Begley, C. M., & Clarke, M. (2011) · BMC Medical Research Methodology · doi:10.1186/1471-2288-11-15 · Cited by 1,227
Moher, D., Jones, A., Lepage, L., & for the CONSORT Group (2001) · JAMA · doi:10.1001/jama.285.15.1992 · Cited by 1,027
Flodgren, G., Eccles, M. P., Shepperd, S., Scott, A., Parmelli, E., & Beyer, F. R. (2011) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd009255 · Cited by 418
Becker, L. A., & Oxman, A. D. (2008) · Cochrane Handbook for Systematic Reviews of Interventions · doi:10.1002/9780470712184.ch22 · Cited by 218
Research works printed but not linked: 13
- 10.1002/sim.2934 · DOI · Paper page
- 1980, Journal of Personality, 48, 449, 10.1111/j.1467-6494.1980.tb02379.x · DOI · Paper page
- 1986, Controlled Clinical Trials, 7, 177, 10.1016/0197-2456(86)90046-2 · DOI · Paper page
- 1997, Canadian Medical Association Journal, 156, 1411
- 2010, Cochrane Database of Systematic Reviews
- 10.1002/sim.4372 · DOI
- 10.1002/sim.3563 · doi:10.1002/sim.3563
- 2000, Statistics in Medicine, 19, 3127, 10.1002/1097-0258(20001130)19:22<3127::AID-SIM784>3.0.CO;2-M · DOI · Paper page
- 10.1002/jclp.20553 · DOI · Paper page
- 10.1136/bmj.38784.384109.2F · DOI · Paper page
- 10.1016/j.knee.2004.06.008 · DOI
- 10.1016/j.ijsu.2010.02.007 · DOI · Paper page
- 2007, PLoS Medicine, 4, e147, 10.1371/journal.pmed.0040147 · DOI · Paper page
Cited by
Lunny, C., Pieper, D., Thabet, P., & Kanji, S. (2021) · BMC Medical Research Methodology · doi:10.1186/s12874-021-01269-y · Cited by 252
“Inflate the variance of the MA estimate [42]; that is, an inflation factor of J can be multiplied with the second order MA variance to correct for the underestimated variance estimator.”
MethodGlobal variation in soil carbon sequestration potential through improved cropland management
Lessmann, M., Ros, G. H., Young, M. D., & de Vries, W. (2022) · Global Change Biology · doi:10.1111/gcb.15954 · Cited by 257
Evidence map of crop diversification strategies at the global scale
Beillouin, D., Ben-Ari, T., & Makowski, D. (2019) · Environmental Research Letters · doi:10.1088/1748-9326/ab4449 · Cited by 192
“Effect sizes corresponding to relative differences were converted to log ratios as exposed in Tang et al (2013).”
MethodLunny, C., Brennan, S. E., McDonald, S., & McKenzie, J. E. (2018) · Systematic Reviews · doi:10.1186/s13643-018-0784-8 · Cited by 139
“4 Determine the method to convert effect metrics (either from primary studies or meta-analyses) to the same scale Cooper 2012 [6]; Tang 2013 [78]; Thomson 2010 [26]”
InfluentialJahrami, H., AlKaabi, J., Trabelsi, K., Pandi-Perumal, S. R., Saif, Z., Seeman, M. V., & Vitiello, M. V. (2023) · Journal of Psychosomatic Research · doi:10.1016/j.jpsychores.2023.111479 · Cited by 72
Metadata
- Authors
- Tang, L. L., Caudy, M., & Taxman, F.
- Venue
- Computational and Mathematical Methods in Medicine
- Publisher
- Wiley
- Published
- 2013
- Volume
- 2013
- Pages
- 1-9
- ISSN
- 1748-670X (ISSN-L)
- 1748-6718
- OpenAlex
- W2063240836
- Cited by
- 27
- References
- 6
- FWCI
- 0.36
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.