The DOI matches its Crossref record; 67 of the 67 references it cites were found in a registry or an index.
Recent developments in meta‐analysis
Open accessAbstract
The art and science of meta‐analysis, the combination of results from multiple independent studies, is now more than a century old. In the last 30 years, however, as the need for medical research and clinical practice to be based on the totality of relevant and sound evidence has been increasingly recognized, the impact of meta‐analysis has grown enormously. In this paper, we review highlights of recent developments in meta‐analysis in medical research. We outline in particular how emphasis has been placed on (i) heterogeneity and random‐effects analyses; (ii) special consideration in different areas of application; (iii) assessing bias within and across studies; and (iv) extension of ideas to complex evidence synthesis. We conclude the paper with some remarks on ongoing challenges and possible directions for the future. Copyright © 2007 John Wiley & Sons, Ltd.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Measuring inconsistency in meta-analyses
Higgins, J. P. T., Thompson, S. G., Deeks, J. J., & Altman, D. G. (2003) · BMJ · doi:10.1136/bmj.327.7414.557 · Cited by 63,139
Self-citationMeta-analysis in clinical trials
DerSimonian, R., & Laird, N. (1986) · Controlled Clinical Trials · doi:10.1016/0197-2456(86)90046-2 · Cited by 39,552
Quantifying heterogeneity in a meta‐analysis
Higgins, J. P. T., & Thompson, S. G. (2002) · Statistics in Medicine · doi:10.1002/sim.1186 · Cited by 36,763
Self-citationOperating characteristics of a rank correlation test for publication bias
Begg, C. B., & Mazumdar, M. (1994) · Biometrics · doi:10.2307/2533446 · Cited by 16,955
Statistical Aspects of the Analysis of Data From Retrospective Studies of Disease
(1959) · JNCI: Journal of the National Cancer Institute · doi:10.1093/jnci/22.4.719 · Cited by 14,689
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · PLoS Medicine · doi:10.1371/journal.pmed.0020124 · Cited by 10,505
Moher, D., Schulz, K. F., & Altman, D. G. (2001) · The Lancet · doi:10.1016/s0140-6736(00)04337-3 · Cited by 5,373
Moher, D., Cook, D. J., Eastwood, S., Olkin, I., Rennie, D., & Stroup, D. F. (1999) · The Lancet · doi:10.1016/s0140-6736(99)04149-5 · Cited by 4,826
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · CHANCE · doi:10.1080/09332480.2005.10722754 · Cited by 4,702 · cited 1×
“With the ever-expanding literature of medical research studies, and the suggestion that the majority of such findings may be false [6], the need for critical evaluations and considered syntheses of multiple studies is an easy case to make.”
BackgroundFunnel plots for detecting bias in meta-analysis
Sterne, J. A. C., & Egger, M. (2001) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(01)00377-8 · Cited by 3,779
Cited by
Systematic reviews: CRD's guidance for undertaking reviews in health care
Tacconelli, E. (2010) · The Lancet Infectious Diseases · doi:10.1016/s1473-3099(10)70065-7 · Cited by 3,245
Effective techniques in healthy eating and physical activity interventions: A meta-regression.
Michie, S., Abraham, C., Whittington, C., McAteer, J., & Gupta, S. (2009) · Health Psychology · doi:10.1037/a0016136 · Cited by 2,229
Hayes, S. A., & Watson, S. L. (2013) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-012-1604-y · Cited by 1,847
Salanti, G. (2012) · Research Synthesis Methods · doi:10.1002/jrsm.1037 · Cited by 1,729
Quantifying publication bias in meta-analysis
Lin, L., & Chu, H. (2018) · Biometrics · doi:10.1111/biom.12817 · Cited by 1,674
Dias, S., Sutton, A. J., Ades, A. E., & Welton, N. J. (2013) · Medical Decision Making · doi:10.1177/0272989x12458724 · Cited by 1,207
Self-citationMethodological issues and advances in biological meta-analysis
Nakagawa, S., & Santos, E. S. A. (2012) · Evolutionary Ecology · doi:10.1007/s10682-012-9555-5 · Cited by 1,032
O'Shea, R. S., Dasarathy, S., & McCullough, A. J. (2010) · Hepatology · doi:10.1002/hep.23258 · Cited by 1,077
Kennedy-Martin, T., Curtis, S., Faries, D., Robinson, S., & Johnston, J. (2015) · Trials · doi:10.1186/s13063-015-1023-4 · Cited by 878
Harbord, R. M., & Higgins, J. P. T. (2008) · The Stata Journal: Promoting communications on statistics and Stata · doi:10.1177/1536867x0800800403 · Cited by 897
Self-citationMultivariate meta-analysis for non-linear and other multi-parameter associations
Gasparrini, A., Armstrong, B., & Kenward, M. G. (2012) · Statistics in Medicine · doi:10.1002/sim.5471 · Cited by 772
Hoaglin, D. C., Hawkins, N., Jansen, J. P., Scott, D. A., Itzler, R., Cappelleri, J. C., Boersma, C., Thompson, D., Larholt, K. M., Diaz, M., et al. (2011) · Value in Health · doi:10.1016/j.jval.2011.01.011 · Cited by 770
Hong, Q. N., Pluye, P., Bujold, M., & Wassef, M. (2017) · Systematic Reviews · doi:10.1186/s13643-017-0454-2 · Cited by 754
“Meta-analysis [58] To obtain a single summarized “effect size.”
MethodHan, B., & Eskin, E. (2011) · The American Journal of Human Genetics · doi:10.1016/j.ajhg.2011.04.014 · Cited by 680
Meta-evaluation of meta-analysis: ten appraisal questions for biologists
Nakagawa, S., Noble, D. W. A., Senior, A. M., & Lagisz, M. (2017) · BMC Biology · doi:10.1186/s12915-017-0357-7 · Cited by 579
Adamina, M., Kehlet, H., Tomlinson, G. A., Senagore, A. J., & Delaney, C. P. (2011) · Surgery · doi:10.1016/j.surg.2010.11.003 · Cited by 555
The Use of Propensity Scores to Assess the Generalizability of Results from Randomized Trials
Stuart, E. A., Cole, S. R., Bradshaw, C. P., & Leaf, P. J. (2011) · Journal of the Royal Statistical Society Series A: Statistics in Society · doi:10.1111/j.1467-985x.2010.00673.x · Cited by 524
Dombrowski, S. U., Sniehotta, F. F., Avenell, A., Johnston, M., MacLennan, G., & Araújo-Soares, V. (2012) · Health Psychology Review · doi:10.1080/17437199.2010.513298 · Cited by 504
Price, M. J., Ades, A., Soldan, K., Welton, N. J., Macleod, J., Simms, I., DeAngelis, D., Turner, K. M., & Horner, P. J. (2016) · Health Technology Assessment · doi:10.3310/hta20220 · Cited by 494
Understanding heterogeneity in meta-analysis: the role of meta-regression
Baker, W. L., Michael White, C., Cappelleri, J. C., Kluger, J., Coleman, C. I., & From the Health Outcomes, P. (2009) · International Journal of Clinical Practice · doi:10.1111/j.1742-1241.2009.02168.x · Cited by 492
The ironic effect of significant results on the credibility of multiple-study articles.
Schimmack, U. (2012) · Psychological Methods · doi:10.1037/a0029487 · Cited by 455
Behrns, K. E. (2012) · Yearbook of Surgery · doi:10.1016/j.ysur.2011.11.001 · Cited by 426
Käyser, S. C., Dekkers, T., Groenewoud, H. J., van der Wilt, G. J., Carel Bakx, J., van der Wel, M. C., Hermus, A. R., Lenders, J. W., & Deinum, J. (2016) · The Journal of Clinical Endocrinology & Metabolism · doi:10.1210/jc.2016-1472 · Cited by 398
Signorovitch, J. E., Wu, E. Q., Yu, A. P., Gerrits, C. M., Kantor, E., Bao, Y., Gupta, S. R., & Mulani, P. M. (2010) · PharmacoEconomics · doi:10.2165/11538370-000000000-00000 · Cited by 377
Validating, augmenting and refining genome-wide association signals
Ioannidis, J. P. A., Thomas, G., & Daly, M. J. (2009) · Nature Reviews Genetics · doi:10.1038/nrg2544 · Cited by 375
One-stage dose–response meta-analysis for aggregated data
Crippa, A., Discacciati, A., Bottai, M., Spiegelman, D., & Orsini, N. (2019) · Statistical Methods in Medical Research · doi:10.1177/0962280218773122 · Cited by 365
Get real in individual participant data (IPD) meta‐analysis: a review of the methodology
Debray, T. P. A., Moons, K. G. M., van Valkenhoef, G., Efthimiou, O., Hummel, N., Groenwold, R. H. H., Reitsma, J. B., & on behalf of the GetReal methods review group (2015) · Research Synthesis Methods · doi:10.1002/jrsm.1160 · Cited by 348
Methods for knowledge synthesis: An overview
Whittemore, R., Chao, A., Jang, M., Minges, K. E., & Park, C. (2014) · Heart & Lung · doi:10.1016/j.hrtlng.2014.05.014 · Cited by 349
An extended mixed‐effects framework for meta‐analysis
Sera, F., Armstrong, B., Blangiardo, M., & Gasparrini, A. (2019) · Statistics in Medicine · doi:10.1002/sim.8362 · Cited by 323
Confidence Distribution, the Frequentist Distribution Estimator of a Parameter: A Review
Xie, M., & Singh, K. (2013) · International Statistical Review · doi:10.1111/insr.12000 · Cited by 319
Assessing the generalizability of randomized trial results to target populations
Stuart, E. A., Bradshaw, C. P., & Leaf, P. J. (2015) · Prevention Science · doi:10.1007/s11121-014-0513-z · Cited by 296
Chen, Y., Copeland, W. K., Vedanthan, R., Grant, E., Lee, J. E., Gu, D., Gupta, P. C., Ramadas, K., Inoue, M., Tsugane, S., et al. (2013) · BMJ · doi:10.1136/bmj.f5446 · Cited by 299
Osland, E., Yunus, R. M., Khan, S., & Memon, M. A. (2011) · Journal of Parenteral and Enteral Nutrition · doi:10.1177/0148607110385698 · Cited by 298
Livesey, G., & Taylor, R. (2008) · The American Journal of Clinical Nutrition · doi:10.3945/ajcn.2007.25700 · Cited by 265
Meta-analysis in Second Language Research: Choices and Challenges
Oswald, F. L., & Plonsky, L. (2010) · Annual Review of Applied Linguistics · doi:10.1017/s0267190510000115 · Cited by 237
Gardner, B., Whittington, C., McAteer, J., Eccles, M. P., & Michie, S. (2010) · Social Science & Medicine · doi:10.1016/j.socscimed.2010.01.039 · Cited by 225
Taylor, N., Conner, M., & Lawton, R. (2012) · Health Psychology Review · doi:10.1080/17437199.2010.533441 · Cited by 223
Gagnier, J. J., Moher, D., Boon, H., Beyene, J., & Bombardier, C. (2012) · BMC Medical Research Methodology · doi:10.1186/1471-2288-12-111 · Cited by 222
Meta-analysis in applied ecology
Stewart, G. (2010) · Biology Letters · doi:10.1098/rsbl.2009.0546 · Cited by 214
Neither fixed nor random: weighted least squares meta‐regression
Stanley, T. D., & Doucouliagos, H. (2017) · Research Synthesis Methods · doi:10.1002/jrsm.1211 · Cited by 205
Sample size and power considerations in network meta-analysis
Thorlund, K., & Mills, E. J. (2012) · Systematic Reviews · doi:10.1186/2046-4053-1-41 · Cited by 197
Jolani, S., Debray, T. P. A., Koffijberg, H., van Buuren, S., & Moons, K. G. M. (2015) · Statistics in Medicine · doi:10.1002/sim.6451 · Cited by 192
Is meta-analysis the platinum standard of evidence?
Stegenga, J. (2011) · Studies in History and Philosophy of Science Part C: Studies in History and Philosophy of Biological and Biomedical Sciences · doi:10.1016/j.shpsc.2011.07.003 · Cited by 193
A Conceptual Framework for Critical Appraisal in Systematic Mixed Studies Reviews
Hong, Q. N., & Pluye, P. (2019) · Journal of Mixed Methods Research · doi:10.1177/1558689818770058 · Cited by 139
Verde, P. E., & Ohmann, C. (2015) · Research Synthesis Methods · doi:10.1002/jrsm.1122 · Cited by 123
GREET, J., ANGUS WEBB, J., & COUSENS, R. D. (2011) · Freshwater Biology · doi:10.1111/j.1365-2427.2011.02564.x · Cited by 121
Analyzing cause and effect in environmental assessments: using weighted evidence from the literature
Norris, R. H., Webb, J. A., Nichols, S. J., Stewardson, M. J., & Harrison, E. T. (2012) · Freshwater Science · doi:10.1899/11-027.1 · Cited by 113
Bennett, K., Manassis, K., Walter, S. D., Cheung, A., Wilansky-Traynor, P., Diaz-Granados, N., Duda, S., Rice, M., Baer, S., Barrett, P., et al. (2013) · Depression and Anxiety · doi:10.1002/da.22099 · Cited by 104
Meta-analytic insights into evolutionary ecology: an introduction and synthesis
Nakagawa, S., & Poulin, R. (2012) · Evolutionary Ecology · doi:10.1007/s10682-012-9593-z · Cited by 77
The use of meta-analytic statistical significance testing
Polanin, J. R., & Pigott, T. D. (2015) · Research Synthesis Methods · doi:10.1002/jrsm.1124 · Cited by 78
Antibiotic therapy for pelvic inflammatory disease
Savaris, R. F., Fuhrich, D. G., Maissiat, J., Duarte, R. V., & Ross, J. (2020) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd010285.pub3 · Cited by 81
Bayesian estimation in random effects meta‐analysis using a non‐informative prior
Bodnar, O., Link, A., Arendacká, B., Possolo, A., & Elster, C. (2017) · Statistics in Medicine · doi:10.1002/sim.7156 · Cited by 73
Tanner‐Smith, E. E., Parr, N. J., Schweer‐Collins, M., & Saitz, R. (2022) · Addiction · doi:10.1111/add.15674 · Cited by 54
Kuppens, S., & Onghena, P. (2012) · Research in Autism Spectrum Disorders · doi:10.1016/j.rasd.2011.04.002 · Cited by 38
Rohden, A. I., Benchaya, M. C., Camargo, R. S., Moreira, T. D. C., Barros, H. M. T., & Ferigolo, M. (2017) · Clinical Therapeutics · doi:10.1016/j.clinthera.2017.03.017 · Cited by 35
Sánchez-Meca, J., & Marín-Martínez, F. (2010) · International Encyclopedia of Education · doi:10.1016/b978-0-08-044894-7.01345-2 · Cited by 31
Tak, L. M., Meijer, A., Manoharan, A., de Jonge, P., & Rosmalen, J. G. M. (2010) · Psychosomatic Medicine · doi:10.1097/psy.0b013e3181d714e1 · Cited by 23
Systematic reviews and meta‐analyses in coloproctology: interpretation and potential pitfalls
Wille‐Jørgensen, P., & Renehan, A. G. (2008) · Colorectal Disease · doi:10.1111/j.1463-1318.2007.01421.x · Cited by 19
Metadata
- Authors
- Sutton, A. J., & Higgins, J. P. T.
- Venue
- Statistics in Medicine
- Publisher
- Wiley
- Published
- 2007-06-25
- Volume
- 27
- Issue
- 5
- Pages
- 625-650
- ISSN
- 0277-6715 (ISSN-L)
- 1097-0258
- OpenAlex
- W2001855995
- Cited by
- 590
- References
- 67
- FWCI
- 28.93
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
