Meta-analysis: Neither quick nor easy
Open accessAbstract
BACKGROUND: Meta-analysis is often considered to be a simple way to summarize the existing literature. In this paper we describe how a meta-analysis resembles a conventional study, requiring a written protocol with design elements that parallel those of a record review. METHODS: The paper provides a structure for creating a meta-analysis protocol. Some guidelines for measurement of the quality of papers are given. A brief overview of statistical considerations is included. Four papers are reviewed as examples. The examples generally followed the guidelines we specify in reporting the studies and results, but in some of the papers there was insufficient information on the meta-analysis process. CONCLUSIONS: Meta-analysis can be a very useful method to summarize data across many studies, but it requires careful thought, planning and implementation.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The study followed a rigorous inclusion/exclusion protocol to ensure minimisation of confounding factors amongst the randomized controlled trial populations.
“We followed a rigorous inclusion/exclusion protocol to ensure minimisation of confounding factors amongst the RCT populations [112].”
From Estimating the Effect of Aerobic Exercise Training on Novel Lipid Biomarkers: A Systematic Review and Multivariate Meta-Analysis of Randomized Controlled Trials (2023) · cites this paper as [112]
The Methods section, “Defining the Population of Studies Included in the Meta-Analysis” (page not specified), recommends protocol-defined inclusion and exclusion criteria to safeguard against selection bias. It does not say that such criteria minimise confounding factors among RCT populations. The citing authors’ statement that they followed a protocol is their own account, not something this source can verify. (LLM, conf=0.84)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Meta-analysis in clinical trials
DerSimonian, R., & Laird, N. (1986) · Controlled Clinical Trials · doi:10.1016/0197-2456(86)90046-2 · Cited by 39,552 · see citing works
Dermyshi, E., Wang, Y., Yan, C., Hong, W., Qiu, G., Gong, X., & Zhang, T. (2017) · Neonatology · doi:10.1159/000454668 · Cited by 24,577 · see citing works
Stroup, D. F. (2000) · JAMA · doi:10.1001/jama.283.15.2008 · Cited by 20,623 · see citing works
Wasserman, S. S., Hedges, L. V., & Olkin, I. (1988) · Journal of Educational Statistics · doi:10.2307/1164953 · Cited by 10,347 · see citing works
The file drawer problem and tolerance for null results.
Rosenthal, R. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.3.638 · Cited by 9,068 · see citing works
Primary, Secondary, and Meta-Analysis of Research
GLASS, G. V. (1976) · Educational Researcher · doi:10.3102/0013189x005010003 · Cited by 4,890 · see citing works
Publication bias in clinical research
Easterbrook, P. J., Gopalan, R., Berlin, J. A., & Matthews, D. R. (1991) · The Lancet · doi:10.1016/0140-6736(91)90201-y · Cited by 3,109 · cited 2× · see citing works
“As we mentioned in the introduction, there is some disagreement on this subject [5,6,9,11,12,15, 16 ].”
Meta-Analysis: Quantitative Methods for Research Synthesis
Rosenthal, R., & Wolf, F. M. (1987) · Contemporary Sociology A Journal of Reviews · doi:10.2307/2071646 · Cited by 1,371 · see citing works
A method for assessing the quality of a randomized control trial
Chalmers, T. C., Smith, H., Blackburn, B., Silverman, B., Schroeder, B., Reitman, D., & Ambroz, A. (1981) · Controlled Clinical Trials · doi:10.1016/0197-2456(81)90056-8 · Cited by 1,349 · see citing works
Moher, D., Jadad, A. R., Nichol, G., Penman, M., Tugwell, P., & Walsh, S. (1995) · Controlled Clinical Trials · doi:10.1016/0197-2456(94)00031-w · Cited by 1,308 · see citing works
Review papers : The statistical basis of meta-analysis
Fleiss, J. (1993) · Statistical Methods in Medical Research · doi:10.1177/096228029300200202 · Cited by 1,284 · see citing works
Meta-Analysis in Clinical Research
L'ABBÉ, K. A., DETSKY, A. S., & O'ROURKE, K. (1987) · Annals of Internal Medicine · doi:10.7326/0003-4819-107-2-224 · Cited by 1,267 · see citing works
Meta-Analyses of Randomized Controlled Trials
Sacks, H. S., Berrier, J., Reitman, D., Ancona-Berk, V. A., & Chalmers, T. C. (1987) · New England Journal of Medicine · doi:10.1056/nejm198702193160806 · Cited by 1,253 · see citing works
Discrepancies between Meta-Analyses and Subsequent Large Randomized, Controlled Trials
LeLorier, J., Grégoire, G., Benhaddad, A. A., Lapierre, J., & Derderian, F. (1997) · New England Journal of Medicine · doi:10.1056/nejm199708213370806 · Cited by 1,171 · see citing works
Dickersin, K., Yuan, M.-Q., & Meinert, C. (1992) · Journal of the American Medical Association (JAMA) · doi:10.1001/jama.1992.03480030052036 · Cited by 900 · see citing works
Glucosamine and Chondroitin for Treatment of Osteoarthritis
McAlindon, T. E., LaValley, M. P., Gulin, J. P., & Felson, D. T. (2000) · JAMA · doi:10.1001/jama.283.11.1469 · Cited by 848 · see citing works
Incorporating variations in the quality of individual randomized trials into meta-analysis
Detsky, A. S., Naylor, C. D., O'Rourke, K., McGeer, A. J., & L'Abbé, K. A. (1992) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(92)90085-2 · Cited by 640 · see citing works
Brand, J. L. (1997) · Digital Commons - Andrews University (Andrews University) · Cited by 535 · see citing works
Grégoire, G., Derderian, F., & LeLorier, J. (1995) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(94)00098-b · Cited by 527 · see citing works
Meta-analysis: State-of-the-Science
Dickersin, K., & Berlin, J. A. (1992) · Epidemiologic Reviews · doi:10.1093/oxfordjournals.epirev.a036084 · Cited by 502 · see citing works
Thompson, S. G., & Pocock, S. (1991) · The Lancet · doi:10.1016/0140-6736(91)91975-z · Cited by 489 · see citing works
Approaches to heterogeneity in meta‐analysis
Petitti, D. B. (2001) · Statistics in Medicine · doi:10.1002/sim.1091 · Cited by 469 · see citing works
A comparison of statistical methods for combining event rates from clinical trials
Berlin, J. A., Laird, N. M., Sacks, H. S., & Chalmers, T. C. (1989) · Statistics in Medicine · doi:10.1002/sim.4780080202 · Cited by 420 · see citing works
The Promise and Problems of Meta-Analysis
Bailar, J. C. (1997) · New England Journal of Medicine · doi:10.1056/nejm199708213370810 · Cited by 407 · see citing works
Ischemic Stroke Risk With Oral Contraceptives
Gillum, L. A., Mamidipudi, S. K., & Johnston, S. C. (2000) · JAMA · doi:10.1001/jama.284.1.72 · Cited by 395 · see citing works
Meta-analysis: Statistical alchemy for the 21st century
Feinstein, A. R. (1995) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(94)00110-c · Cited by 335 · see citing works
Gray, A., Berlin, J. A., McKinlay, J. B., & Longcope, C. (1991) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(91)90028-8 · Cited by 315 · see citing works
Chalmers, T. C., Levin, H. R., Sacks, H. S., Reitman, D., Berrier, J., & Nagalingam, R. (1987) · Statistics in Medicine · doi:10.1002/sim.4780060320 · Cited by 247 · see citing works
Meta-analysis. A quantitative approach to research integration
Thacker, S. B. (1988) · JAMA · doi:10.1001/jama.259.11.1685 · Cited by 237 · see citing works
Caubet, J.-F., Tosteson, T. D., Dong, E. W., Naylon, E. M., Whiting, G. W., Ernstoff, M. S., & Ross, S. D. (1997) · Urology · doi:10.1016/s0090-4295(96)00325-1 · Cited by 203 · see citing works
Dickersin, K. (1992) · JAMA · doi:10.1001/jama.267.3.374 · Cited by 193 · see citing works
Thacker, S. B. (1988) · JAMA · doi:10.1001/jama.1988.03720110047033 · Cited by 150 · see citing works
Problems induced by meta-analyses.
Chalmers, T. (1991) · Statistics in Medicine · doi:10.1002/sim.4780100618 · Cited by 148 · see citing works
Meta-analysis of randomized controlled trials. A concern for standards;
Moher, D. (1995) · JAMA · doi:10.1001/jama.274.24.1962 · Cited by 132 · see citing works
The potential and limitations of meta-analysis.
Spector, T. D., & Thompson, S. G. (1991) · Journal of Epidemiology & Community Health · doi:10.1136/jech.45.2.89 · Cited by 122 · see citing works
Models for estimating the number of unpublished studies.
Gleser, L., & Olkin, I. (1996) · Statistics in Medicine · doi:10.1002/(sici)1097-0258(19961215)15:23 · Cited by 116 · see citing works
Villar, J., Mackey, M. E., Carroli, G., & Donner, A. (2001) · Statistics in Medicine · doi:10.1002/sim.1096 · Cited by 96 · see citing works
Keynote addresses. Meta‐analysis: Reconciling the results of independent studies
Olkin, I. (1995) · Statistics in Medicine · doi:10.1002/sim.4780140507 · Cited by 86 · see citing works
Clinical Trials and Meta-Analysis
Kassirer, J. P. (1992) · New England Journal of Medicine · doi:10.1056/nejm199207233270411 · Cited by 80 · see citing works
Meta-analysis of Randomized Controlled Trials
Moher, D. (1995) · JAMA · doi:10.1001/jama.1995.03530240072044 · Cited by 76 · see citing works
Lee, W. (1997) · Statistics in Medicine · doi:10.1002/(sici)1097-0258(19970415)16:7 · Cited by 74 · see citing works
Meta-meth-analysis: Unanswered questions about aggregating data
Spitzer, W. O. (1991) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(91)90258-b · Cited by 67 · see citing works
Liberati, A. (1995) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(94)00115-7 · Cited by 30 · see citing works
A consumer's guide to meta‐analysis
LaValley, M. P. (1997) · Arthritis & Rheumatism · doi:10.1002/art.1790100309 · Cited by 12 · see citing works
Flagged first, then by citations
Research works printed but not linked: 3
- Stein RA Meta-analysis from one FDA reviewer's perspective. 1988 Proceedings of the American Statistical Association Biopharmaceutical Section 1988 34 38
- Hedges LV Olkin I Statistical Methods for Meta-Analysis London: Academic Press 1985
- Fleiss JL The statistical basis of meta-analysis. Stat Methods Med Res 1993 2 121 145 8261254
Cited by
Sorted by citations
Psychotherapy Relationships That Work
Norcross, J. C. (2011) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780199737208.001.0001 · Cited by 948 · see citing works
Roelfs, D. J., Shor, E., Davidson, K. W., & Schwartz, J. E. (2011) · Social Science & Medicine · doi:10.1016/j.socscimed.2011.01.005 · Cited by 759 · see citing works
Mantyka‐Pringle, C., Martin, T. G., & Rhodes, J. R. (2011) · Global Change Biology · doi:10.1111/j.1365-2486.2011.02593.x · Cited by 752 · see citing works
Elliott, R., Bohart, A. C., Watson, J. C., & Greenberg, L. S. (2011) · Psychotherapy · doi:10.1037/a0022187 · Cited by 511 · see citing works
Publication Bias in the Organizational Sciences
Kepes, S., Banks, G. C., McDaniel, M. A., & Whetzel, D. L. (2012) · Organizational Research Methods · doi:10.1177/1094428112452760 · Cited by 400 · see citing works
A systematic review and meta-analysis of treatments for aortic graft infection
O’Connor, S., Andrew, P., Batt, M., & Becquemin, J. (2006) · Journal of Vascular Surgery · doi:10.1016/j.jvs.2006.02.053 · Cited by 355 · see citing works
Spencer, C. M., & Stith, S. (2018) · Trauma, Violence, & Abuse · doi:10.1177/1524838018781101 · Cited by 289 · see citing works
A re‐evaluation of fixed effect(s) meta‐analysis
Rice, K., Higgins, J. P. T., & Lumley, T. (2018) · Journal of the Royal Statistical Society Series A: Statistics in Society · doi:10.1111/rssa.12275 · Cited by 287 · see citing works
Loneliness in Psychosis: A Meta-analytical Review
da Rocha, B. M., Rhodes, S., Vasilopoulou, E., & Hutton, P. (2017) · Schizophrenia Bulletin · doi:10.1093/schbul/sbx036 · Cited by 286 · see citing works
Phung, D. T., Thai, P. K., Guo, Y., Morawska, L., Rutherford, S., & Chu, C. M.-Y. (2016) · The Science of The Total Environment · doi:10.1016/j.scitotenv.2016.01.154 · Cited by 274 · see citing works
Abbas, A., Hefnawy, M. T., & Negida, A. (2024) · BMC Medical Research Methodology · doi:10.1186/s12874-024-02356-6 · Cited by 270 · see citing works
Probiotic Administration in Early Life, Atopy, and Asthma: A Meta-analysis of Clinical Trials
Elazab, N., Mendy, A., Gasana, J., Vieira, E. R., Quizon, A., & Forno, E. (2013) · PEDIATRICS · doi:10.1542/peds.2013-0246 · Cited by 269 · see citing works
Shor, E., Roelfs, D. J., & Yogev, T. (2013) · Social Networks · doi:10.1016/j.socnet.2013.08.004 · Cited by 266 · see citing works
Margaliot, Z., Haase, S. C., Kotsis, S. V., Kim, H. M., & Chung, K. C. (2005) · The Journal Of Hand Surgery · doi:10.1016/j.jhsa.2005.08.009 · Cited by 259 · see citing works
Gupta, B., & Johnson, N. W. (2014) · PLoS ONE · doi:10.1371/journal.pone.0113385 · Cited by 257 · see citing works
Kosiba, J. D., Maisto, S. A., & Ditre, J. W. (2019) · Social Science & Medicine · doi:10.1016/j.socscimed.2019.06.005 · Cited by 238 · see citing works
Shor, E., Roelfs, D. J., & Vang, Z. M. (2017) · Social Science & Medicine · doi:10.1016/j.socscimed.2017.05.049 · Cited by 233 · see citing works
How frequent does peri-implantitis occur? A systematic review and meta-analysis
Rakić, M., Galindo‐Moreno, P., Monje, A., Radovanović, S., Wang, H., Cochran, D. L., Sculean, A., & Canullo, L. (2017) · Clinical Oral Investigations · doi:10.1007/s00784-017-2276-y · Cited by 234 · see citing works
Kepes, S., McDaniel, M. A., Brannick, M. Τ., & Banks, G. C. (2013) · Journal of Business and Psychology · doi:10.1007/s10869-013-9300-2 · Cited by 221 · see citing works
Widowhood and Mortality: A Meta-Analysis and Meta-Regression
Shor, E., Roelfs, D. J., Curreli, M. A., Clemow, L., Burg, M. M., & Schwartz, J. E. (2012) · Demography · doi:10.1007/s13524-012-0096-x · Cited by 213 · see citing works
Risk Factors for Chronic and Recurrent Otitis Media–A Meta-Analysis
Zhang, Y., Xu, M., Zhang, J., Zeng, L., Wang, Y., & Zheng, Q. Y. (2014) · PLoS ONE · doi:10.1371/journal.pone.0086397 · Cited by 179 · see citing works
Olusanya, B. O., Osibanjo, F., & Slusher, T. M. (2015) · PLoS ONE · doi:10.1371/journal.pone.0117229 · Cited by 175 · see citing works
Tyler, C. J., Sunderland, C. D., & Cheung, S. S. (2013) · British Journal of Sports Medicine · doi:10.1136/bjsports-2012-091739 · Cited by 174 · see citing works
Cardiovascular Function Following Surgical Repair of Pectus Excavatum
Malek, M. H., Berger, D. E., Housh, T. J., Marelich, W. D., Coburn, J. W., & Beck, T. W. (2006) · CHEST Journal · doi:10.1378/chest.130.2.506 · Cited by 167 · see citing works
Meta-analysis of marital dissolution and mortality: Reevaluating the intersection of gender and age
Shor, E., Roelfs, D. J., Bugyi, P., & Schwartz, J. E. (2012) · Social Science & Medicine · doi:10.1016/j.socscimed.2012.03.010 · Cited by 163 · see citing works
Examining the relations between spatial skills and mathematical performance: A meta-analysis
Atit, K., Power, J., Pigott, T., Lee, J., Geer, E. A., Uttal, D. H., Ganley, C. M., & Sorby, S. (2021) · Psychonomic Bulletin & Review · doi:10.3758/s13423-021-02012-w · Cited by 174 · see citing works
A review of parenting and adolescent sexual behavior: The moderating role of gender
Kincaid, C., Jones, D. J., Sterrett, E., & McKee, L. G. (2012) · Clinical Psychology Review · doi:10.1016/j.cpr.2012.01.002 · Cited by 159 · see citing works
de Boer, J., Lok, A., Verlaat, E. V., Duivenvoorden, H. J., Bakker, A. B., & Smit, B. J. (2011) · Social Science & Medicine · doi:10.1016/j.socscimed.2011.05.009 · Cited by 148 · see citing works
Cai, S., Zhou, J., & Pan, J. (2021) · Statistical Methods in Medical Research · doi:10.1177/09622802211047348 · Cited by 144 · see citing works
Social contact frequency and all-cause mortality: a meta-analysis and meta-regression
Shor, E., & Roelfs, D. J. (2015) · Social Science & Medicine · doi:10.1016/j.socscimed.2015.01.010 · Cited by 140 · see citing works
Body mass index and risk of pneumonia: a systematic review and meta‐analysis
Phung, D. T., Wang, Z., Rutherford, S., Huang, C. L., & Chu, C. M.-Y. (2013) · Obesity Reviews · doi:10.1111/obr.12055 · Cited by 140 · see citing works
Jacobs, M., Zhang, G., Chen, S., Mullins, B. J., Bell, M. L., Jin, L., Guo, Y., Huxley, R., & Pereira, G. F. (2016) · The Science of The Total Environment · doi:10.1016/j.scitotenv.2016.11.100 · Cited by 136 · see citing works
Systematic review of the effect of the psychosocial working environment on cognition and dementia
Then, F. S., Luck, T., Luppa, M., Thinschmidt, M., Deckert, S., Nieuwenhuijsen, K., Seidler, A., & Riedel-Heller, S. G. (2013) · Occupational and Environmental Medicine · doi:10.1136/oemed-2013-101760 · Cited by 133 · see citing works
Wang, L. A. L., Petrulla, V., Zampella, C., Waller, R. E., & Schultz, R. T. (2022) · Psychological Bulletin · doi:10.1037/bul0000358 · Cited by 141 · see citing works
Arnold, L. W., & Wang, Z. (2014) · The Review of Diabetic Studies · doi:10.1900/rds.2014.11.138 · Cited by 126 · see citing works
A Research Methodology to Conduct Effective Research Syntheses: Meta-Analysis
Üstün, U., & Eryılmaz, A. (2014) · TED EĞİTİM VE BİLİM · doi:10.15390/eb.2014.3379 · Cited by 122 · see citing works
Pulmonary function following surgical repair of pectus excavatum: a meta-analysis
Malek, M. H., Berger, D. E., Marelich, W. D., Coburn, J. W., Beck, T. W., & Housh, T. J. (2006) · European Journal of Cardio-Thoracic Surgery · doi:10.1016/j.ejcts.2006.07.004 · Cited by 122 · see citing works
Pripp, A. H. (2008) · Food & Nutrition Research · doi:10.3402/fnr.v52i0.1641 · Cited by 112 · see citing works
A meta-analysis of the association between anger and aggressive driving
Bogdan-Ganea, S. R., Măirean, C., & Havârneanu, C.-E. (2016) · Transportation Research Part F Traffic Psychology and Behaviour · doi:10.1016/j.trf.2016.05.009 · Cited by 110 · see citing works
A Meta-Analysis of Outcomes After In Situ Reconstructions for Aortic Graft Infection
Batt, M., Feugier, P., Camou, F., Coffy, A., Senneville, E., Caillon, J., Calvet, B., Chidiac, C., Laurent, F. J., Revest, M., et al. (2017) · Angiology · doi:10.1177/0003319717710114 · Cited by 106 · see citing works
Systematic review and meta-analysis: a primer.
Impellizzeri, F. M., & Bizzini, M. (2012) · Europe PMC (PubMed Central) · Cited by 105 · see citing works
Barrera, T. L., Mott, J. M., Hofstein, R. F., & Teng, E. J. (2013) · Clinical Psychology Review · doi:10.1016/j.cpr.2012.09.005 · Cited by 103 · see citing works
Serum lipids and lipoproteins in malaria - a systematic review and meta-analysis
Visser, B. J., Wieten, R. W., Nagel, I. M., & Grobusch, M. P. (2013) · Malaria Journal · doi:10.1186/1475-2875-12-442 · Cited by 99 · see citing works
Spencer, C. M., Keilholtz, B. M., & Stith, S. M. (2020) · Family Process · doi:10.1111/famp.12545 · Cited by 100 · see citing works
Cysique, L. A., Waters, E. K., & Brew, B. J. (2011) · BMC Neurology · doi:10.1186/1471-2377-11-148 · Cited by 94 · see citing works
Residential Traffic Exposure and Childhood Leukemia
Boothe, V. L., Boehmer, T. K., Wendel, A. M., & Yip, F. Y. (2014) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2013.11.004 · Cited by 94 · see citing works
El‐Zein, M., Parent, M., Benedetti, A., & Rousseau, M. (2009) · International Journal of Epidemiology · doi:10.1093/ije/dyp307 · Cited by 91 · see citing works
Lenters, V. C., Basinas, I., Freeman, L. E. B., Boffetta, P., Checkoway, H., Coggon, D., Portengen, L., Sim, M. R., Wouters, I. M., Heederik, D. J. J., et al. (2009) · Cancer Causes & Control · doi:10.1007/s10552-009-9483-z · Cited by 90 · see citing works
Setti, A. S., Figueira, R. C. S., Braga, D. P. A. F., Colturato, S. S., Iaconelli, A., & Borges, E. (2011) · European Journal of Obstetrics & Gynecology and Reproductive Biology · doi:10.1016/j.ejogrb.2011.07.031 · Cited by 89 · see citing works
Nyland, J. A., Collis, P., Huffstutler, A., Sachdeva, S., Spears, J. R., Greene, J. W., & Caborn, D. N. M. (2019) · Knee Surgery Sports Traumatology Arthroscopy · doi:10.1007/s00167-019-05720-y · Cited by 87 · see citing works
Leonardi, R. M., Annunziata, A., Licciardello, V., & Barbato, E. (2009) · The Angle Orthodontist · doi:10.2319/010709-16.1 · Cited by 87 · see citing works
HIIT is not superior to MICT in altering blood lipids: a systematic review and meta-analysis
Wood, G., Murrell, A., van der Touw, T., & Smart, N. (2019) · BMJ Open Sport & Exercise Medicine · doi:10.1136/bmjsem-2019-000647 · Cited by 85 · see citing works
Wells, M., Goldstein, L. N., & Bentley, A. (2017) · International Journal of Emergency Medicine · doi:10.1186/s12245-017-0156-5 · Cited by 85 · see citing works
Vyas, K. J., Delaney, E. M., Webb-Murphy, J. A., & Johnston, S. L. (2016) · Military Medicine · doi:10.7205/milmed-d-15-00473 · Cited by 80 · see citing works
The Rising Relative Risk of Mortality for Singles: Meta-Analysis and Meta-Regression
Roelfs, D. J., Shor, E., Kalish, R., & Yogev, T. (2011) · American Journal of Epidemiology · doi:10.1093/aje/kwr111 · Cited by 84 · see citing works
Alabed, S., Cabello, J. B., Irving, G. J., Qintar, M., & Burls, A. (2014) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd010652.pub2 · Cited by 81 · see citing works
Haag, G., Diener, H.-C., May, A., Meyer, C., Morck, H., Straube, A., Wessely, P., & Evers, S. (2011) · The Journal of Headache and Pain · doi:10.1007/s10194-010-0266-4 · Cited by 78 · see citing works
Heath, A. K., Ganz, J. B., Parker, R., Burke, M. D., & Ninci, J. (2015) · Review Journal of Autism and Developmental Disorders · doi:10.1007/s40489-014-0044-3 · Cited by 77 · see citing works
Self-citationFisher, H. R., Toit, G. D., & Lack, G. (2010) · Archives of Disease in Childhood · doi:10.1136/adc.2009.172460 · Cited by 77 · see citing works
Gutman, B. A., van Erp, T. G. M., Alpert, K. I., Ching, C. R. K., Isaev, D., Ragothaman, A., Jahanshad, N., Saremi, A., Zavaliangos‐Petropulu, A., Glahn, D. C., et al. (2021) · Human Brain Mapping · doi:10.1002/hbm.25625 · Cited by 76 · see citing works
Quality of Conduct and Reporting of Meta-analyses of Surgical Interventions
Adie, S., F., D. D., Harris, I. A., Naylor, J., & Craig, J. C. (2015) · Annals of Surgery · doi:10.1097/sla.0000000000000836 · Cited by 76 · see citing works
CULTURAL AND ETHNIC BIAS IN TEACHER RATINGS OF BEHAVIOR: A CRITERION‐FOCUSED REVIEW
Mason, B. A., Gunersel, A. B., & Ney, E. A. (2014) · Psychology in the Schools · doi:10.1002/pits.21800 · Cited by 74 · see citing works
Zamparini, F., Lenzi, J., Duncan, H. F., Spinelli, A., Gandolfi, M. G., & Prati, C. (2024) · International Endodontic Journal · doi:10.1111/iej.14069 · Cited by 71 · see citing works
How far can we go? A 20-year meta-analysis of dental implant survival rates
Kupka, J. R., König, J., Al‐Nawas, B., Sagheb, K., & Schiegnitz, E. (2024) · Clinical Oral Investigations · doi:10.1007/s00784-024-05929-3 · Cited by 71 · see citing works
Pabalan, N., Bapat, B. V., Sung, L., Jarjanazi, H., Francisco-Pabalan, O., & Özçelik, H. (2008) · Cancer Epidemiology Biomarkers & Prevention · doi:10.1158/1055-9965.epi-08-0169 · Cited by 67 · see citing works
Systematic Reviews: A Primer for Plastic Surgery Research
Margaliot, Z., & Chung, K. C. (2007) · Plastic & Reconstructive Surgery · doi:10.1097/01.prs.0000295984.24890.2f · Cited by 68 · see citing works
Smith, W. C., Anderson, E. W., Salinas, D., Horvatek, R., & Baker, D. P. (2014) · Social Science & Medicine · doi:10.1016/j.socscimed.2014.10.027 · Cited by 67 · see citing works
Liu, Q., Ayoub‐Charette, S., Khan, T. A., Au‐Yeung, F., Blanco Mejia, S., de Souza, R. J., Wolever, T. M. S., Leiter, L. A., Kendall, C. W. C., & Sievenpiper, J. L. (2019) · Journal of the American Heart Association · doi:10.1161/jaha.118.010977 · Cited by 65 · see citing works
Goodman, C. S., Hur, J., Adajar, M. A., & Coulam, C. H. (2009) · American Journal of Roentgenology · doi:10.2214/ajr.08.1927 · Cited by 65 · see citing works
Ruben, M. A., & Fullerton, M. (2018) · Patient Education and Counseling · doi:10.1016/j.pec.2018.05.001 · Cited by 64 · see citing works
Shor, E., & Roelfs, D. J. (2013) · Journal for the Scientific Study of Religion · doi:10.1111/jssr.12006 · Cited by 63 · see citing works
Wells, M., Goldstein, L. N., Bentley, A., Basnett, S., & Monteith, I. (2017) · Resuscitation · doi:10.1016/j.resuscitation.2017.09.026 · Cited by 61 · see citing works
How to Perform a Systematic Review and Meta-analysis of Diagnostic Imaging Studies
Cronin, P., Kelly, A. M., Altaee, D. K., Foerster, B. R., Petrou, M., & Dwamena, B. A. (2018) · Academic Radiology · doi:10.1016/j.acra.2017.12.007 · Cited by 61 · see citing works
Methodology and reporting of meta-analyses in the neurosurgical literature
Klimo, P., Thompson, C. J., Ragel, B. T., & Boop, F. A. (2014) · Journal of neurosurgery · doi:10.3171/2013.11.jns13195 · Cited by 60 · see citing works
Singh, V. P., Pratap, K., Sinha, J., Desiraju, B. K., Bahal, D., & Kukreti, R. (2016) · International Journal of Immunopathology and Pharmacology · doi:10.1177/0394632016671728 · Cited by 54 · see citing works
Shen, X., Liu, T., Xu, S., Chen, B., Tang, X., Xiao, J., & Qin, Y. (2022) · JAMA Network Open · doi:10.1001/jamanetworkopen.2022.42742 · Cited by 53 · see citing works
Obesity and post‐operative cognitive dysfunction: a systematic review and meta‐analysis
Feinkohl, I., Winterer, G., & Pischon, T. (2016) · Diabetes/Metabolism Research and Reviews · doi:10.1002/dmrr.2786 · Cited by 53 · see citing works
Effect of Statin on Cancer Incidence: An Umbrella Systematic Review and Meta-Analysis
Jeong, G. H., Lee, K. H., Kim, J. Y., Eisenhut, M., Kronbichler, A., van der Vliet, H. J., Hong, S. H., Shin, J. I., & Gamerith, G. (2019) · Journal of Clinical Medicine · doi:10.3390/jcm8060819 · Cited by 53 · see citing works
Student-Report Measures of School Climate: A Dimensional Review
Lewno, B. M., Mason, B. A., Hajovsky, D. B., & Villeneuve, E. F. (2019) · School Mental Health · doi:10.1007/s12310-019-09340-2 · Cited by 64 · see citing works
Liu, H., Yang, M., Li, G.-M., Qiu, Y., Zheng, J., Du, X., Wang, J.-L., & Liu, R.-W. (2010) · Journal of the Neurological Sciences · doi:10.1016/j.jns.2010.04.001 · Cited by 51 · see citing works
Brell, M., Ibáñez, J., & Tortosa, A. (2011) · BMC Cancer · doi:10.1186/1471-2407-11-35 · Cited by 50 · see citing works
Gender difference in snoring and how it changes with age: systematic review and meta-regression
Chan, C., Wong, B. M. L., Tang, J.-L., & Ng, D. K. (2011) · Sleep And Breathing · doi:10.1007/s11325-011-0596-8 · Cited by 47 · see citing works
Maredia, M. K. (2009) · RePEc: Research Papers in Economics · Cited by 47 · see citing works
Sartorello, Y., Pastorino, A., Bogliani, G., Ghidotti, S., Viterbi, R., & Cerrato, C. (2020) · Journal for Nature Conservation · doi:10.1016/j.jnc.2020.125863 · Cited by 46 · see citing works
Liu, X., Cheng, D., Kuang, Q., Liu, G., & Xu, W. (2013) · PLoS ONE · doi:10.1371/journal.pone.0058489 · Cited by 46 · see citing works
Meta-analysis of two ERCC2 (XPD) polymorphisms, Asp312Asn and Lys751Gln, in breast cancer
Pabalan, N., Francisco-Pabalan, O., Sung, L., Jarjanazi, H., & Özçelik, H. (2010) · Breast Cancer Research and Treatment · doi:10.1007/s10549-010-0863-6 · Cited by 46 · see citing works
A Meta-Analysis of Outcomes of Hydration Intervention on Phonation Threshold Pressure
Leydon, C., Wróblewski, M., Eichorn, N., & Sivasankar, M. P. (2010) · Journal of Voice · doi:10.1016/j.jvoice.2009.06.001 · Cited by 46 · see citing works
A Global Meta-analysis of the Immigrant Mortality Advantage
Shor, E., & Roelfs, D. J. (2021) · International Migration Review · doi:10.1177/0197918321996347 · Cited by 45 · see citing works
Wood, G., Taylor, E., Ng, V., Murrell, A., Patil, A., van der Touw, T., Sigal, R., Wolden, M., & Smart, N. (2022) · British Journal of Sports Medicine · doi:10.1136/bjsports-2021-103999 · Cited by 45 · see citing works
A Practical Guide to Meta-Analysis
Chung, K. C., Burns, P. B., & Kim, H. M. (2006) · The Journal Of Hand Surgery · doi:10.1016/j.jhsa.2006.09.002 · Cited by 45 · see citing works
Integrin, alpha 2 gene C807T polymorphism and risk of ischemic stroke: A meta-analysis
Nikolopoulos, G. K., Tsantes, A. Ε., Bagos, P. G., Travlou, Α., & Vaiopoulos, G. (2006) · Thrombosis Research · doi:10.1016/j.thromres.2006.04.002 · Cited by 42 · see citing works
Kasalak, G., Güneri, B., Ehtíyar, R., Apaydın, Ç., & Türker, G. Ö. (2022) · Frontiers in Psychology · doi:10.3389/fpsyg.2022.1038824 · Cited by 41 · see citing works
Plasminogen activator inhibitor-1 4G/5G polymorphism and risk of ischemic stroke: a meta-analysis
Tsantes, A. Ε., Nikolopoulos, G. K., Bagos, P. G., Tsiara, C. G., Kapsimali, V., Travlou, Α., & Vaiopoulos, G. (2007) · Blood Coagulation & Fibrinolysis · doi:10.1097/mbc.0b013e3281ec4eee · Cited by 41 · see citing works
Association of 5-HTT gene polymorphisms with migraine: A systematic review and meta-analysis
Liu, H., Liu, M., Wang, Y., Wang, X. M., Qiu, Y. F., Long, J.-F., & Zhang, S. (2011) · Journal of the Neurological Sciences · doi:10.1016/j.jns.2011.03.016 · Cited by 38 · see citing works
Information system users’ creativity
Pacauskas, D., & Rajala, R. (2017) · Information Technology and People · doi:10.1108/itp-04-2015-0090 · Cited by 38 · see citing works
de Toledo, T. D. S., Roll, A. P., Rutz, F., Dallmann, H. M., Prá, M. A. D., Leite, F. L., & Roll, V. (2020) · PLoS ONE · doi:10.1371/journal.pone.0232853 · Cited by 44 · see citing works
Setti, A. S., Braga, D. P. A. F., Figueira, R. C. S., Iaconelli, A., & Borges, E. (2014) · European Journal of Obstetrics & Gynecology and Reproductive Biology · doi:10.1016/j.ejogrb.2014.10.008 · Cited by 37 · see citing works
Wells, M., Goldstein, L. N., & Bentley, A. (2017) · African Journal of Emergency Medicine · doi:10.1016/j.afjem.2017.06.001 · Cited by 37 · see citing works
The Impact of Capsaicin Intake on Risk of Developing Gastric Cancers: A Meta-Analysis
Pabalan, N., Jarjanazi, H., & Özçelik, H. (2014) · Journal of Gastrointestinal Cancer · doi:10.1007/s12029-014-9610-2 · Cited by 37 · see citing works
Quality assessment in meta-analysis
Torre, G. L., Chiaradia, G., Gianfagna, F., Laurentis, A. D., & Boccia, S. (2006) · Italian Journal of Public Health · doi:10.2427/5937 · Cited by 38 · see citing works
- Authors
- Berman, N. G., & Parker, R. A.
- Affiliations
- Harbor–UCLA Medical Center (US)
- Beth Israel Deaconess Medical Center (US)
- Corresponding author
- Berman, Nancy G
- ORCID
- Parker, Robert A
- Venue
- BMC Medical Research Methodology
- Published
- 2002-08-09
- Volume
- 2
- Issue
- 1
- Pages
- 10-10
- ISSN
- 1471-2288 (ISSN-L)
- PMC
- PMC122061
- OpenAlex
- W2123303485
- Cited by
- 270
- References
- 43
- Citations by year
- 2026: 5 · 2025: 7 · 2024: 13 · 2023: 15 · 2022: 9 · 2021: 14 · 2020: 10 · 2019: 13 · 2018: 10 · 2017: 17 · 2016: 20 · 2015: 11 · 2014: 20 · 2013: 15 · 2012: 16
- FWCI
- 2.67
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- BMC Medical Research Methodology (publishedVersion)
- PubMed Central (publishedVersion, other-oa)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- National Institutes of Health (RR00425, RR 01032)
- National Center for Research Resources (RR 01032, M01RR001032, RR00425, M01RR000425)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Social Sciences › Sociology and Political Science › Delphi Technique in Research
- Keywords
- meta-analysis, protocol design, study quality assessment, reporting guidelines, statistical considerations, research planning
- MeSH terms
- Data Collection, Demography, Humans, Meta-Analysis as Topic, Treatment Outcome, Guidelines as Topic
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
