How to do a meta‐analysis
Abstract
Meta‐analysis is a statistical tool for estimating the mean and variance of underlying population effects from a collection of empirical studies addressing ostensibly the same research question. Meta‐analysis has become an increasing popular and valuable tool in psychological research, and major review articles typically employ these methods. This article describes the process of conducting meta‐analysis: selecting articles, developing inclusion criteria, calculating effect sizes, conducting the actual analysis (including information on how to do the analysis on popular computer packages such as IBM SPSS and R) and estimating the effects of publication bias. Guidance is also given on how to write up a meta‐analysis.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
All studies provided raw M ± SD scores apart from two where estimated marginal M ± SDs were given.
“In terms of data extraction, all studies provided raw M ± SD scores apart from two55,56 where estimated marginal M ± SDs were given (raw data was requested from corresponding authors but could not be obtained).”
From Effect of breathwork on stress and mental health: A meta-analysis of randomised-controlled trials (2023) · cites this paper as [56]
Rosenthal's fail-safe N was calculated to estimate how many further studies yielding zero effect would be required to make the overall stress effect size non-significant.
“Moreover, Rosenthal’s fail-safe N was calculated (to estimate how many further studies yielding zero effect would be required to make the overall ES non-significant for stress)56.”
From Effect of breathwork on stress and mental health: A meta-analysis of randomised-controlled trials (2023) · cites this paper as [56]
A random-effects model was selected because variability in effect sizes should be assumed in psychological research and it allows generalisation beyond the included studies.
“A random-effects model was selected as it was recommended that variability in effect sizes should be assumed in psychological research and that this model allowed generalisation of the findings beyond the studies included in the meta-analysis (Field and Gillett 2010).”
From A meta-analytic review of the efficacy of physical exercise interventions on cognition in individuals with autism spectrum disorder and ADHD (2016) · cites this paper as Field and Gillett 2010
Cites
R: A Language and Environment for Statistical Computing
R Core Team (2000) · doi:10.32614/r.manuals · Cited by 355,706 · see citing works
Statistical Power Analysis for the Behavioral Sciences
Muller, K. E., & Cohen, J. (1989) · Technometrics · doi:10.2307/1270020 · Cited by 99,588 · see citing works
Bias in meta-analysis detected by a simple, graphical test
Egger, M., Smith, G. D., Schneider, M., & Minder, C. (1997) · BMJ · doi:10.1136/bmj.315.7109.629 · Cited by 56,722 · see citing works
Discovering Statistics Using SPSS
Field, A. P., & Miles, J. N. V. (2000) · Medical Entomology and Zoology · Cited by 28,268 · see citing works
Self-citationOperating characteristics of a rank correlation test for publication bias
Begg, C. B., & Mazumdar, M. (1994) · Biometrics · doi:10.2307/2533446 · Cited by 16,955 · see citing works
The file drawer problem and tolerance for null results.
Rosenthal, R. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.3.638 · Cited by 9,068 · see citing works
Cohen, J. (1992) · Psychological Bulletin · doi:10.1037//0033-2909.112.1.155 · Cited by 8,771 · see citing works
THE BIG FIVE PERSONALITY DIMENSIONS AND JOB PERFORMANCE: A META‐ANALYSIS
BARRICK, M. R., & MOUNT, M. K. (1991) · Personnel Psychology · doi:10.1111/j.1744-6570.1991.tb00688.x · Cited by 8,689 · see citing works
The use of ranks to avoid the assumption of normality implicit in the analysis of variance
Friedman, M. (1937) · Journal of the American Statistical Association · doi:10.1080/01621459.1937.10503522 · Cited by 7,005 · see citing works
Statistical Methods for Meta-Analysis.
Freeman, P. R., Hedges, L. V., & Olkin, I. (1986) · Biometrics · doi:10.2307/2531069 · Cited by 4,832 · see citing works
Meta-Analytic Procedures for Social Research
Rosenthal, R. (1991) · doi:10.4135/9781412984997 · Cited by 4,635 · see citing works
Hunter, J., & Schmidt, F. (2004) · doi:10.4135/9781412985031 · Cited by 3,023 · see citing works
Fixed-and random-effects models in meta-analysis.
Hedges, L. V., & Vevea, J. L. (1998) · Psychological Methods · doi:10.1037/1082-989x.3.4.486 · Cited by 2,977 · see citing works
A Nonparametric “Trim and Fill” Method of Accounting for Publication Bias in Meta-Analysis
Duval, S., & Tweedie, R. (2000) · Journal of the American Statistical Association · doi:10.1080/01621459.2000.10473905 · Cited by 2,955 · see citing works
Hox, J., Moerbeek, M., & van de Schoot, R. (2002) · doi:10.4324/9781410604118 · Cited by 2,419 · see citing works
On the probable error of a coefficient of correlation deduced from a small sample
Fisher, R. A. (1921) · Adelaide Research & Scholarship (AR&S) (University of Adelaide) · Cited by 2,089 · see citing works
A Fail-Safe N for Effect Size in Meta-Analysis
Orwin, R. G. (1983) · Journal of Educational Statistics · doi:10.2307/1164923 · Cited by 2,064 · cited 1× · see citing works
“For example, when using d as an effect size measure, Orwin (1983) suggests a variation on the fail-safe N that estimates the number of unpublished studies required to bring the average effect size down to a predetermined value.”
MethodMeta-Analysis: Recent Developments in Quantitative Methods for Literature Reviews
Rosenthal, R., & DiMatteo, M. R. (2001) · Annual Review of Psychology · doi:10.1146/annurev.psych.52.1.59 · Cited by 1,780 · see citing works
Light, R. J., & Pillemer, D. B. (1984) · Harvard University Press eBooks · doi:10.4159/9780674040243 · Cited by 1,422 · see citing works
A comparison of methods to detect publication bias in meta‐analysis
Macaskill, P., Walter, S. D., & Irwig, L. (2001) · Statistics in Medicine · doi:10.1002/sim.698 · Cited by 1,286 · see citing works
Milligan, K., Astington, J. W., & Dack, L. A. (2007) · Child Development · doi:10.1111/j.1467-8624.2007.01018.x · Cited by 1,248 · see citing works
Some Practical Guidelines for Effective Sample Size Determination
Lenth, R. (2001) · The American Statistician · doi:10.1198/000313001317098149 · Cited by 1,200 · see citing works
Gender differences in temperament: A meta-analysis.
Else-Quest, N. M., Hyde, J. S., Goldsmith, H. H., & Van Hulle, C. A. (2006) · Psychological Bulletin · doi:10.1037/0033-2909.132.1.33 · Cited by 1,169 · cited 1× · see citing works
“On the former point, many writers have argued that real-world data in the social sciences are likely to have variable population parameters (Field, 2003b; Hunter & Schmidt, 2000, 2004; National Research Council, 1992; Osburn & Callender, 1992). There are data to support these claims: Field (2005b) calculated the stand…”
BackgroundInterpersonal expectancy effects: the first 345 studies
Rosenthal, R., & Rubin, D. B. (1978) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00075506 · Cited by 1,143 · see citing works
Writing meta-analytic reviews.
Rosenthal, R. (1995) · Psychological Bulletin · doi:10.1037/0033-2909.118.2.183 · Cited by 1,108 · see citing works
Consequences of prejudice against the null hypothesis.
Greenwald, A. G. (1975) · Psychological Bulletin · doi:10.1037/h0076157 · Cited by 1,022 · cited 1× · see citing works
“This bias is not trivial: significant findings are estimated to be eight times more likely to be submitted than non-significant ones (Greenwald, 1975), studies with positive findings are around seven times more likely to be published than studies with results supporting the null hypothesis (Coursol…”
ResultSterling, T. D. (1959) · Journal of the American Statistical Association · doi:10.1080/01621459.1959.10501497 · Cited by 964 · cited 2× · see citing works
“…than non-significant ones (Greenwald, 1975), studies with positive findings are around seven times more likely to be published than studies with results supporting the null hypothesis (Coursol & Wagner, 1986), and 97% of articles in psychology journals report significant results (Sterling, 1959).”
ResultDickersin, K., Yuan, M.-Q., & Meinert, C. (1992) · Journal of the American Medical Association (JAMA) · doi:10.1001/jama.1992.03480030052036 · Cited by 900 · see citing works
Hunter, J. E., & Schmidt, F. L. (2000) · International Journal of Selection and Assessment · doi:10.1111/1468-2389.00156 · Cited by 833 · see citing works
Statistical Methods for Rates and Proportions.
Fielding, A., & Fleiss, J. L. (1974) · Journal of the Royal Statistical Society Series A (General) · doi:10.2307/2344565 · Cited by 772 · see citing works
Field, A. P. (2001) · Psychological Methods · doi:10.1037/1082-989x.6.2.161 · Cited by 725 · see citing works
Self-citationThe power of statistical tests in meta-analysis
Hedges, L. V., & Pigott, T. D. (2001) · Psychological Methods · doi:10.1037/1082-989x.6.3.203 · Cited by 716 · cited 1× · see citing works
“However, these tests should be used cautiously as a means to decide on how to conceptualize that data because they typically have low power to detect genuine variation in population effect sizes (Hedges & Pigott, 2001).”
BackgroundSchmidt, F. L., Oh, I., & Hayes, T. L. (2008) · British Journal of Mathematical and Statistical Psychology · doi:10.1348/000711007x255327 · Cited by 713 · see citing works
Effect-Size Indices for Dichotomized Outcomes in Meta-Analysis.
Sánchez‐Meca, J., Marín‐Martínez, F., & Moscoso, S. C. (2003) · Psychological Methods · doi:10.1037/1082-989x.8.4.448 · Cited by 635 · see citing works
Standardized or simple effect size: what should be reported?
Baguley, T. (2009) · British Journal of Psychology · doi:10.1348/000712608x377117 · Cited by 619 · see citing works
Confusion of confidence intervals and credibility intervals in meta-analysis.
Whitener, E. M. (1990) · Journal of Applied Psychology · doi:10.1037/0021-9010.75.3.315 · Cited by 585 · see citing works
A Fail-Safe N for Effect Size in Meta-Analysis
Orwin, R. G. (1983) · Journal of Educational Statistics · doi:10.3102/10769986008002157 · Cited by 562 · see citing works
The neuropsychological impact of sports-related concussion: A meta-analysis
Belanger, H. G., & Vanderploeg, R. D. (2005) · Journal of the International Neuropsychological Society · doi:10.1017/s1355617705050411 · Cited by 527 · see citing works
Sterling, T. D. (1959) · Journal of the American Statistical Association · doi:10.2307/2282137 · Cited by 524 · see citing works
Bax, L., Yu, L.-M., Ikeda, N., Tsuruta, H., & Moons, K. G. (2006) · BMC Medical Research Methodology · doi:10.1186/1471-2288-6-50 · Cited by 514 · see citing works
Publication Bias in Research Synthesis: Sensitivity Analysis Using A Priori Weight Functions.
Vevea, J. L., & Woods, C. M. (2005) · Psychological Methods · doi:10.1037/1082-989x.10.4.428 · Cited by 461 · cited 22× · see citing works
“Opening this file in a text editor reveals the code that controls the weight functions: # Enter fixed weight function w1 ,- matrix(c(1.0,.99,.95,.90,.80,.75,.65,.60,.55,.50,.50,.50,.50,.50), ncol ¼ 1) w2 ,- matrix(c(1.0,.99,.90,.75,.60,.50,.40,.35,.30,.25,.10,.10,.10,.10), ncol ¼ 1) w3 ,- matrix(c(1.0,.99,.95,.90,.80,…”
BackgroundMethodInfluentialCartwright‐Hatton, S., Roberts, C., Chitsabesan, P., Fothergill, C., & Harrington, R. (2004) · British Journal of Clinical Psychology · doi:10.1348/0144665042388928 · Cited by 449 · see citing works
When effect sizes disagree: The case of r and d.
McGrath, R. E., & Meyer, G. J. (2006) · Psychological Methods · doi:10.1037/1082-989x.11.4.386 · Cited by 402 · see citing works
Evaluation of old and new tests of heterogeneity in epidemiologic meta-analysis
Takkouche, B., Cadarso-Suarez, C., & Spiegelman, D. (1999) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a009981 · Cited by 380 · see citing works
Overton, R. C. (1998) · Psychological Methods · doi:10.1037/1082-989x.3.3.354 · Cited by 353 · see citing works
Is the Meta-Analysis of Correlation Coefficients Accurate When Population Correlations Vary?
Field, A. P. (2005) · Psychological Methods · doi:10.1037/1082-989x.10.4.444 · Cited by 329 · see citing works
Self-citationImplications of direct and indirect range restriction for meta-analysis methods and findings.
Hunter, J. E., Schmidt, F. L., & Le, H. (2006) · Journal of Applied Psychology · doi:10.1037/0021-9010.91.3.594 · Cited by 315 · see citing works
Brewin, C. R., Kleiner, J. S., Vasterling, J. J., & Field, A. P. (2007) · Journal of Abnormal Psychology · doi:10.1037/0021-843x.116.3.448 · Cited by 290 · see citing works
Self-citationHedges, L. V. (1984) · Journal of Educational Statistics · doi:10.3102/10769986009001061 · Cited by 241 · see citing works
The Problems in Using Fixed-Effects Models of Meta-Analysis on Real-World Data
Field, A. P. (2003) · Understanding Statistics · doi:10.1207/s15328031us0202_02 · Cited by 237 · see citing works
Self-citationAre parents' gender schemas related to their children's gender-related cognitions? A meta-analysis.
Tenenbaum, H. R., & Leaper, C. (2002) · Developmental Psychology · doi:10.1037/0012-1649.38.4.615 · Cited by 233 · see citing works
Combining Information: Statistical Issues and Opportunities for Research
Srinivasan, C. (1993) · Technometrics · doi:10.2307/1270296 · Cited by 213 · see citing works
Are parents' gender schemas related to their children's gender-related cognitions? A meta-analysis.
Tenenbaum, H. R., & Leaper, C. (2002) · Developmental Psychology · doi:10.1037//0012-1649.38.4.615 · Cited by 209 · see citing works
Meta-Analysis for Explanation: A Casebook
Spilker, B. (1993) · JAMA · doi:10.1001/jama.1993.03500230123042 · Cited by 199 · see citing works
Hedges, L. V. (1992) · Journal of Educational Statistics · doi:10.3102/10769986017004279 · Cited by 186 · see citing works
Effect of positive findings on submission and acceptance rates: A note on meta-analysis bias.
Coursol, A., & Wagner, E. E. (1986) · Professional Psychology Research and Practice · doi:10.1037/0735-7028.17.2.136 · Cited by 165 · see citing works
Meta-Analysis: A Comparison of Approaches
Tomasic, D. M. (2005) · Medicine & Science in Sports & Exercise · doi:10.1097/00005768-200503000-00032 · Cited by 164 · see citing works
Validity Generalization: A Critical Review
Strube, M., & Murphy, K. R. (2004) · Academy of Management Review · doi:10.2307/20159040 · Cited by 152 · see citing works
Memory distortion in eyewitnesses: a meta-analysis of the post-identification feedback effect
Douglass, A. B., & Steblay, N. K. (2006) · Applied Cognitive Psychology · doi:10.1002/acp.1237 · Cited by 145 · see citing works
Using Dissertations to Examine Potential Bias in Child and Adolescent Clinical Trials.
McLeod, B. D., & Weisz, J. R. (2004) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.72.2.235 · Cited by 125 · see citing works
Comparison of two random-effects methods of meta-analysis.
Hall, S. M., & Brannick, M. Τ. (2002) · Journal of Applied Psychology · doi:10.1037/0021-9010.87.2.377 · Cited by 120 · see citing works
Meta-Analysis of Raw Mean Differences.
Bond, C. F., Wiitala, W. L., & Richard, F. D. (2003) · Psychological Methods · doi:10.1037/1082-989x.8.4.406 · Cited by 113 · see citing works
Field, A. P. (2003) · Figshare · Cited by 67 · see citing works
Self-citationOsburn, H. G., & Callender, J. C. (1992) · Journal of Applied Psychology · doi:10.1037/0021-9010.77.2.115 · Cited by 60 · see citing works
MetaEasy: A Meta-Analysis Add-In for MicrosoftExcel
Kontopantelis, E., & Reeves, D. (2009) · Journal of Statistical Software · doi:10.18637/jss.v030.i07 · Cited by 57 · see citing works
Hafdahl, A. R., & Williams, M. A. (2009) · Psychological Methods · doi:10.1037/a0014697 · Cited by 55 · see citing works
Improved Fisher z estimators for univariate random‐effects meta‐analysis of correlations
Hafdahl, A. R. (2008) · British Journal of Mathematical and Statistical Psychology · doi:10.1348/000711008x281633 · Cited by 33 · see citing works
Kelley, K., Bond, R., & Abraham, C. (2001) · British Journal of Health Psychology · doi:10.1348/135910701169160 · Cited by 29 · see citing works
Random‐effects meta‐analysis of correlations: Monte Carlo evaluation of mean estimators
Hafdahl, A. R. (2009) · British Journal of Mathematical and Statistical Psychology · doi:10.1348/000711009x431914 · Cited by 28 · see citing works
The Metric Comparability of Meta-Analytic Effect-Size Estimators From Factorial Designs.
Gillett, R. (2003) · Psychological Methods · doi:10.1037/1082-989x.8.4.419 · Cited by 27 · see citing works
Self-citation
Flagged first, then by citations
1 of the 71 references couldn’t be matched to a known paper.
Research works printed but not linked: 11
- Clark‐Carter D., 2003, Effect size: The missing piece in the jigsaw, Psychologist, 16, 636
- Cochrane Collaboration, 2008, Review Manager (RevMan) for Windows: Version 5.0
- 10.1037/0033-2909.112.1.155 · DOI · Paper page
- DeCoster J., 1998, Microsoft Excel spreadsheets: Meta‐analysis
- Field A. P., 2005, A handbook of research methods in clinical and health psychology, 295
- Field A. P., 2009, How to do a meta‐analysis
- Fisher R. A., 1935, The design of experiments
- 10.2307/1164832 · DOI · Paper page
- Lavesque R., 2001, Syntax: Meta‐analysis
- Schwarzer G., 2005, Meta
- Wilson D. B., 2004, A spreadsheet for calculating standardized mean difference type effect sizes
Cited by
Sorted by citations
Richardson, M., Abraham, C., & Bond, R. (2012) · Psychological Bulletin · doi:10.1037/a0026838 · Cited by 3,646 · see citing works
Does low self-esteem predict depression and anxiety? A meta-analysis of longitudinal studies.
Sowislo, J. F., & Orth, U. (2013) · Psychological Bulletin · doi:10.1037/a0028931 · Cited by 2,123 · see citing works
Hayes, S. A., & Watson, S. L. (2013) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-012-1604-y · Cited by 1,847 · see citing works
Broadbent, J., & Poon, W. L. (2015) · The Internet and Higher Education · doi:10.1016/j.iheduc.2015.04.007 · Cited by 1,692 · see citing works
Much ado about grit: A meta-analytic synthesis of the grit literature
Credé, M., Tynan, M. C., & Harms, P. D. (2017) · Journal of Personality and Social Psychology · doi:10.1037/pspp0000102 · Cited by 1,653 · see citing works
Sonuga-Barke, E. J. S., Brandeis, D., Cortese, S., Daley, D., Ferrin, M., Holtmann, M., Stevenson, J., Danckaerts, M., van der Oord, S., Döpfner, M., et al. (2013) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2012.12070991 · Cited by 1,167 · see citing works
Meta-analyses of factors motivating climate change adaptation behaviour
van Valkengoed, A. M., & Steg, L. (2019) · Nature Climate Change · doi:10.1038/s41558-018-0371-y · Cited by 940 · see citing works
Suurmond, R., van Rhee, H., & Hak, T. (2017) · Research Synthesis Methods · doi:10.1002/jrsm.1260 · Cited by 881 · see citing works
A meta-analysis of risk factors for post-traumatic stress disorder in children and adolescents
Trickey, D., Siddaway, A. P., Meiser-Stedman, R., Serpell, L., & Field, A. P. (2012) · Clinical Psychology Review · doi:10.1016/j.cpr.2011.12.001 · Cited by 828 · see citing works
Self-citationTaylor, G., Jungert, T., Mageau, G. A., Schattke, K., Dedic, H., Rosenfield, S., & Koestner, R. (2014) · Contemporary Educational Psychology · doi:10.1016/j.cedpsych.2014.08.002 · Cited by 816 · see citing works
The Why and How of the Integrative Review
Cronin, M. A., & George, E. (2020) · Organizational Research Methods · doi:10.1177/1094428120935507 · Cited by 760 · see citing works
Marino, C., Gini, G., Vieno, A., & Spada, M. M. (2018) · Journal of Affective Disorders · doi:10.1016/j.jad.2017.10.007 · Cited by 658 · see citing works
Moral disengagement among children and youth: A meta‐analytic review of links to aggressive behavior
Gini, G., Pozzoli, T., & Hymel, S. C. (2013) · Aggressive Behavior · doi:10.1002/ab.21502 · Cited by 585 · see citing works
Vall, E., & Wade, T. D. (2015) · International Journal of Eating Disorders · doi:10.1002/eat.22411 · Cited by 553 · see citing works
Knight, C., Patterson, M., & Dawson, J. (2017) · Journal of Organizational Behavior · doi:10.1002/job.2167 · Cited by 541 · see citing works
Dawel, A., O’Kearney, R., McKone, E., & Palermo, R. (2012) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2012.08.006 · Cited by 525 · see citing works
Curry, O. S., Rowland, L. A., Van Lissa, C. J., Zlotowitz, S., McAlaney, J., & Whitehouse, H. (2018) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2018.02.014 · Cited by 528 · see citing works
Liu, D., Jiang, K., Shalley, C. E., Keem, S., & Zhou, J. (2016) · Organizational Behavior and Human Decision Processes · doi:10.1016/j.obhdp.2016.08.001 · Cited by 516 · see citing works
Curran, T., Hill, A. P., Appleton, P. R., Vallerand, R. J., & Standage, M. (2015) · Motivation and Emotion · doi:10.1007/s11031-015-9503-0 · Cited by 499 · see citing works
Social cognitive theory and physical activity: a systematic review and meta‐analysis
Young, M. D., Plotnikoff, R. C., Collins, C. E., Callister, R., & Morgan, P. J. (2014) · Obesity Reviews · doi:10.1111/obr.12225 · Cited by 505 · see citing works
Social attention in ASD: A review and meta-analysis of eye-tracking studies
Chita-Tegmark, M. (2015) · Research in Developmental Disabilities · doi:10.1016/j.ridd.2015.10.011 · Cited by 496 · see citing works
Personality Traits and Personal Values: A Meta-Analysis
Parks-Leduc, L., Feldman, G., & Bardi, A. (2015) · Personality and Social Psychology Review · doi:10.1177/1088868314538548 · Cited by 622 · see citing works
What You See Is What You Get? Enhancing Methodological Transparency in Management Research
Aguinis, H., Ramani, R. S., & Alabduljader, N. (2017) · Academy of Management Annals · doi:10.5465/annals.2016.0011 · Cited by 477 · see citing works
Cieślak, R., Shoji, K., Douglas, A., Melville, E., Łuszczyńska, A., & Benight, C. C. (2013) · Psychological Services · doi:10.1037/a0033798 · Cited by 460 · see citing works
Morina, N., Ijntema, H., Meyerbröker, K., & Emmelkamp, P. M. G. (2015) · Behaviour Research and Therapy · doi:10.1016/j.brat.2015.08.010 · Cited by 439 · see citing works
Reading from paper compared to screens: A systematic review and meta‐analysis
Clinton‐Lisell, V. (2019) · Journal of Research in Reading · doi:10.1111/1467-9817.12269 · Cited by 492 · see citing works
A neural reward prediction error revealed by a meta-analysis of ERPs using great grand averages
Sambrook, T. D., & Goslin, J. (2015) · Psychological Bulletin · doi:10.1037/bul0000006 · Cited by 411 · see citing works
SELF‐CONTROL AND VICTIMIZATION: A META‐ANALYSIS
Pratt, T. C., Turanovic, J. J., Fox, K. A., & Wright, K. A. (2013) · Criminology · doi:10.1111/1745-9125.12030 · Cited by 430 · see citing works
Kasper, L. J., Alderson, R. M., & Hudec, K. L. (2012) · Clinical Psychology Review · doi:10.1016/j.cpr.2012.07.001 · Cited by 414 · see citing works
Associations between job burnout and self-efficacy: a meta-analysis
Shoji, K., Cieślak, R., Smoktunowicz, E., Rogala, A., Benight, C. C., & Łuszczyńska, A. (2015) · Anxiety Stress & Coping · doi:10.1080/10615806.2015.1058369 · Cited by 439 · see citing works
Who Leaves and Who Stays? A Review and Statistical Meta-Analysis of Hurricane Evacuation Studies
Huang, S., Lindell, M. K., & Prater, C. S. (2015) · Environment and Behavior · doi:10.1177/0013916515578485 · Cited by 418 · see citing works
Wang, Y., Chau, C. K., Ng, W. Y., & Leung, T. M. (2015) · Cities · doi:10.1016/j.cities.2015.08.004 · Cited by 401 · see citing works
Publication Bias in the Organizational Sciences
Kepes, S., Banks, G. C., McDaniel, M. A., & Whetzel, D. L. (2012) · Organizational Research Methods · doi:10.1177/1094428112452760 · Cited by 400 · see citing works
Marušić, A., Bošnjak, L., & Jerončić, A. (2011) · PLoS ONE · doi:10.1371/journal.pone.0023477 · Cited by 396 · see citing works
Scalco, A., Noventa, S., Sartori, R., & Ceschi, A. (2017) · Appetite · doi:10.1016/j.appet.2017.02.007 · Cited by 365 · see citing works
Vo, H. M., Zhu, C., & Diep, A. N. (2017) · Studies In Educational Evaluation · doi:10.1016/j.stueduc.2017.01.002 · Cited by 399 · see citing works
A comprehensive meta-analysis on Problematic Facebook Use
Marino, C., Gini, G., Vieno, A., & Spada, M. M. (2018) · Computers in Human Behavior · doi:10.1016/j.chb.2018.02.009 · Cited by 378 · see citing works
McEwan, D., Ruissen, G. R., Eys, M., Zumbo, B. D., & Beauchamp, M. R. (2017) · PLoS ONE · doi:10.1371/journal.pone.0169604 · Cited by 356 · see citing works
Cavanagh, K., Strauss, C., Forder, L., & Jones, F. (2014) · Clinical Psychology Review · doi:10.1016/j.cpr.2014.01.001 · Cited by 340 · see citing works
Winsper, C., Bilgin, A., Thompson, A. D., Marwaha, S., Chanen, A. M., Singh, S. P., Wang, A., & Furtado, V. A. (2019) · The British Journal of Psychiatry · doi:10.1192/bjp.2019.166 · Cited by 368 · see citing works
Sensitivity Analysis for Publication Bias in Meta-Analyses
Mathur, M. B., & VanderWeele, T. J. (2020) · Journal of the Royal Statistical Society Series C: Applied Statistics · doi:10.1111/rssc.12440 · Cited by 354 · see citing works
Meaning in life and physical health: systematic review and meta-analysis
Czekierda, K., Banik, A., Park, C. L., & Łuszczyńska, A. (2017) · Health Psychology Review · doi:10.1080/17437199.2017.1327325 · Cited by 348 · see citing works
Loh, R., Stamatakis, E., Folkerts, D., Allgrove, J. E., & Moir, H. J. (2020) · Sports Medicine · doi:10.1007/s40279-019-01183-w · Cited by 326 · see citing works
Nohe, C., Meier, L. L., Sonntag, K., & Michel, A. (2014) · Journal of Applied Psychology · doi:10.1037/a0038012 · Cited by 354 · see citing works
Publication bias examined in meta-analyses from psychology and medicine: A meta-meta-analysis
van Aert, R. C. M., Wicherts, J. M., & van Assen, M. A. L. M. (2019) · PLoS ONE · doi:10.1371/journal.pone.0215052 · Cited by 345 · see citing works
Alderson, R. M., Kasper, L. J., Hudec, K. L., & Patros, C. H. G. (2013) · Neuropsychology · doi:10.1037/a0032371 · Cited by 331 · see citing works
Yule, K., Houston, J., & Grych, J. (2019) · Clinical Child and Family Psychology Review · doi:10.1007/s10567-019-00293-1 · Cited by 331 · see citing works
Riebl, S. K., Estabrooks, P. A., Dunsmore, J. C., Savla, J., Frisard, M. I., Dietrich, A. M., Peng, Y., Zhang, X., & Davy, B. M. (2015) · Eating Behaviors · doi:10.1016/j.eatbeh.2015.05.016 · Cited by 326 · see citing works
A Meta-Analytic Review of Stand-Alone Interventions to Improve Body Image
Alleva, J. M., Sheeran, P., Webb, T. L., Martijn, C., & Miles, E. (2015) · PLoS ONE · doi:10.1371/journal.pone.0139177 · Cited by 335 · see citing works
Implicit Theories of Intelligence and Academic Achievement: A Meta-Analytic Review
Costa, A., & Faria, L. (2018) · Frontiers in Psychology · doi:10.3389/fpsyg.2018.00829 · Cited by 340 · see citing works
The potential of immersive virtual reality to enhance learning: A meta-analysis
Coban, M., Bolat, Y. I., & Goksu, I. (2022) · Educational Research Review · doi:10.1016/j.edurev.2022.100452 · Cited by 354 · see citing works
A meta-regression of the long-term effects of deep brain stimulation on balance and gait in PD
George, R. J. S., Nutt, J. G., Burchiel, K. J., & Horak, F. B. (2010) · Neurology · doi:10.1212/wnl.0b013e3181f61329 · Cited by 305 · see citing works
A meta-analysis of turnover intention predictors among U.S. child welfare workers
Kim, H., & Kao, D. (2014) · Children and Youth Services Review · doi:10.1016/j.childyouth.2014.09.015 · Cited by 305 · see citing works
Vall, E., & Wade, T. D. (2016) · International Journal of Eating Disorders · doi:10.1002/eat.22518 · Cited by 302 · see citing works
Varotto, A., & Spagnolli, A. (2017) · Journal of Environmental Psychology · doi:10.1016/j.jenvp.2017.03.011 · Cited by 308 · see citing works
Piotrowska, P. J., Stride, C., Croft, S., & Rowe, R. (2014) · Clinical Psychology Review · doi:10.1016/j.cpr.2014.11.003 · Cited by 302 · see citing works
Degner, J., & Dalege, J. (2013) · Psychological Bulletin · doi:10.1037/a0031436 · Cited by 301 · see citing works
Cavanagh, A., Wilson, C. J., Kavanagh, D. J., & Caputi, P. (2017) · Harvard Review of Psychiatry · doi:10.1097/hrp.0000000000000128 · Cited by 295 · see citing works
Review: Alleviating loneliness in young people – a meta‐analysis of interventions
Eccles, A. M., & Qualter, P. (2021) · Child and Adolescent Mental Health · doi:10.1111/camh.12389 · Cited by 285 · see citing works
Bilingualism and working memory capacity: A comprehensive meta-analysis
Grundy, J. G., & Timmer, K. (2016) · Second language Research · doi:10.1177/0267658316678286 · Cited by 279 · see citing works
O’Driscoll, C., Laing, J., & Mason, O. J. (2014) · Clinical Psychology Review · doi:10.1016/j.cpr.2014.07.002 · Cited by 288 · see citing works
A systematic review of the effectiveness of empathy education for undergraduate nursing students
Levett-Jones, T. L., Cant, R., & Lapkin, S. (2019) · Nurse Education Today · doi:10.1016/j.nedt.2019.01.006 · Cited by 280 · see citing works
Imagery rescripting as a clinical intervention for aversive memories: A meta-analysis
Morina, N., Lancee, J., & Arntz, A. (2017) · Journal of Behavior Therapy and Experimental Psychiatry · doi:10.1016/j.jbtep.2016.11.003 · Cited by 282 · see citing works
Coghill, D. R., Seth, S., Pedroso, S., Usala, T., Currie, J., & Gagliano, A. (2014) · Biological Psychiatry · doi:10.1016/j.biopsych.2013.10.005 · Cited by 271 · see citing works
McEwan, D., Harden, S. M., Zumbo, B. D., Sylvester, B. D., Kaulius, M., Ruissen, G. R., Dowd, A. J., & Beauchamp, M. R. (2015) · Health Psychology Review · doi:10.1080/17437199.2015.1104258 · Cited by 271 · see citing works
Shadish, W. R., Hedges, L. V., & Pustejovsky, J. E. (2014) · Journal of School Psychology · doi:10.1016/j.jsp.2013.11.005 · Cited by 270 · see citing works
Plotnikoff, R. C., Costigan, S. A., Karunamuni, N. D., & Lubans, D. R. (2013) · Preventive Medicine · doi:10.1016/j.ypmed.2013.01.013 · Cited by 271 · see citing works
A meta-analysis of how signaling affects learning with media
Schneider, S., Beege, M., Nebel, S., & Rey, G. D. (2018) · Educational Research Review · doi:10.1016/j.edurev.2017.11.001 · Cited by 268 · see citing works
The role of trust for climate change mitigation and adaptation behaviour: A meta-analysis
Cologna, V., & Siegrist, M. (2020) · Journal of Environmental Psychology · doi:10.1016/j.jenvp.2020.101428 · Cited by 273 · see citing works
Meta-analysis using effect size distributions of only statistically significant studies.
van Assen, M. A. L. M., van Aert, R. C. M., & Wicherts, J. M. (2015) · Psychological Methods · doi:10.1037/met0000025 · Cited by 265 · see citing works
Mingoia, J., Hutchinson, A. D., Wilson, C., & Gleaves, D. H. (2017) · Frontiers in Psychology · doi:10.3389/fpsyg.2017.01351 · Cited by 253 · see citing works
“Random-effects are recommended (Field, 2005) and allow for generalization beyond the studies included in the current meta-analysis (Field and Gillett, 2010) which is preferred given the emerging nature of SNS-related body image research.”
BackgroundVan Eck, R. M., Burger, T. J., Vellinga, A., Schirmbeck, F., & de Haan, L. (2018) · Schizophrenia Bulletin · doi:10.1093/schbul/sbx088 · Cited by 260 · see citing works
Quintana, D. S. (2015) · Frontiers in Psychology · doi:10.3389/fpsyg.2015.01549 · Cited by 261 · see citing works
Lauriola, M., Panno, A., Levin, I., & Lejuez, C. (2014) · Journal of Behavioral Decision Making · doi:10.1002/bdm.1784 · Cited by 279 · see citing works
Nations' income inequality predicts ambivalence in stereotype content: How societies mind the gap
Durante, F., Fiske, S. T., Kervyn, N. O., Cuddy, A. J. C., Akande, A., Adetoun, B. E., Adewuyi, M. F., Tserere, M. M., Ramiah, A. A., Mastor, K. A., et al. (2012) · British Journal of Social Psychology · doi:10.1111/bjso.12005 · Cited by 258 · see citing works
Cognitive outcomes in children and adolescents born very preterm: a meta‐analysis
Brydges, C. R., Landes, J. K., Reid, C. L., Campbell, C., French, N., & Anderson, M. B. (2018) · Developmental Medicine & Child Neurology · doi:10.1111/dmcn.13685 · Cited by 257 · see citing works
Morina, N., Koerssen, R., & Pollet, T. V. (2016) · Clinical Psychology Review · doi:10.1016/j.cpr.2016.05.006 · Cited by 256 · see citing works
Statistical methods for dealing with publication bias in meta‐analysis
Jin, Z., Zhou, X., & He, J. (2014) · Statistics in Medicine · doi:10.1002/sim.6342 · Cited by 252 · see citing works
The Science of Literature Reviews: Searching, Identifying, Selecting, and Synthesising
Chigbu, U. E., Atiku, S. O., & Plessis, C. C. D. (2023) · Publications · doi:10.3390/publications11010002 · Cited by 387 · see citing works
Effectiveness of career choice interventions: A meta-analytic replication and extension
Whiston, S. C., Li, Y., Mitts, N. G., & Wright, L. (2017) · Journal of Vocational Behavior · doi:10.1016/j.jvb.2017.03.010 · Cited by 249 · see citing works
Marcantoni, W. S., Akouamba, B. S., Wassef, M., Mayrand, J., Lai, H., Richard‐Devantoy, S., & Beauchamp, S. (2020) · Journal of Affective Disorders · doi:10.1016/j.jad.2020.09.007 · Cited by 246 · see citing works
Burnout and depression in nurses: a systematic review and meta-analysis
Chen, C., & Meier, S. T. (2021) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2021.104099 · Cited by 246 · see citing works
Living the good life: A meta-analysis of authenticity, well-being and engagement
Sutton, A. (2019) · Personality and Individual Differences · doi:10.1016/j.paid.2019.109645 · Cited by 244 · see citing works
Signaling text-picture relations in multimedia learning: A comprehensive meta-analysis
Richter, J., Scheiter, K., & Eitel, A. (2016) · Educational Research Review · doi:10.1016/j.edurev.2015.12.003 · Cited by 242 · see citing works
Pinto, A. C. S. N., Faiz, O. D., Davis, R. E., Almoudaris, A. M., & Vincent, C. A. (2016) · BMJ Open · doi:10.1136/bmjopen-2014-007224 · Cited by 235 · see citing works
Posttraumatic growth and adjustment among individuals with cancer or HIV/AIDS: A meta-analysis
Sawyer, A., Ayers, S., & Field, A. P. (2010) · Clinical Psychology Review · doi:10.1016/j.cpr.2010.02.004 · Cited by 238 · see citing works
Self-citationCarlson, E. N., Vazire, S., & Oltmanns, T. F. (2011) · Journal of Personality and Social Psychology · doi:10.1037/a0023781 · Cited by 222 · see citing works
Kaluza, A. J., Boer, D., Buengeler, C., & van Dick, R. (2019) · Work & Stress · doi:10.1080/02678373.2019.1617369 · Cited by 239 · see citing works
Hennissen, L., Bakker, M. J., Banaschewski, T., Carucci, S., Coghill, D., Danckaerts, M., Dittmann, R., Hollis, C. P., Kovshoff, H., McCarthy, S., et al. (2017) · CNS Drugs · doi:10.1007/s40263-017-0410-7 · Cited by 225 · see citing works
Effect of breathwork on stress and mental health: A meta-analysis of randomised-controlled trials
Fincham, G. W., Strauss, C., Montero-Marin, J., & Cavanagh, K. (2023) · Scientific Reports · doi:10.1038/s41598-022-27247-y · Cited by 224 · see citing works
Primary headache epidemiology in children and adolescents: a systematic review and meta-analysis
Onofri, A., Pensato, U., Rosignoli, C., Wells-Gatnik, W. D., Stanyer, E. C., Ornello, R., Chen, H. Z., Santis, F. D., Angelo, T., Mikulenka, P., et al. (2023) · The Journal of Headache and Pain · doi:10.1186/s10194-023-01541-0 · Cited by 221 · see citing works
How to conduct a meta-analysis in eight steps: A practical guide
Hansen, C., Steinmetz, H., & Block, J. (2022) · Management Review Quarterly · doi:10.1007/s11301-021-00247-4 · Cited by 218 · see citing works
van Aert, R. C. M., Wicherts, J. M., & van Assen, M. A. L. M. (2016) · Perspectives on Psychological Science · doi:10.1177/1745691616650874 · Cited by 219 · see citing works
Moreno, C. R. D. C., Marqueze, E. C., Sargent, C., Wright, K. P., Ferguson, S. A., & Tucker, P. (2019) · Industrial Health · doi:10.2486/indhealth.sw-1 · Cited by 223 · see citing works
Treating offenders with mental illness: A research synthesis.
Morgan, R. D., Flora, D. B., Kroner, D. G., Mills, J. F., Varghese, F., & Steffan, J. S. (2012) · Law and Human Behavior · doi:10.1037/h0093964 · Cited by 215 · see citing works
Cannabis use and mania symptoms: A systematic review and meta-analysis
Gibbs, M., Winsper, C., Marwaha, S., Gilbert, E., Broome, M. R., & Singh, S. P. (2014) · Journal of Affective Disorders · doi:10.1016/j.jad.2014.09.016 · Cited by 216 · see citing works
Ma, L., & Zhan, M. M. (2016) · Journal of Public Relations Research · doi:10.1080/1062726x.2016.1166367 · Cited by 214 · see citing works
Shikora, S. A., & Mahoney, C. B. (2015) · Obesity Surgery · doi:10.1007/s11695-015-1703-x · Cited by 210 · see citing works
The relationship between adult attachment style and post-traumatic stress symptoms: A meta-analysis
Woodhouse, S., Ayers, S., & Field, A. P. (2015) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2015.07.002 · Cited by 210 · see citing works
Self-citationFamily correlates of false belief understanding in early childhood: A meta-analysis
Devine, R. T., & Hughes, C. (2018) · Child Development · doi:10.1111/cdev.12682 · Cited by 265 · see citing works
- Authors
- Field, A. P., & Gillett, R.
- Affiliations
- University of Sussex (GB)
- University of Leicester (GB)
- Corresponding author
- Field, Andy P.
- Gillett, Raphael
- ORCID
- Field, Andy P.
- Venue
- British Journal of Mathematical and Statistical Psychology
- Publisher
- Wiley
- Published
- 2010-11
- Volume
- 63
- Issue
- 3
- Pages
- 665-694
- ISSN
- 0007-1102 (ISSN-L)
- 2044-8317
- OpenAlex
- W2094667953
- Cited by
- 1,162
- References
- 71
- Citations by year
- 2026: 99 · 2025: 136 · 2024: 115 · 2023: 117 · 2022: 102 · 2021: 84 · 2020: 74 · 2019: 73 · 2018: 78 · 2017: 63 · 2016: 57 · 2015: 63 · 2014: 41 · 2013: 35 · 2012: 14
- FWCI
- 18.49
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- British Journal of Mathematical and Statistical Psychology (publishedVersion)
- PubMed (publishedVersion)
- Figshare (submittedVersion)
- Leicester Research Archive (University of Leicester) (submittedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Keywords
- meta-analysis, effect size, publication bias, inclusion criteria, article selection, meta-analysis software
- MeSH terms
- Computer Simulation, Data Collection, Humans, Mathematical Computing, Psychology, Research, Software, Meta-Analysis as Topic, Effect Modifier, Epidemiologic, Publication Bias
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review