Cited by 994Meta-analysis and systematic reviewsPsychology Research and Bibliometricsscientometrics and bibliometrics research

The DOI matches its Crossref record; 59 of the 59 references it cites were found in a registry or an index.

Mini Meta‐Analysis of Your Own Studies: Some Arguments on Why and a Primer on How

Goh, Jin X., Hall, Judith A., Rosenthal, Robert·2016·Social and Personality Psychology Compass

DOI 10.1111/spc3.12267

Open this paper in CoChat — free account

Abstract

We outline the need to, and provide a guide on how to, conduct a meta‐analysis on one's own studies within a manuscript. Although conducting a “mini meta” within one's manuscript has been argued for in the past, this practice is still relatively rare and adoption is slow. We believe two deterrents are responsible. First, researchers may not think that it is legitimate to do a meta‐analysis on a small number of studies. Second, researchers may think a meta‐analysis is too complicated to do without expert knowledge or guidance. We dispel these two misconceptions by (1) offering arguments on why researchers should be encouraged to do mini metas, (2) citing previous articles that have conducted such analyses to good effect, and (3) providing a user‐friendly guide on calculating some meta‐analytic procedures that are appropriate when there are only a few studies. We provide formulas for calculating effect sizes and converting effect sizes from one metric to another (e.g., from Cohen's d to r ), as well as annotated Excel spreadsheets and a step‐by‐step guide on how to conduct a simple meta‐analysis. A series of related studies can be strengthened and better understood if accompanied by a mini meta‐analysis.

Integrity signals

Registry

Crossref · 10.1111/spc3.12267

Cites

59 of 59 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Statistical Power Analysis for the Behavioral Sciences
Muller, K. E., & Cohen, J. (1989) · Technometrics · doi:10.2307/1270020 · Cited by 99,603
Measuring inconsistency in meta-analyses
Higgins, J. P. T., Thompson, S. G., Deeks, J. J., & Altman, D. G. (2003) · BMJ · doi:10.1136/bmj.327.7414.557 · Cited by 63,139
Quantifying heterogeneity in a meta‐analysis
Higgins, J. P. T., & Thompson, S. G. (2002) · Statistics in Medicine · doi:10.1002/sim.1186 · Cited by 36,763
Introduction to Meta‐Analysis
Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2009) · doi:10.1002/9780470743386 · Cited by 14,225
Calculating and reporting effect sizes to facilitate cumulative science: A practical primer for t-tests and ANOVAs
Lakens, D. (2013) · Frontiers in Psychology · doi:10.3389/fpsyg.2013.00863 · Cited by 10,303
Introduction to Meta‐Analysis
Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2021) · doi:10.1002/9781119558378 · Cited by 9,799
Untitled work
(2000) · Cited by 9,198
The file drawer problem and tolerance for null results.
Rosenthal, R. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.3.638 · Cited by 9,068 · cited 1×
“…critiques over the years (Cumming, 2014), and by limiting a paper to only significant findings, researchers will inevitably contribute to an unhealthy culture of questionable research practices such as p-hacking (Simonsohn, Nelson, & Simmons, 2014), file-drawer effects (Rosenthal, 1979), and more.”
BackgroundSelf-citation
A power primer.
Cohen, J. (1992) · Psychological Bulletin · doi:10.1037//0033-2909.112.1.155 · Cited by 8,771
A basic introduction to fixed-effect and random-effects models for meta-analysis
Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2010) · Research Synthesis Methods · doi:10.1002/jrsm.12 · Cited by 6,793
Meta-Analytic Procedures for Social Research
Rosenthal, R. (1991) · doi:10.4135/9781412984997 · Cited by 4,635
Self-citation
The Handbook of Research Synthesis and Meta-Analysis
(2019) · doi:10.7758/9781610448864 · Cited by 4,553
Assessing heterogeneity in meta-analysis: Q statistic or I² index?
Huedo-Medina, T. B., Sánchez-Meca, J., Marín-Martínez, F., & Botella, J. (2006) · Psychological Methods · doi:10.1037/1082-989x.11.2.193 · Cited by 4,256
Meta-Analytic Procedures for Social Research.
Metcalfe, A., & Rosenthal, R. (1994) · Journal of the Royal Statistical Society Series D (The Statistician) · doi:10.2307/2348600 · Cited by 4,249
Self-citation
The New Statistics: Why and How
Cumming, G. (2014) · Psychological Science · doi:10.1177/0956797613504966 · Cited by 3,200
Combining effect size estimates in meta-analysis with repeated measures and independent-groups designs.
Morris, S. B., & DeShon, R. P. (2002) · Psychological Methods · doi:10.1037/1082-989x.7.1.105 · Cited by 2,502
Measuring the Prevalence of Questionable Research Practices With Incentives for Truth Telling
John, L. K., Loewenstein, G., & Prelec, D. (2012) · Psychological Science · doi:10.1177/0956797611430953 · Cited by 2,239
Social support and patient adherence to medical treatment: a meta-analysis.
DiMatteo, M. R. (2004) · Health Psychology · doi:10.1037/0278-6133.23.2.207 · Cited by 2,107 · cited 1×
“12267 studies involved ( for illustration of this method, see DiMatteo, 2004).”
Method
Untitled work
(2011) · Cited by 2,025
Meta-analysis of experiments with matched groups or repeated measures designs
Dunlap, W. P., Cortina, J. M., Vaslow, J. B., & Burke, M. J. (1996) · Psychological Methods · doi:10.1037/1082-989x.1.2.170 · Cited by 1,693
P-curve: A key to the file-drawer.
Simonsohn, U., Nelson, L. D., & Simmons, J. P. (2014) · Journal of Experimental Psychology: General · doi:10.1037/a0033242 · Cited by 1,500
Contrasts and Effect Sizes in Behavioral Research
Rosenthal, R., Rosnow, R. L., & Rubin, D. B. (1999) · Cambridge University Press eBooks · doi:10.1017/cbo9780511804403 · Cited by 1,147
Self-citation
Statistical significance testing and cumulative knowledge in psychology: Implications for training of researchers.
Schmidt, F. L. (1996) · Psychological Methods · doi:10.1037/1082-989x.1.2.115 · Cited by 1,044
When small effects are impressive
Prentice, D. A., & Miller, D. T. (1992) · Psychological Bulletin · doi:10.1037/0033-2909.112.1.160 · Cited by 1,008
Psychological Statistics.
Katz, L., & McNemar, Q. (1963) · Journal of the American Statistical Association · doi:10.2307/2283304 · Cited by 991
Combining results of independent studies.
Rosenthal, R. (1978) · Psychological Bulletin · doi:10.1037/0033-2909.85.1.185 · Cited by 910
Self-citation
Understanding The New Statistics
Cumming, G. (2013) · Routledge eBooks · doi:10.4324/9780203807002 · Cited by 878
Contrasts and Effect Sizes in Behavioral Research: A Correlational Approach
Rosenthal, R., Rosnow, R. L., & Rubin, D. B. (1999) · Cited by 854
Self-citation
Sensitivity to Nonverbal Communication: The PONS Test
Rosenthal, R. (1979) · Cited by 777
Self-citation
Pride and perseverance: The motivational role of pride.
Williams, L. A., & DeSteno, D. A. (2008) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.94.6.1007 · Cited by 632
Reducing implicit racial preferences: II. Intervention effectiveness across time
Lai, C. K., Skinner, A. L., Cooley, E., Murrar, S., Brauer, M., Devos, T., Calanchini, J., Xiao, Y. J., Pedram, C., Marshburn, C. K., et al. (2016) · Journal of Experimental Psychology: General · doi:10.1037/xge0000179 · Cited by 624
Psychological statistics, 2nd ed.
McNemar, Q. (1955) · Cited by 559
Attentional bias for positive emotional stimuli: A meta-analytic investigation.
Pool, E. R., Brosch, T., Delplanque, S., & Sander, D. (2015) · Psychological Bulletin · doi:10.1037/bul0000026 · Cited by 468
Research Synthesis and Meta-Analysis
Cooper, H., Patall, E., & Lindsay, J. (2009) · The SAGE Handbook of Applied Social Research Methods · doi:10.4135/9781483348858.n11 · Cited by 397
The subtle suspension of backlash: A meta-analysis of penalties for women’s implicit and explicit dominance behavior.
Williams, M. J., & Tiedens, L. Z. (2016) · Psychological Bulletin · doi:10.1037/bul0000039 · Cited by 374 · cited 1×
“A perusal of meta-analyses published in 2016 in Psychological Bulletin showed that the number of studies included ranged from 63 (Williams & Tiedens, 2016) to 243 (Pool, Brosch, Delplanque, & Sander, 2016).”
Background
Ambiguity in Social Categorization
Hugenberg, K., & Bodenhausen, G. V. (2004) · Psychological Science · doi:10.1111/j.0956-7976.2004.00680.x · Cited by 362
Continuously Cumulating Meta-Analysis and Replicability
Braver, S. L., Thoemmes, F. J., & Rosenthal, R. (2014) · Perspectives on Psychological Science · doi:10.1177/1745691614529796 · Cited by 308
Self-citation
Suffering and compassion: The links among adverse life experiences, empathy, compassion, and prosocial behavior.
Lim, D., & DeSteno, D. (2016) · Emotion · doi:10.1037/emo0000144 · Cited by 299
Replication in Psychological Science
Lindsay, D. S. (2015) · Psychological Science · doi:10.1177/0956797615616374 · Cited by 296
MEASURING SENSITIVITY TO NONVERBAL COMMUNICATION: THE PONS TEST
Rosenthal, R., Archer, D., Hall, J. A., DiMatteo, M. R., & Rogers, P. L. (1979) · Elsevier eBooks · doi:10.1016/b978-0-12-761350-5.50012-4 · Cited by 259
Self-citation
Contrasts and Effect Sizes in Behavioral Research: A Correlational Approach
Boik, R. J. (2001) · Journal of the American Statistical Association · doi:10.1198/jasa.2001.s432 · Cited by 257
The Counternull Value of an Effect Size: A New Statistic
Rosenthal, R., & Rubin, D. B. (1994) · Psychological Science · doi:10.1111/j.1467-9280.1994.tb00281.x · Cited by 170
Self-citation
Let’s Put Our Money Where Our Mouth Is
Maner, J. K. (2014) · Perspectives on Psychological Science · doi:10.1177/1745691614528215 · Cited by 151
Patients' health as a predictor of physician and patient behavior in medical visits. A synthesis of four studies.
Hall, J. A., Roter, D., Milburn, M. A., & Daltroy, L. (1996) · Medical Care · doi:10.1097/00005650-199612000-00006 · Cited by 141
Self-citation
Meta-analytic interval estimation for bivariate correlations.
Bonett, D. G. (2008) · Psychological Methods · doi:10.1037/a0012868 · Cited by 101
Individual differences in the acceptance of stereotyping
Carter, J. D., Hall, J. A., Carney, D. R., & Rosip, J. C. (2006) · Journal of Research in Personality · doi:10.1016/j.jrp.2005.11.005 · Cited by 91
Self-citation
Editorial
Vazire, S. (2015) · Social Psychological and Personality Science · doi:10.1177/1948550615603955 · Cited by 90
Effect Sizes
Rosnow, R. L., & Rosenthal, R. (2009) · Zeitschrift für Psychologie · doi:10.1027/0044-3409.217.1.6 · Cited by 83
Self-citation
Gender Differences in Memory for the Appearance of Others
Horgan, T. G., Mast, M. S., Hall, J. A., & Carter, J. D. (2004) · Personality and Social Psychology Bulletin · doi:10.1177/0146167203259928 · Cited by 57
Self-citation
Meta-analysis to integrate effect sizes within an article: Possible misuse and Type I error inflation.
Ueno, T., Fastrich, G. M., & Murayama, K. (2016) · Journal of Experimental Psychology General · doi:10.1037/xge0000159 · Cited by 56
Motivation and interpersonal sensitivity: Does it matter how hard you try?
Hall, J. A., Blanch‐Hartigan, D., Horgan, T. G., Murphy, N. A., Rosip, J. C., & Mast, M. S. (2009) · Motivation and Emotion · doi:10.1007/s11031-009-9128-2 · Cited by 54
Self-citation
Reducing Implicit Racial Preferences: II. Intervention Effectiveness Across TimePreprint
Lai, C. K., Skinner, A. L., Cooley, E., Murrar, S., Bräuer, M., Devos, T., Calanchini, J., Xiao, Y. J., Pedram, C., Marhsburn, C., et al. (2016) · SSRN Electronic Journal · doi:10.2139/ssrn.2712520 · Cited by 52
Testing the null hypothesis in meta-analysis: A comparison of combined probability and confidence interval procedures.
Hedges, L. V., Cooper, H. M., & Bushman, B. J. (1992) · Psychological Bulletin · doi:10.1037/0033-2909.111.1.188 · Cited by 46
Affiliation‐seeking among the powerless: Lacking power increases social affiliative motivation
Case, C. R., Conlon, K. E., & Maner, J. K. (2015) · European Journal of Social Psychology · doi:10.1002/ejsp.2089 · Cited by 41
The relationship between anti-gay prejudice and the categorization of sexual orientation
Rule, N. O., Tskhay, K. O., Brambilla, M., Riva, P., Andrzejewski, S. A., & Krendl, A. C. (2015) · Personality and Individual Differences · doi:10.1016/j.paid.2014.12.038 · Cited by 38
Individual Differences in Accurately Judging Personality From Text
Hall, J. A., Goh, J. X., Mast, M. S., & Hagedorn, C. (2015) · Journal of Personality · doi:10.1111/jopy.12170 · Cited by 29
Self-citation
Clinically Relevant Correlates of Accurate Perception of Patients’ Thoughts and Feelings
Hall, J. A., Ship, A. N., Ruben, M. A., Curtin, E. M., ROTER, D. L., Clever, S. L., Smith, C. C., & Pounds, K. G. (2014) · Health Communication · doi:10.1080/10410236.2013.865507 · Cited by 24
Self-citation
Selectively Myopic? Self-Esteem and Attentional Bias in Response to Potential Relationship Threats
Lamarche, V. M., & Murray, S. L. (2014) · Social Psychological and Personality Science · doi:10.1177/1948550614532377 · Cited by 17
Who is interested in personality? The Interest in Personality Scale and its correlates
Goh, J. X., Schlegel, K., Tignor, S. M., & Hall, J. A. (2016) · Personality and Individual Differences · doi:10.1016/j.paid.2016.05.366 · Cited by 10
Self-citation

Research works printed but not linked: 4

Borenstein M., 2005, Comprehensive Meta‐analysis (version 3)
Lai C. K., Reducing Implicit Racial Preferences: II
Mosteller F. M., 1954, Handbook of Social Psychology: Volume I. Theory and Method
Rosenthal R., 2008, Essentials of Behavioral Research

Sorted by citations

Meta-analysis of pro-environmental behaviour spillover
Maki, A., Carrico, A. R., Raimi, K. T., Truelove, H. B., Araujo, B., & Yeung, K. L. (2019) · Nature Sustainability · doi:10.1038/s41893-019-0263-9 · Cited by 416
Interventions to improve mental health, well-being, physical health, and lifestyle behaviors in physicians and nurses: a systematic review
Melnyk, B. M., Kelly, S. A., Stephens, J., Dhakal, K., McGovern, C., Tucker, S., Hoying, J., McRae, K., Ault, S., Spurlock, E., et al. (2020) · American Journal of Health Promotion · doi:10.1177/0890117120920451 · Cited by 364
The Relationship Between Forward Head Posture and Neck Pain: a Systematic Review and Meta-Analysis
Mahmoud, N. F., Hassan, K. A., Abdelmajeed, S. F., Moustafa, I. M., & Silva, A. G. (2019) · Current Reviews in Musculoskeletal Medicine · doi:10.1007/s12178-019-09594-y · Cited by 360
Racial bias in judgments of physical size and formidability: From size to threat.
Wilson, J. P., Hugenberg, K., & Rule, N. O. (2017) · Journal of Personality and Social Psychology · doi:10.1037/pspi0000092 · Cited by 364
Effective strategies for rebutting science denialism in public discussions
Schmid, P., & Betsch, C. (2019) · Nature Human Behaviour · doi:10.1038/s41562-019-0632-4 · Cited by 264

See all 994

Authors: Goh, J. X., Hall, J. A., & Rosenthal, R.
Affiliations: Northeastern University (US)
University of California, Riverside (US)
Corresponding author: Goh, Jin X.
ORCID: Goh, Jin X.
Hall, Judith A.
Venue: Social and Personality Psychology Compass
Publisher: Wiley
Published: 2016-10
Volume: 10
Issue: 10
Pages: 535-549
ISSN: 1751-9004 (ISSN-L)
DOI: 10.1111/spc3.12267
OpenAlex: W2527755291
Cited by: 994
References: 58
Citations by year: 2026: 55 · 2025: 110 · 2024: 89 · 2023: 128 · 2022: 121 · 2021: 132 · 2020: 121 · 2019: 100 · 2018: 86 · 2017: 50 · 2016: 2
FWCI: 74.11
Type: journal article
Language: en
Open access: closed
Licence: onlinelibrary.wiley.com/termsAndConditions#vor (vor, 1 d)
Locations: Social and Personality Psychology Compass (publishedVersion)
Topics: Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
Keywords: effect size estimation

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Mini Meta‐Analysis of Your Own Studies: Some Arguments on Why and a Primer on How

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Citations

Cites

Cited by

Related

Metadata

Record

About these checks