Methods of Meta-Analysis: Correcting Error and Bias in Research Findings
The DOI matches its Crossref record.
Abstract
PART ONE: INTRODUCTION TO META-ANALYSIS Integrating Research Findings Across Studies Study Artifacts and Their Impact on Study Outcomes PART TWO: META-ANALYSIS OF CORRELATIONS Meta-Analysis of Correlations Corrected Individually for Artifacts Meta-Analysis of Correlations Using Artifact Distributions Technical Questions in Meta-Analysis of Correlations PART THREE: META-ANALYSIS OF EXPERIMENTAL EFFECTS AND OTHER DICHOTOMOUS COMPARISONS Treatment Effects Experimental Artifacts and Their Impact Meta-Analysis Methods for d Values Technical Questions in Meta-Analysis of d Values PART FOUR: GENERAL ISSUES IN META-ANALYSIS Second Order Sampling Error and Related Issues Cumulation of Findings within Studies Methods of Integrating Findings Across Studies Locating, Selecting, and Evaluating Studies General Criticisms of Meta-Analysis Summary of Psychometric Meta-Analysis
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Because the key test we aimed to perform was differences in performance across time, correcting for test-retest reliability was necessary to avoid issues of bias in effect sizes.”
From Menstrual cycle effects on cognitive performance: A meta-analysis (2025) · cites this paper as [41]
In the citing paper
“Although effect sizes could be averaged within study, the composite variable approach is favored since it generates unbiased variance estimates and an effect size of greater validity [41].”
From Menstrual cycle effects on cognitive performance: A meta-analysis (2025) · cites this paper as [41]
In the citing paper
“When one sample would have contributed two effect sizes to the same meta-analytic estimate, a composite was formed to ensure that all available information was incorporated (76).”
From Meta-analytic relations between personality and cognitive ability (2023) · cites this paper as [76]
In the citing paper
“Psychometric meta-analysis (76) was used to combine effect sizes across studies.”
From Meta-analytic relations between personality and cognitive ability (2023) · cites this paper as [76]
In the citing paper
“Sampling error estimates allow for the degree to which between-study variance might be substantive, i.e. due to the action of potential moderators (Schmidt & Hunter, 2015).”
From A Meta-Analysis of Spearman’s Hypothesis in the United States (2026) · cites this paper as Schmidt & Hunter, 2015
2 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cited by
Items 1,201–1,293 of 1,293
Reynolds, M. R., & Keith, T. Z. (2017) · Intelligence · doi:10.1016/j.intell.2017.02.005 · Cited by 80
Simonsmeier, B. A., Flaig, M., Simacek, T., & Schneider, M. (2022) · Health Psychology Review · doi:10.1080/17437199.2021.1967184 · Cited by 81
The use of meta-analytic statistical significance testing
Polanin, J. R., & Pigott, T. D. (2015) · Research Synthesis Methods · doi:10.1002/jrsm.1124 · Cited by 78
Hypnotic enhancement of cognitive-behavioral weight loss treatments—Another meta-reanalysis.
Kirsch, I. (1996) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.64.3.517 · Cited by 80
Customer participation in service recovery: a meta-analysis
Van Vaerenbergh, Y., Hazée, S., & Costers, A. (2018) · Marketing Letters · doi:10.1007/s11002-018-9470-9 · Cited by 80
Current methods for meta-analysis
Schulze, R. (2007) · Zeitschrift für Psychologie / Journal of Psychology · doi:10.1027/0044-3409.215.2.90 · Cited by 79
Comparison of two random-effects methods of meta-analysis.
Hall, S. M., & Brannick, M. T. (2002) · Journal of Applied Psychology · doi:10.1037/0021-9010.87.2.377 · Cited by 79
Ericsson, K. A. (2016) · Perspectives on Psychological Science · doi:10.1177/1745691616635600 · Cited by 78
Davies, S. E., Connelly, B. S., Ones, D. S., & Birkland, A. S. (2015) · Personality and Individual Differences · doi:10.1016/j.paid.2015.01.006 · Cited by 77
Facilitating retail customers’ use of AI-based virtual assistants: A meta-analysis
Blut, M., Wünderlich, N. V., & Brock, C. (2024) · Journal of Retailing · doi:10.1016/j.jretai.2024.04.001 · Cited by 75
Psychological Effects of Meditation for Healthy Practitioners: An Update
Sedlmeier, P., Loße, C., & Quasten, L. C. (2018) · Mindfulness · doi:10.1007/s12671-017-0780-4 · Cited by 74
Barham, M. P., Enticott, P. G., Conduit, R., & Lum, J. A. G. (2016) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2016.01.009 · Cited by 74
Nienaber, A.-M., Hofeditz, M., & H. Searle, R. (2014) · International Journal of Bank Marketing · doi:10.1108/ijbm-12-2013-0146 · Cited by 74
Intelligence and interpersonal sensitivity: A meta-analysis
Murphy, N. A., & Hall, J. A. (2011) · Intelligence · doi:10.1016/j.intell.2010.10.001 · Cited by 73
Connelly, B. S., Ones, D. S., Davies, S. E., & Birkland, A. (2014) · Journal of Personality Assessment · doi:10.1080/00223891.2013.809355 · Cited by 67
Emotional congruence with children and sexual offending against children: A meta-analytic review.
McPhail, I. V., Hermann, C. A., & Nunes, K. L. (2013) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0033248 · Cited by 70
Marek, R. J., Tarescavage, A. M., Ben-Porath, Y. S., Ashton, K., Merrell Rish, J., & Heinberg, L. J. (2015) · Surgery for Obesity and Related Diseases · doi:10.1016/j.soard.2015.03.020 · Cited by 69
Berry, C. M., & Sackett, P. R. (2009) · Psychological Science · doi:10.1111/j.1467-9280.2009.02368.x · Cited by 68
(2015) · Educational Technology & Society · Cited by 68
The effect of chatbots on learning: a meta-analysis of empirical research
Alemdag, E. (2025) · Journal of Research on Technology in Education · doi:10.1080/15391523.2023.2255698 · Cited by 67
Sala, G., Aksayli, N. D., Tatlidil, K. S., Gondo, Y., & Gobet, F. (2019) · Intelligence · doi:10.1016/j.intell.2019.101386 · Cited by 72
The Reliability of Peer Assessments: A Meta-Analysis
Goldman, R. L. (1994) · Evaluation & the Health Professions · doi:10.1177/016327879401700101 · Cited by 62
Clinical Hypnosis as an Adjunct to Cognitive Behavior Therapy: An Updated Meta-Analysis
Ramondo, N., Gignac, G. E., Pestell, C. F., & Byrne, S. M. (2021) · International Journal of Clinical and Experimental Hypnosis · doi:10.1080/00207144.2021.1877549 · Cited by 72
Autonomic nervous system activity during positive emotions: a meta-analytic review
Behnke, M., Kreibig, S. D., Kaczmarek, L. D., Assink, M., & Gross, J. J. (2022) · Emotion Review · doi:10.1177/17540739211073084 · Cited by 60
BEAULIEU‐PRÉVOST, D., & ZADRA, A. (2007) · Journal of Sleep Research · doi:10.1111/j.1365-2869.2007.00572.x · Cited by 59
Sleep-dependent motor memory consolidation in healthy adults: a meta-analysis
Schmid, D., Erlacher, D., Klostermann, A., Kredel, R., & Hossner, E.-J. (2020) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2020.07.028 · Cited by 58
Park, H. (., Wiernik, B. M., Oh, I.-S., Gonzalez-Mulé, E., Ones, D. S., & Lee, Y. (2020) · Journal of Applied Psychology · doi:10.1037/apl0000476 · Cited by 57
The use of meta-analysis in MIS research: promises and problems
Hwang, M. I. (1996) · ACM SIGMIS Database: the DATABASE for Advances in Information Systems · doi:10.1145/264417.264433 · Cited by 56
Purmehdi, M., Legoux, R., Carrillat, F., & Senecal, S. (2017) · Journal of Public Policy & Marketing · doi:10.1509/jppm.14.047 · Cited by 55
Chae, Y., Lee, S., & Kim, Y. (2019) · Asian Journal of Communication · doi:10.1080/01292986.2018.1499121 · Cited by 55
Chan, R., Steel, Z., Brooks, R., Heung, T., Erlich, J., Chow, J., & Suranyi, M. (2011) · Journal of Psychosomatic Research · doi:10.1016/j.jpsychores.2011.05.002 · Cited by 54
Aripiprazole monotherapy in the treatment of bipolar disorder: A meta-analysis
Fountoulakis, K. N., Vieta, E., & Schmidt, F. (2011) · Journal of Affective Disorders · doi:10.1016/j.jad.2010.10.018 · Cited by 52
Self-citationMeta-analysis, can it ever fail?
Kotiaho, J. S., & Tomkins, J. L. (2002) · Oikos · doi:10.1034/j.1600-0706.2002.960316.x · Cited by 52
Reeve, C. L., & Hakel, M. D. (2000) · Journal of Applied Psychology · doi:10.1037/0021-9010.85.6.897 · Cited by 51
Fernandes, H. B. F., Woodley, M. A., & te Nijenhuis, J. (2014) · Intelligence · doi:10.1016/j.intell.2014.07.007 · Cited by 50
“Cognitive control in media multitaskers” ten years on: A meta-analysis
Parry, D. A., & Le Roux, D. B. (2021) · Cyberpsychology: Journal of Psychosocial Research on Cyberspace · doi:10.5817/cp2021-2-7 · Cited by 49
Metasynthesis of Preservice Professional Preparation and Teacher Education Research Studies
Dunst, C. J., Hamby, D. W., Howse, R. B., Wilkie, H., & Annas, K. (2019) · Education Sciences · doi:10.3390/educsci9010050 · Cited by 49
Iniesta-Sepúlveda, M., Rodríguez-Jiménez, T., Lebowitz, E. R., Goodman, W. K., & Storch, E. A. (2021) · Child Psychiatry & Human Development · doi:10.1007/s10578-020-00987-6 · Cited by 48
A meta-analysis: age and second language grammar acquisition.
Qureshi, M. A. (2016) · System · doi:10.1016/j.system.2016.06.001 · Cited by 48
Allison, D. B., & Faith, M. S. (1996) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.64.3.513 · Cited by 51
Romano, K. A., Heron, K. E., Sandoval, C. M., Howard, L. M., MacIntyre, R. I., & Mason, T. B. (2022) · Clinical Psychology Review · doi:10.1016/j.cpr.2022.102127 · Cited by 47
Woodley, M. A., te Nijenhuis, J., Must, O., & Must, A. (2014) · Intelligence · doi:10.1016/j.intell.2013.12.004 · Cited by 46
The divided self and psychological (mal) adjustment – A meta-analytic review
Bleidorn, W., & Ködding, C. (2013) · Journal of Research in Personality · doi:10.1016/j.jrp.2013.04.009 · Cited by 46
The Impact of APA and AERA Guidelines on effect size reporting
Peng, C.-Y. J., Chen, L.-T., Chiang, H.-M., & Chiang, Y.-C. (2013) · Educational Psychology Review · doi:10.1007/s10648-013-9218-2 · Cited by 46
Schmidt, F. L. (2017) · Archives of Scientific Psychology · doi:10.1037/arc0000033 · Cited by 45
Self-citationRothstein, H. R., & Bushman, B. J. (2015) · Perspectives on Psychological Science · doi:10.1177/1745691615592235 · Cited by 44
Smith, M. M., Hewitt, P. L., Sherry, S. B., Flett, G. L., & Ray, C. (2022) · Journal of Research in Personality · doi:10.1016/j.jrp.2021.104180 · Cited by 47
The correlation between paper length and citations: a meta-analysis
Xie, J., Gong, K., Cheng, Y., & Ke, Q. (2019) · Scientometrics · doi:10.1007/s11192-019-03015-0 · Cited by 40
The effect of rater accountability on performance ratings: a meta-analytic review
Harari, M. B., & Rudolph, C. W. (2017) · Human Resource Management Review · doi:10.1016/j.hrmr.2016.09.007 · Cited by 38
Villanova, P., & Roman, M. A. (1993) · Human Resource Management Review · doi:10.1016/1053-4822(93)90021-u · Cited by 39
Pfefferbaum, B., Nitiéma, P., & Newman, E. (2019) · Journal of Traumatic Stress · doi:10.1002/jts.22391 · Cited by 41
The Social Information Processing Model in Child Physical Abuse and Neglect: A Meta-analytic Review
Camilo, C., Garrido, M. V., & Calheiros, M. M. (2020) · Child Abuse & Neglect · doi:10.1016/j.chiabu.2020.104666 · Cited by 37
White, L. M., Aalsma, M. C., Salyers, M. P., Hershberger, A. R., Anderson, V. R., Schwartz, K., Dir, A. L., & McGrew, J. H. (2019) · Journal of Adolescent Health · doi:10.1016/j.jadohealth.2019.02.010 · Cited by 37
Prevalence and Correlates of Academic Dishonesty: Towards a Sustainable University
Cuadrado, D., Salgado, J. F., & Moscoso, S. (2019) · Sustainability · doi:10.3390/su11216062 · Cited by 37
Changes in Disordered Eating Behaviors over 10 or More Years: A Meta-Analysis
Romano, K. A., Heron, K. E., Amerson, R., Howard, L. M., MacIntyre, R. I., & Mason, T. B. (2020) · International Journal of Eating Disorders · doi:10.1002/eat.23288 · Cited by 36
Thomann, H., & Deutscher, V. (2025) · Educational Research Review · doi:10.1016/j.edurev.2025.100686 · Cited by 40
Reliability assessment of pedometer activity measurements
Tryon, W. W., Pinto, L. P., & Morrison, D. F. (1991) · Journal of Psychopathology and Behavioral Assessment · doi:10.1007/bf00960737 · Cited by 34
Entrepreneurial spawning and knowledge-based perspective: A meta-analysis
Garrett, R. P., Miao, C., Qian, S., & Bae, T. J. (2017) · Small Business Economics · doi:10.1007/s11187-017-9842-1 · Cited by 33
Xue, Y. (2024) · Education and Information Technologies · doi:10.1007/s10639-024-12596-0 · Cited by 33
Are adoption gains on the g factor? A meta-analysis
te Nijenhuis, J., Jongeneel-Grimen, B., & Armstrong, E. L. (2015) · Personality and Individual Differences · doi:10.1016/j.paid.2014.09.022 · Cited by 32
Testing the performance of online recommendation agents: A meta-analysis
Blut, M., Ghiassaleh, A., & Wang, C. (2023) · Journal of Retailing · doi:10.1016/j.jretai.2023.08.001 · Cited by 31
Kaufmann, E., Reips, U.-D., & Maag Merki, K. (2016) · Zeitschrift für Psychologie · doi:10.1027/2151-2604/a000251 · Cited by 31
Morris, S. B. (2008) · Organizational Research Methods · doi:10.1177/1094428106295494 · Cited by 26
Pesta, B. J., Kirkegaard, E. O. W., te Nijenhuis, J., Lasker, J., & Fuerst, J. G. R. (2020) · Intelligence · doi:10.1016/j.intell.2019.101408 · Cited by 24
Tactile Picture Recognition: Errors Are in Shape Acquisition or Object Matching?
Sinha, P., & Kalia, A. A. (2012) · Seeing and Perceiving · doi:10.1163/187847511x584443 · Cited by 24
Bushman, B. J., & Wang, M. C. (1995) · Psychological Bulletin · doi:10.1037//0033-2909.117.3.530 · Cited by 24
Domain-specific innovativeness: A meta-analysis in business and consumer
Araujo, C. F., Ladeira, W. J., Santini, F. D. O., & Sampaio, C. H. (2016) · RAI revista de administração e inovação · doi:10.1016/j.rai.2016.03.003 · Cited by 22
In France, are secular IQ losses biologically caused? A comment on Dutton and Lynn (2015)
Woodley of Menie, M. A., & Dunkel, C. S. (2015) · Intelligence · doi:10.1016/j.intell.2015.08.009 · Cited by 22
Menstrual cycle effects on cognitive performance: A meta-analysis
Jang, D., Zhang, J., & Elfenbein, H. A. (2025) · PLOS ONE · doi:10.1371/journal.pone.0318576 · Cited by 21
Blut, M., Frennea, C. M., Mittal, V., & Mothersbaugh, D. L. (2015) · International Journal of Research in Marketing · doi:10.1016/j.ijresmar.2015.01.001 · Cited by 21
Still no evidence that exergames improve cognitive ability: A commentary on Stanmore et al. (2017)
Sala, G., Tatlidil, K. S., & Gobet, F. (2021) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2019.11.015 · Cited by 21
Schilling, M., Becker, N., Grabenhorst, M. M., & König, C. J. (2021) · International Journal of Selection and Assessment · doi:10.1111/ijsa.12314 · Cited by 20
Spearman’s Hypothesis Tested on Black Adults: A Meta-Analysis
Te Nijenhuis, J., & Van den Hoek, M. (2016) · Journal of Intelligence · doi:10.3390/jintelligence4020006 · Cited by 18
Wicherts, J. M. (2017) · Intelligence · doi:10.1016/j.intell.2016.11.002 · Cited by 17
Woodley of Menie, M. A., Figueredo, A. J., Dunkel, C. S., & Madison, G. (2015) · Personality and Individual Differences · doi:10.1016/j.paid.2015.05.032 · Cited by 17
Otero, I., Cuadrado, D., & Martínez, A. (2020) · Revista de Psicología del Trabajo y de las Organizaciones · doi:10.5093/jwop2020a17 · Cited by 16
Mureşan, V., Montgomery, G. H., & David, D. (2012) · Journal of Technology in Human Services · doi:10.1080/15228835.2011.653290 · Cited by 16
The Effect of Flipped Classroom Model on Mathematical Ability: A Meta Analysis Study
Purnomo, B., Muhtadi, A., Ramadhani, R., Manaf, A., & Hukom, J. (2022) · Jurnal Pendidikan Progresif · doi:10.23960/jpp.v12.i3.202216 · Cited by 16
What Matters for Team Cohesion Measurement? A Synthesis
Grossman, R., Rosch, Z., Mazer, D., & Salas, E. (2015) · Team Cohesion: Advances in Psychological Theory, Methods and Practice · doi:10.1108/s1534-085620150000017007 · Cited by 16
A reinforcement sensitivity theory view of seeking behaviors at work: A meta‐analysis
Sherf, E. N., Gilliam, N., & McElroy, T. (2024) · Personnel Psychology · doi:10.1111/peps.12579 · Cited by 15
Mackey, J. D. (2021) · Journal of Business Research · doi:10.1016/j.jbusres.2021.03.002 · Cited by 14
Consumer confusion: A meta-analytic review
Shahid, S., Maseeh, H. I., Jebarajakirthy, C., Kumar Sharma, B., Saha, R., & Gupta, S. (2025) · Journal of Business Research · doi:10.1016/j.jbusres.2025.115294 · Cited by 13
“Choice-supportive bias” in science: Explanation and mitigation
Kafaee, M., Marhamati, H., & Gharibzadeh, S. (2021) · Accountability in Research · doi:10.1080/08989621.2021.1872377 · Cited by 12
Jaworski, J., & Czerwonka, L. (2024) · DECISION · doi:10.1007/s40622-023-00372-x · Cited by 11
Social adversity reduces polygenic score expressivity for general cognitive ability, but not height
Peñaherrera-Aguirre, M., Woodley, M. A., Sarraf, M. A., & Beaver, K. M. (2022) · Twin Research and Human Genetics · doi:10.1017/thg.2022.3 · Cited by 10
Woodley of Menie, M. A., Fernandes, H. B. F., Kanazawa, S., & Dutton, E. (2018) · HOMO · doi:10.1016/j.jchb.2018.06.003 · Cited by 9
Fendt, M., Muth, X., & Edelsbrunner, P. A. (2025) · Learning and Individual Differences · doi:10.1016/j.lindif.2025.102782 · Cited by 6
How to Fool Yourself With Experiments in Testing Theories in Psychological Research.
Wittmann, W. W., & Klumb, P. L. (2006) · Strengthening research methodology: Psychological measurement and evaluation. · doi:10.1037/11384-010 · Cited by 6
Whether and when e-HRM improves organizational performance: A meta-analysis
Cheng, Y., & Zou, Y. (2021) · Academy of Management Proceedings · doi:10.5465/ambpp.2021.133 · Cited by 3
Martínez, A., Lado, M., Cuadrado, D., & Salgado, J. F. (2025) · Journal of Work and Organizational Psychology · doi:10.5093/jwop2025a3 · Cited by 4
The asymmetry of working memory training transfer: A systematic review and meta-analysis
Fu, J., Zhou, Y., Yuan, M., & Cai, Y. (2026) · Psychonomic Bulletin & Review · doi:10.3758/s13423-026-02994-5
A Meta-Analysis of Spearman’s Hypothesis in the United States
Woodley of Menie, M., Peñaherrera-Aguirre, M., & Sarraf, M. (2026) · Intelligence & Cognitive Abilities · doi:10.65550/001c.171909
Sala, G., & Gobet, F. (2019) · Collabra: Psychology · doi:10.2478/collabra.2019.5.1.18
Metadata
- Authors
- Schmidt, F. L., & Hunter, J. E.
- Affiliations
- Michigan State University (US)
- ORCID
- Hunter, John E.
- Venue
- SAGE Publications Ltd eBooks
- Publisher
- SAGE Publications, Ltd
- Published
- 2015
- OpenAlex
- W1511920456
- Cited by
- 5,542
- References
- 0
- Citations by year
- 2026: 86 · 2025: 155 · 2024: 169 · 2023: 147 · 2022: 170 · 2021: 261 · 2020: 289 · 2019: 295 · 2018: 272 · 2017: 262 · 2016: 272 · 2015: 286
- FWCI
- 126.79
- Type
- book
- Language
- en
- Open access
- closed
- Locations
- SAGE Publications Ltd eBooks (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Keywords
- meta-analysis, measurement error correction, experimental artifacts
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.