On the bias of Huffcutt and Arthur's (1995) procedure for identifying outliers in the meta-analysis of correlations.
Abstract
This study documents how the use of A. I. Huffcutt & W. A. Arthur's (1995) sample adjusted meta-analytic deviancy (SAMD) statistic for identifying outliers in correlational meta-analyses results in inaccuracies in mean r. Monte Carlo simulations found that use of the SAMD resulted in the overidentification of small relative to large correlations as outliers. Furthermore, this tendency to overidentify small correlations was found to increase as the magnitude of the population correlation increased and resulted in mean rs that overestimated the population correlation. The implications for meta-analysts are discussed, and 2 possible solutions are offered.
Cites (2)
- Toward an integrative theory of training motivation: A meta-analytic path analysis of 20 years of research.Colquitt, Jason A., LePine, Jeffrey A., Noe, Raymond A. · 2000 · Journal of Applied Psychology
- Meta-analyzing the relationship between grades and job performance.Roth, Philip L., BeVier, Craig A., Switzer, Fred S., Schippmann, Jeffery S. · 1996 · Journal of Applied Psychology
Cited by (26)
- Perceived organizational support: a meta-analytic evaluation of organizational support theory.Kurtessis, James N., Eisenberger, Robert, Ford, Michael T., Buffardi, Louis C., Stewart, Kathleen A., Adis, Cory S. · 2017 · Journal of Management
- Transfer of Training: A Meta-Analytic ReviewBlume, Brian D., Ford, J. Kevin, Baldwin, Timothy T., Huang, Jason L. · 2010 · Journal of Management
- A meta-analysis of self-regulated learning in work-related training and educational attainment: what we know and where we need to go.Sitzmann, Traci, Ely, Katherine · 2011 · Psychological Bulletin
- Distress in couples coping with cancer: A meta-analysis and critical review of role and gender effects.Hagedoorn, Mariët, Sanderman, Robbert, Bolks, Hilde N., Tuinstra, Jolanda, Coyne, James C. · 2008 · Psychological Bulletin
- Expertise Differences in the Comprehension of Visualizations: a Meta-Analysis of Eye-Tracking Research in Professional DomainsGegenfurtner, Andreas, Lehtinen, Erno, Säljö, Roger · 2011 · Educational Psychology Review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: On the bias of Huffcutt and Arthur's (1995) procedure for identifying outliers in the meta-analysis of correlations. https://app.cochat.ai/papers/10.1037//0021-9010.87.3.583
- The paper
- Beal, D. J., Corey, D. M., & Dunlap, W. P. (2002). On the bias of Huffcutt and Arthur's (1995) procedure for identifying outliers in the meta-analysis of correlations. Journal of Applied Psychology. https://doi.org/10.1037//0021-9010.87.3.583
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.