On the bias of Huffcutt and Arthur's (1995) procedure for identifying outliers in the meta-analysis of correlations.

Beal, Daniel J., Corey, David M., Dunlap, William P.·2002·Journal of Applied Psychology

Abstract

This study documents how the use of A. I. Huffcutt & W. A. Arthur's (1995) sample adjusted meta-analytic deviancy (SAMD) statistic for identifying outliers in correlational meta-analyses results in inaccuracies in mean r. Monte Carlo simulations found that use of the SAMD resulted in the overidentification of small relative to large correlations as outliers. Furthermore, this tendency to overidentify small correlations was found to increase as the magnitude of the population correlation increased and resulted in mean rs that overestimated the population correlation. The implications for meta-analysts are discussed, and 2 possible solutions are offered.

Cites (2)

  1. Toward an integrative theory of training motivation: A meta-analytic path analysis of 20 years of research.
    Colquitt, Jason A., LePine, Jeffrey A., Noe, Raymond A. · 2000 · Journal of Applied Psychology
  2. Meta-analyzing the relationship between grades and job performance.
    Roth, Philip L., BeVier, Craig A., Switzer, Fred S., Schippmann, Jeffery S. · 1996 · Journal of Applied Psychology

Show all 2 references

Cited by (26)

  1. Perceived organizational support: a meta-analytic evaluation of organizational support theory.
    Kurtessis, James N., Eisenberger, Robert, Ford, Michael T., Buffardi, Louis C., Stewart, Kathleen A., Adis, Cory S. · 2017 · Journal of Management
  2. Transfer of Training: A Meta-Analytic Review
    Blume, Brian D., Ford, J. Kevin, Baldwin, Timothy T., Huang, Jason L. · 2010 · Journal of Management
  3. A meta-analysis of self-regulated learning in work-related training and educational attainment: what we know and where we need to go.
    Sitzmann, Traci, Ely, Katherine · 2011 · Psychological Bulletin
  4. Distress in couples coping with cancer: A meta-analysis and critical review of role and gender effects.
    Hagedoorn, Mariët, Sanderman, Robbert, Bolks, Hilde N., Tuinstra, Jolanda, Coyne, James C. · 2008 · Psychological Bulletin
  5. Expertise Differences in the Comprehension of Visualizations: a Meta-Analysis of Eye-Tracking Research in Professional Domains
    Gegenfurtner, Andreas, Lehtinen, Erno, Säljö, Roger · 2011 · Educational Psychology Review

See all 79

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: On the bias of Huffcutt and Arthur's (1995) procedure for identifying outliers in the meta-analysis of correlations. https://app.cochat.ai/papers/10.1037//0021-9010.87.3.583
The paper
Beal, D. J., Corey, D. M., & Dunlap, W. P. (2002). On the bias of Huffcutt and Arthur's (1995) procedure for identifying outliers in the meta-analysis of correlations. Journal of Applied Psychology. https://doi.org/10.1037//0021-9010.87.3.583

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.