Comparison of Three Meta-Analytic Procedures for Estimating Moderating Effects of Categorical Variables
The DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Abstract
The authors conducted Monte Carlo simulations to compare the Hedges and Olkin, the Hunter and Schmidt, and a refinement of the Aguinis and Pierce meta-analytic approaches for estimating moderating effects of categorical variables. The simulation examined binary moderator variables (e.g., gender—male, female; ethnicity—majority, minority). The authors compared the three meta-analytic methods in terms of their point estimation accuracy and Type I and Type II error rates. Results provide guidelines to help researchers choose among the three meta-analytic techniques based on theory (i.e., exploratory vs. confirmatory research) and research design considerations (i.e., degree of range restriction and measurement error).
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Primary, Secondary, and Meta-Analysis of Research
GLASS, G. V. (1976) · Educational Researcher · doi:10.3102/0013189x005010003 · Cited by 4,890
Hunter, J., & Schmidt, F. (2004) · doi:10.4135/9781412985031 · Cited by 3,023
Meta-Analytic review of leader–member exchange theory: Correlates and construct issues.
Gerstner, C. R., & Day, D. V. (1997) · Journal of Applied Psychology · doi:10.1037/0021-9010.82.6.827 · Cited by 3,005
Aguinis, H., Beaty, J. C., Boik, R. J., & Pierce, C. A. (2005) · Journal of Applied Psychology · doi:10.1037/0021-9010.90.1.94 · Cited by 1,216 · cited 5×
“Although the past decade has produced several comparisons of metaanalytic methods (e.g., Field, 2005; Fuller & Hester, 1999; S. M. Hall & Brannick, 2002; Hough & Hall, 1994; Johnson et al., 1995), there are only a few studies that have compared meta-analytic tests for moderator variables. Six notable exceptions are Co…”
BackgroundMethodInfluentialSelf-citationWolf, F. (1986) · doi:10.4135/9781412984980 · Cited by 784
The power of statistical tests in meta-analysis
Hedges, L. V., & Pigott, T. D. (2001) · Psychological Methods · doi:10.1037/1082-989x.6.3.203 · Cited by 716 · cited 1×
“Although previous work has investigated this statistical power issue (Cornwell & Ladd, 1993; Hedges & Pigott, 2001; Overton, 1998; Sackett, Harris, & Orr, 1986; Spector & Levine, 1987), the present study included a more complete set of situations (e.g., measurement error and range restriction) and…”
BackgroundSturman, M. C. (2003) · Journal of Management · doi:10.1016/s0149-2063_03_00028-x · Cited by 578 · cited 1×
“Sturman and his colleagues (Sturman, 2003; Sturman, Cheramie, & Cashen, 2005) tested the moderating effects of type of job performance measure (objective or subjective) on various predictor-job performance relationships.”
BackgroundSelf-citationWebber, S. S., & Donahue, L. M. (2001) · Journal of Management · doi:10.1177/014920630102700202 · Cited by 518 · cited 1×
“First, the Aguinis and Pierce approach was analytically described, and it has already been cited (e.g., Collins & Holton, 2004; Sharma & Yetton, 2003) and used in published research (e.g., Webber & Donahue, 2001).”
MethodSharma, R., & Yetton, P. (2003) · MIS Quarterly · doi:10.2307/30036548 · Cited by 470 · cited 1×
“First, the Aguinis and Pierce approach was analytically described, and it has already been cited (e.g., Collins & Holton, 2004; Sharma & Yetton, 2003) and used in published research (e.g., Webber & Donahue, 2001).”
MethodComparing meta-analytic moderator estimation techniques under realistic conditions.
Steel, P. D., & Kammeyer-Mueller, J. D. (2002) · Journal of Applied Psychology · doi:10.1037/0021-9010.87.1.96 · Cited by 309 · cited 1×
“Six notable exceptions are Cornwell and Ladd (1993), Sagie and Koslowsky (1993), Johnson et al. (1995), Marin-Martinez and Sanchez- Meca (1998), Overton (1998), and Steel and Kammeyer-Mueller (2002).”
Background
Research works printed but not linked: 38
- 10.1111/j.1744-6570.2001.tb00223.x · DOI
- Aguinis, H., 2004, Regression analysis for categorical moderators
- Aguinis, H., 2007, Performance management
- 10.1177/109442810144001 · DOI · Paper page
- 10.1177/109442819924001 · DOI · Paper page
- 10.1177/014920639802400501 · doi:10.1177/014920639802400501
- 10.1037/0021-9010.82.1.192 · doi:10.1037/0021-9010.82.1.192 · Paper page
- 10.1037/0021-9010.82.4.528 · doi:10.1037/0021-9010.82.4.528 · Paper page
- Bobko, P. & Stone-Romero, E.F. (1998). Meta-analysis may be another useful research tool, but it is not a panacea. In Research in personnel and human resources management (Vol. 16, pp. 359-397). Stamford, CT: JAI.
- Cohen, J., 1988, Statistical power analysis for the behavioral sciences
- 10.1002/hrdq.1099 · DOI · Paper page
- 10.1177/0013164493053004002 · DOI · Paper page
- 10.2307/256988 · DOI · Paper page
- 10.1037/1082-989X.10.4.444 · DOI · Paper page
- 10.1177/014920639902500602 · DOI
- 10.1080/03637759109376240 · DOI
- 10.1037/0021-9010.87.2.377 · DOI · Paper page
- Hedges, L.V., 1985, Statistical methods for meta-analysis
- 10.1080/00220671.1994.9941256 · doi:10.1080/00220671.1994.9941256
- 10.1037/0021-9010.81.5.459 · doi:10.1037/0021-9010.81.5.459 · Paper page
- Hunter, J.E., 1990, Methods of meta-analysis: Correcting error and bias in research findings
- Johnson, B.T., 1993, DSTAT 1.10: Software for the meta-analytic review of research literatures
- 10.1037/0021-9010.80.1.94 · doi:10.1037/0021-9010.80.1.94 · Paper page
- 10.1080/00220979809598345 · DOI · Paper page
- 10.1037/0021-9010.74.3.456 · DOI
- Neter, J., 1988, Applied statistics
- 10.1037/0021-9010.83.2.164 · doi:10.1037/0021-9010.83.2.164 · Paper page
- 10.1037/1082-989X.3.3.354 · doi:10.1037/1082-989x.3.3.354 · Paper page
- 10.2307/256964 · DOI · Paper page
- 10.2307/1556374 · DOI · Paper page
- 10.1177/014920639502100412 · doi:10.1177/014920639502100412
- 10.1037/0021-9010.79.2.163 · DOI · Paper page
- 10.1037/0021-9010.71.2.302 · DOI
- 10.1111/j.1744-6570.1993.tb00888.x · DOI · Paper page
- 10.1037/0021-9010.72.1.3 · doi:10.1037/0021-9010.72.1.3 · Paper page
- 10.1016/S0149-2063(03)00028-X · doi:10.1016/s0149-2063(03)00028-x · Paper page
- 10.1037/0021-9010.90.2.269 · DOI · Paper page
- 10.1177/0013164498058001007 · DOI · Paper page
Cited by
Benefits of Training and Development for Individuals and Teams, Organizations, and Society
Aguinis, H., & Kraiger, K. (2009) · Annual Review of Psychology · doi:10.1146/annurev.psych.60.110707.163505 · Cited by 2,302
Self-citationRichardson, H. A., Simmering, M. J., & Sturman, M. C. (2009) · Organizational Research Methods · doi:10.1177/1094428109332834 · Cited by 1,721
Self-citationGolicic, S. L., & Smith, C. D. (2013) · Journal of Supply Chain Management · doi:10.1111/jscm.12006 · Cited by 790
Age and work‐related motives: Results of a meta‐analysis
Kooij, D. T. A. M., De Lange, A. H., Jansen, P. G. W., Kanfer, R., & Dikkers, J. S. E. (2011) · Journal of Organizational Behavior · doi:10.1002/job.665 · Cited by 740
Endrikat, J., Guenther, E., & Hoppe, H. (2014) · European Management Journal · doi:10.1016/j.emj.2013.12.004 · Cited by 575
Metadata
- Authors
- Aguinis, H., Sturman, M. C., & Pierce, C. A.
- Venue
- Organizational Research Methods
- Publisher
- SAGE Publications
- Published
- 2007-07-23
- Volume
- 11
- Issue
- 1
- Pages
- 9-34
- ISSN
- 1094-4281 (ISSN-L)
- 1552-7425
- OpenAlex
- W2096955977
- Cited by
- 108
- References
- 11
- FWCI
- 7.41
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Comparison of Three Meta-Analytic Procedures for Estimating Moderating Effects of Categorical Variables. https://app.cochat.ai/papers/10.1177/1094428106292896
- The paper
- Aguinis, H., Sturman, M. C., & Pierce, C. A. (2008). Comparison of Three Meta-Analytic Procedures for Estimating Moderating Effects of Categorical Variables. Organizational Research Methods. https://doi.org/10.1177/1094428106292896
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.