Advancing Theory by Assessing Boundary Conditions With Metaregression: A Critical Review and Best-Practice Recommendations
The DOI matches its Crossref record; 27 of the 27 references it cites were found in a registry or an index.
Abstract
Understanding boundary conditions, or situations when relations between variables change depending on values of other variables, is critical for theory advancement and for providing guidance for practice. Metaregression is ideally suited to investigate boundary conditions because it provides information on the presence and strength of such conditions. In spite of its potential, results of our review of 63 metaregression articles published in the Journal of Management, Journal of Applied Psychology, Personnel Psychology, Journal of Management, Academy of Management Journal, and Strategic Management Journal uncovered a surprising lack of transparency, frequently implemented erroneous practices, and a lack of attention to important methodological choices. Results also suggest that many substantive conclusions are ambiguous at best and, unbeknownst to authors and readers, potentially misleading. Drawing from our review of the substantive literature as well as the latest statistical and methodological research, we offer evidence-based best-practice recommendations on how to conduct and report the results of a metaregression study. We offer recommendations on calculating statistical power and heterogeneity, choosing an appropriate model, testing boundary condition hypotheses, adjusting R 2 for known variance, explaining methodological choices, and reporting and interpreting model coefficients and other results. Also, we conducted two illustrative metaregression studies that incorporate all of our recommendations with accompanying syntax and data. Our recommendations can be used by authors, readers, journal editors, and reviewers wishing to conduct and evaluate metaregression studies, as well as practitioners interested in understanding conditions under which organizational practices are more or less likely to be effective.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Development of the Job Diagnostic Survey.
Hackman, J. R., & Oldham, G. R. (1975) · Journal of Applied Psychology · doi:10.1037/h0076546 · Cited by 7,246
Kluger, A. N., & DeNisi, A. (1996) · Psychological Bulletin · doi:10.1037/0033-2909.119.2.254 · Cited by 5,882
Cohen, J. (1992) · Current Directions in Psychological Science · doi:10.1111/1467-8721.ep10768783 · Cited by 5,870
The Handbook of Research Synthesis and Meta-Analysis
(2019) · doi:10.7758/9781610448864 · Cited by 4,553 · cited 3×
“The following equation (e.g., Raudenbush, 2009; Viechtbauer, López-López, SánchezMeca, & Marín-Martínez, 2015) describes the extent to which boundary conditions x predict the relation between two variables, as indexed by the effect size y, in a sample of k studies: y B B x B x u ei i j ij i i= + +…”
BackgroundMethodOrganizational Theories: Some Criteria for Evaluation
Bacharach, S. B. (1989) · The Academy of Management Review · doi:10.5465/amr.1989.4308374 · Cited by 2,305
Improved tests for a random effects meta‐regression with a single covariate
Knapp, G., & Hartung, J. (2003) · Statistics in Medicine · doi:10.1002/sim.1482 · Cited by 2,075 · cited 6×
“In a comprehensive simulation study, Viechtbauer et al. (2015) concluded that the Knapp and Hartung (2003) method provides the best statistical power and control of Type 1 error with an accompanying ease of computation over other similarly effective methods.”
MethodInfluentialA Critical Review and Best‐Practice Recommendations for Control Variable Usage
Bernerth, J. B., & Aguinis, H. (2016) · Personnel Psychology · doi:10.1111/peps.12103 · Cited by 1,731
Self-citationLongitudinal Research: The Theory, Design, and Analysis of Change
Ployhart, R. E., & Vandenberg, R. J. (2010) · Journal of Management · doi:10.1177/0149206309352110 · Cited by 1,496 · cited 1×
“…of novel methodological tools, initial usage involves some suboptimal practices, as has been documented regarding the adoption of metaanalytic methods (Schmidt & Hunter, 1999), longitudinal research (Ployhart & Vandenberg, 2010), and multilevel analysis (Aguinis, Gottfredson, & Culpepper, 2013).”
MethodTransfer of Training: A Meta-Analytic Review
Blume, B. D., Ford, J. K., Baldwin, T. T., & Huang, J. L. (2010) · Journal of Management · doi:10.1177/0149206309352880 · Cited by 1,477 · cited 2×
“…have already provided important theoretical contributions in various topical areas, such as resource dependence theory (Drees & Heugens, 2013), counterproductive behaviors (Gonzalez-Mulé, Mount, & Oh, 2014), transfer of training (Blume et al., 2010), and turnover (Griffeth et al., 2000).”
BackgroundBest-practice recommendations for defining, identifying, and handling outliers
Aguinis, H., Gottfredson, R. K., & Joo, H. (2013) · Organizational Research Methods · doi:10.1177/1094428112470848 · Cited by 1,341
Self-citation
Cited by
Self-regulation in childhood as a predictor of future outcomes: A meta-analytic review.
Robson, D. A., Allen, M. S., & Howard, S. J. (2020) · Psychological Bulletin · doi:10.1037/bul0000227 · Cited by 759
“In many instances, the sample size was small meaning the meta-regression models likely had insufficient power to detect even a large effect (see Gonzalez-Mulé & Aguinis, 2018).”
BackgroundAdvancing Theory with Review Articles
Post, C., Sarala, R., Gatrell, C., & Prescott, J. E. (2020) · Journal of Management Studies · doi:10.1111/joms.12549 · Cited by 548
Mackey, J. D., Parker Ellen, B., McAllister, C. P., & Alexander, K. C. (2021) · Journal of Business Research · doi:10.1016/j.jbusres.2020.10.037 · Cited by 320
Passion at work: A meta‐analysis of individual work outcomes
Pollack, J. M., Ho, V. T., O'Boyle, E. H., & Kirkman, B. L. (2020) · Journal of Organizational Behavior · doi:10.1002/job.2434 · Cited by 305
Theorizing Through Literature Reviews: The Miner-Prospector Continuum
Breslin, D., & Gatrell, C. (2023) · Organizational Research Methods · doi:10.1177/1094428120943288 · Cited by 269
Metadata
- Authors
- Gonzalez-Mulé, E., & Aguinis, H.
- Venue
- Journal of Management
- Publisher
- SAGE Publications
- Published
- 2017-06-01
- Volume
- 44
- Issue
- 6
- Pages
- 2246-2273
- ISSN
- 0149-2063 (ISSN-L)
- 1557-1211
- OpenAlex
- W2620936750
- Cited by
- 157
- References
- 27
- FWCI
- 10.35
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Advancing Theory by Assessing Boundary Conditions With Metaregression: A Critical Review and Best-Practice Recommendations. https://app.cochat.ai/papers/10.1177/0149206317710723
- The paper
- Gonzalez-Mulé, E., & Aguinis, H. (2018). Advancing Theory by Assessing Boundary Conditions With Metaregression: A Critical Review and Best-Practice Recommendations. Journal of Management. https://doi.org/10.1177/0149206317710723
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.