The DOI matches its Crossref record; 51 of the 51 references it cites were found in a registry or an index.
Publication Bias in the Organizational Sciences
Abstract
Publication bias poses multiple threats to the accuracy of meta-analytically derived effect sizes and related statistics. Unfortunately, a review of the literature indicates that unlike meta-analytic reviews in medicine, research in the organizational sciences tends to pay little attention to this issue. In this article, the authors introduce advances in meta-analytic techniques from the medical and related sciences for a comprehensive assessment and evaluation of publication bias. The authors illustrate their use on a data set on employment interview validities. Using multiple methods, including contour-enhanced funnel plots, trim and fill, Egger’s test of the intercept, Begg and Mazumdar’s rank correlation, meta-regression, cumulative meta-analysis, and selection models, the authors find limited evidence of publication bias in the studied data.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series
(2008) · doi:10.1002/9780470712184 · Cited by 25,048
Operating characteristics of a rank correlation test for publication bias
Begg, C. B., & Mazumdar, M. (1994) · Biometrics · doi:10.2307/2533446 · Cited by 16,955
Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2009) · doi:10.1002/9780470743386 · Cited by 14,225
Duval, S., & Tweedie, R. (2000) · Biometrics · doi:10.1111/j.0006-341x.2000.00455.x · Cited by 14,099
Missing data: our view of the state of the art
Schafer, J. L., & Graham, J. W. (2002) · Psychological Methods · doi:10.1037/1082-989x.7.2.147 · Cited by 11,638
Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2021) · doi:10.1002/9781119558378 · Cited by 9,799
The file drawer problem and tolerance for null results.
Rosenthal, R. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.3.638 · Cited by 9,068
Sterne, J. A. C., Sutton, A. J., Ioannidis, J. P. A., Terrin, N., Jones, D. R., Lau, J., Carpenter, J., Rucker, G., Harbord, R. M., Schmid, C. H., et al. (2011) · BMJ · doi:10.1136/bmj.d4002 · Cited by 7,709
Mixing Qualitative and Quantitative Methods: Triangulation in Action.
Jick, T. D. (1979) · Administrative Science Quarterly · doi:10.2307/2392366 · Cited by 7,103 · cited 1×
“Our recommendation for the use of multiple publication bias methods is aligned with the concept of triangulation, which refers to the use of ‘‘multiple reference points to locate an object’s exact position’’ (Jick, 1979, p. 602; see also, e.g., Sackett & Larson, 1990; Scandura & Williams, 2000).”
MethodMethods of Meta-Analysis: Correcting Error and Bias in Research Findings
Schmidt, F. L., & Hunter, J. E. (2015) · doi:10.4135/9781483398105 · Cited by 5,542
Cited by
Perceived organizational support: a meta-analytic evaluation of organizational support theory.
Kurtessis, J. N., Eisenberger, R., Ford, M. T., Buffardi, L. C., Stewart, K. A., & Adis, C. S. (2017) · Journal of Management · doi:10.1177/0149206315575554 · Cited by 2,354
Adams, R. J., Smart, P., & Huff, A. S. (2017) · International Journal of Management Reviews · doi:10.1111/ijmr.12102 · Cited by 995
The relationship between professional burnout and quality and safety in healthcare: a meta-analysis
Salyers, M. P., Bonfils, K. A., Luther, L., Firmin, R. L., White, D. A., Adams, E. L., & Rollins, A. L. (2017) · Journal of General Internal Medicine · doi:10.1007/s11606-016-3886-9 · Cited by 843
A meta-analysis of shared leadership and team effectiveness
Wang, D., Waldman, D. A., & Zhang, Z. (2014) · Journal of Applied Psychology · doi:10.1037/a0034531 · Cited by 731
Abusive supervision: A meta-analysis and empirical review
Mackey, J. D., Frieder, R. E., Brees, J. R., & Martinko, M. J. (2017) · Journal of Management · doi:10.1177/0149206315573997 · Cited by 706
A meta-analytic review of authentic and transformational leadership: A test for redundancy
Banks, G. C., McCauley, K. D., Gardner, W. L., & Guler, C. E. (2016) · The Leadership Quarterly · doi:10.1016/j.leaqua.2016.02.006 · Cited by 681
Self-citationTrust and team performance: A meta-analysis of main effects, moderators, and covariates.
De Jong, B. A., Dirks, K. T., & Gillespie, N. (2016) · Journal of Applied Psychology · doi:10.1037/apl0000110 · Cited by 616
A meta-analytical integration of over 40 years of research on diversity training evaluation
Bezrukova, K., Spell, C. S., Perry, J. L., & Jehn, K. A. (2016) · Psychological Bulletin · doi:10.1037/bul0000067 · Cited by 601
Activity Achievement Emotions and Academic Performance: A Meta-analysis
Camacho-Morles, J., Slemp, G. R., Pekrun, R., Loderer, K., Hou, H., & Oades, L. G. (2021) · Educational Psychology Review · doi:10.1007/s10648-020-09585-3 · Cited by 475
Not So Subtle: A Meta-Analytic Investigation of the Correlates of Subtle and Overt Discrimination
Jones, K. P., Peddie, C. I., Gilrane, V. L., King, E. B., & Gray, A. L. (2016) · Journal of Management · doi:10.1177/0149206313506466 · Cited by 445
Bartlett, L., Martin, A., Neil, A. L., Memish, K., Otahal, P., Kilpatrick, M., & Sanderson, K. (2019) · Journal of Occupational Health Psychology · doi:10.1037/ocp0000146 · Cited by 426
Recovery from work-related effort: a meta-analysis
Bennett, A. A., Bakker, A. B., & Field, J. G. (2018) · Journal of Organizational Behavior · doi:10.1002/job.2217 · Cited by 426
Disclosure of sensitive behaviors across self-administered survey modes: a meta-analysis
Gnambs, T., & Kaspar, K. (2015) · Behavior Research Methods · doi:10.3758/s13428-014-0533-4 · Cited by 422
Mackey, J. D., Parker Ellen, B., McAllister, C. P., & Alexander, K. C. (2021) · Journal of Business Research · doi:10.1016/j.jbusres.2020.10.037 · Cited by 320
A Meta-Analytic Review of Social Identification and Health in Organizational Contexts
Steffens, N. K., Haslam, S. A., Schuh, S. C., Jetten, J., & van Dick, R. (2017) · Personality and Social Psychology Review · doi:10.1177/1088868316656701 · Cited by 311
Growth mindsets and psychological distress: A meta-analysis
Burnette, J. L., Knouse, L. E., Vavra, D. T., O'Boyle, E., & Brooks, M. A. (2020) · Clinical Psychology Review · doi:10.1016/j.cpr.2020.101816 · Cited by 271
Meta-analysis using effect size distributions of only statistically significant studies.
van Assen, M. A. L. M., van Aert, R. C. M., & Wicherts, J. M. (2015) · Psychological Methods · doi:10.1037/met0000025 · Cited by 265
Job burnout in mental health providers: A meta-analysis of 35 years of intervention research
Dreison, K. C., Luther, L., Bonfils, K. A., Sliter, M. T., McGrew, J. H., & Salyers, M. P. (2018) · Journal of Occupational Health Psychology · doi:10.1037/ocp0000047 · Cited by 244
A meta-analysis of virtual reality training programs for social skill development
Howard, M. C., & Gutworth, M. B. (2020) · Computers & Education · doi:10.1016/j.compedu.2019.103707 · Cited by 234
How to conduct a meta-analysis in eight steps: A practical guide
Hansen, C., Steinmetz, H., & Block, J. (2022) · Management Review Quarterly · doi:10.1007/s11301-021-00247-4 · Cited by 218
A meta-analysis of autonomous and controlled forms of teacher motivation
Slemp, G. R., Field, J. G., & Cho, A. S. H. (2020) · Journal of Vocational Behavior · doi:10.1016/j.jvb.2020.103459 · Cited by 179
Questions About Questionable Research Practices in the Field of Management: A Guest Commentary
Banks, G. C., O’Boyle, E. H., Pollack, J. M., White, C. D., Batchelor, J. H., Whelpley, C. E., Abston, K. A., Bennett, A. A., & Adkins, C. L. (2016) · Journal of Management · doi:10.1177/0149206315619011 · Cited by 163
Self-citationLeadership in the digital era: A review of who, what, when, where, and why
Banks, G. C., Dionne, S. D., Mast, M. S., & Sayama, H. (2022) · The Leadership Quarterly · doi:10.1016/j.leaqua.2022.101634 · Cited by 155
Self-citationMethods for second order meta-analysis and illustrative applications
Schmidt, F. L., & Oh, I.-S. (2013) · Organizational Behavior and Human Decision Processes · doi:10.1016/j.obhdp.2013.03.002 · Cited by 151
Seeing eye to eye: A meta-analysis of self-other agreement of leadership
Lee, A., & Carpenter, N. C. (2018) · The Leadership Quarterly · doi:10.1016/j.leaqua.2017.06.002 · Cited by 137
Miao, C., Coombs, J. E., Qian, S., & Sirmon, D. G. (2017) · Journal of Business Research · doi:10.1016/j.jbusres.2017.03.016 · Cited by 126
Agreeableness and Its Consequences: A Quantitative Review of Meta-Analytic Findings
Wilmot, M. P., & Ones, D. S. (2022) · Personality and Social Psychology Review · doi:10.1177/10888683211073007 · Cited by 130
Shewach, O. R., Sackett, P. R., & Quint, S. (2019) · Journal of Applied Psychology · doi:10.1037/apl0000420 · Cited by 97
A meta-analytic review of the effect of socioeconomic status on academic performance
Selvitopu, A., & Kaya, M. (2023) · Journal of Education · doi:10.1177/00220574211031978 · Cited by 81
Personality, intelligence, and counterproductive academic behaviors: A meta-analysis
Cuadrado, D., Salgado, J. F., & Moscoso, S. (2021) · Journal of Personality and Social Psychology · doi:10.1037/pspp0000285 · Cited by 63
Shan, W., Keller, J., & Joseph, D. (2019) · Journal of Organizational Behavior · doi:10.1002/job.2357 · Cited by 60
Preliminary Findings about DevSecOps from Grey Literature
Mao, R., Zhang, H., Dai, Q., Huang, H., Rong, G., Shen, H., Chen, L., & Lu, K. (2020) · 2020 IEEE 20th International Conference on Software Quality, Reliability and Security (QRS) · doi:10.1109/qrs51102.2020.00064 · Cited by 49
Mueller, K. F., Meerpohl, J. J., Briel, M., Antes, G., von Elm, E., Lang, B., Motschall, E., Schwarzer, G., & Bassler, D. (2016) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2016.04.015 · Cited by 48
Van Hiel, A., Onraet, E., Bostyn, D. H., Stadeus, J., Haesevoets, T., Van Assche, J., & Roets, A. (2020) · European Review of Social Psychology · doi:10.1080/10463283.2020.1778324 · Cited by 37
Entrepreneurial spawning and knowledge-based perspective: A meta-analysis
Garrett, R. P., Miao, C., Qian, S., & Bae, T. J. (2017) · Small Business Economics · doi:10.1007/s11187-017-9842-1 · Cited by 33
Revisit security in the era of DevOps: An evidence-based inquiry into DevSecOps industry
Zhou, X., Mao, R., Zhang, H., Dai, Q., Huang, H., Shen, H., Li, J., & Rong, G. (2023) · IET Software · doi:10.1049/sfw2.12132 · Cited by 23
Dong, X., Xie, J., & Gong, H. (2025) · Cyberpsychology, Behavior, and Social Networking · doi:10.1089/cyber.2024.0468 · Cited by 22
Not Published Is Not Perished: Addressing Publication Bias in Meta-Analytic Studies in Communication
Sun, Y., & Pan, Z. (2020) · Human Communication Research · doi:10.1093/hcr/hqz015 · Cited by 18
A reinforcement sensitivity theory view of seeking behaviors at work: A meta‐analysis
Sherf, E. N., Gilliam, N., & McElroy, T. (2024) · Personnel Psychology · doi:10.1111/peps.12579 · Cited by 15
Metadata
- Authors
- Kepes, S., Banks, G. C., McDaniel, M., & Whetzel, D. L.
- Venue
- Organizational Research Methods
- Publisher
- SAGE Publications
- Published
- 2012-07-31
- Volume
- 15
- Issue
- 4
- Pages
- 624-662
- ISSN
- 1094-4281 (ISSN-L)
- 1552-7425
- OpenAlex
- W2098274145
- Cited by
- 398
- References
- 51
- FWCI
- 18.75
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
