CoChat

REVISITING THE FILE DRAWER PROBLEM IN META‐ANALYSIS: AN ASSESSMENT OF PUBLISHED AND NONPUBLISHED CORRELATION MATRICES

DALTON, DAN R., AGUINIS, HERMAN, DALTON, CATHERINE M., BOSCO, FRANK A., PIERCE, CHARLES A. · 2012 · Personnel Psychology
Cited by 152

The DOI matches its Crossref record; 25 of the 25 references it cites were found in a registry or an index.

Abstract

The file drawer problem rests on the assumption that statistically non‐significant results are less likely to be published in primary‐level studies and less likely to be included in meta‐analytic reviews, thereby resulting in upwardly biased meta‐analytically derived effect sizes. We conducted 5 studies to assess the extent of the file drawer problem in nonexperimental research. In Study 1, we examined 37,970 correlations included in 403 matrices published in Academy of Management Journal(AMJ),Journal of Applied Psychology(JAP), and Personnel Psychology(PPsych) between 1985 and 2009 and found that 46.81% of those correlations are not statistically significant. In Study 2, we examined 6,935 correlations used as input in 51 meta‐analyses published in AMJ, JAP,PPsych, and elsewhere between 1982 and 2009 and found that 44.31% of those correlations are not statistically significant. In Study 3, we examined 13,943 correlations reported in 167 matrices in nonpublished manuscripts and found that 45.45% of those correlations are not statistically significant. In Study 4, we examined 20,860 correlations reported in 217 matrices in doctoral dissertations and found that 50.78% of those correlations are not statistically significant. In Study 5, we compared the average magnitude of a sample of 1,002 correlations from Study 1 (published articles) versus 1,224 from Study 4 (dissertations) and found that they were virtually identical (i.e., .2270 and .2279, respectively). In sum, our 5 studies provide consistent empirical evidence that the file drawer problem does not produce an inflation bias and does not pose a serious threat to the validity of meta‐analytically derived conclusions as is currently believed.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1111/j.1744-6570.2012.01243.x

Cites

25 of 25 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 25 references

Cited by

See all 152

Metadata

Authors
DALTON, D. R., AGUINIS, H., DALTON, C. M., BOSCO, F. A., & PIERCE, C. A.
Venue
Personnel Psychology
Publisher
Wiley
Published
2012-05-04
Volume
65
Issue
2
Pages
221-249
ISSN
  • 0031-5826 (ISSN-L)
  • 1744-6570
OpenAlex
W1932682057
Cited by
152
References
25
FWCI
12.73
Type
journal article
Language
en
Open access
closed

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: REVISITING THE FILE DRAWER PROBLEM IN META‐ANALYSIS: AN ASSESSMENT OF PUBLISHED AND NONPUBLISHED CORRELATION MATRICES. https://app.cochat.ai/papers/10.1111/j.1744-6570.2012.01243.x
The paper
DALTON, D. R., AGUINIS, H., DALTON, C. M., BOSCO, F. A., & PIERCE, C. A. (2012). REVISITING THE FILE DRAWER PROBLEM IN META‐ANALYSIS: AN ASSESSMENT OF PUBLISHED AND NONPUBLISHED CORRELATION MATRICES. Personnel Psychology. https://doi.org/10.1111/j.1744-6570.2012.01243.x

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.