The DOI matches its Crossref record; 1 of the 1 references it cites were found in a registry or an index.
The "File Drawer Problem" of Non-Significant Results: Does It Apply to Biological Research?
Abstract
We show that there appears to be a publication bias against non-significant results in the biological literature. We suggest reasons why non-significant results are not published, the implications of not publishing non-significant results, and why we need to correct the problem.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Meta-analysis: synthesizing research findings in ecology and evolution
Arnqvist, G., & Wooster, D. (1995) · Trends in Ecology & Evolution · doi:10.1016/s0169-5347(00)89073-4 · Cited by 570
Cited by
Negative results are disappearing from most disciplines and countries
Fanelli, D. (2012) · Scientometrics · doi:10.1007/s11192-011-0494-7 · Cited by 1,248
Do Pressures to Publish Increase Scientists' Bias? An Empirical Support from US States Data
Fanelli, D. (2010) · PLoS ONE · doi:10.1371/journal.pone.0010271 · Cited by 805
Is the Replicability Crisis Overblown? Three Arguments Examined
Pashler, H., & Harris, C. R. (2012) · Perspectives on Psychological Science · doi:10.1177/1745691612463401 · Cited by 697
U SE OF M ULTILINE C ULTIVARS AND C ULTIVAR M IXTURES FOR D ISEASE M ANAGEMENT
Mundt, C. C. (2002) · Annual Review of Phytopathology · doi:10.1146/annurev.phyto.40.011402.113723 · Cited by 651
Comita, L. S., Queenborough, S. A., Murphy, S. J., Eck, J. L., Xu, K., Krishnadas, M., Beckman, N., & Zhu, Y. (2014) · Journal of Ecology · doi:10.1111/1365-2745.12232 · Cited by 636
Invasive mammal eradication on islands results in substantial conservation gains
Jones, H. P., Holmes, N. D., Butchart, S. H. M., Tershy, B. R., Kappes, P. J., Corkery, I., Aguirre-Muñoz, A., Armstrong, D. P., Bonnaud, E., Burbidge, A. A., et al. (2016) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1521179113 · Cited by 517
Long‐term declines and recovery of meadow area across the world’s seagrass bioregions
Dunic, J. C., Brown, C. J., Connolly, R. M., Turschwell, M. P., & Côté, I. M. (2021) · Global Change Biology · doi:10.1111/gcb.15684 · Cited by 499
Insect Performance on Experimentally Stressed Woody Plants: A Meta-Analysis
Koricheva, J., Larsson, S., & Haukioja, E. (1998) · Annual Review of Entomology · doi:10.1146/annurev.ento.43.1.195 · Cited by 459
Gurevitch, J., Curtis, P. S., & Jones, M. H. (2001) · Advances in Ecological Research · doi:10.1016/s0065-2504(01)32013-5 · Cited by 421
Publication and related biases.
Song, Eastwood, Gilbody, Duley, & Sutton (2000) · Health Technology Assessment · doi:10.3310/hta4100 · Cited by 427
Testing and adjusting for publication bias
Møller, A. P., & Jennions, M. D. (2001) · Trends in Ecology & Evolution · doi:10.1016/s0169-5347(01)02235-2 · Cited by 418
Palmer, A. R. (2000) · Annual Review of Ecology and Systematics · doi:10.1146/annurev.ecolsys.31.1.441 · Cited by 385
A Review of Ecological Determinants of Territoriality within Vertebrate Species
MAHER, C. R., & LOTT, D. F. (2000) · The American Midland Naturalist · doi:10.1674/0003-0031(2000)143[0001:aroedo]2.0.co;2 · Cited by 358
Nykänen, H., & Koricheva, J. (2004) · Oikos · doi:10.1111/j.0030-1299.2004.12768.x · Cited by 350
Questionable research practices in ecology and evolution
Fraser, H., Parker, T., Nakagawa, S., Barnett, A., & Fidler, F. (2018) · PLOS ONE · doi:10.1371/journal.pone.0200303 · Cited by 346
Linear and generalized linear mixed models
Bolker, B. M. (2015) · Ecological Statistics · doi:10.1093/acprof:oso/9780199672547.003.0014 · Cited by 339
Multi‐locus species delimitation in closely related animals and fungi: one marker is not enough
DUPUIS, J. R., ROE, A. D., & SPERLING, F. A. H. (2012) · Molecular Ecology · doi:10.1111/j.1365-294x.2012.05642.x · Cited by 338
Publication Bias (The "File-Drawer Problem") in Scientific Inference
Scargle, J. D. (1999) · arXiv · doi:10.48550/arxiv.physics/9909033 · Cited by 313
The earth is flat ( p > 0.05): significance thresholds and the crisis of unreplicable research
Amrhein, V., Korner-Nievergelt, F., & Roth, T. (2017) · PeerJ · doi:10.7717/peerj.3544 · Cited by 308
The distance dependence prediction of the Janzen‐Connell hypothesis: a meta‐analysis
Hyatt, L. A., Rosenberg, M. S., Howard, T. G., Bole, G., Fang, W., Anastasia, J., Brown, K., Grella, R., Hinman, K., Kurdziel, J. P., et al. (2003) · Oikos · doi:10.1034/j.1600-0706.2003.12235.x · Cited by 305
A survey of the statistical power of research in behavioral ecology and animal behavior
Jennions, M. D. (2003) · Behavioral Ecology · doi:10.1093/beheco/14.3.438 · Cited by 278
Publication bias and the canonization of false facts
Nissen, S. B., Magidson, T., Gross, K., & Bergstrom, C. T. (2016) · eLife · doi:10.7554/elife.21451 · Cited by 266
Publication bias in ecology and evolution: an empirical assessment using the ‘trim and fill’ method
JENNIONS, M. D., & MØLLER, A. P. (2002) · Biological Reviews · doi:10.1017/s1464793101005875 · Cited by 230
Transparency in Ecology and Evolution: Real Problems, Real Solutions
Parker, T. H., Forstmeier, W., Koricheva, J., Fidler, F., Hadfield, J. D., Chee, Y. E., Kelly, C. D., Gurevitch, J., & Nakagawa, S. (2016) · Trends in Ecology & Evolution · doi:10.1016/j.tree.2016.07.002 · Cited by 201
Worsening file-drawer problem in the abstracts of natural, medical and social science databases
Pautasso, M. (2010) · Scientometrics · doi:10.1007/s11192-010-0233-5 · Cited by 136
Publication bias and merit in ecology
Lortie, C. J., Aarssen, L. W., Budden, A. E., Koricheva, J. K., Leimu, R., & Tregenza, T. (2007) · Oikos · doi:10.1111/j.0030-1299.2007.15686.x · Cited by 103
Non‐significant results in ecology: a burden or a blessing in disguise?
(2003) · Oikos · doi:10.1034/j.1600-0579.2003.12353.x · Cited by 75
de Winter, J. C., & Dodou, D. (2015) · PeerJ · doi:10.7717/peerj.733 · Cited by 78
Meta-analysis, can it ever fail?
Kotiaho, J. S., & Tomkins, J. L. (2002) · Oikos · doi:10.1034/j.1600-0706.2002.960316.x · Cited by 52
“If only 9% of studies that were actually performed (rather than reported) find non-significant results (Csada et al. 1996), then the true effect sizes for most hypotheses must be close to one.”
BackgroundInfluentialMeta‐analysis can “fail”: reply to Kotiaho and Tomkins
Jennions, M. D., Møller, A. P., & Hunt, J. (2004) · Oikos · doi:10.1111/j.0030-1299.2004.12265.x · Cited by 16
Metadata
- Authors
- Csada, R. D., James, P. C., & Espie, R. H. M.
- Venue
- Oikos
- Publisher
- JSTOR
- Published
- 1996-09
- Volume
- 76
- Issue
- 3
- Pages
- 591
- ISSN
- 0030-1299 (ISSN-L)
- OpenAlex
- W2334431480
- Cited by
- 201
- References
- 1
- FWCI
- 10.23
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.