The DOI matches its Crossref record; 33 of the 33 references it cites were found in a registry or an index.
In defense of P values
Abstract
Statistical hypothesis testing has been widely criticized by ecologists in recent years. I review some of the more persistent criticisms of P values and argue that most stem from misunderstandings or incorrect interpretations, rather than from intrinsic shortcomings of the P value. I show that P values are intimately linked to confidence intervals and to differences in Akaike's information criterion (ΔAIC), two metrics that have been advocated as replacements for the P value. The choice of a threshold value of ΔAIC that breaks ties among competing models is as arbitrary as the choice of the probability of a Type I error in hypothesis testing, and several other criticisms of the P value apply equally to ΔAIC. Since P values, confidence intervals, and ΔAIC are based on the same statistical information, all have their places in modern statistical practice. The choice of which to use should be stylistic, dictated by details of the application rather than by dogmatic, a priori considerations.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Model selection and multimodel inference: a practical information-theoretic approach.
Guthery, F. S., Burnham, K. P., & Anderson, D. R. (2003) · The Journal of Wildlife Management · doi:10.2307/3802723 · Cited by 41,495
Statistical Methods for Research Workers
(1945) · American Journal of Clinical Pathology · doi:10.1093/ajcp/15.11.552b · Cited by 10,880
Pseudoreplication and the Design of Ecological Field Experiments
Hurlbert, S. H. (1984) · Ecological Monographs · doi:10.2307/1942661 · Cited by 8,377
Burnham, K. P., Anderson, D. R., & Huyvaert, K. P. (2011) · Behavioral Ecology and Sociobiology · doi:10.1007/s00265-010-1029-6 · Cited by 4,104
Effect size, confidence interval and statistical significance: a practical guide for biologists
Nakagawa, S., & Cuthill, I. C. (2007) · Biological Reviews · doi:10.1111/j.1469-185x.2007.00027.x · Cited by 3,835
Null Hypothesis Testing: Problems, Prevalence, and an Alternative
Anderson, D. R., Burnham, K. P., & Thompson, W. L. (2000) · The Journal of Wildlife Management · doi:10.2307/3803199 · Cited by 1,930
Akaike Information Criterion Statistics.
Grove, D., Sakamoto, Y., Ishiguro, M., & Kitagawa, G. (1988) · The Statistician · doi:10.2307/2348776 · Cited by 1,184
The statistical sleuth : a course in methods of data analysis
Ramsey, F. L., & Schafer, D. W. (2002) · Cited by 1,166
The Insignificance of Statistical Significance Testing
Johnson, D. H. (1999) · The Journal of Wildlife Management · doi:10.2307/3802789 · Cited by 1,104
Statistical Evidence: A Likelihood Paradigm
Reeves, J. H., & Royall, R. M. (1998) · Journal of the American Statistical Association · doi:10.2307/2669869 · Cited by 814
Akaike Information Criterion Statistics
Brooks, D. G. (1989) · Technometrics · doi:10.1080/00401706.1989.10488538 · Cited by 768
Statistical Evidence: A Likelihood Paradigm
Vieland, V. J., & Hodge, S. E. (1998) · The American Journal of Human Genetics · doi:10.1086/499065 · Cited by 606
Suggestions for Presenting the Results of Data Analyses
Anderson, D. R., Link, W. A., Johnson, D. H., & Burnham, K. P. (2001) · The Journal of Wildlife Management · doi:10.2307/3803088 · Cited by 465
Alternatives To Statistical Hypothesis Testing In Ecology: A Guide To Self Teaching
Hobbs, N. T., & Hilborn, R. (2006) · Ecological Applications · doi:10.1890/04-0645 · Cited by 384
Interpreting DNA evidence: statistical genetics for forensic scientists
(1999) · Choice Reviews Online · doi:10.5860/choice.36-6266 · Cited by 367
Information theory and hypothesis testing: a call for pluralism
STEPHENS, P. A., BUSKIRK, S. W., HAYWARD, G. D., & MARTÍNEZ DEL RIO, C. (2005) · Journal of Applied Ecology · doi:10.1111/j.1365-2664.2005.01002.x · Cited by 360
On Hypothesis Testing in Ecology and Evolution
Quinn, J. F., & Dunham, A. E. (1983) · The American Naturalist · doi:10.1086/284161 · Cited by 338
Scalable Decision Rules for Environmental Impact Studies: Effect Size, Type I, and Type II Errors
Mapstone, B. D. (1995) · Ecological Applications · doi:10.2307/1942031 · Cited by 313
Final Collapse of the Neyman-Pearson Decision Theoretic Framework and Rise of the neoFisherian
Hurlbert, S. H., & Lombardi, C. M. (2009) · Annales Zoologici Fennici · doi:10.5735/086.046.0501 · Cited by 301
Hypothesis Testing in Ecology: Psychological Aspects and the Importance of Theory Maturation
Loehle, C. (1987) · The Quarterly Review of Biology · doi:10.1086/415619 · Cited by 288
Use, Overuse, and Misuse of Significance Tests in Evolutionary Biology and Ecology
(1991) · The Bulletin of the Ecological Society of America · doi:10.2307/20167258 · Cited by 281
Setting an Optimal α That Minimizes Errors in Null Hypothesis Significance Tests
Mudge, J. F., Baker, L. F., Edge, C. B., & Houlahan, J. E. (2012) · PLoS ONE · doi:10.1371/journal.pone.0032734 · Cited by 183
Concerns regarding a call for pluralism of information theory and hypothesis testing
LUKACS, P. M., THOMPSON, W. L., KENDALL, W. L., GOULD, W. R., DOHERTY, P. F., BURNHAM, K. P., & ANDERSON, D. R. (2007) · Journal of Applied Ecology · doi:10.1111/j.1365-2664.2006.01267.x · Cited by 176
Fidler, F. M., Burgman, M. A., Cumming, G., Buttrose, R., & Thomason, N. R. (2006) · Conservation Biology · doi:10.1111/j.1523-1739.2006.00525.x · Cited by 147
Mundry, R. (2010) · Behavioral Ecology and Sociobiology · doi:10.1007/s00265-010-1040-y · Cited by 146
A confidence interval approach to data analysis
Stefano, J. D. (2003) · Forest Ecology and Management · doi:10.1016/s0378-1127(03)00331-1 · Cited by 118
Strong, D. R. (1980) · Synthese · doi:10.1007/bf00413928 · Cited by 108
Strong, D. R. (1982) · Springer eBooks · doi:10.1007/978-94-009-7796-9_10 · Cited by 106
What Should We Do about Hypothesis Testing?
Eberhardt, L. L. (2003) · Journal of Wildlife Management · doi:10.2307/3802765 · Cited by 96
Martínez‐Abraín, A. (2008) · Acta Oecologica · doi:10.1016/j.actao.2008.02.004 · Cited by 94
Statistical methods for research workers. 5th edition
Yates, F. (1935) · PubMed Central · Cited by 91
Inference without significance: measuring support for hypotheses rather than rejecting them
Gerrodette, T. (2011) · Marine Ecology · doi:10.1111/j.1439-0485.2011.00466.x · Cited by 67
Invasive Plant Researchers Should Calculate Effect Sizes, Not P-Values
Rinella, M. J., & James, J. J. (2010) · Invasive Plant Science and Management · doi:10.1614/ipsm-09-038.1 · Cited by 25
Cited by
Statistical tests, P values, confidence intervals, and power: a guide to misinterpretations
Greenland, S., Senn, S. J., Rothman, K. J., Carlin, J. B., Poole, C., Goodman, S. N., & Altman, D. G. (2016) · European Journal of Epidemiology · doi:10.1007/s10654-016-0149-3 · Cited by 3,200
A brief introduction to mixed effects modelling and multi-model inference in ecology
Harrison, X. A., Donaldson, L., Correa-Cano, M. E., Evans, J., Fisher, D. N., Goodwin, C. E. D., Robinson, B. S., Hodgson, D. J., & Inger, R. (2018) · PeerJ · doi:10.7717/peerj.4794 · Cited by 2,094
Model selection for ecologists: the worldviews of AIC and BIC
Aho, K., Derryberry, D., & Peterson, T. (2014) · Ecology · doi:10.1890/13-1452.1 · Cited by 1,165
“Murtaugh (2014) revealed an important mathematical connection between DAIC and P values for a comparison of two models (one nested in the other).”
BackgroundThe fickle P value generates irreproducible results
Halsey, L. G., Curran-Everett, D., Vowler, S. L., & Drummond, G. B. (2015) · Nature Methods · doi:10.1038/nmeth.3288 · Cited by 765
Sensitivity and specificity of information criteria
(2019) · doi:10.1093/bib/bbz016 · Cited by 718
Metadata
- Authors
- Murtaugh, P. A.
- Venue
- Ecology
- Publisher
- Wiley
- Published
- 2014-03
- Volume
- 95
- Issue
- 3
- Pages
- 611-617
- ISSN
- 0012-9658 (ISSN-L)
- 1939-9170
- OpenAlex
- W2037592609
- Cited by
- 317
- References
- 33
- FWCI
- 33.68
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.