Testing a Point Null Hypothesis: The Irreconcilability of P Values and Evidence
Abstract
James O. Berger, Thomas Sellke, Testing a Point Null Hypothesis: The Irreconcilability of P Values and Evidence, Journal of the American Statistical Association, Vol. 82, No. 397 (Mar., 1987), pp. 112-122
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
P-values arguably overstate the evidence for an effect even when there is no model uncertainty.
“In fact, p -values arguably overstate the evidence for an effect even when there is no model uncertainty (Edwards, Lindman and Savage, 1963; Berger and Delampady, 1987; Berger and Sellke, 1987).”
From Bayesian model averaging: a tutorial (with comments by M. Clyde, David Draper and E. I. George, and a rejoinder by the authors (1999) · cites this paper as Berger and Sellke, 1987
Cited by
Sorted by citations
Hoeting, J. A., Madigan, D., Raftery, A. E., & Volinsky, C. T. (1999) · Statistical Science · doi:10.1214/ss/1009212519 · Cited by 4,118 · see citing works
Posada, D., & Buckley, T. R. (2004) · Systematic Biology · doi:10.1080/10635150490522304 · Cited by 3,927 · see citing works
Statistical tests, P values, confidence intervals, and power: a guide to misinterpretations
Greenland, S., Senn, S. J., Rothman, K. J., Carlin, J. B., Poole, C., Goodman, S. N., & Altman, D. G. (2016) · European Journal of Epidemiology · doi:10.1007/s10654-016-0149-3 · Cited by 3,200 · see citing works
Default Bayes factors for ANOVA designs
Rouder, J. N., Morey, R. D., Speckman, P. L., & Province, J. M. (2012) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2012.08.001 · Cited by 1,800 · see citing works
Revised standards for statistical evidence
Johnson, V. E. (2013) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1313476110 · Cited by 808 · see citing works
Philosophy and the practice of Bayesian statistics
Gelman, A., & Shalizi, C. R. (2013) · British Journal of Mathematical and Statistical Psychology · doi:10.1111/j.2044-8317.2011.02037.x · Cited by 615 · see citing works
Optional stopping: No problem for Bayesians
Rouder, J. N. (2014) · Psychonomic Bulletin & Review · doi:10.3758/s13423-014-0595-4 · Cited by 492 · see citing works
A Bayesian Perspective on the Reproducibility Project: Psychology
Etz, A., & Vandekerckhove, J. (2016) · PLOS ONE · doi:10.1371/journal.pone.0149794 · Cited by 295 · see citing works
A comment on replication,<i>P</i>‐values and evidence
Goodman, S. N. (1992) · Statistics in Medicine · doi:10.1002/sim.4780110705 · Cited by 309 · see citing works
When Null Hypothesis Significance Testing Is Unsuitable for Research: A Reassessment
Szucs, D., & Ioannidis, J. P. A. (2017) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2017.00390 · Cited by 298 · see citing works
Meta-analysis in applied ecology
Stewart, G. (2010) · Biology Letters · doi:10.1098/rsbl.2009.0546 · Cited by 214 · see citing works
A Bayes factor meta-analysis of Bem’s ESP claim
Rouder, J. N., & Morey, R. D. (2011) · Psychonomic Bulletin & Review · doi:10.3758/s13423-011-0088-7 · Cited by 194 · see citing works
Misprescription and misuse of one-tailed tests
LOMBARDI, C. M., & HURLBERT, S. H. (2009) · Austral Ecology · doi:10.1111/j.1442-9993.2009.01946.x · Cited by 93 · see citing works
Language-Capable Robots may Inadvertently Weaken Human Moral Norms
Jackson, R. B., & Williams, T. (2019) · 2019 14th ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.1109/hri.2019.8673123 · Cited by 64 · see citing works
Theobald, D. L. (2011) · Biology Direct · doi:10.1186/1745-6150-6-60 · Cited by 16 · see citing works
- Authors
- Berger, J. O., & Sellke, T.
- ORCID
- Berger, James O.
- Venue
- Journal of the American Statistical Association
- Publisher
- JSTOR
- Published
- 1987-03
- Volume
- 82
- Issue
- 397
- Pages
- 112
- ISSN
- 0162-1459 (ISSN-L)
- OpenAlex
- W4243759473
- Cited by
- 548
- References
- 0
- Citations by year
- 2026: 1 · 2025: 10 · 2024: 15 · 2023: 19 · 2022: 18 · 2021: 17 · 2020: 13 · 2019: 39 · 2018: 17 · 2017: 22 · 2016: 16 · 2015: 17 · 2014: 20 · 2013: 19 · 2012: 19
- FWCI
- 9.60
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of the American Statistical Association (publishedVersion)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Physical Sciences › Mathematics › Statistics and Probability › Probability and Statistical Research
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Keywords
- point null hypothesis, p-values, statistical evidence, hypothesis testing, null hypothesis significance testing
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
