The DOI matches its Crossref record.
Evidence and scientific research.
Open accessAbstract
This commentary reviews the arguments for and against the use of p-values put forward in the Journal and other forums, and shows that they are all missing both a measure and concept of "evidence." The mathematics and logic of evidential theory are presented, with the log-likelihood ratio used as the measure of evidence. The profoundly different philosophy behind evidential methods (as compared to traditional ones) is presented, as well as a comparative example showing the difference between the two approaches. The reasons why we mistakenly ascribe evidential meaning to p-values and related measures are discussed. Unfamiliarity with the technology and philosophy of evidence is seen as the main reason why certain arguments about p-values persist, and why they are frequently contradictory and confusing.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cited by
What's wrong with Bonferroni adjustments
Perneger, T. V. (1998) · BMJ · doi:10.1136/bmj.316.7139.1236 · Cited by 5,900
Statistical tests, P values, confidence intervals, and power: a guide to misinterpretations
Greenland, S., Senn, S. J., Rothman, K. J., Carlin, J. B., Poole, C., Goodman, S. N., & Altman, D. G. (2016) · European Journal of Epidemiology · doi:10.1007/s10654-016-0149-3 · Cited by 3,200
Self-citationNull Hypothesis Testing: Problems, Prevalence, and an Alternative
Anderson, D. R., Burnham, K. P., & Thompson, W. L. (2000) · The Journal of Wildlife Management · doi:10.2307/3803199 · Cited by 1,930
Toward Evidence-Based Medical Statistics. 1: The P Value Fallacy
Goodman, S. N. (1999) · Annals of Internal Medicine · doi:10.7326/0003-4819-130-12-199906150-00008 · Cited by 1,185
Self-citationToward Evidence-Based Medical Statistics. 2: The Bayes Factor
Goodman, S. N. (1999) · Annals of Internal Medicine · doi:10.7326/0003-4819-130-12-199906150-00019 · Cited by 912
Self-citationStatistical strategies for avoiding false discoveries in metabolomics and related experiments
Broadhurst, D. I., & Kell, D. B. (2007) · Metabolomics · doi:10.1007/s11306-006-0037-z · Cited by 817
Statistical procedures and the justification of knowledge in psychological science.
Rosnow, R. L., & Rosenthal, R. (1989) · American Psychologist · doi:10.1037/0003-066x.44.10.1276 · Cited by 777
A Dirty Dozen: Twelve P-Value Misconceptions
Goodman, S. (2008) · Seminars in Hematology · doi:10.1053/j.seminhematol.2008.04.003 · Cited by 680
Self-citationGoodman, S. N., & Berlin, J. A. (1994) · Annals of Internal Medicine · doi:10.7326/0003-4819-121-3-199408010-00008 · Cited by 654
Self-citationQualitative research and evidence based medicine
Green, J., & Britten, N. (1998) · BMJ · doi:10.1136/bmj.316.7139.1230 · Cited by 491
Cumming, G. (2008) · Perspectives on Psychological Science · doi:10.1111/j.1745-6924.2008.00079.x · Cited by 451
Randomization, Statistics, and Causal Inference
Greenland, S. (1990) · Epidemiology · doi:10.1097/00001648-199011000-00003 · Cited by 385
A method to automate probabilistic sensitivity analyses of misclassified binary variables
Fox, M. P., Lash, T. L., & Greenland, S. (2005) · International Journal of Epidemiology · doi:10.1093/ije/dyi184 · Cited by 288
Effect sizes and p values: What should be reported and what should be replicated?
Greenwald, A., Gonzalez, R., Harris, R. J., & Guthrie, D. (1996) · Psychophysiology · doi:10.1111/j.1469-8986.1996.tb02121.x · Cited by 274
Statistics in medical journals: Developments in the 1980s
Altman, D. G. (1991) · Statistics in Medicine · doi:10.1002/sim.4780101206 · Cited by 268
Glover, S., Rosenbaum, D. A., Graham, J., & Dixon, P. (2004) · Experimental Brain Research · doi:10.1007/s00221-003-1659-2 · Cited by 259
Likelihood ratios: A simple and flexible statistic for empirical psychologists
Glover, S., & Dixon, P. (2004) · Psychonomic Bulletin & Review · doi:10.3758/bf03196706 · Cited by 218
Toward a theory of evidence based decision making
Baba, V. V., & HakemZadeh, F. (2012) · Management Decision · doi:10.1108/00251741211227546 · Cited by 167
For and Against Methodologies: Some Perspectives on Recent Causal and Statistical Inference Debates
Greenland, S. (2017) · European Journal of Epidemiology · doi:10.1007/s10654-017-0230-6 · Cited by 86
A reckless guide to P-values: local evidence, global errors
Lew, M. J. (2019) · arXiv · doi:10.48550/arxiv.1910.02042 · Cited by 2
Metadata
- Authors
- Goodman, S. N., & Royall, R.
- Venue
- American Journal of Public Health
- Publisher
- American Public Health Association
- Published
- 1988-12
- Volume
- 78
- Issue
- 12
- Pages
- 1568-1574
- ISSN
- 0090-0036 (ISSN-L)
- 1541-0048
- OpenAlex
- W2086600609
- Cited by
- 227
- References
- 0
- FWCI
- 7.01
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.