The appropriate use of null hypothesis testing.
Abstract
The many criticisms of null hypothesis testing suggest when it is not useful and what is should not be used for. This article explores when and why its use is appropriate. Null hypothesis testing is insufficient when size of effect is important, but it is ideal for testing ordinal claims relating the order of conditions, which are common in psychology. Null hypothesis testing also is insufficient for determining beliefs, but it is ideal for demonstrating sufficient evidential strength to support an ordinal claim, with sufficient evidence being 1 criterion for a finding entering the corpus of legitimate findings in psychology. The line between sufficient and insufficient evidence is currently set at p < .05; there is little reason for allowing experimenters to select their own value of alpha. Thus null hypothesis testing is an optimal method for demonstrating sufficient evidence for an ordinal claim.
Cites (5)
- The information available in brief visual presentationsSperling, George · 1960 · Psychological Monographs: General and Applied
- The earth is round (p < .05).Cohen, Jacob · 1994 · American Psychologist
- College sophomores in the laboratory: Influences of a narrow data base on social psychology's view of human nature.Sears, David O. · 1986 · Journal of Personality and Social Psychology
- Some Problems Connected with Statistical InferenceCox, D. R. · 1958 · The Annals of Mathematical Statistics
- Measures of effect sizeRichardson, John T. E. · 1996 · Behavior Research Methods, Instruments, & Computers
Cited by (13)
- A practical solution to the pervasive problems ofp valuesWagenmakers, Eric-Jan · 2007 · Psychonomic Bulletin & Review
- Untitled workNosek · 2012 · 10.1177/1745691612459058
- Null hypothesis significance testing: a review of an old and continuing controversyNickerson, Raymond S. · 2000 · Psychological Methods
- Statistical Evidence in Experimental Psychology: An Empirical Comparison Using 855 t TestsWetzels, Ruud, Matzke, Dora, Lee, Michael D., Rouder, Jeffrey N., Iverson, Geoffrey J., Wagenmakers, Eric-Jan · 2011 · Perspectives on Psychological Science
- ‘Statistical’, ‘practical’, and ‘clinical’: How many kinds of significance do counselors need to considerThompson, Bruce · 2002 · Journal of Counseling & Development
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: The appropriate use of null hypothesis testing. https://app.cochat.ai/papers/10.1037//1082-989x.1.4.379
- The paper
- Frick, R. W. (1996). The appropriate use of null hypothesis testing. Psychological Methods. https://doi.org/10.1037//1082-989x.1.4.379
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.