The appropriate use of null hypothesis testing.

Robert W. Frick·1996·Psychological Methods

Abstract

The many criticisms of null hypothesis testing suggest when it is not useful and what is should not be used for. This article explores when and why its use is appropriate. Null hypothesis testing is insufficient when size of effect is important, but it is ideal for testing ordinal claims relating the order of conditions, which are common in psychology. Null hypothesis testing also is insufficient for determining beliefs, but it is ideal for demonstrating sufficient evidential strength to support an ordinal claim, with sufficient evidence being 1 criterion for a finding entering the corpus of legitimate findings in psychology. The line between sufficient and insufficient evidence is currently set at p < .05; there is little reason for allowing experimenters to select their own value of alpha. Thus null hypothesis testing is an optimal method for demonstrating sufficient evidence for an ordinal claim.

Cites (5)

  1. The information available in brief visual presentations
    Sperling, George · 1960 · Psychological Monographs: General and Applied
  2. The earth is round (p < .05).
    Cohen, Jacob · 1994 · American Psychologist
  3. College sophomores in the laboratory: Influences of a narrow data base on social psychology's view of human nature.
    Sears, David O. · 1986 · Journal of Personality and Social Psychology
  4. Some Problems Connected with Statistical Inference
    Cox, D. R. · 1958 · The Annals of Mathematical Statistics
  5. Measures of effect size
    Richardson, John T. E. · 1996 · Behavior Research Methods, Instruments, & Computers

Show all 5 references

Cited by (13)

  1. A practical solution to the pervasive problems ofp values
    Wagenmakers, Eric-Jan · 2007 · Psychonomic Bulletin & Review
  2. Untitled work
    Nosek · 2012 · 10.1177/1745691612459058
  3. Null hypothesis significance testing: a review of an old and continuing controversy
    Nickerson, Raymond S. · 2000 · Psychological Methods
  4. Statistical Evidence in Experimental Psychology: An Empirical Comparison Using 855 t Tests
    Wetzels, Ruud, Matzke, Dora, Lee, Michael D., Rouder, Jeffrey N., Iverson, Geoffrey J., Wagenmakers, Eric-Jan · 2011 · Perspectives on Psychological Science
  5. ‘Statistical’, ‘practical’, and ‘clinical’: How many kinds of significance do counselors need to consider
    Thompson, Bruce · 2002 · Journal of Counseling & Development

See all 222

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: The appropriate use of null hypothesis testing. https://app.cochat.ai/papers/10.1037//1082-989x.1.4.379
The paper
Frick, R. W. (1996). The appropriate use of null hypothesis testing. Psychological Methods. https://doi.org/10.1037//1082-989x.1.4.379

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.