CoChat

Hypothesis testing and theory evaluation at the boundaries: Surprising insights from Bayes's theorem.

Trafimow, David · 2003 · Psychological Review
Cited by 158

The DOI matches its Crossref record; 5 of the 5 references it cites were found in a registry or an index.

Abstract

Because the probability of obtaining an experimental finding given that the null hypothesis is true [p(F\H0)] is not the same as the probability that the null hypothesis is true given a finding [p(H0\F)], calculating the former probability does not justify conclusions about the latter one. As the standard null-hypothesis significance-testing procedure does just that, it is logically invalid (J. Cohen, 1994). Theoretically, Bayes's theorem yields p(H0\F), but in practice, researchers rarely know the correct values for 2 of the variables in the theorem. Nevertheless, by considering a wide range of possible values for the unknown variables, it is possible to calculate a range of theoretical values for p(H0\F) and to draw conclusions about both hypothesis testing and theory evaluation.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1037/0033-295x.110.3.526

Cites

5 of 5 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Research works printed but not linked: 20

  1. Abelson, 1997, A retrospective on the significance test ban of 1999 (If there were no significance tests, they would be invented)., 117
  2. 10.1037/h0020412 · DOI · Paper page
  3. 10.1017/S0140525X98001162 · DOI · Paper page
  4. Faust, 1984, The limits of scientific reasoning.
  5. 10.1037/0022-3514.36.11.1344 · doi:10.1037/0022-3514.36.11.1344 · Paper page
  6. 10.1037/0003-066X.52.1.15 · doi:10.1037/0003-066x.52.1.15 · Paper page
  7. Hempel, 1965, Aspects of scientific explanation, and other essays, in the philosophy of science.
  8. 10.1207/s15327965pli0102_1 · DOI · Paper page
  9. Meehl, 1997, The problem is epistemology, not statistics: Replace significance tests by confidence intervals and quantify accuracy of risky numerical predictions., 393
  10. Mulaik, 1997, There is a time and place for significance testing., 65
  11. Popper, 1959, The logic of scientific discovery.
  12. Popper, 1962, Conjectures and refutations.
  13. 10.1037/0033-295X.107.2.358 · doi:10.1037/0033-295x.107.2.358 · Paper page
  14. 10.1037/h0042040 · DOI · Paper page
  15. Rozeboom, 1997, Good science is abductive, not hypotheticodeductive., 335
  16. Schaller, 1998, On the purposes served by psychological research and its critics., Theory & Psychology, 8, 205, 10.1177/0959354398082007 · DOI
  17. 10.1037/1082-989X.1.2.115 · DOI · Paper page
  18. Schmidt, 1997, Eight objections to the discontinuation of significance testing in the analysis of research data., 37
  19. Wallach, 2001, Experiments in social psychology: Science or self-deception?, Theory & Psychology, 11, 451, 10.1177/0959354301114001 · DOI
  20. Wallach, 1998, When experiments serve little purposes: Misguided research in mainstream psychology., Theory & Psychology, 8, 183, 10.1177/0959354398082005 · DOI

Cited by

See all 158

Metadata

Authors
Trafimow, D.
Venue
Psychological Review
Published
2003
Volume
110
Issue
3
Pages
526-535
ISSN
  • 0033-295X (ISSN-L)
  • 1939-1471
OpenAlex
W2113174959
Cited by
158
References
5
FWCI
5.54
Type
journal article
Language
en
Open access
closed

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.