The DOI matches its Crossref record; 63 of the 63 references it cites were found in a registry or an index.
Could Fisher, Jeffreys and Neyman Have Agreed on Testing?
Abstract
Ronald Fisher advocated testing using p-values, Harold Jeffreys proposed use of objective posterior probabilities of hypotheses and Jerzy Neyman recommended testing with fixed error probabilities. Each was quite critical of the other approaches. Most troubling for statistics and science is that the three approaches can lead to quite different practical conclusions. This article focuses on discussion of the conditional frequentist approach to testing, which is argued to provide the basis for a methodological unification of the approaches of Fisher, Jeffreys and Neyman. The idea is to follow Fisher in using p-values to define the "strength of evidence" in data and to follow his approach of conditioning on strength of evidence; then follow Neyman by computing Type I and Type II error probabilities, but do so conditional on the strength of evidence in the data. The resulting conditional frequentist error probabilities equal the objective posterior probabilities of the hypotheses advocated by Jeffreys.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Statistical Decision Theory and Bayesian Analysis
Berger, J. O. (1985) · Springer Series in Statistics · doi:10.1007/978-1-4757-4286-2 · Cited by 7,722
Self-citationIX. On the problem of the most efficient tests of statistical hypotheses
Neyman, J., & Pearson, E. S. (1933) · Philosophical Transactions of the Royal Society of London. Series A, Containing Papers of a Mathematical or Physical Character · doi:10.1098/rsta.1933.0009 · Cited by 2,341
Sterne, J. A. C. (2001) · BMJ · doi:10.1136/bmj.322.7280.226 · Cited by 1,466
Error and the Growth of Experimental Knowledge
Mayo, D. G. (1996) · doi:10.7208/chicago/9780226511993.001.0001 · Cited by 1,325
The Logic of Inductive Inference
Fisher, R. A. (1935) · Journal of the Royal Statistical Society · doi:10.2307/2342435 · Cited by 1,265
Toward Evidence-Based Medical Statistics. 1: The P Value Fallacy
Goodman, S. N. (1999) · Annals of Internal Medicine · doi:10.7326/0003-4819-130-12-199906150-00008 · Cited by 1,185
Toward Evidence-Based Medical Statistics. 2: The Bayes Factor
Goodman, S. N. (1999) · Annals of Internal Medicine · doi:10.7326/0003-4819-130-12-199906150-00019 · Cited by 912
Calibration of ρ Values for Testing Precise Null Hypotheses
Sellke, T., Bayarri, M. J., & Berger, J. O. (2001) · The American Statistician · doi:10.1198/000313001300339950 · Cited by 854
Self-citationJoseph, L., Gyorkos, T. W., & Coupal, L. (1995) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a117428 · Cited by 705
Berger, J. O., & Delampady, M. (1987) · Statistical Science · doi:10.1214/ss/1177013238 · Cited by 664
Self-citationBerger, J. O., & Wolpert, R. L. (1988) · doi:10.1214/lnms/1215466210 · Cited by 616
Self-citationLogic of Statistical Inference
Hacking, I., & Romeijn, J.-W. (2016) · Cambridge University Press eBooks · doi:10.1017/cbo9781316534960 · Cited by 611
Statistical Methods and Scientific Induction
Fisher, R. (1955) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1955.tb00180.x · Cited by 596
Testing a Point Null Hypothesis: The Irreconcilability of P Values and Evidence
Berger, J. O., & Sellke, T. (1987) · Journal of the American Statistical Association · doi:10.2307/2289131 · Cited by 548
Self-citationSome Problems Connected with Statistical Inference
Cox, D. R. (1958) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177706618 · Cited by 536
Posterior odds ratios for selected regression hypotheses
Zellner, A., & Siow, A. (1980) · Trabajos de Estadistica Y de Investigacion Operativa · doi:10.1007/bf02888369 · Cited by 463
Reconciling Bayesian and Frequentist Evidence in the One-Sided Testing Problem
Casella, G., & Berger, R. L. (1987) · Journal of the American Statistical Association · doi:10.1080/01621459.1987.10478396 · Cited by 453
The Fisher, Neyman-Pearson Theories of Testing Hypotheses: One Theory or Two?
Lehmann, E. L. (1993) · Journal of the American Statistical Association · doi:10.1080/01621459.1993.10476404 · Cited by 382
Simultaneous Test Procedures--Some Theory of Multiple Comparisons
Gabriel, K. R. (1969) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177697819 · Cited by 366
The Logical Foundations of Statistical Interference
Kyburg, H. E. (1974) · Springer eBooks · doi:10.1007/978-94-010-2175-3 · Cited by 358
P Values for Composite Null Models
Bayarri, M. J., & Berger, J. O. (2000) · Journal of the American Statistical Association · doi:10.1080/01621459.2000.10474309 · Cited by 335
Self-citationOn Formulae for Confidence Points Based on Integrals of Weighted Likelihoods
Welch, B. L., & Peers, H. W. (1963) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1963.tb00512.x · Cited by 327
A Bayesian perspective on the bonferroni adjustment
Westfall, P. (1997) · Biometrika · doi:10.1093/biomet/84.2.419 · Cited by 316
A comment on replication,P‐values and evidence
Goodman, S. N. (1992) · Statistics in Medicine · doi:10.1002/sim.4780110705 · Cited by 309
Goodman, S. N. (1993) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a116700 · Cited by 303
A New Perspective on Priors for Generalized Linear Models
Bedrick, E. J., Christensen, R., & Johnson, W. (1996) · Journal of the American Statistical Association · doi:10.1080/01621459.1996.10476713 · Cited by 271
P Values: What They are and What They are Not
Schervish, M. J. (1996) · The American Statistician · doi:10.1080/00031305.1996.10474380 · Cited by 244
Frequentist probability and frequentist statistics
Neyman, J. (1977) · Synthese · doi:10.1007/bf00485695 · Cited by 230
P-Values: Interpretation and Methodology
Gibbons, J. D., & Pratt, J. W. (1975) · The American Statistician · doi:10.1080/00031305.1975.10479106 · Cited by 228
Savage, L. J. (1976) · The Annals of Statistics · doi:10.1214/aos/1176343456 · Cited by 193
Unified frequentist and Bayesian testing of a precise hypothesis
Berger, J. O., Boukai, B., & Wang, Y. (1997) · Statistical Science · doi:10.1214/ss/1030037904 · Cited by 189
Self-citationScreening without a "Gold Standard": The Hui-Walter Paradigm Revisited
Johnson, W. O. (2001) · American Journal of Epidemiology · doi:10.1093/aje/153.9.921 · Cited by 188
R. A. Fisher and Fiducial Argument
Zabell, S. L. (1992) · Statistical Science · doi:10.1214/ss/1177011233 · Cited by 177
On the Elimination of Nuisance Parameters
Basu, D. (1977) · Journal of the American Statistical Association · doi:10.1080/01621459.1977.10481002 · Cited by 175
The Roles of Conditioning in Inference
Reid, N. (1995) · Statistical Science · doi:10.1214/ss/1177010027 · Cited by 173
The Counternull Value of an Effect Size: A New Statistic
Rosenthal, R., & Rubin, D. B. (1994) · Psychological Science · doi:10.1111/j.1467-9280.1994.tb00281.x · Cited by 168
The Bayes/Non-Bayes Compromise: A Brief Review
Good, I. J. (1992) · Journal of the American Statistical Association · doi:10.1080/01621459.1992.10475256 · Cited by 139
Significance Tests in Parallel and in Series
Good, I. J. (1958) · Journal of the American Statistical Association · doi:10.1080/01621459.1958.10501480 · Cited by 124
Berger, J. O., Brown, L. D., & Wolpert, R. L. (1994) · The Annals of Statistics · doi:10.1214/aos/1176325757 · Cited by 118
Self-citationDefault Bayes Factors for Nonnested Hypothesis Testing
Berger, J. O., & Mortera, J. (1999) · Journal of the American Statistical Association · doi:10.1080/01621459.1999.10474149 · Cited by 113
Self-citationAsymptotic Distribution of P Values in Composite Null Models
Robins, J. M. W., van der Vaart, A., & Ventura, V. (2000) · Journal of the American Statistical Association · doi:10.2307/2669750 · Cited by 111
Comparative Statistical Inference
Barnett, V. (1999) · Wiley series in probability and statistics · doi:10.1002/9780470316955 · Cited by 109
Some Thoughts on Statistical Inference
Pearson, E. S. (1962) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177704566 · Cited by 103
On the Generalization of the Likelihood Function and the Likelihood Principle
Bjørnstad, J. F. (1996) · Journal of the American Statistical Association · doi:10.1080/01621459.1996.10476947 · Cited by 97
Conditional Confidence Statements and Confidence Estimators
Kiefer, J. (1977) · Journal of the American Statistical Association · doi:10.2307/2286460 · Cited by 96
Statistical Concepts in Their Relation to Reality
Pearson, E. S. (1955) · Journal of the Royal Statistical Society Series B (Statistical Methodology) · doi:10.1111/j.2517-6161.1955.tb00194.x · Cited by 92
Bayesian Binomial Regression: Predicting Survival at a Trauma Center
Bedrick, E. J., Christensen, R., & Johnson, W. O. (1997) · The American Statistician · doi:10.1080/00031305.1997.10473965 · Cited by 86
Behavioristic, Evidentialist, and Learning Models of Statistical Testing
Mayo, D. G. (1985) · Philosophy of Science · doi:10.1086/289272 · Cited by 72
Principles of Inference and Their Consequences
Mayo, D. G., & Kruse, M. (2001) · Applied logic series · doi:10.1007/978-94-017-1586-7_16 · Cited by 71
Toward a Reconciliation of the Bayesian and Frequentist Approaches to Point Estimation
Samaniego, F. J., & Reneau, D. M. (1994) · Journal of the American Statistical Association · doi:10.1080/01621459.1994.10476828 · Cited by 59
Tests of statistical hypotheses and their use in studies of natural phenomena
Neyman, J. (1976) · Communication in Statistics- Theory and Methods · doi:10.1080/03610927608827392 · Cited by 56
An objective theory of statistical testing
Mayo, D. G. (1983) · Synthese · doi:10.1007/bf01064701 · Cited by 54
The Logic of Tests of Significance
Spielman, S. (1974) · Philosophy of Science · doi:10.1086/288590 · Cited by 54
On the Foundations of Statistical Inference: Binary Experiments
Birnbaum, A. (1961) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177705050 · Cited by 49
Delampady, M., & Berger, J. O. (1990) · The Annals of Statistics · doi:10.1214/aos/1176347750 · Cited by 45
Self-citationThe Foundations of Statistical Inference.
Brillinger, D. R., & Savage, L. J. (1963) · American Mathematical Monthly · doi:10.2307/2312706 · Cited by 43
MARGINAL AND CONDITIONAL LIKELIHOODS
Kalbfleisch, J. D., & Sprott, D. A. (2016) · Cited by 41
Simultaneous Bayesian-frequentist sequential testing of nested hypotheses
Berger, J. O. (1999) · Biometrika · doi:10.1093/biomet/86.1.79 · Cited by 37
Self-citationUnified Conditional Frequentist and Bayesian Testing of Composite Hypotheses
Dass, S. C., & Berger, J. O. (2003) · Scandinavian Journal of Statistics · doi:10.1111/1467-9469.00326 · Cited by 29
Self-citationBayesian Multiple Testing for Two‐Sample Multivariate Endpoints
Gönen, M., Westfall, P. H., & Johnson, W. O. (2003) · Biometrics · doi:10.1111/1541-0420.00009 · Cited by 19
Wolpert, R. L. (1996) · Studies in classification, data analysis, and knowledge organization · doi:10.1007/978-3-642-80098-6_24 · Cited by 15
The Logic of Tests of Significance
Carlson, R. A. (1976) · Philosophy of Science · doi:10.1086/288672 · Cited by 10
Comparative Classical and Bayesian Interpretations of Statistical Compliance Tests in Auditing
Johnstone, D. J. (1997) · Accounting and Business Research · doi:10.1080/00014788.1997.9728899 · Cited by 9
Cited by
A practical solution to the pervasive problems ofp values
Wagenmakers, E.-J. (2007) · Psychonomic Bulletin & Review · doi:10.3758/bf03194105 · Cited by 2,490
Fay, M. P., & Proschan, M. A. (2010) · Statistics Surveys · doi:10.1214/09-ss051 · Cited by 1,118
Bayesian Versus Orthodox Statistics: Which Side Are You On?
Dienes, Z. (2011) · Perspectives on Psychological Science · doi:10.1177/1745691611406920 · Cited by 938
Ellison, A. M. (2004) · Ecology Letters · doi:10.1111/j.1461-0248.2004.00603.x · Cited by 786
The Deviance Information Criterion: 12 Years on
Spiegelhalter, D. J., Best, N. G., Carlin, B. P., & Linde, A. (2014) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/rssb.12062 · Cited by 629
Metadata
- Authors
- Berger, J. O.
- Venue
- Statistical Science
- Publisher
- Institute of Mathematical Statistics
- Published
- 2003-02-01
- Volume
- 18
- Issue
- 1
- Pages
- 1-32
- ISSN
- 0883-4237 (ISSN-L)
- OpenAlex
- W2038290376
- Cited by
- 346
- References
- 63
- FWCI
- 10.11
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.