The DOI matches its Crossref record.
IX. On the problem of the most efficient tests of statistical hypotheses
Open accessAbstract
The problem of testing statistical hypotheses is an old one. Its origin is usually connected with the name of Thomas Bayes, who gave the well-known theorem on the probabilities a posteriori of the possible “causes“ of a given event. Since then it has been discussed by many writers of whom we shall here mention two only, Bertrand and Borel, whose differing views serve well to illustrate the point from which we shall approach the subject. Bertrand put into statistical form a variety of hypotheses, as for example the hypothesis that a given group of stars with relatively small angular distances between them as seen from the earth, form a “system” or group in space. His method of attack, which is that in common use, consisted essentially in calculating the probability, P, that a certain character, x, of the observed facts would arise if the hypothesis tested were true. If P were very small, this would generally be considered as an indication that the hypothesis, H, was probably false, and vice versa. Bertrand expressed the pessimistic view that no test of this kind could give reliable results. Borel, however, in a later discussion, considered that the method described could be applied with success provided that the character, x, of the observed facts were properly chosen—were, in fact, a character which he terms “en quelque sorte remarquable.”
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cited by
Missing data: our view of the state of the art
Schafer, J. L., & Graham, J. W. (2002) · Psychological Methods · doi:10.1037/1082-989x.7.2.147 · Cited by 11,638
Cohen, J. (1992) · Current Directions in Psychological Science · doi:10.1111/1467-8721.ep10768783 · Cited by 5,870
Bozdogan, H. (1987) · Psychometrika · doi:10.1007/bf02294361 · Cited by 4,468
Quantum detection and estimation theory
Helstrom, C. W. (1969) · Journal of Statistical Physics · doi:10.1007/bf01007479 · Cited by 3,776
A practical solution to the pervasive problems ofp values
Wagenmakers, E.-J. (2007) · Psychonomic Bulletin & Review · doi:10.3758/bf03194105 · Cited by 2,490
Using confidence intervals in within-subject designs
Loftus, G. R., & Masson, M. E. J. (1994) · Psychonomic Bulletin & Review · doi:10.3758/bf03210951 · Cited by 2,448
Lakens, D. (2022) · Collabra Psychology · doi:10.1525/collabra.33267 · Cited by 1,962
Properties of Sufficiency and Statistical Tests
Bartlett, M. S. (1992) · Springer Series in Statistics · doi:10.1007/978-1-4612-0919-5_8 · Cited by 1,886
Equivalence Testing for Psychological Research: A Tutorial
Lakens, D., Scheel, A. M., & Isager, P. M. (2018) · Advances in Methods and Practices in Psychological Science · doi:10.1177/2515245918770963 · Cited by 1,560
Sterne, J. A. C. (2001) · BMJ · doi:10.1136/bmj.322.7280.226 · Cited by 1,466
Bayesian model selection for group studies
Stephan, K. E., Penny, W. D., Daunizeau, J., Moran, R. J., & Friston, K. J. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2009.03.025 · Cited by 1,423
Searching for exotic particles in high-energy physics with deep learning
Baldi, P., Sadowski, P., & Whiteson, D. (2014) · Nature Communications · doi:10.1038/ncomms5308 · Cited by 1,164
A multivariate analysis of the risk of coronary heart disease in Framingham
Truett, J., Cornfield, J., & Kannel, W. (1967) · Journal of Chronic Diseases · doi:10.1016/0021-9681(67)90082-3 · Cited by 958
“Proving the null hypothesis” in clinical trials
Blackwelder, W. C. (1982) · Controlled Clinical Trials · doi:10.1016/0197-2456(82)90024-1 · Cited by 887
Mason, S. J., & Graham, N. E. (2002) · Quarterly Journal of the Royal Meteorological Society · doi:10.1256/003590002320603584 · Cited by 868
The theory of signal detectability
Peterson, W., Birdsall, T., & Fox, W. (1954) · Transactions of the IRE Professional Group on Information Theory · doi:10.1109/tit.1954.1057460 · Cited by 867
Psychology, Science, and Knowledge Construction: Broadening Perspectives from the Replication Crisis
Shrout, P. E., & Rodgers, J. L. (2018) · Annual Review of Psychology · doi:10.1146/annurev-psych-122216-011845 · Cited by 725
Validation of Molecular Docking Programs for Virtual Screening against Dihydropteroate Synthase
Hevener, K. E., Zhao, W., Ball, D. M., Babaoglu, K., Qi, J., White, S. W., & Lee, R. E. (2009) · Journal of Chemical Information and Modeling · doi:10.1021/ci800293n · Cited by 668
Equitability, mutual information, and the maximal information coefficient
Kinney, J. B., & Atwal, G. S. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1309933111 · Cited by 667
Speaker Recognition by Machines and Humans: A tutorial review
Hansen, J. H. L., & Hasan, T. (2015) · IEEE Signal Processing Magazine · doi:10.1109/msp.2015.2462851 · Cited by 621
Tarka, P. (2018) · Quality & Quantity · doi:10.1007/s11135-017-0469-8 · Cited by 617
Quasi-Static Multiple-Antenna Fading Channels at Finite Blocklength
Yang, W., Durisi, G., Koch, T., & Polyanskiy, Y. (2014) · IEEE Transactions on Information Theory · doi:10.1109/tit.2014.2318726 · Cited by 609
Statistical Methods and Scientific Induction
Fisher, R. (1955) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1955.tb00180.x · Cited by 596
Self-Evaluation of Decision-Making: A General Bayesian Framework for Metacognitive Computation
Fleming, S. M., & Daw, N. D. (2017) · Psychological Review · doi:10.1037/rev0000045 · Cited by 584
Statistical power and significance testing in large-scale genetic studies
Sham, P. C., & Purcell, S. M. (2014) · Nature Reviews Genetics · doi:10.1038/nrg3706 · Cited by 573
Consistency in Statistical Inference and Decision
Smith, C. A. B. (1961) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1961.tb00388.x · Cited by 557
Membership Inference Attacks From First Principles
Carlini, N., Chien, S., Nasr, M., Song, S., Terzis, A., & Tramèr, F. (2022) · 2022 IEEE Symposium on Security and Privacy (SP) · doi:10.1109/sp46214.2022.9833649 · Cited by 502
Bloom, H. S., Hill, C. J., Black, A. R., & Lipsey, M. W. (2008) · Journal of Research on Educational Effectiveness · doi:10.1080/19345740802400072 · Cited by 477
Presidential Address: The Scientific Outlook in Financial Economics
HARVEY, C. R. (2017) · The Journal of Finance · doi:10.1111/jofi.12530 · Cited by 461
Lakens, D., Adolfi, F. G., Albers, C. J., Anvari, F., Apps, M. A. J., Argamon, S. E., Baguley, T., Becker, R. B., Benning, S. D., Bradford, D. E., et al. (2018) · Nature Human Behaviour · doi:10.1038/s41562-018-0311-x · Cited by 458
Szucs, D., & Ioannidis, J. P. (2020) · NeuroImage · doi:10.1016/j.neuroimage.2020.117164 · Cited by 453
An Alternative to Null-Hypothesis Significance Tests
Killeen, P. R. (2005) · Psychological Science · doi:10.1111/j.0956-7976.2005.01538.x · Cited by 443
The testing of statistical hypotheses in relation to probabilities a priori
Neyman, J., & Pearson, E. S. (1933) · Mathematical Proceedings of the Cambridge Philosophical Society · doi:10.1017/s030500410001152x · Cited by 412
Self-citationPermutation Theory in the Derivation of Robust Criteria and the Study of Departures from Assumption
Box, G. E. P., & Andersen, S. L. (1955) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1955.tb00176.x · Cited by 401
Dubins, L. E., & Spanier, E. H. (1961) · The American Mathematical Monthly · doi:10.1080/00029890.1961.11989615 · Cited by 385
Bayesian Estimation and Inference: A User’s Guide
Zyphur, M. J., & Oswald, F. L. (2015) · Journal of Management · doi:10.1177/0149206313501200 · Cited by 385
The Fisher, Neyman-Pearson Theories of Testing Hypotheses: One Theory or Two?
Lehmann, E. L. (1993) · Journal of the American Statistical Association · doi:10.1080/01621459.1993.10476404 · Cited by 382
The statistical physics of real-world networks
Cimini, G., Squartini, T., Saracco, F., Garlaschelli, D., Gabrielli, A., & Caldarelli, G. (2019) · Nature Reviews Physics · doi:10.1038/s42254-018-0002-6 · Cited by 378
Statistical Inference as Severe Testing: How to Get Beyond the Statistics Wars
Mayo, D. G. (2018) · doi:10.1017/9781107286184 · Cited by 376
Ince, R. A. A., Giordano, B. L., Kayser, C., Rousselet, G. A., Gross, J., & Schyns, P. G. (2017) · Human Brain Mapping · doi:10.1002/hbm.23471 · Cited by 366
A Panoramic Code for Sound Location by Cortical Neurons
Middlebrooks, J. C., Clock, A. E., Xu, L., & Green, D. M. (1994) · Science · doi:10.1126/science.8171339 · Cited by 351
Low P-Values or Narrow Confidence Intervals: Which Are More Durable?
Poole, C. (2001) · Epidemiology · doi:10.1097/00001648-200105000-00005 · Cited by 350
Could Fisher, Jeffreys and Neyman Have Agreed on Testing?
Berger, J. O. (2003) · Statistical Science · doi:10.1214/ss/1056397485 · Cited by 346
The Insignificance of Null Hypothesis Significance Testing
Gill, J. (1999) · Political Research Quarterly · doi:10.1177/106591299905200309 · Cited by 338
Diedrichsen, J., & Kriegeskorte, N. (2017) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1005508 · Cited by 333
The Probability Heuristics Model of Syllogistic Reasoning
Chater, N., & Oaksford, M. (1999) · Cognitive Psychology · doi:10.1006/cogp.1998.0696 · Cited by 324
A new strategy for testing structural equation models
Moshagen, M., & Erdfelder, E. (2016) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1080/10705511.2014.950896 · Cited by 321
A comment on replication,P‐values and evidence
Goodman, S. N. (1992) · Statistics in Medicine · doi:10.1002/sim.4780110705 · Cited by 309
The earth is flat ( p > 0.05): significance thresholds and the crisis of unreplicable research
Amrhein, V., Korner-Nievergelt, F., & Roth, T. (2017) · PeerJ · doi:10.7717/peerj.3544 · Cited by 308
SOME EXAMPLES OF DISCRIMINATION
SMITH, C. A. B. (1946) · Annals of Eugenics · doi:10.1111/j.1469-1809.1946.tb02368.x · Cited by 305
The DELPHI Collaboration (2003) · The European Physical Journal C · doi:10.1140/epjc/s2003-01355-5 · Cited by 305
Final Collapse of the Neyman-Pearson Decision Theoretic Framework and Rise of the neoFisherian
Hurlbert, S. H., & Lombardi, C. M. (2009) · Annales Zoologici Fennici · doi:10.5735/086.046.0501 · Cited by 301
Sifting the evidence—what's wrong with significance tests?
Sterne, J. A. C., & Smith, G. D. (2001) · Physical Therapy · doi:10.1093/ptj/81.8.1464 · Cited by 301
The Power of Single-Nucleotide Polymorphisms for Large-Scale Parentage Inference
Anderson, E. C., & Garza, J. C. (2006) · Genetics · doi:10.1534/genetics.105.048074 · Cited by 293
A systematic review of statistical power in software engineering experiments
Dybå, T., Kampenes, V. B., & Sjøberg, D. I. K. (2006) · Information and Software Technology · doi:10.1016/j.infsof.2005.08.009 · Cited by 289
Confusion Over Measures of Evidence (p's) Versus Errors (α's) in Classical Statistical Testing
Hubbard, R., & Bayarri, M. J. (2003) · The American Statistician · doi:10.1198/0003130031856 · Cited by 287
When Null Hypothesis Significance Testing Is Unsuitable for Research: A Reassessment
Szucs, D., & Ioannidis, J. P. A. (2017) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2017.00390 · Cited by 298
Model-based fault diagnosis for aerospace systems: a survey
Marzat, J., Piet-Lahanier, H., Damongeot, F., & Walter, E. (2012) · Proceedings of the Institution of Mechanical Engineers, Part G: Journal of Aerospace Engineering · doi:10.1177/0954410011421717 · Cited by 278
Pepe, M. S., Cai, T., & Longton, G. (2006) · Biometrics · doi:10.1111/j.1541-0420.2005.00420.x · Cited by 272
PROPER IMAGE SUBTRACTION—OPTIMAL TRANSIENT DETECTION, PHOTOMETRY, AND HYPOTHESIS TESTING
Zackay, B., Ofek, E. O., & Gal-Yam, A. (2016) · The Astrophysical Journal · doi:10.3847/0004-637x/830/1/27 · Cited by 265
Exposed! A Survey of Attacks on Private Data
Dwork, C., Smith, A., Steinke, T., & Ullman, J. (2017) · Annual Review of Statistics and Its Application · doi:10.1146/annurev-statistics-060116-054123 · Cited by 259
Statistical Rituals: The Replication Delusion and How We Got There
Gigerenzer, G. (2018) · Advances in Methods and Practices in Psychological Science · doi:10.1177/2515245918771329 · Cited by 263
Burgess, A. E. (1999) · Journal of the Optical Society of America A · doi:10.1364/josaa.16.000633 · Cited by 260
Electron efficiency measurements with the ATLAS detector using 2012 LHC proton–proton collision data
ATLAS Collaboration, Aaboud, M., Aad, G., Abbott, B., Abdallah, J., Abdinov, O., Abeloos, B., AbouZeid, O. S., Abraham, N. L., Abramowicz, H., et al. (2017) · The European Physical Journal C · doi:10.1140/epjc/s10052-017-4756-2 · Cited by 260
Learning and comparing functional connectomes across subjects
Varoquaux, G., & Craddock, R. C. (2013) · NeuroImage · doi:10.1016/j.neuroimage.2013.04.007 · Cited by 233
Likelihood ratios: A simple and flexible statistic for empirical psychologists
Glover, S., & Dixon, P. (2004) · Psychonomic Bulletin & Review · doi:10.3758/bf03196706 · Cited by 218
Brain mechanisms for perceptual and reward-related decision-making
Deco, G., Rolls, E. T., Albantakis, L., & Romo, R. (2013) · Progress in Neurobiology · doi:10.1016/j.pneurobio.2012.01.010 · Cited by 196
Relationship of Lipoproteins to Cardiovascular Events
Guyton, J. R., Slee, A. E., Anderson, T., Fleg, J. L., Goldberg, R. B., Kashyap, M. L., Marcovina, S. M., Nash, S. D., O'Brien, K. D., Weintraub, W. S., et al. (2013) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2013.07.023 · Cited by 182
The dynamics of choice among multiple alternatives
McMillen, T., & Holmes, P. (2006) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2005.10.003 · Cited by 153
On the Overuse and Misuse of Mediation Analysis: It May Be a Matter of Timing
Tate, C. U. (2015) · Basic and Applied Social Psychology · doi:10.1080/01973533.2015.1062380 · Cited by 153
Hubbard (2004) · doi:10.1177/0959354304043638 · Cited by 114
Statistical analysis of proteomics data: A review on feature selection
Lualdi, M., & Fasano, M. (2019) · Journal of Proteomics · doi:10.1016/j.jprot.2018.12.004 · Cited by 93
Misprescription and misuse of one-tailed tests
LOMBARDI, C. M., & HURLBERT, S. H. (2009) · Austral Ecology · doi:10.1111/j.1442-9993.2009.01946.x · Cited by 93
Brehmer, J., Mishra-Sharma, S., Hermans, J., Louppe, G., & Cranmer, K. (2019) · The Astrophysical Journal · doi:10.3847/1538-4357/ab4c41 · Cited by 80
Reproducing Statistical Results
Stodden, V. (2015) · Annual Review of Statistics and Its Application · doi:10.1146/annurev-statistics-010814-020127 · Cited by 77
Estimating Population Mean Power Under Conditions of Heterogeneity and Selection for Significance
Brunner, J., & Schimmack, U. (2020) · Meta-Psychology · doi:10.15626/mp.2018.874 · Cited by 76
Modeling the nonlinear dynamics of cellular signal transduction
TIMMER, J., MÜLLER, T. G., SWAMEYE, I., SANDRA, O., & KLINGMÜLLER, U. (2004) · International Journal of Bifurcation and Chaos · doi:10.1142/s0218127404010461 · Cited by 68
Sample size calculations for clinical studies allowing for uncertainty about the variance
Julious, S. A., & Owen, R. J. (2006) · Pharmaceutical Statistics · doi:10.1002/pst.197 · Cited by 59
The Science and Philosophy of a Method for Assessing Environmental Causes
Suter, G. W., Norton, S. B., & Cormier, S. M. (2010) · Human and Ecological Risk Assessment: An International Journal · doi:10.1080/10807030903459254 · Cited by 59
The Challenge of Inferring Unconscious Mental Processes
Shanks, D. R., Malejka, S., & Vadillo, M. A. (2021) · Experimental Psychology · doi:10.1027/1618-3169/a000517 · Cited by 40
Ortega, A., & Navarrete, G. (2017) · Bayesian Inference · doi:10.5772/intechopen.70230 · Cited by 31
Neural physical engines for inferring the halo mass distribution function
Charnock, T., Lavaux, G., Wandelt, B. D., Sarma Boruah, S., Jasche, J., & Hudson, M. J. (2020) · Monthly Notices of the Royal Astronomical Society · doi:10.1093/mnras/staa682 · Cited by 26
Detecting Multi-Agent Collusion Through Multi-Agent Interpretability
Rose, A., Cullen, C., Abdelnabi, S., Torr, P., Kaplowitz, B. G., & de Witt, C. S. (2026) · arXiv · doi:10.48550/arxiv.2604.01151
Metadata
- Authors
- Neyman, J., & Pearson, E. S.
- Venue
- Philosophical Transactions of the Royal Society of London. Series A, Containing Papers of a Mathematical or Physical Character
- Publisher
- The Royal Society
- Published
- 1933-02-16
- Volume
- 231
- Issue
- 694-706
- Pages
- 289-337
- ISSN
- 0264-3952 (ISSN-L)
- 2053-9258
- OpenAlex
- W2993330478
- Cited by
- 2,341
- References
- 0
- FWCI
- 6.76
- Type
- journal article
- Language
- en
- Open access
- diamond
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.