The DOI matches its Crossref record; 274 of the 274 references it cites were found in a registry or an index.
Final Collapse of the Neyman-Pearson Decision Theoretic Framework and Rise of the neoFisherian
Abstract
This essay grew out of an examination of one-tailed significance testing. One-tailed tests were little advocated by the founders of modern statistics but are widely used and recommended nowadays in the biological, behavioral and social sciences. The high frequency of their use in ecology and animal behavior and their logical indefensibility have been documented in a companion review paper. In the present one, we trace the roots of this problem and counter some attacks on significance testing in general. Roots include: the early but irrational dichotomization of the P scale and adoption of the ‘significant/non-significant’ terminology; the mistaken notion that a high P value is evidence favoring the null hypothesis over the alternative hypothesis; and confusion over the distinction between statistical and research hypotheses. Resultant widespread misuse and misinterpretation of significance tests have also led to other problems, such as unjustifiable demands that reporting of P values be disallowed or greatly reduced and that reporting of confidence intervals and standardized effect sizes be required in their place. Our analysis of these matters thus leads us to a recommendation that for standard types of significance assessment the paleoFisherian and Neyman-Pearsonian paradigms be replaced by a neoFisherian one. The essence of the latter is that a critical α (probability of type I error) is not specified, the terms ‘significant’ and ‘non-significant’ are abandoned, that high P values lead only to suspended judgments, and that the so-called “three-valued logic” of Cox, Kaiser, Tukey, Tryon and Harris is adopted explicitly. Confidence intervals and bands, power analyses, and severity curves remain useful adjuncts in particular situations. Analyses conducted under this paradigm we term neoFisherian significance assessments (NFSA). Their role is assessment of the existence, sign and magnitude of statistical effects. The common label of null hypothesis significance tests (NHST) is retained for paleoFisherian and Neyman-Pearsonian approaches and their hybrids. The original Neyman-Pearson framework has no utility outside quality control type applications. Some advocates of Bayesian, likelihood and information-theoretic approaches to model selection have argued that P values and NFSAs are of little or no value, but those arguments do not withstand critical review. Champions of Bayesian methods in particular continue to overstate their value and relevance.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Nonparametric Statistics for the Behavioral Sciences
Guitton, H., & Siegel, S. (1958) · Revue économique · doi:10.2307/3498751 · Cited by 35,245
Baltosser, W. H., & Zar, J. H. (1996) · Ecology · doi:10.2307/2265725 · Cited by 35,166
Principles and procedures of statistics.
Steel, R. G. D., & Torrie, J. H. (1960) · Cited by 24,135
Statistical Methods for Rates and Proportions
Fleiss, J. L., Levin, B., & Paik, M. C. (2003) · Wiley Series in Probability and Statistics · doi:10.1002/0471445428 · Cited by 18,646
Robinson, H. F. (1961) · Agronomy Journal · doi:10.2134/agronj1961.00021962005300050002x · Cited by 17,713
Practical Statistics for Medical Research.
Walter, S. D., & Altman, D. G. (1992) · Biometrics · doi:10.2307/2532320 · Cited by 11,668
Experimental Design and Data Analysis for Biologists
Quinn, G. P., & Keough, M. J. (2002) · doi:10.1017/cbo9780511806384 · Cited by 10,674 · cited 2×
“As Quinn and Keough (2002) nicely state, in the great majority of situations, a " rejection of the H 0 is not important because we thought the H 0 might be true.”
BackgroundPractical Statistics for Medical Research
Altman, D. G. (1990) · doi:10.1201/9780429258589 · Cited by 10,668
Jeffreys, H., Moran, P. A. P., & Chatfield, C. (1922) · Nature · doi:10.1093/oso/9780198503682.001.0001 · Cited by 7,878
Nonparametric statistics for the behavioral sciences
McGinn, L. C. (1957) · Journal of the Franklin Institute · doi:10.1016/0016-0032(57)90766-4 · Cited by 7,204
Journal of The American Statistical Association
Fienberg, S. E. (2005) · Encyclopedia of Statistical Sciences · doi:10.1002/0471667196.ess1317 · Cited by 6,125
Testing Statistical Hypotheses
(2021) · Wiley Series in Probability and Statistics · doi:10.1002/9781119243830.ch12 · Cited by 5,106
Applied Nonparametric Statistics
Wozniak, P. J., & Daniel, W. W. (1991) · Technometrics · doi:10.2307/1268795 · Cited by 4,987
The Design and Analysis of Clinical Experiments
Fleiss, J. L. (1999) · Wiley eBooks · doi:10.1002/9781118032923 · Cited by 4,819
On the mathematical foundations of theoretical statistics
Fisher, R. A. (1922) · Philosophical Transactions of the Royal Society of London. Series A, Containing Papers of a Mathematical or Physical Character · doi:10.1098/rsta.1922.0009 · Cited by 4,039
Cohen, J. (1994) · American Psychologist · doi:10.1037/0003-066x.49.12.997 · Cited by 4,003
Effect size, confidence interval and statistical significance: a practical guide for biologists
Nakagawa, S., & Cuthill, I. C. (2007) · Biological Reviews · doi:10.1111/j.1469-185x.2007.00027.x · Cited by 3,835
Statistical Methods for Rates and Proportions, 2nd ed
GROVE, W. A. (1981) · American Journal of Psychiatry · doi:10.1176/ajp.138.12.1644-a · Cited by 3,748
(1947) · The American Statistician · doi:10.1080/00031305.1947.10501534 · Cited by 3,660
The Design and Analysis of Clinical Experiments.
Hills, M., & Fleiss, J. L. (1987) · Journal of the Royal Statistical Society. Series A (General) · doi:10.2307/2982050 · Cited by 3,261
Statistical methods in psychology journals: Guidelines and explanations.
Wilkinson, L., & Task Force on Statistical Inference (1999) · American Psychologist · doi:10.1037/0003-066x.54.8.594 · Cited by 2,791
A practical solution to the pervasive problems ofp values
Wagenmakers, E.-J. (2007) · Psychonomic Bulletin & Review · doi:10.3758/bf03194105 · Cited by 2,490
IX. On the problem of the most efficient tests of statistical hypotheses
Neyman, J., & Pearson, E. S. (1933) · Philosophical Transactions of the Royal Society of London. Series A, Containing Papers of a Mathematical or Physical Character · doi:10.1098/rsta.1933.0009 · Cited by 2,341
Lambert, N. M., Ketzenberger, K. E., & Kemp, C. A. (2014) · Encyclopedia of Special Education · doi:10.1002/9781118660584.ese0122 · Cited by 2,220
Statistical Decision Functions
Wald, A. (1949) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177730030 · Cited by 2,176
Null Hypothesis Testing: Problems, Prevalence, and an Alternative
Anderson, D. R., Burnham, K. P., & Thompson, W. L. (2000) · The Journal of Wildlife Management · doi:10.2307/3803199 · Cited by 1,930
Smithson, M. (2000) · SAGE Publications Ltd eBooks · doi:10.4135/9781446218525 · Cited by 1,871
Things I have learned (so far).
Cohen, J. (1990) · American Psychologist · doi:10.1037/0003-066x.45.12.1304 · Cited by 1,781
Bayesian statistical inference for psychological research.
Edwards, W., Lindman, H., & Savage, L. J. (1963) · Psychological Review · doi:10.1037/h0044139 · Cited by 1,734
Statistical Methods for Rates and Proportions.
Plewis, I., & Fleiss, J. L. (1982) · Journal of the Royal Statistical Society. Series A (General) · doi:10.2307/2982107 · Cited by 1,731
The review of educational research.
(1931) · Journal of Educational Psychology · doi:10.1037/h0066448 · Cited by 1,562
III. Contributions to the mathematical theory of evolution
Pearson, K. (1894) · Philosophical Transactions of the Royal Society of London. (A.) · doi:10.1098/rsta.1894.0003 · Cited by 1,550
A Primer of Ecological Statistics
Ford, E. D. (2005) · The American Statistician · doi:10.1198/tas.2005.s32 · Cited by 1,544
ON THE PROBLEM OF THE MOST EFFICIENT TESTS OF STATISTICAL HYPOTHESES
(1967) · Joint Statistical Papers · doi:10.1525/9780520339897-008 · Cited by 1,504
Inference by Eye: Confidence Intervals and How to Read Pictures of Data.
Cumming, G., & Finch, S. (2005) · American Psychologist · doi:10.1037/0003-066x.60.2.170 · Cited by 1,449
Student (1908) · Biometrika · doi:10.1093/biomet/6.1.1 · Cited by 1,363
Error and the Growth of Experimental Knowledge
Mayo, D. G. (1996) · doi:10.7208/chicago/9780226511993.001.0001 · Cited by 1,325
A Primer of Ecological Statistics
Gotelli, N. J., & Ellison, A. M. (2004) · Cited by 1,312
Statistical Methods and Scientific Inference.
Bartlett, M. S., & Fisher, R. A. (1957) · Biometrika · doi:10.2307/2333276 · Cited by 1,278
The Logic of Inductive Inference
Fisher, R. A. (1935) · Journal of the Royal Statistical Society · doi:10.2307/2342435 · Cited by 1,265
Toward Evidence-Based Medical Statistics. 1: The P Value Fallacy
Goodman, S. N. (1999) · Annals of Internal Medicine · doi:10.7326/0003-4819-130-12-199906150-00008 · Cited by 1,185
Proceedings of the Fourth Berkeley Symposium on Mathematical Statistics and Probability
Bartlett, M. S. (1963) · Technometrics · doi:10.1080/00401706.1963.10490087 · Cited by 1,179
Some Practical Guidelines for Effective Sample Size Determination
Lenth, R. V. (2001) · The American Statistician · doi:10.1198/000313001317098149 · Cited by 1,139
Statistics: Methods and Applications
Hill, T. E. (2005) · Cited by 1,116
The Insignificance of Statistical Significance Testing
Johnson, D. H. (1999) · The Journal of Wildlife Management · doi:10.2307/3802789 · Cited by 1,104
Cormack, R., & Underwood, A. J. (1997) · The Journal of Ecology · doi:10.2307/2960547 · Cited by 1,101
Null hypothesis significance testing: a review of an old and continuing controversy
Nickerson, R. S. (2000) · Psychological Methods · doi:10.1037/1082-989x.5.2.241 · Cited by 1,090
Outline of a Theory of Statistical Estimation Based on the Classical Theory of Probability
Neyman, J. (1937) · Philosophical Transactions of the Royal Society of London. Series A, Mathematical and Physical Sciences · doi:10.1098/rsta.1937.0005 · Cited by 1,087
Beyond significance testing: Reforming data analysis methods in behavioral research.
Kline, R. B. (2004) · doi:10.1037/10693-000 · Cited by 1,034
Scandinavian Journal of Statistics
(2010) · Scandinavian Journal of Statistics · doi:10.1111/(issn)1467-9469 · Cited by 976
Theory-Testing in Psychology and Physics: A Methodological Paradox
Meehl, P. E. (1967) · Philosophy of Science · doi:10.1086/288135 · Cited by 962
Testing Statistical Hypotheses
Neath, A. A. (2006) · Journal of the American Statistical Association · doi:10.1198/jasa.2006.s100 · Cited by 948
The case against statistical significance testing
Carver, R. (1978) · Harvard Educational Review · doi:10.17763/haer.48.3.t490261645281841 · Cited by 931
Toward Evidence-Based Medical Statistics. 2: The Bayes Factor
Goodman, S. N. (1999) · Annals of Internal Medicine · doi:10.7326/0003-4819-130-12-199906150-00019 · Cited by 912
Berryman, A. A. (1981) · Population Systems · doi:10.1007/978-1-4899-7325-2_6 · Cited by 882
124: The Logic of Inductive Inference.
Fisher, R. A. (1935) · Adelaide Research & Scholarship (AR&S) (University of Adelaide) · Cited by 881
Why environmental scientists are becoming Bayesians
Clark, J. S. (2005) · Ecology Letters · doi:10.1111/j.1461-0248.2004.00702.x · Cited by 862
Calibration of ρ Values for Testing Precise Null Hypotheses
Sellke, T., Bayarri, M. J., & Berger, J. O. (2001) · The American Statistician · doi:10.1198/000313001300339950 · Cited by 854
Schmidt, F. L. (1996) · Psychological Methods · doi:10.1037/1082-989x.1.2.115 · Cited by 830
Statistical Evidence: A Likelihood Paradigm
Reeves, J. H., & Royall, R. M. (1998) · Journal of the American Statistical Association · doi:10.2307/2669869 · Cited by 814
Statistical Methods in Agriculture and Experimental Biology
Mead, R. (2018) · Chapman & Hall/CRC eBooks · doi:10.1201/9781315275772 · Cited by 800
Ellison, A. M. (2004) · Ecology Letters · doi:10.1111/j.1461-0248.2004.00603.x · Cited by 786
Schmidt, F. L. (1996) · Psychological Methods · doi:10.1037//1082-989x.1.2.115 · Cited by 783
Statistical procedures and the justification of knowledge in psychological science.
Rosnow, R. L., & Rosenthal, R. (1989) · American Psychologist · doi:10.1037/0003-066x.44.10.1276 · Cited by 777
Testing a Point Null Hypothesis: The Irreconcilability of P Values and Evidence
Berger, J. O., & Sellke, T. (1987) · Journal of the American Statistical Association · doi:10.1080/01621459.1987.10478397 · Cited by 775
The Philosophy of Multiple Comparisons
Tukey, J. W. (1991) · Statistical Science · doi:10.1214/ss/1177011945 · Cited by 773
McCarthy, M. A. (2007) · Cambridge University Press eBooks · doi:10.1017/cbo9780511802454 · Cited by 756
Do studies of statistical power have an effect on the power of studies?
Sedlmeier, P., & Gigerenzer, G. (1989) · Psychological Bulletin · doi:10.1037/0033-2909.105.2.309 · Cited by 748
The fallacy of the null-hypothesis significance test.
Rozeboom, W. W. (1960) · Psychological Bulletin · doi:10.1037/h0042040 · Cited by 729
The cult of statistical significance: how the standard error costs us jobs, justice, and lives
(2008) · Choice Reviews Online · doi:10.5860/choice.46-0372 · Cited by 713
Principles of Statistical Inference
Cox, D. R. (2006) · doi:10.1017/cbo9780511813559 · Cited by 670
What If There Were No Significance Tests?
(2013) · Psychology Press eBooks · doi:10.4324/9781315827353 · Cited by 667
Berger, J. O., & Delampady, M. (1987) · Statistical Science · doi:10.1214/ss/1177013238 · Cited by 664
Statistical guidelines for contributors to medical journals.
Altman, D. G., Gore, S. M., Gardner, M. J., & Pocock, S. J. (1983) · BMJ · doi:10.1136/bmj.286.6376.1489 · Cited by 661
Statistical procedures and the justification of knowledge in psychological science.
Rosnow, R. L., & Rosenthal, R. (1992) · Methodological issues & strategies in clinical research. · doi:10.1037/10109-027 · Cited by 652
Testing Statistical Hypotheses.
Stuart, A., & Lehmann, E. L. (1960) · Journal of the Royal Statistical Society. Series A (General) · doi:10.2307/2342657 · Cited by 616
Statistical Evidence: A Likelihood Paradigm
Vieland, V. J., & Hodge, S. E. (1998) · The American Journal of Human Genetics · doi:10.1086/499065 · Cited by 606
Statistical Methods and Scientific Induction
Fisher, R. (1955) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1955.tb00180.x · Cited by 596
Testing a Point Null Hypothesis: The Irreconcilability of P Values and Evidence
Berger, J. O., & Sellke, T. (1987) · Journal of the American Statistical Association · doi:10.2307/2289131 · Cited by 548
Some Problems Connected with Statistical Inference
Cox, D. R. (1958) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177706618 · Cited by 536
The Uses of Statistical Power in Conservation Biology: The Vaquita and Northern Spotted Owl
Taylor, B. L., & Gerrodette, T. (1993) · Conservation Biology · doi:10.1046/j.1523-1739.1993.07030489.x · Cited by 502
Copi, I. M., Cohen, C., & McMahon, K. (2016) · doi:10.4324/9781315510897 · Cited by 497
Copi, I. M., Cohen, C., & Rodych, V. (2018) · Routledge eBooks · doi:10.4324/9781315144016 · Cited by 493
An introduction to Bayesian inference for ecological research and environmental decision-making
Ellison, A. M. (1996) · Ecological Applications · doi:10.2307/2269588 · Cited by 482
Statistical Decision Functions.
Lindley, D. V., & Wald, A. (1951) · Journal of the Royal Statistical Society. Series A (General) · doi:10.2307/2980980 · Cited by 475
Statistics As Principled Argument
Abelson, R. P. (2012) · Psychology Press eBooks · doi:10.4324/9781410601155 · Cited by 465
Contributions to the Theory of Statistical Estimation and Testing Hypotheses
Wald, A. (1939) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177732144 · Cited by 460
Introductory Statistics for the Behavioral Sciences.
Greenough, H. P., Lancaster, J. S., Welkowitz, J., Ewen, R. B., & Cohen, J. (1975) · The American Mathematical Monthly · doi:10.2307/2318276 · Cited by 459
Cognition as Intuitive Statistics
Gigerenzer, G., & Murray, D. J. (2015) · Psychology Press eBooks · doi:10.4324/9781315668796 · Cited by 453
Statistics as Principled Argument
Fricker, R. D., & Abelson, R. P. (1996) · The American Statistician · doi:10.2307/2684678 · Cited by 452
An Alternative to Null-Hypothesis Significance Tests
Killeen, P. R. (2005) · Psychological Science · doi:10.1111/j.0956-7976.2005.01538.x · Cited by 443
Confidence Intervals for Reporting Results of Clinical Trials
SIMON, R. (1986) · Annals of Internal Medicine · doi:10.7326/0003-4819-105-3-429 · Cited by 416
Munhoz Junior, E. (2006) · Epidemiologia e Serviços de Saúde · doi:10.5123/s1679-49742006000100002 · Cited by 416
Encyclopedia of Statistics in Behavioral Science
(2006) · Reference Reviews · doi:10.1108/09504120610664123 · Cited by 415
The testing of statistical hypotheses in relation to probabilities a priori
Neyman, J., & Pearson, E. S. (1933) · Mathematical Proceedings of the Cambridge Philosophical Society · doi:10.1017/s030500410001152x · Cited by 412
Some Difficulties of Interpretation Encountered in the Application of the Chi-Square Test
Berkson, J. (1938) · Journal of the American Statistical Association · doi:10.1080/01621459.1938.10502329 · Cited by 411
RESOLVING ECOLOGICAL QUESTIONS THROUGH META-ANALYSIS: GOALS, METRICS, AND MODELS
Osenberg, C. W., Sarnelle, O., Cooper, S. D., & Holt, R. D. (1999) · Ecology · doi:10.1890/0012-9658(1999)080[1105:reqtma]2.0.co;2 · Cited by 403
Tryon, W. W. (2001) · Psychological Methods · doi:10.1037/1082-989x.6.4.371 · Cited by 391
Statistical Inference: A Commentary for the Social and Behavioural Sciences
Oakes, M. W. (1986) · Medical Entomology and Zoology · Cited by 388
Alternatives To Statistical Hypothesis Testing In Ecology: A Guide To Self Teaching
Hobbs, N. T., & Hilborn, R. (2006) · Ecological Applications · doi:10.1890/04-0645 · Cited by 384
The Fisher, Neyman-Pearson Theories of Testing Hypotheses: One Theory or Two?
Lehmann, E. L. (1993) · Journal of the American Statistical Association · doi:10.1080/01621459.1993.10476404 · Cited by 382
Why Isn't Everyone a Bayesian?
Efron, B. (1986) · The American Statistician · doi:10.1080/00031305.1986.10475342 · Cited by 377
Test of Significance for 2 × 2 Contingency Tables
Yates, F. (1984) · Journal of the Royal Statistical Society. Series A (General) · doi:10.2307/2981577 · Cited by 364
Information theory and hypothesis testing: a call for pluralism
STEPHENS, P. A., BUSKIRK, S. W., HAYWARD, G. D., & MARTÍNEZ DEL RIO, C. (2005) · Journal of Applied Ecology · doi:10.1111/j.1365-2664.2005.01002.x · Cited by 360
Could Fisher, Jeffreys and Neyman Have Agreed on Testing?
Berger, J. O. (2003) · Statistical Science · doi:10.1214/ss/1056397485 · Cited by 346
On Hypothesis Testing in Ecology and Evolution
Quinn, J. F., & Dunham, A. E. (1983) · The American Naturalist · doi:10.1086/284161 · Cited by 338
Ecological Communities: Conceptual Issues and the Evidence
(1984) · Princeton University Press eBooks · doi:10.1515/9781400857081 · Cited by 333
Probability Theory and Statistical Inference: Econometric Modeling with Observational Data
Spanos, A. (1984) · Cambridge University Press eBooks · doi:10.1017/cbo9780511754081 · Cited by 328
On the origins of the .05 level of statistical significance.
Cowles, M., & Davis, C. (1982) · American Psychologist · doi:10.1037/0003-066x.37.5.553 · Cited by 323
Needed: A Ban on the Significance Test
Hunter, J. E. (1997) · Psychological Science · doi:10.1111/j.1467-9280.1997.tb00534.x · Cited by 314
Savage, I. R. (1957) · Journal of the American Statistical Association · doi:10.1080/01621459.1957.10501392 · Cited by 303
Statistical Methods in Agriculture and Experimental Biology
Mead, R., & Curnow, R. N. (1983) · Springer eBooks · doi:10.1007/978-1-4899-2951-8 · Cited by 294
Confusion Over Measures of Evidence (p's) Versus Errors (α's) in Classical Statistical Testing
Hubbard, R., & Bayarri, M. J. (2003) · The American Statistician · doi:10.1198/0003130031856 · Cited by 287
Null Versus Neutral Models: What's The Difference?
Gotelli, N. J., & McGill, B. J. (2006) · Ecography · doi:10.1111/j.2006.0906-7590.04714.x · Cited by 284
Null hypothesis significance testing: On the survival of a flawed method.
Krueger, J. (2001) · American Psychologist · doi:10.1037//0003-066x.56.1.16 · Cited by 282
Significance Tests Die Hard: The Amazing Persistence of a Probabilistic Misconception
Falk, R., & Greenbaum, C. W. (1995) · Theory & Psychology · doi:10.1177/0959354395051004 · Cited by 279 · cited 1×
“…on P values by researchers, many critics (e.g. Rozeboom 1960, 1997, Carver 1978, 1993, Guttman 1985, Oakes 1986, Shaver 1993, Cohen 1994, Falk & Greenbaum 1995, Schmidt 1996, Hunter 1997, Schmidt & Hunter 1997, Royall 1997, Nix & Barnette 1998, Johnson 1999, Anderson et al. 2000,…”
BackgroundEffect Size in Ecological Experiments: The Application of Biological Models in Meta‐Analysis
Osenberg, C. W., Sarnelle, O., & Cooper, S. D. (1997) · The American Naturalist · doi:10.1086/286095 · Cited by 278
Severe Testing as a Basic Concept in a Neyman–Pearson Philosophy of Induction
Mayo, D. G., & Spanos, A. (2006) · The British Journal for the Philosophy of Science · doi:10.1093/bjps/axl003 · Cited by 270
Venn, J. (1964) · Biometrika · doi:10.2307/2334241 · Cited by 267
The Foundations of Statistical Inference.
Welch, B. L., & Savage, L. G. (1963) · Journal of the Royal Statistical Society. Series A (General) · doi:10.2307/2982459 · Cited by 266
Tippett, L. H. C. (1931) · Cited by 254
Beyond the confidence interval.
Poole, C. (1987) · American Journal of Public Health · doi:10.2105/ajph.77.2.195 · Cited by 253
Statistics with Confidence (2nd ed.)
Cleary, R. J. (2003) · The American Statistician · Cited by 250
Frick, R. W. (1995) · Memory & Cognition · doi:10.3758/bf03210562 · Cited by 249
Jaccard, J., & Guilamo-Ramos, V. (2002) · Journal of Clinical Child & Adolescent Psychology · doi:10.1207/s15374424jccp3101_15 · Cited by 248
Discussion: Should Ecologists Become Bayesians?
Dennis, B. (1996) · Ecological Applications · doi:10.2307/2269594 · Cited by 244
Fidler, F., Thomason, N., Cumming, G., Finch, S., & Leeman, J. (2004) · Psychological Science · doi:10.1111/j.0963-7214.2004.01502008.x · Cited by 244
ON THE ERROR OF COUNTING WITH A HAEMACYTOMETER
STUDENT (1907) · Biometrika · doi:10.1093/biomet/5.3.351 · Cited by 243
Urdan, T. C. (2001) · Psychology Press eBooks · doi:10.4324/9781410612496 · Cited by 242
Foundations of Probability Theory, Statistical Inference, and Statistical Theories of Science
(1976) · Springer eBooks · doi:10.1007/978-94-010-1436-6 · Cited by 238
Cognition as Intuitive Statistics
Massaro, D. W., Gigerenzer, G., & Murray, D. J. (1988) · The American Journal of Psychology · doi:10.2307/1422845 · Cited by 234
Frequentist probability and frequentist statistics
Neyman, J. (1977) · Synthese · doi:10.1007/bf00485695 · Cited by 230
Statistics: Methods and Applications.
Scheuer, E. M., & Griffin, J. I. (1963) · The American Mathematical Monthly · doi:10.2307/2312922 · Cited by 229
P-Values: Interpretation and Methodology
Gibbons, J. D., & Pratt, J. W. (1975) · The American Statistician · doi:10.1080/00031305.1975.10479106 · Cited by 228
The appropriate use of null hypothesis testing.
Frick, R. W. (1996) · Psychological Methods · doi:10.1037//1082-989x.1.4.379 · Cited by 222
The Fisher, Neyman-Peerson Theories of Testing Hypotheses: One Theory or Two?
Lehmann, E. L. (2012) · Selected Works of E. L. Lehmann · doi:10.1007/978-1-4614-1412-4_19 · Cited by 220
Rationality in psychological research: The good-enough principle.
Serlin, R. C., & Lapsley, D. K. (1985) · American Psychologist · doi:10.1037//0003-066x.40.1.73 · Cited by 217
Henkel, R. (1976) · Sage eBooks · doi:10.4135/9781412986113 · Cited by 217
Directional statistical decisions.
Kaiser, H. F. (1960) · Psychological Review · doi:10.1037/h0047595 · Cited by 212
First Course in Probability and Statistics
Peterson, W. H., & Neyman, J. (1951) · Southern Economic Journal · doi:10.2307/1053927 · Cited by 209
How to Report Statistics in Medicine: Annotated Guidelines for Authors
Lang, T. A., & Secic, M. (1997) · The Nurse Practitioner · doi:10.1097/00006205-199705000-00022 · Cited by 209
The Null Ritual: What You Always Wanted to Know About Significance Testing but Were Afraid to Ask
Gigerenzer, G., Krauss, S., & Vitouch, O. (2004) · The SAGE Handbook of Quantitative Methodology for the Social Sciences · doi:10.4135/9781412986311.n21 · Cited by 205
The Superego, the Ego, and the Id in Statistical Reasoning
Gigerenzer, G. (2002) · Adaptive Thinking · doi:10.1093/acprof:oso/9780195153729.003.0013 · Cited by 203
Pearce, J. (1989) · Journal of Neurology, Neurosurgery & Psychiatry · doi:10.1136/jnnp.52.11.1314 · Cited by 202
The Religion of Statistics as Practiced in Medical Journals
Salsburg, D. S. (1985) · The American Statistician · doi:10.1080/00031305.1985.10479435 · Cited by 197
What Statistical Significance Testing Is, and What It Is Not
Shaver, J. P. (1993) · The Journal of Experimental Education · doi:10.1080/00220973.1993.10806592 · Cited by 196
commentary and analysis: The Insignificance of Significance Testing
Nicholls, N. (2001) · Bulletin of the American Meteorological Society · Cited by 195
Tukey, J. W. (1960) · Technometrics · doi:10.1080/00401706.1960.10489909 · Cited by 194
Savage, L. J. (1976) · The Annals of Statistics · doi:10.1214/aos/1176343456 · Cited by 193
In praise of the null hypothesis statistical test.
Hagen, R. L. (1997) · American Psychologist · doi:10.1037//0003-066x.52.1.15 · Cited by 193
The Place of Statistics in Psychology
Nunnally, J. (1960) · Educational and Psychological Measurement · doi:10.1177/001316446002000401 · Cited by 189
Graham, M. H., & Edwards, M. S. (2001) · Oikos · doi:10.1034/j.1600-0706.2001.930317.x · Cited by 186
On the Foundations of Statistical Inference: Discussion
Savage, L. J., Barnard, G., Cornfield, J., Bross, I., Box, G. E. P., Good, I. J., Lindley, D. V., Clunies-Ross, C. W., Pratt, J. W., Levene, H., et al. (1962) · Journal of the American Statistical Association · doi:10.2307/2281641 · Cited by 183
Anscombe, F. J. (1961) · Project Euclid (Cornell University) · Cited by 177
Concerns regarding a call for pluralism of information theory and hypothesis testing
LUKACS, P. M., THOMPSON, W. L., KENDALL, W. L., GOULD, W. R., DOHERTY, P. F., BURNHAM, K. P., & ANDERSON, D. R. (2007) · Journal of Applied Ecology · doi:10.1111/j.1365-2664.2006.01267.x · Cited by 176
Tests of Significance Considered as Evidence
Berkson, J. (1942) · Journal of the American Statistical Association · doi:10.2307/2279000 · Cited by 174
Statistics: Concepts and Controversies.
Wooff, D., & Moore, D. S. (1993) · The Statistician · doi:10.2307/2349000 · Cited by 173
How to report statistics in medicine
Lang, T., & Secic, M. (2017) · Journal of Neurology & Neurophysiology · Cited by 171
Scientific Method for Ecological Research
Ford, E. D. (2000) · Cambridge University Press eBooks · doi:10.1017/cbo9780511612558 · Cited by 169
Testing the null hypothesis and the strategy and tactics of investigating theoretical models.
Grant, D. A. (1962) · Psychological Review · doi:10.1037/h0038813 · Cited by 169
The Counternull Value of an Effect Size: A New Statistic
Rosenthal, R., & Rubin, D. B. (1994) · Psychological Science · doi:10.1111/j.1467-9280.1994.tb00281.x · Cited by 168
SCHWEDER, T., & HJORT, N. L. (2002) · Scandinavian Journal of Statistics · doi:10.1111/1467-9469.00285 · Cited by 167
On the logic and purpose of significance testing.
Cortina, J. M., & Dunlap, W. P. (1997) · Psychological Methods · doi:10.1037/1082-989x.2.2.161 · Cited by 166 · cited 2×
“…H 1 as with H 0 and is grounds only for indecision or suspension of judgment with respect to the truth of H 0 (Fisher 1925, Tukey 1960, 1991, Kalbfleisch & Sprott 1976, Oakes 1986: 31, Abelson 1995, Cortina & Dunlap 1997, Harris 1997a, 1997b, Nickerson 2000, Tryon 2001, Lombardi & Hurlbert 2009).”
BackgroundKline, R. B. (2004) · Cited by 157
On the probability of making Type I errors.
Pollard, P., & Richardson, J. T. E. (1987) · Psychological Bulletin · doi:10.1037/0033-2909.102.1.159 · Cited by 155
Three criteria for the use of one-tailed tests.
Kimmel, H. D. (1957) · Psychological Bulletin · doi:10.1037/h0046737 · Cited by 155
Yates, F. (1951) · Journal of the American Statistical Association · doi:10.1080/01621459.1951.10500764 · Cited by 154
Misuse of statistical tests in three decades of psychotherapy research.
Dar, R., Serlin, R. C., & Omer, H. (1994) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.62.1.75 · Cited by 152
A Critical Assessment of Null Hypothesis Significance Testing in Quantitative Communication Research
Levine, T. R., Weber, R., Hullett, C. R., Park, H. S., & Lindsey, L. L. M. (2008) · Human Communication Research · doi:10.1111/j.1468-2958.2008.00317.x · Cited by 149
Fidler, F. M., Burgman, M. A., Cumming, G., Buttrose, R., & Thomason, N. R. (2006) · Conservation Biology · doi:10.1111/j.1523-1739.2006.00525.x · Cited by 147
Rutledge, T., & Loh, C. (2004) · Annals of Behavioral Medicine · doi:10.1207/s15324796abm2702_9 · Cited by 144
Howard, G., Maxwell, S., & Fleming, K. J. (2000) · Psychological methods · doi:10.1037/1082-989x.5.3.315 · Cited by 141
Reid, C. (1982) · Springer eBooks · doi:10.1007/978-1-4612-5754-7 · Cited by 140
Reporting Practices and APA Editorial Policies Regarding Statistical Significance and Effect Size
Vacha-haase, T., Nilsson, J. E., Reetz, D. R., Lance, T. S., & Thompson, B. (2000) · Theory & Psychology · doi:10.1177/0959354300103006 · Cited by 138
Statistical Significance: Rationale, Validity and Utility
Nayak, T. K., & Chow, S. L. (1998) · Technometrics · doi:10.2307/1270661 · Cited by 136
Testing Fisher, Neyman, Pearson, and Bayes
Christensen, R. (2005) · The American Statistician · doi:10.1198/000313005x20871 · Cited by 133
Handbook of the Philosophy of Science
(2008) · Elsevier eBooks · doi:10.1016/b978-0-444-51726-5.50026-1 · Cited by 127
Models and Statistical Inference: The Controversy between Fisher and Neyman–Pearson
Lenhard, J. (2006) · The British Journal for the Philosophy of Science · doi:10.1093/bjps/axi152 · Cited by 123
Statistical Reform in Psychology: Is Anything Changing?
Cumming, G., Fidler, F., Leonard, M., Kalinowski, P., Christiansen, A., Kleinig, A., Lo, J., McMenamin, N., & Wilson, S. (2007) · Psychological Science · doi:10.1111/j.1467-9280.2007.01881.x · Cited by 122
The 1988 Wald Memorial Lectures: The Present Position in Bayesian Statistics
Lindley, D. V. (1990) · Statistical Science · doi:10.1214/ss/1177012253 · Cited by 122
A confidence interval approach to data analysis
Stefano, J. D. (2003) · Forest Ecology and Management · doi:10.1016/s0378-1127(03)00331-1 · Cited by 118
Ronald Aylmer Fisher, 1890-1962
Yates, F., Yates, F., Mather, K., & Mather, K. (1963) · Biographical Memoirs of Fellows of the Royal Society · doi:10.1098/rsbm.1963.0006 · Cited by 113
Effect magnitude: A different focus
Kirk, R. E. (2006) · Journal of Statistical Planning and Inference · doi:10.1016/j.jspi.2006.09.011 · Cited by 111
Melton, A. W. (1962) · Journal of Experimental Psychology · doi:10.1037/h0045549 · Cited by 111
The illogic of statistical inference for cumulative science
Guttman, L. (1985) · Applied Stochastic Models and Data Analysis · doi:10.1002/asm.3150010103 · Cited by 109
Strong, D. R. (1980) · Synthese · doi:10.1007/bf00413928 · Cited by 108
Sampling and Statistical Methods for Behavioral Ecologists
Bart, J. R., Fligner, M. A., & Notz, W. I. (1998) · Cambridge University Press eBooks · doi:10.1017/cbo9780511612572 · Cited by 107
Fidler, F. M. (2002) · Educational and Psychological Measurement · doi:10.1177/001316402236876 · Cited by 107
Strong, D. R. (1982) · Springer eBooks · doi:10.1007/978-94-009-7796-9_10 · Cited by 106
The Role of Statistical Significance Testing In Educational Research
McLean, J. E., & Ernest, J. M. (1998) · Cited by 105
Birnbaum, A. (1977) · Synthese · doi:10.1007/bf00485690 · Cited by 104
Statistical reform in medicine, psychology and ecology
Fidler, F. M., Cumming, G., Burgman, M. A., & Thomason, N. R. (2004) · The Journal of Socio-Economics · doi:10.1016/j.socec.2004.09.035 · Cited by 102
A Communication Researchers’ Guide to Null Hypothesis Significance Testing and Alternatives
Levine, T. R., Weber, R., Park, H. S., & Hullett, C. R. (2008) · Human Communication Research · doi:10.1111/j.1468-2958.2008.00318.x · Cited by 102
What Should We Do about Hypothesis Testing?
Eberhardt, L. L. (2003) · Journal of Wildlife Management · doi:10.2307/3802765 · Cited by 96
Misprescription and misuse of one-tailed tests
LOMBARDI, C. M., & HURLBERT, S. H. (2009) · Austral Ecology · doi:10.1111/j.1442-9993.2009.01946.x · Cited by 93
Self-citationError Statistics and Learning From Error: Making a Virtue of Necessity
Mayo, D. G. (1997) · Philosophy of Science · doi:10.1086/392600 · Cited by 93
The Data Analysis Dilemma: Ban or Abandon. A Review of Null Hypothesis Significance Testing.
Nix, T. W., & Barnette, J. J. (1998) · Cited by 93
Daniel, L. G. (1998) · Research in the schools · Cited by 93
Statistical Concepts in Their Relation to Reality
Pearson, E. S. (1955) · Journal of the Royal Statistical Society Series B (Statistical Methodology) · doi:10.1111/j.2517-6161.1955.tb00194.x · Cited by 92
Directional decisions for two-tailed tests: Power, error rates, and sample size.
Leventhal, L., & Huynh, C. (1996) · Psychological Methods · doi:10.1037/1082-989x.1.3.278 · Cited by 89
Cited by
Statistical tests, P values, confidence intervals, and power: a guide to misinterpretations
Greenland, S., Senn, S. J., Rothman, K. J., Carlin, J. B., Poole, C., Goodman, S. N., & Altman, D. G. (2016) · European Journal of Epidemiology · doi:10.1007/s10654-016-0149-3 · Cited by 3,200
Microbial formation of stable soil carbon is more efficient from belowground than aboveground input
Sokol, N. W., & Bradford, M. A. (2019) · Nature Geoscience · doi:10.1038/s41561-018-0258-6 · Cited by 891
Abandon Statistical Significance
McShane, B. B., Gal, D., Gelman, A., Robert, C., & Tackett, J. L. (2019) · The American Statistician · doi:10.1080/00031305.2018.1527253 · Cited by 791
Sokol, N. W., Kuebbing, S. E., Karlsen‐Ayala, E., & Bradford, M. A. (2019) · New Phytologist · doi:10.1111/nph.15361 · Cited by 631
Amrhein, V., Trafimow, D., & Greenland, S. (2019) · The American Statistician · doi:10.1080/00031305.2018.1543137 · Cited by 425
Metadata
- Authors
- Hurlbert, S. H., & Lombardi, C. M.
- Venue
- Annales Zoologici Fennici
- Published
- 2009-10
- Volume
- 46
- Issue
- 5
- Pages
- 311-349
- ISSN
- 0003-455X (ISSN-L)
- 1797-2450
- OpenAlex
- W2120312320
- Cited by
- 301
- References
- 274
- FWCI
- 8.20
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.