The DOI matches its Crossref record; 196 of the 197 references it cites were found in a registry or an index.
When Null Hypothesis Significance Testing Is Unsuitable for Research: A Reassessment
Open accessPublished version of a preprint
Abstract
Null hypothesis significance testing (NHST) has several shortcomings that are likely contributing factors behind the widely debated replication crisis of (cognitive) neuroscience, psychology, and biomedical science in general. We review these shortcomings and suggest that, after sustained negative experience, NHST should no longer be the default, dominant statistical practice of all biomedical and psychological research. If theoretical predictions are weak we should not rely on all or nothing hypothesis tests. Different inferential methods may be most suitable for different types of research questions. Whenever researchers use NHST they should justify its use, and publish pre-study power calculations and effect sizes, including negative findings. Hypothesis-testing studies should be pre-registered and optimally raw data published. The current statistics lite educational approach for students that has sustained the widespread, spurious use of NHST should be phased out.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“In cases where complications arise it can be extremely useful to analyse the data with multiple methods to test the robustness of conclusions24,126.”
From A phylogenetic approach to comparative genomics (2025) · cites this paper as [126]
Experimental — accuracy not yet measuredIn the citing paper
“The use of statistical methods has been demonstrated to be suboptimal in some fields.”
From How to design preclinical studies in nanomedicine and cell therapy to maximize the prospects of clinical translation (2018) · cites this paper as [19]
In the citing paper
“Major threats that have high prevalence include the misuse and misinterpretation of null-hypothesis testing methods19,20”
From How to design preclinical studies in nanomedicine and cell therapy to maximize the prospects of clinical translation (2018) · cites this paper as [19]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing
Benjamini, Y., & Hochberg, Y. (1995) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1995.tb02031.x · Cited by 109,482
Gelman, A., Carlin, J. B., Stern, H. S., & Rubin, D. B. (2003) · doi:10.1201/9780429258480 · Cited by 27,276
(1988) · Cited by 16,582
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · PLoS Medicine · doi:10.1371/journal.pmed.0020124 · Cited by 10,505
Self-citationThe control of the false discovery rate in multiple testing under dependency
Benjamini, Y., & Yekutieli, D. (2001) · The Annals of Statistics · doi:10.1214/aos/1013699998 · Cited by 10,490
Statistical significance for genomewide studies
Storey, J. D., & Tibshirani, R. (2003) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1530509100 · Cited by 9,692
Estimating the reproducibility of psychological science
Open Science Collaboration (2015) · Science · doi:10.1126/science.aac4716 · Cited by 8,515 · cited 2×
“, 2014) are in a crisis of producing too many false positive non-replicable results (Begley and Ellis, 2012; Aarts et al., 2015).”
BackgroundStatistical Decision Theory and Bayesian Analysis
Berger, J. O. (1985) · Springer Series in Statistics · doi:10.1007/978-1-4757-4286-2 · Cited by 7,722
Power failure: why small sample size undermines the reliability of neuroscience
Button, K. S., Ioannidis, J. P. A., Mokrysz, C., Nosek, B. A., Flint, J., Robinson, E. S. J., & Munafò, M. R. (2013) · Nature Reviews Neuroscience · doi:10.1038/nrn3475 · Cited by 7,641 · cited 6×
“While power in principle can be adjusted easily by increasing sample size, power in many/most fields of biomedical science and psychology has been notoriously low and the situation has not improved much during the past 50 years (Cohen, 1962; Sedlmeier and Gigerenzer, 1989; Rossi, 1990; Hallahan and Rosenthal, 1996; Bu…”
BackgroundInfluentialSelf-citationSimmons, J. P., Nelson, L. D., & Simonsohn, U. (2011) · Psychological Science · doi:10.1177/0956797611417632 · Cited by 6,567
Flagged first, then by citations
1 of the 197 references couldn’t be matched to a known paper.
Research works printed but not linked: 5
- Chaisson, 2017, Astronomy Today
- Cohen, 1988, Statistical Power Analysis for the Behavioural Sciences
- Fisher, 1925, Statistical Methods for Research Workers, First Edition.
- Jeffreys, The Theory of Probability.
- Smolin, 2006, The Trouble with Physics
Cited by
Sorted by citations
Items 101–200 of 298
Nuzzo, J. L., Pinto, M. D., & Nosaka, K. (2023) · European Journal of Applied Physiology · doi:10.1007/s00421-023-05157-9 · Cited by 14
Null regions: a unified conceptual framework for statistical inference
Smiley, A. H., Glazier, J. J., & Shoda, Y. (2023) · Royal Society Open Science · doi:10.1098/rsos.221328 · Cited by 18
Smith, P. F. (2017) · PubMed Central · Cited by 14
Mattsson, M., Simkó, M., & Foster, K. R. (2021) · Frontiers in Communications and Networks · doi:10.3389/frcmn.2021.724772 · Cited by 13
Eichhorn, T., Weiss, R., Huber, S., Ebeyer-Masotta, M., Mostageer, M., Emprechtinger, R., Knabl, L., Knabl, L., Würzner, R., & Weber, V. (2023) · International Journal of Molecular Sciences · doi:10.3390/ijms242316886 · Cited by 14
An exploration of knowledge‐organizing technologies to advance transdisciplinary back pain research
Lotz, J. C., Ropella, G. E. P., Anderson, P., Yang, Q., Hedderich, M. A., Bailey, J. F., & Hunt, C. A. (2023) · JOR Spine · doi:10.1002/jsp2.1300 · Cited by 13
Koscelny, S. N., Sadralashrafi, S., & Neyens, D. M. (2025) · Applied Ergonomics · doi:10.1016/j.apergo.2025.104515 · Cited by 15
An Uncertainty-Driven GCN Refinement Strategy for Organ Segmentation
Soberanis-Mukul, R. D., Navab, N., & Albarqouni, S. (2020) · The Journal of Machine Learning for Biomedical Imaging · doi:10.59275/j.melba.2020-8e2b · Cited by 13
Predicting the Significance of Necessity
Sorjonen, K., & Melin, B. (2019) · Frontiers in Psychology · doi:10.3389/fpsyg.2019.00283 · Cited by 13
A Systems Approach to Understanding and Improving Research Integrity
Gorman, D. M., Elkins, A. D., & Lawley, M. (2017) · Science and Engineering Ethics · doi:10.1007/s11948-017-9986-z · Cited by 14
Prediction and inference diverge in biomedicine: Simulations and real-world dataPreprint
Bzdok, D., Engemann, D. A., Grisel, O., Varoquaux, G. P., & Thirion, B. (2018) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/327437 · Cited by 12
Mirzayi, C. A., Renson, A., Zohra, F., Elsafoury, S., Geistlinger, L., Kasselman, L., Eckenrode, K., van de Wijgert, J. H. H. M., Loughman, A., Marques, F. Z., et al. (2020) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2020.06.24.167353 · Cited by 12
Esterhuizen, T. M., Mbuagbaw, L. C. E., Rehman, N., Yanwou, N., Swaby, D. J., Kittle, E., Licht, J.-C., & Thabane, L. (2025) · BMJ Open · doi:10.1136/bmjopen-2025-100411 · Cited by 12
Recommendations to improve use and reporting of statistics in animal experiments
Rowe, A. (2022) · Laboratory Animals · doi:10.1177/00236772221140669 · Cited by 11
Bramhall, N. F., Theodoroff, S. M., McMillan, G. P., Kampel, S. D., & Buran, B. N. (2023) · Journal of Speech Language and Hearing Research · doi:10.1044/2023_jslhr-23-00234 · Cited by 11
van Rentergem, J. A. A., & Schagen, S. B. (2025) · The Clinical Neuropsychologist · doi:10.1080/13854046.2025.2453079 · Cited by 11
Interpretation of and alternatives to p-values in biomedical sciences
Grjibovski, A. M., & Gvozdeckii, A. N. (2022) · Экология человека · doi:10.17816/humeco97249 · Cited by 11
Masharipov, R. S., Knyazeva, I., Nikolaev, Y., Korotkov, A. D., Didur, M., Cherednichenko, D. V., & Kireev, M. V. (2021) · Frontiers in Neuroinformatics · doi:10.3389/fninf.2021.738342 · Cited by 12
Noise Reduction in EEG Signals using Convolutional Autoencoding Techniques
Hanrahan, C. (2019) · Arrow - TU Dublin (Technological University Dublin) · Cited by 11
Leszczyński, D. (2022) · Reviews on Environmental Health · doi:10.1515/reveh-2022-0108 · Cited by 10
How Do Basic Personality Traits Map Onto Moral Judgments of Fairness-Related Actions?
Andrejević, M., Smillie, L. D., Feuerriegel, D., Turner, W., Laham, S. M., & Bode, S. (2021) · Social Psychological and Personality Science · doi:10.1177/19485506211038295 · Cited by 11
Clinical vs. statistical significance: considerations for clinical laboratories
Hakan, H., Tran, M. T. C., Markus, C., Ho, C. S., Loh, T. P., Zakaria, R., Cooke, B. R., Theodorsson, E., & Greaves, R. F. (2025) · Clinical Chemistry and Laboratory Medicine (CCLM) · doi:10.1515/cclm-2025-0219 · Cited by 10
The relationship between anger and suicidal ideation: Investigations in two samples
Schafer, K. M., Daurio, A. M., French, J. E., Rogers, M. L., Meltzer, A. L., Cougle, J. R., & Joiner, T. E. (2022) · Journal of Clinical Psychology · doi:10.1002/jclp.23331 · Cited by 9
Pang, R. Y., Reinecke, K., & Just, R. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3517707 · Cited by 10
The Problem of Irreproducible Bioscience Research
Flier, J. S. (2022) · Perspectives in biology and medicine · doi:10.1353/pbm.2022.0032 · Cited by 10
A Numerical Investigation of Rider Injury Risks During Falls Caused by E-Scooter–Stopper Impacts
Chontos, R., Grindle, D. M., Untăroiu, A., Doerzaph, Z. R., & Untaroiu, C. D. (2023) · Journal of Biomechanical Engineering · doi:10.1115/1.4062847 · Cited by 9
Statistical considerations (or recommendations) for publishing in Science and Medicine in Football
Impellizzeri, F. M., Meyer, T., & Wagenpfeil, S. (2019) · Science and Medicine in Football · doi:10.1080/24733938.2018.1563993 · Cited by 9
The Importance of Clinical Relevance and the Limitations of P-Values in Plastic Surgery Research
Karamitros, G., Johnson, J., Gergoudis, F. R., Giannas, E. (., Torres-Guzman, R. A., Lamaris, G. A., & Lineaweaver, W. C. (2026) · Annals of Plastic Surgery · doi:10.1097/sap.0000000000004738 · Cited by 10
Esterhuizen, T. M., Mbuagbaw, L. C. E., & Thabane, L. (2024) · BMJ Open · doi:10.1136/bmjopen-2024-084375 · Cited by 8
Yuan, S., Humphris, G. M., Ross, A. J., Macpherson, L. M. D., Zhou, Y., & Freeman, R. (2018) · Pilot and Feasibility Studies · doi:10.1186/s40814-018-0331-3 · Cited by 8
NHST is still logically flawed
Schneider, J. (2018) · Scientometrics · doi:10.1007/s11192-018-2655-4 · Cited by 10
Quatto, P., Ripamonti, E., & Marasini, D. (2019) · Journal of Biopharmaceutical Statistics · doi:10.1080/10543406.2019.1632874 · Cited by 8
Current and Future Global Challenges in Management and Leadership: Finance and Quantum Computing
Casati, N. M. (2019) · Springer eBooks · doi:10.1007/978-3-030-29710-7_6 · Cited by 7
Päll, T., Luidalepp, H., Tenson, T., & Maiväli, Ü. (2023) · PLoS Biology · doi:10.1371/journal.pbio.3002007 · Cited by 8
Generalization of auditory expertise in audio engineers and instrumental musicians
Caprini, F., Zhao, S., Maria Chait, A., Agus, T. R., Pomper, U., Tierney, A. T., & Dick, F. (2023) · Cognition · doi:10.1016/j.cognition.2023.105696 · Cited by 8
Bleakley, C., Reijgers, J., & Smoliga, J. M. (2020) · Journal of Orthopaedic and Sports Physical Therapy · doi:10.2519/jospt.2020.9264 · Cited by 7
Statistics education in undergraduate psychology: A survey of UK curriculaPreprint
TARG Meta-Research Group (2020) · doi:10.31234/osf.io/jv8x3 · Cited by 7
A Practical Guide to Bayesian Statistics in Laboratory Medicine
Wilkes, E. H. (2022) · Clinical Chemistry · doi:10.1093/clinchem/hvac049 · Cited by 7
Douven, I. (2023) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2023.102794 · Cited by 7
After p Values: The New Statistics for Undergraduate Neuroscience Education.
Calin-Jageman, R. J. (2017) · PubMed Central · Cited by 6
Decisions with Confidence: Application to the Conformation Sampling of Molecules in the Solid State
Hawkins, P. C. D., & Wlodek, S. T. (2020) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.0c00358 · Cited by 6
Retrospective Bayesian Evidence of Null Effect in Two Decades of Alzheimer’s Disease Clinical Trials
Costa, T., Manuello, J., Cauda, F., & Liloia, D. (2022) · Journal of Alzheimer s Disease · doi:10.3233/jad-220942 · Cited by 6
Sullivan, E. A., Zeki, R., Ward, S., Sherwood, J., Rémond, M., Chang, S., Kypri, K., & BROWN, J. J. (2023) · Addiction · doi:10.1111/add.16339 · Cited by 5
Boyle, G. J. (2018) · Journal of Clinical and Translational Research · doi:10.18053/jctres.03.2017s2.005 · Cited by 6
Cognitive function in association with high estradiol levels resulting from fertility treatment
Leeners, B., Krüger, T. H. C., Geraedts, K., Tronci, E., Mancini, T., Ille, F., Egli, M., Röblitz, S., Wunder, D. M., Saleh, L., et al. (2021) · Hormones and Behavior · doi:10.1016/j.yhbeh.2021.104951 · Cited by 7
The Use and Misuse of Classical Statistics: A Primer for Social Workers
Dunleavy, D. J., & Lacasse, J. R. (2021) · Research on Social Work Practice · doi:10.1177/10497315211008247 · Cited by 6
A Formal Framework for Knowledge Acquisition: Going beyond Machine Learning
Hössjer, O., Pachón, D. A. D., & Rao, J. S. (2022) · Entropy · doi:10.3390/e24101469 · Cited by 8
Schmerwitz, C., & Kopp, B. (2024) · Frontiers in Psychology · doi:10.3389/fpsyg.2024.1437192 · Cited by 5
How can we improve statistical training in archaeological science?
Vaiglova, P. (2025) · Journal of Archaeological Science · doi:10.1016/j.jas.2025.106220 · Cited by 8
What is the threshold for a clinical minimally important drug effect?
Hengartner, M. P. (2018) · BMJ Evidence-Based Medicine · doi:10.1136/bmjebm-2018-111056 · Cited by 5
Aggregate context effects in music processing
Schmuckler, M. A., Vuvan, D. T., & Lewandowska, O. P. (2020) · Attention Perception & Psychophysics · doi:10.3758/s13414-020-02003-4 · Cited by 5
Gartlehner, G., Persad, E., Ledinger, D., Chapman, A. L., Gadinger, A., Feyertag, J., & Emprechtinger, R. (2023) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2023.06.007 · Cited by 5
Robinson, D. T., Cloak, R., Lahart, I. M., & Lane, A. M. (2018) · Progress in brain research · doi:10.1016/bs.pbr.2018.09.005 · Cited by 5
Brandwayn, N., Restrepo, D., Martínez, A. M. M., & Acevedo-Triana, C. A. (2019) · Applied Neuropsychology Adult · doi:10.1080/23279095.2019.1566133 · Cited by 5
Social Simulation Models as Refuting Machines
Mauhé, N., Izquierdo, L. R., & Izquierdo, S. S. (2023) · Journal of Artificial Societies and Social Simulation · doi:10.18564/jasss.5076 · Cited by 5
Sabetian, P. W., & Domb, B. G. (2022) · Arthroscopy The Journal of Arthroscopic and Related Surgery · doi:10.1016/j.arthro.2021.10.009 · Cited by 5
Statistics in publishing: the (mis)use of the p -value (Part 2)
Stunt, J. J., Broekstra, D. C., & de Boer, M. R. (2022) · Journal of Hand Surgery (European Volume) · doi:10.1177/17531934221115968 · Cited by 5
Alternative to the statistical mass confusion of testing for “no effect”
Morgan, J. (2025) · The Journal of Cell Biology · doi:10.1083/jcb.202403034 · Cited by 6
Decoding the Narcissistic Brain
Zhou, Z., Huang, C., Robins, E. M., Angus, D. J., Sedikides, C., & Kelley, N. J. (2025) · NeuroImage · doi:10.1016/j.neuroimage.2025.121284 · Cited by 4
SPARC: Statistical Performance Analysis With Relevance Conclusions
Tullos, J. C., Graham, S., Jordan, J. D., & Patel, P. R. (2021) · IEEE Open Journal of the Computer Society · doi:10.1109/ojcs.2021.3060658 · Cited by 4
Gutzen, R., Grün, S., & Denker, M. (2022) · Biosystems · doi:10.1016/j.biosystems.2022.104813 · Cited by 4
If we accept that poor replication rates are mainstream
Alexander, D. M., & Moors, P. (2018) · Behavioral and Brain Sciences · doi:10.1017/s0140525x18000572 · Cited by 4
Kato, T. (2018) · The Japanese Journal of Personality · doi:10.2132/personality.27.2.11 · Cited by 6
Neuroscience Needs to Test Both Statistical and Scientific Hypotheses
Alger, B. E. (2022) · Journal of Neuroscience · doi:10.1523/jneurosci.1134-22.2022 · Cited by 5
A Hitchhiker’s Guide to Working with Large, Open-Source Neuroimaging DatasetsPreprint
Horien, C. L., Noble, S., Greene, A. S., Lee, K., Barron, D. S., Gao, S., O'Connor, D., Salehi, M., Dadashkarimi, J., Shen, X., et al. (2020) · Preprints.org · doi:10.20944/preprints202007.0153.v1 · Cited by 5
Blair, J. P., Tanksley, P. T., Spivey, E. D., & Martaindale, M. H. (2025) · American Journal of Criminal Justice · doi:10.1007/s12103-025-09845-4 · Cited by 3
Recker, J. (2021) · Progress in IS · doi:10.1007/978-3-030-85436-2_5 · Cited by 4
Qin, Y. F., Sheremet, A., Cooper, T. L., Burke, S. N., & Maurer, A. P. (2023) · eNeuro · doi:10.1523/eneuro.0470-21.2023 · Cited by 3
Servitization and firm performance: a p-curve analysis
Latan, H., Jabbour, A. B. L. D. S., Jabbour, C. J. C., Ali, M., & Filho, M. G. (2024) · Journal of Business and Industrial Marketing · doi:10.1108/jbim-07-2023-0392 · Cited by 3
Improving Replication in Endometrial Omics: Understanding the Influence of the Menstrual Cycle
Chung, J., & Rogers, P. A. W. (2025) · International Journal of Molecular Sciences · doi:10.3390/ijms26020857 · Cited by 4
Thakur, P., & Jha, V. (2021) · Brazilian Journal of Otorhinolaryngology · doi:10.1016/j.bjorl.2021.11.004 · Cited by 2
Nostedt, S., & Joffe, A. R. (2022) · Journal of Intensive Care Medicine · doi:10.1177/08850666221077203 · Cited by 3
Sample Size in Behavioral Research: A Systematic Review of JEAB and JABA from 2009 to 2018
Schrimp, A. J., Griffith, J. D., Potoczak, K., Hatvany, T. C., Norwood, A. E. Q., & Conley, A. A. (2022) · Revista Brasileira de Análise do Comportamento · doi:10.18542/rebac.v18i2.13634 · Cited by 3
Vitality and Application of Effect Size for Quality Research
Dhakal, C. P. (2023) · Journal of the Institute of Agriculture and Animal Science · doi:10.3126/jiaas.v37i1.56976 · Cited by 3
Cohen’s convention, the seriousness of errors, and the body of knowledge in behavioral science
Arslan, A., & Zenker, F. (2024) · Synthese · doi:10.1007/s11229-024-04753-2 · Cited by 3
Artificial neural networks for magnetoencephalography: a review of an emerging field
Dehgan, A., Abdelhedi, H., Hadid, V., Rish, I., & Jerbi, K. (2025) · Journal of Neural Engineering · doi:10.1088/1741-2552/addd4a · Cited by 7
Bayes factor benefits for clinical psychology: review of child and adolescent evidence base
Bertelsen, T. B., Hoffart, A., Rekdal, S. S., & Zahl‐Olsen, R. (2022) · F1000Research · doi:10.12688/f1000research.76842.2 · Cited by 3
Működési zavarok és megújulási törekvések a tudományos pszichológiában, a 21. század elején
Szokolszky, Á. (2018) · Magyar Pszichológiai Szemle · doi:10.1556/0016.2018.73.4.3 · Cited by 3
Spicer, R. C. (2020) · Journal of the Air & Waste Management Association · doi:10.1080/10962247.2020.1768966 · Cited by 3
Number of participants required for common designs in psychology: A power analysisPreprint
Brysbaert, M. (2018) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/2v4yx · Cited by 3
Significance Testing in Natural and Biological Systems: A ReviewPreprint
Kak, S. C. (2021) · doi:10.36227/techrxiv.14599836.v1 · Cited by 3
de Koning, J. J., & Noordhof, D. A. (2019) · International Journal of Sports Physiology and Performance · doi:10.1123/ijspp.2019-0419 · Cited by 3
Updated guidelines for the reporting of methods and statistical analyses
Sedgwick, P. M. (2023) · Acta Obstetricia Et Gynecologica Scandinavica · doi:10.1111/aogs.14760 · Cited by 3
Clinical reasoning, medical error, and treatment failure
Putman, H. P. (2025) · Current research in psychiatry · doi:10.46439/psychiatry.5.036 · Cited by 2
Exploratory Statistical Analysis of Precursors to Moderate Earthquakes in Japan
Konishi, T. (2025) · GeoHazards · doi:10.3390/geohazards6040082 · Cited by 2
Untested Assumptions and Tenuous Evidence: A Critique of the Dual-Process Account of Moral Judgment
Quinlan, P. T., & Cohen, D. J. (2025) · Behavioral Sciences · doi:10.3390/bs16010020 · Cited by 4
Bayes’ Theorem in Neurocritical Care: Principles and Practice
Jawa, N. A., & Maslove, D. M. (2023) · Neurocritical Care · doi:10.1007/s12028-022-01665-2 · Cited by 2
How robust are clinical trials in primary and secondary ankle sprain prevention?
Bleakley, C., Wagemans, J., Schurz, A. P., & Smoliga, J. M. (2023) · Physical Therapy in Sport · doi:10.1016/j.ptsp.2023.08.005 · Cited by 2
Le rouge, le noir, et l'inégalité: tax policy and inequality in the European Union
Chen, J. M., Šimurina, N., & Solenički, M. (2024) · Frontiers in Applied Mathematics and Statistics · doi:10.3389/fams.2023.1282975 · Cited by 2
Kelly, C., Munro, K. J., Visram, A. S., Jones, L., Chilton, H., & Armitage, C. J. (2024) · International Journal of Audiology · doi:10.1080/14992027.2024.2358428 · Cited by 2
Sequential analysis of variance: Increasing efficiency of hypothesis testing.
Snijder-Steinhilber, M., Schnuerch, M., & Schubert, A. (2024) · Psychological Methods · doi:10.1037/met0000677 · Cited by 2
Trends in null hypothesis significance testing: Still going strong
Emmert‐Streib, F. (2024) · Heliyon · doi:10.1016/j.heliyon.2024.e40133 · Cited by 5
A logical framework for data-driven reasoning
Baldi, P., Corsi, E. A., & Hosni, H. (2024) · Logic Journal of IGPL · doi:10.1093/jigpal/jzae113 · Cited by 2
Lindsay, R. M. (2025) · Advances in management accounting · doi:10.1108/s1474-787120250000037001 · Cited by 3
Ganesha, H. R., & Aithal, P. S. (2022) · International Journal of Management Technology and Social Sciences · doi:10.47992/ijmts.2581.6012.0236 · Cited by 2
Reynolds, J. J. (2021) · Teaching of Psychology · doi:10.1177/00986283211022390 · Cited by 2
Publication Policies for Replicable Research and the Community-Wide False Discovery Rate
Habiger, J., & Liang, Y. (2021) · The American Statistician · doi:10.1080/00031305.2021.1999857 · Cited by 2
Recommendations for reporting statistical results when comparing proportions
Vrbin, C. M. (2022) · Cytopathology · doi:10.1111/cyt.13083 · Cited by 2
Preferential reporting of significant p-values in radiology journal abstracts
To, M.-S., Lu, L., Tran, M. A., & Chong, C. (2022) · Clinical Radiology · doi:10.1016/j.crad.2022.05.025 · Cited by 2
A strong alcoholic drink does not influence self-assessments of the big five personality traits
Paruzel‐Czachura, M., Sorokowska, A., Bianga, P., Sorokowski, P., & Gosling, S. D. (2022) · Current Psychology · doi:10.1007/s12144-022-04015-9 · Cited by 2
Metadata
- Authors
- Szucs, D., & Ioannidis, J. P. A.
- Affiliations
- Stanford Medicine (US)
- Venue
- Frontiers in Human Neuroscience
- Publisher
- Frontiers Media SA
- Published
- 2017-08-03
- Volume
- 11
- Pages
- 390-390
- ISSN
- 1662-5161 (ISSN-L)
- PMC
- PMC5540883
- OpenAlex
- W2951307730
- Cited by
- 298
- References
- 197
- Citations by year
- 2026: 18 · 2025: 28 · 2024: 21 · 2023: 34 · 2022: 44 · 2021: 31 · 2020: 48 · 2019: 39 · 2018: 29 · 2017: 6
- FWCI
- 6.14
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- Frontiers in Human Neuroscience (publishedVersion, cc-by)
- bioRxiv (Cold Spring Harbor Laboratory) (acceptedVersion, cc-by-nc-nd)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Apollo (University of Cambridge) (submittedVersion, cc-by)
- Apollo (cc-by)
- Funders
- James S. McDonnell Foundation (220020370)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Mathematics › Statistics and Probability › Statistics Education and Methodologies
- Keywords
- null hypothesis significance testing, replication crisis, statistical inference, preregistration, power analysis, effect size, negative results, statistics education, research methodology critique, hypothesis testing
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review