Empirical assessment of published effect sizes and power in the recent cognitive neuroscience and psychology literature
Open accessPublished version of a preprint
The DOI matches its Crossref record; 62 of the 62 references it cites were found in a registry or an index.
Abstract
We have empirically assessed the distribution of published effect sizes and estimated power by analyzing 26,841 statistical records from 3,801 cognitive neuroscience and psychology papers published recently. The reported median effect size was D = 0.93 (interquartile range: 0.64-1.46) for nominally statistically significant results and D = 0.24 (0.11-0.42) for nonsignificant results. Median power to detect small, medium, and large effects was 0.12, 0.44, and 0.73, reflecting no improvement through the past half-century. This is so because sample sizes have remained small. Assuming similar true effect sizes in both disciplines, power was lower in cognitive neuroscience than in psychology. Journal impact factors negatively correlated with power. Assuming a realistic range of prior probabilities for null hypotheses, false report probability is likely to exceed 50% for the whole literature. In light of our findings, the recently reported low replication success in psychology is realistic, and worse performance may be expected for cognitive neuroscience.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures





Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source doesn’t support the claim as written.
In the citing paper
“Despite methodological challenges10–11, many of the findings of cognitive neuroscience provide a solid basis on which to build.”
From Cognitive computational neuroscience (2018) · cites this paper as [10]
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“In several disciplines, the average statistical power of studies was found to be significantly below the recommended 80% level (13 -16).”
From Is science really facing a reproducibility crisis, and do we need it to? (2018) · cites this paper as [14]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“such studies showed that power varies widely between subfields or methodologies”
From Is science really facing a reproducibility crisis, and do we need it to? (2018) · cites this paper as [14]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“For most published research findings to be false in psychology and neuroscience, for example, one must assume that the hypotheses tested in these disciplines are correct much less than 50% of the time (14, 18).”
From Is science really facing a reproducibility crisis, and do we need it to? (2018) · cites this paper as [14]
The cited source says what the claim attributes to it.
In the citing paper
“and has contributed, in part, to the replication crisis in other fields (Button et al., 2013; Szucs and Ioannidis, 2017; Ioannidis et al., 2017).”
From With Little Power Comes Great Responsibility (2020) · cites this paper as Szucs and Ioannidis, 2017
2 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · PLoS Medicine · doi:10.1371/journal.pmed.0020124 · Cited by 10,505
Self-citationEstimating the reproducibility of psychological science
Open Science Collaboration (2015) · Science · doi:10.1126/science.aac4716 · Cited by 8,515
Power failure: why small sample size undermines the reliability of neuroscience
Button, K. S., Ioannidis, J. P. A., Mokrysz, C., Nosek, B. A., Flint, J., Robinson, E. S. J., & Munafò, M. R. (2013) · Nature Reviews Neuroscience · doi:10.1038/nrn3475 · Cited by 7,641
Self-citationSimmons, J. P., Nelson, L. D., & Simonsohn, U. (2011) · Psychological Science · doi:10.1177/0956797611417632 · Cited by 6,567
Methods of Meta-Analysis: Correcting Error and Bias in Research Findings
Schmidt, F. L., & Hunter, J. E. (2015) · doi:10.4135/9781483398105 · Cited by 5,542
Effect size estimates: Current use, calculations, and interpretation.
Fritz, C. O., Morris, P. E., & Richler, J. J. (2012) · Journal of Experimental Psychology: General · doi:10.1037/a0024338 · Cited by 5,199
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · CHANCE · doi:10.1080/09332480.2005.10722754 · Cited by 4,702 · cited 9×
“…examined p value reporting errors in the cognitive neuroscience literature as recent studies found that 12.5% to 20% of psychology papers have major p value reporting errors which affect judgments about statistical significance (Bakker and Wicherts, 2011; Nuijten et al. 2015; Veldkamp et al. 2014).”
BackgroundMethodResultInfluentialSelf-citationCluster failure: why fMRI inferences for spatial extent have inflated false-positive rates
Eklund, A., Nichols, T. E., & Knutsson, H. (2016) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1602413113 · Cited by 3,487
Promoting an open research culture
Nosek, B. A., Alter, G., Banks, G. C., Borsboom, D., Bowman, S. D., Breckler, S. J., Buck, S., Chambers, C. D., Chin, G., Christensen, G., et al. (2015) · Science · doi:10.1126/science.aab2374 · Cited by 2,708
Circular analysis in systems neuroscience: the dangers of double dipping
Kriegeskorte, N., Simmons, W. K., Bellgowan, P. S. F., & Baker, C. I. (2009) · Nature Neuroscience · doi:10.1038/nn.2303 · Cited by 2,696
Cited by
Items 501–600 of 787
Clarifying the reliability paradox: poor test-retest reliability attenuates group differencesPreprint
Karvelis, P., & Diaconescu, A. O. (2024) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/z4yqe · Cited by 4
Chapter 57. Treatment of Eating Disorders
Agras, W. S. (2024) · American Psychiatric Association Publishing eBooks · doi:10.1176/appi.books.9781615375523.as57 · Cited by 4
Chapter 55. Treatment of Alcohol Use Disorder
Mason, B. J., Ritvo, E. C., & Bonci, A. (2024) · American Psychiatric Association Publishing eBooks · doi:10.1176/appi.books.9781615375523.as55 · Cited by 3
Can AI-generated faces serve as fillers in eyewitness lineups?
Greenspan, R. L., & Bergold, A. N. (2025) · Memory · doi:10.1080/09658211.2025.2467134 · Cited by 3
“We recruited a large sample in Study 2, much larger than that typically used in cognitive or applied psychology research (Shen et al., 2011; Szucs & Ioannidis, 2017), to ensure our findings were sufficiently powered.”
Lindsay, R. M. (2025) · Advances in management accounting · doi:10.1108/s1474-787120250000037001 · Cited by 9
Sangoi, J. A., Kozlowski, M. B., Feeney, K. E., Karalunas, S. L., Riopelle, C., Peraza, J. A., Smith, J. N., Lobo, R. P., González, R., Laird, A. R., et al. (2025) · Clinical Psychological Science · doi:10.1177/21677026251369850 · Cited by 3
“In fact, because of small sample sizes and low statistical power, it is hypothesized that many extant neuroimaging studies are published with mis-leading or false effects (Ioannidis, 2005; Szucs & Ioannidis, 2017).”
Meyer, T. N., Andreeva, O. A., Weiss, R. D., Ding, W., Shen, I. Z., Wang, C., Chen, P., & Dagnew, T. M. (2025) · Neuroscience Informatics · doi:10.1016/j.neuri.2025.100225 · Cited by 3
Algunos problemas de la Psicología y propuestas de solución
LORENZO, E. D. (2018) · APUNTES DE PSICOLOGÍA · doi:10.55414/ch7fnr89 · Cited by 3
Davis, C. E., Martin, J. G., & Thorpe, S. J. (2020) · Frontiers in Neuroinformatics · doi:10.3389/fninf.2020.00002 · Cited by 4
“How big of a problem does this device solve? There is currently a replication crisis in many fields of neuroscience and psychology, with some estimates claiming up to 64% of research in psychological science is not reproducible (Kerr, 1998;Wicherts et al., 2006; Wager et al., 2009; Simmons et al., 2011; Button et al.,…”
BackgroundNostedt, S., & Joffe, A. R. (2022) · Journal of Intensive Care Medicine · doi:10.1177/08850666221077203 · Cited by 3
“005 were 1 [1, 2], 7 [2, 22], and 28 [4, 68].”
BackgroundInfluentialAvoiding Questionable Research Practices Surrounding Statistical Power Analysis
Pek, J. C. X., Hoisington-Shaw, K. J., & Wegener, D. T. (2022) · Springer eBooks · doi:10.1007/978-3-031-04968-2_11 · Cited by 3
Bartl, G., Allen, P., & Sandrini, M. (2023) · Brain Sciences · doi:10.3390/brainsci13020241 · Cited by 5
“Some authors argued that questionable research practices and the lack of reproducibility or consistency in findings may call into question the efficacy of previous research on tDCS [57] or cognitive neuroscience in general [58].”
ResultComputational psychiatry and the psychopathology of psychosis: Promising leads and blind alleys
Tandon, R. (2023) · Schizophrenia Research · doi:10.1016/j.schres.2023.02.003 · Cited by 3
Bouchard, T. J. (2023) · Twin Research and Human Genetics · doi:10.1017/thg.2023.19 · Cited by 3
“The statistical abuses characterized by these terms explain why many scientific findings (true experiments) turned out to be false (Ioannidis, 2005; Szucs & Ioannidis, 2017, 2021).”
BackgroundZanatta, A., Siew, J., der Paelt, S. V., Warreyn, P., & Roeyers, H. (2024) · Review Journal of Autism and Developmental Disorders · doi:10.1007/s40489-024-00437-2 · Cited by 2
“…in interpretation (Fair et al., 2021; Scheel, 2022), which in combination with publication bias favouring positive results can lead to overestimated large observed effects and false positives rather than true effects (Button et al., 2013; Schäfer & Schwarz, 2019; Szucs & Ioannidis, 2017, 2021).”
Network‐based artificial intelligence approaches for advancing personalized psychiatry
Rajan, S., & Schwarz, E. (2024) · American Journal of Medical Genetics Part B Neuropsychiatric Genetics · doi:10.1002/ajmg.b.32997 · Cited by 4
“Across different data types, perhaps with the exception of rare genetic variants, the effect sizes of biological changes found in patients are generally low (Szucs & Ioannidis, 2017).”
Cohen’s convention, the seriousness of errors, and the body of knowledge in behavioral science
Arslan, A., & Zenker, F. (2024) · Synthese · doi:10.1007/s11229-024-04753-2 · Cited by 4
“…in behavioral science normally report effect sizes that were observed under low statistical test power, corresponding to a larger - error rate (Fletcher, 2021; Krefeld-Schwalb, Witte, Zenker, 2018; Szucs & Ioannidis, 2017a; Ioannidis, 2005; van Dongen & Sikorski, 2021; Wagenmakers et al., 2011).”
Segerstrom, S. C. (2020) · International Journal of Behavioral Medicine · doi:10.1007/s12529-020-09868-7 · Cited by 3
Nieuwenhuis, J. (2022) · Asian journal of social science · doi:10.1016/j.ajss.2022.07.001 · Cited by 3
Is neuroscience facing up to statistical power?Preprint
Goodhill, G. J. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1701.01219 · Cited by 4
“Furthermore, there is no reason to think these problems are any different in other journals (though a recent study has argued that statistical power is negatively correlated with journal impact factor [4]).”
BackgroundWhen are sample means meaningful? The role of modern estimation in psychological sciencePreprint
Davis‐Stober, C. P., Dana, J. D., & Rouder, J. N. (2017) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/2ukxj · Cited by 3
The low statistical power of psychological research: Causes, consequences and potential remedies
Thorn, F. S. (2020) · Minerva Access (University of Melbourne) · Cited by 6
Number of participants required for common designs in psychology: A power analysisPreprint
Brysbaert, M. (2018) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/2v4yx · Cited by 4
Elsey, J. W. B. (2021) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/kt4pz · Cited by 5
Hruby, G. G., & Mitra, A. (2022) · Elsevier eBooks · doi:10.1016/b978-0-12-818630-5.07076-7 · Cited by 3
Statistical Power in Musculoskeletal Research: A Meta-Review of 266 Randomised Controlled Trials
Bleakley, C., Klempel, N., Wagemans, J., Netterström-Wedin, F., & Smoliga, J. M. (2025) · Sports Medicine - Open · doi:10.1186/s40798-025-00908-8 · Cited by 3
“Audits in other medical disciplines indicate the pervasive presence of underpowered studies and suggest that it is a key factor exacerbating the replication crisis [8, 9].”
Sample size calculation for training ensemble machine learning models on health data
Mitsakakis, N., Liu, D., Walters, T. D., & Emam, K. E. (2026) · Patterns · doi:10.1016/j.patter.2026.101498 · Cited by 3
“4 In addition, many of these studies (1) did not tune the ML models, and therefore, it is not clear to what extent their re-sults can be applied to the more practical scenario where model tuning is applied, and (2) examined a small range of sample sizes.”
Jiang, L., Zou, Q., & Yu, S. (2026) · Biological Psychology · doi:10.1016/j.biopsycho.2026.109367 · Cited by 1
Hicks, L. J., Smith, A. C., Ralph, B. C. W., & Smilek, D. (2020) · Journal of Environmental Psychology · doi:10.1016/j.jenvp.2020.101515 · Cited by 2
The role of task demands in racial face encoding
Yang, B., Ma, J., Ding, R., Xia, X., & Ding, X. (2022) · Scientific Reports · doi:10.1038/s41598-022-19880-4 · Cited by 2
Mustofa, Z. (2022) · Jurnal Teknodik · doi:10.32550/teknodik.vi.890 · Cited by 2
On the importance of modeling the invisible world of underlying effect sizes
Wilson, B. M., & Wixted, J. T. (2023) · Social Psychological Bulletin · doi:10.32872/spb.9981 · Cited by 2
“Previous work suggests that experiments in the field of psychology have about ~50% power to detect a medium effect size (e.g., Cohen, 1962; Fraley & Vazire, 2014; Maxwell, 2004; Sedlmeier & Gigerenzer, 1989; Szucs & Ioannidis, 2017).”
BackgroundChapter 20. Duloxetine, Milnacipran, and Levomilnacipran
Jha, M. K., Mayes, T. L., & Trivedi, M. H. (2024) · American Psychiatric Association Publishing eBooks · doi:10.1176/appi.books.9781615375523.as20 · Cited by 2
Chapter 11. Tricyclic and Tetracyclic Drugs
Nelson, J. (2024) · American Psychiatric Association Publishing eBooks · doi:10.1176/appi.books.9781615375523.as11 · Cited by 2
Gao, K., & Calabrese, J. R. (2024) · American Psychiatric Association Publishing eBooks · doi:10.1176/appi.books.9781615375523.as41 · Cited by 2
Preregistration and predictivism
Choi, H. H. (2024) · Synthese · doi:10.1007/s11229-024-04827-1 · Cited by 6
“…research flexibility and publication bias, then the disparity in positive rate would require that non-preregistered studies test >90% true hypotheses and have >90% statistical power — but both of these assumptions are implausible and contradicted by extant research (e.g., Szucs and Ioannidis 2017).”
Huber, C., Holzmeister, F., Johannesson, M., König-Kersting, C., Dreber, A., Huber, J., & Kirchler, M. (2026) · The Journal of Finance · doi:10.2139/ssrn.5048949 · Cited by 5
Making a promise increases the moral cost of lying: Evidence from Norway and the United States
Ekström, M., Bjorvatn, K., Mota, P. I. S., & Sjåstad, H. (2025) · Journal of Economic Behavior & Organization · doi:10.1016/j.jebo.2025.106995 · Cited by 2
Maiti, S. I., & Saikia, S. K. (2019) · Advances in Zoology and Botany · doi:10.13189/azb.2019.070202 · Cited by 2
“Nowadays, reporting ‘effect size’ is often prescribed in statistical analysis of biological experiments along with documentation of p-value [12-13].”
BackgroundThe Influence of Team Cohesion and Contextual Performance on Project Team Performance Over Time
Vazquez, M. (2019) · Digital Commons-DePaul (DePaul University) · Cited by 3
Tiemeier, H. W., & Muetzel, R. L. (2020) · Mental health and illness worldwide · doi:10.1007/978-981-10-0753-8_12-1 · Cited by 3
Insights In: Theoretical and Philosophical Psychology
(2023) · Frontiers research topics · doi:10.3389/978-2-8325-3675-9 · Cited by 2
Lost in Translation: Challenges for Translational Research in the Field of Stress and Cognition
Liberzon, I. (2024) · Biological Psychiatry · doi:10.1016/j.biopsych.2024.03.018 · Cited by 2
Towards canine brain–computer interfaces (BCIs)
Kulgod, A. (2024) · Advanced Robotics · doi:10.1080/01691864.2024.2369794 · Cited by 2
“Small sample sizes are especially worth highlighting in light of recent discussion of the replication crisis in the behavioral sciences [46,47], which arguably affects cognitive neuroscience particularly hard [48], and fMRI research hardest of all.”
Classifying Positive Results in Clinical Psychology Using Natural Language Processing
Schiekiera, L., Diederichs, J., & Niemeyer, H. (2024) · Zeitschrift für Psychologie · doi:10.1027/2151-2604/a000563 · Cited by 3
Chapter 6. Pharmacokinetics, Pharmacodynamics, and Pharmacogenomics
Goldberg, J. F. (2024) · American Psychiatric Association Publishing eBooks · doi:10.1176/appi.books.9781615375523.as06 · Cited by 2
Chapter 8. Personalized Medicine in Psychiatry
Perna, G., Alciati, A., & Nemeroff, C. B. (2024) · American Psychiatric Association Publishing eBooks · doi:10.1176/appi.books.9781615375523.as08 · Cited by 2
R v Bingley and the importance of scientifically-guided legal analysisPreprint
Chin, J. M. (2017) · LawArXiv (OSF Preprints) · doi:10.31228/osf.io/4p7eg · Cited by 2
Dys, S. P. (2019) · TSpace (University of Toronto) · Cited by 2
Cheung, K. (2017) · TUScholarShare (Temple University) · Cited by 3
Estudios de Replicación, Pre-registros y Ciencia Abierta en PsicologíaPreprint
García‐Garzón, E., Lecuona, O. Z., & Carbajal, G. V. (2017) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/u3a6r · Cited by 2
Exploring Functional Brain Network Modularity in Educational ContextsPreprint
Weinberger, A. B., Cortes, R. A., Betzel, R. F., & Green, A. E. (2022) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2022.01.06.475275 · Cited by 2
“Mitigating publication bias has been shown to improve replicability (Dwan et al., 2008; Szucs & Ioannidis, 2017), especially with smaller samples (Button et al., 2013).”
BackgroundDaily and Non-daily Smokers: A Profile of Drive and Cognitive Control MechanismsPreprint
Bartlett, J. E. (2021) · Thesis Commons (OSF Preprints) · doi:10.31237/osf.io/h9gpe · Cited by 2
Kochari, A. R., & Ostarek, M. (2018) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/6yv45 · Cited by 2
Examining Psychological Science through Systematic Meta-Method Analysis: A Call for ResearchPreprint
Elson, M. (2019) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/cfbzt · Cited by 2
Aeberhard, A., Gschwind, L., Kossowsky, J., Lukšys, G., de Quervain, D. J. ‐., Papassotiropoulos, A., & Vogler, C. (2018) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/cb4f9 · Cited by 2
The impact of P-hacking on "Redefine statistical significance"Preprint
Crane, H. (2017) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/bp2z4 · Cited by 2
Examining Psychological Science through Systematic Meta-Method Analysis: A Call for ResearchPreprint
Elson, M. (2019) · MetArXiv (OSF Preprints) · doi:10.31222/osf.io/cj7xf · Cited by 2
SNAKE-fMRI: A modular fMRI data simulator from the space-time domain to k-space and backPreprint
Comby, P.-A., Vignaud, A., & Ciuciu, P. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2404.08282 · Cited by 2
“The development of complex methods on data acquisition and image reconstruction in (f)MRI faces challenges in providing a fair comparison due to limited existing ground-truth data collected on the same individuals under different imaging setups.”
Chapter 25. Classic Antipsychotic Medications
Nasrallah, H. A., & Tandon, R. (2024) · American Psychiatric Association Publishing eBooks · doi:10.1176/appi.books.9781615375523.as25 · Cited by 2
Cognitive neuropsychology of implicit emotion regulation through fictional reappraisal
Makowski, D. (2018) · theses.fr (ABES) · doi:10.70675/b893631fzf9dfz4924za932z080163f62da9 · Cited by 2
The Q1K Integrated EEG and Eye-Tracking Experimental Test Battery for Open Autism SciencePreprint
O’Reilly, C., Desjardins, J. A., Blanco-Gomez, G., Huberty, S., Loewen, A. H. P., Ramnani, S., Srishyla, D., Knoth, I. S., Martin, C.-O., Batten, J. P., et al. (2026) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.64898/2026.07.13.738272 · Cited by 2
“…non-replicability of research results is general in science (Aarts et al., 2015; Baker, 2016) and has often been driven by insufficient sample sizes (Szucs & Ioannidis, 2017), it is particularly challenging for fields like autism where research samples are often characterized by high heterogeneity.”
Verhoeven, L. T. W., Li, X., Ogunniran, M. O., Wu, R., Chakraborty, A., Vickers, E., Gupta, L., & Macintyre, T. (2022) · UNESCO MGIEP eBooks · doi:10.56383/nfal3758 · Cited by 1
Regulation and applied science in psychotherapies
Bertolín-Guillén, J. M. (2024) · Psiquiatría Biológica · doi:10.1016/j.psiq.2024.100486 · Cited by 1
Chapter 60. Treatment of Child and Adolescent Disorders
Wagner, K., & Pliszka, S. R. (2024) · American Psychiatric Association Publishing eBooks · doi:10.1176/appi.books.9781615375523.as60 · Cited by 1
Chapter 52. Treatment of Obsessive-Compulsive Disorder
Kayser, R. R., & Simpson, H. B. (2024) · American Psychiatric Association Publishing eBooks · doi:10.1176/appi.books.9781615375523.as52 · Cited by 1
Theoretical models of developmental dyscalculia
Ouyang, X., & Szűcs, D. (2025) · Elsevier eBooks · doi:10.1016/b978-0-443-22224-5.00001-1 · Cited by 1
Casiraghi, C., Chiarelli, S., Gifuni, G., Fici, A., Bilucaglia, M., Jacomuzzi, A. C., Micheletto, V., Zito, M., & Russo, V. (2025) · PLoS ONE · doi:10.1371/journal.pone.0325804 · Cited by 1
“The effect sizes, interpreted respectively as “ medium-to-large” and “small-to-medium” [111], are lower than the “more-than-large” median value ( d = .93) commonly found in recent experimental psychology and neuroscience literature [112].”
Mohyee, R. A., Elliott, B. L., Pike, M. R., Smith, E., Kring, A. M., Olson, I. R., Breen, E. C., Cohn, B. A., Cirillo, P. M., Krigbaum, N. Y., et al. (2025) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2420188122 · Cited by 2
“Our final sample of 72 participants, therefore, provides sufficient power to detect small to medium effects—effect sizes that are typical in neuroimaging studies (137, 138).”
The pursuitworthiness of experiments in neurolinguistics
Dolcini, N., Jap, B. A. J., Kun, C. W., & Politzer‐Ahles, S. (2025) · European Journal for Philosophy of Science · doi:10.1007/s13194-025-00691-z · Cited by 1
“Without clear criteria for pursuitworthiness, resources might be allocated inefficiently, and this could lead to favoring experiments of lesser scientific importance over those poised to make more significant contributions (Szucs & Ioannidis, 2017).”
InfluentialMahafza, Y. S. M., Irvine, M., Telfer, A., Aguilar‐Valles, A., & D’Angiulli, A. (2025) · Neuroimage Reports · doi:10.1016/j.ynirp.2025.100306 · Cited by 1
“Some suggest false positive rates in neuroimaging studies as high as 10 – 40 % (Wager et al., 2009) or even over 50 % of all published findings (Szucs and Ioannidis, 2017).”
Huang, Y., Xu, Z., Bei, X., & Huang, H. (2025) · Mathematics · doi:10.3390/math14010145 · Cited by 1
Léonard, F., & Tirelli, E. (2026) · Journal of Trial and Error · doi:10.36850/34b0-42b1 · Cited by 1
A well-powered test of task difficulty effects on cardiovascular indicators of mental effort
Brinkmann, K., Schlegel, K., Scherer, K. R., & Gendolla, G. H. E. (2026) · International Journal of Psychophysiology · doi:10.1016/j.ijpsycho.2026.113382 · Cited by 1
Gao, H., Schneider, C. V., Seibel, T., Zhang, C., Cong, F., Mathiak, K., Schneider, K. M., & Mehler, D. M. A. (2026) · NeuroImage · doi:10.1016/j.neuroimage.2026.122207 · Cited by 1
Techne and Episteme: Challenges for a Fruitful Translation Between Neuroscience and Psychiatry
Arrondo, G., Barrett, N. F., Güell, F., Bernácer, J., & Murillo, J. I. (2018) · Springer eBooks · doi:10.1007/978-3-319-95360-1_8 · Cited by 1
Azouaghe, S., Adetula, A., Forscher, P. S., Brown, D. M. B., Ouherrou, N., Charyate, A. C. A., & IJzerman, H. R. (2021) · The Journal of Quality in Education · doi:10.37870/joqie.v11i18.274 · Cited by 1
The Logic of Research and Questionable Research Practices: The Role of Enthymemes
Wong, D. R., & O’Donohue, W. (2022) · Springer eBooks · doi:10.1007/978-3-031-04968-2_2 · Cited by 1
Quantitative Literature Synthesis: An A Priori Method for Synthesizing Past and Future Data
Fife, D. A. (2019) · American Educational Research Association Annual Meeting (AERA) · doi:10.3102/1440432 · Cited by 1
Cludius, B., & Ehring, T. W. (2023) · CBT: science into practice · doi:10.1007/978-3-031-23650-1_2 · Cited by 2
Reproduzierbare und replizierbare Forschung
Hoffmann, S., Scheipl, F., & Boulesteix, A. (2023) · Springer eBooks · doi:10.1007/978-3-662-63496-7_25-1 · Cited by 1
Data Analyses that Meet Current Standards of the Profession
Grigorenko, E. L. (2018) · Cambridge University Press eBooks · doi:10.1017/9781108304443.008 · Cited by 1
Reducing the efforts to create reproducible analysis code with FieldTrip
van Es, M. W. J., Spaak, E., Schoffelen, J., & Oostenveld, R. (2024) · The Journal of Open Source Software · doi:10.21105/joss.05566 · Cited by 1
Chapter 14. Citalopram and Escitalopram
Shelton, R. C. (2024) · American Psychiatric Association Publishing eBooks · doi:10.1176/appi.books.9781615375523.as14 · Cited by 1
Schatzberg, A. F. (2024) · American Psychiatric Association Publishing eBooks · doi:10.1176/appi.books.9781615375523.as17 · Cited by 1
Chapter 31. Ziprasidone and Asenapine
Newcomer, J. W., Lipsey, J., Strassnig, M., & Citrome, L. (2024) · American Psychiatric Association Publishing eBooks · doi:10.1176/appi.books.9781615375523.as31 · Cited by 1
Chapter 19. Venlafaxine and Desvenlafaxine
Thase, M. E. (2024) · American Psychiatric Association Publishing eBooks · doi:10.1176/appi.books.9781615375523.as19 · Cited by 1
Chapter 10. Monoamine Oxidase Inhibitors
Krishnan, K. R. R. (2024) · American Psychiatric Association Publishing eBooks · doi:10.1176/appi.books.9781615375523.as10 · Cited by 1
Yang, Y. W.-H., & Marder, S. R. (2024) · American Psychiatric Association Publishing eBooks · doi:10.1176/appi.books.9781615375523.as26 · Cited by 1
Buckley, P. F., & Foster, A. E. (2024) · American Psychiatric Association Publishing eBooks · doi:10.1176/appi.books.9781615375523.as32 · Cited by 1
Chapter 29. Risperidone and Paliperidone
Lopez, L. V., Hill, M. B., & GOFF, D. C. (2024) · American Psychiatric Association Publishing eBooks · doi:10.1176/appi.books.9781615375523.as29 · Cited by 1
Chapter 39. Carbamazepine, Oxcarbazepine, and Eslicarbazepine
Post, R. M., Wang, P. W., & Ketter, T. A. (2024) · American Psychiatric Association Publishing eBooks · doi:10.1176/appi.books.9781615375523.as39 · Cited by 1
Margoni, F., & Walkinshaw, N. (2024) · Infant Behavior and Development · doi:10.1016/j.infbeh.2024.101978 · Cited by 1
A deep learning-enriched framework for analyzing brain functional connectivity
Borra, D., & Magosso, E. (2025) · Scientific Reports · doi:10.1038/s41598-025-17635-5 · Cited by 2
Ethical Considerations in Health Psychology
Crutzen, R. (2025) · Sage eBooks · doi:10.4135/9781529674750.n10 · Cited by 1
To what extent should we trust statistics?
Mjaess, G., Albisinni, S., Aoun, F. Y., Karam, A., Tayeh, G. A., Sarkis, J., & Roumeguère, T. (2021) · European surgery. Supplement/European surgery · doi:10.1007/s10353-021-00708-w · Cited by 1
Bad Smells in Software Analytics PapersPreprint
Krishna, R., Majumder, S., Menzies, T., & Shepperd, M. (2018) · arXiv (Cornell University) · Cited by 2
Research on Research: A Meta-Scientific Study of Problems and Solutions in Psychological SciencePreprint
Nuijten, M. B. (2018) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/qtk7e · Cited by 1
From working memory to maths: A multi-measure physiological investigation of the impact of anxiety
Avancini, C. (2019) · Apollo (University of Cambridge) · doi:10.17863/cam.45777 · Cited by 1
Improving the sensitivity of cluster-based statistics for fMRI dataPreprint
Geerligs, L., & Maris, E. (2020) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2020.01.06.896167 · Cited by 1
“In the current scientific climate, this may be an even more pressing problem than poor FA-rate control (Button et al., 2013; Szucs & Ioannidis, 2017).”
Background
Metadata
- Authors
- Szucs, D., & Ioannidis, J. P. A.
- Affiliations
- Stanford Medicine (US)
- Venue
- PLOS Biology
- Publisher
- Public Library of Science (PLoS)
- Published
- 2017-03-02
- Volume
- 15
- Issue
- 3
- Pages
- e2000797
- ISSN
- 1544-9173 (ISSN-L)
- 1545-7885
- PMC
- PMC5333800
- OpenAlex
- W2951081425
- Cited by
- 761
- References
- 62
- Citations by year
- 2026: 28 · 2025: 43 · 2024: 120 · 2023: 75 · 2022: 80 · 2021: 76 · 2020: 94 · 2019: 102 · 2018: 91 · 2017: 46
- FWCI
- 81.43
- Type
- journal article
- Language
- en
- Update notices
- correction (2021-03-05)
- Open access
- gold
- doi.org
- Licence
- Locations
- PLoS Biology (publishedVersion, cc-by)
- bioRxiv (Cold Spring Harbor Laboratory) (acceptedVersion, cc-by-nc-nd)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- Figshare (submittedVersion, cc-by)
- Apollo (University of Cambridge) (submittedVersion, cc-by)
- Apollo (cc-by)
- Funders
- James S. McDonnell Foundation (220020370)
- Universiteit van Tilburg
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Keywords
- effect size, statistical power, cognitive neuroscience, psychology literature, sample size, replication success, journal impact factor, null hypothesis, publication bias, statistical records
- MeSH terms
- Cognitive Neuroscience, Humans, Probability, Psychology, Publications, Surveys and Questionnaires, Empirical Research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.