Empirical assessment of published effect sizes and power in the recent cognitive neuroscience and psychology literature
Open accessPublished version of a preprint
The DOI matches its Crossref record; 62 of the 62 references it cites were found in a registry or an index.
Abstract
We have empirically assessed the distribution of published effect sizes and estimated power by analyzing 26,841 statistical records from 3,801 cognitive neuroscience and psychology papers published recently. The reported median effect size was D = 0.93 (interquartile range: 0.64-1.46) for nominally statistically significant results and D = 0.24 (0.11-0.42) for nonsignificant results. Median power to detect small, medium, and large effects was 0.12, 0.44, and 0.73, reflecting no improvement through the past half-century. This is so because sample sizes have remained small. Assuming similar true effect sizes in both disciplines, power was lower in cognitive neuroscience than in psychology. Journal impact factors negatively correlated with power. Assuming a realistic range of prior probabilities for null hypotheses, false report probability is likely to exceed 50% for the whole literature. In light of our findings, the recently reported low replication success in psychology is realistic, and worse performance may be expected for cognitive neuroscience.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures





Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source doesn’t support the claim as written.
In the citing paper
“Despite methodological challenges10–11, many of the findings of cognitive neuroscience provide a solid basis on which to build.”
From Cognitive computational neuroscience (2018) · cites this paper as [10]
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“In several disciplines, the average statistical power of studies was found to be significantly below the recommended 80% level (13 -16).”
From Is science really facing a reproducibility crisis, and do we need it to? (2018) · cites this paper as [14]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“such studies showed that power varies widely between subfields or methodologies”
From Is science really facing a reproducibility crisis, and do we need it to? (2018) · cites this paper as [14]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“For most published research findings to be false in psychology and neuroscience, for example, one must assume that the hypotheses tested in these disciplines are correct much less than 50% of the time (14, 18).”
From Is science really facing a reproducibility crisis, and do we need it to? (2018) · cites this paper as [14]
The cited source says what the claim attributes to it.
In the citing paper
“and has contributed, in part, to the replication crisis in other fields (Button et al., 2013; Szucs and Ioannidis, 2017; Ioannidis et al., 2017).”
From With Little Power Comes Great Responsibility (2020) · cites this paper as Szucs and Ioannidis, 2017
2 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · PLoS Medicine · doi:10.1371/journal.pmed.0020124 · Cited by 10,505
Self-citationEstimating the reproducibility of psychological science
Open Science Collaboration (2015) · Science · doi:10.1126/science.aac4716 · Cited by 8,515
Power failure: why small sample size undermines the reliability of neuroscience
Button, K. S., Ioannidis, J. P. A., Mokrysz, C., Nosek, B. A., Flint, J., Robinson, E. S. J., & Munafò, M. R. (2013) · Nature Reviews Neuroscience · doi:10.1038/nrn3475 · Cited by 7,641
Self-citationSimmons, J. P., Nelson, L. D., & Simonsohn, U. (2011) · Psychological Science · doi:10.1177/0956797611417632 · Cited by 6,567
Methods of Meta-Analysis: Correcting Error and Bias in Research Findings
Schmidt, F. L., & Hunter, J. E. (2015) · doi:10.4135/9781483398105 · Cited by 5,542
Effect size estimates: Current use, calculations, and interpretation.
Fritz, C. O., Morris, P. E., & Richler, J. J. (2012) · Journal of Experimental Psychology: General · doi:10.1037/a0024338 · Cited by 5,199
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · CHANCE · doi:10.1080/09332480.2005.10722754 · Cited by 4,702 · cited 9×
“…examined p value reporting errors in the cognitive neuroscience literature as recent studies found that 12.5% to 20% of psychology papers have major p value reporting errors which affect judgments about statistical significance (Bakker and Wicherts, 2011; Nuijten et al. 2015; Veldkamp et al. 2014).”
BackgroundMethodResultInfluentialSelf-citationCluster failure: why fMRI inferences for spatial extent have inflated false-positive rates
Eklund, A., Nichols, T. E., & Knutsson, H. (2016) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1602413113 · Cited by 3,487
Promoting an open research culture
Nosek, B. A., Alter, G., Banks, G. C., Borsboom, D., Bowman, S. D., Breckler, S. J., Buck, S., Chambers, C. D., Chin, G., Christensen, G., et al. (2015) · Science · doi:10.1126/science.aab2374 · Cited by 2,708
Circular analysis in systems neuroscience: the dangers of double dipping
Kriegeskorte, N., Simmons, W. K., Bellgowan, P. S. F., & Baker, C. I. (2009) · Nature Neuroscience · doi:10.1038/nn.2303 · Cited by 2,696
Cited by
Items 401–500 of 787
ASA 2022 Data-Driven Decision Making: Book of short papers
Edited by: Enrico di Bella, L. F., Fabbris, L., di Bella, E., & Lagazio, C. (2023) · Proceedings e report · doi:10.36253/979-12-215-0106-3 · Cited by 7
Isager, P. M., Lakens, D., van Leeuwen, T. N., & Veer, A. V. '. (2023) · Cortex · doi:10.1016/j.cortex.2023.10.012 · Cited by 8
The Role of Socioemotional Wealth in Entrepreneurial Persistence Decisions for Family Businesses
Ma, D., Mattingly, E. S., Kushev, T. N., Ahuja, M. K., & Manikas, A. S. (2022) · Journal of Small Business Strategy · doi:10.53703/001c.34614 · Cited by 8
“Smaller effect sizes are consistent with cognitive psychology research (Szucs & Ioannidis, 2017).”
ResultMaldegem, M. V., Vohryzek, J., Atasoy, S., Alnagger, N., Cardone, P., Bonhomme, V. L., Vanhaudenhuyse, A., Demertzi, A., Jaquet, O., Bahri, M. A., et al. (2025) · British Journal of Anaesthesia · doi:10.1016/j.bja.2024.12.036 · Cited by 10
Introducing a replication-first rule for Ph.D. projects
Kochari, A. R., & Ostarek, M. (2018) · Behavioral and Brain Sciences · doi:10.1017/s0140525x18000730 · Cited by 8
Are P-values and Bayes factors valid measures of evidential strength?
Huisman, L. (2022) · Psychonomic Bulletin & Review · doi:10.3758/s13423-022-02205-x · Cited by 8
“For example, when n = 100, δmax ≈ 0.2, a not uncommon effect size (Szucs & Ioannidis, 2017)).”
BackgroundInfluentialSchiffman, J. E. (2018) · Schizophrenia Research · doi:10.1016/j.schres.2018.03.002 · Cited by 8
Aeberhard, A., Gschwind, L., Kossowsky, J., Lukšys, G., Papassotiropoulos, A., de Quervain, D. J. ‐., & Vogler, C. (2018) · Journal of Technology in Behavioral Science · doi:10.1007/s41347-018-0071-5 · Cited by 8
“Yet today, it does not only still persist, but is even being exacerbated by system design faults (Ioannidis 2015; Smaldino and McElreath 2016; Szucs and Ioannidis 2017): using the amount of published original research as a quality criterion for awarding funding or tenured positions incentiv-izes…”
BackgroundOpen science as a better gatekeeper for science and society: a perspective from neurolaw
Chuan-Peng, H., Jiang, X., Jeffrey, R., & Zuo, X. (2018) · 中国科学通报:英文版 · doi:10.1016/j.scib.2018.11.015 · Cited by 9
“) Studies suggest that the false positive rate in the psychological and neuroscience literature is surprisingly high [4].”
BackgroundPower-enhanced funnel plots for meta-analysis: The sunset funnel plot
Kossmeier, M., Tran, U. S., & Voracek, M. (2019) · doi:10.23668/psycharchives.2472 · Cited by 11
fMRI replicability depends upon sufficient individual-level dataPreprint
Nee, D. E. (2018) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/352633 · Cited by 8
Mesquida, C., Murphy, J., Warne, J. P., & Lakens, D. (2025) · doi:10.51224/srxiv.534 · Cited by 8
Making Sense of Law: Critical Reflection on Neuroscience, Socialization, and Self
Sinha, C. (2023) · Integrative Psychological and Behavioral Science · doi:10.1007/s12124-023-09762-3 · Cited by 8
Delfin, C. (2023) · Frontiers in Psychology · doi:10.3389/fpsyg.2023.1253452 · Cited by 11
“It is well known that many findings in psychological research are not replicable, due in large to small sample sizes and insufficient statistical power (Maxwell et al., 2015; Anderson and Maxwell, 2017; Szucs and Ioannidis, 2017; Tackett et al., 2019; Nosek et al., 2022).”
BackgroundLangensee, L., Spotorno, N., & Mårtensson, J. (2023) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2023.108719 · Cited by 7
“This work ties in with the growing opposition within the cognitive neuroscience community against exploratory studies of interindividual differences with respect to brain and behavior that are non-targeted and based on a limited number of participants (Marek et al., 2022; Szucs and Ioannidis, 2017).”
The role of effect size and significance test in research design and analysis
Elsayir, H. A. (2024) · Edelweiss Applied Science and Technology · doi:10.55214/25768484.v8i6.2062 · Cited by 7
Sample size estimation for task-related functional MRI studies using Bayesian updating
Klapwijk, E. T., Jongerling, J., Hoijtink, H., & Crone, E. A. (2024) · Developmental Cognitive Neuroscience · doi:10.1016/j.dcn.2024.101489 · Cited by 7
Precision medicine in follicular lymphoma: Focus on predictive biomarkers
Sorigué, M., Cañamero, E., & Sancho, J. (2020) · Hematological Oncology · doi:10.1002/hon.2781 · Cited by 7
Socioeconomic status and brain structure and functions: A critical review
Lyu, Z., Peng, K., & Chuan-Peng, H. (2019) · Chinese Science Bulletin (Chinese Version) · doi:10.1360/n972018-01104 · Cited by 9
Neuroscience and Criminal Law: Perils and Promises
Morse, S. J. (2019) · Springer eBooks · doi:10.1007/978-3-030-22811-8_20 · Cited by 7
Chapter 50. Treatment of Anxiety Disorders
Choi, S., & Stein, M. B. (2024) · American Psychiatric Association Publishing eBooks · doi:10.1176/appi.books.9781615375523.as50 · Cited by 7
Population modeling with machine learning can enhance measures of mental healthPreprint
Dadi, K., Varoquaux, G. P., Houenou, J., Bzdok, D., Thirion, B., & Engemann, D. A. (2020) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2020.08.25.266536 · Cited by 8
Practical solutions for sharing data and materials from psychological researchPreprint
Gilmore, R. O., Kennedy, J. L., & Adolph, K. E. (2017) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/kew8u · Cited by 7
Predicted as observed? How to identify empirically adequate theoretical constructs
Witte, E. H., Stanciu, A., & Zenker, F. (2022) · Frontiers in Psychology · doi:10.3389/fpsyg.2022.980261 · Cited by 6
“But a directional alternative hypothesis cannot stand in the one-to-one relation between prediction and observation that is required to evaluate whether a theoretical construct is empirically adequate (Klein, 2014; Szucs and Ioannidis, 2017; Gelman, 2018).”
BackgroundAsleBagh, P., Naeini, A. B., & Moeeni, M. (2024) · Journal of Behavioral and Experimental Economics · doi:10.1016/j.socec.2024.102163 · Cited by 6
Bertin, P., & Nera, K. (2025) · International Review of Social Psychology · doi:10.5334/irsp.979 · Cited by 7
Improving the sensitivity of cluster‐based statistics for functional magnetic resonance imaging data
Geerligs, L., & Maris, E. (2021) · Human Brain Mapping · doi:10.1002/hbm.25399 · Cited by 7
“In the current scientific climate, this may be an even more pressing problem than poor FA rate control (Bansal & Peterson, 2018; Button et al., 2013; Cremers, Wager, & Yarkoni, 2017; Lohmann et al., 2018; Szucs & Ioannidis, 2017).”
BackgroundNeurolaw: Challenges and limits
Morse, S. J. (2023) · Handbook of clinical neurology · doi:10.1016/b978-0-12-821375-9.00003-7 · Cited by 7
Flösch, K., Flaisch, T., Imhof, M. A., & Schupp, H. T. (2023) · Cerebral Cortex · doi:10.1093/cercor/bhad487 · Cited by 9
Rinne, S. (2023) · Energy Policy · doi:10.1016/j.enpol.2023.113931 · Cited by 6
Nguyen, D. T. A., & Hsu, L. (2024) · British Food Journal · doi:10.1108/bfj-08-2023-0753 · Cited by 7
The American Psychiatric Association Publishing Textbook of Psychopharmacology
Schatzberg, A. F., & Nemeroff, C. B. (2024) · American Psychiatric Association Publishing eBooks · doi:10.1176/appi.books.9781615375523 · Cited by 10
Ribeiro, G., & Nitschke, F. (2024) · Behavioral Sciences & the Law · doi:10.1002/bsl.2694 · Cited by 6
Zhang, Y., Johannesen, P. T., Molaee-Ardekani, B., Wijetillake, A., Chiea, R. A., Hasan, P.-Y., Segovia-Martínez, M., & Lopez‐Poveda, E. A. (2024) · Ear and Hearing · doi:10.1097/aud.0000000000001565 · Cited by 6
“The level of evidence claims (i.e., strong, moderate, or weak evidence) followed the guidelines provided in van Doorn et al. (2021), based on previous meta-analysis on effect sizes reported in the field of psychology and cognitive neuroscience (Szucs & Ioannidis 2017, 2020; Lee & Vanpaemel 2018).”
Validation of an online imitation-inhibition task
Westfal, M., Cracco, E., Crusius, J., & Genschow, O. (2025) · Behavior Research Methods · doi:10.3758/s13428-024-02557-3 · Cited by 10
“However, such small samples are less informative, lead to inaccurate parameter estimates, and have been criticized as a factor leading to replicability issues (Brandt et al., 2014; Szucs & Ioannidis, 2017).”
Kato, T. (2018) · The Japanese Journal of Personality · doi:10.2132/personality.27.2.11 · Cited by 6
Transcending humanness or: Doing the right thing for science
Inzlicht, M. (2018) · Cortex · doi:10.1016/j.cortex.2018.11.032 · Cited by 7
Acetaminophen changes Mu rhythm power related to pain empathy
Jelsone-Swain, L. M., McCommon, S. A., Turk, B., & Roach, A. E. (2023) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2023.108544 · Cited by 7
Boyes, A., Levenstein, J. M., McLoughlin, L. T., Driver, C., Mills, L., Lagopoulos, J., & Hermens, D. F. (2024) · Brain Imaging and Behavior · doi:10.1007/s11682-023-00847-6 · Cited by 6
“…any specific interventions (beyond what the participants were doing in their points of a small sample (such as the approach in this study) (Klapwijk et al., 2021), or employ Bayesian statistical analyses to estimate the likelihood of both a null and alternative hypothesis (Szucs & Ioannidis, 2017).”
Background9. Neuroscience in Forensic Contexts: Ethical Concerns
Morse, S. J. (2018) · Columbia University Press eBooks · doi:10.7312/grif18330-010 · Cited by 9
The Use and Misuse of Classical Statistics: A Primer for Social Workers
Dunleavy, D. J., & Lacasse, J. R. (2021) · Research on Social Work Practice · doi:10.1177/10497315211008247 · Cited by 6
Charles, S. J., van Mulukom, V., Saraswati, A., Watts, F., Dunbar, R., & Farias, M. (2022) · Current Psychology · doi:10.1007/s12144-022-04062-2 · Cited by 7
“In cognitive sciences, the median moderate effect size reported is d = 0.46 (Szucs & Ioannidis, 2017, 2021).”
BackgroundInfluentialCalin-Jageman, R. J. (2018) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2017.12.008 · Cited by 6
Bor, D., Barrett, A. B., Schwartzman, D. J., & Seth, A. K. (2018) · Consciousness and Cognition · doi:10.1016/j.concog.2018.07.011 · Cited by 7
When and Why to Replicate: As Easy as 1, 2, 3?Preprint
Field, S. M., Hoekstra, R., Bringmann, L. F., & van Ravenzwaaij, D. (2018) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/h7js8 · Cited by 6
Better Inference in Neuroscience: Test Less, Estimate More
Calin-Jageman, R. J. (2022) · Journal of Neuroscience · doi:10.1523/jneurosci.1133-22.2022 · Cited by 7
Rodrigues, M., Edwards, J., Rosic, T., Wang, Y., Talukdar, J. R., Chowdhury, S. R., Parpia, S., Babe, G., de Oliveira, C., Perez, R., et al. (2025) · PLOS mental health. · doi:10.1371/journal.pmen.0000253 · Cited by 5
“[41,42] Unlike frequentist approaches, which depend on the asymptotic properties of adequately-powered samples, Bayesian estimation is known to perform well with even small sizes, rendering it advantageous for use in mental health research.”
Casiraghi, C., Fici, A., Bilucaglia, M., Rossi, C., Zito, M., & Russo, V. (2025) · Current Psychology · doi:10.1007/s12144-025-08104-3 · Cited by 6
“…size in psychology literature has been found to range from “small-to-medium” ( r =.20) to “more-than-large” ( r =.62) (Schäfer & Schwarz, 2019), whereas in cognitive neuroscience and psychology fields from “small-to-medium” (d = 0.24) to “more-than-large” (d = 0.93) (Szucs & Ioannidis, 2017).”
InfluentialPsychopathy, neuroscience, and critical issues: A legal primer
Danagher, L. (2025) · International Journal of Law and Psychiatry · doi:10.1016/j.ijlp.2025.102139 · Cited by 5
Schäfer, T. (2025) · Humanities and Social Sciences Communications · doi:10.1057/s41599-025-06436-w · Cited by 5
“…subdisciplines that comparability is impossible (e.g., Cristea et al., 2022; Funder & Ozer, 2019; Gignac & Szodorai, 2016; Ioannidis, 2008; Lovakov & Agadullina, 2021; Nordahl-Hansen et al., 2024; Richard et al., 2003; Schäfer & Schwarz, 2019; Szucs & Ioannidis, 2017; Wei-nerová et al., 2022).”
Javor, A., Kindermann, H., Koschutnig, K., & Ischebeck, A. K. (2018) · European Journal of Neuroscience · doi:10.1111/ejn.14134 · Cited by 4
How to Identify and How to Conduct Research that Is Informative and Reproducible
Zickfeld, J., & Schubert, T. W. (2019) · Theory and history in the human and social sciences · doi:10.1007/978-3-030-33099-6_9 · Cited by 5
The Effect of Heuristic Cues on Jurors’ Systematic Information Processing in Rape Trials
Nitschke, F., McKimmie, B. M., & Vanman, E. J. (2022) · Psychology of Women Quarterly · doi:10.1177/03616843221118018 · Cited by 7
Queder, N., Tien, V. B., Abraham, S. A., Urchs, S. G. W., Helmer, K. G., Chaplin, D., van Erp, T. G. M., Kennedy, D. N., Poline, J., Grethe, J. S., et al. (2023) · Frontiers in Neuroinformatics · doi:10.3389/fninf.2023.1174156 · Cited by 5
The application of neurofeedback for positive emotion enhancement in depression treatment
Che, Q., Yunlin, S. U. N., Jin, J. K., Zhu, C., Wang, K., Ye, R., & Yu, F. (2023) · Advances in Psychological Science · doi:10.3724/sp.j.1042.2024.00342 · Cited by 5
Eerola, T. (2024) · Musicae Scientiae · doi:10.1177/10298649241300885 · Cited by 7
“Psychology in particular has been flagged as a discipline subject to biases and misleading results (Ioannidis, Munafò, et al., 2014; Open Science Collaboration, 2015; Szucs & Ioannidis, 2017).”
Static vs. Immersive: A Neuromarketing Exploratory Study of Augmented Reality on Packaging Labels
Accardi, S., Campo, C., Bilucaglia, M., Zito, M., Caccamo, M., & Russo, V. (2025) · Behavioral Sciences · doi:10.3390/bs15091241 · Cited by 6
“This can be deemed adequate, considering the median effect size in cognitive neuroscience and experimental psychology of d = 0.93 (Szucs & Ioannidis, 2017), interpreted as more than “large” (Cohen, 2013).”
InfluentialChoosing Alpha Post Hoc: The Danger of Multiple Standard Significance Thresholds
Hemerik, J., & Koning, N. W. (2026) · Statistical Science · doi:10.1214/25-sts983 · Cited by 5
“Existing papers that advocate decreasing α [23, 43, 4, 22, 14, 41, 9], do not discuss the following question: would they already consider it an improvement if some people or journals in a field decrease α , or do they consider it essential that the field as a whole uses the same α ?”
InfluentialStatistical Power and Swallowing Rehabilitation Research: Current Landscape and Next Steps
Borders, J. C., Grande, A. A., & Troche, M. S. (2022) · Dysphagia · doi:10.1007/s00455-022-10428-2 · Cited by 5
Estudios de replicación, pre-registros y ciencia abierta en Psicología
García‐Garzón, E., Lecuona, O. Z., & Carbajal, G. V. (2018) · APUNTES DE PSICOLOGÍA · doi:10.55414/ap.v36i1-2.713 · Cited by 9
Superiority and stigma in modern psychology and neuroscience
Schwarzlose, R. F. (2022) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2022.09.008 · Cited by 5
Better Accuracy for Better Science . . . Through Random Conclusions
Davis‐Stober, C. P., Dana, J. D., Kellen, D., McMullin, S. D., & Bonifay, W. E. (2023) · Perspectives on Psychological Science · doi:10.1177/17456916231182097 · Cited by 6
“We examined several recent meta-analyses to get a snapshot of how common poor ψ values are in various subfields (Gaeta & Brydges, 2020; Nuijten et al., 2020; Siegel et al., 2021; Szucs & Ioannidis, 2017).”
BackgroundMethodEstimating the total variance explained by whole-brain imaging for zero-inflated outcomes
Ren, J., Loughnan, R. J., Xu, B., Thompson, W. K., & Fan, C. C. (2024) · Communications Biology · doi:10.1038/s42003-024-06504-y · Cited by 5
Chen, Z., & Itier, R. J. (2024) · Psychophysiology · doi:10.1111/psyp.14645 · Cited by 6
Pot la psicologia rescatar-se a si mateixa?. Incentius, biaix i replicabilitat
Fernando, B., César, P. L. J., & Vadillo, M. A. (2018) · Anuari de Psicologia de la Societat Valenciana de Psicologia · doi:10.7203/anuari.psicologia.18.2.231 · Cited by 5
Assessing variability and uncertainty in orthopedic randomized controlled trials
Raittio, L., & Reito, A. R. (2020) · Acta Orthopaedica · doi:10.1080/17453674.2020.1755932 · Cited by 5
“Despite the increasing use of power calculations, low power among RCTs to find small and medium effect sizes still remains endemic in clinical medicine, including orthopedics (Button et al. 2013, Abdullah et al. 2015, Sabharwal et al. 2015, Szucs and Ioannidis 2017, Reito et al. 2020).”
BackgroundA user’s view of the validity of acceptability judgments as evidence for syntactic theories
Sprouse, J. (2020) · Oxford University Press eBooks · doi:10.1093/oso/9780198840558.003.0012 · Cited by 5
Xiao, Q., Zeng, S., & Feldman, G. (2020) · Comprehensive Results in Social Psychology · doi:10.1080/23743603.2021.1878340 · Cited by 5
Ward, R. T., Lotfi, S., Stout, D. M., Mattson, S., Lee, H., & Larson, C. L. (2021) · Biological Psychology · doi:10.1016/j.biopsycho.2021.108091 · Cited by 5
Wacker, J., & Paul, K. (2021) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2021.11.008 · Cited by 6
Fanelli, D. (2022) · Oxford University Press eBooks · doi:10.1093/oso/9780190938550.003.0004 · Cited by 7
Tiemeier, H. W., & Muetzel, R. L. (2020) · Mental health and illness worldwide · doi:10.1007/978-981-10-2348-4_12 · Cited by 5
Chapter 49. Treatment of Bipolar Disorder
Strakowski, S. M., & Keck, P. E. (2024) · American Psychiatric Association Publishing eBooks · doi:10.1176/appi.books.9781615375523.as49 · Cited by 5
Bartl, G., Blackshaw, E., Crossman, M., Allen, P., & Sandrini, M. (2020) · Zeitschrift für Psychologie · doi:10.1027/2151-2604/a000396 · Cited by 5
“This particular approach (pre-registration) has been recommended as one of the tools that could improve replicability in science in general (Munafo et al., 2017) and in our cognitive neuroscience subfield in particular (Szucs & Ioannidis, 2017).”
MethodPeters, G.-J. (2017) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/38vfn · Cited by 5
Ostwald, D., Schneider, S., Bruckner, R., & Horváth, L. (2019) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/613331 · Cited by 5
“Here, a particular emphasis has been on statistical power and its relation to typical sample sizes in fMRI group studies (Button et al., 2013; Guo et al., 2014; Szucs and Ioannidis, 2016; Cremers et al., 2017; Geuter et al., 2018; Turner et al., 2018).”
BackgroundEffect Size Interpretation, Sample Size Calculation, and Statistical Power in GerontologyPreprint
Brydges, C. R. (2019) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/u2jbm · Cited by 5
Power, Dominance, and Constraint: A Note on the Appeal of Different Design TraditionsPreprint
Rouder, J. N., & Haaf, J. M. (2017) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/2mf96 · Cited by 5
From theories to models to predictions: A Bayesian model comparison approachPreprint
Rouder, J. N., Haaf, J. M., & Aust, F. (2017) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/jt4th · Cited by 5
The influence of learning history on anterograde interference
Fontaine, E. D. L., Hamel, R., Lepage, J., & Bernier, P. (2023) · Neurobiology of Learning and Memory · doi:10.1016/j.nlm.2023.107866 · Cited by 4
Bruera, A., & Poesio, M. (2024) · PLoS ONE · doi:10.1371/journal.pone.0291099 · Cited by 5
Klonsky, E. D. (2024) · Assessment · doi:10.1177/10731911241299723 · Cited by 4
“We routinely choose sample sizes that are far too small, while offering conclusions about which effects are ‘‘significant’’ or null (Liu et al., 2023; Szucs & Ioannidis, 2017).”
Berg, M., Suchotzki, K., Zimmermann, J., Merz, C. J., Szota, K., Brandt, H., Hartwigsen, G., Lincoln, T. M., Mokros, A., Gade, M., et al. (2025) · European Psychologist · doi:10.1027/1016-9040/a000555 · Cited by 4
“One important factor contributing to the unsatisfactory replication rates seems to be related to inadequate statistical power (Szucs & Ioannidis, 2017 ).”
A 5-min paradigm to evoke robust emotional reactivity in neuroimaging studies
Sabatinelli, D., Winker, C., Farkas, A. H., Rehbein, M. A., & Junghoefer, M. (2023) · Frontiers in Neuroscience · doi:10.3389/fnins.2023.1102213 · Cited by 4
Comparing Manual and Automatic Artifact Detection in Sleep EEG Recordings
Ujma, P. P., Dresler, M., & Bódizs, R. (2025) · Psychophysiology · doi:10.1111/psyp.70016 · Cited by 4
Fruehlinger, C., Paul, K., Kührt, C., & Wacker, J. (2025) · Cognitive Affective & Behavioral Neuroscience · doi:10.3758/s13415-025-01323-y · Cited by 4
Perceptions of Farm Size Heterogeneity and Demand for Group Index Insurance
Vasilaky, K., Sáenz, S. M., Stanimirova, R., & Osgood, D. E. (2020) · Games · doi:10.3390/g11010015 · Cited by 5
“Therefore, we should be cautious in interpreting the magnitude of our results given that under-powered studies have a greater likelihood of overstating the magnitude of the effect size [34,35].”
ResultDoes Cognitive Bias Modification Reduce Alcohol Consumption?
Jones, A., & Field, M. (2021) · Springer eBooks · doi:10.1007/978-3-030-66941-6_22 · Cited by 5
Siegelman, N., van den Bunt, M. R., Lo, J. C. M., Rueckl, J. G., & Pugh, K. R. (2021) · NeuroImage · doi:10.1016/j.neuroimage.2021.118476 · Cited by 5
“2 Moreover, the generally limited sample sizes in neuoimaging studies means that many positive findings might not reflect rue effects (e.g., Button et al., 2013 ; Szucs and Ioannidis, 2017 ).”
BackgroundPower(ful) myths: misconceptions regarding sample size in quality of life research
Anderson, S. F. (2021) · Quality of Life Research · doi:10.1007/s11136-021-03020-y · Cited by 5
A Comprehensive Survey on Predicting Dyslexia and ADHD Using Machine Learning Approaches
Kothapalli, P. K. V., Rathikarani, V., & Nookala, G. K. M. (2022) · Lecture notes in networks and systems · doi:10.1007/978-981-19-1012-8_8 · Cited by 5
Are most published research findings false in a continuous universe?
Neves, K., Tan, P. B., & Amaral, O. B. (2022) · PLoS ONE · doi:10.1371/journal.pone.0277935 · Cited by 6
“[16, 28]) and systematic replication initiatives (e.”
Hildebolt, C. F. (2022) · Oral Surgery Oral Medicine Oral Pathology and Oral Radiology · doi:10.1016/j.oooo.2022.12.014 · Cited by 4
Augusteijn, H. E. M., Wicherts, J. M., Sijtsma, K., & van Assen, M. A. L. M. (2026) · PLoS ONE · doi:10.1371/journal.pone.0355938 · Cited by 4
Registered Reports: introducing a new article format in Developmental Science
Ansari, D., & Gervain, J. (2017) · Developmental Science · doi:10.1111/desc.12650 · Cited by 4
Klau, S., Schönbrodt, F. D., Patel, C. J., Ioannidis, J. P. A., Boulesteix, A., & Hoffmann, S. (2020) · Open access LMU (Ludwid Maxmilian's Universitat Munchen) · doi:10.5282/ubm/epub.70485 · Cited by 5
“…from the problems arising through the multiplicity of possible analysis strategies, there seem to be more fundamental issues in the analysis of observational data that originate from the low statistical power which characterizes many psychological studies (Maxwell, 2004; Szucs and Ioannidis, 2017).”
BackgroundSelf-citationA Hitchhiker’s Guide to Working with Large, Open-Source Neuroimaging DatasetsPreprint
Horien, C. L., Noble, S., Greene, A. S., Lee, K., Barron, D. S., Gao, S., O'Connor, D., Salehi, M., Dadashkarimi, J., Shen, X., et al. (2020) · Preprints.org · doi:10.20944/preprints202007.0153.v1 · Cited by 5
Ethical and legal implications of the methodological crisis in neuroimagingPreprint
Kellmeyer, P. (2017) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/2gehg · Cited by 4
Action Effects on Visual Perception of Distances: A Multilevel Bayesian Meta-AnalysisPreprint
Molto, L., Nalborczyk, L., Palluel-Germain, R., & Morgado, N. (2019) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/2zutq · Cited by 4
Computational optimization of associative learning experimentsPreprint
Melinščak, F., & Bach, D. R. (2019) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/cgpmh · Cited by 4
Metadata
- Authors
- Szucs, D., & Ioannidis, J. P. A.
- Affiliations
- Stanford Medicine (US)
- Venue
- PLOS Biology
- Publisher
- Public Library of Science (PLoS)
- Published
- 2017-03-02
- Volume
- 15
- Issue
- 3
- Pages
- e2000797
- ISSN
- 1544-9173 (ISSN-L)
- 1545-7885
- PMC
- PMC5333800
- OpenAlex
- W2951081425
- Cited by
- 761
- References
- 62
- Citations by year
- 2026: 28 · 2025: 43 · 2024: 120 · 2023: 75 · 2022: 80 · 2021: 76 · 2020: 94 · 2019: 102 · 2018: 91 · 2017: 46
- FWCI
- 81.43
- Type
- journal article
- Language
- en
- Update notices
- correction (2021-03-05)
- Open access
- gold
- doi.org
- Licence
- Locations
- PLoS Biology (publishedVersion, cc-by)
- bioRxiv (Cold Spring Harbor Laboratory) (acceptedVersion, cc-by-nc-nd)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- Figshare (submittedVersion, cc-by)
- Apollo (University of Cambridge) (submittedVersion, cc-by)
- Apollo (cc-by)
- Funders
- James S. McDonnell Foundation (220020370)
- Universiteit van Tilburg
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Keywords
- effect size, statistical power, cognitive neuroscience, psychology literature, sample size, replication success, journal impact factor, null hypothesis, publication bias, statistical records
- MeSH terms
- Cognitive Neuroscience, Humans, Probability, Psychology, Publications, Surveys and Questionnaires, Empirical Research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.