Empirical assessment of published effect sizes and power in the recent cognitive neuroscience and psychology literature
Open accessPublished version of a preprint
The DOI matches its Crossref record; 62 of the 62 references it cites were found in a registry or an index.
Abstract
We have empirically assessed the distribution of published effect sizes and estimated power by analyzing 26,841 statistical records from 3,801 cognitive neuroscience and psychology papers published recently. The reported median effect size was D = 0.93 (interquartile range: 0.64-1.46) for nominally statistically significant results and D = 0.24 (0.11-0.42) for nonsignificant results. Median power to detect small, medium, and large effects was 0.12, 0.44, and 0.73, reflecting no improvement through the past half-century. This is so because sample sizes have remained small. Assuming similar true effect sizes in both disciplines, power was lower in cognitive neuroscience than in psychology. Journal impact factors negatively correlated with power. Assuming a realistic range of prior probabilities for null hypotheses, false report probability is likely to exceed 50% for the whole literature. In light of our findings, the recently reported low replication success in psychology is realistic, and worse performance may be expected for cognitive neuroscience.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures





Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source doesn’t support the claim as written.
In the citing paper
“Despite methodological challenges10–11, many of the findings of cognitive neuroscience provide a solid basis on which to build.”
From Cognitive computational neuroscience (2018) · cites this paper as [10]
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“In several disciplines, the average statistical power of studies was found to be significantly below the recommended 80% level (13 -16).”
From Is science really facing a reproducibility crisis, and do we need it to? (2018) · cites this paper as [14]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“such studies showed that power varies widely between subfields or methodologies”
From Is science really facing a reproducibility crisis, and do we need it to? (2018) · cites this paper as [14]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“For most published research findings to be false in psychology and neuroscience, for example, one must assume that the hypotheses tested in these disciplines are correct much less than 50% of the time (14, 18).”
From Is science really facing a reproducibility crisis, and do we need it to? (2018) · cites this paper as [14]
The cited source says what the claim attributes to it.
In the citing paper
“and has contributed, in part, to the replication crisis in other fields (Button et al., 2013; Szucs and Ioannidis, 2017; Ioannidis et al., 2017).”
From With Little Power Comes Great Responsibility (2020) · cites this paper as Szucs and Ioannidis, 2017
2 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · PLoS Medicine · doi:10.1371/journal.pmed.0020124 · Cited by 10,505
Self-citationEstimating the reproducibility of psychological science
Open Science Collaboration (2015) · Science · doi:10.1126/science.aac4716 · Cited by 8,515
Power failure: why small sample size undermines the reliability of neuroscience
Button, K. S., Ioannidis, J. P. A., Mokrysz, C., Nosek, B. A., Flint, J., Robinson, E. S. J., & Munafò, M. R. (2013) · Nature Reviews Neuroscience · doi:10.1038/nrn3475 · Cited by 7,641
Self-citationSimmons, J. P., Nelson, L. D., & Simonsohn, U. (2011) · Psychological Science · doi:10.1177/0956797611417632 · Cited by 6,567
Methods of Meta-Analysis: Correcting Error and Bias in Research Findings
Schmidt, F. L., & Hunter, J. E. (2015) · doi:10.4135/9781483398105 · Cited by 5,542
Effect size estimates: Current use, calculations, and interpretation.
Fritz, C. O., Morris, P. E., & Richler, J. J. (2012) · Journal of Experimental Psychology: General · doi:10.1037/a0024338 · Cited by 5,199
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · CHANCE · doi:10.1080/09332480.2005.10722754 · Cited by 4,702 · cited 9×
“…examined p value reporting errors in the cognitive neuroscience literature as recent studies found that 12.5% to 20% of psychology papers have major p value reporting errors which affect judgments about statistical significance (Bakker and Wicherts, 2011; Nuijten et al. 2015; Veldkamp et al. 2014).”
BackgroundMethodResultInfluentialSelf-citationCluster failure: why fMRI inferences for spatial extent have inflated false-positive rates
Eklund, A., Nichols, T. E., & Knutsson, H. (2016) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1602413113 · Cited by 3,487
Promoting an open research culture
Nosek, B. A., Alter, G., Banks, G. C., Borsboom, D., Bowman, S. D., Breckler, S. J., Buck, S., Chambers, C. D., Chin, G., Christensen, G., et al. (2015) · Science · doi:10.1126/science.aab2374 · Cited by 2,708
Circular analysis in systems neuroscience: the dangers of double dipping
Kriegeskorte, N., Simmons, W. K., Bellgowan, P. S. F., & Baker, C. I. (2009) · Nature Neuroscience · doi:10.1038/nn.2303 · Cited by 2,696
Cited by
Items 701–787 of 787
Hirschfeld, R. M. A., & Bowden, C. L. (2024) · American Psychiatric Association Publishing eBooks · doi:10.1176/appi.books.9781615375523.as38
Almeida, J., Spelber, D., & Smith, T. L. (2024) · American Psychiatric Association Publishing eBooks · doi:10.1176/appi.books.9781615375523.as37 · Cited by 2
Chapter 46. Electroconvulsive Therapy and Other Neuromodulation Therapies
McDonald, W. M., Meeks, T. W., McCall, W. V., & Zorumski, C. F. (2024) · American Psychiatric Association Publishing eBooks · doi:10.1176/appi.books.9781615375523.as46 · Cited by 1
Citrome, L. (2024) · American Psychiatric Association Publishing eBooks · doi:10.1176/appi.books.9781615375523.as34
Chapter 36. Management of Psychiatric Medication–Induced Movement Disorders
Marsh, L. (2024) · American Psychiatric Association Publishing eBooks · doi:10.1176/appi.books.9781615375523.as36
Harvey, P. D. (2024) · American Psychiatric Association Publishing eBooks · doi:10.1176/appi.books.9781615375523.as33
Cummings, J. L. (2024) · American Psychiatric Association Publishing eBooks · doi:10.1176/appi.books.9781615375523.as35
Chapter 47. Psychedelic Drugs as Treatments in Psychiatry
Nutt, D. J., & Erritzøe, D. (2024) · American Psychiatric Association Publishing eBooks · doi:10.1176/appi.books.9781615375523.as47
Chapter 5. Brain–Immune System Interactions
Dhabhar, F. S., Raison, C. L., & Miller, A. H. (2024) · American Psychiatric Association Publishing eBooks · doi:10.1176/appi.books.9781615375523.as05
Chapter 1. Basic Principles of Molecular Biology and Genomics
Wahlestedt, C., Rasenick, M. M., Yu, J.-Z., & Zeier, Z. R. (2024) · American Psychiatric Association Publishing eBooks · doi:10.1176/appi.books.9781615375523.as01
Chapter 48. Treatment of Depression
Collier, S. J., & Nemeroff, C. B. (2024) · American Psychiatric Association Publishing eBooks · doi:10.1176/appi.books.9781615375523.as48
Chapter 2. Neurotransmitters, Receptors, and Transporters
Berg, K. A., Clarke, W. P., Daws, L. C., Frazer, A., Girotti, M., & Lodge, D. J. (2024) · American Psychiatric Association Publishing eBooks · doi:10.1176/appi.books.9781615375523.as02
Chapter 43. Agents for Neurocognitive Disorders
Ayers, G. M., & Brown, F. W. (2024) · American Psychiatric Association Publishing eBooks · doi:10.1176/appi.books.9781615375523.as43
Chapter 44. Sedative-Hypnotics
Nishino, S., Ono, T., Nishino, N., Sakai, N., & Mignot, E. J.-M. (2024) · American Psychiatric Association Publishing eBooks · doi:10.1176/appi.books.9781615375523.as44
Chapter 7. Neuroimaging and Psychiatry
Paulus, M. P., & Guinjoan, S. (2024) · American Psychiatric Association Publishing eBooks · doi:10.1176/appi.books.9781615375523.as07
Chapter 9. Machine Learning in Psychopharmacology
Galatzer‐Levy, I. R., & Abbas, A. (2024) · American Psychiatric Association Publishing eBooks · doi:10.1176/appi.books.9781615375523.as09
Chapter 45. Psychostimulants and Wakefulness-Promoting Agents
DeBattista, C. (2024) · American Psychiatric Association Publishing eBooks · doi:10.1176/appi.books.9781615375523.as45
Chapter 51. Treatment of Posttraumatic Stress Disorder
Nemeroff, C. B., Rosen, V., & Ortiz, N. F. (2024) · American Psychiatric Association Publishing eBooks · doi:10.1176/appi.books.9781615375523.as51
Enhancing Replication Research in Developmental Coordination Disorder
Ruddock, S., Petridis, L., & Rahimi‐Golkhandan, S. (2024) · Current Developmental Disorders Reports · doi:10.1007/s40474-024-00310-1
The Promise and Pitfalls of Studying the Neurophysiological Correlates of Automatic Imitation
Darda, K. M., & Ramsey, R. (2024) · Springer eBooks · doi:10.1007/978-3-031-62634-0_6
Bayes factors cannot provide evidence for the null hypothesisPreprint
Fields, E. C. (2024) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/d6u5p_v4
Mitä toistettavuuskriisistä pitäisi ajatella? Kymmenen suomalaistutkijaa sähköpostihaastattelussa
Heino, M., Ilmarinen, V., Leikas, S., Lipsanen, J. O., Lönnqvist, J., Olkkonen, M., Palosaari, E. J., Renvik, T. A., Saurio, K. J., & Silfver-Kuhalampi, M. (2025) · Psykologia · doi:10.62443/psykologia.v54i6.143375 · Cited by 1
How Transparent and Reproducible Are Studies That Use Animal Models of Opioid Addiction?
Blackwell, J. C., Beitner, J., & Holcombe, A. O. (2025) · Addiction Biology · doi:10.1111/adb.70027
Are Most Published Research Findings False In A Continuous Universe?Preprint
Neves, K., Tan, P. B., & Amaral, O. B. (2021) · MetArXiv (OSF Preprints) · doi:10.31222/osf.io/jk7sa_v1
Practical solutions for sharing data and materials from psychological researchPreprint
Gilmore, R. O., Kennedy, J. L., & Adolph, K. E. (2017) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/kew8u_v1
Ethical and legal implications of the methodological crisis in neuroimagingPreprint
Kellmeyer, P. (2017) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/2gehg_v1
Changing Practices and Priorities in Social Psychological Research Methods and Reporting
Giner‐Sorolla, R. (2025) · doi:10.70400/zutf8520 · Cited by 2
Marzuki, A. A., Gloy, K., Kandler, C., Phon-Amnuaisuk, P., Jenkins, M. A., Garrison, K., Tullett, A. M., Wahlers, J. N., Akin, K., Arriaga, P., et al. (2023) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/39vqj_v1
Estimating power in (generalized) linear mixed models: an open introduction and tutorial in R.Preprint
Kumle, L., Võ, M. L. ‐., & Draschkow, D. (2025) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/vxfbh_v2
Pedophilia and hand preference: A meta-analysis
Stein, C. C., Schiffer, B., Παπαδάτου-Παστού, Μ., & Packheiser, J. (2025) · Laterality Asymmetries of Body Brain and Cognition · doi:10.1080/1357650x.2025.2535353
“Sensitivity analyses were also conducted using d = 0.5 (medium effect) and d = 0.787 (the default prior in JASP and around the average effect size in cognitive neuroscience, Szucs & Ioannidis, 2017).”
InfluentialMelo, B. G. D. S. O., de Araujo, V. M. U., de Araújo, I. C., de Santos, A. S., & Pinto, P. H. R. (2025) · Anais do Workshop sobre as Implicações da Computação na Sociedade (WICS) · doi:10.5753/wics.2025.8556
MNM: Multi-level Neuroimaging Meta-analysis with Hyperbolic Brain-Text Representations
Baek, S., Lee, J., Sim, J., Jeong, M., & Kim, W. H. (2025) · Lecture notes in computer science · doi:10.1007/978-3-032-04927-8_38
“However, neuroimaging studies are often underestimated due to small sample sizes of their experiments [3,20].”
Volfikova, K., Tomeček, D., Španiel, F., Tintěra, J., Rydlo, J., & Hlinka, J. (2025) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2025.10.10.681418 · Cited by 1
Stehr, D. A., Zhang, Y., Patgiri, A., Kidder, A., Kay, K., & Duchaine, B. (2025) · eLife · doi:10.7554/elife.108657
Schoenherr, J. R. (2025) · Elsevier eBooks · doi:10.1016/b978-0-323-90509-1.00037-0
It’s all About Power: Sample Size Considerations for Comparative Studies Using Survey Data
Chen, M. Y., & Pullman, A. (2021) · Emerald Group Publishing Limited eBooks · doi:10.1108/978-1-64802-604-120251011
The Overlap Area as a Novel Measure of Effect Size in Neuroscience ResearchPreprint
Wu, Y., Woods, H., Yuan, K., Dominic, D., Qiu, Z., & Grant, S. G. N. (2025) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.64898/2025.12.13.694093
Umiltà, A. M. (2021) · doi:10.11575/prism/39417 · Cited by 1
Can AI-generated faces serve as fillers in eyewitness lineups?Preprint
Bergold, A. N., & Greenspan, R. L. (2024) · OSF Preprints (OSF Preprints) · doi:10.17605/osf.io/k8jaf
Ferraioli, F. (2024) · Preliminary Reports and Negative Results in Life Science and Humanities · doi:10.13129/3035-062x/prnr-4647
Tamura, K., Matsumoto, S., Tseng, Y. H., Kobayashi, T., Miwa, J., Miyazawa, K., Matsumoto, S., Hiramatsu, S., Otake, H., & Okamoto, T. (2022) · Figshare · doi:10.6084/m9.figshare.19607664
Assessment of the Predictive Power of Selected Sociologically Relevant Models
Reinhold, J. (2024) · DuEPublico (University of Duisburg-Essen) · doi:10.17185/duepublico/82538
Advancing theory and research on Open Science Practices in psychology
Torka, A. (2024) · Technische Universität Dortmund Eldorado (Technische Universität Dortmund) · doi:10.17877/de290r-24553
INTELLIGENCE AND THE STRUCTURES OF THE LINGUAL GYRI
Emil, N. (2023) · DiVA (Digitala Vetenskapliga Arkivet)
Les facteurs facilitant et perturbant la formation des mémoires
Hamel, R. (2021) · Knowledge UdeS (Institutional Deposit of the University of Sherbrooke)
Cross-Temporal Meta-Analysis: A Conceptual and Empirical CritiquePreprint
Zacher, H., Rudolph, C. W., & Costanza, D. (2019) · OSF Preprints (OSF Preprints)
Westfal, M. (2024) · Kölner Universitäts PublikationsServer (Universität zu Köln)
Niven, E. C. (2023) · UCL Discovery (University College London)
Psicopatología y el problema epistémico de la filosofía de la mente
Bertolín Guillén, J. M. (2023) · Dialnet (Universidad de la Rioja)
Olofsson, S. (2024) · DiVA (Digitala Vetenskapliga Arkivet)
Lange, M., & Twumasi, R. (2022) · Research Portal (King's College London) · Cited by 1
The paddle effect on speed perception: A multilevel Bayesian meta-analysis
Luo, W., Zhang, L., & Yamada, Y. (2026) · Psychonomic Bulletin & Review · doi:10.3758/s13423-026-03011-5
“For the overall effect size (α), which represents the model’s grand intercept, we assigned a Normal distribution, α ∼ Normal(0, 1), considering that effect sizes in psychological research typically range from 0 to 1.5 (Szucs & Ioannidis, 2017).”
InfluentialAssessing Questionable and Responsible Research Practices in Psychology Master’s Theses
Augusteijn, H. E. M., van Assen, M. A. L. M., Sijtsma, K., & Wicherts, J. M. (2026) · Behavioral Sciences · doi:10.3390/bs16010110 · Cited by 1
“Effect sizes within psychology are relatively small, usually between small and medium (Gignac & Szodorai, 2016; Hartgerink et al., 2017; Nuijten et al., 2020; Open Science Collaboration, 2015; Szucs & Ioannidis, 2017).”
Bruera, A., & Hartwigsen, G. (2026) · Neurobiology of Language · doi:10.1162/nol.a.244
“…significant, we set the threshold at p < 0.05; however, to avoid false positives, we complement it with thresholds for effect sizes tailored to the cognitive neuroscience literature (Szucs & Ioannidis, 2017), following recent recommendations (Correll et al., 2020; Schäfer & Schwarz, 2019).”
InfluentialNeuroscience and the Non-Elimination of Theology
Knox, P. (2026) · Religions · doi:10.3390/rel17020236
“Based on an extensive statistical analysis of the psychology literature, Szucs and Ioannidis (2017) estimated that the “false report probability is likely to exceed 50% for the whole literature” with worse performance expected for the cognitive neuroscience literature.”
Expectation Modulates Hedonic Experiences and Midbrain Responses to Sweet Flavor
Mainetto, E., Westwater, M. L., Ziauddeen, H., Diederen, K. M. J., & Fletcher, P. C. (2026) · Journal of Neuroscience · doi:10.1523/jneurosci.1121-25.2026
“Due to a lack of available e ff ect size estimates, an a priori power analysis was not completed; however, the target sample size re fl ected recommendations for fMRI study sample sizes at the time of data collection (Poldrack et al., 2017; Szucs and Ioannidis, 2017).”
Zhang, H., Chen, B., & Shen, Y. (2026) · Eating Behaviors · doi:10.1016/j.eatbeh.2026.102082
Соціально-психологічні чинники професійного вигорання працівників сфери послуг
Стахурська, М. (2025) · eKNUTSHIR
Variance-calibrated cross-individual bootstrapping for small-sample neuroscience
Uyanik, I. (2026) · Scientific Reports · doi:10.1038/s41598-026-44126-y
Advances in automating analysis of neural time series data
Jas, M. (2018) · theses.fr (ABES) · doi:10.70675/71349a7fzd870z427cz8095z9dcde63e0b12
Machine Learning on Population Imaging for Mental Health
Dadi, K. (2020) · theses.fr (ABES) · doi:10.70675/7d83c22dz4462z4c77za228z80479d1476d1 · Cited by 1
Rolland, X. (2022) · theses.fr (ABES) · doi:10.70675/5b1d2250zbda7z4fb6z8549z332f95038cda · Cited by 1
Jung, U., Choi, K., Kim, S., Lee, J., & Sohn, D. (2026) · Brain and Environment · doi:10.1016/j.braen.2026.100019
Computational Psychiatry and Transdiagnostic Models of Mental Disorders: Confluences and Conflicts
Hallquist, M. N., Allen, T. A., Okan, A., Paolizzi, S. G., & Dombrovski, A. Y. (2026) · Oxford University Press eBooks · doi:10.1093/9780197769676.003.0018
Survey-Software Implicit Association Tests: A Methodological and Empirical AnalysisPreprint
Isenberg, N., Chakroff, A., Aguilar, S. J., LaBouff, J. P., Carpenter, T., Kouril, M., Pullig, C., & Pogacar, R. (2020) · OSF Preprints (OSF Preprints)
Estimating the Evidential Value of Significant Results in Psychological SciencePreprint
Szaszi, B., Pálfi, B., & Aczel, B. (2022) · OSF Preprints (OSF Preprints)
Neighborhood disadvantage and brain myelination: Insights from infancy to childhood
Shah, L., Bond, E., Planalp, E. M., DiPiero, M. A., Weaver, J., Perez, I. Q., Chen, K.-F., Frye, C. J., Kecskemeti, S., Alexander, A. L., et al. (2026) · Imaging Neuroscience · doi:10.1162/imag.a.1288 · Cited by 1
“…in this cohort, the multifactorial nature of early life disadvantage, and heterogeneity in children’s experiences ( Lopez et al., 2021), but are consistent with effect sizes commonly reported in neurodevelopmental research ( Bakker et al., 2019; Sch ä fer & Schwarz, 2019; Szucs & Ioannidis, 2017).”
975 Statistical power and power analysis in quantitative communication science
Sun, Y., & Qian, S. (2026) · De Gruyter eBooks · doi:10.1515/9783111087139-005
Polito, N. D., Gambarota, F., Hampson, E., & Herlitz, A. (2026) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2026.106877
Bilucaglia, M., Casiraghi, C., Russo, V., & Zito, M. (2026) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2026.1740368
Perquin, M. N., Daghlian, M., Perry, G., Singh, K. D., & Bompas, A. (2026) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.64898/2026.07.30.741808
Reporting of Statistical Results in the Field of Pain Research
Chinaka, T. (2025) · University of the Witwatersrand, Johannesburg Institutional Repository on DSpace (University of the Witwatersrand, Johannesburg)
Farran, E. K., Alexiou, S., Danielsson, H., Orefice, C., Cristescu, L., Pellicano, E., Herwegen, J. V., & Scerif, G. (2026) · British Journal of Developmental Psychology · doi:10.1111/bjdp.70065
Cubillos-Pinilla, L., Balthazard, P. A., Quimbayo, G., Emmerling, F., & Peus, C. V. (2026) · Small Business Economics · doi:10.1007/s11187-026-01263-y
Grounding meaning in social and emotional experience: Challenges and opportunities
Solana, P. (2026) · Cortex · doi:10.1016/j.cortex.2026.09.002
The role of measurement practices in the replicability of empirical findings
Böhm, C. M. (2026) · Publication Server of Kaiserslautern University of Technology (Kaiserslautern University of Technology) · doi:10.26204/kluedo/13582
Irta, A. Z., & Kurniawan, R. (2026) · UNP Journal of Statistics and Data Science · doi:10.24036/ujsds/vol4-iss3/507
Person, A. I., & Syed, M. (2026) · Advances in Methods and Practices in Psychological Science · doi:10.1177/25152459261474853
“Importantly, small sample sizes—a frequently cited reason for the lack of generalizability of qualitative stud-ies—are also not relegated to qualitative research given that most quantitative studies are statistically underpow-ered (Szucs & Ioannidis, 2017).”
Grundy, J. G., Yurtsever, A., & Sotebeer, K. N. (2026) · Bilingualism Language and Cognition · doi:10.1017/s1366728926101552
Dottori, M., Sedeño, L., Caro, M. M., Alifano, F., Hesse, E., Mikulan, E., García, A. M., Torregrosa, M. C., Muñoz, É., Ruiz‐Tagle, A., et al. (2019) · Cuadernos de neuropsicología
Mapulanga, T., & Jita, L. C. (2026) · European Journal of Science and Mathematics Education · doi:10.30935/scimath/19500
Fali, I. M., & Nnenna, E. C. (2026) · Qubahan Journal of Coaching and Sports Sciences · doi:10.48161/qjcs.v4n4a90
“Szucs and Ioannidis reported limitations in effect sizes and power across parts of the cognitive neuroscience and psychology literature [30].”
Feng, X., Zhang, L., & Lu, C. (2026) · Educational Research Review · doi:10.1016/j.edurev.2026.100866
Beyond Methodological Constraints: A Multilevel Framework for Evaluating Scientific Credibility
Syrjänen, P., & Rubin, M. (2026) · Review of General Psychology · doi:10.1177/10892680261503129
Metadata
- Authors
- Szucs, D., & Ioannidis, J. P. A.
- Affiliations
- Stanford Medicine (US)
- Venue
- PLOS Biology
- Publisher
- Public Library of Science (PLoS)
- Published
- 2017-03-02
- Volume
- 15
- Issue
- 3
- Pages
- e2000797
- ISSN
- 1544-9173 (ISSN-L)
- 1545-7885
- PMC
- PMC5333800
- OpenAlex
- W2951081425
- Cited by
- 761
- References
- 62
- Citations by year
- 2026: 28 · 2025: 43 · 2024: 120 · 2023: 75 · 2022: 80 · 2021: 76 · 2020: 94 · 2019: 102 · 2018: 91 · 2017: 46
- FWCI
- 81.43
- Type
- journal article
- Language
- en
- Update notices
- correction (2021-03-05)
- Open access
- gold
- doi.org
- Licence
- Locations
- PLoS Biology (publishedVersion, cc-by)
- bioRxiv (Cold Spring Harbor Laboratory) (acceptedVersion, cc-by-nc-nd)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- Figshare (submittedVersion, cc-by)
- Apollo (University of Cambridge) (submittedVersion, cc-by)
- Apollo (cc-by)
- Funders
- James S. McDonnell Foundation (220020370)
- Universiteit van Tilburg
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Keywords
- effect size, statistical power, cognitive neuroscience, psychology literature, sample size, replication success, journal impact factor, null hypothesis, publication bias, statistical records
- MeSH terms
- Cognitive Neuroscience, Humans, Probability, Psychology, Publications, Surveys and Questionnaires, Empirical Research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.