A Bayesian Perspective on the Reproducibility Project: Psychology
Open accessThe DOI matches its Crossref record; 37 of the 37 references it cites were found in a registry or an index.
Abstract
We revisit the results of the recent Reproducibility Project: Psychology by the Open Science Collaboration. We compute Bayes factors-a quantity that can be used to express comparative evidence for an hypothesis but also for the null hypothesis-for a large subset (N = 72) of the original papers and their corresponding replication attempts. In our computation, we take into account the likely scenario that publication bias had distorted the originally published results. Overall, 75% of studies gave qualitatively similar results in terms of the amount of evidence provided. However, the evidence was often weak (i.e., Bayes factor < 10). The majority of the studies (64%) did not provide strong evidence for either the null or the alternative hypothesis in either the original or the replication, and no replication attempts provided strong evidence in favor of the null. In all cases where the original paper provided strong evidence but the replication did not (15%), the sample size in the replication was smaller than the original. Where the replication provided strong evidence but the original did not (10%), the replication sample size was larger. We conclude that the apparent failure of the Reproducibility Project to replicate many target effects can be adequately explained by overestimation of effect sizes (or overestimation of evidence against the null hypothesis) due to small sample sizes and publication bias in the psychological literature. We further conclude that traditional sample sizes are insufficient and that a more widespread adoption of Bayesian methods is desirable.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures


Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“reanalyses of the data suggest that reproducibility in psychological science might be higher than originally claimed (23, 26, 27).”
From Is science really facing a reproducibility crisis, and do we need it to? (2018) · cites this paper as [27]
In the citing paper
“Second, and more importantly, because how reproducibility ought to be measured is the subject of a growing methodological and philosophical debate”
From Is science really facing a reproducibility crisis, and do we need it to? (2018) · cites this paper as [27]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(1972) · Cited by 17,806
Kass, R. E., & Raftery, A. E. (1995) · Journal of the American Statistical Association · doi:10.1080/01621459.1995.10476572 · Cited by 12,558
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · PLoS Medicine · doi:10.1371/journal.pmed.0020124 · Cited by 10,505
The file drawer problem and tolerance for null results.
Rosenthal, R. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.3.638 · Cited by 9,068 · cited 2×
“Studies that do not meet the criteria 57 are relegated to lab file drawers [9].”
Estimating the reproducibility of psychological science
Open Science Collaboration (2015) · Science · doi:10.1126/science.aac4716 · Cited by 8,515
Power failure: why small sample size undermines the reliability of neuroscience
Button, K. S., Ioannidis, J. P. A., Mokrysz, C., Nosek, B. A., Flint, J., Robinson, E. S. J., & Munafò, M. R. (2013) · Nature Reviews Neuroscience · doi:10.1038/nrn3475 · Cited by 7,641 · cited 1×
“…research designs undermine the credibility of statistically significant results in addition to increasing the probability of nonsignificant ones (see (Button et al., 2013) and the references therein for a detailed argument); furthermore, low-powered studies generally provide only small amounts of…”
The American Psychological Association
Langfeld, H. S. (1919) · Science · doi:10.1126/science.49.1254.51 · Cited by 7,475
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · CHANCE · doi:10.1080/09332480.2005.10722754 · Cited by 4,702 · cited 2×
“These two weaknesses of our field have conspired 285 to create a literature that is rife with false alarms [27].”
Bayesian t tests for accepting and rejecting the null hypothesis
Rouder, J. N., Speckman, P. L., Sun, D., Morey, R. D., & Iverson, G. (2009) · Psychonomic Bulletin & Review · doi:10.3758/pbr.16.2.225 · Cited by 3,688 · cited 1×
“Our prior expectation regarding the 82 effect size under HA is represented by a normal distribution centered on zero with 83 variance equal to 1 (this is a unit information prior, which carries a weight equivalent to 84 approximately one observation [17]).”
Bayesian statistical inference for psychological research.
Edwards, W., Lindman, H., & Savage, L. J. (1963) · Psychological Review · doi:10.1037/h0044139 · Cited by 1,734 · cited 1×
“306 Decades of reliance on orthodox statistical inference—which is known to overstate 307 the evidence against a null hypothesis [29–32]—have obfuscated the widespread problem 308 of small samples in psychological studies in general and in replication studies specifically.”
Research works printed but not linked: 1
- Jeffreys H. Theory of Probability. 1st ed Oxford, UK: Oxford University Press; 1939.
Cited by
Items 201–293 of 293
Replicability and Meta-Analysis
Schauer, J. M. (2022) · Springer eBooks · doi:10.1007/978-3-031-04968-2_14 · Cited by 3
What’s Wrong with Replicating the Old Boys’ Networks?
Teele, D. L. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519.016 · Cited by 2
Gerring, J. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519.013 · Cited by 2
Lieberman, E. S. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519.003 · Cited by 3
Dissertation R.C.M. van AertPreprint
van Aert, R. C. M. (2018) · MetArXiv (OSF Preprints) · doi:10.31222/osf.io/eqhjd · Cited by 3
The sceptical Bayes factor for the assessment of replication successPreprint
Pawel, S., & Held, L. (2020) · Zurich Open Repository and Archive (University of Zurich) · doi:10.5167/uzh-196009 · Cited by 2
Weigard, A. S., Matzke, D., Tanis, C. C., & Heathcote, A. (2021) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2021.07.26.453872 · Cited by 2
“…importance of large, population-based samples for bolstering the reproducibility of behavioral and neuroscientific research (Button et al., 2013; Etz & Vandekerckhove, 2016; Falk et al., 2013; Loken & Gelman, 2017; Marek et al., 2020; Poldrack & Gorgolewski, 2014; Szucs & Ioannidis, 2020), the…”
BackgroundDaily and Non-daily Smokers: A Profile of Drive and Cognitive Control MechanismsPreprint
Bartlett, J. E. (2021) · Thesis Commons (OSF Preprints) · doi:10.31237/osf.io/h9gpe · Cited by 2
Bradley, S. H., DeVito, N., Lloyd, K. E., Richards, G. C., Rombey, T., Wayant, C., & Gill, P. J. (2020) · MetArXiv (OSF Preprints) · doi:10.31222/osf.io/jy37f · Cited by 2
New statistical metrics for multisite replication projectsPreprint
Mathur, M. B., & VanderWeele, T. J. (2017) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/w89s5 · Cited by 4
Improving the Replicability of Psychological Science Through PedagogyPreprint
Frank, M. C. (2016) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/p73he · Cited by 2
van Aert, R. C. M., & van Assen, M. A. L. M. (2017) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/ft3tu · Cited by 2
Investigating the relationship between the Bayes factor and the separation of credible intervals
Wei, Z., Nathoo, F. S., & Masson, M. E. J. (2023) · Psychonomic Bulletin & Review · doi:10.3758/s13423-023-02295-1 · Cited by 2
“Even established researchers can sometimes misinterpret p -values and can, as a result, fail to replicate their studies and properly interpret their results (Etz & Vandekerckhove, 2016).”
Wang, N. (2025) · Journal of Public Child Welfare · doi:10.1080/15548732.2025.2585273 · Cited by 1
Kuppelin, M., Goetsch, T., Elbel, M., Laugel, M., Isner-Horobeti, M.-È., & Krasny‐Pacini, A. (2026) · Disability and Rehabilitation · doi:10.1080/09638288.2026.2655107 · Cited by 2
“The practical advantages of Bayesian methods are now recognised, especially within designs with small sample sizes [63].”
Valdenegro, D., Yan, J., Dai, D., & Rahal, C. (2026) · Patterns · doi:10.1016/j.patter.2026.101609 · Cited by 3
“…a stronger emphasis on replication (Edlund et al., 2022), improved statistical power (Head et al., 2015; Benjamin et al., 2018), the adoption of Bayesian inference (Etz and Vandekerckhove, 2016), and a shift towards predictive modeling as an evaluation tool (Verhagen, 2024; Rahal et al., 2022).”
Schwarzkopf, D. S. (2018) · Cortex · doi:10.1016/j.cortex.2018.10.031 · Cited by 1
“Even for some of the major replication efforts (Open Science Collaboration, 2015), both the original results as well as the replications actually provided only inconclusive evidence (Etz & Vandekerckhove, 2016).”
ResultA New Psychology for a New Society: How Psychology Can Profit from Science and Technology Studies
Sørensen, E. (2019) · Springer eBooks · doi:10.1007/978-3-030-25308-0_9 · Cited by 1
Reproducibility of Survey Results: A New Method to Quantify Similarity of Human Subject Pools
Khamesi, A. R., Musmeci, R., Silvestri, S., & Baker, D. A. (2020) · Globecom · doi:10.1109/globecom42002.2020.9348076 · Cited by 1
“This project has significantly captured the attention of the scientific community [19], [20].”
BackgroundMethodMaking our “meta-hypotheses” clear: heterogeneity and the role of direct replications in science
Strømland, E. (2021) · European Journal for Philosophy of Science · doi:10.1007/s13194-021-00348-7 · Cited by 1
“…on meta-analysis (Braver et al., 2014; Cumming, 2014), making statistical inferences more stringent (Benjamin et al., 2018), abandoning statistical significance altogether (Amhrhein et al., 2019; McShane et al., 2019) and a shift towards Bayesian statistics (e.g. Etz & Vandekerckhove, 2016).”
BackgroundOpen Science and Clinical Psychology
Linthicum, K. P., Southward, M. W., & Schleider, J. L. (2021) · Elsevier eBooks · doi:10.1016/b978-0-12-818697-8.00165-5 · Cited by 2
Hari, R., & Puce, A. (2017) · Oxford University Press eBooks · doi:10.1093/med/9780190497774.003.0021 · Cited by 1
Statistical Assumptions and Reproducibility in Psychology: Data Mining Based on Open Science
Zhang, W., Shu, Y., Tian, B., & Fei, D. (2022) · Frontiers in Psychology · doi:10.3389/fpsyg.2022.905977 · Cited by 2
“The estimation for the number of replication series as multiple tests is at least 197–375 using the model in (Hung and Fithian, 2020), This calculation is roughly in the same magnitude as the lower bound estimated by the Bayesian model (Etz and Vandekerckhove, 2016; van Aert and van Assen, 2016).”
MethodKara, E. (2023) · Anadolu Journal Of Educational Sciences International · doi:10.18039/ajesi.1240655 · Cited by 1
Bayesian Analysis on a Noncentral Fisher–Student’s Hypersphere
Blanc, R. L. (2018) · The American Statistician · doi:10.1080/00031305.2017.1377111 · Cited by 2
BAYESOV FAKTOR: OPIS I RAZLOZI ZA UPOTREBU U PSIHOLOŠKIM ISTRAŽIVANJIMA
Lakić, S. (2019) · ГОДИШЊАК ЗА ПСИХОЛОГИЈУ · doi:10.46630/gpsi.18.2019.03 · Cited by 2
Gerring, J., Mahoney, J., & Elman, C. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519.018 · Cited by 2
Gerring, J., & Cojocaru, L. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519.005 · Cited by 1
Gerring, J. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519.014 · Cited by 2
Gross, N., & Robertson, C. T. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519.017 · Cited by 2
On the importance of modeling the invisible world of underlying effect sizes
Wilson, B. M., & Wixted, J. T. (2023) · Social Psychological Bulletin · doi:10.32872/spb.9981 · Cited by 2
“Our model-based analysis is in some ways consistent with the Bayesian analysis of the OSC2015 findings conducted by Etz and Vandekerckhove (2016).”
BackgroundResultA mathematical theory of knowledge, science, bias and pseudosciencePreprint
Fanelli, D. (2016) · doi:10.7287/peerj.preprints.1968v1 · Cited by 1
The Solution to Science's Replication CrisisPreprint
Knuteson, B. (2016) · SSRN Electronic Journal · doi:10.2139/ssrn.2835131 · Cited by 2
Robust Tests of Theory With Randomly Sampled ExperimentsPreprint
Vandekerckhove, J., Baribault, B., Donkin, C., Little, D. R., Trueblood, J. S., Oravecz, Z., van Ravenzwaaij, D., & White, C. N. (2017) · OSF Preprints (OSF Preprints) · Cited by 1
Self-citationResearch on Research: A Meta-Scientific Study of Problems and Solutions in Psychological SciencePreprint
Nuijten, M. B. (2018) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/qtk7e · Cited by 1
Crossey, B. P. (2018) · University of Birmingham Institutional Research Archive (University of Birmingham) · Cited by 1
Bayesian evaluation of replication studiesPreprint
Leplaa, H. J., Rietbergen, C., & Hoijtink, H. J. A. (2020) · doi:10.31234/osf.io/49tbz · Cited by 1
Meta-studies for robust tests of theoryPreprint
Baribault, B., Donkin, C., Little, D. R., Trueblood, J. S., Oravecz, Z., van Ravenzwaaij, D., White, C., de Boeck, P. A. L., & Vandekerckhove, J. (2017) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/g84py · Cited by 2
Self-citationSpatial direction comprehension is guided by efficient allocation of space-based attentionPreprint
Barnas, A. J., Ebner, N. C., & Weisberg, S. M. (2022) · doi:10.31234/osf.io/uwhq9 · Cited by 1
The replication crisis, context sensitivity, and the Simpson’s (Paradox)Preprint
Brief, P. (2016) · doi:10.15200/winn.146839.98275
Preprint of Too good to be false: Nonsignificant results revisitedPreprint
Hartgerink, C. H. J., Wicherts, J. M., & van Assen, M. A. L. M. (2016) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/rkumy · Cited by 1
Beyond p-values: Utilizing Multiple Estimates to Evaluate EvidencePreprint
Valentine, K. D., Buchanan, E. M., Scofield, J. E., & Beauchamp, M. T. (2017) · doi:10.31219/osf.io/9hp7y
Research Integrity in Public Health
Gorman, D. M. (2018) · Oxford University Press eBooks · doi:10.1093/obo/9780199756797-0189
Statistical methods for evidence synthesisPreprint
Mathur, M. B., & VanderWeele, T. J. (2018) · Thesis Commons (OSF Preprints) · doi:10.31237/osf.io/kd6ja
“, [36, 115]) recommend using Bayes factors to quantify evidence for and against the null hypothesis.”
BackgroundMethodPosterior predictive model checking of local misfit for Bayesian Confirmatory factor analysis
Au, C. H. (2018) · JMU Scholoraly Commons (James Madison University)
The Solution to Science's Replication CrisisPreprint
Knuteson, B. (2016) · RePEc: Research Papers in Economics · doi:10.48550/arxiv.1609.03223 · Cited by 1
Meta Research: Replication of Significant Results --- Modeling the Effects of p-HackingPreprint
Ulrich, R., & Miller, J. O. (2020) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/tu7zr · Cited by 1
Preprint of: "Redefine or Justify? Comments on the alpha debate"Preprint
de Ruiter, J. P. (2018) · doi:10.31234/osf.io/rbm8y
Psychological science from 'publish or perish' to 'trust but verify'
Keljanović, A. (2021) · Zbornik radova Filozofskog fakulteta u Pristini · doi:10.5937/zrffp51-24851
Liao, T. F. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519.004
Do red objects enhance sexual attractiveness? No evidence from two large replicationsPreprint
Pollet, T. V., Costello, J., Groeneboom, L., Peperkoorn, L. S., & Wu, J. (2018) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/3bfwh
Caplan, A. L., & Redman, B. K. (2018) · Springer eBooks · doi:10.1007/978-3-319-51358-4_3
de Winter, J., & Dodou, D. (2017) · SpringerBriefs in applied sciences and technology · doi:10.1007/978-3-319-56964-2_3
Elman, C., Gerring, J., & Mahoney, J. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519.019
Basehore, Z. (2017) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/hp53k
Replication and Reproducibility: Concepts, Controversies, Crises and Solutions
(2017) · The Behavior Analyst · doi:10.1007/s40614-017-0116-7
“…replication and reproducibility “crisis” in many scientific fields including economics (Chang & Li, 2015), medicine (Ioannidis, 2005) and psychology (Etz & Vandekerckhove, 2016; Open Science Collaboration, 2015) in which researchers have reported difficulty replicating many well-known findings.”
BackgroundScaling the slippery slopePreprint
Basehore, Z. (2017) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/ubebt
Moral cognition about harm in anxiety disordersPreprint
Patil, I., Larsen, E. M., Kichic, R., & Gleichgerrcht, E. L. (2018) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/g5p7v
Schmid, B. (2020) · Faculty Opinions – Post-Publication Peer Review of the Biomedical Literature · doi:10.3410/f.736726087.793578052
Almgren, H., Parsons, N., Bossche, S. V. D., & Marinazzo, D. (2020) · MetArXiv (OSF Preprints) · doi:10.31222/osf.io/9hg3j
What's Wrong with Scientific Publishing, and How We Can Fix ItPreprint
Smith, J. (2018) · SSRN Electronic Journal · doi:10.2139/ssrn.3129898
Witt_Criteria_For_Statistical_Significance_v1Preprint
Witt, J. K. (2018) · doi:10.31234/osf.io/x587f
Ashburn‐Nardo, L., Moss‐Racusin, C. A., Smith, J. L., Sanzari, C. M., Vescio, T. K., & Glick, P. (2022) · Frontiers in Psychology · doi:10.3389/fpsyg.2022.823147
“Of note, systematic investigations of replication studies suggest that the majority provide weak or inconclusive evidence for the reproducibility of the original findings (Etz and Vandekerckhove, 2016).”
BackgroundInterim Design Analysis Using Bayes Factor ForecastsPreprint
Stefan, A. M., Gronau, Q. F., & Wagenmakers, E. (2022) · doi:10.31234/osf.io/9sazk
[PhD Dissertation] Good Research PracticesPreprint
Sarafoglou, A. (2022) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/7aj5h
The p Value is a Poor Measure of Strength of Evidence in Multiple Sclerosis ResearchPreprint
Ma, J., Kalinčík, T., Sharmin, S., & Malpas, C. B. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4498419
Clark, K., Lindsay, A., Gilligan-Lee, K. A., de‐Wit, L., Scott‐Samuel, N. E., Azevedo, F., & Pennington, C. R. (2023) · doi:10.31234/osf.io/2qx6m
Re-assessing the role of operational definitions in psychologyPreprint
Kvam, P. D., & Alaukik, A. (2023) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/9tcd5
Yeaton, W. H., & Velasquez, G. (2022) · Journal of Methods and Measurement in the Social Sciences · doi:10.2458/jmmss.5793
Toward open science in PLS-SEM: Assessing the state of the art and future perspectivesPreprint
Adler, S. J., Sharma, P. N., & Radomir, L. (2023) · doi:10.31219/osf.io/sbpe9
Bayesian Evaluation of Replication Studies
Leplaa, H. J., Rietbergen, C., & Hoijtink, H. (2024) · Meta-Psychology · doi:10.15626/mp.2020.2554 · Cited by 1
Loft, S. D., Howard, Z. L., Pond, S., Irons, J. L., Michailovs, S., Swe, D. C., Bell, J., Visser, T. A. W., Pinniger, G. J., & Schmitt, M. (2025) · Ergonomics · doi:10.1080/00140139.2025.2470251 · Cited by 1
“…over another (e.g. a BF of 10 means one hypothesis is 10 times more likely than the other). the commonly reported standard of BF > 3 as ‘weak evidence’, BF > 5 as ‘moderate evidence’, BF > 10 as ‘strong evidence’, and BF > 100 as ‘very strong evidence’ (etz and Vandekerckhove 2016) is followed.”
University Professors and Inclusive Education: A Comparative Study Using a Bayesian Approach
González-Castellano, N., Ruiz, M. J. C., & Pozo, E. C. (2025) · International Journal of Disability Development and Education · doi:10.1080/1034912x.2025.2480619
“The Bayesian approach is noted for its flexibility, better accuracy in noisy data and small samples, less proneness to type I errors, and greater reliability (Etz & Vandekerckhove, 2016; J. K. Kruschke et al., 2012; Makowski et al., 2019a).”
Lu, F., Li, L., Wang, J., Chen, X., Yang, H., Li, X., Yao, L., & Liang, Z. (2025) · Frontiers in Neuroscience · doi:10.3389/fnins.2025.1576535 · Cited by 1
Anikin, A. (2025) · Psychonomic Bulletin & Review · doi:10.3758/s13423-025-02740-3
“…evidence in a meta-analysis produces excessively optimistic estimates of the true effect because unrealistically large effects are more likely to be observed by chance in small samples (Etz & Vandekerckhove, 2016; Forstmeier et al., 2017; Rothstein et al., 2005; Smaldino & McElreath, 2016).”
Statistics and Persuasion in Medicine
Osimani, B. (2025) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780197625835.013.0013
Lüdecke, D., Makowski, A. C., Klein, J., Ben-Shachar, M. S., & Makowski, D. (2026) · Frontiers in Psychology · doi:10.3389/fpsyg.2026.1856582 · Cited by 2
“These limitations include the inability of models to converge to a stable solution, lower accuracy in noisy data and small samples, and proneness to type-I errors (Etz and Vandekerckhove, 2016; Dienes and Mclatchie, 2018).”
Researcher Degrees of Freedom in the Psychology of ReligionPreprint
Bartlett, J. E., Uzdavines, A., Coleman, T. J., III, Messick, K. J., & Charles, S. J. (2018) · OSF Preprints (OSF Preprints)
Pollet, T. V., Fitzpatrick, B., Meziani, S., Pashley, E. M., & Sefcikova, E. (2026) · Personality and Individual Differences · doi:10.1016/j.paid.2026.113638
Neilson, D., Cutting, N., & Tecwyn, E. C. (2026) · Acta Psychologica · doi:10.1016/j.actpsy.2026.106396
Léonard, F., & Tirelli, E. (2026) · Journal of Trial and Error · doi:10.36850/34b0-42b1 · Cited by 1
Bona, S. D., Spoto, A., Caserotti, M., Lotto, L., Sarlo, M., Cellini, N., Cutini, S., & Bruno, G. (2026) · Frontiers in Psychology · doi:10.3389/fpsyg.2026.1770212
“…the null hypothesis reflects merely insufficient evidence or instead provides affirmative evidence for the (point) null hypothesis (Dienes, 2014), and clarify whether non-significant findings stem from inadequate evidential strength due to underpowered samples (e.g., Etz and Vandekerckhove, 2016).”
Griffioen, G., Tangen, Ä., Veldman, E. R., Svensson, J. E., Tiger, M., Nord, M., Andersson, M., Sorjonen, K., Varrone, A., Halldin, C., et al. (2026) · EJNMMI Research · doi:10.1186/s13550-026-01435-7
“The Bayes Factors for correlation ranged from 0.015 to 4.5, with the majority falling below 1/3 indicating moderate evidence in favor of the null-hypothesis [70].”
InfluentialHow to become a Bayesian in eight easy steps: An annotated reading listPreprint
Baribault, B., Vandekerckhove, J., Dablander, F., Etz, A., Gronau, Q. F., & Edelsbrunner, P. A. (2018) · OSF Preprints (OSF Preprints)
Self-citationPsychology’s RenaissancePreprint
Simonsohn, U., Nelson, L. D., & Simmons, J. P. (2022) · OSF Preprints (OSF Preprints)
Flexible Yet Fair: Blinding Analyses in Experimental PsychologyPreprint
Wagenmakers, E., Sarafoglou, A., & Dutilh, G. (2019) · OSF Preprints (OSF Preprints)
Estimating the Evidential Value of Significant Results in Psychological SciencePreprint
Szaszi, B., Pálfi, B., & Aczel, B. (2022) · OSF Preprints (OSF Preprints)
Costa, T. (2026) · Frontiers in Psychology · doi:10.3389/fpsyg.2026.1799078
Fundamentos de neuropsicología
Flóres-Lázaro, J. C. (2026) · Ediciones Comunicación Científica eBooks · doi:10.52501/cc.355
Kyobutungi, A., Obala, J., Whitney, C., Oluoch, W. A., & Tabuti, J. R. S. (2026) · Heliyon · doi:10.1016/j.heliyon.2026.e45470
Metadata
- Authors
- Etz, A., & Vandekerckhove, J.
- Affiliations
- University of Amsterdam (NL)
- University of California, Irvine (US)
- Corresponding author
- Etz, Alexander
- Vandekerckhove, Joachim
- Venue
- PLOS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2016-02-26
- Volume
- 11
- Issue
- 2
- Pages
- e0149794
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC4769355
- OpenAlex
- W2282205924
- Cited by
- 295
- References
- 37
- Citations by year
- 2026: 11 · 2025: 14 · 2024: 8 · 2023: 15 · 2022: 25 · 2021: 28 · 2020: 50 · 2019: 34 · 2018: 48 · 2017: 45 · 2016: 17
- FWCI
- 44.56
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- PLoS ONE (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- eScholarship (California Digital Library) (submittedVersion)
- Funders
- National Science Foundation (1230118, 48192, 1534472)
- John Templeton Foundation (1534472, 1230118, 48192)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
- Keywords
- Reproducibility Project: Psychology, replication study, Bayes factor, publication bias, small sample size, effect size overestimation, Bayesian hypothesis testing, Open Science Collaboration
- MeSH terms
- Bayes Theorem, Humans, Psychology, Research Design, Reproducibility of Results, Publication Bias, Sample Size
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.