The DOI matches its Crossref record; 40 of the 41 references it cites were found in a registry or an index.
Using Bayes factor hypothesis testing in neuroscience to establish evidence of absence
Open accessAbstract
Most neuroscientists would agree that for brain research to progress, we have to know which experimental manipulations have no effect as much as we must identify those that do have an effect. The dominant statistical approaches used in neuroscience rely on P values and can establish the latter but not the former. This makes non-significant findings difficult to interpret: do they support the null hypothesis or are they simply not informative? Here we show how Bayesian hypothesis testing can be used in neuroscience studies to establish both whether there is evidence of absence and whether there is absence of evidence. Through simple tutorial-style examples of Bayesian t-tests and ANOVA using the open-source project JASP, this article aims to empower neuroscientists to use this approach to provide compelling and rigorous evidence for the absence of an effect.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Although this is common practice, non-significant p-values are not sufficient evidence to claim the absence of an effect, as they may also reflect insufficient power to detect a small non-zero effect (Keysers et al. 2020).”
From Evidence for unconscious priming using a Bayesian single-subject approach (2026) · cites this paper as Keysers et al. 2020
In the citing paper
“including (1) the ability to obtain evidence in favor of the null hypothesis and discriminate between “absence of evidence” and “evidence of absence” (Dienes, 2014; Keysers, Gazzola, & Wagenmakers, 2020);”
From The JASP guidelines for conducting and reporting a Bayesian analysis (2021) · cites this paper as Keysers, Gazzola, & Wagenmakers, 2020
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. (2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 25,268
Kass, R. E., & Raftery, A. E. (1995) · Journal of the American Statistical Association · doi:10.1080/01621459.1995.10476572 · Cited by 12,558
Jeffreys, H., Moran, P. A. P., & Chatfield, C. (1922) · Nature · doi:10.1038/109132a0 · Cited by 7,877
Bayesian t tests for accepting and rejecting the null hypothesis
Rouder, J. N., Speckman, P. L., Sun, D., Morey, R. D., & Iverson, G. (2009) · Psychonomic Bulletin & Review · doi:10.3758/pbr.16.2.225 · Cited by 3,688
Redefine statistical significance
Benjamin, D. J., Berger, J. O., Johannesson, M., Nosek, B. A., Wagenmakers, E.-J., Berk, R., Bollen, K. A., Brembs, B., Brown, L., Camerer, C., et al. (2017) · Nature Human Behaviour · doi:10.1038/s41562-017-0189-z · Cited by 2,772
Self-citationUsing Bayes to get the most out of non-significant results
Dienes, Z. (2014) · Frontiers in Psychology · doi:10.3389/fpsyg.2014.00781 · Cited by 1,998
Statistics notes: Absence of evidence is not evidence of absence
Altman, D. G., & Bland, J. M. (1995) · BMJ · doi:10.1136/bmj.311.7003.485 · Cited by 1,946
Default Bayes factors for ANOVA designs
Rouder, J. N., Morey, R. D., Speckman, P. L., & Province, J. M. (2012) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2012.08.001 · Cited by 1,800
Bayesian Cognitive Modeling: A Practical Course
Lee, M. D., & Wagenmakers, E.-J. (2014) · doi:10.1017/cbo9781139087759 · Cited by 1,795
Self-citation
Research works printed but not linked: 3
- Jeffreys, H. Theory of Probability (Oxford University Press, 1961).
- Etz, A. & Wagenmakers, E.-J. J. B. S. Haldane’s contribution to the Bayes factor hypothesis test. Stat. Sci. 32, 313–329 (2017). · DOI
- Jeffreys, H. Theory of Probability (Oxford University Press, 1939).
Cited by
Sorted by citations
Items 601–652 of 652
Dissociable Effects of Early and Adolescent Adversity on Emotional ContagionPreprint
Maldonado, P. P., Berretta, E., Canicatti, V., Feng, X., Soyman, E., Cuturela, L., Sadeghi, M., Babiczky, Á., Goebel, G., Krugers, H. J., et al. (2026) · Research Square · doi:10.64898/2026.01.29.702530
Self-citationNeural representations of perceived engagement during action observation
Arcuri, E., Cerliani, L., Ardizzi, M., Langiulli, N., Ferroni, F., Keysers, C., Gazzola, V., & D, V. G. M. (2026) · NeuroImage · doi:10.1016/j.neuroimage.2026.121780
Self-citationQin, C., Nelissen, F., Waasdorp, R., Lotfi, A., Rojas, C., Angelis, L. D., Heemskerk, M., Maresca, D., Keysers, C., Heiles, B., et al. (2026) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.64898/2026.02.04.703701
Self-citationChang, H., Mistry, P. K., Zhang, Y., Schwartz, F., & Menon, V. (2026) · Journal of Neuroscience · doi:10.1523/jneurosci.2385-24.2025
The Effects of Acute Exercise on Memory: Considerations of the Backward Testing Effect
Patrick, Z., DuBois, S. L., Etnier, J. L., & Loprinzi, P. D. (2026) · Journal of Cognitive Enhancement · doi:10.1007/s41465-026-00349-5
Pascuzzo, K., Lanctôt, N., Perrin-Plouffe, R., Vézina, R., Turcotte, M., & Lemieux, A. (2026) · Children and Youth Services Review · doi:10.1016/j.childyouth.2026.108856
Magnitude estimation reveals Poisson-like noise underlying perceptionPreprint
Rodríguez-Arribas, C., López‐Moliner, J., & Linares, D. (2026) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.64898/2026.03.02.709083
Delhaye, E., Fritz, P., Martial, C., & Bastin, C. (2026) · Consciousness and Cognition · doi:10.1016/j.concog.2026.104036 · Cited by 1
Bott, F. S., Turgut, Ö., Zebhauser, P. T., Adhia, D. B., Ashar, Y. K., Day, M. A., Granovsky, Y., Jensen, M. P., Wager, T. D., Yarnitsky, D., et al. (2026) · medRxiv · doi:10.64898/2026.03.06.26347785
Sagehorn, M., Johnsdorf, M., Kisker, J., Gruber, T., & Schöne, B. (2026) · Experimental Brain Research · doi:10.1007/s00221-026-07266-1
Seeing race, stopping action: neural dynamics of face-based inhibitory control
Benedetti, V., de Lissa, P., Gavazzi, G., Giovannelli, F., Caldara, R., & Viggiano, M. P. (2026) · NeuroImage · doi:10.1016/j.neuroimage.2026.121856
Differential tractography suggests a “left-to-whole” white matter degeneration pattern in aging
Porcu, M., Cocco, L., Kumar, V. A., Suri, J. S., Mahammedi, A., Marrosu, F., & Saba, L. (2026) · Brain Imaging and Behavior · doi:10.1007/s11682-026-01115-z
Footstep sounds influence bistable biological motion perception
Qian, Q., Wei, X., Zhang, T., Wang, A., & Zhang, M. (2026) · Attention Perception & Psychophysics · doi:10.3758/s13414-026-03240-9
Guidetti, M., Cupello, S., Marceglia, S. R. F., Pagani, R., Biglioli, F., Bocci, T., Priori, A., & Previtera, A. M. (2026) · doi:10.2196/preprints.94305
Affective touch and face recognition: effects on memory and metacognitive performance
Bregulla, M., Packheiser, J., Merz, C. J., Echterhoff, G., & Scheele, D. (2026) · Scientific Reports · doi:10.1038/s41598-026-43969-9
Poncetti, N. F. (2024) · theses.fr (ABES) · doi:10.70675/be7611b0zec3az44e2z8d5dz4d630ec52b3e
Guidetti, M., Annaloro, S., Gallucci, S., Parazzini, M., Chiaramello, E., Grado, A. D., Marceglia, S. R. F., Morelli, N., Bologna, M., Priori, A., et al. (2026) · Research Square · doi:10.21203/rs.3.rs-9029217/v1
Friehs, M. A., Ferrante, M., Jung, H., Dechant, M., Frings, C., & Hartwigsen, G. (2026) · Cognitive Affective & Behavioral Neuroscience · doi:10.3758/s13415-026-01439-9
Judgments of learning modify memory even when made covertly or using a non-numerical scale
Halamish, V., Meer, Y., & Undorf, M. (2026) · Metacognition and Learning · doi:10.1007/s11409-026-09471-3
King, E., Beros, J. L., Fujiyama, H., Bindoff, A. D., Reynolds, J. N. J., & Tang, A. D. (2026) · Brain Communications · doi:10.1093/braincomms/fcag160 · Cited by 1
Motomura, Y., Iwayama, T., Ueda, T., Kajihara, M., & Momoi, T. (2026) · Journal of PHYSIOLOGICAL ANTHROPOLOGY · doi:10.1186/s40101-026-00431-z
Neural Correlates for Anticipating and Observing Goal‐Directed Actions in Autism
Krol, M. A., Skodova, T., & Jellema, T. (2026) · Autism Research · doi:10.1002/aur.70272
Huang, C., Zhou, X., Liu, F., Yang, B., ZHENG, Z., Li, X., Yin, Y., Luo, Y.-J., & Feng, C. (2026) · Neuroscience Bulletin · doi:10.1007/s12264-026-01647-w
Intensity-dependent topographical expansion of sensory representationsPreprint
Zhang, L., Dehghani, A., Hu, L., Sadil, P. S., Losin, L., Lindquist, M. A., & Wager, T. D. (2026) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.64898/2026.06.05.730458
Langeveld, D., Sipahioğlu, B., Oebel, M., Miletić, S., de Kleijn, R., & Molendijk, M. L. (2026) · Research Integrity and Peer Review · doi:10.1186/s41073-026-00224-z
Allison, C., Huettig, F., Beck, A., Allen, S., & Lachmann, T. (2026) · Language Cognition and Neuroscience · doi:10.1080/23273798.2026.2688404
Takamura, Y., Delsanti, R., Cohen, L., Bartolomeo, P., & Liu, J. (2026) · eLife · doi:10.7554/elife.111728
Takamura, Y., Delsanti, R., Cohen, L., Bartolomeo, P., & Liu, J. (2026) · eLife · doi:10.7554/elife.111728.1
Heightened play following play observation in the absence of 22-kHz calls in juvenile rats
Michon, F., Achterberg, E. J. M., Kaufmann, L. V., Packheiser, J., Bos, S., van Reenen, K., Gazzola, V., & Keysers, C. (2026) · Behavioural Brain Research · doi:10.1016/j.bbr.2026.116382 · Cited by 1
Self-citationOff-target effects of DREADD ligands revealed by an anesthesia emergence paradigm in mice
Moreno-Gomez, M., Foffani, G., & Humanes-Valera, D. (2026) · Cell Reports Methods · doi:10.1016/j.crmeth.2026.101531
Tang, W., Cheng, J.-Q., & Lin, X. (2026) · European Journal of Education · doi:10.1111/ejed.70789
Pupillometric evidence favors an active attentional zoom lens account over passive filtering
Michl, M., Tkacz-Domb, S., Yeshurun, Y., & Wolfgang Einhäuser, A. (2026) · Vision Research · doi:10.1016/j.visres.2026.108887
Kosnoff, J., Zhang, J., Zhang, Y., Ding, Y., Johnson, Z., & He, B. (2026) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2026.3720609
Dienel, S. J., Vespoli, J. C., Lewis, D. A., & Fish, K. N. (2026) · Molecular Psychiatry · doi:10.1038/s41380-026-03763-5
Octave equivalence and the incidental learning of absolute pitch
Henry, W., & Schmidt, J. R. (2026) · Attention Perception & Psychophysics · doi:10.3758/s13414-026-03321-9
Experience Modulates Visuocortical Responses to Faces in 3- to 6-Year-Old Children
Wallsinger, G., Boylan, M. R., Barry‐Anwar, R., Silva, G., Conte, S., & Scott, L. S. (2026) · Journal of Experimental Child Psychology · doi:10.1016/j.jecp.2026.106619
Wattelez, G., Demaneuf, T., Bertrand-Protat, S., & Galy, O. (2026) · Open Research Europe · doi:10.12688/openreseurope.24052.1
Zhang, Y., Tu, S., Zhou, L., & Xue, C. (2026) · Psychology of Music · doi:10.1177/03057356261471423
Does trait anxiety impair inhibitory control processes in an RSVP paradigm? Evidence from ERPs
Li, Y., Mao, N., 西憲, 敬., Zhang, Q., & Cui, L. (2026) · Biological Psychology · doi:10.1016/j.biopsycho.2026.109372
Rotteveel, F., Maat, B., James, C. J., Kovačić, D., Reiss, L. A. J., Başkent, D., & Gaudrain, É. (2026) · Journal of the Association for Research in Otolaryngology · doi:10.1007/s10162-026-01073-9
Does experience modulate automatic imitation? A new look
Genovese, F., Fanghella, M., Sinigaglia, C., & Barchiesi, G. (2026) · PLoS ONE · doi:10.1371/journal.pone.0357821
Lateef, R., Dion, J., Tremblay, K., Daigneault, I., Hébert, M., Lemieux, A., & Paquette, G. (2026) · International Journal of Developmental Disabilities · doi:10.1080/20473869.2026.2733838
Rahmati, Y., van Jaarsveldt, I. E. M., & Jarrold, C. (2026) · Research in Developmental Disabilities · doi:10.1016/j.ridd.2026.105390 · Cited by 1
Spychala, K. M., Miller, A. P., Friedman, N. P., & Gizer, I. R. (2026) · medRxiv · doi:10.64898/2026.10.08.26365006
Avoiding spiders: Affective context shapes tactile sensitivity during movement
Arikan, B. E., McManus, M., & Fiehler, K. (2026) · iScience · doi:10.1016/j.isci.2026.117902
Demir, E., Kaplan, A. D., Atta, M., & Soyman, E. (2026) · Acta Psychologica · doi:10.1016/j.actpsy.2026.107987
Shimizu, S., Kawamura, R., Sasaki, K., & Kodama, N. (2026) · Brain Sciences · doi:10.3390/brainsci16111172
Evidence for unconscious priming using a Bayesian single-subject approach
Sánchez-Fuenzalida, N., van Gaal, S., van den Hurk, Z., Stein, T., & Fahrenfort, J. J. (2026) · Neuroscience of Consciousness · doi:10.1093/nc/niag052
Metadata
- Authors
- Keysers, C., Gazzola, V., & Wagenmakers, E.-J.
- Affiliations
- Netherlands Institute for Neuroscience (NL)
- University of Amsterdam (NL)
- Corresponding author
- Keysers, Christian
- Venue
- Nature Neuroscience
- Published
- 2020-06-29
- Volume
- 23
- Issue
- 7
- Pages
- 788-799
- ISSN
- 1097-6256 (ISSN-L)
- 1546-1726
- PMC
- PMC7610527
- OpenAlex
- W3037007306
- Cited by
- 654
- References
- 41
- Citations by year
- 2026: 69 · 2025: 92 · 2024: 127 · 2023: 118 · 2022: 118 · 2021: 98 · 2020: 29
- FWCI
- 14.74
- Type
- journal article
- Language
- en
- Update notices
- correction (2020-10-06)
- Open access
- green
- pure.knaw.nl
- Licence
- Locations
- Nature Neuroscience (publishedVersion)
- PubMed (publishedVersion)
- KNAW research portal (Royal Academy of Art and Sciences (KNAW)) (publishedVersion, other-oa)
- PubMed Central (acceptedVersion)
- UvA-DARE (University of Amsterdam) (submittedVersion, cc-by)
- KNAW Research Portal (The Royal Netherlands Academy of Arts and Sciences) (submittedVersion, cc-by)
- Data Archiving and Networked Services (DANS) (submittedVersion, cc-by)
- Data Archiving and Networked Services (DANS) (submittedVersion, other-oa)
- Funders
- Nederlandse Organisatie voor Wetenschappelijk Onderzoek (453-15-009, 452-14-015)
- H2020 European Research Council (758703)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Keywords
- Bayes factor, evidence of absence, absence of evidence, Bayesian hypothesis testing, null hypothesis, p-values, Bayesian t-test, JASP
- MeSH terms
- Animals, Bayes Theorem, Brain, Humans, Neurosciences, Research Design
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
