The DOI matches its Crossref record; 46 of the 46 references it cites were found in a registry or an index.
A tutorial on a practical Bayesian alternative to null-hypothesis significance testing
Open accessAbstract
Null-hypothesis significance testing remains the standard inferential tool in cognitive science despite its serious disadvantages. Primary among these is the fact that the resulting probability value does not tell the researcher what he or she usually wants to know: How probable is a hypothesis, given the obtained data? Inspired by developments presented by Wagenmakers (Psychonomic Bulletin & Review, 14, 779-804, 2007), I provide a tutorial on a Bayesian model selection approach that requires only a simple transformation of sum-of-squares values generated by the standard analysis of variance. This approach generates a graded level of evidence regarding which model (e.g., effect absent [null hypothesis] vs. effect present [alternative hypothesis]) is more strongly supported by the data. This method also obviates admonitions never to speak of accepting the null hypothesis. An Excel worksheet for computing the Bayesian analysis is provided as supplemental material.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“JZS Bayes factor ANOVAs with default prior scales [49–52] revealed support for the null hypothesis regarding main and interaction effects for all three cognitive outcomes.”
From Dual N-back working memory training in healthy adults: A randomized comparison to processing speed training. (2016) · cites this paper as [50]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
R: A Language and Environment for Statistical Computing
R Core Team (2000) · doi:10.32614/r.manuals · Cited by 355,893
Statistical Power Analysis for the Behavioral Sciences
Muller, K. E., & Cohen, J. (1989) · Technometrics · doi:10.2307/1270020 · Cited by 99,603
Faul, F., Erdfelder, E., Lang, A.-G., & Buchner, A. (2007) · Behavior Research Methods · doi:10.3758/bf03193146 · Cited by 65,971
Statistical power analysis for the behavioral sciences
Cohen, J. (1990) · Computers Environment and Urban Systems · doi:10.1016/0198-9715(90)90050-4 · Cited by 65,417
A new look at the statistical model identification
Akaike, H. (1974) · IEEE Transactions on Automatic Control · doi:10.1109/tac.1974.1100705 · Cited by 51,879
Statistical Power Analysis for the Behavioral Sciences (2nd ed.).
Lachenbruch, P. A., & Cohen, J. (1989) · Journal of the American Statistical Association · doi:10.2307/2290095 · Cited by 37,421
Bayesian model selection in social research
Raftery, A. E. (1995) · Sociological Methodology · doi:10.2307/271063 · Cited by 6,823
ANew Look at the Statistical Model Identification
AKAlKE, H. (2011) · Cited by 4,177
Cohen, J. (1994) · American Psychologist · doi:10.1037/0003-066x.49.12.997 · Cited by 4,003
Bayesian t tests for accepting and rejecting the null hypothesis
Rouder, J. N., Speckman, P. L., Sun, D., Morey, R. D., & Iverson, G. (2009) · Psychonomic Bulletin & Review · doi:10.3758/pbr.16.2.225 · Cited by 3,688
Cited by
Sorted by citations
Items 701–754 of 754
Somatosensory Involvement in the Conceptual Representation of Objects
Ekstrand, C. (2016) · University Library - University of Saskatchewan (University of Saskatchewan)
Using Bayes factors to assess object-affordance effects: A comment on Sevos et al. (2016)Preprint
Faulkenberry, T. J. (2016) · doi:10.31234/osf.io/e4tbm
Retrieval priming in product verification: Evidence from retrieval-induced forgetting
Neudorf, J., Chen, Y., & Campbell, J. I. D. (2018) · Journal of Numerical Cognition · doi:10.5964/jnc.v4i3.156
Can Bayes Factors "Prove" the Null Hypothesis?Preprint
Smithson, M. J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1907.05583
Kato, R., Yokoyama, T., & Takeda, Y. (2020) · International Journal of Psychophysiology · doi:10.1016/j.ijpsycho.2019.12.012
Surviving an intervention: ERPs and masked intervenor priming
Witzel, J., Witzel, N., Zargar, E. S., & Forster, K. I. (2020) · Language Cognition and Neuroscience · doi:10.1080/23273798.2019.1707841
The rate of forgetting over time in working memory during early childhood
Bertrand, R., Stan-Zahno, I., & Camos, V. (2020) · L’Année psychologique · doi:10.3917/anpsy1.202.0157
Uncertainty Tolerance & Cognitive ControlPreprint
Schroeder, P. A., Dignath, D., & Janczyk, M. (2020) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/t72e6
Implicit Priming Reveals Decomposed Processing in Fraction ComparisonPreprint
Nejman, J. A., & Faulkenberry, T. J. (2019) · doi:10.31234/osf.io/nkw45
Bayesian two-interval testPreprint
Meyer, N., & Sauleau, E. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2107.01271
Beyond Embodied Cognition: Intentionality, Affordance, and Environmental Adaptation
Jin, Z., Tirassa, M., & Borghi, A. M. (2019) · Frontiers research topics · doi:10.3389/978-2-88945-815-8
Task-level and Item-level Components of Procedure Speed-upPreprint
Campbell, J. I. D., Chen, Y., & Langer, E. (2022) · doi:10.31234/osf.io/nzmpe
Why the A/AN prediction effect may be hard to replicate: A rebuttal to DeLong, Urbach & Kutas (2017)Preprint
Ito, A., Martin, A. E., & Nieuwland, M. S. (2017) · doi:10.31234/osf.io/ayd3t
Reversing the manual digit bias in two-digit number comparisonPreprint
Faulkenberry, T. J. (2016) · doi:10.31234/osf.io/xfngj
The Impact of Sexism on Leadership in Female-Male Climbing DyadsPreprint
Kulich, C., de Lemus, S., & Montañés, P. (2020) · doi:10.31234/osf.io/y4kg9
Listeners and Readers Generalise Their Experience With Word Meanings Across ModalitiesPreprint
Gilbert, R. A., Davis, M. H., Gaskell, M. G., & Rodd, J. M. (2018) · doi:10.31234/osf.io/7492a
Kätsyri, J., de Gelder, B., & Takala, T. (2018) · doi:10.31234/osf.io/u7gq9 · Cited by 2
Frequentist and Bayesian Hypothesis Testing: An Intuitive Guide for Urologists and Clinicians
Gaona, J. L., Sánchez, D., González, C., Gonzalez, F. A., Rueda, A., & Ortiz, S. (2022) · Revista Urología Colombiana / Colombian Urology Journal · doi:10.1055/s-0042-1756171
Application of Minimum Bayes Factor to a Balanced Two-Way Anova with Random Effects
Abidoye, A. O., Adewara, A. A., Popoola, J., & D, E. O. (2023) · East Asian Journal of Multidisciplinary Research · doi:10.55927/eajmr.v2i3.3375
Application of Minimum Bayes Factor to a Balanced Two-Way Anova with Random Effects
Abidoye, A. O., D, E. O., Adewara, A. A., & Popoola, J. (2023) · Formosa Journal of Multidisciplinary Research · doi:10.55927/fjmr.v2i3.3376
Does the threat of COVID-19 modulate automatic imitation?
Roberts, J. W., & Bennett, S. J. (2023) · PLoS ONE · doi:10.1371/journal.pone.0284936
Helmond, E., Finlay, K. P., Sheffield, C. S., Hart, M., & Heron, J. (2023) · Canadian Journal of Zoology · doi:10.1139/cjz-2022-0217
Valence moderates the effect of stimulus-hand proximity on conflict processing and gaze-cueing
Hoffmann, S. F., Fischer, R., & Liepelt, R. (2023) · PeerJ · doi:10.7717/peerj.15286
Application of Minimum Bayes Factor to A Balanced Two-Way ANOVA With Random Effects
Abidoye, A. O. (2023) · Indonesian Journal of Contemporary Multidisciplinary Research · doi:10.55927/modern.v2i3.3408
Saliency strikes back: How filtering out high frequencies improves white-box explanationsPreprint
Muzellec, S., Fel, T., Boutin, V., Andéol, L., VanRullen, R., & Serre, T. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2307.09591 · Cited by 2
Mosquea, T. R. J. (2023) · Elsevier eBooks · doi:10.1016/b978-0-323-91259-4.00055-2
Pièges et mésusages en analyse de données
Supplisson, O., & Sofonea, M. T. (2023) · Anesthésie & Réanimation · doi:10.1016/j.anrea.2023.08.002
The Teacher Competency and Beliefs on How to Improve Language Skills of Students
Yaman, Ş., Can, E., & Cakir, O. (2023) · European Journal of English Language Studies · doi:10.12973/ejels.3.2.91
Cenac, Z. (2024) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2024.02.11.579824
الفرضية المعلوماتية مقابل الفرضية الصفرية الإحصائية: دراسة الإحصاء الكلاسيكي مقابل الإحصاء البايزى
محمد, م. إ. م. (2024) · Al-Maǧallaẗ Al-Tarbawiyyaẗ Al-Šāmlaẗ · doi:10.21608/ejc.2024.348261
(2024) · Al-Maǧallaẗ Al-Tarbawiyyaẗ Al-Šāmlaẗ · doi:10.21608/ejc.2024.348256
Looking for unique signals of human expansion from Africa: Beyond diversityPreprint
Cenac, Z. (2024) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2024.08.13.607798
Cost does not prevent pigeons from investing in the future
Cowie, S., & Davison, M. (2024) · Behavioural Processes · doi:10.1016/j.beproc.2024.105125
Nonverbal predication and SELF-assertive truth-conditionality in American Sign Language
Sampson, T., & Mayberry, R. I. (2025) · Lingua · doi:10.1016/j.lingua.2024.103852
Enhancing public campaign messages: The power of causal arguments
Pian, W., Zheng, R., Chi, J., & Khoo, C. S. G. (2025) · Information Processing & Management · doi:10.1016/j.ipm.2025.104160
Gao, P., Ni, X. D., Li, J., & Chu, R. (2025) · Pharmaceutical Statistics · doi:10.1002/pst.70011
WITHDRAWN: Modern humans dispersed from southern Africa?Preprint
Cenac, Z. (2025) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2025.07.15.664985
Sarno, D. M., & Allan, J. N. (2025) · Human Factors The Journal of the Human Factors and Ergonomics Society · doi:10.1177/00187208251363406 · Cited by 1
Eye-tracking evidence for benefits from linguistically-driven text formatting while reading
Dempsey, J., Christianson, K., & Dyke, J. A. V. (2025) · Reading and Writing · doi:10.1007/s11145-025-10716-x
Electrophysiological correlates of multiple object processing
Pagano, S. (2012) · Unitn-eprints PhD (University of Trento) · doi:10.15168/11572_367677
Jaeger, A. J., Weisberg, S. M., Nazareth, A., & Newcombe, N. S. (2024) · Figshare · doi:10.6084/m9.figshare.26606590
It’s the Way You Move: Efficient Movement Shapes Robot Perception Across Embodiments
Nikolovska, К., Pohl, J., Hommel, B., Maurelli, F., & Kappas, A. (2025) · Lecture notes in computer science · doi:10.1007/978-981-95-2379-5_20
Calvert, J., Maxwell, N. P., & Smith, K. A. (2026) · Quarterly Journal of Experimental Psychology · doi:10.1177/17470218261425967
Maxwell, N. P., & Adkins, M. (2026) · Memory · doi:10.1080/09658211.2026.2645631
Sober or Not, You Still Learn: Implicit and Explicit Motor Learning Unaffected by Moderate Alcohol
Luz, J. E. D. M., Bastos, F. H., Lage, G. M., Leal, M. G., Filho, J. R. D. M. G., & Bonuzzi, G. M. G. (2026) · Journal of Motor Behavior · doi:10.1080/00222895.2026.2645122
Contextualizing the clock(s) : integrating cues for the perception of time and timing an action
Jovanović, L. (2018) · theses.fr (ABES) · doi:10.70675/02040c5eze330z4785z905ez7f96060eb46d
The role of brain oscillations in visual perception, attention and consciousness
Luo, C. (2020) · theses.fr (ABES) · doi:10.70675/1a3d0bdez6f9az4dd7z95d6z04210d3961bc
Generative AI as a transformational logic for cognitive neuroscience
Beste, C., & Safavi, S. (2026) · Communications Biology · doi:10.1038/s42003-026-10642-w · Cited by 1
Collier, E. S., Harris, K. L., Niimi, J., Lahne, J., & Bendtsen, M. (2026) · Food Quality and Preference · doi:10.1016/j.foodqual.2026.106081
Motamedisedeh, O., Sedeh, Z. M., Zagia, F., Omrani, S., & Drogemuller, R. (2026) · Utilities Policy · doi:10.1016/j.jup.2026.102328
Metadata
- Authors
- Masson, M. E. J.
- Affiliations
- University of Victoria (CA)
- Corresponding author
- Masson, Michael E. J.
- Venue
- Behavior Research Methods
- Published
- 2011-02-08
- Volume
- 43
- Issue
- 3
- Pages
- 679-690
- ISSN
- 1554-351X (ISSN-L)
- 1554-3528
- OpenAlex
- W2151069696
- Cited by
- 752
- References
- 44
- Citations by year
- 2026: 7 · 2025: 21 · 2024: 29 · 2023: 54 · 2022: 39 · 2021: 62 · 2020: 61 · 2019: 87 · 2018: 84 · 2017: 63 · 2016: 66 · 2015: 55 · 2014: 53 · 2013: 45 · 2012: 22
- FWCI
- 34.66
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Behavior Research Methods (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Computer Science › Artificial Intelligence › Bayesian Modeling and Causal Inference
- Keywords
- Bayesian model selection, null hypothesis significance testing, Bayes factor, analysis of variance, sums of squares, evidence rating, null hypothesis, effect size
- MeSH terms
- Bayes Theorem, Data Interpretation, Statistical, Probability, Research Design, Models, Statistical
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review