A tutorial on a practical Bayesian alternative to null-hypothesis significance testing
Open accessAbstract
Null-hypothesis significance testing remains the standard inferential tool in cognitive science despite its serious disadvantages. Primary among these is the fact that the resulting probability value does not tell the researcher what he or she usually wants to know: How probable is a hypothesis, given the obtained data? Inspired by developments presented by Wagenmakers (Psychonomic Bulletin & Review, 14, 779-804, 2007), I provide a tutorial on a Bayesian model selection approach that requires only a simple transformation of sum-of-squares values generated by the standard analysis of variance. This approach generates a graded level of evidence regarding which model (e.g., effect absent [null hypothesis] vs. effect present [alternative hypothesis]) is more strongly supported by the data. This method also obviates admonitions never to speak of accepting the null hypothesis. An Excel worksheet for computing the Bayesian analysis is provided as supplemental material.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
JZS Bayes factor ANOVAs with default prior scales revealed support for the null hypothesis regarding main and interaction effects for all three cognitive outcomes.
“JZS Bayes factor ANOVAs with default prior scales [49–52] revealed support for the null hypothesis regarding main and interaction effects for all three cognitive outcomes.”
From Dual N-back working memory training in healthy adults: A randomized comparison to processing speed training. (2016) · cites this paper as [50]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
R: A Language and Environment for Statistical Computing
R Core Team (2000) · doi:10.32614/r.manuals · Cited by 355,706 · see citing works
Statistical Power Analysis for the Behavioral Sciences
Muller, K. E., & Cohen, J. (1989) · Technometrics · doi:10.2307/1270020 · Cited by 99,588 · see citing works
Faul, F., Erdfelder, E., Lang, A.-G., & Buchner, A. (2007) · Behavior Research Methods · doi:10.3758/bf03193146 · Cited by 65,971 · see citing works
Statistical power analysis for the behavioral sciences
Cohen, J. (1990) · Computers Environment and Urban Systems · doi:10.1016/0198-9715(90)90050-4 · Cited by 65,406 · see citing works
A new look at the statistical model identification
Akaike, H. (1974) · IEEE Transactions on Automatic Control · doi:10.1109/tac.1974.1100705 · Cited by 51,879 · see citing works
Statistical Power Analysis for the Behavioral Sciences (2nd ed.).
Lachenbruch, P. A., & Cohen, J. (1989) · Journal of the American Statistical Association · doi:10.2307/2290095 · Cited by 37,385 · see citing works
Bayesian model selection in social research
Raftery, A. E. (1995) · Sociological Methodology · doi:10.2307/271063 · Cited by 6,823 · see citing works
ANew Look at the Statistical Model Identification
AKAlKE, H. (2011) · Cited by 4,177 · see citing works
The earth is round (p < .05).
Cohen, J. (1994) · American Psychologist · doi:10.1037/0003-066x.49.12.997 · Cited by 4,003 · see citing works
Bayesian t tests for accepting and rejecting the null hypothesis
Rouder, J. N., Speckman, P. L., Sun, D., Morey, R. D., & Iverson, G. (2009) · Psychonomic Bulletin & Review · doi:10.3758/pbr.16.2.225 · Cited by 3,688 · see citing works
Statistical methods in psychology journals: Guidelines and explanations.
Wilkinson, L., & Task Force on Statistical Inference (1999) · American Psychologist · doi:10.1037/0003-066x.54.8.594 · Cited by 2,791 · see citing works
A practical solution to the pervasive problems ofp values
Wagenmakers, E.-J. (2007) · Psychonomic Bulletin & Review · doi:10.3758/bf03194105 · Cited by 2,490 · see citing works
Kass, R. E., & Raftery, A. E. (1995) · Journal of the American Statistical Association · doi:10.2307/2291091 · Cited by 2,359 · see citing works
Computing Bayes Factors by Combining Simulation and Asymptotic Approximations
DiCiccio, T., Kass, R., Raftery, A., & Wasserman, L. (1997) · Journal of the American Statistical Association · doi:10.1080/01621459.1997.10474045 · Cited by 2,029 · see citing works
A Reference Bayesian Test for Nested Hypotheses and its Relationship to the Schwarz Criterion
Kass, R. E., & Wasserman, L. (1995) · Journal of the American Statistical Association · doi:10.1080/01621459.1995.10476592 · Cited by 1,254 · see citing works
Null hypothesis significance testing: a review of an old and continuing controversy
Nickerson, R. S. (2000) · Psychological Methods · doi:10.1037/1082-989x.5.2.241 · Cited by 1,090 · see citing works
Lindley, D. V. (1957) · Biometrika · doi:10.1093/biomet/44.1-2.187 · Cited by 946 · see citing works
van Meter, K. M. (1994) · Bulletin of Sociological Methodology/Bulletin de Méthodologie Sociologique · doi:10.1177/075910639404200102 · Cited by 688 · see citing works
Berger, J. O., & Delampady, M. (1987) · Statistical Science · doi:10.1214/ss/1177013238 · Cited by 664 · see citing works
Sociological Methodology, 1969
Keesling, W., & Borgatta, E. (1972) · American Educational Research Journal · doi:10.2307/1161695 · Cited by 643 · see citing works
The importance of proving the null
Gallistel, C. R. (2009) · Psychological Review · doi:10.1037/a0015251 · Cited by 392 · see citing works
A Critique of the Bayesian Information Criterion for Model Selection
WEAKLIEM, D. L. (1999) · Sociological Methods & Research · doi:10.1177/0049124199027003002 · Cited by 349 · see citing works
Psychonarratology foundations for the empirical study of literary response
Bortolussi, M., & Dixon, P. A. (2003) · Cited by 328 · see citing works
A Reference Bayesian Test for Nested Hypotheses and its Relationship to the Schwarz Criterion
Kass, R. E., & Wasserman, L. H. (1995) · Journal of the American Statistical Association · doi:10.2307/2291327 · Cited by 256 · see citing works
RAFTERY, A. E. (1999) · Sociological Methods & Research · doi:10.1177/0049124199027003005 · Cited by 249 · see citing works
Why P Values Are Not a Useful Measure of Evidence in Statistical Significance Testing
Hubbard, R., & Lindsay, R. (2008) · Theory & Psychology · doi:10.1177/0959354307086923 · Cited by 244 · see citing works
Null hypothesis significance testing. On the survival of a flawed method.
Krueger, J. (2001) · American Psychologist · doi:10.1037/0003-066x.56.1.16 · Cited by 226 · see citing works
Likelihood ratios: A simple and flexible statistic for empirical psychologists
Glover, S., & Dixon, P. (2004) · Psychonomic Bulletin & Review · doi:10.3758/bf03196706 · Cited by 218 · see citing works
In praise of the null hypothesis statistical test.
Hagen, R. L. (1997) · American Psychologist · doi:10.1037/0003-066x.52.1.15 · Cited by 194 · see citing works
Grasping beer mugs: On the dynamics of alignment effects induced by handled objects.
Bub, D. N., & Masson, M. E. J. (2010) · Journal of Experimental Psychology Human Perception & Performance · doi:10.1037/a0017606 · Cited by 172 · see citing works
Self-citationGlover, S., & Dixon, P. (2001) · Journal of Experimental Psychology Human Perception & Performance · doi:10.1037//0096-1523.27.3.560 · Cited by 164 · see citing works
Why is it easier to identify someone close than far away?
Loftus, G. R., & Harley, E. M. (2005) · Psychonomic Bulletin & Review · doi:10.3758/bf03196348 · Cited by 161 · see citing works
Statistical Significance: Rationale, Validity and Utility
Nayak, T. K., & Chow, S. L. (1998) · Technometrics · doi:10.2307/1270661 · Cited by 136 · see citing works
Glover, S. R., & Dixon, P. (2001) · Journal of Experimental Psychology Human Perception & Performance · doi:10.1037/0096-1523.27.3.560 · Cited by 97 · see citing works
Précis of Statistical significance: Rationale, validity, and utility
Chow, S. L. (1998) · Behavioral and Brain Sciences · doi:10.1017/s0140525x98001162 · Cited by 92 · see citing works
On the Relations among Different Measures of Visible and Informational Persistence
Loftus, G. R., & Irwin, D. E. (1998) · Cognitive Psychology · doi:10.1006/cogp.1998.0678 · Cited by 88 · see citing works
The p-value fallacy and how to avoid it.
Dixon, P. (2003) · Canadian Journal of Experimental Psychology/Revue canadienne de psychologie expérimentale · doi:10.1037/h0087425 · Cited by 88 · see citing works
Can corrective feedback improve recognition memory?
Kantner, J., & Lindsay, D. S. (2010) · Memory & Cognition · doi:10.3758/mc.38.4.389 · Cited by 55 · see citing works
A Test of the Null Hypothesis Significance Testing Procedure Correlation Argument
Trafimow, D., & Rice, S. C. (2009) · The Journal of General Psychology · doi:10.3200/genp.136.3.261-270 · Cited by 46 · see citing works
Scientific versus statistical inference.
Dixon, P., & O’Reilly, T. (1999) · Canadian Journal of Experimental Psychology/Revue canadienne de psychologie expérimentale · doi:10.1037/h0087305 · Cited by 41 · see citing works
A model-averaging approach to replication: The case of prep.
Iverson, G., Wagenmakers, E., & Lee, M. D. (2010) · Psychological Methods · doi:10.1037/a0017182 · Cited by 26 · see citing works
Polysemy effects in word naming.
Lichacz, F. M. J., Herdman, C. M., LeFevre, J., & Baird, B. (1999) · Canadian Journal of Experimental Psychology/Revue canadienne de psychologie expérimentale · doi:10.1037/h0087309 · Cited by 25 · see citing works
Effects of an orientation illusion on motor performance and motor imagery
Glover, S., Dixon, P., Castiello, U., & Rushworth, M. F. S. (2005) · Experimental Brain Research · doi:10.1007/s00221-005-2328-4 · Cited by 18 · see citing works
Object identification in preschool children and adults
Bernstein, D. M., Loftus, G. R., & Meltzoff, A. N. (2005) · Developmental Science · doi:10.1111/j.1467-7687.2005.00402.x · Cited by 17 · see citing works
Winkel, J. (2009) · Frontiers in Human Neuroscience · doi:10.3389/neuro.09.057.2009 · Cited by 16 · see citing works
Long-term repetition priming of briefly identified objects.
Breuer, A. T., Masson, M. E. J., Cohen, A.-L., & Lindsay, D. S. (2009) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/a0014734 · Cited by 4 · see citing works
Self-citation
Flagged first, then by citations
Cited by
Sorted by citations
Bayesian inference for psychology. Part I: Theoretical advantages and practical ramifications
Wagenmakers, E., Marsman, M., Jamil, T., Ly, A., Verhagen, J., Love, J., Selker, R., Gronau, Q. F., Šmíra, M., Epskamp, S., et al. (2017) · Psychonomic Bulletin & Review · doi:10.3758/s13423-017-1343-3 · Cited by 1,652 · see citing works
(2013) · Cited by 1,351 · see citing works
What are the odds? A practical guide to computing and reporting Bayes factors
Jarosz, A. F., & Wiley, J. (2014) · The Journal of Problem Solving · doi:10.7771/1932-6246.1167 · Cited by 1,101 · see citing works
Is psychology suffering from a replication crisis? What does “failure to replicate” really mean?
Maxwell, S. E., Lau, M. Y., & Howard, G. S. (2015) · American Psychologist · doi:10.1037/a0039400 · Cited by 1,018 · see citing works
Steenbergen, L., Sellaro, R., van Hemert, S., Bosch, J. A., & Colzato, L. S. (2015) · Brain, Behavior, and Immunity · doi:10.1016/j.bbi.2015.04.003 · Cited by 671 · see citing works
“To calculate Bayesian probabilities we used the method proposed by Wagenmakers (2007) and Masson (2011).”
MethodMorePower 6.0 for ANOVA with relational confidence intervals and Bayesian analysis
Campbell, J. I. D., & Thompson, V. A. (2012) · Behavior Research Methods · doi:10.3758/s13428-012-0186-0 · Cited by 661 · see citing works
A default Bayesian hypothesis test for correlations and partial correlations
Wetzels, R., & Wagenmakers, E. (2012) · Psychonomic Bulletin & Review · doi:10.3758/s13423-012-0295-x · Cited by 511 · see citing works
Bayesian data analysis for newcomers
Kruschke, J. K., & Liddell, T. M. (2017) · Psychonomic Bulletin & Review · doi:10.3758/s13423-017-1272-1 · Cited by 409 · see citing works
An Introduction to Bayesian Hypothesis Testing for Management Research
Andraszewicz, S., Scheibehenne, B., Rieskamp, J., Grasman, R. P. P. P., Verhagen, J., & Wagenmakers, E. (2014) · Journal of Management · doi:10.1177/0149206314560412 · Cited by 344 · see citing works
Replication in Psychological Science
Lindsay, D. S. (2015) · Psychological Science · doi:10.1177/0956797615616374 · Cited by 282 · see citing works
Designing awe in virtual reality: an experimental study
Chirico, A., Ferrise, F., Cordella, L., & Gaggioli, A. (2018) · Frontiers in Psychology · doi:10.3389/fpsyg.2017.02351 · Cited by 276 · see citing works
A Tutorial on Conducting and Interpreting a Bayesian ANOVA in JASP
van den Bergh, D., van Doorn, J. B., Marsman, M., Draws, T., van Kesteren, E., Derks, K., Dablander, F., Gronau, Q. F., Kucharský, Š., Gupta, A. R. K. N., et al. (2020) · L’Année psychologique · doi:10.3917/anpsy1.201.0073 · Cited by 267 · see citing works
Investigating learning outcomes and subjective experiences in 360-degree videos
Rupp, M. A., Odette, K. L., Kozachuk, J. R., Michaelis, J. R., Smither, J. A.-A., & McConnell, D. S. (2018) · Computers & Education · doi:10.1016/j.compedu.2018.09.015 · Cited by 251 · see citing works
A tutorial on testing hypotheses using the Bayes factor.
Hoijtink, H. J. A., Mulder, J., Lissa, C. J. V., & Gu, X. (2019) · Psychological Methods · doi:10.1037/met0000201 · Cited by 237 · see citing works
Revisiting Mental Simulation in Language Comprehension: Six Replication Attempts
Zwaan, R. A., & Pecher, D. (2012) · PLoS ONE · doi:10.1371/journal.pone.0051382 · Cited by 215 · see citing works
Sörqvist, P., Hedblom, D., Holmgren, M., Haga, A., Langeborg, L., Nöstl, A., & Kågström, J. (2013) · PLoS ONE · doi:10.1371/journal.pone.0080719 · Cited by 178 · see citing works
The brain’s functional network architecture reveals human motives
Hein, G., Morishima, Y., Leiberg, S., Sul, S., & Fehr, E. (2016) · Science · doi:10.1126/science.aac7992 · Cited by 165 · see citing works
Dissociation between mental fatigue and motivational state during prolonged mental activity
Monika, G., Jacob, B., Olivier, E., & Zénon, A. (2015) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2015.00176 · Cited by 161 · see citing works
Animates are better remembered than inanimates: further evidence from word and picture stimuli
Bonin, P., Gelin, M., & Bugaïska, A. (2013) · Memory & Cognition · doi:10.3758/s13421-013-0368-8 · Cited by 153 · see citing works
Focused, unfocused, and defocused information in working memory.
Rerko, L., & Oberauer, K. (2013) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/a0031172 · Cited by 151 · see citing works
The cognitive reflection test is robust to multiple exposures
Białek, M., & Pennycook, G. (2017) · Behavior Research Methods · doi:10.3758/s13428-017-0963-x · Cited by 147 · see citing works
Dealing with the evaluation of supervised classification algorithms
Santafé, G., Inza, I., & Lozano, J. A. (2015) · Artificial Intelligence Review · doi:10.1007/s10462-015-9433-y · Cited by 136 · see citing works
Does Confidence Use a Common Currency Across Two Visual Tasks?
de Gardelle, V., & Mamassian, P. (2014) · Psychological Science · doi:10.1177/0956797614528956 · Cited by 131 · see citing works
HajiHosseini, A., & Holroyd, C. B. (2013) · Psychophysiology · doi:10.1111/psyp.12040 · Cited by 131 · see citing works
Rejection odds and rejection ratios: A proposal for statistical practice in testing hypotheses
Bayarri, M. J., Benjamin, D. J., Berger, J. O., & Sellke, T. M. (2016) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2015.12.007 · Cited by 126 · see citing works
Bayesian parametric estimation of stop-signal reaction time distributions.
Matzke, D., Dolan, C. V., Logan, G. D., Brown, S. D., & Wagenmakers, E. (2012) · Journal of Experimental Psychology General · doi:10.1037/a0030543 · Cited by 126 · see citing works
Understanding the Replication Crisis as a Base Rate Fallacy
Bird, A. (2018) · The British Journal for the Philosophy of Science · doi:10.1093/bjps/axy051 · Cited by 122 · see citing works
Shared striatal activity in decisions to satisfy curiosity and hunger at the risk of electric shocks
Lau, J. K. L., Ozono, H., Kuratomi, K., Komiya, A., & Murayama, K. (2020) · Nature Human Behaviour · doi:10.1038/s41562-020-0848-3 · Cited by 124 · see citing works
Białek, M., & Neys, W. D. (2017) · Judgment and Decision Making · doi:10.1017/s1930297500005696 · Cited by 108 · see citing works
Cipora, K., & Nuerk, H. (2013) · Quarterly Journal of Experimental Psychology · doi:10.1080/17470218.2013.772215 · Cited by 106 · see citing works
Testing adaptive toolbox models: a Bayesian hierarchical approach.
Scheibehenne, B., Rieskamp, J., & Wagenmakers, E. (2013) · Psychology Review · doi:10.1037/a0030777 · Cited by 116 · see citing works
Categorical encoding of color in the brain
Bird, C. M., Berens, S. C., Horner, A. J., & Franklin, A. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1315275111 · Cited by 104 · see citing works
A Tutorial on Conducting and Interpreting a Bayesian ANOVA in JASPPreprint
van den Bergh, D., van Doorn, J. B., Marsman, M., Draws, T., van Kesteren, E., Derks, K., Dablander, F., Gronau, Q. F., Kucharský, Š., Raj, A., et al. (2019) · doi:10.31234/osf.io/spreb · Cited by 107 · see citing works
The impact of cognitive load on delayed recall
Camos, V., & Portrat, S. (2014) · Psychonomic Bulletin & Review · doi:10.3758/s13423-014-0772-5 · Cited by 102 · see citing works
How to design the fair experimental classifier evaluation
Stąpor, K., Ksieniewicz, P., García, S., & Woźniak, M. (2021) · Applied Soft Computing · doi:10.1016/j.asoc.2021.107219 · Cited by 100 · see citing works
Matzke, D., Dolan, C. V., Batchelder, W. H., & Wagenmakers, E. (2013) · Psychometrika · doi:10.1007/s11336-013-9374-9 · Cited by 99 · see citing works
The Doubting System 1: Evidence for automatic substitution sensitivity
Johnson, E. D. M., Tubau, E., & Neys, W. D. (2015) · Acta Psychologica · doi:10.1016/j.actpsy.2015.12.008 · Cited by 96 · see citing works
Buetti, S., Cronin, D. A., Madison, A., Wang, Z., & Lleras, A. (2016) · Journal of Experimental Psychology General · doi:10.1037/xge0000163 · Cited by 98 · see citing works
Human Memory Retrieval and Inhibitory Control in the Brain: Beyond Correlational Evidence
Penolazzi, B., Stramaccia, D. F., Braga, M., Mondini, S., & Galfano, G. (2014) · Journal of Neuroscience · doi:10.1523/jneurosci.0349-14.2014 · Cited by 96 · see citing works
HARK No More: On the Preregistration of CHI Experiments
Cockburn, A., Gutwin, C., & Dix, A. (2018) · International Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3173715 · Cited by 159 · see citing works
Nakayama, M., Sears, C. R., Hino, Y., & Lupker, S. J. (2013) · Journal of Cognitive Psychology · doi:10.1080/20445911.2013.839560 · Cited by 92 · see citing works
Action video games do not improve the speed of information processing in simple perceptual tasks.
van Ravenzwaaij, D., Boekel, W., Forstmann, B. U., Ratcliff, R., & Wagenmakers, E. (2014) · Journal of Experimental Psychology General · doi:10.1037/a0036923 · Cited by 92 · see citing works
Distinct roles of forward and backward alpha-band waves in spatial visual attention
Alamia, A., Terral, L., D’ambra, M. R., & Rufin Vanrullen, A. (2023) · eLife · doi:10.7554/elife.85035 · Cited by 86 · see citing works
Professional mathematicians differ from controls in their spatial-numerical associations
Cipora, K., Hohol, M., Nuerk, H., Willmes, K., Brożek, B., Kucharzyk, B., & Nȩcka, E. (2015) · Psychological Research · doi:10.1007/s00426-015-0677-6 · Cited by 88 · see citing works
Eitel, A., Kühl, T., Scheiter, K., & Gerjets, P. (2014) · Applied Cognitive Psychology · doi:10.1002/acp.3004 · Cited by 85 · see citing works
“Unfocus” on foc.us: commercial tDCS headset impairs working memory
Steenbergen, L., Sellaro, R., Hommel, B., Lindenberger, U., Kühn, S., & Colzato, L. (2015) · Experimental Brain Research · doi:10.1007/s00221-015-4391-9 · Cited by 71 · see citing works
Listeners and readers generalize their experience with word meanings across modalities.
Gilbert, R. A., Davis, M. H., Gaskell, M. G., & Rodd, J. M. (2018) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/xlm0000532 · Cited by 85 · see citing works
Richter, M. (2016) · Ear & Hearing · doi:10.1097/aud.0000000000000295 · Cited by 84 · see citing works
Priming of supernatural agent concepts and agency detection
van Elk, M., Rutjens, B. T., van der Pligt, J., & van Harreveld, F. (2014) · Religion Brain & Behavior · doi:10.1080/2153599x.2014.933444 · Cited by 84 · see citing works
Timm, J., Schönwiesner, M., Schröger, E., & SanMiguel, I. (2016) · Cortex · doi:10.1016/j.cortex.2016.03.018 · Cited by 84 · see citing works
Cipora, K., Soltanlou, M., Reips, U., & Nuerk, H. (2019) · Behavior Research Methods · doi:10.3758/s13428-019-01213-5 · Cited by 83 · see citing works
More attentional focusing through binaural beats: evidence from the global–local task
Colzato, L. S., Barone, H., Sellaro, R., & Hommel, B. (2015) · Psychological Research · doi:10.1007/s00426-015-0727-0 · Cited by 83 · see citing works
Divided attention can enhance memory encoding: The attentional boost effect in implicit memory.
Spataro, P., Mulligan, N. W., & Rossi‐Arnaud, C. (2013) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/a0030907 · Cited by 81 · see citing works
Evaluating visual and auditory contributions to the cognitive restoration effect
Emfield, A. G., & Neider, M. B. (2014) · Frontiers in Psychology · doi:10.3389/fpsyg.2014.00548 · Cited by 80 · see citing works
Pertermann, M., Bluschke, A., Roessner, V., & Beste, C. (2019) · Biological Psychiatry Cognitive Neuroscience and Neuroimaging · doi:10.1016/j.bpsc.2019.03.011 · Cited by 80 · see citing works
Alilović, J., Timmermans, B., Reteig, L. C., van Gaal, S., & Slagter, H. A. (2019) · Cerebral Cortex · doi:10.1093/cercor/bhz038 · Cited by 77 · see citing works
Dopamine Manipulation Affects Response Vigor Independently of Opportunity Cost
Zénon, A., Devesse, S., & Olivier, E. (2016) · Journal of Neuroscience · doi:10.1523/jneurosci.4467-15.2016 · Cited by 79 · see citing works
Gillespie, A., Glăveanu, V. P., & Laurent, C. D. S. (2024) · Cambridge University Press eBooks · doi:10.1017/9781009031066 · Cited by 88 · see citing works
Objective Bayesian Two Sample Hypothesis Testing for Online Controlled Experiments
Deng, A. (2015) · International World Wide Web Conference (WWW) · doi:10.1145/2740908.2742563 · Cited by 77 · see citing works
Branigan, H. P., & Messenger, K. (2016) · Cognition · doi:10.1016/j.cognition.2016.09.004 · Cited by 79 · see citing works
Lawlor-Savage, L., & Goghari, V. M. (2016) · PLOS ONE · doi:10.1371/journal.pone.0151817 · Cited by 74 · see citing works
Seli, P., Ralph, B. C. W., Risko, E. F., Schooler, J. W., Schacter, D. L., & Smilek, D. (2017) · Psychonomic Bulletin & Review · doi:10.3758/s13423-017-1249-0 · Cited by 75 · see citing works
Temporal attention improves perception similarly at foveal and parafoveal locations
Fernández, A., Denison, R. N., & Carrasco, M. (2019) · Journal of Vision · doi:10.1167/19.1.12 · Cited by 74 · see citing works
Sex differences in psychiatric comorbidity and clinical presentation in youths with conduct disorder
Konrad, K., Kohls, G., Baumann, S., Bernhard, A., Martinelli, A., Ackermann, K., Smaragdi, A., González-Madruga, K., Wells, A. E., Rogers, J. C., et al. (2021) · Journal of Child Psychology and Psychiatry · doi:10.1111/jcpp.13428 · Cited by 73 · see citing works
Opitz, A., Beste, C., & Stock, A. (2020) · NeuroImage · doi:10.1016/j.neuroimage.2020.116524 · Cited by 69 · see citing works
Bayesian alternatives to null-hypothesis significance testing for repeated-measures designs
Nathoo, F. S., & Masson, M. E. J. (2015) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2015.03.003 · Cited by 69 · see citing works
Self-citationTemporal Dynamics Underlying the Modulation of Social Status on Social Attention
Dalmaso, M., Galfano, G., Coricelli, C., & Castelli, L. (2014) · PLoS ONE · doi:10.1371/journal.pone.0093139 · Cited by 67 · see citing works
When decision heuristics and science collide
Yu, E. C., Sprenger, A. M., Thomas, R. P., & Dougherty, M. R. P. (2013) · Psychonomic Bulletin & Review · doi:10.3758/s13423-013-0495-z · Cited by 67 · see citing works
Hayward, D. A., Voorhies, W. I., Morris, J. L., Capozzi, F., & Ristic, J. (2017) · Canadian Journal of Experimental Psychology/Revue canadienne de psychologie expérimentale · doi:10.1037/cep0000117 · Cited by 68 · see citing works
Haddara, N., & Rahnev, D. (2022) · Psychological Science · doi:10.1177/09567976211032887 · Cited by 68 · see citing works
Huff, M. J., & Bodner, G. E. (2013) · Journal of Experimental Psychology. Learning, Memory and Cognition · doi:10.1037/a0031338 · Cited by 68 · see citing works
Effects of speech on proofreading: Can task-engagement manipulations shield against distraction?
Halin, N., Marsh, J. E., Haga, A., Holmgren, M., & Sörqvist, P. (2013) · Journal of Experimental Psychology Applied · doi:10.1037/xap0000002 · Cited by 67 · see citing works
Pupil-Linked Arousal Responds to Unconscious Surprisal
Alamia, A., Rufin Vanrullen, A., Pasqualotto, E., Mouraux, A., & Zénon, A. (2019) · Journal of Neuroscience · doi:10.1523/jneurosci.3010-18.2019 · Cited by 66 · see citing works
Adelhöfer, N., & Beste, C. (2020) · NeuroImage · doi:10.1016/j.neuroimage.2020.117052 · Cited by 66 · see citing works
Tracking hierarchical processing in morphological decomposition with brain potentials.
Lavric, A., Elchlepp, H., & Rastle, K. (2012) · Journal of Experimental Psychology Human Perception & Performance · doi:10.1037/a0028960 · Cited by 64 · see citing works
Stenzel, A., Dolk, T., Colzato, L. S., Sellaro, R., Hommel, B., & Liepelt, R. (2014) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2014.00595 · Cited by 63 · see citing works
Petruo, V. A., Bodmer, B., Bluschke, A., Münchau, A. M., Roessner, V., & Beste, C. (2020) · Scientific Reports · doi:10.1038/s41598-020-58269-z · Cited by 62 · see citing works
Buetti, S., & Lleras, A. (2012) · Frontiers in Psychology · doi:10.3389/fpsyg.2012.00337 · Cited by 64 · see citing works
The influence of math anxiety on symbolic and non-symbolic magnitude processing
Dietrich, J. F., Huber, S., Moeller, K., & Klein, E. (2015) · Frontiers in Psychology · doi:10.3389/fpsyg.2015.01621 · Cited by 61 · see citing works
Kätsyri, J., de Gelder, B., & Takala, T. (2019) · Perception · doi:10.1177/0301006619869134 · Cited by 59 · see citing works
Preferential processing of emotionally and self-relevant stimuli persists in unconscious N2 sleep
Blume, C., del Giudice, R., Lechinger, J., Wisłowska, M., Heib, D. P. J., Hoedlmoser, K., & Schabus, M. (2016) · Brain and Language · doi:10.1016/j.bandl.2016.02.004 · Cited by 60 · see citing works
The 'Gateway Belief' Illusion: Reanalyzing the Results of a Scientific-consensus Messaging Study
Kahan, D. M. (2016) · Journal of Science Communication · doi:10.22323/2.16050203 · Cited by 61 · see citing works
Chmielewski, W. X., Mückschel, M., & Beste, C. (2018) · Human Brain Mapping · doi:10.1002/hbm.23974 · Cited by 60 · see citing works
Pscherer, C., Mückschel, M., Summerer, L., Bluschke, A., & Beste, C. (2019) · Human Brain Mapping · doi:10.1002/hbm.24699 · Cited by 57 · see citing works
Which Phish Is on the Hook? Phishing Vulnerability for Older Versus Younger Adults
Sarno, D. M., Lewis, J., Bohil, C. J., & Neider, M. B. (2019) · Human Factors The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720819855570 · Cited by 59 · see citing works
Human cerebellum and corticocerebellar connections involved in emotional memory enhancement
Fastenrath, M., Spalek, K., Coynel, D., Loos, E., Milnik, A., Egli, T., Schicktanz, N. S., Geissmann, L., Roozendaal, B., Papassotiropoulos, A., et al. (2022) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2204900119 · Cited by 56 · see citing works
On the dynamics of action representations evoked by names of manipulable objects.
Bub, D. N., & Masson, M. E. J. (2011) · Journal of Experimental Psychology General · doi:10.1037/a0026748 · Cited by 58 · see citing works
Self-citationNo role for motor affordances in visual working memory.
Pecher, D. (2012) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/a0028642 · Cited by 57 · see citing works
Dalmaso, M., Galfano, G., Tarqui, L., Forti, B., & Castelli, L. (2013) · Neuropsychology · doi:10.1037/a0033518 · Cited by 57 · see citing works
Seeking advice: A sampling approach to advice taking
Hütter, M., & Ache, F. (2016) · Judgment and Decision Making · doi:10.1017/s193029750000382x · Cited by 57 · see citing works
Dopamine Modulates the Efficiency of Sensory Evidence Accumulation During Perceptual Decision Making
Beste, C., Adelhöfer, N., Gohil, K., Passow, S., Roessner, V., & Li, S. (2018) · The International Journal of Neuropsychopharmacology · doi:10.1093/ijnp/pyy019 · Cited by 54 · see citing works
Winskel, H., Perea, M., & Ratitamkul, T. (2012) · Quarterly Journal of Experimental Psychology · doi:10.1080/17470218.2012.658409 · Cited by 55 · see citing works
Biased visuospatial perception in complex regional pain syndrome
Filbrich, L., Alamia, A., Verfaille, C., Berquin, A., Barbier, O., Libouton, X., Fraselle, V., Mouraux, D., & Legrain, V. (2017) · Scientific Reports · doi:10.1038/s41598-017-10077-8 · Cited by 54 · see citing works
Eating to stop: Tyrosine supplementation enhances inhibitory control but not response execution
Colzato, L. S., Jongkees, B. J., Sellaro, R., van den Wildenberg, W. P. M., & Hommel, B. (2014) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2013.12.027 · Cited by 52 · see citing works
Re-reconsidering the role of temporal order in spoken word recognition
Gregg, J. M., Inhoff, A. W., & Connine, C. M. (2019) · Quarterly Journal of Experimental Psychology · doi:10.1177/1747021819849512 · Cited by 52 · see citing works
The system neurophysiological basis of backward inhibition
Zhang, R., Stock, A., Fischer, R., & Beste, C. (2016) · Brain Structure and Function · doi:10.1007/s00429-016-1186-0 · Cited by 51 · see citing works
Equivalent statistics and data interpretation
Francis, G. (2016) · Behavior Research Methods · doi:10.3758/s13428-016-0812-3 · Cited by 52 · see citing works
Differential Effects of Endogenous and Exogenous Attention on Sensory Tuning
Fernández, A., Okun, S., & Carrasco, M. (2021) · Journal of Neuroscience · doi:10.1523/jneurosci.0892-21.2021 · Cited by 51 · see citing works
Spatial Transposition Gradients in Visual Working Memory
Rerko, L., Oberauer, K., & Lin, H.-Y. (2013) · Quarterly Journal of Experimental Psychology · doi:10.1080/17470218.2013.789543 · Cited by 47 · see citing works
Soltanlou, M., Artemenko, C., Ehlis, A., Huber, S., Fallgatter, A. J., Dresler, T., & Nuerk, H. (2018) · Scientific Reports · doi:10.1038/s41598-018-20007-x · Cited by 51 · see citing works
- Authors
- Masson, M. E. J.
- Affiliations
- University of Victoria (CA)
- Corresponding author
- Masson, Michael E. J.
- Venue
- Behavior Research Methods
- Published
- 2011-02-08
- Volume
- 43
- Issue
- 3
- Pages
- 679-690
- ISSN
- 1554-351X (ISSN-L)
- 1554-3528
- OpenAlex
- W2151069696
- Cited by
- 752
- References
- 44
- Citations by year
- 2026: 7 · 2025: 21 · 2024: 29 · 2023: 54 · 2022: 39 · 2021: 62 · 2020: 61 · 2019: 87 · 2018: 84 · 2017: 63 · 2016: 66 · 2015: 55 · 2014: 53 · 2013: 45 · 2012: 22
- FWCI
- 34.66
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Behavior Research Methods (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Computer Science › Artificial Intelligence › Bayesian Modeling and Causal Inference
- Keywords
- Bayesian model selection, null hypothesis significance testing, Bayes factor, analysis of variance, sums of squares, evidence rating, null hypothesis, effect size
- MeSH terms
- Bayes Theorem, Data Interpretation, Statistical, Probability, Research Design, Models, Statistical
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
