How (not) to demonstrate unconscious priming: overcoming issues with post-hoc data selection, low power, and frequentist statistics

Abstract

One widely used scientific approach to studying consciousness involves contrasting conscious operations with unconscious ones. However, challenges in establishing the absence of conscious awareness have led to debates about the extent and existence of unconscious processes. We collected experimental data on unconscious semantic priming, manipulating prime presentation duration to highlight the critical role of the analysis approach in attributing priming effects to unconscious processing. We demonstrate that common practices like post-hoc data selection, low statistical power, and frequentist statistical testing can erroneously support claims of unconscious priming. Conversely, adopting best practices like direct performance-awareness contrasts, Bayesian tests, and increased statistical power can prevent such erroneous conclusions. Many past experiments, including our own, fail to meet these standards, casting doubt on previous claims about unconscious processing. Implementing these robust practices will enhance our understanding of unconscious processing and shed light on the functions and neural mechanisms of consciousness.