Evidence for unconscious priming using a Bayesian single-subject approach
Open accessAbstract
Many studies have claimed the existence of unconscious priming, but a valid statistical procedure for substantiating such claims is often lacking. Absence of prime awareness is often inferred from non-significant p-values, and priming and awareness are typically tested by comparing two separate tests. In a classic study by Vorberg, D., Mattler, U., Heinecke, A., Schmidt, T., & Schwarzbach, J. (Different time courses for visual perception and action priming. Proceedings of the National Academy of Sciences 2003, 100(10), 6275–6280.), observers were slower to identify the direction of an arrow mask when it followed an arrow prime pointing in the opposite direction, despite being unable to identify the prime direction. Using this study as a starting point, we addressed several methodological shortcomings that are common in the field. First, we used a Bayesian methodological-statistical framework to test priming effects and prime awareness at the single-subject level across multiple sessions. Second, participants received extensive training in the prime awareness task to ensure they understood and executed the task as intended. Third, we directly compared prime awareness and priming. Using this approach, we found an indirect-task advantage consistent with unconscious priming at short prime-mask stimulus onset asynchronies (SOAs) in three out of six participants, under the assumption that the awareness task was at least as sensitive as the priming task. However, unlike in the original study by Vorberg and colleagues, evidence for unconscious priming was not consistently present across all SOAs, and awareness increased with SOA. Priming effects were highly consistent across participants, whereas awareness showed substantial inter-individual variability.
AI snapshot
Written from the paper’s full text.
TL;DR
Using a Bayesian single-subject framework across multiple sessions, the authors replicated a classic unconscious-priming paradigm and found an indirect-task advantage consistent with unconscious priming in some participants and SOAs, under the assumption that the awareness task was at least as sensitive as the priming task. Unlike Vorberg et al. (2003), prime awareness increased with SOA and varied substantially across individuals, while priming was highly consistent.
Key findings
- In the initial control session, the original pattern was largely reproduced: prime discrimination showed anecdotal-to-very-strong evidence for chance at 12.5, 25, and 37.5 ms (BF10 = 0.035, 0.104, 0.772; d = 0.05, 0.13, 0.2), with above-chance performance at 50, 62.5, and 75 ms (BF10 = 4.59, 105, 33; d = 0.25, 0.32, 0.32); priming was reliable at 25–75 ms (e.g., 25 ms BF10 = 1015, d = 0.75; 75 ms BF10 = 1017, d = 1.86) but not at 12.5 ms (BF10 = 0.002, d = 0.11).
- In the modified experiment, group-level prime discrimination was above chance at all SOAs and increased with SOA (12.5 ms BF10 = 107, d = 0.2; 75 ms BF10 = 1028, d = 1.1; 300 ms BF10 > 1040, d = 6.6), while priming was absent at 12.5 ms (BF10 = 0.009, d = 0.1) and present at 25–300 ms (e.g., 62.5 ms BF10 = 1013, d = 2; 300 ms BF10 = 1014, d = 1.3).
- At the single-subject level, priming was highly consistent: all participants showed extreme evidence for no priming at 12.5 ms (BF10 < 0.01, d ≤ 0.2) and extreme evidence for priming at 25–75 ms (BF10 ≥ 1013, d ≥ 0.6). Prime awareness was variable; using the double t-test criterion, three participants met the original Vorberg-style criterion for unconscious priming in at least one SOA (participant 3 at 25, 37.5, and 50 ms; participant 4 at 25 ms; participant 5 at 25 and 37.5 ms).
- Using median-split RT-to-accuracy recoding for a direct comparison, an indirect task advantage was found across all participants in at least one SOA; at the group level there was no difference at 12.5 ms (BF10 = 0.08, d = −0.1), extreme evidence for an indirect task advantage at 25–75 ms (BF10 > 1010, d ≥ 0.2), and extreme evidence for a direct task advantage at 300 ms (BF10 = 1020, d = 2.4).
Methods
- Six participants (one man, five women; mean age 19.8 years, SD = 1.33) completed a first control session closely modeled on Vorberg et al. (2003), followed by multiple modified sessions with extensive instructions and practice, alternating prime-discrimination and mask-discrimination blocks, and a 300 ms SOA added from session two onward.
- Analyses used Bayesian single-subject and group-level regression models (logistic for prime discrimination/accuracy; RT models for priming) fitted with brms, with Bayes Factors derived via the Savage-Dickey density ratio; optional stopping continued sessions until strong evidence (BF10 > 10 or < 0.1) was reached in at least four of six SOAs for both tasks.
- For direct comparison of awareness and priming, mask-discrimination RTs were recoded as accuracy using a median-split technique, then modeled with task and session predictors; reliability and raw-versus-recoded convergence were also assessed.
Limitations
- Stated: the authors cannot determine which of their changes caused increased prime discrimination; the direct-comparison inference depends on the assumption that the direct task is at least as sensitive as the indirect task; median-split recoding entails possible information loss; and the source of interindividual variability in awareness remains unclear.
- Stated: LCD versus CRT display differences could not be fully ruled out, though prior work makes this unlikely; the 300 ms SOA may have affected motivation or strategy, although decision criterion did not differ between sessions 1 and 2.
- Evident from the text: the sample was very small (N = 6) and intensive, group-level models omitted random slopes due to convergence issues, and reliability was poor at the shortest SOA in the recoded mask task (12.5 ms = −0.53) and lower at 300 ms in prime discrimination (0.62), with ceiling performance at 300 ms.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
26 of 35 cited sources checked · 20 supported · 1 flagged · accuracy not yet measured
- Premisecitation
Most studies supporting the existence of unconscious priming rely on a dissociation procedure, i.e., showing that prime awareness is not significantly different from chance while also showing a significant priming effect.
“Most studies supporting the existence of unconscious priming rely on what is usually referred to as a dissociation procedure (Reingold and Merikle 1988, Hannula et al. 2005, Schmidt and Vorberg 2006), i.e. showing that prime awareness is not significantly different from chance, while also showing a significant priming effect.”
Quote in the paperSubstantial claim2 of 3 sources checked- cites Reingold and Merikle 1988 source
The paper’s opening discussion (p. 563) says many studies of perception without awareness use a dissociation between an awareness measure and an indirect measure. Its description of the procedure requires null sensitivity on the direct measure and greater-than-zero sensitivity on the indirect measure. It does not specifically establish that most unconscious-priming studies use this procedure, or equate null sensitivity with a result merely not significantly different from chance. (LLM, conf=0.83)
Experimental — accuracy not yet measured - cites Hannula et al. 2005 source
- cites Schmidt and Vorberg 2006 source
- Premisecitation
The problem of non-significant p-values can be addressed by using either alternative frequentist or Bayesian methods that can provide evidence for the absence of an effect.
“Fortunately, this problem can be addressed by using either alternative frequentist (Lakens 2017) or Bayesian (Rouder et al. 2009, Dienes 2014) methods that can provide evidence for the absence of an effect.”
Quote in the paperSubstantial claim3 of 3 sources checked - Premisecitation
Non-significant p-values are not sufficient evidence to claim the absence of an effect, as they may also reflect insufficient power to detect a small non-zero effect.
“Although this is common practice, non-significant p-values are not sufficient evidence to claim the absence of an effect, as they may also reflect insufficient power to detect a small non-zero effect (Keysers et al. 2020).”
Quote in the paperSubstantial claim1 of 1 sources checked- cites Keysers et al. 2020 source
- Study design and conductcitation
The study tested at the single subject level using a Bayesian statistical framework, instead of performing a frequentist fixed effect analysis at the group level as Vorberg et al. (2003) did.
“(iv) As in Vorberg et al. (2003), we collected the data of six participants across multiple sessions. However, instead of performing a frequentist fixed effect analysis at the group level as Vorberg et al. (2003) did, we tested at the single subject level using a Bayesian statistical framework.”
Quote in the paperSubstantial claim1 of 1 sources checked- cites Vorberg et al. (2003) source
The Subjects passages report six participants tested across multiple sessions in each experiment. The Statistical methods passage describes frequentist group-level tests, including summed χ² statistics and repeated-measures ANOVAs, but it also says performance was tested for significance separately for each subject and condition. Thus the contrast with single-subject testing is overstated; the paper does not explicitly describe its analysis as fixed-effect. (LLM, conf=0.86)
Experimental — accuracy not yet measured
- Interpretationown data
Unlike in the original study by Vorberg and colleagues, evidence for unconscious priming was not consistently present across all SOAs.
“However, unlike in the original study by Vorberg and colleagues, evidence for unconscious priming was not consistently present across all SOAs”
- Also stated in: § Abstract · plain
“Unlike Vorberg, D., Mattler, U., Heinecke, A., Schmidt, T., & Schwarzbach, J. (Different time courses for visual perception and action priming. Proceedings of the National Academy of Sciences 2003, 100(10), 6275–6280.) original study, unconscious priming was not consistently present across stimulus onset asynchronies (SOAs)”
Quote in the paperSubstantial claim1 of 1 sources checked- cites Vorberg et al. (2003) source
- Also stated in: § Abstract · plain
- Premisecitation
The statistically proper way to compare awareness and priming effects is to directly compare both effects to establish an indirect task advantage.
“The statistically proper way to compare the awareness and priming effects is to directly compare both effects to establish what has been dubbed an ‘indirect task advantage’”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites Meyen et al. 2022 source
- Findingown data
The data pattern from the initial session mostly replicated the original results by Vorberg et al. (2003).
“The data pattern from the initial session mostly replicated the original results by Vorberg et al. (2003).”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites Vorberg et al. (2003) source
- Findingown data
In the first session, the overall data pattern was similar to that obtained in Vorberg et al. (2003).
“As can be seen in Fig. 2, the overall data pattern was similar to that obtained in their study (see Fig. 1A and B).”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites Vorberg et al. (2003) source
- Findingown data
Awareness showed substantial inter-individual variability.
“whereas awareness showed substantial inter-individual variability”
- Also stated in: § Abstract · plain
“robust priming effects coexisted with highly variable awareness across individuals”
Quote in the paperSubstantial claim - Also stated in: § Abstract · plain
- Findingown data
Priming effects were highly consistent across participants.
“Priming effects were highly consistent across participants”
- Also stated in: § Abstract · plain
“robust priming effects coexisted with highly variable awareness across individuals”
Quote in the paperNot a substantial claim - Also stated in: § Abstract · plain
- Findingown data
The study found an indirect-task advantage at short prime-mask SOAs in three out of six participants.
“we found an indirect-task advantage consistent with unconscious priming at short prime-mask stimulus onset asynchronies (SOAs) in three out of six participants”
- Also stated in: § Abstract · boosted
“this study provides robust evidence for an indirect-task advantage”
Quote in the paperSubstantial claim - Also stated in: § Abstract · boosted
- Findingown data
Awareness increased with prime-mask SOA.
“and awareness increased with SOA”
- Also stated in: § Abstract · plain
“as prime awareness increased with prime-mask SOA”
- Also stated in: § Results · boosted
“at the group level, participants were able to discriminate the direction of the prime above chance across all SOAs, and unlike in the original study this ability also strongly increased with SOA”
Quote in the paperSubstantial claim - Also stated in: § Abstract · plain
- Findingown data
Very strong evidence for above-chance performance (BF10 ≥ 30) in the prime discrimination task was predominant at the 37.5 ms SOA.
“Very strong evidence for above-chance performance (BF10 ≥ 30) was predominant at the 37.5 ms SOA.”
Quote in the paperSubstantial claim - Findingown data
In the prime discrimination task, the Spearman-Brown corrected reliability estimate was at least 0.74 in all SOAs except for the 300 ms SOA, for which it was 0.6.
“In the prime discrimination task, the Spearman-Brown corrected reliability estimate was at least 0.74 in all SOAs except for the 300 ms SOA, for which it was 0.6”
Quote in the paperSubstantial claim - Findingown data
When pooling data of all subjects, there was extreme evidence for an indirect task advantage at all remaining SOAs (25-75 ms: BF10 > 10^10, d ≥ 0.2).
“and extreme evidence for an indirect task advantage at all remaining SOAs (25–75 ms: BF10 > 1010, d > = 0.2”
Quote in the paperSubstantial claim - Findingown data
At the single-subject level in Experiment 1, there was considerable variability in how well participants performed the prime discrimination task.
“To summarize, there was considerable variability in how well participants were able to perform the prime discrimination task.”
Quote in the paperNot a substantial claim - Findingown data
In the mask discrimination task, all participants showed extreme evidence for the absence of a priming effect at the shortest SOA (12.5 ms: BF10 < 0.01, d ≤ 0.2).
“all participants showed extreme evidence for the absence of a priming effect at the shortest SOA (12.5 ms: BF10 < 0.01, d ≤ 0.2)”
Quote in the paperSubstantial claim - Findingown data
At the 300 ms SOA, there was extreme evidence for a direct task advantage (BF10 = 10^20, d = 2.4).
“the 300 ms SOA resulted in extreme evidence for a direct task advantage, i.e. for prime discrimination exceeding the priming effect (BF10 = 1020, d = 2.4)”
Quote in the paperNot a substantial claim - Findingown data
Reliability was medium to high for most SOAs.
“To summarize, reliability was medium to high for most SOAs.”
Quote in the paperSubstantial claim - Findingreasoning
At the single subject level, most participants were able to discriminate the direction of the prime across most SOAs.
“At the single subject level, most participants were able to discriminate the direction of the prime across most SOAs”
Quote in the paperNot a substantial claim - Findingown data
In terms of effect size, participants performed barely above-chance at the two shortest SOAs (12.5 and 25 ms: d ≤ 0.3).
“However, note that, in terms of effect size, participants performed barely above-chance at the two shortest SOAs (12.5 and 25 ms: d ≤ 0.3).”
Quote in the paperNot a substantial claim - Findingown data
There was strong to very strong evidence (BF10 < 0.06) for no difference in decision criterion between sessions 1 and 2.
“we found strong to very strong evidence (BF10 < 0.06) for no difference in decision criterion”
Quote in the paperSubstantial claim - Findingown data
When pooling data of all subjects, there was strong evidence for no difference between tasks at the shortest SOA (12.5 ms: BF10 = 0.08, d = −0.1).
“When pooling the data of all subjects, there was strong evidence for no difference between tasks at the shortest SOA (12.5 ms: BF10 = 0.08, d = −0.1)”
Quote in the paperNot a substantial claim - Findingown data
Using the direct-comparison approach, the study found an indirect task advantage (priming effect larger than prime discrimination performance) across all participants in at least one SOA.
“Using this approach, we found an indirect task advantage (priming effect larger than prime discrimination performance) across all participants in at least one SOA.”
Quote in the paperSubstantial claim - Findingown data
In the first session, when participants had to discriminate the direction of the prime, there was anecdotal to very strong evidence for chance performance at the three shortest SOAs (12.5 ms, 25 ms, 37.5 ms).
“When participants had to discriminate the direction of the prime, there was anecdotal to very strong evidence for chance performance at the three shortest SOAs (12.5 ms: BF10 = 0.035, d = 0.05; 25 ms: BF10 = 0.104, d = 0.13; 37.5 ms: BF10 = 0.772, d = 0.2)”
Quote in the paperNot a substantial claim - Findingown data
Some participants seemed able to discriminate the direction of the prime at longer SOAs from the very beginning, without the need for practice or extensive instructions.
“some participants seemed to be able to discriminate the direction of the prime at longer SOAs from the very beginning, without the need for practice or extensive instructions.”
Quote in the paperNot a substantial claim - Findingown data
There was extreme evidence (BF10 > 10^40) that raw priming values predicted recoded priming values, after accounting for SOA and session, with an R2 of 0.68 (95% CI [0.60, 0.75]).
“There was extreme evidence (BF10 > 1040) that raw priming values predicted recoded priming values, after accounting for SOA and session, with an R2 of 0.68 (95% CI [0.60 0.75]).”
Quote in the paperSubstantial claim - Findingown data
In the mask discrimination task (RT-recoded responses), reliability was lowest for the two shortest SOAs (12.5 ms = −0.53; 25 ms = 0.63), whereas for the rest it was above 0.9.
“In the mask discrimination task (RT-recoded responses), the reliability was the lowest for the two shortest SOAs (12.5 ms = −0.53 95% CI [−0.89, 0.68]; 25 ms = 0.63 [−0.19, 0.95]), whereas for the rest it was above 0.9”
Quote in the paperSubstantial claim - Findingown data
There was more variance in the prime discrimination task than in the mask discrimination task in most SOAs.
“there was more variance in the prime discrimination task in most SOAs”
Quote in the paperSubstantial claim - Findingown data
This evidence for unconscious priming was present only for some participants and some SOAs.
“This evidence was nevertheless present only for some participants and some SOAs.”
Quote in the paperNot a substantial claim - Findingown data
The median correlation between raw priming RT and median-split transformed values was strong across all participants (r between 0.84 and 0.93).
“The correlation was strong across all participants (r between 0.84 and 0.93).”
Quote in the paperSubstantial claim - Findingown data
There was moderate evidence (BF10 = 6) for the variance being larger in the prime discrimination task compared to the mask discrimination (RT-recoded) task.
“There was moderate evidence (BF10 = 6) for the variance being larger in the prime discrimination task compared to the mask discrimination (RT-recoded) task”
Quote in the paperNot a substantial claim - Findingown data
In the mask discrimination task, there was extreme evidence for a priming effect at all remaining SOAs (25-75 ms: BF10 ≥ 10^13, d ≥ 0.6).
“while there was extreme evidence for a priming effect in all the remaining SOAs (25–75 ms: BF10 > = 1013, d > = 0.6”
Quote in the paperSubstantial claim - Findingown data
In the first session, there was moderate to extreme evidence for above-chance performance at the three longest SOAs (50 ms, 62.5 ms, 75 ms).
“whereas there was moderate to extreme evidence for above-chance performance at the three longest SOAs (50 ms: BF10 = 4.59, d = 0.25; 62.5 ms: BF10 = 105, d = 0.32; 75 ms: BF10 = 33, d = 0.32; see Fig. 2A).”
Quote in the paperNot a substantial claim - Findingown data
The three participants that showed unconscious priming when evaluated using the double t-test approach also showed an indirect task advantage in at least one SOA.
“the three participants that showed unconscious priming when evaluated using the double t-test approach, also showed an indirect task advantage in at least one SOA.”
- Also stated in: § Discussion · plain
“Importantly, the same participants who showed unconscious priming when using the double t-test approach also showed an indirect task advantage in at least one SOA.”
Quote in the paperSubstantial claim - Also stated in: § Discussion · plain
- Findingown data
The internal consistency of prime discrimination responses was quite high across all but the 300 ms SOA.
“we show that the internal consistency of prime discrimination responses was quite high across all but the 300 ms SOA.”
Quote in the paperSubstantial claim - Premisereasoning
One issue with the dissociation approach is establishing true absence of awareness.
“One issue with this approach is establishing true absence of awareness.”
Quote in the paperSubstantial claim - Interpretationreasoning
The study advances the field by showing how unconscious priming can be tested with a single-subject approach and a direct comparison of awareness and priming.
“This study advances the field by showing how unconscious priming can be tested with a single-subject approach and a direct comparison of awareness and priming.”
Quote in the paperSubstantial claim - Premisenone given
Absence of prime awareness is often inferred from non-significant p-values.
“Absence of prime awareness is often inferred from non-significant p-values”
- Also stated in: § Introduction · plain
“The performance is often quite low and not statistically distinguishable from chance (i.e. P > .05), which is then interpreted as evidence for absence of awareness.”
Quote in the paperSubstantial claim - Also stated in: § Introduction · plain
- Interpretationreasoning
The Bayesian single-subject approach allowed the study to explicitly test for the absence of awareness separately for each participant.
“This approach allowed us to explicitly test for the absence of awareness separately for each participant.”
Quote in the paperSubstantial claim - Premisecitation
In this Bayesian testing framework optional stopping is not considered problematic.
“In this Bayesian testing framework optional stopping is not considered problematic (Rouder 2014).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Rouder 2014 source
- Interpretationcitation
It is unlikely that a difference in display technology (LCD vs CRT) could fully explain the increased prime awareness found in the study.
“Therefore, although not impossible, it is unlikely that a difference in the display technology could fully explain the increased prime awareness we find in our study.”
Quote in the paperSubstantial claim - Interpretationreasoning
Even with clear instructions and sufficient training, individual differences may pose a problem when concluding lack of awareness across participants, as interindividual differences in performance on the awareness measure may be confounded by differences in the ability to appropriately respond to task demands.
“However, even with such measures and procedures in place, individual differences may pose a problem when concluding lack of awareness across participants, as interindividual differences in performance on the awareness measure may be confounded by differences in the ability to appropriately respond to task demands.”
Quote in the paperSubstantial claim - Interpretationreasoning
The extensive training introduced in the modified version of the task plausibly contributed to the improved prime discrimination performance.
“plausibly due to the extensive training introduced in our modified version of the task.”
Quote in the paperNot a substantial claim - Interpretationreasoning
It is unlikely that differences in timing could explain the increased performance in the prime discrimination task observed in the study.
“it is unlikely that differences in timing could explain the increased performance in the prime discrimination task we observed in our study.”
Quote in the paperSubstantial claim - Interpretationreasoning
Because the direct comparison provides a valid test of an indirect task advantage, these results strengthen the evidence for unconscious priming under the assumption that the direct task is at least as sensitive as the indirect task.
“Because, unlike the double t-test approach, the direct comparison provides a valid test of an indirect task advantage, these results strengthen the evidence for unconscious priming under the assumption that the direct task is at least as sensitive as the indirect task.”
Quote in the paperSubstantial claim- The authors state this as an assumption: The direct task is at least as sensitive as the indirect task to the relevant prime information.
- Premisecitation
The double t-test approach is problematic because comparing two experimental effects requires a statistical test on their difference.
“The combination of two Bayesian t-tests (one to determine the presence or absence of awareness and another to determine the presence of a priming effect) essentially suffers from the same problem as executing two frequentist t-tests: the comparison of two experimental effects requires a statistical test on their difference”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Nieuwenhuis et al. 2011 source
- Classified as probably not a substantial claim. 34
- May combine two claims. 25
- The quote only partly states this claim. 1
Classified as probably not a substantial claim. May combine two claims.
Study design and conductnone givenParticipants were thoroughly instructed and practised each task before completing the experiment, in contrast to Vorberg et al. (2003), where participants received minimal instructions and did not practice the tasks.
“(i) Participants were thoroughly instructed and practised each task before completing the experiment, in contrast to Vorberg et al. (2003), where participants received minimal instructions and did not practice the tasks.”
Quote in the paperSubstantial claim1 of 1 sources checked- cites Vorberg et al. (2003) source
The Method/Design passage (page unavailable) describes task-specific instructions, including response speed and timing, rather than establishing that participants received minimal instructions. It also reports repeated task sessions; for Experiment 2, data were reported only from sessions three to seven. The paper does not explicitly identify dedicated practice trials, but its account is contrary to the unqualified claim that participants did not practise the tasks. (LLM, conf=0.72)
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measured
May combine two claims.
PremisecitationIn Vorberg et al. (2003), observers were slower to identify the direction of an arrow mask when it followed an arrow prime pointing in the opposite direction, despite being unable to identify the prime direction.
“In a classic study by Vorberg, D., Mattler, U., Heinecke, A., Schmidt, T., & Schwarzbach, J. (Different time courses for visual perception and action priming. Proceedings of the National Academy of Sciences 2003, 100(10), 6275–6280.), observers were slower to identify the direction of an arrow mask when it followed an arrow prime pointing in the opposite direction, despite being unable to identify”
- Also stated in: § Introduction · plain
“For example, in a classic study by Vorberg et al. (2003), observers were faster to identify the direction of an arrow-shaped mask when it followed an arrow-shaped prime pointing in the same (rather than the opposite) direction (priming effect), despite them not being able to discriminate the direction of the prime”
Quote in the paperSubstantial claim1 of 1 sources checked- cites Vorberg et al. (2003) source
- Also stated in: § Introduction · plain
Classified as probably not a substantial claim.
Study design and conductcitationThe decision to collect data until four out of six prime-mask SOAs met the stopping rule was made in order to keep data collection manageable, given that larger samples are often needed to obtain the same strength of evidence for the null than for the alternative hypothesis.
“The decision to collect data until four out of six prime-mask SOAs met the stopping rule was made in order to keep data collection manageable, given that larger samples are often needed to obtain the same strength of evidence for the null than for the alternative hypothesis (Stefan et al. 2019).”
Quote in the paperSubstantial claim1 of 1 sources checked- cites Stefan et al. 2019 source
Classified as probably not a substantial claim.
PremisecitationBased on Vorberg et al. (2003), the authors expected most SOAs in the prime discrimination task to show null or near-zero effects.
“Moreover, based on (Vorberg et al. 2003) we expected most SOAs in the prime discrimination task to show null or near-zero effects.”
Quote in the paperSubstantial claim1 of 1 sources checked- cites Vorberg et al. 2003 source
Classified as probably not a substantial claim.
Study design and conductcitationThe stimuli were reconstructed to be as close as possible to the original based on the visual material and specifications in the methods of Vorberg et al. (2003).
“Based on the visual material and specifications in the methods of Vorberg et al. (2003), we reconstructed the stimuli to be as close as possible to the original.”
Quote in the paperSubstantial claim1 of 1 sources checked- cites Vorberg et al. (2003) source
May combine two claims.
PremisecitationSelecting subjects based on the same data used to demonstrate the absence of awareness is comparable to double-dipping and likely to confound the results with regression to the mean.
“This practice is problematic because selecting subjects based on the same data used to demonstrate the absence of awareness is comparable to “double-dipping” (Kriegeskorte et al. 2009) and likely to confound the results with regression to the mean (Shanks 2017, Stein et al. 2024).”
Quote in the paperSubstantial claim2 of 3 sources checkedClassified as probably not a substantial claim.
PremisecitationMany unconscious priming studies, including Vorberg et al. (2003), rely on the double t-test approach.
“Further, many unconscious priming studies, including Vorberg et al. (2003), rely on what is known as the double t-test approach.”
Quote in the paperSubstantial claim1 of 1 sources checked- cites Vorberg et al. (2003) source
In Experiment 1, the Results report priming despite prime-orientation recognition remaining at chance, consistent with comparing an indirect priming measure against a direct awareness measure. But the Statistical methods section says recognition was tested with chi-square tests and reaction-time differences with ANOVAs, not two t-tests. The paper therefore supports the comparison underlying the claim, but not its literal description as a double t-test. (LLM, conf=0.84)
Experimental — accuracy not yet measured
Classified as probably not a substantial claim.
Study design and conductreasoningInstead of performing one task per session, the study alternated prime discrimination blocks and mask discrimination blocks in the same session to control for session-level confounds, such as differences in motivation or fatigue.
“(ii) Instead of performing one task per session, as in Vorberg et al. (2003), we alternated prime discrimination blocks and mask discrimination blocks in the same session (see Fig. 1C) to control for session-level confounds, such as differences in motivation or fatigue.”
Quote in the paperSubstantial claim1 of 1 sources checked- cites Vorberg et al. (2003) source
The Experiment 1 Design passage assigns several tasks to separate sessions, supporting the comparison in part. But the Experiment 2 Design passage says choice reaction and prime recognition were administered in an a-d-a order within each session. Thus, 'one task per session' does not describe the cited paper as a whole; the citing authors’ stated reason for their own design is not attributed to Vorberg et al. (LLM, conf=0.88)
Experimental — accuracy not yet measured
Probably not a substantial claim: may not pass S2 (checkable).
PremisecitationIn a proper statistical framework, priming and prime awareness should be compared directly on the same scale and within the same statistical test.
“Instead, in a proper statistical framework, priming and prime awareness should be compared directly on the same scale and within the same statistical test (Meyen et al. 2022, Stein et al. 2024).”
Quote in the paperNot a substantial claim1 of 2 sources checkedProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductcitationIn the first session, the authors tried to replicate the core original experiment by Vorberg et al. (2003) as closely as possible.
“In the first session, we tried to replicate the core original experiment by Vorberg et al. (2003) as closely as possible (albeit with slightly different presentation times and different display technology; see Stimuli, timing and apparatus above).”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites Vorberg et al. (2003) source
May combine two claims.
Findingown dataThe mask discrimination results closely resembled the original results by Vorberg et al. (2003): RTs were, on average, longer for incongruent compared with congruent trials, and this priming effect difference became more pronounced as the SOA increased.
“The mask discrimination results closely resembled the original results by Vorberg et al. (2003): RTs were, on average, longer for incongruent compared with congruent trials (see 3B), and this priming effect difference became more pronounced as the SOA increased (12.5 ms: BF10 = 0.009, d = 0.1; 25 ms: BF10 = 1019, d = 0.8; 37.5 ms: BF10 = 1013, d = 1.4; 50 ms: BF10 = 1013, d = 1.7; 62.5 ms: BF10 =”
Quote in the paperSubstantial claim1 of 1 sources checked- cites Vorberg et al. (2003) source
The quote only partly states this claim.
PremisereasoningRecoding RT data of the mask discrimination task as accuracy using the median-split technique allowed direct testing of prime discrimination and priming effect within the same scale and statistical test.
“we recoded the RT data of the mask discrimination task as accuracy using the median-split technique”
Quote in the paperSubstantial claim1 of 2 sources checkedMay combine two claims.
Findingown dataAt the group level, participants were able to discriminate the direction of the prime above chance across all SOAs, and this ability strongly increased with SOA.
“Unlike Vorberg et al. (2003), at the group level, participants were able to discriminate the direction of the prime above chance across all SOAs, and unlike in the original study this ability also strongly increased with SOA (12.5 ms: BF10 = 107, d = 0.2; 25 ms: BF10 = 1015, d = 0.2; 37.5 ms: BF10 > 1040, d = 0.3; 50 ms: BF10 = 1014, d = 0.6; 62.5 ms: BF10 > 1040, d = 0.8; 75 ms: BF10 = 1028, d =”
Quote in the paperSubstantial claim1 of 1 sources checked- cites Vorberg et al. (2003) source
In the paper’s Experiment 1 Results (indexed as Abstract; no page given), prime-orientation recognition remained at chance across the tested SOAs, supporting the contrast with above-chance discrimination. But Experiment 2 Results and Discussion (also indexed as Abstract; no page given) reports that recognition of short primes improved as the mask occurred later. The claim that recognition did not increase with SOA in the original study is therefore too broad. (LLM, conf=0.85)
Experimental — accuracy not yet measured
Probably not a substantial claim: may not pass S3 (load-bearing).
Findingnone givenAll participants were able to successfully complete the practice requirements.
“All participants were able to successfully complete the practice requirements.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataIn the modified version of the task, prime discrimination performance at the group level was overall above chance and increased at longer SOAs, similar to the priming effect, albeit with smaller effect sizes.
“In contrast to Vorberg et al. (2003), prime discrimination performance at the group level was overall above chance and increased at longer SOAs, similar to the priming effect, albeit with smaller effect sizes.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataOnly at the longest SOAs there was more variance in the priming effect than in the prime discrimination task, reflecting ceiling performance in the prime discrimination task at the 300 ms SOA.
“Only at the longest SOAs there was more variance in the priming effect than in the prime discrimination task, reflecting ceiling performance in the prime discrimination task at the 300 ms SOA.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataMost participants performed at chance or near-chance at the two shortest SOAs (12.5 and 25 ms) in the prime discrimination task, with performance improving at longer SOAs.
“Further, most participants performed at chance or near-chance at the two shortest SOAs, with their performance improving at longer SOAs.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataIn the prime detection task, the false alarm rate was similar across SOAs (~4%) and the hit-rate went from roughly 50% to 90% across SOAs, suggesting participants could detect the prime across all SOAs.
“In our version of this task the false alarm rate was similar across SOAs (~4%) and the hit-rate went from roughly 50% to 90% across SOAs, suggesting participants could detect the prime across all SOAs (see Supplementary Fig. S2).”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataAll participants showed the same pattern of results in the mask discrimination task: no priming effect at the shortest SOA, with a gradual increase in priming at longer SOAs.
“all participants showed the same pattern of results in the mask discrimination task, no priming effect at the shortest SOA, with a gradual increase in priming at longer SOAs.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataBoth subject- and group-level results offer strong evidence for an indirect task advantage across all subjects and multiple SOAs.
“both subject- and group-level results offer strong evidence for an indirect task advantage across all subjects and multiple SOAs.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataThree participants met the original Vorberg-style criterion for unconscious priming in at least one SOA: participant 3 at 25, 37.5 and 50 ms; participant 4 at 25 ms; participant 5 at 25 and 37.5 ms.
“Participant 3 at the 25, 37.5 and 50 ms SOAs, participant 4 at the 25 ms SOA, and participant 5 at the 25 and 37.5 ms SOAs”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataEven at the longest SOA, the effect size did not exceed 0.32, suggesting that participants performed barely above chance.
“Note, however, that even at the longest SOA, the effect size did not exceed 0.32, suggesting that participants performed barely above chance.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataThe SOA-priming profile was highly consistent across subjects, whereas prime awareness was much more variable.
“the SOA-priming profile was highly consistent across subjects, whereas prime awareness was much more variable.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataAt the 300 ms SOA, there was extreme evidence for a larger effect on prime discrimination compared to priming, and this was true for all participants.
“At the 300 ms SOA there was extreme evidence for a larger effect on prime discrimination compared to priming, and this was true for all participants.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim. May combine two claims.
Study design and conductnone givenAnalyses were conducted at the single-subject level using a Bayesian sequential testing framework and a pre-defined stopping rule.
“Analyses were conducted at the single-subject level using a Bayesian sequential testing framework and a pre-defined stopping rule.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing), S4 (based).
Premisenone givenSome studies may remove participants performing above chance to then test priming on a post-hoc selected subsample.
“Note also that some studies may remove participants performing above chance to then test priming on a post-hoc selected subsample.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Study design and conductreasoningFrom session two onwards, a condition with a long SOA of 300 ms was added to reduce the overall difficulty of the experiment and to provide some trials in which the relevant feature of the stimulus was clearly visible.
“From session two onwards, we added a condition with a long SOA of 300 ms to reduce the overall difficulty of the experiment and to provide some trials in which the relevant feature of the stimulus was clearly visible (see General Procedure for the full rationale).”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim.
InterpretationreasoningAwareness could be present in both cases but not reflected in participants' prime discrimination responses.
“Awareness could be present in both cases but not reflected in their prime discrimination responses.”
Quote in the paperSubstantial claimClassified as probably not a substantial claim. May combine two claims.
Premisenone givenMany studies have claimed the existence of unconscious priming, but a valid statistical procedure for substantiating such claims is often lacking.
“Many studies have claimed the existence of unconscious priming, but a valid statistical procedure for substantiating such claims is often lacking.”
- Also stated in: § Introduction · plain
“Although many studies have claimed such unconscious priming effects, the topic remains controversial, as claims of unconscious priming often rely on statistical tests that fail to adequately demonstrate the absence of awareness.”
Quote in the paperSubstantial claim- Also stated in: § Introduction · plain
Classified as probably not a substantial claim.
PremisecitationPriming and awareness are typically tested by comparing two separate tests.
“priming and awareness are typically tested by comparing two separate tests”
- Also stated in: § Introduction · boosted
“many unconscious priming studies, including Vorberg et al. (2003), rely on what is known as the double t-test approach. In this approach, the comparison of two experimental effects is performed by executing two separate t-tests and independently establishing significance for each.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Nieuwenhuis et al. 2011 source
- Also stated in: § Introduction · boosted
Classified as probably not a substantial claim.
Study design and conductreasoningTo ensure participants were executing the prime discrimination as intended, the authors devised a progressively difficult practice block in which participants could practice experiment-like trials while also having to perform perfectly on easy trials.
“To ensure participants were executing the prime discrimination as intended, we devised a progressively difficult practice block in which participants could practice experiment-like trials (12.5–75 ms SOA) while also having to perform perfectly on easy trials (300 ms SOA).”
Quote in the paperSubstantial claimClassified as probably not a substantial claim.
Study design and conductnone givenThe study used a Bayesian methodological-statistical framework to test priming effects and prime awareness at the single-subject level across multiple sessions.
“First, we used a Bayesian methodological-statistical framework to test priming effects and prime awareness at the single-subject level across multiple sessions.”
- Also stated in: § Introduction · plain
“we attempted to replicate the study by Vorberg et al. (2003) using a Bayesian framework to test for unconscious priming at the single subject level across multiple experimental sessions.”
Quote in the paperSubstantial claim- Also stated in: § Introduction · plain
Classified as probably not a substantial claim.
Study design and conductreasoningParticipants received extensive training in the prime awareness task to ensure they understood and executed the task as intended.
“Second, participants received extensive training in the prime awareness task to ensure they understood and executed the task as intended.”
- Also stated in: § Experiment 1 · plain
“In session two, participants received more detailed instructions than in session one and completed an extensive practice block for each task before starting the experiment.”
- Also stated in: § Experiment 1 · plain
“To ensure participants were executing the prime discrimination as intended, we devised a progressively difficult practice block in which participants could practice experiment-like trials (12.5–75 ms SOA) while also having to perform perfectly on easy trials (300 ms SOA).”
Quote in the paperSubstantial claim- Also stated in: § Experiment 1 · plain
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Study design and conductnone givenIn session two, participants received more detailed instructions than in session one and completed an extensive practice block for each task before starting the experiment.
“In session two, participants received more detailed instructions than in session one and completed an extensive practice block for each task before starting the experiment.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Premisenone givenTypically, researchers ask participants to detect or discriminate a masked prime across many trials and then calculate an aggregated measure of performance, such as proportion correct or Signal Detection Theory's d'.
“Typically, researchers ask participants to detect or discriminate a masked prime across many trials and then calculate an aggregated measure of performance, such as proportion correct or Signal Detection Theory’s d’.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductnone givenNo participants were excluded from analysis.
“No participants were excluded from analysis.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim.
Study design and conductnone givenInstead of testing a fixed number of sessions, each participant completed consecutive sessions until the Bayesian statistical framework indicated sufficient evidence for or against unconscious priming based on a pre-defined stopping rule.
“Further, instead of testing a fixed number of sessions, each participant completed consecutive sessions until our Bayesian statistical framework indicated that there was sufficient evidence for or against unconscious priming based on a pre-defined stopping rule.”
Quote in the paperSubstantial claimClassified as probably not a substantial claim. May combine two claims.
PremisecitationIn the double t-test approach, the comparison of two experimental effects is performed by executing two separate t-tests and independently establishing significance for each; when one is significant and the other is not, one concludes they are different.
“In this approach, the comparison of two experimental effects is performed by executing two separate t-tests and independently establishing significance for each. When one turns out to be significant and the other is not, one concludes that they are different (Nieuwenhuis et al. 2011).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Nieuwenhuis et al. 2011 source
Classified as probably not a substantial claim.
Study design and conductown dataThe study directly compared prime awareness and priming.
“Third, we directly compared prime awareness and priming.”
- Also stated in: § Experiment 1 · plain
“To directly test prime discrimination and priming, we fitted a logistic regression model to the prime discrimination and RT-recoded mask discrimination trial-level data separately for each participant and each SOA.”
Quote in the paperSubstantial claim- Also stated in: § Experiment 1 · plain
Probably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductnone givenAll experimental procedures were approved by the Ethical Review Board (VCWE) of the Free University Amsterdam (ref. number VCWE-2021-173).
“All experimental procedures were approved by the Ethical Review Board (VCWE) of the Free University Amsterdam (ref. number VCWE-2021-173).”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductnone givenFrom session three onwards, participants received instructions and completed a 30-trial warm-up block for each task before starting the experiment.
“From session three onwards, participants received instructions and completed a 30-trial warm-up block for each task before starting the experiment.”
Quote in the paperNot a substantial claimMay combine two claims.
Interpretationown dataThe indirect-task advantage is consistent with unconscious priming, under the assumption that the awareness task was at least as sensitive as the priming task.
“consistent with unconscious priming at short prime-mask stimulus onset asynchronies (SOAs) in three out of six participants, under the assumption that the awareness task was at least as sensitive as the priming task.”
- Also stated in: § Abstract · boosted
“provides robust evidence for an indirect-task advantage, consistent with unconscious priming under the assumption that the awareness task was at least as sensitive as the priming task.”
Quote in the paperSubstantial claim- The authors state this as an assumption: The awareness task was at least as sensitive as the priming task.
- Also stated in: § Abstract · boosted
Probably not a substantial claim: may not pass S4 (based).
Premisenone givenAwareness is frequently assessed by asking participants to complete a difficult task with little or no practice.
“Another often overlooked issue is that awareness is frequently assessed by asking participants to complete a difficult task (e.g. discriminating briefly presented masked stimuli) with little or no practice.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S4 (based).
Premisenone givenEven if participants are trained and know in principle how to perform the task, some may still give up on awareness trials if the task is so difficult that they feel they cannot perform the task meaningfully.
“Additionally, even if participants are trained and know in principle how to perform the task, some of them may still give up on awareness trials if the task is so difficult that they feel they cannot perform the task meaningfully (i.e. performing above chance).”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim. May combine two claims.
Premisenone givenPerformance is often quite low and not statistically distinguishable from chance (P > .05), which is then interpreted as evidence for absence of awareness.
“The performance is often quite low and not statistically distinguishable from chance (i.e. P > .05), which is then interpreted as evidence for absence of awareness.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductreasoningTo reduce the chances of participants giving up, the authors included a set of trials with a long SOA (300 ms), in which the relevant feature of the prime stimulus was clearly visible.
“To reduce the chances of participants giving up, we included a set of trials with a long SOA (300 ms), in which the relevant feature of the prime stimulus participants was clearly visible.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim.
Study design and conductreasoningAfter session one, each participant completed consecutive experimental sessions until there was strong evidence for either an effect or no effect in at least four out of six prime-mask SOAs both in the prime discrimination and in the mask discrimination task.
“After session one, each participant completed consecutive experimental sessions until there was strong evidence for either an effect (BF10 10) or no effect (BF10 0.1) in at least four out of six prime-mask stimulus onset asynchronies (SOAs) (see Stimuli and timing) both in the prime discrimination and in the mask discrimination task (see Analysis for a detailed description of the prime and mask”
Quote in the paperSubstantial claimClassified as probably not a substantial claim.
Study design and conductnone givenOnly sessions two and onwards were included in the analysis relevant for the application of the optional stopping rule.
“Only sessions two and onwards were included in the analysis relevant for the application of the optional stopping rule.”
Quote in the paperSubstantial claimClassified as probably not a substantial claim.
PremisereasoningIn this context, it is not straightforward to judge whether a participant is performing at chance due to the difficulty of the task or because they do not know how to perform the task, even though the relevant information to perform the task is still consciously perceived.
“In this context, it is not straightforward to judge whether a participant is performing at chance due to the difficulty of the task or because they do not know how to perform the task, even though the relevant information to perform the task is still consciously perceived.”
Quote in the paperSubstantial claimClassified as probably not a substantial claim. May combine two claims.
InterpretationreasoningApparent lack of awareness may partially reflect disengagement and/or an inability to convert perceptual experiences into behavioural responses.
“otherwise, apparent lack of awareness may partially reflect disengagement and/or an inability to convert perceptual experiences into behavioural responses.”
Quote in the paperSubstantial claimMay combine two claims.
InterpretationreasoningThe study's findings provide evidence for unconscious priming at the single-subject level using the direct-comparison approach, while the conclusion depends on the assumption that the direct task is at least as sensitive as the indirect task.
“To conclude, our findings provide evidence for unconscious priming at the single-subject level using the direct-comparison approach, while also emphasizing that this conclusion depends on the assumption that the direct task is at least as sensitive as the indirect task.”
Quote in the paperSubstantial claim- The authors state this as an assumption: The direct task is at least as sensitive as the indirect task to the relevant prime information.
May combine two claims.
InterpretationreasoningThe variability observed in prime awareness is unlikely to reflect measurement noise alone and is at least partly consistent with genuine individual differences in perceptual sensitivity.
“Therefore, the variability we observe is unlikely to reflect measurement noise alone and is at least partly consistent with genuine individual differences in perceptual sensitivity”
Quote in the paperSubstantial claim
The authors state this as an assumption.
The awareness task was at least as sensitive as the priming task.
“under the assumption that the awareness task was at least as sensitive as the priming task”
“under the assumption that the awareness task was at least as sensitive as the priming task”
The authors state this as an assumption.
The direct task is at least as sensitive as the indirect task to the relevant prime information.
“this inference relies on the assumption that the direct task is at least as sensitive as the indirect task to the relevant prime information”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Evidence at the shortest SOAs is mislabeled as very strong
MinorThe largest evidence for chance performance among the three listed SOAs is BF10 = 0.035, equivalent to BF01 ≈ 28.6. By the paper's own thresholds, that is strong-not very strong-evidence.
“there was anecdotal to very strong evidence for chance performance at the three shortest SOAs (12.5 ms: BF10 = 0.035, d = 0.05; 25 ms: BF10 = 0.104, d = 0.13; 37.5 ms: BF10 = 0.772, d = 0.2)”
“strong evidence (10 ≤ BF10 < 30), very strong evidence (30 ≤ BF10 < 100)”
Cites
<b>brms</b> : An <i>R</i> Package for Bayesian Multilevel Models Using <i>Stan</i>
Bürkner, P.-C. (2017) · Journal of Statistical Software · doi:10.18637/jss.v080.i01 · Cited by 9,476 · see citing works
Bayesian t tests for accepting and rejecting the null hypothesis
Rouder, J. N., Speckman, P. L., Sun, D., Morey, R. D., & Iverson, G. (2009) · Psychonomic Bulletin & Review · doi:10.3758/pbr.16.2.225 · Cited by 3,688 · see citing works
Circular analysis in systems neuroscience: the dangers of double dipping
Kriegeskorte, N., Simmons, W. K., Bellgowan, P. S. F., & Baker, C. I. (2009) · Nature Neuroscience · doi:10.1038/nn.2303 · Cited by 2,696 · see citing works
Lakens, D. (2017) · Social Psychological and Personality Science · doi:10.1177/1948550617697177 · Cited by 2,161 · see citing works
Using Bayes to get the most out of non-significant results
Dienes, Z. (2014) · Frontiers in Psychology · doi:10.3389/fpsyg.2014.00781 · Cited by 1,998 · see citing works
Bayesian Cognitive Modeling: A Practical Course
Lee, M. D., & Wagenmakers, E.-J. (2014) · doi:10.1017/cbo9781139087759 · Cited by 1,795 · see citing works
Cohen, J. (1983) · Applied Psychological Measurement · doi:10.1177/014662168300700301 · Cited by 1,564 · cited 1× · see citing works
“Note that dichotomizing continuous measures inevitably entails some information loss ( Cohen 1983), a critique that has been raised over the median-split technique in priming literature ( Zerweck et al. 2021, Meyen et al. 2022, Stein et al. 2024, Hernández-Gutiérrez et al. 2025).”
Erroneous analyses of interactions in neuroscience: A problem of significance
Nieuwenhuis, S., Forstmann, B. U., & Wagenmakers, E.-J. (2011) · Nature Neuroscience · doi:10.1038/nn.2886 · Cited by 864 · see citing works
Discrimination and learning without awareness: A methodological survey and evaluation.
Eriksen, C. W. (1960) · Psychological Review · doi:10.1037/h0041622 · Cited by 660 · see citing works
Using Bayes factor hypothesis testing in neuroscience to establish evidence of absence
Keysers, C., Gazzola, V., & Wagenmakers, E.-J. (2020) · Nature Neuroscience · doi:10.1038/s41593-020-0660-4 · Cited by 654 · see citing works
Using direct and indirect measures to study perception without awareness
Reingold, E. M., & Merikle, P. M. (1988) · Perception & Psychophysics · doi:10.3758/bf03207490 · Cited by 596 · see citing works
Optional stopping: No problem for Bayesians
Rouder, J. N. (2014) · Psychonomic Bulletin & Review · doi:10.3758/s13423-014-0595-4 · Cited by 492 · see citing works
Different time courses for visual perception and action priming
Vorberg, D., Mattler, U., Heinecke, A., Schmidt, T., & Schwarzbach, J. (2003) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0931489100 · Cited by 450 · see citing works
Convergence Diagnostics for Markov Chain Monte Carlo
Roy, V. (2019) · Annual Review of Statistics and Its Application · doi:10.1146/annurev-statistics-031219-041300 · Cited by 301 · see citing works
A tutorial on Bayes Factor Design Analysis using an informed prior
Stefan, A. M., Gronau, Q. F., Schönbrodt, F. D., & Wagenmakers, E.-J. (2019) · Behavior Research Methods · doi:10.3758/s13428-018-01189-8 · Cited by 284 · see citing works
Signal detection theory and generalized linear models.
DeCarlo, L. T. (1998) · Psychological Methods · doi:10.1037/1082-989x.3.2.186 · Cited by 279 · see citing works
Shanks, D. R. (2017) · Psychonomic Bulletin & Review · doi:10.3758/s13423-016-1170-y · Cited by 201 · see citing works
The finger in flight: real-time motor control by visually masked color stimuli
Schmidt, T. (2002) · Psychological Science · doi:10.1111/1467-9280.00421 · Cited by 170 · see citing works
Imaging implicit perception: promise and pitfalls
Hannula, D. E., Simons, D. J., & Cohen, N. J. (2005) · Nature Reviews Neuroscience · doi:10.1038/nrn1630 · Cited by 155 · see citing works
Criteria for unconscious cognition: three types of dissociation
Schmidt, T., & Vorberg, D. (2006) · Perception & Psychophysics · doi:10.3758/bf03193692 · Cited by 151 · see citing works
King, J.-R., & Dehaene, S. (2014) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2013.0204 · Cited by 82 · see citing works
Subjective and objective learning effects dissociate in space and in time
Schwiedrzik, C. M., Singer, W., & Melloni, L. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1009147108 · Cited by 72 · see citing works
Individual differences in metacontrast masking are enhanced by perceptual learning
Albrecht, T., Klapötke, S., & Mattler, U. (2009) · Consciousness and Cognition · doi:10.1016/j.concog.2009.12.002 · Cited by 69 · see citing works
Absolute Judgments Are Relative: A Reinterpretation of Some Psychophysical Ideas
Lockhead, G. R. (2004) · Review of General Psychology · doi:10.1037/1089-2680.8.4.265 · Cited by 61 · see citing works
Advancing research on unconscious priming: when can scientists claim an indirect task advantage?
Meyen, S., Zerweck, I. A., Amado, C., von Luxburg, U., & Franz, V. H. (2022) · Journal of Experimental Psychology: General · doi:10.1037/xge0001065 · Cited by 57 · see citing works
Raising awareness about measurement error in research on unconscious mental processes
Vadillo, M. A., Malejka, S., Lee, D. Y. H., Dienes, Z. P., & Shanks, D. R. (2021) · Psychonomic Bulletin & Review · doi:10.3758/s13423-021-01923-y · Cited by 52 · see citing works
Sensitivity and perceptual awareness increase with practice in metacontrast masking
Schwiedrzik, C. M., Singer, W., & Melloni, L. (2009) · Journal of Vision · doi:10.1167/9.10.18 · Cited by 49 · see citing works
Lagroix, H. E. P., Yanko, M. R., & Spalek, T. M. (2012) · Attention Perception & Psychophysics · doi:10.3758/s13414-012-0281-4 · Cited by 45 · see citing works
Zerweck, I. A., Kao, C.-S., Meyen, S., Amado, C., von Eltz, M., Klimm, M., & Franz, V. H. (2021) · Attention Perception & Psychophysics · doi:10.3758/s13414-021-02312-2 · Cited by 29 · see citing works
Practice reduces suppression in metacontrast and in apparent motion
Hogben, J. H., & Lollo, V. D. (1984) · Perception & Psychophysics · doi:10.3758/bf03203920 · Cited by 26 · see citing works
Studying unconscious processing: Contention and consensus
Stockart, F., Schreiber, M., Amerio, P., Carmel, D. P., Cleeremans, A., Deouell, L. Y., Dienes, Z. P., Elosegi, P., Gayet, S., Goldstein, A., et al. (2025) · Behavioral and Brain Sciences · doi:10.1017/s0140525x25101489 · Cited by 25 · see citing works
Measuring unconscious cognition: Beyond the zero-awareness criterion
Schmidt, T. (2007) · Advances in Cognitive Psychology · doi:10.2478/v10053-008-0030-3 · Cited by 25 · see citing works
Individual differences in subjective experience and objective performance in metacontrast masking
Albrecht, T., & Mattler, U. (2012) · Journal of Vision · doi:10.1167/12.5.5 · Cited by 19 · see citing works
Kihara, K., Kawahara, J., & Takeda, Y. (2010) · Behavior Research Methods · doi:10.3758/brm.42.4.1105 · Cited by 18 · see citing works
Rohr, M., & Wagner, A. (2020) · Scientific Reports · doi:10.1038/s41598-020-63853-4 · Cited by 17 · see citing works
Stein, T., van Gaal, S., & Fahrenfort, J. J. (2024) · Consciousness and Cognition · doi:10.1016/j.concog.2024.103669 · Cited by 13 · see citing works
Self-citationDecision Criterion Dynamics in Animals Performing an Auditory Detection Task
Mill, R. W., Alves-Pinto, A., & Sumner, C. J. (2014) · PLoS ONE · doi:10.1371/journal.pone.0114076 · Cited by 9 · see citing works
Metacontrast as Measured under a Signal Detection Model
Hernández, L. L., & Lefton, L. A. (1977) · Perception · doi:10.1068/p060695 · Cited by 7 · see citing works
LCD Monitors as an Alternative for Precision Demanding Visual Psychophysical Experiments
Bognár, A., Csibri, P., András, C. M., & Sáry, G. (2016) · Perception · doi:10.1177/0301006616651954 · Cited by 6 · see citing works
Hernández‐Gutiérrez, D., Sorrel, M. Á., Shanks, D. R., & Vadillo, M. A. (2025) · Journal of Cognition · doi:10.5334/joc.419 · Cited by 4 · see citing works
Flagged first, then by citations
Cited by
Still being checked.
- Authors
- Sánchez-Fuenzalida, N., van Gaal, S., van den Hurk, Z., Stein, T., & Fahrenfort, J. J.
- Affiliations
- Vrije Universiteit Amsterdam (NL)
- Department of Applied and Experimental Psychology, Free University Amsterdam , Van der Boechorststraat 7, 1081 BT Amsterdam ,
- University of Amsterdam (NL)
- Corresponding author
- Sánchez-Fuenzalida, Nicolás
- Venue
- Neuroscience of Consciousness
- Publisher
- Oxford University Press (OUP)
- Published
- 2026
- Volume
- 2026
- Issue
- 1
- Pages
- niag052-niag052
- ISSN
- 2057-2107 (ISSN-L)
- PMC
- PMC13492662
- OpenAlex
- W4415928735
- Semantic Scholar
- 45d979f09b290c46de89d7fb263bcdaa60b2d6e5
- Cited by
- 0
- References
- 40
- FWCI
- 0.00
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- Neuroscience of Consciousness (publishedVersion, cc-by)
- PubMed (publishedVersion)
- PubMed Central (publishedVersion, cc-by)
- UvA-DARE (University of Amsterdam) (submittedVersion, cc-by)
- Funders
- Templeton World Charity Foundation (30260)
- European Research Council
- European Union’s Horizon Europe research and innovation programme (101044686)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Life Sciences › Neuroscience › Cognitive Neuroscience › Visual perception and processing mechanisms
- Life Sciences › Neuroscience › Cognitive Neuroscience › Free Will and Agency
- Keywords
- unconscious priming, stimulus onset asynchrony, interindividual variability, awareness training
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-11-03.
Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-11-03.
Cited sources are checked by gpt-6-sol.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review