Transfer of Predictive Signals Across Saccades

“In line with predictive coding frameworks (Mumford, 1992; Rao and Ballard, 1999; Friston, 2005, 2009, 2010), the decreased BOLD signal in response to predictable targets was interpreted as consistent with the notion that predicted information is processed more efficiently and thus causes less…”

“Rao and Ballard (1999) modeled a hierarchical predictive coding architecture in which higher levels of the model predict responses of the next lower level using feedback.”

“In line with predictive coding frameworks (Mumford, 1992; Rao and Ballard, 1999; Friston, 2005, 2009, 2010), the decreased BOLD signal in response to predictable targets was interpreted as consistent with the notion that predicted information is processed more efficiently and thus causes less…”

“Keywords: inter-hemifield saccades, visual predictions, saccadic transfer, eye-movements”

“In line with predictive coding frameworks (Mumford, 1992; Rao and Ballard, 1999; Friston, 2005, 2009, 2010), the decreased BOLD signal in response to predictable targets was interpreted as consistent with the notion that predicted information is processed more efficiently and thus causes less…”

“An internal copy of the motor command, called efference copy, is used to update these internal predictions (Sperry, 1950).”

“Several models have been proposed demonstrating the importance of the bidirectional influence between higher and lower cortical areas for perception and recognition (Bar et al., 2006; Lamme, 2006; Meyer, 2012).”

“Lower visual areas can use these top-down predictive signals to anticipate expected change and process visual information more rapidly and efficiently (Merriam and Colby, 2005; Bar, 2007; Gilbert and Sigman, 2007; Harrison et al., 2007; Kveraga et al., 2007; Friston, 2009; Alink et al., 2010).”

“Gilbert and Sigman (2007) highlight the wealth of top-down influences and note that “the notion of attention itself may be inadequate as a descriptor of the full range of top-down influences that are exerted.””

“In line with predictive coding frameworks (Mumford, 1992; Rao and Ballard, 1999; Friston, 2005, 2009, 2010), the decreased BOLD signal in response to predictable targets was interpreted as consistent with the notion that predicted information is processed more efficiently and thus causes less…”

“This mislocalization may occur due to spatio-temporal mismatch between the saccade and extraretinal eye position information (Ross et al., 2001).”

“It gives rise to an illusory object moving between the inducing stimuli along the shortest path, but avoiding obstacles (Kolers, 1963; Attneave and Block, 1974; Shepard and Zare, 1983; Goebel et al., 1998; Muckli et al., 2002, 2005; Liu et al., 2004; Larsen et al., 2006).”

“Keywords: inter-hemifield saccades, visual predictions, saccadic transfer, eye-movements”

“This study aims to demonstrate whether a predictive signal is transferred across hemifields and, more precisely, how quickly after www.frontiersin.org June 2012 | Volume 3 | Article 176 | 1 saccade completion we can detect prediction effects previously related to V1 processing (Alink et al., 2010).”

“Lower visual areas can use these top-down predictive signals to anticipate expected change and process visual information more rapidly and efficiently (Merriam and Colby, 2005; Bar, 2007; Gilbert and Sigman, 2007; Harrison et al., 2007; Kveraga et al., 2007; Friston, 2009; Alink et al., 2010).”

“As attention is transferred across saccades as much as visual information (Rolfs et al., 2011), this may lead to a better detection rate of in-time targets as they appear in the focus of attention.”

“Interestingly, the same time window of 50 ms and above was found to be critical for the release of saccadic suppression (Deubel et al., 1996).”

“A common demonstration of forward adjustment of predictions is the flash lag illusion (Nijhawan, 2008).”

“Here, we tested whether spatio-temporal predictions are updated before, during, or shortly after an inter-hemifield saccade is executed, and thus, whether the predictive signal is transferred swiftly across hemifields.”

“Using an apparent motion illusion, we induced an internal motion model that is known to produce a spatio-temporal prediction signal along the apparent motion trace in V1 (Muckli et al., 2005; Alink et al., 2010).”

“Previous results indicate that predictions of moving tokens are generated with the contribution of hMT/V5+ and are fed back to retinotopic visual areas (Sterzer et al., 2006; Wibral et al., 2009).”

“Keywords: inter-hemifield saccades, visual predictions, saccadic transfer, eye-movements”

“For example, predictions developed from previous experience can allow an individual to correctly represent the entire shape of an object when it is partially occluded (van Lier et al., 1994; Sugita, 1999; Erlhagen, 2003; Johnson and Olshausen, 2005).”

“It gives rise to an illusory object moving between the inducing stimuli along the shortest path, but avoiding obstacles (Kolers, 1963; Attneave and Block, 1974; Shepard and Zare, 1983; Goebel et al., 1998; Muckli et al., 2002, 2005; Liu et al., 2004; Larsen et al., 2006).”

“It is worth mentioning that our results are not in contrast to Yantis and Nakama (1998).”

“It gives rise to an illusory object moving between the inducing stimuli along the shortest path, but avoiding obstacles (Kolers, 1963; Attneave and Block, 1974; Shepard and Zare, 1983; Goebel et al., 1998; Muckli et al., 2002, 2005; Liu et al., 2004; Larsen et al., 2006).”

“Functional brain imaging has previously shown that predictions interact with visual input already at the level of the primary visual cortex (V1; Harrison et al., 2007; Alink et al., 2010).”

“It gives rise to an illusory object moving between the inducing stimuli along the shortest path, but avoiding obstacles (Kolers, 1963; Attneave and Block, 1974; Shepard and Zare, 1983; Goebel et al., 1998; Muckli et al., 2002, 2005; Liu et al., 2004; Larsen et al., 2006).”

“Hunt and Cavanagh (2009) showed that subjects who follow the arms of a fast moving clock with peripheral vision will predate the fixation of the clock by 40–60 ms – a process that might be thought of as a temporal filling-in process to avoid discontinuities introduced by each saccadic eye-movement…”

“For example, predictions developed from previous experience can allow an individual to correctly represent the entire shape of an object when it is partially occluded (van Lier et al., 1994; Sugita, 1999; Erlhagen, 2003; Johnson and Olshausen, 2005).”

“It gives rise to an illusory object moving between the inducing stimuli along the shortest path, but avoiding obstacles (Kolers, 1963; Attneave and Block, 1974; Shepard and Zare, 1983; Goebel et al., 1998; Muckli et al., 2002, 2005; Liu et al., 2004; Larsen et al., 2006).”

“Interestingly, the same time window of 50 ms and above was found to be critical for the release of saccadic suppression (Deubel et al., 1996).”

“Previous results indicate that predictions of moving tokens are generated with the contribution of hMT/V5+ and are fed back to retinotopic visual areas (Sterzer et al., 2006; Wibral et al., 2009).”

“Lower visual areas can use these top-down predictive signals to anticipate expected change and process visual information more rapidly and efficiently (Merriam and Colby, 2005; Bar, 2007; Gilbert and Sigman, 2007; Harrison et al., 2007; Kveraga et al., 2007; Friston, 2009; Alink et al., 2010).”

“Here, we tested whether spatio-temporal predictions are updated before, during, or shortly after an inter-hemifield saccade is executed, and thus, whether the predictive signal is transferred swiftly across hemifields.”

“High precision object discrimination may be incompatible with the apparent motion illusion as is exemplified by interference of inconsistent stimulus features on the apparent motion path with motion masking: for example, orthogonally oriented Gabor patches along the apparent motion trace slow down the perceived speed…”

“During trans-saccadic suppression there is a general reduction in visual sensitivity which can occur even prior to saccade onset (Vallines and Greenlee, 2006).”

“Apparent motion stimulation was interrupted with a natural scene display once a minute, enabling subjects to rest their eyes for 20 s and preventing apparent motion breakdown due to adaptation (Anstis and Giaschi, 1985).”

“Even when visuospatial attention is focused on a center task, the apparent motion illusion in the periphery remains strong (Kohler et al., 2008) and brain activity along the apparent motion trace is increased (Muckli et al.”

“Other motion illusions are related to this temporal filling-in: movement into the blind spot is extrapolated in its expected coordinates even when no retinal signal is received (Maus and Nijhawan, 2008).”

“It gives rise to an illusory object moving between the inducing stimuli along the shortest path, but avoiding obstacles (Kolers, 1963; Attneave and Block, 1974; Shepard and Zare, 1983; Goebel et al., 1998; Muckli et al., 2002, 2005; Liu et al., 2004; Larsen et al., 2006).”

“Also, it should be noted that the horizontal saccadic rhythm was much slower in our paradigm compared to Szinte and Cavanagh (2011) and that the illusion did not appear tilted, suggesting that no overcompensation occurred.”

“…could also account for a decrease in target detection as objects which are flashed close to saccade onset are Frontiers in Psychology | Perception Science June 2012 | Volume 3 | Article 176 | 8 largely mislocalized on the retina from their actual physical position (Ostendorf et al., 2007).”

“Our observed prediction effect could be explained by smoothly moving visuo-spatial attention, similar to what Shioiri et al. (2002) demonstrated behaviorally.”

“Replicating previous findings (Schwiedrzik et al., 2007), in-time targets were detected better than out-of time targets [repeated-measures ANOVA: F(1, 23) = 42.09, p 0.001].”

“Bellebaum and Daum (2006) also found an early post-saccadic component at 50 ms after offset which was thought to be imperative for saccadic updating.”

“Motion induced blindness provides another example in which static stimuli not fitting to the motion percept are overwritten by a top-down motion prediction even though the non-perceived stimulus induced a stronger V1 signal (Schölvinck and Rees, 2010).”

“Strong unexpected transients, however, allow for an immediate update (Maus et al., 2010).”

“As a main effect, targets that appeared in-time with the motion illusion were detected more frequently than those appearing out-of-time, replicating previous results (Schwiedrzik et al., 2007; Hidaka et al., 2011).”

“Keywords: inter-hemifield saccades, visual predictions, saccadic transfer, eye-movements”

“Note that as we were interested in the re-occurrence of a predictive effect after saccade, saccade offset was our critical point of reference rather than saccade onset as used in several other studies (e.g., Peterburs et al., 2011).”

“It gives rise to an illusory object moving between the inducing stimuli along the shortest path, but avoiding obstacles (Kolers, 1963; Attneave and Block, 1974; Shepard and Zare, 1983; Goebel et al., 1998; Muckli et al., 2002, 2005; Liu et al., 2004; Larsen et al., 2006).”

“One of the most convincing demonstrations of predictive coding overwriting the physical stimulus is given by Hidaka et al. (2009).”

“Replicating the results of the TMS experiment and previous studies (Schwiedrzik et al. 2007; Vetter et al. 2012), predictable in-time targets were better detected than unpredictable out-of-time targets (repeated-measures ANOVA, F1,14 = 12.”

“Our previous data revealed that subjects take approximately 300ms between saccade cue and saccade completion(Vetter et al., 2012), hence we presented the target approximately 450ms after the red fixation cross shifted location, in the 8 cycle of apparent motion.”

“…et al., 2016; Niefind and Dimigen, 2016; Kornrumpf et al., 2017); however, this is the first neuroimaging study to find evidence for early information transfer that correlates with findings in psychophysical experiments (Wittenberg et al., 2008; Fracasso et al., 2010; Vetter et al., 2012).”

“Accordingly, 50 ms after saccade offset, the detection advantage of target predictability (Vetter et al., 2012) and the blanking effect for target displacements (Deubel & Schneider, 1996) begin to be effective, and event-related potentials in the parietal posterior cortex reflecting the…”

“…were displayed spatiotemporally congruent with a linearly moving token, and out-of-time targets were incongruent—that is, at the same time but at the wrong position (see also Schwiedrzik et al., 2007; Vetter et al., 2012; Vetter et al., in press, for an illustration of target timing across space).”

“This inclusion of parametric prediction errors would allow novel probes of the predictive coding principles of visual function (Edwards et al., 2017; Friston, 2005; Vetter et al., 2012).”

“…targets were detected more often than temporally unexpected targets in the spatiotemporal dynamic context provided by AM (Schwiedrzik et al., 2007; Vetter et al., 2012; Edwards et al., 2017), the target detection task may focus participants’ temporal attention on the AM-provided spatiotemporal…”

“…of presaccadic stimuli features (e.g., orientation) in predictive coding models is explained by a feed-forward process of the presaccadic signal to higher - visual areas, which is then fed back as a predictive signal to the lower - visual areas at the predicted spatiotopic locations (29, 30).”

“…findings highlight the role of prediction in maintaining perceptual stability across saccades (see also Edwards, Vetter, McGruer, Petro, & Muckli, 2017; Melcher & Colby, 2008; Vetter, Edwards, & Muckli, 2012), in turn carrying important implications for future research on transsaccadic perception.”

“…are retained across a saccade through a predictive mechanism, in which the presaccadic signal reaches higher visual areas feedforward before it is fed back to lower-visual areas at the predicted spatiotopic location (33, 64, 65), or for the saccade target (as in our case), simply the fovea (67).”

“…as is observed when a retinal receptive field is modulated by eye position (De Meyer and Spratling, 2011, 2013), enhance the perceived contrast (Han and VanRullen, 2016), modulate contour integration (Spratling, 2013, 2014), or improve the detection of apparent motion (Vetter et al., 2012).”

“232 It was recently shown that predictive coding can account for feature transfer across saccades (34, 35).”