Early recurrent feedback facilitates visual object recognition under challenging conditions
Open accessThe DOI matches its Crossref record; 26 of the 26 references it cites were found in a registry or an index.
Abstract
Standard models of the visual object recognition pathway hold that a largely feedforward process from the retina through inferotemporal cortex leads to object identification. A subsequent feedback process originating in frontoparietal areas through reciprocal connections to striate cortex provides attentional support to salient or behaviorally-relevant features. Here, we review mounting evidence that feedback signals also originate within extrastriate regions and begin during the initial feedforward process. This feedback process is temporally dissociable from attention and provides important functions such as grouping, associational reinforcement, and filling-in of features. Local feedback signals operating concurrently with feedforward processing are important for object identification in noisy real-world situations, particularly when objects are partially occluded, unclear, or otherwise ambiguous. Altogether, the dissociation of early and late feedback processes presented here expands on current models of object identification, and suggests a dual role for descending feedback projections.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Representational similarity analysis-connecting the branches of systems neuroscience
Kriegeskorte, N. (2008) · Frontiers in Systems Neuroscience · doi:10.3389/neuro.06.004.2008 · Cited by 3,355
Hierarchical models of object recognition in cortex
Riesenhuber, M., & Poggio, T. (1999) · Nature Neuroscience · doi:10.1038/14819 · Cited by 3,309 · cited 1×
“…latencies as short as 10 ms (Hupé et al., 2001; Pascual-Leone and Walsh, 2001) and might be important for the Winner-Take-All (WTA) or “max” computations (Riesenhuber and Poggio, 1999; Wyatte et al., 2012b; O’Reilly et al., 2013) that have been suggested to contribute to core object recognition.”
BackgroundThe distinct modes of vision offered by feedforward and recurrent processing
Lamme, V. A. F., & Roelfsema, P. R. (2000) · Trends in Neurosciences · doi:10.1016/s0166-2236(00)01657-x · Cited by 2,338 · cited 4×
“…of backward masking was initially accounted for with a feedforward explanation (Breitmeyer and Ganz, 1976), modern theories of backward masking emphasize recurrent processing between higher-level and lower-level areas (Enns and Di Lollo, 2000; Lamme and Roelfsema, 2000; Wyatte et al., 2012a).”
BackgroundMethodInfluentialConscious, preconscious, and subliminal processing: a testable taxonomy
Dehaene, S., Changeux, J.-P., Naccache, L., Sackur, J., & Sergent, C. (2006) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2006.03.007 · Cited by 2,067
How does the brain solve visual object recognition?
DiCarlo, J. J., Zoccolan, D., & Rust, N. C. (2012) · Neuron · doi:10.1016/j.neuron.2012.01.010 · Cited by 1,790 · cited 5×
““Core object recognition” (DiCarlo et al., 2012) of stimuli that vary in terms of their spatial position, scale, pose, and illumination can be rapidly decoded from the first IT responses (Hung et al., 2005).”
BackgroundMethodInfluentialEvent-related brain potentials in the study of visual selective attention
Hillyard, S. A., & Anllo-Vento, L. (1998) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.95.3.781 · Cited by 1,525 · cited 1×
“Attention has long been known to modulate early EEG responses such as the P1 (first positive deflection, ca. 100 ms) and N1 (first negative deflection, ca. 150–200 ms) (Luck et al., 1990a; Hillyard and Anllo-Vento, 1998).”
BackgroundTop-down facilitation of visual recognition
Bar, M., Kassam, K. S., Ghuman, A. S., Boshyan, J., Schmid, A. M., Dale, A. M., Hämäläinen, M. S., Marinkovic, K., Schacter, D. L., Rosen, B. R., et al. (2006) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0507062103 · Cited by 1,489 · cited 1×
“This feedback from prefrontal areas could reflect top–down predictions that constrain the space of potential object representations in IT cortex (Bar et al., 2006; Kveraga et al., 2007), which might also have the effect of filling in visual information when it is missing from the physical stimulus.”
BackgroundThe Normalization Model of Attention
Reynolds, J. H., & Heeger, D. J. (2009) · Neuron · doi:10.1016/j.neuron.2009.01.002 · Cited by 1,457 · cited 2×
“Top–down amplification promotes visual awareness (Lamme, 2003, 2006; Dehaene et al., 2006), and some data indicate that amplification is a simple contrast gain operation, as some have suggested is implemented by attention (e.g., Reynolds et al., 2000; Reynolds and Heeger, 2009).”
MethodHochstein (2002) · doi:10.1016/s0896-6273(02)01091-7 · Cited by 1,397
Cerebral mechanisms of word masking and unconscious repetition priming
Dehaene, S., Naccache, L., Cohen, L., Bihan, D. L., Mangin, J.-F., Poline, J.-B., & Rivière, D. (2001) · Nature Neuroscience · doi:10.1038/89551 · Cited by 1,305 · cited 2×
“This mismatch causes a decoupling in the functional connectivity (i.e., co-activation) between the visual areas involved in processing the stimulus, which has the psychological effect of greatly reduced perceptual visibility (Dehaene et al., 2001; Haynes et al., 2005).”
BackgroundWhy visual attention and awareness are different
Lamme, V. A. F. (2003) · Trends in Cognitive Sciences · doi:10.1016/s1364-6613(02)00013-x · Cited by 1,172 · cited 3×
“Top–down amplification promotes visual awareness (Lamme, 2003, 2006; Dehaene et al., 2006), and some data indicate that amplification is a simple contrast gain operation, as some have suggested is implemented by attention (e.g., Reynolds et al., 2000; Reynolds and Heeger, 2009).”
BackgroundMethodTowards a true neural stance on consciousness
Lamme, V. A. F. (2006) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2006.09.001 · Cited by 1,149
Contextual modulation in primary visual cortex
Zipser, K., Lamme, V. A. F., & Schiller, P. H. (1996) · The Journal of Neuroscience · doi:10.1523/jneurosci.16-22-07376.1996 · Cited by 873
Cortical feedback improves discrimination between figure and background by V1, V2 and V3 neurons
Hupé, J. M., James, A. C., Payne, B. R., Lomber, S. G., Girard, P., & Bullier, J. (1998) · Nature · doi:10.1038/29537 · Cited by 864 · cited 2×
“In some cases, these grouping computations can cause the perception of illusory contours and surfaces (Lee and Nguyen, 2001; Seghier and Vuilleumier, 2006), but they also seem to be important when objects are degraded in order to rectify signals (Hupé et al., 1998).”
BackgroundFast Readout of Object Identity from Macaque Inferior Temporal Cortex
Hung, C. P., Kreiman, G., Poggio, T., & DiCarlo, J. J. (2005) · Science · doi:10.1126/science.1117593 · Cited by 854
Fast Backprojections from the Motion to the Primary Visual Area Necessary for Visual Awareness
Pascual-Leone, A., & Walsh, V. (2001) · Science · doi:10.1126/science.1057099 · Cited by 761 · cited 3×
“Altogether, the dissociation of early and late feedback processes presented here expands on current models of object identification, and suggests a dual role for descending feedback projections.”
BackgroundEnns, J. T., & Di Lollo, V. (2000) · Trends in Cognitive Sciences · doi:10.1016/s1364-6613(00)01520-5 · Cited by 684 · cited 1×
“Keywords: object recognition, feedback, top–down attention, illusory contours, amodal completion”
BackgroundComparative mapping of higher visual areas in monkeys and humans
Orban, G. A., Van Essen, D., & Vanduffel, W. (2004) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2004.05.009 · Cited by 639
The timing of information transfer in the visual system
Nowak, L. G., & Bullier, J. (1997) · Cerebral cortex · doi:10.1007/978-1-4757-9625-4_5 · Cited by 444 · cited 1×
“Top row: Feedforward-dominant latencies, which are well-documented in the literature (e.g., Nowak and Bullier, 1997).”
BackgroundDynamics of subjective contour formation in the early visual cortex
Lee, T. S., & Nguyen, M. (2001) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.98.4.1907 · Cited by 428
Top-down predictions in the cognitive brain
Kveraga, K., Ghuman, A. S., & Bar, M. (2007) · Brain and Cognition · doi:10.1016/j.bandc.2007.06.007 · Cited by 423
Effects of Spatial Attention on Contrast Response Functions in Macaque Area V4
Williford, T., & Maunsell, J. H. R. (2006) · Journal of Neurophysiology · doi:10.1152/jn.01207.2005 · Cited by 353
Masking Disrupts Reentrant Processing in Human Visual Cortex
Fahrenfort, J. J., Scholte, H. S., & Lamme, V. A. F. (2007) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2007.19.9.1488 · Cited by 344 · cited 9×
“Visual backward masking experiments have also identified a similar time window for recurrent processing around 100 ms after stimulus onset (Fahrenfort et al., 2007, 2008; Boehler et al., 2008).”
BackgroundInfluentialFeedback connections and conscious vision
Bullier, J. (2001) · Trends in Cognitive Sciences · doi:10.1016/s1364-6613(00)01730-7 · Cited by 207 · cited 1×
“Modal completion has been shown to elicit illusory responses in V1 (Lee and Nguyen, 2001), supporting the idea that whatever representation is present in V1 is what we “perceive” (Bullier, 2001).”
BackgroundPaths of information flow through visual cortex
Mignard, M., & Malpeli, J. G. (1991) · Science · doi:10.1126/science.1848727 · Cited by 164
Sehatpour, P., Molholm, S., Javitt, D. C., & Foxe, J. J. (2006) · NeuroImage · doi:10.1016/j.neuroimage.2005.07.049 · Cited by 146 · cited 1×
“However, other studies have suggested a much later time course for object completion effects, beginning around 200 ms and completing around 400 ms (Doniger et al., 2000; Sehatpour et al., 2006, 2008).”
Background
Cited by
Convolutional Neural Networks as a Model of the Visual System: Past, Present, and Future
Lindsay, G. W. (2021) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_01544 · Cited by 557
Recurrence is required to capture the representational dynamics of the human visual system
Kietzmann, T. C., Spoerer, C. J., Sörensen, L. K. A., Cichy, R. M., Hauk, O., & Kriegeskorte, N. (2019) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1905544116 · Cited by 406
Attention in Psychology, Neuroscience, and Machine Learning
Lindsay, G. W. (2020) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2020.00029 · Cited by 309
Deep neural networks in computational neuroscience
Kietzmann, T. C., McClure, P., & Kriegeskorte, N. (2019) · Oxford Research Encyclopedia of Neuroscience · doi:10.1093/acrefore/9780190264086.013.46 · Cited by 186
Perceiving the World Through Group-Colored Glasses: A Perceptual Model of Intergroup Relations
Xiao, Y. J., Coppin, G., & Van Bavel, J. J. (2016) · Psychological Inquiry · doi:10.1080/1047840x.2016.1199221 · Cited by 121
Metadata
- Authors
- Wyatte, D., Jilk, D. J., & O'Reilly, R. C.
- Venue
- Frontiers in Psychology
- Publisher
- Frontiers Media SA
- Published
- 2014-07-01
- Volume
- 5
- Pages
- 674-674
- ISSN
- 1664-1078 (ISSN-L)
- OpenAlex
- W2138971257
- Cited by
- 126
- References
- 26
- FWCI
- 3.58
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.