A Feedback Model of Visual Attention
Open accessThe DOI matches its Crossref record; 31 of the 31 references it cites were found in a registry or an index.
Abstract
Feedback connections are a prominent feature of cortical anatomy and are likely to have a significant functional role in neural information processing. We present a neural network model of cortical feedback that successfully simulates neurophysiological data associated with attention. In this domain, our model can be considered a more detailed, and biologically plausible, implementation of the biased competition model of attention. However, our model is more general as it can also explain a variety of other top-down processes in vision, such as figure/ground segmentation and contextual cueing. This model thus suggests that a common mechanism, involving cortical feedback pathways, is responsible for a range of phenomena and provides a unified account of currently disparate areas of research.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Neural Mechanisms of Selective Visual Attention
Desimone, R., & Duncan, J. (1995) · Annual Review of Neuroscience · doi:10.1146/annurev.ne.18.030195.001205 · Cited by 8,388 · cited 4×
“Attention is one top-down process that operates via the cortical feedback projections (Treue, 2001; Schroeder et al., 2001; Mehta et al., 2000; Desimone and Duncan, 1995; Pollen, 1999) targeting the apical dendrites in layer I ( Cauller, 1995; Olson et al., 2001).”
BackgroundInfluentialControlled and automatic human information processing: I. Detection, search, and attention.
Schneider, W., & Shiffrin, R. M. (1977) · Psychological Review · doi:10.1037/0033-295x.84.1.1 · Cited by 5,902
Computational modelling of visual attention
Itti, L., & Koch, C. (2001) · Nature Reviews Neuroscience · doi:10.1038/35058500 · Cited by 4,733 · cited 5×
“Such top-down modulation also affects the on-going competition between cells (Luck et al., 1997; Itti and Koch, 2001; Reynolds et al., 1999).”
BackgroundInfluentialSelective Attention Gates Visual Processing in the Extrastriate Cortex
Moran, J., & Desimone, R. (1985) · Science · doi:10.1126/science.4023713 · Cited by 2,433 · cited 1×
“If attention is directed toward one stimulus then the response becomes more similar to the response that would be generated by that stimulus in isolation (Moran and Desimone, 1985; Luck et al., 1997; Reynolds et al., 1999).”
BackgroundThe distinct modes of vision offered by feedforward and recurrent processing
Lamme, V. A. F., & Roelfsema, P. R. (2000) · Trends in Neurosciences · doi:10.1016/s0166-2236(00)01657-x · Cited by 2,338 · cited 2×
“Similar effects of feedback, or recurrent, activity on neural responses can also be observed in non-attentional tasks (Lamme et al., 1998; Zipser et al., 1996; Lamme and Roelfsema, 2000; Lee et al., 1998).”
BackgroundMechanisms of visual attention in the human cortex
Ungerleider, S. K. A. L. G. (2000) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.23.1.315 · Cited by 2,159 · cited 10×
“Such top-down modulation also affects the on-going competition between cells (Luck et al., 1997; Itti and Koch, 2001; Reynolds et al., 1999).”
BackgroundInfluentialKastner, S., Pinsk, M. A., De Weerd, P., Desimone, R., & Ungerleider, L. G. (1999) · Neuron · doi:10.1016/s0896-6273(00)80734-5 · Cited by 1,622 · cited 2×
“Attention modulates the sensory-driven activation of cells (Kanwisher and Wojciulik, 2000; Luck et al., 1997; Kastner et al., 1999; McAdams and Maunsell, 2000), such that activity in response to an attended stimulus is increased in amplitude and duration (Schroeder et al., 2001; Kastner and…”
BackgroundNeural mechanisms of spatial selective attention in areas V1, V2, and V4 of macaque visual cortex
Luck, S. J., Chelazzi, L., Hillyard, S. A., & Desimone, R. (1997) · Journal of Neurophysiology · doi:10.1152/jn.1997.77.1.24 · Cited by 1,615
Competitive Mechanisms Subserve Attention in Macaque Areas V2 and V4
Reynolds, J. H., Chelazzi, L., & Desimone, R. (1999) · The Journal of Neuroscience · doi:10.1523/jneurosci.19-05-01736.1999 · Cited by 1,236 · cited 14×
“Such top-down modulation also affects the on-going competition between cells (Luck et al., 1997; Itti and Koch, 2001; Reynolds et al., 1999).”
BackgroundMethodResultInfluentialA new cellular mechanism for coupling inputs arriving at different cortical layers
Larkum, M. E., Zhu, J. J., & Sakmann, B. (1999) · Nature · doi:10.1038/18686 · Cited by 1,180 · cited 1×
“The apical dendrite appears to act as a functionally distinct dendritic compartment since activation applied to the apical dendrites is integrated prior to transmission to the soma (Larkum et al., 1999; K¨ording and K¨onig, 2000, 2001).”
BackgroundOn the computational architecture of the neocortex: II The role of cortico-cortical loops
Mumford, D. (1992) · Biological Cybernetics · doi:10.1007/bf00198477 · Cited by 1,074 · cited 1×
“…by the cortical layers from which they originate and in which they terminate, as illustrated in figure1 (Felleman and Van Essen, 1991; Crick and Koch, 1998; Mountcastle, 1998; Budd, 1998; Ebdon, 1996; Mumford, 1992; Lamme et al., 1998; Johnson and Burkhalter, 1997; Barbas and Rempel-Clower, 1997).”
BackgroundNeural mechanisms for visual memory and their role in attention
Desimone, R. (1996) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.93.24.13494 · Cited by 1,028 · cited 2×
“…visual processing hierarchy, can be modified by past experience (Kobatake et al., 1998; Karni, 1996; Logothetis, 1998; Sigala and Logothetis, 2001; Desimone, 1996) sensory-driven activity is biased to be interpreted in terms of stored knowledge about previously encountered situations ( Lee et…”
BackgroundThe neurophysiology of figure-ground segregation in primary visual cortex
Lamme, V. (1995) · The Journal of Neuroscience · doi:10.1523/jneurosci.15-02-01605.1995 · Cited by 946 · cited 2×
“Physiological data shows that the response of a node is enhanced when its receptive field is within the figure compared to when it receives identical stimulation from a location on the ground (Lee et al., 1998; Lamme, 1995; Zipser et al., 1996; Lamme et al., 1998, 2000; Lamme and Spekreijse, 2000).”
BackgroundOn the computational architecture of the neocortex: I. The role of the thalamo-cortical loop
Mumford, D. (1991) · Biological Cybernetics · doi:10.1007/bf00202389 · Cited by 929 · cited 1×
“…by the cortical layers from which they originate and in which they terminate, as illustrated in figure1 (Felleman and Van Essen, 1991; Crick and Koch, 1998; Mountcastle, 1998; Budd, 1998; Ebdon, 1996; Mumford, 1992; Lamme et al., 1998; Johnson and Burkhalter, 1997; Barbas and Rempel-Clower, 1997).”
BackgroundThe Role of Working Memory in Visual Selective Attention
de Fockert, J. W., Rees, G., Frith, C. D., & Lavie, N. (2001) · Science · doi:10.1126/science.1056496 · Cited by 924
Olshausen, B., Anderson, C., & Van Essen, D. (1993) · The Journal of Neuroscience · doi:10.1523/jneurosci.13-11-04700.1993 · Cited by 908
Contextual modulation in primary visual cortex
Zipser, K., Lamme, V. A. F., & Schiller, P. H. (1996) · The Journal of Neuroscience · doi:10.1523/jneurosci.16-22-07376.1996 · Cited by 873
Cortical feedback improves discrimination between figure and background by V1, V2 and V3 neurons
Hupé, J. M., James, A. C., Payne, B. R., Lomber, S. G., Girard, P., & Bullier, J. (1998) · Nature · doi:10.1038/29537 · Cited by 864 · cited 5×
“Such findings are consistent with the suggestion that feedback acts to modulate responses that are primarily driven by feedforward inputs (Koch and Segev, 2000; Crick and Koch, 1998; Hup´e et al., 1998; Friston and B¨uchel, 2000).”
BackgroundInfluentialObject-based attention in the primary visual cortex of the macaque monkey
Roelfsema, P. R., Lamme, V. A. F., & Spekreijse, H. (1998) · Nature · doi:10.1038/26475 · Cited by 814
Action potential initiation and backpropagation in neurons of the mammalian CNS
Stuart, G., Spruston, N., Sakmann, B., & Häusser, M. (1997) · Trends in Neurosciences · doi:10.1016/s0166-2236(96)10075-8 · Cited by 768
Feature binding, attention and object perception
Treisman, A. (1998) · Philosophical Transactions of the Royal Society of London. Series B: Biological Sciences · doi:10.1098/rstb.1998.0284 · Cited by 754 · cited 6×
“…with this model feedback may also act to resolve ambiguities in sensory data by providing bias for one possible interpretation over all others and hence serve as a mechanism to solve the ‘binding’ problem (Treisman, 1998; Reynolds and Desimone, 1999; Roelfsema et al., 2000; Luck and Ford, 1998).”
BackgroundInfluentialVisual attention mediated by biased competition in extrastriate visual cortex
Desimone, R. (1998) · Philosophical Transactions of the Royal Society of London. Series B: Biological Sciences · doi:10.1098/rstb.1998.0280 · Cited by 696 · cited 2×
“Hence, top-down signals from working memory are likely to bias processing of subsequently presented stimuli (de Fockert, Rees, Frith, & Lavie, 2001; Reynolds & Desimone, 1999; Desimone, 1998).”
BackgroundThe role of the primary visual cortex in higher level vision
Lee, T. S., Mumford, D., Romero, R., & Lamme, V. A. F. (1998) · Vision Research · doi:10.1016/s0042-6989(97)00464-1 · Cited by 534 · cited 2×
“Similar effects of feedback, or recurrent, activity on neural responses can also be observed in non-attentional tasks (Lamme et al., 1998; Zipser et al., 1996; Lamme and Roelfsema, 2000; Lee et al., 1998).”
BackgroundSalinas, E., & Thier, P. (2000) · Neuron · doi:10.1016/s0896-6273(00)00004-0 · Cited by 400 · cited 3×
“Equivalent results can be achieved by using top-down signals to modulate the activity of neurons rather than weights of synapses ( Salinas and Thier, 2000; Salinas and Abbott, 1997).”
BackgroundMethodConstraints on cortical and thalamic projections: the no-strong-loops hypothesis
Crick, F., & Koch, C. (1998) · Nature · doi:10.1038/34584 · Cited by 353 · cited 3×
“Such findings are consistent with the suggestion that feedback acts to modulate responses that are primarily driven by feedforward inputs (Koch and Segev, 2000; Crick and Koch, 1998; Hup´e et al., 1998; Friston and B¨uchel, 2000).”
BackgroundFiltering of neural signals by focused attention in the monkey prefrontal cortex
Everling, S., Tinsley, C. J., Gaffan, D., & Duncan, J. (2002) · Nature Neuroscience · doi:10.1038/nn874 · Cited by 224 · cited 1×
“Similar results have been demonstrated for cells in area V4, inferior temporal cortex, in area MT of the dorsal pathway, and in prefrontal cortex (Treue and Martinez-Trujillo, 1999; Reynolds et al., 1999; Reynolds and Desimone, 1999; Everling et al., 2002).”
ResultLee, T. S., Yang, C. F., Romero, R. D., & Mumford, D. (2002) · Nature Neuroscience · doi:10.1038/nn0602-860 · Cited by 205 · cited 3×
“…can be modified by past experience (Kobatake et al., 1998; Karni, 1996; Logothetis, 1998; Sigala and Logothetis, 2001; Desimone, 1996) sensory-driven activity is biased to be interpreted in terms of stored knowledge about previously encountered situations ( Lee et al., 2002; Siegel et al., 2000).”
BackgroundResultThe implementation of visual routines
Roelfsema, P. R., Lamme, V. A. F., & Spekreijse, H. (2000) · Vision Research · doi:10.1016/s0042-6989(00)00004-3 · Cited by 162 · cited 5×
“…with this model feedback may also act to resolve ambiguities in sensory data by providing bias for one possible interpretation over all others and hence serve as a mechanism to solve the ‘binding’ problem (Treisman, 1998; Reynolds and Desimone, 1999; Roelfsema et al., 2000; Luck and Ford, 1998).”
BackgroundInfluentialUsher, M., & Niebur, E. (1996) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.1996.8.4.311 · Cited by 147 · cited 2×
“For example, experimental data for selective spatial attention has been modelled by Corchs and Deco (2002) and Grossberg and Raizada (2000), and data concerning object-based selective attention has been modelled by Usher and Niebur (1996) and Hamker (2002).”
BackgroundMethodExtrastriate feedback to primary visual cortex in primates: a quantitative analysis of connectivity
Budd, J. M. L. (1998) · Proceedings of the Royal Society of London. Series B: Biological Sciences · doi:10.1098/rspb.1998.0396 · Cited by 99 · cited 6×
“back projections terminating in Layer I are the apical dendrites of pyramidal cells with somata in Layers II, III, and V (Budd, 1998; Cauller, Clancy, & Connors, 1998; Rockland, 1998; Rolls & Treves, 1998; Cauller, 1995).”
BackgroundInfluentialDeterminants and mechanisms of attentional modulation of neural processing.
Schroeder, C. (2001) · Frontiers in bioscience · doi:10.2741/schroed · Cited by 87 · cited 2×
“…the sensory-driven activation of cells (Kanwisher and Wojciulik, 2000; Luck et al., 1997; Kastner et al., 1999; McAdams and Maunsell, 2000), such that activity in response to an attended stimulus is increased in amplitude and duration (Schroeder et al., 2001; Kastner and Ungerleider, 2000).”
Background
Cited by
Image Captioning with Semantic Attention
You, Q., Jin, H., Wang, Z., Fang, C., & Luo, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.503 · Cited by 1,803
The Normalization Model of Attention
Reynolds, J. H., & Heeger, D. J. (2009) · Neuron · doi:10.1016/j.neuron.2009.01.002 · Cited by 1,457
“…related to a number of more detailed models that have been proposed as biophysically plausible implementations of biased competition or the feature-similarity gain principle (Ardid et al., 2007; Deco and Rolls, 2005; Hamker and Zirnsak, 2006; Spratling and Johnson, 2004; Tiesinga et al., 2004).”
BackgroundThe eye contact effect: mechanisms and development
Senju, A., & Johnson, M. H. (2009) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2008.11.009 · Cited by 797
Self-citationInteractive Specialization: A domain-general framework for human functional brain development?
Johnson, M. H. (2011) · Developmental Cognitive Neuroscience · doi:10.1016/j.dcn.2010.07.003 · Cited by 722
“Clearly, only further studies, or appropriate re-analyses of existing data, can definitively address this issue.”
Self-citationWedel, M., & Pieters, R. (2008) · Foundations and Trends® in Marketing · doi:10.1561/1700000011 · Cited by 350
Metadata
- Authors
- Spratling, M. W., & Johnson, M. H.
- Venue
- Journal of Cognitive Neuroscience
- Publisher
- MIT Press - Journals
- Published
- 2004-03-01
- Volume
- 16
- Issue
- 2
- Pages
- 219-237
- ISSN
- 0898-929X (ISSN-L)
- 1530-8898
- OpenAlex
- W2135726080
- Cited by
- 154
- References
- 31
- FWCI
- 3.68
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.