Computing with a Canonical Neural Circuits Model with Pool Normalization and Modulating Feedback
The DOI matches its Crossref record; 36 of the 36 references it cites were found in a registry or an index.
Abstract
Evidence suggests that the brain uses an operational set of canonical computations like normalization, input filtering, and response gain enhancement via reentrant feedback. Here, we propose a three-stage columnar architecture of cascaded model neurons to describe a core circuit combining signal pathways of feedforward and feedback processing and the inhibitory pooling of neurons to normalize the activity. We present an analytical investigation of such a circuit by first reducing its detail through the lumping of initial feedforward response filtering and reentrant modulating signal amplification. The resulting excitatory-inhibitory pair of neurons is analyzed in a 2D phase-space. The inhibitory pool activation is treated as a separate mechanism exhibiting different effects. We analyze subtractive as well as divisive (shunting) interaction to implement center-surround mechanisms that include normalization effects in the characteristics of real neurons. Different variants of a core model architecture are derived and analyzed—in particular, individual excitatory neurons (without pool inhibition), the interaction with an inhibitory subtractive or divisive (i.e., shunting) pool, and the dynamics of recurrent self-excitation combined with divisive inhibition. The stability and existence properties of these model instances are characterized, which serve as guidelines to adjust these properties through proper model parameterization. The significance of the derived results is demonstrated by theoretical predictions of response behaviors in the case of multiple interacting hypercolumns in a single and in multiple feature dimensions. In numerical simulations, we confirm these predictions and provide some explanations for different neural computational properties. Among those, we consider orientation contrast-dependent response behavior, different forms of attentional modulation, contrast element grouping, and the dynamic adaptation of the silent surround in extraclassical receptive field configurations, using only slight variations of the same core reference model.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Rao, R. P. N., & Ballard, D. H. (1999) · Nature Neuroscience · doi:10.1038/4580 · Cited by 5,483
Receptive fields of single neurones in the cat's striate cortex
Hubel, D. H., & Wiesel, T. N. (1959) · The Journal of Physiology · doi:10.1113/jphysiol.1959.sp006308 · Cited by 4,653
Hierarchical models of object recognition in cortex
Riesenhuber, M., & Poggio, T. (1999) · Nature Neuroscience · doi:10.1038/14819 · Cited by 3,309
Selective Attention Gates Visual Processing in the Extrastriate Cortex
Moran, J., & Desimone, R. (1985) · Science · doi:10.1126/science.4023713 · Cited by 2,433
Canonical Microcircuits for Predictive Coding
Bastos, A. M., Usrey, W. M., Adams, R. A., Mangun, G. R., Fries, P., & Friston, K. J. (2012) · Neuron · doi:10.1016/j.neuron.2012.10.038 · Cited by 2,421 · cited 1×
“This is in line with recent experimental observations that FB signals realize predictive coding principles (Bastos et al., 2012; Rauss, Schwartz, & Pourtoise, 2011); a reduction in response amplitude indicates that the predictions generated by FB signals match the driving FF signals (Markov &…”
ResultThe distinct modes of vision offered by feedforward and recurrent processing
Lamme, V. A. F., & Roelfsema, P. R. (2000) · Trends in Neurosciences · doi:10.1016/s0166-2236(00)01657-x · Cited by 2,338
Normalization as a canonical neural computation
Carandini, M., & Heeger, D. J. (2012) · Nature Reviews Neuroscience · doi:10.1038/nrn3136 · Cited by 1,906
Normalization of cell responses in cat striate cortex
Heeger, D. J. (1992) · Visual Neuroscience · doi:10.1017/s0952523800009640 · Cited by 1,835 · cited 4×
“Simple cells in area V1 tend to saturate their activation as a consequence of increasing stimulus contrast and surround activities (Heeger, 1992; Carandini & Heeger, 1994; Carandini et al., 1999; Carandini, Heeger, & Movshon, 1997; see Smith, 2006, for a summary).”
BackgroundInfluentialEmerging concepts for the dynamical organization of resting-state activity in the brain
Deco, G., Jirsa, V. K., & McIntosh, A. R. (2011) · Nature reviews. Neuroscience · doi:10.1038/nrn2961 · Cited by 1,798
The Normalization Model of Attention
Reynolds, J. H., & Heeger, D. J. (2009) · Neuron · doi:10.1016/j.neuron.2009.01.002 · Cited by 1,457 · cited 2×
“Other findings suggest that normalization occurs not only in early visual sensory processing but also in, auditory processing (Rabinowitz et al., 2011), attention mechanisms (Reynolds & Heeger, 2009; Treue, 2001), and decision making (Louie et al., 2011; Louie & Glimcher, 2012).”
BackgroundCompetitive Mechanisms Subserve Attention in Macaque Areas V2 and V4
Reynolds, J. H., Chelazzi, L., & Desimone, R. (1999) · The Journal of Neuroscience · doi:10.1523/jneurosci.19-05-01736.1999 · Cited by 1,236 · cited 1×
“Furthermore, these cover effects of response amplification and changes in contrast gain (Williford & Maunsell, 2006) and the reduction of activity when attending nonpreferred stimuli paired with a preferred stimulus inside the receptive field of a target cell (Moran & Desimone, 1985; Recanzone & Wurtz, 2000; Reynolds…”
BackgroundTop-down influences on visual processing
Gilbert, C. D., & Li, W. (2013) · Nature Reviews Neuroscience · doi:10.1038/nrn3476 · Cited by 1,224 · cited 1×
“The same generic framework has also been extended and applied in the motion domain to account for the mechanism of motion integration, disambiguation (aperture problem), and segregation as well as selective motion feature attention (Barnes & Mingolla, 2013; Bayerl & Neumann, 2004, 2006; Berzhanskaya, Grossberg, & Ming…”
ResultThe neurophysiology of figure-ground segregation in primary visual cortex
Lamme, V. (1995) · The Journal of Neuroscience · doi:10.1523/jneurosci.15-02-01605.1995 · Cited by 946
Kapadia, M. K., Ito, M., Gilbert, C. D., & Westheimer, G. (1995) · Neuron · doi:10.1016/0896-6273(95)90175-2 · Cited by 941
Cortical feedback improves discrimination between figure and background by V1, V2 and V3 neurons
Hupé, J. M., James, A. C., Payne, B. R., Lomber, S. G., Girard, P., & Bullier, J. (1998) · Nature · doi:10.1038/29537 · Cited by 864 · cited 3×
“…is that cortical areas are mostly bidirectionally connected: FF signals drive, while FB signals tend to enhance the gain of the driving FF input (Sherman & Guillery, 1998; Sandell & Schiller, 1982; Bullier, McCourt, & Henry, 1988; Salin & Bullier, 1995; Hupé et al., 1998; Bullier, 2001).”
BackgroundCircuits for local and global signal integration in primary visual cortex
Angelucci, A., Levitt, J. B., Walton, E. J. S., Hupé, J.-M., Bullier, J., & Lund, J. S. (2002) · The Journal of Neuroscience · doi:10.1523/jneurosci.22-19-08633.2002 · Cited by 789
A cellular mechanism for cortical associations: an organizing principle for the cerebral cortex
Larkum, M. (2013) · Trends in Neurosciences · doi:10.1016/j.tins.2012.11.006 · Cited by 755 · cited 6×
“The reproduction of gain enhancement of somatic cortical pyramidal cell responses by coincident input at distal dendritic tufts demonstrates the validity of this generic mechanism (Larkum, 2013).”
BackgroundInfluentialOn the actions that one nerve cell can have on another: distinguishing “drivers” from “modulators”
Sherman, S. M., & Guillery, R. W. (1998) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.95.12.7121 · Cited by 746 · cited 1×
“…is that cortical areas are mostly bidirectionally connected: FF signals drive, while FB signals tend to enhance the gain of the driving FF input (Sherman & Guillery, 1998; Sandell & Schiller, 1982; Bullier, McCourt, & Henry, 1988; Salin & Bullier, 1995; Hupé et al., 1998; Bullier, 2001).”
BackgroundVisual attention mediated by biased competition in extrastriate visual cortex
Desimone, R. (1998) · Philosophical Transactions of the Royal Society of London. Series B: Biological Sciences · doi:10.1098/rstb.1998.0280 · Cited by 696 · cited 1×
“One such framework proposes that FF sensory activations are amplified by matching FB signals such that subsequent competition between neurons yields a competitive advantage, and thus gain enhancement, for those cells that have an increased gain through the action of modulating FB for matching feature selectivity (bias…”
BackgroundSummation and Division by Neurons in Primate Visual Cortex
Carandini, M., & Heeger, D. J. (1994) · Science · doi:10.1126/science.8191289 · Cited by 649 · cited 3×
“Simple cells in area V1 tend to saturate their activation as a consequence of increasing stimulus contrast and surround activities (Heeger, 1992; Carandini & Heeger, 1994; Carandini et al., 1999; Carandini, Heeger, & Movshon, 1997; see Smith, 2006, for a summary).”
BackgroundMethodS‐potentials from luminosity units in the retina of fish (Cyprinidae)
Naka, K. I., & Rushton, W. A. H. (1966) · The Journal of Physiology · doi:10.1113/jphysiol.1966.sp008003 · Cited by 631 · cited 1×
“The response at equilibrium ¯ r has the characteristics of an S-potential measured for retinal cones (Naka & Rushton, 1966) in which the parameter α controls the balance between response differentiation and degree of saturation.”
BackgroundTwo dynamically distinct inhibitory networks in layer 4 of the neocortex
Beierlein, M., Gibson, J. R., & Connors, B. W. (2003) · Journal of Neurophysiology · doi:10.1152/jn.00283.2003 · Cited by 591
Tononi, G., Sporns, O., & Edelman, G. M. (1992) · Cerebral Cortex · doi:10.1093/cercor/2.4.310 · Cited by 435
A Neural Model of Contour Integration in the Primary Visual Cortex
Li, Z. (1998) · Neural Computation · doi:10.1162/089976698300017557 · Cited by 426 · cited 2×
“The proposed model column relates to previous investigations of other E-I systems in which oscillatory and stability behavior has been studied locally (Wilson & Cowan, 1972; Ellias & Grossberg, 1975; Amit & Brunel, 1997; Terman, Kopell, & Bose, 1998; Zhaoping, 1998).”
MethodConstraints on cortical and thalamic projections: the no-strong-loops hypothesis
Crick, F., & Koch, C. (1998) · Nature · doi:10.1038/34584 · Cited by 353
Effects of Spatial Attention on Contrast Response Functions in Macaque Area V4
Williford, T., & Maunsell, J. H. R. (2006) · Journal of Neurophysiology · doi:10.1152/jn.01207.2005 · Cited by 353
Reward value-based gain control: divisive normalization in parietal cortex
Louie, K., Grattan, L. E., & Glimcher, P. W. (2011) · Journal of Neuroscience · doi:10.1523/jneurosci.1237-11.2011 · Cited by 308 · cited 2×
“, 2011), attention mechanisms (Reynolds & Heeger, 2009; Treue, 2001), and decision making (Louie et al., 2011; Louie & Glimcher, 2012).”
BackgroundA Normalization Model of Attentional Modulation of Single Unit Responses
Lee, J., & Maunsell, J. H. R. (2009) · PLoS ONE · doi:10.1371/journal.pone.0004651 · Cited by 257
Figure—Ground Segregation in a Recurrent Network Architecture
Roelfsema, P. R., Lamme, V. A. F., Spekreijse, H., & Bosch, H. (2002) · Journal of Cognitive Neuroscience · doi:10.1162/08989290260045756 · Cited by 254
Always returning: feedback and sensory processing in visual cortex and thalamus.
Sillito, A. M., Cudeiro, J., & Jones, H. E. (2006) · Trends in Neurosciences · doi:10.1016/j.tins.2006.05.001 · Cited by 242
Reaching beyond the classical receptive field of V1 neurons: horizontal or feedback axons?
Angelucci, A., & Bullier, J. (2003) · Journal of Physiology-Paris · doi:10.1016/j.jphysparis.2003.09.001 · Cited by 233
Top-down effects on early visual processing in humans: A predictive coding framework
Rauss, K., Schwartz, S., & Pourtois, G. (2011) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2010.12.011 · Cited by 219
The importance of being hierarchical
Markov, N. T., & Kennedy, H. (2013) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2012.12.008 · Cited by 204 · cited 1×
“…line with recent experimental observations that FB signals realize predictive coding principles (Bastos et al., 2012; Rauss, Schwartz, & Pourtoise, 2011); a reduction in response amplitude indicates that the predictions generated by FB signals match the driving FF signals (Markov & Kennedy, 2013).”
BackgroundDifferent glutamate receptors convey feedforward and recurrent processing in macaque V1
Self, M. W., Kooijmans, R. N., Supèr, H., Lamme, V. A., & Roelfsema, P. R. (2012) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1119527109 · Cited by 184
Visual activity in area V2 during reversible inactivation of area 17 in the macaque monkey
Girard, P., & Bullier, J. (1989) · Journal of Neurophysiology · doi:10.1152/jn.1989.62.6.1287 · Cited by 179
Reconciling predictive coding and biased competition models of cortical function
Spratling, M. W. (2008) · Frontiers in Computational Neuroscience · doi:10.3389/neuro.10.004.2008 · Cited by 153
Cited by
Cognitive functions of intracellular mechanisms for contextual amplification
Phillips, W. A. (2017) · Brain and Cognition · doi:10.1016/j.bandc.2015.09.005 · Cited by 62
Reinforcement learning of linking and tracing contours in recurrent neural networks
Brosch, T., Neumann, H., & Roelfsema, P. R. (2015) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1004489 · Cited by 33
Self-citationThe Cooperative Neuron: Cellular Foundations of Mental Life
Phillips, W. A. (2023) · doi:10.1093/oso/9780198876984.001.0001 · Cited by 13
Metadata
- Authors
- Brosch, T., & Neumann, H.
- Venue
- Neural Computation
- Publisher
- MIT Press
- Published
- 2014-12
- Volume
- 26
- Issue
- 12
- Pages
- 2735-2789
- ISSN
- 0899-7667 (ISSN-L)
- 1530-888X
- OpenAlex
- W2006487251
- Cited by
- 65
- References
- 36
- FWCI
- 2.55
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.