Contrast normalization contributes to a biologically-plausible model of receptive-field development in primary visual cortex (V1)
Open accessAbstract
Neuronal populations in the primary visual cortex (V1) of mammals exhibit contrast normalization. Neurons that respond strongly to simple visual stimuli - such as sinusoidal gratings - respond less well to the same stimuli when they are presented as part of a more complex stimulus which also excites other, neighboring neurons. This phenomenon is generally attributed to generalized patterns of inhibitory connections between nearby V1 neurons. The Bienenstock, Cooper and Munro (BCM) rule is a neural network learning rule that, when trained on natural images, produces model neurons which, individually, have many tuning properties in common with real V1 neurons. However, when viewed as a population, a BCM network is very different from V1 - each member of the BCM population tends to respond to the same dominant features of visual input, producing an incomplete, highly redundant code for visual information. Here, we demonstrate that, by adding contrast normalization into the BCM rule, we arrive at a neurally-plausible Hebbian learning rule that can learn an efficient sparse, overcomplete representation that is a better model for stimulus selectivity in V1. This suggests that one role of contrast normalization in V1 is to guide the neonatal development of receptive fields, so that neurons respond to different features of visual input.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Gain regulation has been suggested to enable networks of neurons to produce distributed representations of stimulus features.
“Gain regulation has been suggested to enable networks of neurons to produce distributed representations of stimulus features223, and to allow downstream decoders to be optimized for diverse stimuli by separating those features224.”
From Mechanisms underlying gain modulation in the cortex (2020) · cites this paper as [223]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Emergence of simple-cell receptive field properties by learning a sparse code for natural images
Olshausen, B. A., & Field, D. J. (1996) · Nature · doi:10.1038/381607a0 · Cited by 5,694 · see citing works
Receptive fields of single neurones in the cat's striate cortex
Hubel, D. H., & Wiesel, T. N. (1959) · The Journal of Physiology · doi:10.1113/jphysiol.1959.sp006308 · Cited by 4,653 · see citing works
Sparse coding with an overcomplete basis set: A strategy employed by V1?
Olshausen, B. A., & Field, D. J. (1997) · Vision Research · doi:10.1016/s0042-6989(97)00169-7 · Cited by 3,642 · see citing works
Bienenstock, E., Cooper, L., & Munro, P. (1982) · The Journal of Neuroscience · doi:10.1523/jneurosci.02-01-00032.1982 · Cited by 2,896 · see citing works
SINGLE-CELL RESPONSES IN STRIATE CORTEX OF KITTENS DEPRIVED OF VISION IN ONE EYE
Wiesel, T. N., & Hubel, D. H. (1963) · Journal of Neurophysiology · doi:10.1152/jn.1963.26.6.1003 · Cited by 2,628 · see citing works
Normalization of cell responses in cat striate cortex
Heeger, D. J. (1992) · Visual Neuroscience · doi:10.1017/s0952523800009640 · Cited by 1,835 · see citing works
Nonlinear neural networks: Principles, mechanisms, and architectures
Grossberg, S. (1988) · Neural Networks · doi:10.1016/0893-6080(88)90021-4 · Cited by 1,623 · see citing works
The “independent components” of natural scenes are edge filters
Bell, A. J., & Sejnowski, T. J. (1997) · Vision Research · doi:10.1016/s0042-6989(97)00121-1 · Cited by 1,592 · see citing works
Spatial frequency selectivity of cells in macaque visual cortex
De Valois, R. L., Albrecht, D. G., & Thorell, L. G. (1982) · Vision Research · doi:10.1016/0042-6989(82)90113-4 · Cited by 1,489 · see citing works
Sparse Coding and Decorrelation in Primary Visual Cortex During Natural Vision
Vinje, W. E., & Gallant, J. L. (2000) · Science · doi:10.1126/science.287.5456.1273 · Cited by 1,288 · see citing works
Mathematical description of the responses of simple cortical cells*
Marĉelja, S. (1980) · Journal of the Optical Society of America · doi:10.1364/josa.70.001297 · Cited by 1,253 · see citing works
Two-dimensional spectral analysis of cortical receptive field profiles
Daugman, J. G. (1980) · Vision Research · doi:10.1016/0042-6989(80)90065-6 · Cited by 1,209 · see citing works
What Is the Goal of Sensory Coding?
Field, D. J. (1994) · Neural Computation · doi:10.1162/neco.1994.6.4.559 · Cited by 1,183 · see citing works
Independent component filters of natural images compared with simple cells in primary visual cortex
van Hateren, J. H., & van der Schaaf, A. (1998) · Proceedings of the Royal Society of London. Series B: Biological Sciences · doi:10.1098/rspb.1998.0303 · Cited by 1,106 · see citing works
Spatial and temporal contrast sensitivities of neurones in lateral geniculate nucleus of macaque.
Derrington, A. M., & Lennie, P. (1984) · The Journal of Physiology · doi:10.1113/jphysiol.1984.sp015498 · Cited by 1,059 · see citing works
Development of the brain depends on the visual environment
BLAKEMORE, C., & COOPER, G. F. (1970) · Nature · doi:10.1038/228477a0 · Cited by 1,005 · see citing works
Striate cortex of monkey and cat: contrast response function.
Albrecht, D. G., & Hamilton, D. B. (1982) · Journal of Neurophysiology · doi:10.1152/jn.1982.48.1.217 · Cited by 956 · see citing works
Spatial summation in the receptive fields of simple cells in the cat's striate cortex.
Movshon, J. A., Thompson, I. D., & Tolhurst, D. J. (1978) · The Journal of Physiology · doi:10.1113/jphysiol.1978.sp012488 · Cited by 890 · see citing works
Self-citationNatural signal statistics and sensory gain control
Schwartz, O., & Simoncelli, E. P. (2001) · Nature Neuroscience · doi:10.1038/90526 · Cited by 835 · see citing works
The orientation and direction selectivity of cells in macaque visual cortex
Valois, R. L. D., Yund, E. W., & Hepler, N. (1982) · Vision Research · doi:10.1016/0042-6989(82)90112-2 · Cited by 773 · see citing works
Innate and environmental factors in the development of the kitten's visual cortex.
Blakemore, C. B., & Sluyters, R. C. V. (1975) · The Journal of Physiology · doi:10.1113/jphysiol.1975.sp010995 · Cited by 679 · see citing works
The two-dimensional spatial structure of simple receptive fields in cat striate cortex
Jones, J. P., & Palmer, L. A. (1987) · Journal of Neurophysiology · doi:10.1152/jn.1987.58.6.1187 · Cited by 676 · see citing works
Spatial and temporal contrast sensitivity of neurones in areas 17 and 18 of the cat's visual cortex.
Movshon, J. A., Thompson, I. D., & Tolhurst, D. J. (1978) · The Journal of Physiology · doi:10.1113/jphysiol.1978.sp012490 · Cited by 667 · see citing works
Self-citationSummation and Division by Neurons in Primate Visual Cortex
Carandini, M., & Heeger, D. J. (1994) · Science · doi:10.1126/science.8191289 · Cited by 649 · see citing works
Retinal waves and visual system development
Wong, R. O. L. (1999) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.22.1.29 · Cited by 544 · see citing works
Amplitude spectra of natural images
Tolhurst, D. J., Tadmor, Y., & Chao, T. (1992) · Ophthalmic and Physiological Optics · doi:10.1111/j.1475-1313.1992.tb00296.x · Cited by 508 · see citing works
Self-citationReceptive fields of P and M ganglion cells across the primate retina
Croner, L. J., & Kaplan, E. (1995) · Vision Research · doi:10.1016/0042-6989(94)e0066-t · Cited by 495 · see citing works
Bonds, A. B. (1989) · Visual Neuroscience · doi:10.1017/s0952523800004314 · Cited by 477 · see citing works
DeAngelis, G. C., Ohzawa, I., & Freeman, R. D. (1993) · Journal of Neurophysiology · doi:10.1152/jn.1993.69.4.1091 · Cited by 427 · see citing works
van Hateren, J. H., & Ruderman, D. (1998) · Proceedings of the Royal Society B Biological Sciences · doi:10.1098/rspb.1998.0577 · Cited by 407 · see citing works
Oblique effect: a neural basis in the visual cortex
Li, B., Peterson, M. R., & Freeman, R. D. (2003) · Journal of Neurophysiology · doi:10.1152/jn.00954.2002 · Cited by 328 · see citing works
Characterizing the sparseness of neural codes
Willmore, B. D. B., & Tolhurst, D. J. (2001) · Network Computation in Neural Systems · doi:10.1088/0954-898x/12/3/302 · Cited by 264 · see citing works
Self-citationThe principal components of natural images
Hancock, P., Baddeley, R., & Smith, L. S. (1992) · Network Computation in Neural Systems · doi:10.1088/0954-898x_3_1_008 · Cited by 239 · see citing works
Characterizing the sparseness of neural codes
Willmore, B. D. B., & Tolhurst, D. J. (2001) · Network Computation in Neural Systems · doi:10.1080/net.12.3.255.270 · Cited by 229 · see citing works
Self-citationCortical neurons: Isolation of contrast gain control
Geisler, W. S., & Albrecht, D. G. (1992) · Vision Research · doi:10.1016/0042-6989(92)90196-p · Cited by 211 · see citing works
Linsenmeier, R. A., Frishman, L. J., Jakiela, H. G., & Enroth‐Cugell, C. (1982) · Vision Research · doi:10.1016/0042-6989(82)90082-7 · Cited by 197 · see citing works
The structure and symmetry of simple-cell receptive-field profiles in the cat’s visual cortex
Field, D. J., & Tolhurst, D. J. (1986) · Proceedings of the Royal Society B Biological Sciences · doi:10.1098/rspb.1986.0060 · Cited by 162 · see citing works
Self-citationYoshioka, T., Levitt, J. B., & Lund, J. S. (1994) · Visual Neuroscience · doi:10.1017/s0952523800002406 · Cited by 152 · see citing works
On the variety of spatial frequency selectivities shown by neurons in area 17 of the cat
Tolhurst, D. J., & Thompson, I. D. (1981) · Proceedings of the Royal Society B Biological Sciences · doi:10.1098/rspb.1981.0061 · Cited by 138 · see citing works
Self-citationSmyth, D., Willmore, B. D. B., Baker, G. E., Thompson, I. D., & Tolhurst, D. J. (2003) · Journal of Neuroscience · doi:10.1523/jneurosci.23-11-04746.2003 · Cited by 133 · see citing works
Self-citationStryker, M. P., & Sherk, H. (1975) · Science · doi:10.1126/science.1188372 · Cited by 123 · see citing works
The receptive field of the primate P retinal ganglion cell, I: Linear dynamics
Benardete, E. A., & Kaplan, E. (1997) · Visual Neuroscience · doi:10.1017/s0952523800008853 · Cited by 122 · see citing works
Irvin, G. E., Casagrande, V. A., & Norton, T. T. (1993) · Visual Neuroscience · doi:10.1017/s0952523800003758 · Cited by 112 · see citing works
Cooper, L. N., Intrator, N., Blais, B. S., & Shouval, H. Z. (2004) · WORLD SCIENTIFIC eBooks · doi:10.1142/9789812562555 · Cited by 103 · see citing works
Tolhurst, D. J., & Heeger, D. J. (1997) · Visual Neuroscience · doi:10.1017/s0952523800011433 · Cited by 99 · see citing works
Self-citationMolecular basis for induction of ocular dominance plasticity
Bear, M. F., & Rittenhouse, C. D. (1999) · Journal of Neurobiology · doi:10.1002/(sici)1097-4695(199910)41:1 · Cited by 99 · see citing works
Vidyasagar, T. R., Kulikowski, J. J., Lipnicki, D. M., & Dreher, B. (2002) · European Journal of Neuroscience · doi:10.1046/j.1460-9568.2002.02137.x · Cited by 89 · see citing works
Krug, K., Akerman, C. J., & Thompson, I. D. (2001) · Journal of Neurophysiology · doi:10.1152/jn.2001.85.4.1436 · Cited by 86 · see citing works
Law, C.-T., & Cooper, L. N. (1994) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.91.16.7797 · Cited by 84 · see citing works
The Sparseness of Neuronal Responses in Ferret Primary Visual Cortex
Tolhurst, D. J., Smyth, D., & Thompson, I. D. (2009) · Journal of Neuroscience · doi:10.1523/jneurosci.3869-08.2009 · Cited by 78 · see citing works
Self-citationChapman, B., & Gödecke, I. (2000) · Journal of Neuroscience · doi:10.1523/jneurosci.20-05-01922.2000 · Cited by 69 · see citing works
Cortical Effect of Early Selective Exposure to Diagonal Lines
Leventhal, A. G., & Hirsch, H. V. B. (1975) · Science · doi:10.1126/science.1188371 · Cited by 67 · see citing works
Independent Components of Color Natural Scenes Resemble V1 Neurons in Their Spatial and Color Tuning
Caywood, M. S., Willmore, B. D. B., & Tolhurst, D. J. (2004) · Journal of Neurophysiology · doi:10.1152/jn.00775.2003 · Cited by 58 · see citing works
Self-citationReceptive Field Formation in Natural Scene Environments: Comparison of Single-Cell Learning Rules
Blais, B. S., Intrator, N., Shouval, H. Z., & Cooper, L. N. (1998) · Neural Computation · doi:10.1162/089976698300017142 · Cited by 56 · see citing works
The principal components of natural images
Hancock, P., Baddeley, R., & Smith, L. S. (1992) · Network Computation in Neural Systems · doi:10.1088/0954-898x/3/1/008 · Cited by 52 · see citing works
A Simple Hebbian/Anti-Hebbian Network Learns the Sparse, Independent Components of Natural Images
Falconbridge, M., Stamps, R. L., & Badcock, D. R. (2005) · Neural Computation · doi:10.1162/089976606775093891 · Cited by 43 · see citing works
Finding compact and sparse-distributed representations of visual images
Fyfe, C., & Baddeley, R. J. (1995) · Network Computation in Neural Systems · doi:10.1088/0954-898x_6_3_002 · Cited by 41 · see citing works
BCM network develops orientation selectivity and ocular dominance in natural scene environment
Shouval, H. Z., Intratorj, N., & Cooper, L. N. (1997) · Vision Research · doi:10.1016/s0042-6989(97)00087-4 · Cited by 39 · see citing works
A Comparison of Natural-Image-Based Models of Simple-Cell Coding
Willmore, B. D. B., Watters, P., & Tolhurst, D. J. (2000) · Perception · doi:10.1068/p2963 · Cited by 32 · see citing works
Self-citationEffects of monocular exposure to oriented lines on monkey striate cortex
Carlson, M., Hubel, D. H., & Wiesel, T. N. (1986) · Developmental Brain Research · doi:10.1016/0165-3806(86)90153-7 · Cited by 23 · see citing works
Finding compact and sparse-distributed representations of visual images
Fyfe, C., & Baddeley, R. J. (1995) · Network Computation in Neural Systems · doi:10.1088/0954-898x/6/3/002 · Cited by 16 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Mechanisms underlying gain modulation in the cortex
Ferguson, K. A., & Cardin, J. A. (2020) · Nature Reviews Neuroscience · doi:10.1038/s41583-019-0253-y · Cited by 327 · see citing works
- Authors
- Willmore, B. D. B., Bulstrode, H., & Tolhurst, D. J.
- Affiliations
- University of Oxford (GB)
- University of Cambridge (GB)
- Corresponding author
- Willmore, Ben D.B.
- Venue
- Vision Research
- Publisher
- Elsevier BV
- Published
- 2012-02
- Volume
- 54
- Pages
- 49-60
- ISSN
- 0042-6989 (ISSN-L)
- PMC
- PMC3334822
- OpenAlex
- W2161725119
- Cited by
- 10
- References
- 61
- Citations by year
- 2022: 1 · 2021: 1 · 2020: 2 · 2017: 1 · 2016: 1 · 2015: 1 · 2014: 1 · 2013: 1 · 2012: 1
- FWCI
- 0.65
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Vision Research (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Funders
- Wellcome Trust (WT076508AIA)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Visual perception and processing mechanisms
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural dynamics and brain function
- Physical Sciences › Computer Science › Artificial Intelligence › Neural Networks and Applications
- Keywords
- contrast normalization, receptive field development, primary visual cortex, BCM rule, Hebbian learning, stimulus selectivity, inhibitory interneurons, neural network model, visual development
- MeSH terms
- Humans, Models, Neurological, Retina, Visual Cortex, Visual Fields, Visual Perception, Contrast Sensitivity
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review