A normalization model of multisensory integration
Open accessAbstract
Responses of neurons that integrate multiple sensory inputs are traditionally characterized in terms of a set of empirical principles. However, a simple computational framework that accounts for these empirical features of multisensory integration has not been established. We propose that divisive normalization, acting at the stage of multisensory integration, can account for many of the empirical principles of multisensory integration shown by single neurons, such as the principle of inverse effectiveness and the spatial principle. This model, which uses a simple functional operation (normalization) for which there is considerable experimental support, also accounts for the recent observation that the mathematical rule by which multisensory neurons combine their inputs changes with cue reliability. The normalization model, which makes a strong testable prediction regarding cross-modal suppression, may therefore provide a simple unifying computational account of the important features of multisensory integration by neurons.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Neurons in many cortical and subcortical brain areas exhibit robust gain modulation that may contribute to multiple cognitive functions, including attention, learning, sensory processing and multimodal integration.
“Neurons in many cortical and subcortical brain areas exhibit robust gain modulation that may contribute to multiple cognitive functions, including attention, learning, sensory processing and multimodal integration1–3,7,8,13–17.”
From Mechanisms underlying gain modulation in the cortex (2020) · cites this paper as [3]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Humans integrate visual and haptic information in a statistically optimal fashion
Ernst, M. O., & Banks, M. S. (2002) · Nature · doi:10.1038/415429a · Cited by 4,844 · see citing works
The Ventriloquist Effect Results from Near-Optimal Bimodal Integration
Alais, D., & Burr, D. (2004) · Current Biology · doi:10.1016/j.cub.2004.01.029 · Cited by 1,936 · see citing works
Normalization of cell responses in cat striate cortex
Heeger, D. J. (1992) · Visual Neuroscience · doi:10.1017/s0952523800009640 · Cited by 1,835 · see citing works
Synaptic depression and cortical gain control
Abbott, L. F., Varela, J. A., Sen, K., & Nelson, S. B. (1997) · Science · doi:10.1126/science.275.5297.221 · Cited by 1,690 · see citing works
Multisensory integration: current issues from the perspective of the single neuron
Stein, B. E., & Stanford, T. R. (2008) · Nature Reviews Neuroscience · doi:10.1038/nrn2331 · Cited by 1,598 · see citing works
Bayesian inference with probabilistic population codes
Ma, W. J., Beck, J. M., Latham, P. E., & Pouget, A. (2006) · Nature Neuroscience · doi:10.1038/nn1790 · Cited by 1,457 · see citing works
The Normalization Model of Attention
Reynolds, J. H., & Heeger, D. J. (2009) · Neuron · doi:10.1016/j.neuron.2009.01.002 · Cited by 1,457 · see citing works
Meredith, M. A., & Stein, B. E. (1986) · Journal of Neurophysiology · doi:10.1152/jn.1986.56.3.640 · Cited by 1,183 · see citing works
Striate cortex of monkey and cat: contrast response function.
Albrecht, D. G., & Hamilton, D. B. (1982) · Journal of Neurophysiology · doi:10.1152/jn.1982.48.1.217 · Cited by 956 · see citing works
A model of neuronal responses in visual area MT
Simoncelli, E. P., & Heeger, D. J. (1998) · Vision Research · doi:10.1016/s0042-6989(97)00183-1 · Cited by 941 · see citing works
Linearity and Normalization in Simple Cells of the Macaque Primary Visual Cortex
Carandini, M., Heeger, D. J., & Movshon, J. A. (1997) · Journal of Neuroscience · doi:10.1523/jneurosci.17-21-08621.1997 · Cited by 926 · see citing works
Determinants of multisensory integration in superior colliculus neurons. I. Temporal factors
Meredith, M. A., Nemitz, J. W., & Stein, B. (1987) · Journal of Neuroscience · doi:10.1523/jneurosci.07-10-03215.1987 · Cited by 763 · see citing works
Neural correlates of multisensory cue integration in macaque MSTd
Gu, Y., Angelaki, D. E., & DeAngelis, G. C. (2008) · Nature Neuroscience · doi:10.1038/nn.2191 · Cited by 554 · see citing works
Self-citationDivisive Normalization in Olfactory Population Codes
Olsen, S. R., Bhandawat, V., & Wilson, R. I. (2010) · Neuron · doi:10.1016/j.neuron.2010.04.009 · Cited by 500 · see citing works
Morrone, M. C., Burr, D. C., & Maffei, L. (1982) · Proceedings of the Royal Society B Biological Sciences · doi:10.1098/rspb.1982.0078 · Cited by 421 · see citing works
Dynamic Reweighting of Visual and Vestibular Cues during Self-Motion Perception
Fetsch, C. R., Turner, A. H., DeAngelis, G. C., & Angelaki, D. E. (2009) · Journal of Neuroscience · doi:10.1523/jneurosci.2574-09.2009 · Cited by 406 · see citing works
Self-citationSpatial factors determine the activity of multisensory neurons in cat superior colliculus
Meredith, M. A., & Stein, B. E. (1986) · Brain Research · doi:10.1016/0006-8993(86)91648-3 · Cited by 393 · see citing works
Organization of suppression in receptive fields of neurons in cat visual cortex
DeAngelis, G. C., Robson, J. G., Ohzawa, I., & Freeman, R. D. (1992) · Journal of Neurophysiology · doi:10.1152/jn.1992.68.1.144 · Cited by 356 · see citing works
Self-citationSpatial determinants of multisensory integration in cat superior colliculus neurons
Meredith, M. A., & Stein, B. E. (1996) · Journal of Neurophysiology · doi:10.1152/jn.1996.75.5.1843 · Cited by 327 · see citing works
Gu, Y., Watkins, P. V., Angelaki, D. E., & DeAngelis, G. C. (2006) · The Journal of Neuroscience · doi:10.1523/jneurosci.2356-05.2006 · Cited by 316 · cited 4× · see citing works
“In area MSTd, many neurons have heading tuning that is not matched for visual and vestibular inputs 13 .”
InfluentialSelf-citationEvaluating the Operations Underlying Multisensory Integration in the Cat Superior Colliculus
Stanford, T. R., Quessy, S., & Stein, B. E. (2005) · The Journal of Neuroscience · doi:10.1523/jneurosci.5095-04.2005 · Cited by 314 · see citing works
A functional link between area MSTd and heading perception based on vestibular signals
Gu, Y., DeAngelis, G. C., & Angelaki, D. E. (2007) · Nature Neuroscience · doi:10.1038/nn1935 · Cited by 297 · see citing works
Self-citationMultisensory Integration in the Ventral Intraparietal Area of the Macaque Monkey.
Avillac, M., Ben Hamed, S., & Duhamel, J.-R. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.2646-06.2007 · Cited by 281 · see citing works
MST Neurons Respond to Optic Flow and Translational Movement
Duffy, C. J. (1998) · Journal of Neurophysiology · doi:10.1152/jn.1998.80.4.1816 · Cited by 277 · see citing works
Sugihara, T., Diltz, M. D., Averbeck, B. B., & Romanski, L. M. (2006) · Journal of Neuroscience · doi:10.1523/jneurosci.3550-06.2006 · Cited by 273 · see citing works
Half-squaring in responses of cat striate cells
Heeger, D. J. (1992) · Visual Neuroscience · doi:10.1017/s095252380001124x · Cited by 262 · see citing works
Representation of Concurrent Stimuli by Population Activity in Visual Cortex
Busse, L., Wade, A. R., & Carandini, M. (2009) · Neuron · doi:10.1016/j.neuron.2009.11.004 · Cited by 247 · see citing works
The contribution of spike threshold to the dichotomy of cortical simple and complex cells
Priebe, N. J., Mechler, F., Carandini, M., & Ferster, D. (2004) · Nature Neuroscience · doi:10.1038/nn1310 · Cited by 217 · see citing works
Multisensory Integration in Macaque Visual Cortex Depends on Cue Reliability
Morgan, M. L., DeAngelis, G. C., & Angelaki, D. E. (2008) · Neuron · doi:10.1016/j.neuron.2008.06.024 · Cited by 208 · see citing works
Self-citationTwo Cortical Areas Mediate Multisensory Integration in Superior Colliculus Neurons
Jiang, W., Wallace, M. T., Jiang, H., Vaughan, J. W., & Stein, B. E. (2001) · Journal of Neurophysiology · doi:10.1152/jn.2001.85.2.506 · Cited by 205 · see citing works
Spatial Summation in the Receptive Fields of MT Neurons
Britten, K. H., & Heuer, H. W. (1999) · Journal of Neuroscience · doi:10.1523/jneurosci.19-12-05074.1999 · Cited by 200 · see citing works
Mechanisms underlying cross-orientation suppression in cat visual cortex
Priebe, N. J., & Ferster, D. (2006) · Nature Neuroscience · doi:10.1038/nn1660 · Cited by 184 · see citing works
Responses of MT and MST Neurons to One and Two Moving Objects in the Receptive Field
Recanzone, G. H., Wurtz, R. H., & Schwarz, U. (1997) · Journal of Neurophysiology · doi:10.1152/jn.1997.78.6.2904 · Cited by 171 · see citing works
A Canonical Neural Circuit for Cortical Nonlinear Operations
Kouh, M., & Poggio, T. (2008) · Neural Computation · doi:10.1162/neco.2008.02-07-466 · Cited by 163 · see citing works
Cross-modal synthesis in the midbrain depends on input from cortex
Wallace, M. T., & Stein, B. E. (1994) · Journal of Neurophysiology · doi:10.1152/jn.1994.71.1.429 · Cited by 163 · see citing works
Decoding of MSTd Population Activity Accounts for Variations in the Precision of Heading Perception
Gu, Y., Fetsch, C. R., Adeyemo, B., DeAngelis, G. C., & Angelaki, D. E. (2010) · Neuron · doi:10.1016/j.neuron.2010.04.026 · Cited by 159 · see citing works
Self-citationPerrault, T. J., Vaughan, J. W., Stein, B. E., & Wallace, M. T. (2005) · Journal of Neurophysiology · doi:10.1152/jn.00926.2004 · Cited by 158 · see citing works
Mechanisms of Within- and Cross-Modality Suppression in the Superior Colliculus
Kadunce, D. C., Vaughan, J. W., Wallace, M. T., Benedek, G., & Stein, B. E. (1997) · Journal of Neurophysiology · doi:10.1152/jn.1997.78.6.2834 · Cited by 149 · see citing works
Tuning Bandwidths for Near-Threshold Stimuli in Area MT
Britten, K. H., & Newsome, W. T. (1998) · Journal of Neurophysiology · doi:10.1152/jn.1998.80.2.762 · Cited by 111 · see citing works
Multisensory Versus Unisensory Integration: Contrasting Modes in the Superior Colliculus
Alvarado, J. C., Vaughan, J. W., Stanford, T. R., & Stein, B. E. (2007) · Journal of Neurophysiology · doi:10.1152/jn.00018.2007 · Cited by 106 · see citing works
Tolhurst, D. J., & Heeger, D. J. (1997) · Visual Neuroscience · doi:10.1017/s0952523800011433 · Cited by 99 · see citing works
Neuron-Specific Response Characteristics Predict the Magnitude of Multisensory Integration
Perrault, T. J., Vaughan, J. W., Stein, B. E., & Wallace, M. T. (2003) · Journal of Neurophysiology · doi:10.1152/jn.00494.2003 · Cited by 95 · see citing works
A Model of the Neural Mechanisms Underlying Multisensory Integration in the Superior Colliculus
Rowland, B. A., Stanford, T. R., & Stein, B. E. (2007) · Perception · doi:10.1068/p5842 · Cited by 73 · see citing works
Multisensory Integration in the Superior Colliculus Requires Synergy among Corticocollicular Inputs
Alvarado, J. C., Stanford, T. R., Rowland, B. A., Vaughan, J. W., & Stein, B. E. (2009) · Journal of Neuroscience · doi:10.1523/jneurosci.0525-09.2009 · Cited by 62 · see citing works
Modeling Cross-Modal Enhancement and Modality-Specific Suppression in Multisensory Neurons
Patton, P. E., & Anastasio, T. J. (2003) · Neural Computation · doi:10.1162/08997660360581903 · Cited by 55 · see citing works
An emergent model of multisensory integration in superior colliculus neurons
Cuppini, C. (2010) · Frontiers in Integrative Neuroscience · doi:10.3389/fnint.2010.00006 · Cited by 51 · see citing works
Alvarado, J. C., Rowland, B. A., Stanford, T. R., & Stein, B. E. (2008) · Brain Research · doi:10.1016/j.brainres.2008.03.074 · Cited by 48 · see citing works
Multisensory integration in the superior colliculus: a neural network model
Ursino, M., Cuppini, C., Magosso, E., Serino, A., & di Pellegrino, G. (2008) · Journal of Computational Neuroscience · doi:10.1007/s10827-008-0096-4 · Cited by 40 · see citing works
A theoretical study of multisensory integration in the superior colliculus by a neural network model
Magosso, E., Cuppini, C., Serino, A., di Pellegrino, G., & Ursino, M. (2008) · Neural Networks · doi:10.1016/j.neunet.2008.06.003 · Cited by 37 · see citing works
Linear Responses to Stochastic Motion Signals in Area MST
Heuer, H. W., & Britten, K. H. (2007) · Journal of Neurophysiology · doi:10.1152/jn.00083.2007 · Cited by 22 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Normalization as a canonical neural computation
Carandini, M., & Heeger, D. J. (2012) · Nature Reviews Neuroscience · doi:10.1038/nrn3136 · Cited by 1,906 · see citing works
Spectral fingerprints of large-scale neuronal interactions
Siegel, M., Donner, T. H., & Engel, A. K. (2012) · Nature Reviews Neuroscience · doi:10.1038/nrn3137 · Cited by 1,295 · see citing works
Division and subtraction by distinct cortical inhibitory networks in vivo
Wilson, N. R., Runyan, C. A., Wang, F. L., & Sur, M. (2012) · Nature · doi:10.1038/nature11347 · Cited by 568 · see citing works
A multilevel multimodal circuit enhances action selection in drosophila
Ohyama, T., Schneider-Mizell, C. M., Fetter, R. D., Aleman, J. V., Franconville, R., Rivera-Alba, M., Mensh, B. D., Branson, K. M., Simpson, J. H., Truman, J. W., et al. (2015) · Nature · doi:10.1038/nature14297 · Cited by 502 · see citing works
Neural correlates of reliability-based cue weighting during multisensory integration
Fetsch, C. R., Pouget, A., DeAngelis, G. C., & Angelaki, D. E. (2012) · Nature Neuroscience · doi:10.1038/nn.2983 · Cited by 459 · see citing works
Self-citationMechanisms underlying gain modulation in the cortex
Ferguson, K. A., & Cardin, J. A. (2020) · Nature Reviews Neuroscience · doi:10.1038/s41583-019-0253-y · Cited by 327 · see citing works
Spatial Sensory Organization and Body Representation in Pain Perception
Haggard, P., Iannetti, G. D., & Longo, M. R. (2013) · Current Biology · doi:10.1016/j.cub.2013.01.047 · Cited by 192 · see citing works
A computational perspective on autism
Rosenberg, A., Patterson, J. S., & Angelaki, D. E. (2015) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1510583112 · Cited by 156 · see citing works
Self-citationLooming Signals Reveal Synergistic Principles of Multisensory Integration
Cappe, C., Thelen, A., Romei, V., Thut, G., & Murray, M. M. (2012) · The Journal of Neuroscience · doi:10.1523/jneurosci.5517-11.2012 · Cited by 107 · see citing works
Response-dependent dynamics of cell-specific inhibition in cortical networks in vivo
El-Boustani, S., & Sur, M. (2014) · Nature Communications · doi:10.1038/ncomms6689 · Cited by 61 · see citing works
Proscription supports robust perceptual integration by suppression in human visual cortex
Rideaux, R., & Welchman, A. E. (2018) · Nature Communications · doi:10.1038/s41467-018-03400-y · Cited by 27 · see citing works
Suboptimal human multisensory cue combination
Arnold, D. H., Petrie, K., Murray, C., & Johnston, A. (2019) · Scientific Reports · doi:10.1038/s41598-018-37888-7 · Cited by 23 · see citing works
Sakamoto, K., Katori, Y., Saito, N., Yoshida, S., Aihara, K., & Mushiake, H. (2013) · PLoS ONE · doi:10.1371/journal.pone.0080906 · Cited by 13 · see citing works
- Authors
- Ohshiro, T., Angelaki, D. E., & DeAngelis, G. C.
- Affiliations
- University of Rochester (US)
- Washington University in St. Louis (US)
- Corresponding author
- DeAngelis, Gregory C
- Venue
- Nature Neuroscience
- Published
- 2011-05-08
- Volume
- 14
- Issue
- 6
- Pages
- 775-782
- ISSN
- 1097-6256 (ISSN-L)
- 1546-1726
- PMC
- PMC3102778
- OpenAlex
- W2167940154
- Cited by
- 320
- References
- 50
- Citations by year
- 2026: 15 · 2025: 26 · 2024: 21 · 2023: 24 · 2022: 19 · 2021: 17 · 2020: 21 · 2019: 18 · 2018: 23 · 2017: 22 · 2016: 31 · 2015: 18 · 2014: 15 · 2013: 19 · 2012: 21
- FWCI
- 26.70
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Nature Neuroscience (publishedVersion)
- PubMed (publishedVersion)
- PubMed Central (acceptedVersion)
- Funders
- National Eye Institute (R01EY019087, R01EY016178)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Multisensory perception and integration
- Life Sciences › Neuroscience › Cognitive Neuroscience › Visual perception and processing mechanisms
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural dynamics and brain function
- Keywords
- multisensory integration, divisive normalization, computational model, cue reliability, multisensory neurons
- MeSH terms
- Auditory Perception, Humans, Models, Neurological, Neurons, Neurons, Afferent, Superior Colliculi, Temporal Lobe, Visual Perception
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
