The DOI matches its Crossref record; 51 of the 51 references it cites were found in a registry or an index.
Multisensory integration: psychophysics, neurophysiology, and computation
Open accessAbstract
Fundamental observations and principles derived from traditional physiological studies of multisensory integration have been difficult to reconcile with computational and psychophysical studies that share the foundation of probabilistic (Bayesian) inference. We review recent work on multisensory integration, focusing on experiments that bridge single-cell electrophysiology, psychophysics, and computational principles. These studies show that multisensory (visual-vestibular) neurons can account for near-optimal cue integration during the perception of self-motion. Unlike the nonlinear (superadditive) interactions emphasized in some previous studies, visual-vestibular neurons accomplish near-optimal cue integration through subadditive linear summation of their inputs, consistent with recent computational theories. Important issues remain to be resolved, including the observation that variations in cue reliability appear to change the weights that neurons apply to their different sensory inputs.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Humans have been shown to take uncertainty into account when combining different sources of information in a manner that conforms to the statistical optimum as prescribed by Bayes’ rule (Ernst & Banks, 2002; Angelaki et al., 2009).”
From The generalized Hierarchical Gaussian Filter (2026) · cites this paper as Angelaki et al., 2009
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(1966) · Medical Entomology and Zoology · Cited by 10,293
Signal detection theory and psychophysics
Ingleby, D. (1967) · Journal of Sound and Vibration · doi:10.1016/0022-460x(67)90197-6 · Cited by 8,616
Humans integrate visual and haptic information in a statistically optimal fashion
Ernst, M. O., & Banks, M. S. (2002) · Nature · doi:10.1038/415429a · Cited by 4,844
The Bayesian brain: The role of uncertainty in neural coding and computation
Knill, D. C., & Pouget, A. (2004) · Trends in Neurosciences · doi:10.1016/j.tins.2004.10.007 · Cited by 2,588
The Ventriloquist Effect Results from Near-Optimal Bimodal Integration
Alais, D., & Burr, D. (2004) · Current Biology · doi:10.1016/j.cub.2004.01.029 · Cited by 1,936
Normalization of cell responses in cat striate cortex
Heeger, D. J. (1992) · Visual Neuroscience · doi:10.1017/s0952523800009640 · Cited by 1,835
Multisensory integration: current issues from the perspective of the single neuron
Stein, B. E., & Stanford, T. R. (2008) · Nature Reviews Neuroscience · doi:10.1038/nrn2331 · Cited by 1,598
Bayesian inference with probabilistic population codes
Ma, W. J., Beck, J. M., Latham, P. E., & Pouget, A. (2006) · Nature Neuroscience · doi:10.1038/nn1790 · Cited by 1,457
Object perception as Bayesian inference
Kersten, D., Mamassian, P., & Yuille, A. (2004) · Annual Review of Psychology · doi:10.1146/annurev.psych.55.090902.142005 · Cited by 1,269
A relationship between behavioral choice and the visual responses of neurons in macaque MT
Britten, K. H., Newsome, W. T., Shadlen, M. N., Celebrini, S., & Movshon, J. A. (1996) · Visual Neuroscience · doi:10.1017/s095252380000715x · Cited by 1,049
Neuronal oscillations and multisensory interaction in primary auditory cortex
Lakatos, P., Chen, C.-M., O'Connell, M. N., Mills, A., & Schroeder, C. E. (2007) · Neuron · doi:10.1016/j.neuron.2006.12.011 · Cited by 961
Driver, J., & Noesselt, T. (2008) · Neuron · doi:10.1016/j.neuron.2007.12.013 · Cited by 940
Interactions Among Converging Sensory Inputs in the Superior Colliculus
Meredith, M. A., & Stein, B. E. (1983) · Science · doi:10.1126/science.6867718 · Cited by 850
SENSE AND THE SINGLE NEURON: Probing the Physiology of Perception
Parker, A. J., & Newsome, W. T. (1998) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.21.1.227 · Cited by 801
Integration of Proprioceptive and Visual Position-Information: An Experimentally Supported Model
van Beers, R. J., Sittig, A. C., & Gon, J. J. D. V. D. (1999) · Journal of Neurophysiology · doi:10.1152/jn.1999.81.3.1355 · Cited by 742
Neural correlates of multisensory cue integration in macaque MSTd
Gu, Y., Angelaki, D. E., & DeAngelis, G. C. (2008) · Nature Neuroscience · doi:10.1038/nn.2191 · Cited by 554
Self-citationMultisensory Integration of Dynamic Faces and Voices in Rhesus Monkey Auditory Cortex
Ghazanfar, A. A., Maier, J. X., Hoffman, K. L., & Logothetis, N. K. (2005) · Journal of Neuroscience · doi:10.1523/jneurosci.0799-05.2005 · Cited by 531
Visual Modulation of Neurons in Auditory Cortex
Kayser, C., Petkov, C. I., & Logothetis, N. K. (2008) · Cerebral Cortex · doi:10.1093/cercor/bhm187 · Cited by 528
Data Fusion for Sensory Information Processing Systems
Clark, J. J., & Yuille, A. (1990) · Springer eBooks · doi:10.1007/978-1-4757-2076-1 · Cited by 519
Calvert, G. A., Hansen, P. C., Iversen, S. D., & Brammer, M. J. (2001) · NeuroImage · doi:10.1006/nimg.2001.0812 · Cited by 464
Bayesian integration of visual and auditory signals for spatial localization
Battaglia, P., Jacobs, R. A., & Aslin, R. Ν. (2003) · Journal of the Optical Society of America A · doi:10.1364/josaa.20.001391 · Cited by 443
Slant from texture and disparity cues: Optimal cue combination
Hillis, J. M., Watt, S. J., Landy, M. S., & Banks, M. S. (2004) · Journal of Vision · doi:10.1167/4.12.1 · Cited by 421
Do humans optimally integrate stereo and texture information for judgments of surface slant?
Knill, D. C., & Saunders, J. A. (2003) · Vision Research · doi:10.1016/s0042-6989(03)00458-9 · Cited by 415
Diederich, A., & Colonius, H. (2004) · Perception & Psychophysics · doi:10.3758/bf03195006 · Cited by 391
Physiological and Anatomical Evidence for Multisensory Interactions in Auditory Cortex
Bizley, J. K., Nodal, F. R., Bajo, V. M., Nelken, I., & King, A. J. (2006) · Cerebral Cortex · doi:10.1093/cercor/bhl128 · Cited by 341
Gu, Y., Watkins, P. V., Angelaki, D. E., & DeAngelis, G. C. (2006) · The Journal of Neuroscience · doi:10.1523/jneurosci.2356-05.2006 · Cited by 316
Self-citationEvaluating the Operations Underlying Multisensory Integration in the Cat Superior Colliculus
Stanford, T. R., Quessy, S., & Stein, B. E. (2005) · The Journal of Neuroscience · doi:10.1523/jneurosci.5095-04.2005 · Cited by 314
Multisensory Integration in the Ventral Intraparietal Area of the Macaque Monkey.
Avillac, M., Ben Hamed, S., & Duhamel, J.-R. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.2646-06.2007 · Cited by 281
MST Neurons Respond to Optic Flow and Translational Movement
Duffy, C. J. (1998) · Journal of Neurophysiology · doi:10.1152/jn.1998.80.4.1816 · Cited by 277
Sugihara, T., Diltz, M. D., Averbeck, B. B., & Romanski, L. M. (2006) · Journal of Neuroscience · doi:10.1523/jneurosci.3550-06.2006 · Cited by 277
Multisensory Integration: Space, Time and Superadditivity
Holmes, N. P., & Spence, C. J. (2005) · Current Biology · doi:10.1016/j.cub.2005.08.058 · Cited by 272
Statistical Criteria in fMRI Studies of Multisensory Integration
Beauchamp, M. S. (2005) · Neuroinformatics · doi:10.1385/ni:3:2:093 · Cited by 234
The contribution of spike threshold to the dichotomy of cortical simple and complex cells
Priebe, N. J., Mechler, F., Carandini, M., & Ferster, D. (2004) · Nature Neuroscience · doi:10.1038/nn1310 · Cited by 217
Bayesian Modelling of Visual Perception
Mamassian, P., Landy, M., & Maloney, L. T. (2002) · Probabilistic Models of the Brain · doi:10.7551/mitpress/5583.003.0005 · Cited by 210
Multisensory Integration in Macaque Visual Cortex Depends on Cue Reliability
Morgan, M. L., DeAngelis, G. C., & Angelaki, D. E. (2008) · Neuron · doi:10.1016/j.neuron.2008.06.024 · Cited by 208
Self-citationLaurienti, P. J., Perrault, T. J., Stanford, T. R., Wallace, M. T., & Stein, B. E. (2005) · Experimental Brain Research · doi:10.1007/s00221-005-2370-2 · Cited by 194
Multisensory Integration Shortens Physiological Response Latencies
Rowland, B. A., Quessy, S., Stanford, T. R., & Stein, B. E. (2007) · Journal of Neuroscience · doi:10.1523/jneurosci.4986-06.2007 · Cited by 191
Takahashi, K., Gu, Y., May, P. J., Newlands, S. D., DeAngelis, G. C., & Angelaki, D. E. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.0817-07.2007 · Cited by 162
Self-citationSchlack, A., Hoffmann, K., & Bremmer, F. (2002) · European Journal of Neuroscience · doi:10.1046/j.1460-9568.2002.02251.x · Cited by 159
Superadditivity in multisensory integration: putting the computation in context
Stanford, T. R., & Stein, B. E. (2007) · Neuroreport · doi:10.1097/wnr.0b013e3280c1e315 · Cited by 156
Using Bayes' Rule to Model Multisensory Enhancement in the Superior Colliculus
Anastasio, T. J., Patton, P. E., & Belkacem-Boussaid, K. (2000) · Neural Computation · doi:10.1162/089976600300015547 · Cited by 151
Heading Representation in MST: Sensory Interactions and Population Encoding
Page, W. K., & Duffy, C. J. (2003) · Journal of Neurophysiology · doi:10.1152/jn.00493.2002 · Cited by 146
Linear Vestibular Self‐Motion Signals in Monkey Medial Superior Temporal Area
Bremmer, F., Kubischik, M., Pekel, M., Lappe, M., & HOFFMANN, K. ‐. (1999) · Annals of the New York Academy of Sciences · doi:10.1111/j.1749-6632.1999.tb09191.x · Cited by 136
Visual-auditory interactions modulate saccade-related activity in monkey superior colliculus
Frens, M. A., & Opstal, A. J. V. (1998) · Brain Research Bulletin · doi:10.1016/s0361-9230(98)00007-0 · Cited by 132
Bimodal Interactions in the Superior Colliculus of the Behaving Cat
Populin, L. C., & Yin, T. C. T. (2002) · Journal of Neuroscience · doi:10.1523/jneurosci.22-07-02826.2002 · Cited by 105
Effects of an auditory signal on visual reaction time.
Bernstein, I. H., Clark, M., & Edelstein, B. A. (1969) · Journal of Experimental Psychology · doi:10.1037/h0027444 · Cited by 103
Neuron-Specific Response Characteristics Predict the Magnitude of Multisensory Integration
Perrault, T. J., Vaughan, J. W., Stein, B. E., & Wallace, M. T. (2003) · Journal of Neurophysiology · doi:10.1152/jn.00494.2003 · Cited by 95
Probabilistic Models of the Brain.
Long, D. M. (2002) · Neurosurgery Quarterly · doi:10.1097/00013414-200212000-00005 · Cited by 67
Rowland, B. A., Stanford, T. R., & Stein, B. E. (2007) · Experimental Brain Research · doi:10.1007/s00221-006-0847-2 · Cited by 66
Krug, K. (2004) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.2003.1415 · Cited by 59
Linear Responses to Stochastic Motion Signals in Area MST
Heuer, H. W., & Britten, K. H. (2007) · Journal of Neurophysiology · doi:10.1152/jn.00083.2007 · Cited by 23
Flagged first, then by citations
Cited by
Sorted by citations
The multifaceted interplay between attention and multisensory integration.
Talsma, D., Senkowski, D., Soto-Faraco, S., & Woldorff, M. G. (2010) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2010.06.008 · Cited by 828
A category-free neural population supports evolving demands during decision-making
Raposo, D. C., Kaufman, M. T., & Churchland, A. K. (2014) · Nature Neuroscience · doi:10.1038/nn.3865 · Cited by 490
Integration of visual motion and locomotion in mouse visual cortex
Saleem, A. B., Ayaz, A., Jeffery, K. J., Harris, K. D., & Carandini, M. (2013) · Nature Neuroscience · doi:10.1038/nn.3567 · Cited by 418
Atzil, S., Gao, W., Fradkin, I., & Barrett, L. F. (2018) · Nature Human Behaviour · doi:10.1038/s41562-018-0384-6 · Cited by 415
Fetsch, C. R., DeAngelis, G. C., & Angelaki, D. E. (2013) · Nature reviews. Neuroscience · doi:10.1038/nrn3503 · Cited by 322
Self-citation
Metadata
- Authors
- Angelaki, D. E., Gu, Y., & DeAngelis, G. C.
- Affiliations
- Washington University in St. Louis (US)
- University of Rochester (US)
- Corresponding author
- Angelaki, Dora E
- Venue
- Current Opinion in Neurobiology
- Publisher
- Elsevier BV
- Published
- 2009-08
- Volume
- 19
- Issue
- 4
- Pages
- 452-458
- ISSN
- 0959-4388 (ISSN-L)
- PMC
- PMC2749464
- OpenAlex
- W2013652395
- Cited by
- 383
- References
- 51
- Citations by year
- 2026: 18 · 2025: 30 · 2024: 26 · 2023: 40 · 2022: 20 · 2021: 20 · 2020: 30 · 2019: 18 · 2018: 18 · 2017: 27 · 2016: 20 · 2015: 20 · 2014: 17 · 2013: 19 · 2012: 25
- FWCI
- 2.88
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- Current Opinion in Neurobiology (publishedVersion)
- PubMed (publishedVersion)
- PubMed Central (acceptedVersion)
- Funders
- National Institutes of Health
- National Eye Institute (R01EY019087, EY-019087, R01EY017866, EY-017866, R01EY016178)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Multisensory perception and integration
- Life Sciences › Neuroscience › Cognitive Neuroscience › Visual perception and processing mechanisms
- Life Sciences › Neuroscience › Neurology › Vestibular and auditory disorders
- Keywords
- multisensory integration, self-motion perception, cue integration, Bayesian inference, cue reliability, sensory weighting, single-cell electrophysiology, psychophysics
- MeSH terms
- Animals, Brain, Models, Neurological, Nerve Net, Synaptic Transmission, Neurons, Sensation, Sensory Thresholds, Neural Networks, Computer
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
