A computational perspective on the neural basis of multisensory spatial representations
The DOI matches its Crossref record; 45 of the 45 references it cites were found in a registry or an index.
Abstract
We argue that current theories of multisensory representations are inconsistent with the existence of a large proportion of multimodal neurons with gain fields and partially shifting receptive fields. Moreover, these theories do not fully resolve the recoding and statistical issues involved in multisensory integration. An alternative theory, which we have recently developed and review here, has important implications for the idea of 'frame of reference' in neural spatial representations. This theory is based on a neural architecture that combines basis functions and attractor dynamics. Basis function units are used to solve the recoding problem, whereas attractor dynamics are used for optimal statistical inferences. This architecture accounts for gain fields and partially shifting receptive fields, which emerge naturally as a result of the network connectivity and dynamics.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“one of the core neural mechanisms underlying PPS representation is the remapping of visual information into body-centered coordinates such as head-centered, limb-centered, or trunk-centered coordinates(Colby 1998; Pouget et al. 2002; Avillac et al. 2005)”
From Neuroanatomical correlates of peripersonal space: bridging the gap between perception, action, emotion and social cognition (2024) · cites this paper as Pouget et al. 2002
In the citing paper
“the capacity of the thalamocortical system to integrate information is probably greatly enhanced by nonlinear switching mechanisms, such as gain modulation or synchronization, that can modify mappings between brain areas dynamically [34,38-40].”
From An information integration theory of consciousness (2004) · cites this paper as [39]
Citations
Cites
Humans integrate visual and haptic information in a statistically optimal fashion
Ernst, M. O., & Banks, M. S. (2002) · Nature · doi:10.1038/415429a · Cited by 4,844
SPACE AND ATTENTION IN PARIETAL CORTEX
Colby, C. L., & Goldberg, M. E. (1999) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.22.1.319 · Cited by 1,710
A hierarchical neural-network model for control and learning of voluntary movement
Kawato, M., Furukawa, K., & Suzuki, R. (1987) · Biological Cybernetics · doi:10.1007/bf00364149 · Cited by 1,573
Forward models: supervised learning with a distal teacher
Jordan, M. I., & Rumelhart, D. E. (1992) · Cognitive Science · doi:10.1207/s15516709cog1603_1 · Cited by 1,451
Perception as Bayesian Inference
(1996) · doi:10.1017/cbo9780511984037 · Cited by 1,425
Encoding of Spatial Location by Posterior Parietal Neurons
Andersen, R. A., Essick, G. K., & Siegel, R. M. (1985) · Science · doi:10.1126/science.4048942 · Cited by 1,402
Zipser, D., & Andersen, R. A. (1988) · Nature · doi:10.1038/331679a0 · Cited by 1,187
The organization of the cortical motor system: new concepts
Rizzolatti, G., Luppino, G., & Matelli, M. (1998) · Electroencephalography and Clinical Neurophysiology · doi:10.1016/s0013-4694(98)00022-4 · Cited by 1,127
Direct visuomotor transformations for reaching
Buneo, C. A., Jarvis, M. R., Batista, A. P., & Andersen, R. A. (2002) · Nature · doi:10.1038/416632a · Cited by 656
Spatial invariance of visual receptive fields in parietal cortex neurons
Duhamel, J.-R., Bremmer, F., Ben Hamed, S., & Graf, W. (1997) · Nature · doi:10.1038/39865 · Cited by 642
Self-citationVisuospatial properties of ventral premotor cortex
Graziano, M. S. A., Hu, X. T., & Gross, C. G. (1997) · Journal of Neurophysiology · doi:10.1152/jn.1997.77.5.2268 · Cited by 603
Multimodal integration for the representation of space in the posterior parietal cortex
Andersen, R. A. (1997) · Philosophical Transactions of the Royal Society of London. Series B: Biological Sciences · doi:10.1098/rstb.1997.0128 · Cited by 515
Neurophysiological aspects of the cerebellar motor control system.
Ito, M. (1970) · PubMed · Cited by 468
Spatial Transformations in the Parietal Cortex Using Basis Functions
Pouget, A., & Sejnowski, T. J. (1997) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.1997.9.2.222 · Cited by 425
Self-citationGaze-centered remapping of remembered visual space in an open-loop pointing task
Henriques, D. Y. P., Klier, E. M., Smith, M. A., Lowy, D., & Crawford, J. D. (1998) · The Journal of Neuroscience · doi:10.1523/jneurosci.18-04-01583.1998 · Cited by 403 · cited 1×
“Recent studies have suggested that reaching motor commands are specified in eye-centred coordinates, regardless of the modalities in which the reaching target is define”
BackgroundReading population codes: a neural implementation of ideal observers
Deneve, S., Latham, P. E., & Pouget, A. (1999) · Nature Neuroscience · doi:10.1038/11205 · Cited by 392
Self-citationComputational approaches to sensorimotor transformations
Pouget, A., & Snyder, L. H. (2000) · Nature Neuroscience · doi:10.1038/81469 · Cited by 357
Self-citationEfficient computation and cue integration with noisy population codes
Deneve, S., Latham, P. E., & Pouget, A. (2001) · Nature Neuroscience · doi:10.1038/90541 · Cited by 351
Self-citationCross–modal links in spatial attention
Driver, J., & Spence, C. (1998) · Philosophical Transactions of the Royal Society of London. Series B: Biological Sciences · doi:10.1098/rstb.1998.0286 · Cited by 308
Transfer of coded information from sensory to motor networks
Salinas, E., & Abbott, L. (1995) · The Journal of Neuroscience · doi:10.1523/jneurosci.15-10-06461.1995 · Cited by 295
Eye-centered, head-centered, and intermediate coding of remembered sound locations in area LIP
Stricanne, B., Andersen, R. A., & Mazzoni, P. (1996) · Journal of Neurophysiology · doi:10.1152/jn.1996.76.3.2071 · Cited by 286
Cognitive Contributions to the Perception of Spatial and Temporal Events
(1999) · Advances in Psychology · doi:10.1016/s0166-4115(99)x8001-0 · Cited by 259
A Theory of How the Brain Might Work
Poggio, T. (1990) · Cold Spring Harbor Symposia on Quantitative Biology · doi:10.1101/sqb.1990.055.01.084 · Cited by 252
Bayesian decision theory and psychophysics
Yuille, A. L., & Bülthoff, H. H. (1996) · Perception as Bayesian Inference · doi:10.1017/cbo9780511984037.006 · Cited by 250
Auditory Spatial Receptive Fields Created by Multiplication
Peña, J. L., & Konishi, M. (2001) · Science · doi:10.1126/science.1059201 · Cited by 222
Statistically Efficient Estimation Using Population Coding
Pouget, A., Zhang, K., Deneve, S., & Latham, P. E. (1998) · Neural Computation · doi:10.1162/089976698300017809 · Cited by 212
Self-citationSensorimotor integration in the primate superior colliculus. I. Motor convergence
Jay, M. F., & Sparks, D. L. (1987) · Journal of Neurophysiology · doi:10.1152/jn.1987.57.1.22 · Cited by 205
Chapter 14 Ventriloquism: A case of crossmodal perceptual grouping
Bertelson, P. (1999) · Advances in Psychology · doi:10.1016/s0166-4115(99)80034-x · Cited by 203
Xing, J., & Andersen, R. A. (2000) · Journal of Cognitive Neuroscience · doi:10.1162/089892900562363 · Cited by 189
Gaze direction controls response gain in primary visual-cortex neurons
Trotter, Y., & Celebrini, S. (1999) · Nature · doi:10.1038/18444 · Cited by 187
Using Bayes' Rule to Model Multisensory Enhancement in the Superior Colliculus
Anastasio, T. J., Patton, P. E., & Belkacem-Boussaid, K. (2000) · Neural Computation · doi:10.1162/089976600300015547 · Cited by 151
Multisensory spatial representations in eye-centered coordinates for reaching
Pouget, A., Ducom, J. C., Torri, J., & Bavelier, D. (2002) · Cognition · doi:10.1016/s0010-0277(01)00163-9 · Cited by 151
Self-citationEffects of gaze on apparent visual responses of frontal cortex neurons
Boussaoud, D., Barth, T. M., & Wise, S. P. (1993) · Experimental Brain Research · doi:10.1007/bf00229358 · Cited by 144
Reaches to Sounds Encoded in an Eye-Centered Reference Frame
Cohen, Y. E., & Andersen, R. A. (2000) · Neuron · doi:10.1016/s0896-6273(00)00073-8 · Cited by 143
Burnod, Y., Grandguillaume, P., Otto, I., Ferraina, S., Johnson, P., & Caminiti, R. (1992) · Journal of Neuroscience · doi:10.1523/jneurosci.12-04-01435.1992 · Cited by 132
REVIEW ■ : Multiple Representations of Space in the Brain
Gross, C. G., & Graziano, M. S. A. (1995) · The Neuroscientist · doi:10.1177/107385849500100107 · Cited by 121
Implications of neural networks for how we think about brain function
Robinson, D. A. (1992) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00072563 · Cited by 107
The effect of eye position on auditory lateralization
Lewald, J., & Ehrenstein, W. H. (1996) · Experimental Brain Research · doi:10.1007/bf00227270 · Cited by 106
The non-visual impact of eye orientation on eye-hand coordination
Enright, J. T. (1995) · Vision Research · doi:10.1016/0042-6989(94)00260-s · Cited by 100
Two models for transforming auditory signals from head-centered to eye-centered coordinates
Groh, J. M., & Sparks, D. L. (1992) · Biological Cybernetics · doi:10.1007/bf02414885 · Cited by 93
A Neural Model of Multimodal Adaptive Saccadic Eye Movement Control by Superior Colliculus
Grossberg, S., Roberts, K. J., Aguilar, M., & Bullock, D. H. (1997) · Journal of Neuroscience · doi:10.1523/jneurosci.17-24-09706.1997 · Cited by 92
Experience-dependent integration of texture and motion cues to depth
Jacobs, R. A., & Fine, I. (1999) · Vision Research · doi:10.1016/s0042-6989(99)00120-0 · Cited by 89
A Neural Model of the Cortical Representation of Egocentric Distance
Pouget, A., & B, T. J. S. A. (1994) · Cerebral Cortex · doi:10.1093/cercor/4.3.314 · Cited by 82
Self-citationKnill, D. C. (1998) · Vision Research · doi:10.1016/s0042-6989(97)00415-x · Cited by 74
Carmel, D. P., Shlomo Bentin, A., Liu, C. H., Chaudhuri, A., Lagnado, D. A., & Shanks, D. R. (2002) · Cited by 12
Research works printed but not linked: 2
- Spence, C. & Driver, J. Crossmodal Space and Crossmodal Attention (Oxford Univ. Press, Oxford, UK, in the press).
- Colonius, H. & Diederich, A. in Advances in Neural Information Processing Systems (eds Dietterich, T. G., Becker, S. & Ghahramani, Z.) (in the press).
Cited by
An information integration theory of consciousness
Tononi, G. (2004) · BMC Neuroscience · doi:10.1186/1471-2202-5-42 · Cited by 1,958
“As suggested by the regular finding of neurons showing multimodal responses that change depending on the context [36,37], the capacity of the thalamocortical system to integrate information is probably greatly enhanced by nonlinear switching mechanisms, such as gain modulation or synchronization, that can modify mappi…”
BackgroundMultisensory integration: current issues from the perspective of the single neuron
Stein, B. E., & Stanford, T. R. (2008) · Nature Reviews Neuroscience · doi:10.1038/nrn2331 · Cited by 1,598
Interactions between number and space in parietal cortex
Hubbard, E. M., Piazza, M., Pinel, P., & Dehaene, S. (2005) · Nature Reviews Neuroscience · doi:10.1038/nrn1684 · Cited by 1,247
The log-dynamic brain: how skewed distributions affect network operations
Buzsáki, G., & Mizuseki, K. (2014) · Nature Reviews Neuroscience · doi:10.1038/nrn3687 · Cited by 981
Vestibular System: The Many Facets of a Multimodal Sense
Angelaki, D. E., & Cullen, K. E. (2008) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.31.060407.125555 · Cited by 960
Metadata
- Authors
- Pouget, A., Deneve, S., & Duhamel, J.-R.
- Affiliations
- University of Rochester (US)
- Lyon 1 Université (FR)
- Corresponding author
- Pouget, Alexandre
- Venue
- Nature Reviews Neuroscience
- Published
- 2002-09
- Volume
- 3
- Issue
- 9
- Pages
- 741-747
- ISSN
- 1471-003X (ISSN-L)
- 1471-0048
- OpenAlex
- W1980226967
- Cited by
- 413
- References
- 45
- Citations by year
- 2026: 4 · 2025: 12 · 2024: 12 · 2023: 14 · 2022: 11 · 2021: 17 · 2020: 13 · 2019: 16 · 2018: 23 · 2017: 20 · 2016: 17 · 2015: 28 · 2014: 26 · 2013: 23 · 2012: 16
- FWCI
- 2.59
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Nature reviews. Neuroscience (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Multisensory perception and integration
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural dynamics and brain function
- Life Sciences › Neuroscience › Cognitive Neuroscience › Visual perception and processing mechanisms
- Keywords
- multisensory integration, spatial representation, reference frames, attractor dynamics, statistical inference, network connectivity
- MeSH terms
- Animals, Brain, Eye Movements, Humans, Models, Neurological, Nerve Net, Neural Pathways, Neurons, Orientation, Psychomotor Performance, Sensation, Space Perception, Nonlinear Dynamics
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.