A computational perspective on the neural basis of multisensory spatial representations
The DOI matches its Crossref record; 45 of the 45 references it cites were found in a registry or an index.
Abstract
We argue that current theories of multisensory representations are inconsistent with the existence of a large proportion of multimodal neurons with gain fields and partially shifting receptive fields. Moreover, these theories do not fully resolve the recoding and statistical issues involved in multisensory integration. An alternative theory, which we have recently developed and review here, has important implications for the idea of 'frame of reference' in neural spatial representations. This theory is based on a neural architecture that combines basis functions and attractor dynamics. Basis function units are used to solve the recoding problem, whereas attractor dynamics are used for optimal statistical inferences. This architecture accounts for gain fields and partially shifting receptive fields, which emerge naturally as a result of the network connectivity and dynamics.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“one of the core neural mechanisms underlying PPS representation is the remapping of visual information into body-centered coordinates such as head-centered, limb-centered, or trunk-centered coordinates(Colby 1998; Pouget et al. 2002; Avillac et al. 2005)”
From Neuroanatomical correlates of peripersonal space: bridging the gap between perception, action, emotion and social cognition (2024) · cites this paper as Pouget et al. 2002
In the citing paper
“the capacity of the thalamocortical system to integrate information is probably greatly enhanced by nonlinear switching mechanisms, such as gain modulation or synchronization, that can modify mappings between brain areas dynamically [34,38-40].”
From An information integration theory of consciousness (2004) · cites this paper as [39]
Citations
Cites
Humans integrate visual and haptic information in a statistically optimal fashion
Ernst, M. O., & Banks, M. S. (2002) · Nature · doi:10.1038/415429a · Cited by 4,844
SPACE AND ATTENTION IN PARIETAL CORTEX
Colby, C. L., & Goldberg, M. E. (1999) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.22.1.319 · Cited by 1,710 · cited 1×
“In a variation of this view, the parietal lobe is subdivided into several modules, each of which is also associated with particular motor streams and their corresponding frames of referenc”
BackgroundA hierarchical neural-network model for control and learning of voluntary movement
Kawato, M., Furukawa, K., & Suzuki, R. (1987) · Biological Cybernetics · doi:10.1007/bf00364149 · Cited by 1,573
Forward models: supervised learning with a distal teacher
Jordan, M. I., & Rumelhart, D. E. (1992) · Cognitive Science · doi:10.1207/s15516709cog1603_1 · Cited by 1,451
Perception as Bayesian Inference
(1996) · doi:10.1017/cbo9780511984037 · Cited by 1,425
Encoding of Spatial Location by Posterior Parietal Neurons
Andersen, R. A., Essick, G. K., & Siegel, R. M. (1985) · Science · doi:10.1126/science.4048942 · Cited by 1,402
Zipser, D., & Andersen, R. A. (1988) · Nature · doi:10.1038/331679a0 · Cited by 1,187
The organization of the cortical motor system: new concepts
Rizzolatti, G., Luppino, G., & Matelli, M. (1998) · Electroencephalography and Clinical Neurophysiology · doi:10.1016/s0013-4694(98)00022-4 · Cited by 1,127
Direct visuomotor transformations for reaching
Buneo, C. A., Jarvis, M. R., Batista, A. P., & Andersen, R. A. (2002) · Nature · doi:10.1038/416632a · Cited by 656
Spatial invariance of visual receptive fields in parietal cortex neurons
Duhamel, J.-R., Bremmer, F., Ben Hamed, S., & Graf, W. (1997) · Nature · doi:10.1038/39865 · Cited by 642
Self-citation
Research works printed but not linked: 2
- Spence, C. & Driver, J. Crossmodal Space and Crossmodal Attention (Oxford Univ. Press, Oxford, UK, in the press).
- Colonius, H. & Diederich, A. in Advances in Neural Information Processing Systems (eds Dietterich, T. G., Becker, S. & Ghahramani, Z.) (in the press).
Cited by
Items 401–412 of 412
Zhi, Y., Zhao, C., Zhang, Y., Ni, J., Zhang, M., Fan, D., & Kong, Y. (2025) · Biomedicines · doi:10.3390/biomedicines13092241
“Given that stroke lesions typically occur within the central nervous system [27], they are likely to influence pain perception more than pain thresholds.”
Localization of a single tactile stimulus during saccadic eye movements
Matsumiya, K., & Nakashima, N. (2025) · i-Perception · doi:10.1177/20416695251376196
“This fi nding may be explained by the standard theory of multisensory integration, which posits that the perceptual system converts spatial information from all sensory modalities into a retinal reference frame (Pouget, Deneve, et al. 2002; Pouget, Ducom, et al. 2002).”
Bowen, M., Costa, M. B., & Burga, A. L. R. (2025) · Biannual Conference of the Italian SIGCHI Chapter (CHItaly) · doi:10.1145/3750069.3750301
“Although not explicitly manipulated in this study, participants may have relied heavily on visual cues, which provide higher spatial resolution than tactile or auditory input [14].”
Perisaccadic Attentional Updating in Area V4: A Neurocomputational Approach
Bergelt, J., & Hamker, F. H. (2025) · European Journal of Neuroscience · doi:10.1111/ejn.70354
“It is gain modulated by two different eye-position related signals to produce a combined representation of stimuli and eye related signals using radial basis-function maps (RBF; for modeling RBFs please refer to Pouget et al. 2002).”
Sensorimotor integration in the moving spinal cord
Knafo, S. (2015) · theses.fr (ABES) · doi:10.70675/80d97ac7z5404z4577za1d5z1c8381c5051c
“Such non-linear transformations can be approximated using a linear combination of “basis functions” (such as sine and cosine functions in a Fourier transform) as the intermediate layer: this is a called the “basis function approach” (Pouget et al., 2002) .”
The peripersonal space : a space to inter-act
Patané, I. (2018) · theses.fr (ABES) · doi:10.70675/65489b37z5297z4a85z96cczc535ef9ca767 · Cited by 1
Cheviet, A. (2021) · theses.fr (ABES) · doi:10.70675/66ee7d58zb3d6z49fdz8463z9a5b3612db6f
Pennartz, C. M. A., & Engeser, M. (2026) · Consciousness and Cognition · doi:10.1016/j.concog.2026.104077
Modality-dependent bottom-up attention and eye gaze direction affect auditory spatial discrimination
Šebeňa, R., Ahveninen, J., Best, V., Shinn‐Cunningham, B. G., & Kopčo, N. (2026) · Attention Perception & Psychophysics · doi:10.3758/s13414-026-03305-9
“For it to influence auditory processing, the signal must be transformed from its native eye-centered representation back to head-centered coordinates, a process known to involve areas such as the parietal cortex (Cohen & Andersen, 2002; Pouget et al., 2002).”
Neural mechanisms for reducing uncertainty in 3D depth perception
Murphy, A. P. (2015) · University of Birmingham Institutional Research Archive (University of Birmingham)
Metadata
- Authors
- Pouget, A., Deneve, S., & Duhamel, J.-R.
- Affiliations
- University of Rochester (US)
- Lyon 1 Université (FR)
- Corresponding author
- Pouget, Alexandre
- Venue
- Nature Reviews Neuroscience
- Published
- 2002-09
- Volume
- 3
- Issue
- 9
- Pages
- 741-747
- ISSN
- 1471-003X (ISSN-L)
- 1471-0048
- OpenAlex
- W1980226967
- Cited by
- 413
- References
- 45
- Citations by year
- 2026: 4 · 2025: 12 · 2024: 12 · 2023: 14 · 2022: 11 · 2021: 17 · 2020: 13 · 2019: 16 · 2018: 23 · 2017: 20 · 2016: 17 · 2015: 28 · 2014: 26 · 2013: 23 · 2012: 16
- FWCI
- 2.59
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Nature reviews. Neuroscience (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Multisensory perception and integration
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural dynamics and brain function
- Life Sciences › Neuroscience › Cognitive Neuroscience › Visual perception and processing mechanisms
- Keywords
- multisensory integration, spatial representation, reference frames, attractor dynamics, statistical inference, network connectivity
- MeSH terms
- Animals, Brain, Eye Movements, Humans, Models, Neurological, Nerve Net, Neural Pathways, Neurons, Orientation, Psychomotor Performance, Sensation, Space Perception, Nonlinear Dynamics
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.