A computational perspective on the neural basis of multisensory spatial representations
The DOI matches its Crossref record; 45 of the 45 references it cites were found in a registry or an index.
Abstract
We argue that current theories of multisensory representations are inconsistent with the existence of a large proportion of multimodal neurons with gain fields and partially shifting receptive fields. Moreover, these theories do not fully resolve the recoding and statistical issues involved in multisensory integration. An alternative theory, which we have recently developed and review here, has important implications for the idea of 'frame of reference' in neural spatial representations. This theory is based on a neural architecture that combines basis functions and attractor dynamics. Basis function units are used to solve the recoding problem, whereas attractor dynamics are used for optimal statistical inferences. This architecture accounts for gain fields and partially shifting receptive fields, which emerge naturally as a result of the network connectivity and dynamics.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“one of the core neural mechanisms underlying PPS representation is the remapping of visual information into body-centered coordinates such as head-centered, limb-centered, or trunk-centered coordinates(Colby 1998; Pouget et al. 2002; Avillac et al. 2005)”
From Neuroanatomical correlates of peripersonal space: bridging the gap between perception, action, emotion and social cognition (2024) · cites this paper as Pouget et al. 2002
In the citing paper
“the capacity of the thalamocortical system to integrate information is probably greatly enhanced by nonlinear switching mechanisms, such as gain modulation or synchronization, that can modify mappings between brain areas dynamically [34,38-40].”
From An information integration theory of consciousness (2004) · cites this paper as [39]
Citations
Cites
Humans integrate visual and haptic information in a statistically optimal fashion
Ernst, M. O., & Banks, M. S. (2002) · Nature · doi:10.1038/415429a · Cited by 4,844
SPACE AND ATTENTION IN PARIETAL CORTEX
Colby, C. L., & Goldberg, M. E. (1999) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.22.1.319 · Cited by 1,710 · cited 1×
“In a variation of this view, the parietal lobe is subdivided into several modules, each of which is also associated with particular motor streams and their corresponding frames of referenc”
BackgroundA hierarchical neural-network model for control and learning of voluntary movement
Kawato, M., Furukawa, K., & Suzuki, R. (1987) · Biological Cybernetics · doi:10.1007/bf00364149 · Cited by 1,573
Forward models: supervised learning with a distal teacher
Jordan, M. I., & Rumelhart, D. E. (1992) · Cognitive Science · doi:10.1207/s15516709cog1603_1 · Cited by 1,451
Perception as Bayesian Inference
(1996) · doi:10.1017/cbo9780511984037 · Cited by 1,425
Encoding of Spatial Location by Posterior Parietal Neurons
Andersen, R. A., Essick, G. K., & Siegel, R. M. (1985) · Science · doi:10.1126/science.4048942 · Cited by 1,402
Zipser, D., & Andersen, R. A. (1988) · Nature · doi:10.1038/331679a0 · Cited by 1,187
The organization of the cortical motor system: new concepts
Rizzolatti, G., Luppino, G., & Matelli, M. (1998) · Electroencephalography and Clinical Neurophysiology · doi:10.1016/s0013-4694(98)00022-4 · Cited by 1,127
Direct visuomotor transformations for reaching
Buneo, C. A., Jarvis, M. R., Batista, A. P., & Andersen, R. A. (2002) · Nature · doi:10.1038/416632a · Cited by 656
Spatial invariance of visual receptive fields in parietal cortex neurons
Duhamel, J.-R., Bremmer, F., Ben Hamed, S., & Graf, W. (1997) · Nature · doi:10.1038/39865 · Cited by 642
Self-citation
Research works printed but not linked: 2
- Spence, C. & Driver, J. Crossmodal Space and Crossmodal Attention (Oxford Univ. Press, Oxford, UK, in the press).
- Colonius, H. & Diederich, A. in Advances in Neural Information Processing Systems (eds Dietterich, T. G., Becker, S. & Ghahramani, Z.) (in the press).
Cited by
Items 201–300 of 412
Maier, A. (2010) · Frontiers in Integrative Neuroscience · doi:10.3389/fnint.2010.00121 · Cited by 30
Temporal stability of reference frames in monkey area V6A during a reaching task in 3D space
Hadjidimitrakis, K., Bertozzi, F., Breveglieri, R., Galletti, C., & Fattori, P. (2016) · Brain Structure and Function · doi:10.1007/s00429-016-1319-5 · Cited by 29
“This timescale is consistent with the predictions of neural network models of reference frame transformations (Zipser and Andersen 1988; Pouget and Snyder 2000; Pouget et al. 2002; Blohm 2012).”
Pathmanathan, J. S., Cromer, J. A., Cullen, K. E., & Waitzman, D. M. (2005) · Experimental Brain Research · doi:10.1007/s00221-005-0105-z · Cited by 23
“Recent theoretical insights suggest that multiple weakly associated neural signals can be combined to generate a more strongly correlated signal (e.g., Pouget et al. 2002 ).”
BackgroundFear-related signals are prioritised in visual, somatosensory and spatial systems
Bertini, C., & Làdavas, E. (2020) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2020.107698 · Cited by 29
Király, L., Shah, N., Abdullah, O., Al‐Ketan, O., & Rowshan, R. (2021) · Biomolecules · doi:10.3390/biom11111703 · Cited by 26
A Neural Network Model for the Acquisition of a Spatial Body Scheme Through Sensorimotor Interaction
Roschin, V. Y., Frolov, A., Burnod, Y., & Maier, M. A. (2011) · Neural Computation · doi:10.1162/neco_a_00138 · Cited by 23
“…et al., 1993; alternatively Cartesian, shoulder centered, or angular space for arm movements, e.g., Ajemian, Bullock, & Grossberg (2000) or left open and undetermined (e.g., the 3D target space is determined by the weighted sum of N basis functions; Pouget & Snyder, 2000; Pouget et al., 2002).”
BackgroundMethodGating Information by Two-State Membrane Potential Fluctuations
Kepecs, Á., & Raghavachari, S. (2007) · Journal of Neurophysiology · doi:10.1152/jn.01242.2006 · Cited by 23
“Gain modulation is recognized as a powerful computational operation for mixing signals ( Pouget et al .”
BackgroundTemporal Cues Influence Space Estimations in Visually Impaired Individuals
Gori, M., Amadeo, M. B., & Campus, C. (2018) · iScience · doi:10.1016/j.isci.2018.07.003 · Cited by 26
Crossmodal Attention Applied: Lessons for and from Driving
Spence, C. J., & Soto‐Faraco, S. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108919951 · Cited by 22
Crossing the Hands Increases Illusory Self-Touch
Pozeg, P., Rognini, G., Salomon, R., & Blanke, O. (2014) · PLoS ONE · doi:10.1371/journal.pone.0094008 · Cited by 25
“Then, in order to localize the touch in the external space, the tactile sensation is integrated with proprioceptive information about the current body position, as well as with the external signals from the visual and auditory system, and mapped into the common, external reference frame [14–16,23,24].”
BackgroundViswanathan, S., Fritz, C., & Grafton, S. T. (2012) · Psychological Science · doi:10.1177/0956797611429802 · Cited by 23
“These results are not explained by imagery, a mechanism widely assumed to account for how hand laterality is identified.”
BackgroundWalle, K. M., Nordvik, J. E., Becker, F., Espeseth, T., Sneve, M. H., & Laeng, B. (2018) · Brain and Behavior · doi:10.1002/brb3.1170 · Cited by 22
Khan, A. Z., Pisella, L., & Blohm, G. (2012) · Cortex · doi:10.1016/j.cortex.2012.12.004 · Cited by 24
“Consistent with current neural network studies (Blohm et al., 2009; Pouget et al., 2002), eye position gain modulations found in PPC (Chang et al., 2009; Chang and Snyder, 2010, 2012) of yet uncombined hand and target signals are the required intermediate processing signatures that produce spatial…”
Renzi, C., Bruns, P., Heise, K.-F., Zimerman, M., Feldheim, J., Hummel, F. C., & Röder, B. (2013) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_00362 · Cited by 21
Deconstructing multisensory enhancement in detection
Pannunzi, M., Pérez-Bellido, A., Pereda-Baños, A., López‐Moliner, J., Deco, G., & Soto‐Faraco, S. (2014) · Journal of Neurophysiology · doi:10.1152/jn.00341.2014 · Cited by 26
Gaze-dependent spatial updating of tactile targets in a localization task
Mueller, S., & Fiehler, K. (2014) · Frontiers in Psychology · doi:10.3389/fpsyg.2014.00066 · Cited by 20
Keith, G. P., DeSouza, J. F. X., Yan, X., Wang, H., & Crawford, J. D. (2009) · Journal of Neuroscience Methods · doi:10.1016/j.jneumeth.2009.03.004 · Cited by 19
Meyer, K. D., & Spratling, M. (2011) · Neural Computation · doi:10.1162/neco_a_00130 · Cited by 23
“2.1 consistently generate 8 nodes with wide, purely visual bell-shaped RFs, and 2 eye-position-only nodes – one with negative slope and one with positive slope.”
BackgroundMethodInfluentialIntegrating Information From Vision and Touch: A Neural Network Modeling Study
Magosso, E. (2010) · IEEE Transactions on Information Technology in Biomedicine · doi:10.1109/titb.2010.2040750 · Cited by 21
“By including recurrent connections between the hidden layers and the input and output maps, the networks were able to perform both coordinate transformations and optimal cue integration with noisy neurons [43], [44].”
BackgroundBertoni, T., Magosso, E., & Serino, A. (2020) · European Journal of Neuroscience · doi:10.1111/ejn.14981 · Cited by 21
Spatial Coding of the Predicted Impact Location of a Looming Object
Neppi-Mòdona, M., Auclair, D., Sirigu, A., & Duhamel, J. (2004) · Current Biology · doi:10.1016/j.cub.2004.06.047 · Cited by 19
Self-citationCuppini, C., Magosso, E., & Ursino, M. (2011) · Frontiers in Psychology · doi:10.3389/fpsyg.2011.00077 · Cited by 22
“A number of these models have been proposed in the literature (Pouget et al., 2002; Anastasio and Patton, 2003; Avillac et al., 2005; Martin et al., 2009) focused on different aspects of multisensory interactions and tied on specific multisensory neural regions.”
BackgroundEye position‐dependent activity in the primary visual area as revealed by fMRI
Andersson, F., Joliot, M., Perchey, G., & Petit, L. (2006) · Human Brain Mapping · doi:10.1002/hbm.20296 · Cited by 18
“Recent reviews of the processes that underlie sensorimotor integration emphasized the influence of gaze coding for the transformations from retinal- to arm-centered reference frame coordinates [Carey, 2003; Desmurget et al., 1998; Pouget et al., 2002].”
Greater benefits of multisensory integration during complex sensorimotor transformations
Buchholz, V. N., Goonetilleke, S. C., Medendorp, W. P., & Corneil, B. D. (2012) · Journal of Neurophysiology · doi:10.1152/jn.01188.2011 · Cited by 23
“This perspective has clear relevance beyond visuotactile behavior (Pouget et al. 2002), given the internal coding of sensory stimuli in different reference frames (e.”
BackgroundSchubert, J. T. W., Badde, S., Röder, B., & Heed, T. (2017) · PLoS ONE · doi:10.1371/journal.pone.0189067 · Cited by 24
The evolution of wetness perception: A comparison of arachnid, insect and human models
Merrick, C., & Filingeri, D. (2019) · Journal of Thermal Biology · doi:10.1016/j.jtherbio.2019.102412 · Cited by 21
The dynamics of multimodal integration: The averaging diffusion model
Turner, B. M., Gao, J., Koenig, S., Palfy, D., & McClelland, J. L. (2017) · Psychonomic Bulletin & Review · doi:10.3758/s13423-017-1255-2 · Cited by 22
“Apparently, the optimal method of assigning weights is to inversely relate them to the reliability of the features, and then combine the weighted representations according to Bayes rule (Fetsch et al., 2011; Pouget et al., 2002; Angelaki et al., 2009b; Battaglia et al., 2003; Angelaki et al., 2009a).”
MethodCortical mechanisms for reach planning
Beurze, S. M. (2004) · Radboud Repository (Radboud University) · Cited by 103
Stimulus value gates multisensory integration
Bean, N. L., Stein, B. E., & Rowland, B. A. (2021) · European Journal of Neuroscience · doi:10.1111/ejn.15167 · Cited by 20
“This posterior distribution is determined by the combination of distributions representing the perceptibility of the individual sensory signals (likelihood) and prior knowledge that common sources generate concordant signals (prior; e.g., Jäkel & Ernst, 2003; Parise & Ernst, 2016; Pouget et al., 2002; Rowland et al.,…”
BackgroundIntegration of spatially opposing cues by a single interneuron guides decision-making in C. elegans
Gat, A., Pechuk, V., Peedikayil‐Kurien, S., Karimi, S., Goldman, G., Sela, S., Lubliner, J., Krieg, M., & Oren‐Suissa, M. (2023) · Cell Reports · doi:10.1016/j.celrep.2023.113075 · Cited by 20
Tagliabue, M., & McIntyre, J. (2013) · PLoS ONE · doi:10.1371/journal.pone.0068438 · Cited by 18
“Both models also assume that the brain can reconstruct missing information from available signals through recurrent neural networks (for review see [18]).”
Acquisition of the Head-Centered Peri-Personal Spatial Representation Found in VIP Neuron
Fuke, S., Ogino, M., & Asada, M. (2009) · IEEE Transactions on Autonomous Mental Development · doi:10.1109/tamd.2009.2031013 · Cited by 19
“Aiming at revealing the above issue, through the process of mutual feedback between hypothesis generation and its verification, here we propose a learning model in which a robot acquires not only the head-centered reference frame, but also the multimodal representation of the face based on the…”
BackgroundThe effects of multisensory targets on saccadic trajectory deviations: eliminating age differences
Campbell, K. L., Al-Aidroos, N., Fatt, R., Pratt, J., & Hasher, L. (2009) · Experimental Brain Research · doi:10.1007/s00221-009-2045-5 · Cited by 20
“Although the precise mechanisms underlying this eVect remain unknown (Colonius and Diederich 2004; Pouget et al. 2002), it is thought that greater activation in the SC in response to bimodal targets leads to inhibition of omnipause neurons in the brainstem”
Multimodal Integration of Visual Place Cells and Grid Cells for Navigation Tasks of a Real Robot
Jauffret, A., Cuperlier, N., Gaussier, P., & Tarroux, P. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-33093-3_14 · Cited by 17
“The task is described as the recoding problem by Pouget and Deneve [23].”
The Body in a Multisensory World
Heed, T., & Röder, B. (2011) · Frontiers in neuroscience · doi:10.1201/b11092-35 · Cited by 22
Motor Activity Improves Temporal Expectancy
Fautrelle, L., Mareschal, D., French, R. M., Addyman, C., & Thomas, E. (2015) · PLoS ONE · doi:10.1371/journal.pone.0119187 · Cited by 16
“It has been suggested that the brain uses a Bayesian framework to integrate multiple sensory cues [54][55][56][57].”
BackgroundCognition in Sensorimotor Control: Interfacing With the Posterior Parietal Cortex
Chivukula, S., Jafari, M., Aflalo, T., Yong, N. A., & Pouratian, N. (2019) · Frontiers in Neuroscience · doi:10.3389/fnins.2019.00140 · Cited by 17
Neuromagnetic signatures of the spatiotemporal transformation for manual pointing
Blohm, G., Alikhanian, H., Gaetz, W. C., Goltz, H. C., DeSouza, J. F. X., Cheyne, D., & Crawford, J. D. (2019) · NeuroImage · doi:10.1016/j.neuroimage.2019.04.074 · Cited by 17
Porter, K. K., & Groh, J. M. (2006) · Progress in brain research · doi:10.1016/s0079-6123(06)55018-6 · Cited by 19
Gain-field modulation mechanism in multimodal networks for spatial perception
Pitti, A., Blanchard, A., Cardinaux, M., & Gaussier, P. (2012) · IEEE-RAS International Conference on Humanoid Robots (Humanoids) · doi:10.1109/humanoids.2012.6651535 · Cited by 20
“Since the synaptic weights follow a power-scale density distribution, the ROC neurons are similar to basis functions, a prerequisite for gain-field modulation; see [5], [13] for a justification proof.”
BackgroundInfluentialTramper, J. J., & Medendorp, W. P. (2015) · Journal of Neurophysiology · doi:10.1152/jn.00576.2015 · Cited by 18
Perrone, J. A. (2018) · Journal of Vision · doi:10.1167/18.4.1 · Cited by 15
Lipinski, J., Sandamirskaya, Y., & Schöner, G. (2009) · Cognitive Neurodynamics · doi:10.1007/s11571-009-9096-y · Cited by 20
“Although the exact neural mechanism of this reference frame transformation process has yet to be identified, different solutions are possible (Pouget et al. 2002, Lipinski et al. 2009).”
BackgroundKeep your head on straight: Facilitating sensori-motor transformations for eye–hand coordination
Tagliabue, M., Arnoux, L., & McIntyre, J. (2013) · Neuroscience · doi:10.1016/j.neuroscience.2013.05.051 · Cited by 16
“While other hypotheses about the reference frames employed by the CNS might explain the data presented here, the notion of multiple internal reference frames tied to different sensory modalities has enjoyed considerable support from recent experiments targeting this specific question (Droulez et al., 1993; Pouget et a…”
InfluentialA neural model of binocular saccade planning and vergence control
Muhammad, W., & Spratling, M. (2015) · Adaptive Behavior · doi:10.1177/1059712315607363 · Cited by 15
“…resolve this issue it is possible to decompose a transformation into multiple steps, and implement each step using a separate basis function network (Pouget et al., 2002).1 However, this has rarely been successful in practice (although exceptions include Chinellato et al., 2011; Meng & Lee, 2008).”
BackgroundMethodInfluentialA Model of Partial Reference Frame Transforms Through Pooling of Gain-Modulated Responses
Meyer, K. D., & Spratling, M. (2012) · Cerebral Cortex · doi:10.1093/cercor/bhs117 · Cited by 14
“In the course of multisensory integration and sensorimotor transformation, these different spatial encodings may require remapping across different frames of reference (Pouget et al. 2002).”
BackgroundHadjidimitrakis, K., Ghodrati, M., Breveglieri, R., Rosa, M. G. P., & Fattori, P. (2020) · The Journal of Comparative Neurology · doi:10.1002/cne.24889 · Cited by 16
Tele-Heri, B., Dobos, K., Harsányi, S., Judit, P., Fenyosi, F., Gesztelyi, R., Móré, C. E., & Zsuga, J. (2021) · Brain Sciences · doi:10.3390/brainsci11081111 · Cited by 22
“These were implicated to enable transformation between distinct coordinate frames, for example from eye to head or to body centered frames [68,69].”
BackgroundTestolin, A., Grazia, M. D. F. D., & Zorzi, M. (2017) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2017.00013 · Cited by 15
“…might shape the emergent neuronal gain fields, and they could similarly be combined with attractor dynamics to simulate optimal statistical inference over multisensory spatial representations (cf. Pouget et al., 2002) and spatial remapping in attention orienting (cf. Casarotti et al., 2012).”
BackgroundNeurocognitive Evidence for Spatial Contributions to Numerical Cognition
Knops, A. (2018) · Elsevier eBooks · doi:10.1016/b978-0-12-811529-9.00011-x · Cited by 14
Setti, W., Engel, I., Cuturi, L. F., Gori, M., & Picinali, L. (2021) · Journal on Multimodal User Interfaces · doi:10.1007/s12193-021-00383-x · Cited by 15
“In this context, it has been argued that vision dominates spatial processing not only for localization but also for memory [36,37,57].”
BackgroundPrivate but not social information validity modulates social conformity bias
Li, L., Li, K. K., & Li, J. (2019) · Human Brain Mapping · doi:10.1002/hbm.24536 · Cited by 15
An Embodied Approach to Cognitive Systems: A Dynamic Neural Field Theory of Spatial Working Memory
Schöner, G., & Spencer, J. P. (2006) · Proceedings of the Annual Meeting of the Cognitive Science Society · Cited by 13
Morrone, M. C., Ross, J., & Burr, D. C. (2010) · Cambridge University Press eBooks · doi:10.1017/cbo9780511750540.005 · Cited by 14
Bernard, J., Canto, D. D., Beraneck, M., McIntyre, J., & Tagliabue, M. (2022) · Frontiers in Integrative Neuroscience · doi:10.3389/fnint.2022.788905 · Cited by 14
“…brain area, the information can be reencoded from the retinal space to the somatosensory space, and vice-versa, thanks to recurrent basis function neural networks (Pouget et al., 2002) which would use the sensory signals relative to the eye-body kinematic chain to “connect” the two sensory spaces.”
How to Compare Two Quantities? A Computational Model of Flutter Discrimination
Verguts, T. (2007) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2007.19.3.409 · Cited by 15
“According to the basis function theory developed by Pouget and colleagues (e.g., Pouget et al., 2002), neurons in the parietal cortex respond to combinations of signal and context input in order to compute appropriate coordinate transformations.”
MethodCross-modal attention modulates tactile subitizing but not tactile numerosity estimation
Tian, Y., & Chen, L. (2018) · Attention Perception & Psychophysics · doi:10.3758/s13414-018-1507-x · Cited by 11
Multisensory coding of self-motion and its contribution to navigation
Mao, D., & Gu, Y. (2025) · Nature reviews. Neuroscience · doi:10.1038/s41583-025-00970-x · Cited by 19
“An alternative hypothesis posits that gain-modulated tuning curves in RSC serve as basis functions that can represent different reference frames by decoding population activity 212,213 , enabling flexibility in behavioural performance according to task demands 214,215 .”
Morfoisse, T., Altamira, G. H., Angelini, L., Clement, G. R., Beraneck, M., McIntyre, J., & Tagliabue, M. (2024) · Journal of Neuroscience · doi:10.1523/jneurosci.2457-20.2023 · Cited by 14
The Effect of Visual Experience on Perceived Haptic Verticality When Tilted in the Roll Plane
Cuturi, L. F., & Gori, M. (2017) · Frontiers in Neuroscience · doi:10.3389/fnins.2017.00687 · Cited by 12
“Moreover, visual experience might have a role in influencing the access to different coordinates systems depending on the sensory modality in use (Pouget et al., 2002).”
BackgroundSpatiotopic perceptual learning mediated by retinotopic processing and attentional remapping
Zhang, E., Zhang, G., & Li, W. (2013) · European Journal of Neuroscience · doi:10.1111/ejn.12379 · Cited by 12
“It is of note that, along the dorsal visual pathway for processing information about stimulus motion and relations, the downstream cortical areas in the parietal lobe are able to represent stimuli in retina-centered, headcentered and object-centered coordinates (Colby & Goldberg, 1999; Andersen & Buneo, 2002; Pouget e…”
BackgroundA moving observer in a three-dimensional world
Glennerster, A. (2016) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.2015.0265 · Cited by 13
“Current models of coordinate transformations in parietal cortex are much more modest, simulating ‘par-tially shifting receptive fields’ [80] or ‘gain fields’ [38] which are two-, not three-dimensional transformations.”
Spatial updating of attention across eye movements: A neuro-computational approachPreprint
Bergelt, J., & Hamker, F. H. (2018) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/440727 · Cited by 15
“Following the concept of coordinate transformation as suggested by Pouget et al. (2002), the gain fields that multiplicatively combine the CD and PC signal are required to be represented – from a computational point of view – in a four-dimensional representation, as computed in Xe FEF .”
BackgroundMethodMixed body- and gaze-centered coding of proprioceptive reach targets after effector movement
Mueller, S., & Fiehler, K. (2016) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2016.04.033 · Cited by 11
“…depending on the direction of gaze have been observed when humans reach to proprioceptive targets (unseen finger) in complete darkness; they reach too far to the left if gaze is directed right of the target and vice versa (Blangero et al., 2005; Jones and Henriques, 2010; Pouget et al., 2002b).”
BackgroundDiverse coordinate frames on sensorimotor areas in visuomotor transformation
Fujiwara, Y., Lee, J., Ishikawa, T., Kakei, S., & Izawa, J. (2017) · Scientific Reports · doi:10.1038/s41598-017-14579-3 · Cited by 10
The breakdown of the Simon effect in cross‐modal contexts: EEG evidence
Castro, L., Soto‐Faraco, S., Fernández, L. M., & Ruzzoli, M. (2018) · European Journal of Neuroscience · doi:10.1111/ejn.13882 · Cited by 11
“However, computing such relevant reference frame involves weighting different sources of spatial information according to task demand and context (see also Kornblum et al., 1990; Pouget et al., 2002).”
BackgroundInfluentialIntegrating Philosophy of Understanding With the Cognitive Sciences
Khalifa, K., Islam, F., Gamboa, J. P., Wilkenfeld, D. A., & Kostić, D. (2022) · Frontiers in Systems Neuroscience · doi:10.3389/fnsys.2022.764708 · Cited by 14
Eye Movements: Illusions in Slow Motion
Ernst, M. O. (2010) · Current Biology · doi:10.1016/j.cub.2010.03.009 · Cited by 10
“There are some first indications from computational neuroscience that probability distributions used for the Bayesian computations — priors, likelihoods — may be implemented in neuronal population codes [13,14].”
Grasping a fruit. Hands do what flavour says
Parma, V., Ghirardello, D., Tirindelli, R., & Castiello, U. (2010) · Appetite · doi:10.1016/j.appet.2010.12.013 · Cited by 13
Six Degrees of Auditory Spatial Separation
Carlile, S., Fox, A., Orchard-Mills, E., Leung, J., & Alais, D. (2016) · Journal of the Association for Research in Otolaryngology · doi:10.1007/s10162-016-0560-1 · Cited by 12
Svenson, O. (2016) · Journal of Cognitive Psychology · doi:10.1080/20445911.2016.1188822 · Cited by 11
“…2014) describe the mechanisms of this process (Fang, Kersten, & Murray, 2008) and the proposition that perception corresponds to unconscious inferential decisions on sensory data was supported by neurophysiological recordings (Friston, 2010; Pouget, Deneve, & Duhamel, 2002; Taillan et al., 2015).”
BackgroundThe case for a notation-independent representation of number
Dehaene, S. (2009) · Behavioral and Brain Sciences · doi:10.1017/s0140525x09990033 · Cited by 10
“Indeed, in parietal cortex, neurons with a joint sensitivity to multiple parameters (e.g., eye position and retinal location) are frequently recorded and are thought to play a compulsory role in transcoding to and from pure representations of each parameter (Pouget et al. 2002).”
BackgroundStability of cross-sensory input to primary somatosensory cortex across experience
Kato, D. D., & Bruno, R. M. (2024) · Neuron · doi:10.1016/j.neuron.2024.10.020 · Cited by 10
“58 To test this hypothesis, we subjected mice ( n = 4) to a passive pairing paradigm in which one auditory stimulus was repeatedly paired with a tactile stimulus over several days (Figure 5A).”
Visuo-tactile predictive mechanisms of peripersonal space
Dijkerman, H. C., & Medendorp, W. P. (2021) · Oxford University Press eBooks · doi:10.1093/oso/9780198851738.003.0005 · Cited by 15
Czajko, S., Vignaud, A., & Eger, E. (2024) · Nature Communications · doi:10.1038/s41467-024-44810-5 · Cited by 8
Implicit mapping of the peripersonal space of a humanoid robot
Antonelli, M., Chinellato, E., & del Pobil, A. P. (2011) · IEEE Symposium on Computational Intelligence, Cognitive Algorithms, Mind, and Brain (CCMB) · doi:10.1109/ccmb.2011.5952119 · Cited by 9
“Basis function networks have been proposed as a computational solution especially suitable for modeling the kind of sensorimotor transformations performed by the posterior parietal cortex [1], [8], [9].”
BackgroundUsing multisensory cues for direction information in teleoperation: More is not always better
Benz, T., & Nitsch, V. (2017) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2017.7989773 · Cited by 10
Sparse Vector Binding on Spiking Neuromorphic Hardware Using Synaptic Delays
Renner, A., Sandamirskaya, Y., Sommer, F. T., & Frady, E. P. (2022) · International Conference on Neuromorphic Systems (ICONS) · doi:10.1145/3546790.3546820 · Cited by 9
“Models that use the full outer product representation, e.g., for coordinate transforms [3, 20, 27] Figure 3: A. Schematic of the network that was implemented on the Loihi chip.”
MethodLearning Posture Invariant Spatial Representations Through Temporal Correlations
Spratling, M. (2009) · IEEE Transactions on Autonomous Mental Development · doi:10.1109/tamd.2009.2038494 · Cited by 10
“Firstly, because the response of a neuron in a basis function network is inversely proportional to the Euclidean distance between the input and the weights of that node, basis function networks require that all the sensory information originates from a single object (Pouget et al., 2002), and hence, unlike the propose…”
BackgroundMethodResultInfluentialMotor-related signals support localization invariance for stable visual perception
Benucci, A. (2022) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1009928 · Cited by 10
“The latter have been proposed in different flavors: in reference to multisensory integration [37,44,45], using gain fields as basis functions for the encoding of the perceptual space [45–47], or without explicit reference frame transformation, using eye position or velocity in retinocentric representation to achieve a…”
MethodFcε- and Fcγ-receptor signaling in diseases
Honda, Z. (2006) · Springer Seminars in Immunopathology · doi:10.1007/s00281-006-0051-2 · Cited by 9
McNorgan, C., & Joanisse, M. F. (2013) · Brain Connectivity · doi:10.1089/brain.2013.0174 · Cited by 9
“Nodes within well-studied areas, such as the visual processing stream, may be further decomposed into smaller networks that may be individually modeled (Meunier et al., 2009b; Pouget et al., 2002).”
Object representation in a gravitational reference frame
Emonds, A. M., Srinath, R., Nielsen, K. J., & Connor, C. E. (2023) · eLife · doi:10.7554/elife.81701 · Cited by 7
Prior expectation of objects in space is dependent on the direction of gaze
Odegaard, B., Beierholm, U., Carpenter, J. M., & Shams, L. B. (2018) · Cognition · doi:10.1016/j.cognition.2018.10.011 · Cited by 8
Axenie, C., & Kurz, D. (2020) · Frontiers in Oncology · doi:10.3389/fonc.2020.01419 · Cited by 8
Attention: beyond neural response increases
Connor, C. E. (2006) · Nature Neuroscience · doi:10.1038/nn0906-1083 · Cited by 7
Accurate planning of manual tracking requires a 3D visuomotor transformation of velocity signals
Leclercq, G., Blohm, G., & Lefèvre, P. (2012) · Journal of Vision · doi:10.1167/12.5.6 · Cited by 9
A role for attentional reorienting during approximate multiplication and division
Katz, C., Hoesterey, H., & Knops, A. (2017) · Journal of Numerical Cognition · doi:10.5964/jnc.v3i2.62 · Cited by 8
“For example, during the planning of eye movements these circuits compute the head-centred position of a given object by adding the activity of neural populations that encode eye-centred coordinates and eye position (Beck et al., 2011; Pouget et al., 2002).”
BackgroundAhmad, H., Setti, W., Campus, C., Capris, E., Facchini, V., Sandini, G., & Gori, M. (2019) · Frontiers in Integrative Neuroscience · doi:10.3389/fnint.2019.00044 · Cited by 8
“Supporting this idea, evidence suggests that eye-centered coordinates are used to align neural representations of space for different sensory modalities in the brain (Jay and Sparks, 1984; Cohen and Andersen, 2002; Pouget et al., 2002; King, 2009).”
BackgroundPitti, A., Quoy, M., Lavandier, C., Boucenna, S., Swaileh, W., & Weidmann, C. (2022) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2022.3168046 · Cited by 10
“Conjunctive cells are neurons that bind mutual information together by gain-modulation [56], [57].”
BackgroundThe Effects of Visual Control and Distance in Modulating Peripersonal Spatial Representation
Renzi, C., Ricciardi, E., Bonino, D., Handjaras, G., Vecchi, T., & Pietrini, P. (2013) · PLoS ONE · doi:10.1371/journal.pone.0059460 · Cited by 8
“, directing an action towards an object or performing a movement to defend ourselves from an approaching object) within a common reference frame [8,9].”
BackgroundNeural Mechanism for Coding Depth from Motion Parallax in Area MT: Gain Modulation or Tuning Shifts?
Xu, Z.-X., & DeAngelis, G. C. (2021) · Journal of Neuroscience · doi:10.1523/jneurosci.1240-21.2021 · Cited by 7
Role of Oculoproprioception in Coding the Locus of Attention
Odoj, B., & Balslev, D. (2015) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_00910 · Cited by 7
“First, populations of gain-field neurons with a retinotopic receptive field scale their activity with the angle of gaze to encode visual location relative to the body and/or the world (Pouget et al., 2002; Andersen & Mountcastle, 1983).”
BackgroundA predictive coding model of gaze shifts and the underlying neurophysiology
Spratling, M. (2017) · Visual Cognition · doi:10.1080/13506285.2017.1336141 · Cited by 7
“…2003; Kim et al., 2005; Latham et al., 2003; Marjanović et al., 1996; Meng & Lee, 2007, 2008; Molina-Vilaplana et al., 2004; Park & Sandberg, 1991; Pouget et al., 2002, 2003; Pouget & Sejnowski, 1994, 1997; Pouget & Snyder, 2000; Salinas & Abbott, 1995; Salinas & Sejnowski, 2001; Schilling et…”
BackgroundMethodInfluentialSelf-motion perception and sequential decision-making: where are we heading?
Jerjian, S. J., Harsch, D. R., & Fetsch, C. R. (2023) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.2022.0333 · Cited by 7
“On the other hand, MSTd neurons lack a common spatial reference frame for visual and vestibular information (they remain eye- and head-centred, respectively) [26], although this may not be a necessity for effective integration [27].”
BackgroundHuman subthalamic nucleus – Automatic auditory change detection as a basis for action selection
Heldmann, M., Münte, T. F., Paracka, L., Beyer, F., Brüggemann, N., Saryyeva, A., Rasche, D., Krauss, J. K., & Tronnier, V. M. (2017) · Neuroscience · doi:10.1016/j.neuroscience.2017.05.008 · Cited by 8
Multisensory Integration for Self-Motion Perception
Hou, H., & Gu, Y. (2020) · Elsevier eBooks · doi:10.1016/b978-0-12-809324-5.23879-0 · Cited by 10
A large-scale neurocomputational model of spatial cognition integrating memory with vision
Burkhardt, M., Bergelt, J., Gönner, L., Dinkelbach, H. Ü., Beuth, F., Schwarz, A., Bičanski, A., Burgess, N., & Hamker, F. H. (2023) · Neural Networks · doi:10.1016/j.neunet.2023.08.034 · Cited by 7
“…and radial basis functions (Figure 4) can perform these coordinate transformations between eye-202 and head-centred reference frames (Pouget & Sejnowski, 1997; Pouget et al., 2002), and diagonal connection patterns for this transformation have recently been observed in Drosophila (Lu et al., 2022).”
Redundant representations are required to disambiguate simultaneously presented complex stimuli
Johnston, W. J., & Freedman, D. J. (2023) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1011327 · Cited by 6
Evolution: The Making of Ediacaran Giants
Xiao, S. (2014) · Current Biology · doi:10.1016/j.cub.2013.12.035 · Cited by 7
Metadata
- Authors
- Pouget, A., Deneve, S., & Duhamel, J.-R.
- Affiliations
- University of Rochester (US)
- Lyon 1 Université (FR)
- Corresponding author
- Pouget, Alexandre
- Venue
- Nature Reviews Neuroscience
- Published
- 2002-09
- Volume
- 3
- Issue
- 9
- Pages
- 741-747
- ISSN
- 1471-003X (ISSN-L)
- 1471-0048
- OpenAlex
- W1980226967
- Cited by
- 413
- References
- 45
- Citations by year
- 2026: 4 · 2025: 12 · 2024: 12 · 2023: 14 · 2022: 11 · 2021: 17 · 2020: 13 · 2019: 16 · 2018: 23 · 2017: 20 · 2016: 17 · 2015: 28 · 2014: 26 · 2013: 23 · 2012: 16
- FWCI
- 2.59
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Nature reviews. Neuroscience (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Multisensory perception and integration
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural dynamics and brain function
- Life Sciences › Neuroscience › Cognitive Neuroscience › Visual perception and processing mechanisms
- Keywords
- multisensory integration, spatial representation, reference frames, attractor dynamics, statistical inference, network connectivity
- MeSH terms
- Animals, Brain, Eye Movements, Humans, Models, Neurological, Nerve Net, Neural Pathways, Neurons, Orientation, Psychomotor Performance, Sensation, Space Perception, Nonlinear Dynamics
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.