A computational perspective on the neural basis of multisensory spatial representations
The DOI matches its Crossref record; 45 of the 45 references it cites were found in a registry or an index.
Abstract
We argue that current theories of multisensory representations are inconsistent with the existence of a large proportion of multimodal neurons with gain fields and partially shifting receptive fields. Moreover, these theories do not fully resolve the recoding and statistical issues involved in multisensory integration. An alternative theory, which we have recently developed and review here, has important implications for the idea of 'frame of reference' in neural spatial representations. This theory is based on a neural architecture that combines basis functions and attractor dynamics. Basis function units are used to solve the recoding problem, whereas attractor dynamics are used for optimal statistical inferences. This architecture accounts for gain fields and partially shifting receptive fields, which emerge naturally as a result of the network connectivity and dynamics.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“one of the core neural mechanisms underlying PPS representation is the remapping of visual information into body-centered coordinates such as head-centered, limb-centered, or trunk-centered coordinates(Colby 1998; Pouget et al. 2002; Avillac et al. 2005)”
From Neuroanatomical correlates of peripersonal space: bridging the gap between perception, action, emotion and social cognition (2024) · cites this paper as Pouget et al. 2002
In the citing paper
“the capacity of the thalamocortical system to integrate information is probably greatly enhanced by nonlinear switching mechanisms, such as gain modulation or synchronization, that can modify mappings between brain areas dynamically [34,38-40].”
From An information integration theory of consciousness (2004) · cites this paper as [39]
Citations
Cites
Humans integrate visual and haptic information in a statistically optimal fashion
Ernst, M. O., & Banks, M. S. (2002) · Nature · doi:10.1038/415429a · Cited by 4,844
SPACE AND ATTENTION IN PARIETAL CORTEX
Colby, C. L., & Goldberg, M. E. (1999) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.22.1.319 · Cited by 1,710 · cited 1×
“In a variation of this view, the parietal lobe is subdivided into several modules, each of which is also associated with particular motor streams and their corresponding frames of referenc”
BackgroundA hierarchical neural-network model for control and learning of voluntary movement
Kawato, M., Furukawa, K., & Suzuki, R. (1987) · Biological Cybernetics · doi:10.1007/bf00364149 · Cited by 1,573
Forward models: supervised learning with a distal teacher
Jordan, M. I., & Rumelhart, D. E. (1992) · Cognitive Science · doi:10.1207/s15516709cog1603_1 · Cited by 1,451
Perception as Bayesian Inference
(1996) · doi:10.1017/cbo9780511984037 · Cited by 1,425
Encoding of Spatial Location by Posterior Parietal Neurons
Andersen, R. A., Essick, G. K., & Siegel, R. M. (1985) · Science · doi:10.1126/science.4048942 · Cited by 1,402
Zipser, D., & Andersen, R. A. (1988) · Nature · doi:10.1038/331679a0 · Cited by 1,187
The organization of the cortical motor system: new concepts
Rizzolatti, G., Luppino, G., & Matelli, M. (1998) · Electroencephalography and Clinical Neurophysiology · doi:10.1016/s0013-4694(98)00022-4 · Cited by 1,127
Direct visuomotor transformations for reaching
Buneo, C. A., Jarvis, M. R., Batista, A. P., & Andersen, R. A. (2002) · Nature · doi:10.1038/416632a · Cited by 656
Spatial invariance of visual receptive fields in parietal cortex neurons
Duhamel, J.-R., Bremmer, F., Ben Hamed, S., & Graf, W. (1997) · Nature · doi:10.1038/39865 · Cited by 642
Self-citation
Research works printed but not linked: 2
- Spence, C. & Driver, J. Crossmodal Space and Crossmodal Attention (Oxford Univ. Press, Oxford, UK, in the press).
- Colonius, H. & Diederich, A. in Advances in Neural Information Processing Systems (eds Dietterich, T. G., Becker, S. & Ghahramani, Z.) (in the press).
Cited by
Items 101–200 of 412
Navigation in space – the role of the macaque ventral intraparietal area
Bremmer, F. (2005) · The Journal of Physiology · doi:10.1113/jphysiol.2005.082552 · Cited by 71
Lappi, O., & Mole, C. D. (2018) · Psychological Bulletin · doi:10.1037/bul0000150 · Cited by 83
Sensory integration for reaching
Sabes, P. N. (2011) · Progress in brain research · doi:10.1016/b978-0-444-53752-2.00004-7 · Cited by 71
“For example, the two parallel representations could be implemented by a single neuronal population (Pouget et al., 2002; Xing and Andersen, 2000; Zipser and Andersen, 1988).”
The Fuzziness of the Molecular World and Its Perspectives
Gentili, P. L. (2018) · Molecules · doi:10.3390/molecules23082074 · Cited by 68
“Since sensory modalities are not equally reliable, and their reliability can change with context, multisensory integration involves statistical issues, and it is often assumed to be a Bayesian probabilistic inference [34].”
BackgroundSpatiotopic perceptual maps in humans: evidence from motion adaptation
Turi, M., & Burr, D. C. (2012) · Proceedings of the Royal Society B Biological Sciences · doi:10.1098/rspb.2012.0637 · Cited by 65
Crossmodal integration of object features: Voxel-based correlations in brain-damaged patients
Taylor, K. I., Stamatakis, E. A., & TYLER, L. K. (2009) · Brain · doi:10.1093/brain/awn361 · Cited by 65
“…in individual polysensory neurons (e.g. differences in visual and auditory receptive fields coded for in non-human primate STS; Hikosaka et al., 1988) are exploited to optimize multimodal integration and generate multidirectional sensory predictions (Pouget et al., 2002; Avillac et al., 2005).”
InfluentialFormal models and quantitative measures of multisensory integration: a selective overview
Colonius, H., & Diederich, A. (2020) · European Journal of Neuroscience · doi:10.1111/ejn.13813 · Cited by 63
“This additive version has raised some controversy because, under some modeling assumptions, an additive combination of crossmodal inputs yields a prediction of optimal multisensory integration (Pouget et al. , 2002).”
BackgroundComputational models of spatial updating in peri-saccadic perception
Hamker, F. H., Zirnsak, M., Ziesche, A., & Lappe, M. (2011) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.2010.0229 · Cited by 68
Horstmann, A., & Hoffmann, K. (2005) · Experimental Brain Research · doi:10.1007/s00221-005-0038-6 · Cited by 64
“The above mentioned leads to the assumption that space is most likely represented differently in several (cortical) areas which build this network in the PPC and can be read corresponding to the movement plan and the actual requirements of the task ( Pouget et al. 2002 ).”
BackgroundDecentralized Multisensory Information Integration in Neural Systems
Zhang, W., Chen, A., Rasch, M. J., & Wu, S. (2016) · Journal of Neuroscience · doi:10.1523/jneurosci.0578-15.2016 · Cited by 67
“Reciprocal connections were also considered previously in a modeling study on coordinate transformation (Denève et al., 2001; Pouget et al., 2002; Avillac et al., 2005).”
MethodLearning Multisensory Integration and Coordinate Transformation via Density Estimation
Makin, J. G., Fellows, M. R., & Sabes, P. N. (2013) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1003035 · Cited by 53
“dynamics [27,30,54] ignore prior distributions but more signifi-”
BackgroundEarly visual and auditory processing rely on modality-specific attentional resources
Keitel, C., Maeß, B., Schröger, E., & Müller, M. M. (2012) · NeuroImage · doi:10.1016/j.neuroimage.2012.12.046 · Cited by 61
“Thus, it might be a consequence of processing in higher-order multisensory cortices (Calvert and Thesen, 2004) where stimuli are represented in unified, supramodal reference frames (see e.g. Pouget et al., 2002; Röder et al., 2007).”
BackgroundRubber Hands Feel Touch, but Not in Blind Individuals
Petkova, V. I., Zetterberg, H., & Ehrsson, H. H. (2012) · PLoS ONE · doi:10.1371/journal.pone.0035912 · Cited by 68
Multiple Reference Frames in Cortical Oscillatory Activity during Tactile Remapping for Saccades
Buchholz, V. N., Jensen, O. B., & Medendorp, W. P. (2011) · Journal of Neuroscience · doi:10.1523/jneurosci.3404-11.2011 · Cited by 61
“…connections between unisensory and multisensory cortices, the brain could generate spatially veridical predictions from one sensory modality to another, here encoding tactile targets in visual coordinates, which is consistent with suggestions by recent computational models (Pouget et al., 2002).”
BackgroundResultHow Visual Cortical Organization Is Altered by Ophthalmologic and Neurologic Disorders
Dumoulin, S. O., & Knapen, T. H. J. (2018) · Annual Review of Vision Science · doi:10.1146/annurev-vision-091517-033948 · Cited by 63
Circuits for presaccadic visual remapping
Rao, H. M., Mayo, J. P., & Sommer, M. A. (2016) · Journal of Neurophysiology · doi:10.1152/jn.00182.2016 · Cited by 55
“…focus on the properties of trained networks (White and Snyder 2004; Xing and Andersen 2000), linear and nonlinear computations in spatial updating (Deneve et al. 2007; Pouget et al. 2002; Salinas and Sejnowski 2001), and geometric aspects of remapping (Keith et al. 2010; Keith and Crawford 2008).”
BackgroundBelief Propagation in Networks of Spiking Neurons
Steimer, A., Maass, W., & Douglas, R. (2009) · Neural Computation · doi:10.1162/neco.2009.08-08-837 · Cited by 54
Pezzulo, G., Iodice, P., Ferraina, S., & Kessler, K. (2013) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2013.00800 · Cited by 56
“FIGURE 3 | Putative architecture supporting reaching actions; from Pouget et al. (2002).”
BackgroundInfluentialMcKenzie, S., Keene, C. S., Farovik, A., Bladon, J., Place, R., Komorowski, R., & Eichenbaum, H. (2016) · Neurobiology of Learning and Memory · doi:10.1016/j.nlm.2015.12.008 · Cited by 54
A theoretical framework for CNS arousal
Pfaff, D., & Banavar, J. R. (2007) · BioEssays · doi:10.1002/bies.20611 · Cited by 53
Dynamic Tuning of Tactile Localization to Body Posture
Azañón, E., Stenner, M., Cardini, F., & Haggard, P. (2015) · Current Biology · doi:10.1016/j.cub.2014.12.038 · Cited by 57
“, on a “snapshot” of proprioceptive, visual, tactile and kinaesthetic information at the time of tactile stimulation [24, 25].”
Hulse, B. K., Haberkern, H., Franconville, R., Turner-Evans, D. B., Takemura, S., Wolff, T., Noorman, M., Dreher, M., Dan, C., Parekh, R., et al. (2020) · doi:10.1101/2020.12.08.413955 · Cited by 392
“…selecting actions based on sensory input requires the dynamical transformation of information from sensors on one body part into a reference frame suitable for the activation of muscles on another (Buneo et al., 2002; Huston and Jayaraman, 2011; Huston and Krapp, 2008; Pouget et al., 2002).”
BackgroundEye position affects the perceived location of touch
Harrar, V., & Harris, L. R. (2009) · Experimental Brain Research · doi:10.1007/s00221-009-1884-4 · Cited by 57
“One theory of how multisensory integration of spatial perception is achieved involves mapping all the modalities into a single frame of reference (Pouget et al. 2002).”
BackgroundImplicit Sensorimotor Mapping of the Peripersonal Space by Gazing and Reaching
Chinellato, E., Antonelli, M., Grzyb, B. J., & del Pobil, A. P. (2011) · IEEE Transactions on Autonomous Mental Development · doi:10.1109/tamd.2011.2106781 · Cited by 57
“Basis function networks have been proposed as a computational solution especially suitable for modeling the kind of sensorimotor transformations performed by the posterior parietal cortex [1], [14], [15].”
BackgroundFlexible egocentric and allocentric representations of heading signals in parietal cortex
Chen, X., DeAngelis, G. C., & Angelaki, D. E. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1715625115 · Cited by 52
Spencer, J. P., Simmering, V. R., & Schutte, A. R. (2006) · Journal of Experimental Psychology Human Perception & Performance · doi:10.1037/0096-1523.32.2.473 · Cited by 55
de Vignemont, F. (2023) · Cambridge University Press eBooks · doi:10.1017/9781009209717 · Cited by 57
“This effect can be explained by the fact that all sensory inputs are remapped by default into an externally anchored supramodal reference frame, which can be directly used by the motor system (Pouget et al., 2002).”
BackgroundA Stable Visual World in Primate Primary Visual Cortex
Morris, A. P., & Krekelberg, B. (2019) · Current Biology · doi:10.1016/j.cub.2019.03.069 · Cited by 58
Influence of saccadic adaptation on spatial localization: Comparison of verbal and pointing reports
Bruno, A., & Morrone, M. C. (2007) · Journal of Vision · doi:10.1167/7.5.16 · Cited by 54
Response requirements modulate tactile spatial congruency effects
Gallace, A., Soto‐Faraco, S., Dalton, P., Kreukniet, B., & Spence, C. J. (2008) · Experimental Brain Research · doi:10.1007/s00221-008-1510-x · Cited by 54
“1997; Jay and Sparks 1987) and computational models (Pouget et al. 2002).”
BackgroundVisuotactile Representation of Peripersonal Space: A Neural Network Study
Magosso, E., Zavaglia, M., Serino, A., di Pellegrino, G., & Ursino, M. (2010) · Neural Computation · doi:10.1162/neco.2009.01-08-694 · Cited by 46
“Furthermore, the studies by Pouget and colleagues share some features and aspects with our model, such as the presence of recurrent connections between the unimodal and the multimodal areas, the topological organization of the unimodal layers, the issue of cue integration (Denève et al., 2001; Pouget et al., 2002; Avi…”
BackgroundSkill theory v2.0: dispositions, emulation, and spatial perception
Grush, R. (2007) · Synthese · doi:10.1007/s11229-007-9236-z · Cited by 57
“This theory is not only computationally detailed, but has been neurophysiologically vindicated (see Pouget and Sejnowski 1997, Pouget et al. 2002; see also Eliasmith and Anderson 2003).”
BackgroundMethodMantel, B., Stoffregen, T. A., Campbell, A., & Bardy, B. G. (2015) · PLoS ONE · doi:10.1371/journal.pone.0120025 · Cited by 54
“If the perceiver is stationary relative to the illuminated environment, the gravito-inertial environment or both, then Eqs 1, 1, 4 – 5, 7,10 – 12,13 – 15 are undefined or ineffective.”
Spatial Representation of the Workspace in Blind, Low Vision, and Sighted Human Participants
Nelson, J. S., Kuling, I. A., Gori, M., Postma, A., Brenner, E., & Smeets, J. B. J. (2018) · i-Perception · doi:10.1177/2041669518781877 · Cited by 50
Neurones associated with saccade metrics in the monkey central mesencephalic reticular formation
Cromer, J. A., & Waitzman, D. M. (2005) · The Journal of Physiology · doi:10.1113/jphysiol.2005.096834 · Cited by 45
“A similar schema has been previously proposed showing that an intermediate cell layer could facilitate sensorimotor transformations such as the transition from eye centred to head centred coordinates (Pouget et al. 2002).”
BackgroundSimmering, V. R., Spencer, J. P., & Schöner, G. (2006) · Perception & Psychophysics · doi:10.3758/bf03193363 · Cited by 45
“Although this collection of research has led to a rich empirical understanding of which frames of reference people use in different situations, there has been less emphasis on the processes that give rise to reference frame effects (see Deneve & Pouget, 2003; Mozer & Sitton, 1998; and Pouget, Deneve, & Duhamel, 2002,…”
BackgroundParietal Oscillations Code Nonvisual Reach Targets Relative to Gaze and Body
Buchholz, V. N., Jensen, O. B., & Medendorp, W. P. (2013) · Journal of Neuroscience · doi:10.1523/jneurosci.3208-12.2013 · Cited by 51
“This diversity of tuning properties is thought to support flexible processing in various reference frames (Pouget et al., 2002; Deneve and Pouget, 2004).”
BackgroundResultParietal disruption impairs reflexive spatial attention within and between sensory modalities
Chambers, C., Payne, J. M., & Mattingley, J. B. (2007) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2007.01.001 · Cited by 50
Auditory, tactile, and audiotactile information processing following visual deprivation
Occelli, V., Spence, C., & Zampini, M. (2013) · Psychological Bulletin · doi:10.1037/a0028416 · Cited by 43
Weightlessness alters up/down asymmetries in the perception of self-motion
Saedeleer, C. D., Vidal, M., Липшиц, М. И., Bengoetxea, A., Cebolla, A. M., Berthoz, A., Cheron, G. A., & McIntyre, J. (2013) · Experimental Brain Research · doi:10.1007/s00221-013-3414-7 · Cited by 44
“gravitational cues with redundant information from other sensory signals (Droulez and Darlot 1989; Pouget et al. 2002; Tagliabue and McIntyre 2011).”
BackgroundSpatial Patterns of Persistent Neural Activity Vary with the Behavioral Context of Short-Term Memory
Daie, K., Goldman, M. S., & Aksay, E. R. F. (2015) · Neuron · doi:10.1016/j.neuron.2015.01.006 · Cited by 42
“On a broader level, utilization of multiple modes to generate different input-output relationships also could be applicable to non-memory settings requiring multi-sensory computations (Cullen, 2012; Fetsch et al., 2012; Pouget et al., 2002).”
Humans Use Predictive Gaze Strategies to Target Waypoints for Steering
Tuhkanen, S., Pekkanen, J., Rinkkala, P., Mole, C. D., Wilkie, R. M., & Lappi, O. (2019) · Scientific Reports · doi:10.1038/s41598-019-44723-0 · Cited by 50
The Racer’s Brain – How Domain Expertise is Reflected in the Neural Substrates of Driving
Lappi, O. (2015) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2015.00635 · Cited by 47
Identification and integration of sensory modalities: Neural basis and relation to consciousness
Pennartz, C. M. A. (2009) · Consciousness and Cognition · doi:10.1016/j.concog.2009.03.003 · Cited by 40
Parieto-frontal networks for eye–hand coordination and movements
Battaglia‐Mayer, A., & Caminiti, R. (2018) · Handbook of clinical neurology · doi:10.1016/b978-0-444-63622-5.00026-7 · Cited by 47
Multisensory integration produces an initial response enhancement
Rowland, B. A. (2007) · Frontiers in Integrative Neuroscience · doi:10.3389/neuro.07.004.2007 · Cited by 40
“, 1993), (2) recurrent interactions may be necessary for its expression (Pouget et al., 2002), and (3) receptors with slower time constants may be part of its implementation (Binns and Salt, 1996).”
BackgroundBayesian Filtering in Spiking Neural Networks: Noise, Adaptation, and Multisensory Integration
Bobrowski, O., Meir, R., & Eldar, Y. C. (2008) · Neural Computation · doi:10.1162/neco.2008.01-08-692 · Cited by 45
“While many naturally occurring problems are dynamic in nature, a large fraction of the work to date has focused on static stimuli (Averbeck et al., 2006; Deneve et al., 2001; Ma et al., 2006; Pouget et al., 2002; Pouget, Dayan, & Zemel, 2003; Zemel et al., 1998).”
BackgroundTagliabue, M., & McIntyre, J. (2011) · Journal of Neuroscience · doi:10.1523/jneurosci.0623-10.2011 · Cited by 41
“…when the head was held upright suggests that the functionality of the neural networks responsible for reconstructing the missing information (Pouget et al., 2002a; Avillac et al., 2005) is partially disrupted by the misalignment between gravity and the idiotropic vector (Mit-telstaedt,…”
InfluentialPozeg, P., Galli, G., & Blanke, O. (2015) · Frontiers in Psychology · doi:10.3389/fpsyg.2015.01749 · Cited by 44
On the right (and left) track: Twenty years of progress in studying hemispatial neglect
Buxbaum, L. J. (2005) · Cognitive Neuropsychology · doi:10.1080/02643290500202698 · Cited by 42
Ziesche, A., & Hamker, F. H. (2011) · Journal of Neuroscience · doi:10.1523/jneurosci.3407-11.2011 · Cited by 45
Oscari, F., Secoli, R., Avanzini, F., Rosati, G., & Reinkensmeyer, D. J. (2012) · Experimental Brain Research · doi:10.1007/s00221-012-3144-2 · Cited by 46
The Leabra Cognitive Architecture: How to Play 20 Principles with Nature and Win!
O’Reilly, R. C., Hazy, T. E., & Herd, S. A. (2012) · Cited by 48
A neurobehavioral model of flexible spatial language behaviors.
Lipinski, J., Schneegans, S., Sandamirskaya, Y., Spencer, J. P., & Schöner, G. (2011) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/a0022643 · Cited by 45
Gentili, P. L. (2014) · Journal of Intelligent & Fuzzy Systems · doi:10.3233/ifs-141179 · Cited by 37
“Therefore, it is often assumed that multisensory integration is a Bayesian probabilistic inference [56].”
BackgroundJones, P. R. (2016) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2016.04.006 · Cited by 45
NMDA Receptor Gating of Information Flow through the Striatum In Vivo
Pomata, P. E., Belluscio, M., Riquelme, L. A., & Murer, M. G. (2008) · Journal of Neuroscience · doi:10.1523/jneurosci.4343-08.2008 · Cited by 46
A neural mechanism for coordinate transformation predicts pre-saccadic remapping
Schneegans, S., & Schöner, G. (2012) · Biological Cybernetics · doi:10.1007/s00422-012-0484-8 · Cited by 43
“Pouget and colleagues presented a number of radial basis function models that successfully account for of reference frame transformations with population codes (Pouget and Sejnowski 1997) and provide a mechanism for sensor fusion by bidirectional transformations (Denève et al. 2001; Pouget et al. 2002).”
BackgroundCisek, P. (2006) · Journal of Neurophysiology · doi:10.1152/jn.00857.2006 · Cited by 36
Spatial maps for time and motion
Morrone, M. C., Cicchini, G. M., & Burr, D. C. (2010) · Experimental Brain Research · doi:10.1007/s00221-010-2334-z · Cited by 34
“One inXuential suggestion is that the fusion of the retinal signal with eye position signals is suYcient in principle to generate craniotopic maps, probably acting via eye-position dependent modulation of the neural response, also referred to as “gain Welds” (Zipser and Andersen 1988; Snyder et al. 1998; Pouget et al.…”
Multisensory integration in multiple reference frames in the posterior parietal cortex
Avillac, M., Olivier, E., Den�ve, S., Hamed, S. B., & Duhamel, J. (2004) · Cognitive Processing · doi:10.1007/s10339-004-0021-3 · Cited by 40
“Why should a change in coordinates be only partial, leading to an intermediate representation that is neither eye nor head centered? A tentative answer to this question is provided by a model of optimal multisensory integration that relies on multidirectional sensory prediction and implements important features of cor…”
BackgroundSelf-citationTubaldi, F., Ansuini, C., Tirindelli, R., & Castiello, U. (2008) · PLoS ONE · doi:10.1371/journal.pone.0001795 · Cited by 42
Seeing and ballistic pointing at perisaccadic targets
Morrone, M. C., Ma-Wyatt, A., & Ross, J. (2005) · Journal of Vision · doi:10.1167/5.9.7 · Cited by 38
“Weights given to different maps will depend on how reliable these maps are on viewing conditions (Niemeier et al., 2003; Pouget et al., 2002) and on task demands.”
BackgroundImpact of years of blindness on neural circuits underlying auditory spatial representation
Amadeo, M. B., Campus, C., & Gori, M. (2019) · NeuroImage · doi:10.1016/j.neuroimage.2019.01.073 · Cited by 41
“those required by the spatial bisection task, seem to originate from the spatial alignment of auditory and visual signals in oculocentric (eye-centered) coordinates (Pouget et al., 2002; King, 2009; Jay and Sparks, 1984; Cohen and Andersen, 2002).”
Vercillo, T., Tonelli, A., & Gori, M. (2017) · Cognition · doi:10.1016/j.cognition.2017.10.013 · Cited by 42
Dissociating strategy-dependent and independent components in task preparation
Baene, W. D., & Braß, M. (2014) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2014.04.015 · Cited by 39
Touretzky, D. S., Weisman, W. E., Fuhs, M. C., Skaggs, W. E., Fenton, A. A., & Muller, R. U. (2004) · Hippocampus · doi:10.1002/hipo.20029 · Cited by 30
“Our results are in accord with previous observations that recurrent neural networks can efficiently implement maximum likelihood estimation (Pouget et al., 2002).”
BackgroundResultMultisensory guidance of orienting behavior
Maier, J. X., & Groh, J. M. (2009) · Hearing Research · doi:10.1016/j.heares.2009.05.008 · Cited by 33
“Indeed, computational models of multisensory coordinate transformations show that hybrid spatial representations can be used to provide auditory spatial location in effector-specific reference frames (Pouget and Sejnowski, 1997; Pouget et al., 2002; Xing and Andersen, 2000).”
BackgroundNumerical and Spatial Intuitions: A Role for Posterior Parietal Cortex?
Hubbard, E. M., Piazza, M., Pinel, P., & Dehaene, S. (2009) · The MIT Press eBooks · doi:10.7551/mitpress/9780262012935.003.0201 · Cited by 49
“First, we predict that shifts of attention along the number line make use of the same hLIP-hVIP circuitry that is involved in the development of multisensory, world-centered representations of space (Deneve and Pouget 2004; Pouget et al. 2002).”
BackgroundMethodPathmanathan, J. S., Presnell, R., Cromer, J. A., Cullen, K. E., & Waitzman, D. M. (2005) · Experimental Brain Research · doi:10.1007/s00221-005-0104-0 · Cited by 34
Error-based analysis of optimal tuning functions explains phenomena observed in sensory neurons
Yaeli, S., & Meir, R. (2010) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2010.00130 · Cited by 37
Inferring eye position from populations of lateral intraparietal neurons
Graf, A. B. A., & Andersen, R. A. (2014) · eLife · doi:10.7554/elife.02813 · Cited by 32
“The EPS also plays a role in accurate visually guided movements (Zipser and Andersen, 1988; Salinas and Abbott, 1996; Pouget et al., 2002) and motor learning (Lewis et al.”
BackgroundChinellato, E., & del Pobil, A. P. (2015) · Cognitive systems monographs · doi:10.1007/978-3-319-20303-4 · Cited by 57
Statistically Optimal Cue Integration During Human Spatial Navigation
Newman, P. M., Qi, Y., Mou, W., & McNamara, T. P. (2023) · Psychonomic Bulletin & Review · doi:10.3758/s13423-023-02254-w · Cited by 33
“…et al., 2018; Chen et al., 2019; Deneve et al., 2001; Deneve & Pouget, 2004; Fortenberry et al., 2012; Knill & Pouget, 2004; Ma et al., 2006; Pouget et al., 2002; see Zeng et al., 2020, for an application of neural network models inspired by the Bayesian cue integration framework to robot…”
Conjugate Mixture Models for Clustering Multimodal Data
Khalidov, V., Forbes, F., & Horaud, R. (2010) · Neural Computation · doi:10.1162/neco_a_00074 · Cited by 31
“This includes the issues of how a human detects objects that are both seen and touched (Pouget, Deneve, & Duhamel, 2002; Ernst & Banks, 2002), seen and heard (Anastasio, Patton, & Belkacem-Boussaid, 2000; King, 2004, 2005), or how a human localizes one source of sensory input in a natural…”
A neural implementation of Bayesian inference based on predictive coding
Spratling, M. (2016) · Connection Science · doi:10.1080/09540091.2016.1243655 · Cited by 32
“Still other models can perform both cue integration and function approximation (Deneve et al., 1999, 2001; Latham et al.,2003 ; Pouget et al.,1998 , 2000, 2003, 2002), but fail to calculate the variance of the posterior, are restricted to working with mono-modal Gaussian distributions, and can not…”
BackgroundMethodResultInfluentialConde, T., & Thalmann, D. (2004) · Computer Animation and Virtual Worlds · doi:10.1002/cav.34 · Cited by 30
Distortions of auditory space during rapid head turns
Cooper, J., Carlile, S., & Alais, D. (2008) · Experimental Brain Research · doi:10.1007/s00221-008-1516-4 · Cited by 30
“eye movements) so that it is temporarily out of correspondence with the body-centric or allocentric maps used at higher levels of spatial processing (Pouget et al. 2002).”
Perceptual learning beyond retinotopic reference frame
Zhang, E., & Li, W. (2010) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1003547107 · Cited by 32
“Extraretinotopic processing is not only suited for multisensory integration and sensory-motor control (17, 18) but also related to some essential functions of the visual system, such asmediating spatiotopic temporal integration of visual stimuli and maintaining stable and continuous visual percepts across eye movement…”
BackgroundState Estimation for Early Feedback Responses in Reaching: Intramodal or Multimodal?
Wijdenes, L. O., & Medendorp, W. P. (2017) · Frontiers in Integrative Neuroscience · doi:10.3389/fnint.2017.00038 · Cited by 33
“To arrive at these multimodal reference frames may require time-consuming neural coordinate transformations, although there are also modeling and empirical suggestions that the multilayer networks in the brain allow for automatic remapping of sensory inputs in multiple reference frames (Pouget et al., 2002; Azañón et…”
BackgroundEye-centered visual receptive fields in the ventral intraparietal area
Chen, X., DeAngelis, G. C., & Angelaki, D. E. (2014) · Journal of Neurophysiology · doi:10.1152/jn.00057.2014 · Cited by 28
“VISUAL SIGNALS ARE INTEGRATED with other sensory cues in many cortical areas to construct a more complete representation of space (Avillac et al. 2005; Cohen and Andersen 2002; Fetsch et al. 2007; Maier and Groh 2009; Pouget et al. 2002).”
BackgroundVestibular contributions to high-level sensorimotor functions
Medendorp, W. P., & Selen, L. P. J. (2017) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2017.02.004 · Cited by 43
Warren, W. H. (2008) · Elsevier eBooks · doi:10.1016/b978-012370880-9.00311-x · Cited by 37
Lerousseau, J. P., Parise, C., Ernst, M. O., & van Wassenhove, V. (2022) · Nature Communications · doi:10.1038/s41467-022-29687-6 · Cited by 32
Ziesche, A., & Hamker, F. H. (2014) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2014.00025 · Cited by 34
“The transformation is sketched as XbFEF = XeCD × XePC and the implementation follows the classical basis function map of Pouget et al. (2002), except that it is computed with a time varying input and different equations for the rate coded neurons.”
BackgroundMethodInfluentialMueller, S., & Fiehler, K. (2014) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2014.07.025 · Cited by 33
Blouin, J., Saradjian, A. H., Lebar, N., Guillaume, A., & Mouchnino, L. (2014) · Journal of Neurophysiology · doi:10.1152/jn.00857.2013 · Cited by 34
A Rational Analysis of the Acquisition of Multisensory Representations
Yildirim, I., & Jacobs, R. A. (2011) · Cognitive Science · doi:10.1111/j.1551-6709.2011.01216.x · Cited by 32
Spatiotemporal Properties of Vestibular Responses in Area MSTd
Fetsch, C. R., Rajguru, S. M., Karunaratne, A., Gu, Y., Angelaki, D. E., & DeAngelis, G. C. (2010) · Journal of Neurophysiology · doi:10.1152/jn.91247.2008 · Cited by 25
McClain, K., Tingley, D., Heeger, D. J., & Buzsáki, G. (2019) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1912792116 · Cited by 27
Head and eyes: Looking behavior in 12- to 24-month-old infants
Borjon, J. I., Abney, D. H., Yu, C., & Smith, L. B. (2021) · Journal of Vision · doi:10.1167/jov.21.8.18 · Cited by 25
Spatial coding for action across spatial scales
Fiehler, K., & Karimpur, H. (2022) · Nature Reviews Psychology · doi:10.1038/s44159-022-00140-1 · Cited by 28
The Dorsal Visual System Predicts Future and Remembers Past Eye Position
Morris, A. P., Bremmer, F., & Krekelberg, B. (2016) · Frontiers in Systems Neuroscience · doi:10.3389/fnsys.2016.00009 · Cited by 25
“This representation is thought to provide a basis for goal-directed actions, such as reaching and navigation, as well as multisensory integration (Pouget et al., 2002).”
BackgroundMethodSensory augmentation: integration of an auditory compass signal into human perception of space
Schumann, F., & O’Regan, J. K. (2017) · Scientific Reports · doi:10.1038/srep42197 · Cited by 25
Rusanen, A., & Lappi, O. (2016) · Synthese · doi:10.1007/s11229-016-1101-5 · Cited by 26
“Pouget and Sejnowksi (1997; see also Pouget et al. 2002; Crawford et al. 2011) discuss in more detail how such a representation of space may be based on basis functions, rather than the 3D frames of reference (retinotopic, head centric etc.) that are originally used to define the computational…”
BackgroundZiesche, A., Bergelt, J., Deubel, H., & Hamker, F. H. (2017) · Vision Research · doi:10.1016/j.visres.2017.06.007 · Cited by 24
“We use the concept of basis function networks (Pouget et al., 2002) to combine a retinotopic retinal signal (modeled in a one-dimensional neuron layer Xr) with proprioceptive (modelled in a 1D layer XePC) and corollary discharge (modeled in a 1D layer XeCD) signals.”
Flexible Reference Frames for Grasp Planning in Human Parietofrontal Cortex
Leoné, F. T. M., Monaco, S., Henriques, D. Y. P., Toni, I., & Medendorp, W. P. (2015) · eNeuro · doi:10.1523/eneuro.0008-15.2015 · Cited by 27
“Thus, aIPS appears to code targets in a statistically optimal fashion, favoring coding in the presented sensory reference frame (Pouget et al., 2002).”
BackgroundBasile, G. A., Tatti, E., Bertino, S., Milardi, D., Genovese, G., Bruno, A., Muscatello, M. R. A., Ciurleo, R., Cerasa, A., Quartarone, A., et al. (2024) · Brain Structure and Function · doi:10.1007/s00429-024-02781-9 · Cited by 24
“Consequently, one of the core neural mechanisms underlying PPS representation is the remapping of visual information into body-centered coordinates such as head-centered, limb-centered, or trunk-centered coordinates(Colby 1998; Pouget et al. 2002; Avil-lac et al. 2005).”
BackgroundBiases in hand perception are driven by somatosensory computations, not a distorted hand model
Peviani, V., Miller, L. E., & Medendorp, W. P. (2024) · Current Biology · doi:10.1016/j.cub.2024.04.010 · Cited by 31
Takahashi, C., & Watt, S. J. (2014) · Frontiers in Psychology · doi:10.3389/fpsyg.2014.00109 · Cited by 25
Metadata
- Authors
- Pouget, A., Deneve, S., & Duhamel, J.-R.
- Affiliations
- University of Rochester (US)
- Lyon 1 Université (FR)
- Corresponding author
- Pouget, Alexandre
- Venue
- Nature Reviews Neuroscience
- Published
- 2002-09
- Volume
- 3
- Issue
- 9
- Pages
- 741-747
- ISSN
- 1471-003X (ISSN-L)
- 1471-0048
- OpenAlex
- W1980226967
- Cited by
- 413
- References
- 45
- Citations by year
- 2026: 4 · 2025: 12 · 2024: 12 · 2023: 14 · 2022: 11 · 2021: 17 · 2020: 13 · 2019: 16 · 2018: 23 · 2017: 20 · 2016: 17 · 2015: 28 · 2014: 26 · 2013: 23 · 2012: 16
- FWCI
- 2.59
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Nature reviews. Neuroscience (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Multisensory perception and integration
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural dynamics and brain function
- Life Sciences › Neuroscience › Cognitive Neuroscience › Visual perception and processing mechanisms
- Keywords
- multisensory integration, spatial representation, reference frames, attractor dynamics, statistical inference, network connectivity
- MeSH terms
- Animals, Brain, Eye Movements, Humans, Models, Neurological, Nerve Net, Neural Pathways, Neurons, Orientation, Psychomotor Performance, Sensation, Space Perception, Nonlinear Dynamics
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.