A computational perspective on the neural basis of multisensory spatial representations
The DOI matches its Crossref record; 45 of the 45 references it cites were found in a registry or an index.
Abstract
We argue that current theories of multisensory representations are inconsistent with the existence of a large proportion of multimodal neurons with gain fields and partially shifting receptive fields. Moreover, these theories do not fully resolve the recoding and statistical issues involved in multisensory integration. An alternative theory, which we have recently developed and review here, has important implications for the idea of 'frame of reference' in neural spatial representations. This theory is based on a neural architecture that combines basis functions and attractor dynamics. Basis function units are used to solve the recoding problem, whereas attractor dynamics are used for optimal statistical inferences. This architecture accounts for gain fields and partially shifting receptive fields, which emerge naturally as a result of the network connectivity and dynamics.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“one of the core neural mechanisms underlying PPS representation is the remapping of visual information into body-centered coordinates such as head-centered, limb-centered, or trunk-centered coordinates(Colby 1998; Pouget et al. 2002; Avillac et al. 2005)”
From Neuroanatomical correlates of peripersonal space: bridging the gap between perception, action, emotion and social cognition (2024) · cites this paper as Pouget et al. 2002
In the citing paper
“the capacity of the thalamocortical system to integrate information is probably greatly enhanced by nonlinear switching mechanisms, such as gain modulation or synchronization, that can modify mappings between brain areas dynamically [34,38-40].”
From An information integration theory of consciousness (2004) · cites this paper as [39]
Citations
Cites
Humans integrate visual and haptic information in a statistically optimal fashion
Ernst, M. O., & Banks, M. S. (2002) · Nature · doi:10.1038/415429a · Cited by 4,844
SPACE AND ATTENTION IN PARIETAL CORTEX
Colby, C. L., & Goldberg, M. E. (1999) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.22.1.319 · Cited by 1,710 · cited 1×
“In a variation of this view, the parietal lobe is subdivided into several modules, each of which is also associated with particular motor streams and their corresponding frames of referenc”
BackgroundA hierarchical neural-network model for control and learning of voluntary movement
Kawato, M., Furukawa, K., & Suzuki, R. (1987) · Biological Cybernetics · doi:10.1007/bf00364149 · Cited by 1,573
Forward models: supervised learning with a distal teacher
Jordan, M. I., & Rumelhart, D. E. (1992) · Cognitive Science · doi:10.1207/s15516709cog1603_1 · Cited by 1,451
Perception as Bayesian Inference
(1996) · doi:10.1017/cbo9780511984037 · Cited by 1,425
Encoding of Spatial Location by Posterior Parietal Neurons
Andersen, R. A., Essick, G. K., & Siegel, R. M. (1985) · Science · doi:10.1126/science.4048942 · Cited by 1,402
Zipser, D., & Andersen, R. A. (1988) · Nature · doi:10.1038/331679a0 · Cited by 1,187
The organization of the cortical motor system: new concepts
Rizzolatti, G., Luppino, G., & Matelli, M. (1998) · Electroencephalography and Clinical Neurophysiology · doi:10.1016/s0013-4694(98)00022-4 · Cited by 1,127
Direct visuomotor transformations for reaching
Buneo, C. A., Jarvis, M. R., Batista, A. P., & Andersen, R. A. (2002) · Nature · doi:10.1038/416632a · Cited by 656
Spatial invariance of visual receptive fields in parietal cortex neurons
Duhamel, J.-R., Bremmer, F., Ben Hamed, S., & Graf, W. (1997) · Nature · doi:10.1038/39865 · Cited by 642
Self-citation
Research works printed but not linked: 2
- Spence, C. & Driver, J. Crossmodal Space and Crossmodal Attention (Oxford Univ. Press, Oxford, UK, in the press).
- Colonius, H. & Diederich, A. in Advances in Neural Information Processing Systems (eds Dietterich, T. G., Becker, S. & Ghahramani, Z.) (in the press).
Cited by
An information integration theory of consciousness
Tononi, G. (2004) · BMC Neuroscience · doi:10.1186/1471-2202-5-42 · Cited by 1,958
“As suggested by the regular finding of neurons showing multimodal responses that change depending on the context [36,37], the capacity of the thalamocortical system to integrate information is probably greatly enhanced by nonlinear switching mechanisms, such as gain modulation or synchronization, that can modify mappi…”
BackgroundMultisensory integration: current issues from the perspective of the single neuron
Stein, B. E., & Stanford, T. R. (2008) · Nature Reviews Neuroscience · doi:10.1038/nrn2331 · Cited by 1,598
Interactions between number and space in parietal cortex
Hubbard, E. M., Piazza, M., Pinel, P., & Dehaene, S. (2005) · Nature Reviews Neuroscience · doi:10.1038/nrn1684 · Cited by 1,247
“First, we predict that shifts of attention along the number line would make use of the same area LIP–VIP neural circuitry that is involved in the development of multisensory, world-centred representations of spac”
MethodThe log-dynamic brain: how skewed distributions affect network operations
Buzsáki, G., & Mizuseki, K. (2014) · Nature Reviews Neuroscience · doi:10.1038/nrn3687 · Cited by 981
Vestibular System: The Many Facets of a Multimodal Sense
Angelaki, D. E., & Cullen, K. E. (2008) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.31.060407.125555 · Cited by 960
Learning and inference in the brain
Friston, K. (2003) · Neural Networks · doi:10.1016/j.neunet.2003.06.005 · Cited by 724
Behavioral, Neural, and Computational Principles of Bodily Self-Consciousness
Blanke, O., Slater, M., & Serino, A. (2015) · Neuron · doi:10.1016/j.neuron.2015.09.029 · Cited by 698
Body schema and body image—Pros and cons
de Vignemont, F. (2010) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2009.09.022 · Cited by 695
“This latter question is at the core of Bayesian models, which provide a set of rules to optimally combine sensory inputs with varying reliabilities (for review, see Mamassian, Landy, & Maloney, 2003; Pouget, Deneve, & Duhamel, 2002).”
Conjunctive input processing drives feature selectivity in hippocampal CA1 neurons
Bittner, K. C., Grienberger, C., Vaidya, S. P., Milstein, A. D., Macklin, J. J., Suh, J., Tonegawa, S., & Magee, J. C. (2015) · Nature Neuroscience · doi:10.1038/nn.4062 · Cited by 540
“Such a nonlinear input interaction would allow the association of internal and external features through a burst-firing related output modulation mechanism that could produce a mixed representation of space and context useful for encoding episodic memory 15,16,22–25 .”
Space in the brain: How the hippocampal formation supports spatial cognition
Hartley, T., Lever, C., Burgess, N., & O'Keefe, J. (2014) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2012.0510 · Cited by 495
“They carry spatial information about stimuli and responses and can, in principle, perform spatial computations linking one with the other [8,9].”
BackgroundReference frames for representing visual and tactile locations in parietal cortex
Avillac, M., Denève, S., Olivier, E., Pouget, A., & Duhamel, J.-R. (2005) · Nature Neuroscience · doi:10.1038/nn1480 · Cited by 464
“In this section, we explored whether these response properties are consistent with a recent model of optimal multisensory integration using recurrent basis function network”
ResultSelf-citationI NFERENCE AND C OMPUTATION WITH P OPULATION C ODES
Pouget, A., Dayan, P., & Zemel, R. S. (2003) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.26.041002.131112 · Cited by 434
“Furthermore, the full, three-dimensional, tuning functions in this scheme have very similar tuning properties to those of parietal cells (Pouget et al. 2002).”
BackgroundSelf-citationIntegration of visual motion and locomotion in mouse visual cortex
Saleem, A. B., Ayaz, A., Jeffery, K. J., Harris, K. D., & Carandini, M. (2013) · Nature Neuroscience · doi:10.1038/nn.3567 · Cited by 418
Recruitment of an Area Involved in Eye Movements During Mental Arithmetic
Knops, A., Thirion, B., Hubbard, E. M., Michel, V., & Dehaene, S. (2009) · Science · doi:10.1126/science.1171599 · Cited by 407
Binocular depth perception and the cerebral cortex
Parker, A. J. (2007) · Nature Reviews Neuroscience · doi:10.1038/nrn2131 · Cited by 402
“The literature on gaze control shows that responses that are only partially correlated with shifts of gaze angle are a suitable basis for an effective visuomotor control signa”
BackgroundHulse, B. K., Haberkern, H., Franconville, R., Turner-Evans, D., Takemura, S.-Y., Wolff, T., Noorman, M., Dreher, M., Dan, C., Parekh, R., et al. (2021) · eLife · doi:10.7554/elife.66039 · Cited by 392
Temporal Complexity and Heterogeneity of Single-Neuron Activity in Premotor and Motor Cortex
Churchland, M. M., & Shenoy, K. V. (2007) · Journal of Neurophysiology · doi:10.1152/jn.00095.2007 · Cited by 356
“Thus generalization error measures how much error increased when generalizing rather than fitting. for the extraction of useful information, even when the activity of individual neurons fails to obey any clear reference frame (Deneve et al. 2001; Pouget et al. 2002).”
BackgroundA revised view of sensory cortical parcellation
Wallace, M. T., Ramachandran, R., & Stein, B. E. (2004) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0305697101 · Cited by 343
Serino, A. (2019) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2019.01.016 · Cited by 304
“(Deneve and Pouget, 2004; Ma et al., 2006; Pouget et al., 2002) proposed an influential computational framework based on neural networks dynamics, consisting of multiple layers ranging from layers coding unisensory inputs in native reference frames to multisensory layers with common references frames.”
Multisensory Processing in Review: from Physiology to Behaviour
Alais, D., Newell, F., & Mamassian, P. (2010) · Seeing and Perceiving · doi:10.1163/187847510x488603 · Cited by 324
Numerical representation in the parietal lobes: Abstract or not abstract?
Cohen Kadosh, R., & Walsh, V. (2009) · Behavioral and Brain Sciences · doi:10.1017/s0140525x09990938 · Cited by 322
Melcher, D., & Colby, C. L. (2008) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2008.09.003 · Cited by 313
Connecting mirror neurons and forward models
Miall, R. C. (2003) · NeuroReport · doi:10.1097/00001756-200312020-00001 · Cited by 299
Preparatory Activity in Premotor and Motor Cortex Reflects the Speed of the Upcoming Reach
Churchland, M. M., Santhanam, G., & Shenoy, K. V. (2006) · Journal of Neurophysiology · doi:10.1152/jn.00307.2006 · Cited by 299
“The observation of response properties with no clear reference frame is beginning to seem almost the norm (e.g., Mullette-Gillman et al. 2005) rather than the exception (for review, see Pouget et al. 2002).”
BackgroundFilimon, F. (2010) · The Neuroscientist · doi:10.1177/1073858410375468 · Cited by 265
Bodily ownership and self-location: Components of bodily self-consciousness
Serino, A., Alsmith, A., Costantini, M., Mandrigin, A., Tajadura-Jimenez, A., & Lopez, C. (2013) · Consciousness and Cognition · doi:10.1016/j.concog.2013.08.013 · Cited by 259
Multisensory Interaction in Saccadic Reaction Time: A Time-Window-of-Integration Model
Colonius, H., & Diederich, A. (2004) · Journal of Cognitive Neuroscience · doi:10.1162/0898929041502733 · Cited by 254
“Although these models capture many aspects of spatial rules of multisensory integration (for a recent critical review, see Pouget, Deneve, & Duhamel, 2002 ), they do not address the effects of temporal coincidences of crossmodal stimulus sets.”
The Illusion of Owning a Third Arm
Guterstam, A., Petkova, V. I., & Ehrsson, H. H. (2011) · PLoS ONE · doi:10.1371/journal.pone.0017208 · Cited by 253
“This phenomenon is probably best understood in a probabilistic framework of multisensory integration [43–46].”
Background(2011) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780195387247.001.0001 · Cited by 252
Multiple Levels of Representation of Reaching in the Parieto-frontal Network
Battaglia-Mayer, A. (2003) · Cerebral Cortex · doi:10.1093/cercor/13.10.1009 · Cited by 251
Body Schema in Robotics: A Review
Hoffmann, M., Marques, H., Arieta, A., Sumioka, H., Lungarella, M., & Pfeifer, R. (2010) · IEEE Transactions on Autonomous Mental Development · doi:10.1109/tamd.2010.2086454 · Cited by 242
“…higher activation on the left side; the population that has a head-centered reference frame encoding of the stimulus (middle) displays a combination (in fact a multiplication [57]) of the retina-centered stimulus and the eye position, as represented by a high amplitude in the left of the spectrum.”
BackgroundVerstynen, T., & Sabes, P. N. (2011) · Journal of Neuroscience · doi:10.1523/jneurosci.6525-10.2011 · Cited by 230
“Adaptive network: model architecture The network architecture and dynamics largely follow an approach used previously (Deneve et al., 1999, 2001, 2007; Pouget et al., 2002; Latham et al., 2003) and were designed to yield line-attractor dynamics.”
MethodA neural-level model of spatial memory and imagery
Bicanski, A., & Burgess, N. (2018) · eLife · doi:10.7554/elife.33752 · Cited by 230
“, 2014; Alexander and Nitz, 2015; Bicanski and Burgess, 2016), analogous to gainfield neurons found in posterior parietal cortex (Snyder et al., 1998; Salinas and Abbott, 1995; Pouget and Sejnowski, 1997; Pouget et al., 2002) or parieto-occipital areas (Galletti et al.”
BackgroundIntersensory binding across space and time: A tutorial review
Chen, L., & Vroomen, J. (2013) · Attention, Perception, & Psychophysics · doi:10.3758/s13414-013-0475-4 · Cited by 228
Stein, B. E., Stanford, T. R., Ramachandran, R., Perrault, T. J., & Rowland, B. A. (2009) · Experimental Brain Research · doi:10.1007/s00221-009-1880-8 · Cited by 220
“For example, an additive combination of cross-modal inputs in some cases yields a prediction of optimal multisensory integration (Pouget et al. 2002).”
BackgroundBody part-centered and full body-centered peripersonal space representations
Serino, A., Noel, J.-P., Galli, G., Canzoneri, E., Marmaroli, P., Lissek, H., & Blanke, O. (2015) · Scientific Reports · doi:10.1038/srep18603 · Cited by 215
Shared mapping of own and others' bodies in visuotactile bimodal area of monkey parietal cortex
Ishida, H., Nakajima, K., Inase, M., & Murata, A. (2010) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2009.21185 · Cited by 212
“For example, recent findings have suggested a role for bimodal neurons in the VIP in predicting touch sensation for objects close to the body by visual information or visual imagery of touch by somatosensory input, to guide or protect the face and brain (Graziano & Cooke, 2006; Sereno & Huang, 2006; Avillac et al., 20…”
BackgroundMultimodal integration learning of robot behavior using deep neural networks
Noda, K., Arie, H., Suga, Y., & Ogata, T. (2014) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2014.03.003 · Cited by 189
“In cognitive science studies, a sense of agency is known to be a product of the general determination of causality between action and effect, and experimental results suggest that the sense of agency arises when there is temporal contiguity and content consistency between signals related to action and those related to…”
BackgroundVestibular syndrome: A change in internal spatial representation
Borel, L., Lopez, C., Péruch, P., & Lacour, M. (2008) · Neurophysiologie Clinique/Clinical Neurophysiology · doi:10.1016/j.neucli.2008.09.002 · Cited by 188
Brain Circuit for Cognitive Control Is Shared by Task and Language Switching
De Baene, W., Duyck, W., Brass, M., & Carreiras, M. (2015) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_00817 · Cited by 185
Three-Dimensional Transformations for Goal-Directed Action
Crawford, J. D., Henriques, D. Y. P., & Medendorp, W. P. (2011) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-061010-113749 · Cited by 180
“…& Henriques 2008), for pointing to goals inferred from expanding motion patterns (Poljac & van den Berg 2003), or proprioceptive and auditory targets ( Jones & Henriques 2010, Pouget et al. 2002), and for repeated pointing movements to the same remembered target (Sorrento & Henriques 2008).”
BackgroundConsciousness, information integration, and the brain
Tononi, G. (2005) · Progress in Brain Research · doi:10.1016/s0079-6123(05)50009-8 · Cited by 173
“cortical system to integrate information is probably greatly enhanced by non-linear switching mechanisms, such as gain modulation or synchronization, that can modify mappings between brain areas dynamically (Pouget et al., 2002; Tononi et al., 1992).”
BackgroundNeuronal vector coding in spatial cognition
Bicanski, A., & Burgess, N. (2020) · Nature Reviews Neuroscience · doi:10.1038/s41583-020-0336-9 · Cited by 172
Spatiotopic selectivity of BOLD responses to visual motion in human area MT
d'Avossa, G., Tosetti, M., Crespi, S., Biagi, L., Burr, D. C., & Morrone, M. C. (2007) · Nature Neuroscience · doi:10.1038/nn1824 · Cited by 167
“, where the remapping is presumably necessary to integrate sensory input from different mobile sensor platform”
BackgroundThe vestibular system: a spatial reference for bodily self-consciousness.
Pfeiffer, C., Serino, A., & Blanke, O. (2014) · Frontiers in Integrative Neuroscience · doi:10.3389/fnint.2014.00031 · Cited by 165
“For all these reasons, computational models have proposed that VIP plays a critical role in coordinates transformation (Pouget et al., 2002; Avillac et al., 2005) and suggest that this region, together with other portions of the posterior parietal cortex plays a key role in remapping multisensory…”
Bernier, P.-M., & Grafton, S. T. (2010) · Neuron · doi:10.1016/j.neuron.2010.11.002 · Cited by 163
“, 2009), show partially shifting receptive fields, which is indicative of a hybrid form of spatial encoding in which multiple reference frames are expressed (Pouget et al., 2002a).”
BackgroundDevelopmental vision determines the reference frame for the multisensory control of action
Röder, B., Kusmierek, A., Spence, C., & Schicke, T. (2007) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0607158104 · Cited by 162
Combined Activation and Deactivation of Visual Cortex During Tactile Sensory Processing
Merabet, L. B., Swisher, J. D., McMains, S. A., Halko, M. A., Amedi, A., Pascual-Leone, A., & Somers, D. C. (2007) · Journal of Neurophysiology · doi:10.1152/jn.00806.2006 · Cited by 156
“Individual subject maps for each contrast of interest (described in RESULTS) were generated by projecting the volume of significance values resulting from the GLM onto the reconstructed cortical surface mesh (Dale et al. 1999) for each hemisphere in each subject.”
MethodProcessing of Abstract Ordinal Knowledge in the Horizontal Segment of the Intraparietal Sulcus
Fias, W., Lammertyn, J., Caessens, B., & Orban, G. A. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.2076-07.2007 · Cited by 155
“Planned comparisons indicated that the difference between the comparison and the dimming control task was significant for saturation (F(1,16) 4.69; MSE 36.2; p 0.05), tended toward significance for numbers (F(1,16) 4.09; MSE 23.37; p 0.07), and was not significant for letters.”
BackgroundInfluentialPerceptual Learning, Cognition, and Expertise
(2013) · The Psychology of learning and motivation/The psychology of learning and motivation · doi:10.1016/b978-0-12-407237-4.00004-9 · Cited by 190
Denève, S., Duhamel, J.-R., & Pouget, A. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.3985-06.2007 · Cited by 137
“…example concerns only one population code for one scalar variable, but we have shown that a similar approach can be used to combine optimally variables encoded in multiple population codes, as long as these variables are functionally related (Deneve et al., 2001; Pouget et al., 2002; Deneve, 2004).”
MethodSelf-citationUsing a Compound Gain Field to Compute a Reach Plan
Chang, S. W. C., Papadimitriou, C., & Snyder, L. H. (2009) · Neuron · doi:10.1016/j.neuron.2009.11.005 · Cited by 134
“Pouget and colleagues have proposed that a reciprocal neural 750 Neuron 64, 744–755, December 10, 2009 ª2009 Elsevier Inc. network can be used for this task (Pouget and Sejnowski, 1994; Pouget and Snyder, 2000; Pouget et al., 2002; Avillac et al., 2005).”
BackgroundMethodInfluentialMultisensory Causal Inference in the Brain
Kayser, C., & Shams, L. B. (2015) · PLoS Biology · doi:10.1371/journal.pbio.1002075 · Cited by 172
“This approach has provided invaluable insights about various aspects of perceptual multisensory integration [3,4,12,13] and helped to identify the sensory computations likely to be carried out by the underlying neural processes [14,15].”
BackgroundFetsch, C. R., Wang, S., Gu, Y., DeAngelis, G. C., & Angelaki, D. E. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.3553-06.2007 · Cited by 130
“According to this view, intermediate frames may arise naturally when a multimodal brain area makes recurrent connections with unimodal areas that encode space in their native reference frame (Pouget et al., 2002).”
BackgroundMethodResultInfluentialTactile remapping: from coordinate transformation to integration in sensorimotor processing
Heed, T., Buchholz, V. N., Engel, A. K., & Röder, B. (2015) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2015.03.001 · Cited by 127
Reference Frames for Reach Planning in Macaque Dorsal Premotor Cortex
Batista, A. P., Santhanam, G., Yu, B. M., Ryu, S. I., Afshar, A., & Shenoy, K. V. (2007) · Journal of Neurophysiology · doi:10.1152/jn.00421.2006 · Cited by 126
“Furthermore, whereas neurons that employ an extrinsic eye-centered reference frame are well-known to exist (in the retina, lateral geniculate nucleus and primary visual cortex, at very least), the existence of neurons that employ an extrinsic hand-centered reference frame have not been unequivocally demonstrated, nor…”
BackgroundMultisensory contributions to the perception of motion
Soto‐Faraco, S., Kingstone, A. F., & Spence, C. J. (2003) · Neuropsychologia · doi:10.1016/s0028-3932(03)00185-4 · Cited by 143
Idiosyncratic and systematic aspects of spatial representations in the macaque parietal cortex
Chang, S. W. C., & Snyder, L. H. (2010) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0913209107 · Cited by 121
“Although it is true that neural networks can be designed to produce intermediate representations (15, 17, 26), it nonetheless behooves us to ask if intermediate representations might be artifactual.”
BackgroundFactor-Analysis Methods for Higher-Performance Neural Prostheses
Santhanam, G., Yu, B. M., Gilja, V., Ryu, S. I., Afshar, A., Sahani, M., & Shenoy, K. V. (2009) · Journal of Neurophysiology · doi:10.1152/jn.00097.2009 · Cited by 116
Current perspectives and methods in studying neural mechanisms of multisensory interactions
Klemen, J., & Chambers, C. (2011) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2011.04.015 · Cited by 132
The Peri-Saccadic Perception of Objects and Space
Hamker, F. H., Zirnsak, M., Calow, D., & Lappe, M. (2008) · PLoS Computational Biology · doi:10.1371/journal.pcbi.0040031 · Cited by 112
“tuning the response selectivity [15,16].”
Knogler, L. D., Markov, D. A., Dragomir, E. I., Štih, V., & Portugues, R. (2017) · Current Biology · doi:10.1016/j.cub.2017.03.029 · Cited by 109
Battaglia, P. W., & Schrater, P. R. (2007) · Journal of Neuroscience · doi:10.1523/jneurosci.1309-07.2007 · Cited by 108
“Conversely, independent noise corruption, sensory or motor recalibration, and general organizational simplicity may favor separate representations (for review, see Pouget et al., 2002).”
BackgroundMultimodal Integration in Rostral Fastigial Nucleus Provides an Estimate of Body Movement
Brooks, J. X., & Cullen, K. E. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.1937-09.2009 · Cited by 106
“The mechanisms that underlie reference frame transformations are thought to require nonlinear interactions between sensory (e.g., vestibular) and postural (e.g., neck position) signals (for review, see Pouget et al., 2002).”
BackgroundTwo Distinct Dynamic Modes Subtend the Detection of Unexpected Sounds
King, J.-R., Gramfort, A., Schurger, A., Naccache, L., & Dehaene, S. (2014) · PLoS ONE · doi:10.1371/journal.pone.0085791 · Cited by 106
“The two EEG components may thus reflect two different computations: the P300 is thought to index a working memory update, passing relevant information to the next trial [8,17,18], whereas the MMN would reflect a prediction error signal [4,19,20], elicited whenever an incoming stimulus differs from its internally gener…”
BackgroundPlumert, J. M., & Spencer, J. P. (2007) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780195189223.001.0001 · Cited by 122
“Recall that evidence suggests parietal cortex has weakly self-sustaining dynamics (Constantinidis & Steinmetz, 1996; Steinmetz & Constantinidis, 1995) and is involved in reference frame calibration (Pouget et al., 2002).”
BackgroundAudio–visual integration in temporal perception
Wada, Y., Kitagawa, N., & Noguchi, K. (2003) · International Journal of Psychophysiology · doi:10.1016/s0167-8760(03)00128-4 · Cited by 123
Genovesio, A., & Ferraina, S. (2004) · Journal of Neurophysiology · doi:10.1152/jn.00712.2003 · Cited by 100
Spatiotopic coding of BOLD signal in human visual cortex depends on spatial attention
Crespi, S., Biagi, L., d'Avossa, G., Burr, D. C., Tosetti, M., & Morrone, M. C. (2011) · PLoS ONE · doi:10.1371/journal.pone.0021661 · Cited by 89
“The construction of maps of this sort is a non-trivial process, involving combination of retinal-based signals with information about eye position [1,2].”
BackgroundDiverse Spatial Reference Frames of Vestibular Signals in Parietal Cortex
Chen, X., DeAngelis, G. C., & Angelaki, D. E. (2013) · Neuron · doi:10.1016/j.neuron.2013.09.006 · Cited by 94
“studies have proposed that broadly distributed and/or intermediate reference frames may arise naturally when a multimodal brain area makes recurrent connections with unimodal areas that encode space in their native reference frames (Pouget et al., 2002) and that multisensory convergence with different reference frames…”
Eye movements in the wild: Oculomotor control, gaze behavior & frames of reference
Lappi, O. (2016) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2016.06.006 · Cited by 139
Coordinate transformations in object recognition.
Graf, M. (2006) · Psychological Bulletin · doi:10.1037/0033-2909.132.6.920 · Cited by 91
“Moreover, the gain modulation approach also allows partial coordinate transformations (Pouget et al., 2002), so that partial compensation in orientation congruency tasks (Graf et al.”
BackgroundMethodInfluentialA Multimodal Conception of Bodily Awareness
de Vignemont, F. (2014) · Mind · doi:10.1093/mind/fzu089 · Cited by 99
McKyton, A., & Zohary, E. (2007) · Cerebral Cortex · doi:10.1093/cercor/bhl027 · Cited by 88
Soto‐Faraco, S., Spence, C. J., & Kingstone, A. F. (2004) · Cognitive Affective & Behavioral Neuroscience · doi:10.3758/cabn.4.2.208 · Cited by 97
“However, there is now ample evidence that partial remapping in the brain may be more prevalent than one would initially think (e.g., Pouget, Deneve, & Duhamel, 2002 ), both at a cortical (e.g., Cohen & Andersen, 2000; Duhamel, Bremmer, BenHamed, & Graf, 1997) and at a subcortical (Jay & Sparks, 1987) level.”
BackgroundThe implementation of verbal instructions: An fMRI study
Hartstra, E., Kühn, S., Verguts, T., & Brass, M. (2011) · Human Brain Mapping · doi:10.1002/hbm.21152 · Cited by 88
“It is believed to bind information stemming from the sensory, cognitive, and motor domains [Gottlieb, 2007; Pouget et al., 2002].”
BackgroundMeijer, G. T., Mertens, P. E. C., Pennartz, C. M. A., Olcese, U., & Lansink, C. S. (2019) · Progress in Neurobiology · doi:10.1016/j.pneurobio.2019.01.004 · Cited by 87
“…level (Stein and Stanford, 2008), a convergence of theoretical and experimental work led some groups to conceive a population-level, Bayesian framework to interpret how different sensory cues are effectively integrated in association cortices (Pouget et al., 2002; Fetsch et al., 2013) – Box 1.”
Allocentric Spatial Referencing of Neuronal Activity in Macaque Posterior Cingulate Cortex
Dean, H. L., & Platt, M. L. (2006) · The Journal of Neuroscience · doi:10.1523/jneurosci.2497-05.2006 · Cited by 86
“An alternative theory suggests that parietal neurons may encode spatial information in several different reference frames by combining visual and eye-or body-position signals in a series of basis functions (Pouget et al., 2002).”
BackgroundA modular theory of multisensory integration for motor control
Tagliabue, M., & McIntyre, J. (2014) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2014.00001 · Cited by 95
“Yet the implication of visual representations in purely kines-thetic tasks is known to occur (Pouget et al., 2002b; Sober and Sabes, 2005; Sarlegna and Sainburg, 2007; McGuire and Sabes, 2009; Jones and Henriques, 2010).”
InfluentialCrossmodal integration for perception and action
Lalanne, C., & Lorenceau, J. (2004) · Journal of Physiology-Paris · doi:10.1016/j.jphysparis.2004.06.001 · Cited by 102
“The use of prior probability distributions in computing maximum-likelihood estimation through population codes has received much attention in recent computational models [21,79,80], which provide valuable explanations of the way perceptual system could perform crossmodal integration.”
Tamè, L., Azañón, E., & Longo, M. R. (2019) · Frontiers in Psychology · doi:10.3389/fpsyg.2019.00291 · Cited by 94
Visuospatial coding as ubiquitous scaffolding for human cognition
Groen, I. I. A., Dekker, T. M., Knapen, T. H. J., & Silson, E. H. (2021) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2021.10.011 · Cited by 101
“These gain-field mechanisms are thought to subserve attention’s influence on visual-spatial processing [83–85], providing a parsimonious mechanism for implementing goal-directed actions in the world while remaining fundamentally grounded in the visusospatial reference frame.”
BackgroundWhat Does Theoretical Neuroscience Have to Offer the Study of Behavioral Development?
Spencer, J. P., Simmering, V. R., Schutte, A. R., & Schöner, G. (2007) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780195189223.003.0014 · Cited by 91
“Recall that evidence suggests parietal cortex has weakly self-sustaining dynamics (Constantinidis & Steinmetz, 1996; Steinmetz & Constantinidis, 1995) and is involved in reference frame calibration (Pouget et al., 2002).”
BackgroundSerino, A., Canzoneri, E., Marzolla, M., di Pellegrino, G., & Magosso, E. (2015) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2015.00004 · Cited by 82
“Each unisensory area may receive an external spatially localized (tactile or auditory) stimulus: the resulting activation in the area is determined by the neuron RFs joined with the action of lateral synapses.”
BackgroundReference Frames for Reach Planning in Human Parietofrontal Cortex
Beurze, S. M., Toni, I., Pisella, L., & Medendorp, W. P. (2010) · Journal of Neurophysiology · doi:10.1152/jn.01044.2009 · Cited by 94
Feeling form: the neural basis of haptic shape perception
Yau, J. M., Kim, S. S., Thakur, P. H., & Bensmaia, S. J. (2016) · Journal of Neurophysiology · doi:10.1152/jn.00598.2015 · Cited by 82
King, J.-R., & Dehaene, S. (2014) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2013.0204 · Cited by 82
Contributions of dynamic systems theory to cognitive development
Spencer, J. P., Austin, A., & Schutte, A. R. (2012) · Cognitive Development · doi:10.1016/j.cogdev.2012.07.006 · Cited by 95
Noel, J., Blanke, O., & Serino, A. (2018) · Annals of the New York Academy of Sciences · doi:10.1111/nyas.13867 · Cited by 79
Coding of the Reach Vector in Parietal Area 5d
Bremner, L. R., & Andersen, R. A. (2012) · Neuron · doi:10.1016/j.neuron.2012.03.041 · Cited by 88
“This framework has been challenged by theoretical studies showing that such systematic and modular reference frames may not be necessary (Blohm et al., 2009; McGuire and Sabes, 2009; Pouget et al., 2002; Pouget and Snyder, 2000).”
BackgroundRobust self-localisation and navigation based on hippocampal place cells
Strösslin, T., Sheynikhovich, D., Chavarriaga, R., & Gerstner, W. (2005) · Neural Networks · doi:10.1016/j.neunet.2005.08.012 · Cited by 87
“Furthermore, it has been shown that attractor dynamics combined with basis functions can find optimal multisensory integration (Deneve, Latham, & Pouget, 2001; Pouget, Deneve, & Duhamel, 2002 ).”
Spatial constancy mechanisms in motor control
Medendorp, W. P. (2011) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.2010.0089 · Cited by 85
Battaglia‐Mayer, A., Archambault, P. S., & Caminiti, R. (2006) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2005.11.021 · Cited by 97
Ley, P., Bottari, D., Shenoy, B. H., Kekunnaya, R., & Röder, B. (2013) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2013.03.004 · Cited by 74
Using Dynamic Field Theory to extend the embodiment stance toward higher cognition
Sandamirskaya, Y., Zibner, S. K. U., Schneegans, S., & Schöner, G. (2013) · New Ideas in Psychology · doi:10.1016/j.newideapsych.2013.01.002 · Cited by 81
ONLINE LEARNING OF THE BODY SCHEMA
Hersch, M., Sauser, E. L., & Billard, A. (2008) · International Journal of Humanoid Robotics · doi:10.1142/s0219843608001376 · Cited by 79
Contributions of local speech encoding and functional connectivity to audio-visual speech perception
Giordano, B. L., Ince, R. A. A., Groß, J., Panzeri, S., Schyns, P. G., & Kayser, C. (2017) · eLife · doi:10.7554/elife.24763 · Cited by 76
“Several computational candidate mechanisms have been proposed for how multisensory information could be integrated at the level of neural populations (Ohshiro et al., 2011; Pouget et al., 2002; van Atteveldt et al., 2014).”
BackgroundEnvironmental Anchoring of Head Direction in a Computational Model of Retrosplenial Cortex
Bicanski, A., & Burgess, N. (2016) · The Journal of Neuroscience · doi:10.1523/jneurosci.0516-16.2016 · Cited by 72
“…a complex problem and could be addressed in terms of coordinate transforms in parietal cortex (Salinas and Abbott, 1995; Pouget and Sejnowski, 1997; Pouget et al., 2002) or retrosplenial cortex (Burgess et al., 2001a; Byrne et al., 2007, Wilber et al., 2014, Alexander and Nitz, 2015), but specific…”
BackgroundInfluentialLeft to right: Representational biases for numbers and the effect of visuomotor adaptation
Loftus, A. M., Nicholls, M. E. R., Mattingley, J. B., & Bradshaw, J. L. (2007) · Cognition · doi:10.1016/j.cognition.2007.09.007 · Cited by 72
Compte, A., & Wang, X. (2005) · Cerebral Cortex · doi:10.1093/cercor/bhj021 · Cited by 80
“Partial receptive field shifts have also been observed in the context of multimodal integration, and are usually attributed to the convergence of inputs in distinct frames of reference (Deneve et al. , 2001; Pouget et al. , 2002; Xing and Andersen, 2000).”
Background
Metadata
- Authors
- Pouget, A., Deneve, S., & Duhamel, J.-R.
- Affiliations
- University of Rochester (US)
- Lyon 1 Université (FR)
- Corresponding author
- Pouget, Alexandre
- Venue
- Nature Reviews Neuroscience
- Published
- 2002-09
- Volume
- 3
- Issue
- 9
- Pages
- 741-747
- ISSN
- 1471-003X (ISSN-L)
- 1471-0048
- OpenAlex
- W1980226967
- Cited by
- 413
- References
- 45
- Citations by year
- 2026: 4 · 2025: 12 · 2024: 12 · 2023: 14 · 2022: 11 · 2021: 17 · 2020: 13 · 2019: 16 · 2018: 23 · 2017: 20 · 2016: 17 · 2015: 28 · 2014: 26 · 2013: 23 · 2012: 16
- FWCI
- 2.59
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Nature reviews. Neuroscience (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Multisensory perception and integration
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural dynamics and brain function
- Life Sciences › Neuroscience › Cognitive Neuroscience › Visual perception and processing mechanisms
- Keywords
- multisensory integration, spatial representation, reference frames, attractor dynamics, statistical inference, network connectivity
- MeSH terms
- Animals, Brain, Eye Movements, Humans, Models, Neurological, Nerve Net, Neural Pathways, Neurons, Orientation, Psychomotor Performance, Sensation, Space Perception, Nonlinear Dynamics
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.