Humans integrate visual and haptic information in a statistically optimal fashion
The DOI matches its Crossref record; 25 of the 25 references it cites were found in a registry or an index.
Abstract
When a person looks at an object while exploring it with their hand, vision and touch both provide information for estimating the properties of the object. Vision frequently dominates the integrated visual-haptic percept, for example when judging size, shape or position, but in some circumstances the percept is clearly affected by haptics. Here we propose that a general principle, which minimizes variance in the final estimate, determines the degree to which vision or haptics dominates. This principle is realized by using maximum-likelihood estimation to combine the inputs. To investigate cue combination quantitatively, we first measured the variances associated with visual and haptic estimation of height. We then used these measurements to construct a maximum-likelihood integrator. This model behaved very similarly to humans in a visual-haptic task. Thus, the nervous system seems to combine visual and haptic information in a fashion that is similar to a maximum-likelihood integrator. Visual dominance occurs when the variance associated with visual estimation is lower than that associated with haptic estimation.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Multimodal integration is believed to follow a general principle; thus, the nervous system weights the information available in each modality in an optimal way (reducing final estimation variance), whereas attention can influence these weights (Alais & Burr, 2004;Ernst & Banks, 2002;v a nB e e r se ta l .,1999).”
From Augmented visual, auditory, haptic, and multimodal feedback in motor learning: A review (2013) · cites this paper as Ernst & Banks, 2002
In the citing paper
“Interestingly, human observers often approach such an 'ideal observer' ([102], but see [103]), inspiring the idea that the human perceptual system may implement (approximate) Bayesian inference [104].”
From How Do Expectations Shape Perception? (2018) · cites this paper as [102]
In the citing paper
“Moreover, the relative weighting of different information sources according to their reliability in this process is suggestive of the deployment of precision expectations which underlie optimal cue combination in a Bayesian scheme [51].”
From Interoceptive inference, emotion, and the embodied self (2013) · cites this paper as [51]
In the citing paper
“In cue integration paradigms, such as the classic visual–haptic study by Ernst and Banks (2002), retrospective model-fitting often justifies Bayesian optimality post hoc, as priors and likelihoods are typically inferred from the behavioral data they purport to explain, rather than derived independently.”
From The myth of the Bayesian brain (2025) · cites this paper as Ernst and Banks 2002
In the citing paper
“Accurate inference requires that more informative cues should be weighted more heavily and, in some cases, this reweighting process can occur instantaneously; for example, we immediately ascribe less weight to a visual cue when it is blurred or degraded51,52.”
From Multimodal cue integration and learning in a neural representation of head direction (2025) · cites this paper as [52]
8 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Immediate perceptual response to intersensory discrepancy.
Welch, R. B., & Warren, D. H. (1980) · Psychological Bulletin · doi:10.1037/0033-2909.88.3.638 · Cited by 1,176 · cited 1×
“Shaded area represents predicted weights expected from within-modality discrimination (a; equation (5)); its height represents predicted errors given the standard errors of the within-modality discrimination.”
BackgroundMeasurement and modeling of depth cue combination: in defense of weak fusion
Landy, M. S., Maloney, L. T., Johnston, E. B., & Young, M. (1995) · Vision Research · doi:10.1016/0042-6989(94)00176-m · Cited by 997
Integration of Proprioceptive and Visual Position-Information: An Experimentally Supported Model
van Beers, R. J., Sittig, A. C., & Gon, J. J. D. V. D. (1999) · Journal of Neurophysiology · doi:10.1152/jn.1999.81.3.1355 · Cited by 742
Vision and Touch: An Experimentally Created Conflict between the Two Senses
Rock, I., & Victor, J. (1964) · Science · doi:10.1126/science.143.3606.594 · Cited by 702
Visual Capture of Touch: Out-of-the-Body Experiences With Rubber Gloves.
Pavani, F., Spence, C., & Driver, J. (2000) · Psychological Science · doi:10.1111/1467-9280.00270 · Cited by 608
Adaptation, after-effect and contrast in the perception of curved lines.
Gibson, J. J. (1933) · Journal of Experimental Psychology · doi:10.1037/h0074626 · Cited by 599
Data Fusion for Sensory Information Processing Systems
Clark, J. J., & Yuille, A. L. (1990) · Springer eBooks · doi:10.1007/978-1-4757-2076-1 · Cited by 525
Visual capture produced by prism spectacles
Hay, J. C., Pick, H. L., & Ikeda, K. (1965) · Psychonomic Science · doi:10.3758/bf03343413 · Cited by 309
Touch can change visual slant perception
Ernst, M. O., Banks, M. S., & Bülthoff, H. H. (2000) · Nature Neuroscience · doi:10.1038/71140 · Cited by 236
Self-citationAuditory Spatial Receptive Fields Created by Multiplication
Peña, J. L., & Konishi, M. (2001) · Science · doi:10.1126/science.1059201 · Cited by 222
Research works printed but not linked: 1
- Tastevin, J. En partant de l’experience d’Aristote. L’Encephale 1, 57–84 (1937).
Cited by
Items 801–900 of 1,044
Kinaesthetic and Cutaneous Contributions to the Perception of Compressibility
Tiest, W. M. B., & Kappers, A. M. L. (2008) · Lecture notes in computer science · doi:10.1007/978-3-540-69057-3_30 · Cited by 59
Stereo and motion information are not independently processed by the visual system
Domini, F., Caudek, C., & Tassinari, H. (2006) · Vision Research · doi:10.1016/j.visres.2005.11.018 · Cited by 62
Visual and Haptic Integration in the Estimation of Softness of Deformable Objects
Cellini, C., Kaim, L. R., & Drewing, K. (2013) · i-Perception · doi:10.1068/i0598 · Cited by 65
What does the illusory-flash look like?
McCormick, D., & Mamassian, P. (2007) · Vision Research · doi:10.1016/j.visres.2007.10.010 · Cited by 64
Audiovisual integration in the human perception of materials
Fujisaki, W., Goda, N., Motoyoshi, I., Komatsu, H., & Nishida, S. (2014) · Journal of Vision · doi:10.1167/14.4.12 · Cited by 70
Probabilistic Encoding of Vocalizations in Macaque Ventral Lateral Prefrontal Cortex
Averbeck, B. B., & Romanski, L. M. (2006) · Journal of Neuroscience · doi:10.1523/jneurosci.3466-06.2006 · Cited by 64
Common Bayesian Models for Common Cognitive Issues
Colas, F., Diard, J., & Bessìère, P. (2010) · Acta Biotheoretica · doi:10.1007/s10441-010-9101-1 · Cited by 66
Stability and change in perception: spatial organization in temporal context
Gepshtein, S., & Kubovy, M. (2004) · Experimental Brain Research · doi:10.1007/s00221-004-2038-3 · Cited by 64
A new heuristic for capturing the complexity of multimodal signals
Smith, C. L., & Evans, C. S. (2013) · Behavioral Ecology and Sociobiology · doi:10.1007/s00265-013-1490-0 · Cited by 59
van Kemenade, B. M., Arikan, B. E., Kircher, T. T. J., & Straube, B. (2016) · Attention Perception & Psychophysics · doi:10.3758/s13414-016-1189-1 · Cited by 62
Vection Latency Is Reduced by Bone-Conducted Vibration and Noisy Galvanic Vestibular Stimulation
Weech, S., & Troje, N. F. (2017) · Multisensory Research · doi:10.1163/22134808-00002545 · Cited by 57
Continuous reports of sensed hand position during sensorimotor adaptation
Tsay, J. S., Parvin, D. E., & Ivry, R. B. (2020) · Journal of Neurophysiology · doi:10.1152/jn.00242.2020 · Cited by 66
Proprioception but not cardiac interoception is related to the rubber hand illusion
Horváth, Á., Ferentzi, E., Bogdány, T., Szolcsányi, T., Witthöft, M., & Köteles, F. G. (2020) · Cortex · doi:10.1016/j.cortex.2020.08.026 · Cited by 64
The interaction between motion and texture in the sense of touch
Ryan, C. P., Bettelani, G. C., Ciotti, S., Parise, C., Moscatelli, A., & Bianchi, M. (2021) · Journal of Neurophysiology · doi:10.1152/jn.00583.2020 · Cited by 68
Wohl, T. R., Criss, C. R., & Grooms, D. R. (2021) · International Journal of Sports Physical Therapy · doi:10.26603/001c.21251 · Cited by 58
Li, L., Xu, H. G., Li, Z., Zhong, B., Lou, Z., & Wang, L. (2024) · Advanced Materials · doi:10.1002/adma.202414054 · Cited by 63
Spencer, R. M. C., & Ivry, R. B. (2012) · Springer eBooks · doi:10.1007/978-94-007-1333-8_52 · Cited by 64
Rapid enhancement of touch from non-informative vision of the hand
Cardini, F., Longo, M. R., Driver, J., & Haggard, P. (2012) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2012.04.020 · Cited by 63
The Role of Stereo Vision in Visual–Vestibular Integration
Butler, J. S., Campos, J. L., Bülthoff, H., & Smith, S. (2011) · Seeing and Perceiving · doi:10.1163/187847511x588070 · Cited by 59
The Role of Visual and Nonvisual Information in the Control of Locomotion.
Wilkie, R. M., & Wann, J. P. (2005) · Journal of Experimental Psychology Human Perception & Performance · doi:10.1037/0096-1523.31.5.901 · Cited by 68
Psychology of auditory perception
Lotto, A. J., & Holt, L. L. (2010) · Wiley Interdisciplinary Reviews Cognitive Science · doi:10.1002/wcs.123 · Cited by 68
How Haptic Size Sensations Improve Distance Perception
Battaglia, P., Kersten, D., & Schrater, P. (2011) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1002080 · Cited by 63
The optimal time window of visual–auditory integration: a reaction time analysis
Colonius, H. (2010) · Frontiers in Integrative Neuroscience · doi:10.3389/fnint.2010.00011 · Cited by 66
The neural underpinnings of an optimal exploitation of social information under uncertainty
Toelch, U., Bach, D. R., & Dolan, R. J. (2013) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nst173 · Cited by 65
Visual feedback distortion in a robotic environment for hand rehabilitation
Brewer, B. R., Klatzky, R. L., & Matsuoka, Y. (2008) · Brain Research Bulletin · doi:10.1016/j.brainresbull.2008.01.006 · Cited by 59
Optimal Sensorimotor Control in Eye Movement Sequences
Munuera, J., Morel, P., Duhamel, J., & Denève, S. (2009) · Journal of Neuroscience · doi:10.1523/jneurosci.1169-08.2009 · Cited by 61
Decentralized Multisensory Information Integration in Neural Systems
Zhang, W., Chen, A., Rasch, M. J., & Wu, S. (2016) · Journal of Neuroscience · doi:10.1523/jneurosci.0578-15.2016 · Cited by 68
Learning control in robot-assisted rehabilitation of motor skills – a review
Zhou, S.-H., Fong, J., Crocher, V., Tan, Y., Oetomo, D., & Mareels, I. (2016) · Journal of Control and Decision · doi:10.1080/23307706.2015.1129295 · Cited by 66
The perceptual and social components of metacognition.
Pescetelli, N., Rees, G. E., & Bahrami, B. (2016) · Journal of Experimental Psychology General · doi:10.1037/xge0000180 · Cited by 75
Aboseria, M., Clemente, F., Engels, L. F., & Cipriani, C. (2018) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2018.2851617 · Cited by 61
Visual–vestibular integration during self-motion perception in younger and older adults.
Ramkhalawansingh, R., Butler, J. S., & Campos, J. L. (2018) · Psychology and Aging · doi:10.1037/pag0000271 · Cited by 58
Multisensory Interactive Technologies for Primary Education: From Science to Technology
Volpe, G., & Gori, M. (2019) · Frontiers in Psychology · doi:10.3389/fpsyg.2019.01076 · Cited by 70
The Undershoot Bias: Learning to Act Optimally Under Uncertainty
Engelbrecht, S. E., Berthier, N. E., & O’Sullivan, L. P. (2003) · Psychological Science · doi:10.1111/1467-9280.03431 · Cited by 62
Alterations of agency in hypnosis: A new predictive coding model.
Martin, J.-R., & Pacherie, E. (2019) · Psychological Review · doi:10.1037/rev0000134 · Cited by 57
Kessler, F., Frankenstein, J., & Rothkopf, C. A. (2024) · Nature Communications · doi:10.1038/s41467-024-49722-y · Cited by 66
Multisensory temporal numerosity judgment
Philippi, T. G., van Erp, J. B. F., & Werkhoven, P. J. (2008) · Brain Research · doi:10.1016/j.brainres.2008.05.056 · Cited by 58
Contribution of visual and proprioceptive information to the precision of reaching movements
Monaco, S., Króliczak, G., Quinlan, D. J., Fattori, P., Galletti, C., Goodale, M. A., & Culham, J. C. (2009) · Experimental Brain Research · doi:10.1007/s00221-009-2106-9 · Cited by 57
Integrating visual cues for motor control: A matter of time
Greenwald, H. S., Knill, D. C., & Saunders, J. A. (2005) · Vision Research · doi:10.1016/j.visres.2005.01.025 · Cited by 61
Compensating for Distance Compression in Audiovisual Virtual Environments Using Incongruence
Finnegan, D. J., O'Neill, E. J., & Proulx, M. J. (2016) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858065 · Cited by 63
Head motion predictability explains activity-dependent suppression of vestibular balance control
Dietrich, H., Heidger, F., Schniepp, R., MacNeilage, P. R., Glasauer, S., & Wuehr, M. (2020) · Scientific Reports · doi:10.1038/s41598-019-57400-z · Cited by 65
Representation of visual uncertainty through neural gain variability
Hénaff, O. J., Boundy-Singer, Z. M., Meding, K., Ziemba, C. M., & Goris, R. L. T. (2020) · Nature Communications · doi:10.1038/s41467-020-15533-0 · Cited by 63
FaceHaptics: Robot Arm based Versatile Facial Haptics for Immersive Environments
Alexander, W., Leschtschow, D., Trepkowski, C., Maiero, J., Kruijff, E., & Riecke, B. E. (2020) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376481 · Cited by 61
Sensory Re-education Today and Tomorrow: A Review of Evolving Concepts
Rosén, B., Balkeniu, C., & Lundborg, G. (2003) · The British Journal of Hand Therapy · doi:10.1177/175899830300800201 · Cited by 60
Human-Robot Collaboration: From Psychology to Social RoboticsPreprint
Bütepage, J., & Kragić, D. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1705.10146 · Cited by 73
Studying the neural representations of uncertainty
Walker, E. Y., Pohl, S., Denison, R. N., Barack, D. L., Lee, J., Block, N., Ma, W. J., & Meyniel, F. (2023) · Nature Neuroscience · doi:10.1038/s41593-023-01444-y · Cited by 56
Goettker, A., & Gegenfurtner, K. R. (2021) · Vision Research · doi:10.1016/j.visres.2021.08.004 · Cited by 59
Altering Perceived Softness of Real Rigid Objects by Restricting Fingerpad Deformation
Tao, Y., Teng, S.-Y., & Lopes, P. (2021) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/3472749.3474800 · Cited by 56
Tracking the Temporal Evolution of a Perceptual Judgment Using a Compelled-Response Task
Shankar, S., Massoglia, D. P., Zhu, D., Costello, M. G., Stanford, T. R., & Salinas, E. (2011) · Journal of Neuroscience · doi:10.1523/jneurosci.1419-11.2011 · Cited by 65
Vocal learning is constrained by the statistics of sensorimotor experience
Sober, S. J., & Brainard, M. S. (2012) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1213622109 · Cited by 59
Optimal visual–vestibular integration under conditions of conflicting intersensory motion profiles
Butler, J. S., Campos, J. L., & Bülthoff, H. (2014) · Experimental Brain Research · doi:10.1007/s00221-014-4136-1 · Cited by 62
Direction Specific Biases in Human Visual and Vestibular Heading Perception
Crane, B. T. (2012) · PLoS ONE · doi:10.1371/journal.pone.0051383 · Cited by 59
Attention in a Bayesian Framework
Whiteley, L., & Sahani, M. (2012) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2012.00100 · Cited by 52
Women's Preferences for Penis Size: A New Research Method Using Selection among 3D Models
Prause, N., Jaymie, P., Leung, S., & Miller, G. F. (2015) · PLoS ONE · doi:10.1371/journal.pone.0133079 · Cited by 56
The effect of long-term exposure to microgravity on the perception of upright
Harris, L. R., Jenkin, M. R. M., Jenkin, H. L., Zacher, J. E., & Dyde, R. T. (2017) · npj Microgravity · doi:10.1038/s41526-016-0005-5 · Cited by 57
Rational Inference of Beliefs and Desires From Emotional Expressions
Wu, Y., Baker, C. L., Tenenbaum, J. B., & Schulz, L. (2017) · Cognitive Science · doi:10.1111/cogs.12548 · Cited by 64
Utilizing the ventriloquism-effect to investigate audio-visual binding
Bischoff, M., Walter, B., Blecker, C. R., Morgen, K., Vaitl, D., & Sammer, G. (2006) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2006.03.008 · Cited by 63
Dissociations between reaction times and temporal order judgments: A diffusion model approach.
Miller, J. O., & Schwarz, W. (2006) · Journal of Experimental Psychology Human Perception & Performance · doi:10.1037/0096-1523.32.2.394 · Cited by 62
Developmental disorders and multisensory perception
Hill, E. L., Crane, L., & Bremner, A. J. (2012) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780199586059.003.0012 · Cited by 57
Brain dynamics for confidence-weighted learning
Meyniel, F. (2020) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1007935 · Cited by 63
Spatial orienting in complex audiovisual environments
Nardo, D., Santangelo, V., & Macaluso, E. (2013) · Human Brain Mapping · doi:10.1002/hbm.22276 · Cited by 59
Touch matters: exploring the relationship between consumption and tactile interaction
Jansson-Boyd, C. V. (2011) · Social Semiotics · doi:10.1080/10350330.2011.591996 · Cited by 68
Inferring action structure and causal relationships in continuous sequences of human action
Buchsbaum, D., Griffiths, T. L., Plunkett, D., Gopnik, A., & Baldwin, D. A. (2014) · Cognitive Psychology · doi:10.1016/j.cogpsych.2014.10.001 · Cited by 59
Neurocognitive Robot-Assisted Therapy of Hand Function
Metzger, J.-C., Lambercy, O., Califfi, A., Conti, F., & Gassert, R. (2014) · IEEE Transactions on Haptics · doi:10.1109/toh.2013.72 · Cited by 60
Predation and the Origin of Neurones
Monk, T., & Paulin, M. G. (2014) · Brain, Behavior and Evolution · doi:10.1159/000368177 · Cited by 56
Auditory temporal modulation of the visual Ternus effect: the influence of time interval
Shi, Z., Chen, L., & Müller, H. J. (2010) · Experimental Brain Research · doi:10.1007/s00221-010-2286-3 · Cited by 59
Cross-modal object recognition and dynamic weighting of sensory inputs in a fish
Schumacher, S., de Perera, T. B., Thenert, J., & von der Emde, G. (2016) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1603120113 · Cited by 64
Environmental stability modulates the role of path integration in human navigation
Zhao, M., & Warren, W. H. (2015) · Cognition · doi:10.1016/j.cognition.2015.05.008 · Cited by 58
Duarte, S., Pascoal, C., & Cássio, F. (2008) · Microbial Ecology · doi:10.1007/s00248-008-9388-5 · Cited by 55
Perception of emotion in abstract artworks
Melcher, D., & Bacci, F. (2013) · Progress in brain research · doi:10.1016/b978-0-444-63287-6.00010-5 · Cited by 54
Electronic skins with multimodal sensing and perception
Tu, J., Wang, M., Li, W., Su, J., Li, Y., Lv, Z., Li, H., Feng, X., & Chen, X. (2023) · Soft Science · doi:10.20517/ss.2023.15 · Cited by 56
Findling, C., & Wyart, V. (2024) · Science Advances · doi:10.1126/sciadv.adl3931 · Cited by 56
The influence of embodiment on multisensory integration using the mirror box illusion
Medina, J., Khurana, P., & Coslett, H. B. (2015) · Consciousness and Cognition · doi:10.1016/j.concog.2015.08.011 · Cited by 61
Tactual perception: a review of experimental variables and procedures
Fernandes, A., & Albuquerque, P. B. (2012) · Cognitive Processing · doi:10.1007/s10339-012-0443-2 · Cited by 63
Representation of Cross-Frequency Spatial Phase Relationships in Human Visual Cortex
Henriksson, L., Hyvärinen, A., & Vanni, S. (2009) · Journal of Neuroscience · doi:10.1523/jneurosci.3136-09.2009 · Cited by 63
Ambiguity and invariance: two fundamental challenges for visual processing
Rust, N. C., & Stocker, A. A. (2010) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2010.04.013 · Cited by 64
Kardamakis, A. A., Pérez-Fernández, J., & Grillner, S. (2016) · eLife · doi:10.7554/elife.16472 · Cited by 53
A biologically inspired neurocomputational model for audiovisual integration and causal inference
Cuppini, C., Shams, L. B., Magosso, E., & Ursino, M. (2017) · European Journal of Neuroscience · doi:10.1111/ejn.13725 · Cited by 56
Improving internal model strength and performance of prosthetic hands using augmented feedback
Shehata, A. W., Engels, L. F., Controzzi, M., Cipriani, C., Scheme, E., & Sensinger, J. W. (2018) · Journal of NeuroEngineering and Rehabilitation · doi:10.1186/s12984-018-0417-4 · Cited by 57
Vestibular System and Self-Motion
Cheng, Z., & Gu, Y. (2018) · Frontiers in Cellular Neuroscience · doi:10.3389/fncel.2018.00456 · Cited by 60
Evaluating Internal Model Strength and Performance of Myoelectric Prosthesis Control Strategies
Shehata, A. W., Scheme, E., & Sensinger, J. W. (2018) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2018.2826981 · Cited by 54
Multisensory Integration Develops Prior to Crossmodal Recalibration
Rohlf, S., Li, L., Bruns, P., & Röder, B. (2020) · Current Biology · doi:10.1016/j.cub.2020.02.048 · Cited by 55
Belief Propagation in Networks of Spiking Neurons
Steimer, A., Maass, W., & Douglas, R. (2009) · Neural Computation · doi:10.1162/neco.2009.08-08-837 · Cited by 54
Sound Representing Self-Motion in Virtual Environments Enhances Linear Vection
Väljamäe, A., Larsson, P., Västfjäll, D., & Kleiner, M. (2008) · PRESENCE Virtual and Augmented Reality · doi:10.1162/pres.17.1.43 · Cited by 61
Are discrimination thresholds a valid measure of variance for judgments of slant from texture?
Todd, J. T. (2010) · Journal of Vision · doi:10.1167/10.2.20 · Cited by 57
Binda, P., Bruno, A., Burr, D. C., & Morrone, M. C. (2007) · Journal of Neuroscience · doi:10.1523/jneurosci.0737-07.2007 · Cited by 56
Touch down: The effect of artificial touch cues on orientation in microgravity
van Erp, J. B. F., & van Veen, H. A. H. C. (2006) · Neuroscience Letters · doi:10.1016/j.neulet.2006.05.060 · Cited by 54
Learning Multisensory Integration and Coordinate Transformation via Density Estimation
Makin, J. G., Fellows, M. R., & Sabes, P. N. (2013) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1003035 · Cited by 53
“based on the peak of the optimal posterior over the stimulus, given a variety of multisensory inputs [1,3–7].”
BackgroundKocur, M., Schauhuber, P., Schwind, V., Wolff, C. G., & Henze, N. (2020) · ACM Symposium on Virtual Reality Software and Technology (VRST) · doi:10.1145/3385956.3418969 · Cited by 58
Strube, A., Rose, M., Fazeli, S., & Büchel, C. (2021) · eLife · doi:10.7554/elife.62809 · Cited by 57
Proprioceptive uncertainty promotes the rubber hand illusion
Chancel, M., & Ehrsson, H. H. (2023) · Cortex · doi:10.1016/j.cortex.2023.04.005 · Cited by 58
Integration of vision and haptics during tool use
Takahashi, C., Diedrichsen, J., & Watt, S. J. (2009) · Journal of Vision · doi:10.1167/9.6.3 · Cited by 53
0 + 1 > 1: How Adding Noninformative Sound Improves Performance on a Visual Task
Kim, R. S., Peters, M. A. K., & Shams, L. B. (2011) · Psychological Science · doi:10.1177/0956797611420662 · Cited by 56
Meaningful auditory information enhances perception of visual biological motion
Arrighi, R., Marini, F., & Burr, D. C. (2009) · Journal of Vision · doi:10.1167/9.4.25 · Cited by 59
Towards a neuro-computational account of prism adaptation
Petitet, P., O’Reilly, J. X., & O’Shea, J. (2017) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2017.12.021 · Cited by 57
Multimodal Uncertainty Reduction for Intention Recognition in Human-Robot Interaction
Trick, S., Koert, D., Peters, J., & Rothkopf, C. A. (2019) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros40897.2019.8968171 · Cited by 70
Packaging texture influences product taste and consumer satisfaction
Ferreira, B. (2019) · Journal of Sensory Studies · doi:10.1111/joss.12532 · Cited by 60
Mechanisms of proprioceptive realignment in human motor learning
Rossi, C., Bastian, A. J., & Therrien, A. S. (2021) · Current Opinion in Physiology · doi:10.1016/j.cophys.2021.01.011 · Cited by 55
Naturalistic approaches to sensorimotor control
Ingram, J. N., & Wolpert, D. M. (2011) · Progress in brain research · doi:10.1016/b978-0-444-53752-2.00016-3 · Cited by 63
Optimal Multimodal Integration in Spatial Localization
Poletti, M., Burr, D. C., & Rucci, M. (2013) · Journal of Neuroscience · doi:10.1523/jneurosci.0523-13.2013 · Cited by 53
On the inability to ignore touch when responding to vision in the crossmodal congruency task
Spence, C. J., & Walton, M. E. (2004) · Acta Psychologica · doi:10.1016/j.actpsy.2004.10.003 · Cited by 58
Metadata
- Authors
- Ernst, M. O., & Banks, M. S.
- Affiliations
- Max Planck Institute for Biological Cybernetics (DE)
- University of California, Berkeley (US)
- Venue
- Nature
- Published
- 2002-01
- Volume
- 415
- Issue
- 6870
- Pages
- 429-433
- ISSN
- 0028-0836 (ISSN-L)
- 1476-4687
- OpenAlex
- W1969090956
- Cited by
- 4,844
- References
- 25
- Citations by year
- 2026: 237 · 2025: 267 · 2024: 260 · 2023: 287 · 2022: 220 · 2021: 279 · 2020: 311 · 2019: 316 · 2018: 267 · 2017: 275 · 2016: 192 · 2015: 230 · 2014: 207 · 2013: 195 · 2012: 198
- FWCI
- 80.64
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Nature (publishedVersion)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Max Planck Institute for Plasma Physics (submittedVersion)
- PUB – Publications at Bielefeld University (Bielefeld University) (submittedVersion)
- Publikationen an der Universität Bielefeld (Universität Bielefeld) (submittedVersion)
- MPG.PuRe (Max Planck Society) (submittedVersion)
- Funders
- National Science Foundation
- National Institutes of Health
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Multisensory perception and integration
- Life Sciences › Neuroscience › Cognitive Neuroscience › Tactile and Sensory Interactions
- Life Sciences › Neuroscience › Cognitive Neuroscience › Visual perception and processing mechanisms
- Keywords
- visual-haptic integration, cue combination, maximum likelihood estimation, statistical optimality, visual dominance, visual estimation, height perception, variance minimization, multisensory perception
- MeSH terms
- Adult, Humans, Models, Neurological, Sensory Thresholds, Size Perception, Touch
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.