Humans integrate visual and haptic information in a statistically optimal fashion
The DOI matches its Crossref record; 25 of the 25 references it cites were found in a registry or an index.
Abstract
When a person looks at an object while exploring it with their hand, vision and touch both provide information for estimating the properties of the object. Vision frequently dominates the integrated visual-haptic percept, for example when judging size, shape or position, but in some circumstances the percept is clearly affected by haptics. Here we propose that a general principle, which minimizes variance in the final estimate, determines the degree to which vision or haptics dominates. This principle is realized by using maximum-likelihood estimation to combine the inputs. To investigate cue combination quantitatively, we first measured the variances associated with visual and haptic estimation of height. We then used these measurements to construct a maximum-likelihood integrator. This model behaved very similarly to humans in a visual-haptic task. Thus, the nervous system seems to combine visual and haptic information in a fashion that is similar to a maximum-likelihood integrator. Visual dominance occurs when the variance associated with visual estimation is lower than that associated with haptic estimation.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Multimodal integration is believed to follow a general principle; thus, the nervous system weights the information available in each modality in an optimal way (reducing final estimation variance), whereas attention can influence these weights (Alais & Burr, 2004;Ernst & Banks, 2002;v a nB e e r se ta l .,1999).”
From Augmented visual, auditory, haptic, and multimodal feedback in motor learning: A review (2013) · cites this paper as Ernst & Banks, 2002
In the citing paper
“Interestingly, human observers often approach such an 'ideal observer' ([102], but see [103]), inspiring the idea that the human perceptual system may implement (approximate) Bayesian inference [104].”
From How Do Expectations Shape Perception? (2018) · cites this paper as [102]
In the citing paper
“Moreover, the relative weighting of different information sources according to their reliability in this process is suggestive of the deployment of precision expectations which underlie optimal cue combination in a Bayesian scheme [51].”
From Interoceptive inference, emotion, and the embodied self (2013) · cites this paper as [51]
In the citing paper
“In cue integration paradigms, such as the classic visual–haptic study by Ernst and Banks (2002), retrospective model-fitting often justifies Bayesian optimality post hoc, as priors and likelihoods are typically inferred from the behavioral data they purport to explain, rather than derived independently.”
From The myth of the Bayesian brain (2025) · cites this paper as Ernst and Banks 2002
In the citing paper
“Accurate inference requires that more informative cues should be weighted more heavily and, in some cases, this reweighting process can occur instantaneously; for example, we immediately ascribe less weight to a visual cue when it is blurred or degraded51,52.”
From Multimodal cue integration and learning in a neural representation of head direction (2025) · cites this paper as [52]
8 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Immediate perceptual response to intersensory discrepancy.
Welch, R. B., & Warren, D. H. (1980) · Psychological Bulletin · doi:10.1037/0033-2909.88.3.638 · Cited by 1,176
Measurement and modeling of depth cue combination: in defense of weak fusion
Landy, M. S., Maloney, L. T., Johnston, E. B., & Young, M. (1995) · Vision Research · doi:10.1016/0042-6989(94)00176-m · Cited by 997
Integration of Proprioceptive and Visual Position-Information: An Experimentally Supported Model
van Beers, R. J., Sittig, A. C., & Gon, J. J. D. V. D. (1999) · Journal of Neurophysiology · doi:10.1152/jn.1999.81.3.1355 · Cited by 742
Vision and Touch: An Experimentally Created Conflict between the Two Senses
Rock, I., & Victor, J. (1964) · Science · doi:10.1126/science.143.3606.594 · Cited by 702
Visual Capture of Touch: Out-of-the-Body Experiences With Rubber Gloves.
Pavani, F., Spence, C., & Driver, J. (2000) · Psychological Science · doi:10.1111/1467-9280.00270 · Cited by 608
Adaptation, after-effect and contrast in the perception of curved lines.
Gibson, J. J. (1933) · Journal of Experimental Psychology · doi:10.1037/h0074626 · Cited by 599
Data Fusion for Sensory Information Processing Systems
Clark, J. J., & Yuille, A. L. (1990) · Springer eBooks · doi:10.1007/978-1-4757-2076-1 · Cited by 525
Visual capture produced by prism spectacles
Hay, J. C., Pick, H. L., & Ikeda, K. (1965) · Psychonomic Science · doi:10.3758/bf03343413 · Cited by 309
Touch can change visual slant perception
Ernst, M. O., Banks, M. S., & Bülthoff, H. H. (2000) · Nature Neuroscience · doi:10.1038/71140 · Cited by 236
Self-citationAuditory Spatial Receptive Fields Created by Multiplication
Peña, J. L., & Konishi, M. (2001) · Science · doi:10.1126/science.1059201 · Cited by 222
Research works printed but not linked: 1
- Tastevin, J. En partant de l’experience d’Aristote. L’Encephale 1, 57–84 (1937).
Cited by
Items 701–800 of 1,044
Vestibular Facilitation of Optic Flow Parsing
MacNeilage, P. R., Zhang, Z., DeAngelis, G. C., & Angelaki, D. E. (2012) · PLoS ONE · doi:10.1371/journal.pone.0040264 · Cited by 67
The neural mechanisms of reliability weighted integration of shape information from vision and touch
Helbig, H. B., Ernst, M. O., Ricciardi, E., Pietrini, P., Thielscher, A., Mayer, K. M., Schultz, J., & Noppeney, U. (2011) · NeuroImage · doi:10.1016/j.neuroimage.2011.09.072 · Cited by 74
Self-citationHuys, Q. J. M., Zemel, R. S., Natarajan, R., & Dayan, P. (2007) · Neural Computation · doi:10.1162/neco.2007.19.2.404 · Cited by 67
Abnormal Binaural Spectral Integration in Cochlear Implant Users
Reiss, L. A. J., Ito, R. A., Eggleston, J. L., & Wozny, D. R. (2014) · Journal of the Association for Research in Otolaryngology · doi:10.1007/s10162-013-0434-8 · Cited by 72
Improving target detection in visual search through the augmenting multi-sensory cues
Hancock, P. A., Mercado, J. E., Merlo, J. L., & van Erp, J. B. F. (2013) · Ergonomics · doi:10.1080/00140139.2013.771219 · Cited by 77
Soe, A. K., Nahavandi, S., & Khoshmanesh, K. (2012) · Biosensors and Bioelectronics · doi:10.1016/j.bios.2012.02.012 · Cited by 70
Pusch, A., Martin, O., & Coquillart, S. (2008) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2008.09.015 · Cited by 70
Touch with foreign hands: the effect of virtual hand appearance on visual-haptic integration
Schwind, V., Lin, L., Luca, M. D., Jörg, S., & Hillis, J. (2018) · ACM Symposium on Applied Perception · doi:10.1145/3225153.3225158 · Cited by 77
Review: The New Handbook of Multisensory Processing: Sensory Ecology, Behaviour, and Evolution
Spence, C. J., & Endler, J. A. (2013) · Perception · doi:10.1068/p4205rvw · Cited by 70
Top-Down Inference in the Auditory System: Potential Roles for Corticofugal Projections
Asilador, A. R., & Llano, D. A. (2021) · Frontiers in Neural Circuits · doi:10.3389/fncir.2020.615259 · Cited by 71
Multi-Sensory Weights Depend on Contextual Noise in Reference Frame Transformations
Burns, J. K., & Blohm, G. (2010) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2010.00221 · Cited by 72
Passive Motion Paradigm: An Alternative to Optimal Control
Mohan, V., & Morasso, P. (2011) · Frontiers in Neurorobotics · doi:10.3389/fnbot.2011.00004 · Cited by 75
Temporal mechanisms of multimodal binding
Burr, D., Silva, O., Cicchini, G. M., Banks, M. S., & Morrone, M. C. (2009) · Proceedings of the Royal Society B: Biological Sciences · doi:10.1098/rspb.2008.1899 · Cited by 61
Self-citationMultisensory uncertainty reduction for hand localization in children and adults.
Nardini, M., Begus, K., & Mareschal, D. (2012) · Journal of Experimental Psychology Human Perception & Performance · doi:10.1037/a0030719 · Cited by 75
A network architecture supporting consistent rich behavior in collaborative interactive applications
Marsh, J., Glencross, M., Pettifer, S. R., & Hubbold, R. J. (2006) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2006.40 · Cited by 69
Balancing new against old information: the role of puzzlement surprise in learning
Faraji, M., Preuschoff, K., & Gerstner, W. (2018) · Neural Computation · doi:10.1162/neco_a_01025 · Cited by 68
“In fact, despite the obvious success of Bayesian models for understanding the brain (Ernst & Banks, 2002; Körding & Wolpert, 2004; Knill & Pouget, 2004; Ma et al., 2006; Beck et al., 2008; Fiser et al., 2010; Berkes et al., 2011; Kolossa et al., 2013), we believe that the brain normally does not…”
BackgroundRate and timing of cortical responses driven by separate sensory channels
Saal, H. P., Harvey, M. A., & Bensmaia, S. J. (2015) · eLife · doi:10.7554/elife.10450 · Cited by 66
Stimulus intensity modulates multisensory temporal processing
Fister, J. K., Stevenson, R. A., Nidiffer, A. R., Barnett, Z. P., & Wallace, M. T. (2016) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2016.02.016 · Cited by 76
Dual-process theories and consciousness: the case for ‘Type Zero’ cognition: Table 1.
Shea, N., & Frith, C. D. (2016) · Neuroscience of Consciousness · doi:10.1093/nc/niw005 · Cited by 63
Kabbaligere, R., Lee, B.-C., & Layne, C. S. (2016) · Gait & Posture · doi:10.1016/j.gaitpost.2016.12.009 · Cited by 68
Formal models and quantitative measures of multisensory integration: a selective overview
Colonius, H., & Diederich, A. (2020) · European Journal of Neuroscience · doi:10.1111/ejn.13813 · Cited by 63
Robotics and Virtual Reality: A Perfect Marriage for Motor Control Research and Rehabilitation
Patton, J. L., Dawe, G., Scharver, C., Mussa-Ivaldi, F. A., & Kenyon, R. V. (2006) · Assistive Technology · doi:10.1080/10400435.2006.10131917 · Cited by 74
Fusion of tactile and visual information in deep learning models for object recognition
Babadian, R. P., Faez, K., Amiri, M., & Falotico, E. (2023) · Information Fusion · doi:10.1016/j.inffus.2022.11.032 · Cited by 67
Aitchison, L., & Lengyel, M. (2016) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1005186 · Cited by 67
Integration of individual and social information for decision-making in groups of different sizes
Park, S. A., Goïame, S., O'Connor, D. A., & Dreher, J.-C. (2017) · PLOS Biology · doi:10.1371/journal.pbio.2001958 · Cited by 67
Hierarchical Bayesian models of delusion
Williams, D. (2018) · Consciousness and Cognition · doi:10.1016/j.concog.2018.03.003 · Cited by 76
Sensory integration for reaching
Sabes, P. N. (2011) · Progress in brain research · doi:10.1016/b978-0-444-53752-2.00004-7 · Cited by 71
Priming of actions increases sense of control over unexpected outcomes
Sidarus, N., Chambon, V., & Haggard, P. (2013) · Consciousness and Cognition · doi:10.1016/j.concog.2013.09.008 · Cited by 69
The dialogically extended mind: Language as skilful intersubjective engagement
Fusaroli, R., Gangopadhyay, N., & Tylén, K. (2013) · Cognitive Systems Research · doi:10.1016/j.cogsys.2013.06.002 · Cited by 80
Sensory Weighting of Force and Position Feedback in Human Motor Control Tasks
Mugge, W., Schuurmans, J., Schouten, A. C., & van der Helm, F. C. T. (2009) · Journal of Neuroscience · doi:10.1523/jneurosci.0116-09.2009 · Cited by 82
Multisensory Interactions between Vestibular, Visual and Somatosensory Signals
Ferrè, E. R., Walther, L. E., & Haggard, P. (2015) · PLoS ONE · doi:10.1371/journal.pone.0124573 · Cited by 72
Multisensory interaction in product choice: Grasping a product affects choice of other seen products
Streicher, M. C., & Estes, Z. (2016) · Journal of Consumer Psychology · doi:10.1016/j.jcps.2016.01.001 · Cited by 77
Optimal combination of environmental cues and path integration during navigation
Sjolund, L. A., Kelly, J. W., & McNamara, T. P. (2017) · Memory & Cognition · doi:10.3758/s13421-017-0747-7 · Cited by 72
Ponzo, S., Kirsch, L. P., Fotopoulou, A., & Jenkinson, P. M. (2018) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2018.06.020 · Cited by 72
The Fuzziness of the Molecular World and Its Perspectives
Gentili, P. L. (2018) · Molecules · doi:10.3390/molecules23082074 · Cited by 68
Integration of audiovisual spatial signals is not consistent with maximum likelihood estimation
Meijer, D., Veselič, S., Calafiore, C., & Noppeney, U. (2019) · Cortex · doi:10.1016/j.cortex.2019.03.026 · Cited by 71
Reduction of cybersickness during and immediately following noisy galvanic vestibular stimulation
Weech, S., Wall, T., & Barnett‐Cowan, M. (2020) · Experimental Brain Research · doi:10.1007/s00221-019-05718-5 · Cited by 74
Response outcomes gate the impact of expectations on perceptual decisions
Hermoso-Mendizabal, A., Hyafil, A., Rueda‐Orozco, P. E., Jaramillo, S., Robbe, D., & de la Rocha, J. (2020) · Nature Communications · doi:10.1038/s41467-020-14824-w · Cited by 72
Methodology for Maximizing Information Transmission of Haptic Devices: A Survey
Tan, H. Z., Choi, S., Lau, F. W. Y., & Abnousi, F. (2020) · Proceedings of the IEEE · doi:10.1109/jproc.2020.2992561 · Cited by 66
Opposite effects of choice history and evidence history resolve a paradox of sequential choice bias
Bosch, E., Fritsche, M., Ehinger, B., & de Lange, F. P. (2020) · Journal of Vision · doi:10.1167/jov.20.12.9 · Cited by 70
Rowland, B. A., Stanford, T. R., & Stein, B. E. (2007) · Experimental Brain Research · doi:10.1007/s00221-006-0847-2 · Cited by 77
Bayesian Cognitive Science, Unification, and Explanation
Colombo, M., & Hartmann, S. (2017) · The British Journal for the Philosophy of Science · doi:10.1093/bjps/axv036 · Cited by 63
Late Development of Cue Integration Is Linked to Sensory Fusion in Cortex
Dekker, T. M., Ban, H., van der Velde, B., Sereno, M. I., Welchman, A. E., & Nardini, M. (2015) · Current Biology · doi:10.1016/j.cub.2015.09.043 · Cited by 70
The Development of Audio-Visual Integration for Temporal Judgements
Adams, W. J. (2016) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1004865 · Cited by 71
Visual, haptic and cross-modal recognition of objects and scenes
Woods, A. T., & Newell, F. N. (2004) · Journal of Physiology-Paris · doi:10.1016/j.jphysparis.2004.03.006 · Cited by 69
How multisensory neurons solve causal inference.
Rideaux, R., Storrs, K. R., Maiello, G., & Welchman, A. E. (2021) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2106235118 · Cited by 65
“Further, the network exhibits key “behavioural” characteristics observed in human and primate studies, such as reliability-based cue weighting (9, 17) and selfmotion estimation biased by causal inference (18).”
Stanney, K., Samman, S., Reeves, L., Hale, K., Buff, W., Bowers, C., Goldiez, B., Nicholson, D., & Lackey, S. (2004) · International Journal of Human-Computer Interaction · doi:10.1207/s15327590ijhc1702_7 · Cited by 65
“In yet other circumstances, such as in the perception of surface roughness, the percept is clearly dominated by haptics (Ernst & Banks, 2002).”
BackgroundMultisensory Integration in Speech Processing: Neural Mechanisms of Cross-Modal Aftereffects
Kilian-Hütten, N., Formisano, E., & Vroomen, J. (2017) · Innovations in cognitive neuroscience · doi:10.1007/978-1-4939-7325-5_6 · Cited by 67
Reflections on Cross-Modal Correspondences: Current Understanding and Issues for Future Research
Motoki, K., Marks, L. E., & Velasco, C. (2023) · Multisensory Research · doi:10.1163/22134808-bja10114 · Cited by 72
Visual size perception and haptic calibration during development
Gori, M., Giuliana, L., Sandini, G., & Burr, D. C. (2012) · Developmental Science · doi:10.1111/j.1467-7687.2012.2012.01183.x · Cited by 71
Self versus Environment Motion in Postural Control
Dokka, K., Kenyon, R. V., Keshner, E. A., & Kording, K. P. (2010) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1000680 · Cited by 60
Changes in tactile sensitivity over the time-course of a goal-directed movement
Juravle, G., Deubel, H., Tan, H. Z., & Spence, C. J. (2009) · Behavioural Brain Research · doi:10.1016/j.bbr.2009.12.009 · Cited by 70
Hartcher-O’Brien, J., Luca, M. D., & Ernst, M. O. (2014) · PLoS ONE · doi:10.1371/journal.pone.0089339 · Cited by 65
Self-citationIndividuation of visual objects over time
FELDMAN, J., & Tremoulet, P. D. (2005) · Cognition · doi:10.1016/j.cognition.2004.12.008 · Cited by 74
Highlights, disparity, and perceived gloss with convex and concave surfaces
Kerrigan, I. S., & Adams, W. J. (2013) · Journal of Vision · doi:10.1167/13.1.9 · Cited by 66
Sensory and affective judgments of skin during inter- and intrapersonal touch
Guest, S., Essick, G. K., Dessirier, J. M., Blot, K., Lopetcharat, K., & McGlone, F. P. (2008) · Acta Psychologica · doi:10.1016/j.actpsy.2008.10.007 · Cited by 72
Audiovisual bounce-inducing effect: When sound congruence affects grouping in vision
Grassi, M., & Casco, C. (2010) · Attention Perception & Psychophysics · doi:10.3758/app.72.2.378 · Cited by 64
Multisensory-Mediated Auditory Localization
Bolognini, N., Leo, F., Passamonti, C., Stein, B. E., & Làdavas, E. (2007) · Perception · doi:10.1068/p5846 · Cited by 77
The Role of Auditory Cues in Modulating the Perception of Electric Toothbrushes
Zampini, M., Guest, S., & Spence, C. J. (2003) · Journal of Dental Research · doi:10.1177/154405910308201116 · Cited by 71
Audiovisual bounce-inducing effect: Attention alone does not explain why the discs are bouncing.
Grassi, M., & Casco, C. (2009) · Journal of Experimental Psychology Human Perception & Performance · doi:10.1037/a0013031 · Cited by 64
Neural substrates of reliability-weighted visual-tactile multisensory integration
Beauchamp, M. S. (2010) · Frontiers in Systems Neuroscience · doi:10.3389/fnsys.2010.00025 · Cited by 63
Interceptive timing: Prior knowledge matters
López-Moliner, J., Field, D. T., & Wann, J. P. (2007) · Journal of Vision · doi:10.1167/7.13.11 · Cited by 62
The Science Behind Virtual Reality Displays
Scarfe, P., & Glennerster, A. (2019) · Annual Review of Vision Science · doi:10.1146/annurev-vision-091718-014942 · Cited by 66
We are most aware of our place in the world when about to fall
Bray, A., Subanandan, A., Isableu, B., Ohlmann, T., Golding, J. F., & Gresty, M. A. (2004) · Current Biology · doi:10.1016/j.cub.2004.07.040 · Cited by 64
Moving Multisensory Research Along: Motion Perception Across Sensory Modalities
Soto‐Faraco, S., Spence, C. J., Lloyd, D. M., & Kingstone, A. F. (2004) · Current Directions in Psychological Science · doi:10.1111/j.0963-7214.2004.01301008.x · Cited by 71
Cognition as a Window into Neuronal Population Space
Ruff, D. A., Ni, A. M., & Cohen, M. R. (2018) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-080317-061936 · Cited by 63
“On the other hand, numerous studies have shown that in certain situations, subjects do appear to behave optimally based on the available sensory information (Drugowitsch et al. 2014, Ernst & Banks 2002, Fetsch et al. 2011, Jacobs 1999, Knill 2007, Pitkow et al. 2015).”
BackgroundKuru, K. (2021) · IEEE Open Journal of Intelligent Transportation Systems · doi:10.1109/ojits.2021.3132725 · Cited by 71
Visual and Haptic Feedback Contribute to Tuning and Online Control During Object Manipulation
Huang, F. C., Gillespie, R. B., & Kuo, A. D. (2007) · Journal of Motor Behavior · doi:10.3200/jmbr.39.3.179-193 · Cited by 71
First evaluation of a novel tactile display exerting shear force via lateral displacement
Drewing, K., Fritschi, M., Zopf, R., Ernst, M. O., & BUSS, M. J. (2005) · ACM Transactions on Applied Perception · doi:10.1145/1060581.1060586 · Cited by 70
Self-citationLearning to integrate contradictory multisensory self-motion cue pairings
Kaliuzhna, M., Prsa, M., Gale, S., Lee, S. J., & Blanke, O. (2015) · Journal of Vision · doi:10.1167/15.1.10 · Cited by 66
Battaglia, E., Clark, J. P., Bianchi, M., Catalano, M. G., Bicchi, A., & O’Malley, M. K. (2019) · IEEE Transactions on Haptics · doi:10.1109/toh.2019.2915075 · Cited by 65
Humans incorporate trial-to-trial working memory uncertainty into rewarded decisions
Honig, M., Ma, W. J., & Fougnie, D. L. (2020) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1918143117 · Cited by 72
Zhao, Y., Cao, X., Lin, J., Yu, D., & Cao, X. (2021) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2021.3093923 · Cited by 70
Probabilistic Computation in Human Perception under Variability in Encoding Precision
Keshvari, S., van den Berg, R., & Ma, W. J. (2012) · PLoS ONE · doi:10.1371/journal.pone.0040216 · Cited by 64
Assessing the Role of Sound in the Perception of Food and Drink
Zampini, M., & Spence, C. J. (2010) · Chemosensory Perception · doi:10.1007/s12078-010-9064-2 · Cited by 79
Body distortions in Anorexia Nervosa: Evidence for changed processing of multisensory bodily signals
Zopf, R., Contini, E. W., Fowler, C., Mondraty, N., & Williams, M. (2016) · Psychiatry Research · doi:10.1016/j.psychres.2016.09.003 · Cited by 64
Illusions of having small or large invisible bodies influence visual perception of object size
van der Hoort, B., & Ehrsson, H. H. (2016) · Scientific Reports · doi:10.1038/srep34530 · Cited by 67
Miklashevsky, A. A. (2017) · Journal of Psycholinguistic Research · doi:10.1007/s10936-017-9548-1 · Cited by 67
URLLC-eMBB Slicing to Support VR Multimodal Perceptions over Wireless Cellular Systems
Park, J., & Bennis, M. (2018) · Globecom · doi:10.1109/glocom.2018.8647208 · Cited by 62
Risso, G., Valle, G., Iberite, F., Strauss, I., Stieglitz, T., Controzzi, M., Clemente, F., Granata, G., Rossini, P. M., Micera, S., et al. (2019) · Scientific Reports · doi:10.1038/s41598-019-43815-1 · Cited by 59
Impact of Coordinate Transformation Uncertainty on Human Sensorimotor Control
Schlicht, E. J., & Schrater, P. (2007) · Journal of Neurophysiology · doi:10.1152/jn.00160.2007 · Cited by 63
A Regression and Boundary-Crossing-Based Model for the Perception of Delayed Stiffness
Nisky, I., Mussa-Ivaldi, F. A., & Karniel, A. (2008) · IEEE Transactions on Haptics · doi:10.1109/toh.2008.17 · Cited by 62
Marlow, N., & Jansson-Boyd, C. V. (2011) · Psychology and Marketing · doi:10.1002/mar.20391 · Cited by 62
Monkeys and Humans Share a Common Computation for Face/Voice Integration
Chandrasekaran, C., Lemus, L., Wieckowski, A. T., Gondan, M., & Ghazanfar, A. A. (2011) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1002165 · Cited by 67
Informing the design of a multisensory learning environment for elementary mathematics learning
Cuturi, L. F., Cappagli, G., Yiannoutsou, N., Price, S., & Gori, M. (2021) · Journal on Multimodal User Interfaces · doi:10.1007/s12193-021-00382-y · Cited by 69
Multi-Classifier Interactive Learning for Ambiguous Speech Emotion Recognition
Zhou, Y., Liang, X., Gu, Y., Yin, Y., & Yao, L. (2022) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2022.3145287 · Cited by 67
Lécuyer, A., Burkhardt, J., & Tan, C.-H. (2008) · ACM Transactions on Applied Perception · doi:10.1145/1402236.1402238 · Cited by 61
Rubber Hands Feel Touch, but Not in Blind Individuals
Petkova, V. I., Zetterberg, H., & Ehrsson, H. H. (2012) · PLoS ONE · doi:10.1371/journal.pone.0035912 · Cited by 68
Combining multisensory temporal information for movement synchronisation
Wing, A. M., Doumas, M., & Welchman, A. E. (2009) · Experimental Brain Research · doi:10.1007/s00221-009-2134-5 · Cited by 65
Cue Integration in Categorical Tasks: Insights from Audio-Visual Speech Perception
Bejjanki, V. R., Clayards, M., Knill, D. C., & Aslin, R. N. (2011) · PLoS ONE · doi:10.1371/journal.pone.0019812 · Cited by 59
Integration of speed and time for estimating time to contact
Chang, C.-J., & Jazayeri, M. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1713316115 · Cited by 66
Modeling Emotions Associated With Novelty at Variable Uncertainty Levels: A Bayesian Approach
YANAGISAWA, H., Kawamata, O., & Ueda, K. (2019) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2019.00002 · Cited by 67
Claessens, P. M. E., & Wagemans, J. P. (2008) · Journal of Vision · doi:10.1167/8.7.33 · Cited by 65
Signal detection theory, uncertainty, and Poisson-like population codes
Ma, W. J. (2010) · Vision Research · doi:10.1016/j.visres.2010.08.035 · Cited by 60
“Humans (Alais & Burr, 2004; Battaglia, Jacobs, & Aslin, 2003; Ernst & Banks, 2002; Jacobs, 1999; Knill, 1998a, 1998b; Knill & Richards, 1996; Knill & Saunders, 2003; Landy, Maloney, Johnston, & Young, 1995; Ma, Zhou, Ross, Foxe, & Parra, 2009; Reuschel, Drewing, Henriques, Roesler, & Fiehler, 2010;…”
Mouse frontal cortex mediates additive multisensory decisions
Coen, P., Sit, T. P. H., Wells, M. J., Carandini, M., & Harris, K. D. (2023) · Neuron · doi:10.1016/j.neuron.2023.05.008 · Cited by 65
Site-specific visual feedback reduces pain perception
Diers, M., Zieglgänsberger, W., Trojan, J., Drevensek, A. M., Erhardt-Raum, G., & Flor, H. (2013) · Pain · doi:10.1016/j.pain.2013.02.022 · Cited by 63
HEMP-Hand-Displacement-Based Pseudo-Haptics: A Study of a Force Field Application
Pusch, A., Martin, O., & Coquillart, S. (2008) · IEEE Symposium on 3D User Interfaces (3DUI) · doi:10.1109/3dui.2008.4476593 · Cited by 61
The Paradigm Shift to Multimodality in Contemporary Computer Interfaces
Oviatt, S. L., & Cohen, P. R. (2015) · Synthesis lectures on human-centered informatics · doi:10.2200/s00636ed1v01y201503hci030 · Cited by 78
Perceptual drifts of real and artificial limbs in the rubber hand illusion
Fuchs, X., Riemer, M., Diers, M., Flor, H., & Trojan, J. (2016) · Scientific Reports · doi:10.1038/srep24362 · Cited by 63
Causal Inference in Multisensory Heading Estimation
de Winkel, K. N., Katliar, M., & Bülthoff, H. H. (2017) · PLOS ONE · doi:10.1371/journal.pone.0169676 · Cited by 53
Metadata
- Authors
- Ernst, M. O., & Banks, M. S.
- Affiliations
- Max Planck Institute for Biological Cybernetics (DE)
- University of California, Berkeley (US)
- Venue
- Nature
- Published
- 2002-01
- Volume
- 415
- Issue
- 6870
- Pages
- 429-433
- ISSN
- 0028-0836 (ISSN-L)
- 1476-4687
- OpenAlex
- W1969090956
- Cited by
- 4,844
- References
- 25
- Citations by year
- 2026: 237 · 2025: 267 · 2024: 260 · 2023: 287 · 2022: 220 · 2021: 279 · 2020: 311 · 2019: 316 · 2018: 267 · 2017: 275 · 2016: 192 · 2015: 230 · 2014: 207 · 2013: 195 · 2012: 198
- FWCI
- 80.64
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Nature (publishedVersion)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Max Planck Institute for Plasma Physics (submittedVersion)
- PUB – Publications at Bielefeld University (Bielefeld University) (submittedVersion)
- Publikationen an der Universität Bielefeld (Universität Bielefeld) (submittedVersion)
- MPG.PuRe (Max Planck Society) (submittedVersion)
- Funders
- National Science Foundation
- National Institutes of Health
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Multisensory perception and integration
- Life Sciences › Neuroscience › Cognitive Neuroscience › Tactile and Sensory Interactions
- Life Sciences › Neuroscience › Cognitive Neuroscience › Visual perception and processing mechanisms
- Keywords
- visual-haptic integration, cue combination, maximum likelihood estimation, statistical optimality, visual dominance, visual estimation, height perception, variance minimization, multisensory perception
- MeSH terms
- Adult, Humans, Models, Neurological, Sensory Thresholds, Size Perception, Touch
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.