Humans integrate visual and haptic information in a statistically optimal fashion
The DOI matches its Crossref record; 25 of the 25 references it cites were found in a registry or an index.
Abstract
When a person looks at an object while exploring it with their hand, vision and touch both provide information for estimating the properties of the object. Vision frequently dominates the integrated visual-haptic percept, for example when judging size, shape or position, but in some circumstances the percept is clearly affected by haptics. Here we propose that a general principle, which minimizes variance in the final estimate, determines the degree to which vision or haptics dominates. This principle is realized by using maximum-likelihood estimation to combine the inputs. To investigate cue combination quantitatively, we first measured the variances associated with visual and haptic estimation of height. We then used these measurements to construct a maximum-likelihood integrator. This model behaved very similarly to humans in a visual-haptic task. Thus, the nervous system seems to combine visual and haptic information in a fashion that is similar to a maximum-likelihood integrator. Visual dominance occurs when the variance associated with visual estimation is lower than that associated with haptic estimation.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Multimodal integration is believed to follow a general principle; thus, the nervous system weights the information available in each modality in an optimal way (reducing final estimation variance), whereas attention can influence these weights (Alais & Burr, 2004;Ernst & Banks, 2002;v a nB e e r se ta l .,1999).”
From Augmented visual, auditory, haptic, and multimodal feedback in motor learning: A review (2013) · cites this paper as Ernst & Banks, 2002
In the citing paper
“Interestingly, human observers often approach such an 'ideal observer' ([102], but see [103]), inspiring the idea that the human perceptual system may implement (approximate) Bayesian inference [104].”
From How Do Expectations Shape Perception? (2018) · cites this paper as [102]
In the citing paper
“Moreover, the relative weighting of different information sources according to their reliability in this process is suggestive of the deployment of precision expectations which underlie optimal cue combination in a Bayesian scheme [51].”
From Interoceptive inference, emotion, and the embodied self (2013) · cites this paper as [51]
In the citing paper
“In cue integration paradigms, such as the classic visual–haptic study by Ernst and Banks (2002), retrospective model-fitting often justifies Bayesian optimality post hoc, as priors and likelihoods are typically inferred from the behavioral data they purport to explain, rather than derived independently.”
From The myth of the Bayesian brain (2025) · cites this paper as Ernst and Banks 2002
In the citing paper
“Accurate inference requires that more informative cues should be weighted more heavily and, in some cases, this reweighting process can occur instantaneously; for example, we immediately ascribe less weight to a visual cue when it is blurred or degraded51,52.”
From Multimodal cue integration and learning in a neural representation of head direction (2025) · cites this paper as [52]
8 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Immediate perceptual response to intersensory discrepancy.
Welch, R. B., & Warren, D. H. (1980) · Psychological Bulletin · doi:10.1037/0033-2909.88.3.638 · Cited by 1,176 · cited 1×
“Shaded area represents predicted weights expected from within-modality discrimination (a; equation (5)); its height represents predicted errors given the standard errors of the within-modality discrimination.”
BackgroundMeasurement and modeling of depth cue combination: in defense of weak fusion
Landy, M. S., Maloney, L. T., Johnston, E. B., & Young, M. (1995) · Vision Research · doi:10.1016/0042-6989(94)00176-m · Cited by 997
Integration of Proprioceptive and Visual Position-Information: An Experimentally Supported Model
van Beers, R. J., Sittig, A. C., & Gon, J. J. D. V. D. (1999) · Journal of Neurophysiology · doi:10.1152/jn.1999.81.3.1355 · Cited by 742
Vision and Touch: An Experimentally Created Conflict between the Two Senses
Rock, I., & Victor, J. (1964) · Science · doi:10.1126/science.143.3606.594 · Cited by 702
Visual Capture of Touch: Out-of-the-Body Experiences With Rubber Gloves.
Pavani, F., Spence, C., & Driver, J. (2000) · Psychological Science · doi:10.1111/1467-9280.00270 · Cited by 608
Adaptation, after-effect and contrast in the perception of curved lines.
Gibson, J. J. (1933) · Journal of Experimental Psychology · doi:10.1037/h0074626 · Cited by 599
Data Fusion for Sensory Information Processing Systems
Clark, J. J., & Yuille, A. L. (1990) · Springer eBooks · doi:10.1007/978-1-4757-2076-1 · Cited by 525
Visual capture produced by prism spectacles
Hay, J. C., Pick, H. L., & Ikeda, K. (1965) · Psychonomic Science · doi:10.3758/bf03343413 · Cited by 309
Touch can change visual slant perception
Ernst, M. O., Banks, M. S., & Bülthoff, H. H. (2000) · Nature Neuroscience · doi:10.1038/71140 · Cited by 236
Self-citationAuditory Spatial Receptive Fields Created by Multiplication
Peña, J. L., & Konishi, M. (2001) · Science · doi:10.1126/science.1059201 · Cited by 222
Research works printed but not linked: 1
- Tastevin, J. En partant de l’experience d’Aristote. L’Encephale 1, 57–84 (1937).
Cited by
Whatever next? Predictive brains, situated agents, and the future of cognitive science
Clark, A. (2013) · Behavioral and Brain Sciences · doi:10.1017/s0140525x12000477 · Cited by 5,924
Faisal, A. A., Selen, L. P. J., & Wolpert, D. M. (2008) · Nature Reviews Neuroscience · doi:10.1038/nrn2258 · Cited by 2,883
The Bayesian brain: The role of uncertainty in neural coding and computation
Knill, D. C., & Pouget, A. (2004) · Trends in Neurosciences · doi:10.1016/j.tins.2004.10.007 · Cited by 2,588
Learning the value of information in an uncertain world
Behrens, T. E. J., Woolrich, M. W., Walton, M. E., & Rushworth, M. F. S. (2007) · Nature Neuroscience · doi:10.1038/nn1954 · Cited by 2,053
Bayesian integration in sensorimotor learning
Körding, K. P., & Wolpert, D. M. (2004) · Nature · doi:10.1038/nature02169 · Cited by 2,004
The Ventriloquist Effect Results from Near-Optimal Bimodal Integration
Alais, D., & Burr, D. (2004) · Current Biology · doi:10.1016/j.cub.2004.01.029 · Cited by 1,936
Merging the senses into a robust percept
Ernst, M. O., & Bülthoff, H. H. (2004) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2004.02.002 · Cited by 1,906
Self-citationTactile Sensing—From Humans to Humanoids
Dahiya, R. S., Metta, G., Valle, M., & Sandini, G. (2010) · IEEE Transactions on Robotics · doi:10.1109/tro.2009.2033627 · Cited by 1,851
Error Correction, Sensory Prediction, and Adaptation in Motor Control
Shadmehr, R., Smith, M. A., & Krakauer, J. W. (2010) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-060909-153135 · Cited by 1,869
“…(Kording et al., 2004), feedback responses to perturbations to the properties of the target (Izawa and Shadmehr, 2008), and perceptual estimates of position and velocity in the presence of noise (Ernst and Banks, 2002; Weiss et al., 2002; Stocker and Simoncelli, 2006; Sato et al., 2007).”
BackgroundInteroceptive inference, emotion, and the embodied self
Seth, A. K. (2013) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2013.09.007 · Cited by 1,816
Uncertainty, Neuromodulation, and Attention
Yu, A. J., & Dayan, P. (2005) · Neuron · doi:10.1016/j.neuron.2005.04.026 · Cited by 1,774
Multisensory integration: current issues from the perspective of the single neuron
Stein, B. E., & Stanford, T. R. (2008) · Nature Reviews Neuroscience · doi:10.1038/nrn2331 · Cited by 1,598
Bayesian inference with probabilistic population codes
Ma, W. J., Beck, J. M., Latham, P. E., & Pouget, A. (2006) · Nature Neuroscience · doi:10.1038/nn1790 · Cited by 1,457
“The goal of these simulations was to assess whether the mean and variance of the distributions encoded in the output layer are consistent with optimal Bayesian inference (equations (2) and (3)).”
InfluentialAugmented visual, auditory, haptic, and multimodal feedback in motor learning: A review
Sigrist, R., Rauter, G., Riener, R., & Wolf, P. (2013) · Psychonomic Bulletin & Review · doi:10.3758/s13423-012-0333-8 · Cited by 1,416
Attention, uncertainty, and free-energy
Feldman, H., & Friston, K. J. (2010) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2010.00215 · Cited by 1,365
The rubber hand illusion revisited: visuotactile integration and self-attribution
Tsakiris, M., & Haggard, P. (2005) · Journal of Experimental Psychology: Human Perception and Performance · doi:10.1037/0096-1523.31.1.80 · Cited by 1,328
Object perception as Bayesian inference
Kersten, D., Mamassian, P., & Yuille, A. (2004) · Annual Review of Psychology · doi:10.1146/annurev.psych.55.090902.142005 · Cited by 1,269
“For instance, visual and haptic information about object size are combined, weighted according to the reliability of the source (Ernst & Banks 2002,Gepshtein & Banks 2003).”
BackgroundBurge, T. (2010) · doi:10.1093/acprof:oso/9780199581405.001.0001 · Cited by 1,075
Lederman, S. J., & Klatzky, R. L. (2009) · Attention, Perception & Psychophysics · doi:10.3758/app.71.7.1439 · Cited by 1,108
Causal Inference in Multisensory Perception
Körding, K. P., Beierholm, U., Ma, W. J., Quartz, S., Tenenbaum, J. B., & Shams, L. (2007) · PLoS ONE · doi:10.1371/journal.pone.0000943 · Cited by 1,069
“[4–7].”
ResultHow Do Expectations Shape Perception?
de Lange, F. P., Heilbron, M., & Kok, P. (2018) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2018.06.002 · Cited by 975
Bayesian decision theory in sensorimotor control
Körding, K. P., & Wolpert, D. M. (2006) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2006.05.003 · Cited by 867
The science of interpersonal touch: An overview
Gallace, A., & Spence, C. (2010) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2008.10.004 · Cited by 879
“Itmight also be the case that the degree to which vision or haptics dominates the social aspects of our behavior is related to a principle of ‘optimization’ that takes into account the variability of the different input signals (e.g., Ernst and Banks, 2002; see also Jansson-Boyd and Marlow, 2007).”
Vision as Bayesian inference: analysis by synthesis?
Yuille, A., & Kersten, D. (2006) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2006.05.002 · Cited by 849
The multifaceted interplay between attention and multisensory integration.
Talsma, D., Senkowski, D., Soto-Faraco, S., & Woldorff, M. G. (2010) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2010.06.008 · Cited by 828
Temporal context calibrates interval timing
Jazayeri, M., & Shadlen, M. N. (2010) · Nature Neuroscience · doi:10.1038/nn.2590 · Cited by 781
Noise characteristics and prior expectations in human visual speed perception
Stocker, A. A., & Simoncelli, E. P. (2006) · Nature Neuroscience · doi:10.1038/nn1669 · Cited by 797
Converging Technologies for Improving Human Performance
(2003) · Springer eBooks · doi:10.1007/978-94-017-0359-8 · Cited by 794
Computational Mechanisms of Sensorimotor Control
Franklin, D. W., & Wolpert, D. M. (2011) · Neuron · doi:10.1016/j.neuron.2011.10.006 · Cited by 725
Simsek, M., Aijaz, A., Dohler, M., Sachs, J., & Fettweis, G. (2016) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2016.2525398 · Cited by 753
“In addition to being important requirement for non-haptic control, the auditory and visual feedbacks play a critical role in increasing the perceptual performance as the human brain naturally integrates different sensory modalities [29].”
BackgroundBahrami, B., Olsen, K., Latham, P. E., Roepstorff, A., Rees, G., & Frith, C. D. (2010) · Science · doi:10.1126/science.1185718 · Cited by 738
Store Atmospherics: A Multisensory Perspective
Spence, C., Puccinelli, N. M., Grewal, D., & Roggeveen, A. L. (2014) · Psychology & Marketing · doi:10.1002/mar.20709 · Cited by 661
Behavioral, Neural, and Computational Principles of Bodily Self-Consciousness
Blanke, O., Slater, M., & Serino, A. (2015) · Neuron · doi:10.1016/j.neuron.2015.09.029 · Cited by 698
Robust speech perception: Recognize the familiar, generalize to the similar, and adapt to the novel.
Kleinschmidt, D. F., & Jaeger, T. F. (2015) · Psychological Review · doi:10.1037/a0038695 · Cited by 635
Statistically optimal perception and learning: from behavior to neural representations
Fiser, J., Berkes, P., Orbán, G., & Lengyel, M. (2010) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2010.01.003 · Cited by 672
Exercising your brain: A review of human brain plasticity and training-induced learning.
Green, C. S., & Bavelier, D. (2008) · Psychology and Aging · doi:10.1037/a0014345 · Cited by 660
Probabilistic brains: knowns and unknowns
Pouget, A., Beck, J. M., Ma, W. J., & Latham, P. E. (2013) · Nature Neuroscience · doi:10.1038/nn.3495 · Cited by 615
“What Ernst and Banks 11 (and several prior studies 12,24,25 ) found is that human behavior is consistent with equations (2) and (3), providing evidence that humans properly take into account uncertainty on a trial-by-trial basis, an integral part of probabilistic reasoning.”
ResultIntentional binding and the sense of agency: A review
Moore, J. W., & Obhi, S. S. (2012) · Consciousness and Cognition · doi:10.1016/j.concog.2011.12.002 · Cited by 563
Decision theory, reinforcement learning, and the brain
Dayan, P., & Daw, N. D. (2008) · Cognitive, Affective, & Behavioral Neuroscience · doi:10.3758/cabn.8.4.429 · Cited by 580
The coordination of movement: optimal feedback control and beyond
Diedrichsen, J., Shadmehr, R., & Ivry, R. B. (2010) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2009.11.004 · Cited by 577
Probabilistic models of cognition: Conceptual foundations
Chater, N., Tenenbaum, J. B., & Yuille, A. (2006) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2006.05.007 · Cited by 549
Neural correlates of multisensory cue integration in macaque MSTd
Gu, Y., Angelaki, D. E., & DeAngelis, G. C. (2008) · Nature Neuroscience · doi:10.1038/nn.2191 · Cited by 554
Kilteni, K., Maselli, A., Kording, K. P., & Slater, M. (2015) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2015.00141 · Cited by 523
Optimal representation of sensory information by neural populations
Jazayeri, M., & Movshon, J. A. (2006) · Nature Neuroscience · doi:10.1038/nn1691 · Cited by 540
Young Children Do Not Integrate Visual and Haptic Form Information
Gori, M., Del Viva, M., Sandini, G., & Burr, D. C. (2008) · Current Biology · doi:10.1016/j.cub.2008.04.036 · Cited by 547
Predictive coding explains binocular rivalry: an epistemological review
Hohwy, J., Roepstorff, A., & Friston, K. (2008) · Cognition · doi:10.1016/j.cognition.2008.05.010 · Cited by 546
Does food color influence taste and flavor perception in humans?
Spence, C., Levitan, C. A., Shankar, M. U., & Zampini, M. (2010) · Chemosensory Perception · doi:10.1007/s12078-010-9067-z · Cited by 540
Cognitive computational neuroscience
Kriegeskorte, N., & Douglas, P. K. (2018) · Nature Neuroscience · doi:10.1038/s41593-018-0210-5 · Cited by 535
Stevens' Handbook of Experimental Psychology and Cognitive Neuroscience
(2018) · Wiley eBooks · doi:10.1002/9781119170174 · Cited by 397
Perception of intersensory synchrony: A tutorial review
Vroomen, J., & Keetels, M. (2010) · Attention, Perception, & Psychophysics · doi:10.3758/app.72.4.871 · Cited by 464
Flexible strategies for sensory integration during motor planning
Sober, S. J., & Sabes, P. N. (2005) · Nature Neuroscience · doi:10.1038/nn1427 · Cited by 480
Towards a neuroscience of active sampling and curiosity
Gottlieb, J., & Oudeyer, P.-Y. (2018) · Nature Reviews Neuroscience · doi:10.1038/s41583-018-0078-0 · Cited by 494
The rubber hand illusion: Sensitivity and reference frame for body ownership.
Costantini, M., & Haggard, P. (2007) · Consciousness and Cognition · doi:10.1016/j.concog.2007.01.001 · Cited by 489
A sensorimotor paradigm for Bayesian model selection
Genewein, T., & Braun, D. A. (2012) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2012.00291 · Cited by 485
Combining Sensory Information: Mandatory Fusion Within, but Not Between, Senses
Hillis, J. M., Ernst, M. O., Banks, M. S., & Landy, M. S. (2002) · Science · doi:10.1126/science.1075396 · Cited by 486
Self-citationSense of agency in health and disease: A review of cue integration approaches
Moore, J. W., & Fletcher, P. C. (2012) · Consciousness and Cognition · doi:10.1016/j.concog.2011.08.010 · Cited by 448
On the psychological impact of food colour
Spence, C. (2015) · Flavour · doi:10.1186/s13411-015-0031-3 · Cited by 481
Patton, J. L., Stoykov, M. E., Kovic, M., & Mussa-Ivaldi, F. A. (2006) · Experimental Brain Research · doi:10.1007/s00221-005-0097-8 · Cited by 469
“Several studies have shown how the nervous system can be ''tricked'' by giving altered sensory feedback (Flanagan and Rao 1995; Srinivasan and LaMotte 1995; Robles-De-La-Torre and Hayward 2001; Ernst and Banks 2002; Sainburg et al. 2003; Brewer et al. 2004; Kording and Wolpert 2004a).”
BackgroundThe role of auditory cues in modulating the perceived crispness and staleness of potato chips
ZAMPINI, M., & SPENCE, C. (2004) · Journal of Sensory Studies · doi:10.1111/j.1745-459x.2004.080403.x · Cited by 463
Neural correlates of reliability-based cue weighting during multisensory integration
Fetsch, C. R., Pouget, A., DeAngelis, G. C., & Angelaki, D. E. (2012) · Nature Neuroscience · doi:10.1038/nn.2983 · Cited by 459
“Note that the predictions specified by equation (2) and (3) are the same if optimality is defined in the Bayesian (maximum a posteriori) sense, assuming Gaussian likelihoods and a uniform prior3,4,6,15,16.”
BackgroundMethodInfluentialMotor Abilities in Autism: A Review Using a Computational Context
Gowen, E., & Hamilton, A. (2013) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-012-1574-0 · Cited by 397
Multisensory design: Reaching out to touch the consumer
Spence, C., & Gallace, A. (2011) · Psychology & Marketing · doi:10.1002/mar.20392 · Cited by 412
I NFERENCE AND C OMPUTATION WITH P OPULATION C ODES
Pouget, A., Dayan, P., & Zemel, R. S. (2003) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.26.041002.131112 · Cited by 434
Bayesian integration of visual and auditory signals for spatial localization
Battaglia, P. W., Jacobs, R. A., & Aslin, R. N. (2003) · Journal of the Optical Society of America A · doi:10.1364/josaa.20.001391 · Cited by 425
Multisensory Integration during Motor Planning
Sober, S. J., & Sabes, P. N. (2003) · The Journal of Neuroscience · doi:10.1523/jneurosci.23-18-06982.2003 · Cited by 430
Bayesian just-so stories in psychology and neuroscience.
Bowers, J. S., & Davis, C. J. (2012) · Psychological Bulletin · doi:10.1037/a0026450 · Cited by 436
“Various behavioral studies have demonstrated that human performance in such conditions is extremely similar to a model that optimally combines information from different modalities (e.g., Alais & Burr, 2004; Ernst & Banks, 2002).”
BackgroundDynamic Reweighting of Visual and Vestibular Cues during Self-Motion Perception
Fetsch, C. R., Turner, A. H., DeAngelis, G. C., & Angelaki, D. E. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.2574-09.2009 · Cited by 412
Directions Toward Effective Utilization of Tactile Skin: A Review
Dahiya, R. S., Mittendorfer, P., Valle, M., Cheng, G., & Lumelsky, V. J. (2013) · IEEE Sensors Journal · doi:10.1109/jsen.2013.2279056 · Cited by 428
Development of Cue Integration in Human Navigation
Nardini, M., Jones, P., Bedford, R., & Braddick, O. (2008) · Current Biology · doi:10.1016/j.cub.2008.04.021 · Cited by 431
Development of multisensory integration from the perspective of the individual neuron
Stein, B. E., Stanford, T. R., & Rowland, B. A. (2014) · Nature Reviews Neuroscience · doi:10.1038/nrn3742 · Cited by 392
Control of human gait stability through foot placement
Bruijn, S. M., & van Dieën, J. H. (2018) · Journal of The Royal Society Interface · doi:10.1098/rsif.2017.0816 · Cited by 424
Relevance of Error: What Drives Motor Adaptation?
Wei, K., & Körding, K. (2009) · Journal of Neurophysiology · doi:10.1152/jn.90545.2008 · Cited by 422
“The statistically optimal way to integrate multimodal sensory cues, under the assumption that all the cues are relevant, is to weight the cues proportionally to their inverse variances (e.g., Ernst and Banks 2002).”
BackgroundSlant from texture and disparity cues: Optimal cue combination
Hillis, J. M., Watt, S. J., Landy, M. S., & Banks, M. S. (2004) · Journal of Vision · doi:10.1167/4.12.1 · Cited by 421
“For example, Ernst and Banks (2002) conducted sizediscrimination experiments for vision alone and haptics alone and then fit cumulative Gaussians to the two psychometric functions.”
BackgroundMethodInfluentialSelf-citationIntegration of visual motion and locomotion in mouse visual cortex
Saleem, A. B., Ayaz, A., Jeffery, K. J., Harris, K. D., & Carandini, M. (2013) · Nature Neuroscience · doi:10.1038/nn.3567 · Cited by 418
Do humans optimally integrate stereo and texture information for judgments of surface slant?
Knill, D. C., & Saunders, J. A. (2003) · Vision Research · doi:10.1016/s0042-6989(03)00458-9 · Cited by 404
A computational perspective on the neural basis of multisensory spatial representations
Pouget, A., Deneve, S., & Duhamel, J.-R. (2002) · Nature Reviews Neuroscience · doi:10.1038/nrn914 · Cited by 413
An extended multisensory temporal binding window in autism spectrum disorders
Foss-Feig, J. H., Kwakye, L. D., Cascio, C. J., Burnette, C. P., Kadivar, H., Stone, W. L., & Wallace, M. T. (2010) · Experimental Brain Research · doi:10.1007/s00221-010-2240-4 · Cited by 411
The neurocognitive bases of human multimodal food perception: Sensory integration
Verhagen, J. V., & Engelen, L. (2006) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2005.11.003 · Cited by 392
Perceptual Decision Making in Rodents, Monkeys, and Humans
Hanks, T. D., & Summerfield, C. (2017) · Neuron · doi:10.1016/j.neuron.2016.12.003 · Cited by 372
The role of metacognition in human social interactions
Frith, C. D. (2012) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2012.0123 · Cited by 407
Causal inference in perception
Shams, L., & Beierholm, U. R. (2010) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2010.07.001 · Cited by 403
The statistical determinants of adaptation rate in human reaching
Burge, J., Ernst, M. O., & Banks, M. S. (2008) · Journal of Vision · doi:10.1167/8.4.20 · Cited by 400
Self-citationSensory integration for human balance control
(2018) · Handbook of Clinical Neurology · doi:10.1016/b978-0-444-63916-5.00002-1 · Cited by 329
The experience of agency: an interplay between prediction and postdiction
Synofzik, M., Vosgerau, G., & Voss, M. (2013) · Frontiers in Psychology · doi:10.3389/fpsyg.2013.00127 · Cited by 358
Lécuyer, A. (2009) · Presence: Teleoperators and Virtual Environments · doi:10.1162/pres.18.1.39 · Cited by 366
Recalibration of temporal order perception by exposure to audio-visual asynchrony
Vroomen, J., Keetels, M., de Gelder, B., & Bertelson, P. (2004) · Cognitive Brain Research · doi:10.1016/j.cogbrainres.2004.07.003 · Cited by 379
Critical features for the perception of emotion from gait
Roether, C. L., Omlor, L., Christensen, A., & Giese, M. A. (2009) · Journal of Vision · doi:10.1167/9.6.15 · Cited by 372
Multisensory integration: psychophysics, neurophysiology, and computation
Angelaki, D. E., Gu, Y., & DeAngelis, G. C. (2009) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2009.06.008 · Cited by 383
Multisensory integration, perception and ecological validity
De Gelder, B., & Bertelson, P. (2003) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2003.08.014 · Cited by 366
Experience can change the 'light-from-above' prior
Adams, W. J., Graf, E. W., & Ernst, M. O. (2004) · Nature Neuroscience · doi:10.1038/nn1312 · Cited by 377
Self-citationUse-dependent and error-based learning of motor behaviors
Diedrichsen, J., White, O., Newman, D., & Lally, N. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.5406-09.2010 · Cited by 376
Posterior parietal cortex represents sensory history and mediates its effects on behaviour
Akrami, A., Kopec, C. D., Diamond, M. E., & Brody, C. D. (2018) · Nature · doi:10.1038/nature25510 · Cited by 380
Supra-personal cognitive control and metacognition
Shea, N., Boldt, A., Bang, D., Yeung, N., Heyes, C., & Frith, C. D. (2014) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2014.01.006 · Cited by 368
Kalckert, A., & Ehrsson, H. H. (2014) · Consciousness and Cognition · doi:10.1016/j.concog.2014.02.003 · Cited by 346
Computational principles of sensorimotor control that minimize uncertainty and variability
Bays, P. M., & Wolpert, D. M. (2007) · The Journal of Physiology · doi:10.1113/jphysiol.2006.120121 · Cited by 359
Multisensory Processing in Review: from Physiology to Behaviour
Alais, D., Newell, F., & Mamassian, P. (2010) · Seeing and Perceiving · doi:10.1163/187847510x488603 · Cited by 324
Valle, G., Mazzoni, A., Iberite, F., D’Anna, E., Strauss, I., Granata, G., Controzzi, M., Clemente, F., Rognini, G., Cipriani, C., et al. (2018) · Neuron · doi:10.1016/j.neuron.2018.08.033 · Cited by 345
Sterling, P. (2004) · Allostasis, Homeostasis, and the Costs of Physiological Adaptation · doi:10.1017/cbo9781316257081.004 · Cited by 353
Flexible Cognitive Strategies during Motor Learning
Taylor, J. A., & Ivry, R. B. (2011) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1001096 · Cited by 352
“Several studies have shown that adaptation rates can change when the certainty of sensory information is manipulated [31,32].”
BackgroundConfidence as Bayesian probability: From neural origins to behavior
Meyniel, F., Sigman, M., & Mainen, Z. F. (2015) · Neuron · doi:10.1016/j.neuron.2015.09.039 · Cited by 349
Metadata
- Authors
- Ernst, M. O., & Banks, M. S.
- Affiliations
- Max Planck Institute for Biological Cybernetics (DE)
- University of California, Berkeley (US)
- Venue
- Nature
- Published
- 2002-01
- Volume
- 415
- Issue
- 6870
- Pages
- 429-433
- ISSN
- 0028-0836 (ISSN-L)
- 1476-4687
- OpenAlex
- W1969090956
- Cited by
- 4,844
- References
- 25
- Citations by year
- 2026: 237 · 2025: 267 · 2024: 260 · 2023: 287 · 2022: 220 · 2021: 279 · 2020: 311 · 2019: 316 · 2018: 267 · 2017: 275 · 2016: 192 · 2015: 230 · 2014: 207 · 2013: 195 · 2012: 198
- FWCI
- 80.64
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Nature (publishedVersion)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Max Planck Institute for Plasma Physics (submittedVersion)
- PUB – Publications at Bielefeld University (Bielefeld University) (submittedVersion)
- Publikationen an der Universität Bielefeld (Universität Bielefeld) (submittedVersion)
- MPG.PuRe (Max Planck Society) (submittedVersion)
- Funders
- National Science Foundation
- National Institutes of Health
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Multisensory perception and integration
- Life Sciences › Neuroscience › Cognitive Neuroscience › Tactile and Sensory Interactions
- Life Sciences › Neuroscience › Cognitive Neuroscience › Visual perception and processing mechanisms
- Keywords
- visual-haptic integration, cue combination, maximum likelihood estimation, statistical optimality, visual dominance, visual estimation, height perception, variance minimization, multisensory perception
- MeSH terms
- Adult, Humans, Models, Neurological, Sensory Thresholds, Size Perception, Touch
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.