Humans integrate visual and haptic information in a statistically optimal fashion
The DOI matches its Crossref record; 25 of the 25 references it cites were found in a registry or an index.
Abstract
When a person looks at an object while exploring it with their hand, vision and touch both provide information for estimating the properties of the object. Vision frequently dominates the integrated visual-haptic percept, for example when judging size, shape or position, but in some circumstances the percept is clearly affected by haptics. Here we propose that a general principle, which minimizes variance in the final estimate, determines the degree to which vision or haptics dominates. This principle is realized by using maximum-likelihood estimation to combine the inputs. To investigate cue combination quantitatively, we first measured the variances associated with visual and haptic estimation of height. We then used these measurements to construct a maximum-likelihood integrator. This model behaved very similarly to humans in a visual-haptic task. Thus, the nervous system seems to combine visual and haptic information in a fashion that is similar to a maximum-likelihood integrator. Visual dominance occurs when the variance associated with visual estimation is lower than that associated with haptic estimation.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Multimodal integration is believed to follow a general principle; thus, the nervous system weights the information available in each modality in an optimal way (reducing final estimation variance), whereas attention can influence these weights (Alais & Burr, 2004;Ernst & Banks, 2002;v a nB e e r se ta l .,1999).”
From Augmented visual, auditory, haptic, and multimodal feedback in motor learning: A review (2013) · cites this paper as Ernst & Banks, 2002
In the citing paper
“Interestingly, human observers often approach such an 'ideal observer' ([102], but see [103]), inspiring the idea that the human perceptual system may implement (approximate) Bayesian inference [104].”
From How Do Expectations Shape Perception? (2018) · cites this paper as [102]
In the citing paper
“Moreover, the relative weighting of different information sources according to their reliability in this process is suggestive of the deployment of precision expectations which underlie optimal cue combination in a Bayesian scheme [51].”
From Interoceptive inference, emotion, and the embodied self (2013) · cites this paper as [51]
In the citing paper
“In cue integration paradigms, such as the classic visual–haptic study by Ernst and Banks (2002), retrospective model-fitting often justifies Bayesian optimality post hoc, as priors and likelihoods are typically inferred from the behavioral data they purport to explain, rather than derived independently.”
From The myth of the Bayesian brain (2025) · cites this paper as Ernst and Banks 2002
In the citing paper
“Accurate inference requires that more informative cues should be weighted more heavily and, in some cases, this reweighting process can occur instantaneously; for example, we immediately ascribe less weight to a visual cue when it is blurred or degraded51,52.”
From Multimodal cue integration and learning in a neural representation of head direction (2025) · cites this paper as [52]
8 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Immediate perceptual response to intersensory discrepancy.
Welch, R. B., & Warren, D. H. (1980) · Psychological Bulletin · doi:10.1037/0033-2909.88.3.638 · Cited by 1,176 · cited 1×
“Shaded area represents predicted weights expected from within-modality discrimination (a; equation (5)); its height represents predicted errors given the standard errors of the within-modality discrimination.”
BackgroundMeasurement and modeling of depth cue combination: in defense of weak fusion
Landy, M. S., Maloney, L. T., Johnston, E. B., & Young, M. (1995) · Vision Research · doi:10.1016/0042-6989(94)00176-m · Cited by 997
Integration of Proprioceptive and Visual Position-Information: An Experimentally Supported Model
van Beers, R. J., Sittig, A. C., & Gon, J. J. D. V. D. (1999) · Journal of Neurophysiology · doi:10.1152/jn.1999.81.3.1355 · Cited by 742
Vision and Touch: An Experimentally Created Conflict between the Two Senses
Rock, I., & Victor, J. (1964) · Science · doi:10.1126/science.143.3606.594 · Cited by 702
Visual Capture of Touch: Out-of-the-Body Experiences With Rubber Gloves.
Pavani, F., Spence, C., & Driver, J. (2000) · Psychological Science · doi:10.1111/1467-9280.00270 · Cited by 608
Adaptation, after-effect and contrast in the perception of curved lines.
Gibson, J. J. (1933) · Journal of Experimental Psychology · doi:10.1037/h0074626 · Cited by 599
Data Fusion for Sensory Information Processing Systems
Clark, J. J., & Yuille, A. L. (1990) · Springer eBooks · doi:10.1007/978-1-4757-2076-1 · Cited by 525
Visual capture produced by prism spectacles
Hay, J. C., Pick, H. L., & Ikeda, K. (1965) · Psychonomic Science · doi:10.3758/bf03343413 · Cited by 309
Touch can change visual slant perception
Ernst, M. O., Banks, M. S., & Bülthoff, H. H. (2000) · Nature Neuroscience · doi:10.1038/71140 · Cited by 236
Self-citationAuditory Spatial Receptive Fields Created by Multiplication
Peña, J. L., & Konishi, M. (2001) · Science · doi:10.1126/science.1059201 · Cited by 222
Research works printed but not linked: 1
- Tastevin, J. En partant de l’experience d’Aristote. L’Encephale 1, 57–84 (1937).
Cited by
Items 101–200 of 1,044
Cortical Hierarchies Perform Bayesian Causal Inference in Multisensory Perception
Rohe, T., & Noppeney, U. (2015) · PLOS Biology · doi:10.1371/journal.pbio.1002073 · Cited by 344
Suboptimality in perceptual decision making
Rahnev, D., & Denison, R. N. (2018) · Behavioral and Brain Sciences · doi:10.1017/s0140525x18000936 · Cited by 342
Vection and visually induced motion sickness: how are they related?
Keshavarz, B., Riecke, B. E., Hettinger, L. J., & Campos, J. L. (2015) · Frontiers in Psychology · doi:10.3389/fpsyg.2015.00472 · Cited by 342
“Further, a prominent and well-supported model of multisensory integration is the Maximum Likelihood Estimation model (Ernst and Banks, 2002; Alais and Burr, 2004; Ernst and Bülthoff, 2004).”
BackgroundKnowing how much you don't know: a neural organization of uncertainty estimates
Bach, D. R., & Dolan, R. J. (2012) · Nature Reviews Neuroscience · doi:10.1038/nrn3289 · Cited by 339
Cue weighting in auditory categorization: Implications for first and second language acquisition
Holt, L. L., & Lotto, A. J. (2006) · The Journal of the Acoustical Society of America · doi:10.1121/1.2188377 · Cited by 335
Learning to integrate arbitrary signals from vision and touch
Ernst, M. O. (2007) · Journal of Vision · doi:10.1167/7.5.7 · Cited by 332
Self-citationA Bayesian perspective on magnitude estimation
Petzschner, F. H., Glasauer, S., & Stephan, K. E. (2015) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2015.03.002 · Cited by 327
Bayesian integration of spatial information.
Cheng, K., Shettleworth, S. J., Huttenlocher, J., & Rieser, J. J. (2007) · Psychological Bulletin · doi:10.1037/0033-2909.133.4.625 · Cited by 326
Zhang, Y., Zhen, Y.-R., Neumann, O., Day, J. K., Nordlander, P., & Halas, N. J. (2014) · Nature Communications · doi:10.1038/ncomms5424 · Cited by 322
Fetsch, C. R., DeAngelis, G. C., & Angelaki, D. E. (2013) · Nature Reviews Neuroscience · doi:10.1038/nrn3503 · Cited by 302
Synofzik, M., Thier, P., Leube, D. T., Schlotterbeck, P., & Lindner, A. (2010) · Brain · doi:10.1093/brain/awp291 · Cited by 321
A normalization model of multisensory integration
Ohshiro, T., Angelaki, D. E., & DeAngelis, G. C. (2011) · Nature Neuroscience · doi:10.1038/nn.2815 · Cited by 320
Crossmodal binding: Evaluating the “unity assumption” using audiovisual speech stimuli
Vatakis, A., & Spence, C. (2007) · Perception & Psychophysics · doi:10.3758/bf03193776 · Cited by 298
Bayesian models of object perception
Kersten, D., & Yuille, A. (2003) · Current Opinion in Neurobiology · doi:10.1016/s0959-4388(03)00042-4 · Cited by 307
An artificial sensory neuron with visual-haptic fusion
Wan, C., Cai, P., Guo, X., Wang, M., Matsuhisa, N., Yang, L., Lv, Z., Luo, Y., Loh, X. J., & Chen, X. (2020) · Nature Communications · doi:10.1038/s41467-020-18375-y · Cited by 311
Recent progresses on flexible tactile sensors
Wan, Y., Wang, Y., & Guo, C. F. (2017) · Materials Today Physics · doi:10.1016/j.mtphys.2017.06.002 · Cited by 309
Estimating the sources of motor errors for adaptation and generalization
Berniker, M., & Kording, K. (2008) · Nature Neuroscience · doi:10.1038/nn.2229 · Cited by 316
Bayesian Spiking Neurons I: Inference
Deneve, S. (2008) · Neural Computation · doi:10.1162/neco.2008.20.1.91 · Cited by 313
“The use of Bayesian inference and priors in human perception recently has been shown to account for a wide range of perceptual phenomena (Knill & Richards, 1996; Weiss & Freeman, 2001; Weiss & Fleet, 2002; Feldman, 2001; Geisler, Perry, Super, & Gallogly, 2001; van Beers, Sittig, & Gon, 1999; Ernst & Banks, 2002 ).”
BackgroundMethodImplicit multisensory associations influence voice recognition
von Kriegstein, K., & Giraud, A.-L. (2006) · PLoS Biology · doi:10.1371/journal.pbio.0040326 · Cited by 309
“Models based on predictive coding assume that the brain captures the regularities of the natural world through statistical assessment of the properties of the environment [7,10,48].”
BackgroundFocus cues affect perceived depth
Watt, S. J., Akeley, K., Ernst, M. O., & Banks, M. S. (2005) · Journal of Vision · doi:10.1167/5.10.7 · Cited by 297
Self-citationSantello, M., Bianchi, M., Gabiccini, M., Ricciardi, E., Salvietti, G., Prattichizzo, D., Ernst, M., Moscatelli, A., Jörntell, H., Kappers, A. M. L., et al. (2016) · Physics of Life Reviews · doi:10.1016/j.plrev.2016.02.001 · Cited by 307
Self-citationWith or without you: predictive coding and Bayesian inference in the brain
Aitchison, L., & Lengyel, M. (2017) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2017.08.010 · Cited by 308
“2) to achieve near-optimal performance in a variety of situations, from decision making [15], through cue combination [16], to motor control [17].”
BackgroundVisual Feedback Control of Hand Movements
Saunders, J. A., & Knill, D. C. (2004) · The Journal of Neuroscience · doi:10.1523/jneurosci.4319-03.2004 · Cited by 293
Multisensory Integration: Flexible Use of General Operations
van Atteveldt, N., Murray, M. M., Thut, G., & Schroeder, C. E. (2014) · Neuron · doi:10.1016/j.neuron.2014.02.044 · Cited by 272
Emotion and decision-making: affect-driven belief systems in anxiety and depression
Paulus, M. P., & Yu, A. J. (2012) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2012.07.009 · Cited by 287
The newly sighted fail to match seen with felt
Held, R., Ostrovsky, Y., de Gelder, B., Gandhi, T., Ganesh, S., Mathur, U., & Sinha, P. (2011) · Nature Neuroscience · doi:10.1038/nn.2795 · Cited by 284
McMurray, B., & Jongman, A. (2011) · Psychological Review · doi:10.1037/a0022325 · Cited by 272
Sound-induced flash illusion as an optimal percept
Shams, L., Ma, W. J., & Beierholm, U. (2005) · NeuroReport · doi:10.1097/01.wnr.0000187634.68504.bb · Cited by 267
Optimal integration of shape information from vision and touch
Helbig, H. B., & Ernst, M. O. (2007) · Experimental Brain Research · doi:10.1007/s00221-006-0814-y · Cited by 264
Self-citationOptimal Encoding of Interval Timing in Expert Percussionists
Cicchini, G. M., Arrighi, R., Cecchetti, L., Giusti, M., & Burr, D. C. (2012) · The Journal of Neuroscience · doi:10.1523/jneurosci.3411-11.2012 · Cited by 261
Neural Variability and Sampling-Based Probabilistic Representations in the Visual Cortex
Orbán, G., Berkes, P., Fiser, J., & Lengyel, M. (2016) · Neuron · doi:10.1016/j.neuron.2016.09.038 · Cited by 255
Contributions of ideal observer theory to vision research
Geisler, W. S. (2011) · Vision Research · doi:10.1016/j.visres.2010.09.027 · Cited by 254
Bayesian learning of visual chunks by human observers
Orbán, G., Fiser, J., Aslin, R. N., & Lengyel, M. (2008) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0708424105 · Cited by 257
Probability matching as a computational strategy used in perception
Wozny, D. R., Beierholm, U. R., & Shams, L. (2010) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1000871 · Cited by 265
Two is better than one: Physical interactions improve motor performance in humans
Ganesh, G., Takagi, A., Osu, R., Yoshioka, T., Kawato, M., & Burdet, E. (2014) · Scientific Reports · doi:10.1038/srep03824 · Cited by 250
Winkler, I., & Czigler, I. (2012) · International Journal of Psychophysiology · doi:10.1016/j.ijpsycho.2011.10.001 · Cited by 252
The functional role of serial dependence
Cicchini, G. M., Mikellidou, K., & Burr, D. C. (2018) · Proceedings of the Royal Society B: Biological Sciences · doi:10.1098/rspb.2018.1722 · Cited by 240
Extreme ultra-reliable and low-latency communication
Park, J., Samarakoon, S., Shiri, H., Abdel-Aziz, M. K., Nishio, T., Elgabli, A., & Bennis, M. (2022) · Nature Electronics · doi:10.1038/s41928-022-00728-8 · Cited by 272
Metacognition and Confidence: A Review and Synthesis
Fleming, S. M. (2024) · Annual Review of Psychology · doi:10.1146/annurev-psych-022423-032425 · Cited by 256
“If subjects are asked to combine information across two sensory modalities, the weights they put on the two sources of information is inversely proportional to their uncertainty, and approaches the predictions of an ideal Bayesian observer (e.g., Ernst & Banks, 2002).”
Visually Induced Analgesia: Seeing the Body Reduces Pain
Longo, M. R., Betti, V., Aglioti, S. M., & Haggard, P. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.3072-09.2009 · Cited by 245
Decoding the activity of neuronal populations in macaque primary visual cortex
Graf, A. B. A., Kohn, A., Jazayeri, M., & Movshon, J. A. (2011) · Nature Neuroscience · doi:10.1038/nn.2733 · Cited by 251
Signatures of a Statistical Computation in the Human Sense of Confidence
Sanders, J. I., Hangya, B., & Kepecs, A. (2016) · Neuron · doi:10.1016/j.neuron.2016.03.025 · Cited by 253
“…used successfully to account for the perceptual and motor systems in decision-making, which obey Bayesian principles when faced with uncertainty (Ernst and Banks, 2002; Fetsch et al., 2013; Fiser et al., 2010; Körding and Wolpert, 2004; Pouget et al., 2013; Stocker and Simoncelli, 2006;…”
Zampini, M., Sanabria, D., Phillips, N., & Spence, C. (2007) · Food Quality and Preference · doi:10.1016/j.foodqual.2007.04.001 · Cited by 238
Auditory dominance over vision in the perception of interval duration
Burr, D., Banks, M. S., & Morrone, M. C. (2009) · Experimental Brain Research · doi:10.1007/s00221-009-1933-z · Cited by 244
Self-citationA Review of Sensory Feedback in Upper-Limb Prostheses From the Perspective of Human Motor Control
Sensinger, J. W., & Dosen, S. (2020) · Frontiers in Neuroscience · doi:10.3389/fnins.2020.00345 · Cited by 230
Bayesian integration of visual and vestibular signals for heading
Butler, J. S., Smith, S. T., Campos, J. L., & Bulthoff, H. H. (2010) · Journal of Vision · doi:10.1167/10.11.23 · Cited by 250
Illusions, perception and Bayes
Geisler, W. S., & Kersten, D. (2002) · Nature Neuroscience · doi:10.1038/nn0602-508 · Cited by 249
Cues for Haptic Perception of Compliance
Bergmann Tiest, W. M., & Kappers, A. (2009) · IEEE Transactions on Haptics · doi:10.1109/toh.2009.16 · Cited by 243
Ageing vision and falls: a review
Saftari, L. N., & Kwon, O.-S. (2018) · Journal of Physiological Anthropology · doi:10.1186/s40101-018-0170-1 · Cited by 211
Toscano, J. C., & McMurray, B. (2010) · Cognitive Science · doi:10.1111/j.1551-6709.2009.01077.x · Cited by 235
Interaction of Visual and Proprioceptive Feedback During Adaptation of Human Reaching Movements
Scheidt, R. A., Conditt, M. A., Secco, E. L., & Mussa-Ivaldi, F. A. (2005) · Journal of Neurophysiology · doi:10.1152/jn.00947.2004 · Cited by 246
“These findings contrast with previous experimental results suggesting additive sensory integration in static limb positioning tasks (van Beers et al. 1996) object discrimination (Ernst and Banks 2002) and movement planning (Sober and Sabes 2003).”
ResultRealizing the Tactile Internet: Haptic Communications over Next Generation 5G Cellular Networks
Aijaz, A., Dohler, M., Aghvami, A. H., Friderikos, V., & Frodigh, M. (2017) · IEEE Wireless Communications · doi:10.1109/mwc.2016.1500157rp · Cited by 242
“This is because the human brain integrates different sensory modalities [5] that leads to incre ased perceptual performance.”
BackgroundIntersensory binding across space and time: A tutorial review
Chen, L., & Vroomen, J. (2013) · Attention, Perception, & Psychophysics · doi:10.3758/s13414-013-0475-4 · Cited by 228
Movement and the Rubber Hand Illusion
Dummer, T., Picot-Annand, A., Neal, T., & Moore, C. (2009) · Perception · doi:10.1068/p5921 · Cited by 232
Distortions of Subjective Time Perception Within and Across Senses
van Wassenhove, V., Buonomano, D. V., Shimojo, S., & Shams, L. (2008) · PLoS ONE · doi:10.1371/journal.pone.0001437 · Cited by 239
“We here compare the predictions of a traditional model of multisensory integration [47,51] with our data on the perception of multi- and inter-sensory AV durations.”
BackgroundResultWeighted linear cue combination with possibly correlated error
Oruç, İ., Maloney, L. T., & Landy, M. S. (2003) · Vision Research · doi:10.1016/s0042-6989(03)00435-8 · Cited by 227
Bayesian models: the structure of the world, uncertainty, behavior, and the brain
Vilares, I., & Kording, K. (2011) · Annals of the New York Academy of Sciences · doi:10.1111/j.1749-6632.2011.05965.x · Cited by 214
Variability in neural activity and behavior
Renart, A., & Machens, C. K. (2014) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2014.02.013 · Cited by 233
Multisensory perception in uncertain environments
Munoz, N. E., & Blumstein, D. T. (2012) · Behavioral Ecology · doi:10.1093/beheco/arr220 · Cited by 215
Stein, B. E., Stanford, T. R., Ramachandran, R., Perrault, T. J., & Rowland, B. A. (2009) · Experimental Brain Research · doi:10.1007/s00221-009-1880-8 · Cited by 220
The neural basis of multisensory integration in the midbrain: Its organization and maturation
Stein, B. E., Stanford, T. R., & Rowland, B. A. (2009) · Hearing Research · doi:10.1016/j.heares.2009.03.012 · Cited by 209
Sensory uncertainty decoded from visual cortex predicts behavior
van Bergen, R. S., Ji Ma, W., Pratte, M. S., & Jehee, J. F. M. (2015) · Nature Neuroscience · doi:10.1038/nn.4150 · Cited by 221
Interactional synchrony: signals, mechanisms and benefits
Hoehl, S., Fairhurst, M., & Schirmer, A. (2021) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nsaa024 · Cited by 231
“Research has demonstrated that multimodal integration depends on the relation between signal and noise (Ernst and Banks, 2002) as well as on the temporal regularity of individual modality streams (Elliott et al.”
BackgroundBayesian multisensory integration and cross-modal spatial links.
Deneve, S., & Pouget, A. (2004) · Journal of Physiology-Paris · doi:10.1016/j.jphysparis.2004.03.011 · Cited by 230
Visual dominance and attention: The Colavita effect revisited
Sinnett, S., Spence, C., & Soto-Faraco, S. (2007) · Perception & Psychophysics · doi:10.3758/bf03193770 · Cited by 209
Perceptual decision making in less than 30 milliseconds
Stanford, T. R., Shankar, S., Massoglia, D. P., Costello, M. G., & Salinas, E. (2010) · Nature Neuroscience · doi:10.1038/nn.2485 · Cited by 228
“Here we mean acceleration in the literal, physical sense because the cue information changes the second derivatives of the decision variables xL and xR (equation (3)).”
InfluentialComputational Models of Interoception and Body Regulation
Petzschner, F. H., Garfinkel, S. N., Paulus, M. P., Koch, C., & Khalsa, S. S. (2021) · Trends in Neurosciences · doi:10.1016/j.tins.2020.09.012 · Cited by 227
The Perception and Misperception of Specular Surface Reflectance
Marlow, P. J., Kim, J., & Anderson, B. L. (2012) · Current Biology · doi:10.1016/j.cub.2012.08.009 · Cited by 217
Martins, J., Gonçalves, R., Branco, F., Barbosa, L., Melo, M., & Bessa, M. (2017) · Journal of Destination Marketing & Management · doi:10.1016/j.jdmm.2017.02.002 · Cited by 199
Interactions between dorsal and ventral streams for controlling skilled grasp
van Polanen, V., & Davare, M. (2015) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2015.07.010 · Cited by 225
“Depending on the task context, information from the ventral stream might be weighted differently in a way comparable to maximumlikelihood estimation (Ernst and Banks, 2002).”
Modelling natural and artificial hands with synergies
Bicchi, A., Gabiccini, M., & Santello, M. (2011) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2011.0152 · Cited by 221
Predictive coding and multisensory integration: an attentional account of the multisensory mind
Talsma, D. (2015) · Frontiers in Integrative Neuroscience · doi:10.3389/fnint.2015.00019 · Cited by 222
“Additionally, it has been successfully applied to explain a number of basic multisensory processing phenomena (Ernst and Banks, 2002; Alais and Burr, 2004; Helbig and Ernst, 2007; Holmes, 2009).”
BackgroundWhen Correlation Implies Causation in Multisensory Integration
Parise, C. V., Spence, C., & Ernst, M. O. (2012) · Current Biology · doi:10.1016/j.cub.2011.11.039 · Cited by 203
Self-citationSpence, C. (2015) · Flavour · doi:10.1186/2044-7248-4-3 · Cited by 201
Neural Synergy Between Kinetic Vision and Touch
Blake, R., Sobel, K. V., & James, T. W. (2004) · Psychological Science · doi:10.1111/j.0956-7976.2004.00691.x · Cited by 225
Heeger, D. J. (2017) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1619788114 · Cited by 220
“The model has since been applied to explain physiological measurements of neural activity in a wide variety of neural systems (43-60), and behavioral/ perceptual analogs of those physiological phenomena (e.”
BackgroundMethodRoach, N. W., Heron, J., & McGraw, P. V. (2006) · Proceedings of the Royal Society B: Biological Sciences · doi:10.1098/rspb.2006.3578 · Cited by 209
Development of Spatial Cognition
Newcombe, N. S., & Huttenlocher, J. (2007) · Handbook of Child Psychology · doi:10.1002/9780470147658.chpsy0217 · Cited by 217
Better Vision through Manipulation
Metta, G., & Fitzpatrick, P. (2003) · Adaptive Behavior · doi:10.1177/10597123030112004 · Cited by 216
Hearing Gestures, Seeing Music: Vision Influences Perceived Tone Duration
Schutz, M., & Lipscomb, S. (2007) · Perception · doi:10.1068/p5635 · Cited by 212
Evaluating the Mind’s Eye: The Metacognition of Visual Imagery
Pearson, J., Rademaker, R. L., & Tong, F. (2011) · Psychological Science · doi:10.1177/0956797611417134 · Cited by 188
Multisensory Decision-Making in Rats and Humans
Raposo, D., Sheppard, J. P., Schrater, P. R., & Churchland, A. K. (2012) · The Journal of Neuroscience · doi:10.1523/jneurosci.4998-11.2012 · Cited by 208
Di Luca, M., Machulla, T. K., & Ernst, M. O. (2009) · Journal of Vision · doi:10.1167/9.12.7 · Cited by 209
Self-citationCombining Priors and Noisy Visual Cues in a Rapid Pointing Task
Tassinari, H., Hudson, T. E., & Landy, M. S. (2006) · The Journal of Neuroscience · doi:10.1523/jneurosci.2779-06.2006 · Cited by 204
Probabilistic models in human sensorimotor control
Wolpert, D. M. (2007) · Human Movement Science · doi:10.1016/j.humov.2007.05.005 · Cited by 212
A Bayesian model of the disambiguation of gravitoinertial force by visual cues
MacNeilage, P. R., Banks, M. S., Berger, D. R., & Bülthoff, H. H. (2007) · Experimental Brain Research · doi:10.1007/s00221-006-0792-0 · Cited by 211
“for the appearance of a two-cue stimulus as well as two-cue discrimination thresholds (Alais and Burr 2004; Ernst and Banks 2002; Gepshtein and Banks 2003; Knill and Saunders 2003; Landy and Kojima 2001).”
BackgroundInfluentialSelf-citationA learning-based approach to artificial sensory feedback leads to optimal integration
Dadarlat, M. C., O'Doherty, J. E., & Sabes, P. N. (2015) · Nature Neuroscience · doi:10.1038/nn.3883 · Cited by 210
A Bayesian View on Multimodal Cue Integration
Ernst, M. O. (2005) · Human Body Perception From The Inside Out · doi:10.1093/oso/9780195178371.003.0006 · Cited by 209
Self-citationMultisensory Integration in Macaque Visual Cortex Depends on Cue Reliability
Morgan, M. L., DeAngelis, G. C., & Angelaki, D. E. (2008) · Neuron · doi:10.1016/j.neuron.2008.06.024 · Cited by 208
Distinct encoding of decision confidence in human medial prefrontal cortex
Bang, D., & Fleming, S. M. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1800795115 · Cited by 207
“For example, when inferring the length of an object from visual and haptic information, the brain needs to know which source is more reliable and thus should dominate the integrated visual-haptic percept, regardless of which response may eventually be required (35).”
BackgroundSensory transformations and the use of multiple reference frames for reach planning
McGuire, L. M. M., & Sabes, P. N. (2009) · Nature Neuroscience · doi:10.1038/nn.2357 · Cited by 199
Causal Inference in the Multisensory Brain
Cao, Y., Summerfield, C., Park, H., Giordano, B. L., & Kayser, C. (2019) · Neuron · doi:10.1016/j.neuron.2019.03.043 · Cited by 202
Millière, R. (2017) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2017.00245 · Cited by 206
“Although many statistical models of bodily multisensory processing have focused on bottom-up integration of stimuli (Ernst and Banks, 2002; Fetsch et al., 2011; Samad et al., 2015), recent research has also emphasized top-down modulation of such integration.”
BackgroundVesper, C., Abramova, E., Bütepage, J., Ciardo, F., Crossey, B., Effenberg, A., Hristova, D., Karlinsky, A., McEllin, L., Nijssen, S. R. R., et al. (2017) · Frontiers in Psychology · doi:10.3389/fpsyg.2016.02039 · Cited by 189
Illusory movement perception improves motor control for prosthetic hands
Marasco, P. D., Hebert, J. S., Sensinger, J. W., Shell, C. E., Schofield, J. S., Thumser, Z. C., Nataraj, R., Beckler, D. T., Dawson, M. R., Blustein, D. H., et al. (2018) · Science Translational Medicine · doi:10.1126/scitranslmed.aao6990 · Cited by 198
Gori, M., Sandini, G., Martinoli, C., & Burr, D. (2010) · Current Biology · doi:10.1016/j.cub.2009.11.069 · Cited by 205
“But why are orientation thresholds dominated by vision? Perhaps Berkeley was not quite right, and touch does not always calibrate vision, but the more robust and hence more accurate sense for a particular perceptual task is the calibrator (as the more precise sense is the more important for sensory fusion [4, 5]).”
The cutaneous contribution to adaptive precision grip
Witney, A. G., Wing, A., Thonnard, J.-L., & Smith, A. M. (2004) · Trends in Neurosciences · doi:10.1016/j.tins.2004.08.006 · Cited by 203
“Recent approaches to these problems propose a probabilistic framework to understand how sensory signals across different modalities are integrated [ 43 ] and how prior predictions are included with current sensory information for optimal motor commands to be issued [44]; these statistical methods could also prove usef…”
BackgroundExploitation of environmental constraints in human and robotic grasping
Eppner, C., Deimel, R., Álvarez-Ruiz, J., Maertens, M., & Brock, O. (2015) · The International Journal of Robotics Research · doi:10.1177/0278364914559753 · Cited by 200
Velasco, C., Woods, A. T., Petit, O., Cheok, A. D., & Spence, C. (2016) · Food Quality and Preference · doi:10.1016/j.foodqual.2016.03.005 · Cited by 200
Ma, W. J., Zhou, X., Ross, L. A., Foxe, J. J., & Parra, L. C. (2009) · PLoS ONE · doi:10.1371/journal.pone.0004638 · Cited by 189
Metadata
- Authors
- Ernst, M. O., & Banks, M. S.
- Affiliations
- Max Planck Institute for Biological Cybernetics (DE)
- University of California, Berkeley (US)
- Venue
- Nature
- Published
- 2002-01
- Volume
- 415
- Issue
- 6870
- Pages
- 429-433
- ISSN
- 0028-0836 (ISSN-L)
- 1476-4687
- OpenAlex
- W1969090956
- Cited by
- 4,844
- References
- 25
- Citations by year
- 2026: 237 · 2025: 267 · 2024: 260 · 2023: 287 · 2022: 220 · 2021: 279 · 2020: 311 · 2019: 316 · 2018: 267 · 2017: 275 · 2016: 192 · 2015: 230 · 2014: 207 · 2013: 195 · 2012: 198
- FWCI
- 80.64
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Nature (publishedVersion)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Max Planck Institute for Plasma Physics (submittedVersion)
- PUB – Publications at Bielefeld University (Bielefeld University) (submittedVersion)
- Publikationen an der Universität Bielefeld (Universität Bielefeld) (submittedVersion)
- MPG.PuRe (Max Planck Society) (submittedVersion)
- Funders
- National Science Foundation
- National Institutes of Health
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Multisensory perception and integration
- Life Sciences › Neuroscience › Cognitive Neuroscience › Tactile and Sensory Interactions
- Life Sciences › Neuroscience › Cognitive Neuroscience › Visual perception and processing mechanisms
- Keywords
- visual-haptic integration, cue combination, maximum likelihood estimation, statistical optimality, visual dominance, visual estimation, height perception, variance minimization, multisensory perception
- MeSH terms
- Adult, Humans, Models, Neurological, Sensory Thresholds, Size Perception, Touch
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.