Bayesian integration of visual and vestibular signals for heading

Butler, J. S.; Smith, S. T.; Campos, J. L.; Bulthoff, H. H.

doi:10.1167/10.11.23

Cited by 250Multisensory perception and integrationVisual perception and processing mechanismsVestibular and auditory disorders

Bayesian integration of visual and vestibular signals for heading

Open access

Butler, J. S., Smith, S. T., Campos, J. L., Bulthoff, H. H.·2010·Journal of Vision

DOI 10.1167/10.11.23

Open this paper in CoChat — free account

Abstract

Self-motion through an environment involves a composite of signals such as visual and vestibular cues. Building upon previous results showing that visual and vestibular signals combine in a statistically optimal fashion, we investigated the relative weights of visual and vestibular cues during self-motion. This experiment was comprised of three experimental conditions: vestibular alone, visual alone (with four different standard heading values), and visual-vestibular combined. In the combined cue condition, inter-sensory conflicts were introduced (Δ = ±6° or ±10°). Participants performed a 2-interval forced choice task in all conditions and were asked to judge in which of the two intervals they moved more to the right. The cue-conflict condition revealed the relative weights associated with each modality. We found that even when there was a relatively large conflict between the visual and vestibular cues, participants exhibited a statistically optimal reduction in variance. On the other hand, we found that the pattern of results in the unimodal conditions did not predict the weights in the combined cue condition. Specifically, visual-vestibular cue combination was not predicted solely by the reliability of each cue, but rather more weight was given to the vestibular cue.

Integrity signals

Registry

Crossref · 10.1167/10.11.23

Cites

65 of 65 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

When a small conflict is introduced between two cues, an observer's judgment incorporates both signals but depends more on the more reliable signal.
“In particular, if a small conflict is introduced between two cues, an observer’s judgment will incorporate both signals but depend more on the signal that is more reliable (i.e., has the lowest estimator variance) (9, 10, 21).”
From How multisensory neurons solve causal inference. (2021) · cites this paper as [21]

Humans integrate visual and haptic information in a statistically optimal fashion
Ernst, M. O., & Banks, M. S. (2002) · Nature · doi:10.1038/415429a · Cited by 4,844 · see citing works
Perception of the Visual World
(1952) · Archives of Ophthalmology · doi:10.1001/archopht.1952.01700030123016 · Cited by 3,748 · see citing works
The psychometric function: I. Fitting, sampling, and goodness of fit
Wichmann, F. A., & Hill, N. J. (2001) · Perception & Psychophysics · doi:10.3758/bf03194544 · Cited by 2,359 · see citing works
The Ventriloquist Effect Results from Near-Optimal Bimodal Integration
Alais, D., & Burr, D. (2004) · Current Biology · doi:10.1016/j.cub.2004.01.029 · Cited by 1,936 · see citing works
Causal Inference in Multisensory Perception
Körding, K. P., Beierholm, U., Ma, W. J., Quartz, S., Tenenbaum, J. B., & Shams, L. (2007) · PLoS ONE · doi:10.1371/journal.pone.0000943 · Cited by 1,069 · see citing works
Vestibular System: The Many Facets of a Multimodal Sense
Angelaki, D. E., & Cullen, K. E. (2008) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.31.060407.125555 · Cited by 966 · see citing works
Sensitivity of MST neurons to optic flow stimuli. I. A continuum of response selectivity to large-field stimuli
Duffy, C. J., & Wurtz, R. H. (1991) · Journal of Neurophysiology · doi:10.1152/jn.1991.65.6.1329 · Cited by 887 · see citing works
The psychometric function: II. Bootstrap-based confidence intervals and sampling
Wichmann, F. A., & Hill, N. J. (2001) · Perception & Psychophysics · doi:10.3758/bf03194545 · Cited by 809 · see citing works
Analysis of motion of the visual field by direction, expansion/contraction, and rotation cells clustered in the dorsal part of the medial superior temporal area of the macaque monkey
Tanaka, K., & Saito, H. (1989) · Journal of Neurophysiology · doi:10.1152/jn.1989.62.3.626 · Cited by 692 · see citing works
Neural correlates of multisensory cue integration in macaque MSTd
Gu, Y., Angelaki, D. E., & DeAngelis, G. C. (2008) · Nature Neuroscience · doi:10.1038/nn.2191 · Cited by 554 · see citing works
Perception of translational heading from optical flow.
Warren, W. H., Morris, M. W., & Kalish, M. L. (1988) · Journal of Experimental Psychology Human Perception & Performance · doi:10.1037/0096-1523.14.4.646 · Cited by 470 · see citing works
Perception of self-motion from visual flow
Lappe, M., Bremmer, F., & van den Berg, A. V. (1999) · Trends in Cognitive Sciences · doi:10.1016/s1364-6613(99)01364-9 · Cited by 430 · see citing works
Bayesian integration of visual and auditory signals for spatial localization
Battaglia, P., Jacobs, R. A., & Aslin, R. Ν. (2003) · Journal of the Optical Society of America A · doi:10.1364/josaa.20.001391 · Cited by 426 · see citing works
Dynamic Reweighting of Visual and Vestibular Cues during Self-Motion Perception
Fetsch, C. R., Turner, A. H., DeAngelis, G. C., & Angelaki, D. E. (2009) · Journal of Neuroscience · doi:10.1523/jneurosci.2574-09.2009 · Cited by 406 · see citing works
Eye movements and optical flow
Warren, W. H., & Hannon, D. J. (1990) · Journal of the Optical Society of America A · doi:10.1364/josaa.7.000160 · Cited by 334 · see citing works
The perception of heading during eye movements
Royden, C. S., Banks, M. S., & Crowell, J. A. (1992) · Nature · doi:10.1038/360583a0 · Cited by 324 · see citing works
Visual and Nonvisual Contributions to Three-Dimensional Heading Selectivity in the Medial Superior Temporal Area
Gu, Y., Watkins, P. V., Angelaki, D. E., & DeAngelis, G. C. (2006) · The Journal of Neuroscience · doi:10.1523/jneurosci.2356-05.2006 · Cited by 316 · see citing works
A functional link between area MSTd and heading perception based on vestibular signals
Gu, Y., DeAngelis, G. C., & Angelaki, D. E. (2007) · Nature Neuroscience · doi:10.1038/nn1935 · Cited by 297 · see citing works
Unifying multisensory signals across time and space
Wallace, M. T., Roberson, G. E., Hairston, W. D., Stein, B. E., Vaughan, J. W., & Schirillo, J. A. (2004) · Experimental Brain Research · doi:10.1007/s00221-004-1899-9 · Cited by 291 · see citing works
Electrical microstimulation of cortical area MST biases heading perception in monkeys
Britten, K. H., & Wezel, R. J. A. V. (1998) · Nature Neuroscience · doi:10.1038/259 · Cited by 288 · see citing works
Bayesian decision theory and psychophysics
Yuille, A. L., & Bülthoff, H. H. (1996) · Perception as Bayesian Inference · doi:10.1017/cbo9780511984037.006 · Cited by 250 · see citing works
Touch can change visual slant perception
Ernst, M. O., Banks, M. S., & Bülthoff, H. (2000) · Nature Neuroscience · doi:10.1038/71140 · Cited by 237 · see citing works
Thresholds for the detection of the direction of whole-body, linear movement in the horizontal plane.
Benson, A. J., Spencer, M. B., & Stott, J. (1986) · PubMed · Cited by 222 · see citing works
First-order analysis of optical flow in monkey brain.
Orban, G. A., Lagae, L., Verri, A., Raiguel, S. E., Xiao, D. K., Maes, H., & Torre, V. (1992) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.89.7.2595 · Cited by 217 · see citing works
Visual and non-visual cues in the perception of linear self motion
Harris, L. R., Jenkin, M. R. M., & Zikovitz, D. C. (2000) · Experimental Brain Research · doi:10.1007/s002210000504 · Cited by 210 · see citing works
Resolving multisensory conflict: a strategy for balancing the costs and benefits of audio-visual integration
Roach, N. W., Heron, J., & McGraw, P. V. (2006) · Proceedings of the Royal Society B Biological Sciences · doi:10.1098/rspb.2006.3578 · Cited by 210 · see citing works
A Bayesian model of the disambiguation of gravitoinertial force by visual cues
MacNeilage, P. R., Banks, M. S., Berger, D. R., & Bülthoff, H. (2006) · Experimental Brain Research · doi:10.1007/s00221-006-0792-0 · Cited by 208 · see citing works
Perceiving heading with different retinal regions and types of optic flow
Crowell, J. A., & Banks, M. S. (1993) · Perception & Psychophysics · doi:10.3758/bf03205187 · Cited by 195 · see citing works
The combination of vision and touch depends on spatial proximity
Gepshtein, S., Burge, J., Ernst, M. O., & Banks, M. S. (2005) · Journal of Vision · doi:10.1167/5.11.7 · Cited by 186 · see citing works
Robustness of perception of heading from optic flow
van den Berg, A. V. (1992) · Vision Research · doi:10.1016/0042-6989(92)90223-6 · Cited by 169 · see citing works
Optic Flow Processing in Monkey STS: A Theoretical and Experimental Approach
Lappe, M., Bremmer, F., Pekel, M., Thiele, A., & Hoffmann, K. (1996) · Journal of Neuroscience · doi:10.1523/jneurosci.16-19-06265.1996 · Cited by 163 · see citing works
Decoding of MSTd Population Activity Accounts for Variations in the Precision of Heading Perception
Gu, Y., Fetsch, C. R., Adeyemo, B., DeAngelis, G. C., & Angelaki, D. E. (2010) · Neuron · doi:10.1016/j.neuron.2010.04.026 · Cited by 159 · see citing works
A parallel algorithm for real-time computation of optical flow
Bülthoff, H., Little, J., & Poggio, T. (1989) · Nature · doi:10.1038/337549a0 · Cited by 158 · see citing works
Self-citation
Neurons in the ventral intraparietal area of awake macaque monkey closely resemble neurons in the dorsal part of the medial superior temporal area in their responses to optic flow patterns
Schaafsma, S. J., & Duysens, J. (1996) · Journal of Neurophysiology · doi:10.1152/jn.1996.76.6.4056 · Cited by 157 · see citing works
Humans can use optic flow to estimate distance of travel
Redlick, F., Jenkin, M. R. M., & Harris, L. R. (2001) · Vision Research · doi:10.1016/s0042-6989(00)00243-1 · Cited by 138 · see citing works
Area MST and Heading Perception in Macaque Monkeys
Britten, K. H. (2002) · Cerebral Cortex · doi:10.1093/cercor/12.7.692 · Cited by 121 · see citing works
Spatial Memory and Path Integration Studied by Self-Driven Passive Linear Displacement. I. Basic Properties
Israël, I., Grasso, R., Georges‐François, P., Tsuzuku, T., & Berthoz, A. (1997) · Journal of Neurophysiology · doi:10.1152/jn.1997.77.6.3180 · Cited by 120 · see citing works
Absolute travel distance from optic flow
Harald Frenz, A., & Lappe, M. (2005) · Vision Research · doi:10.1016/j.visres.2004.12.019 · Cited by 119 · see citing works
Heading judgments during active and passive self-motion
Telford, L., Howard, I. P., & Ohmi, M. (1995) · Experimental Brain Research · doi:10.1007/bf00231984 · Cited by 118 · see citing works
Why two eyes are better than one for judgements of heading
van den Berg, A. V., & Brenner, E. (1994) · Nature · doi:10.1038/371700a0 · Cited by 105 · see citing works
Perception of angular displacement without landmarks: evidence for Bayesian fusion of vestibular, optokinetic, podokinesthetic, and cognitive information
Jürgens, R., & Becker, W. (2006) · Experimental Brain Research · doi:10.1007/s00221-006-0486-7 · Cited by 86 · see citing works
Emulating the Visual Receptive-Field Properties of MST Neurons with a Template Model of Heading Estimation
Perrone, J. A., & Stone, L. S. (1998) · Journal of Neuroscience · doi:10.1523/jneurosci.18-15-05958.1998 · Cited by 85 · see citing works
Optic Flow Signals in Extrastriate Area MST: Comparison of Perceptual and Neuronal Sensitivity
Heuer, H. W., & Britten, K. H. (2004) · Journal of Neurophysiology · doi:10.1152/jn.00637.2003 · Cited by 84 · see citing works
Egocentric perception through interaction among many sensory systems
Ohmi, M. (1996) · Cognitive Brain Research · doi:10.1016/s0926-6410(96)00044-4 · Cited by 81 · see citing works
The Contributions of Static Visual Cues, Nonvisual Cues, and Optic Flow in Distance Estimation
Sun, H., Campos, J. L., Young, M. E., Chan, G. S. W., & Ellard, C. G. (2004) · Perception · doi:10.1068/p5145 · Cited by 81 · see citing works
Self-citation
Estimation of passive horizontal linear whole-body displacement in humans
Israël, I., Chapuis, N., Glasauer, S., Charade, O., & Berthoz, A. (1993) · Journal of Neurophysiology · doi:10.1152/jn.1993.70.3.1270 · Cited by 81 · see citing works
Multisensory integration in the estimation of relative path length
Sun, H., Campos, J. L., & Chan, G. S. W. (2004) · Experimental Brain Research · doi:10.1007/s00221-003-1652-9 · Cited by 78 · see citing works
Self-citation
An Unexpected Role for Visual Feedback in Vehicle Steering Control
Wallis, G. M., Chatziastros, A., & Bülthoff, H. (2002) · Current Biology · doi:10.1016/s0960-9822(02)00685-1 · Cited by 68 · see citing works
Visuo-vestibular interaction in the reconstruction of travelled trajectories
Bertin, R. J. V., & Berthoz, A. (2003) · Experimental Brain Research · doi:10.1007/s00221-003-1524-3 · Cited by 60 · see citing works
The Role of Visual and Nonvisual Information in the Control of Locomotion.
Wilkie, R. M., & Wann, J. P. (2005) · Journal of Experimental Psychology Human Perception & Performance · doi:10.1037/0096-1523.31.5.901 · Cited by 58 · see citing works
Effects of Optic Flow Speed and Lateral Flow Asymmetry on Locomotion in Younger and Older Adults: A Virtual Reality Study
Chou, Y., WAGENAAR, R. C., Saltzman, E. L., Giphart, J. E., Young, D. E., Davidsdottir, R., & Cronin‐Golomb, A. (2009) · The Journals of Gerontology Series B · doi:10.1093/geronb/gbp003 · Cited by 58 · see citing works
Aging affects the ability to use optic flow in the control of heading during locomotion
Berard, J. R., Fung, J., McFadyen, B. J., & Lamontagne, A. (2009) · Experimental Brain Research · doi:10.1007/s00221-008-1685-1 · Cited by 46 · see citing works
Measurement of instantaneous perceived self-motion using continuous pointing
Siegle, J. H., Campos, J. L., Mohler, B. J., Loomis, J. M., & Bülthoff, H. (2009) · Experimental Brain Research · doi:10.1007/s00221-009-1805-6 · Cited by 45 · see citing works
Self-citation
Bayesian Models for Seeing Shapes and Depth
Bülthoff, H., & Yuille, A. (1990) · MPG.PuRe (Max Planck Society) · Cited by 43 · see citing works
Cue integration for the perception and control of self-movement in ageing and Alzheimer's disease
Mapstone, M. E., Logan, D., & Duffy, C. J. (2006) · Brain · doi:10.1093/brain/awl201 · Cited by 34 · see citing works
Translational motion perception and vestiboocular responses in the absence of non-inertial cues
Seidman, S. H. (2007) · Experimental Brain Research · doi:10.1007/s00221-007-1072-3 · Cited by 28 · see citing works
The role of attention on the integration of visual and inertial cues
Berger, D., & Bülthoff, H. (2009) · Experimental Brain Research · doi:10.1007/s00221-009-1767-8 · Cited by 25 · see citing works
Wozu zwei Augen?
Fahle, M. W. (1987) · Die Naturwissenschaften · doi:10.1007/bf00405466 · Cited by 14 · see citing works
Visual Distance Estimation in Static Compared to Moving Virtual Scenes
Harald Frenz, A., & Lappe, M. (2006) · The Spanish Journal of Psychology · doi:10.1017/s1138741600006223 · Cited by 12 · see citing works
How stereovision interacts with optic flow perception: neural mechanisms
Lappe, M., & Grigo, A. (1999) · Neural Networks · doi:10.1016/s0893-6080(99)00061-1 · Cited by 10 · see citing works
Analysis of Motion
Watson, C. P. (1921) · Transactions of the Society of Motion Picture Engineers · doi:10.5594/j12475 · Cited by 9 · see citing works
Visual Vestibular Interactions for Self Motion Estimation
Butler, J., Smith, S., Beykirch, K., & Bülthoff, H. (2006) · eCite Digital Repository (University of Tasmania) · Cited by 4 · see citing works
Self-citation
The robust nature of visual -vestibular combination for heading
Butler, J., Campos, J., & Bülthoff, H. (2008) · MPG.PuRe (Max Planck Society) · Cited by 3 · see citing works
Self-citation
Non-retinotopic motion induced by a Ternus-Pikler display
Boi, M., Otto, T., Öğmen, H., & Herzog, M. H. (2008) · Infoscience (Ecole Polytechnique Fédérale de Lausanne) · Cited by 2 · see citing works
Visual-Vestibular Cue Combination during Temporal Asynchrony
Campos, J., Butler, J., & Bülthoff, H. (2009) · MPG.PuRe (Max Planck Society) · Cited by 2 · see citing works
Self-citation

Flagged first, then by citations

Sorted by citations

Vection and visually induced motion sickness: how are they related?
Keshavarz, B., Riecke, B. E., Hettinger, L. J., & Campos, J. L. (2015) · Frontiers in Psychology · doi:10.3389/fpsyg.2015.00472 · Cited by 325 · see citing works
“…both behavioral and neurophysiological levels (Stein and Meredith, 1993; Stein et al., 2014), and across a variety of sensory combinations, with some of the most recent evidence being in the context of visual-vestibular integration (Gu et al., 2008; Fetsch et al., 2009; Butler et al., 2010, 2014).”
BackgroundSelf-citation
Bridging the gap between theories of sensory cue integration and the physiology of multisensory neurons
Fetsch, C. R., DeAngelis, G. C., & Angelaki, D. E. (2013) · Nature reviews. Neuroscience · doi:10.1038/nrn3503 · Cited by 303 · see citing works
Identifying Causes of and Solutions for Cybersickness in Immersive Technology: Reformulation of a Research and Development Agenda
Stanney, K. M., Lawson, B. D., Rokers, B., Dennison, M., Fidopiastis, C., Stoffregen, T. A., Weech, S., & Fulvio, J. M. (2020) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2020.1828535 · Cited by 251 · see citing works
Iterative Bayesian Estimation as an Explanation for Range and Regression Effects: A Study on Human Path Integration
Petzschner, F. H., & Glasauer, S. (2011) · Journal of Neuroscience · doi:10.1523/jneurosci.2028-11.2011 · Cited by 169 · see citing works
Advancement of motion psychophysics: Review 2001-2010
Nishida, S. (2011) · Journal of Vision · doi:10.1167/11.5.11 · Cited by 141 · see citing works
Cybersickness: a Multisensory Integration Perspective
Gallagher, M., & Ferrè, E. R. (2018) · Multisensory Research · doi:10.1163/22134808-20181293 · Cited by 140 · see citing works
Cue combination in human spatial navigation
Chen, X., McNamara, T. P., Kelly, J. W., & Wolbers, T. (2017) · Cognitive Psychology · doi:10.1016/j.cogpsych.2017.04.003 · Cited by 122 · see citing works
Causal Links between Dorsal Medial Superior Temporal Area Neurons and Multisensory Heading Perception
Gu, Y., DeAngelis, G. C., & Angelaki, D. E. (2012) · Journal of Neuroscience · doi:10.1523/jneurosci.5154-11.2012 · Cited by 128 · see citing works
Perceptual Inference, Learning, and Attention in a Multisensory World
Noppeney, U. (2021) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-100120-085519 · Cited by 133 · see citing works
On-line and model-based approaches to the visual control of action
Zhao, H., & Warren, W. H. (2014) · Vision Research · doi:10.1016/j.visres.2014.10.008 · Cited by 116 · see citing works
Bayesian comparison of explicit and implicit causal inference strategies in multisensory heading perception
Acerbi, L., Dokka, K., Angelaki, D. E., & Ma, W. J. (2018) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1006110 · Cited by 111 · see citing works
A review of human sensory dynamics for application to models of driver steering and speed control
Nash, C., Cole, D. J., & Bigler, R. S. (2016) · Biological Cybernetics · doi:10.1007/s00422-016-0682-x · Cited by 106 · see citing works
From science to technology: Orientation and mobility in blind children and adults
Cuturi, L. F., Aggius-Vella, E., Campus, C., Parmiggiani, A., & Gori, M. (2016) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2016.08.019 · Cited by 107 · see citing works
Multisensory integration in the estimation of walked distances
Campos, J. L., Butler, J. S., & Bülthoff, H. (2012) · Experimental Brain Research · doi:10.1007/s00221-012-3048-1 · Cited by 102 · see citing works
Self-citation
To integrate or not to integrate: Temporal dynamics of hierarchical Bayesian causal inference
Aller, M., & Noppeney, U. (2019) · PLOS Biology · doi:10.1371/journal.pbio.3000210 · Cited by 98 · see citing works
Causal inference accounts for heading perception in the presence of object motion
Dokka, K., Park, H., Jansen, M., DeAngelis, G. C., & Angelaki, D. E. (2019) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1820373116 · Cited by 80 · see citing works
Multisensory coding of angular head velocity in the retrosplenial cortex
Keshavarzi, S., Bracey, E. F., Faville, R., Campagner, D., Tyson, A. L., Lenzi, S. C., Branco, T., & Margrie, T. W. (2021) · Neuron · doi:10.1016/j.neuron.2021.10.031 · Cited by 88 · see citing works
Self-motion perception in autism is compromised by visual noise but integrated optimally across multiple senses
Zaidel, A., Goin-Kochel, R. P., & Angelaki, D. E. (2015) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1506582112 · Cited by 92 · see citing works
Self-motion leads to mandatory cue fusion across sensory modalities
Prsa, M., Gale, S., & Blanke, O. (2012) · Journal of Neurophysiology · doi:10.1152/jn.00439.2012 · Cited by 91 · see citing works
How can a Bayesian approach inform neuroscience?
O’Reilly, J. X., Jbabdi, S., & Behrens, T. E. J. (2012) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2012.08010.x · Cited by 84 · see citing works
A neuroscientific account of how vestibular disorders impair bodily self-consciousness
Christophe Lopez, A. (2013) · Frontiers in Integrative Neuroscience · doi:10.3389/fnint.2013.00091 · Cited by 83 · see citing works
Multisensory Calibration Is Independent of Cue Reliability
Zaidel, A., Turner, A. H., & Angelaki, D. E. (2011) · Journal of Neuroscience · doi:10.1523/jneurosci.2732-11.2011 · Cited by 83 · see citing works
Integration of vestibular and proprioceptive signals for spatial updating
Frissen, I., Campos, J. L., Souman, J. L., & Ernst, M. O. (2011) · Experimental Brain Research · doi:10.1007/s00221-011-2717-9 · Cited by 76 · see citing works
Self-citation
Determining thresholds using adaptive procedures and psychometric fits: evaluating efficiency using theory, simulations, and human experiments
Karmali, F., Chaudhuri, S. E., Yi, Y., & Merfeld, D. M. (2015) · Experimental Brain Research · doi:10.1007/s00221-015-4501-8 · Cited by 77 · see citing works
How multisensory neurons solve causal inference.
Rideaux, R., Storrs, K. R., Maiello, G., & Welchman, A. E. (2021) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2106235118 · Cited by 65 · see citing works
Vestibular and Multi-Sensory Influences Upon Self-Motion Perception and the Consequences for Human Behavior
Britton, Z., & Arshad, Q. (2019) · Frontiers in Neurology · doi:10.3389/fneur.2019.00063 · Cited by 74 · see citing works
Perceptual precision of passive body tilt is consistent with statistically optimal cue integration
Lim, K., Karmali, F., Nicoucar, K. G., & Merfeld, D. M. (2017) · Journal of Neurophysiology · doi:10.1152/jn.00073.2016 · Cited by 73 · see citing works
Vestibular Precision at the Level of Perception, Eye Movements, Posture, and Neurons
Diaz‐Artiles, A., & Karmali, F. (2021) · Neuroscience · doi:10.1016/j.neuroscience.2021.05.028 · Cited by 71 · see citing works
Visual and vestibular perceptual thresholds each demonstrate better precision at specific frequencies and also exhibit optimal integration
Karmali, F., Lim, K., & Merfeld, D. M. (2013) · Journal of Neurophysiology · doi:10.1152/jn.00332.2013 · Cited by 67 · see citing works
Vestibular Facilitation of Optic Flow Parsing
MacNeilage, P. R., Zhang, Z., DeAngelis, G. C., & Angelaki, D. E. (2012) · PLoS ONE · doi:10.1371/journal.pone.0040264 · Cited by 67 · see citing works
Multisensory Convergence of Visual and Vestibular Heading Cues in the Pursuit Area of the Frontal Eye Field
Gu, Y., Cheng, Z., Yang, L., DeAngelis, G. C., & Angelaki, D. E. (2015) · Cerebral Cortex · doi:10.1093/cercor/bhv183 · Cited by 62 · see citing works
Multisensory Integration in Self Motion Perception
Greenlee, M. W., Frank, S., Kaliuzhna, M., Blanke, O., Bremmer, F., Churan, J., Cuturi, L. F., MacNeilage, P. R., & Smith, A. T. (2016) · Multisensory Research · doi:10.1163/22134808-00002527 · Cited by 62 · see citing works
Optimal combination of environmental cues and path integration during navigation
Sjolund, L. A., Kelly, J. W., & McNamara, T. P. (2017) · Memory & Cognition · doi:10.3758/s13421-017-0747-7 · Cited by 63 · see citing works
Multisensory Interactions between Vestibular, Visual and Somatosensory Signals
Ferrè, E. R., Walther, L. E., & Haggard, P. (2015) · PLoS ONE · doi:10.1371/journal.pone.0124573 · Cited by 60 · see citing works
Systematic Biases in Human Heading Estimation
Cuturi, L. F., & MacNeilage, P. R. (2013) · PLoS ONE · doi:10.1371/journal.pone.0056862 · Cited by 60 · see citing works
Integration of audiovisual spatial signals is not consistent with maximum likelihood estimation
Meijer, D., Veselič, S., Calafiore, C., & Noppeney, U. (2019) · Cortex · doi:10.1016/j.cortex.2019.03.026 · Cited by 60 · see citing works
Contributions of visual and proprioceptive information to travelled distance estimation during changing sensory congruencies
Campos, J. L., Butler, J. S., & Bülthoff, H. (2014) · Experimental Brain Research · doi:10.1007/s00221-014-4011-0 · Cited by 57 · see citing works
Self-citation
A standing posture is associated with increased susceptibility to the sound-induced flash illusion in fall-prone older adults
Stapleton, J., Setti, A., Doheny, E. P., Kenny, R. A., & Newell, F. N. (2013) · Experimental Brain Research · doi:10.1007/s00221-013-3750-7 · Cited by 57 · see citing works
Cognitive load reduces the effects of optic flow on gait and electrocortical dynamics during treadmill walking
Malcolm, B. R., Foxe, J. J., Butler, J. S., Molholm, S., & Sanctis, P. D. (2018) · Journal of Neurophysiology · doi:10.1152/jn.00079.2018 · Cited by 55 · see citing works
Self-citation
Learning to integrate contradictory multisensory self-motion cue pairings
Kaliuzhna, M., Prsa, M., Gale, S., Lee, S. J., & Blanke, O. (2015) · Journal of Vision · doi:10.1167/15.1.10 · Cited by 55 · see citing works
NeuroBayesSLAM: Neurobiologically inspired Bayesian integration of multisensory information for robot navigation
Zeng, T., Tang, F., Ji, D., & Si, B. (2020) · Neural Networks · doi:10.1016/j.neunet.2020.02.023 · Cited by 52 · see citing works
Computational Characterization of Visually Induced Auditory Spatial Adaptation
Wozny, D. R., & Shams, L. B. (2011) · Frontiers in Integrative Neuroscience · doi:10.3389/fnint.2011.00075 · Cited by 54 · see citing works
Causal Inference in Multisensory Heading Estimation
de Winkel, K. N., Katliar, M., & Bülthoff, H. (2017) · PLoS ONE · doi:10.1371/journal.pone.0169676 · Cited by 53 · see citing works
The Role of Stereo Vision in Visual–Vestibular Integration
Butler, J. S., Campos, J. L., Bülthoff, H., & Smith, S. (2011) · Seeing and Perceiving · doi:10.1163/187847511x588070 · Cited by 51 · see citing works
Self-citation
Optimal visual–vestibular integration under conditions of conflicting intersensory motion profiles
Butler, J. S., Campos, J. L., & Bülthoff, H. (2014) · Experimental Brain Research · doi:10.1007/s00221-014-4136-1 · Cited by 49 · see citing works
Self-citation
Multisensory Integration of Visual and Vestibular Signals Improves Heading Discrimination in the Presence of a Moving Object
Dokka, K., DeAngelis, G. C., & Angelaki, D. E. (2015) · Journal of Neuroscience · doi:10.1523/jneurosci.2267-15.2015 · Cited by 51 · see citing works
Visual–vestibular integration during self-motion perception in younger and older adults.
Ramkhalawansingh, R., Butler, J. S., & Campos, J. L. (2018) · Psychology and Aging · doi:10.1037/pag0000271 · Cited by 49 · see citing works
Self-citation
Making Sense of the Body: the Role of Vestibular Signals
Christophe Lopez, A. (2015) · Multisensory Research · doi:10.1163/22134808-00002490 · Cited by 50 · see citing works
Supervised Calibration Relies on the Multisensory Percept
Zaidel, A., Ma, W. J., & Angelaki, D. E. (2013) · Neuron · doi:10.1016/j.neuron.2013.09.026 · Cited by 50 · see citing works
Binding body and self in visuo‐vestibular conflicts
Macauda, G., Bertolini, G., Palla, A., Straumann, D., Brugger, P., & Lenggenhager, B. (2014) · European Journal of Neuroscience · doi:10.1111/ejn.12809 · Cited by 47 · see citing works
Shape Perception and Navigation in Blind Adults
Gori, M., Cappagli, G., Baud‐Bovy, G., & Finocchietti, S. (2017) · Frontiers in Psychology · doi:10.3389/fpsyg.2017.00010 · Cited by 47 · see citing works
Integration of sensory information precedes the sensation of vection: A combined behavioral and event-related brain potential (ERP) study
Keshavarz, B., & Berti, S. (2014) · Behavioural Brain Research · doi:10.1016/j.bbr.2013.10.045 · Cited by 46 · see citing works
Forced Fusion in Multisensory Heading Estimation
de Winkel, K. N., Katliar, M., & Bülthoff, H. (2015) · PLoS ONE · doi:10.1371/journal.pone.0127104 · Cited by 47 · see citing works
Vestibular System and Self-Motion
Cheng, Z., & Gu, Y. (2018) · Frontiers in Cellular Neuroscience · doi:10.3389/fncel.2018.00456 · Cited by 45 · see citing works
Statistically optimal integration of biased sensory estimates
Scarfe, P., & Hibbard, P. B. (2011) · Journal of Vision · doi:10.1167/11.7.12 · Cited by 44 · see citing works
Variability in the Vestibulo-Ocular Reflex and Vestibular Perception
Nouri, S., & Karmali, F. (2018) · Neuroscience · doi:10.1016/j.neuroscience.2018.08.025 · Cited by 45 · see citing works
Mathematical models for dynamic, multisensory spatial orientation perception
Clark, T. K., Newman, M. C., Karmali, F., Oman, C. M., & Merfeld, D. M. (2019) · Progress in brain research · doi:10.1016/bs.pbr.2019.04.014 · Cited by 44 · see citing works
Visual self-motion cues are impaired yet overweighted during visual–vestibular integration in Parkinson’s disease
Yakubovich, S., Israeli‐Korn, S., Halperin, O., Yahalom, G., Hassin‐Baer, S., & Zaidel, A. (2020) · Brain Communications · doi:10.1093/braincomms/fcaa035 · Cited by 43 · see citing works
Bioinspired Artificial Motion Sensory System for Rotation Recognition and Rapid Self-Protection
Chen, Z., Yu, R., Yu, X., Li, E., Wang, C., Liu, Y., Guo, T., & Chen, H. (2022) · ACS Nano · doi:10.1021/acsnano.2c08328 · Cited by 45 · see citing works
Image correlates of crowding in natural scenes
Wallis, T. S. A., & Bex, P. J. (2012) · Journal of Vision · doi:10.1167/12.7.6 · Cited by 43 · see citing works
The brain weights body‐based cues higher than vision when estimating walked distances
Campos, J. L., Byrne, P., & Sun, H. (2010) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2010.07212.x · Cited by 43 · see citing works
Self-citation
Distributed Visual–Vestibular Processing in the Cerebral Cortex of Man and Macaque
Smith, A. T., Greenlee, M. W., DeAngelis, G. C., & Angelaki, D. E. (2017) · Multisensory Research · doi:10.1163/22134808-00002568 · Cited by 42 · see citing works
Sensory Contributions to Spatial Knowledge of Real and Virtual Environments
Waller, D. A., & Hodgson, E. (2013) · Springer eBooks · doi:10.1007/978-1-4419-8432-6_1 · Cited by 41 · see citing works
Heading Tuning in Macaque Area V6
Fan, R. H., Liu, S., DeAngelis, G. C., & Angelaki, D. E. (2015) · Journal of Neuroscience · doi:10.1523/jneurosci.2903-15.2015 · Cited by 40 · see citing works
Reliability-Based Weighting of Visual and Vestibular Cues in Displacement Estimation
ter Horst, A. C., Koppen, M., Selen, L. P. J., & Medendorp, W. P. (2015) · PLoS ONE · doi:10.1371/journal.pone.0145015 · Cited by 39 · see citing works
Integration of visual and inertial cues in the perception of angular self-motion
de Winkel, K. N., Soyka, F., Barnett‐Cowan, M., Bülthoff, H., Groen, E. L., & Werkhoven, P. J. (2013) · Experimental Brain Research · doi:10.1007/s00221-013-3683-1 · Cited by 41 · see citing works
Bayesian optimal adaptation explains age-related human sensorimotor changes
Karmali, F., Whitman, G. T., & Lewis, R. F. (2017) · Journal of Neurophysiology · doi:10.1152/jn.00710.2017 · Cited by 39 · see citing works
Self‐motion perception in Parkinson's disease
Halperin, O., Israeli‐Korn, S., Yakubovich, S., Hassin‐Baer, S., & Zaidel, A. (2020) · European Journal of Neuroscience · doi:10.1111/ejn.14716 · Cited by 37 · see citing works
Audiovisual Integration of Time-to-Contact Information for Approaching Objects
DeLucia, P. R., Preddy, D., & Oberfeld, D. (2015) · Multisensory Research · doi:10.1163/22134808-00002520 · Cited by 37 · see citing works
The Effect of Motion Direction and Eccentricity on Vection, VR Sickness and Head Movements in Virtual Reality
Pöhlmann, K. M. T., Föcker, J., Dickinson, P., Parke, A., & O’Hare, L. (2021) · Multisensory Research · doi:10.1163/22134808-bja10049 · Cited by 38 · see citing works
Sensory Evidence Accumulation Using Optic Flow in a Naturalistic Navigation Task
Alefantis, P., Lakshminarasimhan, K. J., Avila, E., Noel, J., Pitkow, X., & Angelaki, D. E. (2022) · Journal of Neuroscience · doi:10.1523/jneurosci.2203-21.2022 · Cited by 32 · see citing works
Reducing Cybersickness in 360-Degree Virtual Reality
Arshad, I., Mello, P. D., Ender, M., McEwen, J. D., & Ferrè, E. R. (2021) · Multisensory Research · doi:10.1163/22134808-bja10066 · Cited by 39 · see citing works
Vestibular signals in primate cortex for self-motion perception
Gu, Y. (2018) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2018.04.004 · Cited by 36 · see citing works
Temporal binding of auditory and rotational stimuli
Sanders, M. C., Chang, N.-Y. N., Hiss, M. M., Uchanski, R. M., & Hullar, T. E. (2011) · Experimental Brain Research · doi:10.1007/s00221-011-2554-x · Cited by 34 · see citing works
The Impact of Oral Promethazine on Human Whole-Body Motion Perceptual Thresholds
Diaz‐Artiles, A., Priesol, A. J., Clark, T. K., Sherwood, D. P., Oman, C. M., Young, L. R., & Karmali, F. (2017) · Journal of the Association for Research in Otolaryngology · doi:10.1007/s10162-017-0622-z · Cited by 35 · see citing works
Visual memorability in the absence of semantic content
Lin, Q., Yousif, S. R., Chun, M. M., & Scholl, B. J. (2021) · Cognition · doi:10.1016/j.cognition.2021.104714 · Cited by 34 · see citing works
Human manual control precision depends on vestibular sensory precision and gravitational magnitude
Rosenberg, M. J. F., Galvan-Garza, R. C., Clark, T. K., Sherwood, D. P., Young, L. R., & Karmali, F. (2018) · Journal of Neurophysiology · doi:10.1152/jn.00565.2018 · Cited by 33 · see citing works
Integration of visual and non-visual self-motion cues during voluntary head movements in the human brain
Schindler, A., & Bartels, A. (2018) · NeuroImage · doi:10.1016/j.neuroimage.2018.02.006 · Cited by 33 · see citing works
Cortical Integration of Vestibular and Visual Cues for Navigation, Visual Processing, and Perception
Keshavarzi, S., Vélez‐Fort, M., & Margrie, T. W. (2023) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-120722-100503 · Cited by 31 · see citing works
Multisensory Interactions in Virtual Reality: Optic Flow Reduces Vestibular Sensitivity, but Only for Congruent Planes of Motion
Gallagher, M., Choi, R., & Ferrè, E. R. (2020) · Multisensory Research · doi:10.1163/22134808-20201487 · Cited by 34 · see citing works
Statistically Optimal Cue Integration During Human Spatial Navigation
Newman, P. M., Qi, Y., Mou, W., & McNamara, T. P. (2023) · Psychonomic Bulletin & Review · doi:10.3758/s13423-023-02254-w · Cited by 31 · see citing works
Identification and validation of a driver steering control model incorporating human sensory dynamics
Nash, C., & Cole, D. J. (2019) · Vehicle System Dynamics · doi:10.1080/00423114.2019.1589536 · Cited by 29 · see citing works
Visual Attention Modulates Glutamate-Glutamine Levels in Vestibular Cortex: Evidence from Magnetic Resonance Spectroscopy
Frank, S., Forster, L., Pawellek, M., Malloni, W. M., Ahn, S., Tse, P. U., & Greenlee, M. W. (2021) · Journal of Neuroscience · doi:10.1523/jneurosci.2018-20.2020 · Cited by 29 · see citing works
Multimodal Integration during Self-Motion in Virtual Reality
Campos, J. L., & Bülthoff, H. (2011) · Frontiers in neuroscience · doi:10.1201/b11092-38 · Cited by 36 · see citing works
Self-citation
Visual-Vestibular Conflict Detection Depends on Fixation
Garzorz, I. T., & MacNeilage, P. R. (2017) · Current Biology · doi:10.1016/j.cub.2017.08.011 · Cited by 28 · see citing works
Inference of perceptual priors from path dynamics of passive self-motion
Prsa, M., Jimenez-Rezende, D., & Blanke, O. (2014) · Journal of Neurophysiology · doi:10.1152/jn.00755.2014 · Cited by 25 · see citing works
Dynamics of individual perceptual decisions
Merfeld, D. M., Clark, T. K., Lu, Y. M., & Karmali, F. (2015) · Journal of Neurophysiology · doi:10.1152/jn.00225.2015 · Cited by 27 · see citing works
Integration of visual landmark cues in spatial memory
Newman, P. M., & McNamara, T. P. (2021) · Psychological Research · doi:10.1007/s00426-021-01581-8 · Cited by 26 · see citing works
Age Differences in Visual-Auditory Self-Motion Perception during a Simulated Driving Task
Ramkhalawansingh, R., Keshavarz, B., Haycock, B., Shahab, S., & Campos, J. L. (2016) · Frontiers in Psychology · doi:10.3389/fpsyg.2016.00595 · Cited by 26 · see citing works
Self-citation
Age-related changes to vestibular heave and pitch perception and associations with postural control
Gabriel, G. A., Harris, L. R., Gnanasegaram, J. J., Cushing, S. L., Gordon, K. A., Haycock, B., & Campos, J. L. (2022) · Scientific Reports · doi:10.1038/s41598-022-09807-4 · Cited by 25 · see citing works
Self-citation
Temporal synchrony effects of optic flow and vestibular inputs on multisensory heading perception
Zheng, Q., Zhou, L., & Gu, Y. (2021) · Cell Reports · doi:10.1016/j.celrep.2021.109999 · Cited by 22 · see citing works
Influence of optic flow on the control of heading and target egocentric direction during steering toward a goal
Li, L., & Niehorster, D. C. (2014) · Journal of Neurophysiology · doi:10.1152/jn.00697.2013 · Cited by 23 · see citing works
Multisensory effects on somatosensation: a trimodal visuo-vestibular-tactile interaction
Kaliuzhna, M., Ferrè, E. R., Herbelin, B., Blanke, O., & Haggard, P. (2016) · Scientific Reports · doi:10.1038/srep26301 · Cited by 26 · see citing works
Modelling the influence of sensory dynamics on linear and nonlinear driver steering control
Nash, C., & Cole, D. J. (2017) · Vehicle System Dynamics · doi:10.1080/00423114.2017.1326615 · Cited by 23 · see citing works
Computational models of multisensory integration
Meijer, D., & Noppeney, U. (2019) · Elsevier eBooks · doi:10.1016/b978-0-12-812492-5.00005-x · Cited by 23 · see citing works
Neural correlates of oddball detection in self-motion heading: A high-density event-related potential study of vestibular integration
Nolan, H., Butler, J. S., Whelan, R., Foxe, J. J., Bülthoff, H., & Reilly, R. B. (2012) · Experimental Brain Research · doi:10.1007/s00221-012-3059-y · Cited by 22 · see citing works
Self-citation
Enabling Unconstrained Omnidirectional Walking Through Virtual Environments: An Overview of the CyberWalk Project
Frissen, I., Campos, J. L., Sreenivasa, M., & Ernst, M. O. (2013) · Springer eBooks · doi:10.1007/978-1-4419-8432-6_6 · Cited by 22 · see citing works
Self-citation
Interhemispheric control of sensory cue integration and self-motion perception
Arshad, Q., Ortega, M. C., Goga, U., Lobo, R., Siddiqui, S., Mediratta, S., Bednarczuk, N. F., Kaski, D. N., & Bronstein, A. M. (2019) · Neuroscience · doi:10.1016/j.neuroscience.2019.04.027 · Cited by 22 · see citing works
Benefits of commitment in hierarchical inference.
Qiu, C., Luu, L., & Stocker, A. A. (2020) · Psychological Review · doi:10.1037/rev0000193 · Cited by 20 · see citing works
Causal inference regulates audiovisual spatial recalibration via its influence on audiovisual perception
Hong, F., Badde, S., & Landy, M. S. (2021) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1008877 · Cited by 21 · see citing works

Visual-vestibular cue integration for heading perception: applications of optimal cue integration theory
Fetsch, C. R., DeAngelis, G. C., & Angelaki, D. E. (2010) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2010.07207.x · Cited by 154 · see citing works
Learning to integrate contradictory multisensory self-motion cue pairings
Kaliuzhna, M., Prsa, M., Gale, S., Lee, S. J., & Blanke, O. (2015) · Journal of Vision · doi:10.1167/15.1.10 · Cited by 55 · see citing works
Dynamic Reweighting of Visual and Vestibular Cues during Self-Motion Perception
Fetsch, C. R., Turner, A. H., DeAngelis, G. C., & Angelaki, D. E. (2009) · Journal of Neuroscience · doi:10.1523/jneurosci.2574-09.2009 · Cited by 406 · see citing works
Optimal visual–vestibular integration under conditions of conflicting intersensory motion profiles
Butler, J. S., Campos, J. L., & Bülthoff, H. (2014) · Experimental Brain Research · doi:10.1007/s00221-014-4136-1 · Cited by 49 · see citing works
Self-citation
The Role of Stereo Vision in Visual–Vestibular Integration
Butler, J. S., Campos, J. L., Bülthoff, H., & Smith, S. (2011) · Seeing and Perceiving · doi:10.1163/187847511x588070 · Cited by 51 · see citing works
Self-citation

Authors: Butler, J. S., Smith, S. T., Campos, J. L., & Bulthoff, H. H.
Affiliations: Albert Einstein College of Medicine (US)
Neuroscience Research Australia (AU)
University of Toronto (CA)
Corresponding author: Butler, J. S.
Smith, S. T.
Campos, J. L.
ORCID: Butler, J. S.
Smith, S. T.
Campos, J. L.
Venue: Journal of Vision
Publisher: Association for Research in Vision and Ophthalmology (ARVO)
Published: 2010-09-23
Volume: 10
Issue: 11
Pages: 23-23
ISSN: 1534-7362 (ISSN-L)
DOI: 10.1167/10.11.23
OpenAlex: W2152174583
Cited by: 250
References: 65
Citations by year: 2026: 8 · 2025: 10 · 2024: 13 · 2023: 19 · 2022: 12 · 2021: 22 · 2020: 19 · 2019: 15 · 2018: 25 · 2017: 24 · 2016: 12 · 2015: 19 · 2014: 10 · 2013: 17 · 2012: 10
FWCI: 17.59
Type: journal article
Language: en
Open access: gold
doi.org
Locations: Journal of Vision (publishedVersion)
PubMed (publishedVersion)
eCite Digital Repository (University of Tasmania) (submittedVersion)
Topics: Social Sciences › Psychology › Experimental and Cognitive Psychology › Multisensory perception and integration
Life Sciences › Neuroscience › Cognitive Neuroscience › Visual perception and processing mechanisms
Life Sciences › Neuroscience › Neurology › Vestibular and auditory disorders
Keywords: heading perception, visual-vestibular integration, cue weighting, self-motion perception, vestibular cues, visual cues, variance reduction
MeSH terms: Adult, Bayes Theorem, Cues, Female, Humans, Male, Motion Perception, Photic Stimulation, Proprioception, Rotation, Vestibule, Labyrinth, Young Adult

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Bayesian integration of visual and vestibular signals for heading

Abstract

Integrity signals

Claims the paper makes

Claims other papers make about this one

Cites

Cited by

Related

Record

About these checks