Vision and touch are automatically integrated for the perception of sequences of events
Open accessThe DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.
Abstract
The purpose of the present experiment was to investigate the integration of sequences of visual and tactile events. Subjects were presented with sequences of visual flashes and tactile taps simultaneously and instructed to count either the flashes (Session 1) or the taps (Session 2). The number of flashes could differ from the number of taps by +/-1. For both sessions, the perceived number of events was significantly influenced by the number of events presented in the task-irrelevant modality. Touch had a stronger influence on vision than vision on touch. Interestingly, touch was the more reliable of the two modalities-less variable estimates when presented alone. For both sessions, the perceptual estimates were less variable when stimuli were presented in both modalities than when the task-relevant modality was presented alone. These results indicate that even when one signal is explicitly task irrelevant, sensory information tends to be automatically integrated across modalities. They also suggest that the relative weight of each sensory channel in the integration process depends on its relative reliability. The results are described using a Bayesian probabilistic model for multimodal integration that accounts for the coupling between the sensory estimates.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Humans integrate visual and haptic information in a statistically optimal fashion
Ernst, M. O., & Banks, M. S. (2002) · Nature · doi:10.1038/415429a · Cited by 4,844
Self-citationThe Ventriloquist Effect Results from Near-Optimal Bimodal Integration
Alais, D., & Burr, D. (2004) · Current Biology · doi:10.1016/j.cub.2004.01.029 · Cited by 1,936 · cited 3×
“Such principle is functionally highly relevant if one considers that integrating multimodal signals reduces the variance of the perceptual estimates (Alais & Burr, 2004; Ernst & Banks, 2002; Gepshtein & Banks, 2003; Landy et al., 1995; Wu, Basdogan, & Srinivasan, 1999) and enhances stimulus…”
BackgroundMethodMerging the senses into a robust percept
Ernst, M. O., & Bülthoff, H. H. (2004) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2004.02.002 · Cited by 1,906 · cited 6×
“The visual scene was presented on a CRT monitor mounted upside down, and the subjects viewed its reflection in an opaque mirror (for a description of the apparatus, see Ernst & Banks, 2002 ). The visual scene consisted of a red central fixation cross (1 deg of visual angle) displayed for the whole duration of each ses…”
BackgroundMethodInfluentialSelf-citationShams, L., Kamitani, Y., & Shimojo, S. (2000) · Nature · doi:10.1038/35048669 · Cited by 1,262 · cited 4×
“Previous experiments using a similar paradigm demonstrated automatic combination of sensory signals (Bresciani et al., 2005; Hötting & Röder, 2004; Shams et al., 2000; Violentyev et al., 2005).”
BackgroundMethodInfluentialImmediate perceptual response to intersensory discrepancy.
Welch, R. B., & Warren, D. H. (1980) · Psychological Bulletin · doi:10.1037/0033-2909.88.3.638 · Cited by 1,176 · cited 4×
“This pattern of results suggests a winner-takeall integration in which the most appropriate channel fully dominates less appropriate ones (for a review, see Welch & Warren, 1980 ).”
BackgroundInfluentialA Bayesian View on Multimodal Cue Integration
Ernst, M. O. (2005) · Human Body Perception From The Inside Out · doi:10.1093/oso/9780195178371.003.0006 · Cited by 209
Self-citationHearing cheats touch, but less in congenitally blind than in sighted individuals
Hötting, K., & Röder, B. (2004) · Psychological Science · doi:10.1111/j.0963-7214.2004.01501010.x · Cited by 136
Cited by
Crossmodal correspondences: A tutorial review
Spence, C. (2011) · Attention, Perception, & Psychophysics · doi:10.3758/s13414-010-0073-7 · Cited by 1,618
Causal Inference in Multisensory Perception
Körding, K. P., Beierholm, U., Ma, W. J., Quartz, S., Tenenbaum, J. B., & Shams, L. (2007) · PLoS ONE · doi:10.1371/journal.pone.0000943 · Cited by 1,069
“Very good fits to human performance have been shown for the combination of two cues [13,14,17,18].”
BackgroundMethodResultInfluentialA Bayesian foundation for individual learning under uncertainty
Mathys, C. (2011) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2011.00039 · Cited by 655
The statistical determinants of adaptation rate in human reaching
Burge, J., Ernst, M. O., & Banks, M. S. (2008) · Journal of Vision · doi:10.1167/8.4.20 · Cited by 400
Self-citationCausal inference in perception
Shams, L., & Beierholm, U. R. (2010) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2010.07.001 · Cited by 403
Learning to integrate arbitrary signals from vision and touch
Ernst, M. O. (2007) · Journal of Vision · doi:10.1167/7.5.7 · Cited by 332
Self-citationMultisensory Processing in Review: from Physiology to Behaviour
Alais, D., Newell, F., & Mamassian, P. (2010) · Seeing and Perceiving · doi:10.1163/187847510x488603 · Cited by 324
Probability matching as a computational strategy used in perception
Wozny, D. R., Beierholm, U. R., & Shams, L. (2010) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1000871 · Cited by 265
Parise, C. V., & Spence, C. (2009) · PLoS ONE · doi:10.1371/journal.pone.0005664 · Cited by 272
(2011) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780195387247.001.0001 · Cited by 252
Distortions of Subjective Time Perception Within and Across Senses
van Wassenhove, V., Buonomano, D. V., Shimojo, S., & Shams, L. (2008) · PLoS ONE · doi:10.1371/journal.pone.0001437 · Cited by 239
“Future studies should investigate alternative models of multisensory perception [46,69,70] to examine whether models that do not a priori assume integration across sensory modalities can better account for multisensory interactions in time perception.”
BackgroundSteinbach, E., Hirche, S., Ernst, M., Brandi, F., Chaudhari, R., Kammerl, J., & Vittorias, I. (2012) · Proceedings of the IEEE · doi:10.1109/jproc.2011.2182100 · Cited by 198
“…from various perceptual situations, which back this result up and which thereby demonstrate that multisensory integration is a general principle used by the human brain to reduce uncertainty and to increase perceptual performance [29], [30], [31], [32], [33], [34], [35], [36], [37], [38], [39].”
BackgroundSelf-citationZhang, W.-H., Wang, H., Chen, A., Gu, Y., Lee, T. S., Wong, K. M., & Wu, S. (2019) · eLife · doi:10.7554/elife.43753 · Cited by 45
Metadata
- Authors
- Bresciani, J.-P., Dammeier, F., & Ernst, M. O.
- Venue
- Journal of Vision
- Published
- 2006-04-20
- Volume
- 6
- Issue
- 5
- Pages
- 2
- ISSN
- 1534-7362 (ISSN-L)
- OpenAlex
- W2121861296
- Cited by
- 178
- References
- 7
- FWCI
- 16.53
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.