Sound enhances visual perception: Cross-modal effects of auditory organization on vision.

Abstract

Six experiments demonstrated cross-modal influences from the auditory modality on the visual modality at an early level of perceptual organization. Participants had to detect a visual target in a rapidly changing sequence of visual distractors. A high tone embedded in a sequence of low tones improved detection of a synchronously presented visual target (Experiment 1), but the effect disappeared when the high tone was presented before the target (Experiment 2). Rhythmically based or order-based anticipation was unlikely to account for the effect because the improvement was unaffected by whether there was jitter (Experiment 3) or a random number of distractors between successive targets (Experiment 4). The facilitatory effect was greatly reduced when the tone was less abrupt and part of a melody (Experiments 5 and 6). These results show that perceptual organization in the auditory modality can have an effect on perceptibility in the visual modality.

Cites (3)

1. Hearing lips and seeing voices
   MCGURK, HARRY, MACDONALD, JOHN · 1976 · Nature
2. Auditory-Visual Integration during Multimodal Object Recognition in Humans: A Behavioral and Electrophysiological Study
   Giard, M. H., Peronnet, F. · 1999 · Journal of Cognitive Neuroscience
3. Audiovisual links in exogenous covert spatial orienting
   Spence, Charles, Driver, Jon · 1997 · Perception & Psychophysics

Show all 3 references

Cited by (15)

1. Multisensory interplay reveals crossmodal influences on ‘sensory-specific’ brain regions, neural responses, and judgments
   Driver, Jon, Noesselt, Toemme · 2008 · Neuron
2. The multifaceted interplay between attention and multisensory integration.
   Talsma, Durk, Senkowski, Daniel, Soto-Faraco, Salvador, Woldorff, Marty G. · 2010 · Trends in Cognitive Sciences
3. Pip and pop: Nonspatial auditory signals improve spatial visual search.
   Van der Burg, Erik, Olivers, Christian N. L., Bronkhorst, Adelbert W., Theeuwes, Jan · 2008 · Journal of Experimental Psychology: Human Perception and Performance
4. Multisensory perception: Beyond modularity and convergence
   Driver, Jon, Spence, Charles · 2000 · Current Biology
5. Do early sensory cortices integrate cross-modal information?
   Kayser, Christoph, Logothetis, Nikos K. · 2007 · Brain Structure and Function

See all 434