Identification of Visual Stimuli is Improved by Accompanying Auditory Stimuli: The Role of Eye Movements and Sound Location
The DOI matches its Crossref record; 44 of the 44 references it cites were found in a registry or an index.
Abstract
Can auditory signals influence the processing of visual information? The present study examined the effects of simple auditory signals (clicks and noise bursts) whose onset was simultaneous with that of the visual target, but which provided no information about the target. It was found that such a signal enhances performance in the visual task: the accessory sound reduced response times for target identification with no cost to accuracy. The spatial location of the sound (whether central to the display or at the target location) did not modify this facilitation. Furthermore, the same pattern of facilitation was evident whether the observer fixated centrally or moved their eyes to the target. The results were not altered by changes in the contrast (and therefore visibility) of the visual stimulus or by the perceived utility of the spatial location of the sound. We speculate that the auditory signal may promote attentional ‘disengagement’ and that, as a result, observers are able to process the visual target sooner when sound accompanies the display relative to when visual information is presented alone.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Multimodal stimuli are typically perceived more precisely and faster than unimodal stimuli (Doyle & Snowden, 2001;Forster, Cavina-Pratesi, Aglioti, & Berlucchi, 2002;Fort, Delpuech, Pernier, & Giard, 2002;G i a r d&P e r o n n e t , 1999).”
From Augmented visual, auditory, haptic, and multimodal feedback in motor learning: A review (2013) · cites this paper as Doyle & Snowden, 2001
Citations
Cites
Society for Neuroscience 2007 abstracts
Wishart, T. M., Paterson, J. M., Short, D. M., Meredith, S., Robertson, K., Sutherland, C. D., Cousin, M. A., Dutia, M. B., & Gillingwater, T. H. (2007) · Cited by 2,094
The role of attention in the programming of saccades
Kowler, E., Anderson, E., Dosher, B., & Blaser, E. (1995) · Vision Research · doi:10.1016/0042-6989(94)00279-u · Cited by 1,302
Visual dominance: An information-processing account of its origins and significance.
Posner, M. I., Nissen, M. J., & Klein, R. M. (1976) · Psychological Review · doi:10.1037//0033-295x.83.2.157 · Cited by 1,097
A model of saccade generation based on parallel processing and competitive inhibition
Findlay, J. M., & Walker, R. (1999) · Behavioral and Brain Sciences · doi:10.1017/s0140525x99002150 · Cited by 730
DIVISION OF PSYCHOLOGY : STATISTICAL FACILITATION OF SIMPLE REACTION TIMES*
Raab, D. H. (1962) · Transactions of the New York Academy of Sciences · doi:10.1111/j.2164-0947.1962.tb01433.x · Cited by 668
Express saccades and visual attention
Fischer, B., & Weber, H. (1993) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00031575 · Cited by 666
Shared neural control of attentional shifts and eye movements
Kustov, A. A., & Lee Robinson, D. (1996) · Nature · doi:10.1038/384074a0 · Cited by 632
Aviation, space and environmental medicine
(1990) · Journal of Sound and Vibration · doi:10.1016/0022-460x(90)90650-o · Cited by 625
Audiovisual links in exogenous covert spatial orienting
Spence, C., & Driver, J. (1997) · Perception & Psychophysics · doi:10.3758/bf03206843 · Cited by 475
Reaction time as a measure of intersensory facilitation.
Hershenson, M. (1962) · Journal of Experimental Psychology · doi:10.1037/h0039516 · Cited by 418
Stein, B. E., Meredith, M. A., Huneycutt, W. S., & McDade, L. (1989) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.1989.1.1.12 · Cited by 394
Latency for Saccadic Eye Movement*
Saslow, M. G. (1967) · Journal of the Optical Society of America · doi:10.1364/josa.57.001030 · Cited by 382
Covert spatial orienting in audition: Exogenous and endogenous mechanisms.
Spence, C. J., & Driver, J. (1994) · Journal of Experimental Psychology Human Perception & Performance · doi:10.1037//0096-1523.20.3.555 · Cited by 366
Audiovisual links in endogenous covert spatial attention.
Spence, C. J., & Driver, J. (1996) · Journal of Experimental Psychology Human Perception & Performance · doi:10.1037//0096-1523.22.4.1005 · Cited by 365
Yantis, S. (1998) · Cited by 339
Spatial and temporal factors determine auditory-visual interactions in human saccadic eye movements
Frens, M. A., Van Opstal, A. J., & Van Der Willigen, R. F. (1995) · Perception & Psychophysics · doi:10.3758/bf03206796 · Cited by 326
Intersensory facilitation of reaction time: Energy summation or preparation enhancement?
Nickerson, R. S. (1973) · Psychological Review · doi:10.1037/h0035437 · Cited by 318
Enhancement of selective listening by illusory mislocation of speech sounds due to lip-reading
Driver, J. (1996) · Nature · doi:10.1038/381066a0 · Cited by 315
Endogenous and Exogenous Control of Visual Selection
Theeuwes, J. (1994) · Perception · doi:10.1068/p230429 · Cited by 273
Visual-auditory interactions in sensorimotor processing: Saccades versus manual responses.
Hughes, H. C., Reuter‐Lorenz, P. A., Nozawa, G., & Fendrich, R. (1994) · Journal of Experimental Psychology Human Perception & Performance · doi:10.1037//0096-1523.20.1.131 · Cited by 252
Automatic visual bias of perceived auditory location
Bertelson, P., & Aschersleben, G. (1998) · Psychonomic Bulletin & Review · doi:10.3758/bf03208826 · Cited by 252
Neurons and behavior: the same rules of multisensory integration apply
Stein, B. E., Scott Huneycutt, W., & Alex Meredith, M. (1988) · Brain Research · doi:10.1016/0006-8993(88)91276-0 · Cited by 249
Cognitive neuroscience of attention: A developmental perspective
Hood, B. M., Atkinson, J. W., & Braddick, O. (1998) · Cited by 205
Auditory psychomotor coordination and visual search performance
Perrott, D. R., Saberi, K., Brown, K., & Strybel, T. Z. (1990) · Perception & Psychophysics · doi:10.3758/bf03211521 · Cited by 178
Saccade latency and warning signals: Effects of auditory and visual stimulus onset and offset
Ross, S. M., & Ross, L. E. (1981) · Perception & Psychophysics · doi:10.3758/bf03207356 · Cited by 170
Effects of some variations in auditory input upon visual choice reaction time.
Bernstein, I. H., & Edelstein, B. A. (1971) · Journal of Experimental Psychology · doi:10.1037/h0030524 · Cited by 167
Mackeben, M., & Nakayama, K. (1993) · Vision Research · doi:10.1016/0042-6989(93)90061-z · Cited by 167
On the nature of intersensory facilitation of reaction time
Gielen, S. C. A. M., Schmidt, R. A., & Van Den Heuvel, P. J. M. (1983) · Perception & Psychophysics · doi:10.3758/bf03211343 · Cited by 165
Transactions of the New York Academy of Sciences
(2012) · Transactions of the New York Academy of Sciences · doi:10.1111/(issn)2164-0947 · Cited by 151
Effects of an irrelevant auditory stimulus on visual choice reaction time.
Simon, J., & Craft, J. L. (1970) · Journal of Experimental Psychology · doi:10.1037/h0029961 · Cited by 143
Experimental study of the influence of vision on sound localization.
Thomas, G. J. (1941) · Journal of Experimental Psychology · doi:10.1037/h0055183 · Cited by 126
The Influence of Auditory and Visual Distractors on Human Orienting Gaze Shifts
Corneil, B. D., & Munoz, D. P. (1996) · Journal of Neuroscience · doi:10.1523/jneurosci.16-24-08193.1996 · Cited by 121
Effects of an auditory signal on visual reaction time.
Bernstein, I. H., Clark, M., & Edelstein, B. A. (1969) · Journal of Experimental Psychology · doi:10.1037/h0027444 · Cited by 107
Perrott, D. R., Sadralodabai, T., Saberi, K., & Strybel, T. Z. (1991) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/001872089103300402 · Cited by 98
Nozawa, G., Reuter‐Lorenz, P. A., & Hughes, H. C. (1994) · Biological Cybernetics · doi:10.1007/bf00206235 · Cited by 88
Attentional and ocular movements.
Stelmach, L. B., Campsall, J. M., & Herdman, C. M. (1997) · Journal of Experimental Psychology: Human Perception and Performance · doi:10.1037//0096-1523.23.3.823 · Cited by 81
Auditory-visual interaction in the generation of saccades in man
Lueck, C. J., Crawford, T. J., Savage, C., & Kennard, C. (1990) · Experimental Brain Research · doi:10.1007/bf00230846 · Cited by 79
Can we see and hear at the same time?
Bernstein, I. H. (1970) · Acta Psychologica · doi:10.1016/0001-6918(70)90119-8 · Cited by 66
Saccadic eye movements in response to visual, auditory, and bisensory stimuli.
Engelken, E. J., & Stevens, K. W. (1989) · PubMed · Cited by 66
Munoz, D., & Corneil, B. D. (1995) · Experimental Brain Research · doi:10.1007/bf00241974 · Cited by 60
Intersensory facilitation of reaction time
Morrell, L. K. (1967) · Psychonomic Science · doi:10.3758/bf03330675 · Cited by 40
Simultaneous auditory stimuli shorten saccade latencies
Konrad, H. R., Rea, C., Olin, B., & Colliver, J. A. (1989) · The Laryngoscope · doi:10.1288/00005537-198912000-00004 · Cited by 40
Auditory accessory effects on visual processing
Keuss, P. J. G., van der Zee, F., & van den Bree, M. B. M. (1990) · Acta Psychologica · doi:10.1016/0001-6918(90)90065-n · Cited by 18
Cross-modality effects upon choice reaction time
Morrell, L. K. (1968) · Psychonomic Science · doi:10.3758/bf03331007 · Cited by 17
Research works printed but not linked: 12
- Costin D, 1991, Society of Neuroscience Abstracts, 17, 656
- Doyle M, 1999, Facilitatory Effects of Response-irrelevant Sound upon Acquisition of Visual Targets
- 10.1037/0096-1523.20.1.131 · doi:10.1037/0096-1523.20.1.131 · Paper page
- Kimmig H, 1986, Express Sakkaden beim Menschen: die Rolle der Aufmerksamkeit in der Vorbereitungs-phase zielgerichteter Blicksrunge
- Morrell L K, 1968, Psychonomic Science, 77, 14
- 10.1037/0033-295X.83.2.157 · doi:10.1037/0033-295x.83.2.157 · Paper page
- 10.1037/0096-1523.22.4.1005 · DOI · Paper page
- 10.1037/0096-1523.20.3.555 · doi:10.1037/0096-1523.20.3.555 · Paper page
- Stein B E, 1994, The Merging of the Senses
- 10.1037/0096-1523.23.3.823 · doi:10.1037/0096-1523.23.3.823 · Paper page
- Todd J W, 1912, Archives of Psychology, 3, 1
- Yantis S, 1998, Attention, 223
Cited by
Augmented visual, auditory, haptic, and multimodal feedback in motor learning: A review
Sigrist, R., Rauter, G., Riener, R., & Wolf, P. (2013) · Psychonomic Bulletin & Review · doi:10.3758/s13423-012-0333-8 · Cited by 1,416
“Multimodal stimuli are typically perceived more precisely and faster than unimodal stimuli (Doyle & Snowden, 2001; Forster, Cavina-Pratesi, Aglioti, & Berlucchi, 2002; Fort, Delpuech, Pernier, & Giard, 2002; Giard & Peronnet, 1999).”
BackgroundMultisensory integration: methodological approaches and emerging principles in the human brain.
Calvert, G. A., & Thesen, T. (2004) · Journal of Physiology-Paris · doi:10.1016/j.jphysparis.2004.03.018 · Cited by 425
“[21] M.”
ResultAssessing the Effectiveness of Various Auditory Cues in Capturing a Driver's Visual Attention.
Ho, C., & Spence, C. (2005) · Journal of Experimental Psychology: Applied · doi:10.1037/1076-898x.11.3.157 · Cited by 228
“Doyle and Snowden (2001) have suggested that spatial auditory information may be more useful in situations where the information presented visually is more demanding.”
BackgroundCrossmodal influences on visual perception
Shams, L., & Kim, R. (2010) · Physics of Life Reviews · doi:10.1016/j.plrev.2010.04.006 · Cited by 227
“Whereas in these studies the auditory cue was spatially and temporally informative, Doyle and Snowden [18] found that even an uninformative auditory signal aided visual processing, in the form of reduced reaction time in a visual identification task.”
BackgroundSensory dominance in combinations of audio, visual and haptic stimuli
Hecht, D., & Reiner, M. (2009) · Experimental Brain Research · doi:10.1007/s00221-008-1626-z · Cited by 193
“Typically, compounds of multi-sensory signals are detected faster than when the same signals are presented separately—a phenomenon known as multisensory enhancement (Hershenson 1962; Doyle and Snowden 2001; Forster et al. 2002; Fort et al. 2002; Hecht et al. 2008a, b).”
Metadata
- Authors
- Doyle, M. C., & Snowden, R. J.
- Affiliations
- Cardiff University (GB)
- Corresponding author
- Snowden, Robert J
- ORCID
- Snowden, Robert J
- Venue
- Perception
- Publisher
- SAGE Publications
- Published
- 2001-07
- Volume
- 30
- Issue
- 7
- Pages
- 795-810
- ISSN
- 0301-0066 (ISSN-L)
- 1468-4233
- OpenAlex
- W2056771075
- Cited by
- 66
- References
- 44
- Citations by year
- 2026: 4 · 2025: 3 · 2024: 3 · 2023: 4 · 2022: 3 · 2020: 3 · 2019: 2 · 2018: 3 · 2017: 2 · 2016: 1 · 2015: 4 · 2014: 2 · 2013: 3 · 2012: 7
- FWCI
- 1.49
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
- Locations
- Perception (publishedVersion)
- PubMed (publishedVersion)
- ORCA Online Research @Cardiff (Cardiff University) (acceptedVersion)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Multisensory perception and integration
- Life Sciences › Neuroscience › Cognitive Neuroscience › Visual perception and processing mechanisms
- Life Sciences › Neuroscience › Cognitive Neuroscience › Tactile and Sensory Interactions
- Keywords
- auditory-visual interaction, target identification, eye movements, sound localization, auditory cues, reaction time (psychology), attentional disengagement, visual attention, stimulus contrast
- MeSH terms
- Adolescent, Adult, Analysis of Variance, Attention, Auditory Perception, Discrimination, Psychological, Eye Movements, Humans, Lighting, Reaction Time, Sound Localization, Visual Perception, Contrast Sensitivity
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.