CoChat
Sign Up
Cited by 940Multisensory perception and integrationTactile and Sensory InteractionsVisual perception and processing mechanisms

Multisensory interplay reveals crossmodal influences on ‘sensory-specific’ brain regions, neural responses, and judgments

Open access
Driver, Jon, Noesselt, Toemme·2008·Neuron
DOI 10.1016/j.neuron.2007.12.013PMC PMC2427054
Open this paper in CoChat — free account

Abstract

Although much traditional sensory research has studied each sensory modality in isolation, there has been a recent explosion of interest in causal interplay between different senses. Various techniques have now identified numerous multisensory convergence zones in the brain. Some convergence may arise surprisingly close to low-level sensory-specific cortex, and some direct connections may exist even between primary sensory cortices. A variety of multisensory phenomena have now been reported in which sensory-specific brain responses and perceptual judgments concerning one sense can be affected by relations with other senses. We survey recent progress in this multisensory field, foregrounding human studies against the background of invasive animal work and highlighting possible underlying mechanisms. These include rapid feedforward integration, possible thalamic influences, and/or feedback from multisensory regions to sensory-specific brain areas. Multisensory interplay is more prevalent than classic modular approaches assumed, and new methods are now available to determine the underlying circuits.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1016/j.neuron.2007.12.013

Cites

8 of 8 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Modalities of perceptual input are often incomplete, and the brain needs to generate predictions by integrating information from other modalities.

    “This is because modalities of perceptual input (auditory, visual, tactile and olfactory) are often incomplete, and the brain needs to generate predictions by integrating information from other modalities (Driver and Noesselt, 2008).”

    From Connecting minds and sharing emotions through mimicry: A neurocognitive model of emotional contagion (2017) · cites this paper as Driver and Noesselt, 2008

    The Behavioral and Perceptual Consequences section (page not available) says information from different senses can be combined to form a joint estimate, with contributions weighted by reliability. It does not say that perceptual inputs are often incomplete or that the brain needs to generate predictions because of that incompleteness. (LLM, conf=0.84)

    Experimental — accuracy not yet measured

  • Neural activity related to multisensory interactions can be seen surprisingly close to cortical areas typically considered unimodal.

    “Neural activity related to multisensory interactions can be seen surprisingly close to cortical areas typically considered unimodal (Driver & Noesselt, 2008).”

    From Designing sensory-substitution devices: Principles, pitfalls and potential1 (2016) · cites this paper as Driver & Noesselt, 2008

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 140

  1. Alais D. Burr D. The ventriloquist effect results from near-optimal bimodal integration Curr. Biol. 14 2004 257 262 14761661
  2. Allman B.L. Meredith M.A. Multisensory processing in “unimodal” neurons: cross-modal subthreshold auditory effects in cat extrastriate visual cortex J. Neurophysiol. 98 2007 545 549 17475717
  3. Amedi A. Jacobson G. Hendler T. Malach R. Zohary E. Convergence of visual and tactile shape processing in the human lateral occipital complex Cereb. Cortex 12 2002 1202 1212 12379608
  4. Arden G.B. Wolf J.E. Messiter C. Electrical activity in visual cortex associated with combined auditory and visual stimulation in temporal sequences known to be associated with a visual illusion Vision Res. 43 2003 2469 2478 12972396
  5. Barbas H. Medalla M. Alade O. Suski J. Zikopoulos B. Lera P. Relationship of prefrontal connections to inhibitory systems in superior temporal areas in the rhesus monkey Cereb. Cortex 15 2005 1356 1370 15635060
  6. Barraclough N.E. Xiao D. Baker C.I. Oram M.W. Perrett D.I. Integration of visual and auditory information by superior temporal sulcus neurons responsive to the sight of actions J. Cogn. Neurosci. 17 2005 377 391 15813999
  7. Bavelier D. Neville H.J. Cross-modal plasticity: where and how? Nat. Rev. Neurosci. 3 2002 443 452 12042879
  8. Bavelier D. Dye M.W. Hauser P.C. Do deaf individuals see better? Trends Cogn. Sci. 10 2006 512 518 17015029 PMC2885708
  9. Beauchamp M.S. See me, hear me, touch me: multisensory integration in lateral occipital-temporal cortex Curr. Opin. Neurobiol. 15 2005 145 153 15831395
  10. Beauchamp M.S. Statistical criteria in FMRI studies of multisensory integration Neuroinformatics 3 2005 93 113 15988040 PMC2843559
  11. Beauchamp M.S. Argall B.D. Bodurka J. Duyn J.H. Martin A. Unraveling multisensory integration: patchy organization within human STS multisensory cortex Nat. Neurosci. 7 2004 1190 1192 15475952
  12. Berger T.D. Martelli M. Pelli D.G. Flicker flutter: is an illusory event as good as the real thing? J. Vis. 3 2003 406 412 12901711
  13. Bizley J.K. Nodal F.R. Bajo V.M. Nelken I. King A.J. Physiological and anatomical evidence for multisensory interactins in auditory cortex Cereb. Cortex 17 2007 2172 2189 17135481 PMC7116518
  14. Bolognini N. Rasi F. Coccia M. Ladavas E. Visual search improvement in hemianopic patients after audio-visual stimulation Brain 128 2005 2830 2842 16219672
  15. Bonath B. Noesselt T. Martinez A. Mishra J. Schwiecker K. Heinze H.-J. Hillyard S.A. Neural basis of the ventriloquist illusion Curr. Biol. 17 2007 1697 1703 17884498
  16. Brosch M. Selezneva E. Scheich H. Nonauditory events of a behavioral procedure activate auditory cortex of highly trained monkeys J. Neurosci. 25 2005 6797 6806 16033889 PMC6725347
  17. Bruce C. Desimone R. Gross C.G. Visual properties of neurons in a polysensory area in superior temporal sulcus of the macaque J. Neurophysiol. 46 1981 369 384 6267219
  18. Budinger E. Heil P. Hess A. Scheich H. Multisensory processing via early cortical stages: Connections of the primary auditory cortical field with other sensory systems Neuroscience 143 2006 1065 1083 17027173
  19. Budinger E. Laszcz A. Lison H. Scheich H. Ohl F.W. Non-sensory cortical and subcortical connections of the primary auditory cortex in Mongolian gerbils: Bottom-up and top-down processing of neuronal information via field AI Brain Res. 2007 in press. Published online August 22, 2007 17964556
  20. Bullier J. Hupe J.M. James A.C. Girard P. The role of feedback connections in shaping the responses of visual cortical neurons Prog. Brain Res. 134 2001 193 204 11702544
  21. Busse L. Roberts K.C. Crist R.E. Weissman D.H. Woldorff M.G. The spread of attention across modalities and space in a multisensory object Proc. Natl. Acad. Sci. USA 102 2005 18751 18756 16339900 PMC1317940
  22. Calvert G.A. Bullmore E.T. Brammer M.J. Campbell R. Williams S.C. McGuire P.K. Woodruff P.W. Iversen S.D. David A.S. Activation of auditory cortex during silent lipreading Science 276 1997 593 596 9110978
  23. Calvert G.A. Brammer M.J. Bullmore E.T. Campbell R. Iversen S.D. David A.S. Response amplification in sensory-specific cortices during crossmodal binding Neuroreport 10 1999 2619 2623 10574380
  24. Calvert G.A. Hansen P.C. Iversen S.D. Brammer M.J. Detection of audio-visual integration sites in humans by application of electrophysiological criteria to the BOLD effect Neuroimage 14 2001 427 438 11467916
  25. Calvert G.A. Stein B.E. Spence C. The Handbook of Multisensory Processing 2004 MIT Press Cambridge, MA
  26. Cappe C. Barone P. Heteromodal connections supporting multisensory integration at low levels of cortical processing in the monkey Eur. J. Neurosci. 22 2005 2886 2902 16324124
  27. Clavagnier S. Falchier A. Kennedy H. Long-distance feedback projections to area V1: implications for multisensory integration, spatial awareness, and visual consciousness Cogn. Affect. Behav. Neurosci. 4 2004 117 126 15460918
  28. Cohen Y.E. Andersen R.A. Multimodal spatial representations in the primate parietal lobe Spence C. Driver J. Crossmodal Space and Crossmodal Attention 2004 Oxford University Press Oxford 277 319
  29. Cusick C.G. The superior temporal polysensory region in monkeys Rockland K.S. Kaas J.H. Peters A. Cerebral Cortex: Extrastriate cortex in primates 1997 Plenum Press New York 435 463
  30. de la Mothe L.A. Blumell S. Kajikawa Y. Hackett T.A. Thalamic connections of the auditory cortex in marmoset monkeys: core and medial belt regions J. Comp. Neurol. 496 2006 72 96 16528728 PMC4419740
  31. Dehner L.R. Keniston L.P. Clemo H.R. Meredith M.A. Cross-modal circuitry between auditory and somatosensory areas of the cat anterior ectosylvian sulcal cortex: a ‘new’ inhibitory form of multisensory convergence Cereb. Cortex 14 2004 387 403 15028643
  32. Driver J. Spence C. Multisensory perception: beyond modularity and convergence Curr. Biol. 10 2000 731 735 11069095
  33. Duhamel J.R. Colby C.L. Goldberg M.E. Ventral intraparietal area of the macaque: congruent visual and somatic response properties J. Neurophysiol. 79 1998 126 136 9425183
  34. Ernst M.O. Bulthoff H.H. Merging the senses into a robust percept Trends Cogn. Sci. 8 2004 162 169 15050512
  35. Farne A. Dematte M.L. Ladavas E. Neuropsychological evidence of modular organization of the near peripersonal space Neurology 65 2005 1754 1758 16344519
  36. Fendrich R. Corballis P.M. The temporal cross-capture of audition and vision Percept. Psychophys. 63 2001 719 725 11436740
  37. Fishman M.C. Michael P. Integration of auditory information in the cat's visual cortex Vision Res. 13 1973 1415 1419 4719075
  38. Frassinetti F. Bolognini N. Ladavas E. Enhancement of visual perception by crossmodal visuo-auditory interaction Exp. Brain Res. 147 2002 332 343 12428141
  39. Fu K.M. Shah A.S. O'Connell M.N. McGinnis T. Eckholdt H. Lakatos P. Smiley J. Schroeder C.E. Timing and laminar profile of eye-position effects on auditory responses in primate auditory cortex J. Neurophysiol. 92 2004 3522 3531 15282263
  40. Ghazanfar A.A. Schroeder C.E. Is neocortex essentially multisensory? Trends Cogn. Sci. 10 2006 278 285 16713325
  41. Ghazanfar A.A. Maier J.X. Hoffman K.L. Logothetis N.K. Multisensory integration of dynamic faces and voices in rhesus monkey auditory cortex J. Neurosci. 25 2005 5004 5012 15901781 PMC6724848
  42. Gougoux F. Zatorre R.J. Lassonde M. Voss P. Lepore F. A functional neuroimaging study of sound localization: visual cortex activity predicts performance in early-blind individuals PLoS Biol. 3 2005 e27 15678166 PMC544927
  43. Goyal M.S. Hansen P.J. Blakemore C.B. Tactile perception recruits functionally related visual areas in the late-blind Neuroreport 17 2006 1381 1384 16932143
  44. Graziano M.S. Taylor C.S. Moore T. Complex movements evoked by microstimulation of precentral cortex Neuron 34 2002 841 851 12062029
  45. Grill-Spector K. Henson R. Martin A. Repetition and the brain: neural models of stimulus-specific effects Trends Cogn. Sci. 10 2006 14 23 16321563
  46. Hackett T.A. De La Mothe L.A. Ulbert I. Karmos G. Smiley J. Schroeder C.E. Multisensory convergence in auditory cortex, II. Thalamocortical connections of the caudal superior temporal plane J. Comp. Neurol. 502 2007 924 952 17444488
  47. Hashikawa T. Raussell E. Molinari M. Jones E.G. Parvalbumin- and calbindin- containing neurons in the monkey medial geniculate complex: differential distribution and cortical layer specific projections Brain Res. 544 1991 335 341 2039948
  48. Helbig H.B. Ernst M.O. Optimal integration of shape information from vision and touch Exp. Brain Res. 179 2007 595 606 17225091
  49. Holmes N.P. The law of inverse effectiveness in neurons and behaviour: Multisensory integration versus normal variability Neuropsychologia 45 2007 3340 3345 17663007
  50. Hunt D.L. Yamoah E.N. Krubitzer L. Multisensory plasticity in congenitally deaf mice: how are cortical areas functionally specified? Neuroscience 139 2006 1507 1524 16529873
  51. Jiang W. Wallace M.T. Jiang H. Vaughan J.W. Stein B.E. Two cortical areas mediate multisensory integration in superior colliculus neurons J. Neurophysiol. 85 2001 506 522 11160489
  52. Jiang W. Jiang H. Stein B.E. Two corticotectal areas facilitate multisensory orientation behavior J. Cogn. Neurosci. 14 2002 1240 1255 12495529
  53. Jiang W. Jiang H. Rowland B.A. Stein B.E. Multisensory orientation behavior is disrupted by neonatal cortical ablation J. Neurophysiol. 97 2007 557 562 16971678
  54. Kaas J.H. Collins C.E. The Resurrection of Multisensory Cortex in Primates Calvert G.A. Spence C. Stein B.E. The Handbook of Multisensory Processes 2004 Bradford Cambridge, MA 285 294
  55. Kastner S. Pinsk M.A. De Weerd P. Desimone R. Ungerleider L.G. Increased activity in human visual cortex during directed attention in the absence of visual stimulation Neuron 22 1999 751 761 10230795
  56. Kayser C. Logothetis N.K. Do early sensory cortices integrate cross-modal information? Brain Struct. Funct. 212 2007 121 132 17717687
  57. Kayser C. Petkov C.I. Augath M. Logothetis N.K. Integration of touch and sound in auditory cortex Neuron 48 2005 373 384 16242415
  58. Kayser C. Petkov C.I. Augath M. Logothetis N.K. Functional imaging reveals visual modulation of specific fields in auditory cortex J. Neurosci. 27 2007 1824 1835 17314280 PMC6673538
  59. Kennett S. Eimer M. Spence C. Driver J. Tactile-visual links in exogenous spatial attention under different postures: convergent evidence from psychophysics and ERPs J. Cogn. Neurosci. 13 2001 462 478 11388920
  60. Kriegstein K.V. Kleinschmidt A. Sterzer P. Giraud A.L. Interaction of face and voice areas during speaker recognition J. Cogn. Neurosci. 17 2005 367 376 15813998
  61. Krubitzer L. Künzle H. Kaas J. Organization of sensory cortex in a Madagascan insectivore, the tenrec (Echinops telfairi) J. Comp. Neurol. 379 1997 399 414 9067832
  62. Ladavas E. Pavani F. Farne A. Auditory peripersonal space in humans: a case of auditory-tactile extinction Neurocase 7 2001 97 103 11320157
  63. Lakatos P. Chen C.M. O'Connell M.N. Mills A. Schroeder C.E. Neuronal oscillations and multisensory interaction in primary auditory cortex Neuron 53 2007 279 292 17224408 PMC3717319
  64. Laurienti P.J. Perrault T.J. Stanford T.R. Wallace M.T. Stein B.E. On the use of superadditivity as a metric for characterizing multisensory integration in functional neuroimaging studies Exp. Brain Res. 166 2005 289 297 15988597
  65. Lomber S.G. Galuske R.A.W. Virtual Lesions: Examining Cortical Function with Reversible Deactivation 2002 Oxford University Press Oxford
  66. Lovelace C.T. Stein B.E. Wallace M.T. An irrelevant light enhances auditory detection in humans: a psychophysical analysis of multisensory integration in stimulus detection Brain Res. Cogn. Brain Res. 17 2003 447 453 12880914
  67. Macaluso E. Driver J. Multisensory spatial interactions: a window onto functional integration in the human brain Trends Neurosci. 28 2005 264 271 15866201
  68. Macaluso E. Frith C.D. Driver J. Modulation of human visual cortex by crossmodal spatial attention Science 289 2000 1206 1208 10947990
  69. Macaluso E. Frith C.D. Driver J. Crossmodal spatial influences of touch on extrastriate visual areas take current gaze direction into account Neuron 34 2002 647 658 12062047
  70. Majewska A.K. Sur M. Plasticity and specificity of cortical processing networks Trends Neurosci. 29 2006 323 329 16697057
  71. Malhotra S. Hall A.J. Lomber S.G. Cortical control of sound localization in the cat: unilateral cooling deactivation of 19 cerebral areas J. Neurophysiol. 92 2004 1625 1643 15331649
  72. Martínez A. Anllo-Vento L. Sereno M.I. Frank L.R. Buxton R.B. Dubowitz D.J. Wong E.C. Hinrichs H. Heinze H.-J. Hillyard S.A. Involvement of striate and extrastriate visual cortical areas in spatial attention Nat. Neurosci. 2 1999 364 369 10204544
  73. Martuzzi R. Murray M.M. Michel C.M. Thiran J.P. Maeder P.P. Clarke S. Meuli R.A. Multisensory interactions within human primary cortices revealed by BOLD dynamics Cereb. Cortex 17 2007 1672 1679 16968869
  74. McDonald J.J. Teder-Salejarvi W.A. Hillyard S.A. Involuntary orienting to sound improves visual perception Nature 407 2000 906 908 11057669
  75. McDonald J.J. Teder-Salejarvi W.A. Di Russo F. Hillyard S.A. Neural substrates of perceptual enhancement by cross-modal spatial attention J. Cogn. Neurosci. 15 2003 10 19 12590839
  76. McDonald J.J. Teder-Salejarvi W.A. Di Russo F. Hillyard S.A. Neural basis of auditory-induced shifts in visual time-order perception Nat. Neurosci. 8 2005 1197 1202 16056224
  77. Merabet L.B. Maguire D. Warde A. Alterescu K. Stickgold R. Pascual-Leone A. Visual hallucinations during prolonged blindfolding in sighted subjects J. Neuroophthalmol. 24 2004 109 113 15179062
  78. Meredith M.A. Stein B.E. Interactions among converging sensory inputs in the superior colliculus Science 221 1983 389 391 6867718
  79. Meredith M.A. Stein B.E. Visual, auditory, and somatosensory convergence on cells in superior colliculus results in multisensory integration J. Neurophysiol. 56 1986 640 662 3537225
  80. Mesulam M.M. From sensation to cognition Brain 121 1998 1013 1052 9648540
  81. Miller L.M. D'Esposito M. Perceptual fusion and stimulus coincidence in the cross-modal integration of speech J. Neurosci. 25 2005 5884 5893 15976077 PMC6724802
  82. Mishra J. Martinez A. Sejnowski T.J. Hillyard S.A. Early cross-modal interactions in auditory and visual cortex underlie a sound-induced visual illusion J. Neurosci. 27 2007 4120 4131 17428990 PMC2905511
  83. Molholm S. Ritter W. Murray M.M. Javitt D.C. Schroeder C.E. Foxe J.J. Multisensory auditory-visual interactions during early sensory processing in humans: a high-density electrical mapping study Brain Res. Cogn. Brain Res. 14 2002 115 128 12063135
  84. Molholm S. Ritter W. Javitt D.C. Foxe J.J. Multisensory visual-auditory object recognition in humans: a high-density electrical mapping study Cereb. Cortex 14 2004 452 465 15028649
  85. Molholm S. Sehatpour P. Mehta A.D. Shpaner M. Gomez-Ramirez M. Ortigue S. Dyke J.P. Schwartz T.H. Foxe J.J. Audio-visual multisensory integration in superior parietal lobule revealed by human intracranial recordings J. Neurophysiol. 96 2006 721 729 16687619
  86. Morrell F. Visual system's view of acoustic space Nature 238 1972 44 46 12635274
  87. Murray M.M. Molholm S. Michel C.M. Heslenfeld D.J. Ritter W. Javitt D.C. Schroeder C.E. Foxe J.J. Grabbing your ear: rapid auditory-somatosensory multisensory interactions in low-level sensory cortices are not constrained by stimulus alignment Cereb. Cortex 15 2005 963 974 15537674
  88. Nagy A. Eordegh G. Paroczy Z. Markus Z. Benedek G. Multisensory integration in the basal ganglia Eur. J. Neurosci. 24 2006 917 924 16930419
  89. Noesselt T. Hillyard S.A. Woldorff M.G. Schoenfeld A. Hagner T. Jäncke L. Tempelmann C. Hinrichs H. Heinze H.-J. Delayed striate cortical activation during spatial attention Neuron 35 2002 575 587 12165478
  90. Noesselt T. Rieger J.W. Schoenfeld M.A. Kanowski M. Hinrichs H. Heinze H. Driver J. Audiovisual temporal correspondence modulates human multisensory superior temporal sulcus plus primary sensory cortices J. Neurosci. 27 2007 11431 11441 17942738 PMC2957075
  91. Padberg J. Seltzer B. Cusick C.G. Architectonics and cortical connections of the upper bank of the superior temporal sulcus in the rhesus monkey: an analysis in the tangential plane J. Comp. Neurol. 467 2003 418 434 14608603
  92. Petrides M. Iversen S.D. The effect of selective anterior and posterior association cortex lesions in the monkey on performance of a visual-auditory compound discrimination test Neuropsychologia 16 1978 527 537 104188
  93. Rauschecker J.P. Tian B. Mechanisms and streams for processing of “what” and “where” in auditory cortex Proc. Natl. Acad. Sci. USA 97 2000 11800 11806 11050212 PMC34352
  94. Recanzone G.H. Auditory influences on visual temporal rate perception J. Neurophysiol. 89 2003 1078 1093 12574482
  95. Redgrave P. Simkins M. McHaffie J.G. Stein B.E. Nociceptive neurones in rat superior colliculus. II. Effects of lesions to the contralateral descending output pathway on nocifensive behaviours Exp. Brain Res. 109 1996 197 208 8738370
  96. Rockland K.S. Ojima H. Multisensory convergence in calcarine visual areas in macaque monkey Int. J. Psychophysiol. 50 2003 19 26 14511833
  97. Roder B. Teder-Sälejärvi W. Sterr A. Rösler F. Hillyard S.A. Neville H.J. Improved auditory spatial tuning in blind humans Nature 400 1999 162 166 10408442
  98. Rouiller E.M. Simm G.M. Villa A. Ribaupierre Y. Ribaupierre F.D. Auditory corticocortical interconnections in the cat: evidence for parallel and hierarchical arrangement of the auditory cortical areas Exp. Brain Res. 86 1991 483 503 1722171
  99. Ruff C.C. Blankenburg F. Bjoertomt O. Bestmann S. Freeman E. Haynes J.D. Rees G. Josephs O. Deichmann R. Driver J. Concurrent TMS-fMRI and psychophysics reveal frontal influences on human retinotopic visual cortex Curr. Biol. 16 2006 1479 1488 16890523
  100. Sadato N. Pascual-Leone A. Grafman J. Ibanez V. Deiber M.P. Dold G. Hallett M. Activation of the primary visual cortex by Braille reading in blind subjects Nature 380 1996 526 528 8606771
  101. Scheich H. Brechmann A. Brosch M. Budinger E. Ohl F.W. The cognitive auditory cortex: Task-specificity of stimulus representations Hear. Res. 229 2007 213 224 17368987
  102. Schmahmann J.D. Pandya D.N. Projections to the basis pontis from the superior temporal sulcus and superior temporal region in the rhesus monkey J. Comp. Neurol. 308 1991 224 248 1716269
  103. Schroeder C.E. Foxe J.J. The timing and laminar profile of converging inputs to multisensory areas of the macaque neocortex Brain Res. Cogn. Brain Res. 14 2002 187 198 12063142
  104. Schroeder C.E. Foxe J. Multisensory contributions to low-level, ‘unisensory’ processing Curr. Opin. Neurobiol. 15 2005 454 458 16019202
  105. Schroeder C.E. Smiley J. Fu K.G. McGinnis T. O'Connell M.N. Hackett T.A. Anatomical mechanisms and functional implications of multisensory convergence in early cortical processing Int. J. Psychophysiol. 50 2003 5 17 14511832
  106. Senkowski D. Talsma D. Herrmann C.S. Woldorff M.G. Multisensory processing and oscillatory gamma responses: effects of spatial selective attention Exp. Brain Res. 166 2005 411 426 16151775
  107. Senkowski D. Talsma D. Grigutsch M. Herrmann C.S. Woldorff M.G. Good times for multisensory integration: Effects of the precision of temporal synchrony as revealed by gamma-band oscillations Neuropsychologia 45 2007 561 571 16542688
  108. Shams L. Kamitani Y. Shimojo S. Illusions. What you see is what you hear Nature 408 2000 788 11130706
  109. Shams L. Kamitani Y. Thompson S. Shimojo S. Sound alters visual evoked potentials in humans Neuroreport 12 2001 3849 3852 11726807
  110. Shipley T. Auditory flutter-driving of visual flicker Science 145 1964 1328 1330 14173429
  111. Slotnick S.D. Thompson W.L. Kosslyn S.M. Visual mental imagery induces retinotopically organized activation of early visual areas Cereb. Cortex 15 2005 1570 1583 15689519
  112. Smiley J.F. Hackett T.A. Ulbert I. Karmas G. Lakatos P. Javitt D.C. Schroeder C.E. Multisensory convergence in auditory cortex, I. Cortical connections of the caudal superior temporal plane in macaque monkeys J. Comp. Neurol. 502 2007 894 923 17447261
  113. Smith A.L. Parsons C.H. Lanyon R.G. Bizley J.K. Akerman C.J. Baker G.E. Dempster A.C. Thompson I.D. King A.J. An investigation of the role of auditory cortex in sound localization using muscimol-releasing Elvax Eur. J. Neurosci. 19 2004 3059 3072 15182314
  114. Spence C. Driver J. Crossmodal Space and Crossmodal Attention 2004 Oxford University Press Oxford
  115. Spence C. McDonald J. Driver J. Exogenous spatial-cuing studies of human crossmodal attention and multisensory integration Spence C. Driver J. Crossmodal Space and Crossmodal Attention 2004 Oxford University Press Oxford 277 319
  116. Spinelli D.N. Starr A. Barrett T.W. Auditory specificity in unit recordings from cat's visual cortex Exp. Neurol. 22 1968 75 84 5687686
  117. Stein B.E. Development and organization of multimodal representation in cat superior colliculus Fed. Proc. 37 1978 2240 2245 658465
  118. Stein B.E. Arigbede M.O. Unimodal and multimodal response properties of neurons in the cat's superior colliculus Exp. Neurol. 36 1972 179 196 4558413
  119. Stein B.E. Meredith M.A. Multisensory integration. Neural and behavioral solutions for dealing with stimuli from different sensory modalities Ann. N Y Acad. Sci. 608 1990 51 65 2075959
  120. Stein B.E. Meredith M.E. The Merging of the Sense 1993 The MIT Press Cambridge, MA
  121. Stein B.E. Huneycutt W.S. Meredith M.A. Neurons and behavior: the same rules of multisensory integration apply Brain Res. 448 1988 355 358 3378157
  122. Stein B.E. Stanford T.R. Wallace M.T. Vaughan J.W. Jiang W. Crossmodal spatial interactions in subcortical and cortical circuits Spence C. Driver J. Crossmodal Space and Crossmodal Attention 2004 Oxford University Press Oxford 25 50
  123. Sugihara T. Diltz M.D. Averbeck B.B. Romanski L.M. Integration of auditory and visual communication information in the primate ventrolateral prefrontal cortex J. Neurosci. 26 2006 11138 11147 17065454 PMC2767253
  124. Talsma D. Woldorff M.G. Selective attention and multisensory integration: multiple phases of effects on the evoked brain activity J. Cogn. Neurosci. 17 2005 1098 1114 16102239
  125. Talsma D. Doty T.J. Strowd R. Woldorff M.G. Attentional capacity for processing concurrent stimuli is larger across sensory modalities than within a modality Psychophysiology 43 2006 541 549 17076810
  126. Teder-Salejarvi W.A. McDonald J.J. Di Russo F. Hillyard S.A. An analysis of audio-visual crossmodal integration by means of event-related potential (ERP) recordings Cogn. Brain Res. 14 2002 106 114 12063134
  127. Teder-Salejarvi W.A. Di Russo F. McDonald J.J. Hillyard S.A. Effects of spatial congruity on audio-visual multimodal integration J. Cogn. Neurosci. 17 2005 1396 1409 16197693
  128. Ungerleider L.G. Mishkin M. Two cortical visual systems Analysis of Visual Behavior 1982 MIT Press Cambride, MA 549 586
  129. Van Essen D.C. Anderson C.H. Felleman D.J. Information processing in the primate visual system: an integrated systems perspective Science 255 1992 419 423 1734518
  130. Vatakis A. Spence C. Crossmodal binding: evaluating the “unity assumption” using audiovisual speech stimuli Percept. Psychophys. 69 2007 744 756 17929697
  131. Vibell J. Klinge C. Zampini M. Spence C. Nobre A.C. Temporal order is coded temporally in the brain: early event-related potential latency shifts underlying prior entry in a cross-modal temporal order judgment task J. Cogn. Neurosci. 19 2007 109 120 17214568
  132. Vroomen J. de Gelder B. Sound enhances visual perception: cross-modal effects of auditory organization on vision J. Exp. Psychol. Hum. Percept. Perform. 26 2000 1583 1590 11039486
  133. Vroomen J. de Gelder B. Ventriloquism and the Freezing Phenomenon Calvert G.A. Spence C. Stein B.E. The Handbook of Multisensory Processes 2004 The MIT Press Cambridge, MA 141 150
  134. Wallace M.T. Ramachandran R. Stein B.E. A revised view of sensory cortical parcellation Proc. Natl. Acad. Sci. USA 101 2004 2167 2172 14766982 PMC357070
  135. Wallace M.T. Carriere B.N. Perrault T.J. Vaughan J.W. Stein B.E. The development of cortical multisensory integration J. Neurosci. 26 2006 11844 11849 17108157 PMC6674880
  136. Wang Q. Burkhalter A. Area map of mouse visual cortex J. Comp. Neurol. 502 2007 339 357 17366604
  137. Watkins S. Shams L. Tanaka S. Haynes J.D. Rees G. Sound alters activity in human V1 in association with illusory visual perception Neuroimage 31 2006 1247 1256 16556505
  138. Welch R.B. Warren D.H. Intersensory interactions Boff K. Kaufmann L. Thomas J. Handbook of Perception and Human Performance: Sensory Processes and Perception 1986 Wiley-Interscience New York 1 36
  139. Werner-Reiss U. Kelly K.A. Trause A.S. Underhill A.M. Groh J.M. Eye position affects activity in primary auditory cortex of primates Curr. Biol. 13 2003 554 562 12676085
  140. Zampini M. Shore D.I. Spence C. Multisensory temporal order judgments: the role of hemispheric redundancy Int. J. Psychophysiol. 50 2003 165 180 14511844

Cited by

Sorted by citations

Authors
Driver, J., & Noesselt, T.
Affiliations
University College London (GB)
Corresponding author
  • Driver, Jon
  • Noesselt, Toemme
ORCID
Noesselt, Toemme
Venue
Neuron
Publisher
Elsevier BV
Published
2008-01
Volume
57
Issue
1
Pages
11-23
ISSN
0896-6273 (ISSN-L)
DOI
10.1016/j.neuron.2007.12.013
PMC
PMC2427054
OpenAlex
W2129409783
Cited by
940
References
8
Citations by year
2026: 20 · 2025: 41 · 2024: 35 · 2023: 47 · 2022: 40 · 2021: 48 · 2020: 43 · 2019: 53 · 2018: 47 · 2017: 62 · 2016: 55 · 2015: 61 · 2014: 53 · 2013: 61 · 2012: 65
FWCI
7.66
Type
journal article
Language
en
Open access
Licence
Locations
  • Neuron (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • UCL Discovery (University College London) (submittedVersion)
Funders
  • Wellcome Trust
  • Deutsche Forschungsgemeinschaft
  • Medical Research Council
Topics
  • Social Sciences › Psychology › Experimental and Cognitive Psychology › Multisensory perception and integration
  • Life Sciences › Neuroscience › Cognitive Neuroscience › Tactile and Sensory Interactions
  • Life Sciences › Neuroscience › Cognitive Neuroscience › Visual perception and processing mechanisms
Keywords
multisensory integration, primary sensory cortices, perceptual judgment, neural responses
MeSH terms
Brain, Brain Mapping, Humans, Judgment, Models, Neurological, Neural Pathways, Perception

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review