The DOI matches its Crossref record; 75 of the 75 references it cites were found in a registry or an index.
Multisensory Visual-Auditory Object Recognition in Humans: a High-density Electrical Mapping Study
Abstract
Multisensory object-recognition processes were investigated by examining the combined influence of visual and auditory inputs upon object identification--in this case, pictures and vocalizations of animals. Behaviorally, subjects were significantly faster and more accurate at identifying targets when the picture and vocalization were matched (i.e. from the same animal), than when the target was represented in only one sensory modality. This behavioral enhancement was accompanied by a modulation of the evoked potential in the latency range and general topographic region of the visual evoked N1 component, which is associated with early feature processing in the ventral visual stream. High-density topographic mapping and dipole modeling of this multisensory effect were consistent with generators in lateral occipito-temporal cortices, suggesting that auditory inputs were modulating processing in regions of the lateral occipital cortices. Both the timing and scalp topography of this modulation suggests that there are multisensory effects during what is considered to be a relatively early stage of visual object-recognition processes, and that this modulation occurs in regions of the visual system that have traditionally been held to be unisensory processing areas. Multisensory inputs also modulated the visual 'selection-negativity', an attention dependent component of the evoked potential this is usually evoked when subjects selectively attend to a particular feature of a visual stimulus.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The fusiform face area: a module in human extrastriate cortex specialized for face perception
Kanwisher, N., McDermott, J., & Chun, M. M. (1997) · The Journal of Neuroscience · doi:10.1523/jneurosci.17-11-04302.1997 · Cited by 7,738 · cited 2×
“These object processing functions have been extensively investigated through both functional imaging and ERP studies, and object processing in humans has been specifically associated with neuronal activation in a cluster of brain regions in the ventral visual stream known as the lateral occipital complex (LOC; e.g. Ko…”
BackgroundHearing lips and seeing voices
MCGURK, H., & MACDONALD, J. (1976) · Nature · doi:10.1038/264746a0 · Cited by 6,183
Snodgrass, J. G., & Vanderwart, M. (1980) · Journal of Experimental Psychology Human Learning & Memory · doi:10.1037//0278-7393.6.2.174 · Cited by 5,615
Reading Senseless Sentences: Brain Potentials Reflect Semantic Incongruity
Kutas, M., & Hillyard, S. A. (1980) · Science · doi:10.1126/science.7350657 · Cited by 4,888
Ungerleider, L. G. (1982) · Medical Entomology and Zoology · Cited by 4,531
Early selective-attention effect on evoked potential reinterpreted
Näätänen, R., Gaillard, A. W. K., & Mäntysalo, S. (1978) · Acta Psychologica · doi:10.1016/0001-6918(78)90006-9 · Cited by 2,706
Visual Contribution to Speech Intelligibility in Noise
Sumby, W. H., & Pollack, I. (1954) · The Journal of the Acoustical Society of America · doi:10.1121/1.1907309 · Cited by 2,583 · cited 2×
“McGurk and MacDonald, 1976), or enhance speech perception in a noisy environment ( Sumby and Pollack, 1954; Campbell and Dodd, 1980; MacLeod and Summerfield, 1990; Thompson, 1995).”
BackgroundElectrophysiology reveals semantic memory use in language comprehension.
Kutas, M., & Federmeier, K. D. (2000) · Trends in Cognitive Sciences · doi:10.1016/s1364-6613(00)01560-6 · Cited by 2,124
Risto, N. (2018) · Routledge eBooks · doi:10.4324/9780429487354 · Cited by 2,024
Object-related activity revealed by functional magnetic resonance imaging in human occipital cortex.
Malach, R., Reppas, J. B., Benson, R. R., Kwong, K. K., Jiang, H., Kennedy, W. A., Ledden, P. J., Brady, T. J., Rosen, B. R., & Tootell, R. B. (1995) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.92.18.8135 · Cited by 1,761
Andersen, R. A., Snyder, L. H., Bradley, D. C., & Xing, J. (1997) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.20.1.303 · Cited by 1,486
Human auditory evoked potentials. I: Evaluation of components
Picton, T. W., Hillyard, S. A., Krausz, H. I., & Galambos, R. (1974) · Electroencephalography and Clinical Neurophysiology · doi:10.1016/0013-4694(74)90155-2 · Cited by 1,468
Wijers, B. (1995) · Acta Psychologica · doi:10.1016/0001-6918(95)90043-8 · Cited by 1,313
Divided attention: Evidence for coactivation with redundant signals
Miller, J. (1982) · Cognitive Psychology · doi:10.1016/0010-0285(82)90010-x · Cited by 1,213
Cortical sources of the early components of the visual evoked potential
Di Russo, F., Martínez, A., Sereno, M. I., Pitzalis, S., & Hillyard, S. A. (2002) · Human Brain Mapping · doi:10.1002/hbm.10010 · Cited by 1,170
Giard, M. H., & Peronnet, F. (1999) · Journal of Cognitive Neuroscience · doi:10.1162/089892999563544 · Cited by 1,072
The visual N1 component as an index of a discrimination process
Vogel, E. K., & Luck, S. J. (2000) · Psychophysiology · doi:10.1111/1469-8986.3720190 · Cited by 1,068
Crossmodal Processing in the Human Brain: Insights from Functional Neuroimaging Studies
Calvert, G. A. (2001) · Cerebral Cortex · doi:10.1093/cercor/11.12.1110 · Cited by 1,012
Puce, A., Allison, T., Asgari, M., Gore, J. C., & McCarthy, G. (1996) · The Journal of Neuroscience · doi:10.1523/jneurosci.16-16-05205.1996 · Cited by 987 · cited 2×
“…a cluster of brain regions in the ventral visual stream known as the lateral occipital complex (LOC; e.g. Kohler et al., 1995; Malach et al., 1995; Puce et al., 1996, 1999; Kanwisher et al., 1997; Allison et al., 1999; Haxby et al., 1999; Ishai et al., 1999; Doniger et al., 2000, 2001, 2002;…”
BackgroundCalvert, G. A., Campbell, R., & Brammer, M. J. (2000) · Current Biology · doi:10.1016/s0960-9822(00)00513-3 · Cited by 954
Molholm, S., Ritter, W., Murray, M. M., Javitt, D. C., Schroeder, C. E., & Foxe, J. J. (2002) · Cognitive Brain Research · doi:10.1016/s0926-6410(02)00066-6 · Cited by 902
Self-citationDistributed representation of objects in the human ventral visual pathway
Ishai, A., Ungerleider, L. G., Martin, A., Schouten, J. L., & Haxby, J. V. (1999) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.96.16.9379 · Cited by 884
Allison, T. (1999) · Cerebral Cortex · doi:10.1093/cercor/9.5.415 · Cited by 882
Rossion, B., Gauthier, I., Tarr, M. J., Despland, P., Bruyer, R., Linotte, S., & Crommelinck, M. (2000) · Neuroreport · doi:10.1097/00001756-200001170-00014 · Cited by 738
Bentin, S., Mouchetant-Rostaing, Y., Giard, M. H., Echallier, J. F., & Pernier, J. (1999) · Journal of Cognitive Neuroscience · doi:10.1162/089892999563373 · Cited by 725
The sources of auditory evoked responses recorded from the human scalp
Vaughan, H. G., & Ritter, W. (1970) · Electroencephalography and Clinical Neurophysiology · doi:10.1016/0013-4694(70)90228-2 · Cited by 693
Two bilateral sources of the late AEP as identified by a spatio-temporal dipole model
Scherg, M., & Von Cramon, D. (1985) · Electroencephalography and Clinical Neurophysiology/Evoked Potentials Section · doi:10.1016/0168-5597(85)90033-4 · Cited by 683
Flow of activation from V1 to frontal cortex in humans
Foxe, J., & Simpson, G. (2002) · Experimental Brain Research · doi:10.1007/s00221-001-0906-7 · Cited by 670
Endogeneous brain potentials associated with selective auditory attention
Hansen, J. C., & Hillyard, S. A. (1980) · Electroencephalography and Clinical Neurophysiology · doi:10.1016/0013-4694(80)90222-9 · Cited by 669
The Effect of Face Inversion on Activity in Human Neural Systems for Face and Object Perception
Haxby, J. V., Ungerleider, L. G., Clark, V. P., Schouten, J. L., Hoffman, E. A., & Martin, A. (1999) · Neuron · doi:10.1016/s0896-6273(00)80690-x · Cited by 657
Visuo-haptic object-related activation in the ventral visual pathway
Amedi, A., Malach, R., Hendler, T., Peled, S., & Zohary, E. (2001) · Nature Neuroscience · doi:10.1038/85201 · Cited by 630
Stimulus deviance and evoked potentials
Näätänen, R., Simpson, M., & Loveless, N. E. (1982) · Biological Psychology · doi:10.1016/0301-0511(82)90017-5 · Cited by 597
Source Analysis of Event-related Cortical Activity during Visuo-spatial Attention
Di Russo, F. (2003) · Cerebral Cortex · doi:10.1093/cercor/13.5.486 · Cited by 525
Involvement of visual cortex in tactile discrimination of orientation
Zangaladze, A., Epstein, C. M., Grafton, S. T., & Sathian, K. (1999) · Nature · doi:10.1038/44139 · Cited by 508
Schweinberger, S. R., Pickering, E. C., Jentzsch, I., Burton, A. M., & Kaufmann, J. M. (2002) · Cognitive Brain Research · doi:10.1016/s0926-6410(02)00142-8 · Cited by 501
Parchment-skin illusion: sound-biased touch
Jousmäki, V, & Hari, R. (1998) · Current Biology · doi:10.1016/s0960-9822(98)70120-4 · Cited by 442
Effects of face inversion on the structural encoding and recognition of faces
Eimer, M. (2000) · Cognitive Brain Research · doi:10.1016/s0926-6410(00)00038-0 · Cited by 440
Auditory-Somatosensory Multisensory Processing in Auditory Association Cortex: An fMRI Study
Foxe, J. J., Wylie, G. R., Martinez, A., Schroeder, C. E., Javitt, D. C., Guilfoyle, D., Ritter, W., & Murray, M. M. (2002) · Journal of Neurophysiology · doi:10.1152/jn.2002.88.1.540 · Cited by 426
Puce, A. (1999) · Cerebral Cortex · doi:10.1093/cercor/9.5.445 · Cited by 422 · cited 2×
“…a cluster of brain regions in the ventral visual stream known as the lateral occipital complex (LOC; e.g. Kohler et al., 1995; Malach et al., 1995; Puce et al., 1996, 1999; Kanwisher et al., 1997; Allison et al., 1999; Haxby et al., 1999; Ishai et al., 1999; Doniger et al., 2000, 2001, 2002;…”
BackgroundHaptic study of three-dimensional objects activates extrastriate visual areas
James, T. W., Humphrey, G. K., Gati, J. S., Servos, P., Menon, R. S., & Goodale, M. A. (2002) · Neuropsychologia · doi:10.1016/s0028-3932(02)00017-9 · Cited by 418
The timing and laminar profile of converging inputs to multisensory areas of the macaque neocortex
Schroeder, C. E., & Foxe, J. J. (2002) · Cognitive Brain Research · doi:10.1016/s0926-6410(02)00073-3 · Cited by 416
Evoked Potential Correlates of Auditory Signal Detection
Hillyard, S. A., Squires, K. C., Bauer, J. W., & Lindsay, P. H. (1971) · Science · doi:10.1126/science.172.3990.1357 · Cited by 413
Enhancement of Perceived Visual Intensity by Auditory Stimuli: A Psychophysical Analysis
Stein, B. E., London, N., Wilkinson, L. K., & Price, D. D. (1996) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.1996.8.6.497 · Cited by 404
Foxe, J. J., Morocz, I. A., Murray, M. M., Higgins, B. A., Javitt, D. C., & Schroeder, C. E. (2000) · Cognitive Brain Research · doi:10.1016/s0926-6410(00)00024-0 · Cited by 395
Response amplification in sensory-specific cortices during crossmodal binding
Calvert, G. A., Brammer, M. J., Bullmore, E. T., Campbell, R., Iversen, S. D., & David, A. S. (1999) · NeuroReport · doi:10.1097/00001756-199908200-00033 · Cited by 331
Anllo-Vento, L., & Hillyard, S. A. (1996) · Perception & Psychophysics · doi:10.3758/bf03211875 · Cited by 322
Murray, M. M., Wylie, G. R., Higgins, B. A., Javitt, D. C., Schroeder, C. E., & Foxe, J. J. (2002) · The Journal of Neuroscience · doi:10.1523/jneurosci.22-12-05055.2002 · Cited by 312
Macleod, A., & Summerfield, Q. A. (1990) · British Journal of Audiology · doi:10.3109/03005369009077840 · Cited by 303
Neural mechanisms for synthesizing sensory information and producing adaptive behaviors
Stein, B. E. (1998) · Experimental Brain Research · doi:10.1007/s002210050553 · Cited by 264
An electrophysiological study of scene effects on object identification
Ganis, G., & Kutas, M. (2003) · Cognitive Brain Research · doi:10.1016/s0926-6410(02)00244-6 · Cited by 264
Doniger, G. M., Foxe, J. J., Murray, M. M., Higgins, B. A., Snodgrass, J. G., Schroeder, C. E., & Javitt, D. C. (2000) · Journal of Cognitive Neuroscience · doi:10.1162/089892900562372 · Cited by 259
The Fusiform Face Area: A Module in Human Extrastriate Cortex Specialized for Face Perception
Kanwisher, N., McDermott, J., & Chun, M. M. (2002) · Foundations in Social Neuroscience · doi:10.7551/mitpress/3077.003.0021 · Cited by 252
Differential Effects of Viewpoint on Object-Driven Activation in Dorsal and Ventral Streams
James, T. W., Humphrey, G. K., Gati, J. S., Menon, R. S., & Goodale, M. A. (2002) · Neuron · doi:10.1016/s0896-6273(02)00803-6 · Cited by 251
Spatio-temporal dynamics of attention to color: Evidence from human electrophysiology
Anllo‐Vento, L., Luck, S. J., & Hillyard, S. A. (1998) · Human Brain Mapping · doi:10.1002/(sici)1097-0193(1998)6:4<216::aid-hbm3>3.0.co;2-6 · Cited by 250
Campbell, R., & Dodd, B. (1980) · Quarterly Journal of Experimental Psychology · doi:10.1080/00335558008248235 · Cited by 244
Kenemans, J. L., Kok, A., & Smulders, F. T. Y. (1993) · Electroencephalography and Clinical Neurophysiology/Evoked Potentials Section · doi:10.1016/0168-5597(93)90028-n · Cited by 224
Foxe, J. J., McCourt, M. E., & Javitt, D. C. (2003) · NeuroImage · doi:10.1016/s1053-8119(03)00057-0 · Cited by 204
On the neuronal basis for multisensory convergence: a brief overview
Meredith, M. A. (2002) · Cognitive Brain Research · doi:10.1016/s0926-6410(02)00059-9 · Cited by 197
Hearing Lips and Seeing Voices
Boston, D. (1977) · British Journal of Audiology · doi:10.3109/03005367709078839 · Cited by 190
Foxe, J. J., Doniger, G. M., & Javitt, D. C. (2001) · Neuroreport · doi:10.1097/00001756-200112040-00043 · Cited by 184
Dissociation of pathways for object and spatial vision: a PET study in humans
Köhler, S., Kapur, S., Moscovitch, M., Winocur, G., & Houle, S. (1995) · NeuroReport · doi:10.1097/00001756-199510020-00011 · Cited by 169
Smid, H. G. O. M., Jakob, A., & Heinze, H. ‐. (1999) · Psychophysiology · doi:10.1017/s0048577299971135 · Cited by 164
A comparison of bound and unbound audio–visual information processing in the human cerebral cortex
Olson, I. R., Gatenby, J. C., & Gore, J. C. (2002) · Cognitive Brain Research · doi:10.1016/s0926-6410(02)00067-8 · Cited by 160
Object-completion Effects in the Human Lateral Occipital Complex
Lerner, Y., Hendler, T., & Malach, R. (2002) · Cerebral Cortex · doi:10.1093/cercor/12.2.163 · Cited by 146
Naming norms for brief environmental sounds: Effects of age and dementia
Fabiani, M., Kazmerski, V. A., Cycowicz, Y. M., & Friedman, D. (1996) · Psychophysiology · doi:10.1111/j.1469-8986.1996.tb01072.x · Cited by 127
Duhamel, J.-R. É., Colby, C., & Goldberg, M. E. (1991) · Brain And Space · doi:10.1093/oso/9780198542841.003.0012 · Cited by 99
Tracking the time course of object categorization using event-related potentials
Tanaka, J. W., Luu, P., Weisbrod, M., & Kiefer, M. (1999) · Neuroreport · doi:10.1097/00001756-199903170-00030 · Cited by 98
Magnetoencephalographic Correlates of Audiotactile Interaction
Lütkenhöner, B., Lammertmann, C., Simões, C., & Hari, R. (2002) · NeuroImage · doi:10.1006/nimg.2001.0991 · Cited by 97
Changing Plans: a High Density Electrical Mapping Study of Cortical Control
Dias, E. C., Foxe, J. J., & Javitt, D. C. (2003) · Cerebral Cortex · doi:10.1093/cercor/13.7.701 · Cited by 79
Event-related potentials during selective attention to speech sounds
Hansen, J. C., Dickstein, P. W., Berka, C., & Hillyard, S. A. (1983) · Biological Psychology · doi:10.1016/0301-0511(83)90025-x · Cited by 76
Encoding and memory for visible speech and gestures: A comparison between young and older adults.
Thompson, L. A. (1995) · Psychology and Aging · doi:10.1037//0882-7974.10.2.215 · Cited by 76
Topographic Analysis of Auditory Event-Related Potentials
Vaughan, H. G., Ritter, W., & Simson, R. (1980) · Progress in brain research · doi:10.1016/s0079-6123(08)61635-0 · Cited by 75
Dynamic Neuroimaging of Brain Function
Simpson, G. V., Pflieger, M. E., Foxe, J. J., et al. (1995) · Journal of Clinical Neurophysiology · doi:10.1097/00004691-199509010-00003 · Cited by 74
Conjoining Three Auditory Features: An Event-Related Brain Potential Study
Woods, D. L., & Alain, C. (2001) · Journal of Cognitive Neuroscience · doi:10.1162/08989290152001916 · Cited by 62
Event-related potentials and audiovisual stimuli: multimodal interactions
Czigler, I., & Balázs, L. (2001) · Neuroreport · doi:10.1097/00001756-200102120-00009 · Cited by 13
Cited by
Crossmodal correspondences: A tutorial review
Spence, C. (2011) · Attention, Perception, & Psychophysics · doi:10.3758/s13414-010-0073-7 · Cited by 1,618
Driver, J., & Noesselt, T. (2008) · Neuron · doi:10.1016/j.neuron.2007.12.013 · Cited by 940
Ross, L. A., Saint-Amour, D., Leavitt, V. M., Javitt, D. C., & Foxe, J. J. (2006) · Cerebral Cortex · doi:10.1093/cercor/bhl024 · Cited by 650
Neural correlates of multisensory cue integration in macaque MSTd
Gu, Y., Angelaki, D. E., & DeAngelis, G. C. (2008) · Nature Neuroscience · doi:10.1038/nn.2191 · Cited by 554
Griffiths, T. D., & Warren, J. D. (2004) · Nature Reviews Neuroscience · doi:10.1038/nrn1538 · Cited by 508
Metadata
- Authors
- Molholm, S.
- Venue
- Cerebral Cortex
- Publisher
- Oxford University Press (OUP)
- Published
- 2004-04-01
- Volume
- 14
- Issue
- 4
- Pages
- 452-465
- ISSN
- 1047-3211 (ISSN-L)
- 1460-2199
- OpenAlex
- W2144734076
- Cited by
- 384
- References
- 75
- FWCI
- 22.75
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.