The DOI matches its Crossref record; 75 of the 75 references it cites were found in a registry or an index.
Multisensory Visual-Auditory Object Recognition in Humans: a High-density Electrical Mapping Study
Abstract
Multisensory object-recognition processes were investigated by examining the combined influence of visual and auditory inputs upon object identification--in this case, pictures and vocalizations of animals. Behaviorally, subjects were significantly faster and more accurate at identifying targets when the picture and vocalization were matched (i.e. from the same animal), than when the target was represented in only one sensory modality. This behavioral enhancement was accompanied by a modulation of the evoked potential in the latency range and general topographic region of the visual evoked N1 component, which is associated with early feature processing in the ventral visual stream. High-density topographic mapping and dipole modeling of this multisensory effect were consistent with generators in lateral occipito-temporal cortices, suggesting that auditory inputs were modulating processing in regions of the lateral occipital cortices. Both the timing and scalp topography of this modulation suggests that there are multisensory effects during what is considered to be a relatively early stage of visual object-recognition processes, and that this modulation occurs in regions of the visual system that have traditionally been held to be unisensory processing areas. Multisensory inputs also modulated the visual 'selection-negativity', an attention dependent component of the evoked potential this is usually evoked when subjects selectively attend to a particular feature of a visual stimulus.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The fusiform face area: a module in human extrastriate cortex specialized for face perception
Kanwisher, N., McDermott, J., & Chun, M. M. (1997) · The Journal of Neuroscience · doi:10.1523/jneurosci.17-11-04302.1997 · Cited by 7,738 · cited 2×
“These object processing functions have been extensively investigated through both functional imaging and ERP studies, and object processing in humans has been specifically associated with neuronal activation in a cluster of brain regions in the ventral visual stream known as the lateral occipital complex (LOC; e.g. Ko…”
BackgroundHearing lips and seeing voices
MCGURK, H., & MACDONALD, J. (1976) · Nature · doi:10.1038/264746a0 · Cited by 6,183
Snodgrass, J. G., & Vanderwart, M. (1980) · Journal of Experimental Psychology Human Learning & Memory · doi:10.1037//0278-7393.6.2.174 · Cited by 5,615
Reading Senseless Sentences: Brain Potentials Reflect Semantic Incongruity
Kutas, M., & Hillyard, S. A. (1980) · Science · doi:10.1126/science.7350657 · Cited by 4,888
Ungerleider, L. G. (1982) · Medical Entomology and Zoology · Cited by 4,531
Early selective-attention effect on evoked potential reinterpreted
Näätänen, R., Gaillard, A. W. K., & Mäntysalo, S. (1978) · Acta Psychologica · doi:10.1016/0001-6918(78)90006-9 · Cited by 2,706
Visual Contribution to Speech Intelligibility in Noise
Sumby, W. H., & Pollack, I. (1954) · The Journal of the Acoustical Society of America · doi:10.1121/1.1907309 · Cited by 2,583 · cited 2×
“McGurk and MacDonald, 1976), or enhance speech perception in a noisy environment ( Sumby and Pollack, 1954; Campbell and Dodd, 1980; MacLeod and Summerfield, 1990; Thompson, 1995).”
BackgroundElectrophysiology reveals semantic memory use in language comprehension.
Kutas, M., & Federmeier, K. D. (2000) · Trends in Cognitive Sciences · doi:10.1016/s1364-6613(00)01560-6 · Cited by 2,124
Risto, N. (2018) · Routledge eBooks · doi:10.4324/9780429487354 · Cited by 2,024
Object-related activity revealed by functional magnetic resonance imaging in human occipital cortex.
Malach, R., Reppas, J. B., Benson, R. R., Kwong, K. K., Jiang, H., Kennedy, W. A., Ledden, P. J., Brady, T. J., Rosen, B. R., & Tootell, R. B. (1995) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.92.18.8135 · Cited by 1,761
Cited by
Crossmodal correspondences: A tutorial review
Spence, C. (2011) · Attention, Perception, & Psychophysics · doi:10.3758/s13414-010-0073-7 · Cited by 1,618
Driver, J., & Noesselt, T. (2008) · Neuron · doi:10.1016/j.neuron.2007.12.013 · Cited by 940
Ross, L. A., Saint-Amour, D., Leavitt, V. M., Javitt, D. C., & Foxe, J. J. (2006) · Cerebral Cortex · doi:10.1093/cercor/bhl024 · Cited by 650
Neural correlates of multisensory cue integration in macaque MSTd
Gu, Y., Angelaki, D. E., & DeAngelis, G. C. (2008) · Nature Neuroscience · doi:10.1038/nn.2191 · Cited by 554
Griffiths, T. D., & Warren, J. D. (2004) · Nature Reviews Neuroscience · doi:10.1038/nrn1538 · Cited by 508
Enhanced multisensory integration in older adults
Laurienti, P. J., Burdette, J. H., Maldjian, J. A., & Wallace, M. T. (2006) · Neurobiology of Aging · doi:10.1016/j.neurobiolaging.2005.05.024 · Cited by 451
Can quantum probability provide a new direction for cognitive modeling?
Pothos, E. M., & Busemeyer, J. R. (2013) · Behavioral and Brain Sciences · doi:10.1017/s0140525x12001525 · Cited by 440
Multimodal Language Processing in Human Communication
Holler, J., & Levinson, S. C. (2019) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2019.05.006 · Cited by 441
Murray, M. M., Molholm, S., Michel, C. M., Heslenfeld, D. J., Ritter, W., Javitt, D. C., Schroeder, C. E., & Foxe, J. J. (2005) · Cerebral Cortex · doi:10.1093/cercor/bhh197 · Cited by 413
Self-citationPhysiological and Anatomical Evidence for Multisensory Interactions in Auditory Cortex
Bizley, J. K., Nodal, F. R., Bajo, V. M., Nelken, I., & King, A. J. (2007) · Cerebral Cortex · doi:10.1093/cercor/bhl128 · Cited by 354
Functional imaging of human crossmodal identification and object recognition
Amedi, A., von Kriegstein, K., van Atteveldt, N. M., Beauchamp, M. S., & Naumer, M. J. (2005) · Experimental Brain Research · doi:10.1007/s00221-005-2396-5 · Cited by 353
Sound alters activity in human V1 in association with illusory visual perception
Watkins, S., Shams, L., Tanaka, S., Haynes, J.-D., & Rees, G. (2006) · NeuroImage · doi:10.1016/j.neuroimage.2006.01.016 · Cited by 343
Neural Correlates of Multisensory Integration of Ecologically Valid Audiovisual Events
Stekelenburg, J. J., & Vroomen, J. (2007) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2007.19.12.1964 · Cited by 336
Emerging Neurophysiological Specialization for Letter Strings
Maurer, U., Brem, S., Bucher, K., & Brandeis, D. (2005) · Journal of Cognitive Neuroscience · doi:10.1162/089892905774597218 · Cited by 294
Noesselt, T., Rieger, J. W., Schoenfeld, M. A., Kanowski, M., Hinrichs, H., Heinze, H.-J., & Driver, J. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.2252-07.2007 · Cited by 292
Brandwein, A. B., Foxe, J. J., Butler, J. S., Russo, N. N., Altschuler, T. S., Gomes, H., & Molholm, S. (2013) · Cerebral Cortex · doi:10.1093/cercor/bhs109 · Cited by 236
“…and social communication (e.g., speech and emotion recognition), are enhanced by complementary multisensory inputs (Stein et al. 1988, 1989; Molholm et al. 2002, 2004; Ross et al. 2007a, 2007b, 2011; Gingras et al. 2009; Werner and Noppeney 2010; Fiebelkorn et al. 2011), impairments in the…”
BackgroundSelf-citationChen, Y.-C., & Spence, C. (2010) · Cognition · doi:10.1016/j.cognition.2009.10.012 · Cited by 221
The multisensory function of the human primary visual cortex
Murray, M. M., Thelen, A., Thut, G., Romei, V., Martuzzi, R., & Matusz, P. J. (2016) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2015.08.011 · Cited by 219
Brandwein, A. B., Foxe, J. J., Butler, J. S., Frey, H.-P., Bates, J. C., Shulman, L. H., & Molholm, S. (2015) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-014-2212-9 · Cited by 187
Self-citationRusso, N., Foxe, J. J., Brandwein, A. B., Altschuler, T., Gomes, H., & Molholm, S. (2010) · Autism Research · doi:10.1002/aur.152 · Cited by 180
Self-citationSehatpour, P., Molholm, S., Javitt, D. C., & Foxe, J. J. (2006) · NeuroImage · doi:10.1016/j.neuroimage.2005.07.049 · Cited by 146
“It is important to note that, in dipole source analysis, the modeled dipoles represent an oversimplification of the activity in the areas and should be considered as representative of centers of gravity of the observed activity rather than pinpoint localizations of exact generators (Murray et al., 2002; Dias et al., 2…”
BackgroundSelf-citationThe effects of visual deprivation on functional and structural organization of the human Brain
NOPPENEY, U. (2007) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2007.04.012 · Cited by 140
“Direct connections with other sensory areas may explain the audio-visual integration effects in early auditory or visual cortices in anaesthetized monkeys and humans (Kayser et al., 2005; Foxe et al., 2000; Calvert et al., 1999; Schroeder and Foxe, 2002; Fu et al., 2003) and the early audio-visual inconguency effects…”
BackgroundGomez-Ramirez, M., Higgins, B. A., Rycroft, J. A., Owen, G. N., Mahoney, J., Shpaner, M., & Foxe, J. J. (2007) · Clinical Neuropharmacology · doi:10.1097/01.wnf.0000240940.13876.17 · Cited by 96
Self-citationEnhancement of response times to bi- and tri-modal sensory stimuli during active movements
Hecht, D., Reiner, M., & Karni, A. (2008) · Experimental Brain Research · doi:10.1007/s00221-007-1191-x · Cited by 76
Stewart, C. R., Sanchez, S. S., Grenesko, E. L., Brown, C. M., Chen, C. P., Keehn, B., Velasquez, F., Lincoln, A. J., & Müller, R.-A. (2016) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-015-2367-z · Cited by 46
Frid, E., Moll, J., Bresin, R., & Sallnäs Pysander, E.-L. (2019) · Journal on Multimodal User Interfaces · doi:10.1007/s12193-018-0264-4 · Cited by 19
“For example, a semantically congruent bisensory stimulus could be a picture of a particular animal, paired with the sound of the same animal, as in [34].”
Reduced multisensory facilitation exists at different periods of development in autism
Ainsworth, K., Ostrolenk, A., Irion, C., & Bertone, A. (2021) · Cortex · doi:10.1016/j.cortex.2020.09.031 · Cited by 18
Metadata
- Authors
- Molholm, S.
- Venue
- Cerebral Cortex
- Publisher
- Oxford University Press (OUP)
- Published
- 2004-04-01
- Volume
- 14
- Issue
- 4
- Pages
- 452-465
- ISSN
- 1047-3211 (ISSN-L)
- 1460-2199
- OpenAlex
- W2144734076
- Cited by
- 384
- References
- 75
- FWCI
- 22.75
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.