The DOI matches its Crossref record; 73 of the 73 references it cites were found in a registry or an index.
Visual Input Enhances Selective Speech Envelope Tracking in Auditory Cortex at a “Cocktail Party”
Open accessAbstract
Our ability to selectively attend to one auditory signal amid competing input streams, epitomized by the “Cocktail Party” problem, continues to stimulate research from various approaches. How this demanding perceptual feat is achieved from a neural systems perspective remains unclear and controversial. It is well established that neural responses to attended stimuli are enhanced compared with responses to ignored ones, but responses to ignored stimuli are nonetheless highly significant, leading to interference in performance. We investigated whether congruent visual input of an attended speaker enhances cortical selectivity in auditory cortex, leading to diminished representation of ignored stimuli. We recorded magnetoencephalographic signals from human participants as they attended to segments of natural continuous speech. Using two complementary methods of quantifying the neural response to speech, we found that viewing a speaker's face enhances the capacity of auditory cortex to track the temporal speech envelope of that speaker. This mechanism was most effective in a Cocktail Party setting, promoting preferential tracking of the attended speaker, whereas without visual input no significant attentional modulation was observed. These neurophysiological results underscore the importance of visual input in resolving perceptual ambiguity in a noisy environment. Since visual cues in speech precede the associated auditory signals, they likely serve a predictive role in facilitating auditory processing of speech, perhaps by directing attentional resources to appropriate points in time when to-be-attended acoustic input is expected to arrive.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The assessment and analysis of handedness: The Edinburgh inventory
Oldfield, R. C. (1971) · Neuropsychologia · doi:10.1016/0028-3932(71)90067-4 · Cited by 35,900
Oostenveld, R., Fries, P., Maris, E., & Schoffelen, J.-M. (2011) · Computational Intelligence and Neuroscience · doi:10.1155/2011/156869 · Cited by 10,323
Some Experiments on the Recognition of Speech, with One and with Two Ears
Cherry, E. C. (1953) · The Journal of the Acoustical Society of America · doi:10.1121/1.1907229 · Cited by 4,549
Speech Recognition with Primarily Temporal Cues
Shannon, R. V., Zeng, F.-G., Kamath, V., Wygonski, J., & Ekelid, M. (1995) · Science · doi:10.1126/science.270.5234.303 · Cited by 3,024
Visual Contribution to Speech Intelligibility in Noise
Sumby, W. H., & Pollack, I. (1954) · The Journal of the Acoustical Society of America · doi:10.1121/1.1907309 · Cited by 2,583
Interpreting magnetic fields of the brain: minimum norm estimates
Hämäläinen, M. S., & Ilmoniemi, R. J. (1994) · Medical & Biological Engineering & Computing · doi:10.1007/bf02512476 · Cited by 1,995
Electrical Signs of Selective Attention in the Human Brain
Hillyard, S. A., Hink, R. F., Schwent, V. L., & Picton, T. W. (1973) · Science · doi:10.1126/science.182.4108.177 · Cited by 1,934
Cortical oscillations and speech processing: emerging computational principles and operations
Giraud, A.-L., & Poeppel, D. (2012) · Nature Neuroscience · doi:10.1038/nn.3063 · Cited by 1,917
Self-citationA "Rationalized" Arcsine Transform
Studebaker, G. A. (1985) · Journal of Speech, Language, and Hearing Research · doi:10.1044/jshr.2803.455 · Cited by 1,479
The dynamics of attending: How people track time-varying events.
Large, E. W., & Jones, M. R. (1999) · Psychological Review · doi:10.1037//0033-295x.106.1.119 · Cited by 1,393
Attention in Dichotic Listening: Affective Cues and the Influence of Instructions
Moray, N. (1959) · Quarterly Journal of Experimental Psychology · doi:10.1080/17470215908416289 · Cited by 1,392
Jung, T.-P., Makeig, S., Westerfield, M., Townsend, J., Courchesne, E., & Sejnowski, T. J. (2000) · Clinical Neurophysiology · doi:10.1016/s1388-2457(00)00386-2 · Cited by 1,322
Lakatos, P., Shah, A. S., Knuth, K. H., Ulbert, I., Karmos, G., & Schroeder, C. E. (2005) · Journal of Neurophysiology · doi:10.1152/jn.00263.2005 · Cited by 1,237
Self-citationTemporal information in speech: acoustic, auditory and linguistic aspects
Rosen, S. (1992) · Philosophical Transactions of the Royal Society of London. Series B: Biological Sciences · doi:10.1098/rstb.1992.0070 · Cited by 1,130
Selective cortical representation of attended speaker in multi-talker speech perception
Mesgarani, N., & Chang, E. F. (2012) · Nature · doi:10.1038/nature11020 · Cited by 1,007
Phase Patterns of Neuronal Responses Reliably Discriminate Speech in Human Auditory Cortex
Luo, H., & Poeppel, D. (2007) · Neuron · doi:10.1016/j.neuron.2007.06.004 · Cited by 995
Self-citationNeuronal oscillations and multisensory interaction in primary auditory cortex
Lakatos, P., Chen, C.-M., O'Connell, M. N., Mills, A., & Schroeder, C. E. (2007) · Neuron · doi:10.1016/j.neuron.2006.12.011 · Cited by 961
Self-citationTemporal structure in spatially organized neuronal ensembles: a role for interneuronal networks
Buzsáki, G., & Chrobak, J. J. (1995) · Current Opinion in Neurobiology · doi:10.1016/0959-4388(95)80012-3 · Cited by 878
Visual speech speeds up the neural processing of auditory speech
van Wassenhove, V., Grant, K. W., & Poeppel, D. (2005) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0408949102 · Cited by 854
Self-citationSource connectivity analysis with MEG and EEG
Schoffelen, J., & Gross, J. (2009) · Human Brain Mapping · doi:10.1002/hbm.20745 · Cited by 850
Kinesics and Context: Essays on Body Motion Communication
Birdwhistell, R. L. (1971) · University of Pennsylvania Press eBooks · doi:10.9783/9780812201284 · Cited by 806
Integration of Auditory and Visual Information about Objects in Superior Temporal Sulcus
Beauchamp, M. S., Lee, K. E., Argall, B. D., & Martin, A. (2004) · Neuron · doi:10.1016/s0896-6273(04)00070-4 · Cited by 773
Mizuseki, K., Sirota, A., Pastalkova, E., & Buzsáki, G. (2009) · Neuron · doi:10.1016/j.neuron.2009.08.037 · Cited by 718
Selective attention enhances the auditory 40-Hz transient response in humans
Tiitinen, H. T., Sinkkonen, J., Reinikainen, K., Alho, K., Lavikainen, J., & Näätänen, R. (1993) · Nature · doi:10.1038/364059a0 · Cited by 657
Ross, L. A., Saint-Amour, D., Leavitt, V. M., Javitt, D. C., & Foxe, J. J. (2006) · Cerebral Cortex · doi:10.1093/cercor/bhl024 · Cited by 650
Modulation of early sensory processing in human auditory cortex during auditory selective attention.
Woldorff, M. G., Gallen, C. C., Hampson, S. A., Hillyard, S. A., Pantev, C., Sobel, D., & Bloom, F. E. (1993) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.90.18.8722 · Cited by 645
The Natural Statistics of Audiovisual Speech
Chandrasekaran, C., Trubanova, A., Stillittano, S., Caplier, A., & Ghazanfar, A. A. (2009) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1000436 · Cited by 630
Phase-Locked Responses to Speech in Human Auditory Cortex are Enhanced During Comprehension
Peelle, J. E., Gross, J., & Davis, M. H. (2013) · Cerebral Cortex · doi:10.1093/cercor/bhs118 · Cited by 568
Nobre, A., Correa, A., & Coull, J. (2007) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2007.07.006 · Cited by 562
The use of visible speech cues for improving auditory detection of spoken sentences
Grant, K. W., & Seitz, P.-F. (2000) · The Journal of the Acoustical Society of America · doi:10.1121/1.1288668 · Cited by 521
Auditory attention — focusing the searchlight on sound
Fritz, J. B., Elhilali, M., David, S. V., & Shamma, S. A. (2007) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2007.07.011 · Cited by 520
Visual Modulation of Neurons in Auditory Cortex
Kayser, C., Petkov, C. I., & Logothetis, N. K. (2008) · Cerebral Cortex · doi:10.1093/cercor/bhm187 · Cited by 509
Neuronal oscillations and visual amplification of speech
Schroeder, C. E., Lakatos, P., Kajikawa, Y., Partan, S., & Puce, A. (2008) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2008.01.002 · Cited by 498
Self-citationNeural coding of continuous speech in auditory cortex during monaural and dichotic listening
Ding, N., & Simon, J. Z. (2012) · Journal of Neurophysiology · doi:10.1152/jn.00297.2011 · Cited by 497
Visual Prosody and Speech Intelligibility: Head Movement Improves Auditory Speech Perception
Munhall, K. G., Jones, J. A., Callan, D. E., Kuratate, T., & Vatikiotis-Bateson, E. (2004) · Psychological Science · doi:10.1111/j.0963-7214.2004.01502010.x · Cited by 482
Attentional Gain Control of Ongoing Cortical Speech Representations in a “Cocktail Party”
Kerlin, J. R., Shahin, A. J., & Miller, L. M. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.3631-09.2010 · Cited by 449
Temporal coherence and attention in auditory scene analysis
Shamma, S. A., Elhilali, M., & Micheyl, C. (2011) · Trends in Neurosciences · doi:10.1016/j.tins.2010.11.002 · Cited by 429
The Leading Sense: Supramodal Control of Neurophysiological Context by Attention
Lakatos, P., O'Connell, M. N., Barczak, A., Mills, A., Javitt, D. C., & Schroeder, C. E. (2009) · Neuron · doi:10.1016/j.neuron.2009.10.014 · Cited by 381
Self-citationMcDermott, J. H. (2009) · Current Biology · doi:10.1016/j.cub.2009.09.005 · Cited by 368
Transitions in neural oscillations reflect prediction errors generated in audiovisual speech
Arnal, L. H., Wyart, V., & Giraud, A.-L. (2011) · Nature Neuroscience · doi:10.1038/nn.2810 · Cited by 353
Ghitza, O. (2011) · Frontiers in Psychology · doi:10.3389/fpsyg.2011.00130 · Cited by 351
Theunissen, F. E., David, S. V., Singh, N. C., Hsu, A., Vinje, W. E., & Gallant, J. L. (2001) · Network: Computation in Neural Systems · doi:10.1080/net.12.3.289.316 · Cited by 349
Bimodal speech: early suppressive visual effects in human auditory cortex
Besle, J., Fort, A., Delpuech, C., & Giard, M. (2004) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2004.03670.x · Cited by 323
Neural responses to uninterrupted natural speech can be extracted with precise temporal resolution
Lalor, E. C., & Foxe, J. J. (2010) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2009.07055.x · Cited by 288
Wood, N., & Cowan, N. (1995) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/0278-7393.21.1.255 · Cited by 281
Seeing to hear better: evidence for early audio-visual interactions in speech identification
SCHWARTZ, J. (2004) · Cognition · doi:10.1016/s0010-0277(04)00054-x · Cited by 279
Seeing to hear better: evidence for early audio-visual interactions in speech identification
Schwartz, J.-L., Berthommier, F., & Savariaux, C. (2004) · Cognition · doi:10.1016/j.cognition.2004.01.006 · Cited by 275
Auditory-visual speech perception examined by fMRI and PET
Sekiyama, K., Kanno, I., Miura, S., & Sugita, Y. (2003) · Neuroscience Research · doi:10.1016/s0168-0102(03)00214-1 · Cited by 249
Dual Neural Routing of Visual Facilitation in Speech Processing
Arnal, L. H., Morillon, B., Kell, C. A., & Giraud, A.-L. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.3194-09.2009 · Cited by 241
Human Cortical Responses to the Speech Envelope
Aiken, S. J., & Picton, T. W. (2008) · Ear & Hearing · doi:10.1097/aud.0b013e31816453dc · Cited by 237
Luo, H., Liu, Z., & Poeppel, D. (2010) · PLoS Biology · doi:10.1371/journal.pbio.1000445 · Cited by 234
Self-citationTemporal Coherence in the Perceptual Organization and Cortical Representation of Auditory Scenes
Elhilali, M., Ma, L., Micheyl, C., Oxenham, A. J., & Shamma, S. A. (2009) · Neuron · doi:10.1016/j.neuron.2008.12.005 · Cited by 228
Denoising based on time-shift PCA
de Cheveigné, A., & Simon, J. Z. (2007) · Journal of Neuroscience Methods · doi:10.1016/j.jneumeth.2007.06.003 · Cited by 214
"Attention" Units in the Auditory Cortex
Hubel, D. H., Henson, C. O., Rupert, A., & Galambos, R. (1959) · Science · doi:10.1126/science.129.3358.1279 · Cited by 194
Neural processes underlying perceptual enhancement by visual speech gestures
Callan, D. E., Jones, J. A., Munhall, K., Callan, A. M., Kroos, C., & Vatikiotis-Bateson, E. (2003) · NeuroReport · doi:10.1097/00001756-200312020-00016 · Cited by 190
Estimating sparse spectro-temporal receptive fields with natural stimuli
David, S. V., Mesgarani, N., & Shamma, S. A. (2007) · Network: Computation in Neural Systems · doi:10.1080/09548980701609235 · Cited by 171
Effects of auditory pattern structure on anticipatory and reactive attending
Jones, M. R., Johnston, H. M., & Puente, J. (2006) · Cognitive Psychology · doi:10.1016/j.cogpsych.2006.01.003 · Cited by 169
Zion Golumbic, E. M., Poeppel, D., & Schroeder, C. E. (2012) · Brain and Language · doi:10.1016/j.bandl.2011.12.010 · Cited by 167
Self-citation(2010) · doi:10.1093/acprof:oso/9780199563456.001.0001 · Cited by 166
A cocktail party with a cortical twist: How cortical mechanisms contribute to sound segregation
Elhilali, M., & Shamma, S. (2008) · The Journal of the Acoustical Society of America · doi:10.1121/1.3001672 · Cited by 143
The role of visual speech cues in reducing energetic and informational masking
Helfer, K. S., & Freyman, R. L. (2005) · The Journal of the Acoustical Society of America · doi:10.1121/1.1836832 · Cited by 126
Musacchia, G., & Schroeder, C. E. (2009) · Hearing Research · doi:10.1016/j.heares.2009.06.018 · Cited by 117
Self-citationA Multisensory Cortical Network for Understanding Speech in Noise
Bishop, C. W., & Miller, L. M. (2008) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2009.21118 · Cited by 117
Optical Phonetics and Visual Perception of Lexical and Phrasal Stress in English
Scarborough, R. A., Keating, P., Mattys, S. L., Cho, T., & Alwan, A. A. (2009) · Language and Speech · doi:10.1177/0023830909103165 · Cited by 111
Speech comprehension aided by multiple modalities: Behavioural and neural interactions
McGettigan, C., Faulkner, A., Altarelli, I., Obleser, J., Baverstock, H., & Scott, S. K. (2012) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2012.01.010 · Cited by 107
Head Movement Correlates of Juncture and Stress at Sentence Level
Hadar, U., Steiner, T. J., Grant, E. C. G., & Rose, F. C. (1983) · Language and Speech · doi:10.1177/002383098302600202 · Cited by 104
Contributions Of The Visual Components Of Oral Symbols To Speech Comprehension
O’Neill, J. J. (1954) · Journal of Speech and Hearing Disorders · doi:10.1044/jshd.1904.429 · Cited by 99
Hertrich, I., Dietrich, S., Trouvain, J., Moos, A., & Ackermann, H. (2011) · Psychophysiology · doi:10.1111/j.1469-8986.2011.01314.x · Cited by 82
The effect of speechreading on masked detection thresholds for filtered speech
Grant, K. W. (2001) · The Journal of the Acoustical Society of America · doi:10.1121/1.1362687 · Cited by 81
Hearing Foreign Voices: Does Knowing What is Said Affect Visual-Masked-Speech Detection?
Kim, J., & Davis, C. (2003) · Perception · doi:10.1068/p3466 · Cited by 59
Beaman, C. P., Bridges, A. M., & Scott, S. K. (2007) · Cortex · doi:10.1016/s0010-9452(08)70450-7 · Cited by 42
Davis, C., Kislyuk, D. S., Kim, J., & Sams, M. E. (2008) · Brain Research · doi:10.1016/j.brainres.2008.04.077 · Cited by 29
Auditory Attention and Filters
Hafter, E. R., Sarampalis, A., & Loui, P. (2007) · Springer handbook of auditory research · doi:10.1007/978-0-387-71305-2_5 · Cited by 25
Cited by
Mechanisms underlying selective neuronal tracking of attended speech at a “cocktail party”
Zion Golumbic, E. M., Ding, N., Bickel, S., Lakatos, P., Schevon, C. A., McKhann, G. M., Goodman, R. R., Emerson, R., Mehta, A. D., Simon, J. Z., et al. (2013) · Neuron · doi:10.1016/j.neuron.2012.12.037 · Cited by 909
Self-citationEphrat, A., Mosseri, I., Lang, O., Dekel, T., Wilson, K., Hassidim, A., Freeman, W. T., & Rubinstein, M. (2018) · ACM Transactions on Graphics · doi:10.1145/3197517.3201357 · Cited by 620
Low-Frequency Cortical Entrainment to Speech Reflects Phoneme-Level Processing
Di Liberto, G. M., O’Sullivan, J. A., & Lalor, E. C. (2015) · Current Biology · doi:10.1016/j.cub.2015.08.030 · Cited by 578
Doelling, K. B., Arnal, L. H., Ghitza, O., & Poeppel, D. (2014) · NeuroImage · doi:10.1016/j.neuroimage.2013.06.035 · Cited by 571
Self-citationA New Unifying Account of the Roles of Neuronal Entrainment
Lakatos, P., Gross, J., & Thut, G. (2019) · Current Biology · doi:10.1016/j.cub.2019.07.075 · Cited by 508
Metadata
- Authors
- Zion Golumbic, E., Cogan, G. B., Schroeder, C. E., & Poeppel, D.
- Venue
- The Journal of Neuroscience
- Publisher
- Society for Neuroscience
- Published
- 2013-01-23
- Volume
- 33
- Issue
- 4
- Pages
- 1417-1426
- ISSN
- 0270-6474 (ISSN-L)
- 1529-2401
- OpenAlex
- W2081144555
- Cited by
- 258
- References
- 73
- FWCI
- 21.00
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.