The DOI matches its Crossref record; 28 of the 28 references it cites were found in a registry or an index.
Selective cortical representation of attended speaker in multi-talker speech perception
Open accessAbstract
Humans possess a remarkable ability to attend to a single speaker’s voice in a multi-talker background. How the auditory system manages to extract intelligible speech under such acoustically complex and adverse listening conditions is not known, and, indeed, it is not clear how attended speech is internally represented. Here, using multi-electrode surface recordings from the cortex of subjects engaged in a listening task with two simultaneous speakers, we demonstrate that population responses in non-primary human auditory cortex encode critical features of attended speech: speech spectrograms reconstructed based on cortical responses to the mixture of speakers reveal the salient spectral and temporal features of the attended speaker, as if subjects were listening to that speaker alone. A simple classifier trained solely on examples of single speakers can decode both attended words and speaker identity. We find that task performance is well predicted by a rapid increase in attention-modulated neural selectivity across both single-electrode and population-level cortical responses. These findings demonstrate that the cortical representation of speech does not merely reflect the external acoustic environment, but instead gives rise to the perceptual aspects relevant for the listener’s intended goal.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Some Experiments on the Recognition of Speech, with One and with Two Ears
Cherry, E. C. (1953) · The Journal of the Acoustical Society of America · doi:10.1121/1.1907229 · Cited by 4,549
Auditory Scene Analysis: The Perceptual Organization of Sound
Bregman, A. S., & McAdams, S. (1994) · The Journal of the Acoustical Society of America · doi:10.1121/1.408434 · Cited by 3,029
TIMIT Acoustic-Phonetic Continuous Speech Corpus
Garofolo, J. S., Lamel, L. F., Fisher, W. M., Pallett, D. S., Dahlgren, N. L., Zue, V. W., & Fiscus, J. G. (2020) · Americanae (AECID Library) · doi:10.35111/17gk-bn40 · Cited by 2,508
Perceptual Restoration of Missing Speech Sounds
Warren, R. M. (1970) · Science · doi:10.1126/science.167.3917.392 · Cited by 1,143
Informational and energetic masking effects in the perception of two simultaneous talkers
Brungart, D. S. (2001) · The Journal of the Acoustical Society of America · doi:10.1121/1.1345696 · Cited by 1,139
Bialek, W., Rieke, F., de Ruyter van Steveninck, R. R., & Warland, D. (1991) · Science · doi:10.1126/science.2063199 · Cited by 992
Object-based auditory and visual attention
Shinn-Cunningham, B. G. (2008) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2008.02.003 · Cited by 729
The neuroanatomical and functional organization of speech perception
Scott, S. K., & Johnsrude, I. S. (2003) · Trends in Neurosciences · doi:10.1016/s0166-2236(02)00037-1 · Cited by 705
Auditory Scene Analysis: The Perceptual Organization of Sound
Kramer, G., & Bregman, A. (1992) · Leonardo Music Journal · doi:10.2307/1513223 · Cited by 657
Reconstructing Speech from Human Auditory Cortex
Pasley, B. N., David, S. V., Mesgarani, N., Flinker, A., Shamma, S. A., Crone, N. E., Knight, R. T., & Chang, E. F. (2012) · PLoS Biology · doi:10.1371/journal.pbio.1001251 · Cited by 604
Self-citation
Cited by
Cortical oscillations and sensory predictions
Arnal, L. H., & Giraud, A.-L. (2012) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2012.05.003 · Cited by 1,114
The Ease of Language Understanding (ELU) model: theoretical, empirical, and clinical advances
Rönnberg, J., Lunner, T., Zekveld, A., Sörqvist, P., Danielsson, H., Lyxell, B., Dahlström, Ö., Signoret, C., Stenfelt, S., Pichora-Fuller, M. K., et al. (2013) · Frontiers in Systems Neuroscience · doi:10.3389/fnsys.2013.00031 · Cited by 989
Mechanisms underlying selective neuronal tracking of attended speech at a “cocktail party”
Zion Golumbic, E. M., Ding, N., Bickel, S., Lakatos, P., Schevon, C. A., McKhann, G. M., Goodman, R. R., Emerson, R., Mehta, A. D., Simon, J. Z., et al. (2013) · Neuron · doi:10.1016/j.neuron.2012.12.037 · Cited by 909
“…of Physicians and Surgeons, New York, NY, USA 4Cognitive Neuroscience and Schizophrenia Program, Nathan S. Kline Institute for Psychiatric Research, Orangeburg, NY 10962, USA 5Department of Electrical and Computer Engineering 6Department of Biology University of Maryland, College Park, College…”
BackgroundInfluentialEmergence of neural encoding of auditory objects while listening to competing speakers
Ding, N., & Simon, J. Z. (2012) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1205381109 · Cited by 835
Attentional Selection in a Cocktail Party Environment Can Be Decoded from Single-Trial EEG
O'Sullivan, J. A., Power, A. J., Mesgarani, N., Rajaram, S., Foxe, J. J., Shinn-Cunningham, B. G., Slaney, M., Shamma, S. A., & Lalor, E. C. (2015) · Cerebral Cortex · doi:10.1093/cercor/bht355 · Cited by 824
Self-citationCrosse, M. J., Di Liberto, G. M., Bednar, A., & Lalor, E. C. (2016) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2016.00604 · Cited by 705
Functional organization of human sensorimotor cortex for speech articulation
Bouchard, K. E., Mesgarani, N., Johnson, K., & Chang, E. F. (2013) · Nature · doi:10.1038/nature11911 · Cited by 686
Self-citationSpeech rhythms and multiplexed oscillatory sensory coding in the human brain
Gross, J., Hoogenboom, N., Thut, G., Schyns, P., Panzeri, S., Belin, P., & Garrod, S. (2013) · PLoS Biology · doi:10.1371/journal.pbio.1001752 · Cited by 643
The what, where and how of auditory-object perception
Bizley, J. K., & Cohen, Y. E. (2013) · Nature Reviews Neuroscience · doi:10.1038/nrn3565 · Cited by 464
The Spectrotemporal Filter Mechanism of Auditory Selective Attention
Lakatos, P., Musacchia, G., O’Connel, M. N., Falchier, A. Y., Javitt, D. C., & Schroeder, C. E. (2013) · Neuron · doi:10.1016/j.neuron.2012.11.034 · Cited by 445
Cortical entrainment to continuous speech: functional roles and interpretations
Ding, N., & Simon, J. Z. (2014) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2014.00311 · Cited by 443
Neural Entrainment and Attentional Selection in the Listening Brain
Obleser, J., & Kayser, C. (2019) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2019.08.004 · Cited by 432
Broderick, M. P., Anderson, A. J., Di Liberto, G. M., Crosse, M. J., & Lalor, E. C. (2018) · Current Biology · doi:10.1016/j.cub.2018.01.080 · Cited by 421
The Encoding of Speech Sounds in the Superior Temporal Gyrus
Yi, H. G., Leonard, M. K., & Chang, E. F. (2019) · Neuron · doi:10.1016/j.neuron.2019.04.023 · Cited by 417
Self-citationSemantic reconstruction of continuous language from non-invasive brain recordings
Tang, J., LeBel, A., Jain, S., & Huth, A. G. (2023) · Nature Neuroscience · doi:10.1038/s41593-023-01304-9 · Cited by 442
Buzsáki, G. (2019) · doi:10.1093/oso/9780190905385.001.0001 · Cited by 358
Bevilacqua, D., Davidesco, I., Wan, L., Chaloner, K., Rowland, J., Ding, M., Poeppel, D., & Dikker, S. (2019) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_01274 · Cited by 312
“…example, several recent studies demonstrated that, in the “ cocktail party effect, ” when confronted with two speakers and paying attention only to one of them, oscillations in high-order auditory areas track only the attended speaker ’ s voice (Zion Golumbic et al., 2013; Mesgarani & Chang, 2012).”
Adaptive Temporal Encoding Leads to a Background-Insensitive Cortical Representation of Speech
Ding, N., & Simon, J. Z. (2013) · The Journal of Neuroscience · doi:10.1523/jneurosci.5297-12.2013 · Cited by 323
Central Gain Restores Auditory Processing following Near-Complete Cochlear Denervation
Chambers, A. R., Resnik, J., Yuan, Y., Whitton, J. P., Edge, A. S., Liberman, M. C., & Polley, D. B. (2016) · Neuron · doi:10.1016/j.neuron.2015.12.041 · Cited by 302
The revolution will not be controlled: natural stimuli in speech neuroscience
Hamilton, L. S., & Huth, A. G. (2020) · Language, Cognition and Neuroscience · doi:10.1080/23273798.2018.1499946 · Cited by 301
The Neural Consequences of Age-Related Hearing Loss
Peelle, J. E., & Wingfield, A. (2016) · Trends in Neurosciences · doi:10.1016/j.tins.2016.05.001 · Cited by 289
The Hierarchical Cortical Organization of Human Speech Processing
de Heer, W. A., Huth, A. G., Griffiths, T. L., Gallant, J. L., & Theunissen, F. E. (2017) · The Journal of Neuroscience · doi:10.1523/jneurosci.3267-16.2017 · Cited by 277
Miller, K. J., Honey, C. J., Hermes, D., Rao, R. P., denNijs, M., & Ojemann, J. G. (2014) · NeuroImage · doi:10.1016/j.neuroimage.2013.08.070 · Cited by 273
Biesmans, W., Das, N., Francart, T., & Bertrand, A. (2017) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2016.2571900 · Cited by 260
Speaker-Independent Speech Separation With Deep Attractor Network
Luo, Y., Chen, Z., & Mesgarani, N. (2018) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2018.2795749 · Cited by 260
Self-citationVisual Input Enhances Selective Speech Envelope Tracking in Auditory Cortex at a “Cocktail Party”
Zion Golumbic, E., Cogan, G. B., Schroeder, C. E., & Poeppel, D. (2013) · The Journal of Neuroscience · doi:10.1523/jneurosci.3675-12.2013 · Cited by 258
Real-time decoding of question-and-answer speech dialogue using human cortical activity
Moses, D. A., Leonard, M. K., Makin, J. G., & Chang, E. F. (2019) · Nature Communications · doi:10.1038/s41467-019-10994-4 · Cited by 224
Self-citationTowards reconstructing intelligible speech from the human auditory cortex
Akbari, H., Khalighinejad, B., Herrero, J. L., Mehta, A. D., & Mesgarani, N. (2019) · Scientific Reports · doi:10.1038/s41598-018-37359-z · Cited by 221
Self-citationDeficits in predictive coding underlie hallucinations in schizophrenia
Horga, G., Schatz, K. C., Abi-Dargham, A., & Peterson, B. S. (2014) · Journal of Neuroscience · doi:10.1523/jneurosci.0200-14.2014 · Cited by 176
Perceptual restoration of masked speech in human cortex
Leonard, M. K., Baud, M. O., Sjerps, M. J., & Chang, E. F. (2016) · Nature Communications · doi:10.1038/ncomms13619 · Cited by 170
Self-citationDissociation of broadband high-frequency activity and neuronal firing in the neocortex
Leszczyński, M., Barczak, A., Kajikawa, Y., Ulbert, I., Falchier, A. Y., Tal, I., Haegens, S., Melloni, L., Knight, R. T., & Schroeder, C. E. (2020) · Science Advances · doi:10.1126/sciadv.abb0977 · Cited by 188
Blank, H., & Davis, M. H. (2016) · PLOS Biology · doi:10.1371/journal.pbio.1002577 · Cited by 181
Word pair classification during imagined speech using direct brain recordings
Martin, S., Brunner, P., Iturrate, I., Millán, J. D. R., Schalk, G., Knight, R. T., & Pasley, B. N. (2016) · Scientific Reports · doi:10.1038/srep25803 · Cited by 171
A review of hyperacusis and future directions: part II. Measurement, mechanisms, and treatment
Pienkowski, M., Tyler, R. S., Roncancio, E. R., Jun, H. J., Brozoski, T., Dauman, N., Coelho, C. B., Andersson, G., Keiner, A. J., Cacace, A. T., et al. (2014) · American Journal of Audiology · doi:10.1044/2014_aja-13-0037 · Cited by 138
“…& Sen, 2008; Pienkowski & Eggermont, 2011c; for a review, see Barbour, 2011), particularly during attentive listening (Ding & Simon, 2012; Mesgarani & Chang, 2012), although the basis for such representations may begin to emerge in the cochlear nucleus (Blackburn & Sachs, 1990; for a review, see…”
BackgroundEngaged listeners: shared neural processing of powerful political speeches
Schmälzle, R., Häcker, F. E. K., Honey, C. J., & Hasson, U. (2015) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nsu168 · Cited by 135
Sestan, N., & State, M. W. (2018) · Neuron · doi:10.1016/j.neuron.2018.10.015 · Cited by 127
Deep language algorithms predict semantic comprehension from brain activity
Caucheteux, C., Gramfort, A., & King, J.-R. (2022) · Scientific Reports · doi:10.1038/s41598-022-20460-9 · Cited by 91
Fiedler, L., Seifi Ala, T., Graversen, C., Alickovic, E., Lunner, T., & Wendt, D. (2021) · Ear & Hearing · doi:10.1097/aud.0000000000001050 · Cited by 80
Conserved mechanisms of vocalization coding in mammalian and songbird auditory midbrain
Woolley, S. M. N., & Portfors, C. V. (2013) · Hearing Research · doi:10.1016/j.heares.2013.05.005 · Cited by 52
Functional imaging of auditory scene analysis
Gutschalk, A., & Dykstra, A. R. (2014) · Hearing Research · doi:10.1016/j.heares.2013.08.003 · Cited by 57
Yildiz, I. B., von Kriegstein, K., & Kiebel, S. J. (2013) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1003219 · Cited by 55
EskandariNasab, M., Raeisi, Z., Lashaki, R. A., & Najafi, H. (2024) · Scientific Reports · doi:10.1038/s41598-024-58886-y · Cited by 55
“In 2012, Mesgarani and Chang 21 showed that it is possible to decode auditory attention in multi-talker scenarios from brain signals.”
BackgroundHuman Responses to Visually Evoked Threat
Yilmaz Balban, M., Cafaro, E., Saue-Fletcher, L., Washington, M. J., Bijanzadeh, M., Lee, A. M., Chang, E. F., & Huberman, A. D. (2021) · Current Biology · doi:10.1016/j.cub.2020.11.035 · Cited by 48
Self-citationHierarchy of speech-driven spectrotemporal receptive fields in human auditory cortex
Venezia, J. H., Thurman, S. M., Richards, V. M., & Hickok, G. (2019) · NeuroImage · doi:10.1016/j.neuroimage.2018.11.049 · Cited by 47
Sleepers selectively suppress informative inputs during rapid eye movements
Koroma, M., Lacaux, C., Andrillon, T., Legendre, G., Léger, D., & Kouider, S. (2020) · Current Biology · doi:10.1016/j.cub.2020.04.047 · Cited by 37
How does inattention affect written and spoken language processing?
Cohen, L., Salondy, P., Pallier, C., & Dehaene, S. (2021) · Cortex · doi:10.1016/j.cortex.2021.02.007 · Cited by 29
Visual objects in the auditory system in sensory substitution: How much information do we need?
Brown, D. J., Simpson, A. J. R., & Proulx, M. J. (2014) · Multisensory Research · doi:10.1163/22134808-00002462 · Cited by 23
Metadata
- Authors
- Mesgarani, N., & Chang, E. F.
- Venue
- Nature
- Published
- 2012-04-18
- Volume
- 485
- Issue
- 7397
- Pages
- 233-236
- ISSN
- 0028-0836 (ISSN-L)
- 1476-4687
- OpenAlex
- W2082183045
- Cited by
- 1,007
- References
- 28
- FWCI
- 27.33
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.