Reconstructing Speech from Human Auditory Cortex
Open accessThe DOI matches its Crossref record; 61 of the 61 references it cites were found in a registry or an index.
Abstract
How the human auditory system extracts perceptually relevant acoustic features of speech is unknown. To address this question, we used intracranial recordings from nonprimary auditory cortex in the human superior temporal gyrus to determine what acoustic information in speech sounds can be reconstructed from population neural activity. We found that slow and intermediate temporal fluctuations, such as those corresponding to syllable rate, were accurately reconstructed using a linear model based on the auditory spectrogram. However, reconstruction of fast temporal fluctuations, such as syllable onsets and offsets, required a nonlinear sound representation based on temporal modulation energy. Reconstruction accuracy was highest within the range of spectro-temporal fluctuations that have been found to be critical for speech intelligibility. The decoded speech representations allowed readout and identification of individual words directly from brain activity during single trial sound presentations. These findings reveal neural encoding mechanisms of speech acoustic parameters in higher order human auditory cortex.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures





![Figure 6 Schematic of nonlinear modulation model. (A) The input spectrogram (top left) is transformed by a linear modulation filter bank (right) followed by a nonlinear magnitude operation (not shown). This nonlinear operation extracts the modulation energy of the incoming spectrogram and generates phase invariance to local fluctuations in the spectrogram envelope. The input representation is the two-dimensional spectrogram S(f,t) across frequency f and time t. The output (bottom left) is the four-dimensional modulation energy representation M(s,r,f,t) across spectral modulation scale s, temporal modulation rate r, frequency f, and time t. In the full modulation representation [18], negative rates by convention correspond to upward frequency sweeps, while positive rates correspond to downward frequency sweeps. Accuracy for positive and negative rates was averaged unless otherwise shown. See Materials and Methods. (B) Schematic of linear (spectrogram envelope) and nonlinear (modulation energy) temporal coding. Left: acoustic waveform (black curve) and spectrogram of a temporally modulated tone. The linear spectrogram model (top) assumes that neural responses are a linear function of the spectrogram envelope (plotted for the tone center frequency channel, top right). In this case, the instantaneous output may be high or low and does not directly indicate the modulation rate of the envelope. The nonlinear modulation model (bottom) assumes that neural responses are a linear function of modulation energy. This is an amplitude-based coding scheme (plotted for the peak modulation channel, bottom right). The nonlinear modulation model explicitly estimates the modulation rate by taking on a constant value for a constant rate [32].](https://figures.cochat.ai/paper-figures/d8911f10b353486dba673852c364a006/reconstructing-speech-from-human-auditory-cortex-figure-6.jpg)
![Figure 7 Example of nonlinear modulation coding and reconstruction. (A) Top: the spectrogram of an isolated word (“waldo”) presented aurally to one participant. Blue curve plots the spectrogram envelope, summed over all frequencies. Left panels: induced high gamma responses (black curves, trial averaged) at four different STG sites. Temporal modulation energy of the stimulus (dashed red curves) is overlaid (computed from 2, 4, 8, and 16 Hz modulation filters and normalized to maximum value). Dashed black lines indicate baseline response level. Right panels: nonlinear modulation rate tuning curves for each site (estimated from nonlinear STRFs). Shaded regions and error bars indicate SEM. (B) Original spectrogram (top), modulation-based reconstruction (middle), and spectrogram-based reconstruction (bottom), linearly decoded from a fixed set of STG electrodes. The modulation reconstruction is projected into the spectrogram domain using an iterative projection algorithm and an overcomplete set of modulation filters [18]. The displayed spectrogram is averaged over 100 random initializations of the algorithm.](https://figures.cochat.ai/paper-figures/2d2eaf31d85c437bb041f38dd7527a14/reconstructing-speech-from-human-auditory-cortex-figure-7.jpg)

Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Neural activity in the STG encodes acoustic features — for example, recurring speech sound patterns in the mel-spectrogram — during speech perception53,54 and may be used to reconstruct perceived speech55,56.”
From The speech neuroprosthesis (2024) · cites this paper as [56]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Elements of Statistical Learning
Hastie, T., Tibshirani, R., & Friedman, J. (2009) · Springer Series in Statistics · doi:10.1007/978-0-387-84858-7 · Cited by 25,970
Receptive fields, binocular interaction and functional architecture in the cat’s visual cortex
Hubel, D. H., & Wiesel, T. N. (1962) · The Journal of Physiology · doi:10.1113/jphysiol.1962.sp006837 · Cited by 13,680 · cited 1×
“The modulation model therefore represents an auditory analog to the classical energy model of complex cells in the visual system [32–36], which are invariant to the spatial phase of visual stimuli.”
MethodFundamentals of speech recognition
Rabiner, L. R., & Juang, B.-H. F. (1993) · Cited by 7,680
The cortical organization of speech processing
Hickok, G., & Poeppel, D. (2007) · Nature Reviews Neuroscience · doi:10.1038/nrn2113 · Cited by 5,495 · cited 2×
“For speech comprehension, it is hypothesized that intermediate and higher-order auditory areas extract or construct information-rich features of speech, while discarding nonessential low-level acoustic information [4,5,9, 10,43].”
BackgroundSpatiotemporal energy models for the perception of motion
Adelson, E. H., & Bergen, J. R. (1985) · Journal of the Optical Society of America A · doi:10.1364/josaa.2.000284 · Cited by 3,442 · cited 2×
“Such amplitude-based coding schemes are broadly referred to as ‘‘energy models’’ [32,33].”
BackgroundDISCONNEXION SYNDROMES IN ANIMALS AND MAN
GESCHWIND, N. (1965) · Brain · doi:10.1093/brain/88.2.237 · Cited by 3,403 · cited 5×
“To recover the acoustic waveform from the spectrogram, we used an iterative projection algorithm to estimate the phase [8].”
BackgroundMethodInfluentialTIMIT Acoustic-Phonetic Continuous Speech Corpus
Garofolo, J. S., Lamel, L. F., Fisher, W. M., Pallett, D. S., Dahlgren, N. L., Zue, V. W., & Fiscus, J. G. (2020) · Americanae (AECID Library) · doi:10.35111/17gk-bn40 · Cited by 2,508
Maps and streams in the auditory cortex: nonhuman primates illuminate human speech processing
Rauschecker, J. P., & Scott, S. K. (2009) · Nature Neuroscience · doi:10.1038/nn.2331 · Cited by 1,766 · cited 5×
“Beyond primary auditory areas, further processing in intermediate and higher-order auditory cortex likely results in additional stimulus transformations [5].”
BackgroundResultInfluentialLogothetis, N. K., & Wandell, B. A. (2004) · Annual Review of Physiology · doi:10.1146/annurev.physiol.66.082602.092845 · Cited by 1,568 · cited 1×
“This is consistent with robust speech-induced high gamma responses reported in previous intracranial studies [24–29] and with observed correlations between high gamma power and local spike rate [30].”
ResultIdentifying natural images from human brain activity
Kay, K. N., Naselaris, T., Prenger, R. J., & Gallant, J. L. (2008) · Nature · doi:10.1038/nature06713 · Cited by 1,286 · cited 2×
“An important application of this approach has also been demonstrated in the study of visual object recognition in the primate visual system [36,49,50].”
BackgroundMethodPredicting Human Brain Activity Associated with the Meanings of Nouns
Mitchell, T. M., Shinkareva, S. V., Carlson, A., Chang, K.-M., Malave, V. L., Mason, R. A., & Just, M. A. (2008) · Science · doi:10.1126/science.1152876 · Cited by 1,180 · cited 1×
“At a more abstract level of representation, a recent functional imaging study also demonstrated that the semantic content of nouns could be used as an effective encoding model across multiple cortical regions [48].”
BackgroundBialek, W., Rieke, F., de Ruyter van Steveninck, R. R., & Warland, D. (1991) · Science · doi:10.1126/science.2063199 · Cited by 992
Neural Processing of Amplitude-Modulated Sounds
JORIS, P. X., SCHREINER, C. E., & REES, A. (2004) · Physiological Reviews · doi:10.1152/physrev.00029.2003 · Cited by 938 · cited 1×
“reconstructed the sound pressure waveform using neural responses from the bullfrog auditory periphery, where neural responses phase-lock to fluctuations in the raw stimulus waveform”
BackgroundMultiresolution spectrotemporal analysis of complex sounds
Chi, T., Ru, P., & Shamma, S. A. (2005) · The Journal of the Acoustical Society of America · doi:10.1121/1.1945807 · Cited by 673 · cited 10×
“We investigated an alternative, nonlinear model based on modulation (described in detail in [18]).”
BackgroundMethodInfluentialSelf-citationPenn, T. (1999) · Medical Entomology and Zoology · Cited by 652
Who “Is Saying What”? Brain-based decoding of human voice and speech
Formisano, E., De Martino, F., Bonte, M., & Goebel, R. (2008) · Science · doi:10.1126/science.1164318 · Cited by 599 · cited 1×
“Previous work suggests that categorical representations are an important organizational principle in STG [9,45–47].”
BackgroundDau, T., Kollmeier, B., & Kohlrausch, A. (1997) · The Journal of the Acoustical Society of America · doi:10.1121/1.420344 · Cited by 594 · cited 1×
“Envelope fluctuations in the spectrogram are referred to as modulations [18–22] and play an important role in the intelligibility of speech [19,21].”
BackgroundCategorical speech representation in human superior temporal gyrus
Chang, E. F., Rieger, J. W., Johnson, K., Berger, M. S., Barbaro, N. M., & Knight, R. T. (2010) · Nature Neuroscience · doi:10.1038/nn.2641 · Cited by 588 · cited 2×
“Multi-channel ECoG data were amplified and digitally recorded with sampling rate = 1,000 Hz (N = 6 participants) [24], 2,003 Hz (N = 5) [25], or 3,052 Hz (N = 4) [46].”
BackgroundSelf-citationModulation spectra of natural sounds and ethological theories of auditory processing
Singh, N. C., & Theunissen, F. E. (2003) · The Journal of the Acoustical Society of America · doi:10.1121/1.1624067 · Cited by 521 · cited 2×
“The spectrogram envelope of natural sounds is not static but rather fluctuates across both frequency and time [19–21].”
BackgroundBayesian Reconstruction of Natural Images from Human Brain Activity
Naselaris, T., Prenger, R. J., Kay, K. N., Oliver, M., & Gallant, J. L. (2009) · Neuron · doi:10.1016/j.neuron.2009.09.006 · Cited by 511
Induced electrocorticographic gamma activity during auditory perception
Crone, N. E., Boatman, D., Gordon, B., & Hao, L. (2001) · Clinical Neurophysiology · doi:10.1016/s1388-2457(00)00545-9 · Cited by 494
Self-citationTemporal and rate representations of time-varying signals in the auditory cortex of awake primates
Lu, T., Liang, L., & Wang, X. (2001) · Nature Neuroscience · doi:10.1038/nn737 · Cited by 461
The Modulation Transfer Function for Speech Intelligibility
Elliott, T. M., & Theunissen, F. E. (2009) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1000302 · Cited by 461 · cited 5×
“These slow temporal fluctuations carry essential phonological information such as formant transitions and syllable rate [7,19,21].”
BackgroundInfluentialSpectrotemporal Receptive Fields in the Lemniscal Auditory Thalamus and Cortex
Miller, L. M., Escabí, M. A., Read, H. L., & Schreiner, C. E. (2002) · Journal of Neurophysiology · doi:10.1152/jn.00395.2001 · Cited by 350 · cited 1×
“Linear rate tuning computed in this way was similar to that computed from the modulation transfer function (modulus of the 2-D Fourier transform) of the fitted linear STRF [57].”
MethodNatural Stimulus Statistics Alter the Receptive Field Structure of V1 Neurons
David, S. V., Vinje, W. E., & Gallant, J. L. (2004) · The Journal of Neuroscience · doi:10.1523/jneurosci.1422-04.2004 · Cited by 344 · cited 1×
“Choosing a nonlinear stimulus representation effectively linearizes the stimulus-response mapping and allows one to fit linear models to the new space of transformed stimulus features [17,35].”
BackgroundSelf-citationCOMPLETE FUNCTIONAL CHARACTERIZATION OF SENSORY NEURONS BY SYSTEM IDENTIFICATION
Wu, M. C.-K., David, S. V., & Gallant, J. L. (2006) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.29.051605.113024 · Cited by 338 · cited 5×
“5 min for different participants) using coordinate gradient descent with early stopping regularization, an iterative linear regression algorithm [16,36,49].”
BackgroundMethodInfluentialSelf-citationSpectro-temporal modulation transfer functions and speech intelligibility
Chi, T., Gao, Y., Guyton, M. C., Ru, P., & Shamma, S. (1999) · The Journal of the Acoustical Society of America · doi:10.1121/1.428100 · Cited by 336 · cited 5×
“These slow temporal fluctuations carry essential phonological information such as formant transitions and syllable rate [7,19,21].”
BackgroundInfluentialSelf-citation(1995) · Proceedings of the Royal Society of London. Series B: Biological Sciences · doi:10.1098/rspb.1995.0204 · Cited by 317 · cited 1×
“[41] reconstructed the sound pressure waveform using neural responses from the bullfrog auditory periphery, where neural responses phase-lock to fluctuations in the raw stimulus waveform [2].”
BackgroundTemporal Envelope of Time-Compressed Speech Represented in the Human Auditory Cortex
Nourski, K. V., Reale, R. A., Oya, H., Kawasaki, H., Kovach, C. K., Chen, H., Howard, M. A., & Brugge, J. F. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.3065-09.2009 · Cited by 250 · cited 2×
“0005, df = 14, Bonferroni correction) indicating that the high gamma response faithfully tracks the spectrogram envelope at these rates [26].”
BackgroundResultPattern Classification Using Ensemble Methods
Rokach, L. (2009) · Series in Machine Perception and Artificial Intelligence · doi:10.1142/7238 · Cited by 248
Reconstruction of Natural Scenes from Ensemble Responses in the Lateral Geniculate Nucleus
Stanley, G. B., Li, F. F., & Dan, Y. (1999) · The Journal of Neuroscience · doi:10.1523/jneurosci.19-18-08036.1999 · Cited by 240 · cited 2×
“We investigated the nature of auditory information contained in temporal cortex neural responses using a stimulus reconstruction approach (see Materials and Methods) [12–15].”
BackgroundMethodSpatiotemporal dynamics of word processing in the human brain
Canolty, R. T. (2007) · Frontiers in Neuroscience · doi:10.3389/neuro.01.1.1.014.2007 · Cited by 226 · cited 3×
“Multi-channel ECoG data were amplified and digitally recorded with sampling rate = 1,000 Hz (N = 6 participants) [24], 2,003 Hz (N = 5) [25], or 3,052 Hz (N = 4) [46].”
BackgroundMethodSelf-citationSpatiotemporal imaging of cortical activation during verb generation and picture naming
Edwards, E., Nagarajan, S. S., Dalal, S. S., Canolty, R. T., Kirsch, H. E., Barbaro, N. M., & Knight, R. T. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2009.12.035 · Cited by 216
Self-citationPei, X., Leuthardt, E. C., Gaona, C. M., Brunner, P., Wolpaw, J. R., & Schalk, G. (2011) · NeuroImage · doi:10.1016/j.neuroimage.2010.10.029 · Cited by 204 · cited 1×
“This is consistent with robust speech-induced high gamma responses reported in previous intracranial studies [24–29] and with observed correlations between high gamma power and local spike rate [30].”
ResultNeural coding of temporal information in auditory thalamus and cortex
Wang, X., Lu, T., Bendor, D., & Bartlett, E. (2008) · Neuroscience · doi:10.1016/j.neuroscience.2008.03.065 · Cited by 191 · cited 1×
“, bottom). These combined results support the idea of an emergent population-level representation of temporal modulation energy in primate auditory cortex”
ResultThe Primate Cortical Auditory System and Neural Representation of Conspecific Vocalizations
Romanski, L. M., & Averbeck, B. B. (2009) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.051508.135431 · Cited by 186 · cited 2×
“described in previous work [10,11], the effect of stimulus statistics”
BackgroundSingle-Trial Speech Suppression of Auditory Cortex Activity in Humans
Flinker, A., Chang, E. F., Kirsch, H. E., Barbaro, N. M., Crone, N. E., & Knight, R. T. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.1809-10.2010 · Cited by 182
Self-citationEstimating sparse spectro-temporal receptive fields with natural stimuli
David, S. V., Mesgarani, N., & Shamma, S. A. (2007) · Network: Computation in Neural Systems · doi:10.1080/09548980701609235 · Cited by 171 · cited 2×
“The spectrogram representation (linear model) was generated from the speech waveform using a 128 channel auditory filter bank mimicking the auditory periphery [18,53].”
MethodSelf-citationModeling auditory processing of amplitude modulation
Dau, T. (1997) · The Journal of the Acoustical Society of America · doi:10.1121/1.418727 · Cited by 167
Temporal Envelope Processing in the Human Left and Right Auditory Cortices
Liegeois-Chauvel, C. (2004) · Cerebral Cortex · doi:10.1093/cercor/bhh033 · Cited by 167 · cited 3×
“with prior recordings from lateral temporal human cortex [31], average envelope-locked responses exhibit prominent tuning to low rates (1–8 Hz) with a gradual loss of sensitivity at higher rates (.”
BackgroundResultMesgarani, N., David, S. V., Fritz, J. B., & Shamma, S. A. (2009) · Journal of Neurophysiology · doi:10.1152/jn.91128.2008 · Cited by 164 · cited 4×
“Consistent with these response properties, spectrogram reconstruction has been demonstrated using neural responses from mammalian primary auditory cortex [14] or the avian midbrain [15].”
BackgroundMethodInfluentialSelf-citationA Canonical Neural Circuit for Cortical Nonlinear Operations
Kouh, M., & Poggio, T. (2008) · Neural Computation · doi:10.1162/neco.2008.02-07-466 · Cited by 162 · cited 1×
“Such amplitude-based coding schemes are broadly referred to as ‘‘energy models’’ [32,33].”
BackgroundDifferential neural coding of acoustic flutter within primate auditory cortex
Bendor, D., & Wang, X. (2007) · Nature Neuroscience · doi:10.1038/nn1888 · Cited by 159 · cited 1×
“In support of this notion, subpopulations of neurons have been found that exhibit both envelope and energy-based response properties in primary auditory cortex of non-human primates [37–39].”
BackgroundPredicting neuronal responses during natural vision
David, S. V., & Gallant, J. L. (2005) · Network Computation in Neural Systems · doi:10.1080/09548980500464030 · Cited by 147 · cited 1×
“= 1.0 due to the presence of random noise that is unrelated to the stimulus. With repeated trials of identical stimuli, it is possible to estimate trial-to-trial variability to correct for the amount of potentially explainable variance”
BackgroundInfluentialSelf-citationListening to Speech : An Auditory Perspective
Greenberg, S., & Ainsworth, W. A. (2012) · Cited by 129
Evaluating Microarray-based Classifiers: An Overview
Boulesteix, A., Strobl, C., Augustin, T., & Däumer, M. (2008) · Cancer Informatics · doi:10.4137/cin.s408 · Cited by 129 · cited 1×
“, also referred to as Monte Carlo cross-validation”
BackgroundNeural Representation of Natural Images in Visual Area V2
Willmore, B. D. B., Prenger, R., & Gallant, J. L. (2010) · Journal of Neuroscience · doi:10.1523/jneurosci.4099-09.2010 · Cited by 122 · cited 2×
“An important application of this approach has also been demonstrated in the study of visual object recognition in the primate visual system [36,49,50].”
BackgroundMethodCoding of Auditory-Stimulus Identity in the Auditory Non-Spatial Processing Stream
Russ, B. E., Ackelson, A. L., Baker, A. E., & Cohen, Y. E. (2007) · Journal of Neurophysiology · doi:10.1152/jn.01069.2007 · Cited by 116 · cited 1×
“Our results are therefore consistent with the idea of pSTG as an intermediate stage in a hierarchy of auditory object processing [5,9,10,44].”
ResultDisconnexion Syndromes in Animals and Man: Part I
Geschwind, N. (2010) · Neuropsychology Review · doi:10.1007/s11065-010-9131-0 · Cited by 114
Representation of speech categories in the primate auditory cortex
Tsunada, J., Lee, J. H., & Cohen, Y. E. (2011) · Journal of Neurophysiology · doi:10.1152/jn.00037.2011 · Cited by 112 · cited 1×
“Previous work suggests that categorical representations are an important organizational principle in STG [9,45–47].”
BackgroundSerial and parallel processing in the primate auditory cortex revisited
Recanzone, G. H., & Cohen, Y. E. (2009) · Behavioural Brain Research · doi:10.1016/j.bbr.2009.08.015 · Cited by 105 · cited 5×
“play a critical role in the transformation of acoustic information into phonetic and pre-lexical representations [4,5,9,10].”
BackgroundResultInfluentialNeural representation of spectral and temporal information in speech
Young, E. D. (2008) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.2007.2151 · Cited by 104 · cited 3×
“primary auditory cortex (A1) [1–3,6], yields a faithful representation of the spectro-temporal properties of the sound waveform, including those acoustic cues relevant for speech perception, such”
BackgroundResultRepresentation of temporal sound features in the human auditory cortex
Nourski, K. V., & Brugge, J. F. (2011) · Reviews in the Neurosciences · doi:10.1515/rns.2011.016 · Cited by 80 · cited 1×
“Although additional studies are needed, this is consistent with a number of results suggesting that the capacity for envelopelocking decreases along the auditory pathway, extending from the inferior colliculus (32–256 Hz), medial geniculate body (16 Hz), primary auditory cortex (8 Hz), to nonprimary auditory areas (4–…”
ResultRamirez, A. D., Ahmadian, Y., Schumacher, J. W., Schneider, D. M., Woolley, S. M. N., & Paninski, L. (2011) · Journal of Neuroscience · doi:10.1523/jneurosci.3256-10.2011 · Cited by 27
Spectral Processing in Auditory Cortex
Schreiner, C. E., Froemke, R. C., & Atencio, C. A. (2010) · Springer eBooks · doi:10.1007/978-1-4419-0074-6_13 · Cited by 24
Temporal Coding in Auditory Cortex
Eggermont, J. J., & Wang, X. (2010) · Springer eBooks · doi:10.1007/978-1-4419-0074-6_14 · Cited by 20
Spatial Localization of Cortical Time-Frequency Dynamics
Dalal, S. S., Guggisberg, A. G., Edwards, E., Sekihara, K., Findlay, A. M., Canolty, R. T., Knight, R. T., Barbaro, N. M., Kirsch, H. E., & Nagarajan, S. S. (2007) · Conference proceedings · doi:10.1109/iembs.2007.4353449 · Cited by 18 · cited 1×
“Localization and coregistration of electrodes with the structural MRI is described in detail in [51].”
BackgroundSelf-citationPhysiological foundations of temporal integration in the perception of speech
Shamma, S. (2003) · Journal of Phonetics · doi:10.1016/j.wocn.2003.09.001 · Cited by 16 · cited 5×
“right) by taking the modulus of the 2-D Fourier transform [7] or by”
BackgroundMethodInfluentialSelf-citationUnlocking the role of the superior temporal gyrus for speech sound categorization
Steinschneider, M. (2011) · Journal of Neurophysiology · doi:10.1152/jn.00238.2011 · Cited by 12 · cited 7×
“study, we used an optimal linear estimator (Wiener filter) [10],”
BackgroundMethodResultInfluentialTemporal and Rate Representations of Time-Varying Signals in Auditory Cortex
Wang, X., Lu, T., & Li, L. (2006) · Springer eBooks · doi:10.1007/0-387-23181-1_7 · Cited by 10
Temporal integration in the perception of speech: introduction
Nguyen, N., & Hawkins, S. (2003) · Journal of Phonetics · doi:10.1016/j.wocn.2003.09.003 · Cited by 8
Cited by
Cortical tracking of hierarchical linguistic structures in connected speech
Ding, N., Melloni, L., Zhang, H., Tian, X., & Poeppel, D. (2016) · Nature Neuroscience · doi:10.1038/nn.4186 · Cited by 1,059
Selective cortical representation of attended speaker in multi-talker speech perception
Mesgarani, N., & Chang, E. F. (2012) · Nature · doi:10.1038/nature11020 · Cited by 1,007
Self-citationMechanisms underlying selective neuronal tracking of attended speech at a “cocktail party”
Zion Golumbic, E. M., Ding, N., Bickel, S., Lakatos, P., Schevon, C. A., McKhann, G. M., Goodman, R. R., Emerson, R., Mehta, A. D., Simon, J. Z., et al. (2013) · Neuron · doi:10.1016/j.neuron.2012.12.037 · Cited by 909
“This selectivity itself seems to sharpen as a sentence unfolds.”
BackgroundInfluentialSpeech synthesis from neural decoding of spoken sentences
Anumanchipalli, G. K., Chartier, J., & Chang, E. F. (2019) · Nature · doi:10.1038/s41586-019-1119-1 · Cited by 883
“Meanwhile, decoding of auditory cortex responses has been more successful for speech sounds 30,31 in part because of the direct relationship between the auditory encoding of spectrotemporal information and the reconstructed spectrogram.”
BackgroundSelf-citationEmergence of neural encoding of auditory objects while listening to competing speakers
Ding, N., & Simon, J. Z. (2012) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1205381109 · Cited by 835
“These hypothesized, object-specific neural representations are investigated and revealed, using single-trial neural recordings and an advanced neural decoding method that parallels state-of-theart analysis methods used in functional MRI (fMRI) (23) and intracranial recording (24, 25).”
Method
Metadata
- Authors
- Pasley, B. N., David, S. V., Mesgarani, N., Flinker, A., Shamma, S. A., Crone, N. E., Knight, R. T., & Chang, E. F.
- Affiliations
- University of California, Berkeley (US)
- University of Maryland, College Park (US)
- University of California, San Francisco (US)
- Johns Hopkins University (US)
- Corresponding author
- Pasley, Brian N.
- ORCID
- Venue
- PLoS Biology
- Publisher
- Public Library of Science (PLoS)
- Published
- 2012-01-31
- Volume
- 10
- Issue
- 1
- Pages
- e1001251
- ISSN
- 1544-9173 (ISSN-L)
- 1545-7885
- PMC
- PMC3269422
- OpenAlex
- W2005066437
- Cited by
- 604
- References
- 61
- Citations by year
- 2026: 21 · 2025: 30 · 2024: 28 · 2023: 35 · 2022: 36 · 2021: 32 · 2020: 51 · 2019: 66 · 2018: 42 · 2017: 53 · 2016: 43 · 2015: 51 · 2014: 42 · 2013: 50 · 2012: 24
- FWCI
- 27.32
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- PLoS Biology (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- eScholarship (California Digital Library) (submittedVersion)
- Figshare (submittedVersion, cc-by)
- Funders
- National Institutes of Health (2r01ns021135-33, 5r00ns065120-04)
- U.S. Public Health Service (P04813)
- National Institute on Deafness and Other Communication Disorders (K99DC010439, K99DC012804, R01DC012379)
- National Institute of Neurological Disorders and Stroke (NS-40596, NS-21135, K99NS065120, R56NS021135, R37NS021135, R01NS040596, R00-NS065120, R01 NS-021135)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neuroscience and Music Perception
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Phonetics and Phonology Research
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neurobiology of Language and Bilingualism
- Keywords
- speech perception, auditory cortex, superior temporal gyrus, neural decoding, speech reconstruction, acoustic features, syllable rate, word recognition, nonlinear decoding, speech intelligibility
- MeSH terms
- Algorithms, Auditory Cortex, Brain Mapping, Computer Simulation, Electrodes, Implanted, Electroencephalography, Female, Humans, Male, Models, Biological, Speech Acoustics, Linear Models
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.