Perceptual restoration of masked speech in human cortex
Open accessThe DOI matches its Crossref record; 49 of the 49 references it cites were found in a registry or an index.
Abstract
Humans are adept at understanding speech despite the fact that our natural listening environment is often filled with interference. An example of this capacity is phoneme restoration, in which part of a word is completely replaced by noise, yet listeners report hearing the whole word. The neurological basis for this unconscious fill-in phenomenon is unknown, despite being a fundamental characteristic of human hearing. Here, using direct cortical recordings in humans, we demonstrate that missing speech is restored at the acoustic-phonetic level in bilateral auditory cortex, in real-time. This restoration is preceded by specific neural activity patterns in a separate language area, left frontal cortex, which predicts the word that participants later report hearing. These results demonstrate that during speech perception, missing acoustic content is synthesized online from the integration of incoming sensory cues and the internal neural dynamics that bias word-level expectation and prediction.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures




Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“To illustrate, sensitivity to auditory stimuli is linked to intrinsic activity levels in lower-level auditory regions prior to stimulus appearance (e.g., Hesselmann, Sadaghiani, Friston, & Kleinschmidt, 2010), and phonemic restoration effects in noise are impacted by the state of the system prior to presentation of the ambiguous stimulus (Leonard, Baud, Sjerps, & Chang, 2016).”
From Grounding the neurobiology of language in first principles: The necessity of non-language-centric explanations for language comprehension (2018) · cites this paper as Leonard, Baud, Sjerps, & Chang, 2016
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
An Integrative Theory of Prefrontal Cortex Function
Miller, E. K., & Cohen, J. D. (2001) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.24.1.167 · Cited by 12,803
The free-energy principle: a unified brain theory?
Friston, K. (2010) · Nature Reviews Neuroscience · doi:10.1038/nrn2787 · Cited by 8,120
Praat: Doing Phonetics by Computer
(2011) · Ear & Hearing · doi:10.1097/aud.0b013e31821473f7 · Cited by 7,863
Auditory Scene Analysis: The Perceptual Organization of Sound
Bregman, A. S. (1990) · The MIT Press eBooks · doi:10.7551/mitpress/1486.001.0001 · Cited by 3,284
Auditory Scene Analysis: The Perceptual Organization of Sound
Bregman, A. S., & McAdams, S. (1994) · The Journal of the Acoustical Society of America · doi:10.1121/1.408434 · Cited by 3,029
The TRACE model of speech perception
McClelland, J. L., & Elman, J. L. (1986) · Cognitive Psychology · doi:10.1016/0010-0285(86)90015-0 · Cited by 2,956
Structural and Functional Brain Networks: From Connections to Cognition
Park, H.-J., & Friston, K. (2013) · Science · doi:10.1126/science.1238411 · Cited by 2,106
Context-dependent computation by recurrent dynamics in prefrontal cortex
Mante, V., Sussillo, D., Shenoy, K. V., & Newsome, W. T. (2013) · Nature · doi:10.1038/nature12742 · Cited by 1,847
DARPA TIMIT: acoustic-phonetic continuous speech corpus CD-ROM, NIST speech disc 1-1.1
Garofolo, J. S., Lamel, L. F., Fisher, W. M., Fiscus, J. G., Pallett, D. S., & Dahlgren, N. L. (1993) · doi:10.6028/nist.ir.4930 · Cited by 1,267
Dimensionality reduction for large-scale neural recordings
Cunningham, J. P., & Yu, B. M. (2014) · Nature Neuroscience · doi:10.1038/nn.3776 · Cited by 1,219 · cited 2×
“To explore how such rapid processing of noise as phonemic percepts is possible, we leveraged single-trial analyses of neural population dynamics 16 .”
Cited by
How Do Expectations Shape Perception?
de Lange, F. P., Heilbron, M., & Kok, P. (2018) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2018.06.002 · Cited by 975
Predicting while comprehending language: A theory and review.
Pickering, M. J., & Gambi, C. (2018) · Psychological Bulletin · doi:10.1037/bul0000158 · Cited by 518
Neural Entrainment and Attentional Selection in the Listening Brain
Obleser, J., & Kayser, C. (2019) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2019.08.004 · Cited by 432
The Encoding of Speech Sounds in the Superior Temporal Gyrus
Yi, H. G., Leonard, M. K., & Chang, E. F. (2019) · Neuron · doi:10.1016/j.neuron.2019.04.023 · Cited by 417
Self-citationThe Border Between Seeing and Thinking
Block, N. (2023) · doi:10.1093/oso/9780197622223.001.0001 · Cited by 367
Rapid Transformation from Auditory to Linguistic Representations of Continuous Speech
Brodbeck, C., Hong, L. E., & Simon, J. Z. (2018) · Current Biology · doi:10.1016/j.cub.2018.10.042 · Cited by 304
The revolution will not be controlled: natural stimuli in speech neuroscience
Hamilton, L. S., & Huth, A. G. (2020) · Language, Cognition and Neuroscience · doi:10.1080/23273798.2018.1499946 · Cited by 301
The language network as a natural kind within the broader landscape of the human brain
Fedorenko, E., Ivanova, A. A., & Regev, T. I. (2024) · Nature Reviews Neuroscience · doi:10.1038/s41583-024-00802-4 · Cited by 293
Real-time decoding of question-and-answer speech dialogue using human cortical activity
Moses, D. A., Leonard, M. K., Makin, J. G., & Chang, E. F. (2019) · Nature Communications · doi:10.1038/s41467-019-10994-4 · Cited by 224
Self-citationHasson, U., Egidi, G., Marelli, M., & Willems, R. M. (2018) · Cognition · doi:10.1016/j.cognition.2018.06.018 · Cited by 157
Decoding Inner Speech Using Electrocorticography: Progress and Challenges Toward a Speech Prosthesis
Martin, S., Iturrate, I., Millán, J. D. R., Knight, R. T., & Pasley, B. N. (2018) · Frontiers in Neuroscience · doi:10.3389/fnins.2018.00422 · Cited by 115
A Neurosurgical Functional Dissection of the Middle Precentral Gyrus during Speech Production
Silva, A. B., Liu, J. R., Zhao, L., Levy, D. F., Scott, T. L., & Chang, E. F. (2022) · The Journal of Neuroscience · doi:10.1523/jneurosci.1614-22.2022 · Cited by 111
“One interpretation is that precentral activations may be particularly important for perceptually challenging situations where internally generated motor representations of speech may help with sound discrimination (Leonard et al., 2016).”
BackgroundSelf-citation
Metadata
- Authors
- Leonard, M. K., Baud, M. O., Sjerps, M. J., & Chang, E. F.
- Affiliations
- University of California, San Francisco (US)
- Radboud University Nijmegen (NL)
- Corresponding author
- Chang, Edward F.
- Venue
- Nature Communications
- Published
- 2016-12-20
- Volume
- 7
- Issue
- 1
- Pages
- 13619-13619
- ISSN
- 2041-1723 (ISSN-L)
- PMC
- PMC5187421
- OpenAlex
- W2563866812
- Cited by
- 170
- References
- 49
- Citations by year
- 2026: 8 · 2025: 13 · 2024: 16 · 2023: 37 · 2022: 15 · 2021: 15 · 2020: 17 · 2019: 19 · 2018: 20 · 2017: 10
- FWCI
- 10.29
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/4.0 (tdm)
- creativecommons.org/licenses/by/4.0 (vor)
- Locations
- Nature Communications (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- MPG.PuRe (Max Planck Society) (submittedVersion, cc-by)
- Radboud Repository (Radboud University) (submittedVersion, cc-by)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- eScholarship (California Digital Library) (submittedVersion)
- Radboud Repository (Radboud University) (submittedVersion)
- Funders
- New York Stem Cell Foundation
- McKnight Foundation
- Shurl and Kay Curci Foundation
- European Commission (623072)
- National Institutes of Health (DP2-OD00862, OD00862, R00-NS065120, 5r00ns065120-04)
- National Institute on Deafness and Other Communication Disorders (F32DC013486, R01DC012379)
- National Institute of Neurological Disorders and Stroke (R00-NS065120)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neurobiology of Language and Bilingualism
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neuroscience and Music Perception
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Phonetics and Phonology Research
- Keywords
- auditory cortex, speech perception, language areas, left frontal cortex, word prediction, neural dynamics, sensory cue integration
- MeSH terms
- Acoustic Stimulation, Adult, Auditory Cortex, Female, Humans, Male, Middle Aged, Noise, Perceptual Masking, Phonetics, Speech Perception
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.