Echoes of the spoken past: how auditory cortex hears context during speech perception
Open accessThe DOI matches its Crossref record; 35 of the 35 references it cites were found in a registry or an index.
Abstract
What do we hear when someone speaks and what does auditory cortex (AC) do with that sound? Given how meaningful speech is, it might be hypothesized that AC is most active when other people talk so that their productions get decoded. Here, neuroimaging meta-analyses show the opposite: AC is least active and sometimes deactivated when participants listened to meaningful speech compared to less meaningful sounds. Results are explained by an active hypothesis-and-test mechanism where speech production (SP) regions are neurally re-used to predict auditory objects associated with available context. By this model, more AC activity for less meaningful sounds occurs because predictions are less successful from context, requiring further hypotheses be tested. This also explains the large overlap of AC co-activity for less meaningful sounds with meta-analyses of SP. An experiment showed a similar pattern of results for non-verbal context. Specifically, words produced less activity in AC and SP regions when preceded by co-speech gestures that visually described those words compared to those words without gestures. Results collectively suggest that what we ‘hear’ during real-world speech perception may come more from the brain than our ears and that the function of AC is to confirm or deny internal predictions about the identity of sounds.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Whatever next? Predictive brains, situated agents, and the future of cognitive science
Clark, A. (2013) · Behavioral and Brain Sciences · doi:10.1017/s0140525x12000477 · Cited by 5,924 · cited 1×
“B 3690130297 (i) Speech production regions There has been a resurgence of research and theory pertaining to ‘the predictive brain’ [79].”
BackgroundWorking memory: Looking back and looking forward
Baddeley, A. (2003) · Nature Reviews Neuroscience · doi:10.1038/nrn1201 · Cited by 5,200
A theory of cortical responses.
Friston, K. (2005) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2005.1622 · Cited by 4,578 · cited 3×
“In particular, there are several ubiquitous effects that are contingent on repeated and surprising stimulus presentations that Friston and co-workers have suggested be re-characterized in a predictive coding (free-energy) framework, including repetition suppression (RS) and the mismatch negativity (MMN) [108].”
BackgroundVisual Contribution to Speech Intelligibility in Noise
Sumby, W. H., & Pollack, I. (1954) · The Journal of the Acoustical Society of America · doi:10.1121/1.1907309 · Cited by 2,583 · cited 1×
“These are a visible form of context that listeners use to improve speech perception, equivalent to removing up to 20 dB of noise from the auditory signal [33].”
BackgroundCommon blood flow changes across visual tasks: II. Decreases in cerebral cortex
Shulman, G. L., Fiez, J. A., Corbetta, M., Buckner, R. L., Miezin, F. M., Raichle, M. E., & Petersen, S. E. (1997) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.1997.9.5.648 · Cited by 1,890 · cited 1×
“(ii) Metabolic savings Results suggest that context is used to generate predictions and that this process ultimately results in a decrease in metabolic expenditure both in terms of relative activation and, possibly, deactivation (see [98–100] for other examples of language- and auditory-related deactivation).”
BackgroundAn integrated theory of language production and comprehension
Pickering, M. J., & Garrod, S. (2013) · Behavioral and Brain Sciences · doi:10.1017/s0140525x12001495 · Cited by 1,569
Bias between MNI and Talairach coordinates analyzed using the ICBM‐152 brain template
Lancaster, J. L., Tordesillas‐Gutiérrez, D., Martinez, M., Salinas, F., Evans, A., Zilles, K., Mazziotta, J. C., & Fox, P. T. (2007) · Human Brain Mapping · doi:10.1002/hbm.20345 · Cited by 1,464
The mismatch negativity: a review of underlying mechanisms
Garrido, M. I., Kilner, J. M., Stephan, K. E., & Friston, K. J. (2009) · Clinical Neurophysiology · doi:10.1016/j.clinph.2008.11.029 · Cited by 1,441 · cited 1×
“case, repeating stimuli similarly lead to less AC activity and the surprising event, because it is not predictable, results in a large prediction error in AC and, therefore, more activity relative to the repeating event [108,112,113].”
BackgroundPulvermüller, F. (1999) · Behavioral and Brain Sciences · doi:10.1017/s0140525x9900182x · Cited by 1,284
Neural reuse: A fundamental organizational principle of the brain
Anderson, M. L. (2010) · Behavioral and Brain Sciences · doi:10.1017/s0140525x10000853 · Cited by 1,212
Processing of low-probability sounds by cortical neurons
Ulanovsky, N., Las, L., & Nelken, I. (2003) · Nature Neuroscience · doi:10.1038/nn1032 · Cited by 1,049
Behavioral interpretations of intrinsic connectivity networks
Laird, A. R., Fox, P. M., Eickhoff, S. B., Turner, J. A., Ray, K. L., McKay, D. R., Glahn, D. C., Beckmann, C. F., Smith, S. M., & Fox, P. T. (2011) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_00077 · Cited by 1,023 · cited 2×
“[52] of all of the neuroimaging data in the BrainMap database (data are available for download at http://brainmap.”
BackgroundJardri, R., Pouchet, A., Pins, D., & Thomas, P. (2011) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2010.09101522 · Cited by 651
Pauses, gaps and overlaps in conversations
Heldner, M., & Edlund, J. (2010) · Journal of Phonetics · doi:10.1016/j.wocn.2010.08.002 · Cited by 575
Brain regions involved in articulation
Wise, R., Greene, J., Büchel, C., & Scott, S. (1999) · The Lancet · doi:10.1016/s0140-6736(98)07491-1 · Cited by 517
Knowledge in perception and illusion
Gregory, R. L. (1997) · Philosophical Transactions of the Royal Society of London. Series B: Biological Sciences · doi:10.1098/rstb.1997.0095 · Cited by 498
Eickhoff, S. B., Bzdok, D., Laird, A. R., Roski, C., Caspers, S., Zilles, K., & Fox, P. T. (2011) · NeuroImage · doi:10.1016/j.neuroimage.2011.05.021 · Cited by 484 · cited 3×
“The new TTG search results were used as the basis of a co-activation ALE meta-analysis, a determination of which regions reliably co-activate with the TTG [50].”
MethodNeural substrates of vocalization feedback monitoring in primate auditory cortex
Eliades, S. J., & Wang, X. (2008) · Nature · doi:10.1038/nature06910 · Cited by 479 · cited 2×
“This shapes processing and increases sensitivity to acoustic patterns associated with the predicted auditory object [31,32].”
BackgroundDiffusion tensor imaging in autism spectrum disorder: a review
Travers, B. G., Adluru, N., Ennis, C., Tromp, D. P. M., Destiche, D., Doran, S., Bigler, E. D., Lange, N., Lainhart, J. E., & Alexander, A. L. (2012) · Autism Research · doi:10.1002/aur.1243 · Cited by 450 · cited 1×
“Similarly, AC processing deficits in autism [123] might well be associated with poor long-range connectivity from frontal SP to AC regions [124].”
BackgroundStuttered and fluent speech production: An ALE meta‐analysis of functional neuroimaging studies
Brown, S., Ingham, R. J., Ingham, J. C., Laird, A. R., & Fox, P. T. (2005) · Human Brain Mapping · doi:10.1002/hbm.20140 · Cited by 449 · cited 3×
“As a simplification, some ‘core’ regions supporting SP, like the anterior insula, supplementary motor area (SMA), basal ganglia and cerebellum [27,28], are not explicitly considered until the discussion (§4b(i)) Hypothesis formation (figure 1b 1 ! 3).”
BackgroundPrior expectation mediates neural adaptation to repeated sounds in the auditory cortex: an MEG study
Todorovic, A., van Ede, F., Maris, E., & de Lange, F. P. (2011) · Journal of Neuroscience · doi:10.1523/jneurosci.1425-11.2011 · Cited by 391 · cited 1×
“In the RS case, stimuli are more predictable because they are repeating and this leads to less prediction error and, therefore, less AC activity [108–111].”
BackgroundThe role of the supplementary motor area (SMA) in word production
Alario, F.-X., Chainay, H., Lehericy, S., & Cohen, L. (2006) · Brain Research · doi:10.1016/j.brainres.2005.11.104 · Cited by 377
Transitions in neural oscillations reflect prediction errors generated in audiovisual speech
Arnal, L. H., Wyart, V., & Giraud, A.-L. (2011) · Nature Neuroscience · doi:10.1038/nn.2810 · Cited by 353 · cited 1×
“This predictive account is supported by other fMRI [38,39] and transcranial magnetic stimulation [40] studies and methods with better temporal resolution [41].”
ResultAuditory verbal hallucinations predominantly activate the right inferior frontal area
Sommer, I. E. C., Diederen, K. M. J., Blom, J.-D., Willems, A., Kushan, L., Slotema, K., Boks, M. P. M., Daalman, K., Hoek, H. W., Neggers, S. F. W., et al. (2008) · Brain · doi:10.1093/brain/awn251 · Cited by 297
Ackermann, H. (2008) · Trends in Neurosciences · doi:10.1016/j.tins.2008.02.011 · Cited by 253
Scott, S. K., McGettigan, C., & Eisner, F. (2009) · Nature Reviews Neuroscience · doi:10.1038/nrn2603 · Cited by 251 · cited 1×
“That is, it would be hard to explain the median 120 ms gap between conversational turns [103] with something other than an active/predictive model [104].”
BackgroundThe neural basis of hallucinations and delusions
Frith, C. (2004) · Comptes Rendus. Biologies · doi:10.1016/j.crvi.2004.10.012 · Cited by 248 · cited 1×
“Likewise, both the auditory hallucinations accompanying schizophrenia [87,120–122] and stuttering [27] have been associated with disorders of efference copy from frontal SP regions to AC.”
BackgroundProcessing of complex stimuli and natural scenes in the auditory cortex
Nelken, I. (2004) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2004.06.005 · Cited by 223
What does motor efference copy represent? Evidence from speech production
Niziolek, C. A., Nagarajan, S. S., & Houde, J. F. (2013) · The Journal of Neuroscience · doi:10.1523/jneurosci.2137-13.2013 · Cited by 222
Modulation of activity in temporal cortex during generation of inner speech
Shergill, S. S., Brammer, M. J., Fukuda, R., Bullmore, E., Amaro, E., Murray, R. M., & McGuire, P. K. (2002) · Human Brain Mapping · doi:10.1002/hbm.10046 · Cited by 182
Tian, X., & Poeppel, D. (2013) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_00381 · Cited by 172
Mangia, S., Giove, F., Tkáč, I., Logothetis, N. K., Henry, P.-G., Olman, C. A., Maraviglia, B., Di Salle, F., & Uğurbil, K. (2009) · Journal of Cerebral Blood Flow & Metabolism · doi:10.1038/jcbfm.2008.134 · Cited by 161 · cited 1×
“Decreases in activity from baseline may be driven by a decrease in neuronal activity and corresponding energy consumption (perhaps involving reallocation of resources and/ or inhibition, see [56] for discussion).”
BackgroundPremotor cortex mediates perceptual performance
Callan, D., Callan, A., Gamez, M., Sato, M.-A., & Kawato, M. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2010.02.027 · Cited by 104
Christoffels, I. K., van de Ven, V., Waldorp, L. J., Formisano, E., & Schiller, N. O. (2011) · PLoS ONE · doi:10.1371/journal.pone.0018307 · Cited by 72
Zevin, J. D., Yang, J., Skipper, J. I., & McCandliss, B. D. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.4599-09.2010 · Cited by 36
Self-citation
Cited by
Language as a multimodal phenomenon: implications for language learning, processing and evolution
Vigliocco, G., Perniss, P., & Vinson, D. (2014) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2013.0292 · Cited by 315
Tian, X., & Poeppel, D. (2013) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_00381 · Cited by 172
A voice without a mouth no more: The neurobiology of language and consciousness
Skipper, J. I. (2022) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2022.104772 · Cited by 31
“A solution for this ambiguity problem is that the brain uses context at all temporal/spatial scales to predict the acoustic patterns arriving in auditory cortices (Skipper, 2015, 2014; Skipper et al., 2021, 2017, 2007b, 2006, 2005; Skipper and Lametti, 2021).”
Self-citationExploring the boundaries of gesture-speech integration during language comprehension
Kelly, S. D. (2017) · Gesture Studies · doi:10.1075/gs.7.12kel · Cited by 30
The Embodied Teaching of Spatial Terms: Gestures Mapped to Morphemes Improve Learning
Janzen Ulbricht, N. (2020) · Frontiers in Education · doi:10.3389/feduc.2020.00109 · Cited by 13
“This connection decreases the need for semantic aspects of language comprehension, which allows the brain to save these resources for additional information processing, possibly leading to more robust learning and better retention (Skipper, 2014; Hupp and Gingras, 2016).”
Background
Metadata
- Authors
- Skipper, J. I.
- Venue
- Philosophical Transactions of the Royal Society B: Biological Sciences
- Publisher
- The Royal Society
- Published
- 2014-09-19
- Volume
- 369
- Issue
- 1651
- Pages
- 20130297
- ISSN
- 0962-8436 (ISSN-L)
- 1471-2970
- OpenAlex
- W2137231174
- Cited by
- 82
- References
- 35
- FWCI
- 3.75
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.