CoChat
Cited by 112

The DOI matches its Crossref record; 18 of the 18 references it cites were found in a registry or an index.

Parallel processing in speech perception with local and global representations of linguistic context

Brodbeck, Christian, Bhattasali, Shohini, Cruz Heredia, Aura AL, Resnik, Philip, Simon, Jonathan Z, Lau, Ellen · 2022 · eLife

Published version of a preprint

Abstract

Speech processing is highly incremental. It is widely accepted that human listeners continuously use the linguistic context to anticipate upcoming concepts, words, and phonemes. However, previous evidence supports two seemingly contradictory models of how a predictive context is integrated with the bottom-up sensory input: Classic psycholinguistic paradigms suggest a two-stage process, in which acoustic input initially leads to local, context-independent representations, which are then quickly integrated with contextual constraints. This contrasts with the view that the brain constructs a single coherent, unified interpretation of the input, which fully integrates available information across representational hierarchies, and thus uses contextual constraints to modulate even the earliest sensory representations. To distinguish these hypotheses, we tested magnetoencephalography responses to continuous narrative speech for signatures of local and unified predictive models. Results provide evidence that listeners employ both types of models in parallel. Two local context models uniquely predict some part of early neural responses, one based on sublexical phoneme sequences, and one based on the phonemes in the current word alone; at the same time, even early responses to phonemes also reflect a unified model that incorporates sentence-level constraints to predict upcoming phonemes. Neural source localization places the anatomical origins of the different predictive models in nonidentical parts of the superior temporal lobes bilaterally, with the right hemisphere showing a relative preference for more local models. These results suggest that speech processing recruits both local and unified predictive models in parallel, reconciling previous disparate findings. Parallel models might make the perceptual system more robust, facilitate processing of unexpected inputs, and serve a function in language acquisition.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.7554/elife.72056

Cites

18 of 18 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 18 references

Research works printed but not linked: 97

  1. Altmann, 1988, Interaction with context during human sentence processing, Cognition, 30, 191, 10.1016/0010-0277(88)90020-0 · DOI · Paper page
  2. Altmann, 1999, Incremental interpretation at verbs: restricting the domain of subsequent reference, Cognition, 73, 247, 10.1016/s0010-0277(99)00059-1 · DOI · Paper page
  3. Auksztulewicz, 2019, Rhythmic Temporal Expectation Boosts Neural Activity by Increasing Neural Gain, The Journal of Neuroscience, 39, 9806, 10.1523/JNEUROSCI.0925-19.2019 · DOI
  4. Beddor, 2013, The time course of perception of coarticulation, The Journal of the Acoustical Society of America, 133, 2350, 10.1121/1.4794366 · DOI
  5. Bejjanki, 2011, Cue integration in categorical tasks: insights from audio-visual speech perception, PLOS ONE, 6, 10.1371/journal.pone.0019812 · DOI
  6. Biesmans, 2017, Auditory-Inspired Speech Envelope Extraction Methods for Improved EEG-Based Auditory Attention Detection in a Cocktail Party Scenario, IEEE Transactions on Neural Systems and Rehabilitation Engineering, 25, 402, 10.1109/TNSRE.2016.2571900 · DOI · Paper page
  7. Bourguignon, 2018, Contrasting functional imaging parametric maps: The mislocation problem and alternative solutions, NeuroImage, 169, 200, 10.1016/j.neuroimage.2017.12.033 · DOI
  8. Brodbeck, 2018, Rapid Transformation from Auditory to Linguistic Representations of Continuous Speech, Current Biology, 28, 3976, 10.1016/j.cub.2018.10.042 · DOI · Paper page
  9. Brodbeck, 2018, Neural source dynamics of brain responses to continuous stimuli: Speech processing from acoustics to comprehension, NeuroImage, 172, 162, 10.1016/j.neuroimage.2018.01.042 · DOI
  10. Brodbeck, 2020, Neural speech restoration at the cocktail party: Auditory cortex recovers masked speech of both attended and ignored speakers, PLOS Biology, 18, 10.1371/journal.pbio.3000883 · DOI
  11. Broderick, 2018, Electrophysiological Correlates of Semantic Dissimilarity Reflect the Comprehension of Natural, Narrative Speech, Current Biology, 28, 803, 10.1016/j.cub.2018.01.080 · DOI · Paper page
  12. Cairns, 1997, Bootstrapping Word Boundaries: A Bottom-up Corpus-Based Approach to Speech Segmentation, Cognitive Psychology, 33, 111, 10.1006/cogp.1997.0649 · DOI · Paper page
  13. Chambers, 2003, Infants learn phonotactic regularities from brief auditory experience, Cognition, 87, B69, 10.1016/s0010-0277(02)00233-0 · DOI · Paper page
  14. Chambers, 2004, Actions and affordances in syntactic ambiguity resolution, Journal of Experimental Psychology. Learning, Memory, and Cognition, 30, 687, 10.1037/0278-7393.30.3.687 · DOI · Paper page
  15. Christiansen, 2016, The Now-or-Never bottleneck: A fundamental constraint on language, The Behavioral and Brain Sciences, 39, 10.1017/S0140525X1500031X · DOI · Paper page
  16. Connolly, 1994, Event-related potential components reflect phonological and semantic processing of the terminal word of spoken sentences, Journal of Cognitive Neuroscience, 6, 256, 10.1162/jocn.1994.6.3.256 · DOI · Paper page
  17. Coulson, 2005, Right hemisphere sensitivity to word- and sentence-level context: evidence from event-related brain potentials, Journal of Experimental Psychology. Learning, Memory, and Cognition, 31, 129, 10.1037/0278-7393.31.1.129 · DOI · Paper page
  18. David, 2007, Estimating sparse spectro-temporal receptive fields with natural stimuli, Network, 18, 191, 10.1080/09548980701609235 · DOI · Paper page
  19. DeLong, 2005, Probabilistic word pre-activation during language comprehension inferred from electrical brain activity, Nature Neuroscience, 8, 1117, 10.1038/nn1504 · DOI · Paper page
  20. Diaz, 2007, Electrophysiological differentiation of phonological and semantic integration in word and sentence contexts, Brain Research, 1146, 85, 10.1016/j.brainres.2006.07.034 · DOI
  21. Donhauser, 2020, Two Distinct Neural Timescales for Predictive Speech Processing, Neuron, 105, 385, 10.1016/j.neuron.2019.10.019 · DOI · Paper page
  22. Ettinger, 2014, The role of morphology in phoneme prediction: evidence from MEG, Brain and Language, 129, 14, 10.1016/j.bandl.2013.11.004 · DOI
  23. Federmeier, 1999, Right words and left words: electrophysiological evidence for hemispheric differences in meaning processing, Brain Research. Cognitive Brain Research, 8, 373, 10.1016/s0926-6410(99)00036-1 · DOI · Paper page
  24. Federmeier, 2005, Both sides get the point: hemispheric sensitivities to sentential constraint, Memory & Cognition, 33, 871, 10.3758/bf03193082 · DOI · Paper page
  25. Federmeier, 2007, Thinking ahead: the role and roots of prediction in language comprehension, Psychophysiology, 44, 491, 10.1111/j.1469-8986.2007.00531.x · DOI · Paper page
  26. Federmeier, 2008, What’s ‘Right’ in Language Comprehension: Event-Related Potentials Reveal Right Hemisphere Language Capabilities, Language and Linguistics Compass, 2, 1, 10.1111/j.1749-818X.2007.00042.x · DOI
  27. Feldman, 2009, The influence of categories on perception: explaining the perceptual magnet effect as optimal statistical inference, Psychological Review, 116, 752, 10.1037/a0017196 · DOI · Paper page
  28. Ferreira, 2018, Integration and Prediction in Language Processing: A Synthesis of Old and New, Current Directions in Psychological Science, 27, 443, 10.1177/0963721418794491 · DOI
  29. Fodor, 1985, Précis of The Modularity of Mind, The Behavioral and Brain Sciences, 8, 1, 10.1017/S0140525X0001921X · DOI · Paper page
  30. Forseth, 2020, Language prediction mechanisms in human auditory cortex, Nature Communications, 11, 10.1038/s41467-020-19010-6 · DOI
  31. Frisson, 2017, No prediction error cost in reading: Evidence from eye movements, Journal of Memory and Language, 95, 200, 10.1016/j.jml.2017.04.007 · DOI
  32. Futrell, 2020, Lossy-Context Surprisal: An Information-Theoretic Model of Memory Effects in Sentence Processing, Cognitive Science, 44, 10.1111/cogs.12814 · DOI · Paper page
  33. Ganong, 1980, Phonetic categorization in auditory word perception, Journal of Experimental Psychology. Human Perception and Performance, 6, 110, 10.1037//0096-1523.6.1.110 · doi:10.1037//0096-1523.6.1.110 · Paper page
  34. Gaston, 2017, The time course of contextual cohort effects in auditory processing of category-ambiguous words: MEG evidence for a single “clash” as noun or verb, Language, Cognition and Neuroscience, 33, 402, 10.1080/23273798.2017.1395466 · DOI
  35. Gaston P, Lau E, Phillips C. 2020. How Does(n’t) Syntactic Context Guide Auditory Word Recognition?. PsyArXiv. https://psyarxiv.com/sbxpn/.
  36. Gazzaniga, 1967, Language after section of the cerebral commissures, Brain, 90, 131, 10.1093/brain/90.1.131 · DOI · Paper page
  37. Gillis, 2021, Neural Markers of Speech Comprehension: Measuring EEG Tracking of Linguistic Speech Representations, Controlling the Speech Acoustics, The Journal of Neuroscience, 41, 10316, 10.1523/JNEUROSCI.0812-21.2021 · DOI
  38. Gramfort, 2014, MNE software for processing MEG and EEG data, NeuroImage, 86, 446, 10.1016/j.neuroimage.2013.10.027 · DOI · Paper page
  39. Greve, 2013, A surface-based analysis of language lateralization and cortical asymmetry, Journal of Cognitive Neuroscience, 25, 1477, 10.1162/jocn_a_00405 · DOI · Paper page
  40. Gwilliams, 2015, Non-linear processing of a linear speech stream: The influence of morphological structure on the recognition of spoken Arabic words, Brain and Language, 147, 1, 10.1016/j.bandl.2015.04.006 · DOI
  41. Hale, 2003, The information conveyed by words in sentences, Journal of Psycholinguistic Research, 32, 101, 10.1023/a:1022492123056 · DOI · Paper page
  42. Hale, 2016, Information‐theoretical Complexity Metrics, Language and Linguistics Compass, 10, 397, 10.1111/lnc3.12196 · DOI · Paper page
  43. Halle, 1962, Speech recognition: A model and a program for research, IEEE Transactions on Information Theory, 8, 155, 10.1109/TIT.1962.1057686 · DOI · Paper page
  44. Hämäläinen, 1994, Interpreting magnetic fields of the brain: minimum norm estimates, Medical & Biological Engineering & Computing, 32, 35, 10.1007/BF02512476 · DOI · Paper page
  45. Heafield K. 2011. Proceedings of the Sixth Workshop on Statistical Machine Translation. KenLM: Faster and Smaller Language Model QueriesProceedings of the 6th Workshop on Statistical Machine Translation.
  46. Heller, 2016, Perspective-taking behavior as the probabilistic weighing of multiple domains, Cognition, 149, 104, 10.1016/j.cognition.2015.12.008 · DOI
  47. Hitczenko, 2020, When context is and isn’t helpful: A corpus study of naturalistic speech, Psychonomic Bulletin & Review, 27, 640, 10.3758/s13423-019-01687-6 · DOI
  48. Holcomb, 2013, Natural speech processing: An analysis using event-related brain potentials, Psychobiology, 19, 286, 10.3758/BF03332082 · DOI · Paper page
  49. Jaramillo, 2011, The auditory cortex mediates the perceptual effects of acoustic temporal expectation, Nature Neuroscience, 14, 246, 10.1038/nn.2688 · DOI · Paper page
  50. Jung-Beeman, 2005, Bilateral brain processes for comprehending natural language, Trends in Cognitive Sciences, 9, 512, 10.1016/j.tics.2005.09.009 · DOI · Paper page
  51. Jurafsky, 1996, A Probabilistic Model of Lexical and Syntactic Access and Disambiguation, Cognitive Science, 20, 137, 10.1207/s15516709cog2002_1 · doi:10.1207/s15516709cog2002_1 · Paper page
  52. Kutas, 1988, Processing of semantic anomaly by right and left hemispheres of commissurotomy patients. Evidence from event-related brain potentials, Brain, 111 (Pt 3), 553, 10.1093/brain/111.3.553 · DOI · Paper page
  53. Lalor, 2009, Resolving precise temporal processing properties of the auditory system using continuous stimuli, Journal of Neurophysiology, 102, 349, 10.1152/jn.90896.2008 · DOI · Paper page
  54. Leonard, 2016, Perceptual restoration of masked speech in human cortex, Nature Communications, 7, 10.1038/ncomms13619 · DOI · Paper page
  55. Levy, 2008, Expectation-based syntactic comprehension, Cognition, 106, 1126, 10.1016/j.cognition.2007.05.006 · DOI · Paper page
  56. Loftus, 1994, Using confidence intervals in within-subject designs, Psychonomic Bulletin & Review, 1, 476, 10.3758/BF03210951 · DOI · Paper page
  57. Luke, 2016, Limits on lexical prediction during reading, Cognitive Psychology, 88, 22, 10.1016/j.cogpsych.2016.06.002 · DOI · Paper page
  58. Luthra, 2021, Robust Lexically Mediated Compensation for Coarticulation: Christmash Time Is Here Again, Cognitive Science, 45, 10.1111/cogs.12962 · DOI
  59. Lütkenhöner, 2003, Magnetoencephalography and its Achilles’ heel, Journal of Physiology, Paris, 97, 641, 10.1016/j.jphysparis.2004.01.020 · DOI
  60. Magnuson, 2018, Interaction in Spoken Word Recognition Models: Feedback Helps, Frontiers in Psychology, 9, 10.3389/fpsyg.2018.00369 · DOI
  61. Marslen-Wilson, 1975, Processing structure of sentence perception, Nature, 257, 784, 10.1038/257784a0 · DOI
  62. Marslen-Wilson, 1987, Functional parallelism in spoken word-recognition, Cognition, 25, 71, 10.1016/0010-0277(87)90005-9 · DOI · Paper page
  63. Matchin, 2019, The temporal dynamics of structure and content in sentence comprehension: Evidence from fMRI-constrained MEG, Human Brain Mapping, 40, 663, 10.1002/hbm.24403 · DOI
  64. McAuliffe M, Socolof M, Mihuc S, Wagner M, Sonderegger M. 2017. Interspeech 2017. Montreal Forced Aligner: Trainable Text-Speech Alignment Using Kaldi. · DOI · Paper page
  65. McCarthy, 1985, Scalp distributions of event-related potentials: An ambiguity associated with analysis of variance models, Electroencephalography and Clinical Neurophysiology, 61, S226, 10.1016/0013-4694(85)90858-2 · DOI
  66. McClelland, 1981, An interactive activation model of context effects in letter perception: I. An account of basic findings, Psychological Review, 88, 375, 10.1037/0033-295X.88.5.375 · DOI · Paper page
  67. McClelland, 1986, The TRACE model of speech perception, Cognitive Psychology, 18, 1, 10.1016/0010-0285(86)90015-0 · DOI · Paper page
  68. Morton, 1969, Interaction of information in word recognition, Psychological Review, 76, 165, 10.1037/h0027366 · DOI · Paper page
  69. Nieuwland, 2006, When peanuts fall in love: N400 evidence for the power of discourse, Journal of Cognitive Neuroscience, 18, 1098, 10.1162/jocn.2006.18.7.1098 · DOI · Paper page
  70. Nieuwland, 2018, Large-scale replication study reveals a limit on probabilistic prediction in language comprehension, eLife, 7, 10.7554/eLife.33468 · DOI · Paper page
  71. Nieuwland, 2020, Dissociable effects of prediction and integration during language comprehension: evidence from a large-scale study using brain potentials, Philosophical Transactions of the Royal Society of London. Series B, Biological Sciences, 375, 10.1098/rstb.2018.0522 · DOI · Paper page
  72. Norris, 1994, Shortlist: a connectionist model of continuous speech recognition, Cognition, 52, 189, 10.1016/0010-0277(94)90043-4 · DOI · Paper page
  73. Norris, 2000, Merging information in speech recognition: feedback is never necessary, The Behavioral and Brain Sciences, 23, 299, 10.1017/s0140525x00003241 · DOI · Paper page
  74. Norris, 2008, Shortlist B: a Bayesian model of continuous speech recognition, Psychological Review, 115, 357, 10.1037/0033-295X.115.2.357 · DOI · Paper page
  75. Oldfield, 1971, The assessment and analysis of handedness: the Edinburgh inventory, Neuropsychologia, 9, 97, 10.1016/0028-3932(71)90067-4 · DOI · Paper page
  76. Pickering, 2018, Predicting while comprehending language: A theory and review, Psychological Bulletin, 144, 1002, 10.1037/bul0000158 · DOI · Paper page
  77. Poeppel, 2001, Pure word deafness and the bilateral processing of the speech code, Cognitive Science, 25, 679, 10.1207/s15516709cog2505_3 · doi:10.1207/s15516709cog2505_3 · Paper page
  78. Pollan, 2001, The Botany of Desire: A Plant’s-Eye View of the World
  79. Rommers, 2013, The contents of predictions in sentence comprehension: activation of the shape of objects before they are referred to, Neuropsychologia, 51, 437, 10.1016/j.neuropsychologia.2012.12.002 · DOI
  80. Saffran, 1996, Statistical learning by 8-month-old infants, Science, 274, 1926, 10.1126/science.274.5294.1926 · DOI · Paper page
  81. Salverda, 2003, The role of prosodic boundaries in the resolution of lexical embedding in speech comprehension, Cognition, 90, 51, 10.1016/s0010-0277(03)00139-2 · DOI · Paper page
  82. Schmitt, 2020, Predicting Speech from a Cortical Hierarchy of Event-Based Timescales, 10.1101/2020.12.19.423616 · DOI
  83. Singer, 2018, Sensory cortex is optimized for prediction of future input, eLife, 7, 10.7554/eLife.31557 · DOI
  84. Sohoglu, 2020, Rapid computations of spectrotemporal prediction error support perception of degraded speech, eLife, 9, 10.7554/eLife.58077 · DOI
  85. Swinney, 1979, Lexical access during sentence comprehension: (Re)consideration of context effects, Journal of Verbal Learning and Verbal Behavior, 18, 645, 10.1016/S0022-5371(79)90355-4 · DOI · Paper page
  86. Tabas, 2021, Adjudicating Between Local and Global Architectures of Predictive Processing in the Subcortical Auditory Pathway, Frontiers in Neural Circuits, 15, 10.3389/fncir.2021.644743 · DOI
  87. Tanenhaus, 1995, Integration of visual and linguistic information in spoken language comprehension, Science, 268, 1632, 10.1126/science.7777863 · DOI · Paper page
  88. Taulu, 2006, Spatiotemporal signal space separation method for rejecting nearby interference in MEG measurements, Physics in Medicine and Biology, 51, 1759, 10.1088/0031-9155/51/7/008 · DOI · Paper page
  89. van Berkum, 2003, When and how do listeners relate a sentence to the wider discourse? Evidence from the N400 effect, Brain Research. Cognitive Brain Research, 17, 701, 10.1016/s0926-6410(03)00196-4 · DOI · Paper page
  90. Van Berkum, 2005, Anticipating upcoming words in discourse: evidence from ERPs and reading times, Journal of Experimental Psychology. Learning, Memory, and Cognition, 31, 443, 10.1037/0278-7393.31.3.443 · DOI · Paper page
  91. Van Petten, 1999, Time course of word identification and semantic integration in spoken language, Journal of Experimental Psychology. Learning, Memory, and Cognition, 25, 394, 10.1037//0278-7393.25.2.394 · doi:10.1037//0278-7393.25.2.394
  92. Vitevitch, 1999, Probabilistic Phonotactics and Neighborhood Activation in Spoken Word Recognition, Journal of Memory and Language, 40, 374, 10.1006/jmla.1998.2618 · DOI · Paper page
  93. Vitevitch, 2016, When Words Compete: Levels of Processing in Perception of Spoken Words, Psychological Science, 9, 325, 10.1111/1467-9280.00064 · DOI · Paper page
  94. Weissbart, 2020, Cortical Tracking of Surprisal during Continuous Speech Comprehension, Journal of Cognitive Neuroscience, 32, 155, 10.1162/jocn_a_01467 · DOI
  95. Wilson, 2018, Convergence of spoken and written language processing in the superior temporal sulcus, NeuroImage, 171, 62, 10.1016/j.neuroimage.2017.12.068 · DOI · Paper page
  96. Wlotko, 2007, Finding the right word: hemispheric asymmetries in the use of sentence context information, Neuropsychologia, 45, 3001, 10.1016/j.neuropsychologia.2007.05.013 · DOI · Paper page
  97. Zwitserlood, 1989, The locus of the effects of sentential-semantic context in spoken-word processing, Cognition, 32, 25, 10.1016/0010-0277(89)90013-9 · DOI · Paper page

Cited by

See all 112

Metadata

Authors
Brodbeck, C., Bhattasali, S., Cruz Heredia, A. A., Resnik, P., Simon, J. Z., & Lau, E.
Affiliations
  • Department of Psychological Sciences, University of Connecticut
  • Department of Linguistics, University of Maryland
  • Institute for Systems Research, University of Maryland
Venue
eLife
Published
2022-01-21
Volume
11
ISSN
2050-084X
Cited by
112
References
18
Language
en
Funders
  • University of Maryland (BBI Seed Grant)
  • National Science Foundation (BCS-1749407, SMA-1734892, BCS-1754284)
  • National Institutes of Health (R01DC014085)
  • Office of Naval Research (MURI Award N00014-18-1-2670)

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Parallel processing in speech perception with local and global representations of linguistic context. https://app.cochat.ai/papers/10.7554/elife.72056
The paper
Brodbeck, C., Bhattasali, S., Cruz Heredia, A. A., Resnik, P., Simon, J. Z., & Lau, E. (2022). Parallel processing in speech perception with local and global representations of linguistic context. eLife. https://doi.org/10.7554/elife.72056

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.