Differential Representation of Articulatory Gestures and Phonemes in Precentral and Inferior Frontal Gyri
Open accessAbstract
Speech is a critical form of human communication and is central to our daily lives. Yet, despite decades of study, an understanding of the fundamental neural control of speech production remains incomplete. Current theories model speech production as a hierarchy from sentences and phrases down to words, syllables, speech sounds (phonemes), and the actions of vocal tract articulators used to produce speech sounds (articulatory gestures). Here, we investigate the cortical representation of articulatory gestures and phonemes in ventral precentral and inferior frontal gyri in men and women. Our results indicate that ventral precentral cortex represents gestures to a greater extent than phonemes, while inferior frontal cortex represents both gestures and phonemes. These findings suggest that speech production shares a common cortical representation with that of other types of movement, such as arm and hand movements. This has important implications both for our understanding of speech production and for the design of brain–machine interfaces to restore communication to people who cannot speak. SIGNIFICANCE STATEMENT Despite being studied for decades, the production of speech by the brain is not fully understood. In particular, the most elemental parts of speech, speech sounds (phonemes) and the movements of vocal tract articulators used to produce these sounds (articulatory gestures), have both been hypothesized to be encoded in motor cortex. Using direct cortical recordings, we found evidence that primary motor and premotor cortices represent gestures to a greater extent than phonemes. Inferior frontal cortex (part of Broca's area) appears to represent both gestures and phonemes. These findings suggest that speech production shares a similar cortical organizational structure with the movement of other body parts.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Subsequent work discovered that SMC populations encode articulatory kinematic trajectories and vocal-tract configurations during continuous speech.
“Subsequent work discovered that SMC populations encode articulatory kinematic trajectories and vocal-tract configurations43 during continuous speech24,39,44,45 (Fig. 1; Mugler et al. 2018, Chartier et al. 2018 and Dichter et al. 2018).”
From The speech neuroprosthesis (2024) · cites this paper as [43]
The Discussion reports that precentral-gyrus activity represented articulatory gestures more strongly than phonemes. But the Results describe recordings during single-word, monosyllabic utterances, not continuous speech. The paper estimated articulator trajectories to label gestures; it does not establish that the recorded populations encoded continuous kinematic trajectories or vocal-tract configurations. (LLM, conf=0.87)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Neurophysiological investigation of the basis of the fMRI signal
Logothetis, N. K., Pauls, J., Augath, M., Trinath, T., & Oeltermann, A. (2001) · Nature · doi:10.1038/35084005 · Cited by 6,542 · see citing works
Rare and common variants: twenty arguments
Gibson, G. (2012) · Nature Reviews Genetics · doi:10.1038/nrg3118 · Cited by 1,278 · see citing works
A Dynamical Approach to Gestural Patterning in Speech Production
Saltzman, E. L., & Munhall, K. G. (1989) · Ecological Psychology · doi:10.1207/s15326969eco0104_2 · Cited by 946 · see citing works
Computational neuroanatomy of speech production
Hickok, G. (2012) · Nature Reviews Neuroscience · doi:10.1038/nrn3158 · Cited by 837 · see citing works
Pandarinath, C., Nuyujukian, P., Blabe, C. H., Sorice, B. L., Saab, J., Willett, F. R., Hochberg, L. R., Shenoy, K. V., & Henderson, J. M. (2017) · eLife · doi:10.7554/elife.18554 · Cited by 566 · cited 2× · see citing works
“A speech BMI that could directly decode attempted speech would be more efficient than, and could dramatically increase the communication rate over, current slow and often tedious methods for this patient population (e.g., eye trackers, gaze communication boards, and even the most recent spelling-based BMIs; Brumberg e…”
BackgroundBrain-to-text: decoding spoken phrases from phone representations in the brain
Herff, C., Heger, D., de Pesters, A., Telaar, D., Brunner, P., Schalk, G., & Schultz, T. (2015) · Frontiers in Neuroscience · doi:10.3389/fnins.2015.00217 · Cited by 297 · see citing works
Pei, X., Leuthardt, E. C., Gaona, C. M., Brunner, P., Wolpaw, J. R., & Schalk, G. (2011) · NeuroImage · doi:10.1016/j.neuroimage.2010.10.029 · Cited by 204 · see citing works
Mugler, E. M., Patton, J. L., Flint, R. D., Wright, Z. A., Schuele, S. U., Rosenow, J., Shih, J. J., Krusienski, D. J., & Slutzky, M. W. (2014) · Journal of Neural Engineering · doi:10.1088/1741-2560/11/3/035015 · Cited by 192 · see citing works
Self-citation
Flagged first, then by citations
Research works printed but not linked: 85
- Bakovic E (2014) Phonology and phonological theory. In: The Oxford handbook of language production (Goldrick MA, Ferreira V, Miozzo M, eds), pp 199 -209. Oxford: Oxford UP.
- Ballard KJ, Granier JP, Robin DA (2000) Understanding the nature of apraxia of speech: theory, analysis, and treatment. Aphasiology 14:969 - 995. CrossRef · DOI
- Bocquelet F, Hueber T, Girin L, Savariaux C, Yvert B (2016) Real-time con- trol of an articulatory-based speech synthesizer for brain computer inter- faces. PLoS Comput Biol 12:e1005119. CrossRef Medline · DOI
- Bouchard KE, Chang EF (2014) Control of spoken vowel acoustics and the influence of phonetic context in human speech sensorimotor cortex. J Neurosci 34:12662-12677. CrossRef Medline · DOI
- Bouchard KE, Mesgarani N, Johnson K, Chang EF (2013) Functional orga- nization of human sensorimotor cortex for speech articulation. Nature 495:327-332. CrossRef Medline · DOI · Paper page
- Bouchard KE, Conant DF, Anumanchipalli GK, Dichter B, Chaisanguan- thum KS, Johnson K, Chang EF (2016) High-resolution, non-invasive imaging of upper vocal tract articulators compatible with human brain recordings. PLoS One 11:e0151327. CrossRef Medline · DOI
- Browman CP, Goldstein L (1992) Articulatory phonology: an overview. Phonetica 49:155-180. CrossRef Medline · DOI
- Brumberg JS, Nieto-Castanon A, Kennedy PR, Guenther FH (2010) Brain- computer interfaces for speech communication. Speech Commun 52: 367-379. CrossRef Medline · DOI
- Brumberg JS, Guenther FH, Kennedy PR (2013) An auditory output brain- computer interface for speech communication. In: Brain-computer in- terface research: SpringerBriefs in electrical and computer engineering (Guger C, Allison BZ, Edlinger G, eds), pp 7-14. New York: Springer.
- Buchwald A (2014) Phonetic processing. In: The Oxford handbook of lan- guage production (Goldrick MA, Ferreira V, Miozzo M, eds), pp 245-258. New York: Oxford UP.
- Buchwald A, Miozzo M (2011) Finding levels of abstraction in speech pro- duction: evidence from sound-production impairment. Psychol Sci 22: 1113-1119. CrossRef Medline · DOI
- Carey D, McGettigan C (2017) Magnetic resonance imaging of the brain and vocal tract: applications to the study of speech production and lan- guage learning. Neuropsychologia 98:201-211. CrossRef Medline · DOI
- Chao ZC, Nagasaka Y, Fujii N (2010) Long-term asynchronous decoding of arm motion using electrocorticographic signals in monkeys. Front Neu- roeng 3:3. CrossRef Medline · DOI
- Chen X, Wang Y, Nakanishi M, Gao X, Jung TP, Gao S (2015) High-speed spelling with a noninvasive brain-computer interface. Proc Natl Acad Sci U S A 112:E6058 -E6067. CrossRef Medline · DOI · Paper page
- Cherian A, Fernandes HL, Miller LE (2013) Primary motor cortical dis- charge during force field adaptation reflects muscle-like dynamics. J Neu- rophysiol 110:768 -783. CrossRef Medline · DOI
- Cheung C, Hamiton LS, Johnson K, Chang EF (2016) The auditory repre- sentation of speech sounds in human motor cortex. Elife 5:e12577. CrossRef Medline · DOI
- Cho T, Lee Y, Kim S (2014) Prosodic strengthening on the/s/-stop cluster and the phonetic implementation of an allophonic rule in English. J Phon 46:128 -146. CrossRef · DOI
- Cogan GB, Thesen T, Carlson C, Doyle W, Devinsky O, Pesaran B (2014) Sensory-motor transformations for speech occur bilaterally. Nature 507: 94 -98. CrossRef Medline · DOI · Paper page
- Conant DF, Bouchard KE, Leonard MK, Chang EF (2018) Human sensori- motor cortex control of directly measured vocal tract movements during vowel production. J Neurosci 38:2955-2966. CrossRef Medline · DOI
- Crone NE, Hao L, Hart J Jr, Boatman D, Lesser RP, Irizarry R, Gordon B (2001) Electrocorticographic gamma activity during word production in spoken and sign language. Neurology 57:2045-2053. CrossRef Medline · DOI
- Das K, Nenadic Z (2009) An efficient discriminant-based solution for small sample size problem. Pattern Recognit 42:857-866. CrossRef · DOI
- Das K, Rizzuto DS, Nenadic Z (2009) Mental state estimation for brain- computer interfaces. IEEE Trans Biomed Eng 56:2114 -2122. CrossRef Medline · DOI
- Denby B, Schultz T, Honda K, Hueber T, Gilbert JM, Brumberg JS (2010) Silent speech interfaces. Speech Commun 52:270 -287. CrossRef · DOI · Paper page
- Evarts EV (1968) Relation of pyramidal tract activity to force exerted during voluntary movement. J Neurophysiol 31:14 -27. CrossRef Medline · DOI
- Fesl G, Moriggl B, Schmid UD, Naidich TP, Herholz K, Yousry TA (2003) Inferior central sulcus: variations of anatomy and function on the exam- ple of the motor tongue area. Neuroimage 20:601-610. CrossRef Medline · DOI
- Flinker A, Knight RT (2016) A cool approach to probing speech cortex. Neuron 89:1123-1125. CrossRef Medline · DOI
- Flinker A, Korzeniewska A, Shestyuk AY, Franaszczuk PJ, Dronkers NF, Knight RT, Crone NE (2015) Redefining the role of Broca's area in speech. Proc Natl Acad Sci U S A 112:2871-2875. CrossRef Medline · DOI · Paper page
- Flint RD, Ethier C, Oby ER, Miller LE, Slutzky MW (2012a) Local field potentials allow accurate decoding of muscle activity. J Neurophysiol 108:18 -24. CrossRef Medline · DOI
- Flint RD, Lindberg EW, Jordan LR, Miller LE, Slutzky MW (2012b) Accu- rate decoding of reaching movements from field potentials in the absence of spikes. J Neural Eng 9:046006. CrossRef Medline · DOI
- Flint RD, Wang PT, Wright ZA, King CE, Krucoff MO, Schuele SU, Rosenow JM, Hsu FP, Liu CY, Lin JJ, Sazgar M, Millett DE, Shaw SJ, Nenadic Z, Do AH, Slutzky MW (2014) Extracting kinetic information from human motor cortical signals. Neuroimage 101:695-703. CrossRef Medline · DOI
- Flint RD, Rosenow JM, Tate MC, Slutzky MW (2017) Continuous decoding of human grasp kinematics using epidural and subdural signals. J Neural Eng 14:016005. CrossRef Medline · DOI
- Gelfand JR, Bookheimer SY (2003) Dissociating neural mechanisms of tem- poral sequencing and processing phonemes. Neuron 38:831-842. CrossRef Medline · DOI
- Georgopoulos AP, Schwartz AB, Kettner RE (1986) Neuronal population coding of movement direction. Science 233:1416 -1419. CrossRef Medline · DOI
- Ghosh SS, Tourville JA, Guenther FH (2008) A neuroimaging study of pre- motor lateralization and cerebellar involvement in the production of pho- nemes and syllables. J Speech Lang Hear Res 51:1183-1202. CrossRef Medline · DOI
- Guenther FH, Ghosh SS, Tourville JA (2006) Neural modeling and imaging of the cortical interactions underlying syllable production. Brain Lang 96:280 -301. CrossRef Medline · DOI · Paper page
- Hatsopoulos N, Joshi J, O'Leary JG (2004) Decoding continuous and dis- crete motor behaviors using motor and premotor cortical ensembles. J Neurophysiol 92:1165-1174. CrossRef Medline · DOI
- Hermes D, Miller KJ, Noordmans HJ, Vansteensel MJ, Ramsey NF (2010) Automated electrocorticographic electrode localization on individually rendered brain surfaces. J Neurosci Methods 185:293-298. CrossRef Medline · DOI
- Hermes D, Miller KJ, Vansteensel MJ, Aarnoutse EJ, Leijten FS, Ramsey NF (2012) Neurophysiologic correlates of fMRI in human motor cortex. Hum Brain Mapp 33:1689 -1699. CrossRef Medline · DOI
- Hickok G (2012a) The cortical organization of speech processing: feedback control and predictive coding the context of a dual-stream model. J Com- mun Disord 45:393-402. CrossRef Medline · DOI
- Hickok G, Houde J, Rong F (2011) Sensorimotor integration in speech pro- cessing: computational basis and neural organization. Neuron 69:407- 422. CrossRef Medline · DOI
- House AS, Williams C, Hecker MHL, Kryter KD (1963) Psychoacoustic speech tests: a modified rhyme test. J Acoust Soc Am 35:55. CrossRef · DOI
- Indefrey P, Levelt WJ (2004) The spatial and temporal signatures of word production components. Cognition 92:101-144. CrossRef Medline · DOI · Paper page
- Kakei S, Hoffman DS, Strick PL (1999) Muscle and movement representa- tions in the primary motor cortex. Science 285:2136 -2139. CrossRef Medline · DOI · Paper page
- Kellis S, Miller K, Thomson K, Brown R, House P, Greger B (2010) Decod- ing spoken words using local field potentials recorded from the cortical surface. J Neural Eng 7:056007. CrossRef Medline · DOI · Paper page
- Korostenskaja M, Wilson AJ, Rose DF, Brunner P, Schalk G, Leach J, Man- gano FT, Fujiwara H, Rozhkov L, Harris E, Chen P-C, Seo JH, Lee KH (2014) Real-time functional mapping with electrocorticography in pedi- atric epilepsy: comparison with FMRI and ESM findings. Clin EEG Neu- rosci 45:205-211. CrossRef Medline · DOI
- Leuthardt EC, Gaona C, Sharma M, Szrama N, Roland J, Freudenberg Z, Solis J, Breshears J, Schalk G (2011) Using the electrocorticographic speech network to control a brain-computer interface in humans. J Neural Eng 8:036004. CrossRef Medline · DOI
- Levelt WJ (1999) Models of word production. Trends Cogn Sci 3:223-232. CrossRef Medline · DOI
- Long MA, Katlowitz KA, Svirsky MA, Clary RC, Byun TM, Majaj N, Oya H, Howard MA 3rd, Greenlee JDW (2016) Functional segregation of cor- tical regions underlying speech timing and articulation. Neuron 89:1187- 1193. CrossRef Medline · DOI · Paper page
- Lotte F, Brumberg JS, Brunner P, Gunduz A, Ritaccio AL, Guan C, Schalk G (2015) Electrocorticographic representations of segmental features in continuous speech. Front Hum Neurosci 9:97. CrossRef Medline · DOI
- Magen HS (1997) The extent of vowel-to-vowel coarticulation in english. J Phon 25:187-205. CrossRef · DOI
- Marianne P, Goldstein L (2010) Intention in articulation: articulatory tim- ing in alternating consonant sequences and its implications for models of speech production. Lang Cogn Process 25:616 -649. CrossRef Medline · DOI
- Mehring C, Nawrot MP, de Oliveira SC, Vaadia E, Schulze-Bonhage A, Aertsen A, Ball T (2004) Comparing information about arm movement direction in single channels of local and epicortical field potentials from monkey and human motor cortex. J Physiol Paris 98:498 -506. CrossRef Medline · DOI
- Mendoza G, Merchant H (2014) Motor system evolution and the emer- gence of high cognitive functions. Prog Neurobiol 122:73-93. CrossRef Medline · DOI
- Mines MA, Hanson BF, Shoup JE (1978) Frequency of occurrence of pho- nemes in conversational english. Lang Speech 21:221-241. CrossRef Medline · DOI
- Moran DW, Schwartz AB (1999) Motor cortical representation of speed and direction during reaching. J Neurophysiol 82:2676 -2692. CrossRef Medline · DOI
- Morrow MM, Miller LE (2003) Prediction of muscle activity by populations of sequentially recorded primary motor cortex neurons. J Neurophysiol 89:2279 -2288. CrossRef Medline · DOI
- Mugler EM, Goldrick M, Slutzky MW (2014a) Cortical encoding of phone- mic context during word production. Paper presented at the 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, Chicago, IL, August.
- Nam H, Mitra V, Tiede MK, Saltzman E, Goldstein L, Espy-Wilson C, Hasegawa-Johnson M (2012) A procedure for estimating gestural scores from articulatory data. J Acoust Soc Am 132:3980 -3989. CrossRef Medline · DOI
- Oby ER, Ethier C, Miller LE (2013) Movement representation in the pri- mary motor cortex and its contribution to generalizable EMG predic- tions. J Neurophysiol 109:666 -678. CrossRef Medline · DOI
- Ohman SE (1966) Coarticulation in VCV utterances: spectrographic mea- surements. J Acoust Soc Am 39:151-168. CrossRef Medline · DOI
- Papoutsi M, de Zwart JA, Jansma JM, Pickering MJ, Bednar JA, Horwitz B (2009) From phonemes to articulatory codes: an fMRI study of the role of broca's area in speech production. Cereb Cortex 19:2156 -2165. CrossRef Medline · DOI · Paper page
- Paz R, Boraud T, Natan C, Bergman H, Vaadia E (2003) Preparatory activity in motor cortex reflects learning of local visuomotor skills. Nat Neurosci 6:882-890. CrossRef Medline · DOI
- Pei X, Barbour DL, Leuthardt EC, Schalk G (2011a) Decoding vowels and consonants in spoken and imagined words using electrocorticographic signals in humans. J Neural Eng 8:046028. CrossRef Medline · DOI · Paper page
- Penfield W, Boldrey E (1937) Somatic motor and sensory representation in the cerebral cortex of man as studied by electrical stimulation. Brain 60:389 -443. CrossRef · DOI · Paper page
- Penfield W, Rasmussen T (1949) Vocalization and arrest of speech. Arch Neurol Psychiatry 61:21-27. CrossRef Medline · DOI
- Pesaran B, Pezaris JS, Sahani M, Mitra PP, Andersen RA (2002) Temporal structure in neuronal activity during working memory in macaque pari- etal cortex. Nat Neurosci 5:805-811. CrossRef Medline · DOI
- Pesaran B, Nelson MJ, Andersen RA (2006) Dorsal premotor neurons en- code the relative position of the hand, eye, and goal during reach plan- ning. Neuron 51:125-134. CrossRef Medline · DOI
- Ramsey NF, Salari E, Aarnoutse EJ, Vansteensel MJ, Bleichner MG, Freuden- burg ZV (2018) Decoding spoken phonemes from sensorimotor cortex with high-density ECoG grids. Neuroimage 180:301-311. CrossRef Medline · DOI · Paper page
- Ray S, Maunsell JH (2011) Different origins of gamma rhythm and high- gamma activity in macaque visual cortex. PLoS Biol 9:e1000610. CrossRef Medline · DOI · Paper page
- Ray S, Crone NE, Niebur E, Franaszczuk PJ, Hsiao SS (2008) Neural corre- lates of high-gamma oscillations (60 -200 Hz) in macaque local field po- tentials and their potential implications in electrocorticography. J Neurosci 28:11526 -11536. CrossRef Medline · DOI · Paper page
- Riecker A, Ackermann H, Wildgruber D, Meyer J, Dogil G, Haider H, Grodd W (2000) Articulatory/phonetic sequencing at the level of the anterior perisylvian cortex: a functional magnetic resonance imaging (fMRI) study. Brain Lang 75:259 -276. CrossRef Medline · DOI
- Roland J, Brunner P, Johnston J, Schalk G, Leuthardt EC (2010) Passive real-time identification of speech and motor cortex during an awake cra- niotomy. Epilepsy Behav 18:123-128. CrossRef Medline · DOI
- Schalk G, McFarland DJ, Hinterberger T, Birbaumer N, Wolpaw JR (2004) BCI2000: a general-purpose brain-computer interface (BCI) system. IEEE Trans Biomed Eng 51:1034 -1043. CrossRef Medline · DOI
- Schalk G, Leuthardt EC, Brunner P, Ojemann JG, Gerhardt LA, Wolpaw JR (2008) Real-time detection of event-related brain activity. Neuroimage 43:245-249. CrossRef Medline · DOI
- Schultz T, Wand M (2010) Modeling coarticulation in EMG-based contin- uous speech recognition. Speech Commun 52:341-353. CrossRef · DOI
- Scott SH, Kalaska JF (1997) Reaching movements with similar hand paths but different arm orientations. I. Activity of individual cells in motor cortex. J Neurophysiol 77:826 -852. CrossRef Medline · DOI
- Shen L, Alexander GE (1997) Preferential representation of instructed tar- get location versus limb trajectory in dorsal premotor area. J Neuro- physiol 77:1195-1212. CrossRef Medline · DOI
- Slutzky MW (2018) Brain-machine interfaces: powerful tools for clinical treat- ment and neuroscientific investigations. Neuroscientist. Advance online publication. Retrieved September 17, 2018. doi:10.1177/1073858418775355. · DOI
- Slutzky MW, Jordan LR, Lindberg EW, Lindsay KE, Miller LE (2011) De- coding the rat forelimb movement direction from epidural and intracor- tical field potentials. J Neural Eng 8:036013. CrossRef Medline · DOI
- Tate MC, Herbet G, Moritz-Gasser S, Tate JE, Duffau H (2014) Probabilistic map of critical functional regions of the human cerebral cortex: Broca's area revisited. Brain 137:2773-2782. CrossRef Medline · DOI · Paper page
- Tourville JA, Reilly KJ, Guenther FH (2008) Neural mechanisms underlying auditory feedback control of speech. Neuroimage 39:1429 -1443. CrossRef Medline · DOI · Paper page
- Wang WR, Arora R, Livescu K (2014) Reconstruction of articulatory mea- surements with smoothed low-rank matrix completion. Paper presented at 2014 IEEE Spoken Language Technology Workshop, South Lake Ta- hoe, CA, December.
- Wang W, Arora R, Livescu K, Bilmes JA (2015) Unsupervised learning of acoustic features via deep canonical correlation analysis. Paper presented at the ICASSP 2015: 40th IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Brisbane, QLD, Australia, April.
- Wise RJ, Greene J, Bu ¨chel C, Scott SK (1999) Brain regions involved in articulation. Lancet 353:1057-1061. CrossRef Medline · DOI · Paper page
- Wise SP, Moody SL, Blomstrom KJ, Mitz AR (1998) Changes in motor cor- tical activity during visuomotor adaptation. Exp Brain Res 121:285-299. CrossRef Medline · DOI
Cited by
Sorted by citations
Speech synthesis from neural decoding of spoken sentences
Anumanchipalli, G. K., Chartier, J., & Chang, E. F. (2019) · Nature · doi:10.1038/s41586-019-1119-1 · Cited by 883 · see citing works
Neuroprosthesis for Decoding Speech in a Paralyzed Person with Anarthria
Moses, D. A., Metzger, S. L., Liu, J. R., Anumanchipalli, G. K., Makin, J. G., Sun, P. F., Chartier, J., Dougherty, M. E., Liu, P. M., Abrams, G. M., et al. (2021) · New England Journal of Medicine · doi:10.1056/nejmoa2027540 · Cited by 582 · see citing works
A high-performance neuroprosthesis for speech decoding and avatar control
Metzger, S. L., Littlejohn, K. T., Silva, A. B., Moses, D. A., Seaton, M. P., Wang, R., Dougherty, M. E., Liu, J. R., Wu, P., Berger, M. A., et al. (2023) · Nature · doi:10.1038/s41586-023-06443-4 · Cited by 522 · see citing works
Machine translation of cortical activity to text with an encoder–decoder framework
Makin, J. G., Moses, D. A., & Chang, E. F. (2020) · Nature Neuroscience · doi:10.1038/s41593-020-0608-8 · Cited by 321 · see citing works
Real-time decoding of question-and-answer speech dialogue using human cortical activity
Moses, D. A., Leonard, M. K., Makin, J. G., & Chang, E. F. (2019) · Nature Communications · doi:10.1038/s41467-019-10994-4 · Cited by 224 · see citing works
Speech synthesis from ECoG using densely connected 3D convolutional neural networks
Angrick, M., Herff, C., Mugler, E., Tate, M. C., Slutzky, M. W., Krusienski, D. J., & Schultz, T. (2019) · Journal of Neural Engineering · doi:10.1088/1741-2552/ab0c59 · Cited by 225 · see citing works
Self-citationDamage to Broca’s area does not contribute to long-term speech production outcome after stroke
Gajardo-Vidal, A., Lorca-Puls, D. L., team, P., Warner, H., Pshdary, B., Crinion, J. T., Leff, A. P., Hope, T. M. H., Geva, S., Seghier, M. L., et al. (2021) · Brain · doi:10.1093/brain/awaa460 · Cited by 150 · see citing works
Herff, C., Diener, L., Angrick, M., Mugler, E., Tate, M. C., Goldrick, M. A., Krusienski, D. J., Slutzky, M. W., & Schultz, T. (2019) · Frontiers in Neuroscience · doi:10.3389/fnins.2019.01267 · Cited by 118 · see citing works
Self-citationNeural ensemble dynamics in dorsal motor cortex during speech in people with paralysis
Stavisky, S. D., Willett, F. R., Wilson, G. H., Murphy, B. A., Rezaii, P., Avansino, D. T., Memberg, W. D., Miller, J. P., Kirsch, R. F., Hochberg, L. R., et al. (2019) · eLife · doi:10.7554/elife.46015 · Cited by 105 · see citing works
Decoding spoken English from intracortical electrode arrays in dorsal precentral gyrus
Wilson, G. H., Stavisky, S. D., Willett, F. R., Avansino, D. T., Kelemen, J. N., Hochberg, L. R., Henderson, J. M., Druckmann, S., & Shenoy, K. V. (2020) · Journal of Neural Engineering · doi:10.1088/1741-2552/abbfef · Cited by 103 · see citing works
Brain-Computer Interface: Applications to Speech Decoding and Synthesis to Augment Communication
Luo, S., Rabbani, Q., & Crone, N. E. (2022) · Neurotherapeutics · doi:10.1007/s13311-022-01190-2 · Cited by 106 · see citing works
Silva, A. B., Littlejohn, K. T., Liu, J. R., Moses, D. A., & Chang, E. F. (2024) · Nature Reviews Neuroscience · doi:10.1038/s41583-024-00819-9 · Cited by 103 · see citing works
“Subsequent work discovered that SMC populations encode articulatory kinematic trajectories and vocal-tract configurations 43 during continuous speech 24,39,44,45 24 discovered that the SMC encodes a large variety of low-dimensional movement trajectories of the vocal tract (also called gestures),…”
Brain2Char: a deep architecture for decoding text from brain recordings
Sun, P., Anumanchipalli, G. K., & Chang, E. F. (2020) · Journal of Neural Engineering · doi:10.1088/1741-2552/abc742 · Cited by 77 · see citing works
High-resolution neural recordings improve the accuracy of speech decoding
Duraivel, S., Rahimpour, S., Chiang, C.-H., Trumpis, M., Wang, C., Barth, K., Harward, S. C., Lad, S. P., Friedman, A. H., Southwell, D. G., et al. (2023) · Nature Communications · doi:10.1038/s41467-023-42555-1 · Cited by 75 · see citing works
Angrick, M., Luo, S., Rabbani, Q., Candrea, D. N., Shah, S., Milsap, G. W., Anderson, W. S., Gordon, C. R., Rosenblatt, K. R., Clawson, L., et al. (2023) · doi:10.1101/2023.06.30.23291352 · Cited by 95 · see citing works
Thomas, T. M., Singh, A., Bullock, L. P., Liang, D., Morse, C. W., Scherschligt, X., Seymour, J. P., & Tandon, N. (2023) · Journal of Neural Engineering · doi:10.1088/1741-2552/ace9fb · Cited by 18 · see citing works
Bullock, L., Forseth, K. J., Woolnough, O., Rollo, P. S., & Tandon, N. (2023) · doi:10.1101/2023.04.04.535557 · Cited by 2 · see citing works
- Authors
- Mugler, E. M., Tate, M. C., Livescu, K., Templer, J. W., Goldrick, M. A., & Slutzky, M. W.
- Affiliations
- Toyota Technological Institute at Chicago (US)
- Northwestern University (US)
- ORCID
- Venue
- The Journal of Neuroscience
- Publisher
- Society for Neuroscience
- Published
- 2018-09-26
- Volume
- 38
- Issue
- 46
- Pages
- 9803-9813
- ISSN
- 0270-6474 (ISSN-L)
- 1529-2401
- PMC
- PMC6234299
- OpenAlex
- W2893673238
- Cited by
- 96
- References
- 8
- Citations by year
- 2026: 5 · 2025: 20 · 2024: 19 · 2023: 11 · 2022: 8 · 2021: 8 · 2020: 13 · 2019: 12
- FWCI
- 4.91
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Journal of Neuroscience (publishedVersion, cc-by-nc-sa)
- Europe PMC (PubMed Central) (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- Funders
- National Science Foundation (1321015, 2011039)
- Doris Duke Charitable Foundation (2011039)
- Northwestern University
- Northwestern Memorial Foundation
- National Institutes of Health (UL1TR001422, UL1TR000150, UL1-TR-)
- National Institute on Deafness and Other Communication Disorders (F32DC015708)
- National Institute of Neurological Disorders and Stroke (R01NS094748)
- National Center for Advancing Translational Sciences (UL1-TR, 001422)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neurobiology of Language and Bilingualism
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Phonetics and Phonology Research
- Health Sciences › Medicine › Physiology › Voice and Speech Disorders
- Keywords
- speech production, articulatory gestures, phonemes, inferior frontal cortex, Broca's area, primary motor cortex, premotor cortex, brain-computer interface, sex differences
- MeSH terms
- Electrocorticography, Adult, Brain Mapping, Female, Frontal Lobe, Gestures, Humans, Male, Movement, Photic Stimulation, Speech, Prefrontal Cortex
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
