The DOI matches its Crossref record; 73 of the 76 references it cites were found in a registry or an index.
Speech synthesis from ECoG using densely connected 3D convolutional neural networks
Open accessPublished version of a preprint
Abstract
Objective . Direct synthesis of speech from neural signals could provide a fast and natural way of communication to people with neurological diseases. Invasively-measured brain activity (electrocorticography; ECoG) supplies the necessary temporal and spatial resolution to decode fast and complex processes such as speech production. A number of impressive advances in speech decoding using neural signals have been achieved in recent years, but the complex dynamics are still not fully understood. However, it is unlikely that simple linear models can capture the relation between neural activity and continuous spoken speech. Approach . Here we show that deep neural networks can be used to map ECoG from speech production areas onto an intermediate representation of speech (logMel spectrogram). The proposed method uses a densely connected convolutional neural network topology which is well-suited to work with the small amount of data available from each participant. Main results . In a study with six participants, we achieved correlations up to r = 0.69 between the reconstructed and original logMel spectrograms. We transfered our prediction back into an audible waveform by applying a Wavenet vocoder. The vocoder was conditioned on logMel features that harnessed a much larger, pre-existing data corpus to provide the most natural acoustic output. Significance . To the best of our knowledge, this is the first time that high-quality speech has been reconstructed from neural recordings during speech production using deep neural networks.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Previous work in speakers with intact speech has demonstrated that intelligible speech can be synthesized from neural activity during vocalized or mimed speech10,11, but this has not been shown with someone who is paralysed.”
From A high-performance neuroprosthesis for speech decoding and avatar control (2023) · cites this paper as [10]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Another approach, pursued by Angrick et al.111 and Anumanchipalli et al.110, involved a two-stage decoding process. In the first stage, a deep-learning model is trained to regress neural activity (recorded from SEEG111 or ECoG110) to a time series of acoustic features, such as the mel-spectrogram (Fig. 3b). In the second stage, a speech synthesizer — a vocoder — is used to convert the acoustic rep”
From The speech neuroprosthesis (2024) · cites this paper as [111]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Densely Connected Convolutional Networks
Huang, G., Liu, Z., Van Der Maaten, L., & Weinberger, K. Q. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.243 · Cited by 48,566
Hinton, G., Deng, L., Yu, D., Dahl, G., Mohamed, A.-R., Jaitly, N., Senior, A., Vanhoucke, V., Nguyen, P., Sainath, T., et al. (2012) · IEEE Signal Processing Magazine · doi:10.1109/msp.2012.2205597 · Cited by 10,260
Brain–computer interfaces for communication and control
Wolpaw, J. R., Birbaumer, N., McFarland, D. J., Pfurtscheller, G., & Vaughan, T. M. (2002) · Clinical Neurophysiology · doi:10.1016/s1388-2457(02)00057-3 · Cited by 7,927
WaveNet: a generative model for raw audio
Oord, A. V. D., Dieleman, S., Zen, H., Simonyan, K., Vinyals, O., Graves, A., Kalchbrenner, N., Senior, A., & Kavukcuoglu, K. (2016) · arXiv · doi:10.48550/arxiv.1609.03499 · Cited by 4,911
Deep learning with convolutional neural networks for EEG decoding and visualization
Schirrmeister, R. T., Springenberg, J. T., Fiederer, L. D. J., Glasstetter, M., Eggensperger, K., Tangermann, M., Hutter, F., Burgard, W., & Ball, T. (2017) · Human Brain Mapping · doi:10.1002/hbm.23730 · Cited by 3,751
Neuronal ensemble control of prosthetic devices by a human with tetraplegia
Hochberg, L. R., Serruya, M. D., Friehs, G. M., Mukand, J. A., Saleh, M., Caplan, A. H., Branner, A., Chen, D., Penn, R. D., & Donoghue, J. P. (2006) · Nature · doi:10.1038/nature04970 · Cited by 3,295
BCI2000: A General-Purpose Brain-Computer Interface (BCI) System
Schalk, G., McFarland, D. J., Hinterberger, T., Birbaumer, N., & Wolpaw, J. R. (2004) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2004.827072 · Cited by 3,129
Natural TTS Synthesis by Conditioning Wavenet on MEL Spectrogram Predictions
Shen, J., Pang, R., Weiss, R. J., Schuster, M., Jaitly, N., Yang, Z., Chen, Z., Zhang, Y., Wang, Y., Skerrv-Ryan, R., et al. (2018) · 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2018.8461368 · Cited by 2,791
Rare and common variants: twenty arguments
Gibson, G. (2012) · Nature Reviews Genetics · doi:10.1038/nrg3118 · Cited by 1,278
A short-time objective intelligibility measure for time-frequency weighted noisy speech
Taal, C., Hendriks, R. C., Heusdens, R. R., & Jensen, J. (2010) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2010.5495701 · Cited by 1,111
A Scale for the Measurement of the Psychological Magnitude Pitch
Stevens, S. S., Volkmann, J., & Newman, E. B. (1937) · The Journal of the Acoustical Society of America · doi:10.1121/1.1915893 · Cited by 1,107 · cited 2×
“The compression is based on the usage of the mel-scale which condenses frequency bands in accordance to the human perception [53].”
BackgroundMethodPhonetic Feature Encoding in Human Superior Temporal Gyrus
Mesgarani, N., Cheung, C., Johnson, K., & Chang, E. F. (2014) · Science · doi:10.1126/science.1245994 · Cited by 993
Ajiboye, A. B., Willett, F. R., Young, D. R., Memberg, W. D., Murphy, B. A., Miller, J. P., Walter, B. L., Sweet, J. A., Hoyen, H. A., Keith, M. W., et al. (2017) · The Lancet · doi:10.1016/s0140-6736(17)30601-3 · Cited by 862
Computational neuroanatomy of speech production
Hickok, G. (2012) · Nature Reviews Neuroscience · doi:10.1038/nrn3158 · Cited by 837
Statistical parametric speech synthesis using deep neural networks
Zen, H., Senior, A., & Schuster, M. (2013) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2013.6639215 · Cited by 818
Ray, S., Crone, N. E., Niebur, E., Franaszczuk, P. J., & Hsiao, S. S. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.2848-08.2008 · Cited by 722
Inferring single-trial neural population dynamics using sequential auto-encoders
Pandarinath, C., O’Shea, D. J., Collins, J., Józefowicz, R., Stavisky, S. D., Kao, J. C., Trautmann, E. M., Kaufman, M. T., Ryu, S. I., Hochberg, L. R., et al. (2018) · Nature Methods · doi:10.1038/s41592-018-0109-9 · Cited by 721
Reconstructing Speech from Human Auditory Cortex
Pasley, B. N., David, S. V., Mesgarani, N., Flinker, A., Shamma, S. A., Crone, N. E., Knight, R. T., & Chang, E. F. (2012) · PLoS Biology · doi:10.1371/journal.pbio.1001251 · Cited by 604
Salimans, T., Karpathy, A., Chen, X., & Kingma, D. P. (2017) · arXiv · doi:10.48550/arxiv.1701.05517 · Cited by 584
Pandarinath, C., Nuyujukian, P., Blabe, C. H., Sorice, B. L., Saab, J., Willett, F. R., Hochberg, L. R., Shenoy, K. V., & Henderson, J. M. (2017) · eLife · doi:10.7554/elife.18554 · Cited by 566 · cited 1×
“While our study uses overtly-produced speech in motor-intact participants, there are recent advances in decoding motor function [67, 68, 69, 70] in paralyzed patients that might be extended to the decoding of speech from motor areas in the future.”
BackgroundInterpretable deep neural networks for single-trial EEG classification
Sturm, I., Lapuschkin, S., Samek, W., & Müller, K. (2016) · Journal of Neuroscience Methods · doi:10.1016/j.jneumeth.2016.10.008 · Cited by 396
Turner, G. S., Tjaden, K., & Weismer, G. G. (1995) · Journal of Speech Language and Hearing Research · doi:10.1044/jshr.3805.1001 · Cited by 328
A Wireless Brain-Machine Interface for Real-Time Speech Synthesis
Guenther, F. H., Brumberg, J. S., Wright, E. J., Nieto-Castanon, A., Tourville, J. A., Panko, M., Law, R., Siebert, S. A., Bartels, J. L., Andreasen, D. S., et al. (2009) · PLoS ONE · doi:10.1371/journal.pone.0008218 · Cited by 306
Brain-to-text: decoding spoken phrases from phone representations in the brain
Herff, C., Heger, D., de Pesters, A., Telaar, D., Brunner, P., Schalk, G., & Schultz, T. (2015) · Frontiers in Neuroscience · doi:10.3389/fnins.2015.00217 · Cited by 297
Self-citationSpeaker-Dependent WaveNet Vocoder
Tamamori, A., Hayashi, T., Kobayashi, K., Takeda, K., & Toda, T. (2017) · Interspeech (USB) · doi:10.21437/interspeech.2017-314 · Cited by 276
Parallel WaveNet: Fast High-Fidelity Speech SynthesisPreprint
van den Oord, A., Li, Y., Babuschkin, I., Simonyan, K., Vinyals, O., Kavukcuoglu, K., van den Driessche, G., Lockhart, E., Cobo, L. C., Stimberg, F., et al. (2017) · arXiv (Cornell University) · Cited by 262
Ito, K. A. (2024) · TIB Data Manager · doi:10.57702/yamk7ojd · Cited by 259
The equilibrium function of the otolith organs of the thornback ray (Raja clavata)
Lowenstein, O. E., & Roberts, T. D. M. (1949) · The Journal of Physiology · doi:10.1113/jphysiol.1949.sp004448 · Cited by 243
Decoding spoken words using local field potentials recorded from the cortical surface
Kellis, S., Miller, K., Thomson, K., Brown, R., House, P., & Greger, B. (2010) · Journal of Neural Engineering · doi:10.1088/1741-2560/7/5/056007 · Cited by 235
Biosignal-Based Spoken Communication: A Survey
Schultz, T., Wand, M., Hueber, T., Krusienski, D. J., Herff, C., & Brumberg, J. S. (2017) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2017.2752365 · Cited by 207
Self-citationDecoding spectrotemporal features of overt and covert speech from the human cortex
Martin, S., Brunner, P., Holdgraf, C., Heinze, H.-J., Crone, N. E., Rieger, J., Schalk, G., Knight, R. T., & Pasley, B. N. (2014) · Frontiers in Neuroengineering · doi:10.3389/fneng.2014.00014 · Cited by 200
Mugler, E. M., Patton, J. L., Flint, R. D., Wright, Z. A., Schuele, S. U., Rosenow, J., Shih, J. J., Krusienski, D. J., & Slutzky, M. W. (2014) · Journal of Neural Engineering · doi:10.1088/1741-2560/11/3/035015 · Cited by 192
Self-citationA recurrent neural network for closed-loop intracortical brain–machine interface decoders
Sussillo, D., Nuyujukian, P., Fan, J. M., Kao, J. C., Stavisky, S. D., Ryu, S. I., & Shenoy, K. V. (2012) · Journal of Neural Engineering · doi:10.1088/1741-2560/9/2/026027 · Cited by 189
The Control of Vocal Pitch in Human Laryngeal Motor Cortex
Dichter, B. K., Breshears, J. D., Leonard, M. K., & Chang, E. F. (2018) · Cell · doi:10.1016/j.cell.2018.05.016 · Cited by 183
Word pair classification during imagined speech using direct brain recordings
Martin, S., Brunner, P., Iturrate, I., Millán, J. D. R., Schalk, G., Knight, R. T., & Pasley, B. N. (2016) · Scientific Reports · doi:10.1038/srep25803 · Cited by 171
Intonational speech prosody encoding in the human auditory cortex
Tang, C., Hamilton, L. S., & Chang, E. F. (2017) · Science · doi:10.1126/science.aam8577 · Cited by 161
Effect of delayed auditory feedback on normal speakers at two speech rates
Stuart, A., Kalinowski, J. S., Rastatter, M. P., & Lynch, K. (2002) · The Journal of the Acoustical Society of America · doi:10.1121/1.1466868 · Cited by 145
Language and motor speech skills in children with cerebral palsy
Pirilä, S., van der Meere, J., Pentikainen, T., Ruusu-Niemi, P., Korpela, R., Kilpinen, J., & Nieminen, P. (2006) · Journal of Communication Disorders · doi:10.1016/j.jcomdis.2006.06.002 · Cited by 145
The Tracking of Speech Envelope in the Human Cortex
Kubanek, J., Brunner, P., Gunduz, A., Poeppel, D., & Schalk, G. (2013) · PLoS ONE · doi:10.1371/journal.pone.0053398 · Cited by 141
Seeliger, K., Fritsche, M., Güçlü, U., Schoenmakers, S., Schoffelen, J., Bosch, S., & van Gerven, M. A. J. (2017) · NeuroImage · doi:10.1016/j.neuroimage.2017.07.018 · Cited by 132
Deep learning for epileptic intracranial EEG data
Antoniades, A., Spyrou, L., Took, C. C., & Sanei, S. (2016) · 2016 IEEE 26th International Workshop on Machine Learning for Signal Processing (MLSP) · doi:10.1109/mlsp.2016.7738824 · Cited by 129
Reconstructing the spectrotemporal modulations of real-life sounds from fMRI response patterns
Santoro, R., Moerel, M., Martino, F. D., Valente, G., Uǧurbil, K., Yacoub, E. S., & Formisano, E. (2017) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1617622114 · Cited by 129
Decoding spoken phonemes from sensorimotor cortex with high-density ECoG grids
Ramsey, N. F., Salari, E., Aarnoutse, E. J., Vansteensel, M. J., Bleichner, M. G., & Freudenburg, Z. V. (2018) · NeuroImage · doi:10.1016/j.neuroimage.2017.10.011 · Cited by 124
EEG Classification of Covert Speech Using Regularized Neural Networks
Sereshkeh, A. R., Trott, R. E., Bricout, A., & Chau, T. T. (2017) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2017.2758164 · Cited by 123
Modeling the Dynamics of Human Brain Activity with Recurrent Neural Networks
Güçlü, U., & van Gerven, M. A. J. (2017) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2017.00007 · Cited by 119
Automatic Speech Recognition from Neural Signals: A Focused Review
Herff, C., & Schultz, T. (2016) · Frontiers in Neuroscience · doi:10.3389/fnins.2016.00429 · Cited by 117
Self-citationThe Potential for a Speech Brain–Computer Interface Using Chronic Electrocorticography
Rabbani, Q., Milsap, G., & Crone, N. E. (2019) · Neurotherapeutics · doi:10.1007/s13311-018-00692-2 · Cited by 112
Impairment of Speech Intelligibility in Men with Amyotrophic Lateral Sclerosis
Kent, R. D., Kent, J. F., Weismer, G. G., Sufit, R. L., Rosenbek, J. C., Martin, R. E., & Brooks, B. R. (1990) · Journal of Speech and Hearing Disorders · doi:10.1044/jshd.5504.721 · Cited by 98
Mugler, E. M., Tate, M. C., Livescu, K., Templer, J. W., Goldrick, M. A., & Slutzky, M. W. (2018) · The Journal of Neuroscience · doi:10.1523/jneurosci.1206-18.2018 · Cited by 96
Self-citationMoses, D. A., Mesgarani, N., Leonard, M. K., & Chang, E. F. (2016) · Journal of Neural Engineering · doi:10.1088/1741-2560/13/5/056004 · Cited by 95
Electrocorticographic representations of segmental features in continuous speech
Lotte, F., Brumberg, J. S., Brunner, P., Gunduz, A., Ritaccio, A. L., Guan, C., & Schalk, G. (2015) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2015.00097 · Cited by 88
Brumberg, J. S., Krusienski, D. J., Chakrabarti, S., Gunduz, A., Brunner, P., Ritaccio, A. L., & Schalk, G. (2016) · PLoS ONE · doi:10.1371/journal.pone.0166872 · Cited by 78
Self-citationKey considerations in designing a speech brain-computer interface
Bocquelet, F., Hueber, T., Laurent Girin, B., Chabardès, S., & Yvert, B. (2016) · Journal of Physiology-Paris · doi:10.1016/j.jphysparis.2017.07.002 · Cited by 78
15th Int. Conf on Machine Learning
Cristianini, N., Shawe-Taylor, J. S., & Sybacek, P. (1998) · Cited by 76
Riès, S., Dhillon, R. K., Clarke, A., King‐Stephens, D., Laxer, K. D., Weber, P. B., Kuperman, R. A., Auguste, K. I., Brunner, P., Schalk, G., et al. (2017) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1620669114 · Cited by 74
Progress in speech decoding from the electrocorticogram
Chakrabarti, S., Sandberg, H. M., Brumberg, J. S., & Krusienski, D. J. (2015) · Biomedical Engineering Letters · doi:10.1007/s13534-015-0175-1 · Cited by 67
Self-citationInvestigating deep learning for fNIRS based BCI
Hennrich, J., Herff, C., Heger, D., & Schultz, T. (2015) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc.2015.7318984 · Cited by 67
Self-citationMotor cortical activity changes during neuroprosthetic-controlled object interaction
Downey, J. E., Brane, L., Gaunt, R. A., Tyler-Kabara, E. C., Boninger, M. L., & Collinger, J. L. (2017) · Scientific Reports · doi:10.1038/s41598-017-17222-3 · Cited by 63
Psychoacoustic Speech Tests: A Modified Rhyme Test
House, A. S., Williams, C. E., Hecker, M. H. L., & Kryter, K. D. (1963) · The Journal of the Acoustical Society of America · doi:10.1121/1.2142744 · Cited by 62
Livezey, J. A., Bouchard, K. E., & Chang, E. F. (2019) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1007091 · Cited by 62
Effects of Laryngeal Cancer on Voice and Swallowing
Starmer, H. M., Tippett, D. C., & Webster, K. T. (2008) · Otolaryngologic Clinics of North America · doi:10.1016/j.otc.2008.01.018 · Cited by 55
Experiments on Parallel Training of Deep Neural Network using Model AveragingPreprint
Su, H., & Chen, H. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1507.01239 · Cited by 53
A Deep Learning Architecture to Detect Events in EEG Signals During Sleep
Chambon, S., Thorey, V., Arnal, P. J., Mignot, E. J.-M., & Gramfort, A. (2018) · Machine learning for signal processing ... · doi:10.1109/mlsp.2018.8517067 · Cited by 51
The use of intracranial recordings to decode human language: Challenges and opportunities
Martin, S., Millán, J. D. R., Knight, R. T., & Pasley, B. N. (2016) · Brain and Language · doi:10.1016/j.bandl.2016.06.003 · Cited by 49
Physiological properties of brain-machine interface input signals
Slutzky, M. W., & Flint, R. D. (2017) · Journal of Neurophysiology · doi:10.1152/jn.00070.2017 · Cited by 47
Self-citationON the Use of Wavenet as a Statistical Vocoder
Adiga, N., Tsiaras, V., & Stylianou, Y. (2018) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2018.8462393 · Cited by 47
Towards direct speech synthesis from ECoG: A pilot study
Herff, C., Johnson, G. D., Diener, L., Shih, J. J., Krusienski, D. J., & Schultz, T. (2016) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc.2016.7591004 · Cited by 43
Self-citationIljina, O., Derix, J., Schirrmeister, R. T., Schulze‐Bonhage, A., Auer, P. L., Aertsen, A., & Ball, T. (2017) · Brain-Computer Interfaces · doi:10.1080/2326263x.2017.1330611 · Cited by 38
Effect of Delayed Auditory Feedback, Speech Rate, and Sex on Speech Production
Stuart, A., & Kalinowski, J. S. (2015) · Perceptual and Motor Skills · doi:10.2466/23.25.pms.120v17x2 · Cited by 15
Modeling brain responses to perceived speech with LSTM networks
Berezutskaya, J., Freudenburg, Z. V., Ramsey, N. F., Güçlü, U., & van Gerven, M. A. J. (2017) · Radboud Repository (Radboud University) · Cited by 5
interpretation of convolutional neural networks for speech regression from electrocorticography.
Angrick, M., Herff, C., Johnson, G. D., Shih, J. J., Krusienski, D. J., & Schultz, T. (2018) · The European Symposium on Artificial Neural Networks · Cited by 2
Self-citation
Cited by
Sorted by citations
Neuroprosthesis for Decoding Speech in a Paralyzed Person with Anarthria
Moses, D. A., Metzger, S. L., Liu, J. R., Anumanchipalli, G. K., Makin, J. G., Sun, P. F., Chartier, J., Dougherty, M. E., Liu, P. M., Abrams, G. M., et al. (2021) · New England Journal of Medicine · doi:10.1056/nejmoa2027540 · Cited by 582
A high-performance neuroprosthesis for speech decoding and avatar control
Metzger, S. L., Littlejohn, K. T., Silva, A. B., Moses, D. A., Seaton, M. P., Wang, R., Dougherty, M. E., Liu, J. R., Wu, P., Berger, M. A., et al. (2023) · Nature · doi:10.1038/s41586-023-06443-4 · Cited by 522
Decoding speech perception from non-invasive brain recordings
Défossez, A., Caucheteux, C., Rapin, J., Kabeli, O., & King, J.-R. (2023) · Nature Machine Intelligence · doi:10.1038/s42256-023-00714-5 · Cited by 322
He, B., Yuan, H., Meng, J., & Gao, S. (2020) · Springer eBooks · doi:10.1007/978-3-030-43395-6_4 · Cited by 150
Silent Speech Interfaces for Speech Restoration: A Review
González, J. A., Gomez-Alanis, A., Martín-Doñas, J. M., Pérez-Córdoba, J. L., & Gomez, A. M. (2020) · IEEE Access · doi:10.1109/access.2020.3026579 · Cited by 147
Metadata
- Authors
- Angrick, M., Herff, C., Mugler, E., Tate, M. C., Slutzky, M. W., Krusienski, D. J., & Schultz, T.
- Affiliations
- University of Bremen (DE)
- Northwestern University (US)
- Virginia Commonwealth University (US)
- Corresponding author
- Angrick, Miguel
- Herff, Christian
- ORCID
- Venue
- Journal of Neural Engineering
- Publisher
- IOP Publishing
- Published
- 2019-04-16
- Volume
- 16
- Issue
- 3
- Pages
- 036019
- ISSN
- 1741-2552 (ISSN-L)
- 1741-2560
- PMC
- PMC6822609
- OpenAlex
- W2952609044
- Cited by
- 225
- References
- 76
- Citations by year
- 2026: 18 · 2025: 36 · 2024: 35 · 2023: 28 · 2022: 34 · 2021: 30 · 2020: 29 · 2019: 15
- FWCI
- 12.32
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Licence
- Locations
- Journal of Neural Engineering (publishedVersion)
- bioRxiv (Cold Spring Harbor Laboratory) (acceptedVersion)
- PubMed (publishedVersion)
- PubMed Central (acceptedVersion)
- Research Publications (Maastricht University) (submittedVersion, other-oa)
- Funders
- National Science Foundation (1608140)
- National Institutes of Health (F32DC015708)
- National Center for Advancing Translational Sciences (UL1TR000150)
- Bundesministerium für Bildung und Forschung (01GQ1602)
- Doris Duke Charitable Foundation (2011039)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
- Physical Sciences › Computer Science › Signal Processing › Speech and Audio Processing
- Life Sciences › Neuroscience › Cognitive Neuroscience › EEG and Brain-Computer Interfaces
- Keywords
- speech synthesis, electrocorticography, neural speech decoding, 3D convolutional neural networks, speech production, brain-computer interface, augmentative and alternative communication
- MeSH terms
- Electrocorticography, Cerebral Cortex, Communication Aids for Disabled, Communication Devices for People with Disabilities, Humans, Photic Stimulation, Speech, Neural Networks, Computer
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
