The DOI matches its Crossref record; 73 of the 76 references it cites were found in a registry or an index.
Speech synthesis from ECoG using densely connected 3D convolutional neural networks
Open accessPublished version of a preprint
Abstract
Objective . Direct synthesis of speech from neural signals could provide a fast and natural way of communication to people with neurological diseases. Invasively-measured brain activity (electrocorticography; ECoG) supplies the necessary temporal and spatial resolution to decode fast and complex processes such as speech production. A number of impressive advances in speech decoding using neural signals have been achieved in recent years, but the complex dynamics are still not fully understood. However, it is unlikely that simple linear models can capture the relation between neural activity and continuous spoken speech. Approach . Here we show that deep neural networks can be used to map ECoG from speech production areas onto an intermediate representation of speech (logMel spectrogram). The proposed method uses a densely connected convolutional neural network topology which is well-suited to work with the small amount of data available from each participant. Main results . In a study with six participants, we achieved correlations up to r = 0.69 between the reconstructed and original logMel spectrograms. We transfered our prediction back into an audible waveform by applying a Wavenet vocoder. The vocoder was conditioned on logMel features that harnessed a much larger, pre-existing data corpus to provide the most natural acoustic output. Significance . To the best of our knowledge, this is the first time that high-quality speech has been reconstructed from neural recordings during speech production using deep neural networks.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Previous work in speakers with intact speech has demonstrated that intelligible speech can be synthesized from neural activity during vocalized or mimed speech10,11, but this has not been shown with someone who is paralysed.”
From A high-performance neuroprosthesis for speech decoding and avatar control (2023) · cites this paper as [10]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Another approach, pursued by Angrick et al.111 and Anumanchipalli et al.110, involved a two-stage decoding process. In the first stage, a deep-learning model is trained to regress neural activity (recorded from SEEG111 or ECoG110) to a time series of acoustic features, such as the mel-spectrogram (Fig. 3b). In the second stage, a speech synthesizer — a vocoder — is used to convert the acoustic rep”
From The speech neuroprosthesis (2024) · cites this paper as [111]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Densely Connected Convolutional Networks
Huang, G., Liu, Z., Van Der Maaten, L., & Weinberger, K. Q. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.243 · Cited by 48,566
Hinton, G., Deng, L., Yu, D., Dahl, G., Mohamed, A.-R., Jaitly, N., Senior, A., Vanhoucke, V., Nguyen, P., Sainath, T., et al. (2012) · IEEE Signal Processing Magazine · doi:10.1109/msp.2012.2205597 · Cited by 10,260
Brain–computer interfaces for communication and control
Wolpaw, J. R., Birbaumer, N., McFarland, D. J., Pfurtscheller, G., & Vaughan, T. M. (2002) · Clinical Neurophysiology · doi:10.1016/s1388-2457(02)00057-3 · Cited by 7,927
WaveNet: a generative model for raw audio
Oord, A. V. D., Dieleman, S., Zen, H., Simonyan, K., Vinyals, O., Graves, A., Kalchbrenner, N., Senior, A., & Kavukcuoglu, K. (2016) · arXiv · doi:10.48550/arxiv.1609.03499 · Cited by 4,911
Deep learning with convolutional neural networks for EEG decoding and visualization
Schirrmeister, R. T., Springenberg, J. T., Fiederer, L. D. J., Glasstetter, M., Eggensperger, K., Tangermann, M., Hutter, F., Burgard, W., & Ball, T. (2017) · Human Brain Mapping · doi:10.1002/hbm.23730 · Cited by 3,751
Neuronal ensemble control of prosthetic devices by a human with tetraplegia
Hochberg, L. R., Serruya, M. D., Friehs, G. M., Mukand, J. A., Saleh, M., Caplan, A. H., Branner, A., Chen, D., Penn, R. D., & Donoghue, J. P. (2006) · Nature · doi:10.1038/nature04970 · Cited by 3,295
BCI2000: A General-Purpose Brain-Computer Interface (BCI) System
Schalk, G., McFarland, D. J., Hinterberger, T., Birbaumer, N., & Wolpaw, J. R. (2004) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2004.827072 · Cited by 3,129
Natural TTS Synthesis by Conditioning Wavenet on MEL Spectrogram Predictions
Shen, J., Pang, R., Weiss, R. J., Schuster, M., Jaitly, N., Yang, Z., Chen, Z., Zhang, Y., Wang, Y., Skerrv-Ryan, R., et al. (2018) · 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2018.8461368 · Cited by 2,791
Cited by
Sorted by citations
Items 101–200 of 227
Stuart, M., Lesaja, S., Shih, J. J., Schultz, T., Manic, M., & Krusienski, D. J. (2022) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2022.3207624 · Cited by 10
Self-citationXue, P., Wang, K., Ma, C., Chen, C., Yin, M., & Diao, D. (2025) · Carbon · doi:10.1016/j.carbon.2025.120720 · Cited by 9
Machine-Learning Methods for Speech and Handwriting Detection Using Neural Signals: A Review
Sen, O., Sheehan, A. M., Raman, P. R., Khara, K. S., Khalifa, A., & Chatterjee, B. (2023) · Sensors · doi:10.3390/s23125575 · Cited by 11
Prediction of Speech Onset by Micro-Electrocorticography of the Human Brain
Delfino, E., Pastore, A., Zucchini, E., Cruz, M. F. P., Ius, T., Vomero, M., D’Ausilio, A., Casile, A., Škrap, M., Stieglitz, T., et al. (2021) · International Journal of Neural Systems · doi:10.1142/s0129065721500258 · Cited by 10
Local field potentials in a pre-motor region predict learned vocal sequences
Brown, D. E., Chavez, J. I., Nguyen, D. H., Kadwory, A., Voytek, B., Arneodo, E. M., Gentner, T. Q., & Gilja, V. (2021) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1008100 · Cited by 11
Milyani, A. H., & Attar, E. T. (2025) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2025.1668935 · Cited by 9
Recognizing Tonal and Nontonal Mandarin Sentences for EEG-Based Brain–Computer Interface
Yang, S.-R., Jung, T., Lin, C., Huang, K., Wei, C.-S., Chiueh, H., Hsin, Y.-L., Liou, G.-T., & Wang, L. (2021) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2021.3137251 · Cited by 9
Toward Silent Paralinguistics: Speech-to-EMG — Retrieving Articulatory Muscle Activity from Speech
Botelho, C., Diener, L., Küster, D., Scheck, K., Amiriparian, S., Schuller, B. W., Schultz, T., Abad, A., & Trancoso, I. M. (2020) · Interspeech (USB) · doi:10.21437/interspeech.2020-2926 · Cited by 8
Self-citationSubject-Agnostic Transformer-Based Neural Speech Decoding from Surface and Depth Electrode SignalsPreprint
Chen, J., Chen, X., Wang, R., Le, C., Khalilian-Gourtani, A., Jensen, E., Dugan, P. C., Doyle, W., Devinsky, O., Friedman, D. J., et al. (2024) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2024.03.11.584533 · Cited by 8
Jæger, K. H., & Tveito, A. (2026) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2026.1755548 · Cited by 7
Saa, J. F. D., Christen, A., Martin, S., Pasley, B. N., Knight, R. T., & Giraud, A. (2020) · Scientific Reports · doi:10.1038/s41598-020-63303-1 · Cited by 7
Compact and interpretable architecture for speech decoding from stereotactic EEG
Petrosyan, A., Voskoboynikov, A., & Ossadtchi, A. E. (2021) · International Conference Neurotechnologies and Neurointerfaces (CNN) · doi:10.1109/cnn53494.2021.9580381 · Cited by 7
Spatiotemporal dynamics of human high gamma discriminate naturalistic behavioral states
Alasfour, A., Gabriel, P., Jiang, X., Shamie, I., Melloni, L., Thesen, T., Dugan, P. C., Friedman, D. J., Doyle, W., Devinsky, O., et al. (2022) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1010401 · Cited by 7
Contributions of Stereotactic EEG Electrodes in Grey and White Matter to Speech Activity Detection
Soroush, P. Z., Herff, C., Riès, S., Shih, J. J., Schultz, T., & Krusienski, D. J. (2022) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc48229.2022.9871464 · Cited by 7
Self-citationRekrut, M., Fey, A., Nadig, M., Ihl, J., Jungbluth, T., & Krüger, A. (2022) · IEEE International Conference on Metrology for eXtended Reality, Artificial Intelligence and Neural Engineering (MetroXRAINE) · doi:10.1109/metroxraine54828.2022.9967665 · Cited by 7
Creating Song From Lip and Tongue Videos With a Convolutional Vocoder
Zhang, J., Roussel, P., & Denby, B. (2021) · IEEE Access · doi:10.1109/access.2021.3050843 · Cited by 7
Deep learning approaches for neural decoding: from CNNs to LSTMs and spikes to fMRIPreprint
Livezey, J. A., & Glaser, J. I. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2005.09687 · Cited by 7
Synthesizing Speech from Intracranial Depth Electrodes using an Encoder-Decoder FrameworkPreprint
Herff, C. (2021) · arXiv (Cornell University) · Cited by 7
Self-citationMild and Efficient Degradation of Amine‐Cured Epoxy Resins Using Mixed Solvents
Zhang, X., Shi, Y., Qu, C., Shi, X., & Tan, Q. (2025) · Journal of Applied Polymer Science · doi:10.1002/app.57311 · Cited by 6
Progress, challenges and future of linguistic neural decoding with deep learning
Wang, Y., Liu, H., Wang, Y., Xuan, C., Hou, Y., Feng, S., Liu, H., Liao, Y., & Wang, Y. (2025) · Communications Biology · doi:10.1038/s42003-025-08511-z · Cited by 10
Transfer learning via distributed brain recordings enables reliable speech decoding
Singh, A., Thomas, T. M., Li, J., Hickok, G. S., Pitkow, X., & Tandon, N. (2025) · Nature Communications · doi:10.1038/s41467-025-63825-0 · Cited by 11
Consistent spectro-spatial features of human ECoG successfully decode naturalistic behavioral states
Alasfour, A., & Gilja, V. (2024) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2024.1388267 · Cited by 6
Iterative alignment discovery of speech-associated neural activity
Rabbani, Q., Shah, S., Milsap, G., Fifer, M. S., Heřmanský, H., & Crone, N. E. (2024) · Journal of Neural Engineering · doi:10.1088/1741-2552/ad663c · Cited by 6
Towards Naturalistic Speech Decoding from Intracranial Brain Data
Berezutskaya, J., Ambrogioni, L., Ramsey, N. F., & van Gerven, M. A. J. (2022) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc48229.2022.9871301 · Cited by 6
Direct Speech Reconstruction from Sensorimotor Brain Activity with Optimized Deep Learning Models
Berezutskaya, J., Freudenburg, Z. V., Vansteensel, M. J., Aarnoutse, E. J., Ramsey, N. F., & van Gerven, M. A. J. (2022) · doi:10.1101/2022.08.02.502503 · Cited by 42
Lin, S.-K., Lee, J.-H., Tsai, H.-S., Chen, Y.-C., Zhang, M.-X., Kuo, W.-C., & Yang, Y.-J. J. (2025) · Sensors and Actuators Reports · doi:10.1016/j.snr.2025.100407 · Cited by 5
Sensing technologies for silent speech interfaces
Tang, C., Qi, L., Gao, S., Zhang, Z., Yi, W., Xu, M., Occhipinti, E., Pan, Y., & Occhipinti, L. G. (2026) · Nature Sensors · doi:10.1038/s44460-025-00010-2 · Cited by 8
Jude, J. J., Haro, S., Levi-Aharoni, H., Hashimoto, H., Acosta, A. J., Card, N. S., Wairagkar, M., Brandman, D. M., Stavisky, S. D., Williams, Z. M., et al. (2026) · Cell Reports · doi:10.1016/j.celrep.2026.117162 · Cited by 13
Noninvasive decoding of typed sentences from human brain activity
Levy, J., Zhang, M., Pinet, S., Rapin, J., Banville, H. J., d’Ascoli, S., & King, J.-R. (2026) · Nature Neuroscience · doi:10.1038/s41593-026-02303-2 · Cited by 49
Xu, X., & Fu, C. (2024) · IEEE Transactions on Consumer Electronics · doi:10.1109/tce.2024.3472054 · Cited by 6
Speech Spectrogram Estimation from Intracranial Brain Activity Using a Quantization Approach
Angrick, M., Herff, C., Johnson, G. D., Shih, J. J., Krusienski, D. J., & Schultz, T. (2020) · Interspeech (USB) · doi:10.21437/interspeech.2020-2946 · Cited by 6
Self-citationSpoken Utterance Classification Task of Arabic Numerals and Selected Isolated Words
Dabbabi, K., & Mars, A. (2022) · Arabian Journal for Science and Engineering · doi:10.1007/s13369-022-06649-0 · Cited by 5
Vojtech, J. M., Mitchell, C. L., Raiff, L., Kline, J. C., & Luca, G. D. (2022) · Vibration · doi:10.3390/vibration5040041 · Cited by 5
VocalMind: A Stereotactic EEG Dataset for Vocalized, Mimed, and Imagined Speech in Tonal Language
He, T., Wei, M., Wang, R., Wang, R., Du, S., Cai, S., Tao, W., & Li, H. (2025) · Scientific Data · doi:10.1038/s41597-025-04741-2 · Cited by 9
Prosodic Preferences of Surface Electromyography-based Subvocal Speech for People With Laryngectomy
Raiff, L., Turashvili, D. M., Heaton, J. T., Luca, G. D., Kline, J. C., & Vojtech, J. M. (2024) · Journal of Voice · doi:10.1016/j.jvoice.2024.10.024 · Cited by 4
Vowel Sound Synthesis from Electroencephalography during Listening and Recalling
Akashi, W., Kambara, H., Ogata, Y., Koike, Y., Minati, L., & Yoshimura, N. (2021) · Advanced Intelligent Systems · doi:10.1002/aisy.202170023 · Cited by 4
Speech Decoding as Machine Translation
Makin, J. G., Moses, D. A., & Chang, E. F. (2021) · Springer briefs in electrical and computer engineering · doi:10.1007/978-3-030-79287-9_3 · Cited by 4
Angrick, M., Luo, S., Rabbani, Q., Joshi, S. R., Candrea, D. N., Milsap, G., Gordon, C. R., Rosenblatt, K. R., Clawson, L., Maragakis, N. J., et al. (2025) · Journal of Neural Engineering · doi:10.1088/1741-2552/ae0965 · Cited by 4
Self-citationFernández-García, C. E., Marín, D. V., & Velásquez, H. S. (2023) · Bridging human and machine: future education with intelligence · doi:10.1007/978-981-19-8641-3_9 · Cited by 4
Brain signals translated into speech using artificial intelligence
Guglielmi, G. (2019) · Nature · doi:10.1038/d41586-019-01328-x · Cited by 5
Editorial: Neurotechnologies for Human Augmentation
Valeriani, D., Ayaz, H., Kosmyna, N., Poli, R., & Maes, P. (2021) · Frontiers in Neuroscience · doi:10.3389/fnins.2021.789868 · Cited by 5
He, V. Y., Liu, A., Duan, S., Gao, Y., Qian, R., & Chen, X. (2025) · IEEE Sensors Journal · doi:10.1109/jsen.2025.3563587 · Cited by 5
A Wearable Ultra-Low-Power System for EEG-Based Speech-Imagery Interfaces
Ingolfsson, T. M., Kartsch, V., Luca Benini, C., & Cossettini, A. (2025) · IEEE Transactions on Biomedical Circuits and Systems · doi:10.1109/tbcas.2025.3573027 · Cited by 3
Eichler, G., Gilhotra, Y., Zeng, N., Kim, M., Shepard, K., & Carloni, L. P. (2025) · IEEE/ACM International Symposium on Microarchitecture (MICRO) · doi:10.1145/3725843.3756032 · Cited by 3
Han, S. Y., Feng, S., & Li, F. (2026) · The Innovation Life · doi:10.59717/j.xinn-life.2026.100198 · Cited by 3
Vowel Sound Synthesis from Electroencephalography during Listening and Recalling
Akashi, W., Kambara, H., Ogata, Y., Koike, Y., Minati, L., & Yoshimura, N. (2021) · Advanced Intelligent Systems · doi:10.1002/aisy.202000164 · Cited by 4
Temporal-channel cascaded transformer for imagined handwriting character recognition
Zhou, W., Wang, Y., Mo, L., Li, C., Xu, M., Kong, W., & Dai, G. (2024) · Neurocomputing · doi:10.1016/j.neucom.2024.127243 · Cited by 3
Parvez, L., Keshavarzi, M., Richards, S., Liberto, G. M. D., & Goswami, U. (2024) · Journal of Speech Language and Hearing Research · doi:10.1044/2024_jslhr-24-00031 · Cited by 5
Schultz, T., Angrick, M., Diener, L., Küster, D., Meier, M., Krusienski, D. J., Herff, C., & Brumberg, J. S. (2019) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc.2019.8857670 · Cited by 3
Self-citationDiscrimination of Overt, Mouthed, and Imagined Speech Activity using Stereotactic EEG
Soroush, P. Z., Cole, S. Y., Herff, C., Riès, S., Shih, J. J., Schultz, T., & Krusienski, D. J. (2023) · International IEEE/EMBS Conference on Neural Engineering · doi:10.1109/ner52421.2023.10123716 · Cited by 3
Self-citationSemantic Representations of Speech Production in Intracranial EEG
Herff, C., Verwoert, M., Amigó-Vega, J., & Ottenhoff, M. C. (2023) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/smc53992.2023.10394550 · Cited by 3
Self-citationSentence Reconstruction Leveraging Contextual Meaning from Speech-Related Brain Signals
Lee, J., Lee, S., Lee, Y.-E., Kim, S.-W., & Lee, S. (2023) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/smc53992.2023.10394348 · Cited by 3
Enhanced Generative Adversarial Networks for Unseen Word Generation from EEG Signals
Lee, Y.-E., Lee, S., Kim, S.-W., Lee, J., & Kim, D.-S. (2024) · International Winter Conference on Brain-Computer Interface (BCI) · doi:10.1109/bci60775.2024.10480505 · Cited by 5
A protocol for trustworthy EEG decoding with neural networks
Borra, D., Magosso, E., & Ravanelli, M. (2024) · Neural Networks · doi:10.1016/j.neunet.2024.106847 · Cited by 5
Decoding speech intent from non-frontal cortical areas
Prakash, P. R., Lei, T., Flint, R. D., Hsieh, J. K., Fitzgerald, Z., Mugler, E. M., Templer, J. W., Goldrick, M., Tate, M. C., Rosenow, J. M., et al. (2025) · Journal of Neural Engineering · doi:10.1088/1741-2552/adaa20 · Cited by 6
Self-citationVoice Restoration with Silent Speech Interfaces (ReSSInt)
Hernáez, I., González, J. A., Navas, E., Pérez-Córdoba, J. L., Saratxaga, I., Olivares, G., de la Fuente, J. S., Galdón, A., Romillo, V. G., González-Atienza, M., et al. (2021) · IberSPEECH · doi:10.21437/iberspeech.2021-28 · Cited by 3
Self-citationZhang, R., & Huang, H. (2022) · Mathematical Problems in Engineering · doi:10.1155/2022/3378599 · Cited by 3
Distributed Feedforward and Feedback Processing across Perisylvian Cortex Supports Human SpeechPreprint
Wang, R., Chen, X., Khalilian-Gourtani, A., Yu, L., Dugan, P. C., Friedman, D. J., Doyle, W., Devinsky, O., Wang, Y., & Flinker, A. (2021) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2021.12.06.471521 · Cited by 3
Jude, J. J., Haro, S., Levi-Aharoni, H., Hashimoto, H., Acosta, A. J., Card, N. S., Wairagkar, M., Brandman, D. M., Stavisky, S. D., Williams, Z. M., et al. (2025) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2025.08.12.668516 · Cited by 3
Robust Imagined Speech Production from Electrocorticography with Adaptive Frequency Enhancement
Xu, X., Fu, C., Chen, J., Jeon, G., & Camacho, D. (2024) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn60899.2024.10651465 · Cited by 2
Kwon, J., Lee, G., Park, Y. J., Lee, E., & Chung, C. K. (2025) · Scientific Reports · doi:10.1038/s41598-025-18537-2 · Cited by 4
Li, R., Yu, Z., Hu, H., Tang, Z., & Liu, Y. (2025) · ACS Applied Polymer Materials · doi:10.1021/acsapm.5c02828 · Cited by 2
Generative AI for brain-computer interfaces decoding: Advances, challenges and future
Guo, Y., Ren, G., Ma, S., Zhou, J., Al-Nashash, H. A., Jolfaei, A., Zhang, Z., Li, G., Li, Y., Hu, Y., et al. (2026) · The Innovation Medicine · doi:10.59717/j.xinn-med.2026.100193 · Cited by 3
Speech Synthesis from Brain Signals Based on Generative Model
Lee, Y.-E., Kim, S., Lee, S., Lee, J., Kim, S.-W., & Lee, S. (2023) · International Winter Conference on Brain-Computer Interface (BCI) · doi:10.1109/bci57258.2023.10078574 · Cited by 3
The Easy and Versatile Neural Recording Platform (T-REX): Design and Development Study
Amigó-Vega, J., Ottenhoff, M. C., Verwoert, M., Kubben, P., & Herff, C. (2023) · JMIR Neurotechnology · doi:10.2196/47881 · Cited by 3
Self-citationDistinct neural processes link speech planning and execution
Duraivel, S., Rahimpour, S., Barth, K. J., Chiang, C., Wang, C., Harward, S. C., Lad, S. P., Sexton, D., Friedman, A. H., Sinha, S. R., et al. (2026) · Nature Human Behaviour · doi:10.1038/s41562-026-02546-w · Cited by 3
VowelNet: Enhancing Communication with Wearable EEG-Based Vowel Imagery
Ingolfsson, T. M., Kartsch, V., Cossettini, A., Wang, X., & Luca Benini, C. (2024) · IEEE Biomedical Circuits and Systems Conference (BioCAS) · doi:10.1109/biocas61083.2024.10798267 · Cited by 2
A Tone-Assisted Chinese Silent Speech Input Method for Virtual Reality
Zhang, X., Shan, X., Zhou, Y., Chen, Z., Tan, P., Xing, Y., Bin, L., Pan, Z., & Feng, G. (2025) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2025.2537784 · Cited by 2
Towards Speech Synthesis from Intracranial Signals
Herff, C., Diener, L., Mugler, E. M., Slutzky, M. W., Krusienski, D. J., & Schultz, T. (2020) · Springer briefs in electrical and computer engineering · doi:10.1007/978-3-030-49583-1_5 · Cited by 2
Self-citationVStyclone: Real-time Chinese voice style clone
Wu, Y., Zhao, H., Liang, X., & Sun, Y. (2022) · Computers & Electrical Engineering · doi:10.1016/j.compeleceng.2022.108534 · Cited by 3
BrainTalker: Low-Resource Brain-to-Speech Synthesis with Transfer Learning using Wav2Vec 2.0
Kim, M., Piao, Z., Lee, J., & Kang, H.-G. (2023) · IEEE-EMBS International Conference on Biomedical and Health Informatics (BHI ...) · doi:10.1109/bhi58575.2023.10313388 · Cited by 4
Improving EEG based continuous speech recognition using GANPreprint
Krishna, G., Tran, C., Carnahan, M., & Tewfik, A. H. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.01260 · Cited by 3
Wu, S., Bhadra, K., Giraud, A., & Marchesotti, S. (2023) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2023.12.12.571206 · Cited by 2
3M-CPSEED, An EEG-based Dataset for Chinese Pinyin Production in Overt, Mouthed, and Imagined Speech
Ma, X., Jiang, Y., & Jiang, N. (2025) · Scientific Data · doi:10.1038/s41597-025-06346-1 · Cited by 4
Semantic Categorization of Naming Responses Based on Prearticulatory Electrical Brain Activity
Wilmskoetter, J., Roth, R., McDowell, K. P., Munsell, B. C., Fontenot, S., Andrews, K., Chang, A. J., Johnson, L. P., Sangtian, S., Behroozmand, R., et al. (2022) · Journal of Clinical Neurophysiology · doi:10.1097/wnp.0000000000000933 · Cited by 1
Hong, W. (2024) · Advanced Materials Technologies · doi:10.1002/admt.202400059 · Cited by 1
A Vision Transformer Architecture For Overt Speech Decoding From ECoG Data
Ticha, M. B. B., Ran, X., Roussel, P., Bocquelet, F., Godais, G. L., Aubert, M., Costecalde, T., Struber, L., Zhang, S., Charvet, G., et al. (2024) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc53108.2024.10781877 · Cited by 2
Representation of Articulatory Features in EEG During Speech Production Tasks
Sun, S., Zhang, L., Wang, B., Wu, X. H., & Chen, J. (2024) · International Symposium on Chinese Spoken Language Processing (ISCSLP) · doi:10.1109/iscslp63861.2024.10800095 · Cited by 1
New Applications of Neurotechnologies for Neurological Disorders
Orsborn, A. L., Pirondini, E., Capogrosso, M., Gaunt, R. A., & Stavisky, S. D. (2025) · Springer eBooks · doi:10.1007/978-3-031-89307-0_25 · Cited by 1
Kovacs, J., Krusienski, D. J., Maninder, M., & Wriggers, W. R. (2025) · Neuroscience Informatics · doi:10.1016/j.neuri.2025.100232 · Cited by 2
Self-citationLearning discrete neural latent spaces for high-performance speech decoding
Jia, Y., Lian, Q., Wang, L., Wang, Y., & Qi, Y. (2025) · Journal of Neural Engineering · doi:10.1088/1741-2552/ae2ccd · Cited by 1
Artificial intelligence for brain-to-speech decoding in paralysis: a systematic review
Belfrouh, S., Salmam, F. Z., Errattahi, R., Hanine, M., Obidallah, W. J., & Alhulayyil, H. A. (2026) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-026-03552-8 · Cited by 3
Cogan, G. B. (2020) · Nature Neuroscience · doi:10.1038/s41593-020-0616-8 · Cited by 1
Practical, Conceptual and Ethical Dimensions of a Neuro-controlled Speech Neuroprosthesis
Rainey, S. (2021) · Advances in neuroethics · doi:10.1007/978-3-030-64590-8_13 · Cited by 1
Reconstruction of speech spectrogram based on non-invasive EEG signal
Zhou, D., Unoki, M., Zhang, G., & Dang, J. (2022) · International Symposium on Chinese Spoken Language Processing (ISCSLP) · doi:10.1109/iscslp57327.2022.10038234 · Cited by 1
Permana, S. D. H., & Rahman, T. K. A. (2023) · International Conference on Modeling & E-Information Research, Artificial Learning and Digital Applications (ICMERALDA) · doi:10.1109/icmeralda60125.2023.10458162 · Cited by 1
Fifty Years of Second Language Acquisition Research: Critical Commentary and Proposal
Alsaedi, N. (2024) · PSYCHOLINGUISTICS · doi:10.31470/2309-1797-2024-35-1-24-57 · Cited by 2
Peterson, V., Vissani, M., Luo, S., Rabbani, Q., Crone, N. E., Bush, A., & Richardson, R. M. (2024) · Imaging Neuroscience · doi:10.1162/imag_a_00301 · Cited by 2
Yang, J. (2022) · Journal of Control Science and Engineering · doi:10.1155/2022/1971679 · Cited by 1
RetractedKrishna, G., Tran, C., Carnahan, M., & Tewfik, A. H. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.01262 · Cited by 2
Local Field Potentials in a Pre-motor Region Predict Learned Vocal SequencesPreprint
Brown, D. E., Chavez, J. I., Nguyen, D. H., Kadwory, A., Voytek, B., Arneodo, E. M., Gentner, T. Q., & Gilja, V. (2020) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2020.06.30.179861 · Cited by 1
T-Rex: sTandalone Recorder of EXperiments; An easy and versatile neural recording platformPreprint
Amigó-Vega, J., Ottenhoff, M. C., Verwoert, M., Kubben, P., & Herff, C. (2022) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2022.10.26.513822 · Cited by 1
Self-citationParvez, L., Keshavarzi, M., Richards, S., Liberto, G. M. D., & Goswami, U. (2024) · doi:10.31234/osf.io/52r6h · Cited by 1
Komeiji, S., Shigemi, K., Mitsuhashi, T., Iimura, Y., Suzuki, H., Sugano, H., Shinoda, K., Yatabe, K., & Tanaka, T. (2024) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2024.08.21.608927 · Cited by 1
Decoding Speech from Dorsal Motor Cortex
Stavisky, S. D. (2021) · Springer briefs in electrical and computer engineering · doi:10.1007/978-3-030-60460-8_10
Voice Reconstruction from Silent Speech with a Sequence-to-Sequence ModelPreprint
Li, H., Lin, H., Wang, Y., Wang, H., Gao, H., Ai, Q., & Li, G. (2021) · arXiv (Cornell University)
A Method To Map EEG Signals To Spoken Speech Using Gaussian Process Modeling
Wu, H., Pan, C., Li, M., & Chen, F. (2021) · European Signal Processing Conference (EUSIPCO) · doi:10.23919/eusipco54536.2021.9615959
Speech Production in Intracranial Electroencephalography: iBIDS DatasetPreprint
Verwoert, M., Ottenhoff, M. C., Goulis, S., Colon, A., Wagner, L., Tousseyn, S., van Dijk, J. P., Kubben, P., & Herff, C. (2022) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2022.04.05.487183
Self-citationYurianta, A., Ihsan, A. S., Jati, A. I., Rahma, O. N., & Pramulen, A. S. (2022) · Indonesian Applied Physics Letters · doi:10.20473/iapl.v3i1.40257
Literature Review of Deep Learning for Physiological signal AnalysisPreprint
Ortiz, N., Beleño, R. D. H., Pérez, M. A., & Suárez, P. A. N. (2023) · doi:10.22541/au.170121283.33310565/v1
Metadata
- Authors
- Angrick, M., Herff, C., Mugler, E., Tate, M. C., Slutzky, M. W., Krusienski, D. J., & Schultz, T.
- Affiliations
- University of Bremen (DE)
- Northwestern University (US)
- Virginia Commonwealth University (US)
- Corresponding author
- Angrick, Miguel
- Herff, Christian
- ORCID
- Venue
- Journal of Neural Engineering
- Publisher
- IOP Publishing
- Published
- 2019-04-16
- Volume
- 16
- Issue
- 3
- Pages
- 036019
- ISSN
- 1741-2552 (ISSN-L)
- 1741-2560
- PMC
- PMC6822609
- OpenAlex
- W2952609044
- Cited by
- 225
- References
- 76
- Citations by year
- 2026: 18 · 2025: 36 · 2024: 35 · 2023: 28 · 2022: 34 · 2021: 30 · 2020: 29 · 2019: 15
- FWCI
- 12.32
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Licence
- Locations
- Journal of Neural Engineering (publishedVersion)
- bioRxiv (Cold Spring Harbor Laboratory) (acceptedVersion)
- PubMed (publishedVersion)
- PubMed Central (acceptedVersion)
- Research Publications (Maastricht University) (submittedVersion, other-oa)
- Funders
- National Science Foundation (1608140)
- National Institutes of Health (F32DC015708)
- National Center for Advancing Translational Sciences (UL1TR000150)
- Bundesministerium für Bildung und Forschung (01GQ1602)
- Doris Duke Charitable Foundation (2011039)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
- Physical Sciences › Computer Science › Signal Processing › Speech and Audio Processing
- Life Sciences › Neuroscience › Cognitive Neuroscience › EEG and Brain-Computer Interfaces
- Keywords
- speech synthesis, electrocorticography, neural speech decoding, 3D convolutional neural networks, speech production, brain-computer interface, augmentative and alternative communication
- MeSH terms
- Electrocorticography, Cerebral Cortex, Communication Aids for Disabled, Communication Devices for People with Disabilities, Humans, Photic Stimulation, Speech, Neural Networks, Computer
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
