The DOI matches its Crossref record; 72 of the 72 references it cites were found in a registry or an index.
Brain–computer interfaces for speech communication
Open accessAbstract
This paper briefly reviews current silent speech methodologies for normal and disabled individuals. Current techniques utilizing electromyographic (EMG) recordings of vocal tract movements are useful for physically healthy individuals but fail for tetraplegic individuals who do not have accurate voluntary control over the speech articulators. Alternative methods utilizing EMG from other body parts (e.g., hand, arm, or facial muscles) or electroencephalography (EEG) can provide capable silent communication to severely paralyzed users, though current interfaces are extremely slow relative to normal conversation rates and require constant attention to a computer screen that provides visual feedback and/or cueing. We present a novel approach to the problem of silent speech via an intracortical microelectrode brain computer interface (BCI) to predict intended speech information directly from the activity of neurons involved in speech production. The predicted speech is synthesized and acoustically fed back to the user with a delay under 50 ms. We demonstrate that the Neurotrophic Electrode used in the BCI is capable of providing useful neural recordings for over 4 years, a necessary property for BCIs that need to remain viable over the lifespan of the user. Other design considerations include neural decoding techniques based on previous research involving BCIs for computer cursor or robotic arm control via prediction of intended movement kinematics from motor cortical signals in monkeys and humans. Initial results from a study of continuous speech production with instantaneous acoustic feedback show the BCI user was able to improve his control over an artificial speech synthesizer both within and across recording sessions. The success of this initial trial validates the potential of the intracortical microelectrode-based approach for providing a speech prosthesis that can allow much more rapid communication rates.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A New Approach to Linear Filtering and Prediction Problems
Kalman, R. E. (1960) · Journal of Basic Engineering · doi:10.1115/1.3662552 · Cited by 31,751
GELB, A. (1974) · CERN Document Server (European Organization for Nuclear Research) · Cited by 6,405
Hämäläinen, M., Hari, R., Ilmoniemi, R. J., Knuutila, J., & Lounasmaa, O. V. (1993) · Reviews of Modern Physics · doi:10.1103/revmodphys.65.413 · Cited by 4,684
Neuronal ensemble control of prosthetic devices by a human with tetraplegia
Hochberg, L. R., Serruya, M. D., Friehs, G. M., Mukand, J. A., Saleh, M., Caplan, A. H., Branner, A., Chen, D., Penn, R. D., & Donoghue, J. P. (2006) · Nature · doi:10.1038/nature04970 · Cited by 3,295
(1960) · Medical Journal of Australia · doi:10.5694/j.1326-5377.1960.tb76238.x · Cited by 2,178
Georgopoulos, A., Kalaska, J., Caminiti, R., & Massey, J. (1982) · The Journal of Neuroscience · doi:10.1523/jneurosci.02-11-01527.1982 · Cited by 2,130
Mountcastle, V. B., Lynch, J. C., Georgopoulos, A., Sakata, H., & Acuna, C. (1975) · Journal of Neurophysiology · doi:10.1152/jn.1975.38.4.871 · Cited by 2,061 · cited 2×
“The electrode is then driven slowly into the cortex in very small increments (5–15 nm per step) using a microdrive, leading to the discovery of new neurons at different cortical depths (Mountcastle et al., 1975).”
MethodLearning to control a brain–machine interface for reaching and grasping by primates
Carmena, J. M., Lebedev, M. A., Crist, R. E., O'Doherty, J. E., Santucci, D. M., Dimitrov, D. F., Patil, P. G., Henriquez, C. S., & Nicolelis, M. A. L. (2003) · PLoS Biology · doi:10.1371/journal.pbio.0000042 · Cited by 1,761
Mitzdorf, U. (1985) · Physiological Reviews · doi:10.1152/physrev.1985.65.1.37 · Cited by 1,673
Cortical control of a prosthetic arm for self-feeding
Velliste, M., Perel, S., Spalding, M. C., Whitford, A. S., & Schwartz, A. B. (2008) · Nature · doi:10.1038/nature06996 · Cited by 1,591
A spelling device for the paralysed
Birbaumer, N., Ghanayim, N., Hinterberger, T., Iversen, I., Kotchoubey, B., Kübler, A., Perelmouter, J., Taub, E., & Flor, H. (1999) · Nature · doi:10.1038/18581 · Cited by 1,577
Direct Cortical Control of 3D Neuroprosthetic Devices
Taylor, D. M., Tillery, S. I. H., & Schwartz, A. B. (2002) · Science · doi:10.1126/science.1070291 · Cited by 1,540
Control of a two-dimensional movement signal by a noninvasive brain-computer interface in humans
Wolpaw, J. R., & McFarland, D. J. (2004) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0403504101 · Cited by 1,512
Real-time prediction of hand trajectory by ensembles of cortical neurons in primates
Wessberg, J., Stambaugh, C. R., Kralik, J. D., Beck, P. D., Laubach, M., Chapin, J. K., Kim, J., Biggs, S. J., Srinivasan, M. A., & Nicolelis, M. A. L. (2000) · Nature · doi:10.1038/35042582 · Cited by 1,487
The mental prosthesis: assessing the speed of a P300-based brain-computer interface
Donchin, E., Spencer, K. M., & Wijesinghe, R. (2000) · IEEE Transactions on Rehabilitation Engineering · doi:10.1109/86.847808 · Cited by 1,222
A brain–computer interface using electrocorticographic signals in humans
Leuthardt, E. C., Schalk, G., Wolpaw, J. R., Ojemann, J. G., & Moran, D. W. (2004) · Journal of Neural Engineering · doi:10.1088/1741-2560/1/2/001 · Cited by 1,188
Truccolo, W., Eden, U. T., Fellows, M. R., Donoghue, J. P., & Brown, E. N. (2005) · Journal of Neurophysiology · doi:10.1152/jn.00697.2004 · Cited by 1,049
Neural modeling and imaging of the cortical interactions underlying syllable production
Guenther, F. H., Ghosh, S. S., & Tourville, J. A. (2006) · Brain and Language · doi:10.1016/j.bandl.2005.06.001 · Cited by 879
Self-citationDesign and implementation of a brain-computer interface with high transfer rates
Cheng, M., Gao, X., Gao, S., & Xu, D. (2002) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2002.803536 · Cited by 818
A comparison of classification techniques for the P300 Speller
Krusienski, D. J., Sellers, E. W., Cabestaing, F., Bayoudh, S., McFarland, D. J., Vaughan, T. M., & Wolpaw, J. R. (2006) · Journal of Neural Engineering · doi:10.1088/1741-2560/3/4/007 · Cited by 762
Toward enhanced p300 speller performance
Krusienski, D. J., Sellers, E. W., McFarland, D. J., Vaughan, T. M., & Wolpaw, J. R. (2008) · Journal of Neuroscience Methods · doi:10.1016/j.jneumeth.2007.07.017 · Cited by 749 · cited 1×
“…cortical potentials (SCP; Birbaumer et al., 1999, 2000, 2003; Hinterberger et al., 2003; Kü bler et al., 1999), P300 signal (Donchin et al., 2000; Krusienski et al., 2006, 2008; Sellers et al., 2006; Vaughan et al., 2006), sensorimotor rhythms (SMR; Vaughan et al., 2006; Wolpaw et al., 2000;…”
BackgroundChronic, multisite, multielectrode recordings in macaque monkeys
Nicolelis, M. A. L., Dimitrov, D., Carmena, J. M., Crist, R., Lehew, G., Kralik, J. D., & Wise, S. P. (2003) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1934665100 · Cited by 740
Wireless Implantable Microsystems: High-Density Electronic Interfaces to the Nervous System
Wise, K. D., Anderson, D. J., Hetke, J. F., Kipke, D. R., & Najafi, K. (2004) · Proceedings of the IEEE · doi:10.1109/jproc.2003.820544 · Cited by 656
Chronic recording capability of the Utah Intracortical Electrode Array in cat sensory cortex
Rousche, P. J., & Normann, R. A. (1998) · Journal of Neuroscience Methods · doi:10.1016/s0165-0270(98)00031-4 · Cited by 646
Maynard, E. M., Nordhausen, C. T., & Normann, R. A. (1997) · Electroencephalography and Clinical Neurophysiology · doi:10.1016/s0013-4694(96)95176-0 · Cited by 640
Direct control of a computer from the human central nervous system
Kennedy, P. R., Bakay, R. A. E., Moore, M. M., Adams, K., & Goldwaithe, J. (2000) · IEEE Transactions on Rehabilitation Engineering · doi:10.1109/86.847815 · Cited by 573
Self-citationAn Integrated-Circuit Approach to Extracellular Microelectrodes
Wise, K. D., Angell, J. B., & Starr, A. (1970) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.1970.4502738 · Cited by 544
Decoding two-dimensional movement trajectories using electrocorticographic signals in humans
Schalk, G., Kubánek, J., Miller, K. J., Anderson, N. R., Leuthardt, E. C., Ojemann, J. G., Limbrick, D., Moran, D., Gerhardt, L. A., & Wolpaw, J. R. (2007) · Journal of Neural Engineering · doi:10.1088/1741-2560/4/3/012 · Cited by 527
Sellers, E. W., Krusienski, D. J., McFarland, D. J., Vaughan, T. M., & Wolpaw, J. R. (2006) · Biological Psychology · doi:10.1016/j.biopsycho.2006.04.007 · Cited by 501
The thought translation device (TTD) for completely paralyzed patients
Birbaumer, N., Kubler, A., Ghanayim, N., Hinterberger, T., Perelmouter, J., Kaiser, J., Iversen, I., Kotchoubey, B., Neumann, N., & Flor, H. (2000) · IEEE Transactions on Rehabilitation Engineering · doi:10.1109/86.847812 · Cited by 493
Two-dimensional movement control using electrocorticographic signals in humans
Schalk, G., Miller, K. J., Anderson, N. R., Wilson, J. A., Smyth, M. D., Ojemann, J. G., Moran, D. W., Wolpaw, J. R., & Leuthardt, E. C. (2008) · Journal of Neural Engineering · doi:10.1088/1741-2560/5/1/008 · Cited by 482
Restoration of neural output from a paralyzed patient by a direct brain connection
Kennedy, P. R., & Bakay, R. A. E. (1998) · NeuroReport · doi:10.1097/00001756-199806010-00007 · Cited by 475
Self-citationBrain-computer interface research at the Wadsworth Center
Wolpaw, J. R., McFarland, D. J., & Vaughan, T. M. (2000) · IEEE Transactions on Rehabilitation Engineering · doi:10.1109/86.847823 · Cited by 440
Suner, S., Fellows, M. R., Vargas-Irwin, C., Nakata, G. K., & Donoghue, J. P. (2005) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2005.857687 · Cited by 415
Williams, J. C., Rennaker, R. L., & Kipke, D. R. (1999) · Brain Research Protocols · doi:10.1016/s1385-299x(99)00034-3 · Cited by 395
A three-dimensional microelectrode array for chronic neural recording
Hoogerwerf, A. C., & Wise, K. D. (1994) · IEEE Transactions on Biomedical Engineering · doi:10.1109/10.335862 · Cited by 371
Kipke, D. R., Vetter, R. J., Williams, J. C., & Hetke, J. F. (2003) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2003.814443 · Cited by 367
A glass/silicon composite intracortical electrode array
Jones, K. E., Campbell, P. K., & Normann, R. A. (1992) · Annals of Biomedical Engineering · doi:10.1007/bf02368134 · Cited by 354
Guenther, F. H. (1995) · Psychological Review · doi:10.1037/0033-295x.102.3.594 · Cited by 335
Self-citationThe wadsworth BCI research and development program: at home with BCI
Vaughan, T. M., McFarland, D. J., Schalk, G., Sarnacki, W. A., Krusienski, D. J., Sellers, E. W., & Wolpaw, J. R. (2006) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2006.875577 · Cited by 334
Towards an independent brain–computer interface using steady state visual evoked potentials
Allison, B. Z., McFarland, D. J., Schalk, G., Zheng, S. D., Jackson, M. M., & Wolpaw, J. R. (2008) · Clinical Neurophysiology · doi:10.1016/j.clinph.2007.09.121 · Cited by 327
A Wireless Brain-Machine Interface for Real-Time Speech Synthesis
Guenther, F. H., Brumberg, J. S., Wright, E. J., Nieto-Castanon, A., Tourville, J. A., Panko, M., Law, R., Siebert, S. A., Bartels, J. L., Andreasen, D. S., et al. (2009) · PLoS ONE · doi:10.1371/journal.pone.0008218 · Cited by 306
Self-citationKübler, A., Kotchoubey, B., Hinterberger, T., Ghanayim, N., Perelmouter, J., Schauer, M., Fritsch, C., Taub, E., & Birbaumer, N. (1999) · Experimental Brain Research · doi:10.1007/s002210050617 · Cited by 297
Computational neuroscience: a comprehensive approach
(2004) · Choice Reviews Online · doi:10.5860/choice.41-5284 · Cited by 279
Single-trial classification of vowel speech imagery using common spatial patterns
DaSalla, C. S., Kambara, H., Sato, M., & Koike, Y. (2009) · Neural Networks · doi:10.1016/j.neunet.2009.05.008 · Cited by 274
Primary Motor Cortex Tuning to Intended Movement Kinematics in Humans with Tetraplegia
Truccolo, W., Friehs, G. M., Donoghue, J. P., & Hochberg, L. R. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.4415-07.2008 · Cited by 272
Trejo, L. J., Rosipal, R., & Matthews, B. (2006) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2006.875578 · Cited by 267
A neural network model of speech acquisition and motor equivalent speech production
Guenther, F. H. (1994) · Biological Cybernetics · doi:10.1007/bf00206237 · Cited by 263
Self-citationDonoghue, J. P., Nurmikko, A., Black, M., & Hochberg, L. R. (2007) · The Journal of Physiology · doi:10.1113/jphysiol.2006.127209 · Cited by 197
The thought-translation device (TTD): neurobehavioral mechanisms and clinical outcome
Birbaumer, N., Hinterberger, T., Kubler, A., & Neumann, N. (2003) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2003.814439 · Cited by 196
Hinterberger, T., Kübler, A., Kaiser, J., Neumann, N., & Birbaumer, N. (2003) · Clinical Neurophysiology · doi:10.1016/s1388-2457(02)00411-x · Cited by 164
Brain wave recognition of words
Suppes, P., Lu, Z., & Han, B. (1997) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.94.26.14965 · Cited by 161
Kennedy, P. R. (1989) · Journal of Neuroscience Methods · doi:10.1016/0165-0270(89)90142-8 · Cited by 151
Self-citationDevelopment of a (silent) speech recognition system for patients following laryngectomy
Fagan, M. J., Ell, S. R., Gilbert, J. M., Sarrazin, E., & Chapman, P. (2007) · Medical Engineering & Physics · doi:10.1016/j.medengphy.2007.05.003 · Cited by 145
Towards continuous speech recognition using surface electromyography
Jou, S.-C. S., Schultz, T., Walliczek, M., Kraft, F., & Waibel, A. (2006) · Interspeech (USB) · doi:10.21437/interspeech.2006-212 · Cited by 143
Session independent non-audible speech recognition using surface electromyography
Maier‐Hein, L., Metze, F., Schultz, T., & Waibel, A. (2005) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru.2005.1566521 · Cited by 137
Computer control using human intracortical local field potentials
Kennedy, P. R., Kirby, M. T., Moore, M. M., King, B., & Mallory, A. (2004) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2004.834629 · Cited by 134
Self-citationLong-term chronic recording from cortical neurons
Schmidt, E. M., Bak, M. J., & McIntosh, J. S. (1976) · Experimental Neurology · doi:10.1016/0014-4886(76)90220-x · Cited by 127
Neurotrophic electrode: Method of assembly and implantation into human motor speech cortex
Bartels, J., Andreasen, D., Ehirim, P., Mao, H., Seibert, S., Wright, E. J., & Kennedy, P. (2008) · Journal of Neuroscience Methods · doi:10.1016/j.jneumeth.2008.06.030 · Cited by 108
Self-citationEEG-BASED SPEECH RECOGNITION - Impact of Temporal Effects
Porbadnigk, A. K., Wester, M., Calliess, J.-P., & Schultz, T. (2009) · International Conference on Bio-inspired Systems and Signal Processing · doi:10.5220/0001554303760381 · Cited by 108
Likelihood Methods for Neural Spike Train Data Analysis
Brown, E. N., Barbieri, R., Eden, U. T., & Frank, L. M. (2003) · Chapman & Hall/CRC mathematical and computational biology series · doi:10.1201/9780203494462.ch9 · Cited by 100
Sub auditory speech recognition based on EMG signals
Jorgensen, C. C., Lee, D. D., & Agabon, S. (2004) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2003.1224072 · Cited by 98
MacKay, D. G. (1968) · The Journal of the Acoustical Society of America · doi:10.1121/1.1910900 · Cited by 94
The cone electrode: Ultrastructural studies following long-term recording in rat and monkey cortex
Kennedy, P. R., Mirra, S. S., & Bakay, R. A. E. (1992) · Neuroscience Letters · doi:10.1016/0304-3940(92)90627-j · Cited by 81
Self-citationBehavioral correlates of action potentials recorded chronically inside the Cone Electrode
Kennedy, P. R., Bakay, R. A. E., & Sharpe, S. M. (1992) · Neuroreport · doi:10.1097/00001756-199207000-00015 · Cited by 50
Self-citationSmall-vocabulary speech recognition using surface electromyography
Betts, B. J., Binsted, K. A., & Jorgensen, C. C. (2006) · Interacting with Computers · doi:10.1016/j.intcom.2006.08.012 · Cited by 45
Kim, S.-P., Simeral, J. D., Hochberg, L. R., Donoghue, J. P., Friehs, G. M., & Black, M. J. (2007) · International IEEE/EMBS Conference on Neural Engineering · doi:10.1109/cne.2007.369715 · Cited by 37
Small Vocabulary Recognition Using Surface Electromyography in an Acoustically Harsh Environment
Betts, B. J., & Jorgensen, C. C. (2005) · Cited by 32
Sub-word unit based non-audible speech recognition using surface electromyography
Walliczek, M., Kraft, F., Jou, S.-C. S., et al. (2006) · Interspeech (USB) · doi:10.21437/interspeech.2006-425 · Cited by 25
TOWARDS SPEAKER-ADAPTIVE SPEECH RECOGNITION BASED ON SURFACE ELECTROMYOGRAPHY
Wand, M., & Schultz, T. (2009) · International Conference on Bio-inspired Systems and Signal Processing · doi:10.5220/0001549601550162 · Cited by 20
Artificial speech synthesizer control by brain-computer interface
Brumberg, J. S., Kennedy, P. R., & Guenther, F. H. (2009) · Interspeech (USB) · doi:10.21437/interspeech.2009-225 · Cited by 20
Self-citationKennedy, P. (2007) · CRC Press eBooks · doi:10.1201/9780849381850.ch14 · Cited by 7
Self-citation
Cited by
Brain-Machine Interfaces: From Basic Science to Neuroprostheses and Neurorehabilitation
Lebedev, M. A., & Nicolelis, M. A. L. (2017) · Physiological Reviews · doi:10.1152/physrev.00027.2016 · Cited by 653
Brain computer interfacing: Applications and challenges
Abdulkader, S. N., Atia, A., & Mostafa, M.-S. M. (2015) · Egyptian Informatics Journal · doi:10.1016/j.eij.2015.06.002 · Cited by 533
Simeral, J. D., Kim, S.-P., Black, M. J., Donoghue, J. P., & Hochberg, L. R. (2011) · Journal of Neural Engineering · doi:10.1088/1741-2560/8/2/025027 · Cited by 496
Denby, B., Schultz, T., Honda, K., Hueber, T., Gilbert, J. M., & Brumberg, J. S. (2010) · Speech Communication · doi:10.1016/j.specom.2009.08.002 · Cited by 487
Self-citationHong, K.-S., & Khan, M. J. (2017) · Frontiers in Neurorobotics · doi:10.3389/fnbot.2017.00035 · Cited by 267
Metadata
- Authors
- Brumberg, J. S., Nieto-Castanon, A., Kennedy, P. R., & Guenther, F. H.
- Venue
- Speech Communication
- Publisher
- Elsevier BV
- Published
- 2010-04
- Volume
- 52
- Issue
- 4
- Pages
- 367-379
- ISSN
- 0167-6393 (ISSN-L)
- OpenAlex
- W2076676508
- Cited by
- 267
- References
- 72
- FWCI
- 6.15
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.