A High-Performance Neural Prosthesis Incorporating Discrete State Selection With Hidden Markov Models
The DOI matches its Crossref record; 12 of the 12 references it cites were found in a registry or an index.
Abstract
Communication neural prostheses aim to restore efficient communication to people with motor neurological injury or disease by decoding neural activity into control signals. These control signals are both analog (e.g., the velocity of a computer mouse) and discrete (e.g., clicking an icon with a computer mouse) in nature. Effective, high-performing, and intuitive-to-use communication prostheses should be capable of decoding both analog and discrete state variables seamlessly. However, to date, the highest-performing autonomous communication prostheses rely on precise analog decoding and typically do not incorporate high-performance discrete decoding. In this report, we incorporated a hidden Markov model (HMM) into an intracortical communication prosthesis to enable accurate and fast discrete state decoding in parallel with analog decoding. In closed-loop experiments with nonhuman primates implanted with multielectrode arrays, we demonstrate that incorporating an HMM into a neural prosthesis can increase state-of-the-art achieved bitrate by 13.9% and 4.2% in two monkeys ( ). We found that the transition model of the HMM is critical to achieving this performance increase. Further, we found that using an HMM resulted in the highest achieved peak performance we have ever observed for these monkeys, achieving peak bitrates of 6.5, 5.7, and 4.7 bps in Monkeys J, R, and L, respectively. Finally, we found that this neural prosthesis was robustly controllable for the duration of entire experimental sessions. These results demonstrate that high-performance discrete decoding can be beneficially combined with analog decoding to achieve new state-of-the-art levels of performance.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Reach and grasp by people with tetraplegia using a neurally controlled robotic arm
Hochberg, L. R., Bacher, D., Jarosiewicz, B., Masse, N. Y., Simeral, J. D., Vogel, J., Haddadin, S., Liu, J., Cash, S. S., van der Smagt, P., et al. (2012) · Nature · doi:10.1038/nature11076 · Cited by 2,719 · cited 2×
“Thus, a quick and accurate discrete state decoder must 1) integrate neural activity for only tens of milliseconds as opposed to hundreds of milliseconds (as in [6] and [18]); and 2) be robust in the presence of substantial noise, not making frequent spurious transitions between discrete states.”
BackgroundHigh-performance neuroprosthetic control by an individual with tetraplegia
Collinger, J. L., Wodlinger, B., Downey, J. E., Wang, W., Tyler-Kabara, E. C., Weber, D. J., McMorland, A. J., Velliste, M., Boninger, M. L., & Schwartz, A. B. (2013) · The Lancet · doi:10.1016/s0140-6736(12)61816-9 · Cited by 1,848
Learning to control a brain–machine interface for reaching and grasping by primates
Carmena, J. M., Lebedev, M. A., Crist, R. E., O'Doherty, J. E., Santucci, D. M., Dimitrov, D. F., Patil, P. G., Henriquez, C. S., & Nicolelis, M. A. L. (2003) · PLoS Biology · doi:10.1371/journal.pbio.0000042 · Cited by 1,761
Cortical control of a prosthetic arm for self-feeding
Velliste, M., Perel, S., Spalding, M. C., Whitford, A. S., & Schwartz, A. B. (2008) · Nature · doi:10.1038/nature06996 · Cited by 1,591
Dimensionality reduction for large-scale neural recordings
Cunningham, J. P., & Yu, B. M. (2014) · Nature Neuroscience · doi:10.1038/nn.3776 · Cited by 1,219 · cited 1×
“To avoid the " curse of dimensionality " [21], we reduced the dimensionality of the neural activity with PCA, especially as the dimensionality of motor cortex during simple reaching tasks is on the order of 10–20 (e.g., [47], [48]).”
MethodCortical activity in the null space: permitting preparation without movement
Kaufman, M. T., Churchland, M. M., Ryu, S. I., & Shenoy, K. V. (2014) · Nature Neuroscience · doi:10.1038/nn.3643 · Cited by 831
Self-citationA high-performance brain–computer interface
Santhanam, G., Ryu, S. I., Yu, B. M., Afshar, A., & Shenoy, K. V. (2006) · Nature · doi:10.1038/nature04968 · Cited by 698
Self-citationCognitive Control Signals for Neural Prosthetics
Musallam, S., Corneil, B. D., Greger, B., Scherberger, H., & Andersen, R. A. (2004) · Science · doi:10.1126/science.1097938 · Cited by 663 · cited 1×
“This is in contrast to discrete decoders such as na¨ıve Bayes classifiers (e.g., [9], [10], [24], [25]), LDAs (e.g., [19], [26]–[28]), and support vector machines (e.g., [29], [30]), which do not incorporate a transition model and may therefore more often switch between states due to observation…”
Wodlinger, B., Downey, J. E., Tyler-Kabara, E. C., Schwartz, A. B., Boninger, M. L., & Collinger, J. L. (2015) · Journal of Neural Engineering · doi:10.1088/1741-2560/12/1/016011 · Cited by 536
Clinical translation of a high-performance neural prosthesis
Gilja, V., Pandarinath, C., Blabe, C. H., Nuyujukian, P., Simeral, J. D., Sarma, A. A., Sorice, B. L., Perge, J. A., Jarosiewicz, B., Hochberg, L. R., et al. (2015) · Nature Medicine · doi:10.1038/nm.3953 · Cited by 343 · cited 3×
“A recent study reported that using such discrete decoders resulted in selection rates that were over 2× longer than simply holding the target for 500 ms with a continuous decoder [20].”
BackgroundMethodResultInfluentialSelf-citation
Cited by
Pandarinath, C., Nuyujukian, P., Blabe, C. H., Sorice, B. L., Saab, J., Willett, F. R., Hochberg, L. R., Shenoy, K. V., & Henderson, J. M. (2017) · eLife · doi:10.7554/elife.18554 · Cited by 566
“In summary, we demonstrated a BCI that achieved high performance communication in both free typing and copy typing, leveraging system design and algorithmic innovations demonstrated in prior pre-clinical and clinical studies ( Gilja et al., 2012 , 2015 ; Kao et al., 2016 ).”
MethodSelf-citationMachine Learning for Neural Decoding
Glaser, J. I., Benjamin, A. S., Chowdhury, R. H., Perich, M. G., Miller, L. E., & Kording, K. P. (2020) · eneuro · doi:10.1523/eneuro.0506-19.2020 · Cited by 319
Accurate Estimation of Neural Population Dynamics without Spike Sorting
Trautmann, E. M., Stavisky, S. D., Lahiri, S., Ames, K. C., Kaufman, M. T., O’Shea, D. J., Vyas, S., Sun, X., Ryu, S. I., Ganguli, S., et al. (2019) · Neuron · doi:10.1016/j.neuron.2019.05.003 · Cited by 255
Self-citationCortical control of a tablet computer by people with paralysis
Nuyujukian, P., Albites Sanabria, J., Saab, J., Pandarinath, C., Jarosiewicz, B., Blabe, C. H., Franco, B., Mernoff, S. T., Eskandar, E. N., Simeral, J. D., et al. (2018) · PLOS ONE · doi:10.1371/journal.pone.0204566 · Cited by 170
“recent advances in neural decoders [24, 32, 33].”
MethodSelf-citationPlug-and-play control of a brain–computer interface through neural map stabilization
Silversmith, D. B., Abiri, R., Hardy, N. F., Natraj, N., Tu-Chan, A., Chang, E. F., & Ganguly, K. (2021) · Nature Biotechnology · doi:10.1038/s41587-020-0662-5 · Cited by 126
Nason, S. R., Vaskov, A. K., Willsey, M. S., Welle, E. J., An, H., Vu, P. P., Bullard, A. J., Nu, C. S., Kao, J. C., Shenoy, K. V., et al. (2020) · Nature Biomedical Engineering · doi:10.1038/s41551-020-0591-0 · Cited by 113
Self-citationPower-saving design opportunities for wireless intracortical brain–computer interfaces
Even-Chen, N., Muratore, D. G., Stavisky, S. D., Hochberg, L. R., Henderson, J. M., Murmann, B., & Shenoy, K. V. (2020) · Nature Biomedical Engineering · doi:10.1038/s41551-020-0595-9 · Cited by 118
“1f) to decode the user’s intention 8,11,12,25,52–59 .”
Self-citationWalker, R. M., Rieth, L., Iyer, S. S., Bajwa, A. A., Silver, J., Ahmed, T., Tasneem, N., Sharma, M., & Gardner, A. T. (2017) · 2017 IEEE 60th International Midwest Symposium on Circuits and Systems (MWSCAS) · doi:10.1109/mwscas.2017.8053106 · Cited by 7
“In contrast, passive intracortical microelectrode arrays have remained functional in non-human primate subjects for up to six years [18], albeit with a maximum of ~100 channels.”
BackgroundVarshney, S., Farias, D., Brandman, D. M., Stavisky, S. D., & Miller, L. M. (2023) · 2023 11th International IEEE/EMBS Conference on Neural Engineering (NER) · doi:10.1109/ner52421.2023.10123751 · Cited by 6
Metadata
- Authors
- Kao, J. C., Nuyujukian, P., Ryu, S. I., & Shenoy, K. V.
- Venue
- IEEE Transactions on Biomedical Engineering
- Published
- 2017-04
- Volume
- 64
- Issue
- 4
- Pages
- 935-945
- ISSN
- 0018-9294 (ISSN-L)
- 1558-2531
- OpenAlex
- W2462780241
- Cited by
- 78
- References
- 12
- FWCI
- 4.40
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.