Making brain–machine interfaces robust to future neural variability
Open accessThe DOI matches its Crossref record; 18 of the 18 references it cites were found in a registry or an index.
Abstract
A major hurdle to clinical translation of brain–machine interfaces (BMIs) is that current decoders, which are trained from a small quantity of recent data, become ineffective when neural recording conditions subsequently change. We tested whether a decoder could be made more robust to future neural variability by training it to handle a variety of recording conditions sampled from months of previously collected data as well as synthetic training data perturbations. We developed a new multiplicative recurrent neural network BMI decoder that successfully learned a large variety of neural-to-kinematic mappings and became more robust with larger training data sets. Here we demonstrate that when tested with a non-human primate preclinical BMI model, this decoder is robust under conditions that disabled a state-of-the-art Kalman filter-based decoder. These results validate a new BMI strategy in which accumulated data history are effectively harnessed, and may facilitate reliable BMI use by reducing decoder retraining downtime.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Improving neural networks by preventing co-adaptation of feature detectors
Hinton, G. E., Srivastava, N., Krizhevsky, A., Sutskever, I., & Salakhutdinov, R. R. (2012) · arXiv · doi:10.48550/arxiv.1207.0580 · Cited by 6,382
Reach and grasp by people with tetraplegia using a neurally controlled robotic arm
Hochberg, L. R., Bacher, D., Jarosiewicz, B., Masse, N. Y., Simeral, J. D., Vogel, J., Haddadin, S., Liu, J., Cash, S. S., van der Smagt, P., et al. (2012) · Nature · doi:10.1038/nature11076 · Cited by 2,719
High-performance neuroprosthetic control by an individual with tetraplegia
Collinger, J. L., Wodlinger, B., Downey, J. E., Wang, W., Tyler-Kabara, E. C., Weber, D. J., McMorland, A. J., Velliste, M., Boninger, M. L., & Schwartz, A. B. (2013) · The Lancet · doi:10.1016/s0140-6736(12)61816-9 · Cited by 1,848
Decoding motor imagery from the posterior parietal cortex of a tetraplegic human
Aflalo, T., Kellis, S., Klaes, C., Lee, B., Shi, Y., Pejsa, K., Shanfield, K., Hayes-Jackson, S., Aisen, M., Heck, C., et al. (2015) · Science · doi:10.1126/science.aaa5417 · Cited by 649
Failure mode analysis of silicon-based intracortical microelectrode arrays in non-human primates
Barrese, J. C., Rao, N., Paroo, K., Triebwasser, C., Vargas-Irwin, C., Franquemont, L., & Donoghue, J. P. (2013) · Journal of Neural Engineering · doi:10.1088/1741-2560/10/6/066014 · Cited by 600
Emergence of a stable cortical map for neuroprosthetic control
Ganguly, K., & Carmena, J. M. (2009) · PLoS Biology · doi:10.1371/journal.pbio.1000153 · Cited by 578
Wireless Recording in the Peripheral Nervous System with Ultrasonic Neural Dust
Seo, D., Neely, R. M., Shen, K., Singhal, U., Alon, E., Rabaey, J. M., Carmena, J. M., & Maharbiz, M. M. (2016) · Neuron · doi:10.1016/j.neuron.2016.06.034 · Cited by 557
Wodlinger, B., Downey, J. E., Tyler-Kabara, E. C., Schwartz, A. B., Boninger, M. L., & Collinger, J. L. (2015) · Journal of Neural Engineering · doi:10.1088/1741-2560/12/1/016011 · Cited by 536
Simeral, J. D., Kim, S.-P., Black, M. J., Donoghue, J. P., & Hochberg, L. R. (2011) · Journal of Neural Engineering · doi:10.1088/1741-2560/8/2/025027 · Cited by 496
Cited by
EmotionMeter: A Multimodal Framework for Recognizing Human Emotions
Zheng, W.-L., Liu, W., Lu, Y., Lu, B.-L., & Cichocki, A. (2019) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2018.2797176 · Cited by 1,276
High-performance brain-to-text communication via handwriting
Willett, F. R., Avansino, D. T., Hochberg, L. R., Henderson, J. M., & Shenoy, K. V. (2021) · Nature · doi:10.1038/s41586-021-03506-2 · Cited by 1,024
“Finally, we envision that a combination of algorithmic innovations 42–44 and improvements to device stability will continue to reduce the need for daily decoder retraining.”
BackgroundSelf-citationInferring single-trial neural population dynamics using sequential auto-encoders
Pandarinath, C., O’Shea, D. J., Collins, J., Jozefowicz, R., Stavisky, S. D., Kao, J. C., Trautmann, E. M., Kaufman, M. T., Ryu, S. I., Hochberg, L. R., et al. (2018) · Nature Methods · doi:10.1038/s41592-018-0109-9 · Cited by 686
Self-citationA high-performance speech neuroprosthesis
Willett, F. R., Kunz, E. M., Fan, C., Avansino, D. T., Wilson, G. H., Choi, E. Y., Kamdar, F., Glasser, M. F., Hochberg, L. R., Druckmann, S., et al. (2023) · Nature · doi:10.1038/s41586-023-06377-x · Cited by 581
Self-citationBenabid, A. L., Costecalde, T., Eliseyev, A., Charvet, G., Verney, A., Karakas, S., Foerster, M., Lambert, A., Morinière, B., Abroug, N., et al. (2019) · The Lancet Neurology · doi:10.1016/s1474-4422(19)30321-7 · Cited by 404
Long-term stability of cortical population dynamics underlying consistent behavior
Gallego, J. A., Perich, M. G., Chowdhury, R. H., Solla, S. A., & Miller, L. E. (2020) · Nature Neuroscience · doi:10.1038/s41593-019-0555-4 · Cited by 405
Machine Learning for Neural Decoding
Glaser, J. I., Benjamin, A. S., Chowdhury, R. H., Perich, M. G., Miller, L. E., & Kording, K. P. (2020) · eneuro · doi:10.1523/eneuro.0506-19.2020 · Cited by 319
Summary of over Fifty Years with Brain-Computer Interfaces—A Review
Kawala-Sterniuk, A., Browarska, N., Al-Bakri, A., Pelc, M., Zygarlicki, J., Sidikova, M., Martinek, R., & Gorzelanczyk, E. J. (2021) · Brain Sciences · doi:10.3390/brainsci11010043 · Cited by 292
EEG-based brain–computer interfaces
McFarland, D. J., & Wolpaw, J. R. (2017) · Current Opinion in Biomedical Engineering · doi:10.1016/j.cobme.2017.11.004 · Cited by 283
An Accurate and Rapidly Calibrating Speech Neuroprosthesis
Card, N. S., Wairagkar, M., Iacobacci, C., Hou, X., Singer-Clark, T., Willett, F. R., Kunz, E. M., Fan, C., Vahdati Nia, M., Deo, D. R., et al. (2024) · New England Journal of Medicine · doi:10.1056/nejmoa2314132 · Cited by 268
Self-citationDegenhart, A. D., Bishop, W. E., Oby, E. R., Tyler-Kabara, E. C., Chase, S. M., Batista, A. P., & Yu, B. M. (2020) · Nature Biomedical Engineering · doi:10.1038/s41551-020-0542-9 · Cited by 212
Latent Factors and Dynamics in Motor Cortex and Their Application to Brain–Machine Interfaces
Pandarinath, C., Ames, K. C., Russo, A. A., Farshchian, A., Miller, L. E., Dyer, E. L., & Kao, J. C. (2018) · The Journal of Neuroscience · doi:10.1523/jneurosci.1669-18.2018 · Cited by 103
“Known as latent factor analysis via dynamical systems (LFADS; Sussillo et al., 2016a; Pandarinath et al., 2018), the approach trains an RNN as a generative model of the observed spiking activity.”
BackgroundSelf-citationPower-saving design opportunities for wireless intracortical brain–computer interfaces
Even-Chen, N., Muratore, D. G., Stavisky, S. D., Hochberg, L. R., Henderson, J. M., Murmann, B., & Shenoy, K. V. (2020) · Nature Biomedical Engineering · doi:10.1038/s41551-020-0595-9 · Cited by 118
“This allows the user to compensate for errors 60,69,94 .”
BackgroundSelf-citationDecoding spoken English from intracortical electrode arrays in dorsal precentral gyrus
Wilson, G. H., Stavisky, S. D., Willett, F. R., Avansino, D. T., Kelemen, J. N., Hochberg, L. R., Henderson, J. M., Druckmann, S., & Shenoy, K. V. (2020) · Journal of Neural Engineering · doi:10.1088/1741-2552/abbfef · Cited by 103
Self-citationLuo, S., Angrick, M., Coogan, C., Candrea, D. N., Wyse‐Sookoo, K., Shah, S., Rabbani, Q., Milsap, G. W., Weiss, A. R., Anderson, W. S., et al. (2023) · Advanced Science · doi:10.1002/advs.202304853 · Cited by 90
Robust and accurate decoding of hand kinematics from entire spiking activity using deep learning
Ahmadi, N., Constandinou, T. G., & Bouganis, C.-S. (2021) · Journal of Neural Engineering · doi:10.1088/1741-2552/abde8a · Cited by 69
Moly, A., Costecalde, T., Martel, F., Martin, M., Larzabal, C., Karakas, S., Verney, A., Charvet, G., Chabardes, S., Benabid, A. L., et al. (2022) · Journal of Neural Engineering · doi:10.1088/1741-2552/ac59a0 · Cited by 65
“They suffer from a decrease of signal-to-noise ratio over time [4, 5], a high across-day variation in the neural signals [6, 7] and still require wired recording systems despite recent efforts in this domain.”
BackgroundStabilizing brain-computer interfaces through alignment of latent dynamics
Karpowicz, B. M., Ali, Y. H., Wimalasena, L. N., Sedler, A. R., Keshtkaran, M. R., Bodkin, K., Ma, X., Miller, L. E., & Pandarinath, C. (2022) · doi:10.1101/2022.04.06.487388 · Cited by 71
Speech-related dorsal motor cortex activity does not interfere with iBCI cursor control
Stavisky, S. D., Willett, F. R., Avansino, D. T., Hochberg, L. R., Shenoy, K. V., & Henderson, J. M. (2020) · Journal of Neural Engineering · doi:10.1088/1741-2552/ab5b72 · Cited by 25
Self-citationFan, C., Hahn, N., Kamdar, F., Avansino, D., Wilson, G. H., Hochberg, L., Shenoy, K. V., Henderson, J. M., & Willett, F. R. (2023) · arXiv · doi:10.48550/arxiv.2311.03611 · Cited by 19
Self-citationAn accurate and rapidly calibrating speech neuroprosthesis
Card, N. S., Wairagkar, M., Iacobacci, C., Hou, X., Singer-Clark, T., Willett, F. R., Kunz, E. M., Fan, C., Vahdati Nia, M., Deo, D. R., et al. (2023) · doi:10.1101/2023.12.26.23300110 · Cited by 244
“Here, adopting the recent recognition that recent days' neural data can be used to calibrate an effective neural decoder for a new day 31,32 , we demonstrated that a speech decoder could similarly be used to provide >95% accuracy at the start of each session.”
MethodSelf-citationWillett, F. R., Murphy, B. A., Memberg, W. D., Blabe, C. H., Pandarinath, C., Walter, B. L., Sweet, J. A., Miller, J. P., Henderson, J. M., Shenoy, K. V., et al. (2017) · Journal of Neural Engineering · doi:10.1088/1741-2552/aa5990 · Cited by 16
“More generic non-linear decoders could automatically extract information about stopping or about movement scale in general, if it exists (Li et al 2009, Sussillo et al 2012, Sussillo et al 2016).”
BackgroundSelf-citation
Metadata
- Authors
- Sussillo, D., Stavisky, S. D., Kao, J. C., Ryu, S. I., & Shenoy, K. V.
- Venue
- Nature Communications
- Published
- 2016-12-13
- Volume
- 7
- Issue
- 1
- Pages
- 13749-13749
- ISSN
- 2041-1723 (ISSN-L)
- OpenAlex
- W2538079766
- Cited by
- 213
- References
- 18
- FWCI
- 9.01
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.