Adversarial Domain Adaptation for Stable Brain-Machine Interfaces
Open accessAbstract
Brain-Machine Interfaces (BMIs) have recently emerged as a clinically viable option to restore voluntary movements after paralysis. These devices are based on the ability to extract information about movement intent from neural signals recorded using multi-electrode arrays chronically implanted in the motor cortices of the brain. However, the inherent loss and turnover of recorded neurons requires repeated recalibrations of the interface, which can potentially alter the day-to-day user experience. The resulting need for continued user adaptation interferes with the natural, subconscious use of the BMI. Here, we introduce a new computational approach that decodes movement intent from a low-dimensional latent representation of the neural data. We implement various domain adaptation methods to stabilize the interface over significantly long times. This includes Canonical Correlation Analysis used to align the latent variables across days; this method requires prior point-to-point correspondence of the time series across domains. Alternatively, we match the empirical probability distributions of the latent variables across days through the minimization of their Kullback-Leibler divergence. These two methods provide a significant and comparable improvement in the performance of the interface. However, implementation of an Adversarial Domain Adaptation Network trained to match the empirical probability distribution of the residuals of the reconstructed neural signals outperforms the two methods based on latent variables, while requiring remarkably few data points to solve the domain adaptation problem.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
These results indicate that substantial gains in performance are probably still possible with further language model improvements and more robust decoding algorithms that generalize better to non-stationary data.
“These results indicate that substantial gains in performance are probably still possible with further language model improvements and more robust decoding algorithms that generalize better to non-stationary data (for example, unsupervised methods that track non-stationarities without the requirement for new training data24–27).”
From A high-performance speech neuroprosthesis (2023) · cites this paper as [25]
The Methods (p. 5) describe an unsupervised approach to aligning neural recordings across days, supporting the example of a method that addresses non-stationarity. But the Results (p. 7) say domain adaptation with ADAN requires a small new training set—prediction accuracy saturates at about one minute of data—so this source does not support the claim that no new training data is required. It does not address language-model improvements. (LLM, conf=0.88)
Experimental — accuracy not yet measuredUnsupervised algorithms for updating decoders to neural changes should be feasible.
“Furthermore, we found that neural activity changed at a gradual rate over time, suggesting that unsupervised algorithms for updating decoders to neural changes should be feasible24–27 (Fig. 4d).”
From A high-performance speech neuroprosthesis (2023) · cites this paper as [25]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318 · see citing works
(2008) · Journal of Machine Learning Research · Cited by 33,051 · see citing works
GAN(Generative Adversarial Nets)
淳司, 柴. (2017) · Journal of Japan Society for Fuzzy Theory and Intelligent Informatics · doi:10.3156/jsoft.29.5_177_2 · Cited by 19,268 · see citing works
(2017) · International Conference on Machine Learning · Cited by 6,382 · see citing works
Neuronal ensemble control of prosthetic devices by a human with tetraplegia
Hochberg, L. R., Serruya, M. D., Friehs, G. M., Mukand, J. A., Saleh, M., Caplan, A. H., Branner, A., Chen, D., Penn, R. D., & Donoghue, J. P. (2006) · Nature · doi:10.1038/nature04970 · Cited by 3,295 · see citing works
Targeting Recovery: Priorities of the Spinal Cord-Injured Population
Anderson, K. D. (2004) · Journal of Neurotrauma · doi:10.1089/neu.2004.21.1371 · Cited by 2,094 · see citing works
High-performance neuroprosthetic control by an individual with tetraplegia
Collinger, J. L., Wodlinger, B., Downey, J. E., Wang, W., Tyler-Kabara, E. C., Weber, D. J., McMorland, A. J., Velliste, M., Boninger, M. L., & Schwartz, A. B. (2013) · The Lancet · doi:10.1016/s0140-6736(12)61816-9 · Cited by 1,848 · see citing works
BEGAN: Boundary Equilibrium Generative Adversarial NetworksPreprint
Berthelot, D., Schumm, T., & Metz, L. (2017) · arXiv.org · doi:10.48550/arxiv.1703.10717 · Cited by 1,217 · see citing works
Restoring cortical control of functional movement in a human with quadriplegia
Bouton, C. E., Shaikhouni, A., Annetta, N. V., Bockbrader, M. A., Friedenberg, D. A., Nielson, D. M., Sharma, G., Sederberg, P. B., Glenn, B. C., Mysiw, W. J., et al. (2016) · Nature · doi:10.1038/nature17435 · Cited by 924 · see citing works
Energy-based Generative Adversarial Network
Zhao, J., Mathieu, M., & LeCun, Y. (2016) · arXiv · doi:10.48550/arxiv.1609.03126 · Cited by 912 · cited 3× · see citing works
“3 ADVERSARIAL DOMAIN ADAPTATION NETWORK (ADAN) In addition to matching the probability distributions of latent variables of day-k to those of day-0, we seek an alternative approach: to match the probability distributions of the residuals of the reconstructed firing rates (Zhao et al., 2016), as a proxy for matching th…”
MethodInfluentialAjiboye, A. B., Willett, F. R., Young, D. R., Memberg, W. D., Murphy, B. A., Miller, J. P., Walter, B. L., Sweet, J. A., Hoyen, H. A., Keith, M. W., et al. (2017) · The Lancet · doi:10.1016/s0140-6736(17)30601-3 · Cited by 862 · see citing works
Cortical Control of Arm Movements: A Dynamical Systems Perspective
Shenoy, K. V., Sahani, M., & Churchland, M. M. (2013) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-062111-150509 · Cited by 835 · see citing works
Neural constraints on learning
Sadtler, P. T., Quick, K. M., Golub, M. D., Chase, S. M., Ryu, S. I., Tyler-Kabara, E. C., Yu, B. M., & Batista, A. P. (2014) · Nature · doi:10.1038/nature13665 · Cited by 713 · see citing works
Neural Manifolds for the Control of Movement
Gallego, J. Á., Perich, M. G., Miller, L. E., & Solla, S. A. (2017) · Neuron · doi:10.1016/j.neuron.2017.05.025 · Cited by 676 · see citing works
Self-citationInferring single-trial neural population dynamics using sequential auto-encoders
Pandarinath, C., O’Shea, D. J., Collins, J., Józefowicz, R., Stavisky, S. D., Kao, J. C., Trautmann, E. M., Kaufman, M. T., Ryu, S. I., Hochberg, L. R., et al. (2018) · Nature Methods · doi:10.1038/s41592-018-0109-9 · Cited by 672 · see citing works
Yu, B. M., Cunningham, J. P., Santhanam, G., Ryu, S. I., Shenoy, K. V., & Sahani, M. (2009) · Journal of Neurophysiology · doi:10.1152/jn.90941.2008 · Cited by 659 · see citing works
Failure mode analysis of silicon-based intracortical microelectrode arrays in non-human primates
Barrese, J. C., Rao, N., Paroo, K., Triebwasser, C., Vargas-Irwin, C., Franquemont, L., & Donoghue, J. P. (2013) · Journal of Neural Engineering · doi:10.1088/1741-2560/10/6/066014 · Cited by 600 · see citing works
A neural network that finds a naturalistic solution for the production of muscle activity
Sussillo, D., Churchland, M. M., Kaufman, M. T., & Shenoy, K. V. (2015) · Nature Neuroscience · doi:10.1038/nn.4042 · Cited by 598 · see citing works
(2000) · Applied Physics Letters · doi:10.1162/153244303768966085 · Cited by 583 · see citing works
Restoration of grasp following paralysis through brain-controlled stimulation of muscles
Ethier, C., Oby, E. R., Bauman, M. J., & Miller, L. E. (2012) · Nature · doi:10.1038/nature10987 · Cited by 485 · see citing works
Self-citationJarosiewicz, B., Sarma, A. A., Bacher, D., Masse, N. Y., Simeral, J. D., Sorice, B., Oakley, E. M., Blabe, C., Pandarinath, C., Gilja, V., et al. (2015) · Science Translational Medicine · doi:10.1126/scitranslmed.aac7328 · Cited by 340 · see citing works
Motor Cortex Embeds Muscle-like Commands in an Untangled Population Response
Russo, A. A., Bittner, S. R., Perkins, S. M., Seely, J., London, B. M., Lara, A. H., Miri, A., Marshall, N. J., Kohn, A., Jessell, T. M., et al. (2018) · Neuron · doi:10.1016/j.neuron.2018.01.004 · Cited by 299 · see citing works
Single-Unit Stability Using Chronically Implanted Multielectrode Arrays
Dickey, A. S., Suminski, A., Amit, Y., & Hatsopoulos, N. G. (2009) · Journal of Neurophysiology · doi:10.1152/jn.90920.2008 · Cited by 234 · see citing works
Orsborn, A. L., Dangi, S., Moorman, H. G., & Carmena, J. M. (2012) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2012.2185066 · Cited by 169 · see citing works
Improving Generative Adversarial Networks with Denoising Feature Matching
Warde-Farley, D., & Bengio, Y. (2017) · International Conference on Learning Representations · Cited by 157 · see citing works
Self-citationIntracortical recording stability in human brain–computer interface users
Downey, J. E., Schwed, N., Chase, S. M., Schwartz, A. B., & Collinger, J. L. (2018) · Journal of Neural Engineering · doi:10.1088/1741-2552/aab7a0 · Cited by 149 · see citing works
Assessment of brain–machine interfaces from the perspective of people with paralysis
Blabe, C. H., Gilja, V., Chestek, C. A., Shenoy, K. V., Anderson, K. D., & Henderson, J. M. (2015) · Journal of Neural Engineering · doi:10.1088/1741-2560/12/4/043002 · Cited by 121 · see citing works
Design and analysis of closed-loop decoder adaptation algorithms for brain-machine interfaces
Dangi, S., Orsborn, A. L., Moorman, H. G., & Carmena, J. M. (2013) · Neural Computation · doi:10.1162/neco_a_00460 · Cited by 103 · see citing works
A cryptography-based approach for movement decoding
Dyer, E. L., Gheshlaghi Azar, M., Perich, M. G., Fernandes, H. L., Naufel, S., Miller, L. E., & Körding, K. P. (2017) · Nature Biomedical Engineering · doi:10.1038/s41551-017-0169-7 · Cited by 70 · see citing works
Self-citationPerformance sustaining intracortical neural prostheses
Nuyujukian, P., Kao, J. C., Fan, J. M., Stavisky, S. D., Ryu, S. I., & Shenoy, K. V. (2014) · Journal of Neural Engineering · doi:10.1088/1741-2560/11/6/066003 · Cited by 66 · see citing works
Oby, E. R., Éthier, C., & Miller, L. E. (2012) · Journal of Neurophysiology · doi:10.1152/jn.00331.2012 · Cited by 54 · see citing works
Self-citationLeveraging neural dynamics to extend functional lifetime of brain-machine interfaces
Kao, J. C., Ryu, S. I., & Shenoy, K. V. (2017) · Scientific Reports · doi:10.1038/s41598-017-06029-x · Cited by 41 · see citing works
Flagged first, then by citations
Research works printed but not linked: 6
- Francis R Bach and Michael I Jordan. Kernel independent component analysis. Journal of Machine Learning Research , 3(Jul):1-48, 2002.
- William Bishop, Cynthia C Chestek, Vikash Gilja, Paul Nuyujukian, Justin D Foster, Stephen I Ryu, Krishna V Shenoy, and M Yu Byron. Self-recalibrating classifiers for intracortical braincomputer interfaces. Journal of Neural Engineering , 11(2):026001, 2014. ISSN 1741-2552.
- Ian Goodfellow, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron Courville, and Yoshua Bengio. Generative adversarial nets. In Advances in Neural Information Processing Systems , pp. 2672-2680, 2014.
- Diederik P Kingma and Max Welling. Auto-encoding variational bayes. arXiv:1312.6114 , 2013. · arXiv
- Dawn M Taylor, Stephen I Helms Tillery, and Andrew B Schwartz. Direct cortical control of 3d neuroprosthetic devices. Science , 296(5574):1829-1832, 2002. ISSN 0036-8075.
- Yin Zhang and Steve M Chase. A stabilized dual kalman filter for adaptive tracking of braincomputer interface decoding parameters. In Engineering in Medicine and Biology Society (EMBC), 2013 35th Annual International Conference of the IEEE , pp. 7100-7103. IEEE, 2013.
Cited by
Sorted by citations
A high-performance speech neuroprosthesis
Willett, F. R., Kunz, E. M., Fan, C., Avansino, D. T., Wilson, G. H., Choi, E. Y., Kamdar, F., Glasser, M. F., Hochberg, L. R., Druckmann, S., et al. (2023) · Nature · doi:10.1038/s41586-023-06377-x · Cited by 581 · see citing works
Stabilizing brain-computer interfaces through alignment of latent dynamics
Karpowicz, B. M., Ali, Y. H., Wimalasena, L. N., Sedler, A. R., Keshtkaran, M. R., Bodkin, K., Ma, X., Miller, L. E., & Pandarinath, C. (2022) · doi:10.1101/2022.04.06.487388 · Cited by 71 · see citing works
Self-citation
- Authors
- Farshchian, A., Gallego, J. A., Cohen, J. P., Bengio, Y., Miller, L. E., & Solla, S. A.
- Affiliations
- Université de Montréal (CA)
- Northwestern University (US)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2018
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1810.00045
- OpenAlex
- W2892541114
- Cited by
- 48
- References
- 32
- Citations by year
- 2025: 7 · 2024: 7 · 2023: 6 · 2022: 7 · 2021: 10 · 2020: 10 · 2018: 1
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- National Institute of Neurological Disorders and Stroke
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › EEG and Brain-Computer Interfaces
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neuroscience and Neural Engineering
- Keywords
- brain-computer interface, domain adaptation, adversarial domain adaptation, neural decoding, latent representations, canonical correlation analysis, Kullback-Leibler divergence, motor cortex, chronic neural recording
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review