Real-time control of a prosthetic hand using human electrocorticography signals: Technical note
The DOI matches its Crossref record; 32 of the 33 references it cites were found in a registry or an index.
Abstract
Object: A brain-machine interface (BMI) offers patients with severe motor disabilities greater independence by controlling external devices such as prosthetic arms. Among the available signal sources for the BMI, electrocorticography (ECoG) provides a clinically feasible signal with long-term stability and low clinical risk. Although ECoG signals have been used to infer arm movements, no study has examined its use to control a prosthetic arm in real time. The authors present an integrated BMI system for the control of a prosthetic hand using ECoG signals in a patient who had suffered a stroke. This system used the power modulations of the ECoG signal that are characteristic during movements of the patient's hand and enabled control of the prosthetic hand with movements that mimicked the patient's hand movements. Methods: A poststroke patient with subdural electrodes placed over his sensorimotor cortex performed 3 types of simple hand movements following a sound cue (calibration period). Time-frequency analysis was performed with the ECoG signals to select 3 frequency bands (1–8, 25–40, and 80–150 Hz) that revealed characteristic power modulation during the movements. Using these selected features, 2 classifiers (decoders) were trained to predict the movement state—that is, whether the patient was moving his hand or not—and the movement type based on a linear support vector machine. The decoding accuracy was compared among the 3 frequency bands to identify the most informative features. With the trained decoders, novel ECoG signals were decoded online while the patient performed the same task without cues (free-run period). According to the results of the real-time decoding, the prosthetic hand mimicked the patient's hand movements. Results: Offline cross-validation analysis of the ECoG data measured during the calibration period revealed that the state and movement type of the patient's hand were predicted with an accuracy of 79.6% (chance 50%) and 68.3% (chance 33.3%), respectively. Using the trained decoders, the onset of the hand movement was detected within 0.37 ± 0.29 seconds of the actual movement. At the detected onset timing, the type of movement was inferred with an accuracy of 69.2%. In the free-run period, the patient's hand movements were faithfully mimicked by the prosthetic hand in real time. Conclusions: The present integrated BMI system successfully decoded the hand movements of a poststroke patient and controlled a prosthetic hand in real time. This success paves the way for the restoration of the patient's motor function using a prosthetic arm controlled by a BMI using ECoG signals.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Subcutaneous invasive electrophysiological signals can be derived through brain interfaces,[270–272] using electrocorticography (ECoG)[273,274] on the cortical surface as well as local field potentials (LFP)[275,276] extracted from electrodes inserted into the cortex.”
From Flexible Electronics and Devices as Human–Machine Interfaces for Medical Robotics (2022) · cites this paper as [274]
In the citing paper
“Currently, all reported BMI experiments with human patients [26, 35, 57, 58, 150] require the subjects tethered percutaneously to a bench-top computer for neural signal acquisition and decoding.”
From Implantable neurotechnologies: a review of integrated circuit neural amplifiers (2016) · cites this paper as [150]
Citations
Cites
Wu, Y. (1999) · Technometrics · doi:10.1080/00401706.1999.10485951 · Cited by 27,221
Delorme, A., & Makeig, S. (2004) · Journal of Neuroscience Methods · doi:10.1016/j.jneumeth.2003.10.009 · Cited by 24,371
Brain–computer interfaces for communication and control
Wolpaw, J. R., Birbaumer, N., McFarland, D. J., Pfurtscheller, G., & Vaughan, T. M. (2002) · Clinical Neurophysiology · doi:10.1016/s1388-2457(02)00057-3 · Cited by 7,927
Neuronal ensemble control of prosthetic devices by a human with tetraplegia
Hochberg, L. R., Serruya, M. D., Friehs, G. M., Mukand, J. A., Saleh, M., Caplan, A. H., Branner, A., Chen, D., Penn, R. D., & Donoghue, J. P. (2006) · Nature · doi:10.1038/nature04970 · Cited by 3,295
Neuronal Population Coding of Movement Direction
Georgopoulos, A. P., Schwartz, A. B., & Kettner, R. E. (1986) · Science · doi:10.1126/science.3749885 · Cited by 3,161
Decoding the visual and subjective contents of the human brain
Kamitani, Y., & Tong, F. (2005) · Nature Neuroscience · doi:10.1038/nn1444 · Cited by 1,829
Self-citationCortical control of a prosthetic arm for self-feeding
Velliste, M., Perel, S., Spalding, M. C., Whitford, A. S., & Schwartz, A. B. (2008) · Nature · doi:10.1038/nature06996 · Cited by 1,591
Control of a two-dimensional movement signal by a noninvasive brain-computer interface in humans
Wolpaw, J. R., & McFarland, D. J. (2004) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0403504101 · Cited by 1,512
Real-time prediction of hand trajectory by ensembles of cortical neurons in primates
Wessberg, J., Stambaugh, C. R., Kralik, J. D., Beck, P. D., Laubach, M., Chapin, J. K., Kim, J., Biggs, S. J., Srinivasan, M. A., & Nicolelis, M. A. L. (2000) · Nature · doi:10.1038/35042582 · Cited by 1,487
A brain–computer interface using electrocorticographic signals in humans
Leuthardt, E. C., Schalk, G., Wolpaw, J. R., Ojemann, J. G., & Moran, D. W. (2004) · Journal of Neural Engineering · doi:10.1088/1741-2560/1/2/001 · Cited by 1,188
Heuristics of instability and stabilization in model selection
Breiman, L. (1996) · The Annals of Statistics · doi:10.1214/aos/1032181158 · Cited by 1,146
No Unbiased Estimator of the Variance of K-Fold Cross-ValidationPreprint
Bengio, Y., & Grandvalet, Y. (2003) · RePEc: Research Papers in Economics · Cited by 883
Extracting information from neuronal populations: information theory and decoding approaches
Quian Quiroga, R., & Panzeri, S. (2009) · Nature Reviews Neuroscience · doi:10.1038/nrn2578 · Cited by 811
Ray, S., Crone, N. E., Niebur, E., Franaszczuk, P. J., & Hsiao, S. S. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.2848-08.2008 · Cited by 722
Two-dimensional movement control using electrocorticographic signals in humans
Schalk, G., Miller, K. J., Anderson, N. R., Wilson, J. A., Smyth, M. D., Ojemann, J. G., Moran, D. W., Wolpaw, J. R., & Leuthardt, E. C. (2008) · Journal of Neural Engineering · doi:10.1088/1741-2560/5/1/008 · Cited by 482
Inference of hand movements from local field potentials in monkey motor cortex
Mehring, C., Rickert, J., Vaadia, E., de Oliveira, S. C., Aertsen, A., & Rotter, S. (2003) · Nature Neuroscience · doi:10.1038/nn1158 · Cited by 435
Hand Movement Direction Decoded from MEG and EEG
Waldert, S., Preissl, H., Demandt, E., Braun, C., Birbaumer, N., Aertsen, A., & Mehring, C. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.5171-07.2008 · Cited by 415
Miller, K. J., Zanos, S., Fetz, E. E., den Nijs, M., & Ojemann, J. G. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.5506-08.2009 · Cited by 350
Long-term asynchronous decoding of arm motion using electrocorticographic signals in monkey
Chao (2010) · Frontiers in Neuroengineering · doi:10.3389/fneng.2010.00003 · Cited by 341
Selecting the signals for a brain–machine interface
Andersen, R. A., Musallam, S., & Pesaran, B. (2004) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2004.10.005 · Cited by 332
Prediction of arm movement trajectories from ECoG-recordings in humans
Pistohl, T., Ball, T., Schulze-Bonhage, A., Aertsen, A., & Mehring, C. (2008) · Journal of Neuroscience Methods · doi:10.1016/j.jneumeth.2007.10.001 · Cited by 331
Primary Motor Cortex Tuning to Intended Movement Kinematics in Humans with Tetraplegia
Truccolo, W., Friehs, G. M., Donoghue, J. P., & Hochberg, L. R. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.4415-07.2008 · Cited by 272
Shain, W., Spataro, L., Dilgen, J., Haverstick, K., Retterer, S., Isaacson, M., Saltzman, M., & Turner, J. N. (2003) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2003.814800 · Cited by 227
Multidigit Movement Synergies of the Human Hand in an Unconstrained Haptic Exploration Task
Thakur, P. H., Bastian, A. J., & Hsiao, S. S. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.4512-07.2008 · Cited by 190
The Emerging World Of Motor Neuroprosthetics: a Neurosurgical Perspective
Leuthardt, E. C., Schalk, G., Moran, D., & Ojemann, J. G. (2006) · Neurosurgery · doi:10.1227/01.neu.0000221506.06947.ac · Cited by 128
Hosomi, K., Saitoh, Y., Kishima, H., Oshino, S., Hirata, M., Tani, N., Shimokawa, T., & Yoshimine, T. (2008) · Clinical Neurophysiology · doi:10.1016/j.clinph.2007.12.022 · Cited by 106
Self-citationNeural decoding using gyral and intrasulcal electrocorticograms
Yanagisawa, T., Hirata, M., Saitoh, Y., Kato, A., Shibuya, D., Kamitani, Y., & Yoshimine, T. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2008.12.069 · Cited by 102
Self-citationChapter 63 Development of neuromotor prostheses for humans
Donoghue, J. P., Nurmikko, A. V., Friehs, G. M., & Black, M. J. (2004) · Supplements to Clinical neurophysiology · doi:10.1016/s1567-424x(09)70399-x · Cited by 64
Mutual adaptation among man and machine by using f-MRI analysis
Kato, R., Yokoi, H., Arieta, A. H., Yu, W., & Arai, T. (2008) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2008.07.005 · Cited by 30
Self-citationMutually adaptable EMG devices for prosthetic hand
Yokoi, H., Kita, K., Nakamura, T., Kato, R., Arieta, A. H., Arai, T., Ikoma, K., Makino, H., Ito, T., & Pennacchio, S. (2009) · Zurich Open Repository and Archive (University of Zurich) · Cited by 14
Self-citationFujiwara, Y., Yamashita, O., Kawawaki, D., Doya, K., Kawato, M., Toyama, K., & Sato, M.-A. (2008) · NeuroImage · doi:10.1016/j.neuroimage.2008.12.012 · Cited by 12
Nakamura, T., Kita, K., Kato, R., Matsushita, K., & Hiroshi, Y. (2009) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/iembs.2009.5333667 · Cited by 8
Cited by
High-performance neuroprosthetic control by an individual with tetraplegia
Collinger, J. L., Wodlinger, B., Downey, J. E., Wang, W., Tyler-Kabara, E. C., Weber, D. J., McMorland, A. J., Velliste, M., Boninger, M. L., & Schwartz, A. B. (2013) · The Lancet · doi:10.1016/s0140-6736(12)61816-9 · Cited by 1,848
Brain-Computer Interfaces in Medicine
Shih, J. J., Krusienski, D. J., & Wolpaw, J. R. (2012) · Mayo Clinic Proceedings · doi:10.1016/j.mayocp.2011.12.008 · Cited by 724
Flexible Electronics and Devices as Human–Machine Interfaces for Medical Robotics
Heng, W., Solomon, S., & Gao, W. (2022) · Advanced Materials · doi:10.1002/adma.202107902 · Cited by 609
Brain-Computer Interfaces Using Electrocorticographic Signals
Schalk, G., & Leuthardt, E. C. (2011) · IEEE Reviews in Biomedical Engineering · doi:10.1109/rbme.2011.2172408 · Cited by 427
Electrocorticographic control of a prosthetic arm in paralyzed patients
Yanagisawa, T., Hirata, M., Saitoh, Y., Kishima, H., Matsushita, K., Goto, T., Fukuma, R., Yokoi, H., Kamitani, Y., & Yoshimine, T. (2012) · Annals of Neurology · doi:10.1002/ana.22613 · Cited by 256
Self-citation
Metadata
- Authors
- Yanagisawa, T., Hirata, M., Saitoh, Y., Goto, T., Kishima, H., Fukuma, R., Yokoi, H., Kamitani, Y., & Yoshimine, T.
- Affiliations
- Advanced Telecommunications Research Institute International (JP)
- The University of Osaka (JP)
- The University of Tokyo (JP)
- Corresponding author
- Hirata, Masayuki
- ORCID
- Venue
- Journal of Neurosurgery
- Published
- 2011-06
- Volume
- 114
- Issue
- 6
- Pages
- 1715-1722
- ISSN
- 0022-3085 (ISSN-L)
- 1933-0693
- OpenAlex
- W1545922961
- Cited by
- 208
- References
- 33
- Citations by year
- 2026: 3 · 2025: 7 · 2024: 8 · 2023: 13 · 2022: 9 · 2021: 14 · 2020: 16 · 2019: 14 · 2018: 21 · 2017: 9 · 2016: 19 · 2015: 15 · 2014: 24 · 2013: 18 · 2012: 14
- FWCI
- 9.74
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of neurosurgery (publishedVersion)
- PubMed (publishedVersion)
- Funders
- Japan Society for the Promotion of Science (22700435, 22390275, 23390347)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › EEG and Brain-Computer Interfaces
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neuroscience and Neural Engineering
- Physical Sciences › Engineering › Biomedical Engineering › Muscle activation and electromyography studies
- Keywords
- electrocorticography, brain-computer interface, prosthetic hand control, stroke, motor recovery, real-time decoding, subdural electrodes, sensorimotor cortex, support vector machine, time-frequency analysis, frequency band selection, upper limb prosthesis
- MeSH terms
- Artificial Limbs, Electroencephalography, Hand, Humans, Male, Middle Aged, Motor Cortex, Movement, User-Computer Interface, Stroke
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.