Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 40 of the 40 references it cites were found in a registry or an index; 8 of the 9 sources its claims cite were checked for support.

Noninvasive Electroencephalogram Based Control of a Robotic Arm for Reach and Grasp Tasks

Open access

Abstract

Brain-computer interface (BCI) technologies aim to provide a bridge between the human brain and external devices. Prior research using non-invasive BCI to control virtual objects, such as computer cursors and virtual helicopters, and real-world objects, such as wheelchairs and quadcopters, has demonstrated the promise of BCI technologies. However, controlling a robotic arm to complete reach-and-grasp tasks efficiently using non-invasive BCI has yet to be shown. In this study, we found that a group of 13 human subjects could willingly modulate brain activity to control a robotic arm with high accuracy for performing tasks requiring multiple degrees of freedom by combination of two sequential low dimensional controls. Subjects were able to effectively control reaching of the robotic arm through modulation of their brain rhythms within the span of only a few training sessions and maintained the ability to control the robotic arm over multiple months. Our results demonstrate the viability of human operation of prosthetic limbs using non-invasive BCI technology.

Overview

CoChat Summary

TL;DR

Thirteen healthy subjects used a noninvasive EEG motor-imagery BCI to control a 7-DOF robotic arm for reach-and-grasp tasks in 3D by combining sequential low-dimensional controls. Performance improved with training, exceeded chance, and was maintained over multiple months, supporting the viability of noninvasive BCI for prosthetic-limb control.

Key findings

  • Across 8–15 sessions, 1D left-right cursor control averaged 78.4 ± 7.0% PVC in session 1, rose to 90.2 ± 3.1% in session 2, and exceeded 95% in later sessions; 2D cursor control averaged 77.0 ± 9.3% initially and increased above 85% after seven sessions.
  • Four-target grasp averaged 80.3 ± 17.0% PVC across two sessions; five-target grasp averaged 77.9 ± 14.7% across three sessions. For six subjects, four-target PVC was 90.1 ± 7.7% without the virtual cursor vs. 89.9 ± 8.9% with it (n.s., p > 0.05), while five-target PVC was 79.0 ± 8.3% without vs. 85.1 ± 8.0% with it (p = 0.031).
  • In random-target grasp, 10 subjects grasped 7.4 ± 1.3 blocks per run (max 10), took 6.4 ± 0.7 s per step and 30.5 ± 4.1 s per block; success rate exceeded 62.2% across the accessible workspace except bottom-center areas, where median was 53.1% and minimum 47.2%.
  • In shelf-target grasp, 8 subjects moved 4.6 ± 0.9 blocks per run (max 6), took 6.0 ± 0.5 s per step and 63.8 ± 5.1 s per block; fast-shelf-target reduced time to 40.6 ± 5.8 s per block, about 36% faster, with similar blocks per run (5.1 ± 0.6 vs. 5.1 ± 0.5). Empirical chance levels were 25.3% for four-target and 22.5% for five-target virtual tasks.

Methods

  • 18 healthy subjects were recruited; 5 dropped early, leaving 13 analyzed (7 women; mean age 27.3 y; range 18–54) who completed 8–15 sessions over an average of 81 ± 34 days.
  • EEG was recorded with a 64-channel Neuroscan cap; 62 channels acquired, with C3/C4 and surrounding motor-cortex channels used online. Signals were spatially filtered with a small Laplacian, modeled with a 16th-order autoregressive model over a 400-ms window, and upper mu (10–14 Hz) power was linearly mapped to cursor/robotic-arm velocity. A JACO 7-DOF robotic arm served as actuator.
  • Five progressive stages were used: virtual cursor only, four-target grasp, five-target grasp, random-target grasp, and shelf-target grasp. Reach-and-grasp used a two-step sequence with a 2-s hover requirement; statistical comparisons used two-sided Wilcoxon signed-rank tests at α = 0.05.

Limitations

  • Stated: the study used healthy subjects, not patients; the approach used sequential low-dimensional control rather than fluid 3D continuous control; fluid 3D control would require at least three independent control signals and had not yet been shown; decoding was minimally customized per subject; a high-speed robotic arm was not available; the hover period increased task complexity; performance varied day by day; and some subjects dropped before later stages.
  • Stated: in the presence vs. absence of the virtual cursor, only five-target PVC showed a significant difference; possible reasons included occasional robotic-arm lag, physical speed limits, and visual distortion without the cursor.
  • Evident from the text: the sample was small and healthy, the workspace was constrained, grasping was partly shared/automatic after hover, and the system was tested in laboratory sessions rather than in daily-life or home use.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1038/srep38565

Cites

40 of 40 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Figures

Figure 1 Experiment setup and task progression. (a) Overview of experimental sessions for each participant. There were five stages of experiments with increasing level of difficulty, where each stage included two to four sessions of the same experimental paradigm. (b) Motor imagery tasks were used to drive two dimensional virtual cursor or robotic arm movement. The imagination of left hand, right hand, both hands, and relaxation corresponds to the respective left, right, up, and down movement of the robotic arm and virtual cursor. (c) Overview of tasks for experiment stages two through five. Experiment stage two (four-target grasp): Grasping one of the four fixed targets. Experiment stage three (five-target grasp): Grasping one of the five fixed targets. Experiment stage four (random-target grasp): Grasping a randomly located target. Experiment stage five (shelf-target grasp): Moving one target from the table onto the shelf. (d) Trial structure of a single trial task. First, there is a short period of inter-trial interval between two separate trials. After that, the target is displayed on the screen for three seconds during the prefeedback period and is followed by a moving pink cursor and robotic arm in the respective workspaces during the feedback period. If the robotic arm remained within the predefined radius above the designated block for 2 seconds, the hover period would be complete and the task would progress to the step of grasping in the reach-and-grasp sequence (otherwise the step is timeout after 12 seconds and a new trial begins). At this point, the computer would recognize that the robotic arm was meant to stop and grasp the target. The robotic arm would open the fingers and be prepared to finish the grasping sequence during the next trial (step) if the subject controls the robotic arm to move towards the block correctly.
Figure 1 Experiment setup and task progression. (a) Overview of experimental sessions for each participant. There were five stages of experiments with increasing level of difficulty, where each stage included two to four sessions of the same experimental paradigm. (b) Motor imagery tasks were used to drive two dimensional virtual cursor or robotic arm movement. The imagination of left hand, right hand, both hands, and relaxation corresponds to the respective left, right, up, and down movement of the robotic arm and virtual cursor. (c) Overview of tasks for experiment stages two through five. Experiment stage two (four-target grasp): Grasping one of the four fixed targets. Experiment stage three (five-target grasp): Grasping one of the five fixed targets. Experiment stage four (random-target grasp): Grasping a randomly located target. Experiment stage five (shelf-target grasp): Moving one target from the table onto the shelf. (d) Trial structure of a single trial task. First, there is a short period of inter-trial interval between two separate trials. After that, the target is displayed on the screen for three seconds during the prefeedback period and is followed by a moving pink cursor and robotic arm in the respective workspaces during the feedback period. If the robotic arm remained within the predefined radius above the designated block for 2 seconds, the hover period would be complete and the task would progress to the step of grasping in the reach-and-grasp sequence (otherwise the step is timeout after 12 seconds and a new trial begins). At this point, the computer would recognize that the robotic arm was meant to stop and grasp the target. The robotic arm would open the fingers and be prepared to finish the grasping sequence during the next trial (step) if the subject controls the robotic arm to move towards the block correctly.CC BY · PubMed Central
Figure 2 Overall learning process of virtual cursor control. Learning processes (PVC) of 1D LR and 2D cursor movement for all subjects across all sessions. Average PVC for LR and 2D are highlighted by the red and green lines, respectively. The standard errors of the mean (SEM) are indicated by the shaded regions alongside the two lines. Since not all subjects participated in all 15 sessions, the number of subjects included in each 1D LR and 2D session which are arranged chronologically are indicated, respectively, by the red and green bar plots in the lower part of the figure.
Figure 2 Overall learning process of virtual cursor control. Learning processes (PVC) of 1D LR and 2D cursor movement for all subjects across all sessions. Average PVC for LR and 2D are highlighted by the red and green lines, respectively. The standard errors of the mean (SEM) are indicated by the shaded regions alongside the two lines. Since not all subjects participated in all 15 sessions, the number of subjects included in each 1D LR and 2D session which are arranged chronologically are indicated, respectively, by the red and green bar plots in the lower part of the figure.CC BY · PubMed Central
Figure 3 Event related desychronization (ERD)/event related synchronization (ERS) maps of 2D virtual cursor movement. ERD/ERS maps of left, right, up and down target trials for electrodes C3 and C4. In each subplot the horizontal axis indicates the time (seconds); the vertical solid black line denotes when the target appeared, and the vertical solid blue line indicates when cursor control began. The period between the black dashed line and the black solid line shows the baseline period that was used to calculate the ERD/ERS. Only significant changes of ERD/ERS activity quantified by a bootstrap resampling method (see method) were shown here. The 8–26 Hz frequency band is indicated in the vertical axis. The red rectangle centered at 12 Hz (3 Hz bin width) highlights the mu band rhythmic activity starting from the appearance of the target and ending at 3.5 seconds after the cursor began to move. The target appeared at −3 seconds and the virtual cursor control began at 0 seconds. The baseline was selected as −4.5 seconds to −3 seconds during which the screen was black and the subject was instructed to remain in an idle state.
Figure 3 Event related desychronization (ERD)/event related synchronization (ERS) maps of 2D virtual cursor movement. ERD/ERS maps of left, right, up and down target trials for electrodes C3 and C4. In each subplot the horizontal axis indicates the time (seconds); the vertical solid black line denotes when the target appeared, and the vertical solid blue line indicates when cursor control began. The period between the black dashed line and the black solid line shows the baseline period that was used to calculate the ERD/ERS. Only significant changes of ERD/ERS activity quantified by a bootstrap resampling method (see method) were shown here. The 8–26 Hz frequency band is indicated in the vertical axis. The red rectangle centered at 12 Hz (3 Hz bin width) highlights the mu band rhythmic activity starting from the appearance of the target and ending at 3.5 seconds after the cursor began to move. The target appeared at −3 seconds and the virtual cursor control began at 0 seconds. The baseline was selected as −4.5 seconds to −3 seconds during which the screen was black and the subject was instructed to remain in an idle state.CC BY · PubMed Central
Figure 4 Event related desychronization (ERD)/event related synchronization (ERS) maps of the fixed four target grasping task. ERD/ERS maps of moving towards the left, right, up and down targets for electrodes C3 and C4. The target appeared at −2.5 seconds and the robotic arm began to move at 0 seconds. The baseline was selected as −4 seconds to −2.5 seconds during which the robotic arm was stationary, the screen was black, and the subject was instructed to remain in an idle state.
Figure 4 Event related desychronization (ERD)/event related synchronization (ERS) maps of the fixed four target grasping task. ERD/ERS maps of moving towards the left, right, up and down targets for electrodes C3 and C4. The target appeared at −2.5 seconds and the robotic arm began to move at 0 seconds. The baseline was selected as −4 seconds to −2.5 seconds during which the robotic arm was stationary, the screen was black, and the subject was instructed to remain in an idle state.CC BY · PubMed Central
Figure 5 Grasping performance of the four-target and five-target grasp tasks in the presence and absence of the accompanying cursor movement. (a) Group average PVC and one standard deviation for the four-target and five-target grasp tasks. The leftmost bar for each task indicates the PVC of the original 13 subjects. The right two bars compare the PVC of the subset of six subjects who participated in additional sessions both with and without the cursor present. (b) Average number of blocks grasped in each run of the four-target and five-target grasp tasks for all subjects and all sessions, as well as the subset of six subjects. The green line shows the ideal maximum number of blocks (13 blocks) that can be grasped in each run. (c) Average single-trial time-to-hit target for all subjects and all sessions, as well as the subset of six subjects. The feedback duration when the robotic arm moved to complete the individual steps of the reach-and-grasp sequence was denoted as the single-trial time-to-hit.
Figure 5 Grasping performance of the four-target and five-target grasp tasks in the presence and absence of the accompanying cursor movement. (a) Group average PVC and one standard deviation for the four-target and five-target grasp tasks. The leftmost bar for each task indicates the PVC of the original 13 subjects. The right two bars compare the PVC of the subset of six subjects who participated in additional sessions both with and without the cursor present. (b) Average number of blocks grasped in each run of the four-target and five-target grasp tasks for all subjects and all sessions, as well as the subset of six subjects. The green line shows the ideal maximum number of blocks (13 blocks) that can be grasped in each run. (c) Average single-trial time-to-hit target for all subjects and all sessions, as well as the subset of six subjects. The feedback duration when the robotic arm moved to complete the individual steps of the reach-and-grasp sequence was denoted as the single-trial time-to-hit.CC BY · PubMed Central
Figure 6 Grasping performance of randomly located targets. (a) Average number of targets grasped per run for all subjects and all sessions versus the ideal number of targets that could be grasped per run (10 targets). (b) Average single-trial time-to-hit of EEG robotic arm control compared to the ideal time-to-hit of the robotic arm control.
Figure 6 Grasping performance of randomly located targets. (a) Average number of targets grasped per run for all subjects and all sessions versus the ideal number of targets that could be grasped per run (10 targets). (b) Average single-trial time-to-hit of EEG robotic arm control compared to the ideal time-to-hit of the robotic arm control.CC BY · PubMed Central
Figure 7 Example trajectories and the distribution of successful grasping trials for randomly located targets. (a) 24 example trajectories from six different subjects (four each) for grasping random targets located in the four quadrants. The circles indicate the hover area for the randomly placed targets. (b) The distribution of successful and unsuccessful grasping within the workspace. The histograms above and to the right of the plot indicate how often the target was placed in that area of the workspace. (c) Topography of successful grasping rate within the workspace.
Figure 7 Example trajectories and the distribution of successful grasping trials for randomly located targets. (a) 24 example trajectories from six different subjects (four each) for grasping random targets located in the four quadrants. The circles indicate the hover area for the randomly placed targets. (b) The distribution of successful and unsuccessful grasping within the workspace. The histograms above and to the right of the plot indicate how often the target was placed in that area of the workspace. (c) Topography of successful grasping rate within the workspace.CC BY · PubMed Central
Figure 8 Grasping performance of the shelf-target grasp stage. (a) Average number of targets grasped in each run for the original 8 subjects (orange bar) and the subset of 6 subjects who participated in three extra sessions. These extra three sessions involved controlling the robotic arm with the initial normal speed (shelf-target grasp) and an increased speed of movement (fast-shelf-target grasp). The green line shows the ideal number of blocks (6 blocks) that can be reached in a single run. (b) Average single-trial time-to-hit and standard deviation for all of the original 8 subjects and the 6 subjects who participated in both the shelf-target grasp and fast-shelf-target graps tasks. (Examples of robotic hand trajectories during the feedback period are shown as blue, yellow, red and green lines in Supplementary Figure 5). (c) Distribution of PVC for moving targets from a table onto a shelf. Average PVC of reach-and-grasp for the blocks on the table (x-y plane) and average PVC of reach-and-release for the blocks onto the shelf (x-z plane) are shown.
Figure 8 Grasping performance of the shelf-target grasp stage. (a) Average number of targets grasped in each run for the original 8 subjects (orange bar) and the subset of 6 subjects who participated in three extra sessions. These extra three sessions involved controlling the robotic arm with the initial normal speed (shelf-target grasp) and an increased speed of movement (fast-shelf-target grasp). The green line shows the ideal number of blocks (6 blocks) that can be reached in a single run. (b) Average single-trial time-to-hit and standard deviation for all of the original 8 subjects and the 6 subjects who participated in both the shelf-target grasp and fast-shelf-target graps tasks. (Examples of robotic hand trajectories during the feedback period are shown as blue, yellow, red and green lines in Supplementary Figure 5). (c) Distribution of PVC for moving targets from a table onto a shelf. Average PVC of reach-and-grasp for the blocks on the table (x-y plane) and average PVC of reach-and-release for the blocks onto the shelf (x-z plane) are shown.CC BY · PubMed Central

Verification

Claims the paper makes

8 Valid · 2 Not valid · 1 Not checked · 96 Own results and interpretations

58 more claims

Create a free account to see all 107 claims and every source verdict.

See all claims — free account
  • Probably not a substantial claim. 22
  • It may state two separate claims as one. 30

Create a free account to see these claims.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Show all 40 references

Cited by

Metadata

Authors
Meng, J., Zhang, S., Bekyo, A., Olsoe, J., Baxter, B., & He, B.
Affiliations
University of Minnesota (US)
Corresponding author
He, Bin
Venue
Scientific Reports
Published
2016-12-14
Volume
6
Issue
1
Pages
38565-38565
ISSN
2045-2322 (ISSN-L)
OpenAlex
W2561907433
Cited by
484
References
40
Citations by year
2026: 23 · 2025: 48 · 2024: 52 · 2023: 55 · 2022: 45 · 2021: 60 · 2020: 59 · 2019: 57 · 2018: 60 · 2017: 25
FWCI
30.03
Type
journal article
Language
en
Open access
Licence
Locations
  • Scientific Reports (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
Funders
  • National Science Foundation (1264782, 1069104)
  • National Institutes of Health (NSF DGE-1069104, DGE-1069104)
  • National Institute of Neurological Disorders and Stroke (R01NS096761)
  • National Institute of Biomedical Imaging and Bioengineering (R01EB021027)
  • Division of Chemical, Bioengineering, Environmental, and Transport Systems (1264782, CBET-1264782)
  • National Center for Complementary and Integrative Health (R01AT009263)
Topics
  • Life Sciences › Neuroscience › Cognitive Neuroscience › EEG and Brain-Computer Interfaces
  • Physical Sciences › Engineering › Biomedical Engineering › Muscle activation and electromyography studies
  • Health Sciences › Medicine › Rehabilitation › Stroke Rehabilitation and Recovery
Keywords
brain-computer interface, robotic arm control, reach and grasp, prosthetic control, motor imagery, neural oscillations

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-09-29, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-09-29 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.