The signature of robot action success in EEG signals of a human observer: Decoding and visualization using deep convolutional neural networks
Open accessThe DOI matches its Crossref record; 6 of the 6 references it cites were found in a registry or an index.
Abstract
The importance of robotic assistive devices grows in our work and everyday life. Cooperative scenarios involving both robots and humans require safe human-robot interaction. One important aspect here is the management of robot errors, including fast and accurate online robot-error detection and correction. Analysis of brain signals from a human interacting with a robot may help identifying robot errors, but accuracies of such analyses have still substantial space for improvement. In this paper we evaluate whether a novel framework based on deep convolutional neural networks (deep ConvNets) could improve the accuracy of decoding robot errors from the EEG of a human observer, both during an object grasping and a pouring task. We show that deep ConvNets reached significantly higher accuracies than both regularized Linear Discriminant Analysis (rLDA) and filter bank common spatial patterns (FB-CSP) combined with rLDA, both widely used EEG classifiers. Deep ConvNets reached mean accuracies of 75% ± 9 %, rLDA 65% ± 10% and FB-CSP + rLDA 63% ± 6% for decoding of erroneous vs. correct trials. Visualization of the time-domain EEG features learned by the ConvNets to decode errors revealed spatiotemporal patterns that reflected differences between the two experimental paradigms. Across subjects, ConvNet decoding accuracies were significantly correlated with those obtained with rLDA, but not CSP, indicating that in the present context ConvNets behaved more “rLDA-like” (but consistently better), while in a previous decoding study with another task but the same ConvNet architecture, it was found to behave more “CSP-like”. Our findings thus provide further support for the assumption that deep ConvNets are a versatile addition to the existing toolbox of EEG decoding techniques, and we discuss steps how ConvNet EEG decoding performance could be further optimized.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep learning with convolutional neural networks for EEG decoding and visualization
Schirrmeister, R. T., Springenberg, J. T., Fiederer, L. D. J., Glasstetter, M., Eggensperger, K., Tangermann, M., Hutter, F., Burgard, W., & Ball, T. (2017) · Human Brain Mapping · doi:10.1002/hbm.23730 · Cited by 3,751
Self-citationA well-conditioned estimator for large-dimensional covariance matrices
Ledoit, O., & Wolf, M. (2004) · Journal of Multivariate Analysis · doi:10.1016/s0047-259x(03)00096-4 · Cited by 3,046
Filter Bank Common Spatial Pattern Algorithm on BCI Competition IV Datasets 2a and 2b
Ang, K. K., Chin, Z. Y., Wang, C., Guan, C., & Zhang, H. (2012) · Frontiers in Neuroscience · doi:10.3389/fnins.2012.00039 · Cited by 1,264
Single-Neuron Responses in Humans during Execution and Observation of Actions
Mukamel, R., Ekstrom, A. D., Kaplan, J., Iacoboni, M., & Fried, I. (2010) · Current Biology · doi:10.1016/j.cub.2010.02.045 · Cited by 1,178
The Berlin Brain–Computer Interface: Non-Medical Uses of BCI Technology
Blankertz, B., Tangermann, M., Vidaurre, C., Fazli, S., Sannelli, C., Haufe, S., Maeder, C., Ramsey, L., Sturm, I., Curio, G., et al. (2010) · Frontiers in Neuroscience · doi:10.3389/fnins.2010.00198 · Cited by 357
Teaching brain-machine interfaces as an alternative paradigm to neuroprosthetics control
Iturrate, I., Chavarriaga, R., Montesano, L., Minguez, J., & Millán, J. D. R. (2015) · Scientific Reports · doi:10.1038/srep13893 · Cited by 149
Cited by
Deep learning-based electroencephalography analysis: a systematic review
Roy, Y., Banville, H., Albuquerque, I., Gramfort, A., Falk, T. H., & Faubert, J. (2019) · Journal of Neural Engineering · doi:10.1088/1741-2552/ab260c · Cited by 1,532
A survey on deep learning-based non-invasive brain signals: recent advances and new frontiers
Zhang, X., Yao, L., Wang, X., Monaghan, J., McAlpine, D., & Zhang, Y. (2021) · Journal of Neural Engineering · doi:10.1088/1741-2552/abc902 · Cited by 296
A systematic deep learning model selection for p300-based brain-computer interfaces
Abibullaev, B., & Zollanvari, A. (2022) · IEEE Transactions on Systems Man and Cybernetics Systems · doi:10.1109/tsmc.2021.3051136 · Cited by 53
Decoding visual motions from EEG using attention based RNN.
Yang, D., Liu, Y., Zhou, Z., Yu, Y., & Liang, X. (2020) · Applied Sciences · doi:10.3390/app10165662 · Cited by 20
Metadata
- Authors
- Behncke, J., Schirrmeister, R. T., Burgard, W., & Ball, T.
- Venue
- 2018 6th International Conference on Brain-Computer Interface (BCI)
- Publisher
- IEEE
- Published
- 2018-01
- Pages
- 1-6
- OpenAlex
- W2768578923
- Cited by
- 33
- References
- 6
- FWCI
- 10.49
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: The signature of robot action success in EEG signals of a human observer: Decoding and visualization using deep convolutional neural networks. https://app.cochat.ai/papers/10.1109/iww-bci.2018.8311531
- The paper
- Behncke, J., Schirrmeister, R. T., Burgard, W., & Ball, T. (2018). The signature of robot action success in EEG signals of a human observer: Decoding and visualization using deep convolutional neural networks. 2018 6th International Conference on Brain-Computer Interface (BCI). https://doi.org/10.1109/iww-bci.2018.8311531
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.