The DOI matches its Crossref record; 68 of the 68 references it cites were found in a registry or an index.
A convolutional neural network for steady state visual evoked potential classification under ambulatory environment
Open accessAbstract
The robust analysis of neural signals is a challenging problem. Here, we contribute a convolutional neural network (CNN) for the robust classification of a steady-state visual evoked potentials (SSVEPs) paradigm. We measure electroencephalogram (EEG)-based SSVEPs for a brain-controlled exoskeleton under ambulatory conditions in which numerous artifacts may deteriorate decoding. The proposed CNN is shown to achieve reliable performance under these challenging conditions. To validate the proposed method, we have acquired an SSVEP dataset under two conditions: 1) a static environment, in a standing position while fixated into a lower-limb exoskeleton and 2) an ambulatory environment, walking along a test course wearing the exoskeleton (here, artifacts are most challenging). The proposed CNN is compared to a standard neural network and other state-of-the-art methods for SSVEP decoding (i.e., a canonical correlation analysis (CCA)-based classifier, a multivariate synchronization index (MSI), a CCA combined with k-nearest neighbors (CCA-KNN) classifier) in an offline analysis. We found highly encouraging SSVEP decoding results for the CNN architecture, surpassing those of other methods with classification rates of 99.28% and 94.03% in the static and ambulatory conditions, respectively. A subsequent analysis inspects the representation found by the CNN at each layer and can thus contribute to a better understanding of the CNN's robust, accurate decoding abilities.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Learning representations by back-propagating errors
Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1986) · Nature · doi:10.1038/323533a0 · Cited by 31,892
On Pixel-Wise Explanations for Non-Linear Classifier Decisions by Layer-Wise Relevance Propagation
Bach, S., Binder, A., Montavon, G., Klauschen, F., Müller, K.-R., & Samek, W. (2015) · PLOS ONE · doi:10.1371/journal.pone.0130140 · Cited by 4,524
Self-citationNeuronal ensemble control of prosthetic devices by a human with tetraplegia
Hochberg, L. R., Serruya, M. D., Friehs, G. M., Mukand, J. A., Saleh, M., Caplan, A. H., Branner, A., Chen, D., Penn, R. D., & Donoghue, J. P. (2006) · Nature · doi:10.1038/nature04970 · Cited by 3,295
Theory of the backpropagation neural network
Hecht-Nielsen (1989) · International Joint Conference on Neural Networks · doi:10.1109/ijcnn.1989.118638 · Cited by 2,222
Neural Networks: Tricks of the Trade: Second Edition
(2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-35289-8 · Cited by 2,116
Self-citationOptimizing Spatial filters for Robust EEG Single-Trial Analysis
Blankertz, B., Tomioka, R., Lemm, S., Kawanabe, M., & Muller, K.-R. (2008) · IEEE Signal Processing Magazine · doi:10.1109/msp.2008.4408441 · Cited by 2,080
Brain–machine interfaces: past, present and future
Lebedev, M. A., & Nicolelis, M. A. L. (2006) · Trends in Neurosciences · doi:10.1016/j.tins.2006.07.004 · Cited by 1,875 · cited 1×
“A brain-computer interface (BCI) allows for the decoding of (a limited set of) user intentions employing only brain signals—without making use of peripheral nerve activity or muscles [1, 2].”
BackgroundHigh-performance neuroprosthetic control by an individual with tetraplegia
Collinger, J. L., Wodlinger, B., Downey, J. E., Wang, W., Tyler-Kabara, E. C., Weber, D. J., McMorland, A. J., Velliste, M., Boninger, M. L., & Schwartz, A. B. (2013) · The Lancet · doi:10.1016/s0140-6736(12)61816-9 · Cited by 1,848
LeCun, Y., Bottou, L., Orr, G., & Müller, K. (1998) · neural information processing systems · Cited by 1,333
Self-citationThe mental prosthesis: assessing the speed of a P300-based brain-computer interface
Donchin, E., Spencer, K. M., & Wijesinghe, R. (2000) · IEEE Transactions on Rehabilitation Engineering · doi:10.1109/86.847808 · Cited by 1,222
Single-trial analysis and classification of ERP components — A tutorial
Blankertz, B., Lemm, S., Treder, M., Haufe, S., & Müller, K.-R. (2011) · NeuroImage · doi:10.1016/j.neuroimage.2010.06.048 · Cited by 1,138
Self-citationBrain–machine interface in chronic stroke rehabilitation: A controlled study
Ramos‐Murguialday, A., Broetz, D., Rea, M., Läer, L., Yilmaz, Ö., Brasil, F. L., Liberati, G., Curado, M. R., Garcia‐Cossio, E., Vyziotis, A., et al. (2013) · Annals of Neurology · doi:10.1002/ana.23879 · Cited by 994
High-speed spelling with a noninvasive brain–computer interface
Chen, X., Wang, Y., Nakanishi, M., Gao, X., Jung, T.-P., & Gao, S. (2015) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1508080112 · Cited by 969
Frequency recognition based on canonical correlation analysis for SSVEP-based BCIs
Lin, Z., Zhang, C., Wu, W., & Gao, X. (2007) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2006.889197 · Cited by 867
Toward Brain-Computer Interfacing
(2007) · The MIT Press eBooks · doi:10.7551/mitpress/7493.001.0001 · Cited by 785
Convolutional Neural Networks for P300 Detection with Application to Brain-Computer Interfaces
Cecotti, H., & Graser, A. (2011) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2010.125 · Cited by 778
Frequency Recognition Based on Canonical Correlation Analysis for SSVEP-Based BCIs
Lin, Z., Zhang, C., Wu, W., & Gao, X. (2006) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2006.886577 · Cited by 724
Introduction to machine learning for brain imaging
Lemm, S., Blankertz, B., Dickhaus, T., & Müller, K.-R. (2011) · NeuroImage · doi:10.1016/j.neuroimage.2010.11.004 · Cited by 630
Self-citationLaFleur, K., Cassady, K., Doud, A., Shades, K., Rogin, E., & He, B. (2013) · Journal of Neural Engineering · doi:10.1088/1741-2560/10/4/046003 · Cited by 583
Müller-Putz, G. R., Scherer, R., Brauneis, C., & Pfurtscheller, G. (2005) · Journal of Neural Engineering · doi:10.1088/1741-2560/2/4/008 · Cited by 534
Removal of Movement Artifact From High-Density EEG Recorded During Walking and Running
Gwin, J. T., Gramann, K., Makeig, S., & Ferris, D. P. (2010) · Journal of Neurophysiology · doi:10.1152/jn.00105.2010 · Cited by 481
Brain-Controlled Wheelchairs: A Robotic Architecture
Carlson, T., & del R. Millan, J. (2013) · IEEE Robotics & Automation Magazine · doi:10.1109/mra.2012.2229936 · Cited by 432
van Kuijk, A. A., Bakker, C. D., Hendriks, J. C., Geurts, A. C., Stegeman, D. F., & Pasman, J. W. (2014) · Journal of NeuroEngineering and Rehabilitation · doi:10.1186/1743-0003-11-1 · Cited by 373
FREQUENCY RECOGNITION IN SSVEP-BASED BCI USING MULTISET CANONICAL CORRELATION ANALYSIS
ZHANG, Y., ZHOU, G., JIN, J., WANG, X., & CICHOCKI, A. (2014) · International Journal of Neural Systems · doi:10.1142/s0129065714500130 · Cited by 357
Steady-state somatosensory evoked potentials: suitable brain signals for brain-computer interfaces?
Muller-Putz, G. R., Scherer, R., Neuper, C., & Pfurtscheller, G. (2006) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2005.863842 · Cited by 288
Frequency recognition in SSVEP-based BCI using multiset canonical correlation analysisPreprint
Zhang, Y., Zhou, G., Jin, J., Wang, X., & Cichocki, A. S. (2014) · Cited by 264
Concurrent neuromechanical and functional gains following upper-extremity power training post-stroke
Patten, C., Condliffe, E. G., Dairaghi, C. A., & Lum, P. S. (2013) · Journal of NeuroEngineering and Rehabilitation · doi:10.1186/1743-0003-10-1 · Cited by 259
Development of an SSVEP-based BCI spelling system adopting a QWERTY-style LED keyboard
Hwang, H.-J., Lim, J.-H., Jung, Y.-J., Choi, H., Lee, S. W., & Im, C.-H. (2012) · Journal of Neuroscience Methods · doi:10.1016/j.jneumeth.2012.04.011 · Cited by 251
Self-citationA Novel Bayesian Framework for Discriminative Feature Extraction in Brain-Computer Interfaces
Suk, H.-I., & Lee, S.-W. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.69 · Cited by 241
Self-citationA comparison of geometric- and regression-based mobile gaze-tracking
Browatzki, B., Bülthoff, H. H., & Chuang, L. L. (2014) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2014.00200 · Cited by 234
Multivariate synchronization index for frequency recognition of SSVEP-based brain–computer interface
Zhang, Y., Xu, P., Cheng, K., & Yao, D. (2014) · Journal of Neuroscience Methods · doi:10.1016/j.jneumeth.2013.07.018 · Cited by 233
A lower limb exoskeleton control system based on steady state visual evoked potentials
Kwak, N.-S., Müller, K.-R., & Lee, S.-W. (2015) · Journal of Neural Engineering · doi:10.1088/1741-2560/12/5/056009 · Cited by 221
Self-citationNilsson, A., Vreede, K., Häglund, V., Kawamoto, H., Sankai, Y., & Borg, J. (2014) · Journal of NeuroEngineering and Rehabilitation · doi:10.1186/1743-0003-11-92 · Cited by 206
Krepki, R., Blankertz, B., Curio, G., & Müller, K.-R. (2007) · Multimedia Tools and Applications · doi:10.1007/s11042-006-0094-3 · Cited by 205
Self-citationIsolating gait-related movement artifacts in electroencephalography during human walking
Kline, J. E., Huang, H. J., Snyder, K. L., & Ferris, D. P. (2015) · Journal of Neural Engineering · doi:10.1088/1741-2560/12/4/046022 · Cited by 204
High accuracy decoding of user intentions using EEG to control a lower-body exoskeleton
Kilicarslan, A., Prasad, S., Grossman, R. G., & Contreras-Vidal, J. L. (2013) · 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc.2013.6610821 · Cited by 196
Brain-computer interface controlled robotic gait orthosis
Do, A. H., Wang, P. T., King, C. E., Chun, S. N., & Nenadic, Z. (2013) · Journal of NeuroEngineering and Rehabilitation · doi:10.1186/1743-0003-10-111 · Cited by 189
How Many People Could Use an SSVEP BCI?
Guger, C., Allison, B. Z., Großwindhager, B., Prückl, R., Hintermüller, C., Kapeller, C., Bruckner, M., Krausz, G., & Edlinger, G. (2012) · Frontiers in Neuroscience · doi:10.3389/fnins.2012.00169 · Cited by 176 · cited 1×
“Of these EEG paradigms, SSVEPs have shown reliable performance in terms of accuracy and response time, even with a small number of EEG channels, at a relatively high information transfer rate (ITR) [35] and reasonable signal-to-noise ratio (SNR) [36].”
BackgroundTsukahara, A., Hasegawa, Y., Eguchi, K., & Sankai, Y. (2015) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2014.2364618 · Cited by 174
Divergence-Based Framework for Common Spatial Patterns Algorithms
Samek, W., Kawanabe, M., & Muller, K.-R. (2014) · IEEE Reviews in Biomedical Engineering · doi:10.1109/rbme.2013.2290621 · Cited by 174
Multiway Canonical Correlation Analysis for Frequency Components Recognition in SSVEP-Based BCIs
Zhang, Y., Zhou, G., Zhao, Q., Onishi, A., Jin, J., Wang, X., & Cichocki, A. (2011) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-24955-6_35 · Cited by 161
A user-friendly SSVEP-based brain–computer interface using a time-domain classifier
Luo, A., & Sullivan, T. J. (2010) · Journal of Neural Engineering · doi:10.1088/1741-2560/7/2/026010 · Cited by 161
Brain-computer interface (BCI) operation: signal and noise during early training sessions
McFarland, D. J., Sarnacki, W. A., Vaughan, T. M., & Wolpaw, J. R. (2004) · Clinical Neurophysiology · doi:10.1016/j.clinph.2004.07.004 · Cited by 157
Pan, J., Gao, X., duan, F. Y., Zheng, Y. L., & Gao, S. (2011) · Journal of Neural Engineering · doi:10.1088/1741-2560/8/3/036027 · Cited by 142
Kim, J.-H., Bießmann, F., & Lee, S. (2014) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2014.2375879 · Cited by 138
Self-citationKim, D.-W., Hwang, H., Lim, J., Lee, Y., Jung, K.-Y., & Im, C. (2011) · Journal of Neuroscience Methods · doi:10.1016/j.jneumeth.2011.02.007 · Cited by 135
Effect of higher frequency on the classification of steady-state visual evoked potentials
Won, D.-O., Hwang, H., Dähne, S., Müller, K., & Lee, S. (2015) · Journal of Neural Engineering · doi:10.1088/1741-2560/13/1/016014 · Cited by 121
Self-citationHill, N. J., & Schölkopf, B. (2012) · Journal of Neural Engineering · doi:10.1088/1741-2560/9/2/026011 · Cited by 120
Contreras-Vidal, J. L., & Grossman, R. G. (2013) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc.2013.6609816 · Cited by 116
Convolutional Neural Network with embedded Fourier Transform for EEG classification
Cecotti, H., & Graeser, A. (2008) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr.2008.4761638 · Cited by 115
An Efficient ERP-Based Brain-Computer Interface Using Random Set Presentation and Face Familiarity
Yeom, S.-K., Fazli, S., Müller, K., & Lee, S. (2014) · PLoS ONE · doi:10.1371/journal.pone.0111157 · Cited by 113
Self-citationAssisted navigation for a brain-actuated intelligent wheelchair
Lopes, A., Pires, G., & Nunes, U. (2012) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2012.11.002 · Cited by 112
Operation of a brain-computer interface walking simulator for individuals with spinal cord injury
King, C., Wang, P. T., Chui, L. A., Do, A. H., & Nenadić, Z. (2013) · Journal of NeuroEngineering and Rehabilitation · doi:10.1186/1743-0003-10-77 · Cited by 110
Morone, G., Pisotta, I., Pichiorri, F., Kleih, S. C., Paolucci, S., Molinari, M., Cincotti, F., Kübler, A., & Mattia, D. (2015) · Archives of Physical Medicine and Rehabilitation · doi:10.1016/j.apmr.2014.05.026 · Cited by 105
Toward noninvasive brain-computer interfaces
Müller, K. R., & Blankertz, B. (2006) · IEEE Signal Processing Magazine · doi:10.1109/msp.2006.1708426 · Cited by 104
Self-citationMultivariate Machine Learning Methods for Fusing Multimodal Functional Neuroimaging Data
Dähne, S., Bieszmann, F., Samek, W., Haufe, S., Goltz, D., Gundlach, C., Villringer, A., Fazli, S., & Müller, K. (2015) · Proceedings of the IEEE · doi:10.1109/jproc.2015.2425807 · Cited by 102
Self-citationLASSO based stimulus frequency recognition model for SSVEP BCIs
Zhang, Y., Jin, J., Qing, X., Wang, B., & Wang, X. (2011) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2011.02.002 · Cited by 101
Kernel analysis of deep networks
Montavon, G., Braun, M. L., & Müller, K. (2011) · Cited by 97
Self-citationFazli, S., Dähne, S., Samek, W., Bieszmann, F., & Müller, K. (2015) · Proceedings of the IEEE · doi:10.1109/jproc.2015.2413993 · Cited by 97
Self-citationBreitwieser, C., Kaiser, V., Neuper, C., & Müller-Putz, G. (2012) · Medical & Biological Engineering & Computing · doi:10.1007/s11517-012-0877-9 · Cited by 90
Cecotti, H. (2011) · Pattern Recognition Letters · doi:10.1016/j.patrec.2011.02.022 · Cited by 80
Applications of Brain–Machine Interface Systems in Stroke Recovery and Rehabilitation
Venkatakrishnan, A., Francisco, G. E., & Contreras-Vidal, J. L. (2014) · Current Physical Medicine and Rehabilitation Reports · doi:10.1007/s40141-014-0051-4 · Cited by 78
Neural decoding of expressive human movement from scalp electroencephalography (EEG)
Cruz-Garza, J. G., Hernandez, Z., Nepaul, S., Bradley, K. K., & Contreras-Vidal, J. L. (2014) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2014.00188 · Cited by 71
Bevilacqua, V., Tattoli, G., Buongiorno, D., Loconsole, C., Leonardis, D., Barsotti, M., Frisoli, A., & Bergamasco, M. (2014) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2014.6889955 · Cited by 57
Assessing the feasibility of online SSVEP decoding in human walking using a consumer EEG headset
Lin, Y., Wang, Y., & Jung, T. (2014) · Journal of NeuroEngineering and Rehabilitation · doi:10.1186/1743-0003-11-119 · Cited by 55
A comparison of techniques and technologies for SSVEP classification
Tello, R. M. G., Müller, S. M. T., Bastos-Filho, T., & Ferreira, A. (2014) · ISSNIP Biosignals and Biorobotics Conference: Biosignals and Robotics for Better and Safer Living · doi:10.1109/brc.2014.6880956 · Cited by 44
Brain-Computer Interface Controlled Robotic Gait Orthosis
Do, A., Wang, P. T., King, C., Schombs, A., Chun, S., & Nenadić, Z. (2020) · TUGraz OPEN Library (Graz University of Technology) · doi:10.3217/978-3-85125-260-6-127 · Cited by 6
Contreras-Vidal, J. L. (2014) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/smc.2014.6974126 · Cited by 5
Cited by
A review of classification algorithms for EEG-based brain–computer interfaces: A 10 year update
Lotte, F., Bougrain, L., Cichocki, A., Clerc, M., Congedo, M., Rakotomamonjy, A., & Yger, F. (2018) · Journal of Neural Engineering · doi:10.1088/1741-2552/aab2f2 · Cited by 2,239
Deep learning-based electroencephalography analysis: a systematic review
Roy, Y., Banville, H., Albuquerque, I., Gramfort, A., Falk, T. H., & Faubert, J. (2019) · Journal of Neural Engineering · doi:10.1088/1741-2552/ab260c · Cited by 1,532
“In [17, 33, 93, 120, 167, 232], one-dimensional convolutions were used in the input layer with the aim of processing either temporal or spatial information independently at this point of the hierarchy.”
BackgroundMethodInfluentialEEG-Based Spatio–Temporal Convolutional Neural Network for Driver Fatigue Evaluation
Gao, Z., Wang, X., Yang, Y., Mu, C., Cai, Q., Dang, W., & Zuo, S. (2019) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2018.2886414 · Cited by 482
Data augmentation for deep-learning-based electroencephalography
Lashgari, E., Liang, D., & Maoz, U. (2020) · Journal of Neuroscience Methods · doi:10.1016/j.jneumeth.2020.108885 · Cited by 398
Subject-Independent Brain–Computer Interfaces Based on Deep Convolutional Neural Networks
Kwon, O.-Y., Lee, M.-H., Guan, C., & Lee, S.-W. (2020) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2019.2946869 · Cited by 347
Self-citation
Metadata
- Authors
- Kwak, N.-S., Müller, K.-R., & Lee, S.-W.
- Venue
- PLOS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2017-02-22
- Volume
- 12
- Issue
- 2
- Pages
- e0172578
- ISSN
- 1932-6203 (ISSN-L)
- OpenAlex
- W2590420622
- Cited by
- 272
- References
- 68
- FWCI
- 15.75
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.