The DOI matches its Crossref record; 66 of the 66 references it cites were found in a registry or an index.
Subject-Independent Brain–Computer Interfaces Based on Deep Convolutional Neural Networks
Open accessAbstract
For a brain-computer interface (BCI) system, a calibration procedure is required for each individual user before he/she can use the BCI. This procedure requires approximately 20-30 min to collect enough data to build a reliable decoder. It is, therefore, an interesting topic to build a calibration-free, or subject-independent, BCI. In this article, we construct a large motor imagery (MI)-based electroencephalography (EEG) database and propose a subject-independent framework based on deep convolutional neural networks (CNNs). The database is composed of 54 subjects performing the left- and right-hand MI on two different days, resulting in 21 600 trials for the MI task. In our framework, we formulated the discriminative feature representation as a combination of the spectral-spatial input embedding the diversity of the EEG signals, as well as a feature representation learned from the CNN through a fusion technique that integrates a variety of discriminative brain signal patterns. To generate spectral-spatial inputs, we first consider the discriminative frequency bands in an information-theoretic observation model that measures the power of the features in two classes. From discriminative frequency bands, spectral-spatial inputs that include the unique characteristics of brain signal patterns are generated and then transformed into a covariance matrix as the input to the CNN. In the process of feature representations, spectral-spatial inputs are individually trained through the CNN and then combined by a concatenation fusion technique. In this article, we demonstrate that the classification accuracy of our subject-independent (or calibration-free) model outperforms that of subject-dependent models using various methods [common spatial pattern (CSP), common spatiospectral pattern (CSSP), filter bank CSP (FBCSP), and Bayesian spatio-spectral filter optimization (BSSFO)].
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Pan, S. J., & Yang, Q. (2010) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2009.191 · Cited by 23,387
Fully convolutional networks for semantic segmentation
Shelhamer, E., Long, J., & Darrell, T. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2572683 · Cited by 11,898
Learning Deep Features for Discriminative Localization
Zhou, B., Khosla, A., Lapedriza, A., Oliva, A., & Torralba, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.319 · Cited by 11,428
Peng, H., Long, F., & Ding, C. (2005) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2005.159 · Cited by 10,544
Deep learning with convolutional neural networks for EEG decoding and visualization
Schirrmeister, R. T., Springenberg, J. T., Fiederer, L. D. J., Glasstetter, M., Eggensperger, K., Tangermann, M., Hutter, F., Burgard, W., & Ball, T. (2017) · Human Brain Mapping · doi:10.1002/hbm.23730 · Cited by 3,751
Reach and grasp by people with tetraplegia using a neurally controlled robotic arm
Hochberg, L. R., Bacher, D., Jarosiewicz, B., Masse, N. Y., Simeral, J. D., Vogel, J., Haddadin, S., Liu, J., Cash, S. S., van der Smagt, P., et al. (2012) · Nature · doi:10.1038/nature11076 · Cited by 2,719
Convolutional Two-Stream Network Fusion for Video Action Recognition
Feichtenhofer, C., Pinz, A., & Zisserman, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.213 · Cited by 2,684
A review of classification algorithms for EEG-based brain–computer interfaces
Lotte, F., Congedo, M., Lécuyer, A., Lamarche, F., & Arnaldi, B. (2007) · Journal of Neural Engineering · doi:10.1088/1741-2560/4/2/r01 · Cited by 2,665 · cited 2×
“However, unfortunately, the process of calibration is an inconvenient and time-consuming task, which requires approximately 20–30 min for a reliable decoder to be built [24], [25].”
BackgroundOptimal spatial filtering of single trial EEG during imagined hand movement
Ramoser, H., Muller-Gerking, J., & Pfurtscheller, G. (2000) · IEEE Transactions on Rehabilitation Engineering · doi:10.1109/86.895946 · Cited by 2,457
Convolutional networks and applications in vision
LeCun, Y., Kavukcuoglu, K., & Farabet, C. (2010) · Proceedings of 2010 IEEE International Symposium on Circuits and Systems · doi:10.1109/iscas.2010.5537907 · Cited by 2,213 · cited 3×
“The whole CNN framework is trained to reduce the loss function by stochastic gradient descent [40]–[43].”
BackgroundMethodBrain Computer Interfaces, a Review
Nicolas-Alonso, L. F., & Gomez-Gil, J. (2012) · Sensors · doi:10.3390/s120201211 · Cited by 2,143
Motor imagery and direct brain-computer communication
Pfurtscheller, G., & Neuper, C. (2001) · Proceedings of the IEEE · doi:10.1109/5.939829 · Cited by 1,990
Deep Learning Face Representation by Joint Identification-Verification
Sun, Y., Wang, X., & Tang, X. (2014) · arXiv · doi:10.48550/arxiv.1406.4773 · Cited by 1,906
Deep Learning: Methods and Applications
Deng, L. (2014) · now publishers, Inc. eBooks · doi:10.1561/9781601988157 · Cited by 1,759
Filter Bank Common Spatial Pattern (FBCSP) in Brain-Computer Interface
Ang, K. K., Chin, Z. Y., Zhang, H., & Guan, C. (2008) · 2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence) · doi:10.1109/ijcnn.2008.4634130 · Cited by 1,514
Self-citationUnderstanding Neural Networks Through Deep Visualization
Yosinski, J., Clune, J., Nguyen, A. M., Fuchs, T. J., & Lipson, H. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1506.06579 · Cited by 1,358
Brain–machine interface in chronic stroke rehabilitation: A controlled study
Ramos‐Murguialday, A., Broetz, D., Rea, M., Läer, L., Yilmaz, Ö., Brasil, F. L., Liberati, G., Curado, M. R., Garcia‐Cossio, E., Vyziotis, A., et al. (2013) · Annals of Neurology · doi:10.1002/ana.23879 · Cited by 994
Blankertz, B., Dornhege, G., Krauledat, M., Müller, K.-R., & Curio, G. (2007) · NeuroImage · doi:10.1016/j.neuroimage.2007.01.051 · Cited by 946
A novel deep learning approach for classification of EEG motor imagery signals
Tabar, Y. R., & Halici, U. (2017) · Journal of Neural Engineering · doi:10.1088/1741-2560/14/1/016003 · Cited by 859
Neurophysiological predictor of SMR-based BCI performance
Blankertz, B., Sannelli, C., Halder, S., Hammer, E. M., Kübler, A., Müller, K.-R., Curio, G., & Dickhaus, T. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2010.03.022 · Cited by 674
Learning Temporal Information for Brain-Computer Interface Using Convolutional Neural Networks
Sakhavi, S., Guan, C., & Yan, S. (2018) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2018.2789927 · Cited by 656
Self-citationSpatio-spectral filters for improving the classification of single trial EEG
Lemm, S., Blankertz, B., Curio, G., & Muller, K.-R. (2005) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2005.851521 · Cited by 643
EEG dataset and OpenBMI toolbox for three BCI paradigms: an investigation into BCI illiteracy
Lee, M.-H., Kwon, O.-Y., Kim, Y.-J., Kim, H.-K., Lee, Y.-E., Williamson, J., Fazli, S., & Lee, S.-W. (2019) · GigaScience · doi:10.1093/gigascience/giz002 · Cited by 590
Self-citationLaFleur, K., Cassady, K., Doud, A., Shades, K., Rogin, E., & He, B. (2013) · Journal of Neural Engineering · doi:10.1088/1741-2560/10/4/046003 · Cited by 583 · cited 1×
“Over the course of numerous BCI studies [16]–[21], growing attention has been dedicated to the analysis of electroencephalography (EEG) signals, especially by movement imagination, called motor imagery (MI) [1], [2], [8], [12], [14], [16], [22].”
BackgroundLiu, J., Gong, M., Qin, K., & Zhang, P. (2018) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2016.2636227 · Cited by 522
Noninvasive Electroencephalogram Based Control of a Robotic Arm for Reach and Grasp Tasks
Meng, J., Zhang, S., Bekyo, A., Olsoe, J., Baxter, B., & He, B. (2016) · Scientific Reports · doi:10.1038/srep38565 · Cited by 484 · cited 1×
“Over the course of numerous BCI studies [16]–[21], growing attention has been dedicated to the analysis of electroencephalography (EEG) signals, especially by movement imagination, called motor imagery (MI) [1], [2], [8], [12], [14], [16], [22].”
BackgroundJayaram, V., Alamgir, M., Altun, Y., Scholkopf, B., & Grosse-Wentrup, M. (2016) · IEEE Computational Intelligence Magazine · doi:10.1109/mci.2015.2501545 · Cited by 468
A Deep Learning Scheme for Motor Imagery Classification based on Restricted Boltzmann Machines
Lu, N., Li, T., Ren, X., & Miao, H. (2017) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2016.2601240 · Cited by 419
Lotte, F. (2015) · Proceedings of the IEEE · doi:10.1109/jproc.2015.2404941 · Cited by 327
Toward Unsupervised Adaptation of LDA for Brain–Computer Interfaces
Vidaurre, C., Kawanabe, M., von Bünau, P., Blankertz, B., & Müller, K. R. (2011) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2010.2093133 · Cited by 296
Kwak, N.-S., Müller, K.-R., & Lee, S.-W. (2017) · PLOS ONE · doi:10.1371/journal.pone.0172578 · Cited by 272
Self-citationSubject-independent mental state classification in single trials
Fazli, S., Popescu, F., Danóczy, M., Blankertz, B., Müller, K.-R., & Grozea, C. (2009) · Neural Networks · doi:10.1016/j.neunet.2009.06.003 · Cited by 252
Invariant Common Spatial Patterns: Alleviating Nonstationarities in Brain-Computer Interfacing
Blankertz, B., Kawanabe, M., Tomioka, R., Hohlefeld, F. U., Nikulin, V. V., & Müller, K. R. (2008) · Publikationsdatenbank der Fraunhofer-Gesellschaft (Fraunhofer-Gesellschaft) · Cited by 251
Neurofeedback-based motor imagery training for brain–computer interface (BCI)
Hwang, H.-J., Kwon, K., & Im, C.-H. (2009) · Journal of Neuroscience Methods · doi:10.1016/j.jneumeth.2009.01.015 · Cited by 251
A Novel Bayesian Framework for Discriminative Feature Extraction in Brain-Computer Interfaces
Suk, H.-I., & Lee, S.-W. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.69 · Cited by 241
Self-citationTransferring Subspaces Between Subjects in Brain--Computer Interfacing
Samek, W., Meinecke, F. C., & Muller, K.-R. (2013) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2013.2253608 · Cited by 217
Brain–Computer Interface for Neurorehabilitation of Upper Limb After Stroke
Ang, K. K., & Guan, C. (2015) · Proceedings of the IEEE · doi:10.1109/jproc.2015.2415800 · Cited by 167
Self-citationCommanding a Brain-Controlled Wheelchair Using Steady-State Somatosensory Evoked Potentials
Kim, K.-T., Suk, H.-I., & Lee, S.-W. (2018) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2016.2597854 · Cited by 166
Self-citationA High Performance Spelling System based on EEG-EOG Signals With Visual Feedback
Lee, M.-H., Williamson, J., Won, D.-O., Fazli, S., & Lee, S.-W. (2018) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2018.2839116 · Cited by 163
Self-citationAn introduction to deep learning
Lauzon, F. Q. (2012) · International Conference on Information Science, Signal Processing and their Applications (ISSPA) · doi:10.1109/isspa.2012.6310529 · Cited by 157
Kim, J.-H., Bießmann, F., & Lee, S. (2014) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2014.2375879 · Cited by 138
Self-citationEffect of higher frequency on the classification of steady-state visual evoked potentials
Won, D.-O., Hwang, H., Dähne, S., Müller, K., & Lee, S. (2015) · Journal of Neural Engineering · doi:10.1088/1741-2560/13/1/016014 · Cited by 121
Self-citationLee, M.-H., Fazli, S., Mehnert, J., & Lee, S. (2015) · Pattern Recognition · doi:10.1016/j.patcog.2015.03.010 · Cited by 119
Self-citationBrain computer interface control via functional connectivity dynamics
Daly, I. P., Nasuto, S. J., & Warwick, K. (2011) · Pattern Recognition · doi:10.1016/j.patcog.2011.04.034 · Cited by 115
An Efficient ERP-Based Brain-Computer Interface Using Random Set Presentation and Face Familiarity
Yeom, S.-K., Fazli, S., Müller, K., & Lee, S. (2014) · PLoS ONE · doi:10.1371/journal.pone.0111157 · Cited by 113
Self-citationCecotti, H., Eckstein, M. P., & Giesbrecht, B. (2014) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2014.2302898 · Cited by 109
Multitask Learning for Brain-Computer Interfaces
Alamgir, M., Grosse‐Wentrup, M., & Altün, Y. (2010) · Max Planck Institute for Plasma Physics · Cited by 108
Local Temporal Common Spatial Patterns for Robust Single-Trial EEG Classification
Wang, H., & Zheng, W. (2008) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2007.914468 · Cited by 103
Learning to Predict Eye Fixations via Multiresolution Convolutional Neural Networks
Liu, N., Han, J.-W., Liu, T., & Li, X.-L. (2018) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2016.2628878 · Cited by 100
Carabalona, R., Grossi, F., Tessadri, A., Castiglioni, P., Caracciolo, A., & Munari, I. D. (2012) · Ergonomics · doi:10.1080/00140139.2012.661083 · Cited by 93
Comparison of designs towards a subject-independent brain-computer interface based on motor imagery
Lotte, F., Guan, C., & Ang, K. K. (2009) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/iembs.2009.5334126 · Cited by 88
Self-citationSharma, G., Friedenberg, D. A., Annetta, N. V., Glenn, B., Bockbrader, M. A., Majstorovic, C., Domas, S., Mysiw, W. J., Rezai, A. R., & Bouton, C. E. (2016) · Scientific Reports · doi:10.1038/srep33807 · Cited by 76
Arnold, L., Rebecchi, S., Chevallier, S., & Paugam‐Moisy, H. (2019) · The MIT Press eBooks · doi:10.7551/mitpress/11171.003.0004 · Cited by 66
Kwak, N.-S., & Lee, S. (2019) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2019.2924237 · Cited by 65
Self-citationA subject-independent brain-computer interface based on smoothed, second-order baselining
Reuderink, B., Farquhar, J. D. R., Poel, M., & Nijholt, A. (2011) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/iembs.2011.6091139 · Cited by 63
A subject-independent pattern-based Brain-Computer Interface
Ray, A. M., Sitaram, R., Rana, M., Pasqualotto, E., Buyukturkoglu, K., Guan, C., Ang, K. K., Cristián Tejos, N., Zamorano, F. J., Aboitiz, F., et al. (2015) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2015.00269 · Cited by 58
Self-citationFunctional Brain Connectivity as a New Feature for P300 Speller
Kabbara, A., Khalil, M. A., Falou, W. E., Eid, H., & Hassan, M. (2016) · PLoS ONE · doi:10.1371/journal.pone.0146282 · Cited by 49
Adaptive Multiclass Classification for Brain Computer Interfaces
Llera, A., Gómez, V., & Kappen, H. J. (2014) · Neural Computation · doi:10.1162/neco_a_00592 · Cited by 41
Single-trial effective brain connectivity patterns enhance discriminability of mental imagery tasks
Rathee, D., Cecotti, H., & Prasad, G. (2017) · Journal of Neural Engineering · doi:10.1088/1741-2552/aa785c · Cited by 41
Improving CNN Performance Accuracies With Min-Max Objective
Shi, W., Gong, Y., Tao, X., Wang, J., & Zheng, N. (2017) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2017.2705682 · Cited by 39
Development of an open source platform for brain-machine interface: openBMI
Lee, M.-H., Fazli, S., Kim, K.-T., & Lee, S. (2016) · International Winter Conference on Brain-Computer Interface (BCI) · doi:10.1109/iww-bci.2016.7457440 · Cited by 23
Self-citationMugruza-Vassallo, C. A., & Potter, D. D. (2019) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2019.00039 · Cited by 23
BCI Use and Its Relation to Adaptation in Cortical Networks
Casimo, K., Weaver, K. E., Wander, J. D., & Ojemann, J. G. (2017) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2017.2681963 · Cited by 22
Li, L., Huang, G., Lin, Q., Liu, J., Zhang, S., & Zhang, Z. (2018) · Frontiers in Neuroscience · doi:10.3389/fnins.2018.00340 · Cited by 18
A Novel Algorithm for Learning Sparse Spatio-Spectral Patterns for Event-Related Potentials
Wu, C., Lin, K. C., Wu, W., & Gao, X. (2016) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2015.2496284 · Cited by 17
Cited by
Altaheri, H., Muhammad, G., Alsulaiman, M., Amin, S. U., Altuwaijri, G. A., Abdul, W., Bencherif, M. A., & Faisal, M. (2023) · Neural Computing and Applications · doi:10.1007/s00521-021-06352-5 · Cited by 590
Deep learning for motor imagery EEG-based classification: A review
Al-Saegh, A., Dawwd, S. A., & Abdul-Jabbar, J. M. (2021) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2020.102172 · Cited by 437
TSception: Capturing Temporal Dynamics and Spatial Asymmetry From EEG for Emotion Recognition
Ding, Y., Robinson, N., Zhang, S., Zeng, Q., & Guan, C. (2023) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2022.3169001 · Cited by 428
Self-citationProgress in Brain Computer Interface: Challenges and Opportunities
Saha, S., Mamun, K. A., Ahmed, K., Mostafa, R., Naik, G. R., Darvishi, S., Khandoker, A. H., & Baumert, M. (2021) · Frontiers in Systems Neuroscience · doi:10.3389/fnsys.2021.578875 · Cited by 365
Past, Present, and Future of EEG-Based BCI Applications
Värbu, K., Muhammad, N., & Muhammad, Y. (2022) · Sensors · doi:10.3390/s22093331 · Cited by 321
Metadata
- Authors
- Kwon, O.-Y., Lee, M.-H., Guan, C., & Lee, S.-W.
- Venue
- IEEE Transactions on Neural Networks and Learning Systems
- Published
- 2020-10
- Volume
- 31
- Issue
- 10
- Pages
- 3839-3852
- ISSN
- 2162-237X (ISSN-L)
- 2162-2388
- OpenAlex
- W2986984881
- Cited by
- 347
- References
- 66
- FWCI
- 21.77
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.