Adaptive transfer learning for EEG motor imagery classification with deep Convolutional Neural Network
Open accessThe DOI matches its Crossref record; 46 of the 46 references it cites were found in a registry or an index.
Abstract
In recent years, deep learning has emerged as a powerful tool for developing Brain-Computer Interface (BCI) systems. However, for deep learning models trained entirely on the data from a specific individual, the performance increase has only been marginal owing to the limited availability of subject-specific data. To overcome this, many transfer-based approaches have been proposed, in which deep networks are trained using pre-existing data from other subjects and evaluated on new target subjects. This mode of transfer learning however faces the challenge of substantial inter-subject variability in brain data. Addressing this, in this paper, we propose 5 schemes for adaptation of a deep convolutional neural network (CNN) based electroencephalography (EEG)-BCI system for decoding hand motor imagery (MI). Each scheme fine-tunes an extensively trained, pre-trained model and adapt it to enhance the evaluation performance on a target subject. We report the highest subject-independent performance with an average (N=54) accuracy of 84.19% (±9.98%) for two-class motor imagery, while the best accuracy on this dataset is 74.15% (±15.83%) in the literature. Further, we obtain a statistically significant improvement (p=0.005) in classification using the proposed adaptation schemes compared to the baseline subject-independent model.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
(2014) · Cited by 33,419
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S., & Szegedy, C. (2015) · arXiv · doi:10.48550/arxiv.1502.03167 · Cited by 27,818
Goldberger, A. L., Amaral, L. A. N., Glass, L., Hausdorff, J. M., Ivanov, P. C., Mark, R. G., Mietus, J. E., Moody, G. B., Peng, C.-K., & Stanley, H. E. (2000) · Circulation · doi:10.1161/01.cir.101.23.e215 · Cited by 14,809
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S. (2024) · arXiv (Cornell University) · doi:10.57702/o9raffed · Cited by 14,214
Decoupled Weight Decay Regularization
Loshchilov, I., & Hutter, F. (2017) · arXiv · doi:10.48550/arxiv.1711.05101 · Cited by 12,522
Brain–computer interfaces for communication and control
Wolpaw, J. R., Birbaumer, N., McFarland, D. J., Pfurtscheller, G., & Vaughan, T. M. (2002) · Clinical Neurophysiology · doi:10.1016/s1388-2457(02)00057-3 · Cited by 7,927
Event-related EEG/MEG synchronization and desynchronization: basic principles
Pfurtscheller, G., & Lopes da Silva, F. H. (1999) · Clinical Neurophysiology · doi:10.1016/s1388-2457(99)00141-8 · Cited by 7,328
SGDR: Stochastic Gradient Descent with Warm Restarts
Loshchilov, I., & Hutter, F. (2016) · arXiv · doi:10.48550/arxiv.1608.03983 · Cited by 5,309
EEGNet: a compact convolutional neural network for EEG-based brain-computer interfaces
Lawhern, V. J., Solon, A. J., Waytowich, N. R., Gordon, S. M., Hung, C. P., & Lance, B. J. (2018) · Journal of Neural Engineering · doi:10.1088/1741-2552/aace8c · Cited by 5,115
EEGNet: A Compact Convolutional Network for EEG-based Brain-Computer Interfaces
Lawhern, V. J., Solon, A. J., Waytowich, N. R., Gordon, S. M., Hung, C. P., & Lance, B. J. (2016) · arXiv · doi:10.48550/arxiv.1611.08024 · Cited by 5,105
Deep learning with convolutional neural networks for EEG decoding and visualization
Schirrmeister, R. T., Springenberg, J. T., Fiederer, L. D. J., Glasstetter, M., Eggensperger, K., Tangermann, M., Hutter, F., Burgard, W., & Ball, T. (2017) · Human Brain Mapping · doi:10.1002/hbm.23730 · Cited by 3,751
Region-based convolutional networks for accurate object detection and segmentation
Girshick, R., Donahue, J., Darrell, T., & Malik, J. (2016) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2437384 · Cited by 2,912
Learning Important Features Through Propagating Activation Differences
Shrikumar, A., Greenside, P., & Kundaje, A. (2017) · arXiv · doi:10.48550/arxiv.1704.02685 · Cited by 2,761
A review of classification algorithms for EEG-based brain–computer interfaces
Lotte, F., Congedo, M., Lécuyer, A., Lamarche, F., & Arnaldi, B. (2007) · Journal of Neural Engineering · doi:10.1088/1741-2560/4/2/r01 · Cited by 2,665
Unsupervised Domain Adaptation by Backpropagation
Ganin, Y., & Lempitsky, V. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1409.7495 · Cited by 2,521
Optimal spatial filtering of single trial EEG during imagined hand movement
Ramoser, H., Muller-Gerking, J., & Pfurtscheller, G. (2000) · IEEE Transactions on Rehabilitation Engineering · doi:10.1109/86.895946 · Cited by 2,457
Optimizing Spatial filters for Robust EEG Single-Trial Analysis
Blankertz, B., Tomioka, R., Lemm, S., Kawanabe, M., & Muller, K.-R. (2008) · IEEE Signal Processing Magazine · doi:10.1109/msp.2008.4408441 · Cited by 2,080
Return of Frustratingly Easy Domain Adaptation
Sun, B., Feng, J., & Saenko, K. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v30i1.10306 · Cited by 2,004
Motor imagery and direct brain-computer communication
Pfurtscheller, G., & Neuper, C. (2001) · Proceedings of the IEEE · doi:10.1109/5.939829 · Cited by 1,990
Deep learning for electroencephalogram (EEG) classification tasks: a review
Craik, A., He, Y., & Contreras-Vidal, J. L. (2019) · Journal of Neural Engineering · doi:10.1088/1741-2552/ab0ab5 · Cited by 1,758
Filter Bank Common Spatial Pattern (FBCSP) in Brain-Computer Interface
Ang, K. K., Chin, Z. Y., Zhang, H., & Guan, C. (2008) · 2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence) · doi:10.1109/ijcnn.2008.4634130 · Cited by 1,514
Self-citationReview of the BCI Competition IV
Tangermann, M., Müller, K.-R., Aertsen, A., Birbaumer, N., Braun, C., Brunner, C., Leeb, R., Mehring, C., Miller, K. J., Müller-Putz, G. R., et al. (2012) · Frontiers in Neuroscience · doi:10.3389/fnins.2012.00055 · Cited by 1,288
Deep Reconstruction-Classification Networks for Unsupervised Domain Adaptation
Ghifary, M., Kleijn, W. B., Zhang, M., Balduzzi, D., & Li, W. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46493-0_36 · Cited by 877
Learning Temporal Information for Brain-Computer Interface Using Convolutional Neural Networks
Sakhavi, S., Guan, C., & Yan, S. (2018) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2018.2789927 · Cited by 656
Self-citationSpatio-spectral filters for improving the classification of single trial EEG
Lemm, S., Blankertz, B., Curio, G., & Muller, K.-R. (2005) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2005.851521 · Cited by 643
EEG dataset and OpenBMI toolbox for three BCI paradigms: an investigation into BCI illiteracy
Lee, M.-H., Kwon, O.-Y., Kim, Y.-J., Kim, H.-K., Lee, Y.-E., Williamson, J., Fazli, S., & Lee, S.-W. (2019) · GigaScience · doi:10.1093/gigascience/giz002 · Cited by 590
Self-citationBeyond Sharing Weights for Deep Domain Adaptation
Rozantsev, A., Salzmann, M., & Fua, P. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2814042 · Cited by 462
2020 IEEE International Conference on Systems, Man, and Cybernetics
(2018) · IEEE Systems, Man, and Cybernetics Magazine · doi:10.1109/msmc.2017.2769262 · Cited by 392
Subject-Independent Brain–Computer Interfaces Based on Deep Convolutional Neural Networks
Kwon, O.-Y., Lee, M.-H., Guan, C., & Lee, S.-W. (2020) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2019.2946869 · Cited by 347
Self-citationFahimi, F., Zhang, Z., Goh, W. B., Lee, T.-S., Ang, K. K., & Guan, C. (2019) · Journal of Neural Engineering · doi:10.1088/1741-2552/aaf3f6 · Cited by 264
Self-citationOn the existence of different types of central beta rhythms below 30 Hz
Pfurtscheller, G., Stancák, A., & Edlinger, G. (1997) · Electroencephalography and Clinical Neurophysiology · doi:10.1016/s0013-4694(96)96612-2 · Cited by 242
A Novel Bayesian Framework for Discriminative Feature Extraction in Brain-Computer Interfaces
Suk, H.-I., & Lee, S.-W. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.69 · Cited by 241
Self-citationRiemannian Procrustes Analysis: Transfer Learning for Brain–Computer Interfaces
Rodrigues, P. L. C., Jutten, C., & Congedo, M. (2019) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2018.2889705 · Cited by 219
Manifold Embedded Knowledge Transfer for Brain-Computer Interfaces
Zhang, W., & Wu, D. (2020) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2020.2985996 · Cited by 183
A Survey on Deep Learning based Brain Computer Interface: Recent Advances and New FrontiersPreprint
Zhang, X., Yao, L., Wang, X., Monaghan, J. J. M., & McAlpine, D. (2018) · arXiv (Cornell University) · doi:10.13140/rg.2.2.31039.36001 · Cited by 155
Adaptive learning with covariate shift-detection for motor imagery-based brain–computer interface
Raza, H., Cecotti, H., Li, Y., & Prasad, G. (2015) · Soft Computing · doi:10.1007/s00500-015-1937-5 · Cited by 134
Cross-Dataset Variability Problem in EEG Decoding With Deep Learning
Xu, L., Xu, M., Ke, Y., An, X., Liu, S., & Ming, D. (2020) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2020.00103 · Cited by 129
EEG Data Space Adaptation to Reduce Intersession Nonstationarity in Brain-Computer Interface
Arvaneh, M., Guan, C., Ang, K. K., & Quek, C. H. (2013) · Neural Computation · doi:10.1162/neco_a_00474 · Cited by 99
Self-citationSakhavi, S., & Guan, C. (2017) · International IEEE/EMBS Conference on Neural Engineering · doi:10.1109/ner.2017.8008420 · Cited by 86
Self-citationDynamically weighted ensemble classification for non-stationary EEG processing
Liyanage, S. R., Guan, C., Zhang, H., Ang, K. K., Xu, J., & Lee, T. H. (2013) · Journal of Neural Engineering · doi:10.1088/1741-2560/10/3/036007 · Cited by 72
Self-citationLeveraging anatomical information to improve transfer learning in brain–computer interfaces
Wronkiewicz, M., Larson, E. B., & Lee, A. K. C. (2015) · Journal of Neural Engineering · doi:10.1088/1741-2560/12/4/046027 · Cited by 40
EEG Representation in Deep Convolutional Neural Networks for Classification of Motor Imagery
Robinson, N., Lee, S., & Guan, C. (2019) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/smc.2019.8914184 · Cited by 38
Self-citationAzab, A. M., Ahmadi, H., Mihaylova, L. S., & Arvaneh, M. (2019) · Journal of Neural Engineering · doi:10.1088/1741-2552/ab64a0 · Cited by 36
8th International IEEE EMBS Conference on Neural Engineering
(2017) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2017.2663202 · Cited by 5
Cited by
Altaheri, H., Muhammad, G., Alsulaiman, M., Amin, S. U., Altuwaijri, G. A., Abdul, W., Bencherif, M. A., & Faisal, M. (2023) · Neural Computing and Applications · doi:10.1007/s00521-021-06352-5 · Cited by 590
EEG Dataset for RSVP and P300 Speller Brain-Computer Interfaces
Won, K., Kwon, M., Ahn, M., & Jun, S. C. (2022) · Scientific Data · doi:10.1038/s41597-022-01509-w · Cited by 68
Metadata
- Authors
- Zhang, K., Robinson, N., Lee, S.-W., & Guan, C.
- Venue
- Neural Networks
- Publisher
- Elsevier BV
- Published
- 2021-04
- Volume
- 136
- Pages
- 1-10
- ISSN
- 0893-6080 (ISSN-L)
- OpenAlex
- W3115305254
- Cited by
- 284
- References
- 46
- FWCI
- 17.53
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.