Optimizing Layers Improves CNN Generalization and Transfer Learning for Imagined Speech Decoding from EEG
The DOI matches its Crossref record; 8 of the 8 references it cites were found in a registry or an index.
Abstract
A brain-computer interface (BCI) that employs imagined speech as the mode of determining user intent requires strong generalizability for a feasible system to be realized. Research in this field has typically applied data to training algorithms on a within-subject basis. However, even within-subject training and test data are not always of the same feature space and distribution. Such scenarios can contribute to poor BCI performance, and real-world applications for imagined speech-based BCIs cannot assume homogeneity in user data. Transfer Learning (TL) is a common approach used to improve generalizability in machine learning models through transfer of knowledge from a source domain to a target task. In this study, two distinct TL methodologies are employed to classify EEG data corresponding to imagined speech production of vowels, using a deep convolutional neural network (CNN). Both TL approaches involved conditional training of the CNN on all subjects, excluding the target subject. A subset of the target subject data was then used to fine-tune either the input or output layers of the CNN. Results were compared with a standard benchmark using a within-subject approach. Both TL methods significantly outperformed the baseline and fine-tuning of the input layers resulted in the highest overall accuracy (35.68%; chance: 20%).
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
EEGNet: a compact convolutional neural network for EEG-based brain-computer interfaces
Lawhern, V. J., Solon, A. J., Waytowich, N. R., Gordon, S. M., Hung, C. P., & Lance, B. J. (2018) · Journal of Neural Engineering · doi:10.1088/1741-2552/aace8c · Cited by 5,115 · cited 1×
“EEGNet is a CNN designed to minimize the number of parameters required while retaining strong performance across EEG paradigms [13].”
BackgroundEEGNet: A Compact Convolutional Network for EEG-based Brain-Computer Interfaces
Lawhern, V. J., Solon, A. J., Waytowich, N. R., Gordon, S. M., Hung, C. P., & Lance, B. J. (2016) · arXiv · doi:10.48550/arxiv.1611.08024 · Cited by 5,105
Universal Language Model Fine-tuning for Text Classification
Howard, J., & Ruder, S. (2018) · Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p18-1031 · Cited by 4,100 · cited 1×
“Techniques with potential benefits include fine-tuning a randomly-weighted softmax classifier with a pre-trained network [29] and gradual unfreezing of layers aimed at preserving low-level, and adapting, high level features [30].”
BackgroundDeep learning with convolutional neural networks for EEG decoding and visualization
Schirrmeister, R. T., Springenberg, J. T., Fiederer, L. D. J., Glasstetter, M., Eggensperger, K., Tangermann, M., Hutter, F., Burgard, W., & Ball, T. (2017) · Human Brain Mapping · doi:10.1002/hbm.23730 · Cited by 3,751
Filter Bank Common Spatial Pattern (FBCSP) in Brain-Computer Interface
Ang, K. K., Chin, Z. Y., Zhang, H., & Guan, C. (2008) · 2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence) · doi:10.1109/ijcnn.2008.4634130 · Cited by 1,514
Automated EEG-based screening of depression using deep convolutional neural network
Acharya, U. R., Oh, S. L., Hagiwara, Y., Tan, J. H., Adeli, H., & Subha, D. P. (2018) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2018.04.012 · Cited by 650
Jiang, Y., Wu, D., Deng, Z., Qian, P., Wang, J., Wang, G., Chung, F.-L., Choi, K.-S., & Wang, S. (2017) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2017.2748388 · Cited by 221
Cited by
Decoding Covert Speech From EEG-A Comprehensive Review
Panachakel, J. T., & Ramakrishnan, A. G. (2021) · Frontiers in Neuroscience · doi:10.3389/fnins.2021.642251 · Cited by 156
“Transfer learning (TL) is used in García-Salinas et al. (2019) and Cooney et al. (2019) for improving the performance of the classifier.”
BackgroundData augmentation for motor imagery signal classification based on a hybrid neural network.
Zhang, K., Xu, G., Han, Z., Ma, K., Zheng, X., Chen, L., Duan, N., & Zhang, S. (2020) · Sensors · doi:10.3390/s20164485 · Cited by 130
A State-of-the-Art Review of EEG-Based Imagined Speech Decoding
Lopez-Bernal, D., Balderas, D., Ponce, P., & Molina, A. (2022) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2022.867281 · Cited by 107
“In the works done by Saha et al. (2019a,b) they used channel cross-covariance (CCV) for pre-processing; while in Cooney et al. (2019) they employed independent component analysis (ICA).”
BackgroundMethodInfluentialSimistira Liwicki, F., Gupta, V., Saini, R., De, K., Abid, N., Rakesh, S., Wellington, S., Wilson, H., Liwicki, M., & Eriksson, J. (2023) · Scientific Data · doi:10.1038/s41597-023-02286-w · Cited by 28
Metadata
- Authors
- Cooney, C., Folli, R., & Coyle, D.
- Venue
- 2019 IEEE International Conference on Systems, Man and Cybernetics (SMC)
- Publisher
- IEEE
- Published
- 2019-10
- Pages
- 1311-1316
- ISSN
- 1062-922X (ISSN-L)
- OpenAlex
- W2991515203
- Cited by
- 95
- References
- 8
- FWCI
- 19.65
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.