The DOI matches its Crossref record; 49 of the 49 references it cites were found in a registry or an index.
Inter-subject transfer learning with an end-to-end deep convolutional neural network for EEG-based BCI
Open accessAbstract
OBJECTIVE: Despite the effective application of deep learning (DL) in brain-computer interface (BCI) systems, the successful execution of this technique, especially for inter-subject classification, in cognitive BCI has not been accomplished yet. In this paper, we propose a framework based on the deep convolutional neural network (CNN) to detect the attentive mental state from single-channel raw electroencephalography (EEG) data. APPROACH: We develop an end-to-end deep CNN to decode the attentional information from an EEG time series. We also explore the consequences of input representations on the performance of deep CNN by feeding three different EEG representations into the network. To ensure the practical application of the proposed framework and avoid time-consuming re-training, we perform inter-subject transfer learning techniques as a classification strategy. Eventually, to interpret the learned attentional patterns, we visualize and analyse the network perception of the attention and non-attention classes. MAIN RESULTS: The average classification accuracy is 79.26%, with only 15.83% of 120 subjects having an accuracy below 70% (a generally accepted threshold for BCI). This is while with the inter-subject approach, it is literally difficult to output high classification accuracy. This end-to-end classification framework surpasses conventional classification methods for attention detection. The visualization results demonstrate that the learned patterns from the raw data are meaningful. SIGNIFICANCE: This framework significantly improves attention detection accuracy with inter-subject classification. Moreover, this study sheds light on the research on end-to-end learning; the proposed network is capable of learning from raw data with the least amount of pre-processing, which in turn eliminates the extensive computational load of time-consuming data preparation and feature extraction.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805 · cited 1×
“The early convolutional neural network (LeNet-5) introduced by LeCun [40], was composed of a sequence of convolution and pooling layers.”
Method(2014) · Cited by 33,419
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S., & Szegedy, C. (2015) · arXiv · doi:10.48550/arxiv.1502.03167 · Cited by 27,818 · cited 1×
“Since then, numerous attempts have been made to upgrade the CNNs through some extensions, such as batch normalization [41] and dropout [42], in order to accelerate training, avoid over-fitting and better preserve the information.”
BackgroundGAN(Generative Adversarial Nets)
(2017) · Journal of Japan Society for Fuzzy Theory and Intelligent Informatics · doi:10.3156/jsoft.29.5_177_2 · Cited by 19,270
Studies of interference in serial verbal reactions
Stroop, J. R. (1935) · Journal of Experimental Psychology · doi:10.1037/h0054651 · Cited by 18,622
A fast learning algorithm for deep belief nets
Hinton, G. E., Osindero, S., & Teh, Y.-W. (2006) · Neural Computation · doi:10.1162/neco.2006.18.7.1527 · Cited by 16,336
Half a century of research on the Stroop effect: An integrative review.
MacLeod, C. M. (1991) · Psychological Bulletin · doi:10.1037/0033-2909.109.2.163 · Cited by 5,500
The Organization of Behavior; A Neuropsychological Theory.
Attneave, F., B., M., & Hebb, D. O. (1950) · The American Journal of Psychology · doi:10.2307/1418888 · Cited by 5,146
The Organization of Behavior: A Neuropsychological Theory
(1950) · Journal of the American Medical Association · doi:10.1001/jama.1950.02910470083028 · Cited by 4,195
EEG alpha oscillations: The inhibition–timing hypothesis
Klimesch, W., Sauseng, P., & Hanslmayr, S. (2007) · Brain Research Reviews · doi:10.1016/j.brainresrev.2006.06.003 · Cited by 3,891
Deep learning with convolutional neural networks for EEG decoding and visualization
Schirrmeister, R. T., Springenberg, J. T., Fiederer, L. D. J., Glasstetter, M., Eggensperger, K., Tangermann, M., Hutter, F., Burgard, W., & Ball, T. (2017) · Human Brain Mapping · doi:10.1002/hbm.23730 · Cited by 3,751
Alpha-band oscillations, attention, and controlled access to stored information
Klimesch, W. (2012) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2012.10.007 · Cited by 3,310
Brain Computer Interfaces, a Review
Nicolas-Alonso, L. F., & Gomez-Gil, J. (2012) · Sensors · doi:10.3390/s120201211 · Cited by 2,143
A Critical Review of Recurrent Neural Networks for Sequence Learning
Lipton, Z. C., Berkowitz, J. A., & Elkan, C. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1506.00019 · Cited by 1,996
Filter Bank Common Spatial Pattern Algorithm on BCI Competition IV Datasets 2a and 2b
Ang, K. K., Chin, Z. Y., Wang, C., Guan, C., & Zhang, H. (2012) · Frontiers in Neuroscience · doi:10.3389/fnins.2012.00039 · Cited by 1,264
Self-citationBrain–Computer InterfacesPrinciples and Practice
Wolpaw, J., & Wolpaw, E. W. (2012) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780195388855.001.0001 · Cited by 1,104
A novel deep learning approach for classification of EEG motor imagery signals
Tabar, Y. R., & Halici, U. (2017) · Journal of Neural Engineering · doi:10.1088/1741-2560/14/1/016003 · Cited by 859
Executive Function: The Search for an Integrated Account
Banich, M. T. (2009) · Current Directions in Psychological Science · doi:10.1111/j.1467-8721.2009.01615.x · Cited by 840
MacLeod, C. M., & MacDonald, P. A. (2000) · Trends in Cognitive Sciences · doi:10.1016/s1364-6613(00)01530-8 · Cited by 694
Learning Temporal Information for Brain-Computer Interface Using Convolutional Neural Networks
Sakhavi, S., Guan, C., & Yan, S. (2018) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2018.2789927 · Cited by 656
Self-citationA Decade of EEG Theta/Beta Ratio Research in ADHD: A Meta-Analysis
Arns, M., Conners, C. K., & Kraemer, H. C. (2013) · Journal of Attention Disorders · doi:10.1177/1087054712460087 · Cited by 608
The Stroop phenomenon and its use in the stlldy of perceptual, cognitive, and response processes
Dyer, F. N. (1973) · Memory & Cognition · doi:10.3758/bf03198078 · Cited by 526
Towards a cure for BCI illiteracy
Vidaurre, C., & Blankertz, B. (2010) · Brain Topography · doi:10.1007/s10548-009-0121-6 · Cited by 501 · cited 3×
“To evaluate the performance of proposed framework in the case of subjects with poor performance at baseline, we consider a threshold accuracy at 70% [44, 45].”
BackgroundMethodJirayucharoensak, S., Pan-Ngum, S., & Israsena, P. (2014) · The Scientific World Journal · doi:10.1155/2014/627892 · Cited by 486
Towards adaptive classification for BCI
Shenoy, P., Krauledat, M., Blankertz, B., Rao, R. P. N., & Müller, K.-R. (2006) · Journal of Neural Engineering · doi:10.1088/1741-2560/3/1/r02 · Cited by 438
A Deep Learning Scheme for Motor Imagery Classification based on Restricted Boltzmann Machines
Lu, N., Li, T., Ren, X., & Miao, H. (2017) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2016.2601240 · Cited by 419
Recognizing the Degree of Human Attention Using EEG Signals from Mobile Sensors
Liu, N.-H., Chiang, C.-Y., & Chu, H.-C. (2013) · Sensors · doi:10.3390/s130810273 · Cited by 410
The role of alpha oscillations in temporal attention
Hanslmayr, S., Gross, J., Klimesch, W., & Shapiro, K. L. (2011) · Brain Research Reviews · doi:10.1016/j.brainresrev.2011.04.002 · Cited by 403
Interpretable deep neural networks for single-trial EEG classification
Sturm, I., Lapuschkin, S., Samek, W., & Müller, K.-R. (2016) · Journal of Neuroscience Methods · doi:10.1016/j.jneumeth.2016.10.008 · Cited by 374
Lim, C. G., Lee, T. S., Guan, C., Fung, D. S. S., Zhao, Y., Teng, S. S. W., Zhang, H., & Krishnan, K. R. R. (2012) · PLoS ONE · doi:10.1371/journal.pone.0046692 · Cited by 214
Self-citationBeta band oscillations engagement in human alertness process
Kamiński, J., Brzezicka, A., Gola, M., & Wróbel, A. (2012) · International Journal of Psychophysiology · doi:10.1016/j.ijpsycho.2011.11.006 · Cited by 200
Predictability of Brain-Computer Communication
Kübler, A., Neumann, N., Wilhelm, B., Hinterberger, T., & Birbaumer, N. (2004) · Journal of Psychophysiology · doi:10.1027/0269-8803.18.23.121 · Cited by 170
Lee, T.-S. W., Goh, S. J. A., Quek, S. Y., Phillips, R., Guan, C., Cheung, Y. B., Feng, L., Teng, S. S. W., Wang, C. C., Chin, Z. Y., et al. (2013) · PLoS ONE · doi:10.1371/journal.pone.0079419 · Cited by 129
Self-citationResting EEG in alpha and beta bands predicts individual differences in attentional blink magnitude
MacLean, M. H., Arnell, K. M., & Côté, K. A. (2012) · Brain and Cognition · doi:10.1016/j.bandc.2011.12.010 · Cited by 127
Brain-computer interfacing using modulations of alpha activity induced by covert shifts of attention
Treder, M. S., Bahramisharif, A., Schmidt, N. M., van Gerven, M. A. J., & Blankertz, B. (2011) · Journal of NeuroEngineering and Rehabilitation · doi:10.1186/1743-0003-8-24 · Cited by 122
Deep EEG super-resolution: Upsampling EEG spatial resolution with Generative Adversarial Networks
Corley, I., & Huang, Y. (2018) · IEEE-EMBS International Conference on Biomedical and Health Informatics (BHI ...) · doi:10.1109/bhi.2018.8333379 · Cited by 111
Learning EEG-based spectral-spatial patterns for attention level measurement
Hamadicharef, B., Zhang, H., Guan, C., Wang, C., Phua, K. S., Tee, K. P., & Ang, K. K. (2009) · IEEE International Symposium on Circuits and Systems proceedings · doi:10.1109/iscas.2009.5118043 · Cited by 94
Self-citationThe extraction of motion-onset VEP BCI features based on deep learning and compressed sensing
Ma, T., Li, Y., Yang, H., Lv, X., Li, P., Liu, T., Yao, D., & Xu, P. (2016) · Journal of Neuroscience Methods · doi:10.1016/j.jneumeth.2016.11.002 · Cited by 81
Tuning Up the Old Brain with New Tricks: Attention Training via Neurofeedback
Jiang, Y., Abiri, R., & Zhao, X. (2017) · Frontiers in Aging Neuroscience · doi:10.3389/fnagi.2017.00052 · Cited by 81
A deep learning scheme for mental workload classification based on restricted Boltzmann machines
Zhang, J., & Li, S. (2017) · Cognition Technology & Work · doi:10.1007/s10111-017-0430-6 · Cited by 33
Cognitive ability assessment by Brain–Computer Interface
Perego, P., Turconi, A. C., Andreoni, G., Maggi, L., Beretta, E., Parini, S., & Gagliardi, C. (2011) · Journal of Neuroscience Methods · doi:10.1016/j.jneumeth.2011.06.025 · Cited by 26
Fahimi, F., Guan, C., Goh, W. B., Ang, K. K., Lim, C. G., & Lee, T.-S. W. (2017) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc.2017.8036850 · Cited by 17
Self-citationCharacterizing Computer Access Using a One-Channel EEG Wireless Sensor
Molina-Cantero, A. J., Guerrero-Cubero, J., Gómez, I., Merino-Monge, M., & Silva-Silva, J. (2017) · Sensors · doi:10.3390/s17071525 · Cited by 13
Lim, S. K., Choi, S. H., Shin, H., Cho, B. J., Park, H. S., Ahn, B. Y., Kang, S. M., Yoon, J. W., Jang, H. C., Kim, Y., et al. (2012) · PLoS ONE · doi:10.1371/annotation/f0a21e28-7f3c-4b76-870e-128dd89d0e29 · Cited by 13
Deep Convolutional Neural Network for the Detection of Attentive Mental State in Elderly
Fahimi, F., Zhang, Z., Lee, T.-S. W., et al. (2018) · Cited by 5
Self-citation
Cited by
Deep learning for electroencephalogram (EEG) classification tasks: a review
Craik, A., He, Y., & Contreras-Vidal, J. L. (2019) · Journal of Neural Engineering · doi:10.1088/1741-2552/ab0ab5 · Cited by 1,758
A review on transfer learning in EEG signal analysis
Wan, Z., Yang, R., Huang, M., Zeng, N., & Liu, X. (2021) · Neurocomputing · doi:10.1016/j.neucom.2020.09.017 · Cited by 468
Transfer Learning for EEG-Based Brain–Computer Interfaces: A Review of Progress Made Since 2016
Wu, D., Xu, Y., & Lu, B.-L. (2022) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2020.3007453 · Cited by 434
TSception: Capturing Temporal Dynamics and Spatial Asymmetry From EEG for Emotion Recognition
Ding, Y., Robinson, N., Zhang, S., Zeng, Q., & Guan, C. (2023) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2022.3169001 · Cited by 428
Self-citationData augmentation for deep-learning-based electroencephalography
Lashgari, E., Liang, D., & Maoz, U. (2020) · Journal of Neuroscience Methods · doi:10.1016/j.jneumeth.2020.108885 · Cited by 398
Metadata
- Authors
- Fahimi, F., Zhang, Z., Goh, W. B., Lee, T.-S., Ang, K. K., & Guan, C.
- Venue
- Journal of Neural Engineering
- Publisher
- IOP Publishing
- Published
- 2019-01-23
- Volume
- 16
- Issue
- 2
- Pages
- 026007
- ISSN
- 1741-2552 (ISSN-L)
- 1741-2560
- OpenAlex
- W2902034646
- Cited by
- 264
- References
- 49
- FWCI
- 13.14
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.