Interpretable and lightweight convolutional neural network for EEG decoding: Application to movement execution and imagination
Open accessThe DOI matches its Crossref record; 32 of the 32 references it cites were found in a registry or an index.
Abstract
Convolutional neural networks (CNNs) are emerging as powerful tools for EEG decoding: these techniques, by automatically learning relevant features for class discrimination, improve EEG decoding performances without relying on handcrafted features. Nevertheless, the learned features are difficult to interpret and most of the existing CNNs introduce many trainable parameters. Here, we propose a lightweight and interpretable shallow CNN (Sinc-ShallowNet), by stacking a temporal sinc-convolutional layer (designed to learn band-pass filters, each having only the two cut-off frequencies as trainable parameters), a spatial depthwise convolutional layer (reducing channel connectivity and learning spatial filters tied to each band-pass filter), and a fully-connected layer finalizing the classification. This convolutional module limits the number of trainable parameters and allows direct interpretation of the learned spectral-spatial features via simple kernel visualizations. Furthermore, we designed a post-hoc gradient-based technique to enhance interpretation by identifying the more relevant and more class-specific features. Sinc-ShallowNet was evaluated on benchmark motor-execution and motor-imagery datasets and against different design choices and training strategies. Results show that (i) Sinc-ShallowNet outperformed a traditional machine learning algorithm and other CNNs for EEG decoding; (ii) The learned spectral-spatial features matched well-known EEG motor-related activity; (iii) The proposed architecture performed better with a larger number of temporal kernels still maintaining a good compromise between accuracy and parsimony, and with a trialwise rather than a cropped training strategy. In perspective, the proposed approach, with its interpretative capacity, can be exploited to investigate cognitive/motor aspects whose EEG correlates are yet scarcely known, potentially characterizing their relevant features.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing
Benjamini, Y., & Hochberg, Y. (1995) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1995.tb02031.x · Cited by 109,482
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Xception: Deep Learning with Depthwise Separable Convolutions
Chollet, F. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.195 · Cited by 20,380
Event-related EEG/MEG synchronization and desynchronization: basic principles
Pfurtscheller, G., & Lopes da Silva, F. H. (1999) · Clinical Neurophysiology · doi:10.1016/s1388-2457(99)00141-8 · Cited by 7,328
Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Maps
Simonyan, K., Vedaldi, A., & Zisserman, A. (2013) · arXiv · doi:10.48550/arxiv.1312.6034 · Cited by 5,370
EEGNet: a compact convolutional neural network for EEG-based brain-computer interfaces
Lawhern, V. J., Solon, A. J., Waytowich, N. R., Gordon, S. M., Hung, C. P., & Lance, B. J. (2018) · Journal of Neural Engineering · doi:10.1088/1741-2552/aace8c · Cited by 5,115
EEGNet: A Compact Convolutional Network for EEG-based Brain-Computer Interfaces
Lawhern, V. J., Solon, A. J., Waytowich, N. R., Gordon, S. M., Hung, C. P., & Lance, B. J. (2016) · arXiv · doi:10.48550/arxiv.1611.08024 · Cited by 5,105
Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs)
Clevert, D.-A., Unterthiner, T., & Hochreiter, S. (2015) · arXiv · doi:10.48550/arxiv.1511.07289 · Cited by 4,513
Deep learning with convolutional neural networks for EEG decoding and visualization
Schirrmeister, R. T., Springenberg, J. T., Fiederer, L. D. J., Glasstetter, M., Eggensperger, K., Tangermann, M., Hutter, F., Burgard, W., & Ball, T. (2017) · Human Brain Mapping · doi:10.1002/hbm.23730 · Cited by 3,751
A well-conditioned estimator for large-dimensional covariance matrices
Ledoit, O., & Wolf, M. (2004) · Journal of Multivariate Analysis · doi:10.1016/s0047-259x(03)00096-4 · Cited by 3,046
Methods for interpreting and understanding deep neural networks
Montavon, G., Samek, W., & Müller, K.-R. (2018) · Digital Signal Processing · doi:10.1016/j.dsp.2017.10.011 · Cited by 2,665
A review of classification algorithms for EEG-based brain–computer interfaces: A 10 year update
Lotte, F., Bougrain, L., Cichocki, A., Clerc, M., Congedo, M., Rakotomamonjy, A., & Yger, F. (2018) · Journal of Neural Engineering · doi:10.1088/1741-2552/aab2f2 · Cited by 2,239
Optimizing Spatial filters for Robust EEG Single-Trial Analysis
Blankertz, B., Tomioka, R., Lemm, S., Kawanabe, M., & Muller, K.-R. (2008) · IEEE Signal Processing Magazine · doi:10.1109/msp.2008.4408441 · Cited by 2,080
Deep learning-based electroencephalography analysis: a systematic review
Roy, Y., Banville, H., Albuquerque, I., Gramfort, A., Falk, T. H., & Faubert, J. (2019) · Journal of Neural Engineering · doi:10.1088/1741-2552/ab260c · Cited by 1,532
Filter Bank Common Spatial Pattern (FBCSP) in Brain-Computer Interface
Ang, K. K., Chin, Z. Y., Zhang, H., & Guan, C. (2008) · 2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence) · doi:10.1109/ijcnn.2008.4634130 · Cited by 1,514
Review of the BCI Competition IV
Tangermann, M., Müller, K.-R., Aertsen, A., Birbaumer, N., Braun, C., Brunner, C., Leeb, R., Mehring, C., Miller, K. J., Müller-Putz, G. R., et al. (2012) · Frontiers in Neuroscience · doi:10.3389/fnins.2012.00055 · Cited by 1,288
Filter Bank Common Spatial Pattern Algorithm on BCI Competition IV Datasets 2a and 2b
Ang, K. K., Chin, Z. Y., Wang, C., Guan, C., & Zhang, H. (2012) · Frontiers in Neuroscience · doi:10.3389/fnins.2012.00039 · Cited by 1,264
Crone, N. (1998) · Brain · doi:10.1093/brain/121.12.2301 · Cited by 1,044
Bashashati, A., Fatourechi, M., Ward, R. K., & Birch, G. E. (2007) · Journal of Neural Engineering · doi:10.1088/1741-2560/4/2/r03 · Cited by 907
Speaker Recognition from Raw Waveform with SincNet
Ravanelli, M., & Bengio, Y. (2018) · 2018 IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt.2018.8639585 · Cited by 896
A novel deep learning approach for classification of EEG motor imagery signals
Tabar, Y. R., & Halici, U. (2017) · Journal of Neural Engineering · doi:10.1088/1741-2560/14/1/016003 · Cited by 859
Learning Representations from EEG with Deep Recurrent-Convolutional Neural Networks
Bashivan, P., Rish, I., Yeasin, M., & Codella, N. (2015) · arXiv · doi:10.48550/arxiv.1511.06448 · Cited by 836
Convolutional Neural Networks for P300 Detection with Application to Brain-Computer Interfaces
Cecotti, H., & Graser, A. (2011) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2010.125 · Cited by 778
Xception: Deep Learning with Depthwise Separable Convolutions
Chollet, F. (2016) · arXiv · doi:10.48550/arxiv.1610.02357 · Cited by 538
Central beta rhythm during sensorimotor activities in man
Pfurtscheller, G. (1981) · Electroencephalography and Clinical Neurophysiology · doi:10.1016/0013-4694(81)90139-5 · Cited by 472
Lotte, F. (2015) · Proceedings of the IEEE · doi:10.1109/jproc.2015.2404941 · Cited by 327
Movement related activity in the high gamma range of the human EEG
Ball, T., Demandt, E., Mutschler, I., Neitzel, E., Mehring, C., Vogt, K., Aertsen, A., & Schulze-Bonhage, A. (2008) · NeuroImage · doi:10.1016/j.neuroimage.2008.02.032 · Cited by 274
Deep learning based on Batch Normalization for P300 signal detection
Liu, M., Wu, W., Gu, Z., Yu, Z., Qi, F., & Li, Y. (2018) · Neurocomputing · doi:10.1016/j.neucom.2017.08.039 · Cited by 230
BCI meeting 2005-workshop on BCI signal processing: feature extraction and translation
McFarland, D. J., Anderson, C. W., Muller, K.-R., Schlogl, A., & Krusienski, D. J. (2006) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2006.875637 · Cited by 204
Learning joint space–time–frequency features for EEG decoding on small labeled data.
Zhao, D., Tang, F., Si, B., & Feng, X. (2019) · Neural Networks · doi:10.1016/j.neunet.2019.02.009 · Cited by 123
Farahat, A., Reichert, C., Sweeney-Reed, C. M., & Hinrichs, H. (2019) · Journal of Neural Engineering · doi:10.1088/1741-2552/ab3bb4 · Cited by 92
Single-trial EEG RSVP classification using convolutional neural networks
Shamwell, J., Lee, H., Kwon, H., Marathe, A. R., Lawhern, V., & Nothwang, W. (2016) · SPIE Proceedings · doi:10.1117/12.2224172 · Cited by 34
Cited by
Simões, M., Borra, D., Santamaría-Vázquez, E., GBT-UPM, Bittencourt-Villalpando, M., Krzemiński, D., Miladinović, A., Neural_Engineering_Group, Schmid, T., Zhao, H., et al. (2020) · Frontiers in Neuroscience · doi:10.3389/fnins.2020.568104 · Cited by 72
Self-citationBorra, D., Fantozzi, S., & Magosso, E. (2021) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2021.655840 · Cited by 36
Self-citationEvaluating the structure of cognitive tasks with transfer learning
Aristimunha, B., de Camargo, R. Y., Pinaya, W. H. L., Chevallier, S., Gramfort, A., & Rommel, C. (2023) · arXiv · doi:10.48550/arxiv.2308.02408 · Cited by 4
Metadata
- Authors
- Borra, D., Fantozzi, S., & Magosso, E.
- Venue
- Neural Networks
- Publisher
- Elsevier BV
- Published
- 2020-09
- Volume
- 129
- Pages
- 55-74
- ISSN
- 0893-6080 (ISSN-L)
- OpenAlex
- W3030420691
- Cited by
- 145
- References
- 32
- FWCI
- 9.01
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.