Data augmentation for motor imagery signal classification based on a hybrid neural network.
Open accessThe DOI matches its Crossref record; 74 of the 75 references it cites were found in a registry or an index.
Abstract
As an important paradigm of spontaneous brain-computer interfaces (BCIs), motor imagery (MI) has been widely used in the fields of neurological rehabilitation and robot control. Recently, researchers have proposed various methods for feature extraction and classification based on MI signals. The decoding model based on deep neural networks (DNNs) has attracted significant attention in the field of MI signal processing. Due to the strict requirements for subjects and experimental environments, it is difficult to collect large-scale and high-quality electroencephalogram (EEG) data. However, the performance of a deep learning model depends directly on the size of the datasets. Therefore, the decoding of MI-EEG signals based on a DNN has proven highly challenging in practice. Based on this, we investigated the performance of different data augmentation (DA) methods for the classification of MI data using a DNN. First, we transformed the time series signals into spectrogram images using a short-time Fourier transform (STFT). Then, we evaluated and compared the performance of different DA methods for this spectrogram data. Next, we developed a convolutional neural network (CNN) to classify the MI signals and compared the classification performance of after DA. The Fréchet inception distance (FID) was used to evaluate the quality of the generated data (GD) and the classification accuracy, and mean kappa values were used to explore the best CNN-DA method. In addition, analysis of variance (ANOVA) and paired t-tests were used to assess the significance of the results. The results showed that the deep convolutional generative adversarial network (DCGAN) provided better augmentation performance than traditional DA methods: geometric transformation (GT), autoencoder (AE), and variational autoencoder (VAE) (p < 0.01). Public datasets of the BCI competition IV (datasets 1 and 2b) were used to verify the classification performance. Improvements in the classification accuracies of 17% and 21% (p < 0.01) were observed after DA for the two datasets. In addition, the hybrid network CNN-DCGAN outperformed the other classification methods, with average kappa values of 0.564 and 0.677 for the two datasets.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures















Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Meanwhile, they discussed the performance of different DA models and then verified that the generated data by DCGAN show the best similarity and diversity.”
From Data Augmentation for Deep Neural Networks Model in EEG Classification Task: A Review (2021) · cites this paper as Zhang et al., 2020
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Researchers have explored the influence of different ratios of real data (RD) and generated data (GD) for classification performance and demonstrated that the enhancement effect does not increase with the size of GD (Zhang et al., 2020).”
From Data Augmentation for Deep Neural Networks Model in EEG Classification Task: A Review (2021) · cites this paper as Zhang et al., 2020
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
A survey on Image Data Augmentation for Deep Learning
Shorten, C., & Khoshgoftaar, T. M. (2019) · Journal of Big Data · doi:10.1186/s40537-019-0197-0 · Cited by 13,203 · cited 1×
“We used EEG signals from three The sampling frequency of this experiment was 100 Hz, and each subject underwent 200 trials, resulting in 800 trials for the four subjects as the training and test data. sampling frequency of this experiment was 100 Hz, and each subject underwent 200 trials, resulting…”
MethodUnsupervised representation learning with deep convolutional generative adversarial networks
Radford, A., Metz, L., & Chintala, S. (2015) · arXiv · doi:10.48550/arxiv.1511.06434 · Cited by 12,235 · cited 1×
“In the generator, all layers except for the output use the rectified linear unit (ReLU) as an activation function; the output layer use tanh.”
MethodExplaining and Harnessing Adversarial Examples
Goodfellow, I. J., Shlens, J., & Szegedy, C. (2014) · arXiv · doi:10.48550/arxiv.1412.6572 · Cited by 10,381
Event-related EEG/MEG synchronization and desynchronization: basic principles
Pfurtscheller, G., & Lopes da Silva, F. H. (1999) · Clinical Neurophysiology · doi:10.1016/s1388-2457(99)00141-8 · Cited by 7,328 · cited 1×
“MI can cause ERD in the contralateral motor cortex and ERS in the ipsilateral cortex; these phenomena are reflected in changes in the energy of different frequency bands [43].”
BackgroundImproved Techniques for Training GANs
Salimans, T., Goodfellow, I., Zaremba, W., Cheung, V., Radford, A., & Chen, X. (2016) · arXiv · doi:10.48550/arxiv.1606.03498 · Cited by 6,965
EEGNet: a compact convolutional neural network for EEG-based brain-computer interfaces
Lawhern, V. J., Solon, A. J., Waytowich, N. R., Gordon, S. M., Hung, C. P., & Lance, B. J. (2018) · Journal of Neural Engineering · doi:10.1088/1741-2552/aace8c · Cited by 5,115
EEGNet: A Compact Convolutional Network for EEG-based Brain-Computer Interfaces
Lawhern, V. J., Solon, A. J., Waytowich, N. R., Gordon, S. M., Hung, C. P., & Lance, B. J. (2016) · arXiv · doi:10.48550/arxiv.1611.08024 · Cited by 5,105
Research works printed but not linked: 3
- Logan, E., Brandon, T., Dimitris, T., Ludwig, S., and Aleksander, M. (2018). A rotation and a translation sufce: Fooling CNNs with simple transformations. arXiv.
- Kingma, D.P., and Welling, M. (2013). Auto-encoding variational bayes. arXiv.
- Goodfellow, I., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farely, D., Ozair, S., Courville, A., and Bengio, Y. (2014, January 8–12). Generative Adversarial Nets. Proceedings of the International Conference on Neural Information Processing Systems, Montreal, QC, Canada.
Cited by
Altaheri, H., Muhammad, G., Alsulaiman, M., Amin, S. U., Altuwaijri, G. A., Abdul, W., Bencherif, M. A., & Faisal, M. (2023) · Neural Computing and Applications · doi:10.1007/s00521-021-06352-5 · Cited by 590
Khademi, Z., Ebrahimi, F., & Kordy, H. M. (2022) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2022.105288 · Cited by 187
Generative adversarial networks in EEG analysis: an overview
Habashi, A. G., Azab, A. M., Eldawlatly, S., & Aly, G. M. (2023) · Journal of NeuroEngineering and Rehabilitation · doi:10.1186/s12984-023-01169-w · Cited by 172
A review of critical challenges in MI-BCI: From conventional to deep learning methods
Khademi, Z., Ebrahimi, F., & Kordy, H. M. (2022) · Journal of Neuroscience Methods · doi:10.1016/j.jneumeth.2022.109736 · Cited by 164
Hybrid Deep Learning (hDL)-Based Brain-Computer Interface (BCI) Systems: A Systematic Review
Alzahab, N. A., Apollonio, L., Iorio, A. D., Alshalak, M., Iarlori, S., Ferracuti, F., Monteriù, A., & Porcaro, C. (2021) · Brain Sciences · doi:10.3390/brainsci11010075 · Cited by 118
Metadata
- Authors
- Zhang, K., Xu, G., Han, Z., Ma, K., Zheng, X., Chen, L., Duan, N., & Zhang, S.
- Affiliations
- Xi'an Jiaotong University (CN)
- Corresponding author
- Xu, Guanghua
- Venue
- Sensors
- Publisher
- MDPI AG
- Published
- 2020-08-11
- Volume
- 20
- Issue
- 16
- Pages
- 4485
- ISSN
- 1424-8220 (ISSN-L)
- PMC
- PMC7474427
- OpenAlex
- W3048643622
- Cited by
- 130
- References
- 75
- Citations by year
- 2026: 15 · 2025: 20 · 2024: 25 · 2023: 28 · 2022: 20 · 2021: 15 · 2020: 7
- FWCI
- 9.40
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Sensors (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- National Natural Science Foundation of China (51775415)
- National Key Research & Development Plan of China (2017YFC1308500)
- Key Research & Development Plan of Shaanxi Province (2018ZDCXL-GY-06-01)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › EEG and Brain-Computer Interfaces
- Physical Sciences › Computer Science › Artificial Intelligence › Emotion and Mood Recognition
- Physical Sciences › Engineering › Biomedical Engineering › Muscle activation and electromyography studies
- Keywords
- motor imagery, EEG classification, data augmentation, DCGAN, spectrogram images, short-time Fourier transform, convolutional neural networks, brain-computer interface, BCI Competition IV, hybrid neural network
- MeSH terms
- Algorithms, Electroencephalography, Humans, Imagination, Neural Networks, Computer, Brain-Computer Interfaces
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.