The DOI matches its Crossref record; 49 of the 49 references it cites were found in a registry or an index.
Making Sense of Spatio-Temporal Preserving Representations for EEG-Based Human Intention Recognition
Open accessAbstract
Brain-computer interface (BCI) is a system empowering humans to communicate with or control the outside world with exclusively brain intentions. Electroencephalography (EEG)-based BCI is one of the promising solutions due to its convenient and portable instruments. Despite the extensive research of EEG in recent years, it is still challenging to interpret EEG signals effectively due to its nature of noise and difficulties in capturing the inconspicuous relations between EEG signals and specific brain activities. Most existing works either only consider EEG as chain-like sequences while neglecting complex dependencies between adjacent signals or requiring complex preprocessing. In this paper, we introduce two deep learning-based frameworks with novel spatio-temporal preserving representations of raw EEG streams to precisely identify human intentions. The two frameworks consist of both convolutional and recurrent neural networks effectively exploring the preserved spatial and temporal information in either a cascade or a parallel manner. Extensive experiments on a large scale movement intention EEG dataset (108 subjects, 3 145 160 EEG records) have demonstrated that the proposed frameworks achieve high accuracy of 98.3% and outperform a set of state-of-the-art and baseline models. The developed models are further evaluated with a real-world brain typing BCI and achieve a recognition accuracy of 93% over five instruction intentions suggesting good generalization over different kinds of intentions and BCI systems.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Goldberger, A. L., Amaral, L. A. N., Glass, L., Hausdorff, J. M., Ivanov, P. C., Mark, R. G., Mietus, J. E., Moody, G. B., Peng, C.-K., & Stanley, H. E. (2000) · Circulation · doi:10.1161/01.cir.101.23.e215 · Cited by 14,809
Deep learning with convolutional neural networks for EEG decoding and visualization
Schirrmeister, R. T., Springenberg, J. T., Fiederer, L. D. J., Glasstetter, M., Eggensperger, K., Tangermann, M., Hutter, F., Burgard, W., & Ball, T. (2017) · Human Brain Mapping · doi:10.1002/hbm.23730 · Cited by 3,751
BCI2000: A General-Purpose Brain-Computer Interface (BCI) System
Schalk, G., McFarland, D. J., Hinterberger, T., Birbaumer, N., & Wolpaw, J. R. (2004) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2004.827072 · Cited by 3,024
Deep Convolutional and LSTM Recurrent Neural Networks for Multimodal Wearable Activity Recognition
Ordóñez, F., & Roggen, D. (2016) · Sensors · doi:10.3390/s16010115 · Cited by 2,761 · cited 1×
“RNNs, especially the RNNs with long short-term memory (LSTM) units, have been demonstrated successfully in processing the time series problems, especially when employing multiple layers for each time step [37].”
BackgroundMotor imagery and direct brain-computer communication
Pfurtscheller, G., & Neuper, C. (2001) · Proceedings of the IEEE · doi:10.1109/5.939829 · Cited by 1,990
EmotionMeter: A Multimodal Framework for Recognizing Human Emotions
Zheng, W.-L., Liu, W., Lu, Y., Lu, B.-L., & Cichocki, A. (2019) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2018.2797176 · Cited by 1,276
EEG signal classification using PCA, ICA, LDA and support vector machines
Subasi, A., & Ismail Gursoy, M. (2010) · Expert Systems with Applications · doi:10.1016/j.eswa.2010.06.065 · Cited by 1,209
Training Deep Spiking Neural Networks Using Backpropagation
Lee, J. H., Delbruck, T., & Pfeiffer, M. (2016) · Frontiers in Neuroscience · doi:10.3389/fnins.2016.00508 · Cited by 976
Convolutional Neural Networks for P300 Detection with Application to Brain-Computer Interfaces
Cecotti, H., & Graser, A. (2011) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2010.125 · Cited by 778
Spatial–Temporal Recurrent Neural Network for Emotion Recognition
Zhang, T., Zheng, W., Cui, Z., Zong, Y., & Li, Y. (2019) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2017.2788081 · Cited by 595
Kasabov, N. K. (2014) · Neural Networks · doi:10.1016/j.neunet.2014.01.006 · Cited by 454
Kevric, J., & Subasi, A. (2017) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2016.09.007 · Cited by 428
LSTM-Based EEG Classification in Motor Imagery Tasks
Wang, P., Jiang, A., Liu, X., Shang, J., & Zhang, L. (2018) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2018.2876129 · Cited by 358
Temporally Constrained Sparse Group Spatial Patterns for Motor Imagery BCI
Zhang, Y., Nam, C. S., Zhou, G., Jin, J., Wang, X., & Cichocki, A. (2019) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2018.2841847 · Cited by 330
On the computational power of circuits of spiking neurons
Maass, W., & Markram, H. (2004) · Journal of Computer and System Sciences · doi:10.1016/j.jcss.2004.04.001 · Cited by 301
A Novel Deep Learning-Based Collaborative Filtering Model for Recommendation System
Fu, M., Qu, H., Yi, Z., Lu, L., & Liu, Y. (2019) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2018.2795041 · Cited by 243
Self-citationNakisa, B., Rastgoo, M. N., Tjondronegoro, D., & Chandran, V. (2018) · Expert Systems with Applications · doi:10.1016/j.eswa.2017.09.062 · Cited by 233
Deep learning based on Batch Normalization for P300 signal detection
Liu, M., Wu, W., Gu, Z., Yu, Z., Qi, F., & Li, Y. (2018) · Neurocomputing · doi:10.1016/j.neucom.2017.08.039 · Cited by 230 · cited 1×
“Liu et al. [35] achieved the state-of-the-art ERP signal clas-sification and spelling character recognition performance on previous BCI competition datasets via a carefully designed 1-”
MethodA New Gaze-BCI-Driven Control of an Upper Limb Exoskeleton for Rehabilitation in Real-World Tasks
Frisoli, A., Loconsole, C., Leonardis, D., Banno, F., Barsotti, M., Chisari, C., & Bergamasco, M. (2012) · IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews) · doi:10.1109/tsmcc.2012.2226444 · Cited by 217
Zhang, D., Yao, L., Zhang, X., Wang, S., Chen, W., Boots, R., & Benatallah, B. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11496 · Cited by 210
Self-citationProbabilistic Common Spatial Patterns for Multichannel EEG Analysis
Wu, W., Chen, Z., Gao, X., Li, Y., Brown, E. N., & Gao, S. (2015) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2014.2330598 · Cited by 194
Towards Independence: A BCI Telepresence Robot for People With Severe Motor Disabilities
Leeb, R., Tonin, L., Rohm, M., Desideri, L., Carlson, T., & Millan, J. D. R. (2015) · Proceedings of the IEEE · doi:10.1109/jproc.2015.2419736 · Cited by 187
Towards correlation-based time window selection method for motor imagery BCIs
Feng, J., Yin, E., Jin, J., Saab, R., Daly, I. P., Wang, X., Hu, D., & Cichocki, A. S. (2018) · Neural Networks · doi:10.1016/j.neunet.2018.02.011 · Cited by 148
Al-Qaysi, Z. T., Zaidan, B. B., Zaidan, A. A., & Suzani, M. S. (2018) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2018.06.012 · Cited by 138
Deep Network Embedding for Graph Representation Learning in Signed Networks
Shen, X. X., & Chung, F.-L. (2018) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2018.2871503 · Cited by 116
Kim, Y., Ryu, J., Kim, K. K., Took, C. C., Mandic, D. P., & Park, C. (2016) · Computational Intelligence and Neuroscience · doi:10.1155/2016/1489692 · Cited by 114
RSTFC: A Novel Algorithm for Spatio-Temporal Filtering and Classification of Single-Trial EEG
Qi, F., Li, Y., & Wu, W. (2015) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2015.2402694 · Cited by 92
Feature Weighting and Regularization of Common Spatial Patterns in EEG-Based Motor Imagery BCI
Mishuhina, V., & Jiang, X. (2018) · IEEE Signal Processing Letters · doi:10.1109/lsp.2018.2823683 · Cited by 83
A Wireless BCI and BMI System for Wearable Robots
He, W., Zhao, Y., Tang, H., Sun, C., & Fu, W. (2015) · IEEE Transactions on Systems Man and Cybernetics Systems · doi:10.1109/tsmc.2015.2506618 · Cited by 81
Intent Recognition in Smart Living Through Deep Recurrent Neural Networks
Zhang, X., Yao, L., Huang, C., Sheng, Q. Z., & Wang, X. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-70096-0_76 · Cited by 80
Self-citationOnline Removal of Eye Movement and Blink EEG Artifacts Using a High-Speed Eye Tracker
Noureddin, B., Lawrence, P. D., & Birch, G. E. (2011) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2011.2108295 · Cited by 79
Xie, L., Deng, Z., Xu, P., Choi, K., & Wang, S. (2018) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2018.2821764 · Cited by 73
Self-citationMulti-Person Brain Activity Recognition via Comprehensive EEG Signal Analysis
Zhang, X., Yao, L., Zhang, D., Wang, X., Sheng, Q. Z., & Gu, T. (2017) · EAI International Conference on Mobile and Ubiquitous Systems: Computing, Networking and Services (MobiQuitous) · doi:10.1145/3144457.3144477 · Cited by 71
Self-citationTembiné, H. (2019) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2018.2886238 · Cited by 67
A Classification Algorithm for Electroencephalography Signals by Self-Induced Emotional Stimuli
Iacoviello, D., Petracca, A., Spezialetti, M., & Placidi, G. (2015) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2015.2498974 · Cited by 60
A Hybrid Network for ERP Detection and Analysis Based on Restricted Boltzmann Machine
Li, J., Yu, Z. L., Gu, Z., Wu, W., Li, Y., & Jin, L. (2018) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2018.2803066 · Cited by 58
Distributionally Robust Semi-Supervised Learning for People-Centric Sensing
Chen, K., Yao, L., Zhang, D., Chang, X., Long, G., & Wang, S. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33013321 · Cited by 57
Self-citationAn FDES-Based Shared Control Method for Asynchronous Brain-Actuated Robot
Liu, R., Wang, Y., & Zhang, L. (2015) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2015.2469278 · Cited by 56
A Brain–Robot Interaction System by Fusing Human and Machine Intelligence
Mao, X., Li, W., Lei, C., Jin, J., Duan, F., & Chen, S. (2019) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2019.2897323 · Cited by 49
Hasib, M. M., Nayak, T., & Huang, Y. (2018) · IEEE-EMBS International Conference on Biomedical and Health Informatics (BHI ...) · doi:10.1109/bhi.2018.8333380 · Cited by 47
Wheelchair simulator game for training people with severe disabilities
Pinheiro, O. R., Alves, L. R. G., Romero, M. F. M., & de Souza, J. R. (2016) · International Conference on Technology and Innovation in Sports, Health and Wellbeing (TISHW) · doi:10.1109/tishw.2016.7847792 · Cited by 43
Shrinkage estimator based regularization for EEG motor imagery classification
Shenoy, H. V., Vinod, A. P., & Guan, C. (2015) · International Conference on Information, Communications & Signal Processing (ICICS) · doi:10.1109/icics.2015.7459836 · Cited by 38
EEG-Based Classification of Implicit Intention During Self-Relevant Sentence Reading
Dong, S.-Y., Kim, B.-K., & Lee, S.-Y. (2015) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2015.2479240 · Cited by 34
The offline feature extraction of four-class motor imagery EEG based on ICA and Wavelet-CSP
Bai, X., Wang, X., Zheng, S., & Yu, M. (2014) · Chinese Control Conference (CCC) · doi:10.1109/chicc.2014.6896188 · Cited by 31
Feature extraction and classification of EEG signals for mapping motor area of the brain
Sita, J., & Nair, G. J. (2013) · International Conference on Control, Communication and Computing (ICCC) · doi:10.1109/iccc.2013.6731699 · Cited by 25
Zhang, D., Yao, L.-N., Chen, K.-X., & Wang, S. (2018) · International Conference on Information and Knowledge Management · doi:10.1145/3269206.3269259 · Cited by 22
Self-citationFuzzy Integral Optimization with Deep Q-Network for EEG-Based Intention Recognition
Zhang, D., Yao, L., Wang, S., Chen, K., Yang, Z., & Benatallah, B. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-93034-3_13 · Cited by 20
Self-citationMajor, T. C., & Conrad, J. M. (2017) · IEEE SoutheastCon · doi:10.1109/secon.2017.7925289 · Cited by 19
Research works printed but not linked: 4
- 10.1007/978-981-13-1747-7_72 · doi:10.1007/978-981-13-1747-7_72
- 10.1109/TFUZZ.2016.2598362 · doi:10.1109/tfuzz.2016.2598362
- bashivan, 2016, Learning representations from EEG with deep recurrent-convolutional neural networks, Proc Int Conf Learn Represent, 1
- 10.1063/1.5090244 · doi:10.1063/1.5090244
Cited by
Deep Learning for Sensor-based Human Activity Recognition
Chen, K., Zhang, D., Yao, L., Guo, B., Yu, Z., & Liu, Y. (2022) · ACM Computing Surveys · doi:10.1145/3447744 · Cited by 690
“RNN is a widely applied deep temporal feature extraction approach in many fields [92, 169].”
BackgroundSelf-citationDeep learning for motor imagery EEG-based classification: A review
Al-Saegh, A., Dawwd, S. A., & Abdul-Jabbar, J. M. (2021) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2020.102172 · Cited by 437
Gu, X., Cao, Z., Jolfaei, A., Xu, P., Wu, D., Jung, T.-P., & Lin, C.-T. (2021) · IEEE/ACM Transactions on Computational Biology and Bioinformatics · doi:10.1109/tcbb.2021.3052811 · Cited by 395
Self-Supervised Learning for Electroencephalography
Rafiei, M. H., Gauthier, L. V., Adeli, H., & Takabi, D. (2024) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3190448 · Cited by 317
Deep Learning for Sensor-based Human Activity Recognition: Overview, Challenges and Opportunities
Chen, K., Zhang, D., Yao, L., Guo, B., Yu, Z., & Liu, Y. (2020) · arXiv · doi:10.48550/arxiv.2001.07416 · Cited by 314
“RNN is a widely applied deep temporal feature extraction approach in many fields [92, 169].”
BackgroundSelf-citation
Metadata
- Authors
- Zhang, D., Yao, L., Chen, K., Wang, S., Chang, X., & Liu, Y.
- Venue
- IEEE Transactions on Cybernetics
- Published
- 2020-07
- Volume
- 50
- Issue
- 7
- Pages
- 3033-3044
- ISSN
- 2168-2267 (ISSN-L)
- 2168-2275
- OpenAlex
- W2940740645
- Cited by
- 365
- References
- 49
- FWCI
- 23.80
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.