A Transformer Encoder and Convolutional Neural Network Combined Method for Classification of Error-related Potentials
Abstract
Background and Objectives. As an inherent feedback mechanism in humans, Error-related Potentials (ErrPs) signals have received increasing attention for their potential to improve the accuracy and efficiency of Brain-computer interface (BCI) systems. However, the successful detection of ErrPs signals in a single trial is a great challenge due to the low signal-to-noise ratio (SNR) and the high individual differences. In this study, we propose a novel method that combines convolutional layers and transformer encoder modules to classify ErrPs from electroencephalogram (EEG) signals. Methods. The raw data from all electrode channels were chosen as the inputs of the proposed method and two different dataset partition ways, which include within-session and cross-subject, were used to test the proposed model. The dataset used for evaluation is the ‘Monitoring error-related potentials’ dataset of the BNCI Horizon 2020. Results. For within-session classification, a mean accuracy of 88.50%, an AUROC of 0.95, and a F1-score of 0.82 using stratified 10-fold cross-validation were achieved. For cross-subject classification, the average accuracy, AUROC, and Fl-score have reached 82.89%, 0.90, and 0.71 respectively. The results obtained outperformed the state-of-the-art methods. Conclusions. The results showed the ability of transformer-based deep learning (DL) method in detecting ErrPs signals from low SNR EEG data and shed light on improving the performance of BCI systems.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
CNN-transformer architectures have demonstrated competitive cross-subject ErrP performance under LOSO evaluation.
“CNN-transformer architectures have demonstrated competitive cross-subject ErrP performance under leave-one-subject-out (LOSO) evaluation [9], [10]”
From ERP-XTTN: interpretable prototype-guided cross-attention for cross-subject ERP classification (2026) · cites this paper as [9]
All results reported here use causal IIR filtering under calibration-free LOSO evaluation; many published LOSO benchmarks use acausal filtering instead, so their reported performance is not reproducible in a forward-processing pipeline.
“All results reported here use causal IIR filtering under calibration-free LOSO evaluation; many published LOSO benchmarks use acausal filtering instead [9], [16], so their reported performance is not reproducible in a forward-processing pipeline.”
From ERP-XTTN: interpretable prototype-guided cross-attention for cross-subject ERP classification (2026) · cites this paper as [9]
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474 · see citing works
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404 · see citing works
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946 · see citing works
Delorme, A., & Makeig, S. (2004) · Journal of Neuroscience Methods · doi:10.1016/j.jneumeth.2003.10.009 · Cited by 24,371 · see citing works
Individual Comparisons by Ranking Methods
Wilcoxon, F. (1945) · Springer series in statistics · doi:10.1007/978-1-4612-4380-9_16 · Cited by 18,704 · see citing works
(2010) · Cited by 14,134 · see citing works
A Study of Cross-Validation and Bootstrap for Accuracy Estimation and Model Selection
Kohavi, R. (1995) · Zenodo · doi:10.5281/zenodo.19712698 · Cited by 10,909 · see citing works
TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems
Abadi, M., Agarwal, A., Barham, P., Brevdo, E., Chen, Z., Citro, C., Corrado, G. S., Davis, A., Dean, J., Devin, M., et al. (2016) · arXiv · doi:10.48550/arxiv.1603.04467 · Cited by 9,408 · see citing works
Learning long-term dependencies with gradient descent is difficult
Bengio, Y., Simard, P., & Frasconi, P. (1994) · IEEE Transactions on Neural Networks · doi:10.1109/72.279181 · Cited by 8,542 · see citing works
SGDR: Stochastic Gradient Descent with Warm Restarts
Loshchilov, I., & Hutter, F. (2016) · arXiv · doi:10.48550/arxiv.1608.03983 · Cited by 5,309 · see citing works
MEG and EEG data analysis with MNE-Python
Gramfort, A. (2013) · Frontiers in Neuroscience · doi:10.3389/fnins.2013.00267 · Cited by 3,879 · see citing works
API design for machine learning software: experiences from the scikit-learn projectPreprint
Buitinck, L., Louppe, G., Blondel, M., Pedregosa, F., Mueller, A., Grisel, O., Niculae, V., Prettenhofer, P., Gramfort, A., Grobler, J., et al. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1309.0238 · Cited by 2,387 · see citing works
When does label smoothing help?
Müller, R., Kornblith, S., & Hinton, G. (2019) · arXiv · doi:10.48550/arxiv.1906.02629 · Cited by 859 · see citing works
Altaheri, H., Muhammad, G., Alsulaiman, M., Amin, S. U., Altuwaijri, G. A., Abdul, W., Bencherif, M. A., & Faisal, M. (2021) · Neural Computing and Applications · doi:10.1007/s00521-021-06352-5 · Cited by 601 · see citing works
Borderline over-sampling for imbalanced data classification
Nguyen, H. M., Cooper, E. W., & Kamei, K. (2011) · International Journal of Knowledge Engineering and Soft Data Paradigms · doi:10.1504/ijkesdp.2011.039875 · Cited by 595 · see citing works
Epileptic Seizures Detection Using Deep Learning Techniques: A Review
Shoeibi, A., Khodatars, M., Ghassemi, N., Jafari, M., Moridian, P., Alizadehsani, R., Panahiazar, M., Khozeimeh, F., Zare, A., Hosseini‐Nejad, H., et al. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph18115780 · Cited by 490 · see citing works
Xie, J., Zhang, J., Sun, J., Ma, Z., Qin, L., Li, G., Zhou, H., & Zhan, Y. (2022) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2022.3194600 · Cited by 323 · see citing works
Learning From EEG Error-Related Potentials in Noninvasive Brain-Computer Interfaces
Chavarriaga, R., & Millan, J. D. R. (2010) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2010.2053387 · Cited by 277 · see citing works
Correcting robot mistakes in real time using EEG signals
Salazar-Gómez, A. F., DelPreto, J., Gil, S., Guenther, F. H., & Rus, D. L. (2017) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2017.7989777 · Cited by 187 · see citing works
Spatial-temporal Transformers for EEG Emotion Recognition
Liu, J., Wu, H., Zhang, L., & Zhao, Y. (2022) · International Conference on Advances in Artificial Intelligence (ICAAI) · doi:10.1145/3571560.3571577 · Cited by 82 · see citing works
A Review of Error-Related Potential-Based Brain–Computer Interfaces for Motor Impaired People
Kumar, A., Gao, L., Pirogova, E., & Fang, Q. (2019) · IEEE Access · doi:10.1109/access.2019.2944067 · Cited by 61 · see citing works
Self-citationError-related electrocorticographic activity in humans during continuous movements
Milekovic, T., Ball, T., Schulze‐Bonhage, A., Aertsen, A., & Mehring, C. (2012) · Journal of Neural Engineering · doi:10.1088/1741-2560/9/2/026007 · Cited by 56 · see citing works
A Generic Transferable EEG Decoder for Online Detection of Error Potential in Target Selection
Bhattacharyya, S., Konar, A., Tibarewala, D. N., & Hayashibe, M. (2017) · Frontiers in Neuroscience · doi:10.3389/fnins.2017.00226 · Cited by 43 · cited 1× · see citing works
“The classical machine learning methods like linear discriminant analysis (LDA) [5][6] and support vector machines (SVM) [7] achieved some results in detection performance.”
MethodClassification of Error Related Potentials using Convolutional Neural Networks
Bellary, S. A. S., & Conrad, J. M. (2019) · International Conference on Cloud Computing, Data Science & Engineering (Confluence) · doi:10.1109/confluence.2019.8776901 · Cited by 23 · see citing works
Enhanced Error Decoding from Error-Related Potentials using Convolutional Neural Networks
Torres, J. M. M., Clarkson, T., Stepanov, E. A., Luhmann, C. C., Lerner, M. D., & Riccardi, G. (2018) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc.2018.8512183 · Cited by 21 · see citing works
Classification of Error-Related Potentials using Linear Discriminant Analysis
Kumar, A., Pirogova, E., & Fang, J. Q. (2018) · IEEE-EMBS Conference on Biomedical Engineering and Sciences · doi:10.1109/iecbes.2018.8626709 · Cited by 19 · see citing works
Self-citationClassification of error-related potentials evoked during stroke rehabilitation training
Kumar, A., Pirogova, E., Mahmoud, S. S., & Fang, Q. (2021) · Journal of Neural Engineering · doi:10.1088/1741-2552/ac1d32 · Cited by 17 · see citing works
Self-citationGao, C., Li, Z., Ora, H., & Miyake, Y. (2020) · IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm49941.2020.9313238 · Cited by 13 · see citing works
Usama, N., Niazi, I. K., Dremstrup, K., & Jochumsen, M. (2022) · Sensors · doi:10.3390/s22041676 · Cited by 8 · see citing works
Parashiva, P. K., & Vinod, A. P. (2020) · International Conference on Awareness Science and Technology (iCAST) · doi:10.1109/icast51195.2020.9319482 · Cited by 8 · see citing works
An Efficient Electrode Ranking Method for Single Trial Detection of EEG Error-Related Potentials
Parashiva, P. K., & Vinod, A. P. (2021) · International Conference on Bio-engineering for Smart Technologies (BioSMART) · doi:10.1109/biosmart54244.2021.9677569 · Cited by 7 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
ERP-XTTN: interpretable prototype-guided cross-attention for cross-subject ERP classification
Genevier Wyman, C., & Hirshfield, L. (2026) · Journal of Neural Engineering · doi:10.1088/1741-2552/ae9f95
“All results reported here use causal IIR filtering under calibration-free LOSO evaluation; many published LOSO benchmarks use acausal filtering instead [9, 16], so their reported performance is not reproducible in a forward-processing pipeline.”
- Authors
- Ren, G., Mahmoud, S. S., Kumar, A., Fang, Q., & Yu, B.
- Affiliations
- Shantou University (CN)
- Venue
- 2023 IEEE Biomedical Circuits and Systems Conference (BioCAS)
- Publisher
- IEEE
- Published
- 2023-10-19
- Volume
- 30
- Pages
- 1-5
- OpenAlex
- W4390993526
- Cited by
- 0
- References
- 31
- FWCI
- 0.00
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- IEEE Biomedical Circuits and Systems Conference (BioCAS) (publishedVersion)
- Funders
- Li Ka Shing Foundation
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › EEG and Brain-Computer Interfaces
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Emotion and Mood Recognition
- Physical Sciences › Computer Science › Human-Computer Interaction › Gaze Tracking and Assistive Technology
- Keywords
- error-related potentials, EEG classification, Transformer encoder, convolutional neural networks, CNN-Transformer hybrid, brain-computer interface, low signal-to-noise ratio, cross-subject classification
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review