A review of deep learning methods for cross-subject rapid serial visual presentation detection in World Robot Contest 2022
Open accessThe DOI matches its Crossref record; 30 of the 30 references it cites were found in a registry or an index.
Abstract
The rapid serial visual presentation (RSVP) paradigm has garnered considerable attention in brain–computer interface (BCI) systems. Studies have focused on using cross-subject electroencephalogram data to train cross-subject RSVP detection models. In this study, we performed a comparative analysis of the top 5 deep learning algorithms used by various teams in the event-related potential competition of the BCI Controlled Robot Contest in World Robot Contest 2022. We evaluated these algorithms on the final data set and compared their performance in cross-subject RSVP detection. The results revealed that deep learning models can achieve excellent results with appropriate training methods when applied to cross-subject detection tasks. We discussed the limitations of existing deep learning algorithms in cross-subject RSVP detection and highlighted potential research directions.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Furthermore, the EEGNet has been proven its effectiveness in BCI competitions [41],[51],[52].”
From A Cascade xDAWN EEGNet Structure for Unified Visual-Evoked Related Potential Detection (2024) · cites this paper as [41]
Citations
Cites
Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization
Selvaraju, R. R., Cogswell, M., Das, A., Vedantam, R., Parikh, D., & Batra, D. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.74 · Cited by 24,513
Focal Loss for Dense Object Detection
Lin, T.-Y., Goyal, P., Girshick, R., He, K., & Dollar, P. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2858826 · Cited by 9,556
Updating P300: An integrative theory of P3a and P3b
Polich, J. (2007) · Clinical Neurophysiology · doi:10.1016/j.clinph.2007.04.019 · Cited by 7,919 · cited 1×
“P300 is a widely used BCI paradigm that is based on the event-related potential (ERP) component that occurs in response to the target stimuli [3].”
MethodA Review of Recurrent Neural Networks: LSTM Cells and Network Architectures
Yu, Y., Si, X., Hu, C., & Zhang, J. (2019) · Neural Computation · doi:10.1162/neco_a_01199 · Cited by 5,591 · cited 6×
“Finally, the weighted integration probability and the LSTM calibrated probability were added to obtain the final output.”
InfluentialEEGNet: a compact convolutional neural network for EEG-based brain-computer interfaces
Lawhern, V. J., Solon, A. J., Waytowich, N. R., Gordon, S. M., Hung, C. P., & Lance, B. J. (2018) · Journal of Neural Engineering · doi:10.1088/1741-2552/aace8c · Cited by 5,115 · cited 1×
“For example, EEGNet, is a robust deep learning algorithm with a compact convolutional neural network (CNN) that achieves high accuracy and fast classification of EEG signals [16].”
BackgroundDeep learning with convolutional neural networks for EEG decoding and visualization
Schirrmeister, R. T., Springenberg, J. T., Fiederer, L. D. J., Glasstetter, M., Eggensperger, K., Tangermann, M., Hutter, F., Burgard, W., & Ball, T. (2017) · Human Brain Mapping · doi:10.1002/hbm.23730 · Cited by 3,751 · cited 1×
“In DeepConvNet, a deeper CNN architecture with additional max pooling and dense layers are used to improve classifier robustness [17].”
MethodFarwell, L. A., & Donchin, E. (1988) · Electroencephalography and Clinical Neurophysiology · doi:10.1016/0013-4694(88)90149-6 · Cited by 3,228 · cited 1×
“The P300 speller proposed by Farwell and Donchin has been studied extensively [5], and various algorithms, such as denoising autoencoder [6], BN3 [7], ST-CapsNet [8], MsCNN [9], have been proposed.”
MethodThe P300 wave of the human event-related potential
Picton, T. W. (1992) · Journal of Clinical Neurophysiology · doi:10.1097/00004691-199210000-00002 · Cited by 1,908
Averaging Weights Leads to Wider Optima and Better Generalization
Izmailov, P., Podoprikhin, D., Garipov, T., Vetrov, D., & Wilson, A. G. (2018) · arXiv · doi:10.48550/arxiv.1803.05407 · Cited by 1,409 · cited 1×
“Stochastic weight averaging (SWA) is a regularization technique that is used in deep learning to improve the generalization of neural networks [29].”
MethodEEG signal classification using PCA, ICA, LDA and support vector machines
Subasi, A., & Ismail Gursoy, M. (2010) · Expert Systems with Applications · doi:10.1016/j.eswa.2010.06.065 · Cited by 1,209 · cited 1×
“Although LDA is a simple and effective algorithm [12], it has several limitations because of its linear assumption of data.”
BackgroundWang, Z., Liu, M., Yan, W.-J., Song, H., Zhou, Z., Yuen, K.-V., Wei, Q., & Cheng, S. S. (2021) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2021.3123218 · Cited by 678
Self-citationTransfer Learning for Brain–Computer Interfaces: A Euclidean Space Data Alignment Approach
He, H., & Wu, D. (2020) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2019.2913914 · Cited by 569 · cited 1×
“Wu, who was awarded in the ERP final competition of the WRC 2021, proposed a novel method for improving the classification performance of RSVP across subjects [20].”
MethodMonte Carlo theory and practice
James, F. (1980) · Reports on Progress in Physics · doi:10.1088/0034-4885/43/9/002 · Cited by 544 · cited 1×
“Next, we applied the Monte Carlo method [32] to obtain the best weighting ensemble weights for models trained”
MethodxDAWN Algorithm to Enhance Evoked Potentials: Application to Brain–Computer Interface
Rivet, B., Souloumiac, A., Attina, V., & Gibert, G. (2009) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2009.2012869 · Cited by 537 · cited 1×
“When the data are aligned, Wu used xDAWN [21] and tangent space mapping to extract ERP features.”
MethodA Brain Controlled Wheelchair to Navigate in Familiar Environments
Rebsamen, B., Guan, C., Zhang, H., Wang, C., Teo, C., Ang, M. H., & Burdet, E. (2010) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2010.2049862 · Cited by 405
Self-citationCortically coupled computer vision for rapid image search
Gerson, A. D., Parra, L. C., & Sajda, P. (2006) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2006.875550 · Cited by 258 · cited 1×
“By contrast, SWFP is designed for single-trial RSVP detection and exhibits better performance than hierarchical discriminant component analysis (HDCA) [14] and hierarchical discriminant principal component analysis algorithm (HDCPA) [15].”
MethodDeep learning based on Batch Normalization for P300 signal detection
Liu, M., Wu, W., Gu, Z., Yu, Z., Qi, F., & Li, Y. (2018) · Neurocomputing · doi:10.1016/j.neucom.2017.08.039 · Cited by 230 · cited 1×
“The P300 speller proposed by Farwell and Donchin has been studied extensively [5], and various algorithms, such as denoising autoencoder [6], BN3 [7], ST-CapsNet [8], MsCNN [9], have been proposed.”
MethodSantamaría-Vázquez, E., Martínez-Cagigal, V., Vaquerizo-Villar, F., & Hornero, R. (2020) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2020.3048106 · Cited by 213 · cited 9×
“This step is crucial because ERP data can vary considerably between subjects.”
MethodInfluentialA review of rapid serial visual presentation-based brain–computer interfaces
Lees, S., Dayan, N., Cecotti, H., McCullagh, P., Maguire, L., Lotte, F., & Coyle, D. (2018) · Journal of Neural Engineering · doi:10.1088/1741-2552/aa9817 · Cited by 149 · cited 1×
“In RSVP, target stimuli are presented among distractors, and the BCI detects the target stimuli [10, 11].”
BackgroundDESIGN OF ASSISTIVE WHEELCHAIR SYSTEM DIRECTLY STEERED BY HUMAN THOUGHTS
LI, J., LIANG, J., ZHAO, Q., LI, J., HONG, K., & ZHANG, L. (2013) · International Journal of Neural Systems · doi:10.1142/s0129065713500135 · Cited by 114 · cited 1×
“BCI systems allow people with disabilities to interact with their environment through their brain signals [1, 2].”
BackgroundThinker invariance: enabling deep neural networks for BCI across more people
Kostas, D., & Rudzicz, F. (2020) · Journal of Neural Engineering · doi:10.1088/1741-2552/abb7a7 · Cited by 113
Fuhrmann Alpert, G., Manor, R., Spanier, A. B., Deouell, L. Y., & Geva, A. B. (2014) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2013.2289898 · Cited by 74 · cited 2×
“Therefore, the model can be time-consuming and subjective [15].”
BackgroundMethodMsCNN: A Deep Learning Framework for P300-Based Brain–Computer Interface Speller
Kundu, S., & Ari, S. (2020) · IEEE Transactions on Medical Robotics and Bionics · doi:10.1109/tmrb.2019.2959559 · Cited by 70 · cited 1×
“The P300 speller proposed by Farwell and Donchin has been studied extensively [5], and various algorithms, such as denoising autoencoder [6], BN3 [7], ST-CapsNet [8], MsCNN [9], have been proposed.”
Method(1999) · Machine learning for signal processing ... · doi:10.1109/nnsp.1999.788116 · Cited by 55
Lei, Y., Belkacem, A. N., Wang, X., Sha, S., Wang, C., & Chen, C. (2021) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2021.103370 · Cited by 48
Domain Generalization for Session-Independent Brain-Computer Interface
Han, D., & Jeong, J.-H. (2021) · International Winter Conference on Brain-Computer Interface (BCI) · doi:10.1109/bci51272.2021.9385322 · Cited by 34
An improved EEGNet for single-trial EEG classification in rapid serial visual presentation task
Zhang, H., Wang, Z., Yu, Y., Yin, H., Chen, C., & Wang, H. (2022) · Brain Science Advances · doi:10.26599/bsa.2022.9050007 · Cited by 30 · cited 1×
“, the EEG signal was first spatially filtered with xDAWN and subsequently inputted into EEGNet for processing [23].”
MethodSelf-citationHajinoroozi, M., Mao, Z., Lin, Y., & Huang, Y. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-58628-1_4 · Cited by 24 · cited 1×
“In RSVP, target stimuli are presented among distractors, and the BCI detects the target stimuli [10, 11].”
BackgroundLi, F., Li, H., Li, Y., Wu, H., Fu, B., Ji, Y., Wang, C., & Shi, G. (2022) · Journal of Neural Engineering · doi:10.1088/1741-2552/ac6a7d · Cited by 19 · cited 8×
“In the competition, unweighted average recall (UAR) [24] was used as the scoring criterion, Brain Sci. Adv. https://mc03.manuscriptcentral.com/brainsa | Brain Science Advances 198 where n denotes the total number of categories, wr denotes the weight factor applied for each category, which is set to [0.33, 0.33, 0.33],…”
MethodInfluentialWu, H., & Wu, D. (2022) · Brain Science Advances · doi:10.26599/bsa.2022.9050001 · Cited by 7 · cited 1×
“The results revealed that Wu’s method considerably improved the classification performance of RSVP across subjects [22].”
Method
Research works printed but not linked: 5
- Wang HT, 2019, Contr Theory Appl, 36, 589
- Wang ZH, IEEE Trans Neural Syst Rehabil Eng 2023
- Zhang HY, Cisse M, Dauphin YN, et al. Mixup: beyond empirical risk minimization. arXiv 2017, arXiv: 1710.09412. https://arxiv.org/abs/1710.09412 · arXiv
- Müller R, 2019, 33rd Conference on Neural Information Processing Systems (NeurIPS 2019)
- Ghorbani A, Zou J. Data shapley: equitable valuation of data for machine learning. arXiv 2019, arXiv: 1904.02868. https://arxiv.org/abs/1904.02868 · arXiv
Cited by
A Cascade xDAWN EEGNet Structure for Unified Visual-Evoked Related Potential Detection
Wang, H., Wang, Z., Sun, Y., Yuan, Z., Xu, T., & Li, J. (2024) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2024.3415474 · Cited by 20
“Furthermore, EEGNet has been proven its effectiveness in BCI competitions [41], [51], [52].”
BackgroundMethodInfluentialSelf-citationJi, Z., Li, S., Zhang, H., Chen, C., Xu, Q., Li, J., & Wang, H. (2025) · Brain-Apparatus Communication A Journal of Bacomics · doi:10.1080/27706710.2025.2489396 · Cited by 17
Self-citationPreliminary Study on Rapid Serial Visualization Presentation Multi-Class Target EEG Classification
Wei, W., Li, X., Qiu, S., & He, H. (2024) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2024.3439820 · Cited by 8
Exploring EEG and eye movement fusion for multi-class target RSVP-BCI
Li, X., Wei, W., Zhao, K., Mao, J., Lu, Y., Qiu, S., & He, H. (2025) · Information Fusion · doi:10.1016/j.inffus.2025.103135 · Cited by 8
“In 2022, Wang et al. designed an RSVP task requiring participants to identify images containing people (target-1) or cars (target-2) from street scenarios [24] (see Fig.”
Group-member selection for RSVP-based collaborative brain-computer interfaces
Si, Y., Wang, Z., Xu, G., Wang, Z., Xu, T., Zhou, T., & Hu, H. (2024) · Frontiers in Neuroscience · doi:10.3389/fnins.2024.1402154 · Cited by 6
Self-citation
Metadata
- Authors
- Wang, Z., Zhang, H., Ji, Z., Yang, Y., & Wang, H.
- Affiliations
- Wuyi University (CN)
- Corresponding author
- Wang, Hongtao
- ORCID
- Wang, Hongtao
- Venue
- Brain Science Advances
- Publisher
- Tsinghua University Press
- Published
- 2023-09
- Volume
- 9
- Issue
- 3
- Pages
- 195-209
- ISSN
- 2096-5958 (ISSN-L)
- OpenAlex
- W4386521428
- Cited by
- 9
- References
- 29
- Citations by year
- 2025: 3 · 2024: 5 · 2023: 1
- FWCI
- 1.35
- Type
- journal article
- Language
- en
- Open access
- diamond
- doi.org
- Licence
- Locations
- Brain Science Advances (publishedVersion, cc-by-nc)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › EEG and Brain-Computer Interfaces
- Physical Sciences › Computer Science › Human-Computer Interaction › Gaze Tracking and Assistive Technology
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural dynamics and brain function
- Keywords
- rapid serial visual presentation, brain-computer interface, EEG, deep learning, event-related potentials, model comparison
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.