Student or educator? Sign up with your school email and get 6 months of Pro free.

The DOI matches its Crossref record; 48 of the 48 references it cites were found in a registry or an index; 7 of the 20 sources its claims cite were checked for support.

ST-CapsNet: Linking Spatial and Temporal Attention With Capsule Network for P300 Detection Improvement

Open access
Wang, Zehui, Chen, Chuangquan, Li, Junhua, Wan, Feng, Sun, Yu, Wang, Hongtao·2023·IEEE Transactions on Neural Systems and Rehabilitation Engineering

Abstract

A brain-computer interface (BCI), which provides an advanced direct human-machine interaction, has gained substantial research interest in the last decade for its great potential in various applications including rehabilitation and communication. Among them, the P300-based BCI speller is a typical application that is capable of identifying the expected stimulated characters. However, the applicability of the P300 speller is hampered for the low recognition rate partially attributed to the complex spatio-temporal characteristics of the EEG signals. Here, we developed a deep-learning analysis framework named ST-CapsNet to overcome the challenges regarding better P300 detection using a capsule network with both spatial and temporal attention modules. Specifically, we first employed spatial and temporal attention modules to obtain refined EEG signals by capturing event-related information. Then the obtained signals were fed into the capsule network for discriminative feature extraction and P300 det- ection. In order to quantitatively assess the performance of the proposed ST-CapsNet, two publicly-available datasets (i.e., Dataset IIb of BCI Competition 2003 and Dataset II of BCI Competition III) were applied. A new metric of averaged symbols under repetitions (ASUR) was adopted to evaluate the cumulative effect of symbol recognition under different repetitions. In comparison with several widely-used methods (i.e., LDA, ERP-CapsNet, CNN, MCNN, SWFP, and MsCNN-TL-ESVM), the proposed ST-CapsNet framework significantly outperformed the state-of-the-art methods in terms of ASUR. More interestingly, the absolute values of the spatial filters learned by ST-CapsNet are higher in the parietal lobe and occipital region, which is consistent with the generation mechanism of P300.

Overview

CoChat Summary

TL;DR

ST-CapsNet combines spatial and temporal attention modules with a capsule network to refine EEG signals before P300 detection. Across BCI Competition datasets, it improved single-trial P300 detection and cumulative symbol recognition over ERP-CapsNet and several CNN/traditional baselines.

Key findings

  • Single-trial P300 detection: ST-CapsNet reached Acc./F1 of 0.8997/0.7213 on IIb, 0.7785/0.4535 on II-A, and 0.8342/0.5405 on II-B; ERP-CapsNet reached 0.8927/0.7146, 0.7456/0.4546, and 0.8160/0.5287, respectively. ST-CapsNet outperformed other models on IIb and II-B, while ERP-CapsNet had slightly higher F1 on II-A.
  • Symbol recognition: ST-CapsNet had the highest ASUR15 on all three datasets (IIb 30.5, II-A 74.0, II-B 84.3), versus ERP-CapsNet’s 30.1, 73.7, and 82.9. ERP-CapsNet was slightly more accurate in the first 5 repetitions on II-A (ASUR5 45.8 vs. 45.2).
  • ITR: ST-CapsNet and MsCNN-TL-SVM achieved the highest ITR on IIb (51.56 bits/min); ST-CapsNet reached 13.32 bits/min in the 6th repetition on II-A and 19.74 bits/min in the 2nd repetition on II-B.
  • Learned spatial attention maps shared channels Cz and CPz and highlighted central/parietal regions; averaged spatial filters had higher values in parietal and occipital regions, with common top electrodes PO7, PO8, O1, CPz, and Pz.

Methods

  • Design: EEG signals were first refined by spatial attention and temporal attention modules, then fed into a capsule network for discriminative feature extraction and P300 classification. The capsule network used 10 C×1 spatial filters, 64 1×13 temporal filters, 48 8D primary capsules, 3 dynamic-routing iterations, two 16D output capsules, and a decoder with 512, 1024, and C×78 neurons.
  • Data: Two public datasets were used—Dataset IIb of BCI Competition 2003 and Dataset II of BCI Competition III, with the latter split into II-A and II-B. Preprocessing extracted 0–650 ms after intensification, applied a 0.1–20 Hz FIR band-pass filter, downsampled to 78 time points, and normalized via z-score and sigmoid; P300/Non-P300 imbalance was reduced by averaging randomly selected P300 samples.
  • Analysis: Models were implemented in PyTorch, trained on an RTX 2080 Ti with batch size 64, initial learning rate 0.001 with exponential decay 0.96, Adam optimizer, early stopping, and braindecode augmentation. Evaluation used accuracy and F1 for single-trial P300 detection, the proposed ASUR metric for cumulative symbol recognition across repetitions, and ITR.

Limitations

  • Stated: the capsule network has relatively many parameters compared with traditional methods and CNNs, requiring longer training time and higher-performance equipment.
  • Stated: the model cannot precisely control recognition accuracy at a single repetition because P300 detection in single trial and symbol recognition are separate tasks, and the model/loss were designed for the first task without a dedicated training method for symbol recognition.
  • Evident from the text: evaluation is limited to two public P300 datasets, split into three subject-specific datasets (IIb, II-A, II-B), so generalization to other subjects, paradigms, or larger cohorts is not established.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1109/tnsre.2023.3237319

Cites

48 of 48 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Verification

Claims the paper makes

7 Valid · 1 Not valid · 7 Not checked · 50 Own results and interpretations

37 more claims

Create a free account to see all 65 claims and to verify the 1 reference still open.

See all claims — free account
  • Probably not a substantial claim. 12
  • It may state two separate claims as one. 13

Create a free account to see these claims.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

1 of 1

Citations

Cites

Show all 43 references

Research works printed but not linked: 2

  1. Wang, 2019, An event related potential electroencephalogram signal analysis method based on denoising auto-encoder neural network, Control Theory Appl., 36, 589
  2. Christof, 2021, Lossfunctions.jl.

Cited by

See all 75

Metadata

Authors
Wang, Z., Chen, C., Li, J., Wan, F., Sun, Y., & Wang, H.
Affiliations
  • Wuyi University (CN)
  • University of Essex (GB)
  • University of Macau (MO)
  • Sir Run Run Shaw Hospital (CN)
Venue
IEEE Transactions on Neural Systems and Rehabilitation Engineering
Published
2023
Volume
31
Pages
991-1000
ISSN
  • 1534-4320 (ISSN-L)
  • 1558-0210
OpenAlex
W4316660615
Cited by
75
References
43
Citations by year
2026: 19 · 2025: 23 · 2024: 29 · 2023: 4
FWCI
11.25
Type
journal article
Language
en
Open access
Locations
  • IEEE Transactions on Neural Systems and Rehabilitation Engineering (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • Open Access at Essex (University of Essex) (acceptedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Funders
  • Special Projects in Key Fields Supported by the Technology Development Project of Guangdong (2020ZDZX3018)
  • Special Fund for Science and Technology of Guangdong Province (2020182)
  • Wuyi University and Hong Kong and Macao joint Research Project (2019WGALH16)
  • Basic and Applied Basic Research Foundation of Guangdong Province (2020A1515111154)
  • Department of Education of Guangdong Province (2021KTSCX136)
  • National Natural Science Foundation of China (82172056)
  • Zhejiang Provincial Natural Science Foundation of China (LR23F010003)
  • National Key Research and Development Program of China (2021ZD030048)
  • Key Research and Development Program of Zhejiang Province (2022C03064)
  • Science and Technology Development Fund, Macau (0045/2019/AFJ)
  • University of Macau (MYRG2022-00197-FST)
Topics
  • Life Sciences › Neuroscience › Cognitive Neuroscience › EEG and Brain-Computer Interfaces
  • Physical Sciences › Computer Science › Human-Computer Interaction › Gaze Tracking and Assistive Technology
  • Physical Sciences › Computer Science › Artificial Intelligence › Emotion and Mood Recognition
Keywords
P300 detection, brain-computer interface, capsule networks, spatial attention, temporal attention, symbol recognition, BCI competition datasets

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: ST-CapsNet: Linking Spatial and Temporal Attention With Capsule Network for P300 Detection Improvement. https://app.cochat.ai/papers/10.1109/tnsre.2023.3237319
The paper
Wang, Z., Chen, C., Li, J., Wan, F., Sun, Y., & Wang, H. (2023). ST-CapsNet: Linking Spatial and Temporal Attention With Capsule Network for P300 Detection Improvement. IEEE Transactions on Neural Systems and Rehabilitation Engineering. https://doi.org/10.1109/tnsre.2023.3237319

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.