Cited by 53EEG and Brain-Computer InterfacesGaze Tracking and Assistive TechnologyEmotion and Mood Recognition

A Simple Convolutional Neural Network for Accurate P300 Detection and Character Spelling in Brain Computer Interface

Open access
Shan, Hongchang, Liu, Yu, Stefanov, Todor·2018·Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence

Abstract

A Brain Computer Interface (BCI) character speller allows human-beings to directly spell characters using eye-gazes, thereby building communication between the human brain and a computer. Convolutional Neural Networks (CNNs) have shown better performance than traditional machine learning methods for BCI signal recognition and its application to the character speller. However, current CNN architectures limit further accuracy improvements of signal detection and character spelling and also need high complexity to achieve competitive accuracy, thereby preventing the use of CNNs in portable BCIs. To address these issues, we propose a novel and simple CNN which effectively learns feature representations from both raw temporal information and raw spatial information. The complexity of the proposed CNN is significantly reduced compared with state-of-the-art CNNs for BCI signal detection. We perform experiments on three benchmark datasets and compare our results with those in previous research works which report the best results. The comparison shows that our proposed CNN can increase the signal detection accuracy by up to 15.61% and the character spelling accuracy by up to 19.35%.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.24963/ijcai.2018/222

Cites

3 of 3 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Shan et al. (2018) proved that an architecture with the first layer performing a mixed spatio-temporal convolution (OCLNN) improved decoding performance compared with the architecture proposed by Cecotti and Graser (2011) and other variants.

    “The authors proved that an architecture with the first layer performing a mixed spatio-temporal convolution (OCLNN) improved the decoding performance compared with the architecture proposed by Cecotti and Graser (2011) and other variants (Manor and Geva, 2015; Liu et al., 2018).”
  • Shan et al. (2018) pointed out that architectures that learn spatial features before temporal features may lose useful raw temporal information related to the P300 event because temporal features are learned from spatially filtered signals instead of from raw inputs.

    “Shan et al. (2018) pointed out that these architectures may lose useful raw temporal information related to the P300 event since temporal features are learned from spatially filtered signals instead of from raw inputs.”

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 21

  1. Abadi et al., 2016] Martín Abadi, Ashish Agarwal, et al. Tensorflow: Large-scale machine learning on heterogeneous distributed systems. arXiv preprint arXiv:1603.04467, 2016. · arXiv
  2. Vladimir Bostanov. BCI competition 2003-data sets Ib and IIb: feature extraction from event- related brain potentials with the continuous wavelet trans- form and the t-value scalogram. IEEE Transactions on Biomedical Engineering, 51(6):1057-1061, 2004.
  3. Cecotti and Graser, 2011] Hubert Cecotti and Axel Graser. Convolutional neural networks for P300 detection with ap- plication to brain-computer interfaces. IEEE Transactions on Pattern Analysis and Machine Intelligence, 33(3):433- 445, 2011.
  4. Hubert Cecotti, Bertrand Rivet, et al. A robust sensor-selection method for P300 brain-computer interfaces. Journal of Neural Engineering, 8(1):016001, 2011.
  5. Tsan-Yu Chen, Chih-Wei Feng, and Wai- Chi Fang. Development of a reliable SSVEP-based BCI mobile dialing system. In Consumer Electronics (ICCE), 2016 IEEE International Conference on, pages 269-272. IEEE, 2016.
  6. Farwell and Donchin, 1988] Lawrence Ashley Farwell and Emanuel Donchin. Talking off the top of your head: to- ward a mental prosthesis utilizing event-related brain po- tentials. Electroencephalography and Clinical Neurophys- iology, 70(6):510-523, 1988.
  7. Junfeng Gao, Chongxun Zheng, and Pei Wang. Online removal of muscle artifact from electroen- cephalogram signals based on canonical correlation anal- ysis. Clinical EEG and Neuroscience, 41(1):53-59, 2010.
  8. Stephen William Gilroy, Julie Porteous, et al. A brain-computer interface to a plan-based narra- tive. In International Joint Conference on Artificial Intel- ligence, pages 1997-2005, 2013.
  9. Joseph T Gwin, Klaus Gramann, et al. Removal of movement artifact from high-density EEG recorded during walking and running. Journal of Neuro- physiology, 103(6):3526-3534, 2010.
  10. Ioffe and Szegedy, 2015] Sergey Ioffe and Christian Szegedy. Batch normalization: Accelerating deep net- work training by reducing internal covariate shift. In International Conference on Machine Learning, pages 448-456, 2015.
  11. Chin-Teng Lin, Shu-Fang Tsai, and Li-Wei Ko. EEG-based learning system for online motion sick- ness level estimation in a dynamic vehicle environment. IEEE Transactions on Neural Networks and Learning Sys- tems, 24(10):1689-1700, 2013.
  12. Chin-Teng Lin, Bor-Shyh Lin, et al. Brain computer interface-based smart living environmental auto- adjustment control system in UPnP home networking. IEEE Systems Journal, 8(2):363-370, 2014.
  13. Mennes et al., 2010] Maarten Mennes, Heidi Wouters, Bart Vanrumste, Lieven Lagae, and Peter Stiers. Validation of ICA as a tool to remove eye movement artifacts from EEG/ERP. Psychophysiology, 47(6):1142-1150, 2010.
  14. Polich, 2007] John Polich. Updating P300: an integra- tive theory of P3a and P3b. Clinical Neurophysiology, 118(10):2128-2148, 2007.
  15. Rakotomamonjy and Guigue, 2008] Alain Rakotomamonjy and Vincent Guigue. BCI competition III: dataset II- ensemble of SVMs for BCI P300 speller. IEEE Transac- tions on Biomedical Engineering, 55(3):1147-1154, 2008.
  16. Bertrand Rivet, Antoine Souloumiac, et al. xDAWN algorithm to enhance evoked potentials: ap- plication to brain-computer interface. IEEE Transactions on Biomedical Engineering, 56(8):2035-2043, 2009.
  17. Sellers and Donchin, 2006] Eric W Sellers and Emanuel Donchin. A P300-based brain-computer interface: ini- tial tests by ALS patients. Clinical Neurophysiology, 117(3):538-548, 2006.
  18. Karen Simonyan and An- drew Zisserman. Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556, 2014. · arXiv
  19. Nitish Srivastava, Geoffrey E Hin- ton, et al. Dropout: a simple way to prevent neural net- works from overfitting. Journal of Machine Learning Re- search, 15(1):1929-1958, 2014.
  20. Sutton et al., 1967] Samuel Sutton, Patricia Tueting, et al. Information delivery and the sensory evoked potential. Science, 155(3768):1436-1439, 1967.
  21. Yu-Te Wang, Yijun Wang, and Tzyy- Ping Jung. A cell-phone-based brain-computer interface for communication in daily life. Journal of Neural Engi- neering, 8(2):025018, 2011.

Cited by

Authors
Shan, H., Liu, Y., & Stefanov, T.
Affiliations
Leiden University (NL)
Venue
Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence
Published
2018-07
Pages
1604-1610
OpenAlex
W2808255765
Cited by
53
References
3
Citations by year
2026: 2 · 2025: 3 · 2024: 6 · 2023: 6 · 2022: 14 · 2021: 7 · 2020: 9 · 2019: 6
FWCI
9.49
Type
conference paper
Language
en
Open access
Locations
International Joint Conference on Artificial Intelligence (publishedVersion)
Topics
  • Life Sciences › Neuroscience › Cognitive Neuroscience › EEG and Brain-Computer Interfaces
  • Physical Sciences › Computer Science › Human-Computer Interaction › Gaze Tracking and Assistive Technology
  • Social Sciences › Psychology › Experimental and Cognitive Psychology › Emotion and Mood Recognition
Keywords
P300 detection, brain-computer interface, convolutional neural networks, EEG classification, gaze, portable BCI, feature representation learning

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review