Cited by 92EEG and Brain-Computer InterfacesGaze Tracking and Assistive TechnologyEmotion and Mood Recognition

Convolutional neural networks for decoding of covert attention focus and saliency maps for EEG feature visualization

Open access
Farahat, Amr, Reichert, Christoph, Sweeney-Reed, Catherine M, Hinrichs, Hermann·2019·Journal of Neural Engineering

Published version of a preprint

Abstract

OBJECTIVE: Convolutional neural networks (CNNs) have proven successful as function approximators and have therefore been used for classification problems including electroencephalography (EEG) signal decoding for brain-computer interfaces (BCI). Artificial neural networks, however, are considered black boxes, because they usually have thousands of parameters, making interpretation of their internal processes challenging. Here we systematically evaluate the use of CNNs for EEG signal decoding and investigate a method for visualizing the CNN model decision process. APPROACH: We developed a CNN model to decode the covert focus of attention from EEG event-related potentials during object selection. We compared the CNN and the commonly used linear discriminant analysis (LDA) classifier performance, applied to datasets with different dimensionality, and analyzed transfer learning capacity. Moreover, we validated the impact of single model components by systematically altering the model. Furthermore, we investigated the use of saliency maps as a tool for visualizing the spatial and temporal features driving the model output. MAIN RESULTS: The CNN model and the LDA classifier achieved comparable accuracy on the lower-dimensional dataset, but CNN exceeded LDA performance significantly on the higher-dimensional dataset (without hypothesis-driven preprocessing), achieving an average decoding accuracy of 90.7% (chance level = 8.3%). Parallel convolutions, tanh or ELU activation functions, and dropout regularization proved valuable for model performance, whereas the sequential convolutions, ReLU activation function, and batch normalization components reduced accuracy or yielded no significant difference. Saliency maps revealed meaningful features, displaying the typical spatial distribution and latency of the P300 component expected during this task. SIGNIFICANCE: Following systematic evaluation, we provide recommendations for when and how to use CNN models in EEG decoding. Moreover, we propose a new approach for investigating the neural correlates of a cognitive task by training CNN models on raw high-dimensional EEG data and utilizing saliency maps for relevant feature extraction.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1088/1741-2552/ab3bb4

Cites

62 of 62 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

1 of the 63 references couldn’t be matched to a known paper.

Cited by

Sorted by citations

Authors
Farahat, A., Reichert, C., Sweeney-Reed, C. M., & Hinrichs, H.
Affiliations
  • Otto-von-Guericke-Universität Magdeburg (DE)
  • Leibniz Institute for Neurobiology (DE)
  • Center for Behavioral Brain Sciences (DE)
Corresponding author
Farahat, Amr
Venue
Journal of Neural Engineering
Published
2019-10-23
Volume
16
Issue
6
Pages
066010
ISSN
  • 1741-2552 (ISSN-L)
  • 1741-2560
OpenAlex
W2968094935
Cited by
92
References
63
Citations by year
2026: 6 · 2025: 14 · 2024: 22 · 2023: 10 · 2022: 18 · 2021: 15 · 2020: 7
FWCI
5.81
Type
journal article
Language
en
Open access
Locations
  • Journal of Neural Engineering (publishedVersion, cc-by)
  • bioRxiv (Cold Spring Harbor Laboratory) (acceptedVersion)
  • PubMed (publishedVersion)
  • Informationszentrum Lebenswissenschaften (ZB MED) (submittedVersion, cc-by)
Funders
Bundesministerium für Bildung und Forschung (13GW0095D)
Topics
  • Life Sciences › Neuroscience › Cognitive Neuroscience › EEG and Brain-Computer Interfaces
  • Physical Sciences › Computer Science › Human-Computer Interaction › Gaze Tracking and Assistive Technology
  • Social Sciences › Psychology › Experimental and Cognitive Psychology › Emotion and Mood Recognition
Keywords
EEG decoding, covert attention, saliency maps, convolutional neural networks, brain-computer interface, event-related potentials, P300, model interpretability, transfer learning, linear discriminant analysis, object selection, activation function comparison, dropout regularization, neural correlates
MeSH terms
Attention, Brain Mapping, Electroencephalography, Female, Humans, Male, Neural Networks, Computer

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review