CoChat

Emotion Recognition from Multiband EEG Signals Using CapsNet

Open access
Chao, Hao, Dong, Liang, Liu, Yongli, Lu, Baoyun · 2019 · Sensors

The DOI matches its Crossref record; 45 of the 45 references it cites were found in a registry or an index.

Abstract

Emotion recognition based on multi-channel electroencephalograph (EEG) signals is becoming increasingly attractive. However, the conventional methods ignore the spatial characteristics of EEG signals, which also contain salient information related to emotion states. In this paper, a deep learning framework based on a multiband feature matrix (MFM) and a capsule network (CapsNet) is proposed. In the framework, the frequency domain, spatial characteristics, and frequency band characteristics of the multi-channel EEG signals are combined to construct the MFM. Then, the CapsNet model is introduced to recognize emotion states according to the input MFM. Experiments conducted on the dataset for emotion analysis using EEG, physiological, and video signals (DEAP) indicate that the proposed method outperforms most of the common models. The experimental results demonstrate that the three characteristics contained in the MFM were complementary and the capsule network was more suitable for mining and utilizing the three correlation characteristics.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.3390/s19092212

Cites

45 of 45 references verified0 citation errors · 0 not checkable

Statistics

Figures

Figure 1 Three-dimensional space of the emotion model.
Figure 1 Three-dimensional space of the emotion model.CC BY · PubMed Central
Figure 2 Images used for self-assessment: (top) Valence self-assessment manikin (SAM); (middle) Arousal SAM; (bottom) Dominance SAM.
Figure 2 Images used for self-assessment: (top) Valence self-assessment manikin (SAM); (middle) Arousal SAM; (bottom) Dominance SAM.CC BY · PubMed Central
Figure 3 International 10–20 system and 9 × 9 square matrix.
Figure 3 International 10–20 system and 9 × 9 square matrix.CC BY · PubMed Central
Figure 4 The mapping process of multiband feature matrix according to the raw electroencephalograph (EEG) signals of 32 channels.
Figure 4 The mapping process of multiband feature matrix according to the raw electroencephalograph (EEG) signals of 32 channels.CC BY · PubMed Central
Figure 5 (a) Information transfer between capsules; (b) Routing process.
Figure 5 (a) Information transfer between capsules; (b) Routing process.CC BY · PubMed Central
Figure 6 Architecture of the capsule network (CapsNet)-based model. ReLU: rectified linear unit.
Figure 6 Architecture of the capsule network (CapsNet)-based model. ReLU: rectified linear unit.CC BY · PubMed Central
Figure 7 Accuracy of different models in three dimensions in the first step.
Figure 7 Accuracy of different models in three dimensions in the first step.CC BY · PubMed Central
Figure 8 Accuracy of different models in three dimensions in the second step.
Figure 8 Accuracy of different models in three dimensions in the second step.CC BY · PubMed Central
Figure 9 Comparison of emotion recognition results between CapsNet and comparison classifiers. CNN: convolutional neural network; k-NN: k-nearest neighbor; RDF: random decision forest; SVM: support vector machine.
Figure 9 Comparison of emotion recognition results between CapsNet and comparison classifiers. CNN: convolutional neural network; k-NN: k-nearest neighbor; RDF: random decision forest; SVM: support vector machine.CC BY · PubMed Central
Figure 10 Comparison of 2D-CNN and CapsNet using multiband feature matrices (MFMs).
Figure 10 Comparison of 2D-CNN and CapsNet using multiband feature matrices (MFMs).CC BY · PubMed Central

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 45 references

Research works printed but not linked: 1

  1. Morris J.D. SAM: The Self-Assessment Manikin an Efficient Cross-Cultural Measurement of Emotional Response Advertising Research. 1995 35 63 68

Cited by

Items 101–200 of 303

Metadata

Authors
Chao, H., Dong, L., Liu, Y., & Lu, B.
Affiliations
  • School of Computer Science and Technology, Henan Polytechnic University, Jiaozuo 454000, China
  • Henan Polytechnic University (CN)
Venue
Sensors
Publisher
MDPI AG
Published
2019-05-13
Volume
19
Issue
9
Pages
2212
ISSN
1424-8220 (ISSN-L)
OpenAlex
W2944401411
Cited by
287
References
45
Citations by year
2026: 16 · 2025: 25 · 2024: 34 · 2023: 51 · 2022: 65 · 2021: 47 · 2020: 40 · 2019: 9
FWCI
47.26
Type
journal article
Language
en
Open access
Locations
  • Sensors (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Funders
  • Foundation for University Key Teacher by Henan Province (2015GGJS068)
  • Fundamental Research Funds for the Universities of Henan Province (NSFRF1616)
  • Key Scientific Research Projects of Universities in Henan (19A520004)
  • Foundation for Scientific and Technological Project of Henan Province (172102210279)
  • National Nature Science Foundation of China (61502150 and 61403128)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Emotion and Mood Recognition
  • Life Sciences › Neuroscience › Cognitive Neuroscience › EEG and Brain-Computer Interfaces
  • Physical Sciences › Computer Science › Signal Processing › Biometric Identification and Security
Keywords
emotion recognition, capsule networks, frequency-domain features, DEAP dataset, physiological signals
MeSH terms
Machine Learning, Cerebral Cortex, Electrodes, Electroencephalography, Emotions, Humans, Signal Processing, Computer-Assisted, Entropy

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.