Expression EEG Multimodal Emotion Recognition Method Based on the Bidirectional LSTM and Attention Mechanism
Open accessThe DOI matches its Crossref record; 2 of the 2 references it cites were found in a registry or an index.
Abstract
Due to the complexity of human emotions, there are some similarities between different emotion features. The existing emotion recognition method has the problems of difficulty of character extraction and low accuracy, so the bidirectional LSTM and attention mechanism based on the expression EEG multimodal emotion recognition method are proposed. Firstly, facial expression features are extracted based on the bilinear convolution network (BCN), and EEG signals are transformed into three groups of frequency band image sequences, and BCN is used to fuse the image features to obtain the multimodal emotion features of expression EEG. Then, through the LSTM with the attention mechanism, important data is extracted in the process of timing modeling, which effectively avoids the randomness or blindness of sampling methods. Finally, a feature fusion network with a three-layer bidirectional LSTM structure is designed to fuse the expression and EEG features, which is helpful to improve the accuracy of emotion recognition. On the MAHNOB-HCI and DEAP datasets, the proposed method is tested based on the MATLAB simulation platform. Experimental results show that the attention mechanism can enhance the visual effect of the image, and compared with other methods, the proposed method can extract emotion features from expressions and EEG signals more effectively, and the accuracy of emotion recognition is higher.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Learning Affective Features With a Hybrid Deep Model for Audio–Visual Emotion Recognition
Zhang, S., Zhang, S., Huang, T., Gao, W., & Tian, Q. (2018) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2017.2719043 · Cited by 346 · cited 1×
“However, this kind of method has low e ffi ciency in processing large-scale human emotion data [21].”
BackgroundEEG-Based Emotion Recognition Using Hierarchical Network With Subnetwork Nodes
Yang, Y., Wu, Q. M. J., Zheng, W.-L., & Lu, B.-L. (2018) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2017.2685338 · Cited by 141
Cited by
Muhammad, F., Hussain, M., & Aboalsamh, H. (2023) · Diagnostics · doi:10.3390/diagnostics13050977 · Cited by 36
“(6) Bidirectional Long-term and Short-term Memory (BLSM) Network [57]: A threelayered bidirectional LSTM network is designed for feature-level fusion.”
BackgroundMethodInfluentialMulti-Domain Encoding of Spatiotemporal Dynamics in EEG for Emotion Recognition
Cheng, C., Zhang, Y., Liu, L., Liu, W., & Feng, L. (2023) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2022.3232497 · Cited by 29
“Emotion recognition is a significant research topic in the field of HCI, which aims to use computer technology to perceive human emotional states and establish an intelligent system that can identify human emotional states and provide accurate feedback [1].”
BackgroundMethodMoussaoui, K., & Farah, M. (2024) · 2024 IEEE 7th International Conference on Advanced Technologies, Signal and Image Processing (ATSIP) · doi:10.1109/atsip62566.2024.10638977 · Cited by 2
Metadata
- Authors
- Zhao, Y., & Chen, D.
- Venue
- Computational and Mathematical Methods in Medicine
- Publisher
- Wiley
- Published
- 2021-05-11
- Volume
- 2021
- Pages
- 1-12
- ISSN
- 1748-670X (ISSN-L)
- 1748-6718
- OpenAlex
- W3161138502
- Cited by
- 39
- References
- 2
- FWCI
- 5.34
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.