CoChat

An Improved Multimodal Dimension Emotion Recognition Based on Different Fusion Methods

Su, Haiyang, Liu, Bin, Tao, Jianhua, Dong, Yongfeng, Huang, Jian, Lian, Zheng, Song, Leichao · 2020 · 2020 15th IEEE International Conference on Signal Processing (ICSP)

The DOI matches its Crossref record; 25 of the 26 references it cites were found in a registry or an index.

Abstract

Continuous emotion recognition is a challenging task and a key part of human-computer interaction, especially multimodal emotion recognition can effectively improve the accuracy and robustness of recognition. But there are limited emotion data sets, and it is difficult to extract emotion features. We present a multi-level segmented decision level fusion emotion recognition model to improve the performance of emotion recognition. In this paper, we predict multi-modal dimensional emotional state on AVEC2017 dataset. Our model uses Bidirectional Long Short-Term Memory (BLSTM) as multi-level segmented emotional feature learning model, and uses the SVR model as fusion model of the decision layer. The BLSTM can model different forms of emotional information in time, and can also consider the impact of previous and later emotional features on current results. The SVR model can compensate for the redundant information of emotion recognition. At the same time, we also consider annotation delay and temporal pooling in our multi-modal dimensional emotion recognition model. Our multi-modal emotion recognition model achieves significant recognition improvements and provide the robustness. Finally, we compare the baseline methods which used the same dataset, and find that the CCC performance of our method is the best on arousal, which is 0.685. Our research shows that the proposed multi-layer segmentation decision level fusion emotion recognition model is conducive to improving performance.

Overview

Integrity signals

Registry

Crossref · 10.1109/icsp48669.2020.9321008

Cites

25 of 25 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Show all 25 references

Cited by

See all 10

Metadata

Authors
Su, H., Liu, B., Tao, J., Dong, Y., Huang, J., Lian, Z., & Song, L.
Affiliations
  • Hebei University of Technology (CN)
  • Institute of Automation (CN)
Venue
2020 15th IEEE International Conference on Signal Processing (ICSP)
Publisher
IEEE
Published
2020-12-06
Pages
257-261
OpenAlex
W3127502324
Cited by
10
References
26
Citations by year
2026: 1 · 2025: 2 · 2024: 3 · 2023: 2 · 2022: 2
FWCI
0.97
Type
conference paper
Language
en
Open access
closed
Locations
International Conference on Signal Processing (publishedVersion)
Funders
National Natural Science Foundation of China
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Emotion and Mood Recognition
  • Physical Sciences › Computer Science › Artificial Intelligence › Sentiment Analysis and Opinion Mining
  • Physical Sciences › Computer Science › Signal Processing › Speech and Audio Processing
Keywords
multimodal emotion recognition, decision fusion, bidirectional LSTM, support vector regression, arousal prediction, temporal pooling

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: An Improved Multimodal Dimension Emotion Recognition Based on Different Fusion Methods. https://app.cochat.ai/papers/10.1109/icsp48669.2020.9321008
The paper
Su, H., Liu, B., Tao, J., Dong, Y., Huang, J., Lian, Z., & Song, L. (2020). An Improved Multimodal Dimension Emotion Recognition Based on Different Fusion Methods. 2020 15th IEEE International Conference on Signal Processing (ICSP). https://doi.org/10.1109/icsp48669.2020.9321008

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.