Continuous Multimodal Emotion Prediction Based on Long Short Term Memory Recurrent Neural Network
The DOI matches its Crossref record; 33 of the 34 references it cites were found in a registry or an index.
Abstract
The continuous dimensional emotion can depict subtlety and complexity of emotional change, which is an inherently challenging problem with growing attention. This paper presents our automatic prediction of dimensional emotional state for Audio-Visual Emotion Challenge (AVEC 2017), which uses multi-features and fusion across all available modalities. Besides the baseline features provided by the organizers, we also extract other acoustic audio feature sets, appearance features and deep visual features as complementary features. Each type of feature is trained using Long Short-Term Memory Recurrent Neutral Network (LSTM-RNN) for every dimensional emotion prediction separately considering annotation delay and temporal pooling. To overcome overfitting problem, robust models are chosen carefully for individual model. Finally, multimodal emotion fusion is achieved by utilizing Support Vector Regression (SVR) with the estimates from different feature sets in decision level fusion. The experimental results indicate that our extracted features are beneficial to performance improvement and our system design achieves very promising results with Concordant Correlation Coefficient (CCC), which outperform the baseline system on the testing set for arousal of 0.599 vs 0.375 (baseline) and for valence of 0.721 vs 0.466 and for liking 0.295 vs 0.246.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Furthermore, Huang et al. [86] adopted Long Short-Term Memory (LSTM) networks to create affect prediction models that fully leverage affective information from each modality. They formulated prediction models for various feature types within each modality and used Support Vector Regression (SVR) as the fusion model in the decision layer.”
From A Survey of Deep Learning-Based Multimodal Emotion Recognition: Speech, Text, and Face (2023) · cites this paper as [86]
Citations
Cites
Histograms of Oriented Gradients for Human Detection
Dalal, N., & Triggs, B. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.177 · Cited by 33,584 · cited 1×
“HOG [28] features describe the distribution information of intensity gradients or edge directions.”
BackgroundADADELTA: An Adaptive Learning Rate Method
Zeiler, M. D. (2012) · arXiv · doi:10.48550/arxiv.1212.5701 · Cited by 5,322
Opensmile: the munich versatile and fast open-source audio feature extractor
Eyben, F., Wöllmer, M., & Schuller, B. (2010) · Proceedings of the 18th ACM international conference on Multimedia · doi:10.1145/1873951.1874246 · Cited by 2,642 · cited 1×
“The extraction of the LLDs and the computation of the functionals are done using the openSMILE toolkit [25].”
MethodThe Geneva Minimalistic Acoustic Parameter Set (GeMAPS) for Voice Research and Affective Computing
Eyben, F., Scherer, K. R., Schuller, B. W., Sundberg, J., Andre, E., Busso, C., Devillers, L. Y., Epps, J., Laukka, P., Narayanan, S. S., et al. (2016) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2015.2457417 · Cited by 1,818 · cited 1×
“For the audio signals, AVEC organizers provide the extended Geneva Minimalistic Acoustic Parameter Set (eGeMAPS) [13] as baseline features.”
MethodAMIGOS: A Dataset for Affect, Personality and Mood Research on Individuals and Groups
Miranda-Correa, J. A., Abadi, M. K., Sebe, N., & Patras, I. (2021) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2018.2884461 · Cited by 709
AVEC 2013: the continuous audio/visual emotion and depression recognition challenge
Valstar, M., Schuller, B., Smith, K., Eyben, F., Jiang, B., Bilakhia, S., Schnieder, S., Cowie, R., & Pantic, M. (2013) · Proceedings of the 3rd ACM international workshop on Audio/visual emotion challenge · doi:10.1145/2512530.2512533 · Cited by 581 · cited 1×
“The depression recognition sub-challenge is added since AVEC 2013 [7], which is related to emotion recognition well.”
BackgroundThe INTERSPEECH 2010 paralinguistic challenge
Schuller, B., Steidl, S., Batliner, A., Burkhardt, F., Devillers, L., Müller, C., & Narayanan, S. S. (2010) · Interspeech 2010 · doi:10.21437/interspeech.2010-739 · Cited by 571 · cited 1×
“Specifically, we extract the baseline audio feature set of INTERSPEECH 2010 Paralinguistic Challenge (IS10) [26] which can better reflect a border coverage of paralinguistic information assessment.”
MethodAVEC 2016: Depression, Mood, and Emotion Recognition Workshop and Challenge
Valstar, M., Gratch, J., Schuller, B., Ringeval, F., Lalanne, D., Torres Torres, M., Scherer, S., Stratou, G., Cowie, R., & Pantic, M. (2016) · Proceedings of the 6th International Workshop on Audio/Visual Emotion Challenge · doi:10.1145/2988257.2988258 · Cited by 503 · cited 4×
“The physiological modality is added in AVEC 2015 [9] and AVEC 2016 [10], but doesn’t appear in AVEC 2017 [11].”
BackgroundMethodInfluentialTao, J., & Tan, T. (2005) · Lecture Notes in Computer Science · doi:10.1007/11573548_125 · Cited by 494 · cited 2×
“In SVM, the parameter C varies from range [1, 100]”
BackgroundSelf-citationAVEC 2014: 3D Dimensional Affect and Depression Recognition Challenge
Valstar, M., Schuller, B., Smith, K., Almaev, T., Eyben, F., Krajewski, J., Cowie, R., & Pantic, M. (2014) · Proceedings of the 4th International Workshop on Audio/Visual Emotion Challenge · doi:10.1145/2661806.2661807 · Cited by 472 · cited 1×
“Michel et al. [8] calculate the average ratings from all raters to minimize the label noise.”
Background
Research works printed but not linked: 1
- 10.1016/j.imavis.2012.03.001 · DOI · Paper page
Cited by
Disentangled Representation Learning for Multimodal Emotion Recognition
Yang, D., Huang, S., Kuang, H., Du, Y., & Zhang, L. (2022) · Proceedings of the 30th ACM International Conference on Multimedia · doi:10.1145/3503161.3547754 · Cited by 266
“Benefiting from the excellent performance of deep learning technologies in processing diverse signals [8, 21, 26– 28, 46, 54], various models have been developed to extract emotionrelated information from multimodal sequences, such as convolution neural networks [20], recurrent neural networks [22, 41], transformers […”
BackgroundA Survey of Deep Learning-Based Multimodal Emotion Recognition: Speech, Text, and Face
Lian, H., Lu, C., Li, S., Zhao, Y., Tang, C., & Zong, Y. (2023) · Entropy · doi:10.3390/e25101440 · Cited by 224
“Furthermore, Huang et al. [86] adopted Long Short-Term Memory (LSTM) networks to create affect prediction models that fully leverage affective information from each modality.”
BackgroundMultimodal Transformer Fusion for Continuous Emotion Recognition
Huang, J., Tao, J., Liu, B., Lian, Z., & Niu, M. (2020) · ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp40776.2020.9053762 · Cited by 173
“Traditional feature level fusion directly feeds the concatenated features into a classifier or uses shallow-layered fusion models [5], but it has the difficulty to learn mutual relationships among different modalities.”
BackgroundSelf-citationMocanu, B., Țapu, R., & Zaharia, T. B. (2023) · Image and Vision Computing · doi:10.1016/j.imavis.2023.104676 · Cited by 183
Transformer Encoder With Multi-Modal Multi-Head Attention for Continuous Affect Recognition
Chen, H., Jiang, D., & Sahli, H. (2020) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2020.3037496 · Cited by 158
Robust Multimodal Emotion Recognition from Conversation with Transformer-Based Crossmodality Fusion
Xie, B., Sidulova, M., & Park, C. H. (2021) · Sensors · doi:10.3390/s21144913 · Cited by 108
“A recent study [31] also investigated using a Long Short-Term Memory Recurrent Neural Network (LSTM-RNN) to train different modalities of features and to combine different feature vectors via concatenation.”
MethodEnd-to-end multimodal affect recognition in real-world environments
Tzirakis, P., Chen, J., Zafeiriou, S., & Schuller, B. (2021) · Information Fusion · doi:10.1016/j.inffus.2020.10.011 · Cited by 105
“Trigeorgis et al. [58] .541 .488 .513 Li et al. [14] .552 .534 .543 Tzirakis et al. [13] .563 .532 .545 Table 3 SEWA dataset test results (in terms of 𝜌 𝑐 ) for the text modality, and for the prediction of arousal and valence.”
InfluentialModeling Emotion in Complex Stories: The Stanford Emotional Narratives Dataset
Ong, D. C., Wu, Z., Zhi‐Xuan, T., Reddan, M. C., Kahhalé, I., Mattek, A. M., & Zaki, J. (2019) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2019.2955949 · Cited by 98
“These individual models are then connected later in the computation to predict outputs [44], [53].”
BackgroundSun, L., Lian, Z., Tao, J., Liu, B., & Niu, M. (2020) · Proceedings of the 1st International on Multimodal Sentiment Analysis in Real-life Media Challenge and Workshop · doi:10.1145/3423327.3423672 · Cited by 81
“At first, competitors use the classic bag-of-words features [12, 23].”
BackgroundMethodInfluentialSelf-citationMultimodal temporal machine learning for Bipolar Disorder and Depression Recognition
Ceccarelli, F., & Mahmoud, M. (2021) · Pattern Analysis and Applications · doi:10.1007/s10044-021-01001-y · Cited by 77
“[24] fused features from different modalities by separately training long shortterm memory (LSTM) models and concatenating estimates from different feature sets using support vector regression (SVR) [25].”
MethodMultimodal emotion recognition based on manifold learning and convolution neural network
Zhang, Y., Cheng, C., & Zhang, Y. (2022) · Multimedia Tools and Applications · doi:10.1007/s11042-022-13149-8 · Cited by 67
“These bands have been proved to be closely related to psychological activities such as human emotions [11].”
BackgroundZhang, Y., Cheng, C., Wang, S., & Xia, T. (2022) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2022.103877 · Cited by 64
Wang, Y., Liang, L., Zhang, Z., Xu, X. D., Liu, R., Fang, H., Zhang, R., Wei, Y., Liu, Z., Zhu, R., et al. (2023) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2023.1195276 · Cited by 50
“While this model can exclude emotional interaction between psychotherapy and patients, it may also exhibit other voice issues, such as confusion of voice, changes in the virtual agent’s behavior, and long voice (18, 19).”
BackgroundMultimodal Continuous Emotion Recognition with Data Augmentation Using Recurrent Neural Networks
Huang, J., Li, Y., Tao, J., Lian, Z., Niu, M., & Yang, M. (2018) · Proceedings of the 2018 on Audio/Visual Emotion Challenge and Workshop · doi:10.1145/3266302.3266304 · Cited by 40
“Compared with SVR, LSTM can capture the temporal information of the emotional dimension better, which can achieve superior information [15][26].”
BackgroundMethodSelf-citationHybrid Multimodal Feature Extraction, Mining and Fusion for Sentiment Analysis
Li, J., Zhang, Z., Lang, J., Jiang, Y., An, L., Zou, P., Xu, Y., Gao, S., Lin, J., Fan, C., et al. (2022) · doi:10.1145/3551876.3554809 · Cited by 42
“In the past series of AVECs, participants use the deep learning method [8, 18], which is better than the traditional handcrafted features.”
BackgroundA Multi-Task Neural Approach for Emotion Attribution, Classification, and Summarization
Tu, G., Fu, Y., Li, B., Gao, J., Jiang, Y., & Xue, X. (2019) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2019.2922129 · Cited by 38
Multimodal Sentiment Analysis based on Recurrent Neural Network and Multimodal Attention
Cai, C., He, Y. L., Sun, L., Lian, Z., Liu, B., Tao, J., Xu, M., & Wang, K. (2021) · doi:10.1145/3475957.3484454 · Cited by 38
“Over the past decade, numerous research efforts have been made to build an effective and robust recognition model, leading to a great achievement [8, 10, 13, 18].”
BackgroundMethodSelf-citationSpeech Emotion Recognition Using Semantic Information
Tzirakis, P., Nguyen, A., Zafeiriou, S. P., & Schuller, B. W. (2021) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp39728.2021.9414866 · Cited by 40
Hybrid Mutimodal Fusion for Dimensional Emotion Recognition
Ma, Z., Ma, F., Sun, B., & Li, S. (2021) · doi:10.1145/3475957.3484457 · Cited by 38
“The methods [4] [15] in AVEC 2017 demonstrated that utilizing the convolutional neural networks for the visual representations obtained comparable and even better results than carefully-engineered features.”
BackgroundMethodRazzaq, M. A., Hussain, J., Bang, J., Hua, C.-H., Satti, F. A., Rehman, U. U., Bilal, H. S. M., Kim, S. T., & Lee, S. (2023) · Sensors · doi:10.3390/s23094373 · Cited by 36
“The outcomes of each emotion model are combined for prediction, using various integration techniques including averaging, majority voting, ensemble classification, weighting based on channel noise, signal variance, or through a learned model [18].”
MethodGuo, L., Wang, L., Dang, J., Fu, Y., Liu, J., & Ding, S. (2022) · IEEE Multimedia · doi:10.1109/mmul.2022.3161411 · Cited by 30
Jointly Aligning and Predicting Continuous Emotion Annotations
Khorram, S., McInnis, M. G., & Provost, E. M. (2019) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2019.2917047 · Cited by 31
“, segments or utterances) [18], [19], or continuously in time with a fixed sampling rate [20], [21].”
BackgroundReview on Multimodal Fusion Techniques for Human Emotion Recognition
Karani, R. B., & Desai, S. S. (2022) · International Journal of Advanced Computer Science and Applications · doi:10.14569/ijacsa.2022.0131035 · Cited by 32
“In many studies, researchers have used SVR with the RBF kernel for decision-level fusion of emotion recognition [10, 12].”
MethodMM-EMOR: Multi-Modal Emotion Recognition of Social Media Using Concatenated Deep Learning Networks
Adel, O., Fathalla, K. M., & Elfarag, A. A. (2023) · Big Data and Cognitive Computing · doi:10.3390/bdcc7040164 · Cited by 26
A Contextual Attention Network for Multimodal Emotion Recognition in Conversation
Wang, T., Hou, Y., Zhou, D., & Zhang, Q. (2021) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn52387.2021.9533718 · Cited by 27
“Traditional feature fusion approaches always directly feed the concatenated features into a classifier or use shallow-layered fusion models [25], which results in lack of learning mutual relationships among different modalities.”
BackgroundMultimodal Emotion Recognition for One-Minute-Gradual Emotion ChallengePreprint
Zheng, Z., Cao, C., Chen, X., & Xu, G. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.01060 · Cited by 23
Quality-Aware Bag of Modulation Spectrum Features for Robust Speech Emotion Recognition
Kshirsagar, S., & Falk, T. H. (2022) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2022.3188223 · Cited by 26
“and an autoregressive exogenousmodel backend [55], MFCC and GeMAPS features with a BiLSTM classifier [56], a BiLSTMmodel [57] with SoundNet [33] and bottleck features [58], and lastly, a transformer neural network trained on 34 features, corresponding to 13 MFCCs, 13 chromagram-based features, zero-crossing speeds, en…”
MethodLearning long-term temporal contexts using skip RNN for continuous emotion recognition
Huang, J., Liu, B., & Tao, J. (2021) · Virtual Reality & Intelligent Hardware · doi:10.1016/j.vrih.2020.11.005 · Cited by 17
Self-citationMultimodal Emotional Classification Based on Meaningful Learning
Filali, H., Riffi, J., Boulealam, C., Mahraz, M. A., & Tairi, H. (2022) · Big Data and Cognitive Computing · doi:10.3390/bdcc6030095 · Cited by 15
Vision based body gesture meta features for Affective ComputingPreprint
Orton, I. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.00809 · Cited by 14
“[31] train long-short-term memory (LSTM) models on facial, vocal, and text modalities and then use a decision level fusion, via a SVR, to predict the final regression values.”
MethodA Bayesian Filtering Framework for Continuous Affect Recognition From Facial Images
Pei, E., Zhao, Y. H., Oveneke, M. C., Jiang, D., & Sahli, H. (2022) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2022.3164248 · Cited by 11
“post-processing step involving median filtering, moving average or weighted moving average filtering [6]–[9].”
MethodLiu, Z., Zhao, Y., Song, S., Ba, Z., & Zhu, Q. (2022) · Telematics and Informatics · doi:10.1016/j.tele.2022.101872 · Cited by 14
An Improved Multimodal Dimension Emotion Recognition Based on Different Fusion Methods
Su, H., Liu, B., Tao, J., Dong, Y., Huang, J., Lian, Z., & Song, L. (2020) · 2020 15th IEEE International Conference on Signal Processing (ICSP) · doi:10.1109/icsp48669.2020.9321008 · Cited by 10
“The factor of annotation delay is processed in many emotion recognition systems of AVEC [9][17][18]to improve the prediction performance.”
BackgroundMethodInfluentialSelf-citationEfficient Modeling of Long Temporal Contexts for Continuous Emotion Recognition
Huang, J., Tao, J., Liu, B., Lian, Z., & Niu, M. (2019) · International Conference on Affective Computing and Intelligent Interaction and workshops · doi:10.1109/acii.2019.8925452 · Cited by 10
Self-citationHumor Detection System for MuSE 2023: Contextual Modeling, Pesudo Labelling, and Post-smoothing
Xu, M., Chen, S., Lian, Z., & Liu, B. (2023) · doi:10.1145/3606039.3613107 · Cited by 9
Self-citationDeep Learning for Continuous Multiple Time Series Annotations
Huang, J., Li, Y., Tao, J., Lian, Z., Niu, M., & Yang, M. (2018) · doi:10.1145/3266302.3266305 · Cited by 10
“Over the past decade, numerous research efforts have been made to build an effective and robust recognition model, leading to a great achievement [2][3][4].”
BackgroundMethodSelf-citationActive Speaker Recognition using Cross Attention Audio-Video Fusion
Mocanu, B., & Țapu, R. (2022) · European Workshop on Visual Information Processing · doi:10.1109/euvip53989.2022.9922810 · Cited by 7
“In early fusion [2], [3] the feature descriptors extracted from the visual and audio modalities are simply concatenated after extraction and applied as input to a fully connected layer to predict the final outputs.”
MethodChen, G., Qian, Z., Qiu, S., Zhang, D., & Zhou, R. (2025) · Digital Signal Processing · doi:10.1016/j.dsp.2025.105322 · Cited by 6
A Multi-Scale Multi-Task Learning Model for Continuous Dimensional Emotion Recognition from Audio
Li, X., Lu, G., Yan, J., & Zhang, Z. (2022) · Electronics · doi:10.3390/electronics11030417 · Cited by 6
Real-Time Human-Music Emotional Interaction Based on Deep Learning and Multimodal Sentiment Analysis
Jiang, T., Deng, S., Wu, P., & Jiang, H. (2023) · Wireless Communications and Mobile Computing · doi:10.1155/2023/4939048 · Cited by 4
A Lightweight Multi-modal Emotion Recognition Network Based on Multi-task Learning
Liu, P., & Wang, X. (2021) · International Conference on Neuromorphic Computing (ICNC) · doi:10.1109/icnc52316.2021.9608488 · Cited by 4
Ayoub, I. (2019) · uO Research (University of Ottawa) · doi:10.20381/ruor-23584 · Cited by 4
“[79], trained different LSTM-RNN models separately on different features types while utilizing temporal pooling and annotation delay.”
MethodResultJoint Sentiment Part Topic Regression Model for Multimodal Analysis
Li, M., Zhu, Y., Gao, W.-J., Cao, M., & Wang, S. (2020) · Information · doi:10.3390/info11100486 · Cited by 4
“The proposed topic model with a joint sentiment part (JSP) is based on latent Dirichlet allocation (LDA) [46].”
MethodRaju, J., Gaus, Y. F. A., & Breckon, T. P. (2021) · International Conference on Machine Learning and Applications · doi:10.1109/icmla52953.2021.00115 · Cited by 5
“Notable works such as Chen et al. [13], Huang et al. [30] and Zhao et al. [9] demonstrate that deep learning features achieve comparable or even better performance than handcrafted features, across video and audio modalities.”
BackgroundAn Emotion-Embedded Visual Attention Model for Dimensional Emotion Context Learning
Tang, Y., Mao, Q., Jia, H., Song, H., & Zhan, Y. (2019) · IEEE Access · doi:10.1109/access.2019.2911714 · Cited by 3
“The best performer of AVEC2017 [30] employ appearance features and deep visual features as complementary features.”
BackgroundInfluentialTS-MEFM: A New Multimodal Speech Emotion Recognition Network Based on Speech and Text Fusion
Wei, W., Zhang, B., & Wang, Y. (2025) · Lecture notes in computer science · doi:10.1007/978-981-96-2071-5_33 · Cited by 3
Pandit, V., Schmitt, M., Cummins, N., & Schuller, B. W. (2019) · Proceedings - IEEE Symposium on Computer-Based Medical Systems · doi:10.1109/cbms.2019.00096 · Cited by 4
Real-time Human-Music Emotional Interaction Based on Multimodal Analysis
Jiang, T., Deng, S., Wu, P., & Jiang, H. (2022) · International Conference on Culture-oriented Science & Technology (ICCST) · doi:10.1109/cost57098.2022.00020 · Cited by 1
Multimodal Affect Recognition Using Temporal Convolutional Neural Networks
Ayoub, I., Heiries, V., & Osman, H. A. (2022) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn55064.2022.9892145 · Cited by 1
“Haung et al. [39], trained several LSTM-RNN models separately on different features types while utilizing temporal pooling and annotation delay for the SEWA dataset.”
MethodPeng, Z., Hua, Z., Li, Y., Du, Y., & Dang, J. (2023) · Electronics · doi:10.3390/electronics12224620 · Cited by 1
“Recently, some studies have proposed parallel attention or multi-headed attention through multi-scale, multi-modal, multi-channel, and other methods to obtain salient features related to target tasks [16–18].”
BackgroundSelf-citationMultimodal transformers for emotion recognition
Vazquez-Rodriguez, J. (2023) · theses.fr (ABES) · doi:10.70675/a1927be2zdba6z405azbe6fz6856529b46bb · Cited by 3
Multimodal continuous emotion analysis
Zhang, S. (2023) · DR-NTU (Nanyang Technological University) · doi:10.32657/10356/166783 · Cited by 1
FREE-Net: A dual-modality emotion recognition network for fusing raw and enhanced data
Wei, W., Zhang, B., & Wang, Y. (2025) · Neurocomputing · doi:10.1016/j.neucom.2025.130361
Head- and eye-based features for continuous core affect prediction
O'Dwyer, J. (. (2020) · Research@THEA
Cholet, S. (2019) · theses.fr (ABES) · doi:10.70675/06a29d9fz43b9z4d1dzb252zbf9e59fe9a6b · Cited by 2
Macary, M. (2022) · theses.fr (ABES) · doi:10.70675/900e2862z85aez4bfbz91f3za4e7a5bebbe8 · Cited by 1
Donatus, R. E. (2026) · Computer Engineering and Applications Journal · doi:10.18495/comengapp.v15i2.1332
Metadata
- Authors
- Huang, J., Li, Y., Tao, J., Lian, Z., Wen, Z., Yang, M., & Yi, J.
- Affiliations
- Chinese Academy of Sciences (CN)
- Venue
- Proceedings of the 7th Annual Workshop on Audio/Visual Emotion Challenge
- Publisher
- ACM
- Published
- 2017-10-23
- Pages
- 11-18
- OpenAlex
- W2766925079
- Cited by
- 54
- References
- 34
- Citations by year
- 2025: 3 · 2023: 10 · 2022: 14 · 2021: 9 · 2020: 7 · 2019: 8 · 2018: 3
- FWCI
- 5.65
- Type
- conference paper
- Language
- en
- Open access
- closed
- Funders
- the National Key Research & Development Plan of China (No. 2016YFB1001404)
- the Major Program for the National Social Science Fund of China (13&ZD189)
- the National High-Tech Research and Development Program of China (863 Program) (No.2015AA016305)
- the National Natural Science Foundation of China (NSFC) (No.61425017)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Emotion and Mood Recognition
- Physical Sciences › Computer Science › Signal Processing › Speech and Audio Processing
- Physical Sciences › Computer Science › Artificial Intelligence › Sentiment Analysis and Opinion Mining
- Keywords
- audio-visual emotion recognition, acoustic features, appearance features, LSTM-RNN, support vector regression, decision fusion, valence and arousal, liking, temporal pooling
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.