Multimodal Sentiment Intensity Analysis in Videos: Facial Gestures and Verbal Messages

Cited by (852)

Items 501–600 of 852

1. TB-MEN: Text-Centric Bidirectional Modality Enhancement Network for Multimodal Sentiment Analysis
   Jieqiang Zhang, Ming Yin, Geng Wei, Daming Shi, Yi Guo · 2026 · IEEE Transactions on Audio Speech and Language Processing
2. A Semantically-Driven Multimodal Sentiment Analysis Framework With Temporal and Synergistic Attention
   Yonghong Xie · 2026 · International Journal on Semantic Web and Information Systems
3. HLCN: A Hypergraph Laplace Contrastive Network for enhanced multimodal sentiment analysis
   Cheng Qian, Ruotian Zhang, Ying Mao, Jiwu Cao, Fei Long, Jun Sang · 2026 · Pattern Recognition Letters
4. AMCCL: Adaptive Multi-scale Convolution Fusion Network with Contrastive Learning for Multimodal Sentiment Analysis
   Jiakang Yu, Mingxin Li, Hongtao Deng, Wang Gao Wang Gao, Xun Zhu · 2026 · Lecture notes in computer science
5. Uncertainty-aware mixture of experts for robust multimodal sentiment analysis
   Xinyu Xiao, Xuan Wang, Shuhan Qi, Huale Li · 2026 · Pattern Recognition
6. Sequential Late Fusion Technique for Multi-modal Sentiment Analysis
   Debapriya Banerjee, Fotios Lygerakis, Fillia S. Makedon · 2021 · International Conference on PErvasive Technologies Related to Assistive Environments (PETRA)
7. Supervised Contrastive Learning for Robust and Efficient Multi-modal Emotion and Sentiment Analysis
   Ahmed Gomaa, Andreas Maier, Ronak Kosti · 2022 · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition
8. Multimodal Sentiment Analysis under modality deficiency with prototype-Augmentation in software engineering
   Baolei Wang, Xuan Zhang, Kunpeng Du, Chen Gao, Linyu Li · 2023 · IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER)
9. Robust Contrastive Learning With Dynamic Mixed Margin
   Junhyuk So, Yongtaek Lim, Yewon Kim, Changdae Oh, Kyungwoo Song · 2023 · IEEE Access
10. Multi-Modality Tensor Fusion Based Human Fatigue Detection
    Jongwoo Ha, Joonhyuck Ryu, Joong-Hoon Ko · 2023 · Electronics
11. Social media and genetic evidence demonstrate the expansion of an invasive fish in India
    Chandani R. Verma, Manoj Pise, Tushar Ramachandra Khare, Pradeep Kumkar, Lukáš Kalous · 2024 · Journal of Vertebrate Biology
12. Semantic-specific multimodal relation learning for sentiment analysis
    Rui Wu, Yuanyi Luo, Jiafeng Liu, Xianglong Tang · 2024 · Neural Computing and Applications
13. Machine Learning Based Multimodal Opinion Mining
    Ruchi Sharma, Hemil Shah, Divyanshi Jain, Birva Shah · 2024 · Lecture notes in networks and systems
14. Adversarial Training and Cross-modal Feature Fusion in Multimodal Sentiment Analysis
    Junhuai Li, Chuang Lin, Huaijun Wang, Yuxing Zhi, Jing Chen, Tao Huang · 2025 · IEEE International Conference on Acoustics Speech and Signal Processing
15. BiMSA: Multimodal Sentiment Analysis Based on BiGRU and Bidirectional Interactive Attention
    Qi Wang, Hai-Zheng Yu, Yao Wang, Hong-Li Bian · 2025 · The European Journal on Artificial Intelligence
16. ProNet: A contrastive propagation network for multimodal lifelong clustering
    Yiqiao Mao, Zirui Hu, Qiang Guo, Xiaoqiang Yan, Yangdong Ye · 2025 · Knowledge-Based Systems
17. Triaxial modality attention fusion with top-down mask generation for enhanced multimodal sentiment analysis
    Cheng Feng, Hai Yang, Shuxian Wang, Xue Li · 2025 · The Journal of Supercomputing
18. Contextual multimodal sentiment analysis with information enhancement
    Dandan Jiang, Dongsheng Zou, Zhipeng Deng, Jingpei Dan · 2020 · Journal of Physics Conference Series
19. Big Data and Multimodal Communication: A Perspective View
    Costanza Navarretta, Lucretia Oemig · 2019 · Intelligent systems reference library
20. Fine-grained Multimodal Sentiment Analysis Based on Gating and Attention Mechanism
    Yingxue Sun, Junbo Gao · 2021 · Electronics Science Technology and Application
21. Model-Agnostic Temporal Regularizer for Object Localization Using Motion Fields
    Carlos Santiago, Daniela O. Medley, Jorge Salvador Marques, Jacinto C. Nascimento · 2022 · IEEE Transactions on Image Processing
22. MSDD: A Multimodal Language Dateset for Stance Detection
    Mengyang Hu, Pengyuan Liu, Weikang Wang, Hu Zhang, Chengxiao Lin · 2023 · Lecture notes in computer science
23. Augmenting pre-trained language models with audio feature embedding for argumentation mining in political debates
    Rafael Mestre, Stuart E. Middleton, Matt E. Ryan, Masood Gheasi, Timothy J. Norman, Jiatong Zhu · 2023 · Findings of the Association for Computational Linguistics: EACL
24. PMFNet: A Progressive Multichannel Fusion Network for Multimodal Sentiment Analysis
    Jiaming Li, Chuanqi Tao, Donghai Guan · 2023 · Communications in computer and information science
25. Self-Distillation and Pinyin Character Prediction for Chinese Spelling Correction Based on Multimodality
    Li He, Feng Liu, Jie Liu, Jianyong Duan, Hao Wang · 2024 · Applied Sciences
26. Multimodal Language Analysis with Recurrent Multistage Fusion
    Paul Pu Liang, Liu Ziyin, Amir Zadeh, Louis‐Philippe Morency · 2018 · arXiv (Cornell University)
27. Pseudo-Encoded Stochastic Variational Inference
    Amir Zadeh, Smon Hessner, Yao Chong Lim, Morency, Louis-Phlippe · 2019 · arXiv (Cornell University)
28. A Residual Multi-Scale Convolutional Transformer Network with Chunk-level Log-Mel Spectrograms for Speech Emotion Recognition
    Tianhao Yan, Hao Meng, Emilia Parada‐Cabaleiro, Jianhua Tao, Björn Wolfgang Schuller · 2022
29. A Sneak Preview of Sentiment Analysis
    Roopal Mamtora, Lata L. Ragha · 2018 · International Conference on Smart City and Emerging Technology (ICSCET)
30. A Method with Universal Transformer for Multimodal Sentiment Analysis
    Hao Ai, Ying Liu, Jie Fang, Sheikh Faisal Rashid · 2022
31. Learning Co-Speech Gesture for Multimodal Aphasia Type Detection
    Daeun Lee, Sejung Son, Hyolim Jeon, Seungbae Kim, Jinyoung Han · 2023 · Conference on Empirical Methods in Natural Language Processing (EMNLP)
32. Measuring Similarity of Dual-Modal Academic Data Based on Multi-Fusion Representation Learning
    Li Zhang, Qiang Gao, Ming Liu, Zepeng Gu, Bo Lang · 2024 · IEEE Access
33. Sentiment Confidence Separation: A Trust-Optimized Framework for Multimodal Sentiment Classification
    Zemin Tang, Min Shi, Zhibang Yang, Xu Zhou, Cen Chen, Joey Tianyi Zhou · 2024 · IEEE International Conference on Multimedia and Expo (ICME)
34. Greedy Fusion Oriented Representations for Multimodal Sentiment Analysis
    Ran Xu · 2024 · Lecture notes in computer science
35. Transferring Personality Knowledge to Multimodal Sentiment Analysis
    Kang Zhu, Xuefei Liu, Heng Xie, Cong Cai, Ruibo Fu, Guanjun Li, Zhengqi Wen, Jianhua Tao, Cunhang Fan, Zhao Lv et al. · 2024 · International Symposium on Chinese Spoken Language Processing (ISCSLP)
36. Cross-Modality Disentangled Information Bottleneck Strategy for Multimodal Sentiment Analysis
    Zhengnan Deng, Guoheng Huang, Guo Zhong, Xiaochen Yuan, Lian Huang, Chi‐Man Pun · 2024 · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics
37. Sentiment Analysis of Multimodal Content: A Fusion of Visual and Textual Clues
    Irtika Khan, Siddhi Kadu · 2024 · International Conference on Innovation and Novelty in Engineering and Technology (INNOVA)
38. APOLLO: Differential Private Online Multi-Sensor Data Prediction with Certified Performance
    Honghui Xu, Wei Li, Shaoen Wu, Liang Zhao, Zhipeng Cai · 2024 · Proceedings
39. TDMER: A Task-Driven Method for Multimodal Emotion Recognition
    Qian Xu, Yu Gu, Chenyu Li, He Zhang, Hai Xiang Lin, Linsong Liu · 2025 · IEEE International Conference on Acoustics Speech and Signal Processing
40. Fine-grained Semantic Disentanglement Network for Multimodal Sarcasm Analysis
    Jiajia Tang, Binbin Ni, Feiwei Zhou, Dongjun Liu, Yu Ding, Yong Kang Peng, Andrzej S Cichocki, Qibin Zhao, Wanzeng Kong · 2025 · ACM Transactions on Multimedia Computing Communications and Applications
41. HPFA: A hybrid perception and feature attention framework for multimodal sentiment analysis with missing modalities
    Yu Chai Sun, Bin Gao, Linlin Li, Yutong Li, Shutian Liu, Zhengjun Liu · 2026 · Applied Soft Computing
42. Knowledge Distillation and Contrastive Learning for Robust Multimodal Sentiment Analysis with Missing Data
    Yue Wang, Weiliang Zhang, Ning Sun · 2024 · IEEE International Conference on Communication Technology (ICCT)
43. A Wander Through the Multimodal Landscape: Efficient Transfer Learning via Low-rank Sequence Multimodal Adapter
    Zirun Guo, Xize Cheng, Yangyang Wu, Tao Jin · 2025 · Proceedings of the AAAI Conference on Artificial Intelligence
44. AGCL: Attention Aggregation Contrastive Learning for Multimodal Emotion Analysis
    Shiqi Wang · 2025 · International Symposium on Computer Applications and Information Systems (ISCAIS)
45. Multi-Dilated Transformer for Multimodal Sentiment Analysis
    Senyuan Xie, Ziqi Hu, Xiaohong Xie, Yu Mao, Xinyu Zhen, Xiaoli Zeng · 2025 · International Seminar on Artificial Intelligence, Networking and Information Technology (AINIT)
46. Adaptive Agent Semantic Aggregation Network for Multimodal Sentiment Analysis
    Yue Su, X. Y. Zhao · 2025 · International Conference on Multimedia Retrieval
47. Exploring Feature Interactions for Multimodal Sentiment Analysis
    Dan Xu, Chi Zhang · 2025 · International Journal of Cognitive Informatics and Natural Intelligence
48. Multimodal sentiment analysis based on slice aggregation and dynamic fusion
    Zhouwen Zhan, Dongtao Cao, Zheyi Chen, Hongju Cheng, Zhiyong Yu · 2025 · CCF Transactions on Pervasive Computing and Interaction
49. A Character-Image-Modality and Multi-Label Auxiliary Model for Chinese Sentiment Analysis
    Liya Wang, Zhe Chen, Ming Zhang, Vasile Palade · 2025 · IEEE Access
50. The feature deep fusion model for multimodal emotion analysis based on transformer
    Yidi Zhou · 2025 · Journal of Computational Methods in Sciences and Engineering
51. Creating Multimodal Interactive Digital Twin Characters From Videos: A Dataset and Baseline
    Meidai Xuanyuan, Yuwang Wang, Honglei Guo, Hanshi Qu, Kun Zhang, Zhongming Li, Danping Yan, Tao Yu, Jianhua Tao, Qionghai Dai · 2025 · IEEE Transactions on Pattern Analysis and Machine Intelligence
52. Self-Supervised Guided Modality Disentangled Representation Learning for Multimodal Sentiment Analysis and Schizophrenia Assessment
    Hsin-Yang Chang, An-Sheng Liu, Yi‐Ting Lin, Chen‐Chung Liu, Lue-En Lee, Fengyi Chen, Shu‐Hui Hung, Li‐Chen Fu · 2025 · IEEE Journal of Biomedical and Health Informatics
53. MSAF-CF: A Multimodal Sentiment Analysis Framework Based on Feature Enhancement and Cross-Fusion
    Zhongliang Wei, Ruofan Chen, Jing Sun · 2025 · IEEE Access
54. Asymmetric simulation-enhanced flow reconstruction for incomplete multimodal learning
    Jiacheng Yao, Jing Zhang, Yixiao Wang, Zhuo Li · 2025 · Pattern Recognition
55. Multimodal Sentiment Analysis and Depression Detection of Social Media Users Based on MLP
    Ziteng Wu · 2025 · IEEE International Conference on Image Processing and Computer Applications (ICIPCA)
56. CR-GAC: Cross-modal Recombination via Graph-Attention Collaborative Optimization for multimodal sentiment analysis
    Haoran Chen, Jiapeng Liu, Zuhe Li, Yushan Pan, Hongwei Tao, Huaiguang Wu, Yunyang Wang, Chenguang Yang · 2025 · Expert Systems with Applications
57. MPFBL: Modal pairing-based cross-fusion bootstrap learning for multimodal emotion recognition
    Yong Zhang, Yongqing Liu, HongKai Li, Cheng Cheng, Ziyu Jia · 2025 · Neurocomputing
58. EmoDuo: A Dual-Tower Framework for Efficient and Robust Multimodal Sentiment Analysis
    Jiaqi Su · 2025 · International Conference on Artificial Intelligence, Big Data and Algorithms (CAIBDA)
59. PgM: Partitioner Guided Modal Learning Framework
    Guimin Hu, Yuchen Xin, Lijie Hu, Zhihong Zhu, Hasti Seifi · 2025 · ACM International Conference on Multimedia (ACM MM)
60. MDMU:Multimodal Dynamic Mamba UNet for Multimodal sentiment analysis
    Weibin Li, Jiazheng Huang, Bohuan Xue, Wenhao Shao, Yijun Liu, Xiaoyu Tang · 2025 · IEEE International Conference on Multimedia and Expo (ICME)
61. Multimodal Sentiment Analysis via Progressive Fusion of Audio-Visual Affective Descriptions
    Lisong Ou, Zhixin Li · 2025 · ACM International Conference on Information and Knowledge Management (CIKM)
62. MKDF: Knowledge Distillation Based Lightweight Multimodal Framework for Emotion Recognition
    Yiwen Wang, Yujian Sun, Bingtian Qiao, Cheng Wang, Zeyu Li, Shanliang Yang · 2025 · Communications in computer and information science
63. MSLMamba: Mamba-driven cross-modal fusion network with modality-specific learning for multimodal sentiment analysis
    Fei Ma, Shuzhi Li, Feixia Yang, Guangxian Xu · 2025 · Neurocomputing
64. Multimodal Sentiment Analysis with Missing Modality: A Knowledge-Transfer Approach
    Weide Liu, Huijing Zhan · 2025 · Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC)
65. Progressive Learning Framework With Missing Modality Reconstruction for Multimodal Emotion Recognition
    Haoqin Sun, Xugang Lu, Jingguang Tian, Jiaming Zhou, Jiabei He, Hui Wang, Xiangyu Kong, Xinhui Hu, Yong Qin · 2025 · IEEE Transactions on Audio Speech and Language Processing
66. MCIHN: A Hybrid Network Model Based on Multi-path Cross-modal Interaction for Multimodal Emotion Recognition
    Haoyang Zhang, Yang Zhou, Ke Sun, Yucai Pang, Guoliang Xu · 2025 · ACM International Conference on Multimedia in Asia (MMAsia)
67. Multimodal Sentiment Analysis with Contrastive Constraint Propagation
    Guoping Wang, Ming Zhang · 2025 · ACM International Conference on Multimedia in Asia (MMAsia)
68. A dual-modality deep learning approach for fine-grained sentiment analysis using speech and text
    Divya Agrawal, Maroti Deshmukh, Surendra Singh · 2025 · Knowledge-Based Systems
69. Hierarchical Multi-Criteria Representation Fusion for Robust Incomplete Multimodal Sentiment Analysis
    Yijing Dai, Yingjian Li, Jinxing Li, Guangming Lu · 2025 · IEEE Transactions on Affective Computing
70. Mitigating modality imbalance in multimodal sentiment analysis via emotion-enriched visual encoding and pyramid gated fusion
    Fushun E, Yuanyi Luo, Jiafeng Liu, Rui Wu · 2025 · Neurocomputing
71. Multimodal Emotion Recognition with Temporal Slicing Encoder and Attention-Enhanced Synergy Integration
    Haoyu Wang, Bengong Yu, Zhonghao Xi, Shuping Zhao, Ying Yang · 2026 · IEEE Transactions on Multimedia
72. Text-Dominant Disentangled Fusion Network for Multimodal Sentiment Analysis
    Tengfei Xiao, Zhiyong Wang, Gaoxiang Ouyang, Jin Li · 2025 · IFAC-PapersOnLine
73. A Review of Multimodal Sentiment Analysis in Online Public Opinion Monitoring
    Shuxian Liu, Tianyi Li · 2026 · Informatics
74. Black-Box Test-Time Ensemble
    Siyang Li, Ziwei Wang, Chenhao Liu, Dongrui Wu · 2026 · IEEE Computational Intelligence Magazine
75. G-TBML: GAN-enhanced Transformer-based Multimodal Binding Learning Model
    Wenting Qu, Bin Wei · 2025 · International Conference on Machine Learning and Computer Application (ICMLCA)
76. Transformer based Multimodal Mental Health Assessment Framework Using Cross-Attention Mechanisms on Audio-Visual Data
    Arun Kumar Singh, Arun Kumar Shukla · 2025 · IEEE International Conference on Intelligent Signal Processing and Effective Communication Technologies (INSPECT)
77. Fusion decomposition and backbone gathering based multimodal sentiment analysis under uncertain missing modalities
    Hongxiang Sun, Zhizhong Liu, Dianhui Chu, Quan Z. Sheng, Zhaowei Liu, Yingjie Wang, Adnan Mahmood · 2026 · Information Processing & Management
78. Multimodal sentiment analysis based on dual perspective modeling
    Tuerhong Gulanbaier, Wang Hao, Mairidan Wushouer · 2026 · Multimedia Systems
79. Refined separated representation learning and conflict alleviation for multimodal sentiment analysis
    Yaoyao Zheng, Anjiang Lu, Senyang Peng, Yang Chen, Xishun Peng · 2026 · Journal of King Saud University - Computer and Information Sciences
80. DMIC2: A dynamic modality importance and cascaded cross-attention framework for multimodal sentiment analysis
    Jinming Ping, Ruicong Zhi, Shufan Guo, Yuewu Hou, Xiaoyuan Liang, Fei Wan · 2026 · Knowledge-Based Systems
81. Insight Into Neighborhood Information: A Novel Multimodal Sentiment Analysis Approach With Joint Alignment, Fusion, and Denoising
    Dongtao Cao, Jiale Zhang, Zheyi Chen, Hongju Cheng · 2026 · IEEE Transactions on Computational Social Systems
82. Hierarchical Graph Fusion with Mutual Information Enhancement for Robust Multimodal Sentiment Analysis
    Nanjie Zheng, Yiyang Tang, Jiuzhou Chen, Haoming Liu, Qian Chen · 2026 · Journal of King Saud University - Computer and Information Sciences
83. AttMamba: Mamba with attention mechanism for multimodal depression detection
    Xiangyun Zheng, Yingjian Liu, Z.Y. Zha, Minghuan Lv, Hao Wang · 2026 · Neurocomputing
84. DKTCF: Dual-view knowledge enhanced text-guided contrastive fusion for multimodal sentiment analysis
    Yimeng Zhan, Zhixin Qu, Jing Li, Donghong Han · 2026 · Neurocomputing
85. A contrastive graph-transformer network model for multimodal sentiment analysis
    Hoang Nam Do, Huyen Trang Phan, Ngoc Thanh Nguyên · 2026 · Applied Intelligence
86. Hybrid Progressive Fusion Network for Multimodal Sentiment Analysis
    Xiang Li, Jidong Leng, Xianfu Cheng, Tianbo Wang, Xiaoming Zhang · 2026 · IEEE International Conference on Acoustics Speech and Signal Processing
87. CMDPAD: A Chinese multimodal dynamic personality and affect dataset for affect prediction in conversations
    Zisen Zhou, Heng Xie, Chang Wen, Xuefei Liu, Jianhua Tao, Zhengqi Wen, Changsheng Li, Zheng Lian, Jinming Zhao, Bingsen Xiong et al. · 2026 · Pattern Recognition
88. Dynamic cross-instance context mining for multimodal sentiment analysis
    Haiying Xia, Youyong Cheng, Yumei Tan, Shuxiang Song · 2026 · Information Processing & Management
89. Decoding emotions: a survey of multimodal sentiment analysis in the digital age in artificial intelligence
    Akanksha Puri, Amrit Lal Sangal, Harsh K. Verma, Shilpa Mahajan · 2026 · Knowledge and Information Systems
90. Dynamic Interaction-Aware and Causality-Disentangled Framework for Multimodal Sentiment Analysis
    Hu Jian, D F Chen, Bo Lei, Sun Jinhua · 2026 · International Seminar on Artificial Intelligence, Networking and Information Technology (AINIT)
91. HDR: Hypergraph dynamic representation network for multimodal sentiment analysis
    Kejiang Xiao, Cheng Zhang, Shiyan Pang · 2026 · Expert Systems with Applications
92. Modality-Incomplete Human Status Recognition on Mobile Devices With Multi-Scale Relation and Semantic-Matching Distillation
    Xu Xu, Chong Fu, Chi Lin, J C Chen · 2026 · IEEE Transactions on Mobile Computing
93. Improving Cross-Modal Semantic Alignment with Cross-Modal Joint Semantic Transformer for Multimodal Sentiment Analysis
    Wenxuan Zhang, Jihong Ding, Huazhong Liu, Tingting Han, Yuanhan Liu, Laurence T. Yang · 2026 · Big Data Mining and Analytics
94. Multimodal Fusion Representation Learning Based on Differential Privacy
    Chaoxin Cai, Yingpeng Sang, Jinghao Huang, Maliang Zhang, Weizheng Li · 2022 · Lecture notes in computer science
95. Quantifying emotions through quantum computations
    Jaiteg Singh, Kamalpreet Singh Bhangu · 2023 · International Journal of Quantum Information
96. Multimodal Emotion Analysis Model based on Interactive Attention Mechanism
    Bainan Zhou, Xu Li · 2023 · Frontiers in Computing and Intelligent Systems
97. PSRMER: Proactive Services Recommendation Driven-by Multimodal Emotion Recognition
    Zhizhong Liu, Guangyu Huang, Dianhui Chu, Yuhang Sun · 2023 · IEEE International Conference on Web Services (ICWS)
98. Multimodal Sentimental Analysis Using Hierarchical Fusion Technique
    A D Tharani, J Aravinth · 2023 · IEEE India Council International Subsections Conference (INDISCON)
99. CH-MEAD: A Chinese Multimodal Conversational Emotion Analysis Dataset with Fine-Grained Emotion Taxonomy
    Yu-Ping Ruan, Shukai Zheng, Jiantao Huang, Xiaoning Zhang, Yulong Liu, Taihao Li · 2023 · Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC)
100. Multimodal Sentiment Analysis based on Supervised Contrastive Learning and Cross-modal Translation under Modalities Missing*
     Yuqing Miao, Gaowei Zhu, Tonglai Liu, Wanzhen Zhang, Yimin Wen, Ming Quan Zhou · 2023 · International Symposium on Parallel Architectures, Algorithms and Programming