Multimodal sentiment analysis with word-level fusion and reinforcement learning

Cited by (330)

Items 201–300 of 330

1. TEASEL: A Transformer-Based Speech-Prefixed Language Model
   Arjmand, Mehdi, Mohammad Javad Dousti, Hadi Moradi · 2021 · arXiv (Cornell University)
2. User identification across online social networks based on gated multi-feature extraction
   Yan Mao, Cuicui Ye · 2024 · Alexandria Engineering Journal
3. TriSAT: Trimodal Representation Learning for Multimodal Sentiment Analysis
   Ruohong Huan, Guowei Zhong, Peng Chen, Ronghua Liang · 2024 · IEEE/ACM Transactions on Audio Speech and Language Processing
4. CAETFN: Context Adaptively Enhanced Text-Guided Fusion Network for Multimodal Sentiment Analysis
   Jiabao Li, Ruyi Liu, Qiguang Miao, Di Wang, Xiangzeng Liu · 2025 · IEEE Transactions on Affective Computing
5. Enhancing Multimodal Learning via Hierarchical Fusion Architecture Search With Inconsistency Mitigation
   Kaifang Long, Guoyang Xie, Lianbo Ma, Qing Li, Min Huang, Jianhui Lv, Zhichao Lu · 2025 · IEEE Transactions on Image Processing
6. Context-Dependent Multimodal Sentiment Analysis Based on a Complex Attention Mechanism
   Lujuan Deng, Boyi Liu, Zuhe Li, Jiangtao Ma, Hanbing Li · 2023 · Electronics
7. A Recommendation Model Based on Multi-Emotion Similarity in the Social Networks
   Jun Long, Yulou Wang, Xinpan Yuan, Ting Li, Qunfeng Liu · 2019 · Information
8. Sentiment Classification on Erroneous ASR Transcripts: A Multi View Learning Approach
   Sri Harsha Dumpala, Imran Sheikh, Rupayan Chakraborty, Sunil Kumar Kopparapu · 2018 · IEEE Spoken Language Technology Workshop (SLT)
9. Af-CAN: Multimodal Emotion Recognition Method Based on Situational Attention Mechanism
   Xue Zhang, Mingjiang Wang, Xiao Zeng, Xuyi Zhuang · 2024 · IEEE Access
10. CTHFNet: contrastive translation and hierarchical fusion network for text–video–audio sentiment analysis
    Qiaohong Chen, Shufan Xie, Xianwen Fang, Qi Sun · 2024 · The Visual Computer
11. MulDeF: A Model-Agnostic Debiasing Framework for Robust Multimodal Sentiment Analysis
    Ruohong Huan, Guowei Zhong, Peng Chen, Ronghua Liang · 2024 · IEEE Transactions on Multimedia
12. Privacy-Preserving Multimodal Sentiment Analysis
    Honghui Xu, Wei Li, Daniel Takabi, Daehee Seo, Zhipeng Cai · 2025 · IEEE Internet of Things Journal
13. DNMCN: Dual-Stage Normalization Based Modality-Collaborative Fusion Network for Multimodal Sentiment Analysis
    Miao Chen, Jin Liu, Xingye Li, Yaohui Zhang, Hongze Liu, Jiajia Jiao, Huihua He · 2025 · IEEE Transactions on Affective Computing
14. CCDA: A Novel Method to Explore the Cross-Correlation in Dual-Attention for Multimodal Sentiment Analysis
    Peicheng Wang, Shuxian Liu, Jinyan Chen · 2024 · Applied Sciences
15. DC-BVM: Dual-channel information fusion network based on voting mechanism
    Borui Miao, Yunfeng Xu, Jialin Wang, Yan Zhang · 2024 · Biomedical Signal Processing and Control
16. Detecting Multimodal Fake News with Gated Variational AutoEncoder
    Yimeng Gu, Ignacio Castro, Gareth Tyson A · 2024 · ACM Web Science Conference (WebSci)
17. Multimodal Sentiment Analysis of Government Information Comments Based on Contrastive Learning and Cross-Attention Fusion Networks
    Guangyu Mu, Chuanzhi Chen, Xiurong Li, Jiaxue Li, Xiaoqing Ju, Jiaxiu Dai · 2024 · IEEE Access
18. Emotion recognition at the edge with AI specific low power architectures
    Emanuel Di Nardo, Vincenzo Santopietro, Alfredo Petrosino · 2021 · Microprocessors and Microsystems
19. MECG: modality-enhanced convolutional graph for unbalanced multimodal representations
    Jiajia Tang, Binbin Ni, Yutao Yang, Yu Ding, Wanzeng Kong · 2024 · The Journal of Supercomputing
20. CSMF-SPC: Multimodal Sentiment Analysis Model with Effective Context Semantic Modality Fusion and Sentiment Polarity Correction
    Yuqiang Li, Wenxuan Weng, Chun Liu, Li Lin · 2024 · Pattern Analysis and Applications
21. Looking Beyond a Clever Narrative: Visual Context and Attention are Primary Drivers of Affect in Video Advertisements
    Abhinav Shukla, Harish Katti, Mohan Kankanhalli, Ramanathan Subramanian · 2018 · NOT FOUND REPOSITORY (Indian Institute of Science Bangalore)
22. Multimodal emotion recognition with hierarchical memory networks
    Helang Lai, Keke Wu, Lingli Li · 2021 · Intelligent Data Analysis
23. Toward RNN Based Micro Non-verbal Behavior Generation for Virtual Listener Agents
    Hung‐Hsuan Huang, Masato Fukuda, Toyoaki Nishida · 2019 · Lecture notes in computer science
24. Multimodal Tweet Sentiment Classification Algorithm Based on Attention Mechanism
    Peiyu Zou, Shuangtao Yang · 2019 · Communications in computer and information science
25. Visual and Textual Sentiment Analysis of Daily News Social Media Images by Deep Learning
    Andrea Felicetti, Massimo Martini, Marina Paolanti, Roberto Pierdicca, Emanuele Frontoni, Primo Zingaretti · 2019 · Lecture notes in computer science
26. Text-centric disentangled representation interaction network for Multimodal Sentiment Analysis
    Jingming Hou, Nazlia Omar, Sabrina Binti Tiun, Saidah Saad, Qian He · 2025 · Neurocomputing
27. Rethinking the Effect of Unimodal Labels in Multimodal Sentiment Analysis
    Lianwei Zhang, Tianrui Li, Baiyu Lu, J.-F. Fang, Desheng Zheng, Wei Zhou, Weide Liu, Fengmao Lv · 2026 · ACM Transactions on Multimedia Computing Communications and Applications
28. Feature Stacking Fusion in Multimodal Neural Architecture Search
    Kaifang Long, Lianbo Ma, Yang Gao, Guo Yu · 2024 · International Conference on Data-driven Optimization of Complex Systems (DOCS)
29. TOMFuN: A tensorized optical multimodal fusion network
    Xian Xiao, Yequan Zhao, Yuan Yuan, Géza Kurczveil, Marco Fiorentino B, Raymond G. Beausoleil, Zheng Zhang · 2025 · APL Machine Learning
30. WeaveNet: End-to-End Audiovisual Sentiment Analysis
    Yinfeng Yu, Zhenhong Jia, Fei Shi, Meiling Zhu, Wenjun Wang, Xiuhong Li · 2022 · Communications in computer and information science
31. A Review of Multimodal Sentiment Analysis: Modal Fusion and Representation
    Hanxue Fu, Huimin Lu · 2024 · International Wireless Communications and Mobile Computing Conference (IWCMC)
32. An early fusion approach for multimodal emotion recognition using deep recurrent networks
    Beniamin Bucur, Iulia Somfelean, Alexandru Ghiurutan, Camelia Lemnaru, Mihaela Dînșoreanu · 2018 · IEEE International Conference on Intelligent Computer Communication and Processing (ICCP)
33. Gated Value Network for Multilabel Classification
    Yimin Hou, Sen Wan, Feng Bao, Zhiquan Ren, Yunfeng Dong, Qionghai Dai, Yue Cheng Deng · 2020 · IEEE Transactions on Neural Networks and Learning Systems
34. Hierarchical Fusion Network with Enhanced Knowledge and Contrastive Learning for Multimodal Aspect-Based Sentiment Analysis on Social Media
    Xiaoran Hu, M. Yamamura · 2023 · Sensors
35. MultiViz: Towards User-Centric Visualizations and Interpretations of Multimodal Models
    Liang, Paul Pu, Lyu, Yiwei, Chhablani, Gunjan, Jain, Nihal, Deng, Zihao, Wang, Xingbo, Morency, Louis-Philippe, Salakhutdinov, Ruslan · 2023 · Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems
36. A Robust Framework for Multimodal Sentiment Analysis with Noisy Labels Generated from Distributed Data Annotation
    Kai Jiang, Bin Cao, Jing Fan · 2024 · Computer Modeling in Engineering & Sciences
37. A high speed inference architecture for multimodal emotion recognition based on sparse cross modal encoder
    Lin Cui, Yuanbang Zhang, Yingkai Cui, Boyan Wang, Xiaodong Sun · 2024 · Journal of King Saud University - Computer and Information Sciences
38. Multi-modal Intent Detection with LVAMoE: the Language-Visual-Audio Mixture of Experts
    Tingyu Li, Junpeng Bao, Jiaqi Qin, Yuping Liang, Ruijiang Zhang, Jason Wang · 2024 · IEEE International Conference on Multimedia and Expo (ICME)
39. TextAI 3.0 (Multimodal): multimodal sentiment analysis using attention-enabled ensemble-based deep learning in hyperbolic space
    Jaskaran Singh, Prabhav Sanga, Narendra Nath Khanna, John R. Laird, Inder M. Singh, Mannudeep K. Kalra, Laura E. Mantella, Amer M. Johri, Gavino Faa, Ekta Tiwari et al. · 2025 · International Journal of Information Technology
40. An Investigation on the Effectiveness of Multimodal Fusion and Temporal Feature Extraction in Reactive and Spontaneous Behavior Generative RNN Models for Listener Agents
    Hung‐Hsuan Huang, Masato Fukuda, Toyoaki Nishida · 2019 · International Conference on Human-Agent Interaction (HAI)
41. Unimodal and Multimodal Integrated Representation Learning via Improved Information Bottleneck for Multimodal Sentiment Analysis
    Tonghui Zhang, Changfei Dong, Jinsong Su, Haiying Zhang, Yuzheng Li · 2022 · Lecture notes in computer science
42. Mutual information maximization and feature space separation and bi-bimodal mo-dality fusion for multimodal sentiment analysis
    Kun Li, Shengwei Tian, Long Yu, Tiejun Zhou, Bo Wang, Fun Wang · 2023 · Journal of Intelligent & Fuzzy Systems
43. Multilevel Representation Disentanglement Framework for Multimodal Sentiment Analysis
    Nan Jia, Zicong Bai, Tiancheng Xiong, Mingyang Guo · 2025 · IEEE Signal Processing Letters
44. Global information regulation network for multimodal sentiment analysis
    Shufan Xie, Qiaohong Chen, Xianwen Fang, Qi Sun · 2024 · Image and Vision Computing
45. Automatic Sentiment Labelling of Multimodal Data
    Sumana Biswas, Karen Young, Josephine Griffith · 2023 · Communications in computer and information science
46. Differently processed modality and appropriate model selection lead to richer representation of the multimodal input
    Saroj Kumar Panda, Tausif Diwan, Omprakash G. Kakde · 2024 · International Journal of Information Technology
47. CentralNet: a Multilayer Approach for Multimodal Fusion
    Valentin Vielzeuf, Alexis Lechervy, Stéphane Pateux, Frédéric Jurie · 2018 · HAL
48. Development of a Platform for RNN Driven Multimodal Interaction with Embodied Conversational Agents
    Hung‐Hsuan Huang, Masato Fukuda, Toyoaki Nishida · 2019 · ACM International Conference on Intelligent Virtual Agents (IVA)
49. Analyzing the Robustness of Vision & Language Models
    Alexander Shirnin, Nikita Andreev, Sofia Potapova, Ekaterina Artemova · 2024 · IEEE/ACM Transactions on Audio Speech and Language Processing
50. TACL: A Trusted Action-enhanced Curriculum Learning Approach to Multimodal Affective Computing
    Tan Yu, Jingjing Wang, Jiamin Luo, Jiawen Wang, Guodong Zhou · 2024 · Neurocomputing
51. Dual-stream collaborative network (DSCN): Multimodal sentiment analysis via modality-invariant and modality-specific representation learning
    Shengbing Chen, Dongmei Zhou, Chao Wei, Xingyang Li, Hong-Yu Yao, Hao Luo · 2025 · Neurocomputing
52. Deploying Emotion-Aware Speech GANs on Edge Devices: A Real-Time Optimization Framework
    Natarajan Meenakshisundaram, G. Sajiv · 2025 · International Conference on Electronics and Sustainable Communication Systems (ICESC)
53. DAST-GAN: An Adversarial Learning Multimodal Sentiment Analysis Model Based on Dynamic Attention and Spatio-Temporal Fusion
    Wenlong Tan, Wenjuan Zhang · 2025 · Sensors
54. A unified framework for detecting point and collective anomalies in operating system logs via collaborative transformers
    Mohammad Nasirzadeh, Jafar Tahmoresnezhad, Parviz Rashidi Khazaee · 2025 · Scientific Reports
55. NFCMF: Noise Filtering and CrossModal Fusion for Multimodal Sentiment Analysis
    Guixin Su, Junyi He, Xia Li, Meixiu Lu, Hanqun Yang · 2021 · International Conference on Asian Language Processing
56. Large Pretrained Models on Multimodal Sentiment Analysis
    Yunfeng Song, Xiaochao Fan, Yong Yang, Ge Ren, Weiming Pan · 2022 · Lecture notes in electrical engineering
57. Supervised Contrastive Learning for Robust and Efficient Multi-modal Emotion and Sentiment Analysis
    Ahmed Gomaa, Andreas Maier, Ronak Kosti · 2022 · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition
58. Optimal Target-Oriented Knowledge Transportation For Aspect-Based Multimodal Sentiment Analysis.
    Linhao Zhang, Jin Li, Guangluan Xu, Xiaoyu Li, Xian Sun, Zequn Zhang, Yanan Zhang, Qi Li · 2024 · International Journal of Interactive Multimedia and Artificial Intelligence
59. Bimodal sentiment analysis in social media: a one-shot learning approach
    Zahra Pakdaman, Abbas Koochari, Arash Sharifi · 2024 · Multimedia Tools and Applications
60. A Deep Multimodal Representation Learning Framework for Accurate Molecular Properties Prediction
    Yuxin Yang, Zixu Wang, Pegah Ahadian, Abby Jerger, Jeremy Zucker, Song Feng, Feixiong Cheng, Qiang Guan · 2024 · ACM Great Lakes Symposium on VLSI (GLSVLSI)
61. Multimodal Enhanced Sentiment Analysis with Hierarchical Feature Extraction
    Sha Liu, Shuyue Wang, Bin Chen · 2024 · International Conference on Communications, Information System and Computer Engineering (CISCE)
62. Exploring key technologies for multimodal emotion recognition: Research and application analysis
    Junjie Gao · 2024 · AIP conference proceedings
63. CU-SEMLP: All-MLP-based multimodal interaction model for multimodal sentiment analysis
    Siyuan Liu, Hongkun Zhao, Yang Chen, Fanmin Kong, Kang Li · 2025 · The Journal of Supercomputing
64. Analyzing Public Discourse and Sentiment in Climate Change Discussions Using Transformer-Based Models
    Nikolaos Roufas, Alaa Mohasseb, Ioannis Karamitsos, Andreas Kanavos · 2025 · IFIP advances in information and communication technology
65. Contextual multimodal sentiment analysis with information enhancement
    Dandan Jiang, Dongsheng Zou, Zhipeng Deng, Jingpei Dan · 2020 · Journal of Physics Conference Series
66. Learning Sensor Interdependencies for IMU-to-Segment Assignment
    Tomoya Kaichi, Tsubasa Maruyama, Mitsunori Tada, Hideo Saitô · 2021 · IEEE Access
67. A Cross-Modal Attention and Multi-task Learning Based Approach for Multi-modal Sentiment Analysis
    Yunfeng Song, Xiaochao Fan, Yong Yang, Ge Ren, Weiming Pan · 2022 · Lecture notes in electrical engineering
68. Attention-free based dual-encoder mechanism for Aspect-based Multimodal Sentiment Recognition
    Pankaj Gupta, Ananya Pandey, Ajeet Kumar, Dinesh Kumar Vishwakarma · 2023 · International Conference in Advances in Power, Signal, and Information Technology (APSIT)
69. Apparent Personality Analysis Based on Aggregation Model
    Milić Vukojičić, Mladen Đ. Veinović · 2021 · International Scientific Conference Sinteza
70. Multimodal Local-Global Ranking Fusion for Emotion Recognition
    Paul Pu Liang, Amir Zadeh, Louis‐Philippe Morency · 2018 · arXiv (Cornell University)
71. Pseudo-Encoded Stochastic Variational Inference
    Amir Zadeh, Smon Hessner, Yao Chong Lim, Morency, Louis-Phlippe · 2019 · arXiv (Cornell University)
72. Relay Variational Inference: A Method for Accelerated Encoderless VI
    Amir Zadeh, Santiago Benoit, Louis‐Philippe Morency · 2021 · arXiv (Cornell University)
73. Context Dependent Sentiments Analysis Using Machine Learning
    Mahima Shanker Pandey, Bihari Nandan Pandey, Abhishek Singh, Ashish Kumar Mishra, Brijesh Kumar Pandey · 2025
74. A Method with Universal Transformer for Multimodal Sentiment Analysis
    Hao Ai, Ying Liu, Jie Fang, Sheikh Faisal Rashid · 2022
75. Trait analysis based on multimodal prediction and optimization of the output parameters: A survey
    Milić Vukojičić, Mladen Đ. Veinović · 2023 · Serbian Journal of Electrical Engineering
76. Utterance-Level Incongruity Learning Network for Multimodal Sarcasm Detection
    Liujing Song, Zefang Zhao, Yuxiang Ma, Yuyang Liu, Jun Li · 2024 · International Conference on Advanced Communications Technology (ICACT)
77. VATE: A Large Scale Multimodal Spontaneous Dataset for Affective Evaluation
    Francesco Agnelli, Giuliano Grossi, Alessandro D’Amelio, Marco De Paoli, Raffaella Lanzarotti · 2025 · Lecture notes in computer science
78. Image Recognition Cropping and Multimodal Aspect-Level Sentiment Analysis Using Knowledge Graph Enhancement
    Enshou Liang, Guozhe Jin · 2025
79. Adaptive weighting in a transformer framework for multimodal emotion recognition
    Weijie Lü, Yunfeng Xu, Jia-Chen Gu · 2025 · Speech Communication
80. Multimodal Sentiment Analysis Based on Heterogeneous Contrastive Representation Learning with Prior Knowledge Enhancement
    Lichao Cui, Shaojie Liu, Lei Wang, Shanliang Yang · 2025 · International Joint Conference on Neural Networks (IJCNN)
81. Improving Cross-Modal Semantic Alignment with Cross-Modal Joint Semantic Transformer for Multimodal Sentiment Analysis
    Wenxuan Zhang, Jihong Ding, Huazhong Liu, Tingting Han, Yuanhan Liu, Laurence T. Yang · 2026 · Big Data Mining and Analytics
82. Sentiment Analysis of Telephone Conversations Using Multimodal Data
    Alexander Gafuanovich Logumanov, Julius Klenin, Dmitry Botov · 2018 · Lecture notes in computer science
83. Correlations Between Positive or Negative Utterances and Basic Acoustic Features of Voice: a Preliminary Analysis
    Łukasz Stolarski · 2022 · Research in Language
84. Weighted Cause-Reward Analysis-based Reinforcement Learning Method for Optimizing the Sentiment Prediction
    Kushal Devgun, Deexa Jamwal, Kapil Juneja · 2022 · International Conference on Smart Generation Computing, Communication and Networking (SMART GENCON)
85. PSRMER: Proactive Services Recommendation Driven-by Multimodal Emotion Recognition
    Zhizhong Liu, Guangyu Huang, Dianhui Chu, Yuhang Sun · 2023 · IEEE International Conference on Web Services (ICWS)
86. Residual Learning with Bi-LSTM and Multi-Head Attention for Multi-Modal Emotion Recognition
    Yifei Gao, Chi Xu · 2023 · IEEE International Conference on Image Processing and Computer Applications (ICIPCA)
87. Information Aggregate and Sentiment Enhance Network to Handle Missing Modalities for Multimodal Sentiment Analysis
    Liang Shi, Fuyong Xu, Ru Wang, Yongqing Wei, Guangjin Wang, Bao Wang, Peiyu Liu · 2024 · IEEE International Conference on Multimedia and Expo (ICME)
88. Heterogeneous Hierarchical Fusion Network for Multimodal Sentiment Analysis in Real-World Environments
    Ju Huang, Wenkang Chen, Fangyi Wang, Haijun Zhang · 2024 · Electronics
89. Efficient Low-Dimensional Representation Via Manifold Learning-Based Model for Multimodal Sentiment Analysis
    Xingang Wang, Mengyi Wang, Hai Ning Cui, Yijia Zhang · 2024 · ACM International Conference on Multimedia in Asia (MMAsia)
90. Multi-Feature Fusion for Multimodal Attentive Sentiment Analysis
    Man A, Yuanyuan Pu, Dan Xu, Wenhua Qian, Zhengpeng Zhao, Qiuxia Yang · 2019 · ACM International Conference on Multimedia in Asia (MMAsia)
91. Speech-based affective computing using attention with multimodal fusion
    Yue Gu · 2020
92. Relational structure predictive neural architecture search for multimodal fusion
    Xiao Lan Yao, Li Fang, Yifeng Zeng · 2022 · Soft Computing
93. Advanced Cross-Modal Gating for Enhanced Multimodal Sentiment Analysis
    Emily Johnson, Rodolfo Patel, Michael Smith · 2024 · Preprints.org
94. Hierarchical-Gate Multimodal Network for Human Communication Comprehension
    Qiyuan Liu, Liangqing Wu, Yang Xu, Dong Zhang, Shoushan Li, Guodong Zhou · 2019 · Lecture notes in computer science
95. Deep audio and video emotion detection
    Masih Aminbeidokhti · 2020 · Espace ÉTS (ETS)
96. Attentive Intra-modality Fusion for Multimodal Sentiment Analysis
    Jianxun Ding, Yongqiang Zheng, Xia Li, Minping Chen, Junshan Huang · 2021 · Lecture notes in computer science
97. Multi-Head Attention with Disagreement Regularization for Multimodal Sentiment Analysis
    Hao Ai, Ying Liu, Jie Fang · 2021 · 2021 4th International Conference on Artificial Intelligence and Pattern Recognition
98. Esuf: Extracting Sufficient Unimodal Feature with Mlp for Multimodal Sentiment Analysis
    Xianxin Ke, Qinghua Liu, Tao Xue · 2023 · SSRN Electronic Journal
99. From knowledge augmentation to multi-tasking: towards human-like dialogue systems
    T. H. Yang · 2023
100. Modal Interactive Feature Encoder for Multimodal Sentiment Analysis
     Xiaowei Zhao, Jie Zhou, XU Xiu-juan · 2023 · Communications in computer and information science