Multimodal Sentiment Intensity Analysis in Videos: Facial Gestures and Verbal Messages
Zadeh, Amir, Zellers, Rowan, Pincus, Eli, Morency, Louis-Philippe·2016·IEEE Intelligent Systems
Cited by (852)
Items 101–200 of 852
- Attention-Based Multimodal Fusion with Contrast for Robust Clinical Prediction in the Face of Missing ModalitiesLiu, Jinghui, Capurro, Daniel, Nguyen, Anthony, Verspoor, Karin · 2023 · Journal of Biomedical Informatics
- Multimodal Sentiment Analysis via RNN variantsAyush Agarwal, Ashima Yadav, D. Vishwakarma · 2019 · International Conference on Big Data, Cloud Computing, Data Science & Engineering
- Emotion Recognition for Multiple Context AwarenessDingkang Yang, Shuai Huang, Shunli Wang, Yang Liu, Peng Zhai, Liuzhen Su, Mingcheng Li, Lihua Zhang · 2022 · Lecture notes in computer science
- Multimodal Prompt Learning with Missing Modalities for Sentiment Analysis and Emotion RecognitionGuo, Zirun, Jin, Tao, Zhao, Zhou · 2024 · Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
- Learning to Balance the Learning Rates Between Various Modalities via Adaptive Tracking FactorSun Ya, Sijie Mai, Haifeng Hu · 2021 · IEEE Signal Processing Letters
- Multimodal Sentiment Analysis Based on Attentional Temporal Convolutional Network and Multi-Layer Feature FusionHongju Cheng, Zizhen Yang, Xiaoqi Zhang, Yang Yang · 2023 · IEEE Transactions on Affective Computing
- Sentiment Analysis: Comprehensive Reviews, Recent Advances, and Open ChallengesQiang Lu, Xia Sun, Yunfei Long, Zhizezhang Gao, Jun Hong Feng, Tong Sheng Sun · 2023 · IEEE Transactions on Neural Networks and Learning Systems
- Combating Human Trafficking with Multimodal Deep ModelsEdmund Tong, Amir Zadeh, Cara Jones, Louis‐Philippe Morency · 2017 · Proceedings of the conference - Association for Computational Linguistics. Meeting
- Survey on multimodal approaches to emotion recognitionAruna Gladys A., V. Vetriselvi · 2023 · Neurocomputing
- Robust Multimodal Learning with Missing Modalities via Parameter-Efficient AdaptationReza, Md Kaykobad, Prater-Bennette, Ashley, Asif, M. Salman · 2025 · IEEE Transactions on Pattern Analysis and Machine Intelligence
- Make Acoustic and Visual Cues Matter: CH-SIMS v2.0 Dataset and AV-Mixup Consistent ModuleLiu, Yihe, Yuan, Ziqi, Mao, Huisheng, Liang, Zhiyun, Yang, Wanqiuyue, Qiu, Yuanzhe, Cheng, Tie, Li, Xiaoteng, Xu, Hua, Gao, Kai · 2022 · Proceedings of the 2022 International Conference on Multimodal Interaction
- Human-building interaction for indoor environmental control: Evolution of technology and future prospectsHakpyeong Kim, Hyuna Kang, Heeju Choi, Dahyun Jung, Taehoon Hong · 2023 · Automation in Construction
- A survey of transformer-based multimodal pre-trained modalsHan, Xue, Wang, Yi-Tong, Feng, Jun-Lan, Deng, Chao, Chen, Zhan-Heng, Huang, Yu-An, Su, Hui, Hu, Lun, Hu, Peng-Wei · 2023 · Neurocomputing
- Attention-based Multi-modal Sentiment Analysis and Emotion Detection in Conversation using RNN.Mahesh G. Huddar, Sanjeev S. Sannakki, Vijay S. Rajpurohit · 2020 · International Journal of Interactive Multimedia and Artificial Intelligence
- Multimodal emotion recognition: A comprehensive review, trends, and challengesRamaswamy, Manju Priya Arthanarisamy, Palaniswamy, Suja · 2024 · WIREs Data Mining and Knowledge Discovery
- EmoCo: Visual Analysis of Emotion Coherence in Presentation VideosHaipeng Zeng, Xingbo Wang, Aoyu Wu, Yong Wang, Quan Li, Alex Endert, Huamin Qu · 2019 · IEEE Transactions on Visualization and Computer Graphics
- Deep Reinforcement Learning Techniques in Diversified Domains: A SurveySurbhi Gupta, Gaurav Singal, Deepak Garg · 2021 · Archives of Computational Methods in Engineering
- Learning to Learn Better Unimodal Representations via Adaptive Multimodal Meta-LearningSun Ya, Sijie Mai, Haifeng Hu · 2022 · IEEE Transactions on Affective Computing
- The Weighted Cross-Modal Attention Mechanism With Sentiment Prediction Auxiliary Task for Multimodal Sentiment AnalysisQiupu Chen, Guimin Huang, Yabing Wang · 2022 · IEEE/ACM Transactions on Audio Speech and Language Processing
- TEDT: Transformer-Based Encoding–Decoding Translation Network for Multimodal Sentiment AnalysisFan Wang, Shengwei Tian, Long Yu, Jing Liu, Junwen Wang, Kun Li, Yongtao Wang · 2022 · Cognitive Computation
- MEISD: A Multimodal Multi-Label Emotion, Intensity and Sentiment Dialogue Dataset for Emotion Recognition and Sentiment Analysis in ConversationsMauajama Firdaus, Hardik Chauhan, Asif Ekbal, Pushpak Bhattacharyya · 2020 · International Conference on Computational Linguistics
- Multimodal Sentiment Analysis Using Multi-tensor Fusion Network with Cross-modal ModelingXueming Yan, Haiwei Xue, Shengyi Jiang, Ziang Liu · 2021 · Applied Artificial Intelligence
- SDR-GNN: Spectral Domain Reconstruction Graph Neural Network for incomplete multimodal learning in conversational emotion recognitionFangze Fu, Wei Ai, Fan Yang, Yuntao Shou, Tao Meng, Keqin Li · 2024 · Knowledge-Based Systems
- DNN Multimodal Fusion Techniques for Predicting Video SentimentJennifer A. Williams, Ramona Comanescu, Oana Radu, Leimin Tian · 2018
- Excavating multimodal correlation for representation learningSijie Mai, Sun Ya, Ying Zeng, Haifeng Hu · 2022 · Information Fusion
- Dynamically Shifting Multimodal Representations via Hybrid-Modal Attention for Multimodal Sentiment AnalysisRonghao Lin, Haifeng Hu · 2023 · IEEE Transactions on Multimedia
- Dynamic hypergraph convolutional network for multimodal sentiment analysisJian Huang, Yuanyuan Pu, Dongming Zhou, Jinde Cao, Jinjing Gu, Zhengpeng Zhao, Dan Xu · 2023 · Neurocomputing
- LD-MAN: Layout-Driven Multimodal Attention Network for Online News Sentiment RecognitionWenya Guo, Ying Zhang, Xiangrui Cai, Lei Meng, Jufeng Yang, Xiaojie Yuan · 2020 · IEEE Transactions on Multimedia
- Perspectives and Prospects on Transformer Architecture for Cross-Modal Tasks with Language and VisionAndrew Shin, Masato Ishii, Takuya Narihira · 2022 · International Journal of Computer Vision
- Learning fine-grained representation with token-level alignment for multimodal sentiment analysisXiang Li, Haijun Zhang, Zhiqiang Dong, Xianfu Cheng, Yun Liu, Xiaoming Zhang · 2024 · Expert Systems with Applications
- UniMF: A Unified Multimodal Framework for Multimodal Sentiment Analysis in Missing Modalities and Unaligned Multimodal SequencesRuohong Huan, Guowei Zhong, Peng Chen, Ronghua Liang · 2023 · IEEE Transactions on Multimedia
- A Multi-Modal Vertical Federated Learning Framework Based on Homomorphic EncryptionMaoguo Gong, Yuanqiao Zhang, Yuan Gao, Alex Kai Qin, Yue Wu, Shanfeng Wang, Yihong Zhang · 2023 · IEEE Transactions on Information Forensics and Security
- Polarity and Intensity: the Two Aspects of Sentiment AnalysisLeimin Tian, Catherine Lai, Johanna D. Moore · 2018
- Attention-based multimodal contextual fusion for sentiment and emotion classification using bidirectional LSTMMahesh G. Huddar, Sanjeev S. Sannakki, Vijay S. Rajpurohit · 2021 · Multimedia Tools and Applications
- DeepCU: Integrating both Common and Unique Latent Information for Multimodal Sentiment AnalysisSunny Verma, Chen Wang, Liming Zhu, Wei Liu · 2019 · International Joint Conference on Artificial Intelligence
- Multimodal Fusion Method Based on Self-Attention MechanismHu Zhu, Ze Wang, Yu Shi, Yingying Hua, Guoxia Xu, Lizhen Deng · 2020 · Wireless Communications and Mobile Computing
- MAGDRA: A Multi-modal Attention Graph Network with Dynamic Routing-By-Agreement for multi-label emotion recognitionXingye Li, Jin Liu, Yurong Xie, Peizhu Gong, Xiliang Zhang, Huihua He · 2023 · Knowledge-Based Systems
- Target and source modality co-reinforcement for emotion understanding from asynchronous multimodal sequencesDingkang Yang, Yang Liu, Can Huang, Mingcheng Li, Xiao Xuan Zhao, Yuzheng Wang, Kun Yang, Yan Wang, Peng Zhai, Lihua Zhang · 2023 · Knowledge-Based Systems
- MF-BERT: Multimodal Fusion in Pre-Trained BERT for Sentiment AnalysisJiaxuan He, Haifeng Hu · 2021 · IEEE Signal Processing Letters
- MIA-Net: Multi-Modal Interactive Attention Network for Multi-Modal Affective AnalysisShuzhen Li, Tong Zhang, Bianna Chen, C. L. Philip Chen · 2023 · IEEE Transactions on Affective Computing
- Learning discriminative multi-relation representations for multimodal sentiment analysisZemin Tang, Qi Xiao, Xu Zhou, Yangfan Li, Cen Chen, Kenli Li · 2023 · Information Sciences
- Similar modality completion-based multimodal sentiment analysis under uncertain missing modalitiesYuhang Sun, Zhizhong Liu, Quan Z. Sheng, Dianhui Chu, Jian Yu, Hongxiang Sun · 2024 · Information Fusion
- Robust Multimodal Sentiment Analysis via Tag Encoding of Uncertain Missing ModalitiesJiandian Zeng, Jiantao Zhou, Tianyi Liu · 2022 · IEEE Transactions on Multimedia
- CMU-MOSEAS: A Multimodal Language Dataset for Spanish, Portuguese, German and FrenchAmirAli Bagher Zadeh, Yansheng Cao, Simon Hessner, Paul Pu Liang, Soujanya Poria, Louis‐Philippe Morency · 2020 · Conference on Empirical Methods in Natural Language Processing (EMNLP)
- A fine-grained modal label-based multi-stage network for multimodal sentiment analysisJunjie Peng, Ting Wu, Wenqiang Zhang, Feng Cheng, Shuhua Tan, Fen Yi, Yansong Huang · 2023 · Expert Systems with Applications
- A review on sentiment discovery and analysis of educational big‐dataZhongmei Han, Jiyi Wu, Changqin Huang, Qionghao Huang, Meihua Zhao · 2019 · Wiley Interdisciplinary Reviews Data Mining and Knowledge Discovery
- Enhanced Video Analytics for Sentiment Analysis Based on Fusing Textual, Auditory and Visual InformationSadam Al-Azani, El-Sayed M. El-Alfy · 2020 · IEEE Access
- AIA-Net: Adaptive Interactive Attention Network for Text–Audio Emotion RecognitionTong Zhang, Shuzhen Li, Bianna Chen, Haozhang Yuan, C. L. Philip Chen · 2022 · IEEE Transactions on Cybernetics
- LMR-CBT: learning modality-fused representations with CB-Transformer for multimodal emotion recognition from unaligned multimodal sequencesZiwang Fu, Feng Liu, Qing Xu, Xiangling Fu, Jiayin Qi · 2023 · Frontiers of Computer Science
- An efficient preprocessing method for supervised sentiment analysis by converting sentences to numerical vectors: a twitter case studyM. Sohrabi, Fatemeh Hemmatian · 2019 · Multimedia tools and applications
- Graph Capsule Aggregation for Unaligned Multimodal SequencesJianfeng Wu, Sijie Mai, Haifeng Hu · 2021 · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION
- Co-space Representation Interaction Network for multimodal sentiment analysisHang Shi, Yuanyuan Pu, Zhengpeng Zhao, Jian Huang, Dongming Zhou, Dan Xu, Jinde Cao · 2023 · Knowledge-Based Systems
- Multimodal Relational Tensor Network for Sentiment and Emotion ClassificationSaurav Sahay, Shachi H Kumar, Rui Xia, Jonathan Huang, Lama Nachman · 2018
- A Deep Multi-task Contextual Attention Framework for Multi-modal Affect AnalysisMd Shad Akhtar, Dushyant Singh Chauhan, Asif Ekbal · 2020 · ACM Transactions on Knowledge Discovery from Data
- Mitigating Inconsistencies in Multimodal Sentiment Analysis under Uncertain Missing ModalitiesJiandian Zeng, Jiantao Zhou, Tianyi Liu · 2022 · Conference on Empirical Methods in Natural Language Processing (EMNLP)
- Mimicking the Brain’s Cognition of Sarcasm From Multidisciplines for Twitter Sarcasm DetectionFanglong Yao, Xian Sun, Hongfeng Yu, Wenkai Zhang, Wei Liang, Kun Fu · 2021 · IEEE Transactions on Neural Networks and Learning Systems
- VLP2MSA: Expanding vision-language pre-training to multimodal sentiment analysisGuofeng Yi, Cunhang Fan, Kang Zhu, Zhao Lv, Shan Liang, Zhengqi Wen, Guanxiong Pei, Taihao Li, Jianhua Tao · 2023 · Knowledge-Based Systems
- Refashioning Emotion Recognition Modeling: The Advent of Generalized Large ModelsZixing Zhang, Liyizhe Peng, Tao Pang, Jing Han, Huan Zhao, Björn Wolfgang Schuller · 2024 · IEEE Transactions on Computational Social Systems
- EMOE: Modality-Specific Enhanced Dynamic Emotion ExpertsYiyang Fang, Wenke Huang, Guancheng Wan, Kehua Su, Mang Ye · 2025 · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
- Multi-Attention Fusion Network for Video-based Emotion RecognitionYanan Wang, Jianming Wu, Keiichiro Hoashi · 2019 · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION
- Rate-Adaptive Coding Mechanism for Semantic Communications With Multi-Modal DataYangshuo He, Guanding Yu, Yunlong Cai · 2023 · IEEE Transactions on Communications
- Multi-level context extraction and attention-based contextual inter-modal fusion for multimodal sentiment analysis and emotion classificationMahesh G. Huddar, Sanjeev S. Sannakki, Vijay S. Rajpurohit · 2019 · International Journal of Multimedia Information Retrieval
- Foundations of Multimodal Co-learningZadeh, Amir, Liang, Paul Pu, Morency, Louis-Philippe · 2020 · Information Fusion
- Learning from the global view: Supervised contrastive learning of multimodal representationSijie Mai, Ying Zeng, Haifeng Hu · 2023 · Information Fusion
- Leveraging Knowledge of Modality Experts for Incomplete Multimodal LearningWenxin Xu, Hexin Jiang, Xuefeng Liang · 2024 · ACM International Conference on Multimedia (ACM MM)
- Sentiment analysis from Customer-generated online videos on product review using topic modeling and Multi-attention BLSTMZheng Wang, Peng Gao, Xuening Chu · 2022 · Advanced Engineering Informatics
- BiERU: Bidirectional Emotional Recurrent Unit for Conversational Sentiment AnalysisWei Li, Wei Shao, Shaoxiong Ji, Erik Cambria · 2020 · arXiv (Cornell University)
- Fcdnet: Fuzzy Cognition-Based Dynamic Fusion Network for Multimodal Sentiment AnalysisShuai Liu, Zhe Luo, Weina Fu · 2024 · IEEE Transactions on Fuzzy Systems
- Multimodal fusion techniques: Review, data representation, information fusion, and application areasSakshini Hangloo, Bhavna Arora · 2025 · Neurocomputing
- NHFNET: A Non-Homogeneous Fusion Network for Multimodal Sentiment AnalysisZiwang Fu, Feng Liu, Qing Xu, Jiayin Qi, Xiangling Fu, Aimin Zhou, Zhibin Li · 2022 · IEEE International Conference on Multimedia and Expo (ICME)
- Token-disentangling Mutual Transformer for multimodal emotion recognitionGuanghao Yin, Yuanyuan Liu, Tengfei Liu, Haoyu Zhang, Fang Fang, Chang Tang, Liangxiao Jiang · 2024 · Engineering Applications of Artificial Intelligence
- High-Performance Modelling and Simulation for Big Data ApplicationsJoanna Kołodziej, Horacio González–Vélez · 2019 · Lecture notes in computer science
- Layer-wise Fusion with Modality Independence Modeling for Multi-modal Emotion RecognitionJun Sun, Shoukang Han, Yu-Ping Ruan, Xiaoning Zhang, Shukai Zheng, Yulong Liu, Yuxin Huang, Taihao Li · 2023 · Proceedings of the conference - Association for Computational Linguistics. Meeting
- A context-sensitive multi-tier deep learning framework for multimodal sentiment analysisP. Ganeshkumar, S. Arul Antran Vijay, Jothi Prakash V, Anand Paul, Anand Nayyar · 2023 · Multimedia Tools and Applications
- FDR-MSA: Enhancing multimodal sentiment analysis through feature disentanglement and reconstructionYao Fu, Biao Huang, Yujun Wen, Pengzhou Zhang · 2024 · Knowledge-Based Systems
- MDKAT: Multimodal Decoupling With Knowledge Aggregation and Transfer for Video Emotion RecognitionJian Wang, Chenglong Wang, Lin Guo, Shuchang Zhao, Dandan Wang, Shiqing Zhang, Xiaoming Zhao, Jun Yu, Yaowei Wang, Yi Yang et al. · 2025 · IEEE Transactions on Circuits and Systems for Video Technology
- Integrating audio–visual text generation with contrastive learning for enhanced multimodal emotion analysisJunyi Xiang, Xianxun Zhu, Erik Cambria · 2025 · Information Fusion
- General Debiasing for Multimodal Sentiment AnalysisTeng Sun, Juntong Ni, Wenjie Wang, Liqiang Jing, Yinwei Wei, Liqiang Nie · 2023 · ACM International Conference on Multimedia (ACM MM)
- AdaMoW: Multimodal Sentiment Analysis Based on Adaptive Modality-Specific Weight Fusion NetworkJunling Zhang, Xuemei Wu, Changqin Huang · 2023 · IEEE Access
- Multimodal Graph for Unaligned Multimodal Sequence Analysis via Graph Convolution and Graph PoolingSijie Mai, Songlong Xing, Jiaxuan He, Ying Zeng, Haifeng Hu · 2022 · ACM Transactions on Multimedia Computing Communications and Applications
- Towards Robust Multimodal Sentiment Analysis Under Uncertain Signal MissingMingcheng Li, Dingkang Yang, Lihua Zhang · 2023 · IEEE Signal Processing Letters
- Ensemble Pretrained Models for Multimodal Sentiment Analysis using Textual and Video Data FusionZhicheng Liu, Ali Braytee, Ali Anaissi, Guifu Zhang, Lingyun Qin, Junaid Akram · 2024 · International World Wide Web Conference (WWW)
- Diversity and Balance: Multimodal Sentiment Analysis Using Multimodal-Prefixed and Cross-Modal AttentionMeng Li, Zhenfang Zhu, Kefeng Li, Hongli Pei · 2024 · IEEE Transactions on Affective Computing
- Advancements in Affective Disorder Detection: Using Multimodal Physiological Signals and Neuromorphic Computing Based on SNNsFuze Tian, Lixin Zhang, Lixian Zhu, Mingqi Zhao, Jingyu Liu, Qunxi Dong, Qinglin Zhao · 2024 · IEEE Transactions on Computational Social Systems
- Transfer-based adaptive tree for multimodal sentiment analysis based on user latent aspectsSana Rahmani, Saeid Hosseini, Raziyeh Zall, Mohammad Reza Kangavari, Sara Kamran, Wen Hua · 2022 · Knowledge-Based Systems
- Cross-modal contrastive learning for multimodal sentiment recognitionShanliang Yang, Lichao Cui, Lei Wang, Tao Wang · 2024 · Applied Intelligence
- Noise-Resistant Multimodal Transformer for Emotion RecognitionYuanyuan Liu, Haoyu Zhang, Yibing Zhan, Zijing Chen, Guanghao Yin, Lin Wei, Zhe Chen · 2024 · International Journal of Computer Vision
- Temporally Selective Attention Model for Social and Affective State Recognition in Multimedia ContentHongliang Yu, Liangke Gui, Michael Madaio, Amy Ogan, Justine Cassell, Louis‐Philippe Morency · 2017 · ACM International Conference on Multimedia (ACM MM)
- Emotion Ontology Studies: A Framework for Expressing Feelings Digitally and its Application to Sentiment AnalysisEun Hee Park, Veda C. Storey · 2022 · ACM Computing Surveys
- Multimodal Affective Computing With Dense Fusion Transformer for Inter- and Intra-Modality InteractionsHuan Deng, Zhenguo Yang, Tianyong Hao, Qing Li, Wenyin Liu · 2022 · IEEE Transactions on Multimedia
- Multimodal Sentiment Recognition With Multi-Task LearningSun Zhang, Chunyong Yin, Zhichao Yin · 2022 · IEEE Transactions on Emerging Topics in Computational Intelligence
- AcFormer: An Aligned and Compact Transformer for Multimodal Sentiment AnalysisDaoming Zong, Chaoyue Ding, Baoxiang Li, Jiakui Li, Keru Zheng, Qunyan Zhou · 2023 · ACM International Conference on Multimedia (ACM MM)
- Multi-modal feature fusion based on multi-layers LSTM for video emotion recognitionWeizhi Nie, Yan Yan, Dan Song, Kun Wang · 2020 · Multimedia Tools and Applications
- Transformer-Based Interactive Multi-Modal Attention Network for Video Sentiment DetectionXuqiang Zhuang, Fangai Liu, Jian Hou, Jianhua Hao, Xiaohong Cai · 2022 · Neural Processing Letters
- PIRNet: Personality-Enhanced Iterative Refinement Network for Emotion Recognition in ConversationZheng Lian, Bin Liu, Jianhua Tao · 2022 · IEEE Transactions on Neural Networks and Learning Systems
- A Survey of Cross-Modal Visual Content GenerationFatemeh Nazarieh, Zhenhua Feng, Muhammad Awais, Wenwu Wang, Josef Kittler · 2024 · IEEE Transactions on Circuits and Systems for Video Technology
- Text-centered cross-sample fusion network for multimodal sentiment analysisQionghao Huang, Jili Chen, Changqin Huang, Xiaodi Huang, Yi Wang · 2024 · Multimedia Systems
- Transformer-based correlation mining network with self-supervised label generation for multimodal sentiment analysisRuiqing Wang, Qimeng Yang, Shengwei Tian, Long Yu, Xiaoyu He, Bo Wang · 2024 · Neurocomputing
- 3WD-DRT: A three-way decision enhanced dynamic routing transformer for cost-sensitive multimodal sentiment analysisHaoyu Jiang, Xiaoliang Chen, Duoqian Miao, Hongyun Zhang, Xiaolin Qin, Shangyi Du, Peng Lu · 2025 · Information Sciences
- Multi-Modal Sentiment Classification With Independent and Interactive Knowledge via Semi-Supervised LearningDong Zhang, Shoushan Li, Qiaoming Zhu, Guodong Zhou · 2020 · IEEE Access