Multimodal Sentiment Intensity Analysis in Videos: Facial Gestures and Verbal Messages
Zadeh, Amir, Zellers, Rowan, Pincus, Eli, Morency, Louis-Philippe·2016·IEEE Intelligent Systems
Cited by (852)
Items 301–400 of 852
- Multimodal Hierarchical Attention Neural Network: Looking for Candidates Behaviour Which Impact Recruiter's DecisionLéo Hemamou, Arthur Guillon, Jean‐Claude Martin, Chloé Clavel · 2021 · IEEE Transactions on Affective Computing
- AFR-BERT: Attention-based mechanism feature relevance fusion multimodal sentiment analysis modelJi Mingyu, Jiawei Zhou, Wei Ning · 2022 · PLoS ONE
- Video-Based Sentiment Analysis with hvnLBP-TOP Feature and bi-LSTMHaoran Li, Hua Xu · 2019 · Proceedings of the AAAI Conference on Artificial Intelligence
- Improving Multimodal Accuracy Through Modality Pre-training and AttentionAya Abdelsalam Ismail, Md. Mahmudul Hasan, Faisal Ishtiaq · 2020 · arXiv (Cornell University)
- TriagedMSA: Triaging Sentimental Disagreement in Multimodal Sentiment AnalysisYuanyi Luo, Wei Liu, Qiang Sun, Sirui Li, Jichunyang Li, Rui Wu, Xianglong Tang · 2025 · IEEE Transactions on Affective Computing
- Multimodal hypergraph network with contrastive learning for sentiment analysisJian Huang, Kun Jiang, Yuanyuan Pu, Zhengpeng Zhao, Qiuxia Yang, Jinjing Gu, Dan Xu · 2025 · Neurocomputing
- Asynchronous Multimodal Video Sequence Fusion via Learning Modality-Exclusive and -Agnostic RepresentationsDingkang Yang, Mingcheng Li, Linhao Qu, Kun Yang, Peng Zhai, Song Wang, Lihua Zhang · 2024 · IEEE Transactions on Circuits and Systems for Video Technology
- Graph Reconstruction Attention Fusion Network for Multimodal Sentiment AnalysisRonglong Hu, Jizheng Yi, Lijiang Chen, Ze Jin · 2024 · IEEE Transactions on Industrial Informatics
- Domain-Separated Bottleneck Attention Fusion Framework for Multimodal Emotion RecognitionPeng He, Jun Yu, Chengjie Ge, Ye Yu, Wei Xu, Lei Wang, Tianyu Liu, Zhen Kan · 2025 · ACM Transactions on Multimedia Computing Communications and Applications
- Temporal text-guided feedback-based progressive fusion network for multimodal sentiment analysisZhihao Yang, Qing He, Nisuo Du, Qianhua He · 2025 · Alexandria Engineering Journal
- Multimodal Sentiment Analysis Using Deep LearningRakhee Sharma, Tan Le Ngoc, Fatiha Sadat · 2018 · International Conference on Machine Learning and Applications
- A Multimodal LSTM for Predicting Listener Empathic Responses Over TimeTan Zhi‐Xuan, Arushi Goel, Thanh-Son Nguyen, Desmond C. Ong · 2019 · International Conference on Automatic Face and Gesture Recognition
- Multi-task Learning for Multi-modal Emotion Recognition and Sentiment AnalysisShad Akhtar, Dushyant Singh Chauhan, Deepanway Ghosal, Soujanya Poria, Asif Ekbal, Pushpak Bhattacharyya · 2019 · arXiv (Cornell University)
- Multi-level fusion with fine-grained alignment for multimodal sentiment analysisXiaoge Li, Yanan Ma, Xiaochun An, Jinshuo Xing, Ren Ping Liu, Yihua Ren · 2025 · Journal of King Saud University - Computer and Information Sciences
- Brain-Inspired Recognition System Based on Multimodal In-Memory Computing Framework for Edge AIHe Xiao, Dirui Xie, Xiaofang Hu, Yue Zhou, Guangdong Zhou, Shukai Duan · 2023 · IEEE Transactions on Circuits and Systems I Regular Papers
- Balanced sentimental information via multimodal interaction modelYuanyi Luo, Rui Wu, Jiafeng Liu, Xianglong Tang · 2024 · Multimedia Systems
- Mixture of Attention Variants for Modal Fusion in Multi-Modal Sentiment AnalysisChao He, Xinghua Zhang, Dongqing Song, Yingshan Shen, Chengjie Mao, Huosheng Wen, Dingju Zhu, Lihua Cai · 2024 · Big Data and Cognitive Computing
- Multi-Modal Hierarchical Empathetic Framework for Social Robots With Affective Body ControlYue Gao, Yangqing Fu, Ming Sun, Feng Gao · 2024 · IEEE Transactions on Affective Computing
- A Two-Stage Stacked Transformer Framework for Multimodal Sentiment AnalysisGuofeng Yi, Cunhang Fan, Jianhua Tao, Zhao Lv, Zhengqi Wen, Guanxiong Pei, Taihao Li · 2024 · Intelligent Computing
- AdaFN-AG: Enhancing multimodal interaction with Adaptive Feature Normalization for multimodal sentiment analysisWeilong Liu, Hua Xu, Yu Hua, Yunxian Chi, Kai Gao · 2024 · Intelligent Systems with Applications
- Conv-Enhanced Transformer and Robust Optimization Network for robust multimodal sentiment analysisBin Sun, Li Jia, Yiming Cui, Na Wang, Tao Jiang · 2025 · Neurocomputing
- Sentiment Analysis of Fashion Related Posts in Social MediaYifei Yuan, Wai Pang Lam · 2022 · ACM International Conference on Web Search and Data Mining (WSDM)
- Rethinking Missing Modality Learning from a Decoding PerspectiveTao Jin, Xize Cheng, Linjun Li, Lin Wang, Ye Wang, Zhou Zhao · 2023 · ACM International Conference on Multimedia (ACM MM)
- Integration of Driver Behavior into Emotion Recognition Systems: A Preliminary Study on Steering Wheel and Vehicle AccelerationSina Shafaei, Tahir Hacizade, Alois Knoll · 2019 · Lecture notes in computer science
- Temporal Graph Convolutional Network for Multimodal Sentiment AnalysisJian Huang, Zehang Lin, Zhenguo Yang, Wenyin Liu · 2021 · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION
- Unbiased Missing-Modality Multimodal LearningDai, Ruiting, Li, Chenxi, Yan, Yandong, Mo, Lisi, Qin, Ke, He, Tao · 2025 · 2025 IEEE/CVF International Conference on Computer Vision (ICCV)
- A multi-scale representation and multi-level decision learning network for multimodal sentiment analysisXiang Li, Zhiqiang Dong, Xianfu Cheng, Dezhuang Miao, Haijun Zhang, Tianbo Wang, Xiaoming Zhang, Zhoujun Li · 2025 · Expert Systems with Applications
- A Fine-Grained Tri-Modal Interaction Model for Multimodal Sentiment AnalysisYuxing Zhi, Junhuai Li, Huaijun Wang, Jing Chen, Ting Cao · 2024 · IEEE International Conference on Acoustics Speech and Signal Processing
- Multiplex graph aggregation and feature refinement for unsupervised incomplete multimodal emotion recognitionYuanyue Deng, Jintang Bian, Shisong Wu, Jianhuang Lai, Xiaohua Xie · 2024 · Information Fusion
- Mi-CGA: Cross-modal Graph Attention Network for robust emotion recognition in the presence of incomplete modalitiesCam-Van Thi Nguyen, Hai-Dang Kieu, Quang-Thuy Ha, Xuan-Hieu Phan, Duc-Trong Le · 2025 · Neurocomputing
- A Social Media Dataset and H-GNN-Based Contrastive Learning Scheme for Multimodal Sentiment AnalysisJiao Peng, Yue He, Yongjuan Chang, Yanyan Lu, Pengfei Zhang, Zhonghong Ou, Qifeng Yu · 2025 · Applied Sciences
- Dense Fusion Network with Multimodal Residual for Sentiment ClassificationHuan Deng, Peipei Kang, Zhenguo Yang, Tianyong Hao, Qing Li, Wenyin Liu · 2021 · IEEE International Conference on Multimedia and Expo (ICME)
- Multi-scale Cooperative Multimodal Transformers for Multimodal Sentiment Analysis in VideosLianyang Ma, Yue Yu, Tao Liang, Tongliang Liu · 2024 · Lecture notes in computer science
- On the Use of Modality-Specific Large-Scale Pre-Trained Encoders for Multimodal Sentiment AnalysisAtsushi Ando, Ryo Masumura, Akihiko Takashima, Satoshi Suzuki, Naoki Makishima, Keita Suzuki, Takafumi Moriya, Takanori Ashihara, Hiroshi Satō · 2023 · IEEE Spoken Language Technology Workshop (SLT)
- Second Grand-Challenge and Workshop on Multimodal Language (Challenge-HML)2020
- Dynamic Weighted Multitask Learning and Contrastive Learning for Multimodal Sentiment AnalysisXingqi Wang, Mengrui Zhang, Bin Chen, Dan Wei, Yanli Shao · 2023 · Electronics
- Adaptive Multimodal Graph Integration Network for Multimodal Sentiment AnalysisPeizhu Gong, Jin Liu, Xiliang Zhang, Xingye Li, Lai Wei, Huihua He · 2024 · IEEE Transactions on Audio Speech and Language Processing
- Tripartite interaction representation learning for multi-modal sentiment analysisBinqiang Wang, Gang Dong, Yaqian Zhao, Rengang Li, Wenfeng Yin, Lihua Lu · 2025 · Expert Systems with Applications
- DashFusion: Dual-Stream Alignment With Hierarchical Bottleneck Fusion for Multimodal Sentiment AnalysisYuhua Wen, Qifei Li, Yingying Zhou, Yingming Gao, Zhengqi Wen, Jianhua Tao, Ya Li · 2025 · IEEE Transactions on Neural Networks and Learning Systems
- Emotional Tendency Dictionary Construction for College Teaching EvaluationWeiwen Shen, Shuping Zhang · 2018 · International Journal of Emerging Technologies in Learning (iJET)
- Multimodal Sentiment Analysis Using BiGRU and Attention-Based Hybrid Fusion StrategyZhizhong Liu, Bin Zhou, Lingqiang Meng, Guangyu Huang · 2023 · Intelligent Automation & Soft Computing
- Curriculum Learning Meets Weakly Supervised Multimodal Correlation LearningSijie Mai, Sun Ya, Haifeng Hu · 2022 · Conference on Empirical Methods in Natural Language Processing (EMNLP)
- Hybrid Representation and Decision Fusion towards Visual-textual SentimentChunyong Yin, Sun Zhang, Qingkui Zeng · 2023 · ACM Transactions on Intelligent Systems and Technology
- A Multimodal Approach for Hate and Offensive Content Detection in Tamil: From Corpus Creation to Model DevelopmentJayanth Mohan, Mekapati Spandana Reddy, B. Premjith, Jyothish Lal G, Bharathi Raja Chakravarthi · 2025 · ACM Transactions on Asian and Low-Resource Language Information Processing
- Multilevel information compression and textual information enhancement for multimodal sentiment analysisYuchen Zhang, Hong Zhong, Naji Alhusaini, Guilin Chen, Cheng Wu · 2025 · Knowledge-Based Systems
- BC-PMJRS: A Brain Computing-inspired Predefined Multimodal Joint Representation Spaces for enhanced cross-modal learningJiahao Qin, Feng Liu, Lu Zong · 2025 · Neural Networks
- Multi-modal sentiment recognition with residual gating network and emotion intensity attentionYadi Wang, Xiaoding Guo, Xianhong Hou, Zhijun Miao, Xiaojin Yang, Jinkai Guo · 2025 · Neural Networks
- SAGE-Net: Single-layer augmented gated encoder network for efficient multimodal sentiment analysisJiazheng Zhou, Xin Kang, Weiping Ding, Linhuang Wang, Fei Ding, Kazuyuki Matsumoto, Chenmeng Zhang, Huiwen Chi · 2025 · Applied Soft Computing
- Towards Explainable Fusion and Balanced Learning in Multimodal Sentiment AnalysisMiaosen Luo, Yuncheng Jiang, Sijie Mai · 2025 · ACM International Conference on Multimedia (ACM MM)
- Multimodal Classification and Out-of-Distribution Detection for Multimodal Intent UnderstandingHanlei Zhang, Qianrui Zhou, Hua Xu, Jianhua Su, Roger H. Evans, Kai Gao · 2025 · IEEE Transactions on Multimedia
- VAD: A Video Affective Dataset With DanmuShangfei Wang, Xin Li, Feiyi Zheng, Jicai Pan, Xuewei Li, Yanan Chang, Zhouan Zhu, Qiong Li, Jiahe Wang, Yufei Xiao · 2024 · IEEE Transactions on Affective Computing
- Towards Asynchronous Multimodal Signal Interaction and Fusion via Tailored TransformersDingkang Yang, Haopeng Kuang, Kun Yang, Mingcheng Li, Lihua Zhang · 2024 · IEEE Signal Processing Letters
- A Mini-Survey and Feasibility Study of Deep-Learning-Based Human Activity Recognition from Slight Feature Signals Obtained Using Privacy-Aware Environmental SensorsHirokazu Madokoro, Stephanie Nix, Hanwool Woo, Kazuhito Sato · 2021 · Applied Sciences
- Language Reinforced Superposition Multimodal Fusion for Sentiment AnalysisJiaxuan He, Haifeng Hu · 2022 · IEEE Signal Processing Letters
- Integrating Multimodal Information in Large Pretrained TransformersWasifur Rahman, Md. Kamrul Hasan, Sangwu Lee, Amir Zadeh, Chengfeng Mao, Louis‐Philippe Morency, Mohammed Ehsan Hoque · 2019 · arXiv (Cornell University)
- ScaleVLAD: Improving Multimodal Sentiment Analysis via Multi-Scale Fusion of Locally DescriptorsHuaishao Luo, Lei Ji, Yanyong Huang, Bin Wang, Shenggong Ji, Tianrui Li · 2021 · arXiv (Cornell University)
- Global Local Fusion Neural Network for Multimodal Sentiment AnalysisXiaoran Hu, M. Yamamura · 2022 · Applied Sciences
- TriSAT: Trimodal Representation Learning for Multimodal Sentiment AnalysisRuohong Huan, Guowei Zhong, Peng Chen, Ronghua Liang · 2024 · IEEE/ACM Transactions on Audio Speech and Language Processing
- Incremental Multiview Clustering With Continual Information Bottleneck MethodXiaoqiang Yan, Yiqiao Mao, Yangdong Ye, Hui Ling Yu · 2024 · IEEE Transactions on Systems Man and Cybernetics Systems
- GRACE: GRadient-based Active Learning with Curriculum Enhancement for Multimodal Sentiment AnalysisXinyu Li, Wenqing Ye, Yueyi Zhang, Xiaoyan Sun · 2024 · ACM International Conference on Multimedia (ACM MM)
- Dynamic Weighted Gating for Enhanced Cross-Modal Interaction in Multimodal Sentiment AnalysisNan Wang, Qi Wang · 2024 · ACM Transactions on Multimedia Computing Communications and Applications
- Mamba-assisted modality subspace complementary fusion for multimodal sentiment analysisQian Chen, Yiyang Tang, Haoming Liu · 2025 · Pattern Recognition Letters
- UCMIB-PNS: Balancing Sufficiency and Necessity With Probabilistic Causality and Cross-Modal Uncertainty in Multimodal Sentiment AnalysisJili Chen, Yihua Zhong, Qionghao Huang, Changqin Huang, Fan Jiang, Xiaodi Huang, Xun Wang · 2025 · IEEE Transactions on Affective Computing
- Consistency and discrepancy information learning in multimodal sentiment analysis via maximizing mutual information and contrastive learningYadi Wang, Man Yang, Xiaoding Guo, Huiyu Mu · 2025 · Expert Systems with Applications
- MMAN-M2: Multiple multi-head attentions network based on encoder with missing modalitiesJiayao Li, Li Li, Ruizhi Sun, Gang Yuan, Shufan Wang, Shulin Sun · 2023 · Pattern Recognition Letters
- TSCL-FHFN: two-stage contrastive learning and feature hierarchical fusion network for multimodal sentiment analysisYuqiang Li, Wenxuan Weng, Chun Liu · 2024 · Neural Computing and Applications
- Semantic Feature Scheduling and Rate Control in Multi-Modal Distributed NetworkHuiguo Gao, Guanding Yu, Yangshuo He, Yuanwei Liu · 2024 · IEEE Transactions on Wireless Communications
- A multimodal differential privacy framework based on fusion representation learningChaoxin Cai, Yingpeng Sang, Hui Tian · 2022 · Connection Science
- Analysis of infoware and software for human affective states recognitionAnastasia Dvoynikova, Maxim Markitantov, Елена Витальевна Рюмина, Mikhail Uzdiaev, Алёна Николаевна Величко, Dmitry Ryumin, Elena Lyakso, Alexey Anatolievich Karpov · 2022 · Informatics and Automation
- MORSE: MultimOdal sentiment analysis for Real-life SEttingsYiqun Yao, Verónica Pérez‐Rosas, Mohamed Abouelenien, Mihai G. Burzo · 2020 · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION
- A multimodal movie review corpus for fine-grained opinion miningAlexandre Garcia, Slim Essid, Florence d’Alché–Buc, Chloé Clavel · 2019 · arXiv (Cornell University)
- CTHFNet: contrastive translation and hierarchical fusion network for text–video–audio sentiment analysisQiaohong Chen, Shufan Xie, Xianwen Fang, Qi Sun · 2024 · The Visual Computer
- CMDAF: Cross-Modality Dual-Attention Fusion Network for Multimodal Sentiment AnalysisWang Guo, Kun Su, Bin Jiang, Kang Xie, Jie Liu · 2024 · Applied Sciences
- MulDeF: A Model-Agnostic Debiasing Framework for Robust Multimodal Sentiment AnalysisRuohong Huan, Guowei Zhong, Peng Chen, Ronghua Liang · 2024 · IEEE Transactions on Multimedia
- Privacy-Preserving Multimodal Sentiment AnalysisHonghui Xu, Wei Li, Daniel Takabi, Daehee Seo, Zhipeng Cai · 2025 · IEEE Internet of Things Journal
- Multi-level Conflict-Aware Network for Multi-modal Sentiment AnalysisYubo Gao, Haotian Wu, Lei Zhang · 2025 · IEEE International Conference on Acoustics Speech and Signal Processing
- MOTIF: A text-aware and disentangled Mamba-based architecture for multimodal sentiment analysisBohan Hu, Yuhang Li · 2025 · Knowledge-Based Systems
- Beyond Emotion Recognition: A Multi-Turn Multimodal Emotion Understanding and Reasoning BenchmarkJinpeng Hu, Hongchang Shi, Chongyuan Dai, Zhuo Li, Peipei Song, Meng Wang · 2025 · ACM International Conference on Multimedia (ACM MM)
- Robust Multimodal Sentiment Analysis Based on Adaptive Information Distillation and Adversarial LearningNing Sun, Weiliang Zhang, Wenming Zheng, Jixin Liu, Lei Chai, Cong Wu · 2025 · IEEE Transactions on Affective Computing
- MMP: Towards Robust Multi-Modal Learning with Masked Modality ProjectionNiki Nezakati, Md Kaykobad Reza, Ameya D. Patil, Mashhour Solh, M. Salman Asif · 2025 · IEEE International Conference on Big Data (BigData)
- Circular Decomposition and Cross-Modal Recombination for Multimodal Sentiment AnalysisHaijian Liang, Weicheng Xie, Xilin He, Siyang Song, Linlin Shen · 2024 · IEEE International Conference on Acoustics Speech and Signal Processing
- Multi-task learning and mutual information maximization with crossmodal transformer for multimodal sentiment analysisShi Yang, Jinglang Cai, Lei Liao · 2024 · Journal of Intelligent Information Systems
- Learning modality-fused representation based on transformer for emotion analysisPiao Shi, Min Qiang Hu, Fuji Ren, Xuefeng Shi, Liangfeng Xu · 2022 · Journal of Electronic Imaging
- Multi-modal Multi-view Clustering based on Non-negative Matrix FactorizationYassèr Khalafaoui, Nistor Grozavu, Basarab Mateï, Laurent-Walter Goix · 2022 · IEEE Symposium Series on Computational Intelligence (SSCI)
- [Retracted] Semantic Analysis of Multimodal Sports Video Based on the Support Vector Machine and Mobile Edge ComputingXu Chen · 2022 · Wireless Communications and Mobile Computing · Retracted
- Querying Depression VlogsJoana Correia, Bhiksha Raj, Isabel M. Trancoso · 2018 · IEEE Spoken Language Technology Workshop (SLT)
- MECG: modality-enhanced convolutional graph for unbalanced multimodal representationsJiajia Tang, Binbin Ni, Yutao Yang, Yu Ding, Wanzeng Kong · 2024 · The Journal of Supercomputing
- A method for multimodal sentiment analysis: adaptive interaction and multi-scale fusionHailong Wang, Jiaxin Cao, Jinjin Liu, Jie Song · 2025 · Journal of Intelligent Information Systems
- Multimodal Emotion Fusion Mechanism and Empathetic Responses in Companion RobotsXiaofeng Liu, Qincheng Lv, Jie Li, Siyang Song, Angelo Cangelosi · 2024 · IEEE Transactions on Cognitive and Developmental Systems
- CSMF-SPC: Multimodal Sentiment Analysis Model with Effective Context Semantic Modality Fusion and Sentiment Polarity CorrectionYuqiang Li, Wenxuan Weng, Chun Liu, Li Lin · 2024 · Pattern Analysis and Applications
- Crossmodal ASR Error Correction With Discrete Speech UnitsYuanchao Li, Pinzhen Chen, Peter Bell, Catherine Lai · 2024 · IEEE Spoken Language Technology Workshop (SLT)
- Manifold knowledge-guided feature fusion network for multimodal sentiment analysisXingang Wang, Mengyi Wang, Hai Ning Cui, Yijia Zhang · 2025 · Expert Systems with Applications
- IITR CodeBusters at SemEval-2022 Task 5: Misogyny Identification using TransformersGagan Sharma, Gajanan Sunil Gitte, Shlok Goyal, Raksha Sharma · 2022 · International Workshop on Semantic Evaluation (SemEval)
- Causal Narrative Comprehension: A New Perspective for Emotion Cause ExtractionWei Cao, Kun Zhang, Shulan Ruan, Hanqing Tao, Sirui Zhao, Hao Wang, Qi Liu, Enhong Chen · 2022 · IEEE Transactions on Affective Computing
- SentDep: Pioneering Fusion-Centric Multimodal Sentiment Analysis for Unprecedented Performance and InsightsChong Lu, Xufeng Fu · 2024 · IEEE Access
- Learning Modality Consistency and Difference Information with Multitask Learning for Multimodal Sentiment AnalysisCheng Fang, Feifei Liang, Tianchi Li, Fangheng Guan · 2024 · Future Internet
- Multimodel Sentiment Analysis with Self-attentionRunqing Cao, Chunyang Ye, Hui Zhou · 2020 · Advances in intelligent systems and computing
- Automatic Annotation of Corpora For Emotion Recognition Through Facial Expressions AnalysisClaudia Diamantini, Alex Mircoli, Domenico Potena, Emanuele Storti · 2021 · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition
- Multi-Feature Intelligent Oral English Error Correction Based on Few-Shot Learning TechnologyFengxiang Zhang, Jieli Sun · 2022 · Computational Intelligence and Neuroscience
- Handling negative mentions on social media channels using deep learningKhuong Vo, Tri‐Hai Nguyen, Dang Pham, Mao Nguyen, Minh Truong, Dinh Nguyen, Tho Quan · 2019 · Journal of Information and Telecommunication