Multimodal Sentiment Intensity Analysis in Videos: Facial Gestures and Verbal Messages

Zadeh, Amir, Zellers, Rowan, Pincus, Eli, Morency, Louis-Philippe·2016·IEEE Intelligent Systems
DOI 10.1109/mis.2016.94

Cited by (852)

Items 601–700 of 852

  1. Multimodal Sentiment Analysis Based on Information Bottleneck and Attention Mechanisms
    Xiangrui Chen, Zhendong Wu, Yu Tang, Rong Dong Han · 2023 · International Conference on Cloud Computing, Big Data Application and Software Engineering (CBASE)
  2. MSA-HCL: Multimodal sentiment analysis model with hybrid contrastive learning
    Wang Zhao, Yong Zhang, Qiang Hua, Chun-Ru Dong, Jianan Wang, Feng Zhang · 2024 · Mathematical Foundations of Computing
  3. Attention Information Fusion Emotion Analysis Model Based on BiLSTM-BERT
    Zhiwei Cheng, Shunxin Li · 2024 · International Conference on Consumer Electronics and Computer Engineering (ICCECE)
  4. Multimodal sentiment analysis based on TCN and cross-modal interactive feedback network
    Guangbin Bao, Zhiming Shen, Chen Liu, Liangliang Sun, Shuang Chen · 2024 · International Conference on Computer Supported Cooperative Work in Design (CSCWD)
  5. Language Analysis of Science and Technology Textbook in Nepal: A Semiotic Perspective
    Dilu Ram Parajuli · 2024 · Gipan
  6. MCAF: Multi-Headed Causal Attention Fusion Approach for Multimodal Sentiment Analysis
    Qingao Wang, Xingang Wang, Jinxiao Yang, Yurun Bi · 2024 · International Joint Conference on Neural Networks (IJCNN)
  7. Multimodal Sentiment Analysis via Low-Rank Tensor Attention Network with Unimodal Self-Supervised Learning
    Linghui Sun, Chaoqun Zhao, Xudong Li, Chengjie Bai, Jie Pan · 2024 · International Joint Conference on Neural Networks (IJCNN)
  8. TMMM: Transformer in Multimodal Sentiment Analysis under Missing Modalities
    Huanyu Wu, Siyang Li, Dongrui Wu · 2024 · International Joint Conference on Neural Networks (IJCNN)
  9. ARIF: An Adaptive Attention-Based Cross-Modal Representation Integration Framework
    Chengzhi Liu, Zihong Luo, Yifei Bi, Zile Huang, Dong Shu, Jiheng Hou, Hongchen Wang, Kaiyu Liang · 2024 · Lecture notes in computer science
  10. Information Aggregate and Sentiment Enhance Network to Handle Missing Modalities for Multimodal Sentiment Analysis
    Liang Shi, Fuyong Xu, Ru Wang, Yongqing Wei, Guangjin Wang, Bao Wang, Peiyu Liu · 2024 · IEEE International Conference on Multimedia and Expo (ICME)
  11. The Application of Review of Facial Expression Recognition Technology in Smart Homes
    勉 周 · 2025 · Computer Science and Application
  12. A Multimodal, Multilabel Approach to Recognize Emotions in Oral History Interviews
    Anargh Viswanath, Michael Gref, Teena Hassan, Christoph Schmidt · 2024 · International Conference on Affective Computing and Intelligent Interaction and workshops
  13. Prototype-oriented multimodal emotion contrast-enhancer
    Qiyuan Zhang, Qimeng Yang, Shengwei Tian, Long Yu, Xin Fan, Jinmiao Song · 2025 · Computers & Electrical Engineering
  14. Shuffling Augmented Decoupled Features for Multimodal Emotion Recognition
    Sunyoung Cho · 2025 · IEEE Access
  15. ABAW7 Challenge: A Facial Affect Recognition Approach Based on Transformer Encoder and Multilayer Perceptron
    Xuxiong Liu, Kang Shen, Jun Yao, Boyan Wang, Yu Wang, Yujie Guan, Xin Liu, Gengchen Li, Liuwei An, Zishun Cui et al. · 2025 · Lecture notes in computer science
  16. SGMN: Self-Supervised Guidance for Modality-Specific Network in Multimodal Sentiment Analysis
    Baiyu Lu, Tianrui Li · 2025 · International Conference on Neural Networks, Information and Communication Engineering (NNICE)
  17. Contrastive learning with mirror-task for multimodal sentiment analysis
    Hang Shi, Lianmin Zhou, Yuan-Yuan Pu, Zheng-Peng Zhao, Jin-Jing Gu, Dan Xu · 2025 · Applied Soft Computing
  18. Unified-Modality Attention Network for Multimodal Sentiment Analysis
    Zuocheng Li, Lishuang Li · 2025 · IEEE International Conference on Multimedia and Expo (ICME)
  19. Novel framework for data transformation for yielding structured data in opinion mining
    P. K. Kumar, S. Nanadagopalan · 2017 · International Conference on Electrical, Electronics, Communication, Computer and Optimization Techniques (ICEECCOT)
  20. Contextual information usage for the enhancement of basic emotion classification in a weakly labelled social network dataset in Spanish
    Juan Pablo Tessore, Leonardo Esnaola, Hugo Dionisio Ramón, Laura Cristina Lanzarini, Sandra Baldassarri · 2022 · Multimedia Tools and Applications
  21. Memory and attention in deep learning
    Hung Lê · 2021 · arXiv (Cornell University)
  22. Deep Temporal Features and Multi-Level Cross-Modal Attention Fusion for Multimodal Sentiment Analysis
    Min Zhu · 2025 · Research Square
  23. Chat-Box: Proposing a Mood Analyzer for Individuals with Social Interaction Disabilities
    Bineeta Gupta, Michael Saxon, Troy L. McDaniel, Sethuraman Panchanathan · 2018 · Communications in computer and information science
  24. An Empirical Evaluation of Sketched SVD and its Application to Leverage Score Ordering
    Hui Han Chin, Paul Pu Liang · 2018 · arXiv (Cornell University)
  25. Current Situation of Multimodal Corpora and the Method of Tibetan Corpus Construction
    Guangyan Li, Tian Fang, Liang Li, Benwang Sun · 2018 · International Conference on Safety Produce Informatization (IICSPI)
  26. Modeling Spatiotemporal Multimodal Language with Recurrent Multistage Fusion
    Paul Pu Liang, Liu Ziyin, Amir Zadeh, Louis‐Philippe Morency · 2018
  27. Hybrid Feature-Based Sentiment Strength Detection for Big Data Applications
    Yanghui Rao, Haoran Xie, Fu Lee Wang, Leonard K. M. Poon, Endong Zhu · 2019 · Springer eBooks
  28. Hierarchical-Gate Multimodal Network for Human Communication Comprehension
    Qiyuan Liu, Liangqing Wu, Yang Xu, Dong Zhang, Shoushan Li, Guodong Zhou · 2019 · Lecture notes in computer science
  29. Predicting Video Affect via Induced Affection in the Wild
    Yi Ding, Radha Kumaran, Tianjiao Yang, Tobias Höllerer · 2020 · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION
  30. Sequential Late Fusion Technique for Multi-modal Sentiment Analysis
    Debapriya Banerjee, Fotios Lygerakis, Fillia S. Makedon · 2021 · arXiv (Cornell University)
  31. Attentive Intra-modality Fusion for Multimodal Sentiment Analysis
    Jianxun Ding, Yongqiang Zheng, Xia Li, Minping Chen, Junshan Huang · 2021 · Lecture notes in computer science
  32. Project Vāc: Can a Text-to-Speech Engine Generate Human Sentiments?
    Shivam Kulkarni, Luis Barbado, Jordan Hosier, Yu Tian Zhou, Siddharth Rajagopalan, Vijay K. Gurbani · 2021 · International Conference on Speech Technology and Human-Computer Dialogue (SpeD)
  33. MULTIMODALANALYSIS OF VIDEO WITH NEURAL NETWORKS
    A. Futane Vedant · 2022 · Indian Journal Of Applied Research
  34. Multi-Head Attention with Disagreement Regularization for Multimodal Sentiment Analysis
    Hao Ai, Ying Liu, Jie Fang · 2021 · 2021 4th International Conference on Artificial Intelligence and Pattern Recognition
  35. Sentiment analysis using Hierarchical Multimodal Fusion (HMF)
    Bishwo Prakash Pokharel, Roshan Koju · 2022 · World Journal of Advanced Research and Reviews
  36. SWOT Analysis of Behavioural Recognition Through Variable Modalities
    Abhilasha Sharma, Aakash Garg, Akshat Thapliyal, Abhishek Rajput · 2022 · Smart innovation, systems and technologies
  37. Mental State Assessment in College English Teaching Courses Based on Deep Learning
    JI Bei-bei · 2022 · Mathematical Problems in Engineering
  38. Demusa: Demo for Multimodal Sentiment Analysis
    Soyeon Hong, Jeong-Hoon Kim, Donghoon Lee, Hyunsouk Cho · 2022 · IEEE International Conference on Multimedia and Expo workshops
  39. A Residual Multi-Scale Convolutional Transformer Network with Chunk-level Log-Mel Spectrograms for Speech Emotion Recognition
    Tianhao Yan, Hao Meng, Emilia Parada‐Cabaleiro, Jianhua Tao, Björn Wolfgang Schuller · 2022
  40. A New Emotion Recognition Method based on Low-Rank Representation and Nonnegative Matrix Factorization
    Aimei Dong, Qiuyu Zheng, Guodong Zhang · 2022 · International Conference on Machine Learning, Control, and Robotics (MLCR)
  41. Multi-source Data Fusion Base on Block-Term Decomposition in Federated Learning
    Junjun Nie, Xinxin Feng, Lixia Xu, Haifeng Zheng · 2022 · IEEE International Conference on Computer and Communications (ICCC)
  42. Esuf: Extracting Sufficient Unimodal Feature with Mlp for Multimodal Sentiment Analysis
    Xianxin Ke, Qinghua Liu, Tao Xue · 2023 · SSRN Electronic Journal
  43. Multi-modal sentiment analysis based on graph neural network
    Boao Li · 2023 · Applied and Computational Engineering
  44. An adversarial training-based mutual information constraint method
    Renyuan Liu, Xuejie Zhang, Jin Wang, Xiaobing Zhou · 2023 · Applied Intelligence
  45. Cross-Modal Sentiment Analysis
    Hua Xu · 2023 · Springer eBooks
  46. Video-and-Language (VidL) models and their cognitive relevance
    Anne W. Zonneveld, Albert Gatt A, Iacer Calixto · 2023 · IEEE International Conference on Computer Vision Workshops
  47. The Confluence of Edge Computing and Artificial Neural Networks for Real-time Data Processing in IoT Devices
    Bhuvana Jayabalan, Chetan Chaudhary, Renuka Manish Bhagwat · 2023 · International Conference on System, Computation, Automation and Networking (ICSCAN)
  48. Adaptive Token Selection and Fusion Network for Multimodal Sentiment Analysis
    Xiang Li, Ming Lu, Ziming Guo, Xiaoming Zhang · 2024 · Lecture notes in computer science
  49. Deep Multimodal K-Fold Model for Emotion and Sentiment Analysis in Figurative Language
    Sudipta Bhattacharya, Samarjeet Borah, Brojo Kishore Mishra · 2024 · SSRN Electronic Journal
  50. SWACL: Sentimental Words Aware Contrastive Learning for Multimodal Sentiment Analysis
    Junbin Zhuang, Junyi He, Xia Li · 2023 · International Conference on Computing and Pattern Recognition (ICCPR)
  51. Research on Multimodal Chinese Spelling Correction Task with Integrated Contrastive Learning Strategies
    Guangming Pan, Jianyong Duan, Yuhang Jiang, Mei Zhang, Hao Wang, Li He · 2023 · International Conference on Digital Society and Intelligent Systems (DSInS)
  52. Multi-token Fusion Framework for Multimodal Sentiment Analysis
    Zhihui Long, Huan Deng, Zhenguo Yang, Wenyin Liu · 2024 · Lecture notes in computer science
  53. Part of speech weighted multi-modal emotion analysis model with dynamic adjustment of semantic representation
    Qiang Hua, Zhuo CHEN, Feng Zhang, Chun-Ru Dong · 2024 · JOURNAL OF SHENZHEN UNIVERSITY SCIENCE AND ENGINEERING
  54. Enhancing Multimodal Emotion Analysis through Fusion with EMT Model Based on BBFN
    Wenshuo Wang · 2024 · Transactions on Computer Science and Intelligent Systems Research
  55. WConF: Weighted Contrastive Fusion for Multimodal Sentiment Analysis
    Biqing Zeng, Ruiyuan Li, Liuxing Lu, Liangqi Xie, Jiazhen Wang, Weihai Chen, Huimin Deng · 2024 · Lecture notes in computer science
  56. Adaptive Both homo- and hetero-Feature Integration for Multimodal Emotion Recognition
    Ze Kun Wang, Zhan Jun · 2024 · ACM International Conference on Multimedia in Asia (MMAsia)
  57. MRIB: Robust Task-Oriented Communication for Multi-Device Scenarios
    Yue Cao, Ruihao Guo, Shuai Ma, Yuanming Shi, Feng Tian, Youlong Wu · 2024 · International Conference on Wireless Communications and Signal Processing (WCSP)
  58. Enhanced Multimodal Sentiment Analysis via Tensor Decomposition and Hypergraph Convolutional Networks
    Xinyin Zhang, Yonghua Zhao, Yang Liu, Dingye Zhang · 2024 · IEEE International Conference on Tools with Artificial Intelligence (ICTAI)
  59. Factorization-Based Information Reconstruction for Enhancing Missing Modality Robustness
    Chao Wang, Miaolei Zhou, Xiaofei Yu, Junchao Weng, Yong Zhang · 2025 · IEEE Signal Processing Letters
  60. Self-Supervised Text-Centric Sentiment Analysis via Sparse Cross-Modal Interactions
    Hongkun Zhou, Jin Liu, Xingye Li, Jiajia Jiao · 2024 · International Conference on Computer, Big Data and Artificial Intelligence (ICCBD+AI)
  61. FusionX: A Symbolic-fused Multimodal Emotion Interaction Framework
    Lars de Vries, L.-C. Hsu, Sofie Berg · 2025 · Preprints.org
  62. Word-Aware Modality Stimulation for Multimodal Fusion
    Shuhei Tateishi, Yasuhito Osugi, Makoto Nakatsuji · 2025 · Transactions of the Japanese Society for Artificial Intelligence
  63. Multi-Interaction Modeling with Intelligent Coordination for Multimodal Emotion Recognition
    Cambria Ellis, Wyne Nasir, Linden Porter · 2025 · Preprints.org
  64. Text Enhancement-Based Multimodal Fusion for Video Sentiment Analysis
    Junhao Luo, Yan Zhu, Yiqiang Peng · 2025 · Lecture notes in computer science
  65. QSMT: Query-Shared Multimodal Transformer for Multimodal Sentiment Analysis
    Huazhong Liu, Yuanhan Liu, Jihong Ding, Wenxuan Zhang · 2025 · Lecture notes in computer science
  66. Detecting Audio Deepfakes Through Emotional Fingerprinting
    Long Nguyen-Vu, Yowon Lee, Thien-Phuc Doan, Kihun Hong, Souhwan Jung · 2025 · Communications in computer and information science
  67. γ -CRD:Gamma-Cooperative Retrieval Diffusion Model for Robust Incomplete Multimodal Learning
    Ruiting Dai, Wenwei Zhu, Zheyu Wang, Haoran Meng, Zhengdao Yuan, Yandong Yan, Lisi Mo · 2025 · International Conference on Multimedia Retrieval
  68. LGCMNet: Multimodal Sentiment Analysis Network Based on Language-Guided Cross-Modal Interaction
    Yao Wang, Minghua Nuo, Yuan Zhang, Xiaoyu Jia · 2025 · Lecture notes in computer science
  69. Motif: A Text-Aware and Disentangled Mamba-Based Architecture for Multimodal Emotion Recognition
    Bohan Hu, Yuhang Li · 2025 · SSRN Electronic Journal
  70. A Global-Local Interactive Multimodal Sentiment Analysis Framework with Adaptive Attention and Multi-scale Feature Enhancement
    Lingling Zi, Houji Lv, Xin Cong · 2025 · Communications in computer and information science
  71. When Sentiment Analysis Faces Missing Modalities: A Specific and Invariant Feature Learning Approach
    Zhouwen Zhan, Dongtao Cao, Hongju Cheng · 2025 · International Conference on Neural Networks, Information and Communication Engineering (NNICE)
  72. LGFN: A Dynamic Gating Framework for Lyrics-Audio Alignment in Music Emotion Recognition
    Yinghui Wang, Mengqi Zang, Huasen Zhang, Xin Shan, Xinyue Wang · 2025 · bioRxiv (Cold Spring Harbor Laboratory)
  73. Multimodal emotion recognition in the wild: Corruption modeling and relevance-guided scoring
    Yoon Sun Lee, Sunyoung Cho · 2026 · Expert Systems with Applications
  74. Annotating aspects in text and image: A new task and dataset for multimodal aspect‐based sentiment analysis
    Li Yang, Yang Jia, Jin‐Cheon Na, Jianfei Yu · 2025 · Journal of the Association for Information Science and Technology
  75. MCFM: Multimodal Competitive Fusion Mechanism for Sentiment Analysis
    Mali Xing, Zilang Zhai, Muqing Deng, Qianqian Cai, Hongru Ren, Tian Wang · 2025 · IEEE Transactions on Computational Social Systems
  76. Emotional Earth Mover’s Distance for Fine-Grained Hierarchical Emotion Analysis
    Hai-Tao Yu, Dawei Li, Xin Kang · 2025 · Lecture notes in computer science
  77. ATD-AMSMamba: Improving Robustness of State Space Models for Multimodal Sentiment Analysis
    Yahong Li, Zhanxun Dong, Zhou Fang, Lai Li · 2025 · IEEE International Conference on Multimedia and Expo (ICME)
  78. Decoding Emotional Silences: Reliable Multimodal Sentiment Analysis with Bipolar Uncertainty
    Yutao Wei, Hongzhu Fu, Yuxiang Li, Yichen Xin, Xovee Xu, Fan Zhou, Ting Zhong · 2025 · IEEE International Conference on Multimedia and Expo (ICME)
  79. Temporal Invariant Feature Combined with Arbitrary Enhancement for Missing Modality Emotion Recognition
    Jiahao Fan, Weiting Chen, Zheming Fan, Ruizhi Yu · 2025 · IEEE International Conference on Multimedia and Expo (ICME)
  80. Feature Decoupling with Modality Modulation for Multimodal Sentiment Analysis
    Yongbo Wang, Jiaxiang Wang, Aihua Zheng, Wenjuan Cheng, Xiaofei Sheng · 2025 · Lecture notes in computer science
  81. DMBT Decoupled Multi-Modal Binding Transformer for Multimodal Sentiment Analysis
    Rui Guo, Gu Gong, Fan Jiang · 2025 · Electronics
  82. Disentangling consistent, complementary and modality-private information via twin information bottleneck for multi-modal clustering
    Mingyuan Li, Dongqing Liu, Chao Wang, Qianqian Ma, Yadong Dong · 2025 · Applied Soft Computing
  83. DGFN: Brain-Inspired Distributed Fusion for Robust Multimodal Sentiment Analysis
    Ningping Li, Ruibao Zhang, Xiangyu Zhou, Weichen Dai, Ji Qi, Yi Zhou · 2025 · Communications in computer and information science
  84. MAGI: Modality-Aligned Geometry-Aware Integration for Robust Multimodal Sentiment Analysis
    Bohan Hu, Yuhang Li · 2025 · Lecture notes in computer science
  85. Multi-channel Cross-modal Fusion With Contrastive Learning For Multimodal Sentiment Analysis
    Ding Zhang, Shaokang Zhang, Ning Ran, Liang Wang · 2025 · International Joint Conference on Neural Networks (IJCNN)
  86. Modality Modulation with Adaptive Fusion for Multimodal Sentiment Analysis
    Aihua Zheng, Yongbo Wang, Jiaxiang Wang, Xiaofei Sheng, Wenjuan Cheng · 2025 · International Joint Conference on Neural Networks (IJCNN)
  87. IBCL: Integrating Information Bottleneck and Multi-Level Contrastive Learning for Accurate Multimodal Sentiment Analysis
    Feifei Xu, Haoran Bi, Bo Li, Zixi Wu, Miaoyue Jiafu · 2025 · International Joint Conference on Neural Networks (IJCNN)
  88. Modality Modulation with Adaptive Fusion for Multimodal Sentiment Analysis
    Aihua Zheng, Yongbo Wang, Jiaxiang Wang, Xiaofei Sheng, Wenjuan Cheng · 2025 · International Joint Conference on Neural Networks (IJCNN)
  89. PMAAN: a priority-guided multi-scale adaptive attention network for multimodal sentiment analysis
    Fei Xu, Shuo An, Daipeng Guo, Xintong Zhang · 2025 · The Journal of Supercomputing
  90. DMBL: Dual-Stage Multimodal Balanced Learning for Multimodal Sentiment Analysis
    Yu-Chi Tang, Qian Chen, NanJie Zheng, Ning Luo · 2025 · Lecture notes in computer science
  91. MRF: A Modality-Resilient Framework for Handling Missing Modalities in Multimodal Learning
    Pengfei Du, Yongjun Huang, Xu Chang, Ruifan Li · 2025 · Lecture notes in computer science
  92. A Stitch in Time Saves Nine: Progressive Information Bottleneck for Incremental Multiview Clustering
    Xiaoqiang Yan, Fengshou Han, Yiqiao Mao, Zhen Tian, Witold Pedrycz, Hui Ling Yu · 2025 · IEEE Transactions on Computational Social Systems
  93. Multilevel Feature Fusion and Attention Enhancement for Multimodal Sentiment Analysis
    Lianjie Zhang, Tingnian He, Bojia Chen, Chen Shuan · 2025 · International Symposium on Computer and Information Processing Technology (ISCIPT)
  94. CDFN: Credibility-Driven Fusion Network for Multimodal Sentiment Analysis
    Chengyu Liu, Chengguang Liu, Xiqing Wei · 2025 · ACM International Conference on Multimedia in Asia (MMAsia)
  95. Dynamic Text-guided Multi-task Transformer for Multi-modal Sentiment Analysis
    W. Ronny Huang, Weihong Cai, Z. She · 2025 · ACM International Conference on Multimedia in Asia (MMAsia)
  96. Text-driven Noise Filtering and Affective Conflict Mitigation Network for Multimodal Sentiment Analysis
    Zezhong Chen, Hong Zhong, Naji Alhusaini, Guilin Chen · 2025 · International Conference on Networking and Network Applications (NaNA)
  97. Cross-Modal Explicit Invariance Coordinated Dual Constraint Reconstruction for Heterogeneous Incomplete Multimodal Sentiment Analysis
    Qi Shen, Junchang Xin, Bing Tian Dai, Zhihong Huang, Zhiqiong Wang · 2025 · IEEE Transactions on Multimedia
  98. BPFN: A Binding-guided Preferential Fusion Network with Distance-aware Contrastive Learning for Multimodal Sentiment Analysis
    Wei Liu, Chaoqun Zhang, HU Shun-shi, Jinlong Zhang · 2025 · International Conference on Intelligent Computing and Human-Computer Interaction (ICHCI)
  99. Multimodal Sentiment Analysis Based on Text Augmentation With Adaptive Gating and Hierarchical Fusion
    Jing Wang, Yan Jiang · 2025 · International Conference on Information Science, Computer Technology and Transportation (ISCTT)
  100. Multilingual Lie Detection via Emotion and Multimodal Cues
    Tao Guo, Changhe Xiao, Yiming Kan, Zhiang Zhang, Yaxin Zheng, Humaira Ashraf · 2025 · International Conference on Emerging Trends in Networks and Computer Communications (ETNCC)