Multimodal Sentiment Intensity Analysis in Videos: Facial Gestures and Verbal Messages

A tutorial on support vector regression

Smola, A. J., & Schölkopf, B. (2004) · Statistics and Computing · doi:10.1023/b:stco.0000035301.49549.88 · Cited by 13,482 · see citing works

Recursive Deep Models for Semantic Compositionality Over a Sentiment Treebank

Socher, R., Perelygin, A., Wu, J., Chuang, J., Manning, C. D., Ng, A., & Potts, C. (2013) · Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d13-1170 · Cited by 6,878 · see citing works

Praat, a system for doing phonetics by computer

Boersma, P. (2002) · UvA-DARE (University of Amsterdam) · Cited by 4,417 · see citing works

Lexicon-based methods for sentiment analysis

Taboada, M., Brooke, J., Tofiloski, M., Voll, K., & Stede, M. (2011) · Computational Linguistics · doi:10.1162/coli_a_00049 · Cited by 3,301 · see citing works

Annotating Expressions of Opinions and Emotions in Language

Wiebe, J., Wilson, T., & Cardie, C. (2005) · Computers and the Humanities · doi:10.1007/s10579-005-7880-9 · Cited by 1,763 · see citing works

Affective Computing and Sentiment Analysis

Cambria, E. (2016) · IEEE Intelligent Systems · doi:10.1109/mis.2016.31 · Cited by 1,445 · see citing works

Language and Gesture

(2000) · Cambridge University Press eBooks · doi:10.1017/cbo9780511620850 · Cited by 969 · see citing works

Speaker identification on the SCOTUS corpus

Yuan, J., & Liberman, M. (2008) · The Journal of the Acoustical Society of America · doi:10.1121/1.2935783 · Cited by 600 · see citing works

Deep Convolutional Neural Network Textual Features and Multiple Kernel Learning for Utterance-level Multimodal Sentiment Analysis

Poria, S., Cambria, E., & Gelbukh, A. F. (2015) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d15-1303 · Cited by 553 · see citing works

Fusing audio, visual and textual clues for sentiment analysis from multimodal content

Poria, S., Cambria, E., Howard, N., Huang, G.-B., & Hussain, A. (2016) · Neurocomputing · doi:10.1016/j.neucom.2015.01.095 · Cited by 534 · see citing works

Dependency Tree-based Sentiment Classification using CRFs with Hidden Variables

Nakagawa, T., Inui, K., & Kurohashi, S. (2011) · Cited by 332 · see citing works

Multimodal Sentiment Analysis of Spanish Online Videos

Rosas, V. P., Mihalcea, R. F., & Morency, L. (2013) · IEEE Intelligent Systems · doi:10.1109/mis.2013.9 · Cited by 228 · see citing works

Extracting Opinion Expressions with semi-Markov Conditional Random Fields

Yang, B., & Cardie, C. (2012) · Cited by 139 · see citing works

Recent Trends in Deep Learning Based Natural Language Processing [Review Article]

Young, T., Hazarika, D., Poria, S., & Cambria, E. (2018) · IEEE Computational Intelligence Magazine · doi:10.1109/mci.2018.2840738 · Cited by 2,921 · see citing works

Multimodal Transformer for Unaligned Multimodal Language Sequences

Tsai, Y.-H. H., Bai, S., Liang, P. P., Kolter, J. Z., Morency, L.-P., & Salakhutdinov, R. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1656 · Cited by 2,259 · see citing works

Tensor Fusion Network for Multimodal Sentiment Analysis

Zadeh, A., Chen, M., Poria, S., Cambria, E., & Morency, L.-P. (2017) · Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d17-1115 · Cited by 2,102 · see citing works

Multimodal Language Analysis in the Wild: CMU-MOSEI Dataset and Interpretable Dynamic Fusion Graph

Bagher Zadeh, A., Liang, P. P., Poria, S., Cambria, E., & Morency, L.-P. (2018) · Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p18-1208 · Cited by 1,433 · see citing works

MELD: A Multimodal Multi-Party Dataset for Emotion Recognition in Conversations

Poria, S., Hazarika, D., Majumder, N., Naik, G., Cambria, E., & Mihalcea, R. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1050 · Cited by 1,416 · see citing works

Recent Trends in Deep Learning Based Natural Language ProcessingPreprint

Young, T., Hazarika, D., Poria, S., & Cambria, E. (2017) · IEEE Computational Intelligence Magazine · doi:10.48550/arxiv.1708.02709 · Cited by 3,133 · see citing works

Efficient Low-rank Multimodal Fusion With Modality-Specific Factors

Liu, Z., Shen, Y., Lakshminarasimhan, V. B., Liang, P. P., Bagher Zadeh, A., & Morency, L.-P. (2018) · Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p18-1209 · Cited by 1,170 · see citing works

MISA: Modality-Invariant and -Specific Representations for Multimodal Sentiment Analysis

Hazarika, D., Zimmermann, R., & Poria, S. (2020) · Proceedings of the 28th ACM International Conference on Multimedia · doi:10.1145/3394171.3413678 · Cited by 1,073 · see citing works

Context-Dependent Sentiment Analysis in User-Generated Videos

Poria, S., Cambria, E., Hazarika, D., Majumder, N., Zadeh, A., & Morency, L.-P. (2017) · Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p17-1081 · Cited by 939 · see citing works

Memory Fusion Network for Multi-view Sequential Learning

Zadeh, A., Liang, P. P., Mazumder, N., Poria, S., Cambria, E., & Morency, L.-P. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.12021 · Cited by 855 · see citing works

Convolutional MKL Based Multimodal Emotion Recognition and Sentiment Analysis

Poria, S., Chaturvedi, I., Cambria, E., & Hussain, A. (2016) · Proceedings · doi:10.1109/icdm.2016.0055 · Cited by 624 · see citing works

Multi-attention Recurrent Network for Human Communication Comprehension

Zadeh, A., Liang, P. P., Poria, S., Vij, P., Cambria, E., & Morency, L. (2018) · AAAI Publications (The Association for the Advancement of Artificial Intelligence (AAAI)) · doi:10.1609/aaai.v32i1.12024 · Cited by 535 · see citing works

Improving Multimodal Fusion with Hierarchical Mutual Information Maximization for Multimodal Sentiment Analysis

Han, W., Chen, H., & Poria, S. (2021) · Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2021.emnlp-main.723 · Cited by 570 · see citing works

Words Can Shift: Dynamically Adjusting Word Representations Using Nonverbal Behaviors

Wang, Y., Shen, Y., Liu, Z., Liang, P. P., Zadeh, A., & Morency, L. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33017216 · Cited by 493 · see citing works

Dawn of the Transformer Era in Speech Emotion Recognition: Closing the Valence Gap

Wagner, J., Triantafyllopoulos, A., Wierstorf, H., Schmitt, M., Burkhardt, F., Eyben, F., & Schuller, B. W. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3263585 · Cited by 424 · see citing works

Multimodal sentiment analysis using hierarchical fusion with context modeling

Majumder, N., Hazarika, D., Gelbukh, A. F., Cambria, E., & Poria, S. (2018) · Knowledge-Based Systems · doi:10.1016/j.knosys.2018.07.041 · Cited by 385 · see citing works

Multimodal sentiment analysis with word-level fusion and reinforcement learning

Chen, M., Wang, S., Liang, P. P., Baltrušaitis, T., Zadeh, A., & Morency, L.-P. (2017) · Proceedings of the 19th ACM International Conference on Multimodal Interaction · doi:10.1145/3136755.3136801 · Cited by 334 · see citing works

Beneath the Tip of the Iceberg: Current Challenges and New Directions in Sentiment Analysis Research

Poria, S., Hazarika, D., Majumder, N., & Mihalcea, R. F. (2020) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2020.3038167 · Cited by 344 · see citing works

A Deeper Look into Sarcastic Tweets Using Deep Convolutional Neural NetworksPreprint

Poria, S., Cambria, E., Hazarika, D., & Vij, P. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1610.08815 · Cited by 368 · see citing works

Hybrid Contrastive Learning of Tri-Modal Representation for Multimodal Sentiment Analysis

Mai, S., Zeng, Y., Zheng, S., & Hu, H. (2022) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2022.3172360 · Cited by 301 · see citing works

Disentangled Representation Learning for Multimodal Emotion Recognition

Yang, D., Huang, S., Kuang, H., Du, Y., & Zhang, L. (2022) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3503161.3547754 · Cited by 273 · see citing works

UniMSE: Towards Unified Multimodal Sentiment Analysis and Emotion Recognition

Hu, G., Lin, T.-E., Zhao, Y., Lu, G., Wu, Y., & Li, Y. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.534 · Cited by 304 · see citing works

Efficient Multimodal Transformer With Dual-Level Feature Restoration for Robust Multimodal Sentiment Analysis

Sun, L., Lian, Z., Liu, B., & Tao, J. (2023) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2023.3274829 · Cited by 283 · see citing works

Bi-Bimodal Modality Fusion for Correlation-Controlled Multimodal Sentiment Analysis

Han, W., Chen, H., Gelbukh, A. F., Zadeh, A., Morency, L., & Poria, S. (2021) · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · doi:10.1145/3462244.3479919 · Cited by 261 · see citing works

Deep learning-based multimodal emotion recognition from audio, visual, and text modalities: A systematic review of recent advancements and future prospects

Zhang, S., Yang, Y., Chen, C., Zhang, X., Leng, Q., & Zhao, X. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.121692 · Cited by 273 · see citing works

Multimodal Sentiment Analysis: Addressing Key Issues and Setting Up the Baselines

Poria, S., Majumder, N., Hazarika, D., Cambria, E., Gelbukh, A. F., & Hussain, A. (2018) · IEEE Intelligent Systems · doi:10.1109/mis.2018.2882362 · Cited by 254 · see citing works

Modality to Modality Translation: An Adversarial Representation Learning and Graph Fusion Network for Multimodal Fusion

Mai, S., Hu, H., & Xing, S. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i01.5347 · Cited by 237 · see citing works

BiERU: Bidirectional emotional recurrent unit for conversational sentiment analysis

Li, W., Shao, W., Ji, S., & Cambria, E. (2021) · Neurocomputing · doi:10.1016/j.neucom.2021.09.057 · Cited by 237 · see citing works

Multi-task Learning for Multi-modal Emotion Recognition and Sentiment Analysis

Akhtar, M. S., Chauhan, D. S., Ghosal, D., Poria, S., Ekbal, A., & Bhattacharyya, P. (2019) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n19-1034 · Cited by 233 · see citing works

Multimodal Language Analysis with Recurrent Multistage Fusion

Liang, P. P., Liu, Z., Bagher Zadeh, A., & Morency, L.-P. (2018) · Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d18-1014 · Cited by 230 · see citing works

Decoupled Multimodal Distilling for Emotion Recognition

Li, Y., Wang, Y., & Cui, Z. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.00641 · Cited by 249 · see citing works

Progressive Modality Reinforcement for Human Multimodal Emotion Recognition from Unaligned Multimodal Sequences

Lv, F., Chen, X., Huang, Y., Duan, L., & Lin, G. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00258 · Cited by 221 · see citing works

Multi-level Multiple Attentions for Contextual Multimodal Sentiment Analysis

Poria, S., Cambria, E., Hazarika, D., Mazumder, N., Zadeh, A., & Morency, L. (2017) · Proceedings · doi:10.1109/icdm.2017.134 · Cited by 215 · see citing works

Learning Language-guided Adaptive Hyper-modality Representation for Multimodal Sentiment Analysis

Zhang, H., Wang, Y., Yin, G., Liu, K., Liu, Y., & Yu, T. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.49 · Cited by 213 · see citing works

Ensemble application of convolutional neural networks and multiple kernel learning for multimodal sentiment analysis

Poria, S., Peng, H., Hussain, A., Howard, N., & Cambria, E. (2017) · Neurocomputing · doi:10.1016/j.neucom.2016.09.117 · Cited by 214 · see citing works

Convolutional Experts Constrained Local Model for 3D Facial Landmark Detection

Zadeh, A., Lim, Y. C., Baltrušaitis, T., & Morency, L. (2017) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2017.296 · Cited by 211 · see citing works

Cross-Subject Multimodal Emotion Recognition Based on Hybrid Fusion

Çimtay, Y., Ekmekcioǧlu, E., & Özhan, Ş. Ç. (2020) · IEEE Access · doi:10.1109/access.2020.3023871 · Cited by 202 · see citing works

Contextual Inter-modal Attention for Multi-modal Sentiment Analysis

Ghosal, D., Akhtar, M. S., Chauhan, D. S., Poria, S., Ekbal, A., & Bhattacharyya, P. (2018) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d18-1382 · Cited by 196 · see citing works

ConFEDE: Contrastive Feature Decomposition for Multimodal Sentiment Analysis

Yang, J., Yu, Y., Niu, D., Guo, W., & Xu, Y. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.421 · Cited by 189 · see citing works

CubeMLP: An MLP-based Model for Multimodal Sentiment Analysis and Depression Estimation

Sun, H., Wang, H., Liu, J., Chen, Y., & Lin, L. (2022) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3503161.3548025 · Cited by 176 · see citing works

Multimodal Information Bottleneck: Learning Minimal Sufficient Unimodal and Multimodal Representations

Mai, S., Zeng, Y., & Hu, H. (2023) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2022.3171679 · Cited by 182 · see citing works

GCNet: Graph Completion Network for Incomplete Multimodal Learning in Conversation

Lian, Z., Chen, L., Sun, L., Liu, B., & Tao, J. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3234553 · Cited by 165 · see citing works

TMBL: Transformer-based multimodal binding learning model for multimodal sentiment analysis

Huang, J., Zhou, J. W., Tang, Z., Lin, J., & Chen, C. Y. (2023) · Knowledge-Based Systems · doi:10.1016/j.knosys.2023.111346 · Cited by 162 · see citing works

Affect-LM: A Neural Language Model for Customizable Affective Text Generation

Ghosh, S., Chollet, M., Laksana, E., Morency, L., & Scherer, S. J. (2017) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p17-1059 · Cited by 161 · see citing works

MISA: Modality-Invariant and -Specific Representations for Multimodal Sentiment AnalysisPreprint

Hazarika, D., Zimmermann, R., & Poria, S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2005.03545 · Cited by 154 · see citing works

Divide, Conquer and Combine: Hierarchical Feature Fusion Network with Local and Global Perspectives for Multimodal Affective Computing

Mai, S., Hu, H., & Xing, S. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1046 · Cited by 153 · see citing works

Modality translation-based multimodal sentiment analysis under uncertain missing modalities

Liu, Z., Zhou, B., Chu, D., Sun, Y., & Meng, L. (2023) · Information Fusion · doi:10.1016/j.inffus.2023.101973 · Cited by 141 · see citing works

Survey on AI-Based Multimodal Methods for Emotion Detection

Marechal, C., Mikołajewski, D., Tyburek, K., Prokopowicz, P., Bougueroua, L., Ancourt, C., & Węgrzyn-Wolska, K. (2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-16272-6_11 · Cited by 137 · see citing works

Recognizing Emotions in Video Using Multimodal DNN Feature Fusion

Williams, J., Kleinegesse, S., Comanescu, R., & Radu, O. (2018) · Proceedings of Grand Challenge and Workshop on Human Multimodal Language (Challenge-HML) · doi:10.18653/v1/w18-3302 · Cited by 132 · see citing works

CM-BERT

Yang, K., Xu, H., & Gao, K. (2020) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3394171.3413690 · Cited by 132 · see citing works

Multilogue-Net: A Context-Aware RNN for Multi-modal Emotion Detection and Sentiment Analysis in Conversation

Shenoy, A., & Sardana, A. (2020) · doi:10.18653/v1/2020.challengehml-1.3 · Cited by 124 · see citing works

A client-server based recognition system: Non-contact single/multiple emotional and behavioral state assessment methods

Zhu, X.-X., Liu, Z., Cambria, E., Yu, X.-H., Fan, X., Chen, H., & Wang, R. (2024) · Comput. Methods Programs Biomed. · doi:10.1016/j.cmpb.2024.108564 · Cited by 128 · see citing works

Dual Memory Neural Computer for Asynchronous Two-view Sequential Learning

Lê, H., Tran, T., & Venkatesh, S. (2018) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3219819.3219981 · Cited by 121 · see citing works

Multitask Representation Learning for Multimodal Estimation of Depression Level

Qureshi, S. A., Saha, S., Hasanuzzaman, M., & Dias, G. H. (2019) · IEEE Intelligent Systems · doi:10.1109/mis.2019.2925204 · Cited by 112 · see citing works

Distribution-Consistent Modal Recovering for Incomplete Multimodal Learning

Wang, Y., Cui, Z., & Li, Y. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.02013 · Cited by 111 · see citing works

A survey of multimodal deep generative models

Suzuki, M., & Matsuo, Y. (2022) · Advanced Robotics · doi:10.1080/01691864.2022.2035253 · Cited by 109 · see citing works

MTAG: Modal-Temporal Attention Graph for Unaligned Human Multimodal Language Sequences

Yang, J., Wang, Y., Yi, R., Zhu, Y., Rehman, A., Zadeh, A., Poria, S., & Morency, L. (2021) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2021.naacl-main.79 · Cited by 104 · see citing works

Context-aware Interactive Attention for Multi-modal Sentiment and Emotion Analysis

Chauhan, D. S., Akhtar, M. S., Ekbal, A., & Bhattacharyya, P. (2019) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d19-1566 · Cited by 97 · see citing works

Sentiment analysis in textual, visual and multimodal inputs using recurrent neural networks

Tembhurne, J. V., & Diwan, T. (2020) · Multimedia Tools and Applications · doi:10.1007/s11042-020-10037-x · Cited by 98 · see citing works

Social-IQ: A Question Answering Benchmark for Artificial Social Intelligence

Zadeh, A., Chan, M., Liang, P. P., Tong, E., & Morency, L. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00901 · Cited by 98 · see citing works

A Deep Multi-level Attentive Network for Multimodal Sentiment Analysis

Yadav, A., & Vishwakarma, D. K. (2022) · ACM Transactions on Multimedia Computing Communications and Applications · doi:10.1145/3517139 · Cited by 96 · see citing works

M-SENA: An Integrated Platform for Multimodal Sentiment Analysis

Mao, H., Yuan, Z., Xu, H., Yu, W., Liu, Y., & Gao, K. (2022) · Annual Meeting of the Association for Computational Linguistics: System Demonstrations (ACL Demo) · doi:10.18653/v1/2022.acl-demo.20 · Cited by 108 · see citing works

SKEAFN: Sentiment Knowledge Enhanced Attention Fusion Network for multimodal sentiment analysis

Zhu, C., Chen, M., Zhang, S., Sun, C., Liang, H., Liu, Y., & Chen, J. (2023) · Information Fusion · doi:10.1016/j.inffus.2023.101958 · Cited by 93 · see citing works

A Survey of Cutting-edge Multimodal Sentiment Analysis

Singh, U., Abhishek, K., & Azad, H. K. (2024) · ACM Computing Surveys · doi:10.1145/3652149 · Cited by 99 · see citing works

Contrastive Learning Based Modality-Invariant Feature Acquisition for Robust Multimodal Emotion Recognition With Missing Modalities

Liu, R., Zuo, H., Lian, Z., Schuller, B. W., & Li, H. (2024) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2024.3378570 · Cited by 96 · see citing works

Locally Confined Modality Fusion Network With a Global Perspective for Multimodal Human Affective Computing

Mai, S., Xing, S., & Hu, H. (2020) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2019.2925966 · Cited by 89 · see citing works

What makes the difference? An empirical comparison of fusion strategies for multimodal language analysis

Gkoumas, D., Li, Q., Lioma, C., Yu, Y., & Song, D. (2020) · Information Fusion · doi:10.1016/j.inffus.2020.09.005 · Cited by 94 · see citing works

Read, Listen, and See: Leveraging Multimodal Information Helps Chinese Spell Checking

Xu, H.-D., Li, Z., Zhou, Q. S., Li, C., Wang, Z., Cao, Y., Huang, H., & Mao, X.-L. (2021) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2021.findings-acl.64 · Cited by 97 · see citing works

SMIN: Semi-Supervised Multi-Modal Interaction Network for Conversational Emotion Recognition

Lian, Z., Liu, B., & Tao, J. (2022) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2022.3141237 · Cited by 89 · see citing works

Analyzing Multimodal Sentiment Via Acoustic- and Visual-LSTM With Channel-Aware Temporal Convolution Network

Mai, S., Xing, S., & Hu, H. (2021) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2021.3068598 · Cited by 89 · see citing works

Multimodal Emotion Recognition Fusion Analysis Adapting BERT With Heterogeneous Feature Unification

Lee, S., Han, D. K., & Ko, H. (2021) · IEEE Access · doi:10.1109/access.2021.3092735 · Cited by 91 · see citing works

BAFN: Bi-Direction Attention Based Fusion Network for Multimodal Sentiment Analysis

Tang, J., Liu, D., Jin, X., Peng, Y. K., Zhao, Q., Ding, Y., & Kong, W. (2022) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2022.3218018 · Cited by 90 · see citing works

TeFNA: Text-centered fusion network with crossmodal attention for multimodal sentiment analysis

Huang, C., Zhang, J., Wu, X., Wang, Y., Li, M., & Huang, X. (2023) · Knowledge-Based Systems · doi:10.1016/j.knosys.2023.110502 · Cited by 89 · see citing works

Adapted Dynamic Memory Network for Emotion Recognition in Conversation

Xing, S., Mai, S., & Hu, H. (2020) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2020.3005660 · Cited by 87 · see citing works

Benchmarking Multimodal Sentiment Analysis

Cambria, E., Hazarika, D., Poria, S., Hussain, A., & Subramanyam, R. B. V. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-77116-8_13 · Cited by 90 · see citing works

Tag-assisted Multimodal Sentiment Analysis under Uncertain Missing Modalities

Zeng, J., Liu, T., & Zhou, J. (2022) · Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval · doi:10.1145/3477495.3532064 · Cited by 94 · see citing works

What You Say and How You Say It Matters: Predicting Stock Volatility Using Verbal and Vocal Cues

Qin, Y. W., & Yang, Y. (2019) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p19-1038 · Cited by 89 · see citing works

Attention is not Enough: Mitigating the Distribution Discrepancy in Asynchronous Multimodal Sequence Fusion

Liang, T., Lin, G., Feng, L., Zhang, Y., & Lv, F. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00804 · Cited by 93 · see citing works

Untitled work

(2019) · neural information processing systems · Cited by 83 · see citing works

Multimodal Sentiment Analysis

Kaur, R., & Kautish, S. (2022) · IGI Global eBooks · doi:10.4018/978-1-6684-6303-1.ch098 · Cited by 84 · see citing works

PS-Mixer: A Polar-Vector and Strength-Vector Mixer Model for Multimodal Sentiment Analysis

Lin, H., Zhang, P., Ling, J., Yang, Z., Lee, L., & Liu, W. (2022) · Information Processing & Management · doi:10.1016/j.ipm.2022.103229 · Cited by 84 · see citing works

UniViLM: A Unified Video and Language Pre-Training Model for Multimodal Understanding and Generation.Preprint

Luo, H., Ji, L., Shi, B., Huang, H., Duan, N., Li, T., Chen, X., & Zhou, M. (2020) · arXiv (Cornell University) · Cited by 82 · see citing works

Disentanglement Translation Network for multimodal sentiment analysis

Zeng, Y., Yan, W., Mai, S., & Hu, H. (2023) · Information Fusion · doi:10.1016/j.inffus.2023.102031 · Cited by 84 · see citing works

Efficient Low-rank Multimodal Fusion with Modality-Specific FactorsPreprint

Liu, Z., Shen, Y., Lakshminarasimhan, V., Liang, P. P., Zadeh, A., & Morency, L. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1806.00064 · Cited by 80 · see citing works

Multimodal sentiment analysis based on multi-head attention mechanism

Chen, X., Lu, G., & Yan, J. (2020) · International Conference on Machine Learning and Soft Computing (ICMLSC) · doi:10.1145/3380688.3380693 · Cited by 78 · see citing works

Low Rank Fusion based Transformers for Multimodal Sequences

Sahay, S., Okur, E., Kumar, S. H., & Nachman, L. (2020) · doi:10.18653/v1/2020.challengehml-1.4 · Cited by 79 · see citing works

Noise Imitation Based Adversarial Training for Robust Multimodal Sentiment Analysis

Yuan, Z., Liu, Y., Xu, H., & Gao, K. (2023) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2023.3267882 · Cited by 78 · see citing works

Contrastive Multimodal Fusion with TupleInfoNCE

Liu, Y., Fan, Q., Zhang, S., Dong, H., Funkhouser, T. A., & Yi, L. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00079 · Cited by 77 · see citing works

Seq2Seq2Sentiment: Multimodal Sequence to Sequence Models for Sentiment Analysis

Pham, H., Manzini, T., Liang, P. P., & Póczos, B. (2018) · doi:10.18653/v1/w18-3308 · Cited by 76 · see citing works

TensorFormer: A Tensor-Based Multimodal Transformer for Multimodal Sentiment Analysis and Depression Detection

Sun, H., Chen, Y., & Lin, L. (2022) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2022.3233070 · Cited by 77 · see citing works

Multi-Level Contrastive Learning: Hierarchical Alleviation of Heterogeneity in Multimodal Sentiment Analysis

Fan, C., Zhu, K., Tao, J., Yi, G., Xue, J., & Lv, Z. (2024) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2024.3423671 · Cited by 79 · see citing works

Multimodal Sentiment Analysis

Kaur, R., & Kautish, S. (2019) · International Journal of Service Science Management Engineering and Technology · doi:10.4018/ijssmet.2019040103 · Cited by 73 · see citing works

Joyful: Joint Modality Fusion and Graph Contrastive Learning for Multimoda Emotion Recognition

Li, D., Wang, Y., Funakoshi, K., & Okumura, M. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.996 · Cited by 84 · see citing works

Convolutional Experts Constrained Local Model for Facial Landmark Detection

Zadeh, A., Baltrušaitis, T., & Morency, L. (2017) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2017.256 · Cited by 72 · see citing works

Towards Emotion-aided Multi-modal Dialogue Act Classification

Saha, T., Patra, A., Saha, S., & Bhattacharyya, P. (2020) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2020.acl-main.402 · Cited by 71 · see citing works

Counterfactual Reasoning for Out-of-distribution Multimodal Sentiment Analysis

Sun, T. F., Wang, W., Jing, L., Cui, Y., Song, X., & Nie, L. (2022) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3503161.3548211 · Cited by 70 · see citing works

AtCAF: Attention-based causality-aware fusion network for multimodal sentiment analysis

Huang, C., Chen, J., Huang, Q., Wang, S., Tu, Y., & Huang, X. (2024) · Information Fusion · doi:10.1016/j.inffus.2024.102725 · Cited by 70 · see citing works

Multi-Fusion Residual Memory Network for Multimodal Human Sentiment Comprehension

Mai, S., Hu, H., Jia, X., & Xing, S. (2020) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2020.3000510 · Cited by 66 · see citing works

Coordinated-joint translation fusion framework with sentiment-interactive graph convolutional networks for multimodal sentiment analysis

Lu, Q., Sun, X., Gao, Z., Long, Y., Feng, J., & Zhang, H. (2023) · Information Processing & Management · doi:10.1016/j.ipm.2023.103538 · Cited by 68 · see citing works

Learning Modality-Specific and -Agnostic Representations for Asynchronous Multimodal Language Sequences

Yang, D., Kuang, H., Huang, S., & Zhang, L. (2022) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3503161.3547755 · Cited by 67 · see citing works

Untitled work

(2013) · Cited by 236 · see citing works

MOSI: Multimodal Corpus of Sentiment Intensity and Subjectivity Analysis in Online Opinion Videos

Zadeh, A., Zellers, R., Pincus, E., & Morency, L.-P. (2016) · arXiv · doi:10.48550/arxiv.1606.06259 · Cited by 350 · see citing works

AMOSI:Attention-Based Multimodal Sentiment Intensity Analysis with LSTM-CNN Architecture for Online Opinion Videos

Sree, V. V. V. B., Mohan, G. B., Kumar, R. P., Rithani, M., & Pallavi, G. (2024) · International Conference on Computing, Communication and Networking Technologies (ICCCNT) · doi:10.1109/icccnt61001.2024.10725013 · Cited by 2 · see citing works

Multimodal Sentiment Analysis

Mihalcea, R. F. (2012) · Cited by 16 · see citing works

Multimodal Emotion Recognition and Fluctuation: A Study on Sentiment Analysis of Online Public Opinion

Sun, L. (2023) · Frontiers in Computing and Intelligent Systems · doi:10.54097/fcis.v3i1.6021 · Cited by 4 · see citing works