MOSI: Multimodal Corpus of Sentiment Intensity and Subjectivity Analysis in Online Opinion Videos

A tutorial on support vector regression

Smola, A. J., & Schölkopf, B. (2004) · Statistics and Computing · doi:10.1023/b:stco.0000035301.49549.88 · Cited by 13,482 · see citing works

Praat: Doing Phonetics by Computer

(2011) · Ear and Hearing · doi:10.1097/aud.0b013e31821473f7 · Cited by 8,004 · see citing works

Mining and summarizing customer reviews

Hu, M., & Liu, B. (2004) · Proceedings of the tenth ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/1014052.1014073 · Cited by 7,793 · see citing works

A Sentimental Education: Sentiment Analysis Using Subjectivity Summarization Based on Minimum Cuts

Pang, B., & Lee, L. (2004) · Annual Meeting of the Association for Computational Linguistics · doi:10.3115/1218955.1218990 · Cited by 4,257 · see citing works

Thumbs Up or Thumbs Down? Semantic Orientation Applied to Unsupervised Classification of Reviews

Peter, P., & Turney (2002) · Cited by 3,646 · see citing works

Lexicon-based methods for sentiment analysis

Taboada, M., Brooke, J., Tofiloski, M., Voll, K., & Stede, M. (2011) · Computational Linguistics · doi:10.1162/coli_a_00049 · Cited by 3,301 · see citing works

Annotating Expressions of Opinions and Emotions in Language

Wiebe, J., Wilson, T., & Cardie, C. (2005) · Language Resources and Evaluation · doi:10.1007/s10579-005-7880-9 · Cited by 2,158 · see citing works

Recognizing action units for facial expression analysis

Tian, Y.-I., Kanade, T., & Cohn, J. F. (2001) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.908962 · Cited by 1,745 · see citing works

Predicting the semantic orientation of adjectives

Hatzivassiloglou, V., & McKeown, K. R. (1997) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.3115/979617.979640 · Cited by 822 · see citing works

COVAREP — A collaborative voice analysis repository for speech technologies

Degottex, G., Kane, J., Drugman, T., Raitio, T., & Scherer, S. (2014) · 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2014.6853739 · Cited by 695 · see citing works

Deep Convolutional Neural Network Textual Features and Multiple Kernel Learning for Utterance-level Multimodal Sentiment Analysis

Poria, S., Cambria, E., & Gelbukh, A. F. (2015) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d15-1303 · Cited by 553 · see citing works

A principal component analysis of facial expressions

Calder, A. J., Burton, A. M., Miller, P. C., Young, A. W., & Akamatsu, S. (2001) · Vision Research · doi:10.1016/s0042-6989(01)00002-5 · Cited by 471 · see citing works

Towards multimodal sentiment analysis: harvesting opinions from the web

Morency, L.-P., Mihalcea, R., & Doshi, P. (2011) · Proceedings of the 13th international conference on multimodal interfaces · doi:10.1145/2070481.2070509 · Cited by 470 · see citing works

Youtube movie reviews: Sentiment analysis in an audio-visual context

Wollmer, M., Weninger, F., Knaup, T., Schuller, B., Sun, C., Sagae, K., & Morency, L.-P. (2013) · IEEE Intelligent Systems · doi:10.1109/mis.2013.34 · Cited by 403 · see citing works

Learning Multilingual Subjective Language via Cross-Lingual Projections

Mihalcea, R. F., Banea, C., & Wiebe, J. (2007) · University of North Texas Digital Library (University of North Texas) · Cited by 395 · see citing works

Human expression recognition from motion using a radial basis function network architecture

Rosenblum, M., Yacoob, Y., & Davis, L. S. (1996) · IEEE Transactions on Neural Networks · doi:10.1109/72.536309 · Cited by 284 · see citing works

Multimodal Sentiment Analysis of Spanish Online Videos

Rosas, V. P., Mihalcea, R. F., & Morency, L. (2013) · IEEE Intelligent Systems · doi:10.1109/mis.2013.9 · Cited by 228 · see citing works

Emotion Recognition In The Wild Challenge 2014

Dhall, A., Goecke, R., Joshi, J., Sikka, K., & Gedeon, T. (2014) · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · doi:10.1145/2663204.2666275 · Cited by 216 · see citing works

Cross-Domain Co-Extraction of Sentiment and Topic Lexicons

Li, F., Pan, S. J., Jin, O., Yang, Q., & Zhu, X. (2012) · Cited by 175 · see citing works

Exploring Fusion Methods for Multimodal Emotion Recognition with Missing Data

Wagner, J., Andre, E., Lingenfelser, F., & Kim, J. (2011) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2011.12 · Cited by 156 · see citing works

Extracting Opinion Expressions with semi-Markov Conditional Random Fields

Yang, B., & Cardie, C. (2012) · Cited by 139 · see citing works

Why are they excited?

Balog, K., Mishne, G., & de Rijke, M. (2006) · doi:10.3115/1608974.1609010 · Cited by 115 · see citing works

Multimodal subjectivity analysis of multiparty conversation

Raaijmakers, S., Truong, K. P., & Wilson, T. (2008) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/1613715.1613774 · Cited by 104 · see citing works

Context-Enhanced Citation Sentiment Detection

Athar, A., & Teufel, S. (2012) · Cited by 104 · see citing works

Continuous Conditional Neural Fields for Structured Regression

Baltrušaitis, T., Robinson, P., & Morency, L. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-10593-2_39 · Cited by 101 · see citing works

Latent Variable Models for Semantic Orientations of Phrases

Takamura, H., Inui, T., & Okumura, M. (2006) · Cited by 97 · see citing works

Liars and Saviors in a Sentiment Annotated Corpus of Comments to Political Debates

Carvalho, P., Sarmento, L., Teixeira, J., & Silva, M. J. (2011) · Cited by 90 · see citing works

Summarizing Emails with Conversational Cohesion and Subjectivity

Carenini, G., Ng, R. T., & Zhou, X. (2008) · Cited by 66 · see citing works

Rendering of Eyes for Eye-Shape Registration and Gaze EstimationPreprint

Wood, E., Baltrušaitis, T., Zhang, X., Sugano, Y., Robinson, P., & Bulling, A. (2015) · arXiv (Cornell University) · doi:10.17863/cam.32367 · Cited by 59 · see citing works

Why Question Answering using Sentiment Analysis and Word Classes

Oh, J., Torisawa, K., Hashimoto, C., Kawada, T., Saeger, S. D., Kazama, J., & Wang, Y. (2012) · Cited by 52 · see citing works

Can prosody inform sentiment analysis? Experiments on short spoken reviews

Mairesse, F., Polifroni, J. H., & Fabbrizio, G. D. (2012) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2012.6289066 · Cited by 46 · see citing works

Fusion of Acoustic and Linguistic Features for Emotion Detection

Metze, F., Polzehl, T., & Wagner, M. (2009) · IEEE International Conference on Semantic Computing (ICSC) · doi:10.1109/icsc.2009.32 · Cited by 20 · see citing works

Manual annotation of opinion categories in meetings

Somasundaran, S., Wiebe, J., Hoffmann, P., & Litman, D. J. (2006) · doi:10.3115/1641991.1641998 · Cited by 14 · see citing works

Tensor Fusion Network for Multimodal Sentiment Analysis

Zadeh, A., Chen, M., Poria, S., Cambria, E., & Morency, L.-P. (2017) · Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d17-1115 · Cited by 2,102 · see citing works

Multimodal Language Analysis in the Wild: CMU-MOSEI Dataset and Interpretable Dynamic Fusion Graph

Bagher Zadeh, A., Liang, P. P., Poria, S., Cambria, E., & Morency, L.-P. (2018) · Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p18-1208 · Cited by 1,433 · see citing works

Efficient Low-rank Multimodal Fusion With Modality-Specific Factors

Liu, Z., Shen, Y., Lakshminarasimhan, V. B., Liang, P. P., Bagher Zadeh, A., & Morency, L.-P. (2018) · Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p18-1209 · Cited by 1,170 · see citing works

Sentiment analysis using deep learning architectures: a review

Yadav, A., & Vishwakarma, D. K. (2020) · Artificial Intelligence Review · doi:10.1007/s10462-019-09794-5 · Cited by 841 · see citing works

Learning Modality-Specific Representations with Self-Supervised Multi-Task Learning for Multimodal Sentiment Analysis

Yu, W., Xu, H., Yuan, Z., & Wu, J. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i12.17289 · Cited by 816 · see citing works

Integrating Multimodal Information in Large Pretrained Transformers

Rahman, W., Hasan, M. K., Lee, S., Zadeh, A. B., Mao, C., Morency, L., & Hoque, M. E. (2020) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2020.acl-main.214 · Cited by 743 · see citing works

An introduction to Deep Learning in Natural Language Processing: Models, techniques, and tools

Lauriola, I., Lavelli, A., & Aiolli, F. (2021) · Neurocomputing · doi:10.1016/j.neucom.2021.05.103 · Cited by 721 · see citing works

CH-SIMS: A Chinese Multimodal Sentiment Analysis Dataset with Fine-grained Annotation of Modality

Yu, W., Xu, H., Meng, F., Zhu, Y., Ma, Y., Wu, J., Zou, J., & Yang, K. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.343 · Cited by 482 · see citing works

Learning Relationships between Text, Audio, and Video via Deep Canonical Correlation for Multimodal Language Analysis

Sun, Z., Sarma, P., Sethares, W., & Liang, Y. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i05.6431 · Cited by 410 · see citing works

Multimodal Sentiment Analysis: A Survey of Methods, Trends, and Challenges

Das, R., & Singh, T. D. (2023) · ACM Computing Surveys · doi:10.1145/3586075 · Cited by 369 · see citing works

Multimodal sentiment analysis based on fusion methods: A survey

Zhu, L., Zhu, Z., Zhang, C., Xu, Y., & Kong, X. (2023) · Information Fusion · doi:10.1016/j.inffus.2023.02.028 · Cited by 368 · see citing works

Recent trends in deep learning based personality detection

Mehta, Y., Majumder, N., Gelbukh, A. F., & Cambria, E. (2019) · Artificial Intelligence Review · doi:10.1007/s10462-019-09770-z · Cited by 342 · see citing works

TETFN: A text enhanced transformer fusion network for multimodal sentiment analysis

Wang, D., Guo, X., Tian, Y., Liu, J., He, L., & Luo, X. (2022) · Pattern Recognition · doi:10.1016/j.patcog.2022.109259 · Cited by 349 · see citing works

Multimodal sentiment analysis with word-level fusion and reinforcement learning

Chen, M., Wang, S., Liang, P. P., Baltrušaitis, T., Zadeh, A., & Morency, L.-P. (2017) · Proceedings of the 19th ACM International Conference on Multimodal Interaction · doi:10.1145/3136755.3136801 · Cited by 334 · see citing works

A Deeper Look into Sarcastic Tweets Using Deep Convolutional Neural NetworksPreprint

Poria, S., Cambria, E., Hazarika, D., & Vij, P. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1610.08815 · Cited by 368 · see citing works

Recent advancements and challenges of NLP-based sentiment analysis: A state-of-the-art review

Jim, J. R., Talukder, M. A. R., Malakar, P., Kabir, M. M., Nur, K. M., & Mridha, M. F. (2024) · Natural Language Processing Journal · doi:10.1016/j.nlp.2024.100059 · Cited by 381 · see citing works

SMIL: Multimodal Learning with Severely Missing Modality

Ma, M., Ren, J., Zhao, L., Tulyakov, S., Wu, C., & Peng, X. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i3.16330 · Cited by 332 · see citing works

Hybrid Contrastive Learning of Tri-Modal Representation for Multimodal Sentiment Analysis

Mai, S., Zeng, Y., Zheng, S., & Hu, H. (2022) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2022.3172360 · Cited by 301 · see citing works

Domain Adaptation: Challenges, Methods, Datasets, and Applications

Singhal, P., Walambe, R. A., Ramanna, S., & Kotecha, K. V. (2023) · IEEE Access · doi:10.1109/access.2023.3237025 · Cited by 253 · see citing works

Multimodal Emotion Recognition with Deep Learning: Advancements, challenges, and future directions

Vijayaraghavan, G., Mala, T., Dhanasekaran, P., & Uma, E. (2023) · Information Fusion · doi:10.1016/j.inffus.2023.102218 · Cited by 246 · see citing works

A Survey of Deep Learning-Based Multimodal Emotion Recognition: Speech, Text, and Face

Lian, H., Lu, C., Li, S., Zhao, Y., Tang, C., & Zong, Y. (2023) · Entropy · doi:10.3390/e25101440 · Cited by 224 · see citing works

Multimodal Co-learning: Challenges, applications with datasets, recent advances and future directions

Rahate, A., Walambe, R., Ramanna, S., & Kotecha, K. (2022) · Information Fusion · doi:10.1016/j.inffus.2021.12.003 · Cited by 214 · see citing works

Exploiting BERT for Multimodal Target Sentiment Classification through Input Space Translation

Khan, Z., & Fu, Y. (2021) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3474085.3475692 · Cited by 203 · see citing works

Sentiment analysis using deep learning approaches: an overview

Habimana, O., Li, Y., Li, R., Gu, X., & Yu, G. (2019) · Science China Information Sciences · doi:10.1007/s11432-018-9941-6 · Cited by 191 · see citing works

Cross-Modal Enhancement Network for Multimodal Sentiment Analysis

Wang, D., Liu, S., Wang, Q., Tian, Y., He, L., & Gao, X. (2022) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2022.3183830 · Cited by 191 · see citing works

Sentiment Analysis in Social Networks

Gonçalves, J. P. M. (2016) · Elsevier eBooks · doi:10.1016/c2015-0-01864-0 · Cited by 182 · see citing works

UR-FUNNY: A Multimodal Language Dataset for Understanding Humor

Hasan, M. K., Rahman, W., Bagher Zadeh, A., Zhong, J., Tanveer, M. I., Morency, L.-P., & Hoque, M. (. (2019) · Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · doi:10.18653/v1/d19-1211 · Cited by 174 · see citing works

Multimodal Affective Analysis Using Hierarchical Attention Strategy with Word-Level Alignment

Gu, Y., Yang, K., Fu, S., Chen, S., Li, X., & Marsic, I. (2018) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p18-1207 · Cited by 160 · see citing works

Multimodal Emotion Recognition With Transformer-Based Self Supervised Feature Fusion

Siriwardhana, S., Kaluarachchi, T. I., Billinghurst, M., & Nanayakkara, S. C. (2020) · IEEE Access · doi:10.1109/access.2020.3026823 · Cited by 164 · see citing works

A Comprehensive Survey on Deep Learning Multi-Modal Fusion: Methods, Technologies and Applications

Jiao, T., Guo, C., Feng, X., Chen, Y., & Song, J. (2024) · Computers, Materials & Continua · doi:10.32604/cmc.2024.053204 · Cited by 158 · see citing works

TransModality: An End2End Fusion Method with Transformer for Multimodal Sentiment Analysis

Wang, Z., Wan, Z., & Wan, X. (2020) · Proceedings of The Web Conference 2020 · doi:10.1145/3366423.3380000 · Cited by 156 · see citing works

Divide, Conquer and Combine: Hierarchical Feature Fusion Network with Local and Global Perspectives for Multimodal Affective Computing

Mai, S., Hu, H., & Xing, S. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1046 · Cited by 153 · see citing works

AOBERT: All-modalities-in-One BERT for multimodal sentiment analysis

Kim, K.-H., & Park, S. (2022) · Information Fusion · doi:10.1016/j.inffus.2022.11.022 · Cited by 148 · see citing works

Multimodal Video Sentiment Analysis Using Deep Learning Approaches, a Survey

Abdu, S. A., Yousef, A. H., & Salem, A. (2021) · Information Fusion · doi:10.1016/j.inffus.2021.06.003 · Cited by 147 · see citing works

Quantum-inspired multimodal fusion for video sentiment analysis

Li, Q., Gkoumas, D., Lioma, C., & Melucci, M. (2021) · Information Fusion · doi:10.1016/j.inffus.2020.08.006 · Cited by 143 · see citing works

A Systematic Review on Multimodal Emotion Recognition: Building Blocks, Current State, Applications, and Challenges

Kalateh, S., Estrada-Jimenez, L. A., Nikghadam-Hojjati, S., & Barata, J. (2024) · IEEE Access · doi:10.1109/access.2024.3430850 · Cited by 151 · see citing works

Video sentiment analysis with bimodal information-augmented multi-head attention

Wu, T., Peng, J., Zhang, W., Zhang, H., Tan, S., Yi, F., Ma, C., & Huang, Y. (2021) · Knowledge-Based Systems · doi:10.1016/j.knosys.2021.107676 · Cited by 137 · see citing works

Recognizing Emotions in Video Using Multimodal DNN Feature Fusion

Williams, J., Kleinegesse, S., Comanescu, R., & Radu, O. (2018) · Proceedings of Grand Challenge and Workshop on Human Multimodal Language (Challenge-HML) · doi:10.18653/v1/w18-3302 · Cited by 132 · see citing works

Multilogue-Net: A Context-Aware RNN for Multi-modal Emotion Detection and Sentiment Analysis in Conversation

Shenoy, A., & Sardana, A. (2020) · doi:10.18653/v1/2020.challengehml-1.3 · Cited by 124 · see citing works

Gated Mechanism for Attention Based Multi Modal Sentiment Analysis

Kumar, A., & Vepa, J. (2020) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp40776.2020.9053012 · Cited by 123 · see citing works

The OMG-Emotion Behavior Dataset

Barros, P., Churamani, N., Lakomkin, E., Siqueira, H., Sutherland, A., & Wermter, S. (2018) · 2018 International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2018.8489099 · Cited by 121 · see citing works

Jointly Fine-Tuning “BERT-Like” Self Supervised Models to Improve Multimodal Speech Emotion Recognition

Siriwardhana, S., Reis, A., Weerasekera, R., & Nanayakkara, S. C. (2020) · Interspeech (USB) · doi:10.21437/interspeech.2020-1212 · Cited by 122 · see citing works

Interactional Stancetaking in Online Forums

Kiesling, S. F., Pavalanathan, U., Fitzpatrick, J., Han, X., & Eisenstein, J. (2018) · Computational Linguistics · doi:10.1162/coli_a_00334 · Cited by 118 · see citing works

A cross modal hierarchical fusion multimodal sentiment analysis method based on multi-task learning

Wang, L., Peng, J., Zheng, C., Zhao, T., & Zhu, L. (2024) · Information Processing & Management · doi:10.1016/j.ipm.2024.103675 · Cited by 111 · see citing works

Behavioral and Physiological Signals-Based Deep Multimodal Approach for Mobile Emotion Recognition

Yang, K., Wang, C., Gu, Y., Sarsenbayeva, Z., Tag, B., Dingler, T., Wadley, G., & Gonçalves, J. (2021) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2021.3100868 · Cited by 106 · see citing works

Dynamic interactive multiview memory network for emotion recognition in conversation

Wen, J., Jiang, D., Tu, G., Liu, C., & Cambria, E. (2022) · Information Fusion · doi:10.1016/j.inffus.2022.10.009 · Cited by 102 · see citing works

Multimodal sentiment analysis with unidirectional modality translation

Yang, B., Shao, B., Wu, L., & Lin, X. (2021) · Neurocomputing · doi:10.1016/j.neucom.2021.09.041 · Cited by 100 · see citing works

AF: An Association-Based Fusion Method for Multi-Modal Classification

Liang, X., Qian, Y., Guo, Q. J., Cheng, H., & Liang, J. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3125995 · Cited by 98 · see citing works

Learning Representations from Imperfect Time Series Data via Tensor Rank Regularization

Liang, P. P., Liu, Z., Tsai, Y.-H. H., Zhao, Q., Salakhutdinov, R., & Morency, L.-P. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1152 · Cited by 95 · see citing works

Multimodal sentiment analysis: A survey

Lai, S., Hu, X., Xu, H., Ren, Z., & Liu, Z. (2023) · Displays · doi:10.1016/j.displa.2023.102563 · Cited by 106 · see citing works

A Survey of Cutting-edge Multimodal Sentiment Analysis

Singh, U., Abhishek, K., & Azad, H. K. (2024) · ACM Computing Surveys · doi:10.1145/3652149 · Cited by 99 · see citing works

Multi-modal emotion recognition using tensor decomposition fusion and self-supervised multi-tasking

Wang, R., Zhu, J., Wang, S., Wang, T., Huang, J., & Zhu, X. (2024) · International Journal of Multimedia Information Retrieval · doi:10.1007/s13735-024-00347-3 · Cited by 95 · see citing works

Multimodal End-to-End Sparse Model for Emotion Recognition

Dai, W., Cahyawijaya, S., Liu, Z., & Fung, P. (2021) · Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.18653/v1/2021.naacl-main.417 · Cited by 91 · see citing works

What makes the difference? An empirical comparison of fusion strategies for multimodal language analysis

Gkoumas, D., Li, Q., Lioma, C., Yu, Y., & Song, D. (2020) · Information Fusion · doi:10.1016/j.inffus.2020.09.005 · Cited by 94 · see citing works

The Multimodal Sentiment Analysis in Car Reviews (MuSe-CaR) Dataset: Collection, Insights and Improvements

Stappen, L., Baird, A., Schumann, L., & Schuller, B. W. (2021) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2021.3097002 · Cited by 92 · see citing works

Multimodal transformer with adaptive modality weighting for multimodal sentiment analysis

Wang, Y., He, J., Wang, D., Wang, Q., Wan, B., & Luo, X. (2023) · Neurocomputing · doi:10.1016/j.neucom.2023.127181 · Cited by 91 · see citing works

Multimodal Emotion Recognition Fusion Analysis Adapting BERT With Heterogeneous Feature Unification

Lee, S., Han, D. K., & Ko, H. (2021) · IEEE Access · doi:10.1109/access.2021.3092735 · Cited by 91 · see citing works

Emotional Speech-Driven Animation with Content-Emotion Disentanglement

Daněček, R., Chhatre, K., Tripathi, S., Wen, Y., Black, M. J., & Bolkart, T. (2023) · SIGGRAPH Asia Conference Papers · doi:10.1145/3610548.3618183 · Cited by 89 · see citing works

What You Say and How You Say It Matters: Predicting Stock Volatility Using Verbal and Vocal Cues

Qin, Y. W., & Yang, Y. (2019) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p19-1038 · Cited by 89 · see citing works

MissModal: Increasing Robustness to Missing Modality in Multimodal Sentiment Analysis

Lin, R., & Hu, H. (2023) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00628 · Cited by 91 · see citing works

CTFN: Hierarchical Learning for Multimodal Sentiment Analysis Using Coupled-Translation Fusion Network

Tang, J., Li, K., Jin, X., Cichocki, A. S., Zhao, Q., & Kong, W. (2021) · doi:10.18653/v1/2021.acl-long.412 · Cited by 87 · see citing works

Efficient Low-rank Multimodal Fusion with Modality-Specific FactorsPreprint

Liu, Z., Shen, Y., Lakshminarasimhan, V., Liang, P. P., Zadeh, A., & Morency, L. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1806.00064 · Cited by 80 · see citing works

Multimodal Sentiment Analysis With Two-Phase Multi-Task Learning

Yang, B., Wu, L., Zhu, J., Shao, B., Lin, X., & Liu, T. (2022) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2022.3178204 · Cited by 80 · see citing works

Heterogeneous graph convolution based on In-domain Self-supervision for Multimodal Sentiment Analysis

Zeng, Y., Li, Z., Tang, Z., Chen, Z., & Ma, H. (2022) · Expert Systems with Applications · doi:10.1016/j.eswa.2022.119240 · Cited by 74 · see citing works

Convolutional Experts Constrained Local Model for Facial Landmark Detection

Zadeh, A., Baltrušaitis, T., & Morency, L. (2017) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2017.256 · Cited by 72 · see citing works

Multi-Task Momentum Distillation for Multimodal Sentiment Analysis

Lin, R., & Hu, H. (2023) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2023.3282410 · Cited by 71 · see citing works

Multimodality Representation Learning: A Survey on Evolution, Pretraining and Its Applications

Manzoor, M. A., Albarri, S., Xian, Z., Meng, Z., Nakov, P., & Liang, S. (2023) · ACM Transactions on Multimedia Computing Communications and Applications · doi:10.1145/3617833 · Cited by 76 · see citing works

Multimodality Sentiment Analysis in Social Internet of Things Based on Hierarchical Attentions and CSAT-TCN With MBM Network

Xiao, G., Tu, G., Zheng, L., Zhou, T., Li, X., Ahmed, S. H., & Jiang, D. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.3015381 · Cited by 67 · see citing works

Multimodal Sentiment Analysis via RNN variants

Agarwal, A., Yadav, A., & Vishwakarma, D. (2019) · International Conference on Big Data, Cloud Computing, Data Science & Engineering · doi:10.1109/bcd.2019.8885108 · Cited by 61 · see citing works

Multimodal Phased Transformer for Sentiment Analysis

Cheng, J., Fostiropoulos, I., BOEHM, B. W., & Soleymani, M. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.189 · Cited by 66 · see citing works

A Unified Self-Distillation Framework for Multimodal Sentiment Analysis with Uncertain Missing Modalities

Li, M., Yang, D., Lei, Y., Wang, S., Wang, S., Su, L., Yang, K., Wang, Y., Sun, M., & Zhang, L. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i9.28871 · Cited by 66 · see citing works

Sentiment Analysis: Comprehensive Reviews, Recent Advances, and Open Challenges

Lu, Q., Sun, X., Long, Y., Gao, Z., Feng, J. H., & Sun, T. S. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2023.3294810 · Cited by 72 · see citing works

Correlation-Decoupled Knowledge Distillation for Multimodal Sentiment Analysis with Incomplete Modalities

Li, M., Yang, D., Zhao, X. X., Wang, S., Wang, Y., Yang, K., Sun, M., Kou, D., Qian, Z., & Zhang, L. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01184 · Cited by 64 · see citing works

Combating Human Trafficking with Multimodal Deep Models

Tong, E., Zadeh, A., Jones, C., & Morency, L. (2017) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p17-1142 · Cited by 83 · see citing works

A cognitive brain model for multimodal sentiment analysis based on attention neural networks

Li, Y., Zhang, K., Wang, J., & Gao, X. (2020) · Neurocomputing · doi:10.1016/j.neucom.2020.10.021 · Cited by 63 · see citing works

Natural Language Supervision For General-Purpose Audio Representations

Elizalde, B., Deshmukh, S., & Wang, H. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10448504 · Cited by 61 · see citing works

MEDT: Using Multimodal Encoding-Decoding Network as in Transformer for Multimodal Sentiment Analysis

Qi, Q., Lin, L., Zhang, R., & Xue, C. (2022) · IEEE Access · doi:10.1109/access.2022.3157712 · Cited by 63 · see citing works

Complementary Fusion of Multi-Features and Multi-Modalities in Sentiment AnalysisPreprint

Chen, F., Luo, Z., Xu, Y., & Ke, D. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1904.08138 · Cited by 78 · see citing works

Trustworthy Multimodal Fusion for Sentiment Analysis in Ordinal Sentiment Space

Xie, Z., Yang, Y. Z., Wang, J., Liu, X., & Li, X. (2024) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2024.3376564 · Cited by 63 · see citing works

Sentiment analysis based on text information enhancement and multimodal feature fusion

Liu, Z., Cai, L., Yang, W., & Liu, J. (2024) · Pattern Recognition · doi:10.1016/j.patcog.2024.110847 · Cited by 59 · see citing works

Deep Multimodal Emotion Recognition on Human Speech: A Review

Koromilas, P., & Giannakopoulos, T. (2021) · Applied Sciences · doi:10.3390/app11177962 · Cited by 58 · see citing works

Embracing Unimodal Aleatoric Uncertainty for Robust Multimodal Fusion

Gao, Z., Jiang, X., Xu, X., Shen, F., Li, Y., & Shen, H. T. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02538 · Cited by 63 · see citing works

DNN Multimodal Fusion Techniques for Predicting Video Sentiment

Williams, J. A., Comanescu, R., Radu, O., & Tian, L. (2018) · doi:10.18653/v1/w18-3309 · Cited by 56 · see citing works

Large language models meet text-centric multimodal sentiment analysis: a survey

Yang, H., Zhao, Y., Wu, Y., Wang, S., Zheng, T., Zhang, H., Ma, Z., Che, W., Wang, S., Wei, S., et al. (2025) · Science China Information Sciences · doi:10.1007/s11432-024-4593-8 · Cited by 88 · see citing works

Improving Depression Level Estimation by Concurrently Learning Emotion Intensity

Qureshi, S. A., Dias, G. H., Hasanuzzaman, M., & Saha, S. (2020) · IEEE Computational Intelligence Magazine · doi:10.1109/mci.2020.2998234 · Cited by 56 · see citing works

Dynamically Shifting Multimodal Representations via Hybrid-Modal Attention for Multimodal Sentiment Analysis

Lin, R., & Hu, H. (2023) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2023.3303711 · Cited by 56 · see citing works

Multimodal sentiment analysis with unimodal label generation and modality decomposition

Zhu, L., Zhao, H., Zhu, Z., Zhang, C., & Kong, X. (2024) · Information Fusion · doi:10.1016/j.inffus.2024.102787 · Cited by 55 · see citing works

SWAFN: Sentimental Words Aware Fusion Network for Multimodal Sentiment Analysis

Chen, M., & Li, X. (2020) · International Conference on Computational Linguistics · doi:10.18653/v1/2020.coling-main.93 · Cited by 54 · see citing works

Joint multimodal sentiment analysis based on information relevance

Chen, D., Su, W., Wu, P., & Hua, B. (2022) · Information Processing & Management · doi:10.1016/j.ipm.2022.103193 · Cited by 56 · see citing works

TCHFN: Multimodal sentiment analysis based on Text-Centric Hierarchical Fusion Network

Hou, J., Omar, N., Tiun, S. B., Saad, S., & He, Q. (2024) · Knowledge-Based Systems · doi:10.1016/j.knosys.2024.112220 · Cited by 55 · see citing works

Combining cross-modal knowledge transfer and semi-supervised learning for speech emotion recognition

Zhang, S., Chen, M., Chen, J., Li, Y.-F., Wu, Y., Li, M., & Zhu, C. (2021) · Knowledge-Based Systems · doi:10.1016/j.knosys.2021.107340 · Cited by 54 · see citing works

A Low-Rank Matching Attention Based Cross-Modal Feature Fusion Method for Conversational Emotion Recognition

Shou, Y., Liu, H., Cao, X., Meng, D., & Dong, B. (2024) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2024.3498443 · Cited by 53 · see citing works

ConKI: Contrastive Knowledge Injection for Multimodal Sentiment Analysis

Yu, Y., Zhao, M. M., Qi, S.-A., Sun, F., Wang, B., Guo, W., Wang, X. L., Yang, L., & Niu, D. (2023) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2023.findings-acl.860 · Cited by 55 · see citing works

Feature Fusion for Multimodal Emotion Recognition Based on Deep Canonical Correlation Analysis

Zhang, K., Li, Y., Wang, J., Wang, Z., & Li, X. (2021) · IEEE Signal Processing Letters · doi:10.1109/lsp.2021.3112314 · Cited by 51 · see citing works

Shared-Private Memory Networks For Multimodal Sentiment Analysis

Zhao, X., Chen, Y., Liu, S., & Tang, B. (2022) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2022.3222023 · Cited by 50 · see citing works

Multi-Channel Attentive Graph Convolutional Network with Sentiment Fusion for Multimodal Sentiment Analysis

Xiao, L., Wu, X., Wu, W., Yang, J., & He, L. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9747542 · Cited by 49 · see citing works

Multi-level correlation mining framework with self-supervised label generation for multimodal sentiment analysis

Li, Z., Guo, Q., Pan, Y., Ding, W., Yu, J., Zhang, Y., Liu, W., Chen, H., Wang, H., & Xie, Y. (2023) · Information Fusion · doi:10.1016/j.inffus.2023.101891 · Cited by 49 · see citing works

FMSA-SC: A Fine-Grained Multimodal Sentiment Analysis Dataset Based on Stock Comment Videos

Song, L., Chen, S., Meng, Z., Sun, M., & Shang, X. (2024) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2024.3363641 · Cited by 48 · see citing works

CMU-MOSEAS: A Multimodal Language Dataset for Spanish, Portuguese, German and French

Zadeh, A. B., Cao, Y., Hessner, S., Liang, P. P., Poria, S., & Morency, L. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.141 · Cited by 46 · see citing works

Multimodal Mutual Attention-Based Sentiment Analysis Framework Adapted to Complicated Contexts

He, L., Wang, Z., Wang, L., & Li, F. (2023) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2023.3276075 · Cited by 45 · see citing works

AMOSI:Attention-Based Multimodal Sentiment Intensity Analysis with LSTM-CNN Architecture for Online Opinion Videos

Sree, V. V. V. B., Mohan, G. B., Kumar, R. P., Rithani, M., & Pallavi, G. (2024) · International Conference on Computing, Communication and Networking Technologies (ICCCNT) · doi:10.1109/icccnt61001.2024.10725013 · Cited by 2 · see citing works

Multimodal Sentiment Intensity Analysis in Videos: Facial Gestures and Verbal Messages

Zadeh, A., Zellers, R., Pincus, E., & Morency, L.-P. (2016) · IEEE Intelligent Systems · doi:10.1109/mis.2016.94 · Cited by 852 · see citing works

Towards Multimodal Sentiment Analysis: Harvesting Opinions from the Web

Doshi, P., & Mihalcea, R. (2012)

Multimodal Sentiment Analysis

Mihalcea, R. F. (2012) · Cited by 16 · see citing works

Multimodal Sentiment Analysis of Spanish Online Videos

Rosas, V. P., Mihalcea, R. F., & Morency, L. (2013) · IEEE Intelligent Systems · doi:10.1109/mis.2013.9 · Cited by 228 · see citing works