Multimodal Sentiment Analysis: A Survey of Methods, Trends, and Challenges
Open accessThe DOI matches its Crossref record; 153 of the 153 references it cites were found in a registry or an index.
Abstract
Sentiment analysis has come long way since it was introduced as a natural language processing task nearly 20 years ago. Sentiment analysis aims to extract the underlying attitudes and opinions toward an entity. It has become a powerful tool used by governments, businesses, medicine, marketing, and others. The traditional sentiment analysis model focuses mainly on text content. However, technological advances have allowed people to express their opinions and feelings through audio, image and video channels. As a result, sentiment analysis is shifting from unimodality to multimodality. Multimodal sentiment analysis brings new opportunities with the rapid increase of sentiment analysis as complementary data streams enable improved and deeper sentiment detection which goes beyond text-based analysis. Audio and video channels are included in multimodal sentiment analysis in terms of broadness. People have been working on different approaches to improve sentiment analysis system performance by employing complex deep neural architectures. Recently, sentiment analysis has achieved significant success using the transformer-based model. This paper presents a comprehensive study of different sentiment analysis approaches, applications, challenges, and resources then concludes that it holds tremendous potential. The primary motivation of this survey is to highlight changing trends in the unimodality to multimodality for solving sentiment analysis tasks.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
A fast learning algorithm for deep belief nets
Hinton, G. E., Osindero, S., & Teh, Y.-W. (2006) · Neural Computation · doi:10.1162/neco.2006.18.7.1527 · Cited by 16,336
Proceedings of IEEE Conference on Computer Vision and Pattern Recognition
(1993) · Proceedings of IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.1993.341010 · Cited by 14,265
WordNet: a lexical database for English
Miller, G. A. (1995) · Communications of the ACM · doi:10.1145/219717.219748 · Cited by 14,015 · cited 10×
“They used the sentiment lexicon enhanced with the assistance of SentiWordNet and fuzzy sets to estimate the semantic orientation polarity and its intensity for sentences.”
InfluentialDeep Contextualized Word Representations
Peters, M., Neumann, M., Iyyer, M., Gardner, M., Clark, C., Lee, K., & Zettlemoyer, L. (2018) · Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers) · doi:10.18653/v1/n18-1202 · Cited by 11,983
Mining and summarizing customer reviews
Hu, M., & Liu, B. (2004) · Proceedings of the tenth ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/1014052.1014073 · Cited by 7,793
Thumbs up?: sentiment classification using machine learning techniques
Pang, B., Lee, L., & Vaithyanathan, S. (2002) · Proceedings of the ACL-02 conference on Empirical methods in natural language processing - EMNLP '02 · doi:10.3115/1118693.1118704 · Cited by 7,024
Recursive Deep Models for Semantic Compositionality Over a Sentiment Treebank
Socher, R., Perelygin, A., Wu, J., Chuang, J., Manning, C. D., Ng, A., & Potts, C. (2013) · Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d13-1170 · Cited by 6,878
Universal Language Model Fine-tuning for Text Classification
Howard, J., & Ruder, S. (2018) · Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p18-1031 · Cited by 4,100 · cited 3×
“[79] reported a multi-task learning-based financial aspect-based sentiment analysis framework using ULMFiT [80] which is an inductive transfer-learning method.”
Lexicon-based methods for sentiment analysis
Taboada, M., Brooke, J., Tofiloski, M., Voll, K., & Stede, M. (2011) · Computational Linguistics · doi:10.1162/coli_a_00049 · Cited by 3,301
A sentimental education: sentiment analysis using subjectivity summarization based on minimum cuts
Pang, B., & Lee, L. (2004) · Proceedings of the 42nd Annual Meeting on Association for Computational Linguistics - ACL '04 · doi:10.3115/1218955.1218990 · Cited by 3,301
Sentiment analysis algorithms and applications: A survey
Medhat, W., Hassan, A., & Korashy, H. (2014) · Ain Shams Engineering Journal · doi:10.1016/j.asej.2014.04.011 · Cited by 3,248
Attention-based LSTM for Aspect-level Sentiment Classification
Wang, Y., Huang, M., zhu, X., & Zhao, L. (2016) · Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d16-1058 · Cited by 2,450
Thumbs up or thumbs down?: semantic orientation applied to unsupervised classification of reviews
Turney, P. D. (2001) · Proceedings of the 40th Annual Meeting on Association for Computational Linguistics - ACL '02 · doi:10.3115/1073083.1073153 · Cited by 2,352
Tensor Fusion Network for Multimodal Sentiment Analysis
Zadeh, A., Chen, M., Poria, S., Cambria, E., & Morency, L.-P. (2017) · Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d17-1115 · Cited by 2,102 · cited 2×
“[144] by developing a tensor fusion network.”
BackgroundMining the peanut gallery: opinion extraction and semantic classification of product reviews
Dave, K., Lawrence, S., & Pennock, D. M. (2003) · Proceedings of the twelfth international conference on World Wide Web - WWW '03 · doi:10.1145/775152.775226 · Cited by 1,916
Annotating Expressions of Opinions and Emotions in Language
Wiebe, J., Wilson, T., & Cardie, C. (2005) · Language Resources and Evaluation · doi:10.1007/s10579-005-7880-9 · Cited by 1,755
Proceedings of the 40th Annual Meeting on Association for Computational Linguistics
Isabelle, P. (2002) · Cited by 1,635
A survey on sentiment analysis methods, applications, and challenges
Wankhade, M., Rao, A. C. S., & Kulkarni, C. (2022) · Artificial Intelligence Review · doi:10.1007/s10462-022-10144-1 · Cited by 1,528
Document Modeling with Gated Recurrent Neural Network for Sentiment Classification
Tang, D., Qin, B., & Liu, T. (2015) · Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d15-1167 · Cited by 1,519
A GENERAL PSYCHOEVOLUTIONARY THEORY OF EMOTION
PLUTCHIK, R. (1980) · Theories of Emotion · doi:10.1016/b978-0-12-558701-3.50007-7 · Cited by 1,370
Birch, A., & Osborne, M. (2011) · The Association for Computational Linguistics · Cited by 1,200
Sentiment analysis: capturing favorability using natural language processing
Nasukawa, T., & Yi, J. (2003) · Proceedings of the 2nd international conference on Knowledge capture · doi:10.1145/945645.945658 · Cited by 1,165
Context-Dependent Sentiment Analysis in User-Generated Videos
Poria, S., Cambria, E., Hazarika, D., Majumder, N., Zadeh, A., & Morency, L.-P. (2017) · Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p17-1081 · Cited by 939
A comprehensive survey on sentiment analysis: Approaches, challenges and trends
Birjali, M., Kasri, M., & Beni-Hssane, A. (2021) · Knowledge-Based Systems · doi:10.1016/j.knosys.2021.107134 · Cited by 921
Ambati, B. R., Deoskar, T., Johnson, M., & Steedman, M. J. (2015) · The Association for Computational Linguistics · Cited by 860
Large-scale visual sentiment ontology and detectors using adjective noun pairs
Borth, D., Ji, R., Chen, T., Breuel, T., & Chang, S.-F. (2013) · Proceedings of the 21st ACM international conference on Multimedia · doi:10.1145/2502081.2502282 · Cited by 851
Li, L.-J., Su, H., Fei-Fei, L., & Xing, E. P. (2018) · KiltHub Repository · doi:10.1184/r1/6475985 · Cited by 827
Gandhi, A., Adhvaryu, K., Poria, S., Cambria, E., & Hussain, A. (2023) · Information Fusion · doi:10.1016/j.inffus.2022.09.025 · Cited by 783 · cited 1×
“[20] reported a survey paper to examine the primary taxonomy and newly released multimodal fusion architectures.”
BackgroundImproving sentiment analysis via sentence type classification using BiLSTM-CRF and CNN
Chen, T., Xu, R., He, Y., & Wang, X. (2017) · Expert Systems with Applications · doi:10.1016/j.eswa.2016.10.065 · Cited by 730
Proceedings of the 22nd ACM international conference on Multimedia
(2014) · doi:10.1145/2647868 · Cited by 725
2019 International Joint Conference on Neural Networks (IJCNN)
(2019) · doi:10.1109/ijcnn46175.2019 · Cited by 642
Proceedings of the 25th ACM international conference on Multimedia
(2017) · doi:10.1145/3123266 · Cited by 618
SemEval-2007 task 14: affective text
Strapparava, C., & Mihalcea, R. (2007) · Proceedings of the 4th International Workshop on Semantic Evaluations - SemEval '07 · doi:10.3115/1621474.1621487 · Cited by 602
A survey of multimodal sentiment analysis
Soleymani, M., Garcia, D., Jou, B., Schuller, B., Chang, S.-F., & Pantic, M. (2017) · Image and Vision Computing · doi:10.1016/j.imavis.2017.08.003 · Cited by 601
Sentiment analysis in Facebook and its application to e-learning
Ortigosa, A., Martín, J. M., & Carro, R. M. (2014) · Computers in Human Behavior · doi:10.1016/j.chb.2013.05.024 · Cited by 594
Fusing audio, visual and textual clues for sentiment analysis from multimodal content
Poria, S., Cambria, E., Howard, N., Huang, G.-B., & Hussain, A. (2016) · Neurocomputing · doi:10.1016/j.neucom.2015.01.095 · Cited by 534 · cited 1×
“Poria et al. [136] designed a real-time multimodal sentiment understanding model to harvest sentiments from web videos.”
BackgroundPoria, S., Cambria, E., & Gelbukh, A. (2015) · Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d15-1303 · Cited by 533
Current State of Text Sentiment Analysis from Opinion to Emotion Mining
Yadollahi, A., Shahraki, A. G., & Zaiane, O. R. (2018) · ACM Computing Surveys · doi:10.1145/3057270 · Cited by 489
Towards multimodal sentiment analysis: harvesting opinions from the web
Morency, L.-P., Mihalcea, R., & Doshi, P. (2011) · Proceedings of the 13th international conference on multimodal interfaces · doi:10.1145/2070481.2070509 · Cited by 470
OpinionFinder: a system for subjectivity analysis
Wilson, T., Hoffmann, P., Somasundaran, S., Kessler, J., Wiebe, J., Choi, Y., Cardie, C., Riloff, E., & Patwardhan, S. (2005) · Proceedings of HLT/EMNLP on Interactive Demonstrations - · doi:10.3115/1225733.1225751 · Cited by 469
Boosting for transfer learning with multiple sources
Yao, Y., & Doretto, G. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5539857 · Cited by 464
Twenty-Ninth AAAI Conference on Artificial Intelligence
Albrecht, S. V., Crandall, J. W., & Ramamoorthy, R. (2015) · National Conference on Artificial Intelligence · Cited by 464
Machine Learning-Based Sentiment Analysis for Twitter Accounts
Hasan, A., Moin, S., Karim, A., & Shamshirband, S. (2018) · Mathematical and Computational Applications · doi:10.3390/mca23010011 · Cited by 447
2018 IEEE International Conference on Data Mining (ICDM)
(2018) · doi:10.1109/icdm44384.2018 · Cited by 444
Sentiment Analysis Is a Big Suitcase
Cambria, E., Poria, S., Gelbukh, A., & Thelwall, M. (2017) · IEEE Intelligent Systems · doi:10.1109/mis.2017.4531228 · Cited by 439
Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing
Yarowsky, D., Baldwin, T., Korhonen, A., Livescu, K., & Bethard, S. J. (2013) · Empirical Methods in Natural Language Processing · Cited by 422
Youtube movie reviews: Sentiment analysis in an audio-visual context
Wollmer, M., Weninger, F., Knaup, T., Schuller, B., Sun, C., Sagae, K., & Morency, L.-P. (2013) · IEEE Intelligent Systems · doi:10.1109/mis.2013.34 · Cited by 403
Multimodal sentiment analysis using hierarchical fusion with context modeling
Majumder, N., Hazarika, D., Gelbukh, A., Cambria, E., & Poria, S. (2018) · Knowledge-Based Systems · doi:10.1016/j.knosys.2018.07.041 · Cited by 383
Using SentiWordNet for multilingual sentiment analysis
Denecke, K. (2008) · IEEE International Conference on Data Engineering Workshops (ICDEW) · doi:10.1109/icdew.2008.4498370 · Cited by 374
Proceedings of the 23rd ACM international conference on Multimedia
(2015) · doi:10.1145/2733373 · Cited by 367
More than a Feeling: Accuracy and Application of Sentiment Analysis
Hartmann, J., Heitmann, M., Siebert, C., & Schamp, C. (2023) · International Journal of Research in Marketing · doi:10.1016/j.ijresmar.2022.05.005 · Cited by 356 · cited 1×
“These groups reflect two major methodological transitions: the first one is from manual labor-intensive and hand-crafted lexicons to an automatic machine learning approach trained on high-dimensional, sparse bag-of-words features, and the second one is learning the low-dimensional and dense embeddings vector from text…”
BackgroundMOSI: Multimodal Corpus of Sentiment Intensity and Subjectivity Analysis in Online Opinion Videos
Zadeh, A., Zellers, R., Pincus, E., & Morency, L.-P. (2016) · arXiv · doi:10.48550/arxiv.1606.06259 · Cited by 350
Sentic patterns: Dependency-based rules for concept-level sentiment analysis
Poria, S., Cambria, E., Winterstein, G., & Huang, G.-B. (2014) · Knowledge-Based Systems · doi:10.1016/j.knosys.2014.05.005 · Cited by 345
LSTM with sentence representations for document-level sentiment classification
Rao, G., Huang, W., Feng, Z., & Cong, Q. (2018) · Neurocomputing · doi:10.1016/j.neucom.2018.04.045 · Cited by 326
In Proceedings of the Fifth International Conference on Language Resources and Evaluation (LREC
Grover, C., & Tobin, R. (2006) · Cited by 324
Beneath the Tip of the Iceberg: Current Challenges and New Directions in Sentiment Analysis Research
Poria, S., Hazarika, D., Majumder, N., & Mihalcea, R. (2023) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2020.3038167 · Cited by 321
A CNN-BiLSTM Model for Document-Level Sentiment Analysis
Rhanoui, M., Mikram, M., Yousfi, S., & Barzali, S. (2019) · Machine Learning and Knowledge Extraction · doi:10.3390/make1030048 · Cited by 300
Image–text sentiment analysis via deep multimodal attentive fusion
Huang, F., Zhang, X., Zhao, Z., Xu, J., & Li, Z. (2019) · Knowledge-Based Systems · doi:10.1016/j.knosys.2019.01.019 · Cited by 296
Proceedings of the 15th international conference on World Wide Web
(2006) · doi:10.1145/1135777 · Cited by 295
Maxwell, K. T., Oberlander, J., & Croft, W. B. (2013) · The Association for Computational Linguistics · Cited by 294
Multilingual Sentiment Analysis: State of the Art and Independent Comparison of Techniques
Dashtipour, K., Poria, S., Hussain, A., Cambria, E., Hawalah, A. Y. A., Gelbukh, A., & Zhou, Q. (2016) · Cognitive Computation · doi:10.1007/s12559-016-9415-7 · Cited by 286
Convolutional Recurrent Deep Learning Model for Sentence Classification
Hassan, A., & Mahmood, A. (2018) · IEEE Access · doi:10.1109/access.2018.2814818 · Cited by 257
Enhanced SenticNet with Affective Labels for Concept-Based Opinion Mining
Poria, S., Gelbukh, A., Hussain, A., Howard, N., Das, D., & Bandyopadhyay, S. (2013) · IEEE Intelligent Systems · doi:10.1109/mis.2013.4 · Cited by 253
Fine-tuning Convolutional Neural Networks for fine art classification
Cetinic, E., Lipic, T., & Grgic, S. (2018) · Expert Systems with Applications · doi:10.1016/j.eswa.2018.07.026 · Cited by 250
Sentiment classification of Internet restaurant reviews written in Cantonese
Zhang, Z., Ye, Q., Zhang, Z., & Li, Y. (2011) · Expert Systems with Applications · doi:10.1016/j.eswa.2010.12.147 · Cited by 230
Multimodal Sentiment Analysis of Spanish Online Videos
Perez Rosas, V., Mihalcea, R., & Morency, L.-P. (2013) · IEEE Intelligent Systems · doi:10.1109/mis.2013.9 · Cited by 227
A hybrid approach to the sentiment analysis problem at the sentence level
Appel, O., Chiclana, F., Carter, J., & Fujita, H. (2016) · Knowledge-Based Systems · doi:10.1016/j.knosys.2016.05.040 · Cited by 224
Analyzing and predicting sentiment of images on the social web
Siersdorfer, S., Minack, E., Deng, F., & Hare, J. (2010) · Proceedings of the 18th ACM international conference on Multimedia · doi:10.1145/1873951.1874060 · Cited by 218
A computer approach to content analysis: studies using the General Inquirer system
Stone, P. J., & Hunt, E. B. (1963) · Proceedings of the May 21-23, 1963, spring joint computer conference on - AFIPS '63 (Spring) · doi:10.1145/1461551.1461583 · Cited by 209
Deep learning for sentiment analysis: successful approaches and future challenges
Tang, D., Qin, B., & Liu, T. (2015) · WIREs Data Mining and Knowledge Discovery · doi:10.1002/widm.1171 · Cited by 207
Select-additive learning: Improving generalization in multimodal sentiment analysis
Wang, H., Meghawat, A., Morency, L.-P., & Xing, E. P. (2017) · 2017 IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme.2017.8019301 · Cited by 203
Sentiment Classification Using Convolutional Neural Networks
Kim, H., & Jeong, Y.-S. (2019) · Applied Sciences · doi:10.3390/app9112347 · Cited by 201
From pixels to sentiment: Fine-tuning CNNs for visual sentiment prediction
Campos, V., Jou, B., & Giró-i-Nieto, X. (2017) · Image and Vision Computing · doi:10.1016/j.imavis.2017.01.011 · Cited by 197
Jones, B., Johnson, M., & Goldwater, S. J. (2012) · The Association for Computational Linguistics · Cited by 196
Opinion digger: an unsupervised opinion miner from unstructured product reviews
Moghaddam, S., & Ester, M. (2010) · Proceedings of the 19th ACM international conference on Information and knowledge management · doi:10.1145/1871437.1871739 · Cited by 196
Multi-level Multiple Attentions for Contextual Multimodal Sentiment Analysis
Poria, S., Cambria, E., Hazarika, D., Mazumder, N., Zadeh, A., & Morency, L.-P. (2017) · 2017 IEEE International Conference on Data Mining (ICDM) · doi:10.1109/icdm.2017.134 · Cited by 193
Multilingual sentiment analysis: from formal to informal and scarce resource languages
Lo, S. L., Cambria, E., Chiong, R., & Cornforth, D. (2017) · Artificial Intelligence Review · doi:10.1007/s10462-016-9508-4 · Cited by 192
A Survey of Sentiment Analysis Based on Transfer Learning
Liu, R., Shi, Y., Ji, C., & Jia, M. (2019) · IEEE Access · doi:10.1109/access.2019.2925059 · Cited by 189
Borth, D., Chen, T., Ji, R., & Chang, S.-F. (2013) · Proceedings of the 21st ACM international conference on Multimedia · doi:10.1145/2502081.2502268 · Cited by 188
Contextual Inter-modal Attention for Multi-modal Sentiment Analysis
Ghosal, D., Akhtar, M. S., Chauhan, D., Poria, S., Ekbal, A., & Bhattacharyya, P. (2018) · Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d18-1382 · Cited by 185
Weakly-Supervised Deep Embedding for Product Review Sentiment Analysis
Zhao, W., Guan, Z., Chen, L., He, X., Cai, D., Wang, B., & Wang, Q. (2018) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2017.2756658 · Cited by 177
Fuzzy commonsense reasoning for multimodal sentiment analysis
Chaturvedi, I., Satapathy, R., Cavallari, S., & Cambria, E. (2019) · Pattern Recognition Letters · doi:10.1016/j.patrec.2019.04.024 · Cited by 170
A survey on sentiment analysis and opinion mining for social multimedia
Li, Z., Fan, Y., Jiang, B., Lei, T., & Liu, W. (2019) · Multimedia Tools and Applications · doi:10.1007/s11042-018-6445-z · Cited by 164 · cited 1×
“Li et al. [15] presented an overview of social media topics and described sentiment analysis and opinion-mining algorithms for social multimedia.”
BackgroundBoosting image sentiment analysis with visual attention
Song, K., Yao, T., Ling, Q., & Mei, T. (2018) · Neurocomputing · doi:10.1016/j.neucom.2018.05.104 · Cited by 162
An image-text consistency driven multimodal sentiment analysis approach for social media
Zhao, Z., Zhu, H., Xue, Z., Liu, Z., Tian, J., Chua, M. C. H., & Liu, M. (2019) · Information Processing & Management · doi:10.1016/j.ipm.2019.102097 · Cited by 160
Multimodal sentimental analysis for social media applications: A comprehensive review
Chandrasekaran, G., Nguyen, T. N., & Hemanth D., J. (2021) · WIREs Data Mining and Knowledge Discovery · doi:10.1002/widm.1415 · Cited by 159
Gated Mechanism for Attention Based Multi Modal Sentiment Analysis
Kumar, A., & Vepa, J. (2020) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp40776.2020.9053012 · Cited by 158
A comparative study of machine translation for multilingual sentence-level sentiment analysis
Araújo, M., Pereira, A. C. M., & Benevenuto, F. (2019) · Information Sciences · doi:10.1016/j.ins.2019.10.031 · Cited by 155
Alamoudi, E. S., & Alghamdi, N. S. (2021) · Journal of Decision System · doi:10.1080/12460125.2020.1864106 · Cited by 152
Object-Based Visual Sentiment Concept Analysis and Application
Chen, T., Yu, F. X., Chen, J., Cui, Y., Chen, Y., & Chang, S. (2014) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/2647868.2654935 · Cited by 136
Multi-task learning for aspect term extraction and aspect sentiment classification
Akhtar, M. S., Garg, T., & Ekbal, A. (2020) · Neurocomputing · doi:10.1016/j.neucom.2020.02.093 · Cited by 135
Sentence Compression for Aspect-Based Sentiment Analysis
Che, W., Zhao, Y., Guo, H., Su, Z., & Liu, T. (2015) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2015.2443982 · Cited by 131
Deep learning for sentiment analysis
Rojas‐Barahona, L. M. (2016) · Language and Linguistics Compass · doi:10.1111/lnc3.12228 · Cited by 130
DASA: Dissatisfaction-oriented Advertising based on Sentiment Analysis
Qiu, G., He, X., Zhang, F., Shi, Y., Bu, J., & Chen, C. (2010) · Expert Systems with Applications · doi:10.1016/j.eswa.2010.02.109 · Cited by 129
Microblog Sentiment Analysis Based on Cross-media Bag-of-words Model
Wang, M., Cao, D., Li, L., Li, S., & Ji, R. (2014) · International Conference on Internet Multimedia Computing and Service · doi:10.1145/2632856.2632912 · Cited by 128
Dyadic Memory Networks for Aspect-based Sentiment Analysis
Tay, Y., Tuan, L. A., & Hui, S. C. (2017) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3132847.3132936 · Cited by 124
Multimodal Sentiment Analysis: A Survey and Comparison
Kaur, R., & Kautish, S. (2022) · IGI Global eBooks · doi:10.4018/978-1-6684-6303-1.ch098 · Cited by 113
Survey on visual sentiment analysis
Ortis, A., Farinella, G. M., & Battiato, S. (2020) · IET Image Processing · doi:10.1049/iet-ipr.2019.1270 · Cited by 103
Joint Visual-Textual Sentiment Analysis with Deep Neural Networks
You, Q., Luo, J., Jin, H., & Yang, J. (2015) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/2733373.2806284 · Cited by 101
Towards Twitter sentiment classification by multi-level sentiment-enriched word embeddings
Xiong, S., Hai-lian, L., Zhao, W., & Ji, D. (2017) · Neurocomputing · doi:10.1016/j.neucom.2017.11.023 · Cited by 100
A novel context-aware multimodal framework for persian sentiment analysis
Dashtipour, K., Gogate, M., Cambria, E., & Hussain, A. (2021) · Neurocomputing · doi:10.1016/j.neucom.2021.02.020 · Cited by 99
Domain attention model for multi-domain sentiment classification
Yuan, Z., Wu, S., Wu, F., Liu, J., & Huang, Y. (2018) · Knowledge-Based Systems · doi:10.1016/j.knosys.2018.05.004 · Cited by 98
Implicit feature identification in Chinese reviews using explicit topic mining model
Xu, H., Zhang, F., & Wang, W. (2014) · Knowledge-Based Systems · doi:10.1016/j.knosys.2014.12.012 · Cited by 93
A survey of sentiment analysis in the Portuguese language
Pereira, D. A. (2020) · Artificial Intelligence Review · doi:10.1007/s10462-020-09870-1 · Cited by 87
Affective Image Content Analysis: A Comprehensive Survey
Zhao, S., Ding, G., Huang, Q., Chua, T., Schuller, B. W., & Keutzer, K. (2018) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2018/780 · Cited by 77
COLING 2004: Proceedings of the 20th International Conference on Computational Linguistics
Yuste, E., Jekat, S. J., Pantli, A.-K., & Massey, G. (2004) · Zürcher Hochschule für Angewandte Wissenschaften digital collection (Zurich University of Applied Sciences) · Cited by 74
Improving BERT Performance for Aspect-Based Sentiment AnalysisPreprint
Karimi, A., Rossi, L., & Prati, A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.11731 · Cited by 68
Image sentiment analysis using deep convolutional neural networks with domain specific fine tuning
Jindal, S., & Singh, S. (2015) · doi:10.1109/infop.2015.7489424 · Cited by 67
Huddar, M. G., Sannakki, S. S., & Rajpurohit, V. S. (2021) · Multimedia Tools and Applications · doi:10.1007/s11042-020-10285-x · Cited by 64
Sememe knowledge and auxiliary information enhanced approach for sarcasm detection
Wen, Z., Gui, L., Wang, Q., Guo, M., Yu, X., Du, J., & Xu, R. (2022) · Information Processing & Management · doi:10.1016/j.ipm.2022.102883 · Cited by 60
Visual sentiment topic model based microblog image sentiment analysis
Cao, D., Ji, R., Lin, D., & Li, S. (2014) · Multimedia Tools and Applications · doi:10.1007/s11042-014-2337-z · Cited by 50
Cross-lingual deep neural transfer learning in sentiment analysis
Kanclerz, K., Miłkowski, P., & Kocoń, J. (2020) · Procedia Computer Science · doi:10.1016/j.procs.2020.08.014 · Cited by 48
Training and Evaluating Multimodal Word Embeddings with Large-scale Web Annotated ImagesPreprint
Mao, J., Xu, J., Jing, Y., & Yuille, A. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.08321 · Cited by 46
A multi-stage multimodal framework for sentiment analysis of Assamese in low resource setting
Das, R., & Singh, T. D. (2022) · Expert Systems with Applications · doi:10.1016/j.eswa.2022.117575 · Cited by 46
Self-citationExploiting Multimodal Affect and Semantics to Identify Politically Persuasive Web Videos
Siddiquie, B., Chisholm, D., & Divakaran, A. (2015) · Proceedings of the 2015 ACM on International Conference on Multimodal Interaction · doi:10.1145/2818346.2820732 · Cited by 44
Image sentiment prediction based on textual descriptions with adjective noun pairs
Li, Z., Fan, Y., Liu, W., & Wang, F. (2017) · Multimedia Tools and Applications · doi:10.1007/s11042-016-4310-5 · Cited by 44
Predicting Viewer Affective Comments Based on Image Content in Social Media
Chen, Y., Chen, T., Hsu, W. H., Liao, H.-Y. M., & Chang, S. (2014) · International Conference on Multimedia Retrieval · doi:10.1145/2578726.2578756 · Cited by 43
Sentiment analysis using image-based deep spectrum features
Amiriparian, S., Cummins, N., Ottl, S., Gerczuk, M., & Schuller, B. W. (2017) · International Conference on Affective Computing and Intelligent Interaction Workshops and Demos (ACIIW) · doi:10.1109/aciiw.2017.8272618 · Cited by 43
Automatic Sentiment Detection in Naturalistic Audio
Kaushik, L., Sangwan, A., & Hansen, J. H. L. (2017) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2017.2678164 · Cited by 41
Tu, M., & Wang, B. (2019) · IEEE Access · doi:10.1109/access.2019.2901929 · Cited by 41
A Survey of Computational Approaches and Challenges in Multimodal Sentiment Analysis
Huddar, M. G., Sannakki, S. S., & Rajpurohit, V. S. (2019) · International Journal of Computer Sciences and Engineering · doi:10.26438/ijcse/v7i1.876883 · Cited by 41
Balahur, A., Boldrini, E., Montoyo, A., & Martínez-Barco, P. (2011) · Cited by 40
An Overview on Image Sentiment Analysis: Methods, Datasets and Current Challenges
Ortis, A., Farinella, G. M., & Battiato, S. (2019) · International Joint Conference on e-Business and Telecommunications (ICETE) · doi:10.5220/0007909602900300 · Cited by 40
Low resource language specific pre-processing and features for sentiment analysis task
Meetei, L. S., Singh, T. D., Borgohain, S. K., & Bandyopadhyay, S. (2021) · Language Resources and Evaluation · doi:10.1007/s10579-021-09541-9 · Cited by 40
Self-citationExploiting objective text description of images for visual sentiment analysis
Ortis, A., Farinella, G. M., Torrisi, G., & Battiato, S. (2020) · Multimedia Tools and Applications · doi:10.1007/s11042-019-08312-7 · Cited by 36
Why We Watch the News: A Dataset for Exploring Sentiment in Broadcast Video News
Ellis, J. G., Jou, B., & Chang, S. (2014) · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · doi:10.1145/2663204.2663237 · Cited by 35
Financial Aspect-Based Sentiment Analysis using Deep RepresentationsPreprint
Yang, S. Y., Rosenfeld, J., & Makutonin, J. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1808.07931 · Cited by 30
The effect of whitening transformation on pooling operations in convolutional autoencoders
Li, Z., Fan, Y., & Liu, W. (2015) · EURASIP Journal on Advances in Signal Processing · doi:10.1186/s13634-015-0222-1 · Cited by 27
Towards using visual attributes to infer image sentiment of social events
Ahsan, U., Choudhury, M. D., & Essa, I. A. (2017) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2017.7966013 · Cited by 27
Deep sentiment hashing for text retrieval in social CIoT
Zhou, K., Zeng, J., Liu, Y., & Zou, F. (2018) · Future Generation Computer Systems · doi:10.1016/j.future.2018.03.047 · Cited by 26
Multi-Modal Embeddings Using Multi-Task Learning for Emotion Recognition
Khare, A., Parthasarathy, S., & Sundaram, S. (2020) · Interspeech (USB) · doi:10.21437/interspeech.2020-1827 · Cited by 26
2017 Tenth International Conference on Contemporary Computing (IC3)
(2017) · doi:10.1109/ic341648.2017 · Cited by 26
Cross-Modality Transfer Learning for Image-Text Information Management
Niu, S., Jiang, Y., Chen, B., Wang, J., Liu, Y., & Song, H. (2021) · ACM Transactions on Management Information Systems · doi:10.1145/3464324 · Cited by 22
A roadmap towards implementing parallel aspect level sentiment analysis
Basha, S. M., & Rajput, D. S. (2019) · Multimedia Tools and Applications · doi:10.1007/s11042-018-7093-z · Cited by 19
Clustering Aspect-related Phrases by Leveraging Sentiment Distribution Consistency
Li, Z., Huang, M., Chen, H., Cheng, J., & Zhu, X. (2014) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1169 · Cited by 17
2017 International Conference on Green Informatics (ICGI)
(2017) · doi:10.1109/icgi41732.2017 · Cited by 15
Sentiment retrieval on web reviews using spontaneous natural speech
Pereira, J. C., Luque, J., & Anguera, X. (2014) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2014.6854470 · Cited by 12
Improved multimodal sentiment detection using stressed regions of audio
Abburi, H., Shrivastava, M., & Gangashetty, S. V. (2016) · IEEE Region 10 Conference (TENCON) · doi:10.1109/tencon.2016.7848560 · Cited by 11
Review Comments of Manipuri Online Video: Good, Bad or Ugly
Singh, T. D., Singh, T. J., Shadang, M., & Thokchom, S. (2021) · Lecture notes in networks and systems · doi:10.1007/978-981-33-4084-8_5 · Cited by 10
Self-citationMOCA: Multi-Objective, Collaborative, and Attentive Sentiment Analysis
Zhang, J.-D., & Chow, C.-Y. (2019) · IEEE Access · doi:10.1109/access.2019.2891019 · Cited by 9
Convolutional Transformer with Sentiment-aware Attention for Sentiment Analysis
Li, P., Zhong, P., Zhang, J., & Mao, K. (2020) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn48605.2020.9206796 · Cited by 9
Efficient Multi-Modal Embeddings from Structured DataPreprint
Verő, A. L., & Copestake, A. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.02577 · Cited by 7
AudioSentibank: Large-scale Semantic Ontology of Acoustic Concepts for Audio Content Analysis.Preprint
Säger, S., Borth, D., Elizalde, B., Schulze, C., Raj, B., Lane, I. R., & Dengel, A. R. (2016) · arXiv (Cornell University) · Cited by 5
Cited by
Recent advancements and challenges of NLP-based sentiment analysis: A state-of-the-art review
Jim, J. R., Talukder, M. A. R., Malakar, P., Kabir, M. M., Nur, K., & Mridha, M. F. (2024) · Natural Language Processing Journal · doi:10.1016/j.nlp.2024.100059 · Cited by 297
Ask in Any Modality: A Comprehensive Survey on Multimodal Retrieval-Augmented Generation
Abootorabi, M. M., Zobeiri, A., Dehghani, M., Mohammadkhani, M., Mohammadi, B., Ghahroodi, O., Baghshah, M. S., & Asgari, E. (2025) · Findings of the Association for Computational Linguistics: ACL 2025 · doi:10.18653/v1/2025.findings-acl.861 · Cited by 76
Metadata
- Authors
- Das, R., & Singh, T. D.
- Venue
- ACM Computing Surveys
- Published
- 2023-07-13
- Volume
- 55
- Issue
- 13s
- Pages
- 1-38
- ISSN
- 0360-0300 (ISSN-L)
- 1557-7341
- OpenAlex
- W4322736091
- Cited by
- 363
- References
- 153
- FWCI
- 31.89
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.