Multimodal Sentiment Detection Based on Multi-channel Graph Neural Networks
Open accessAbstract
Xiaocui Yang, Shi Feng, Yifei Zhang, Daling Wang. Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers). 2021.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The text we found for this paper looks like another document, so the self-check wasn’t run.
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474 · see citing works
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404 · see citing works
Jakubův, J., Chvalovský, K., Goertzel, Z., et al. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.itp.2023.19 · Cited by 76,648 · see citing works
Glove: Global Vectors for Word Representation
Pennington, J., Socher, R., & Manning, C. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1162 · Cited by 34,071 · see citing works
Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation
Cho, K., van Merrienboer, B., Gulcehre, C., Bahdanau, D., Bougares, F., Schwenk, H., & Bengio, Y. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1179 · Cited by 25,545 · see citing works
Semi-supervised classification with graph convolutional networks
Kipf, T. N., & Welling, M. (2016) · arXiv · doi:10.48550/arxiv.1609.02907 · Cited by 24,853 · see citing works
YOLOv3: An Incremental Improvement
Redmon, J., & Farhadi, A. (2018) · arXiv · doi:10.48550/arxiv.1804.02767 · Cited by 17,141 · see citing works
Convolutional Neural Networks for Sentence Classification
Kim, Y. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1181 · Cited by 14,831 · see citing works
A Multi-Modal Distributed Real-Time IoT System for Urban Traffic Control (Invited Paper)
Khanam, Z., Achari, V. P. S., Boukhennoufa, I., et al. (2024) · Durham Research Online (Durham University) · doi:10.4230/oasics.ng-res.2024.2 · Cited by 14,048 · see citing works
Neural Message Passing for Quantum ChemistryPreprint
Gilmer, J., Schoenholz, S. S., Riley, P. F., Vinyals, O., & Dahl, G. E. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1704.01212 · Cited by 5,414 · see citing works
Places: A 10 Million Image Database for Scene Recognition
Zhou, B., Lapedriza, A., Khosla, A., Oliva, A., & Torralba, A. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2723009 · Cited by 4,042 · see citing works
GQA: A New Dataset for Real-World Visual Reasoning and Compositional Question Answering
Hudson, D. A., & Manning, C. D. (2019) · Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2019.00686 · Cited by 3,703 · see citing works
Recurrent Convolutional Neural Networks for Text Classification
Lai, S., Xu, L., Liu, K., & Zhao, J. (2015) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v29i1.9513 · Cited by 2,365 · see citing works
Graph Convolutional Networks for Text Classification
Yao, L., Mao, C., & Luo, Y. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33017370 · Cited by 2,171 · see citing works
Attention-Based Bidirectional Long Short-Term Memory Networks for Relation Classification
Zhou, P., Shi, W. Y., Tian, J., Qi, Z., Li, B., Hao, H., & Xu, B. (2016) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p16-2034 · Cited by 2,108 · see citing works
Deep learning for sentiment analysis: A survey
Zhang, L., Wang, S., & Liu, B. (2018) · Wiley Interdisciplinary Reviews Data Mining and Knowledge Discovery · doi:10.1002/widm.1253 · Cited by 2,058 · see citing works
Multi-Label Image Recognition With Graph Convolutional Networks
Chen, Z.-M., Wei, X.-S., Wang, P., & Guo, Y. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00532 · Cited by 1,339 · see citing works
Hierarchical Question-Image Co-Attention for Visual Question AnsweringPreprint
Lu, J., Yang, J., Batra, D., & Parikh, D. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1606.00061 · Cited by 1,303 · see citing works
MISA: Modality-Invariant and -Specific Representations for Multimodal Sentiment Analysis
Hazarika, D., Zimmermann, R., & Poria, S. (2020) · Proceedings of the 28th ACM International Conference on Multimedia · doi:10.1145/3394171.3413678 · Cited by 1,073 · see citing works
A survey of multimodal sentiment analysis
Soleymani, M., García, D., Jou, B., Schuller, B. W., Chang, S., & Pantić, M. (2017) · Image and Vision Computing · doi:10.1016/j.imavis.2017.08.003 · Cited by 620 · see citing works
A survey of sentiment analysis in social media
Yue, L., Chen, W., Li, X., Zuo, W., & Yin, M. (2018) · Knowledge and Information Systems · doi:10.1007/s10115-018-1236-4 · Cited by 594 · see citing works
Hierarchical Question-Image Co-Attention for Visual Question Answering
Lu, J. (2024) · TIB Data Manager · doi:10.57702/uhdmfu1r · Cited by 357 · see citing works
Text Level Graph Neural Network for Text Classification
Huang, L., Ma, D., Li, S., Zhang, X., & Wang, H. (2019) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d19-1345 · Cited by 338 · see citing works
Biometric Face Presentation Attack Detection With Multi-Channel Convolutional Neural Network
George, A., Mostaani, Z., Geissenbuhler, D., Nikisins, O., Anjos, A., & Marcel, S. (2019) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2019.2916652 · Cited by 308 · see citing works
Tensor Graph Convolutional Networks for Text Classification
Liu, X., You, X., Zhang, X., Wu, J. Y., & Lv, P. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i05.6359 · Cited by 299 · see citing works
Image-Text Multimodal Emotion Classification via Multi-View Attentional Network
Yang, X., Feng, S., Wang, D., & Zhang, Y. (2020) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2020.3035277 · Cited by 273 · see citing works
Self-citationSentiment Analysis on Multi-View Social Data
Niu, T., Zhu, S., Pang, L., & Saddik, A. E. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-27674-8_2 · Cited by 272 · see citing works
(2013) · Cited by 236 · see citing works
You, Q., Luo, J., Jin, H., & Yang, J. (2016) · ACM International Conference on Web Search and Data Mining (WSDM) · doi:10.1145/2835776.2835779 · Cited by 195 · see citing works
Fake News Detection via Knowledge-driven Multimodal Graph Convolutional Networks
Wang, Y., Qian, S., Hu, J., Fang, Q., & Xu, C. (2020) · International Conference on Multimedia Retrieval · doi:10.1145/3372278.3390713 · Cited by 190 · see citing works
Xu, N., & Mao, W. (2017) · doi:10.1145/3132847.3133142 · Cited by 185 · see citing works
A Co-Memory Network for Multimodal Sentiment Analysis
Xu, N., Mao, W., & Chen, G. (2018) · doi:10.1145/3209978.3210093 · Cited by 182 · see citing works
TransModality: An End2End Fusion Method with Transformer for Multimodal Sentiment Analysis
Wang, Z., Wan, Z., & Wan, X. (2020) · Proceedings of The Web Conference 2020 · doi:10.1145/3366423.3380000 · Cited by 156 · see citing works
George, A., & Marcel, S. (2020) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2020.3013214 · Cited by 122 · see citing works
Analyzing multimodal public sentiment based on hierarchical semantic attentional network
Xu, N. (2017) · IEEE International Conference on Intelligence and Security Informatics (ISI) · doi:10.1109/isi.2017.8004895 · Cited by 109 · see citing works
Kaur, R., & Kautish, S. (2019) · International Journal of Service Science Management Engineering and Technology · doi:10.4018/ijssmet.2019040103 · Cited by 73 · see citing works
Iterative Context-Aware Graph Inference for Visual Dialog
Guo, D., Wang, H., Zhang, H., Zha, Z.-J., & Wang, M. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.01007 · Cited by 57 · see citing works
KBGN: Knowledge-Bridge Graph Network for Adaptive Vision-Text Reasoning in Visual Dialogue
Jiang, X., Du, S., Qin, Z.-C., Sun, Y., & Yu, J. (2020) · ACM Multimedia · doi:10.1145/3394171.3413826 · Cited by 42 · see citing works
Multimodal Neural Graph Memory Networks for Visual Question Answering
Khademi, M. (2020) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2020.acl-main.643 · Cited by 34 · see citing works
Multi-Channel Convolutional Neural Network for Twitter Emotion and Sentiment Recognition
Islam, J., Mercer, R. E., & Xiao, L. (2019) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n19-1137 · Cited by 28 · see citing works
Zhang, D., Li, S., Zhu, Q., & Zhou, G. (2020) · IEEE Access · doi:10.1109/access.2020.2969205 · Cited by 28 · see citing works
Chen, T., Wang, Z., Li, L., Li, D., Li, Z., Chang, X., Bian, P., Liang, G., Wang, Q., & Xie, T. (2025) · Schloss Dagstuhl – Leibniz-Zentrum für Informatik · doi:10.4230/lipics.ecoop.2025.6
Flagged first, then by citations
Cited by
Sorted by citations
Multimodal learning with transformers: A survey
Xu, P., Zhu, X., & Clifton, D. A. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3275156 · Cited by 1,072 · see citing works
Multi-Modal Sarcasm Detection via Cross-Modal Graph Convolutional Network
Liang, B., Lou, C., Li, X., Yang, M., Gui, L., He, Y., Pei, W., & Xu, R. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.124 · Cited by 170 · see citing works
Vision-Language Pre-Training for Multimodal Aspect-Based Sentiment Analysis
Yan, L., Yu, J., & Xia, R. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.152 · Cited by 162 · see citing works
CLMLF:A Contrastive Learning and Multi-Layer Fusion Method for Multimodal Sentiment Detection
Li, Z., Xu, B. H., Zhu, C., & Zhao, T. (2022) · Findings of the Association for Computational Linguistics: NAACL · doi:10.18653/v1/2022.findings-naacl.175 · Cited by 149 · see citing works
Targeted Multimodal Sentiment Classification based on Coarse-to-Fine Grained Image-Target Matching
Yu, J., Wang, J., Xia, R., & Li, J. (2022) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2022/622 · Cited by 67 · see citing works
Wei, Y., Yuan, S., Yang, R., Shen, L., Li, Z., Wang, L., & Chen, M. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.287 · Cited by 59 · see citing works
A multimodal fusion network with attention mechanisms for visual–textual sentiment analysis
Gan, C., Fu, X., Feng, Q., Zhu, Q., Cao, Y., & Zhu, Y. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.122731 · Cited by 63 · see citing works
Liang, B., Gui, L., He, Y., Cambria, E., & Xu, R. (2024) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2024.3380375 · Cited by 58 · see citing works
Joint multimodal sentiment analysis based on information relevance
Chen, D., Su, W., Wu, P., & Hua, B. (2022) · Information Processing & Management · doi:10.1016/j.ipm.2022.103193 · Cited by 56 · see citing works
A Survey of Multimodal Fake News Detection: A Cross-Modal Interaction Perspective
Li, X., Qiao, J., Yin, S., Wu, L., Gao, C., Wang, Z., & Li, X. (2025) · IEEE Transactions on Emerging Topics in Computational Intelligence · doi:10.1109/tetci.2025.3543389 · Cited by 54 · see citing works
Multimodal sentiment analysis based on multiple attention
Wang, H., Ren, C., & Yu, Z. (2024) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2024.109731 · Cited by 53 · see citing works
Unified Multi-modal Pre-training for Few-shot Sentiment Analysis with Prompt-based Learning
Yu, Y., Zhang, D., & Li, S. (2022) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3503161.3548306 · Cited by 47 · see citing works
Few-Shot Multi-Modal Sentiment Analysis with Prompt-Based Vision-Aware Language Modeling
Yu, Y., & Zhang, D. (2022) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme52920.2022.9859654 · Cited by 43 · see citing works
Al-Tameemi, I. K. S., Feizi‐Derakhshi, M., Pashazadeh, S., & Asadpour, M. (2023) · IEEE Access · doi:10.1109/access.2023.3307716 · Cited by 42 · see citing works
Multimodal fusion and vision–language models: A survey for robot vision
Han, X., Chen, S., Fu, Z., Feng, Z., Fan, L., An, D., Wang, C., Guo, L., Meng, W., Zhang, X., et al. (2026) · Information Fusion · doi:10.1016/j.inffus.2025.103652 · Cited by 41 · see citing works
“In addition, models such as MGA [74] and MGNNS [75] demonstrate that heterogeneous GNNs and multi-channel architectures can effectively bridge structural and semantic modality gaps by integrating multimodal graph representations.”
Few-shot Joint Multimodal Aspect-Sentiment Analysis Based on Generative Multimodal Prompt
Yang, X., Shi, F., Wang, D., Sun, Q., Wu, W., Zhang, Y., Hong, P., & Poria, S. (2023) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2023.findings-acl.735 · Cited by 44 · see citing works
Self-citationA comprehensive review of visual–textual sentiment analysis from social media networks
Al-Tameemi, I. K. S., Feizi‐Derakhshi, M., Pashazadeh, S., & Asadpour, M. (2024) · Journal of Computational Social Science · doi:10.1007/s42001-024-00326-y · Cited by 50 · see citing works
Wang, Q., Xu, H., Wen, Z., Liang, B., Yang, M., Qin, B., & Xu, R. (2023) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2023.3333200 · Cited by 39 · see citing works
Multimodal sentiment analysis based on cross-instance graph neural networks
Wang, H., Ren, C., & Yu, Z. (2024) · Applied Intelligence · doi:10.1007/s10489-024-05309-0 · Cited by 38 · see citing works
Wang, H., Li, X., Ren, Z., Wang, M., & Ma, C. (2023) · Sensors · doi:10.3390/s23052679 · Cited by 37 · see citing works
Fact-sentiment incongruity combination network for multimodal sarcasm detection
Lu, Q., Long, Y., Sun, X., Feng, J. H., & Zhang, H. (2023) · Information Fusion · doi:10.1016/j.inffus.2023.102203 · Cited by 36 · see citing works
Li, Z., Zhang, L., Zhang, K., Zhang, Y., & Mao, Z. (2024) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2024.3358411 · Cited by 39 · see citing works
Self-citationAffective Region Recognition and Fusion Network for Target-Level Multimodal Sentiment Classification
Jia, L., Ma, T., Rong, H., & Al-Nabhan, N. (2023) · IEEE Transactions on Emerging Topics in Computing · doi:10.1109/tetc.2022.3231746 · Cited by 35 · see citing works
Multimodal Emotion Classification With Multi-Level Semantic Reasoning Network
Zhu, T., Li, L., Yang, J., Zhao, S., & Xiao, X. (2022) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2022.3214989 · Cited by 35 · see citing works
Integrating color cues to improve multimodal sentiment analysis in social media
An, J., & Zainon, W. M. N. W. (2023) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2023.106874 · Cited by 28 · see citing works
Phukan, A., Pal, S., & Ekbal, A. (2024) · IEEE Transactions on Computational Social Systems · doi:10.1109/tcss.2024.3388016 · Cited by 28 · see citing works
Crossmodal Translation Based Meta Weight Adaption for Robust Image-Text Sentiment Analysis
Zhang, B., Yuan, Z., Xu, H., & Gao, K. (2024) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2024.3405662 · Cited by 23 · see citing works
A graph convolution-based heterogeneous fusion network for multimodal sentiment analysis
Zhao, T., Peng, J., Huang, Y., Wang, L., Zhang, H., & Cai, Z. (2023) · Applied Intelligence · doi:10.1007/s10489-023-05151-w · Cited by 23 · see citing works
Yang, X., Wu, W., Feng, S., Wang, M., Wang, D., Li, Y., Sun, Q., Zhang, Y., Fu, X., & Poria, S. (2025) · Information Fusion · doi:10.1016/j.inffus.2025.103204 · Cited by 26 · see citing works
Self-citationGPT-4V(ision) as A Social Media Analysis Engine
Lyu, H., Huang, J., Zhang, D., Yu, Y., Mou, X., Pan, J., Yang, Z., Wei, Z., & Luo, J. (2024) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3709005 · Cited by 34 · see citing works
Fine-Grained Multimodal DeepFake Classification via Heterogeneous Graphs
Yin, Q., Lu, W., Cao, X., Luo, X., Zhou, Y., & Huang, J. (2024) · International Journal of Computer Vision · doi:10.1007/s11263-024-02128-1 · Cited by 23 · see citing works
Social Image–Text Sentiment Classification With Cross-Modal Consistency and Knowledge Distillation
Liu, H., Li, K., Jianping Fan, B., Yan, C., Qin, T., & Zheng, Q. (2022) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2022.3220762 · Cited by 20 · see citing works
Dominant SIngle-Modal SUpplementary Fusion (SIMSUF) for Multimodal Sentiment Analysis
Huang, J., Ji, Y., Qin, Z., Yang, Y., & Shen, H. T. (2023) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2023.3344358 · Cited by 19 · see citing works
Image–Text Sentiment Analysis Via Context Guided Adaptive Fine-Tuning Transformer
Xiao, X., Pu, Y., Zhao, Z., Nie, R., Xu, D., Qian, W., & Wu, H. (2022) · Neural Processing Letters · doi:10.1007/s11063-022-11124-w · Cited by 19 · see citing works
Cross-modality Representation Interactive Learning for Multimodal Sentiment Analysis
Huang, J., Ji, Y., Yang, Y., & Shen, H. T. (2023) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3581783.3612295 · Cited by 17 · see citing works
Wan, Y., Chen, Y., Lin, J., Zhong, J., & Dong, C. (2023) · Computer Speech & Language · doi:10.1016/j.csl.2023.101587 · Cited by 17 · see citing works
Multimodal sentiment analysis method based on image-text quantum transformer
Wu, H., Kong, D., Wang, L., Li, D., Zhang, J., & Han, Y. (2025) · Neurocomputing · doi:10.1016/j.neucom.2025.130107 · Cited by 17 · see citing works
Guo, Q., Liao, Y., Li, Z., & Liang, S. (2023) · Entropy · doi:10.3390/e25101421 · Cited by 16 · see citing works
Liu, Y., Ding, X., Chi, M., Wu, J., & Ma, L. (2023) · Information Technology & Tourism · doi:10.1007/s40558-023-00280-x · Cited by 16 · see citing works
Wang, H., Du, Q., & Xiang, Y. (2025) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2025.110262 · Cited by 15 · see citing works
Multi-Modal Sarcasm Detection via Knowledge-Aware Focused Graph Convolutional Networks
Zhuang, X., Zhou, F., & Li, Z. (2025) · ACM Transactions on Multimedia Computing Communications and Applications · doi:10.1145/3722115 · Cited by 14 · see citing works
Modality-Dependent Sentiments Exploring for Multi-Modal Sentiment Classification
Li, J., Wang, C., Luo, Z., Wu, Y., & Jiang, X. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10445820 · Cited by 13 · see citing works
Multi-grained feature gating fusion network for multimodal sentiment analysis
Yu, B., Li, C., & Shi, Z. (2025) · Knowledge and Information Systems · doi:10.1007/s10115-025-02446-x · Cited by 13 · see citing works
Multi-layer cross-modality attention fusion network for multimodal sentiment analysis
Yin, Z., Du, Y., Liu, Y., & Wang, Y. (2024) · Multimedia Tools and Applications · doi:10.1007/s11042-023-17685-9 · Cited by 13 · see citing works
Dong, S., Fan, X., & Ma, X. (2024) · Neural Processing Letters · doi:10.1007/s11063-024-11641-w · Cited by 12 · see citing works
Cross-Domain Sentiment Analysis via Disentangled Representation and Prototypical Learning
Wang, Q., Wen, Z., Ding, K., Liang, B., & Xu, R. (2024) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2024.3431946 · Cited by 12 · see citing works
Survey of Multimodal Sentiment Analysis Based on Deep Learning
Zhang, J., Xue, S., Wang, X., & Liu, J. (2023) · IEEE International Conference on Cloud Computing and Intelligence Systems (CCIS) · doi:10.1109/ccis59572.2023.10263012 · Cited by 12 · see citing works
A Social Media Dataset and H-GNN-Based Contrastive Learning Scheme for Multimodal Sentiment Analysis
Peng, J., He, Y., Chang, Y., Lu, Y., Zhang, P., Ou, Z., & Yu, Q. (2025) · Applied Sciences · doi:10.3390/app15020636 · Cited by 11 · see citing works
Two-stage Attention-based Fusion Neural Network for Image-Text Sentiment Classification
Hu, X., & Yamamura, M. (2022) · International Conference on Image, Video and Signal Processing (IVSP) · doi:10.1145/3531232.3531233 · Cited by 10 · see citing works
Holistic Visual-Textual Sentiment Analysis with Prior Models
Chen, J., An, J., Lyu, H., Kanan, C., & Luo, J. (2024) · IEEE International Conference on Multimedia Information Processing and Retrieval (MIPR) · doi:10.1109/mipr62202.2024.00037 · Cited by 10 · see citing works
Multi-granularity visual-textual jointly modeling for aspect-level multimodal sentiment analysis
Chen, Y., Shi, L., Lin, J., Chen, J., Zhong, J., & Dong, C. (2024) · The Journal of Supercomputing · doi:10.1007/s11227-024-06567-y · Cited by 9 · see citing works
Improving multimodal sentiment prediction through vision-language feature interaction
An, J., Ding, B., & Zainon, W. M. N. W. (2025) · Multimedia Systems · doi:10.1007/s00530-024-01659-4 · Cited by 11 · see citing works
Multiple Contrastive Learning for Multimodal Sentiment Analysis
Yang, X., Feng, S., Wang, D., Hong, P., & Poria, S. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10096777 · Cited by 9 · see citing works
Self-citationFeature-guided Multimodal Sentiment Analysis towards Industry 4.0
Yu, B., Wei, J., Yu, B., Cai, X., Wang, K., Sun, H., Bu, L., & Chen, X. (2022) · Computers & Electrical Engineering · doi:10.1016/j.compeleceng.2022.107961 · Cited by 9 · see citing works
BIT: Improving Image-text Sentiment Analysis via Learning Bidirectional Image-text Interaction
Xiao, X., Pu, Y., Zhao, Z., Gu, J., & Xu, D. (2023) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn54540.2023.10191445 · Cited by 8 · see citing works
SSMIM: Semi-supervised Multimodal Interaction Model for real-time conversational emotion recognition
Liu, H., & Zhong, K. (2025) · The Journal of Supercomputing · doi:10.1007/s11227-025-07373-w · Cited by 8 · see citing works
Multi-Modal Emotion Recognition for Online Education Using Emoji Prompts
Qin, X., Zhou, Y., & Li, J. (2024) · Applied Sciences · doi:10.3390/app14125146 · Cited by 6 · see citing works
Transformer-based short-term memory attention for enhanced multimodal sentiment analysis
Shao, D., Tang, K., Li, J., Yi, S., & Ma, L. (2025) · The Visual Computer · doi:10.1007/s00371-025-03883-z · Cited by 6 · see citing works
Semantic Interaction Fusion Framework for Multimodal Sentiment Recognition
Yang, S., Cui, L., & Wang, T. (2023) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/smc53992.2023.10394433 · Cited by 6 · see citing works
Adaptive multimodal prompt-tuning model for few-shot multimodal sentiment analysis
Xiang, Y., Zhang, A., Guo, J., & Huang, Y. (2025) · International Journal of Machine Learning and Cybernetics · doi:10.1007/s13042-025-02549-5 · Cited by 7 · see citing works
CLIP-driven attention network for multimodal sentiment analysis
Lv, J., Yang, Q., Tian, S., Liu, B., & Yu, L. (2025) · The Journal of Supercomputing · doi:10.1007/s11227-025-07411-7 · Cited by 6 · see citing works
Deep Learning Approaches on Multimodal Sentiment Analysis
Cai, Z., Gao, H., Li, J., & Wang, X. (2022) · IEEE International Conference on Electrical Engineering, Big Data and Algorithms (EEBDA) · doi:10.1109/eebda53927.2022.9745018 · Cited by 6 · see citing works
Hou, S., Tuerhong, G., & Wushouer, M. (2023) · Sensors · doi:10.3390/s23104829 · Cited by 6 · see citing works
A Sentimental Prompt Framework with Visual Text Encoder for Multimodal Sentiment Analysis
Huang, S., Xu, B., Li, C., Ye, J., & Lin, X. A. (2024) · International Conference on Multimedia Retrieval · doi:10.1145/3652583.3658115 · Cited by 7 · see citing works
Multimodal sarcasm detection based on sentiment-clue inconsistency global detection fusion network
Xi, Z., Yu, B., & Wang, H. (2025) · Expert Systems with Applications · doi:10.1016/j.eswa.2025.127020 · Cited by 5 · see citing works
Yan, K., Lai, P., Zheng, X., Yang, Y., Ren, Y. C., Badarch, T., & Chen, Y. (2025) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2025.112923 · Cited by 6 · see citing works
Semantic enhancement and cross-modal interaction fusion for sentiment analysis in social media
Mu, G., Chen, Y., Li, X., Li, D., & Dai, J. (2025) · PLoS ONE · doi:10.1371/journal.pone.0321011 · Cited by 5 · see citing works
Momentum Distillation Improves Multimodal Sentiment Analysis
Li, S., Deng, W., & Hu, J. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-18907-4_33 · Cited by 5 · see citing works
Heterogeneous Graph Learning for Acoustic Event Classification
Shirian, A., Ahmadian, M., Somandepalli, K., & Guha, T. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10095073 · Cited by 5 · see citing works
Video Games as a Corpus: Sentiment Analysis using Fallout New Vegas Dialog
Hämäläinen, M. K., Alnajjar, K., & Poibeau, T. (2022) · International Conference on the Foundations of Digital Games (FDG) · doi:10.1145/3555858.3555930 · Cited by 5 · see citing works
Cross-Modality Fused Graph Convolutional Network for Image-Text Sentiment Analysis
Tan, Q., Shen, X., Bai, Z., & Sun, Y. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-46314-3_32 · Cited by 5 · see citing works
MOC: Multi-modal Sentiment Analysis via Optimal Transport and Contrastive Interactions
Li, Y., Zhu, Q., He, H., Gu, Z., & Zheng, C. (2023) · Lecture notes in computer science · doi:10.1007/978-981-99-8082-6_34 · Cited by 5 · see citing works
An, J., Ding, B., & Jiang, N. (2026) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2026.114058 · Cited by 4 · see citing works
Cross-Modal Hierarchical Knowledge Distillation for Image Aesthetics Assessment
Chen, H., Shao, F., Jing, W., Wang, H., & Jiang, Q. (2024) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2024.3521765 · Cited by 4 · see citing works
Visually-aware Acoustic Event Detection using Heterogeneous Graphs
Shirian, A., Somandepalli, K., Sánchez, V., & Guha, T. (2022) · Interspeech (USB) · doi:10.21437/interspeech.2022-10670 · Cited by 4 · see citing works
Multi-Task Supervised Alignment Pre-Training for Few-Shot Multimodal Sentiment Analysis
Yang, J., Cao, J., & Duan, C. (2025) · Applied Sciences · doi:10.3390/app15042095 · Cited by 4 · see citing works
Multimodal Alignment and Hierarchical Fusion Network for Multimodal Sentiment Analysis
Huang, J., Li, H., & Mo, X. (2025) · Electronics · doi:10.3390/electronics14193828 · Cited by 3 · see citing works
Chang, Y., Li, Z., Ruan, Y., & Yin, G. (2026) · Big Data and Cognitive Computing · doi:10.3390/bdcc10010023 · Cited by 4 · see citing works
MPNAS: Multimodal Sentiment Analysis Pruning via Neural Architecture Search
Zhang, B., Ren, A., Zhang, Z., Duan, M., Liu, D., Tan, Y., & Zhong, K. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10887670 · Cited by 3 · see citing works
Gupta, A., Mittal, A., & Jain, R. (2025) · Information Fusion · doi:10.1016/j.inffus.2025.103266 · Cited by 3 · see citing works
Multi-Modal Graph-Based Sentiment Analysis via Hybrid Contrastive Learning
Zhang, J. (2024) · IEEE International Conference on Sensors, Electronics and Computer Engineering (ICSECE) · doi:10.1109/icsece61636.2024.10729439 · Cited by 3 · see citing works
Quantum-inspired multimodal fusion with Lindblad master equation for sentiment analysis
Yan, K., Lai, P., Yang, Y., Ren, Y., Badarch, T., Chen, Y., & Zheng, X. (2025) · Neurocomputing · doi:10.1016/j.neucom.2025.130710 · Cited by 3 · see citing works
Multimodal Affect Perception With Large Language Model Enhancement Network
Yang, K., Luo, Y., Zhang, Z., Chen, C. L. P., & Zhang, T. (2025) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2025.3607727 · Cited by 2 · see citing works
FADD-Net:Multimodal Sentiment Analysis Based on Feature Alignment and Differential Decoupling
Zhang, J., Zhang, S., Liu, J., Wen, H., Zhang, Y., & Chen, M. (2025) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn64981.2025.11228674 · Cited by 2 · see citing works
Self-citationFew-Shot Multimodal Sentiment Analysis Based on Dynamic Adjustment and Contrastive Learning
Wang, H., Liu, S., & Xie, N. (2026) · Journal of Advanced Computational Intelligence and Intelligent Informatics · doi:10.20965/jaciii.2026.p0472 · Cited by 2 · see citing works
AutoAMS: Automated attention-based multi-modal graph learning architecture search
Al-Sabri, R., Gao, J., Chen, J., Olouladé, B. M., & Wu, Z. (2024) · Neural Networks · doi:10.1016/j.neunet.2024.106427 · Cited by 3 · see citing works
Kavitha., A., Aishwarya, B., & Durgagowri, G. (2025) · International Conference on Multi-Agent Systems for Collaborative Intelligence (ICMSCI) · doi:10.1109/icmsci62561.2025.10894282 · Cited by 2 · see citing works
A Multimodal Sentiment Analysis Model for Graphic Texts Based on Deep Feature Interaction Networks
Chang, W., & Zhang, D. (2024) · International Journal of Ambient Computing and Intelligence · doi:10.4018/ijaci.355192 · Cited by 1 · see citing works
A Novel MLLMs-Based Two-Stage Model for Zero-Shot Multimodal Sentiment Analysis
Lu, H., & Li, X.-F. (2024) · Lecture notes in computer science · doi:10.1007/978-981-96-0119-6_41 · Cited by 1 · see citing works
An Image-Text Sentiment Analysis Method for Small Samples Based on Image Captioning
Chen, S. (2024) · Highlights in Science Engineering and Technology · doi:10.54097/xsrhp326 · Cited by 1 · see citing works
MC-GNN: Multi-Channel Graph Neural Networks With Hilbert-Schmidt Independence Criterion
Cui, S., Li, D., & Zhang, J. (2024) · IEEE Transactions on Big Data · doi:10.1109/tbdata.2024.3522817 · Cited by 2 · see citing works
Two-Stage Multi-Modal Prompt Tuning for Few-Shot Sentiment Analysis
Gu, J., & Niu, H. (2024) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/smc54092.2024.10831782 · Cited by 1 · see citing works
MSAF: Multimodal Sentiment Detection via Multiscale Adaptive Fusion
Guan, J., Shu, Y., Liu, W., Li, W., Zhou, S., & Zhang, Y. (2025) · IEEE Transactions on Artificial Intelligence · doi:10.1109/tai.2025.3602409 · Cited by 1 · see citing works
Self-citationCross-Hierarchical Multimodal Sentiment Analysis for Mental State Monitoring
Yuan, W., Liu, Y., Gao, D., & Shi, Y. (2025) · International Conference on Computer Information Science and Application Technology (CISAT) · doi:10.1109/cisat66811.2025.11181716 · Cited by 1 · see citing works
Image-Text Sentiment Analysis Using Modality Adaption and Multi-Broad Learning
Deng, C., Yu, J., Peng, S., Huang, Q., & Cao, L. (2025) · Tsinghua Science & Technology · doi:10.26599/tst.2025.9010152 · Cited by 1 · see citing works
Sahoo, R. K., Kumar, V., & Dash, S. (2025) · Lecture notes in networks and systems · doi:10.1007/978-981-96-8639-1_5 · Cited by 1 · see citing works
A Review of Multimodal Sentiment Analysis in Online Public Opinion Monitoring
Liu, S., & Li, T. (2026) · Informatics · doi:10.3390/informatics13010010 · Cited by 1 · see citing works
Multimodal Cross-Attention Graph Network for Desire Detection
Gu, R., Wang, X., & Yang, Q. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-44216-2_42 · Cited by 1 · see citing works
Multimodal Sentiment Analysis With Image-Text Correlation Modal
Li, Y., Jiang, S. L., & Chaomurilige, C. (2023) · IEEE International Conference on Internet of Things (iThings) and IEEE Green Computing and Communications (GreenCom) and IEEE Cyber, Physical and Social Computing (CPSCom) and IEEE Smart Data (SmartData) · doi:10.1109/ithings-greencom-cpscom-smartdata-cybermatics60724.2023.00067 · Cited by 1 · see citing works
News-Driven Price Movement Forecasting with Label-Prior Graph Attention
Liu, Y. F., Chen, C.-C., Huang, H., & Chen, H. (2024) · International World Wide Web Conference (WWW) · doi:10.1145/3589335.3651539 · Cited by 1 · see citing works
- Authors
- Yang, X., Feng, S., Zhang, Y., & Wang, D.
- Affiliations
- Northeastern University (CN)
- Venue
- Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers)
- Published
- 2021
- Pages
- 328-339
- OpenAlex
- W3174517569
- Cited by
- 145
- References
- 39
- Citations by year
- 2026: 27 · 2025: 41 · 2024: 33 · 2023: 27 · 2022: 17
- FWCI
- 8.88
- Type
- conference paper
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Funders
- National Natural Science Foundation of China (U1811261, 61872074, 61772122)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Sentiment Analysis and Opinion Mining
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Emotion and Mood Recognition
- Keywords
- sentiment analysis, multimodal fusion, graph neural networks
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review