The DOI matches its Crossref record; 70 of the 70 references it cites were found in a registry or an index.
Quantum-inspired multimodal fusion for video sentiment analysis
Open accessOverview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
XLNet: Generalized Autoregressive Pretraining for Language Understanding
Yang, Z., Dai, Z., Yang, Y., Carbonell, J., Salakhutdinov, R., & Le, Q. V. (2019) · arXiv · doi:10.48550/arxiv.1906.08237 · Cited by 6,687
Lipton, Z. C. (2018) · Queue · doi:10.1145/3236386.3241340 · Cited by 5,427
Quantum Computation and Quantum Information: 10th Anniversary Edition
Nielsen, M. A., & Chuang, I. L. (2011) · Cited by 2,724
Multimodal Transformer for Unaligned Multimodal Language Sequences
Tsai, Y.-H. H., Bai, S., Liang, P. P., Kolter, J. Z., Morency, L.-P., & Salakhutdinov, R. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1656 · Cited by 2,259 · cited 10×
“Multimodal Transformer (MulT) [8] takes a different approach by directly computing the inter-modal representations via the encoder of Transformer [34], resulting in a simpler but better-performed network.”
BackgroundMethodInfluentialTensor Fusion Network for Multimodal Sentiment Analysis
Zadeh, A., Chen, M., Poria, S., Cambria, E., & Morency, L.-P. (2017) · Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d17-1115 · Cited by 2,102
Multimodal Language Analysis in the Wild: CMU-MOSEI Dataset and Interpretable Dynamic Fusion Graph
Bagher Zadeh, A., Liang, P. P., Poria, S., Cambria, E., & Morency, L.-P. (2018) · Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p18-1208 · Cited by 1,433 · cited 6×
“We evaluate our model by comparing it against state-of-the-art (SOTA) baselines on two benchmarking multimodal sentiment analysis datasets, namely CMU-MOSI [25] and CMU-MOSEI [6].”
BackgroundMethodInfluentialEfficient Low-rank Multimodal Fusion With Modality-Specific Factors
Liu, Z., Shen, Y., Lakshminarasimhan, V. B., Liang, P. P., Bagher Zadeh, A., & Morency, L.-P. (2018) · Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p18-1209 · Cited by 1,170
Quantum Models of Cognition and Decision
Busemeyer, J., & Bruza, P. (2012) · Cambridge University Press eBooks · doi:10.1017/cbo9780511997716 · Cited by 1,066
Measures on the Closed Subspaces of a Hilbert Space
Gleason, A. M. (1975) · Springer eBooks · doi:10.1007/978-94-010-1795-4_7 · Cited by 1,011
Memory Fusion Network for Multi-view Sequential Learning
Zadeh, A., Liang, P. P., Mazumder, N., Poria, S., Cambria, E., & Morency, L.-P. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.12021 · Cited by 855
Integrating Multimodal Information in Large Pretrained Transformers
Rahman, W., Hasan, M. K., Lee, S., Zadeh, A. B., Mao, C., Morency, L., & Hoque, M. E. (2020) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2020.acl-main.214 · Cited by 778
Alfredo Cuzzocrea, J. A., Cuzzocrea, A., Allan, J., Paton, N. W., Srivastava, D., Agrawal, R., Broder, A., Zaki, M. J., Selçuk Candan, K., Labrinidis, A., et al. (2006) · doi:10.1145/1183614 · Cited by 756
Vanderwende, L., Daumé, H., & Kirchhoff, K. (2013) · North American Chapter of the Association for Computational Linguistics · Cited by 685
Mathematical Foundations for a Compositional Distributional Model of MeaningPreprint
Coecke, B., Sadrzadeh, M., & Clark, S. (2010) · arXiv.org · doi:10.48550/arxiv.1003.4394 · Cited by 685
Measures on the Closed Subspaces of a Hilbert Space
Gleason, A. M. (1957) · Indiana University Mathematics Journal · doi:10.1512/iumj.1957.6.56050 · Cited by 666
Speaker identification on the SCOTUS corpus
Yuan, J., & Liberman, M. (2008) · The Journal of the Acoustical Society of America · doi:10.1121/1.2935783 · Cited by 610
Axiom: A Householder-Parameterized Pure Unitary RNN for Long-Range Sequence ModelingPreprint
Arjovsky, M., Shah, A., & Bengio, Y. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1511.06464 · Cited by 580
Quantum Models of Cognition and Decision
Busemeyer, J. R., Wang, Z., & Pothos, E. (2015) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780199957996.013.17 · Cited by 550
Pham, H., Liang, P. P., Manzini, T., Morency, L.-P., & Póczos, B. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33016892 · Cited by 512
Words Can Shift: Dynamically Adjusting Word Representations Using Nonverbal Behaviors
Wang, Y., Shen, Y., Liu, Z., Liang, P. P., Zadeh, A., & Morency, L. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33017216 · Cited by 501
The Geometry of Information Retrieval
van Rijsbergen, C. J. (2004) · Cambridge University Press eBooks · doi:10.1017/cbo9780511543333 · Cited by 395
The geometry of information retrieval
(2006) · Choice Reviews Online · doi:10.5860/choice.43-2848 · Cited by 390
MOSI: Multimodal Corpus of Sentiment Intensity and Subjectivity Analysis in Online Opinion Videos
Zadeh, A., Zellers, R., Pincus, E., & Morency, L.-P. (2016) · arXiv · doi:10.48550/arxiv.1606.06259 · Cited by 350
Learning Factorized Multimodal Representations
Tsai, Y.-H. H., Liang, P. P., Zadeh, A., Morency, L.-P., & Salakhutdinov, R. (2018) · arXiv · doi:10.48550/arxiv.1806.06176 · Cited by 323
Axiom: A Householder-Parameterized Pure Unitary RNN for Long-Range Sequence ModelingPreprint
Chaudhary, S. (2026) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.20108465 · Cited by 321
Multimodal Saliency and Fusion for Movie Summarization Based on Aural, Visual, and Textual Attention
Evangelopoulos, G., Zlatintsi, A., Potamianos, A., Maragos, P. A., Rapantzikos, K. E., Σκούμας, Γ., & Avrithis, Y. (2013) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2013.2267205 · Cited by 272
Barzilay, R., & Kan, M.-Y. (2017) · Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p17-1 · Cited by 269
Full-Capacity Unitary Recurrent Neural NetworksPreprint
Wisdom, S., Powers, T., Hershey, J. R., Roux, J. L., & Atlas, L. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.00035 · Cited by 263
Multimodal Language Analysis with Recurrent Multistage Fusion
Liang, P. P., Liu, Z., Bagher Zadeh, A., & Morency, L.-P. (2018) · Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d18-1014 · Cited by 230
Black Holes and White Rabbits: Metaphor Identification with Visual Features
Shutova, E., Kiela, D., & Maillard, J. (2016) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n16-1020 · Cited by 229
Holzinger, A., Kieseberg, P., Weippl, E. R., & Tjoa, A. M. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-99740-7_1 · Cited by 225
Fuzzy commonsense reasoning for multimodal sentiment analysis
Chaturvedi, I., Satapathy, R., Cavallari, S., & Cambria, E. (2019) · Pattern Recognition Letters · doi:10.1016/j.patrec.2019.04.024 · Cited by 171
Mai, S., Hu, H., & Xing, S. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1046 · Cited by 153
Multimodal Machine Learning: A Survey and TaxonomyPreprint
Baltrušaitis, T., Ahuja, C., & Morency, L. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1705.09406 · Cited by 152
Multiple Classifier Systems for the Classification of Audio-Visual Emotional States
Glodek, M., Tschechne, S., Layher, G., Schels, M., Brosch, T., Scherer, S. J., Kächele, M., Schmidt, M., Heiko Neumann, B., Palm, G., et al. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-24571-8_47 · Cited by 135
Modeling term dependencies with quantum language models for IR
Sordoni, A., Nie, J., & Bengio, Y. (2013) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/2484028.2484098 · Cited by 125
Cambria, E., Howard, N., Hsu, J. Y.-J., & Hussain, A. (2013) · IEEE Symposium on Computational Intelligence for Human-like Intelligence (CIHLI) · doi:10.1109/cihli.2013.6613272 · Cited by 123
Affective Computing and Intelligent Interaction
D’Mello, S., Martin, J.-C., Schuller, B., & Graesser, A. C. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-24571-8 · Cited by 122
A quantum-inspired multimodal sentiment analysis framework
Zhang, Y., Song, D., Zhang, P., Wang, P., Li, J., Li, X., & Wang, B. (2018) · Theoretical Computer Science · doi:10.1016/j.tcs.2018.04.029 · Cited by 107
Introduction to Information Retrieval and Quantum Mechanics
Melucci, M. (2015) · The Kluwer international series on information retrieval · doi:10.1007/978-3-662-48313-8 · Cited by 96
Self-citationLearning Representations from Imperfect Time Series Data via Tensor Rank Regularization
Liang, P. P., Liu, Z., Tsai, Y.-H. H., Zhao, Q., Salakhutdinov, R., & Morency, L.-P. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1152 · Cited by 95
Using the Quantum Probability Ranking Principle to Rank Interdependent Documents
Zuccon, G., & Azzopardi, L. A. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-12275-0_32 · Cited by 93
Efficient Low-rank Multimodal Fusion with Modality-Specific FactorsPreprint
Liu, Z., Shen, Y., Lakshminarasimhan, V., Liang, P. P., Zadeh, A., & Morency, L. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1806.00064 · Cited by 80
CNM: An Interpretable Complex-valued Network for Matching
Li, Q., Wang, B., & Melucci, M. (2019) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n19-1420 · Cited by 56
Self-citationMulti-attention Recurrent Network for Human Communication Comprehension
Zadeh, A., Liang, P. P., Poria, S., Vij, P., Cambria, E., & Morency, L. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.12024 · Cited by 49
A Quantum Many-body Wave Function Inspired Language Modeling Approach
Zhang, P., Su, Z., Zhang, L., Wang, B., & Song, D. (2018) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3269206.3271723 · Cited by 46
Semantic Hilbert Space for Text Representation Learning
Wang, B., Li, Q., Melucci, M., & Song, D. (2019) · International World Wide Web Conference (WWW) · doi:10.1145/3308558.3313516 · Cited by 45
Self-citationExploration of Quantum Interference in Document Relevance Judgement Discrepancy
Wang, B., Zhang, P., Li, J., Song, D., Hou, Y., & Shang, Z. (2016) · Entropy · doi:10.3390/e18040144 · Cited by 43
Modality-based Factorization for Multimodal Fusion
Barezi, E. J., & Fung, P. (2019) · Workshop on Representation Learning for NLP (RepL4NLP) · doi:10.18653/v1/w19-4331 · Cited by 39
Quantum-Inspired Complex Word Embedding
Li, Q., Uprety, S., Wang, B., & Song, D. (2018) · Workshop on Representation Learning for NLP (RepL4NLP) · doi:10.18653/v1/w18-3006 · Cited by 36
Self-citationHolzinger, A., Kieseberg, P., Tjoa, A., & Weippl, E. (2018) · International Cross-Domain Conference on Machine Learning and Knowledge Extraction · doi:10.1007/978-3-319-99740-7 · Cited by 35
A Quantum-Theoretic Approach to Distributional Semantics
Blacoe, W., Kashefi, E., & Lapata, M. (2013) · Cited by 32
Modeling Multi-query Retrieval Tasks Using Density Matrix Transformation
Li, Q., Li, J., Zhang, P., & Song, D. (2015) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/2766462.2767819 · Cited by 32
Self-citationModeling quantum entanglements in quantum language models
Xie, M., Hou, Y., Zhang, P., Li, J., Li, W., & Song, D. (2015) · Open Research Online (The Open University) · Cited by 28
Distributional Sentence Entailment Using Density Matrices
Balkır, E., Sadrzadeh, M., & Coecke, B. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-28678-5_1 · Cited by 26
Modeling latent topic interactions using quantum interference for information retrieval
Sordoni, A., He, J., & Nie, J. (2013) · Proceedings of the ... ACM International Conference on Information & Knowledge Management · doi:10.1145/2505515.2507854 · Cited by 24
Proceedings of the 4th Workshop on Representation Learning for NLP (RepL4NLP-2019)
Augenstein, I., Gella, S., Ruder, S., Kann, K., Can, B., Conneau, A., Welbl, J., Ren, X., & Rei, M. (2019) · doi:10.18653/v1/w19-43 · Cited by 24
A Quantum Query Expansion Approach for Session Search
Zhang, P., Li, J., Wang, B., Zhao, X., Song, D., Hou, Y., & Melucci, M. (2016) · Entropy · doi:10.3390/e18040146 · Cited by 20
Self-citationProceedings of The Third Workshop on Representation Learning for NLP
(2018) · doi:10.18653/v1/w18-30 · Cited by 20
Investigating Non-classical Correlations Between Decision Fused Multi-modal Documents
Gkoumas, D., Uprety, S., & Song, D. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-35895-2_11 · Cited by 10
Self-citationQuantum-inspired Complex Word Embedding
Li, Q., Uprety, S., Wang, B., et al. (2018) · Open Research Online (The Open University) · doi:10.48550/arxiv.1805.11351 · Cited by 6
Self-citationTopics in Theoretical Computer Science
Mousavi, M. R., & Sgall, J. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-68953-1 · Cited by 4
Majority Vote of Diverse Classifiers for Late FusionPreprint
Morvant, E., Habrard, A., & Ayache, S. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1404.7796 · Cited by 1
Towards modeling implicit feedback with quantum entanglement
Melucci, M. (2008) · Padua Research Archive (University of Padova) · Cited by 1
Self-citation
Flagged first, then by citations
Research works printed but not linked: 1
- J. Wang, D. Song, K. Leszek, Tensor Product of Correlated Textual and Visual Features: A Quantum Theory Inspired Image Retrieval Framework, in: AAAI Fall Symposium Series, URL https://www.aaai.org/ocs/index.php/FSS/FSS10/paper/view/2297.
Cited by
Sorted by citations
Gandhi, A., Adhvaryu, K., Poria, S., Cambria, E., & Hussain, A. (2023) · Information Fusion · doi:10.1016/j.inffus.2022.09.025 · Cited by 783
Multimodal sentiment analysis based on fusion methods: A survey
Zhu, L., Zhu, Z., Zhang, C., Xu, Y., & Kong, X. (2023) · Information Fusion · doi:10.1016/j.inffus.2023.02.028 · Cited by 375
Hybrid Contrastive Learning of Tri-Modal Representation for Multimodal Sentiment Analysis
Mai, S., Zeng, Y., Zheng, S., & Hu, H. (2022) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2022.3172360 · Cited by 307
Mai, S., Zeng, Y., & Hu, H. (2023) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2022.3171679 · Cited by 182
Multimodal Video Sentiment Analysis Using Deep Learning Approaches, a Survey
Abdu, S. A., Yousef, A. H., & Salem, A. (2021) · Information Fusion · doi:10.1016/j.inffus.2021.06.003 · Cited by 154
Metadata
- Authors
- Li, Q., Gkoumas, D., Lioma, C., & Melucci, M.
- Affiliations
- University of Padua (IT)
- The Open University (GB)
- University of Copenhagen (DK)
- Corresponding author
- Li, Qiuchi
- Venue
- Information Fusion
- Publisher
- Elsevier BV
- Published
- 2021-01
- Volume
- 65
- Pages
- 58-71
- ISSN
- 1566-2535 (ISSN-L)
- OpenAlex
- W3048195943
- Cited by
- 143
- References
- 65
- Citations by year
- 2026: 12 · 2025: 31 · 2024: 23 · 2023: 31 · 2022: 32 · 2021: 13
- FWCI
- 7.57
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- Information Fusion (publishedVersion)
- Open Research Online (The Open University) (acceptedVersion)
- arXiv (Cornell University) (submittedVersion)
- Research at the University of Copenhagen (University of Copenhagen) (submittedVersion)
- Padua Research Archive (University of Padova) (submittedVersion, cc-by-nc-nd)
- arXiv (Cornell University) (cc-by)
- Funders
- H2020 Marie Skłodowska-Curie Actions
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Sentiment Analysis and Opinion Mining
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Emotion and Mood Recognition
- Keywords
- multimodal fusion, video sentiment analysis, quantum-inspired neural networks, quantum entanglement, superposition, complex-valued neural networks, interpretability
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
