The DOI matches its DataCite record; 33 of the 33 references it cites were found in a registry or an index.
MOSI: Multimodal Corpus of Sentiment Intensity and Subjectivity Analysis in Online Opinion Videos
Open accessAbstract
People are sharing their opinions, stories and reviews through online video sharing websites every day. Studying sentiment and subjectivity in these opinion videos is experiencing a growing attention from academia and industry. While sentiment analysis has been successful for text, it is an understudied research question for videos and multimedia content. The biggest setbacks for studies in this direction are lack of a proper dataset, methodology, baselines and statistical analysis of how information from different modality sources relate to each other. This paper introduces to the scientific community the first opinion-level annotated corpus of sentiment and subjectivity analysis in online videos called Multimodal Opinion-level Sentiment Intensity dataset (MOSI). The dataset is rigorously annotated with labels for subjectivity, sentiment intensity, per-frame and per-opinion annotated visual features, and per-milliseconds annotated audio features. Furthermore, we present baselines for future studies in this direction as well as a new multimodal fusion approach that jointly models spoken words and visual gestures.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“The dataset includes 93 randomly selected videos from YouTube, involving 89 different speakers—41 females and 48 males.”
From A Survey of Deep Learning-Based Multimodal Emotion Recognition: Speech, Text, and Face (2023) · cites this paper as [28]
The cited source says what the claim attributes to it.
In the citing paper
“The videos are segmented into 2199 clips, each rated on an emotional polarity scale, from +3 (signifying strongly positive sentiment) to −3 (signifying strongly negative sentiment).”
From A Survey of Deep Learning-Based Multimodal Emotion Recognition: Speech, Text, and Face (2023) · cites this paper as [28]
The cited source says what the claim attributes to it.
In the citing paper
“CMU-MOSI is a collection of 2 , 199 opinion video clips each rigorously annotated with labels for subjectivity, sentiment intensity, per-frame, and per-opinion annotated visual features, and permilliseconds annotated audio features [181].”
From MultiBench: Multiscale Benchmarks for Multimodal Representation Learning (2021) · cites this paper as [181]
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“Therefore the features used in this paper cannot be used to identify the speaker [181, 183].”
From MultiBench: Multiscale Benchmarks for Multimodal Representation Learning (2021) · cites this paper as [181]
Experimental — accuracy not yet measuredIn the citing paper
“The Multimodal Opinion-level Sentiment Intensity (CMU-MOSI) dataset, introduced by Zadeh et al. in 2016 [28], marks a significant milestone in multimodal sentiment analysis databases due to its unique characteristic of incorporating subjective sentiment and emotional intensity annotations.”
From A Survey of Deep Learning-Based Multimodal Emotion Recognition: Speech, Text, and Face (2023) · cites this paper as [28]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A tutorial on support vector regression
Smola, A. J., & Schölkopf, B. (2004) · Statistics and Computing · doi:10.1023/b:stco.0000035301.49549.88 · Cited by 13,723
Praat: Doing Phonetics by Computer
(2011) · Ear and Hearing · doi:10.1097/aud.0b013e31821473f7 · Cited by 8,010
Mining and summarizing customer reviews
Hu, M., & Liu, B. (2004) · Proceedings of the tenth ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/1014052.1014073 · Cited by 7,793
Thumbs Up or Thumbs Down? Semantic Orientation Applied to Unsupervised Classification of Reviews
Peter, P., & Turney (2002) · Cited by 3,646
Pang, B., & Lee, L. (2004) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.3115/1218955.1218990 · Cited by 3,376
Lexicon-based methods for sentiment analysis
Taboada, M., Brooke, J., Tofiloski, M., Voll, K., & Stede, M. (2011) · Computational Linguistics · doi:10.1162/coli_a_00049 · Cited by 3,301
Annotating Expressions of Opinions and Emotions in Language
Wiebe, J., Wilson, T., & Cardie, C. (2005) · Computers and the Humanities · doi:10.1007/s10579-005-7880-9 · Cited by 1,794
Recognizing action units for facial expression analysis
Tian, Y.-I., Kanade, T., & Cohn, J. F. (2001) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.908962 · Cited by 1,745
Predicting the semantic orientation of adjectives
Hatzivassiloglou, V., & McKeown, K. R. (1997) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.3115/979617.979640 · Cited by 822
COVAREP — A collaborative voice analysis repository for speech technologies
Degottex, G., Kane, J., Drugman, T., Raitio, T., & Scherer, S. (2014) · 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2014.6853739 · Cited by 695
Research works printed but not linked: 1
- [37]37. Vinodhini, G., and R. M. Chandrasekaran. "Sentiment analysis and opinion mining: a survey." International Journal 2, no. 6 (2012).
Cited by
Sorted by citations
Items 301–351 of 351
A Multimodal Sentiment Dataset for Video RecommendationPreprint
Tang, H., Liu, H., Xiao, X., & Wu, H. R. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2109.08333 · Cited by 2
Study on Sentiment Classification Strategies Based on the Fuzzy Logic with Crow Search AlgorithmPreprint
Mohammed, M. T., Yu, L., Aldhubri, A., & Qaid, G. R. S. (2022) · Research Square · doi:10.21203/rs.3.rs-1216679/v1 · Cited by 2
Enhancing Multimodal Sentiment Analysis with Cross-Attention Enhanced Fusion NetworksPreprint
Ning, O., Zhang, E., Lin, L., & Mo, J. (2024) · Research Square · doi:10.21203/rs.3.rs-5359494/v1 · Cited by 2
A Method for Opinion Classification in Video Combining Facial Expressions and Gestures
Júnior, A. G., & Santos, E. M. D. (2018) · SIBGRAPI Conference on Graphics, Patterns and Images (SIBGRAPI) · doi:10.1109/sibgrapi.2018.00011 · Cited by 1
Effects of Facial Expressions and Gestures on the Trustworthiness of a Person
Lutfi, S. L., Lahasan, B. M., Luna-Jiménez, C., Bamasood, Z. A., & Akhtar, Z. (2023) · IEEE Access · doi:10.1109/access.2023.3334270 · Cited by 3
Sentiment Analysis of Telephone Conversations Using Multimodal Data
Logumanov, A. G., Klenin, J., & Botov, D. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-11027-7_9 · Cited by 1
Cross-modal Memory Fusion Network for Multimodal Sequential Learning with Missing Values
Lin, C., Ho, J. C., & Agichtein, E. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-72240-1_30 · Cited by 1
Zhang, Q., Shi, L., Liu, P., & Xu, L. (2023) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn54540.2023.10191402 · Cited by 1
A Multi-View Co-Learning Method for Multimodal Sentiment Analysis
Geng, W., Bian, Y., & Li, X. (2023) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme55011.2023.00238 · Cited by 1
Attention-Based Fusion of Intra- and Intermodal Dynamics in Multimodal Sentiment Analysis
Yaghoubi, E., Tran, T. K., Borza, D. L., & Frintrop, S. (2024) · IEEE International Conference on Pervasive Computing and Communications Workshops (PerCom Workshops) · doi:10.1109/percomworkshops59983.2024.10502594 · Cited by 1
Progressive Fusion Network with Mixture of Experts for Multimodal Sentiment Analysis
Liu, D., Yang, Z., & Guo, Z. (2024) · International Conference on Advanced Computational Intelligence (ICACI) · doi:10.1109/icaci60820.2024.10537022 · Cited by 1
MFM: Multimodal Sentiment Analysis Based on Modal Focusing Model
Sun, S., Xu, G., & Lu, S. (2024) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/smc54092.2024.10831023 · Cited by 1
A unified prompt-based framework for few-shot multimodal language analysis
Zhang, X., Cao, R., Wang, Y., Li, S., Xu, H., Gao, K., & Huang, L. (2025) · Intelligent Systems with Applications · doi:10.1016/j.iswa.2025.200498 · Cited by 1
Multimodal Data Fusion with Quantum Inspiration
Li, Q. (2019) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3331184.3331419 · Cited by 1
MUSER: MUltimodal Stress Detection using Emotion Recognition as an Auxiliary TaskPreprint
Yao, Y., Papakostas, M., Burzo, M. G., Abouelenien, M., & Mihalcea, R. F. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2105.08146 · Cited by 1
Synergistic Perception: Adaptive Multimodal Sentiment Analysis via Multi-Task LearningPreprint
Cao, T., Ren, B., Cao, H., Chen, A., Bai, S., & Liu, N. (2025) · doi:10.36227/techrxiv.175036750.08379260/v1 · Cited by 1
Ha, J. (2021) · Journal of Ambient Intelligence and Humanized Computing · doi:10.1007/s12652-021-03214-9
RetractedHighlight Timestamp Detection Model for Comedy Videos via Multimodal Sentiment AnalysisPreprint
Huang, F. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.00451
Sequential Late Fusion Technique for Multi-modal Sentiment AnalysisPreprint
Banerjee, D., Lygerakis, F., & Makedon, F. S. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.11473
Attentive Intra-modality Fusion for Multimodal Sentiment Analysis
Ding, J., Zheng, Y., Li, X., Chen, M., & Huang, J. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-81197-6_38
Guhan, P., Awasthi, N., Das, R., Agarwal, M., McDonald, K., Bussell, K., Manocha, D., Reeves, G. M., & Bera, A. (2021) · arXiv (Cornell University)
Multimodal Query-Guided Object LocalizationPreprint
Tripathi, A., Dani, R. R., Mishra, A., & Chakraborty, A. (2021) · SSRN Electronic Journal · doi:10.2139/ssrn.3989558
Soha (Soft & Hard) Intelligence- A Fulcrum of High Performance of Teachers in HEIs
Parker, S., Zunjur, A., & Ahire, V. S. (2021) · IEEE Pune Section International Conference (PuneCon) · doi:10.1109/punecon52575.2021.9686475
A novel filter bank design for speech emotion recognitionPreprint
Parlak, C., & Altun, Y. (2022) · Research Square · doi:10.21203/rs.3.rs-1993444/v1
A novel filter bank design for speech emotion recognitionPreprint
Parlak, C., & Altun, Y. (2022) · Research Square · doi:10.21203/rs.3.rs-1993444/v2
A novel filter bank design for speech emotion recognitionPreprint
Parlak, C., & Altun, Y. (2022) · Research Square · doi:10.21203/rs.3.rs-1993444/v3
3DSSCN: A Sentiment Analysis Model for Short Video Based on 3D-Dense NetworkPreprint
silva, M., Kruger, H., Vieira, M., & Stellato, C. (2022) · Preprints.org · doi:10.20944/preprints202212.0132.v1
Dong, A., Zheng, Q., & Zhang, G. (2022) · International Conference on Machine Learning, Control, and Robotics (MLCR) · doi:10.1109/mlcr57210.2022.00017
A Review of Multimodal Sentiment Analysis for Measuring Visual Information
孙, 睿. (2023) · Statistics and Applications · doi:10.12677/sa.2023.121015
A Multi-modal Fusion-based Sentiment Analysis Model for Short VideosPreprint
Prescott, A., Throne, J., Callahan, S., & Harper, M. (2023) · Research Square · doi:10.21203/rs.3.rs-2997353/v1
Design of Intelligent models for Multimodal Socio-Affective Computing
Luna-Jiménez, C. (2023) · doi:10.20868/upm.thesis.74338
Modality-Aware Ood Suppression Using Feature Discrepancy for Multi-Modal Emotion Recognition
Kang, D., Kang, S., Kim, D. H., & Song, B. C. (2023) · Proceedings - International Conference on Image Processing · doi:10.1109/icip49359.2023.10222425
Hai, J., Liu, Y.-J., & Elhilali, M. (2023) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru57964.2023.10389694
Multimodal affective computing for video summarization
Lew, W.-C. L. (2023) · doi:10.32657/10356/174824
Research on a Modified MMMU-BA Framework for Multimodal Sentiment Analysis
Zhang, Y., & Zou, Y. (2023) · IEEE International Conference on Advances in Electrical Engineering and Computer Applications (AEECA) · doi:10.1109/aeeca59734.2023.00102
Research on Contrast-Based Negative Information Filtering in Multimodal Emotion AnalysisPreprint
Wang, R., Wang, Y., Feng, H., Yu, X., Guo, C., Zhao, Z., Huang, J., & Zhu, X. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4884270
A cognitive strategy for service robots in recognizing emotional attribute of objects
Wu, H., Du, J., Qin, C., & Ma, Q. (2024) · Artificial Life and Robotics · doi:10.1007/s10015-024-00960-9
Orthogonal Synthesis: Data Augmentation for Multimodal Sentiment Analysis
Zheng, T., & Liu, W. (2024) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn60899.2024.10650640
Multimodal Coordinated Representation Learning Based on Evidence Theory
Li, W., Han, D., Dezert, J., & Yang, Y. (2024) · International Conference on Information Fusion (FUSION) · doi:10.23919/fusion59988.2024.10706295
Learning to Switch off, Switch on, and Integrate Modalities in Large Pre-trained Transformers
Duseja, T., Annervaz, K. M., Duggani, J., Zacharia, S., Free, M., & Dukkipati, A. (2024) · IEEE International Conference on Multimedia Information Processing and Retrieval (MIPR) · doi:10.1109/mipr62202.2024.00070
Multimodal Sentiment Analysis Based on Self-Attention and Information Fusion MethodsPreprint
zhongyuan, C., Lu, C., yihan, W., & jie, L. (2024) · doi:10.22541/au.173269111.13682273/v1
RoBERTa-based Multimodal Sentiment Analysis of Detecting Teachers’ Emotions
Lei, N., Meng, H., & Jiang, X. (2024) · International Conference on Intelligent Education and Intelligent Research (IEIR) · doi:10.1109/ieir62538.2024.10959946
Sentiment Analysis Review: Methods and Challenges
Lalrinawma, C., & Nunsanga, M. V. L. (2025) · International Conference on Intelligent Systems, Advanced Computing and Communication (ISACC) · doi:10.1109/isacc65211.2025.10969235
An Enhanced Feature Fusion Network for Multimodal Sentiment Analysis
Xu, Y. L., & Wu, Y. (2024) · Asian Conference on Artificial Intelligence Technology (ACAIT) · doi:10.1109/acait63902.2024.11022222
Liu, J., & Yang, L. (2024) · International Conference on Virtual Reality and Visualization · doi:10.1109/icvrv62410.2024.00039
Sathya, J., Asha, V., Kalaivani, A., Sanjitha, N. S., U, S. M., & H, S. S. R. C. (2025) · International Conference on Inventive Computing and Informatics (ICICI) · doi:10.1109/icici65870.2025.11069447
SIREN: Scalable isotropic recursive column multimodal neural architecture
Truchan, H., Farag, A., & Ahmadi, Z. (2025) · Information Fusion · doi:10.1016/j.inffus.2025.103500
Adaptive Multi-Dimensional and Multi-Scale Convolutional Fusion for Multimodal Sentiment Analysis*
Xiao, H., Liu, S., Wang, H., Cai, H., & Ni, S. (2025) · IEEE International Conference on Real-time Computing and Robotics (RCAR) · doi:10.1109/rcar65431.2025.11139527
KI-gestützte Inhaltsanalysen im Social-Media-Marketing
Zerres, C. (2025) · Springer eBooks · doi:10.1007/978-3-658-42282-0_41-1
Text-enhanced cross-modal reinforced fusion network for multimodal sentiment analysis
Zhao, W., & Wu, Y. (2026) · Pattern Analysis and Applications · doi:10.1007/s10044-026-01676-1
Cross-modal consistency gating for reliable LLM reasoning in multimodal sentiment analysis
Bai, Y., Yan, Z., Yang, C., & Li, S. (2026) · Multimedia Systems · doi:10.1007/s00530-026-02731-x
Metadata
- Authors
- Zadeh, A., Zellers, R., Pincus, E., & Morency, L.-P.
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2016
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1606.06259
- OpenAlex
- W2465534249
- Cited by
- 350
- References
- 33
- Citations by year
- 2026: 2 · 2025: 38 · 2024: 74 · 2023: 52 · 2022: 42 · 2021: 58 · 2020: 32 · 2019: 24 · 2018: 19 · 2017: 7 · 2016: 2
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Sentiment Analysis and Opinion Mining
- Physical Sciences › Computer Science › Artificial Intelligence › Emotion and Mood Recognition
- Physical Sciences › Computer Science › Artificial Intelligence › Hate Speech and Cyberbullying Detection
- Keywords
- sentiment intensity, subjectivity, online video sharing, multimodal fusion, video sentiment analysis, audio features, annotated corpus, spoken word
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
