The DOI matches its Crossref record; 68 of the 68 references it cites were found in a registry or an index.
Sentiment Analysis of Short Informal Texts
Open accessAbstract
We describe a state-of-the-art sentiment analysis system that detects (a) the sentiment of short informal textual messages such as tweets and SMS (message-level task) and (b) the sentiment of a word or a phrase within a message (term-level task). The system is based on a supervised statistical text classification approach leveraging a variety of surface-form, semantic, and sentiment features. The sentiment features are primarily derived from novel high-coverage tweet-specific sentiment lexicons. These lexicons are automatically generated from tweets with sentiment-word hashtags and from tweets with emoticons. To adequately capture the sentiment of words in negated contexts, a separate sentiment lexicon is generated for negated words. The system ranked first in the SemEval-2013 shared task `Sentiment Analysis in Twitter' (Task 2), obtaining an F-score of 69.02 in the message-level task and 88.93 in the term-level task. Post-competition improvements boost the performance to an F-score of 70.45 (message-level task) and 89.50 (term-level task). The system also obtains state-of-the-art performance on two additional datasets: the SemEval-2013 SMS test set and a corpus of movie review excerpts. The ablation experiments demonstrate that the use of the automatically generated lexicons results in performance gains of up to 6.5 absolute percentage points.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
LIBSVM: A library for support vector machines
Chang, C.-C., & Lin, C.-J. (2011) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/1961189.1961199 · Cited by 40,918
The meaning and use of the area under a receiver operating characteristic (ROC) curve.
Hanley, J. A., & McNeil, B. J. (1982) · Radiology · doi:10.1148/radiology.143.1.7063747 · Cited by 21,856
Libsvm : A library for support vector machines
Ferrari, V. (2008) · Medical Entomology and Zoology · Cited by 10,122
An algorithm for suffix stripping
Porter, M. F. (1980) · Program · doi:10.1108/eb046814 · Cited by 8,096
Mining and summarizing customer reviews
Hu, M., & Liu, B. (2004) · Proceedings of the tenth ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/1014052.1014073 · Cited by 7,793
Thumbs up?: sentiment classification using machine learning techniques
Pang, B., Lee, L., & Vaithyanathan, S. (2002) · Proceedings of the ACL-02 conference on Empirical methods in natural language processing - EMNLP '02 · doi:10.3115/1118693.1118704 · Cited by 7,024
Recursive Deep Models for Semantic Compositionality Over a Sentiment Treebank
Socher, R., Perelygin, A., Wu, J., Chuang, J., Manning, C. D., Ng, A., & Potts, C. (2013) · Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d13-1170 · Cited by 6,878
Opinion Mining and Sentiment Analysis
Pang, B., & Lee, L. (2008) · now publishers, Inc. eBooks · doi:10.1561/9781601981516 · Cited by 6,720
Recognizing contextual polarity in phrase-level sentiment analysis
Wilson, T., Wiebe, J., & Hoffmann, P. (2005) · Proceedings of the conference on Human Language Technology and Empirical Methods in Natural Language Processing - HLT '05 · doi:10.3115/1220575.1220619 · Cited by 3,345
Lexicon-based methods for sentiment analysis
Taboada, M., Brooke, J., Tofiloski, M., Voll, K., & Stede, M. (2011) · Computational Linguistics · doi:10.1162/coli_a_00049 · Cited by 3,301
Cited by
Hierarchical Attention Networks for Document Classification
Yang, Z., Yang, D., Dyer, C., He, X., Smola, A., & Hovy, E. (2016) · Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.18653/v1/n16-1174 · Cited by 4,712
A survey on sentiment analysis methods, applications, and challenges
Wankhade, M., Rao, A. C. S., & Kulkarni, C. (2022) · Artificial Intelligence Review · doi:10.1007/s10462-022-10144-1 · Cited by 1,528
Document Modeling with Gated Recurrent Neural Network for Sentiment Classification
Tang, D., Qin, B., & Liu, T. (2015) · Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d15-1167 · Cited by 1,519
SemEval-2016 Task 6: Detecting Stance in Tweets
Mohammad, S., Kiritchenko, S., Sobhani, P., Zhu, X., & Cherry, C. (2016) · Proceedings of the 10th International Workshop on Semantic Evaluation (SemEval-2016) · doi:10.18653/v1/s16-1003 · Cited by 844
Self-citationSentiment analysis using deep learning architectures: a review
Yadav, A., & Vishwakarma, D. K. (2020) · Artificial Intelligence Review · doi:10.1007/s10462-019-09794-5 · Cited by 841
Kralj Novak, P., Smailović, J., Sluban, B., & Mozetič, I. (2015) · PLOS ONE · doi:10.1371/journal.pone.0144296 · Cited by 805
SemEval-2018 Task 1: Affect in Tweets
Mohammad, S., Bravo-Marquez, F., Salameh, M., & Kiritchenko, S. (2018) · Proceedings of The 12th International Workshop on Semantic Evaluation · doi:10.18653/v1/s18-1001 · Cited by 746
Self-citationNRC-Canada-2014: Detecting Aspects and Sentiment in Customer Reviews
Kiritchenko, S., Zhu, X., Cherry, C., & Mohammad, S. (2014) · Proceedings of the 8th International Workshop on Semantic Evaluation (SemEval 2014) · doi:10.3115/v1/s14-2076 · Cited by 697
Self-citationA survey on sentiment analysis challenges
Hussein, D. M. E.-D. M. (2018) · Journal of King Saud University - Engineering Sciences · doi:10.1016/j.jksues.2016.04.002 · Cited by 659
Enhancing deep learning sentiment analysis with ensemble techniques in social applications
Araque, O., Corcuera-Platas, I., Sánchez-Rada, J. F., & Iglesias, C. A. (2017) · Expert Systems with Applications · doi:10.1016/j.eswa.2017.02.002 · Cited by 563
Like It or Not: A Survey of Twitter Sentiment Analysis Methods
Giachanou, A., & Crestani, F. (2017) · ACM Computing Surveys · doi:10.1145/2938640 · Cited by 547
Current State of Text Sentiment Analysis from Opinion to Emotion Mining
Yadollahi, A., Shahraki, A. G., & Zaiane, O. R. (2018) · ACM Computing Surveys · doi:10.1145/3057270 · Cited by 489
Baziotis, C., Pelekis, N., & Doulkeridis, C. (2017) · Proceedings of the 11th International Workshop on Semantic Evaluation (SemEval-2017) · doi:10.18653/v1/s17-2126 · Cited by 485
Deep Convolution Neural Networks for Twitter Sentiment Analysis
Jianqiang, Z., Xiaolin, G., & Xuejun, Z. (2018) · IEEE Access · doi:10.1109/access.2017.2776930 · Cited by 482
Stance and Sentiment in Tweets
Mohammad, S. M., Sobhani, P., & Kiritchenko, S. (2017) · ACM Transactions on Internet Technology · doi:10.1145/3003433 · Cited by 449
Self-citationSentiment Analysis: An Overview from Linguistics
Taboada, M. (2016) · Annual Review of Linguistics · doi:10.1146/annurev-linguistics-011415-040518 · Cited by 411
Examining Gender and Race Bias in Two Hundred Sentiment Analysis Systems
Kiritchenko, S., & Mohammad, S. (2018) · Proceedings of the Seventh Joint Conference on Lexical and Computational Semantics · doi:10.18653/v1/s18-2005 · Cited by 384
Self-citationThe Effects of Twitter Sentiment on Stock Price Returns
Ranco, G., Aleksovski, D., Caldarelli, G., Grčar, M., & Mozetič, I. (2015) · PLoS ONE · doi:10.1371/journal.pone.0138441 · Cited by 395
Big Data: Deep Learning for financial sentiment analysis
Sohangir, S., Wang, D., Pomeranets, A., & Khoshgoftaar, T. M. (2018) · Journal of Big Data · doi:10.1186/s40537-017-0111-6 · Cited by 390
Mohammad, S. M. (2016) · Emotion Measurement · doi:10.1016/b978-0-08-100508-8.00009-6 · Cited by 391
Self-citationSemEval-2015 Task 10: Sentiment Analysis in Twitter
Rosenthal, S., Nakov, P., Kiritchenko, S., Mohammad, S., Ritter, A., & Stoyanov, V. (2015) · Proceedings of the 9th International Workshop on Semantic Evaluation (SemEval 2015) · doi:10.18653/v1/s15-2078 · Cited by 367
Self-citationLearning Semantic Representations of Users and Products for Document Level Sentiment Classification
Tang, D., Qin, B., & Liu, T. (2015) · Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · doi:10.3115/v1/p15-1098 · Cited by 365
Debunking in a world of tribes
Zollo, F., Bessi, A., Del Vicario, M., Scala, A., Caldarelli, G., Shekhtman, L., Havlin, S., & Quattrociocchi, W. (2017) · PLOS ONE · doi:10.1371/journal.pone.0181821 · Cited by 345
Al-Smadi, M., Qawasmeh, O., Al-Ayyoub, M., Jararweh, Y., & Gupta, B. (2018) · Journal of Computational Science · doi:10.1016/j.jocs.2017.11.006 · Cited by 339
Sentiment Embeddings with Applications to Sentiment Analysis
Tang, D., Wei, F., Qin, B., Yang, N., Liu, T., & Zhou, M. (2016) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2015.2489653 · Cited by 335
Sentiment analysis based on improved pre-trained word embeddings
Rezaeinia, S. M., Rahmani, R., Ghodsi, A., & Veisi, H. (2019) · Expert Systems with Applications · doi:10.1016/j.eswa.2018.08.044 · Cited by 325
Sentiment, emotion, purpose, and style in electoral tweets
Mohammad, S. M., Zhu, X., Kiritchenko, S., & Martin, J. (2015) · Information Processing & Management · doi:10.1016/j.ipm.2014.09.003 · Cited by 274
Self-citationEmotional Dynamics in the Age of Misinformation
Zollo, F., Novak, P. K., Del Vicario, M., Bessi, A., Mozetič, I., Scala, A., Caldarelli, G., & Quattrociocchi, W. (2015) · PLOS ONE · doi:10.1371/journal.pone.0138740 · Cited by 273
A survey of state-of-the-art approaches for emotion recognition in text
Alswaidan, N., & Menai, M. E. B. (2020) · Knowledge and Information Systems · doi:10.1007/s10115-020-01449-0 · Cited by 273
Sentiment Analysis of Review Datasets Using Naïve Bayes‘ and K-NN Classifier
Department of Computer Science & Engineering, H. I. O. T., Dey, L., Chakraborty, S., Biswas, A., Bose, B., & Tiwari, S. (2016) · International Journal of Information Engineering and Electronic Business · doi:10.5815/ijieeb.2016.04.07 · Cited by 272
WASSA-2017 Shared Task on Emotion Intensity
Mohammad, S., & Bravo-Marquez, F. (2017) · Proceedings of the 8th Workshop on Computational Approaches to Subjectivity, Sentiment and Social Media Analysis · doi:10.18653/v1/w17-5205 · Cited by 270
Self-citationResearching Mental Health Disorders in the Era of Social Media: Systematic Review
Wongkoblap, A., Vadillo, M. A., & Curcin, V. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.7215 · Cited by 268
Hajek, P., Barushka, A., & Munk, M. (2020) · Neural Computing and Applications · doi:10.1007/s00521-020-04757-2 · Cited by 186
Sentiment analysis: A survey on design framework, applications and future scopes
Bordoloi, M., & Biswas, S. K. (2023) · Artificial Intelligence Review · doi:10.1007/s10462-023-10442-2 · Cited by 183
A survey on sentiment analysis and opinion mining for social multimedia
Li, Z., Fan, Y., Jiang, B., Lei, T., & Liu, W. (2019) · Multimedia Tools and Applications · doi:10.1007/s11042-018-6445-z · Cited by 164
Baziotis, C., Nikolaos, A., Chronopoulou, A., Kolovou, A., Paraskevopoulos, G., Ellinas, N., Narayanan, S., & Potamianos, A. (2018) · Proceedings of The 12th International Workshop on Semantic Evaluation · doi:10.18653/v1/s18-1037 · Cited by 142
Detecting Stance in Tweets And Analyzing its Interaction with Sentiment
Sobhani, P., Mohammad, S., & Kiritchenko, S. (2016) · Proceedings of the Fifth Joint Conference on Lexical and Computational Semantics · doi:10.18653/v1/s16-2021 · Cited by 130
Self-citationFrom classification to quantification in tweet sentiment analysis
Gao, W., & Sebastiani, F. (2016) · Social Network Analysis and Mining · doi:10.1007/s13278-016-0327-z · Cited by 75
Sentence-level Emotion Classification with Label and Context Dependence
Li, S., Huang, L., Wang, R., & Zhou, G. (2015) · Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · doi:10.3115/v1/p15-1101 · Cited by 66
Learning Lexico-Functional Patterns for First-Person Affect
Reed, L., Wu, J., Oraby, S., Anand, P., & Walker, M. (2017) · Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers) · doi:10.18653/v1/p17-2022 · Cited by 15
Chatbot Experiences of Informal Language Learners: A Sentiment Analysis
Alm, A., & Nkomo, L. M. (2022) · Research Anthology on Implementing Sentiment Analysis Across Multiple Disciplines · doi:10.4018/978-1-6684-6303-1.ch050 · Cited by 11
Metadata
- Authors
- Kiritchenko, S., Zhu, X., & Mohammad, S. M.
- Venue
- Journal of Artificial Intelligence Research
- Publisher
- AI Access Foundation
- Published
- 2014-08-20
- Volume
- 50
- Pages
- 723-762
- ISSN
- 1076-9757 (ISSN-L)
- OpenAlex
- W2156413587
- Cited by
- 880
- References
- 68
- FWCI
- 93.09
- Type
- journal article
- Language
- en
- Open access
- diamond
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.