The DOI matches its Crossref record; 40 of the 40 references it cites were found in a registry or an index.
Sentiment of Emojis
Open accessAbstract
There is a new generation of emoticons, called emojis, that is increasingly being used in mobile communications and social media. In the past two years, over ten billion emojis were used on Twitter. Emojis are Unicode graphic symbols, used as a shorthand to express concepts and ideas. In contrast to the small number of well-known emoticons that carry clear emotional contents, there are hundreds of emojis. But what are their emotional contents? We provide the first emoji sentiment lexicon, called the Emoji Sentiment Ranking, and draw a sentiment map of the 751 most frequently used emojis. The sentiment of the emojis is computed from the sentiment of the tweets in which they occur. We engaged 83 human annotators to label over 1.6 million tweets in 13 European languages by the sentiment polarity (negative, neutral, or positive). About 4% of the annotated tweets contain emojis. The sentiment analysis of the emojis allows us to draw several interesting conclusions. It turns out that most of the emojis are positive, especially the most popular ones. The sentiment distribution of the tweets with and without emojis is significantly different. The inter-annotator agreement on the tweets with emojis is higher. Emojis tend to occur at the end of the tweets, and their sentiment polarity increases with the distance. We observe no significant differences in the emoji rankings between the 13 languages and the Emoji Sentiment Ranking. Consequently, we propose our Emoji Sentiment Ranking as a European language-independent resource for automated sentiment analysis. Finally, the paper provides a formalization of sentiment and a novel visualization in the form of a sentiment bar.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Content Analysis: An Introduction to its Methodology.
Shelley, M., & Krippendorff, K. (1984) · Journal of the American Statistical Association · doi:10.2307/2288384 · Cited by 24,312
Content Analysis: An Introduction to Its Methodology
Krippendorff, K. (2019) · doi:10.4135/9781071878781 · Cited by 15,448
WordNet: a lexical database for English
Miller, G. A. (1995) · Communications of the ACM · doi:10.1145/219717.219748 · Cited by 14,015 · cited 1×
“SentiWordNet extends the well-knownWordNet [17] by associating each synset with three numerical scores, describing how ‘objective’, ‘positive’, and ‘negative’ the terms in the synset are.”
BackgroundThe proof and measurement of association between two things
Spearman, C. (1904) · The American Journal of Psychology · doi:10.2307/1412159 · Cited by 8,039
Newman (2005) · doi:10.1080/00107510500052444 · Cited by 5,749
THE GENERALIZATION OF ‘STUDENT'S’ PROBLEM WHEN SEVERAL DIFFERENT POPULATION VARLANCES ARE INVOLVED
WELCH, B. L. (1947) · Biometrika · doi:10.1093/biomet/34.1-2.28 · Cited by 4,135
Experimental evidence of massive-scale emotional contagion through social networks
Kramer, A. D. I., Guillory, J. E., & Hancock, J. T. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1320040111 · Cited by 3,687
VII. Note on regression and inheritance in the case of two parents
Pearson, K. (1895) · Proceedings of the Royal Society of London · doi:10.1098/rspl.1895.0041 · Cited by 3,424
Sentiment Analysis and Opinion Mining
Liu, B. (2012) · Synthesis Lectures on Human Language Technologies · doi:10.1007/978-3-031-02145-9 · Cited by 3,281
Sentiment Analysis and Opinion Mining
Zhang, L., & Liu, B. (2017) · Encyclopedia of Machine Learning and Data Mining · doi:10.1007/978-1-4899-7687-1_907 · Cited by 3,260
Twitter as a Corpus for Sentiment Analysis and Opinion Mining
Pak, A., & Paroubek, P. (2010) · Language Resources and Evaluation Conference (LREC) · doi:10.63317/47akcj8foo4d · Cited by 2,704
SentiWordNet 3.0: An Enhanced Lexical Resource for Sentiment Analysis and Opinion Mining
Baccianella, S., Esuli, A., & Sebastiani, F. (2010) · Language Resources and Evaluation Conference (LREC) · doi:10.63317/2jktnrykui9s · Cited by 2,666
The Generalization of `Student's' Problem when Several Different Population Variances are Involved
Welch, B. L. (1947) · Biometrika · doi:10.2307/2332510 · Cited by 1,924
5.7 The WORDNET lexical database of English
(2019) · Computer Corpus Lexicography · doi:10.1515/9781474471459-050 · Cited by 1,865
Sentiment strength detection in short informal text
Thelwall, M., Buckley, K., Paltoglou, G., Cai, D., & Kappas, A. (2010) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.21416 · Cited by 1,449
The proof and measurement of association between two things. By C. Spearman, 1904.
Spearman, C. (1987) · PubMed · Cited by 1,023
Sentiment Analysis of Short Informal Texts
Kiritchenko, S., Zhu, X., & Mohammad, S. M. (2014) · Journal of Artificial Intelligence Research · doi:10.1613/jair.4272 · Cited by 880
Enhanced Sentiment Learning Using Twitter Hashtags and Smileys
Davidov, D., Tsur, O., & Rappoport, A. (2010) · Cited by 700
Sentiment Analysis: Mining Opinions, Sentiments, and Emotions
Liu, B. (2015) · Cited by 656
Accessibility of cities in the digital economy
Tranos, E., Reggiani, A., & Nijkamp, P. (2013) · Cities · doi:10.1016/j.cities.2012.03.001 · Cited by 580
Sentiment Analysis: Mining Opinions, Sentiments, and Emotions
Zhao, J., Liu, K., & Xu, L. (2016) · Computational Linguistics · doi:10.1162/coli_r_00259 · Cited by 552
t-tests, non-parametric tests, and large studies—a paradox of statistical practice?
Fagerland, M. W. (2012) · BMC Medical Research Methodology · doi:10.1186/1471-2288-12-78 · Cited by 547
The Estimation of Probabilities: An Essay on Modern Bayesian Methods
Sparks, J. N., & Good, I. J. (1967) · American Educational Research Journal · doi:10.2307/1162122 · Cited by 528
Detecting Emotional Contagion in Massive Social Networks
Coviello, L., Sohn, Y., Kramer, A. D. I., Marlow, C., Franceschetti, M., Christakis, N. A., & Fowler, J. H. (2014) · PLoS ONE · doi:10.1371/journal.pone.0090315 · Cited by 478
The Effects of Twitter Sentiment on Stock Price Returns
Ranco, G., Aleksovski, D., Caldarelli, G., Grčar, M., & Mozetič, I. (2015) · PLoS ONE · doi:10.1371/journal.pone.0138441 · Cited by 395 · cited 2×
“An object of Twitter posts to which we attribute sentiment (an emoji in our case, but it can also be a stock [37], a political party [35], a discussion topic [26,36], etc.) occurs in several tweets.”
BackgroundMethodSelf-citationUsing Emoticons to reduce Dependency in Machine Learning Techniques for Sentiment Classification
Jonathon, & Read (2005) · Cited by 373
Using emoticons to reduce dependency in machine learning techniques for sentiment classification
Read, J. (2005) · Proceedings of the ACL Student Research Workshop on - ACL '05 · doi:10.3115/1628960.1628969 · Cited by 367
The Estimation of Probabilities: An Essay on Modern Bayesian Methods
Hill, B. M., & Good, I. J. (1965) · Journal of the American Statistical Association · doi:10.2307/2283422 · Cited by 337
Emotional Dynamics in the Age of Misinformation
Zollo, F., Novak, P. K., Del Vicario, M., Bessi, A., Mozetič, I., Scala, A., Caldarelli, G., & Quattrociocchi, W. (2015) · PLOS ONE · doi:10.1371/journal.pone.0138740 · Cited by 273
Self-citationTrading Strategies to Exploit Blog and News Sentiment
Zhang, W., & Skiena, S. (2010) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v4i1.14075 · Cited by 252
Emoticon Smoothed Language Models for Twitter Sentiment Analysis
Liu, K.-L., Li, W.-J., & Guo, M. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v26i1.8353 · Cited by 252
MoodLens: an emoticon-based sentiment analysis system for chinese tweets
Zhao, J., Dong, L., Wu, J., & Xu, K. (2012) · Proceedings of the 18th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/2339530.2339772 · Cited by 245
Stream-based active learning for sentiment analysis in the financial domain
Smailović, J., Grčar, M., Lavrač, N., & Žnidaršič, M. (2014) · Information Sciences · doi:10.1016/j.ins.2014.04.034 · Cited by 220
Self-citationExploiting emoticons in sentiment analysis
Hogenboom, A., Bal, D., Frasincar, F., Bal, M., de Jong, F., & Kaymak, U. (2013) · Proceedings of the 28th Annual ACM Symposium on Applied Computing · doi:10.1145/2480362.2480498 · Cited by 211
The spread of emotion via facebook
Kramer, A. D. I. (2012) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2207676.2207787 · Cited by 165
Is Happiness Contagious Online? A Case of Twitter and the 2010 Winter Olympics
Gruzd, A. A., Doiron, S., & Mai, P. (2011) · Hawaii International Conference on System Sciences (HICSS) · doi:10.1109/hicss.2011.259 · Cited by 91
A :) Is Worth a Thousand Words: How People Attach Sentiment to Emoticons and Words in Tweets
Boia, M., Faltings, B. V., Musat, C.-C., & Pu, P. (2013) · International Conference on Social Computing · doi:10.1109/socialcom.2013.54 · Cited by 79
Exploiting emoticons in polarity classification of text
Hogenboom, A., Bal, D., Frăsincar, F., Bal, M., de Jong, F. M. G., & Kaymak, U. (2015) · EUR Research Repository (Erasmus University Rotterdam) · doi:10.5555/2871254.2871257 · Cited by 67
Sentiment leaning of influential communities in social networks
Sluban, B., Smailović, J., Battiston, S., & Mozetič, I. (2015) · Computational Social Networks · doi:10.1186/s40649-015-0016-5 · Cited by 48
Self-citationMonitoring the Twitter sentiment during the Bulgarian elections
Smailović, J., Kranjc, J., Grćar, M., Žnidaršič, M., & Mozetič, I. (2015) · IEEE International Conference on Data Science and Advanced Analytics (DSAA) · doi:10.1109/dsaa.2015.7344886 · Cited by 46
Self-citation
Cited by
A Systematic Review of Emoji: Current Research and Future Perspectives
Bai, Q., Dan, Q., Mu, Z., & Yang, M. (2019) · Frontiers in Psychology · doi:10.3389/fpsyg.2019.02221 · Cited by 502
emoji2vec: Learning Emoji Representations from their Description
Eisner, B., Rocktäschel, T., Augenstein, I., Bosnjak, M., & Riedel, S. (2016) · Proceedings of The Fourth International Workshop on Natural Language Processing for Social Media · doi:10.18653/v1/w16-6208 · Cited by 291
Metadata
- Authors
- Kralj Novak, P., Smailović, J., Sluban, B., & Mozetič, I.
- Venue
- PLOS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2015-12-07
- Volume
- 10
- Issue
- 12
- Pages
- e0144296
- ISSN
- 1932-6203 (ISSN-L)
- OpenAlex
- W2122522916
- Cited by
- 805
- References
- 40
- FWCI
- 52.24
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.