The DOI matches its Crossref record; 17 of the 17 references it cites were found in a registry or an index.
Comparing and combining sentiment analysis methods
Open accessAbstract
Several messages express opinions about events, products, and services, political views or even their author's emotional state and mood. Sentiment analysis has been used in several applications including analysis of the repercussions of events in social networks, analysis of opinions about products and services, and simply to better understand aspects of social communication in Online Social Networks (OSNs). There are multiple methods for measuring sentiments, including lexical-based approaches and supervised machine learning methods. Despite the wide use and popularity of some methods, it is unclear which method is better for identifying the polarity (i.e., positive or negative) of a message as the current literature does not provide a method of comparison among existing methods. Such a comparison is crucial for understanding the potential limitations, advantages, and disadvantages of popular methods in analyzing the content of OSNs messages. Our study aims at filling this gap by presenting comparisons of eight popular sentiment analysis methods in terms of coverage (i.e., the fraction of messages whose sentiment is identified) and agreement (i.e., the fraction of identified sentiments that are in tune with ground truth). We develop a new method that combines existing approaches, providing the best coverage results and competitive agreement. We also present a free Web service called iFeel, which provides an open API for accessing and comparing results across different sentiment methods for a given text.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Development and validation of brief measures of positive and negative affect: The PANAS scales.
Watson, D., Clark, L. A., & Tellegen, A. (1988) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.54.6.1063 · Cited by 32,433 · cited 18×
“In this paper, we present an apple-toapple comparison of eight representative sentiment metho ds: SentiWordNet, SASA, PANAS-t, Emoticons, SentiStrength, LIWC, SenticNet, and Happiness Index.”
MethodInfluentialWordNet: a lexical database for English
Miller, G. A. (1995) · Communications of the ACM · doi:10.1145/219717.219748 · Cited by 14,015
Thumbs up?: sentiment classification using machine learning techniques
Pang, B., Lee, L., & Vaithyanathan, S. (2002) · Proceedings of the ACL-02 conference on Empirical methods in natural language processing - EMNLP '02 · doi:10.3115/1118693.1118704 · Cited by 7,024
The Psychological Meaning of Words: LIWC and Computerized Text Analysis Methods
Tausczik, Y. R., & Pennebaker, J. W. (2010) · Journal of Language and Social Psychology · doi:10.1177/0261927x09351676 · Cited by 5,774
Twitter mood predicts the stock market
Bollen, J., Mao, H., & Zeng, X. (2011) · Journal of Computational Science · doi:10.1016/j.jocs.2010.12.007 · Cited by 5,206
Earthquake shakes Twitter users: real-time event detection by social sensors
Sakaki, T., Okazaki, M., & Matsuo, Y. (2010) · Proceedings of the 19th international conference on World wide web · doi:10.1145/1772690.1772777 · Cited by 3,640
A System for Real-time Twitter Sentiment Analysis of 2012 U.S. Presidential Election Cycle
Wang, H., Can, D., Kazemzadeh, A., Bar, F., & Narayanan, S. S. (2012) · Cited by 542
OpinionFinder: a system for subjectivity analysis
Wilson, T., Hoffmann, P., Somasundaran, S., Kessler, J., Wiebe, J., Choi, Y., Cardie, C., Riloff, E., & Patwardhan, S. (2005) · Proceedings of HLT/EMNLP on Interactive Demonstrations - · doi:10.3115/1225733.1225751 · Cited by 469
Classifying sentiment in microblogs: is brevity an advantage?
Bermingham, A., & Smeaton, A. F. (2010) · Proceedings of the 19th ACM international conference on Information and knowledge management · doi:10.1145/1871437.1871741 · Cited by 324
Modeling public mood and emotion: Twitter sentiment and socio-economic phenomena
Bollen, J., Pepe, A., & Mao, H. (2009) · arXiv (Cornell University) · doi:10.48550/arxiv.0911.1583 · Cited by 316
Separating Fact from Fear: Tracking Flu Infections on Twitter
Lamb, A., Paul, M. J., & Dredze, M. H. (2013) · Cited by 310
SenticNet: A Publicly Available Semantic Resource for Opinion Mining
Cambria, E., Speer, R. E., Havasi, C., & Hussain, A. (2010) · Stirling Online Research Repository (University of Stirling) · Cited by 271
Measuring the Happiness of Large-Scale Written Expression: Songs, Blogs, and Presidents
Dodds, P. S., & Danforth, C. M. (2010) · Journal of Happiness Studies · doi:10.1007/s10902-009-9150-9 · Cited by 260
Dengue surveillance based on a computational model of spatio-temporal locality of Twitter
Gomide, J., Veloso, A., Meira, W., Almeida, V., Benevenuto, F., Ferraz, F., & Teixeira, M. (2011) · Proceedings of the 3rd International Web Science Conference · doi:10.1145/2527031.2527049 · Cited by 240
Self-citationTwitter, MySpace, Digg: Unsupervised Sentiment Analysis in Social Media
Paltoglou, G., & Thelwall, M. (2012) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/2337542.2337551 · Cited by 213
Discourse level opinion interpretation
Somasundaran, S., Wiebe, J., & Ruppenhofer, J. (2008) · International Conference on Computational Linguistics · doi:10.3115/1599081.1599182 · Cited by 97
Towards Crowd Validation of the UK National Health Service
Cambria, E., Hussain, A., Havasi, C., Eckl, C., & Munro, J. B. (2010) · Cited by 45
Research works printed but not linked: 10
- Amazon. Amazon mechanical turk. https://www.mturk.com/ . Accessed June 17, 2013 . Amazon. Amazon mechanical turk. https://www.mturk.com/. Accessed June 17, 2013.
- M. M. Bradley and P. J. Lang . Affective norms for english words (ANEW): Stimuli, instruction manual, and affective ratings. Technical report , Center for Research in Psychophysiology, University of Florida , Gainesville, Florida, 1999 . M. M. Bradley and P. J. Lang. Affective norms for english words (ANEW): Stimuli, instruction manual, and affective ratings. Technical report, Center for Research in Psychophysiology, University of Florida, Gainesville, Florida, 1999.
- M. Cha , H. Haddadi , F. Benevenuto , and K. P. Gummadi . Measuring User Influence in Twitter: The Million Follower Fallacy . In Int'l AAAI Conference on Weblogs and Social Media (ICWSM) , 2010 . M. Cha, H. Haddadi, F. Benevenuto, and K. P. Gummadi. Measuring User Influence in Twitter: The Million Follower Fallacy. In Int'l AAAI Conference on Weblogs and Social Media (ICWSM), 2010.
- Esuli and Sebastiani. Sentwordnet : A publicly available lexical resource for opinion mining . In In Proceedings of the 5th Conference on Language Resources and Evaluation , pages 417 -- 422 , 2006 . Esuli and Sebastiani. Sentwordnet: A publicly available lexical resource for opinion mining. In In Proceedings of the 5th Conference on Language Resources and Evaluation, pages 417--422, 2006.
- P. Gonçalves , F. Benevenuto , and M. Cha . Panas-t: A pychometric scale for measuring sentiments on twitter. abs/1308.1857v1 , 2013 . P. Gonçalves, F. Benevenuto, and M. Cha. Panas-t: A pychometric scale for measuring sentiments on twitter. abs/1308.1857v1, 2013. · arXiv
- A. Hannak , E. Anderson , L. F. Barrett , S. Lehmann , A. Mislove , and M. Riedewald . Tweetin' in the rain: Exploring societal-scale effects of weather on mood . In Int'l AAAI Conference on Weblogs and Social Media (ICWSM) , 2012 . A. Hannak, E. Anderson, L. F. Barrett, S. Lehmann, A. Mislove, and M. Riedewald. Tweetin' in the rain: Exploring societal-scale effects of weather on mood. In Int'l AAAI Conference on Weblogs and Social Media (ICWSM), 2012.
- X. Hu , J. Tang , H. Gao , and H. Liu . Unsupervised sentiment analysis with emotional signals . In Int'l Conference on World Wide Web , 2013 . X. Hu, J. Tang, H. Gao, and H. Liu. Unsupervised sentiment analysis with emotional signals. In Int'l Conference on World Wide Web, 2013.
- J. Park , V. Barash , C. Fink , and M. Cha . Emoticon style: Interpreting differences in emoticons across cultures . In Int'l AAAI Conference on Weblogs and Social Media (ICWSM) , 2013 . J. Park, V. Barash, C. Fink, and M. Cha. Emoticon style: Interpreting differences in emoticons across cultures. In Int'l AAAI Conference on Weblogs and Social Media (ICWSM), 2013.
- 10.5555/1628960.1628969 · doi:10.5555/1628960.1628969
- A. Tumasjan , T. O. Sprenger , P. G. Sandner , and I. M. Welpe . Predicting elections with twitter: What 140 characters reveal about political sentiment . In Int'l AAAI Conference on Weblogs and Social Media (ICWSM) , 2010 . A. Tumasjan, T. O. Sprenger, P. G. Sandner, and I. M. Welpe. Predicting elections with twitter: What 140 characters reveal about political sentiment. In Int'l AAAI Conference on Weblogs and Social Media (ICWSM), 2010.
Cited by
Sentiment Analysis in Tourism: Capitalizing on Big Data
Alaei, A. R., Becken, S., & Stantic, B. (2019) · Journal of Travel Research · doi:10.1177/0047287517747753 · Cited by 622
Big data: Dimensions, evolution, impacts, and challenges
Lee, I. (2017) · Business Horizons · doi:10.1016/j.bushor.2017.01.004 · Cited by 546
Detecting Emotional Contagion in Massive Social Networks
Coviello, L., Sohn, Y., Kramer, A. D. I., Marlow, C., Franceschetti, M., Christakis, N. A., & Fowler, J. H. (2014) · PLoS ONE · doi:10.1371/journal.pone.0090315 · Cited by 478
Hyperparameter Tuning for Machine Learning Algorithms Used for Arabic Sentiment Analysis
Elgeldawi, E., Sayed, A., Galal, A. R., & Zaki, A. M. (2021) · Informatics · doi:10.3390/informatics8040079 · Cited by 399
Sarlan, A., Nadam, C., & Basri, S. (2014) · Proceedings of the 6th International Conference on Information Technology and Multimedia · doi:10.1109/icimu.2014.7066632 · Cited by 306
Metadata
- Authors
- Gonçalves, P., Araújo, M., Benevenuto, F., & Cha, M.
- Venue
- Proceedings of the first ACM conference on Online social networks
- Publisher
- ACM
- Published
- 2013-10-07
- Pages
- 27-38
- OpenAlex
- W2019268418
- Cited by
- 371
- References
- 17
- FWCI
- 16.04
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.