Student or educator? Sign up with your school email and get 6 months of Pro free.
Cited by 371

The DOI matches its Crossref record; 3 of the 3 references it cites were found in a registry or an index.

Comparing and combining sentiment analysis methods

Open access
Gonçalves, Pollyanna, Araújo, Matheus, Benevenuto, Fabrício, Cha, Meeyoung·2013·Proceedings of the first ACM conference on Online social networks

Abstract

Several messages express opinions about events, products, and services, political views or even their author's emotional state and mood. Sentiment analysis has been used in several applications including analysis of the repercussions of events in social networks, analysis of opinions about products and services, and simply to better understand aspects of social communication in Online Social Networks (OSNs). There are multiple methods for measuring sentiments, including lexical-based approaches and supervised machine learning methods. Despite the wide use and popularity of some methods, it is unclear which method is better for identifying the polarity (i.e., positive or negative) of a message as the current literature does not provide a method of comparison among existing methods. Such a comparison is crucial for understanding the potential limitations, advantages, and disadvantages of popular methods in analyzing the content of OSNs messages. Our study aims at filling this gap by presenting comparisons of eight popular sentiment analysis methods in terms of coverage (i.e., the fraction of messages whose sentiment is identified) and agreement (i.e., the fraction of identified sentiments that are in tune with ground truth). We develop a new method that combines existing approaches, providing the best coverage results and competitive agreement. We also present a free Web service called iFeel, which provides an open API for accessing and comparing results across different sentiment methods for a given text.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1145/2512938.2512951

Cites

3 of 3 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 3 references

Research works printed but not linked: 24

  1. Amazon. Amazon mechanical turk. https://www.mturk.com/ . Accessed June 17, 2013 . Amazon. Amazon mechanical turk. https://www.mturk.com/. Accessed June 17, 2013.
  2. 10.1145/1871437.1871741 · DOI · Paper page
  3. J. Bollen , A. Pepe , and H. Mao . Modeling public mood and emotion: Twitter sentiment and socio-economic phenomena. CoRR, abs/0911.1583 , 2009 . J. Bollen, A. Pepe, and H. Mao. Modeling public mood and emotion: Twitter sentiment and socio-economic phenomena. CoRR, abs/0911.1583, 2009. · arXiv
  4. M. M. Bradley and P. J. Lang . Affective norms for english words (ANEW): Stimuli, instruction manual, and affective ratings. Technical report , Center for Research in Psychophysiology, University of Florida , Gainesville, Florida, 1999 . M. M. Bradley and P. J. Lang. Affective norms for english words (ANEW): Stimuli, instruction manual, and affective ratings. Technical report, Center for Research in Psychophysiology, University of Florida, Gainesville, Florida, 1999.
  5. E. Cambria , A. Hussain , C. Havasi , C. Eckl , and J. Munro . Towards crowd validation of the uk national health service . In ACM Web Science Conference (WebSci) , 2010 . E. Cambria, A. Hussain, C. Havasi, C. Eckl, and J. Munro. Towards crowd validation of the uk national health service. In ACM Web Science Conference (WebSci), 2010.
  6. E. Cambria , R. Speer , C. Havasi , and A. Hussain . Senticnet: A publicly available semantic resource for opinion mining . In AAAI Fall Symposium Series , 2010 . E. Cambria, R. Speer, C. Havasi, and A. Hussain. Senticnet: A publicly available semantic resource for opinion mining. In AAAI Fall Symposium Series, 2010.
  7. M. Cha , H. Haddadi , F. Benevenuto , and K. P. Gummadi . Measuring User Influence in Twitter: The Million Follower Fallacy . In Int'l AAAI Conference on Weblogs and Social Media (ICWSM) , 2010 . M. Cha, H. Haddadi, F. Benevenuto, and K. P. Gummadi. Measuring User Influence in Twitter: The Million Follower Fallacy. In Int'l AAAI Conference on Weblogs and Social Media (ICWSM), 2010.
  8. 10.1007/s10902-009-9150-9 · DOI · Paper page
  9. Esuli and Sebastiani. Sentwordnet : A publicly available lexical resource for opinion mining . In In Proceedings of the 5th Conference on Language Resources and Evaluation , pages 417 -- 422 , 2006 . Esuli and Sebastiani. Sentwordnet: A publicly available lexical resource for opinion mining. In In Proceedings of the 5th Conference on Language Resources and Evaluation, pages 417--422, 2006.
  10. 10.1145/2527031.2527049 · DOI · Paper page
  11. P. Gonçalves , F. Benevenuto , and M. Cha . Panas-t: A pychometric scale for measuring sentiments on twitter. abs/1308.1857v1 , 2013 . P. Gonçalves, F. Benevenuto, and M. Cha. Panas-t: A pychometric scale for measuring sentiments on twitter. abs/1308.1857v1, 2013. · arXiv
  12. A. Hannak , E. Anderson , L. F. Barrett , S. Lehmann , A. Mislove , and M. Riedewald . Tweetin' in the rain: Exploring societal-scale effects of weather on mood . In Int'l AAAI Conference on Weblogs and Social Media (ICWSM) , 2012 . A. Hannak, E. Anderson, L. F. Barrett, S. Lehmann, A. Mislove, and M. Riedewald. Tweetin' in the rain: Exploring societal-scale effects of weather on mood. In Int'l AAAI Conference on Weblogs and Social Media (ICWSM), 2012.
  13. X. Hu , J. Tang , H. Gao , and H. Liu . Unsupervised sentiment analysis with emotional signals . In Int'l Conference on World Wide Web , 2013 . X. Hu, J. Tang, H. Gao, and H. Liu. Unsupervised sentiment analysis with emotional signals. In Int'l Conference on World Wide Web, 2013.
  14. A. Lamb , M. J. Paul , and M. Dredze . Separating fact from fear: Tracking flu infections on twitter . In Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies , pages 789 -- 795 , June 2013 . A. Lamb, M. J. Paul, and M. Dredze. Separating fact from fear: Tracking flu infections on twitter. In Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pages 789--795, June 2013.
  15. 10.1145/2337542.2337551 · DOI · Paper page
  16. 10.3115/1118693.1118704 · DOI · Paper page
  17. J. Park , V. Barash , C. Fink , and M. Cha . Emoticon style: Interpreting differences in emoticons across cultures . In Int'l AAAI Conference on Weblogs and Social Media (ICWSM) , 2013 . J. Park, V. Barash, C. Fink, and M. Cha. Emoticon style: Interpreting differences in emoticons across cultures. In Int'l AAAI Conference on Weblogs and Social Media (ICWSM), 2013.
  18. 10.5555/1628960.1628969 · doi:10.5555/1628960.1628969
  19. 10.1145/1772690.1772777 · DOI · Paper page
  20. S. Somasundaran , J. Wiebe , and J. Ruppenhofer . Discourse level opinion interpretation . In Int'l Conference on Computational Linguistics (COLING) , pages 801 -- 808 , 2008 . S. Somasundaran, J. Wiebe, and J. Ruppenhofer. Discourse level opinion interpretation. In Int'l Conference on Computational Linguistics (COLING), pages 801--808, 2008. · DOI
  21. A. Tumasjan , T. O. Sprenger , P. G. Sandner , and I. M. Welpe . Predicting elections with twitter: What 140 characters reveal about political sentiment . In Int'l AAAI Conference on Weblogs and Social Media (ICWSM) , 2010 . A. Tumasjan, T. O. Sprenger, P. G. Sandner, and I. M. Welpe. Predicting elections with twitter: What 140 characters reveal about political sentiment. In Int'l AAAI Conference on Weblogs and Social Media (ICWSM), 2010.
  22. H. Wang , D. Can , A. Kazemzadeh , F. Bar , and S. Narayanan . A system for real-time twitter sentiment analysis of 2012 u.s. presidential election cycle . In ACL System Demonstrations , pages 115 -- 120 , 2012 . H. Wang, D. Can, A. Kazemzadeh, F. Bar, and S. Narayanan. A system for real-time twitter sentiment analysis of 2012 u.s. presidential election cycle. In ACL System Demonstrations, pages 115--120, 2012.
  23. D. Watson and L. Clark . Development and validation of brief measures of positive and negative affect: the panas scales . Journal of Personality and Social Psychology , 54 ( 1 ): 1063 -- 1070 , 1985 . D. Watson and L. Clark. Development and validation of brief measures of positive and negative affect: the panas scales. Journal of Personality and Social Psychology, 54(1):1063--1070, 1985.
  24. 10.3115/1225733.1225751 · DOI · Paper page

Cited by

See all 371

Metadata

Authors
Gonçalves, P., Araújo, M., Benevenuto, F., & Cha, M.
Venue
Proceedings of the first ACM conference on Online social networks
Publisher
ACM
Published
2013-10-07
Pages
27-38
OpenAlex
W2019268418
Cited by
371
References
3
FWCI
16.04
Type
conference paper
Language
en
Open access
green

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Comparing and combining sentiment analysis methods. https://app.cochat.ai/papers/10.1145/2512938.2512951
The paper
Gonçalves, P., Araújo, M., Benevenuto, F., & Cha, M. (2013). Comparing and combining sentiment analysis methods. Proceedings of the first ACM conference on Online social networks. https://doi.org/10.1145/2512938.2512951

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.