Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat
Cited by 371

The DOI matches its Crossref record; 17 of the 17 references it cites were found in a registry or an index.

Comparing and combining sentiment analysis methods

Open access
Gonçalves, Pollyanna, Araújo, Matheus, Benevenuto, Fabrício, Cha, Meeyoung · 2013 · Proceedings of the first ACM conference on Online social networks

Abstract

Several messages express opinions about events, products, and services, political views or even their author's emotional state and mood. Sentiment analysis has been used in several applications including analysis of the repercussions of events in social networks, analysis of opinions about products and services, and simply to better understand aspects of social communication in Online Social Networks (OSNs). There are multiple methods for measuring sentiments, including lexical-based approaches and supervised machine learning methods. Despite the wide use and popularity of some methods, it is unclear which method is better for identifying the polarity (i.e., positive or negative) of a message as the current literature does not provide a method of comparison among existing methods. Such a comparison is crucial for understanding the potential limitations, advantages, and disadvantages of popular methods in analyzing the content of OSNs messages. Our study aims at filling this gap by presenting comparisons of eight popular sentiment analysis methods in terms of coverage (i.e., the fraction of messages whose sentiment is identified) and agreement (i.e., the fraction of identified sentiments that are in tune with ground truth). We develop a new method that combines existing approaches, providing the best coverage results and competitive agreement. We also present a free Web service called iFeel, which provides an open API for accessing and comparing results across different sentiment methods for a given text.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1145/2512938.2512951

Cites

17 of 17 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Research works printed but not linked: 10

  1. Amazon. Amazon mechanical turk. https://www.mturk.com/ . Accessed June 17, 2013 . Amazon. Amazon mechanical turk. https://www.mturk.com/. Accessed June 17, 2013.
  2. M. M. Bradley and P. J. Lang . Affective norms for english words (ANEW): Stimuli, instruction manual, and affective ratings. Technical report , Center for Research in Psychophysiology, University of Florida , Gainesville, Florida, 1999 . M. M. Bradley and P. J. Lang. Affective norms for english words (ANEW): Stimuli, instruction manual, and affective ratings. Technical report, Center for Research in Psychophysiology, University of Florida, Gainesville, Florida, 1999.
  3. M. Cha , H. Haddadi , F. Benevenuto , and K. P. Gummadi . Measuring User Influence in Twitter: The Million Follower Fallacy . In Int'l AAAI Conference on Weblogs and Social Media (ICWSM) , 2010 . M. Cha, H. Haddadi, F. Benevenuto, and K. P. Gummadi. Measuring User Influence in Twitter: The Million Follower Fallacy. In Int'l AAAI Conference on Weblogs and Social Media (ICWSM), 2010.
  4. Esuli and Sebastiani. Sentwordnet : A publicly available lexical resource for opinion mining . In In Proceedings of the 5th Conference on Language Resources and Evaluation , pages 417 -- 422 , 2006 . Esuli and Sebastiani. Sentwordnet: A publicly available lexical resource for opinion mining. In In Proceedings of the 5th Conference on Language Resources and Evaluation, pages 417--422, 2006.
  5. P. Gonçalves , F. Benevenuto , and M. Cha . Panas-t: A pychometric scale for measuring sentiments on twitter. abs/1308.1857v1 , 2013 . P. Gonçalves, F. Benevenuto, and M. Cha. Panas-t: A pychometric scale for measuring sentiments on twitter. abs/1308.1857v1, 2013. · arXiv
  6. A. Hannak , E. Anderson , L. F. Barrett , S. Lehmann , A. Mislove , and M. Riedewald . Tweetin' in the rain: Exploring societal-scale effects of weather on mood . In Int'l AAAI Conference on Weblogs and Social Media (ICWSM) , 2012 . A. Hannak, E. Anderson, L. F. Barrett, S. Lehmann, A. Mislove, and M. Riedewald. Tweetin' in the rain: Exploring societal-scale effects of weather on mood. In Int'l AAAI Conference on Weblogs and Social Media (ICWSM), 2012.
  7. X. Hu , J. Tang , H. Gao , and H. Liu . Unsupervised sentiment analysis with emotional signals . In Int'l Conference on World Wide Web , 2013 . X. Hu, J. Tang, H. Gao, and H. Liu. Unsupervised sentiment analysis with emotional signals. In Int'l Conference on World Wide Web, 2013.
  8. J. Park , V. Barash , C. Fink , and M. Cha . Emoticon style: Interpreting differences in emoticons across cultures . In Int'l AAAI Conference on Weblogs and Social Media (ICWSM) , 2013 . J. Park, V. Barash, C. Fink, and M. Cha. Emoticon style: Interpreting differences in emoticons across cultures. In Int'l AAAI Conference on Weblogs and Social Media (ICWSM), 2013.
  9. 10.5555/1628960.1628969 · doi:10.5555/1628960.1628969
  10. A. Tumasjan , T. O. Sprenger , P. G. Sandner , and I. M. Welpe . Predicting elections with twitter: What 140 characters reveal about political sentiment . In Int'l AAAI Conference on Weblogs and Social Media (ICWSM) , 2010 . A. Tumasjan, T. O. Sprenger, P. G. Sandner, and I. M. Welpe. Predicting elections with twitter: What 140 characters reveal about political sentiment. In Int'l AAAI Conference on Weblogs and Social Media (ICWSM), 2010.

Cited by

See all 371

Metadata

Authors
Gonçalves, P., Araújo, M., Benevenuto, F., & Cha, M.
Venue
Proceedings of the first ACM conference on Online social networks
Publisher
ACM
Published
2013-10-07
Pages
27-38
OpenAlex
W2019268418
Cited by
371
References
17
FWCI
16.04
Type
conference paper
Language
en
Open access
green

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.