Cited by 6,087Sentiment Analysis and Opinion MiningEmotion and Mood RecognitionHate Speech and Cyberbullying Detection

VADER: a parsimonious rule-based model for sentiment analysis of social media text

Open access
Hutto, C., Gilbert, Eric·2014·Proceedings of the International AAAI Conference on Web and Social Media

Abstract

The inherent nature of social media content poses serious challenges to practical applications of sentiment analysis. We present VADER, a simple rule-based model for general sentiment analysis, and compare its effectiveness to eleven typical state-of-practice benchmarks including LIWC, ANEW, the General Inquirer, SentiWordNet, and machine learning oriented techniques relying on Naive Bayes, Maximum Entropy, and Support Vector Machine (SVM) algorithms. Using a combination of qualitative and quantitative methods, we first construct and empirically validate a gold-standard list of lexical features (along with their associated sentiment intensity measures) which are specifically attuned to sentiment in microblog-like contexts. We then combine these lexical features with consideration for five general rules that embody grammatical and syntactical conventions for expressing and emphasizing sentiment intensity. Interestingly, using our parsimonious rule-based model to assess the sentiment of tweets, we find that VADER outperforms individual human raters (F1 Classification Accuracy = 0.96 and 0.84, respectively), and generalizes more favorably across contexts than any of our benchmarks.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1609/icwsm.v8i1.14550

Cites

41 of 41 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • VADER (Hutto and Gilbert, 2014) delivered the best results in the multi-class classification case.

    “However, the VADER (Hutto and Gilbert, 2014) delivered the best results in the multi-class classification case.”

    From Sentiment Analysis in Tourism: Capitalizing on Big Data (2019) · cites this paper as Hutto and Gilbert, 2014

    The Introduction and Results report strong three-class classification performance on tweets: VADER achieved F1 = 0.96, above individual human raters’ F1 = 0.84. But the Results say VADER performed “as well or better” than machine-learning approaches in three of four domain comparisons, not that it delivered the best multiclass results across the board. No page numbers are available in our copy. (LLM, conf=0.83)

    Experimental — accuracy not yet measured
  • Additional consistency checks were performed using the VADER lexicon, providing further assurance against algorithmic biases and misclassifications.

    “Additional consistency checks were performed using the established VADER lexicon (Hutto & Gilbert, 2014), providing further assurance against algorithmic biases and misclassifications.”
  • VADER is a rule-based sentiment analysis tool validated for social media text.

    “Comment-level sentiment is measured using VADER (Valence Aware Dictionary and sEntiment Reasoner) [14], a rule-based sentiment analysis tool validated for social media text.”
  • VADER is rule-based and deterministic: the same text always produces the same score.

    “VADER is chosen for its rule-based, deterministic character: the same text always produces the same score.”
  • Emotional valences measured with tools such as LIWC, VADER, LabMT, or NRC emotion lexicon were often associated with PTSD symptoms or severity.

    “Emotional valences, measured with tools such as the LIWC, VADER 51 LabMT, or NRC emotion lexicon were often associated with PTSD symptoms or severity.”

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

4 of the 45 references couldn’t be matched to a known paper.

Research works printed but not linked: 9

  1. [3]3. Baccianella, S., Esuli, A., & Sebastiani, F. (2010). SentiWordNet 3.0. In Proc. of LREC-10.
  2. [5]5. Cambria, E., Havasi, C., & Hussain, A. (2012). SenticNet 2. In Proc. AAAI IFAI RSC-12.
  3. [6]6. Cambria, E., Speer, R., Havasi, C., & Hussain, A. (2010). SenticNet. In Proc. of AAAI SCK-10.
  4. [18]18. Kamps, J., Mokken, R. J., Marx, M., & de Rijke, M. (2004). Us- ing WordNet to measure semantic orientation. In Proc. LREC-04.
  5. [31]31. Snow, R., O'Connor, B., Jurafsky, D., & Ng, A. Y. (2008). Cheap and Fast -But is it Good?. In Proc. EMNLP-08.
  6. [33]33. Stone, P. J., Dunphy, D. C., Smith, M. S., & Ogilvie, D. M. (1966). General Inquirer. Cambridge, MA: MIT Press.
  7. [34]34. Strauss, A. L., & Corbin, J. (1998). Basics of Qualitative Re- search. Thousand Oaks, CA: Sage Publications.
  8. [36]36. Tumasjan, A., Sprenger, T. O., Sandner, P. G., & Welpe, I. M. (2010). Predicting Elections with Twitter:. In Proc. ICWSM-10.
  9. [38]38. Wang, H., Can, D., Kazemzadeh, A., Bar, F., & Narayanan, S. (2012). A system…real-time Twitter sentiment analysis. ACL-12.

Cited by

Sorted by citations

Authors
Hutto, C., & Gilbert, E.
Affiliations
Georgia Institute of Technology (US)
Venue
Proceedings of the International AAAI Conference on Web and Social Media
Published
2014-05-16
Volume
8
Issue
1
Pages
216-225
ISSN
  • 2162-3449 (ISSN-L)
  • 2334-0770
OpenAlex
W2099813784
Cited by
6,087
References
45
Citations by year
2026: 676 · 2025: 846 · 2024: 877 · 2023: 885 · 2022: 731 · 2021: 714 · 2020: 526 · 2019: 332 · 2018: 245 · 2017: 148 · 2016: 76 · 2015: 27 · 2014: 4
FWCI
50.06
Type
conference paper
Language
en
Open access
Locations
  • Proceedings of the International AAAI Conference on Web and Social Media (publishedVersion)
  • AAAI Publications (The Association for the Advancement of Artificial Intelligence (AAAI)) (submittedVersion)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Sentiment Analysis and Opinion Mining
  • Social Sciences › Psychology › Experimental and Cognitive Psychology › Emotion and Mood Recognition
  • Physical Sciences › Computer Science › Artificial Intelligence › Hate Speech and Cyberbullying Detection
Keywords
sentiment analysis, VADER, rule-based sentiment analysis, social media text, tweets, lexical features, sentiment intensity, microblogging, human raters

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review