SemEval-2014 Task 9: Sentiment Analysis in Twitter
Open accessThe DOI matches its Crossref record; 19 of the 19 references it cites were found in a registry or an index.
Abstract
We describe the Sentiment Analysis in Twitter task, ran as part of SemEval-2014.It is a continuation of the last year's task that ran successfully as part of SemEval-2013.As in 2013, this was the most popular SemEval task; a total of 46 teams contributed 27 submissions for subtask A (21 teams) and 50 submissions for subtask B (44 teams).This year, we introduced three new test sets: (i) regular tweets, (ii) sarcastic tweets, and (iii) LiveJournal sentences.We further tested on (iv) 2013 tweets, and (v) 2013 SMS messages.The highest F1score on (i) was achieved by NRC-Canada at 86.63 for subtask A and by TeamX at 70.96 for subtask B.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Thumbs up?: sentiment classification using machine learning techniques
Pang, B., Lee, L., & Vaithyanathan, S. (2002) · Proceedings of the ACL-02 conference on Empirical methods in natural language processing - EMNLP '02 · doi:10.3115/1118693.1118704 · Cited by 7,024
SentiWordNet 3.0: An Enhanced Lexical Resource for Sentiment Analysis and Opinion Mining
Baccianella, S., Esuli, A., & Sebastiani, F. (2010) · Language Resources and Evaluation Conference (LREC) · doi:10.63317/2jktnrykui9s · Cited by 2,666
Predicting Elections with Twitter: What 140 Characters Reveal about Political Sentiment
Tumasjan, A., Sprenger, T., Sandner, P., & Welpe, I. (2010) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v4i1.14009 · Cited by 2,649
Thumbs up? Sentiment Classification using Machine Learning Techniques
Pang, B., Lee, L., & Vaithyanathan, S. (2002) · arXiv (Cornell University) · doi:10.48550/arxiv.cs/0205070 · Cited by 2,191
From Tweets to Polls: Linking Text Sentiment to Public Opinion Time Series
O'Connor, B., Balasubramanyan, R., Routledge, B., & Smith, N. (2010) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v4i1.14031 · Cited by 1,923
SemEval-2014 Task 4: Aspect Based Sentiment Analysis
Pontiki, M., Galanis, D., Pavlopoulos, J., Papageorgiou, H., Androutsopoulos, I., & Manandhar, S. (2014) · Proceedings of the 8th International Workshop on Semantic Evaluation (SemEval 2014) · doi:10.3115/v1/s14-2004 · Cited by 1,862
Annotating Expressions of Opinions and Emotions in Language
Wiebe, J., Wilson, T., & Cardie, C. (2005) · Language Resources and Evaluation · doi:10.1007/s10579-005-7880-9 · Cited by 1,755
Twitter power: Tweets as electronic word of mouth
Jansen, B. J., Zhang, M., Sobel, K., & Chowdury, A. (2009) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.21149 · Cited by 1,642
Named Entity Recognition in Tweets: An Experimental Study
Ritter, A., Clark, S., & Etzioni, O. (2011) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · Cited by 1,496
Self-citationTwitter Sentiment Analysis: The Good the Bad and the OMG!
Kouloumpis, E., Wilson, T., & Moore, J. (2021) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v5i1.14185 · Cited by 1,225
Robust Sentiment Detection on Twitter from Biased and Noisy Data
Barbosa, L., & Feng, J. (2010) · International Conference on Computational Linguistics · Cited by 1,090
SemEval-2016 Task 4: Sentiment Analysis in Twitter
Nakov, P., Ritter, A., Rosenthal, S., Sebastiani, F., & Stoyanov, V. (2016) · Proceedings of the 10th International Workshop on Semantic Evaluation (SemEval-2016) · doi:10.18653/v1/s16-1001 · Cited by 966
Self-citationPart-of-Speech Tagging for Twitter: Annotation, Features, and Experiments
Gimpel, K., Schneider, N., O'Connor, B., Das, D., Mills, D. P., Eisenstein, J., Heilman, M., Yogatama, D., Flanigan, J., & Smith, N. A. (2018) · Figshare · doi:10.1184/r1/6473609.v1 · Cited by 800
Identifying Sarcasm in Twitter: A Closer Look
González‐Ibáñez, R., Muresan, S., & Wacholder, N. (2011) · Cited by 627
Part-of-Speech Tagging for Twitter: Annotation, Features, and Experiments
Gimpel, K., Schneider, N., O'Connor, B., Das, D., Mills, D., Eisenstein, J., Heilman, M., Yogatama, D., Flanigan, J., & Smith, N. A. (2010) · doi:10.21236/ada547371 · Cited by 491
NRC-Canada: Building the State-of-the-Art in Sentiment Analysis of Tweets
Mohammad, S. M., Kiritchenko, S., & Zhu, X. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1308.6242 · Cited by 451
The perfect solution for detecting sarcasm in tweets #not
Liebrecht, C., Kunneman, F., & van den Bosch, A. P. J. (2013) · Radboud Repository (Radboud University) · Cited by 245
Creating a live, public short message service corpus: The NUS SMS corpus
Chen, T., Kan, M., & Chen, T. (2011) · Cited by 105
Detecting Sentiment Change in Twitter Streaming Data
Bifet, A., Holmes, G., Pfahringer, B., & Gavaldà, R. (2011) · RECERCAT (Consorci de Serveis Universitaris de Catalunya) · Cited by 52
Cited by
SemEval-2016 Task 5: Aspect Based Sentiment Analysis
Pontiki, M., Galanis, D., Papageorgiou, H., Androutsopoulos, I., Manandhar, S., AL-Smadi, M., Al-Ayyoub, M., Zhao, Y., Qin, B., De Clercq, O., et al. (2016) · Proceedings of the 10th International Workshop on Semantic Evaluation (SemEval-2016) · doi:10.18653/v1/s16-1002 · Cited by 1,281
Learning Sentiment-Specific Word Embedding for Twitter Sentiment Classification
Tang, D., Wei, F., Yang, N., Zhou, M., Liu, T., & Qin, B. (2014) · Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.3115/v1/p14-1146 · Cited by 1,181
Sentiment Analysis of Short Informal Texts
Kiritchenko, S., Zhu, X., & Mohammad, S. M. (2014) · Journal of Artificial Intelligence Research · doi:10.1613/jair.4272 · Cited by 880
SemEval-2017 Task 4: Sentiment Analysis in Twitter
Rosenthal, S., Farra, N., & Nakov, P. (2017) · Proceedings of the 11th International Workshop on Semantic Evaluation (SemEval-2017) · doi:10.18653/v1/s17-2088 · Cited by 870
Self-citationSemEval-2016 Task 6: Detecting Stance in Tweets
Mohammad, S., Kiritchenko, S., Sobhani, P., Zhu, X., & Cherry, C. (2016) · Proceedings of the 10th International Workshop on Semantic Evaluation (SemEval-2016) · doi:10.18653/v1/s16-1003 · Cited by 844
Metadata
- Authors
- Rosenthal, S., Ritter, A., Nakov, P., & Stoyanov, V.
- Venue
- Proceedings of the 8th International Workshop on Semantic Evaluation (SemEval 2014)
- Published
- 2014
- Pages
- 73-80
- OpenAlex
- W2250243742
- Cited by
- 617
- References
- 19
- FWCI
- 61.66
- Type
- conference paper
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.