ICWSM — A Great Catchy Name: Semi-Supervised Recognition of Sarcastic Sentences in Online Product Reviews
Open accessThe DOI matches its Crossref record; 27 of the 27 references it cites were found in a registry or an index.
Abstract
Sarcasm is a sophisticated form of speech act widely used in online communities. Automatic recognition of sarcasm is, however, a novel task. Sarcasm recognition could contribute to the performance of review summarization and ranking systems. This paper presents SASI, a novel Semi-supervised Algorithm for Sarcasm Identification that recognizes sarcastic sentences in product reviews. SASI has two stages: semi-supervised pattern acquisition, and sarcasm classification. We experimented on a data set of about 66000 Amazon reviews for various books and products. Using a gold standard in which each sentence was tagged by 3 annotators, we obtained precision of 77% and recall of 83.1% for identifying sarcastic sentences. We found some strong features that characterize sarcastic utterances. However, a combination of more subtle pattern-based features proved more promising in identifying the various facets of sarcasm. We also speculate on the motivation for using sarcasm in online communities and social networks.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Measurement of Observer Agreement for Categorical Data
Landis, J. R., & Koch, G. G. (1977) · Biometrics · doi:10.2307/2529310 · Cited by 81,148
Grice, H. P. (1975) · Speech Acts · doi:10.1163/9789004368811_003 · Cited by 23,221
Mining and summarizing customer reviews
Hu, M., & Liu, B. (2004) · Proceedings of the tenth ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/1014052.1014073 · Cited by 7,793
Opinion Mining and Sentiment Analysis
Pang, B., & Lee, L. (2008) · now publishers, Inc. eBooks · doi:10.1561/9781601981516 · Cited by 6,720
A sentimental education: sentiment analysis using subjectivity summarization based on minimum cuts
Pang, B., & Lee, L. (2004) · Proceedings of the 42nd Annual Meeting on Association for Computational Linguistics - ACL '04 · doi:10.3115/1218955.1218990 · Cited by 3,301
Extracting product features and opinions from reviews
Popescu, A.-M., & Etzioni, O. (2005) · Proceedings of the conference on Human Language Technology and Empirical Methods in Natural Language Processing - HLT '05 · doi:10.3115/1220575.1220618 · Cited by 1,698
Wiebe, J., Wilson, T., Bruce, R., Bell, M., & Martin, M. (2004) · Computational Linguistics · doi:10.1162/0891201041850885 · Cited by 748
A Sentimental Education: Sentiment Analysis Using Subjectivity Summarization Based on Minimum Cuts
Pang, B., & Lee, L. (2004) · arXiv (Cornell University) · doi:10.48550/arxiv.cs/0409058 · Cited by 652
On the psycholinguistics of sarcasm.
Gibbs, R. W. (1986) · Journal of Experimental Psychology: General · doi:10.1037//0096-3445.115.1.3 · Cited by 635
Wilson, D., & Sperber, D. (1992) · Lingua · doi:10.1016/0024-3841(92)90025-e · Cited by 575
Polanyi, L., & Zaenen, A. (2006) · The Information Retrieval Series · doi:10.1007/1-4020-4102-0_1 · Cited by 521
Utsumi, A. (2000) · Journal of Pragmatics · doi:10.1016/s0378-2166(99)00116-2 · Cited by 499
Extracting Product Features and Opinions from Reviews
Popescu, A.-M., & Etzioni, O. (2007) · Natural Language Processing and Text Mining · doi:10.1007/978-1-84628-754-1_2 · Cited by 494
Low-Quality Product Review Detection in Opinion Summarization
Liu, J., Cao, Y., Lin, C.-Y., Huang, Y., & Zhou, M. (2007) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · Cited by 448
On the pretense theory of irony.
Clark, H. H., & Gerrig, R. J. (1984) · PubMed · Cited by 413
Making computers laugh: investigations in automatic humor recognition
Mihalcea, R., & Strapparava, C. (2005) · Proceedings of the conference on Human Language Technology and Empirical Methods in Natural Language Processing - HLT '05 · doi:10.3115/1220575.1220642 · Cited by 224
yeah right: sarcasm recognition for spoken dialogue systems
Tepperman, J., Traum, D. R., & Narayanan, S. S. (2006) · Interspeech (USB) · doi:10.21437/interspeech.2006-507 · Cited by 196
Psychological aspects of irony understanding
Gibbs, R. W., & O'Brien, J. (1991) · Journal of Pragmatics · doi:10.1016/0378-2166(91)90101-3 · Cited by 189
Automatic satire detection: are you having a laugh?
Burfoot, C., & Baldwin, T. (2009) · Proceedings of the ACL-IJCNLP 2009 Conference Short Papers on - ACL-IJCNLP '09 · doi:10.3115/1667583.1667633 · Cited by 145
Targeting Sentiment Expressions through Supervised Ranking of Linguistic Configurations
Kessler, J. S., & Nicolov, N. (2009) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v3i1.13948 · Cited by 141
RevRank: A Fully Unsupervised Algorithm for Selecting the Most Helpful Book Reviews
Tsur, O., & Rappoport, A. (2009) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v3i1.13945 · Cited by 134
Self-citationCharacterizing Humour: An Exploration of Features in Humorous Texts
Mihalcea, R. F., & Pulman, S. (2007) · Lecture notes in computer science · doi:10.1007/978-3-540-70939-8_30 · Cited by 110
Davidov, D., & Rappoport, A. (2006) · International Conference on Computational Linguistics · doi:10.3115/1220175.1220213 · Cited by 92
Self-citationRundell, M. (2002) · Cited by 73
How opinions are received by online communities: A case study on Amazon.com helpfulness votesPreprint
Danescu-Niculescu-Mizil, C., Kossinets, G., Kleinberg, J. M., & Lee, L. (2009) · arXiv (Cornell University) · doi:10.48550/arxiv.0906.3741 · Cited by 65
Linguistics: Syntax and Semantics. Volume 1. JOHN P. KIMBALL
Bendix, E. H. (1975) · American Anthropologist · doi:10.1525/aa.1975.77.4.02a00910 · Cited by 46
Making Computers Laugh: Investigations in Automatic Humor Recognition
Mihalcea, R., & Strapparava, C. (2005) · University of North Texas Digital Library (University of North Texas) · Cited by 15
Cited by
Sentiment Analysis and Opinion Mining
Liu, B. (2012) · Synthesis Lectures on Human Language Technologies · doi:10.1007/978-3-031-02145-9 · Cited by 3,281
Sentiment Analysis and Opinion Mining
Zhang, L., & Liu, B. (2017) · Encyclopedia of Machine Learning and Data Mining · doi:10.1007/978-1-4899-7687-1_907 · Cited by 3,260
Techniques and applications for sentiment analysis
Feldman, R. (2013) · Communications of the ACM · doi:10.1145/2436256.2436274 · Cited by 1,489
Improving sentiment analysis via sentence type classification using BiLSTM-CRF and CNN
Chen, T., Xu, R., He, Y., & Wang, X. (2017) · Expert Systems with Applications · doi:10.1016/j.eswa.2016.10.065 · Cited by 730
Sentiment Analysis and Opinion Mining
Zhang, L., & Liu, B. (2016) · Encyclopedia of Machine Learning and Data Mining · doi:10.1007/978-1-4899-7502-7_907-1 · Cited by 614
Metadata
- Authors
- Tsur, O., Davidov, D., & Rappoport, A.
- Venue
- Proceedings of the International AAAI Conference on Web and Social Media
- Published
- 2010-05-16
- Volume
- 4
- Issue
- 1
- Pages
- 162-169
- ISSN
- 2162-3449 (ISSN-L)
- 2334-0770
- OpenAlex
- W2099653665
- Cited by
- 347
- References
- 27
- FWCI
- 12.47
- Type
- conference paper
- Language
- en
- Open access
- diamond
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.