The DOI matches its Crossref record; 60 of the 60 references it cites were found in a registry or an index.
Automatic Sarcasm Detection: A Survey
Open accessAbstract
Automatic sarcasm detection is the task of predicting sarcasm in text. This is a crucial step to sentiment analysis, considering prevalence and challenges of sarcasm in sentiment-bearing text. Beginning with an approach that used speech-based features, automatic sarcasm detection has witnessed great interest from the sentiment analysis community. This article is a compilation of past work in automatic sarcasm detection. We observe three milestones in the research so far: semi-supervised pattern extraction to identify implicit sentiment, use of hashtag-based supervision, and incorporation of context beyond target text. In this article, we describe datasets, approaches, trends, and issues in sarcasm detection. We also discuss representative performance values, describe shared tasks, and provide pointers to future work, as given in prior works. In terms of resources to understand the state-of-the-art, the survey presents several useful illustrations—most prominently, a table that summarizes past papers along different dimensions such as the types of features, annotation techniques, and datasets used.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Poetics of Mind: Figurative Thought, Language, and Understanding
Gibbs, R. W. (1994) · Medical Entomology and Zoology · Cited by 2,979
Sentiment Analysis and Subjectivity
Bing, L. (2010) · Cited by 1,724
Identifying Sarcasm in Twitter: A Closer Look
González‐Ibáñez, R., Muresan, S., & Wacholder, N. (2011) · Cited by 627
SemEval-2014 Task 9: Sentiment Analysis in Twitter
Rosenthal, S., Ritter, A., Nakov, P., & Stoyanov, V. (2014) · Proceedings of the 8th International Workshop on Semantic Evaluation (SemEval 2014) · doi:10.3115/v1/s14-2009 · Cited by 617
How to be sarcastic: The echoic reminder theory of verbal irony.
Kreuz, R. J., & Glucksberg, S. (1989) · Journal of Experimental Psychology General · doi:10.1037//0096-3445.118.4.374 · Cited by 605
Sarcasm as Contrast between a Positive Sentiment and Negative Situation
Riloff, E., Qadir, A., Surve, P., De Silva, L., Gilbert, N., & Huang, R. (2013) · Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d13-1066 · Cited by 587
The pragmatics of verbal irony: Echo or pretence?
Wilson, D. (2006) · Lingua · doi:10.1016/j.lingua.2006.05.001 · Cited by 496
A multidimensional approach for detecting irony in Twitter
Reyes, A., Rosso, P., & Veale, T. (2013) · Language Resources and Evaluation · doi:10.1007/s10579-012-9196-x · Cited by 454
Semi-supervised recognition of sarcastic sentences in Twitter and Amazon
Davidov, D., Tsur, O., & Rappoport, A. (2010) · Cited by 424
Giora, R. (1995) · Discourse Processes · doi:10.1080/01638539509544916 · Cited by 388
From humor recognition to irony detection: The figurative language of social media
Reyes, A., Rosso, P., & Buscaldi, D. (2012) · Data & Knowledge Engineering · doi:10.1016/j.datak.2012.02.005 · Cited by 377
Sarcasm Detection on Twitter: A Behavioral Modeling Approach
Rajadesingan, A., Zafarani, R., & Liu, H. (2015) · Proceedings of the Eighth ACM International Conference on Web Search and Data Mining · doi:10.1145/2684822.2685316 · Cited by 363
Contextualized Sarcasm Detection on Twitter
Bamman, D., & Smith, N. (2021) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v9i1.14655 · Cited by 352
Who cares about Sarcastic Tweets? Investigating the Impact of Sarcasm on Sentiment Analysis.
Maynard, D., & Greenwood, M. (2014) · Language Resources and Evaluation Conference (LREC) · doi:10.63317/2ios4bdd5xas · Cited by 349
Tsur, O., Davidov, D., & Rappoport, A. (2010) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v4i1.14018 · Cited by 347
Harnessing Context Incongruity for Sarcasm Detection
Joshi, A., Sharma, V., & Bhattacharyya, P. (2015) · doi:10.3115/v1/p15-2124 · Cited by 329
Self-citationA Deeper Look into Sarcastic Tweets Using Deep Convolutional Neural Networks
Poria, S., Cambria, E., Hazarika, D., & Vij, P. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1610.08815 · Cited by 292
Fracking Sarcasm using Neural Network
Ghosh, A., & Veale, D. T. (2016) · Proceedings of the 7th Workshop on Computational Approaches to Subjectivity, Sentiment and Social Media Analysis · doi:10.18653/v1/w16-0425 · Cited by 290
Wit and humor in discourse processing
Long, D. L., & Graesser, A. C. (1988) · Discourse Processes · doi:10.1080/01638538809544690 · Cited by 276
Modelling Context with User Embeddings for Sarcasm Detection in Social Media
Amir, S., Wallace, B. C., Lyu, H., Carvalho, P., & Silva, M. J. (2016) · Proceedings of The 20th SIGNLL Conference on Computational Natural Language Learning · doi:10.18653/v1/k16-1017 · Cited by 272
Verbal irony: Pretense or echoic mention?
Sperber, D. (1984) · Journal of Experimental Psychology: General · doi:10.1037//0096-3445.113.1.130 · Cited by 249
The perfect solution for detecting sarcasm in tweets #not
Liebrecht, C., Kunneman, F., & van den Bosch, A. P. J. (2013) · Radboud Repository (Radboud University) · Cited by 245
Lexical influences on the perception of sarcasm
Kreuz, R. J., & Caucci, G. M. (2007) · Proceedings of the Workshop on Computational Approaches to Figurative Language - FigLanguages '07 · doi:10.3115/1611528.1611529 · Cited by 244
Sarcasm, Pretense, and The Semantics/Pragmatics Distinction*
Camp, E. (2012) · Noûs · doi:10.1111/j.1468-0068.2010.00822.x · Cited by 228
A Corpus for Research on Deliberation and Debate
Walker, M. A., Tree, J. E. F., Anand, P., Abbott, R., & King, J. (2012) · Language Resources and Evaluation Conference (LREC) · doi:10.63317/2ommjodrhqvf · Cited by 223
Proceedings of the 13th Pacific Asia Conference on Language, Information and Computation
Wang, J.-F., & Wu, C. (1999) · Pacific Asia Conference on Language, Information, and Computation · Cited by 209
Psychological aspects of irony understanding
Gibbs, R. W., & O'Brien, J. (1991) · Journal of Pragmatics · doi:10.1016/0378-2166(91)90101-3 · Cited by 189
Irony and Sarcasm: Corpus Generation and Analysis Using Crowdsourcing
Filatova, E. (2012) · Language Resources and Evaluation Conference (LREC) · doi:10.63317/2esatvw48hsm · Cited by 179
Modelling Sarcasm in Twitter, a Novel Approach
Barbieri, F., Saggion, H., & Ronzano, F. (2014) · Proceedings of the 5th Workshop on Computational Approaches to Subjectivity, Sentiment and Social Media Analysis · doi:10.3115/v1/w14-2609 · Cited by 175
Making objective decisions from subjective data: Detecting irony in customer reviews
Reyes, A., & Rosso, P. (2012) · Decision Support Systems · doi:10.1016/j.dss.2012.05.027 · Cited by 173
A Large Self-Annotated Corpus for Sarcasm
Khodak, M., Saunshi, N., & Vodrahalli, K. (2018) · Language Resources and Evaluation Conference (LREC) · doi:10.63317/2ifwj74dgdbw · Cited by 171
The Differential Role of Ridicule in Sarcasm and Irony
Lee, C., & Katz, A. N. (1998) · Metaphor and Symbol · doi:10.1207/s15327868ms1301_1 · Cited by 170
Sarcasm Detection on Czech and English Twitter
Ptáċek, T., Habernal, I., & Hong, J. S. (2014) · Research Portal (Queen's University Belfast) · Cited by 170
Figurative messages and affect in Twitter: Differences between #irony, #sarcasm and #not
Sulis, E., Irazú Hernández Farías, D., Rosso, P., Patti, V., & Ruffo, G. (2016) · Knowledge-Based Systems · doi:10.1016/j.knosys.2016.05.035 · Cited by 170
Detecting Ironic Intent in Creative Comparisons
Tony, V., & Yanfen, H. (2010) · Frontiers in Artificial Intelligence and Applications · doi:10.3233/978-1-60750-606-5-765 · Cited by 167
Are There Necessary Conditions for Inducing a Sense of Sarcastic Irony?
Campbell, J. D., & Katz, A. N. (2012) · Discourse Processes · doi:10.1080/0163853x.2012.687863 · Cited by 160
Irony Detection in Twitter: The Role of Affective Content
Farías, D. I. H., Patti, V., & Rosso, P. (2016) · ACM Transactions on Internet Technology · doi:10.1145/2930663 · Cited by 154
yeah right: sarcasm recognition for spoken dialogue systems
Tepperman, J., Traum, D. R., & Narayanan, S. S. (2006) · Interspeech (USB) · doi:10.21437/interspeech.2006-507 · Cited by 153
On the difficulty of automatically detecting irony: beyond a simple case of negation
Reyes, A., & Rosso, P. (2013) · Knowledge and Information Systems · doi:10.1007/s10115-013-0652-8 · Cited by 149
Humans Require Context to Infer Ironic Intent (so Computers Probably do, too)
Wallace, B., Choe, D. K., Kertz, L., & Eugene Charniak, D. (2014) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.3115/v1/p14-2084 · Cited by 143
Indonesian social media sentiment analysis with sarcasm detection
Lunando, E., & Purwarianti, A. (2013) · International Conference on Advanced Computer Science and Information Systems · doi:10.1109/icacsis.2013.6761575 · Cited by 134
Humor styles and their relationship to explicit and implicit self-esteem
Stieger, S., Formann, A. K., & Burger, C. (2010) · Personality and Individual Differences · doi:10.1016/j.paid.2010.11.025 · Cited by 127
Sarcasm detection in microblogs using Naïve Bayes and fuzzy clustering
Mukherjee, S., & Bala, P. K. (2016) · Technology in Society · doi:10.1016/j.techsoc.2016.10.003 · Cited by 120
Sarcastic or Not: Word Embeddings to Predict the Literal or Sarcastic Meaning of Words
Ghosh, D., Guo, W., & Muresan, S. (2015) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d15-1116 · Cited by 117
An Impact Analysis of Features in a Classification Approach to Irony Detection in Product Reviews
Buschmeier, K., Cimiano, P., & Klinger, R. (2014) · Workshop on Computational Approaches to Subjectivity, Sentiment and Social Media Analysis (WASSA) · doi:10.3115/v1/w14-2608 · Cited by 116
Wallace, B., Choe, D. K., & Charniak, E. (2015) · doi:10.3115/v1/p15-1100 · Cited by 93
Lukin, S. M., & Walker, M. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1708.08572 · Cited by 81
Sarcasm SIGN: Interpreting Sarcasm with Sentiment Based Monolingual Machine Translation
Peled-Cohen, L., & Reichart, R. (2017) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p17-1155 · Cited by 77
Twitter Sarcasm Detection Exploiting a Context-Based Model
Wang, Z., Wu, Z., Wang, R., & Ren, Y. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-26190-4_6 · Cited by 71
Harnessing Sequence Labeling for Sarcasm Detection in Dialogue from TV Series `Friends'
Joshi, A., Tripathi, V., Bhattacharyya, P., & Carman, M. (2016) · Conference on Computational Natural Language Learning · doi:10.18653/v1/k16-1015 · Cited by 70
Self-citationHarnessing Cognitive Features for Sarcasm Detection
Mishra, A., Kanojia, D., Nagar, S., Dey, K., & Bhattacharyya, P. (2016) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p16-1104 · Cited by 64
Self-citationAbercrombie, G., & Hovy, D. (2016) · doi:10.18653/v1/p16-3016 · Cited by 63
Applying Basic Features from Sentiment Analysis for Automatic Irony Detection
Hernández-Farías, I., Benedí, J.-M., & Rosso, P. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-19390-8_38 · Cited by 62
Charalampakis, B., Spathis, D., Kouslis, E., & Kermanidis, K. L. (2016) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2016.01.007 · Cited by 56
Identification of nonliteral language in social media: A case study on sarcasm
Muresan, S., González‐Ibáñez, R., Ghosh, D., & Wacholder, N. (2015) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.23624 · Cited by 52
♯Irony or ♯Sarcasm - A Quantitative and Qualitative Study Based on Twitter
Wang, P.-Y. A. (2013) · Waseda University Repository (Waseda University) · Cited by 51
“sure, i did the right thing”: a system for sarcasm detection in speech
Rakov, R., & Rosenberg, A. (2013) · Interspeech (USB) · doi:10.21437/interspeech.2013-239 · Cited by 35
Proceedings of the Workshop on Language Analysis in Social Media
Danescu-Niculescu-Mizil, C., Farzindar, A., Gamon, M., Inkpen, D. Z., & Nagarajan, M. (2013) · Cited by 31
Joshi, A., Bhattacharyya, P., Carman, M., et al. (2016) · doi:10.18653/v1/w16-2111 · Cited by 30
Self-citation
Cited by
Can Large Language Models Transform Computational Social Science?
Ziems, C., Held, W., Shaikh, O., Chen, J., Zhang, Z., & Yang, D. (2023) · arXiv · doi:10.48550/arxiv.2305.03514 · Cited by 839
Can Large Language Models Transform Computational Social Science?
Ziems, C., Held, W., Shaikh, O., Chen, J., Zhang, Z., & Yang, D. (2024) · Computational Linguistics · doi:10.1162/coli_a_00502 · Cited by 585
Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models
Srivastava, A., Rastogi, A., Rao, A., Shoeb, A. A. M., Abid, A., Fisch, A., Brown, A. R., Santoro, A., Gupta, A., Garriga-Alonso, A., et al. (2022) · arXiv · doi:10.48550/arxiv.2206.04615 · Cited by 569
Beneath the Tip of the Iceberg: Current Challenges and New Directions in Sentiment Analysis Research
Poria, S., Hazarika, D., Majumder, N., & Mihalcea, R. (2023) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2020.3038167 · Cited by 321
A Pattern-Based Approach for Sarcasm Detection on Twitter
Bouazizi, M., & Otsuki Ohtsuki, T. (2016) · IEEE Access · doi:10.1109/access.2016.2594194 · Cited by 303
Metadata
- Authors
- Joshi, A., Bhattacharyya, P., & Carman, M. J.
- Venue
- ACM Computing Surveys
- Published
- 2017-09-26
- Volume
- 50
- Issue
- 5
- Pages
- 1-22
- ISSN
- 0360-0300 (ISSN-L)
- 1557-7341
- OpenAlex
- W2252381721
- Cited by
- 411
- References
- 60
- FWCI
- 21.98
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.