Fake News or Truth? Using Satirical Cues to Detect Potentially Misleading News
Open accessThe DOI matches its Crossref record; 34 of the 34 references it cites were found in a registry or an index.
Abstract
Satire is an attractive subject in deception detection research: it is a type of deception that intentionally incorporates cues revealing its own deceptiveness.Whereas other types of fabrications aim to instill a false sense of truth in the reader, a successful satirical hoax must eventually be exposed as a jest.This paper provides a conceptual overview of satire and humor, elaborating and illustrating the unique features of satirical news, which mimics the format and style of journalistic reporting.Satirical news stories were carefully matched and examined in contrast with their legitimate news counterparts in 12 contemporary news topics in 4 domains (civics, science, business, and "soft" news).Building on previous work in satire detection, we proposed an SVMbased algorithm, enriched with 5 predictive features (Absurdity, Humor, Grammar, Negative Affect, and Punctuation) and tested their combinations on 360 news articles.Our best predicting feature combination (Absurdity, Grammar and Punctuation) detects satirical news with a 90% precision and 84% recall (F-score=87%).Our work in algorithmically identifying satirical news pieces can aid in minimizing the potential deceptive impact of satire.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Scikit-learn: Machine Learning in Python
Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., Blondel, M., Müller, A., Nothman, J., Louppe, G., et al. (2012) · arXiv · doi:10.48550/arxiv.1201.0490 · Cited by 71,016
Verbs semantics and lexical selection
Wu, Z., & Palmer, M. (1994) · Proceedings of the 32nd annual meeting on Association for Computational Linguistics - · doi:10.3115/981732.981751 · Cited by 3,136
The Development and Psychometric Properties of LIWC2015
Pennebaker, J. W., Boyd, R. L., Jordan, K., & Blackburn, K. (2015) · University of Texas at Austin · doi:10.15781/t25p41 · Cited by 1,674
Interpersonal Deception Theory
Buller, D. B., & Burgoon, J. K. (1996) · Communication Theory · doi:10.1111/j.1468-2885.1996.tb00127.x · Cited by 1,195
Deception detection for news: Three types of fakes
Rubin, V. L., Chen, Y., & Conroy, N. K. (2015) · Proceedings of the Association for Information Science and Technology · doi:10.1002/pra2.2015.145052010083 · Cited by 546
Self-citationOn the reception and detection of pseudo-profound bullshit
Pennycook, G., Allan Cheyne, J., Barr, N., Koehler, D. J., & Fugelsang, J. A. (2015) · Judgment and Decision Making · doi:10.1017/s1930297500006999 · Cited by 536
Polanyi, L., & Zaenen, A. (2006) · The Information Retrieval Series · doi:10.1007/1-4020-4102-0_1 · Cited by 521
Utsumi, A. (2000) · Journal of Pragmatics · doi:10.1016/s0378-2166(99)00116-2 · Cited by 499
A multidimensional approach for detecting irony in Twitter
Reyes, A., Rosso, P., & Veale, T. (2013) · Language Resources and Evaluation · doi:10.1007/s10579-012-9196-x · Cited by 454
Zhou, L., Burgoon, J. K., Nunamaker, J. F., & Twitchell, D. (2004) · Group Decision and Negotiation · doi:10.1023/b:grup.0000011944.62889.6f · Cited by 440
Cited by
Fake News Detection on Social Media: A Data Mining Perspective
Shu, K., Sliva, A., Wang, S., Tang, J., & Liu, H. (2017) · ACM SIGKDD Explorations Newsletter · doi:10.1145/3137597.3137600 · Cited by 3,304
An overview of online fake news: Characterization, detection, and discussion
Zhang, X., & Ghorbani, A. A. (2020) · Information Processing & Management · doi:10.1016/j.ipm.2019.03.004 · Cited by 997
MVAE: Multimodal Variational Autoencoder for Fake News Detection
Khattar, D., Goud, J. S., Gupta, M., & Varma, V. (2019) · The World Wide Web Conference · doi:10.1145/3308558.3313552 · Cited by 799
Fake news, disinformation and misinformation in social media: a review
Aïmeur, E., Amri, S., & Brassard, G. (2023) · Social Network Analysis and Mining · doi:10.1007/s13278-023-01028-5 · Cited by 772
Horne, B., & Adali, S. (2017) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v11i1.14976 · Cited by 688
A Stylometric Inquiry into Hyperpartisan and Fake News
Potthast, M., Kiesel, J., Reinartz, K., Bevendorff, J., & Stein, B. (2018) · Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p18-1022 · Cited by 686
A survey on fake news and rumour detection techniques
Bondielli, A., & Marcelloni, F. (2019) · Information Sciences · doi:10.1016/j.ins.2019.05.035 · Cited by 658
“[78] has trained an SVM for satirical fake news detection with a number of content-based features, obtaining an F1 of 0.”
BackgroundMethodInfluentialDetection of Online Fake News Using N-Gram Analysis and Machine Learning Techniques
Ahmed, H., Traore, I., & Saad, S. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-69155-8_9 · Cited by 658
Fake News Detection on Social Media: A Data Mining Perspective
Shu, K., Sliva, A. L., Wang, S., Tang, J., & Liu, H. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1708.01967 · Cited by 581
Detecting opinion spams and fake news using text classification
Ahmed, H., Traore, I., & Saad, S. (2018) · SECURITY AND PRIVACY · doi:10.1002/spy2.9 · Cited by 521
Combating Fake News: A Survey on Identification and Mitigation Techniques
Sharma, K., Qian, F., Jiang, H., Ruchansky, N., Zhang, M., & Liu, Y. (2019) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3305260 · Cited by 514
“[95] analyzed several text analysisbased features, such as the number of punctuation marks and the sentiment of the text.”
BackgroundAutomatic Detection of Fake News
Pérez‐Rosas, V., Kleinberg, B., Lefevre, A., & Mihalcea, R. F. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1708.07104 · Cited by 502
Fake News Detection Using Machine Learning Ensemble Methods
Ahmad, I., Yousaf, M., Yousaf, S., & Ahmad, M. O. (2020) · Complexity · doi:10.1155/2020/8885861 · Cited by 474
Fake news detection within online social media using supervised artificial intelligence algorithms
Ozbay, F. A., & Alatas, B. (2020) · Physica A: Statistical Mechanics and its Applications · doi:10.1016/j.physa.2019.123174 · Cited by 394
Fake news detection on social media using geometric deep learning
Monti, F., Frasca, F., Eynard, D., Mannion, D., & Bronstein, M. M. (2019) · arXiv · doi:10.48550/arxiv.1902.06673 · Cited by 392
Harnessing Artificial Intelligence Capabilities to Improve Cybersecurity
Zeadally, S., Adi, E., Baig, Z., & Khan, I. A. (2020) · IEEE Access · doi:10.1109/access.2020.2968045 · Cited by 316
Detecting fake news by exploring the consistency of multimodal data
Xue, J., Wang, Y., Tian, Y., Li, Y., Shi, L., & Wei, L. (2021) · Information Processing & Management · doi:10.1016/j.ipm.2021.102610 · Cited by 298
False Information on Web and Social Media: A Survey
Kumar, S., & Shah, N. (2018) · arXiv · doi:10.48550/arxiv.1804.08559 · Cited by 289
“[80] studied satire news separately from the viewpoint of misleading readers into believing it is true, and also found that satirical articles pack a lot of information in single sentences.”
BackgroundFighting an Infodemic: COVID-19 Fake News Dataset
Patwa, P., Sharma, S., Pykl, S., Guptha, V., Kumari, G., Akhtar, M. S., Ekbal, A., Das, A., & Chakraborty, T. (2021) · Communications in Computer and Information Science · doi:10.1007/978-3-030-73696-5_3 · Cited by 271
Automating fake news detection system using multi-level voting model
Kaur, S., Kumar, P., & Kumaraguru, P. (2020) · Soft Computing · doi:10.1007/s00500-019-04436-y · Cited by 190
Gongane, V. U., Munot, M. V., & Anuse, A. D. (2022) · Social Network Analysis and Mining · doi:10.1007/s13278-022-00951-3 · Cited by 153
Rubin, V. L. (2019) · Journal of Documentation · doi:10.1108/jd-12-2018-0209 · Cited by 146
Self-citationPaschen, J. (2019) · Journal of Product & Brand Management · doi:10.1108/jpbm-12-2018-2179 · Cited by 132
Detecting fake news stories via multimodal analysis
Singh, V. K., Ghosh, I., & Sonagara, D. (2021) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.24359 · Cited by 128
Feature-based detection of automated language models: tackling GPT-2, GPT-3 and Grover
Fröhling, L., & Zubiaga, A. (2021) · PeerJ Computer Science · doi:10.7717/peerj-cs.443 · Cited by 106
The Web of False Information: Rumors, Fake News, Hoaxes, Clickbait, and Various Other Shenanigans
Zannettou, S., Sirivianos, M., Blackburn, J., & Kourtellis, N. (2019) · Journal of Data and Information Quality · doi:10.1145/3309699 · Cited by 86
“[155] (S), Kumar et al.”
On Sentiment of Online Fake News
Zaeem, R. N., Li, C., & Barber, K. S. (2020) · 2020 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining (ASONAM) · doi:10.1109/asonam49781.2020.9381323 · Cited by 61
Dataset of Fake News Detection and Fact Verification: A Survey
Murayama, T. (2021) · arXiv · doi:10.48550/arxiv.2111.03299 · Cited by 40
“SatiricalCues [184] 360 articles 2 Civics, Science, The Onion, News articles Satire detection English 2016 Business, Soft news The Beaverton”
BackgroundBeyond Text: Multimodal Credibility Assessment Approaches for Online User-Generated Content
Choudhary, M., Chouhan, S. S., & Rathore, S. S. (2024) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3673236 · Cited by 20
One-Class Learning for AI-Generated Essay Detection
Corizzo, R., & Leal-Arenas, S. (2023) · Applied Sciences · doi:10.3390/app13137901 · Cited by 16
A deep fusion model for human $vs$. Machine-generated essay classification
Corizzo, R., & Leal-Arenas, S. (2023) · 2023 International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn54540.2023.10191322 · Cited by 13
Metadata
- Authors
- Rubin, V., Conroy, N., Chen, Y., & Cornwell, S.
- Venue
- Proceedings of the Second Workshop on Computational Approaches to Deception Detection
- Published
- 2016
- Pages
- 7-17
- OpenAlex
- W2516338333
- Cited by
- 584
- References
- 34
- FWCI
- 141.25
- Type
- conference paper
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.