Fighting post-truth using natural language processing: A review and open challenges
Open accessThe DOI matches its Crossref record; 23 of the 23 references it cites were found in a registry or an index.
Abstract
Post-truth is a term that describes a distorting phenomenon that aims to manipulate public opinion and behavior. One of its key engines is the spread of Fake News. Nowadays most news is rapidly disseminated in written language via digital media and social networks. Therefore, to detect fake news it is becoming increasingly necessary to apply Artificial Intelligence (AI) and, more specifically Natural Language Processing (NLP). This paper presents a review of the application of AI to the complex task of automatically detecting fake news. The review begins with a definition and classification of fake news. Considering the complexity of the fake news detection task, a divide-and-conquer methodology was applied to identify a series of subtasks to tackle the problem from a computational perspective. As a result, the following subtasks were identified: deception detection; stance detection; controversy and polarization; automated fact checking; clickbait detection; and, credibility scores. From each subtask, a PRISMA compliant systematic review of the main studies was undertaken, searching Google Scholar. The various approaches and technologies are surveyed, as well as the resources and competitions that have been involved in resolving the different subtasks. The review concludes with a roadmap for addressing the future challenges that have emerged from the analysis of the state of the art, providing a rich source of potential work for the research community going forward.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The spread of true and false news online
Vosoughi, S., Roy, D., & Aral, S. (2018) · Science · doi:10.1126/science.aap9559 · Cited by 8,847 · cited 2×
“In a post-truth era alternative facts replace actual6 facts, and feelings have more weight than evidence (McIntyre, 2018).7 One of the key engines of the post-truth era is the proliferation of fake8 news, which has been facilitated by the growth of digital and social me-9 dia personal blogs, alternative media and soci…”
BackgroundA large annotated corpus for learning natural language inference
Bowman, S. R., Angeli, G., Potts, C., & Manning, C. D. (2015) · Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d15-1075 · Cited by 3,377
Fake News Detection on Social Media: A Data Mining Perspective
Shu, K., Sliva, A., Wang, S., Tang, J., & Liu, H. (2017) · ACM SIGKDD Explorations Newsletter · doi:10.1145/3137597.3137600 · Cited by 3,304
DePaulo, B. M., Lindsay, J. J., Malone, B. E., Muhlenbruck, L., Charlton, K., & Cooper, H. (2003) · Psychological Bulletin · doi:10.1037/0033-2909.129.1.74 · Cited by 2,479 · cited 10×
“In the 455 same domain, but for Italian language, Fornaciari & Poesio (2012) created 456 the DECOUR - DEception in COURt - corpus. DECOUR is a corpus con457 sisting of 3,015 utterances extracted from the transcripts of 35 hearings held 458 in four Italian Courts. Fuller et al. (2009) collected a set of real-world data…”
BackgroundMethodInfluentialJindal, N., & Liu, B. (2008) · Proceedings of the international conference on Web search and web data mining - WSDM '08 · doi:10.1145/1341531.1341560 · Cited by 1,542
FEVER: a Large-scale Dataset for Fact Extraction and VERification
Thorne, J., Vlachos, A., Christodoulopoulos, C., & Mittal, A. (2018) · Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers) · doi:10.18653/v1/n18-1074 · Cited by 1,343
Finding Deceptive Opinion Spam by Any Stretch of the Imagination
Ott, M., Choi, Y., Cardie, C., & Hancock, J. T. (2011) · arXiv · doi:10.48550/arxiv.1107.4557 · Cited by 1,008
Social Media as Information Source: Recency of Updates and Credibility of Information
Westerman, D., Spence, P. R., & Van Der Heide, B. (2014) · Journal of Computer-Mediated Communication · doi:10.1111/jcc4.12041 · Cited by 708
Influence of fake news in Twitter during the 2016 US presidential election
Bovet, A., & Makse, H. A. (2019) · Nature Communications · doi:10.1038/s41467-018-07761-2 · Cited by 701
Computational Fact Checking from Knowledge Networks
Ciampaglia, G. L., Shiralkar, P., Rocha, L. M., Bollen, J., Menczer, F., & Flammini, A. (2015) · PLOS ONE · doi:10.1371/journal.pone.0128193 · Cited by 486
Quantifying controversy on social media
Garimella, K., Morales, G. D. F., Gionis, A., & Mathioudakis, M. (2018) · ACM Transactions on Social Computing · doi:10.1145/3140565 · Cited by 472
Zhou, L., Burgoon, J. K., Nunamaker, J. F., & Twitchell, D. (2004) · Group Decision and Negotiation · doi:10.1023/b:grup.0000011944.62889.6f · Cited by 440
Fact Checking: Task definition and dataset construction
Vlachos, A., & Riedel, S. (2014) · Proceedings of the ACL 2014 Workshop on Language Technologies and Computational Social Science · doi:10.3115/v1/w14-2508 · Cited by 402
Stop clickbait: detecting and preventing clickbaits in online news media
Chakraborty, A., Paranjape, B., Kakarla, S., & Ganguly, N. (2016) · 2016 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining (ASONAM) · doi:10.1109/asonam.2016.7752207 · Cited by 368
Emergent: a novel data-set for stance classification
Ferreira, W., & Vlachos, A. (2016) · Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.18653/v1/n16-1138 · Cited by 360
SemEval-2017 Task 8: RumourEval: Determining rumour veracity and support for rumours
Derczynski, L., Bontcheva, K., Liakata, M., Procter, R., Wong Sak Hoi, G., & Zubiaga, A. (2017) · Proceedings of the 11th International Workshop on Semantic Evaluation (SemEval-2017) · doi:10.18653/v1/s17-2006 · Cited by 323
Factors Influencing Information credibility on Social Media Platforms: Evidence from Facebook Pages
Li, R., & Suh, A. (2015) · Procedia Computer Science · doi:10.1016/j.procs.2015.12.146 · Cited by 225
The Fact Extraction and VERification (FEVER) Shared Task
Thorne, J., Vlachos, A., Cocarascu, O., Christodoulopoulos, C., & Mittal, A. (2018) · Proceedings of the First Workshop on Fact Extraction and VERification (FEVER) · doi:10.18653/v1/w18-5501 · Cited by 212
Detecting Deception through Linguistic Analysis
Burgoon, J. K., Blair, J. P., Qin, T., & Nunamaker, J. F. (2003) · Lecture Notes in Computer Science · doi:10.1007/3-540-44853-5_7 · Cited by 209
Armstrong, C. L., & McAdams, M. J. (2009) · Journal of Computer-Mediated Communication · doi:10.1111/j.1083-6101.2009.01448.x · Cited by 179
Experiments in open domain deception detection
Pérez-Rosas, V., & Mihalcea, R. (2015) · Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d15-1133 · Cited by 97
Using TwitterTrails.com to Investigate Rumor Propagation
Metaxas, P. T., Finn, S., & Mustafaraj, E. (2015) · Proceedings of the 18th ACM Conference Companion on Computer Supported Cooperative Work & Social Computing · doi:10.1145/2685553.2702691 · Cited by 54
On the credibility perception of news on Twitter: Readers, topics and features
Shariff, S. M., Zhang, X., & Sanderson, M. (2017) · Computers in Human Behavior · doi:10.1016/j.chb.2017.06.026 · Cited by 49
Cited by
A Review on Fact Extraction and Verification
Bekoulis, G., Papagiannopoulou, C., & Deligiannis, N. (2023) · ACM Computing Surveys · doi:10.1145/3485127 · Cited by 48
Clickbait: Research, challenges and opportunities – A systematic literature review
Jácobo-Morales, D., & Marino-Jiménez, M. (2024) · Online Journal of Communication and Media Technologies · doi:10.30935/ojcmt/15267 · Cited by 23
Impact of Celebrity Endorsement and Breaking News Effect on the Attention of Consumers
Lazar, L., & Pop, M.-I. (2021) · Studia Universitatis „Vasile Goldis” Arad – Economics Series · doi:10.2478/sues-2021-0014 · Cited by 10
“This phenomenon is problematic as it affects the credibility of media and directly contributes to a higher spreading degree of fake news in the online environment (Saquete et al., 2020).”
Background
Metadata
- Authors
- Saquete, E., Tomás, D., Moreda, P., Martínez-Barco, P., & Palomar, M.
- Venue
- Expert Systems with Applications
- Publisher
- Elsevier BV
- Published
- 2020-03
- Volume
- 141
- Pages
- 112943
- ISSN
- 0957-4174 (ISSN-L)
- OpenAlex
- W2973131549
- Cited by
- 100
- References
- 23
- FWCI
- 26.25
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.