The DOI matches its Crossref record; 28 of the 28 references it cites were found in a registry or an index.
SpotFake: A Multi-modal Framework for Fake News Detection
Abstract
A rapid growth in the amount of fake news on social media is a very serious concern in our society. It is usually created by manipulating images, text, audio, and videos. This indicates that there is a need of multimodal system for fake news detection. Though, there are multimodal fake news detection systems but they tend to solve the problem of fake news by considering an additional sub-task like event discriminator and finding correlations across the modalities. The results of fake news detection are heavily dependent on the subtask and in absence of subtask training, the performance of fake news detection degrade by 10% on an average. To solve this issue, we introduce SpotFake-a multi-modal framework for fake news detection. Our proposed solution detects fake news without taking into account any other subtasks. It exploits both the textual and visual features of an article. Specifically, we made use of language models (like BERT) to learn text features, and image features are learned from VGG-19 pre-trained on ImageNet dataset. All the experiments are performed on two publicly available datasets, i.e., Twitter and Weibo. The proposed model performs better than the current state-of-the-art on Twitter and Weibo datasets by 3.27% and 6.83%, respectively.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
Convolutional Neural Networks for Sentence Classification
Kim, Y. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1181 · Cited by 14,831
Social Media and Fake News in the 2016 Election
Allcott, H., & Gentzkow, M. (2017) · Journal of Economic Perspectives · doi:10.1257/jep.31.2.211 · Cited by 6,767 · cited 2×
“However, a recent study [3] define fake news “to be news”
BackgroundShow and tell: A neural image caption generator
Vinyals, O., Toshev, A., Bengio, S., & Erhan, D. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298935 · Cited by 6,318
Learning Entity and Relation Embeddings for Knowledge Graph Completion
Lin, Y., Liu, Z., Sun, M., Liu, Y., & Zhu, X. (2015) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v29i1.9491 · Cited by 3,749
Information credibility on twitter
Castillo, C., Mendoza, M., & Poblete, B. (2011) · Proceedings of the 20th international conference on World wide web · doi:10.1145/1963405.1963500 · Cited by 2,593
EANN: Event Adversarial Neural Networks for Multi-Modal Fake News Detection
Wang, Y., Ma, F., Jin, Z., Yuan, Y., Xun, G., Jha, K., Su, L., & Gao, J. (2018) · Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3219819.3219903 · Cited by 1,168
Automatic deception detection: Methods for finding fake news
Conroy, N. K., Rubin, V. L., & Chen, Y. (2015) · Proceedings of the Association for Information Science and Technology · doi:10.1002/pra2.2015.145052010082 · Cited by 979
Multimodal Fusion with Recurrent Neural Networks for Rumor Detection on Microblogs
Jin, Z., Cao, J., Guo, H., Zhang, Y., & Luo, J. (2017) · Proceedings of the 25th ACM international conference on Multimedia · doi:10.1145/3123266.3123454 · Cited by 812
MVAE: Multimodal Variational Autoencoder for Fake News Detection
Khattar, D., Goud, J. S., Gupta, M., & Varma, V. (2019) · The World Wide Web Conference · doi:10.1145/3308558.3313552 · Cited by 799
A Stylometric Inquiry into Hyperpartisan and Fake News
Potthast, M., Kiesel, J., Reinartz, K., Bevendorff, J., & Stein, B. (2018) · Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p18-1022 · Cited by 686
VQA: Visual Question Answering: www.visualqa.org
Agrawal, A., Lu, J., Antol, S., Mitchell, M., Zitnick, C. L., Parikh, D., & Batra, D. (2017) · International Journal of Computer Vision · doi:10.1007/s11263-016-0966-6 · Cited by 570
Fighting Fake News: Image Splice Detection via Learned Self-Consistency
Huh, M., Liu, A., Owens, A., & Efros, A. A. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01252-6_7 · Cited by 442
Misleading Online Content: Recognizing Clickbait as "False News"
Chen, Y., Conroy, N. J., & Rubin, V. L. (2015) · Proceedings of the 2015 ACM on Workshop on Multimodal Deception Detection · doi:10.1145/2823465.2823467 · Cited by 432
Detection of GAN-Generated Fake Images over Social Networks
Marra, F., Gragnaniello, D., Cozzolino, D., & Verdoliva, L. (2018) · 2018 IEEE Conference on Multimedia Information Processing and Retrieval (MIPR) · doi:10.1109/mipr.2018.00084 · Cited by 399 · cited 1×
“[18] used GANs to detect fake images.”
Detecting Clusters of Fake Accounts in Online Social Networks
Xiao, C., Freeman, D. M., & Hwa, T. (2015) · Proceedings of the 8th ACM Workshop on Artificial Intelligence and Security · doi:10.1145/2808769.2808779 · Cited by 184
Content Based Fake News Detection Using Knowledge Graphs
Pan, J. Z., Pavlova, S., Li, C., Li, N., Li, Y., & Liu, J. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-00671-6_39 · Cited by 183
The Fake News Spreading Plague: Was it Preventable?
Mustafaraj, E., & Metaxas, P. (2017) · ACM Web Science Conference (WebSci) · doi:10.1145/3091478.3091523 · Cited by 175
Random Walk Based Fake Account Detection in Online Social Networks
Jia, J., Wang, B., & Gong, N. Z. (2017) · International Conference on Dependable Systems & Networks/Proceedings · doi:10.1109/dsn.2017.55 · Cited by 165
No More Pesky Learning Rate Guessing Games.Preprint
Smith, L. N. (2015) · arXiv (Cornell University) · Cited by 154
Twitter fake account detection
Erşahin, B., Aktaş, Ö., Kılınç, D., & Akyol, C. K. (2017) · International Conference on Computer Science and Engineering (UBMK) · doi:10.1109/ubmk.2017.8093420 · Cited by 149
Exploiting Tri-Relationship for Fake News Detection.Preprint
Shu, K., Wang, S., & Liu, H. (2017) · arXiv (Cornell University) · Cited by 138
Verifying Multimedia Use at MediaEval 2015
Boididou, C., Papadopoulos, S., Dang‐Nguyen, D., Boato, G., Riegler, M. A., Middleton, S. E., Petlund, A., & Kompatsiaris, I. (2015) · Iris (University of Trento) · Cited by 136
Attending Sentences to detect Satirical Fake News.
Sarkar, S. D., Yang, F., & Mukherjee, A. (2018) · International Conference on Computational Linguistics · Cited by 101
TweetCred: A Real-time Web-based System for Assessing Credibility of Content on Twitter.
Gupta, A., Kumaraguru, P., Castillo, C., & Meier, P. P. (2014) · Cited by 56
Self-citationAn Early Warning System for Suspicious Accounts
Halawa, H. H., Ripeanu, M., Beznosov, K., Coşkun, B., & Liu, M. (2017) · ACM Workshop on Artificial Intelligence and Security (AISec) · doi:10.1145/3128572.3140455 · Cited by 5
Cited by
Gongane, V. U., Munot, M. V., & Anuse, A. D. (2022) · Social Network Analysis and Mining · doi:10.1007/s13278-022-00951-3 · Cited by 153
Beyond Text: Multimodal Credibility Assessment Approaches for Online User-Generated Content
Choudhary, M., Chouhan, S. S., & Rathore, S. S. (2024) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3673236 · Cited by 20
Is Multi-Modal Necessarily Better? Robustness Evaluation of Multi-Modal Fake News Detection
Chen, J., Jia, C., Zheng, H., Chen, R., & Fu, C. (2023) · IEEE Transactions on Network Science and Engineering · doi:10.1109/tnse.2023.3249290 · Cited by 17
“SpotFake [17] BERT VGG19 1× 10−3 256 0.”
BackgroundMethodInfluential
Metadata
- Authors
- Singhal, S., Shah, R. R., Chakraborty, T., Kumaraguru, P., & Satoh, S.
- Venue
- 2019 IEEE Fifth International Conference on Multimedia Big Data (BigMM)
- Publisher
- IEEE
- Published
- 2019-09
- Pages
- 39-47
- OpenAlex
- W2994071599
- Cited by
- 534
- References
- 28
- FWCI
- 86.80
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.