The DOI matches its Crossref record; 31 of the 31 references it cites were found in a registry or an index.
Exploiting Multi-domain Visual Information for Fake News Detection
Open accessAbstract
The increasing popularity of social media promotes the proliferation of fake news. With the development of multimedia technology, fake news attempts to utilize multimedia content with images or videos to attract and mislead readers for rapid dissemination, which makes visual content an important part of fake news. Fake-news images, images attached to fake news posts, include not only fake images that are maliciously tampered but also real images that are wrongly used to represent irrelevant events. Hence, how to fully exploit the inherent characteristics of fake-news images is an important but challenging problem for fake news detection. In the real world, fake-news images may have significantly different characteristics from real-news images at both physical and semantic levels, which can be clearly reflected in the frequency and pixel domain, respectively. Therefore, we propose a novel framework Multi-domain Visual Neural Network (MVNN) to fuse the visual information of frequency and pixel domains for detecting fake news. Specifically, we design a CNN-based network to automatically capture the complex patterns of fake-news images in the frequency domain; and utilize a multi-branch CNN-RNN model to extract visual features from different semantic levels in the pixel domain. An attention mechanism is utilized to fuse the feature representations of frequency and pixel domains dynamically. Extensive experiments conducted on a real world dataset demonstrate that MVNN outperforms existing methods with at least 9.2% in accuracy, and can help improve the performance of multi-modal fake news detection by over 5.2%.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
(2008) · Journal of Machine Learning Research · Cited by 33,051
Neural Machine Translation by Jointly Learning to Align and Translate
Bahdanau, D., Cho, K., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1409.0473 · Cited by 16,213
Social Media and Fake News in the 2016 Election
Allcott, H., & Gentzkow, M. (2017) · Journal of Economic Perspectives · doi:10.1257/jep.31.2.211 · Cited by 6,767
Fake News Detection on Social Media: A Data Mining Perspective
Shu, K., Sliva, A., Wang, S., Tang, J., & Liu, H. (2017) · ACM SIGKDD Explorations Newsletter · doi:10.1145/3137597.3137600 · Cited by 3,304
Information credibility on twitter
Castillo, C., Mendoza, M., & Poblete, B. (2011) · Proceedings of the 20th international conference on World wide web · doi:10.1145/1963405.1963500 · Cited by 2,593
Stacked Convolutional Auto-Encoders for Hierarchical Feature Extraction
Masci, J., Meier, U., Cireşan, D., & Schmidhuber, J. (2011) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-21735-7_7 · Cited by 1,955
Detecting rumors from microblogs with recurrent neural networks
Ma, J., Gao, W. G., Mitra, P., Kwon, S., Jansen, B. J. J., Wong, K., & Cha, M. (2016) · Singapore Management University Institutional Knowledge (InK) (Singapore Management University) · Cited by 1,769
A Bio‐Informational Theory of Emotional Imagery
Lang, P. J. (1979) · Psychophysiology · doi:10.1111/j.1469-8986.1979.tb01511.x · Cited by 1,750 · cited 2×
“We have shown that fake-news images usually show some visual impacts and emotion provocation, which have been proven related to many visual factors from low-level to high-level [22].”
BackgroundEANN: Event Adversarial Neural Networks for Multi-Modal Fake News Detection
Wang, Y., Ma, F., Jin, Z., Yuan, Y., Xun, G., Jha, K., Su, L., & Gao, J. (2018) · Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3219819.3219903 · Cited by 1,168
Amulet: Aggregating Multi-level Convolutional Features for Salient Object Detection
Zhang, P., Wang, D., Lu, H., Wang, H., & Ruan, X. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.31 · Cited by 884
Detection and Resolution of Rumours in Social Media: A Survey
Zubiaga, A., Aker, A., Bontcheva, K., Liakata, M., & Procter, R. (2019) · ACM Computing Surveys · doi:10.1145/3161603 · Cited by 862 · cited 2×
“The input image is fed to the CNN, and features extracted from four branches will pass through a 1 × 1 convolutional layer and a fully connected layer, obtaining the corresponding feature vectors v t , t ∈ [1 , 4] .”
MethodMultimodal Fusion with Recurrent Neural Networks for Rumor Detection on Microblogs
Jin, Z., Cao, J., Guo, H., Zhang, Y., & Luo, J. (2017) · Proceedings of the 25th ACM international conference on Multimedia · doi:10.1145/3123266.3123454 · Cited by 812
Self-citationMVAE: Multimodal Variational Autoencoder for Fake News Detection
Khattar, D., Goud, J. S., Gupta, M., & Varma, V. (2019) · The World Wide Web Conference · doi:10.1145/3308558.3313552 · Cited by 799
Automatic detection of rumor on Sina Weibo
Yang, F., Liu, Y., Yu, X., & Yang, M. (2012) · Proceedings of the ACM SIGKDD Workshop on Mining Data Semantics · doi:10.1145/2350190.2350203 · Cited by 680 · cited 1×
“Some early works use basic statistical features about attached images to help classify fake news posts, such as the number of attached images [10], [24], image popularity and image type [6].”
BackgroundFalse rumors detection on Sina Weibo by propagation structures
Wu, K., Yang, S., & Zhu, K. Q. (2015) · 2015 IEEE 31st International Conference on Data Engineering · doi:10.1109/icde.2015.7113322 · Cited by 585
Beyond News Contents: The Role of Social Context for Fake News Detection
Shu, K., Wang, S., & Liu, H. (2019) · Proceedings of the Twelfth ACM International Conference on Web Search and Data Mining · doi:10.1145/3289600.3290994 · Cited by 582
Novel Visual and Statistical Image Features for Microblogs News Verification
Jin, Z., Cao, J., Zhang, Y., Zhou, J., & Tian, Q. (2017) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2016.2617078 · Cited by 476
Self-citationImage Forgery Localization via Block-Grained Analysis of JPEG Artifacts
Bianchi, T., & Piva, A. (2012) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2012.2187516 · Cited by 459
Fast, automatic and fine-grained tampered JPEG image detection via DCT coefficient analysis
Lin, Z., He, J., Tang, X., & Tang, C.-K. (2009) · Pattern Recognition · doi:10.1016/j.patcog.2009.03.019 · Cited by 395
False Information on Web and Social Media: A Survey
Kumar, S., & Shah, N. (2018) · arXiv · doi:10.48550/arxiv.1804.08559 · Cited by 289
Detect Rumors on Twitter by Promoting Information Campaigns with Generative Adversarial Learning
Ma, J., Gao, W., & Wong, K.-F. (2019) · The World Wide Web Conference · doi:10.1145/3308558.3313741 · Cited by 235
Double JPEG compression forensics based on a convolutional neural network
Wang, Q., & Zhang, R. (2016) · EURASIP Journal on Information Security · doi:10.1186/s13635-016-0047-y · Cited by 161
Chen, Y.-L., & Hsu, C.-T. (2011) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2011.2106121 · Cited by 160
Dependency Exploitation: A Unified CNN-RNN Approach for Visual Emotion Recognition
Zhu, X., Li, L., Zhang, W., Rao, T., Xu, M. G., Huang, Q., & Xu, D. (2017) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2017/503 · Cited by 157
Verifying Multimedia Use at MediaEval 2015
Boididou, C., Papadopoulos, S., Dang‐Nguyen, D., Boato, G., Riegler, M. A., Middleton, S. E., Petlund, A., & Kompatsiaris, I. (2015) · Iris (University of Trento) · Cited by 136
Detecting Event Rumors on Sina Weibo Automatically
Sun, S., Liu, H., He, J., & Du, X. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-37401-2_14 · Cited by 116
Mining Misinformation in Social Media
Wu, L., Morstatter, F., Hu, X., & Liu, H. (2016) · doi:10.1201/9781315396705-14 · Cited by 74
Image Credibility Analysis with Effective Domain Transferred Deep NetworksPreprint
Jin, Z., Cao, J., Luo, J., & Zhang, Y. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.05328 · Cited by 23
Self-citationUnderstanding Image Impressiveness Inspired by Instantaneous Human Perceptual Cues
Yang, J., Sun, Y., Liang, J., Yang, Y., & Cheng, M. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.12315 · Cited by 10
Cited by
Cross-modal Ambiguity Learning for Multimodal Fake News Detection
Chen, Y., Li, D., Zhang, P., Sui, J., Lv, Q., Tun, L., & Shang, L. (2022) · Proceedings of the ACM Web Conference 2022 · doi:10.1145/3485447.3511968 · Cited by 370
Multimodal Fusion with Co-Attention Networks for Fake News Detection
Wu, Y., Zhan, P., Zhang, Y., Wang, L., & Xu, Z. (2021) · Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021 · doi:10.18653/v1/2021.findings-acl.226 · Cited by 309
Detecting fake news by exploring the consistency of multimodal data
Xue, J., Wang, Y., Tian, Y., Li, Y., Shi, L., & Wei, L. (2021) · Information Processing & Management · doi:10.1016/j.ipm.2021.102610 · Cited by 298
A Comprehensive Review on Fake News Detection With Deep Learning
Mridha, M. F., Keya, A. J., Hamid, M. A., Monowar, M. M., & Rahman, M. S. (2021) · IEEE Access · doi:10.1109/access.2021.3129329 · Cited by 281
Gongane, V. U., Munot, M. V., & Anuse, A. D. (2022) · Social Network Analysis and Mining · doi:10.1007/s13278-022-00951-3 · Cited by 153
Metadata
- Authors
- Qi, P., Cao, J., Yang, T., Guo, J., & Li, J.
- Venue
- 2019 IEEE International Conference on Data Mining (ICDM)
- Publisher
- IEEE
- Published
- 2019-11
- Pages
- 518-527
- ISSN
- 1550-4786 (ISSN-L)
- OpenAlex
- W3003961771
- Cited by
- 326
- References
- 31
- FWCI
- 70.02
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.