The DOI matches its Crossref record; 64 of the 64 references it cites were found in a registry or an index.
Detecting fake news by exploring the consistency of multimodal data
Open accessAbstract
During the outbreak of the new Coronavirus (2019-nCoV) in 2020, the spread of fake news has caused serious social panic. Fake news often uses multimedia information such as text and image to mislead readers, spreading and expanding its influence. One of the most important problems in fake news detection based on multimodal data is to extract the general features as well as to fuse the intrinsic characteristics of the fake news, such as mismatch of image and text and image tampering. This paper proposes a Multimodal Consistency Neural Network (MCNN) that considers the consistency of multimodal data and captures the overall characteristics of social media information. Our method consists of five subnetworks: the text feature extraction module, the visual semantic feature extraction module, the visual tampering feature extraction module, the similarity measurement module, and the multimodal fusion module. The text feature extraction module and the visual semantic feature extraction module are responsible for extracting the semantic features of text and vision and mapping them to the same space for a common representation of cross-modal features. The visual tampering feature extraction module is responsible for extracting visual physical and tamper features. The similarity measurement module can directly measure the similarity of multimodal data for the problem of mismatching of image and text. We assess the constructed method in terms of four datasets commonly used for fake news detection. The accuracy of the detection is improved clearly compared to the best available methods.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
Distributed Representations of Words and Phrases and their Compositionality
Mikolov, T., Sutskever, I., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1310.4546 · Cited by 24,533
Social Media and Fake News in the 2016 Election
Allcott, H., & Gentzkow, M. (2017) · Journal of Economic Perspectives · doi:10.1257/jep.31.2.211 · Cited by 6,767 · cited 1×
“Fake news uses fictional or even fake pictures to mislead readers and spread quickly (Allcott & Gentzkow, 2017; Rubin, Conroy, Chen, & Cornwell, 2016).”
Proceedings of the 19th International Joint Conference on Artificial Intelligence
Pujol, J. M., Delgado, J., Ramon Sangüesa, A., & Flache, A. (2005) · International Joint Conference on Artificial Intelligence · Cited by 5,771
VQA: Visual Question Answering
Antol, S., Agrawal, A., Lu, J., Mitchell, M., Batra, D., Zitnick, C. L., & Parikh, D. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.279 · Cited by 4,487
Proceedings of the 21st International Conference on Neural Information Processing Systems
Koller, D., Schuurmans, D., Bengio, Y., & Bottou, L. (2008) · Cited by 4,461
Fake News Detection on Social Media: A Data Mining Perspective
Shu, K., Sliva, A., Wang, S., Tang, J., & Liu, H. (2017) · ACM SIGKDD Explorations Newsletter · doi:10.1145/3137597.3137600 · Cited by 3,304
2011 International Conference on Computer Vision
(2011) · doi:10.1109/iccv17851.2011 · Cited by 2,860
Information credibility on twitter
Castillo, C., Mendoza, M., & Poblete, B. (2011) · Proceedings of the 20th international conference on World wide web · doi:10.1145/1963405.1963500 · Cited by 2,593
2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
(2019) · doi:10.1109/cvpr41558.2019 · Cited by 1,775
Detecting rumors from microblogs with recurrent neural networks
Ma, J., Gao, W. G., Mitra, P., Kwon, S., Jansen, B. J. J., Wong, K., & Cha, M. (2016) · Singapore Management University Institutional Knowledge (InK) (Singapore Management University) · Cited by 1,769
A Bio‐Informational Theory of Emotional Imagery
Lang, P. J. (1979) · Psychophysiology · doi:10.1111/j.1469-8986.1979.tb01511.x · Cited by 1,750 · cited 1×
“To obtain a better semantic expression of the image (Lang, 1979), we used BiGRU to form the image to sequence module.”
EANN: Event Adversarial Neural Networks for Multi-Modal Fake News Detection
Wang, Y., Ma, F., Jin, Z., Yuan, Y., Xun, G., Jha, K., Su, L., & Gao, J. (2018) · Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3219819.3219903 · Cited by 1,168
Self-citationCSI: A Hybrid Deep Model for Fake News Detection
Ruchansky, N., Seo, S., & Liu, Y. (2017) · Proceedings of the 2017 ACM on Conference on Information and Knowledge Management · doi:10.1145/3132847.3132877 · Cited by 1,039
(2019) · doi:10.1145/3308558 · Cited by 917
VQA: Visual Question Answering
Agrawal, A., Lu, J., Antol, S., Mitchell, M., Zitnick, C. L., Batra, D., & Parikh, D. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1505.00468 · Cited by 900
Show and Tell: Lessons Learned from the 2015 MSCOCO Image Captioning Challenge
Vinyals, O., Toshev, A., Bengio, S., & Erhan, D. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2587640 · Cited by 875
Multimodal Fusion with Recurrent Neural Networks for Rumor Detection on Microblogs
Jin, Z., Cao, J., Guo, H., Zhang, Y., & Luo, J. (2017) · Proceedings of the 25th ACM international conference on Multimedia · doi:10.1145/3123266.3123454 · Cited by 812
MVAE: Multimodal Variational Autoencoder for Fake News Detection
Khattar, D., Goud, J. S., Gupta, M., & Varma, V. (2019) · The World Wide Web Conference · doi:10.1145/3308558.3313552 · Cited by 799
2010 IEEE International Conference on Data Mining
(2010) · doi:10.1109/icdm17440.2010 · Cited by 779
Proceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence
Chen, Y., Diethe, T., & Flach, P. A. (2016) · National Conference on Artificial Intelligence · Cited by 680
Liu, Y., & Wu, Y.-F. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11268 · Cited by 663 · cited 1×
“The textual and visual information of fake news cannot be effectively used (Liu & Wu, 2018; Ma et al., 2016; Ma, Gao, & Wong, 2018).”
Proceedings of the 27th International Conference on Neural Information Processing Systems - Volume 1
Zoubin Ghahramani, A., Welling, M., Cortes, C., Lawrence, N. D., & Weinberger, K. Q. (2014) · Cited by 656
Rumor Detection on Twitter with Tree-structured Recursive Neural Networks
Ma, J., Gao, W., & Wong, K.-F. (2018) · Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p18-1184 · Cited by 634
False rumors detection on Sina Weibo by propagation structures
Wu, K., Yang, S., & Zhu, K. Q. (2015) · 2015 IEEE 31st International Conference on Data Engineering · doi:10.1109/icde.2015.7113322 · Cited by 585
Fake News or Truth? Using Satirical Cues to Detect Potentially Misleading News
Rubin, V., Conroy, N., Chen, Y., & Cornwell, S. (2016) · Proceedings of the Second Workshop on Computational Approaches to Deception Detection · doi:10.18653/v1/w16-0802 · Cited by 584
VQA: Visual Question Answering: www.visualqa.org
Agrawal, A., Lu, J., Antol, S., Mitchell, M., Zitnick, C. L., Parikh, D., & Batra, D. (2017) · International Journal of Computer Vision · doi:10.1007/s11263-016-0966-6 · Cited by 570
Supervised Learning for Fake News Detection
Reis, J. C. S., Correia, A., Murai, F., Veloso, A., & Benevenuto, F. (2019) · IEEE Intelligent Systems · doi:10.1109/mis.2019.2899143 · Cited by 521
Deep Supervised Cross-Modal Retrieval
Zhen, L., Hu, P., Wang, X., & Peng, D. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.01064 · Cited by 478 · cited 1×
“To certify that the two sub-networks learn the common representation space of image and text patterns, we apply a fully connected layer to the last layer of each sub-network and force the two sub-networks to share weights of the last layer (Zhen, Hu, Wang, & Peng, 2019).”
Novel Visual and Statistical Image Features for Microblogs News Verification
Jin, Z., Cao, J., Zhang, Y., Zhou, J., & Tian, Q. (2017) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2016.2617078 · Cited by 476
Fast, automatic and fine-grained tampered JPEG image detection via DCT coefficient analysis
Lin, Z., He, J., Tang, X., & Tang, C.-K. (2009) · Pattern Recognition · doi:10.1016/j.patcog.2009.03.019 · Cited by 395
$$\mathsf {SAFE}$$: Similarity-Aware Multi-modal Fake News Detection
Zhou, X., Wu, J., & Zafarani, R. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-47436-2_27 · Cited by 385
Call Attention to Rumors: Deep Attention Based Recurrent Neural Networks for Early Rumor Detection
Chen, T., Li, X., Yin, H., & Zhang, J. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-04503-6_4 · Cited by 370
News Verification by Exploiting Conflicting Social Viewpoints in Microblogs
Jin, Z., Cao, J., Zhang, Y., & Luo, J. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v30i1.10382 · Cited by 364
Exploiting Multi-domain Visual Information for Fake News Detection
Qi, P., Cao, J., Yang, T., Guo, J., & Li, J. (2019) · 2019 IEEE International Conference on Data Mining (ICDM) · doi:10.1109/icdm.2019.00062 · Cited by 326
Neural User Response Generator: Fake News Detection with Collective User Intelligence
Qian, F., Gong, C., Sharma, K., & Liu, Y. (2018) · Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2018/533 · Cited by 237 · cited 1×
“Eliminating fake news is of great necessity for perfecting the quality of the information network ecosystem and maintaining social stability (Castillo, Mendoza, & Poblete, 2011; Qian, Gong, Sharma, & Liu, 2018; Ruchansky, Seo, & Liu, 2017; Sunstein, 2009).”
Detect Rumors on Twitter by Promoting Information Campaigns with Generative Adversarial Learning
Ma, J., Gao, W., & Wong, K.-F. (2019) · The World Wide Web Conference · doi:10.1145/3308558.3313741 · Cited by 235
TI-CNN: Convolutional Neural Networks for Fake News Detection
Yang, Y., Zheng, L., Zhang, J., Cui, Q., Li, Z., & Yu, P. S. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1806.00749 · Cited by 223
Imran, M., Ofli, F., Caragea, D., & Torralba, A. (2020) · Information Processing & Management · doi:10.1016/j.ipm.2020.102261 · Cited by 217
Kumar, A., Srinivasan, K., Cheng, W.-H., & Zomaya, A. Y. (2020) · Information Processing & Management · doi:10.1016/j.ipm.2019.102141 · Cited by 211
Credibility Assessment of Textual Claims on the Web
Popat, K., Mukherjee, S., Strötgen, J., & Weikum, G. (2016) · Proceedings of the 25th ACM International on Conference on Information and Knowledge Management · doi:10.1145/2983323.2983661 · Cited by 177
Proceedings of the 20th international conference on World wide web
(2011) · doi:10.1145/1963405 · Cited by 175
CSI: A Hybrid Deep Model for Fake News Detection
Ruchansky, N., Seo, S., & Liu, Y. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.06959 · Cited by 170
An image-text consistency driven multimodal sentiment analysis approach for social media
Zhao, Z., Zhu, H., Xue, Z., Liu, Z., Tian, J., Chua, M. C. H., & Liu, M. (2019) · Information Processing & Management · doi:10.1016/j.ipm.2019.102097 · Cited by 160
2015 IEEE 31st International Conference on Data Engineering
(2015) · doi:10.1109/icde34367.2015 · Cited by 154
Unsupervised rumor detection based on users’ behaviors using neural networks
Chen, W., Zhang, Y., Yeo, C. K., Lau, C. T., & Lee, B. (2017) · Pattern Recognition Letters · doi:10.1016/j.patrec.2017.10.014 · Cited by 119
Wang, B., Gong, N. Z., & Fu, H. (2017) · Proceedings · doi:10.1109/icdm.2017.56 · Cited by 107
On Rumours: How Falsehoods Spread, Why We Believe Them, What Can Be Done
Sunstein, C. R. (2009) · Medical Entomology and Zoology · Cited by 103
SAFE: Similarity-Aware Multi-Modal Fake News DetectionPreprint
Zhou, X., Wu, J., & Zafarani, R. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.04981 · Cited by 93
Handling Cold-Start Problem in Review Spam Detection by Jointly Embedding Texts and Behaviors
Wang, X., Liu, K., & Zhao, J. (2017) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p17-1034 · Cited by 78
Transformer based contextualization of pre-trained word embeddings for irony detection in Twitter
González, J. Á., Hurtado, L.-F., & Plà, F. (2020) · Information Processing & Management · doi:10.1016/j.ipm.2020.102262 · Cited by 72
Dynamic attention-based explainable recommendation with textual and visual fusion
Liu, P., Zhang, L., & Gulla, J. A. (2019) · Information Processing & Management · doi:10.1016/j.ipm.2019.102099 · Cited by 71
Multimodal Review Generation for Recommender Systems
Truong, Q.-T., & Lauw, H. W. (2019) · International World Wide Web Conference (WWW) · doi:10.1145/3308558.3313463 · Cited by 63
Combating Crowdsourced Review Manipulators: A Neighborhood-Based Approach
Kaghazgaran, P., Caverlee, J., & Squicciarini, A. (2018) · Proceedings of the Eleventh ACM International Conference on Web Search and Data Mining · doi:10.1145/3159652.3159726 · Cited by 59 · cited 1×
“The detection of fake news has many related tasks, such as rumor detection (Cao et al., 2019; Imran, Ofli, Caragea, & Torralba, 2020; Ma et al., 2019) and spam detection (Kaghazgaran, Caverlee, & Squicciarini, 2018; Wang, Gong, & Fu, 2017; Wang, Liu, & Zhao, 2017).”
False News Detection on Social MediaPreprint
Cao, J., Sheng, Q., Qi, P., Zhong, L., Wang, Y., & Zhang, X. (2019) · arXiv.org · doi:10.48550/arxiv.1908.10818 · Cited by 14
Self-citation
Cited by
Cross-modal Ambiguity Learning for Multimodal Fake News Detection
Chen, Y., Li, D., Zhang, P., Sui, J., Lv, Q., Tun, L., & Shang, L. (2022) · Proceedings of the ACM Web Conference 2022 · doi:10.1145/3485447.3511968 · Cited by 370
Multimodal fake news detection via progressive fusion networks
Jing, J., Wu, H., Sun, J., Fang, X., & Zhang, H. (2023) · Information Processing & Management · doi:10.1016/j.ipm.2022.103120 · Cited by 243
Metadata
- Authors
- Xue, J., Wang, Y., Tian, Y., Li, Y., Shi, L., & Wei, L.
- Venue
- Information Processing & Management
- Publisher
- Elsevier BV
- Published
- 2021-09
- Volume
- 58
- Issue
- 5
- Pages
- 102610
- ISSN
- 0020-0271 (ISSN-L)
- 0306-4573
- OpenAlex
- W3157731560
- Cited by
- 298
- References
- 64
- FWCI
- 52.43
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.