The DOI matches its Crossref record; 26 of the 26 references it cites were found in a registry or an index.
MVAE: Multimodal Variational Autoencoder for Fake News Detection
Open accessAbstract
In recent times, fake news and misinformation have had a disruptive and adverse impact on our lives. Given the prominence of microblogging networks as a source of news for most individuals, fake news now spreads at a faster pace and has a more profound impact than ever before. This makes detection of fake news an extremely important challenge. Fake news articles, just like genuine news articles, leverage multimedia content to manipulate user opinions but spread misinformation. A shortcoming of the current approaches for the detection of fake news is their inability to learn a shared representation of multimodal (textual + visual) information. We propose an end-to-end network, Multimodal Variational Autoencoder (MVAE), which uses a bimodal variational autoencoder coupled with a binary classifier for the task of fake news detection. The model consists of three main components, an encoder, a decoder and a fake news detector module. The variational autoencoder is capable of learning probabilistic latent variable models by optimizing a bound on the marginal likelihood of the observed data. The fake news detector then utilizes the multimodal representations obtained from the bimodal variational autoencoder to classify posts as fake or not. We conduct extensive experiments on two standard fake news datasets collected from popular microblogging websites: Weibo and Twitter. The experimental results show that across the two datasets, on average our model outperforms state-of-the-art methods by margins as large as ~ 6% in accuracy and ~ 5% in F1 scores.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Distributed Representations of Words and Phrases and their Compositionality
Mikolov, T., Sutskever, I., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1310.4546 · Cited by 24,533
Auto-Encoding Variational Bayes
Kingma, D. P., & Welling, M. (2013) · arXiv · doi:10.48550/arxiv.1312.6114 · Cited by 20,067
Show and tell: A neural image caption generator
Vinyals, O., Toshev, A., Bengio, S., & Erhan, D. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298935 · Cited by 6,318
Deep visual-semantic alignments for generating image descriptions
Karpathy, A., & Fei-Fei, L. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298932 · Cited by 4,902
VQA: Visual Question Answering
Antol, S., Agrawal, A., Lu, J., Mitchell, M., Batra, D., Zitnick, C. L., & Parikh, D. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.279 · Cited by 4,487
On the difficulty of training recurrent neural networks
Pascanu, R., Mikolov, T., & Bengio, Y. (2012) · arXiv · doi:10.48550/arxiv.1211.5063 · Cited by 4,310
Fake News Detection on Social Media: A Data Mining Perspective
Shu, K., Sliva, A., Wang, S., Tang, J., & Liu, H. (2017) · ACM SIGKDD Explorations Newsletter · doi:10.1145/3137597.3137600 · Cited by 3,304
Information credibility on twitter
Castillo, C., Mendoza, M., & Poblete, B. (2011) · Proceedings of the 20th international conference on World wide web · doi:10.1145/1963405.1963500 · Cited by 2,593
Cited by
Media Forensics and DeepFakes: An Overview
Verdoliva, L. (2020) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2020.3002101 · Cited by 979
A survey on deep learning for multimodal data fusion
Gao, J., Li, P., Chen, Z., & Zhang, J. (2020) · Neural Computation · doi:10.1162/neco_a_01273 · Cited by 821
“Khattar, Goud, Gupta, and Varma (2019) designed a multimodal variational framework based on the encoder-decoder architecture.”
BackgroundSpotFake: A Multi-modal Framework for Fake News Detection
Singhal, S., Shah, R. R., Chakraborty, T., Kumaraguru, P., & Satoh, S. (2019) · 2019 IEEE Fifth International Conference on Multimedia Big Data (BigMM) · doi:10.1109/bigmm.2019.00-44 · Cited by 534
Meel, P., & Vishwakarma, D. K. (2020) · Expert Systems with Applications · doi:10.1016/j.eswa.2019.112986 · Cited by 505
Zhao, F., Zhang, C., & Geng, B. (2024) · ACM Computing Surveys · doi:10.1145/3649447 · Cited by 480
$$\mathsf {SAFE}$$: Similarity-Aware Multi-modal Fake News Detection
Zhou, X., Wu, J., & Zafarani, R. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-47436-2_27 · Cited by 385
Exploiting Multi-domain Visual Information for Fake News Detection
Qi, P., Cao, J., Yang, T., Guo, J., & Li, J. (2019) · 2019 IEEE International Conference on Data Mining (ICDM) · doi:10.1109/icdm.2019.00062 · Cited by 326
Multimodal Fusion with Co-Attention Networks for Fake News Detection
Wu, Y., Zhan, P., Zhang, Y., Wang, L., & Xu, Z. (2021) · Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021 · doi:10.18653/v1/2021.findings-acl.226 · Cited by 309
Detecting fake news by exploring the consistency of multimodal data
Xue, J., Wang, Y., Tian, Y., Li, Y., Shi, L., & Wei, L. (2021) · Information Processing & Management · doi:10.1016/j.ipm.2021.102610 · Cited by 298
A Comprehensive Review on Fake News Detection With Deep Learning
Mridha, M. F., Keya, A. J., Hamid, M. A., Monowar, M. M., & Rahman, M. S. (2021) · IEEE Access · doi:10.1109/access.2021.3129329 · Cited by 281
Hierarchical Multi-modal Contextual Attention Network for Fake News Detection
Qian, S., Wang, J., Hu, J., Fang, Q., & Xu, C. (2021) · Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval · doi:10.1145/3404835.3462871 · Cited by 276
FANG: Leveraging Social Context for Fake News Detection Using Graph Representation
Nguyen, V.-H., Sugiyama, K., Nakov, P., & Kan, M.-Y. (2020) · Proceedings of the 29th ACM International Conference on Information & Knowledge Management · doi:10.1145/3340531.3412046 · Cited by 270
Multimodal fake news detection via progressive fusion networks
Jing, J., Wu, H., Sun, J., Fang, X., & Zhang, H. (2023) · Information Processing & Management · doi:10.1016/j.ipm.2022.103120 · Cited by 243
Multimodal learning with graphs
Ektefaie, Y., Dasoulas, G., Noori, A., Farhat, M., & Zitnik, M. (2023) · Nature Machine Intelligence · doi:10.1038/s42256-023-00624-6 · Cited by 166
“While multimodal learning has been successfully used in settings where unimodal methods fail [14, 15, 16], it presents several challenges that must be overcome to enable its broad use in AI [13, 17].”
BackgroundGongane, V. U., Munot, M. V., & Anuse, A. D. (2022) · Social Network Analysis and Mining · doi:10.1007/s13278-022-00951-3 · Cited by 153
The Future of False Information Detection on Social Media: New Perspectives and Trends
Guo, B., Ding, Y., Yao, L., Liang, Y., & Yu, Z. (2021) · ACM Computing Surveys · doi:10.1145/3393880 · Cited by 122
Images and Misinformation in Political Groups: Evidence from WhatsApp in India
Garimella, K., & Eckles, D. (2020) · Harvard Kennedy School Misinformation Review · doi:10.37016/mr-2020-030 · Cited by 111
SoK: Content Moderation in Social Media, from Guidelines to Enforcement, and Research to Practice
Singhal, M., Ling, C., Paudel, P., Thota, P., Kumarswamy, N., Stringhini, G., & Nilizadeh, S. (2023) · 2023 IEEE 8th European Symposium on Security and Privacy (EuroS&P) · doi:10.1109/eurosp57164.2023.00056 · Cited by 57
“Researchers have proposed multiple methods to tackle this problem leveraging the relationship between different modalities of content on social media [288], learning shared representations of text and images [178], learning the shared representations of audio and visual information [274], learning transferable multi-m…”
BackgroundDetecting and Grounding Multi-Modal Media Manipulation and Beyond
Shao, R., Wu, T., Wu, J., Nie, L., & Liu, Z. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3367749 · Cited by 53
Beyond Text: Multimodal Credibility Assessment Approaches for Online User-Generated Content
Choudhary, M., Chouhan, S. S., & Rathore, S. S. (2024) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3673236 · Cited by 20
Is Multi-Modal Necessarily Better? Robustness Evaluation of Multi-Modal Fake News Detection
Chen, J., Jia, C., Zheng, H., Chen, R., & Fu, C. (2023) · IEEE Transactions on Network Science and Engineering · doi:10.1109/tnse.2023.3249290 · Cited by 17
“We choose these models because the considerations of these models are often used to design other fake news detection algorithms, i.e., Att-RNN considers the relationship between text and image (RbTaI), and also considers the social context (SC), EANN and BDANN use event discriminator (ED) and MVAE uses feature reconst…”
BackgroundMethodInfluentialMultimodal Fusion Refiner Networks
Sankaran, S., Yang, D., & Lim, S.-N. (2021) · arXiv · doi:10.48550/arxiv.2104.03435 · Cited by 10
“The application of multi-modal inference or decision making systems span several fields such as hate speech detection [15], mis-information detection [22], reasoning tasks [7], etc. Multimodal modeling includes two broad steps: extraction of features from different modalities such as images and…”
Background
Metadata
- Authors
- Khattar, D., Goud, J. S., Gupta, M., & Varma, V.
- Venue
- The World Wide Web Conference
- Publisher
- ACM
- Published
- 2019-05-13
- Pages
- 2915-2921
- OpenAlex
- W2912305564
- Cited by
- 799
- References
- 26
- FWCI
- 164.11
- Type
- conference paper
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.