The DOI matches its Crossref record; 32 of the 32 references it cites were found in a registry or an index.
Cross-modal Ambiguity Learning for Multimodal Fake News Detection
Abstract
Cross-modal learning is essential to enable accurate fake news detection due to the fast-growing multimodal contents in online social communities. A fundamental challenge of multimodal fake news detection lies in the inherent ambiguity across different content modalities, i.e., decisions made from unimodalities may disagree with each other, which may lead to inferior multimodal fake news detection. To address this issue, we formulate the cross-modal ambiguity learning problem from an information-theoretic perspective and propose CAFE — an ambiguity-aware multimodal fake news detection method. CAFE consists of 1) a cross-modal alignment module to transform the heterogeneous unimodality features into a shared semantic space, 2) a cross-modal ambiguity learning module to estimate the ambiguity between different modalities, and 3) a cross-modal fusion module to capture the cross-modal correlations. CAFE improves fake news detection accuracy by judiciously and adaptively aggregating unimodal features and cross-modal correlations, i.e., relying on unimodal features when cross-modal ambiguity is weak and referring to cross-modal correlations when cross-modal ambiguity is strong. Experimental studies on two widely used datasets (Twitter and Weibo) demonstrate that CAFE outperforms state-of-the-art fake news detection methods by 2.2-18.9% and 1.7-11.4% on accuracy, respectively.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Representation Learning: A Review and New Perspectives
Bengio, Y., Courville, A., & Vincent, P. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.50 · Cited by 13,001
Multimodal Machine Learning: A Survey and Taxonomy
Baltrusaitis, T., Ahuja, C., & Morency, L.-P. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2798607 · Cited by 5,018
Fake News Detection on Social Media: A Data Mining Perspective
Shu, K., Sliva, A., Wang, S., Tang, J., & Liu, H. (2017) · ACM SIGKDD Explorations Newsletter · doi:10.1145/3137597.3137600 · Cited by 3,304
EANN: Event Adversarial Neural Networks for Multi-Modal Fake News Detection
Wang, Y., Ma, F., Jin, Z., Yuan, Y., Xun, G., Jha, K., Su, L., & Gao, J. (2018) · Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3219819.3219903 · Cited by 1,168
(2019) · doi:10.1145/3308558 · Cited by 917
Detection and Resolution of Rumours in Social Media: A Survey
Zubiaga, A., Aker, A., Bontcheva, K., Liakata, M., & Procter, R. (2019) · ACM Computing Surveys · doi:10.1145/3161603 · Cited by 862 · cited 1×
“While people enjoy the convenience of online social media, the lack of systematic efforts to verify the credibility of online posts has led to the wide and fast spread of fake news across social platforms [19, 38, 40].”
BackgroundMultimodal Fusion with Recurrent Neural Networks for Rumor Detection on Microblogs
Jin, Z., Cao, J., Guo, H., Zhang, Y., & Luo, J. (2017) · Proceedings of the 25th ACM international conference on Multimedia · doi:10.1145/3123266.3123454 · Cited by 812
Rumor Detection on Social Media with Bi-Directional Graph Convolutional Networks
Bian, T., Xiao, X., Xu, T., Zhao, P., Huang, W., Rong, Y., & Huang, J. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i01.5393 · Cited by 796
Gupta, A., Lamba, H., Kumaraguru, P., & Joshi, A. (2013) · Proceedings of the 22nd International Conference on World Wide Web Companion · doi:10.1145/2487788.2488033 · Cited by 573 · cited 3×
“both claimed that the spreading pattern of image content across a social platform exhibits discriminating features, which are suitable for fake image detection [10, 14].”
BackgroundCalculation of the Wasserstein Distance Between Probability Distributions on the Line
Vallender, S. S. (1974) · Theory of Probability & Its Applications · doi:10.1137/1118101 · Cited by 483
Novel Visual and Statistical Image Features for Microblogs News Verification
Jin, Z., Cao, J., Zhang, Y., Zhou, J., & Tian, Q. (2017) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2016.2617078 · Cited by 476
$$\mathsf {SAFE}$$: Similarity-Aware Multi-modal Fake News Detection
Zhou, X., Wu, J., & Zafarani, R. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-47436-2_27 · Cited by 385
Exploiting Multi-domain Visual Information for Fake News Detection
Qi, P., Cao, J., Yang, T., Guo, J., & Li, J. (2019) · 2019 IEEE International Conference on Data Mining (ICDM) · doi:10.1109/icdm.2019.00062 · Cited by 326
Detecting fake news by exploring the consistency of multimodal data
Xue, J., Wang, Y., Tian, Y., Li, Y., Shi, L., & Wei, L. (2021) · Information Processing & Management · doi:10.1016/j.ipm.2021.102610 · Cited by 298
Mining Dual Emotion for Fake News Detection
Zhang, X., Cao, J., Li, X., Sheng, Q., Zhong, L., & Shu, K. (2021) · Proceedings of the Web Conference 2021 · doi:10.1145/3442381.3450004 · Cited by 251
Neural User Response Generator: Fake News Detection with Collective User Intelligence
Qian, F., Gong, C., Sharma, K., & Liu, Y. (2018) · Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2018/533 · Cited by 237 · cited 2×
“built a text-based method to capture semantic information from article text, and proposed a generative model of user responses to assist fake news detection [23].”
BackgroundMethodA survey of recent advances in visual feature detection
Li, Y., Wang, S., Tian, Q., & Ding, X. (2015) · Neurocomputing · doi:10.1016/j.neucom.2014.08.003 · Cited by 229
Detection and visualization of misleading content on Twitter
Boididou, C., Papadopoulos, S., Zampoglou, M., Apostolidis, L., Papadopoulou, O., & Kompatsiaris, Y. (2018) · International Journal of Multimedia Information Retrieval · doi:10.1007/s13735-017-0143-x · Cited by 219
Multi-modal Knowledge-aware Event Memory Network for Social Media Rumor Detection
Zhang, H., Fang, Q., Qian, S., & Xu, C. (2019) · Proceedings of the 27th ACM International Conference on Multimedia · doi:10.1145/3343031.3350850 · Cited by 203
Rumor Detection on Social Media with Graph Structured Adversarial Learning
Yang, X., Lyu, Y., Tian, T., Liu, Y., Liu, Y., & Zhang, X. (2020) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2020/197 · Cited by 142
Rumor Detection on Social Media with Event Augmentations
He, Z., Li, C., Zhou, F., & Yang, Y. (2021) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3404835.3463001 · Cited by 116
A Parsimonious Language Model of Social Media Credibility Across Disparate Events
Mitra, T., Wright, G. P., & Gilbert, É. (2017) · ACM Conference on Computer Supported Cooperative Work (CSCW) · doi:10.1145/2998181.2998351 · Cited by 105
The Surprising Performance of Simple Baselines for Misinformation Detection
Pelrine, K., Danovitch, J., & Rabbany, R. (2021) · International World Wide Web Conference (WWW) · doi:10.1145/3442381.3450111 · Cited by 96
Rumor Detection with Field of Linear and Non-Linear Propagation
Lao, A., Shi, C., & Yang, Y. (2021) · International World Wide Web Conference (WWW) · doi:10.1145/3442381.3450016 · Cited by 74
Attention-Residual Network with CNN for Rumor Detection
Chen, Y., Sui, J., Hu, L., & Gong, W. Y. (2019) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3357384.3357950 · Cited by 67
Self-citationDeepCU: Integrating both Common and Unique Latent Information for Multimodal Sentiment Analysis
Verma, S., Wang, C., Zhu, L., & Liu, W. (2019) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2019/503 · Cited by 55
A State-independent and Time-evolving Network for Early Rumor Detection in Social Media
Xia, R., Xuan, K., & Yu, J. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.727 · Cited by 49
Trends and Applications in Knowledge Discovery and Data Mining
Long, C., Shi, J., Yuxuan, L., Huang, X., Choi, B., Song, Y., & Yiu, M. L. (2013) · Lecture notes in computer science · doi:10.1007/978-981-92-2014-4 · Cited by 13
$$T^3N$$: Harnessing Text and Temporal Tree Network for Rumor Detection on Twitter
Pinnaparaju, N., Gupta, M., & Varma, V. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-75762-5_54 · Cited by 3
Metadata
- Authors
- Chen, Y., Li, D., Zhang, P., Sui, J., Lv, Q., Tun, L., & Shang, L.
- Venue
- Proceedings of the ACM Web Conference 2022
- Publisher
- ACM
- Published
- 2022-04-25
- Pages
- 2897-2905
- OpenAlex
- W4224324956
- Cited by
- 370
- References
- 32
- FWCI
- 219.92
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.