The DOI matches its Crossref record; 39 of the 39 references it cites were found in a registry or an index.
Hierarchical Multi-modal Contextual Attention Network for Fake News Detection
Abstract
Nowadays, detecting fake news on social media platforms has become a top priority since the widespread dissemination of fake news may mislead readers and have negative effects. To date, many algorithms have been proposed to facilitate the detection of fake news from the hand-crafted feature extraction methods to deep learning approaches. However, these methods may suffer from the following limitations: (1) fail to utilize the multi-modal context information and extract high-order complementary information for each news to enhance the detection of fake news; (2) largely ignore the full hierarchical semantics of textual content to assist in learning a better news representation. To overcome these limitations, this paper proposes a novel hierarchical multi-modal contextual attention network (HMCAN) for fake news detection by jointly modeling the multi-modal context information and the hierarchical semantics of text in a unified deep model. Specifically, we employ BERT and ResNet to learn better representations for text and images, respectively. Then, we feed the obtained representations of images and text into a multi-modal contextual attention network to fuse both inter-modality and intra-modality relationships. Finally, we design a hierarchical encoding network to capture the rich hierarchical semantics for fake news detection. Extensive experiments on three public real datasets demonstrate that our proposed HMCAN achieves state-of-the-art performance.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
(2017) · Cited by 11,625
Show, Attend and Tell: Neural Image Caption Generation with Visual Attention
Xu, K., Ba, J., Kiros, R., Cho, K., Courville, A., Salakhutdinov, R., Zemel, R., & Bengio, Y. (2015) · arXiv · doi:10.48550/arxiv.1502.03044 · Cited by 8,248
XLNet: Generalized Autoregressive Pretraining for Language Understanding
Yang, Z., Dai, Z., Yang, Y., Carbonell, J., Salakhutdinov, R., & Le, Q. V. (2019) · arXiv · doi:10.48550/arxiv.1906.08237 · Cited by 6,687
DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter
Sanh, V., Debut, L., Chaumond, J., & Wolf, T. (2019) · arXiv · doi:10.48550/arxiv.1910.01108 · Cited by 4,653
Fake News Detection on Social Media: A Data Mining Perspective
Shu, K., Sliva, A., Wang, S., Tang, J., & Liu, H. (2017) · ACM SIGKDD Explorations Newsletter · doi:10.1145/3137597.3137600 · Cited by 3,304
Information credibility on twitter
Castillo, C., Mendoza, M., & Poblete, B. (2011) · Proceedings of the 20th international conference on World wide web · doi:10.1145/1963405.1963500 · Cited by 2,593
Graph Convolutional Networks for Text Classification
Yao, L., Mao, C., & Luo, Y. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33017370 · Cited by 1,983
How to Fine-Tune BERT for Text Classification?
Sun, C., Qiu, X., Xu, Y., & Huang, X. (2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-32381-3_16 · Cited by 1,534
(2019) · doi:10.18653/v1/p19-1356 · Cited by 1,291
EANN: Event Adversarial Neural Networks for Multi-Modal Fake News Detection
Wang, Y., Ma, F., Jin, Z., Yuan, Y., Xun, G., Jha, K., Su, L., & Gao, J. (2018) · Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3219819.3219903 · Cited by 1,168
Detecting rumors from microblogs with recurrent neural networks
Ma, J., Gao, W. G., Mitra, P., Kwon, S., Jansen, B. J. J., Wong, K., & Cha, M. (2016) · Singapore Management University Institutional Knowledge (InK) (Singapore Management University) · Cited by 1,097
Prominent Features of Rumor Propagation in Online Social Media
Kwon, S., Cha, M., Jung, K., Chen, W., & Wang, Y. (2013) · 2013 IEEE 13th International Conference on Data Mining · doi:10.1109/icdm.2013.61 · Cited by 859
Chen, J., Zhang, H., He, X., Nie, L., Liu, W., & Chua, T.-S. (2017) · Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval · doi:10.1145/3077136.3080797 · Cited by 851
Multimodal Fusion with Recurrent Neural Networks for Rumor Detection on Microblogs
Jin, Z., Cao, J., Guo, H., Zhang, Y., & Luo, J. (2017) · Proceedings of the 25th ACM international conference on Multimedia · doi:10.1145/3123266.3123454 · Cited by 812
MVAE: Multimodal Variational Autoencoder for Fake News Detection
Khattar, D., Goud, J. S., Gupta, M., & Varma, V. (2019) · The World Wide Web Conference · doi:10.1145/3308558.3313552 · Cited by 799
Detect Rumors Using Time Series of Social Context Information on Microblogging Websites
Ma, J., Gao, W., Wei, Z., Lu, Y., & Wong, K.-F. (2015) · Proceedings of the 24th ACM International on Conference on Information and Knowledge Management · doi:10.1145/2806416.2806607 · Cited by 640
Revealing the Dark Secrets of BERT
Kovaleva, O., Romanov, A., Rogers, A., & Rumshisky, A. (2019) · Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · doi:10.18653/v1/d19-1445 · Cited by 495
A Convolutional Approach for Misinformation Identification
Yu, F., Liu, Q., Wu, S., Wang, L., & Tan, T. (2017) · Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2017/545 · Cited by 494
Real-time Rumor Debunking on Twitter
Liu, X., Nourbakhsh, A., Li, Q., Fang, R., & Shah, S. (2015) · Proceedings of the 24th ACM International on Conference on Information and Knowledge Management · doi:10.1145/2806416.2806651 · Cited by 391 · cited 2×
“Basically, existing studies on automatic fake news detection can be summarized into two categories: (1) The first one is traditional learning methods [2, 16, 18, 20], which design plenty of hand-crafted features from the media content of posts and the Session 1D: Social Aspects SIGIR ’21, July 11–15, 2021, Virtual Eve…”
BackgroundMethodTweetCred: Real-Time Credibility Assessment of Content on Twitter
Gupta, A., Kumaraguru, P., Castillo, C., & Meier, P. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-13734-6_16 · Cited by 371
Call Attention to Rumors: Deep Attention Based Recurrent Neural Networks for Early Rumor Detection
Chen, T., Li, X., Yin, H., & Zhang, J. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-04503-6_4 · Cited by 370
Exploiting Context for Rumour Detection in Social Media
Zubiaga, A., Liakata, M., & Procter, R. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-67217-5_8 · Cited by 350 · cited 10×
“We compare the proposed HMCAN with stateof-the-art baselines on three public datasets: WEIBO [12], TWITTER [12, 13], and PHEME [42].”
MethodInfluentialDetect Rumors on Twitter by Promoting Information Campaigns with Generative Adversarial Learning
Ma, J., Gao, W., & Wong, K.-F. (2019) · The World Wide Web Conference · doi:10.1145/3308558.3313741 · Cited by 235
SpotFake+: A Multimodal Framework for Fake News Detection via Transfer Learning (Student Abstract)
Singhal, S., Kabra, A., Sharma, M., Shah, R. R., Chakraborty, T., & Kumaraguru, P. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i10.7230 · Cited by 226
Attention-Based Transactional Context Embedding for Next-Item Recommendation
Wang, S., Hu, L., Cao, L., Huang, X., Lian, D., & Liu, W. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11851 · Cited by 215
SAME: sentiment-aware multi-modal embedding for detecting fake news
Cui, L., Wang, S., & Lee, D. (2019) · IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining (ASONAM) · doi:10.1145/3341161.3342894 · Cited by 180
Fake News Detection via Knowledge-driven Multimodal Graph Convolutional Networks
Wang, Y., Qian, S., Hu, J., Fang, Q., & Xu, C. (2020) · Proceedings of the 2020 International Conference on Multimedia Retrieval · doi:10.1145/3372278.3390713 · Cited by 180
Self-citationMulti-Modal Event Topic Model for Social Event Analysis
Qian, S., Zhang, T., Xu, C., & Shao, J. (2015) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2015.2510329 · Cited by 159
Self-citationSong, Y., Wang, J., Liang, Z., Liu, Z., & Jiang, T. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.04815 · Cited by 107
Self-citationSAFE: Similarity-Aware Multi-Modal Fake News DetectionPreprint
Zhou, X., Wu, J., & Zafarani, R. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.04981 · Cited by 93
How to Fine-Tune BERT for Text Classification?Preprint
Sun, C. C., Qiu, X., Xu, Y., & Huang, X. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.05583 · Cited by 89
Multi-modal Multi-view Topic-opinion Mining for Social Event Analysis
Qian, S., Zhang, T., & Xu, C. (2016) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/2964284.2964294 · Cited by 62
Self-citationMultimodal News Story Clustering With Pairwise Visual Near-Duplicate Constraint
Wu, X. Y., Ngo, C., & Hauptmann, A. G. (2008) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2007.911778 · Cited by 61
Efficient Graph Deep Learning in TensorFlow with tf_geometric
Hu, J., Qian, S., Fang, Q., Wang, Y., Zhao, Q., Zhang, H., & Xu, C. (2021) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3474085.3478322 · Cited by 53
Self-citation
Metadata
- Authors
- Qian, S., Wang, J., Hu, J., Fang, Q., & Xu, C.
- Venue
- Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval
- Publisher
- ACM
- Published
- 2021-07-11
- Pages
- 153-162
- OpenAlex
- W3156558703
- Cited by
- 276
- References
- 39
- FWCI
- 100.98
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.